2023-11-29T10:59:56.580 INFO:root:teuthology version: 0.0.1.dev212+g735a43c 2023-11-29T10:59:56.581 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607 --verbose --name neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi -- /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/orig.config.yaml 2023-11-29T10:59:56.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:59:56.714 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607 branch: wip-neesingh-testing-231123 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7470607' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-neesingh-testing-231123 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: issue_54557 sha1: 7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b owner: scheduled_neesingh@teuthology priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1315 sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 sleep_before_teardown: 0 suite: fs suite_branch: issue_54557 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 735a43c3d8e74286f980f1d14817fb093cd8147e timestamp: 2023-11-29_10:52:27 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-29T10:59:56.714 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa; will attempt to use it 2023-11-29T10:59:56.715 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks 2023-11-29T10:59:56.715 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-29T10:59:56.717 INFO:teuthology.task.internal:Checking packages... 2023-11-29T10:59:56.740 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2f5f6028b893ad41357cd06e827373f0fe2a1232' 2023-11-29T10:59:56.740 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-29T10:59:56.740 INFO:teuthology.packaging:ref: None 2023-11-29T10:59:56.740 INFO:teuthology.packaging:tag: None 2023-11-29T10:59:56.740 INFO:teuthology.packaging:branch: wip-neesingh-testing-231123 2023-11-29T10:59:56.740 INFO:teuthology.packaging:sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-29T10:59:56.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-neesingh-testing-231123 2023-11-29T10:59:56.959 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2697-g2f5f6028-1focal 2023-11-29T10:59:56.959 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-29T10:59:56.966 INFO:teuthology.task.internal:no buildpackages task found 2023-11-29T10:59:56.966 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-29T10:59:56.975 INFO:teuthology.task.internal:Saving configuration 2023-11-29T10:59:56.990 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-29T10:59:56.996 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T10:59:57.022 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 10:54:01.310442', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-29T10:59:57.044 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 10:54:01.312326', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-29T10:59:57.044 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-29T10:59:57.049 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-29T10:59:57.049 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-29T10:59:57.049 INFO:teuthology.run_tasks:Running task console_log... 2023-11-29T10:59:57.123 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3f23748160>, signals=[15]) 2023-11-29T10:59:57.124 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-29T10:59:57.133 INFO:teuthology.task.internal:Opening connections... 2023-11-29T10:59:57.134 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T10:59:57.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T10:59:57.187 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T10:59:57.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T10:59:57.236 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-29T10:59:57.243 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-11-29T10:59:57.271 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-11-29T10:59:57.271 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-11-29T10:59:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2023-11-29T10:59:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="20.04" 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=focal 2023-11-29T10:59:57.319 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=focal 2023-11-29T10:59:57.320 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-11-29T10:59:57.339 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2023-11-29T10:59:57.346 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2023-11-29T10:59:57.346 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-11-29T10:59:57.352 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu" 2023-11-29T10:59:57.352 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-29T10:59:57.352 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu 2023-11-29T10:59:57.352 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian 2023-11-29T10:59:57.352 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-29T10:59:57.352 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="20.04" 2023-11-29T10:59:57.352 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T10:59:57.353 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T10:59:57.353 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T10:59:57.353 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T10:59:57.353 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=focal 2023-11-29T10:59:57.353 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=focal 2023-11-29T10:59:57.353 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-11-29T10:59:57.372 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-29T10:59:57.384 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-29T10:59:57.390 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-29T10:59:57.390 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-11-29T10:59:57.392 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2023-11-29T10:59:57.401 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-29T10:59:57.406 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-29T10:59:57.406 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-11-29T10:59:57.438 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2023-11-29T10:59:57.464 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-29T10:59:57.518 INFO:teuthology.run_tasks:Running task kernel... 2023-11-29T10:59:57.532 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-29T10:59:57.532 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-29T10:59:57.533 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-29T10:59:57.533 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-29T10:59:57.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T10:59:57.539 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-11-29T10:59:57.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T10:59:57.540 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2023-11-29T10:59:57.546 INFO:teuthology.orchestra.run.smithi081.stdout:5.4.0-124-generic 2023-11-29T10:59:57.546 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.4.0-124-generic 2023-11-29T10:59:57.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2023-11-29T10:59:57.590 INFO:teuthology.orchestra.run.smithi176.stdout:5.4.0-124-generic 2023-11-29T10:59:57.590 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.4.0-124-generic 2023-11-29T10:59:57.590 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get clean 2023-11-29T10:59:57.681 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2023-11-29T10:59:57.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-11-29T10:59:57.828 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-29T10:59:57.832 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-29T10:59:57.832 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-29T10:59:57.851 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-29T10:59:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-29T10:59:57.896 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-29T10:59:57.917 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-29T10:59:57.960 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-29T10:59:58.195 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [679 kB] 2023-11-29T10:59:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,981 kB] 2023-11-29T10:59:58.275 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,593 kB] 2023-11-29T10:59:58.318 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [401 kB] 2023-11-29T10:59:58.321 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-29T10:59:58.327 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,981 kB] 2023-11-29T10:59:58.331 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-29T10:59:58.332 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,398 kB] 2023-11-29T10:59:58.353 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [335 kB] 2023-11-29T10:59:58.356 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-29T10:59:58.356 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [623 kB] 2023-11-29T10:59:58.361 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [901 kB] 2023-11-29T10:59:58.367 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [189 kB] 2023-11-29T10:59:58.369 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-29T10:59:58.369 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-29T10:59:58.369 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-29T10:59:58.369 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-29T10:59:58.370 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-29T10:59:58.408 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [912 kB] 2023-11-29T10:59:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-11-29T10:59:58.422 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [912 kB] 2023-11-29T10:59:58.425 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-29T10:59:58.426 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,516 kB] 2023-11-29T10:59:58.432 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-11-29T10:59:58.436 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-29T10:59:58.436 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,516 kB] 2023-11-29T10:59:58.445 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-29T10:59:58.445 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [351 kB] 2023-11-29T10:59:58.448 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-29T10:59:58.448 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [757 kB] 2023-11-29T10:59:58.453 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-29T10:59:58.453 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [351 kB] 2023-11-29T10:59:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,134 kB] 2023-11-29T10:59:58.456 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-29T10:59:58.456 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,134 kB] 2023-11-29T10:59:58.462 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [270 kB] 2023-11-29T10:59:58.464 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [757 kB] 2023-11-29T10:59:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-29T10:59:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-29T10:59:58.465 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-29T10:59:58.469 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [270 kB] 2023-11-29T10:59:58.471 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-29T10:59:58.471 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-29T10:59:58.471 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-29T10:59:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-29T10:59:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-29T10:59:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-29T10:59:58.473 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-29T10:59:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-29T10:59:58.484 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-29T10:59:58.484 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-29T10:59:58.484 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-29T10:59:58.484 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-29T10:59:58.485 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-29T10:59:58.489 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-29T10:59:58.490 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-29T10:59:58.490 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-29T10:59:58.500 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-29T10:59:58.500 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-29T10:59:58.501 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-29T10:59:58.592 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,593 kB] 2023-11-29T10:59:59.073 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [679 kB] 2023-11-29T10:59:59.087 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [401 kB] 2023-11-29T10:59:59.096 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-29T10:59:59.096 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,398 kB] 2023-11-29T10:59:59.172 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-29T10:59:59.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [335 kB] 2023-11-29T10:59:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-29T10:59:59.180 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [623 kB] 2023-11-29T10:59:59.193 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [901 kB] 2023-11-29T10:59:59.376 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [189 kB] 2023-11-29T10:59:59.805 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-29T10:59:59.810 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-29T10:59:59.813 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-29T10:59:59.820 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-29T10:59:59.822 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-29T11:00:02.113 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 18.2 MB in 3s (7,198 kB/s) 2023-11-29T11:00:02.337 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 18.2 MB in 3s (6,879 kB/s) 2023-11-29T11:00:03.552 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-29T11:00:03.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-29T11:00:03.657 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-29T11:00:03.728 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-29T11:00:03.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-29T11:00:03.834 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-29T11:00:03.841 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2023-11-29T11:00:03.842 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2023-11-29T11:00:04.014 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2023-11-29T11:00:04.014 INFO:teuthology.orchestra.run.smithi176.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-29T11:00:04.014 INFO:teuthology.orchestra.run.smithi176.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-11-29T11:00:04.014 INFO:teuthology.orchestra.run.smithi176.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-11-29T11:00:04.015 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2023-11-29T11:00:04.015 INFO:teuthology.orchestra.run.smithi176.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-29T11:00:04.015 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2023-11-29T11:00:04.016 INFO:teuthology.orchestra.run.smithi176.stdout: thermald 2023-11-29T11:00:04.016 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-11-29T11:00:04.016 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-11-29T11:00:04.070 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2023-11-29T11:00:04.070 INFO:teuthology.orchestra.run.smithi176.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-29T11:00:04.070 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-11-29T11:00:04.070 INFO:teuthology.orchestra.run.smithi176.stdout: linux-modules-extra-5.4.0-167-generic 2023-11-29T11:00:04.071 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2023-11-29T11:00:04.072 INFO:teuthology.orchestra.run.smithi176.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-29T11:00:04.191 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-11-29T11:00:04.191 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-29T11:00:04.191 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-11-29T11:00:04.192 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-11-29T11:00:04.193 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-11-29T11:00:04.193 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-29T11:00:04.193 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2023-11-29T11:00:04.193 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2023-11-29T11:00:04.251 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-11-29T11:00:04.251 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-29T11:00:04.251 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-11-29T11:00:04.251 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.4.0-167-generic 2023-11-29T11:00:04.253 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2023-11-29T11:00:04.253 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-29T11:00:09.158 INFO:teuthology.orchestra.run.smithi176.stdout:3 upgraded, 5 newly installed, 0 to remove and 280 not upgraded. 2023-11-29T11:00:09.158 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 77.0 MB of archives. 2023-11-29T11:00:09.158 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-29T11:00:09.158 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-11-29T11:00:09.589 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-11-29T11:00:09.720 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-11-29T11:00:10.330 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 280 not upgraded. 2023-11-29T11:00:10.331 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 77.0 MB of archives. 2023-11-29T11:00:10.331 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-29T11:00:10.331 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-11-29T11:00:10.398 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-11-29T11:00:10.398 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-11-29T11:00:10.398 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-11-29T11:00:10.587 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-11-29T11:00:10.612 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-11-29T11:00:10.668 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-11-29T11:00:10.760 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-11-29T11:00:11.225 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-11-29T11:00:11.225 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-11-29T11:00:11.225 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-11-29T11:00:11.307 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 77.0 MB in 7s (11.8 MB/s) 2023-11-29T11:00:11.320 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-11-29T11:00:11.330 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-11-29T11:00:11.492 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-11-29T11:00:11.997 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 77.0 MB in 7s (10.9 MB/s) 2023-11-29T11:00:12.174 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-11-29T11:00:13.241 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-29T11:00:13.246 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-29T11:00:13.355 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:13.949 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-29T11:00:13.955 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-29T11:00:14.038 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:15.155 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-11-29T11:00:15.171 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-29T11:00:15.270 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:15.981 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-11-29T11:00:15.994 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-29T11:00:16.094 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:16.308 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-11-29T11:00:16.323 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-29T11:00:16.366 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:17.176 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-11-29T11:00:17.188 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-29T11:00:17.217 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:21.418 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-11-29T11:00:21.544 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-29T11:00:21.864 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-11-29T11:00:21.878 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-11-29T11:00:21.990 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-29T11:00:22.022 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-29T11:00:22.345 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-11-29T11:00:22.358 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-11-29T11:00:22.373 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-11-29T11:00:22.416 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-29T11:00:22.477 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-29T11:00:22.805 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-11-29T11:00:22.818 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-11-29T11:00:22.863 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-29T11:00:27.739 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-11-29T11:00:27.762 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-29T11:00:27.806 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-11-29T11:00:28.576 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-29T11:00:28.613 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:30.391 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-11-29T11:00:30.503 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-29T11:00:31.232 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:33.042 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-29T11:00:33.097 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-11-29T11:00:33.168 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:33.219 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-29T11:00:33.294 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:33.558 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:34.479 INFO:teuthology.orchestra.run.smithi176.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-11-29T11:00:34.479 INFO:teuthology.orchestra.run.smithi176.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-11-29T11:00:34.612 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:34.800 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-29T11:00:34.926 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:35.052 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:35.781 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-11-29T11:00:35.907 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-11-29T11:00:36.066 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-11-29T11:00:36.193 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:36.234 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-11-29T11:00:36.234 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-11-29T11:00:36.269 INFO:teuthology.orchestra.run.smithi176.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-29T11:00:36.269 INFO:teuthology.orchestra.run.smithi176.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-11-29T11:00:36.379 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:37.748 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-11-29T11:00:37.874 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-11-29T11:00:38.000 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-11-29T11:00:38.135 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-29T11:00:38.205 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-29T11:00:38.205 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-11-29T11:00:57.942 INFO:teuthology.orchestra.run.smithi176.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-29T11:00:57.943 INFO:teuthology.orchestra.run.smithi176.stdout:Sourcing file `/etc/default/grub' 2023-11-29T11:00:57.955 INFO:teuthology.orchestra.run.smithi176.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-29T11:00:57.984 INFO:teuthology.orchestra.run.smithi176.stdout:Generating grub configuration file ... 2023-11-29T11:00:58.285 INFO:teuthology.orchestra.run.smithi176.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-29T11:00:58.305 INFO:teuthology.orchestra.run.smithi176.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-29T11:00:58.724 INFO:teuthology.orchestra.run.smithi176.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-29T11:00:58.736 INFO:teuthology.orchestra.run.smithi176.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-29T11:01:00.229 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-29T11:01:00.229 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2023-11-29T11:01:00.258 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-29T11:01:00.267 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2023-11-29T11:01:00.642 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-29T11:01:00.672 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-29T11:01:00.822 INFO:teuthology.orchestra.run.smithi176.stdout:done 2023-11-29T11:01:01.080 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-29T11:01:01.100 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-29T11:01:01.229 DEBUG:teuthology.orchestra.run.smithi176:> dpkg -s linux-image-generic 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Package: linux-image-generic 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Status: install ok installed 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Priority: optional 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Section: kernel 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Installed-Size: 20 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Maintainer: Ubuntu Kernel Team 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: amd64 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Source: linux-meta 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Version: 5.4.0.167.164 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-29T11:01:01.275 INFO:teuthology.orchestra.run.smithi176.stdout:Recommends: thermald 2023-11-29T11:01:01.276 INFO:teuthology.orchestra.run.smithi176.stdout:Description: Generic Linux kernel image 2023-11-29T11:01:01.276 INFO:teuthology.orchestra.run.smithi176.stdout: This package will always depend on the latest generic kernel image 2023-11-29T11:01:01.276 INFO:teuthology.orchestra.run.smithi176.stdout: available. 2023-11-29T11:01:01.276 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-11-29T11:01:01.276 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-29T11:01:01.276 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-29T11:01:01.276 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-29T11:01:01.276 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=None, version=distro) 2023-11-29T11:01:01.276 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get clean 2023-11-29T11:01:01.346 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2023-11-29T11:01:01.584 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-29T11:01:01.621 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-29T11:01:01.672 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-29T11:01:01.689 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-29T11:01:03.256 INFO:teuthology.orchestra.run.smithi081.stdout:done 2023-11-29T11:01:03.314 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-29T11:01:03.341 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-29T11:01:03.412 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-29T11:01:03.616 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2023-11-29T11:01:03.616 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2023-11-29T11:01:03.718 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2023-11-29T11:01:03.763 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2023-11-29T11:01:03.763 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2023-11-29T11:01:03.763 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2023-11-29T11:01:03.763 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2023-11-29T11:01:03.763 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 20 2023-11-29T11:01:03.763 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.4.0.167.164 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2023-11-29T11:01:03.764 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2023-11-29T11:01:03.764 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-11-29T11:01:03.764 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-29T11:01:03.764 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-29T11:01:03.764 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-29T11:01:03.764 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2023-11-29T11:01:03.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2023-11-29T11:01:03.840 INFO:teuthology.orchestra.run.smithi176.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-11-29T11:01:03.840 INFO:teuthology.orchestra.run.smithi176.stdout:0 upgraded, 0 newly installed, 0 to remove and 280 not upgraded. 2023-11-29T11:01:03.842 DEBUG:teuthology.orchestra.run.smithi176:> dpkg -s linux-image-generic 2023-11-29T11:01:03.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Package: linux-image-generic 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Status: install ok installed 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Priority: optional 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Section: kernel 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Installed-Size: 20 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Maintainer: Ubuntu Kernel Team 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: amd64 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Source: linux-meta 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Version: 5.4.0.167.164 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-29T11:01:03.861 INFO:teuthology.orchestra.run.smithi176.stdout:Recommends: thermald 2023-11-29T11:01:03.862 INFO:teuthology.orchestra.run.smithi176.stdout:Description: Generic Linux kernel image 2023-11-29T11:01:03.862 INFO:teuthology.orchestra.run.smithi176.stdout: This package will always depend on the latest generic kernel image 2023-11-29T11:01:03.862 INFO:teuthology.orchestra.run.smithi176.stdout: available. 2023-11-29T11:01:03.863 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2023-11-29T11:01:03.869 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.xY8UrqDpD8 2023-11-29T11:01:03.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub/grub.cfg /tmp/tmp.xY8UrqDpD8 2023-11-29T11:01:03.878 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.xY8UrqDpD8 2023-11-29T11:01:03.956 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.xY8UrqDpD8 is 9KB 2023-11-29T11:01:03.970 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.xY8UrqDpD8 2023-11-29T11:01:03.977 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-29T11:01:04.034 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:01:04.034 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-29T11:01:04.034 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-29T11:01:04.049 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-29T11:01:04.063 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-11-29T11:01:04.063 DEBUG:teuthology.orchestra.run.smithi176:> sudo update-grub 2023-11-29T11:01:04.087 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-29T11:01:04.109 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-29T11:01:04.134 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-29T11:01:05.314 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2023-11-29T11:01:05.325 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-29T11:01:05.341 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2023-11-29T11:01:05.571 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-29T11:01:05.583 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-29T11:01:05.821 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-29T11:01:05.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-29T11:01:05.914 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-29T11:01:05.932 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-29T11:01:05.944 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-29T11:01:06.117 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-11-29T11:01:06.118 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-11-29T11:01:06.333 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-11-29T11:01:06.333 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 280 not upgraded. 2023-11-29T11:01:06.335 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2023-11-29T11:01:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2023-11-29T11:01:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2023-11-29T11:01:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2023-11-29T11:01:06.356 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 20 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.4.0.167.164 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2023-11-29T11:01:06.357 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2023-11-29T11:01:06.358 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-11-29T11:01:06.362 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.vDMhnfk3NQ 2023-11-29T11:01:06.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vDMhnfk3NQ 2023-11-29T11:01:06.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.vDMhnfk3NQ 2023-11-29T11:01:06.459 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.vDMhnfk3NQ is 9KB 2023-11-29T11:01:06.473 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.vDMhnfk3NQ 2023-11-29T11:01:06.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-29T11:01:06.535 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:01:06.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-29T11:01:06.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-29T11:01:06.567 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-11-29T11:01:06.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2023-11-29T11:01:06.970 INFO:teuthology.orchestra.run.smithi176.stderr:done 2023-11-29T11:01:06.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2023-11-29T11:01:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2023-11-29T11:01:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-29T11:01:07.710 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2023-11-29T11:01:08.028 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-29T11:01:08.039 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-29T11:01:08.442 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-29T11:01:08.453 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-29T11:01:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:done 2023-11-29T11:01:09.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2023-11-29T11:01:36.998 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-29T11:01:36.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-29T11:01:36.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:01:39.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-29T11:01:39.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-29T11:01:39.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:01:55.426 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-11-29T11:01:57.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-29T11:02:04.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-29T11:02:04.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:02:06.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-29T11:02:06.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:02:07.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-11-29T11:02:10.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-29T11:02:19.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-29T11:02:19.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:02:22.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-29T11:02:22.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:02:37.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-11-29T11:02:52.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-29T11:02:52.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:02:53.139 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-11-29T11:02:53.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-29T11:02:53.678 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-167-generic"... 2023-11-29T11:02:53.678 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2023-11-29T11:02:53.684 INFO:teuthology.orchestra.run.smithi176.stdout:5.4.0-167-generic 2023-11-29T11:02:53.684 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-11-29T11:02:53.684 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-29T11:02:53.685 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-29T11:02:53.741 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-11-29T11:02:54.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-29T11:02:54.309 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-167-generic"... 2023-11-29T11:02:54.309 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-11-29T11:02:54.316 INFO:teuthology.orchestra.run.smithi081.stdout:5.4.0-167-generic 2023-11-29T11:02:54.316 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-11-29T11:02:54.316 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-29T11:02:54.316 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-29T11:02:54.686 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-29T11:02:54.686 DEBUG:teuthology.orchestra.run.smithi176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-29T11:02:54.787 INFO:teuthology.orchestra.run.smithi176.stdout:ttyS1 2023-11-29T11:02:54.812 DEBUG:teuthology.parallel:result is None 2023-11-29T11:02:55.316 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-29T11:02:55.317 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-29T11:02:55.410 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2023-11-29T11:02:55.436 DEBUG:teuthology.parallel:result is None 2023-11-29T11:02:55.436 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-29T11:02:55.443 INFO:teuthology.task.internal:Creating test directory... 2023-11-29T11:02:55.443 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-29T11:02:55.446 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-29T11:02:55.452 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-29T11:02:55.458 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-29T11:02:55.510 INFO:teuthology.task.internal:Creating archive directory... 2023-11-29T11:02:55.510 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-29T11:02:55.512 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-29T11:02:55.532 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-29T11:02:55.538 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-29T11:02:55.538 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-29T11:02:55.541 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-29T11:02:55.556 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-29T11:02:55.559 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-29T11:02:55.567 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-29T11:02:55.569 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-29T11:02:55.571 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-29T11:02:55.577 INFO:teuthology.task.internal:Configuring sudo... 2023-11-29T11:02:55.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-29T11:02:55.580 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-29T11:02:55.628 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-29T11:02:55.637 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-29T11:02:55.637 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-29T11:02:55.639 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-29T11:02:55.645 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-29T11:02:55.651 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-29T11:02:55.658 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:02:55.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-29T11:02:55.677 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-29T11:02:55.684 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-29T11:02:55.732 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:02:55.733 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-29T11:02:55.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-11-29T11:02:55.754 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2023-11-29T11:02:55.802 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-29T11:02:55.810 INFO:teuthology.task.internal:Starting timer... 2023-11-29T11:02:55.810 INFO:teuthology.run_tasks:Running task pcp... 2023-11-29T11:02:55.820 INFO:teuthology.run_tasks:Running task selinux... 2023-11-29T11:02:55.828 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2023-11-29T11:02:55.828 DEBUG:teuthology.task.selinux:Excluding smithi176: OS 'ubuntu' does not support SELinux 2023-11-29T11:02:55.828 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-29T11:02:55.828 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-29T11:02:55.829 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-29T11:02:55.829 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-29T11:02:55.837 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-29T11:02:55.837 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-29T11:02:55.853 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-29T11:02:55.854 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-29T11:08:41.770 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2023-11-29T11:08:41.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-29T11:08:41.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:08:41.824 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-11-29T11:08:41.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-29T11:08:41.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-29T11:08:41.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T11:08:42.001 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-11-29T11:08:42.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-29T11:08:42.120 INFO:teuthology.run_tasks:Running task clock... 2023-11-29T11:08:42.133 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-29T11:08:42.134 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-29T11:08:42.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T11:08:42.136 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-29T11:08:42.136 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T11:08:42.167 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-29T11:08:42.167 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: Command line: ntpd -gq 2023-11-29T11:08:42.169 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: proto: precision = 0.116 usec (-23) 2023-11-29T11:08:42.169 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-29T11:08:42.169 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-29T11:08:42.170 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-29T11:08:42.171 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: restrict ::: KOD does nothing without LIMITED. 2023-11-29T11:08:42.171 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: Listen and drop on 0 v6wildcard [::]:123 2023-11-29T11:08:42.171 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-29T11:08:42.171 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: Listen normally on 2 lo 127.0.0.1:123 2023-11-29T11:08:42.171 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2023-11-29T11:08:42.171 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: Listen normally on 4 lo [::1]:123 2023-11-29T11:08:42.171 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2023-11-29T11:08:42.171 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:42 ntpd[23589]: Listening on routing socket on fd #22 for interface updates 2023-11-29T11:08:42.172 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-29T11:08:42.172 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: Command line: ntpd -gq 2023-11-29T11:08:42.172 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: proto: precision = 0.149 usec (-23) 2023-11-29T11:08:42.172 INFO:teuthology.orchestra.run.smithi176.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-29T11:08:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-29T11:08:42.173 INFO:teuthology.orchestra.run.smithi176.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-29T11:08:42.174 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: restrict ::: KOD does nothing without LIMITED. 2023-11-29T11:08:42.174 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: Listen and drop on 0 v6wildcard [::]:123 2023-11-29T11:08:42.174 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-29T11:08:42.174 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: Listen normally on 2 lo 127.0.0.1:123 2023-11-29T11:08:42.174 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: Listen normally on 3 enp3s0f1 172.21.15.176:123 2023-11-29T11:08:42.174 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: Listen normally on 4 lo [::1]:123 2023-11-29T11:08:42.174 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f61%5]:123 2023-11-29T11:08:42.175 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:42 ntpd[23622]: Listening on routing socket on fd #22 for interface updates 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:43 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:43.170 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:43 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:43.170 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:43 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:43.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:43 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:43.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:43 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:43.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:43 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:43.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:43 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:44.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:44 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:44.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:44 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:44.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:44 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:44.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:44 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:44 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:44 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:44 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:44.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:44 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:44.170 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:44 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:44.170 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:44 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:44.170 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:44 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:44.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:44 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:44.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:44 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:44.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:44 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:45 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:45.170 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:45 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:45.170 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:45 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:45.170 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:45 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:45.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:45 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:45.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:45 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:45.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:45 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:46 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:46 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:46 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:46 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:46 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:46 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:46.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:46.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:46.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:46.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:46.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:46.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:46 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:47.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:47 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:47.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:47 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:47.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:47 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:47.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:47 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:47.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:47 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:47.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:47 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:47.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:47 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:48 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:48 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:48 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:48 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:48 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:48 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:48.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:48.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:48.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:48.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:48.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:48.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:48.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:48.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:48.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:48.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:48.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:48.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:48 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:49.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:49.168 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:49.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:49.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:49.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:49.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:49.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:49.169 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:49.169 INFO:teuthology.orchestra.run.smithi081.stdout:29 Nov 11:08:49 ntpd[23589]: ntpd: time slew +0.004109 s 2023-11-29T11:08:49.169 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew +0.004109s 2023-11-29T11:08:49.170 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-29T11:08:49.170 INFO:teuthology.orchestra.run.smithi081.stderr:29 Nov 11:08:49 ntpd[23589]: can't open /var/log/ntpstats/loopstats.20231129: Permission denied 2023-11-29T11:08:49.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:49 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:49.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:49 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:49.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:49 ntpd[23622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-29T11:08:49.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:49 ntpd[23622]: can't open /var/log/ntpstats/rawstats.20231129: Permission denied 2023-11-29T11:08:49.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:49 ntpd[23622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-29T11:08:49.171 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:49 ntpd[23622]: can't open /var/log/ntpstats/peerstats.20231129: Permission denied 2023-11-29T11:08:49.171 INFO:teuthology.orchestra.run.smithi176.stdout:29 Nov 11:08:49 ntpd[23622]: ntpd: time slew +0.002060 s 2023-11-29T11:08:49.171 INFO:teuthology.orchestra.run.smithi176.stdout:ntpd: time slew +0.002060s 2023-11-29T11:08:49.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:49 ntpd[23622]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-29T11:08:49.172 INFO:teuthology.orchestra.run.smithi176.stderr:29 Nov 11:08:49 ntpd[23622]: can't open /var/log/ntpstats/loopstats.20231129: Permission denied 2023-11-29T11:08:49.244 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2023-11-29T11:08:49.244 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2023-11-29T11:08:49.244 INFO:teuthology.orchestra.run.smithi176.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-29T11:08:49.244 INFO:teuthology.orchestra.run.smithi176.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-29T11:08:49.244 INFO:teuthology.orchestra.run.smithi176.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-29T11:08:49.244 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-29T11:08:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2023-11-29T11:08:49.248 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2023-11-29T11:08:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-29T11:08:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-29T11:08:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-29T11:08:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-29T11:08:49.249 INFO:teuthology.run_tasks:Running task install... 2023-11-29T11:08:49.258 DEBUG:teuthology.task.install:project ceph 2023-11-29T11:08:49.258 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}} 2023-11-29T11:08:49.258 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'} 2023-11-29T11:08:49.258 INFO:teuthology.task.install:Using flavor: default 2023-11-29T11:08:49.264 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-29T11:08:49.264 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-29T11:08:49.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2023-11-29T11:08:49.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-key list | grep Ceph 2023-11-29T11:08:49.387 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-29T11:08:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-29T11:08:49.444 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-29T11:08:49.444 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2023-11-29T11:08:49.445 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-29T11:08:49.445 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-29T11:08:49.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-29T11:08:49.449 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-29T11:08:49.450 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph.com (release key) 2023-11-29T11:08:49.450 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-29T11:08:49.450 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-29T11:08:49.450 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-29T11:08:49.595 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default/ 2023-11-29T11:08:49.595 INFO:teuthology.task.install.deb:Package version is 18.0.0-2697-g2f5f6028-1focal 2023-11-29T11:08:49.660 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default/ 2023-11-29T11:08:49.660 INFO:teuthology.task.install.deb:Package version is 18.0.0-2697-g2f5f6028-1focal 2023-11-29T11:08:49.714 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:08:49.714 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-29T11:08:49.731 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2023-11-29T11:08:49.835 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:08:49.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-29T11:08:49.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-11-29T11:08:49.897 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-29T11:08:49.897 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-29T11:08:49.902 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-29T11:08:49.919 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-29T11:08:49.935 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal InRelease 2023-11-29T11:08:49.995 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-29T11:08:50.001 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-29T11:08:50.006 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-29T11:08:50.017 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-29T11:08:50.018 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-29T11:08:50.040 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release.gpg 2023-11-29T11:08:50.064 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main i386 Packages [3,418 B] 2023-11-29T11:08:50.115 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-29T11:08:50.116 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal InRelease 2023-11-29T11:08:50.152 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-29T11:08:50.190 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release.gpg 2023-11-29T11:08:50.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main i386 Packages [3,418 B] 2023-11-29T11:08:50.273 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-29T11:08:50.557 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 28.4 kB in 1s (42.4 kB/s) 2023-11-29T11:08:50.640 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.4 kB in 1s (45.7 kB/s) 2023-11-29T11:08:51.620 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-29T11:08:51.646 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2697-g2f5f6028-1focal cephadm=18.0.0-2697-g2f5f6028-1focal ceph-mds=18.0.0-2697-g2f5f6028-1focal ceph-mgr=18.0.0-2697-g2f5f6028-1focal ceph-common=18.0.0-2697-g2f5f6028-1focal ceph-fuse=18.0.0-2697-g2f5f6028-1focal ceph-test=18.0.0-2697-g2f5f6028-1focal ceph-volume=18.0.0-2697-g2f5f6028-1focal radosgw=18.0.0-2697-g2f5f6028-1focal python3-rados=18.0.0-2697-g2f5f6028-1focal python3-rgw=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal python3-rbd=18.0.0-2697-g2f5f6028-1focal libcephfs2=18.0.0-2697-g2f5f6028-1focal libcephfs-dev=18.0.0-2697-g2f5f6028-1focal librados2=18.0.0-2697-g2f5f6028-1focal librbd1=18.0.0-2697-g2f5f6028-1focal rbd-fuse=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal cephfs-shell=18.0.0-2697-g2f5f6028-1focal cephfs-top=18.0.0-2697-g2f5f6028-1focal cephfs-mirror=18.0.0-2697-g2f5f6028-1focal 2023-11-29T11:08:51.697 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-29T11:08:51.719 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-29T11:08:51.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2697-g2f5f6028-1focal cephadm=18.0.0-2697-g2f5f6028-1focal ceph-mds=18.0.0-2697-g2f5f6028-1focal ceph-mgr=18.0.0-2697-g2f5f6028-1focal ceph-common=18.0.0-2697-g2f5f6028-1focal ceph-fuse=18.0.0-2697-g2f5f6028-1focal ceph-test=18.0.0-2697-g2f5f6028-1focal ceph-volume=18.0.0-2697-g2f5f6028-1focal radosgw=18.0.0-2697-g2f5f6028-1focal python3-rados=18.0.0-2697-g2f5f6028-1focal python3-rgw=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal python3-rbd=18.0.0-2697-g2f5f6028-1focal libcephfs2=18.0.0-2697-g2f5f6028-1focal libcephfs-dev=18.0.0-2697-g2f5f6028-1focal librados2=18.0.0-2697-g2f5f6028-1focal librbd1=18.0.0-2697-g2f5f6028-1focal rbd-fuse=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal cephfs-shell=18.0.0-2697-g2f5f6028-1focal cephfs-top=18.0.0-2697-g2f5f6028-1focal cephfs-mirror=18.0.0-2697-g2f5f6028-1focal 2023-11-29T11:08:51.792 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-29T11:08:51.920 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2023-11-29T11:08:51.920 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2023-11-29T11:08:51.970 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-11-29T11:08:51.970 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-11-29T11:08:52.094 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2023-11-29T11:08:52.095 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-29T11:08:52.095 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-29T11:08:52.095 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2023-11-29T11:08:52.095 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-29T11:08:52.095 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-29T11:08:52.095 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-29T11:08:52.095 INFO:teuthology.orchestra.run.smithi176.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-29T11:08:52.095 INFO:teuthology.orchestra.run.smithi176.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-29T11:08:52.096 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-29T11:08:52.096 INFO:teuthology.orchestra.run.smithi176.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-29T11:08:52.097 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-29T11:08:52.098 INFO:teuthology.orchestra.run.smithi176.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-29T11:08:52.098 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2023-11-29T11:08:52.098 INFO:teuthology.orchestra.run.smithi176.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-29T11:08:52.098 INFO:teuthology.orchestra.run.smithi176.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-29T11:08:52.098 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-29T11:08:52.098 INFO:teuthology.orchestra.run.smithi176.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-29T11:08:52.098 INFO:teuthology.orchestra.run.smithi176.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-29T11:08:52.099 INFO:teuthology.orchestra.run.smithi176.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-29T11:08:52.099 INFO:teuthology.orchestra.run.smithi176.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-29T11:08:52.099 INFO:teuthology.orchestra.run.smithi176.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-29T11:08:52.099 INFO:teuthology.orchestra.run.smithi176.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-29T11:08:52.099 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2023-11-29T11:08:52.099 INFO:teuthology.orchestra.run.smithi176.stdout: btrfs-tools 2023-11-29T11:08:52.142 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-11-29T11:08:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-29T11:08:52.144 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-29T11:08:52.144 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-11-29T11:08:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-29T11:08:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-29T11:08:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-29T11:08:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-29T11:08:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-29T11:08:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-29T11:08:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-29T11:08:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-29T11:08:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-29T11:08:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-29T11:08:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-29T11:08:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-29T11:08:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-29T11:08:52.147 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2023-11-29T11:08:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2023-11-29T11:08:52.221 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2023-11-29T11:08:52.222 INFO:teuthology.orchestra.run.smithi176.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-29T11:08:52.222 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-29T11:08:52.222 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-29T11:08:52.222 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-29T11:08:52.222 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-29T11:08:52.222 INFO:teuthology.orchestra.run.smithi176.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-29T11:08:52.222 INFO:teuthology.orchestra.run.smithi176.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-29T11:08:52.223 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-29T11:08:52.224 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-29T11:08:52.225 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-29T11:08:52.225 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-29T11:08:52.225 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-29T11:08:52.225 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-29T11:08:52.225 INFO:teuthology.orchestra.run.smithi176.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-29T11:08:52.225 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2023-11-29T11:08:52.225 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 librbd1 2023-11-29T11:08:52.270 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-11-29T11:08:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-29T11:08:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-29T11:08:52.270 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-29T11:08:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-29T11:08:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-29T11:08:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-29T11:08:52.271 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-29T11:08:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-29T11:08:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-29T11:08:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-29T11:08:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-29T11:08:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-29T11:08:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-29T11:08:52.272 INFO:teuthology.orchestra.run.smithi081.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-29T11:08:52.273 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2023-11-29T11:08:52.274 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 librbd1 2023-11-29T11:08:52.287 INFO:teuthology.orchestra.run.smithi176.stdout:2 upgraded, 116 newly installed, 0 to remove and 259 not upgraded. 2023-11-29T11:08:52.287 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 207 MB of archives. 2023-11-29T11:08:52.287 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-29T11:08:52.287 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-29T11:08:52.306 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-29T11:08:52.313 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-29T11:08:52.338 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-29T11:08:52.340 INFO:teuthology.orchestra.run.smithi081.stdout:2 upgraded, 116 newly installed, 0 to remove and 259 not upgraded. 2023-11-29T11:08:52.340 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 207 MB of archives. 2023-11-29T11:08:52.340 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-29T11:08:52.340 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-29T11:08:52.362 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-29T11:08:52.367 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-29T11:08:52.370 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-29T11:08:52.370 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-29T11:08:52.383 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-29T11:08:52.401 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-29T11:08:52.425 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-29T11:08:52.427 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-29T11:08:52.433 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-29T11:08:52.435 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-29T11:08:52.435 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-29T11:08:52.436 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-29T11:08:52.436 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-29T11:08:52.437 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-29T11:08:52.439 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-29T11:08:52.440 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-29T11:08:52.440 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-29T11:08:52.443 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-29T11:08:52.455 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-29T11:08:52.459 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-29T11:08:52.459 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-29T11:08:52.460 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-29T11:08:52.462 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-29T11:08:52.462 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-29T11:08:52.463 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-29T11:08:52.464 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-29T11:08:52.465 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-29T11:08:52.466 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-29T11:08:52.476 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-29T11:08:52.480 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2697-g2f5f6028-1focal [3,431 kB] 2023-11-29T11:08:52.484 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-29T11:08:52.489 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2697-g2f5f6028-1focal [3,431 kB] 2023-11-29T11:08:52.494 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-29T11:08:52.494 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-29T11:08:52.494 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-29T11:08:52.494 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-29T11:08:52.494 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-29T11:08:52.497 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-29T11:08:52.501 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-29T11:08:52.502 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-29T11:08:52.508 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-29T11:08:52.509 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-29T11:08:52.510 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-29T11:08:52.511 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-29T11:08:52.511 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-29T11:08:52.522 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-29T11:08:52.526 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-29T11:08:52.528 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-29T11:08:52.529 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-29T11:08:52.529 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-29T11:08:52.529 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-29T11:08:52.531 INFO:teuthology.orchestra.run.smithi176.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-29T11:08:52.531 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-29T11:08:52.532 INFO:teuthology.orchestra.run.smithi176.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-29T11:08:52.532 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-29T11:08:52.532 INFO:teuthology.orchestra.run.smithi176.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-29T11:08:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-29T11:08:52.538 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-29T11:08:52.541 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-29T11:08:52.543 INFO:teuthology.orchestra.run.smithi176.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-29T11:08:52.544 INFO:teuthology.orchestra.run.smithi176.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-29T11:08:52.544 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-29T11:08:52.545 INFO:teuthology.orchestra.run.smithi176.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-29T11:08:52.560 INFO:teuthology.orchestra.run.smithi176.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-29T11:08:52.560 INFO:teuthology.orchestra.run.smithi176.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-29T11:08:52.561 INFO:teuthology.orchestra.run.smithi176.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-29T11:08:52.568 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-29T11:08:52.569 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-29T11:08:52.570 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-29T11:08:52.571 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-29T11:08:52.572 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-29T11:08:52.572 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-29T11:08:52.574 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-29T11:08:52.575 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-29T11:08:52.577 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-29T11:08:52.588 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-29T11:08:52.599 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-29T11:08:52.606 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-29T11:08:52.606 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-29T11:08:52.607 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-29T11:08:52.607 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-29T11:08:52.608 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-29T11:08:52.611 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-29T11:08:52.614 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-29T11:08:52.615 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-29T11:08:52.633 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-29T11:08:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-29T11:08:52.635 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-29T11:08:52.636 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-29T11:08:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-29T11:08:52.637 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-29T11:08:52.639 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-29T11:08:52.646 INFO:teuthology.orchestra.run.smithi176.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-29T11:08:52.653 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-29T11:08:52.653 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-29T11:08:52.656 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-29T11:08:52.661 INFO:teuthology.orchestra.run.smithi176.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-29T11:08:52.662 INFO:teuthology.orchestra.run.smithi176.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-29T11:08:52.673 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-29T11:08:52.673 INFO:teuthology.orchestra.run.smithi176.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-29T11:08:52.673 INFO:teuthology.orchestra.run.smithi176.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-29T11:08:52.675 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-29T11:08:52.677 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-29T11:08:52.679 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-29T11:08:52.679 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-29T11:08:52.680 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-29T11:08:52.732 INFO:teuthology.orchestra.run.smithi176.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-29T11:08:52.732 INFO:teuthology.orchestra.run.smithi176.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-29T11:08:52.733 INFO:teuthology.orchestra.run.smithi176.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-29T11:08:52.734 INFO:teuthology.orchestra.run.smithi176.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-29T11:08:52.735 INFO:teuthology.orchestra.run.smithi176.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-29T11:08:52.737 INFO:teuthology.orchestra.run.smithi176.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-29T11:08:52.738 INFO:teuthology.orchestra.run.smithi176.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-29T11:08:52.739 INFO:teuthology.orchestra.run.smithi176.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-29T11:08:52.744 INFO:teuthology.orchestra.run.smithi176.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-29T11:08:52.749 INFO:teuthology.orchestra.run.smithi176.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-29T11:08:52.751 INFO:teuthology.orchestra.run.smithi176.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-29T11:08:52.766 INFO:teuthology.orchestra.run.smithi176.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-29T11:08:52.770 INFO:teuthology.orchestra.run.smithi176.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-29T11:08:52.774 INFO:teuthology.orchestra.run.smithi176.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-29T11:08:52.776 INFO:teuthology.orchestra.run.smithi176.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-29T11:08:52.785 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-29T11:08:52.793 INFO:teuthology.orchestra.run.smithi176.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-29T11:08:52.796 INFO:teuthology.orchestra.run.smithi176.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-29T11:08:52.798 INFO:teuthology.orchestra.run.smithi176.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-29T11:08:52.808 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-29T11:08:52.810 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-29T11:08:52.833 INFO:teuthology.orchestra.run.smithi176.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-29T11:08:52.834 INFO:teuthology.orchestra.run.smithi176.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-29T11:08:52.834 INFO:teuthology.orchestra.run.smithi176.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-29T11:08:52.835 INFO:teuthology.orchestra.run.smithi176.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-29T11:08:52.836 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-29T11:08:52.837 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-29T11:08:52.837 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-29T11:08:52.838 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-29T11:08:52.838 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-29T11:08:52.838 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-29T11:08:52.838 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-29T11:08:52.847 INFO:teuthology.orchestra.run.smithi176.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-29T11:08:52.847 INFO:teuthology.orchestra.run.smithi176.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-29T11:08:52.848 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-29T11:08:52.848 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-29T11:08:52.848 INFO:teuthology.orchestra.run.smithi176.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-29T11:08:52.849 INFO:teuthology.orchestra.run.smithi176.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-29T11:08:52.849 INFO:teuthology.orchestra.run.smithi176.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-29T11:08:52.867 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-29T11:08:52.872 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-29T11:08:52.876 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-29T11:08:52.878 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-29T11:08:52.879 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-29T11:08:52.881 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-29T11:08:52.884 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-29T11:08:52.884 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-29T11:08:52.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2697-g2f5f6028-1focal [3,982 kB] 2023-11-29T11:08:52.912 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-29T11:08:52.918 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-29T11:08:52.931 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-29T11:08:53.037 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-29T11:08:53.038 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-29T11:08:53.038 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-29T11:08:53.039 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-29T11:08:53.055 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-29T11:08:53.055 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2697-g2f5f6028-1focal [721 kB] 2023-11-29T11:08:53.092 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2697-g2f5f6028-1focal [376 kB] 2023-11-29T11:08:53.092 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-29T11:08:53.095 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-29T11:08:53.095 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-29T11:08:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-29T11:08:53.106 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2697-g2f5f6028-1focal [22.4 kB] 2023-11-29T11:08:53.107 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2697-g2f5f6028-1focal [184 kB] 2023-11-29T11:08:53.182 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2697-g2f5f6028-1focal [47.7 kB] 2023-11-29T11:08:53.433 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2697-g2f5f6028-1focal [353 kB] 2023-11-29T11:08:53.585 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2697-g2f5f6028-1focal [6,529 kB] 2023-11-29T11:08:53.877 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2697-g2f5f6028-1focal [103 kB] 2023-11-29T11:08:53.881 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2697-g2f5f6028-1focal [468 kB] 2023-11-29T11:08:54.025 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2697-g2f5f6028-1focal [25.0 MB] 2023-11-29T11:08:54.240 INFO:teuthology.orchestra.run.smithi176.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2697-g2f5f6028-1focal [3,982 kB] 2023-11-29T11:08:56.349 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2697-g2f5f6028-1focal [10.9 MB] 2023-11-29T11:08:56.524 INFO:teuthology.orchestra.run.smithi176.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2697-g2f5f6028-1focal [721 kB] 2023-11-29T11:08:56.666 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2697-g2f5f6028-1focal [221 kB] 2023-11-29T11:08:56.673 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2697-g2f5f6028-1focal [133 kB] 2023-11-29T11:08:56.679 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2697-g2f5f6028-1focal [1,547 kB] 2023-11-29T11:08:56.726 INFO:teuthology.orchestra.run.smithi176.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2697-g2f5f6028-1focal [376 kB] 2023-11-29T11:08:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2697-g2f5f6028-1focal [9,378 kB] 2023-11-29T11:08:56.905 INFO:teuthology.orchestra.run.smithi176.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2697-g2f5f6028-1focal [22.4 kB] 2023-11-29T11:08:56.906 INFO:teuthology.orchestra.run.smithi176.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2697-g2f5f6028-1focal [184 kB] 2023-11-29T11:08:56.922 INFO:teuthology.orchestra.run.smithi176.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2697-g2f5f6028-1focal [47.7 kB] 2023-11-29T11:08:56.924 INFO:teuthology.orchestra.run.smithi176.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2697-g2f5f6028-1focal [353 kB] 2023-11-29T11:08:56.981 INFO:teuthology.orchestra.run.smithi176.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2697-g2f5f6028-1focal [6,529 kB] 2023-11-29T11:08:57.089 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2697-g2f5f6028-1focal [31.3 MB] 2023-11-29T11:08:58.402 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2697-g2f5f6028-1focal [3,812 B] 2023-11-29T11:08:58.403 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2697-g2f5f6028-1focal [831 kB] 2023-11-29T11:08:58.416 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2697-g2f5f6028-1focal [2,284 kB] 2023-11-29T11:08:58.433 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2697-g2f5f6028-1focal [96.8 kB] 2023-11-29T11:08:58.434 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2697-g2f5f6028-1focal [117 kB] 2023-11-29T11:08:58.435 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2697-g2f5f6028-1focal [1,795 kB] 2023-11-29T11:08:58.843 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2697-g2f5f6028-1focal [7,878 kB] 2023-11-29T11:08:59.487 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2697-g2f5f6028-1focal [3,936 B] 2023-11-29T11:08:59.487 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2697-g2f5f6028-1focal [49.9 MB] 2023-11-29T11:09:00.259 INFO:teuthology.orchestra.run.smithi176.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2697-g2f5f6028-1focal [103 kB] 2023-11-29T11:09:00.264 INFO:teuthology.orchestra.run.smithi176.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2697-g2f5f6028-1focal [468 kB] 2023-11-29T11:09:00.417 INFO:teuthology.orchestra.run.smithi176.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2697-g2f5f6028-1focal [25.0 MB] 2023-11-29T11:09:01.561 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2697-g2f5f6028-1focal [225 kB] 2023-11-29T11:09:01.566 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2697-g2f5f6028-1focal [253 kB] 2023-11-29T11:09:01.571 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2697-g2f5f6028-1focal [23.3 kB] 2023-11-29T11:09:01.572 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2697-g2f5f6028-1focal [13.0 kB] 2023-11-29T11:09:01.572 INFO:teuthology.orchestra.run.smithi081.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2697-g2f5f6028-1focal [27.4 kB] 2023-11-29T11:09:01.573 INFO:teuthology.orchestra.run.smithi081.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2697-g2f5f6028-1focal [13.3 MB] 2023-11-29T11:09:01.981 INFO:teuthology.orchestra.run.smithi081.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2697-g2f5f6028-1focal [97.4 kB] 2023-11-29T11:09:02.607 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 207 MB in 10s (21.3 MB/s) 2023-11-29T11:09:02.753 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-29T11:09:02.808 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-11-29T11:09:02.812 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-29T11:09:02.852 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-29T11:09:03.155 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-29T11:09:03.171 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-29T11:09:03.230 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-29T11:09:03.508 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cmd2. 2023-11-29T11:09:03.526 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-29T11:09:03.566 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-29T11:09:03.836 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-29T11:09:03.854 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-29T11:09:03.944 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-29T11:09:04.315 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-29T11:09:04.331 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-29T11:09:04.342 INFO:teuthology.orchestra.run.smithi176.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2697-g2f5f6028-1focal [10.9 MB] 2023-11-29T11:09:04.373 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-29T11:09:04.668 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-29T11:09:04.686 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-29T11:09:04.726 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-29T11:09:05.222 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-29T11:09:05.241 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-29T11:09:05.290 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:09:05.453 INFO:teuthology.orchestra.run.smithi176.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2697-g2f5f6028-1focal [221 kB] 2023-11-29T11:09:05.457 INFO:teuthology.orchestra.run.smithi176.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2697-g2f5f6028-1focal [133 kB] 2023-11-29T11:09:05.489 INFO:teuthology.orchestra.run.smithi176.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2697-g2f5f6028-1focal [1,547 kB] 2023-11-29T11:09:05.639 INFO:teuthology.orchestra.run.smithi176.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2697-g2f5f6028-1focal [9,378 kB] 2023-11-29T11:09:05.758 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-29T11:09:05.777 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-29T11:09:05.808 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:09:06.144 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-29T11:09:06.160 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-29T11:09:06.236 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:09:06.614 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-29T11:09:06.615 INFO:teuthology.orchestra.run.smithi176.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2697-g2f5f6028-1focal [31.3 MB] 2023-11-29T11:09:06.631 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-29T11:09:06.673 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-29T11:09:07.011 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-librbd1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:07.118 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-29T11:09:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-librados2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:07.923 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-29T11:09:08.627 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2023-11-29T11:09:08.643 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:09.015 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2023-11-29T11:09:09.033 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:09.073 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:09.434 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-29T11:09:09.450 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:09.484 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:09.686 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2023-11-29T11:09:09.705 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:09.736 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:09.787 INFO:teuthology.orchestra.run.smithi176.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2697-g2f5f6028-1focal [3,812 B] 2023-11-29T11:09:09.788 INFO:teuthology.orchestra.run.smithi176.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2697-g2f5f6028-1focal [831 kB] 2023-11-29T11:09:09.803 INFO:teuthology.orchestra.run.smithi176.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2697-g2f5f6028-1focal [2,284 kB] 2023-11-29T11:09:09.978 INFO:teuthology.orchestra.run.smithi176.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2697-g2f5f6028-1focal [96.8 kB] 2023-11-29T11:09:09.980 INFO:teuthology.orchestra.run.smithi176.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2697-g2f5f6028-1focal [117 kB] 2023-11-29T11:09:10.004 INFO:teuthology.orchestra.run.smithi176.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2697-g2f5f6028-1focal [1,795 kB] 2023-11-29T11:09:10.139 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-29T11:09:10.154 INFO:teuthology.orchestra.run.smithi176.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2697-g2f5f6028-1focal [7,878 kB] 2023-11-29T11:09:10.158 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:10.333 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:10.676 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2023-11-29T11:09:10.693 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-29T11:09:10.734 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-29T11:09:10.772 INFO:teuthology.orchestra.run.smithi176.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2697-g2f5f6028-1focal [3,936 B] 2023-11-29T11:09:10.773 INFO:teuthology.orchestra.run.smithi176.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2697-g2f5f6028-1focal [49.9 MB] 2023-11-29T11:09:10.986 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2023-11-29T11:09:11.003 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:11.045 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:11.423 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-29T11:09:11.439 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-29T11:09:11.473 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-29T11:09:11.768 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-29T11:09:11.783 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-29T11:09:11.826 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-29T11:09:12.187 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-29T11:09:12.204 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-29T11:09:12.245 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-29T11:09:12.624 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2023-11-29T11:09:12.639 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-librgw2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:12.681 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:13.534 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2023-11-29T11:09:13.551 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:13.592 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:13.903 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0. 2023-11-29T11:09:13.922 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-29T11:09:13.953 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-29T11:09:14.202 INFO:teuthology.orchestra.run.smithi176.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2697-g2f5f6028-1focal [225 kB] 2023-11-29T11:09:14.206 INFO:teuthology.orchestra.run.smithi176.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2697-g2f5f6028-1focal [253 kB] 2023-11-29T11:09:14.211 INFO:teuthology.orchestra.run.smithi176.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2697-g2f5f6028-1focal [23.3 kB] 2023-11-29T11:09:14.212 INFO:teuthology.orchestra.run.smithi176.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2697-g2f5f6028-1focal [13.0 kB] 2023-11-29T11:09:14.213 INFO:teuthology.orchestra.run.smithi176.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2697-g2f5f6028-1focal [27.4 kB] 2023-11-29T11:09:14.214 INFO:teuthology.orchestra.run.smithi176.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2697-g2f5f6028-1focal [13.3 MB] 2023-11-29T11:09:14.273 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2023-11-29T11:09:14.290 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:14.331 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:14.662 INFO:teuthology.orchestra.run.smithi176.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2697-g2f5f6028-1focal [97.4 kB] 2023-11-29T11:09:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2023-11-29T11:09:14.802 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:15.299 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 207 MB in 22s (9,231 kB/s) 2023-11-29T11:09:15.438 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-29T11:09:15.496 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-11-29T11:09:15.501 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-29T11:09:15.540 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-29T11:09:15.801 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-29T11:09:15.817 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-29T11:09:15.851 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-29T11:09:16.121 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cmd2. 2023-11-29T11:09:16.137 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-29T11:09:16.179 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-29T11:09:16.532 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-29T11:09:16.549 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-29T11:09:16.632 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-29T11:09:16.952 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-29T11:09:16.969 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-29T11:09:17.019 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-29T11:09:17.207 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2023-11-29T11:09:17.223 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:17.267 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:17.288 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-29T11:09:17.306 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-29T11:09:17.347 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-29T11:09:17.842 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-29T11:09:17.858 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-29T11:09:17.911 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:09:18.412 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-29T11:09:18.428 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-29T11:09:18.462 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:09:18.602 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-29T11:09:18.618 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-29T11:09:18.660 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-29T11:09:18.790 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-29T11:09:18.806 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-29T11:09:18.848 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:09:18.998 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2023-11-29T11:09:19.014 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-29T11:09:19.056 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-29T11:09:19.242 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-29T11:09:19.262 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-29T11:09:19.301 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-29T11:09:19.392 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2023-11-29T11:09:19.408 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-29T11:09:19.450 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-29T11:09:19.687 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../010-librbd1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:19.728 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-29T11:09:19.744 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-29T11:09:19.778 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-29T11:09:19.796 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librbd1 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-29T11:09:20.048 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2023-11-29T11:09:20.066 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-29T11:09:20.122 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-29T11:09:20.451 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-29T11:09:20.469 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-29T11:09:20.492 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../011-librados2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:20.542 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-29T11:09:20.650 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librados2 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-29T11:09:20.845 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-29T11:09:20.862 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-29T11:09:20.903 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-29T11:09:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2023-11-29T11:09:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-29T11:09:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-29T11:09:21.313 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs2. 2023-11-29T11:09:21.329 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:21.363 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-29T11:09:21.550 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-29T11:09:21.584 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-29T11:09:21.682 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rados. 2023-11-29T11:09:21.702 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:21.740 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:21.853 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bs4. 2023-11-29T11:09:21.873 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-29T11:09:21.911 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-29T11:09:22.085 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-29T11:09:22.101 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:22.143 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:22.315 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2023-11-29T11:09:22.331 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-29T11:09:22.376 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-29T11:09:22.420 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cephfs. 2023-11-29T11:09:22.436 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:22.478 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:22.701 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2023-11-29T11:09:22.718 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-29T11:09:22.756 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-29T11:09:22.759 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-29T11:09:22.773 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:22.806 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:23.087 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2023-11-29T11:09:23.104 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-29T11:09:23.145 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-29T11:09:23.167 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-prettytable. 2023-11-29T11:09:23.183 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-29T11:09:23.225 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-29T11:09:23.461 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rbd. 2023-11-29T11:09:23.465 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-29T11:09:23.477 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:23.482 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-29T11:09:23.519 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:23.523 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-29T11:09:23.809 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-29T11:09:23.829 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-29T11:09:23.867 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-29T11:09:23.881 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-29T11:09:23.897 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-29T11:09:23.939 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-29T11:09:24.195 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2023-11-29T11:09:24.212 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-29T11:09:24.253 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-29T11:09:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-29T11:09:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-29T11:09:24.367 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-29T11:09:24.557 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2023-11-29T11:09:24.572 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-29T11:09:24.615 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-29T11:09:24.704 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-29T11:09:24.720 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-29T11:09:24.761 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-29T11:09:24.961 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-29T11:09:24.981 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-29T11:09:25.019 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-29T11:09:25.106 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librgw2. 2023-11-29T11:09:25.126 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../022-librgw2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:25.164 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:25.331 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-29T11:09:25.349 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:25.397 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:26.594 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-29T11:09:26.611 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:26.652 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:26.658 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rgw. 2023-11-29T11:09:26.675 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:26.717 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:26.980 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cryptography. 2023-11-29T11:09:26.996 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-29T11:09:27.038 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-29T11:09:27.094 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liboath0. 2023-11-29T11:09:27.110 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-29T11:09:27.152 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-29T11:09:27.426 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2023-11-29T11:09:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-29T11:09:27.455 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libradosstriper1. 2023-11-29T11:09:27.472 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:27.483 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-29T11:09:27.505 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:27.820 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2023-11-29T11:09:27.838 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:27.878 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:27.958 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-common. 2023-11-29T11:09:27.978 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:28.017 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:28.398 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2023-11-29T11:09:28.415 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:28.456 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:29.710 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2023-11-29T11:09:29.729 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:29.759 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:30.430 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-base. 2023-11-29T11:09:30.446 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:30.499 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:31.918 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-29T11:09:31.934 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-29T11:09:31.976 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-29T11:09:32.246 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-natsort. 2023-11-29T11:09:32.264 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-29T11:09:32.295 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-29T11:09:32.615 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-logutils. 2023-11-29T11:09:32.634 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-29T11:09:32.673 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-29T11:09:32.771 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2023-11-29T11:09:32.787 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:32.828 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:33.001 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-29T11:09:33.017 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-29T11:09:33.059 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-29T11:09:33.173 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2023-11-29T11:09:33.191 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:33.231 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:33.337 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-mako. 2023-11-29T11:09:33.354 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-29T11:09:33.412 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-29T11:09:33.659 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2023-11-29T11:09:33.675 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:33.717 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:33.740 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-29T11:09:33.759 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-29T11:09:33.798 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-29T11:09:34.102 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-29T11:09:34.117 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-29T11:09:34.159 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-29T11:09:34.245 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2023-11-29T11:09:34.265 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-cephadm_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:34.303 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:34.487 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webob. 2023-11-29T11:09:34.503 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-29T11:09:34.545 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-29T11:09:34.648 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-29T11:09:34.664 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-29T11:09:34.706 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-29T11:09:34.873 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-29T11:09:34.889 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-29T11:09:34.931 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-29T11:09:35.084 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2023-11-29T11:09:35.102 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-29T11:09:35.142 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-29T11:09:35.234 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-bs4. 2023-11-29T11:09:35.252 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-29T11:09:35.284 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-29T11:09:35.445 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-29T11:09:35.462 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:35.503 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:35.662 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-waitress. 2023-11-29T11:09:35.682 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-29T11:09:35.723 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-29T11:09:35.848 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-29T11:09:35.866 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-29T11:09:35.906 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-29T11:09:36.023 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempita. 2023-11-29T11:09:36.043 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-29T11:09:36.081 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-29T11:09:36.251 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jwt. 2023-11-29T11:09:36.267 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-29T11:09:36.309 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-29T11:09:36.409 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-paste. 2023-11-29T11:09:36.425 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-29T11:09:36.467 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-29T11:09:36.620 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-attr. 2023-11-29T11:09:36.638 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-29T11:09:36.712 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-29T11:09:36.787 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-29T11:09:36.804 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-29T11:09:36.845 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-29T11:09:37.050 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2023-11-29T11:09:37.069 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-29T11:09:37.106 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-29T11:09:37.173 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-29T11:09:37.189 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-29T11:09:37.231 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-29T11:09:37.409 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2023-11-29T11:09:37.426 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-29T11:09:37.467 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-29T11:09:37.534 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webtest. 2023-11-29T11:09:37.550 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-29T11:09:37.617 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-29T11:09:37.787 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-29T11:09:37.803 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-29T11:09:37.845 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-29T11:09:37.912 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pecan. 2023-11-29T11:09:37.931 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-29T11:09:37.978 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-29T11:09:38.182 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-packaging. 2023-11-29T11:09:38.199 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-29T11:09:38.240 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-29T11:09:38.325 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-29T11:09:38.343 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-29T11:09:38.383 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-29T11:09:38.551 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2023-11-29T11:09:38.567 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-29T11:09:38.609 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-29T11:09:38.677 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-29T11:09:38.693 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:38.735 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:38.929 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-29T11:09:38.949 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-29T11:09:38.987 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-29T11:09:39.115 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-29T11:09:39.135 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:39.173 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:39.240 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjs-underscore. 2023-11-29T11:09:39.256 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-29T11:09:39.298 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-29T11:09:39.501 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cryptography. 2023-11-29T11:09:39.517 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-29T11:09:39.567 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-29T11:09:39.586 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-29T11:09:39.592 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-29T11:09:39.625 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-29T11:09:39.944 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2023-11-29T11:09:39.963 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-29T11:09:39.963 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-openssl. 2023-11-29T11:09:39.981 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-29T11:09:40.021 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-29T11:09:40.024 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-29T11:09:40.324 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr. 2023-11-29T11:09:40.341 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:40.347 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-29T11:09:40.364 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:40.382 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:40.405 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:40.860 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mon. 2023-11-29T11:09:40.877 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:40.884 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-decorator. 2023-11-29T11:09:40.900 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-29T11:09:40.942 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-29T11:09:40.943 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:41.262 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-29T11:09:41.278 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-29T11:09:41.320 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-29T11:09:41.633 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-scipy. 2023-11-29T11:09:41.650 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-29T11:09:41.689 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-29T11:09:42.589 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-osd. 2023-11-29T11:09:42.605 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:42.647 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:43.290 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-29T11:09:43.307 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-29T11:09:43.356 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-29T11:09:43.893 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2023-11-29T11:09:43.910 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-29T11:09:43.951 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-29T11:09:44.327 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2023-11-29T11:09:44.343 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-29T11:09:44.386 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-29T11:09:45.086 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-29T11:09:45.105 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:45.144 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:45.866 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph. 2023-11-29T11:09:45.885 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../053-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:45.924 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:46.244 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-fuse. 2023-11-29T11:09:46.263 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2023-11-29T11:09:46.263 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:46.279 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-29T11:09:46.302 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:46.321 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-29T11:09:46.693 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-29T11:09:46.713 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-29T11:09:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mds. 2023-11-29T11:09:46.733 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:46.751 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-29T11:09:46.773 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:47.089 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-29T11:09:47.105 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-29T11:09:47.147 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-29T11:09:47.318 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephadm. 2023-11-29T11:09:47.334 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../056-cephadm_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:47.376 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:47.473 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2023-11-29T11:09:47.490 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-29T11:09:47.531 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-29T11:09:47.654 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-29T11:09:47.673 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-29T11:09:47.704 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-29T11:09:47.843 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2023-11-29T11:09:47.859 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-29T11:09:47.909 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-29T11:09:48.015 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jinja2. 2023-11-29T11:09:48.033 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-29T11:09:48.065 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-29T11:09:48.237 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-blinker. 2023-11-29T11:09:48.253 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-29T11:09:48.295 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-29T11:09:48.418 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-29T11:09:48.434 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:48.476 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:48.598 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-29T11:09:48.615 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-29T11:09:48.656 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-29T11:09:48.863 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-29T11:09:48.878 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-29T11:09:48.921 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-29T11:09:49.009 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-29T11:09:49.027 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-29T11:09:49.067 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-29T11:09:49.190 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jwt. 2023-11-29T11:09:49.209 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-29T11:09:49.240 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-29T11:09:49.387 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2023-11-29T11:09:49.404 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-29T11:09:49.445 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-29T11:09:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-attr. 2023-11-29T11:09:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-29T11:09:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-29T11:09:49.724 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-29T11:09:49.742 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-29T11:09:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-29T11:09:49.937 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pluggy. 2023-11-29T11:09:49.953 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-29T11:09:49.995 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-29T11:09:50.323 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-py. 2023-11-29T11:09:50.341 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-29T11:09:50.371 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-29T11:09:50.381 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-29T11:09:50.388 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:50.428 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:50.701 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-29T11:09:50.717 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-29T11:09:50.748 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-29T11:09:50.764 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-29T11:09:50.784 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-29T11:09:50.806 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-29T11:09:51.062 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-packaging. 2023-11-29T11:09:51.080 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-29T11:09:51.120 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-29T11:09:51.185 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-29T11:09:51.200 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:09:51.242 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-29T11:09:51.443 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pytest. 2023-11-29T11:09:51.462 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-29T11:09:51.506 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-29T11:09:51.529 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2023-11-29T11:09:51.546 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:09:51.587 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-29T11:09:51.815 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2023-11-29T11:09:51.826 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-29T11:09:51.833 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-29T11:09:51.842 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-29T11:09:51.873 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-29T11:09:51.884 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-29T11:09:52.143 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2023-11-29T11:09:52.159 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-29T11:09:52.161 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjs-underscore. 2023-11-29T11:09:52.178 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-29T11:09:52.192 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-29T11:09:52.220 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-29T11:09:52.489 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-29T11:09:52.505 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-29T11:09:52.530 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2023-11-29T11:09:52.547 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-29T11:09:52.550 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:52.588 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:52.892 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-routes. 2023-11-29T11:09:52.907 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-29T11:09:52.949 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-29T11:09:53.277 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-29T11:09:53.294 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:53.336 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:53.848 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-decorator. 2023-11-29T11:09:53.865 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-29T11:09:53.906 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-29T11:09:54.233 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-29T11:09:54.250 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-29T11:09:54.291 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-29T11:09:54.603 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-scipy. 2023-11-29T11:09:54.620 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-29T11:09:54.661 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-29T11:09:55.961 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-29T11:09:55.980 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-29T11:09:56.019 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-29T11:09:56.539 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-joblib. 2023-11-29T11:09:56.559 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-29T11:09:56.597 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-29T11:09:57.001 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn. 2023-11-29T11:09:57.017 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-29T11:09:57.034 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2023-11-29T11:09:57.053 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:57.059 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-29T11:09:57.092 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:57.405 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-29T11:09:57.425 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:57.463 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:57.809 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-colorama. 2023-11-29T11:09:57.825 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-29T11:09:57.831 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-29T11:09:57.852 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:57.875 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-29T11:09:57.889 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:58.153 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-shell. 2023-11-29T11:09:58.169 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:58.211 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-top. 2023-11-29T11:09:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:09:58.513 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:58.766 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-29T11:09:58.783 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-29T11:09:58.824 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-29T11:09:59.017 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cachetools. 2023-11-29T11:09:59.034 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-29T11:09:59.075 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-29T11:09:59.362 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-29T11:09:59.378 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:09:59.419 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:09:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-29T11:09:59.497 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-29T11:09:59.538 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-29T11:09:59.823 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2023-11-29T11:09:59.840 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-29T11:09:59.851 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-29T11:09:59.871 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-29T11:09:59.898 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-29T11:09:59.909 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-29T11:10:00.228 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-29T11:10:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-29T11:10:00.246 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rsa. 2023-11-29T11:10:00.264 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-29T11:10:00.286 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-29T11:10:00.304 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-29T11:10:00.603 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-google-auth. 2023-11-29T11:10:00.624 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-29T11:10:00.647 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-29T11:10:00.661 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-29T11:10:00.666 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-29T11:10:00.705 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-29T11:10:01.006 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-blinker. 2023-11-29T11:10:01.023 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-29T11:10:01.064 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-29T11:10:01.396 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-29T11:10:01.416 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-29T11:10:01.458 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-29T11:10:01.811 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-29T11:10:01.829 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-29T11:10:01.869 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-29T11:10:02.197 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-websocket. 2023-11-29T11:10:02.214 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-29T11:10:02.255 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-29T11:10:02.353 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-29T11:10:02.375 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-29T11:10:02.419 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-29T11:10:02.542 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-29T11:10:02.558 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-29T11:10:02.592 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-29T11:10:02.756 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webencodings. 2023-11-29T11:10:02.772 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-29T11:10:02.830 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-29T11:10:03.150 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-html5lib. 2023-11-29T11:10:03.164 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-29T11:10:03.170 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-29T11:10:03.181 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:10:03.208 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-29T11:10:03.222 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:03.544 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-29T11:10:03.563 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-29T11:10:03.592 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-29T11:10:03.602 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-29T11:10:03.609 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-29T11:10:03.650 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-29T11:10:04.011 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-29T11:10:04.029 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:10:04.081 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2023-11-29T11:10:04.094 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-29T11:10:04.101 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-29T11:10:04.139 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-29T11:10:04.372 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package jq. 2023-11-29T11:10:04.389 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:10:04.422 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-29T11:10:04.467 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2023-11-29T11:10:04.484 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-29T11:10:04.525 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-29T11:10:04.683 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package socat. 2023-11-29T11:10:04.699 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-29T11:10:04.758 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-29T11:10:04.853 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-29T11:10:04.870 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-29T11:10:04.911 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-29T11:10:05.061 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package xmlstarlet. 2023-11-29T11:10:05.077 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-29T11:10:05.119 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-29T11:10:05.239 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2023-11-29T11:10:05.256 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-29T11:10:05.297 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-29T11:10:05.465 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-test. 2023-11-29T11:10:05.484 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:10:05.523 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:05.558 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-29T11:10:05.577 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-29T11:10:05.616 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-29T11:10:06.296 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2023-11-29T11:10:06.315 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../116-radosgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:10:06.353 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2023-11-29T11:10:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:10:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:08.171 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-29T11:10:08.473 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-29T11:10:08.582 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-29T11:10:08.711 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-29T11:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:09.483 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2023-11-29T11:10:09.644 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-29T11:10:09.789 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-29T11:10:09.860 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-volume. 2023-11-29T11:10:09.877 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:10:09.918 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:10.141 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-29T11:10:10.265 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-29T11:10:10.281 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:10:10.314 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:10.425 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-29T11:10:10.551 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-29T11:10:10.677 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-colorama. 2023-11-29T11:10:10.677 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-29T11:10:10.694 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-29T11:10:10.735 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-29T11:10:10.996 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-shell. 2023-11-29T11:10:11.012 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-29T11:10:11.012 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:10:11.054 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:11.340 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-top. 2023-11-29T11:10:11.356 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-29T11:10:11.398 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:11.422 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-29T11:10:11.617 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-29T11:10:11.636 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-29T11:10:11.675 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-29T11:10:11.724 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-29T11:10:12.008 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-29T11:10:12.221 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-29T11:10:12.237 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:10:12.278 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:12.293 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-29T11:10:12.661 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-29T11:10:12.707 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package nvme-cli. 2023-11-29T11:10:12.725 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-29T11:10:12.782 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-29T11:10:12.978 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:13.279 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-29T11:10:13.399 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-29T11:10:13.453 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-29T11:10:13.470 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-29T11:10:13.502 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-29T11:10:13.675 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-29T11:10:13.872 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-29T11:10:13.892 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-29T11:10:13.930 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-29T11:10:13.976 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-29T11:10:14.277 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-29T11:10:14.420 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-29T11:10:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-29T11:10:15.106 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-29T11:10:15.382 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-29T11:10:15.585 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-29T11:10:15.606 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-29T11:10:15.643 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-29T11:10:15.741 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-29T11:10:16.015 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webencodings. 2023-11-29T11:10:16.032 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-29T11:10:16.042 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-29T11:10:16.072 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-29T11:10:16.375 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-html5lib. 2023-11-29T11:10:16.377 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-29T11:10:16.396 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-29T11:10:16.433 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-29T11:10:16.678 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-29T11:10:16.803 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-29T11:10:16.824 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-29T11:10:16.861 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-29T11:10:16.979 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-29T11:10:17.105 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-29T11:10:17.231 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-29T11:10:17.339 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastescript. 2023-11-29T11:10:17.358 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-29T11:10:17.397 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-29T11:10:17.532 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-29T11:10:17.717 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-psutil. 2023-11-29T11:10:17.734 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-29T11:10:17.775 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-29T11:10:18.109 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-29T11:10:18.145 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-29T11:10:18.163 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-29T11:10:18.203 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-29T11:10:18.410 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-29T11:10:18.506 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplejson. 2023-11-29T11:10:18.525 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-29T11:10:18.564 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-29T11:10:18.786 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-29T11:10:18.867 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-29T11:10:18.886 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-29T11:10:18.925 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-29T11:10:19.155 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-29T11:10:19.281 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:19.562 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package radosgw. 2023-11-29T11:10:19.581 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../116-radosgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:10:19.607 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:10:19.620 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:19.742 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-29T11:10:20.101 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-29T11:10:20.228 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-29T11:10:20.353 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-29T11:10:20.655 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-29T11:10:20.949 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package rbd-fuse. 2023-11-29T11:10:20.966 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-29T11:10:20.981 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:10:21.006 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:21.099 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-29T11:10:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-29T11:10:21.346 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-29T11:10:21.543 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-29T11:10:21.622 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-29T11:10:21.723 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-29T11:10:21.833 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-29T11:10:21.836 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-29T11:10:22.053 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:22.162 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-29T11:10:22.288 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-29T11:10:22.589 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-29T11:10:22.623 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user cephadm....done 2023-11-29T11:10:22.793 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-29T11:10:22.881 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-29T11:10:22.919 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-29T11:10:23.166 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-29T11:10:23.290 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-29T11:10:23.557 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-29T11:10:23.599 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-29T11:10:23.675 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-29T11:10:23.801 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-29T11:10:23.863 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-29T11:10:23.995 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-29T11:10:24.119 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-29T11:10:24.329 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-29T11:10:24.530 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-29T11:10:24.697 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-29T11:10:24.823 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-29T11:10:24.848 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-29T11:10:24.966 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-29T11:10:25.107 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-29T11:10:25.309 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-29T11:10:25.366 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-29T11:10:25.602 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-29T11:10:25.651 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-29T11:10:25.944 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:26.253 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-29T11:10:26.379 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-29T11:10:26.664 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-29T11:10:26.923 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-29T11:10:27.086 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-29T11:10:27.212 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-29T11:10:27.216 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-29T11:10:27.325 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-29T11:10:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-29T11:10:27.685 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-29T11:10:27.889 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-29T11:10:27.986 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-29T11:10:28.182 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:10:28.254 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-29T11:10:28.308 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-29T11:10:28.597 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-29T11:10:28.659 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-29T11:10:28.898 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-29T11:10:28.986 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-29T11:10:29.232 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-29T11:10:29.379 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-29T11:10:29.500 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-29T11:10:29.705 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-29T11:10:29.793 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-29T11:10:29.952 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-29T11:10:30.078 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-29T11:10:30.371 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-29T11:10:30.781 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-29T11:10:30.830 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-29T11:10:30.956 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-29T11:10:31.057 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-29T11:10:31.082 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-29T11:10:31.208 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-29T11:10:31.408 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-29T11:10:31.501 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-29T11:10:31.627 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-29T11:10:31.760 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-29T11:10:31.911 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:31.945 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-29T11:10:32.229 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:10:32.254 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-29T11:10:32.363 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-29T11:10:32.564 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-29T11:10:32.681 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-29T11:10:32.807 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-29T11:10:32.926 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:32.933 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-29T11:10:33.137 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-29T11:10:33.226 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-29T11:10:33.263 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:33.465 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:33.536 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:10:33.575 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-29T11:10:33.662 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-29T11:10:33.788 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-29T11:10:33.876 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:34.002 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-29T11:10:34.140 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-29T11:10:34.295 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:34.421 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:34.432 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-29T11:10:34.539 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:34.742 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-29T11:10:34.745 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-29T11:10:34.745 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-29T11:10:34.859 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-29T11:10:35.158 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-29T11:10:35.190 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:35.325 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:35.451 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:35.453 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-29T11:10:35.577 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-29T11:10:35.746 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-29T11:10:36.162 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-29T11:10:36.415 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-29T11:10:36.497 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:36.541 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-29T11:10:36.631 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:36.791 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:36.867 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-29T11:10:36.925 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:37.051 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:37.177 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:37.218 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-29T11:10:37.344 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-29T11:10:37.470 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-29T11:10:37.721 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2023-11-29T11:10:37.830 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-29T11:10:38.098 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2023-11-29T11:10:38.114 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-29T11:10:38.275 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2023-11-29T11:10:38.300 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-29T11:10:38.440 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-29T11:10:38.762 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-29T11:10:39.221 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:39.347 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:39.473 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:39.579 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-29T11:10:39.725 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-29T11:10:39.745 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-29T11:10:39.745 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-29T11:10:40.075 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-29T11:10:40.400 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:40.401 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-29T11:10:40.694 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-29T11:10:40.771 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-29T11:10:40.820 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-29T11:10:41.163 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-29T11:10:41.243 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:41.466 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-29T11:10:41.466 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-29T11:10:41.481 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-29T11:10:41.858 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-29T11:10:41.920 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:42.149 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-29T11:10:42.149 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-29T11:10:42.184 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-29T11:10:42.597 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:43.104 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-29T11:10:43.104 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-29T11:10:43.241 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-29T11:10:43.367 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-29T11:10:43.493 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-29T11:10:43.617 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:43.749 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:43.884 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:44.052 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-29T11:10:44.105 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-29T11:10:44.105 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-29T11:10:44.379 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-29T11:10:44.505 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-29T11:10:44.543 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:44.703 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:44.806 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-29T11:10:44.829 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:44.988 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:45.090 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-29T11:10:45.107 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-29T11:10:45.250 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-29T11:10:45.383 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-29T11:10:45.535 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-29T11:10:45.737 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librados2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:45.948 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-29T11:10:46.066 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:46.183 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:46.334 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:46.460 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-29T11:10:46.770 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:46.896 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-29T11:10:47.223 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librbd1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:47.349 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:47.458 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:47.686 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-29T11:10:47.686 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-29T11:10:48.118 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:48.277 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:48.403 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-29T11:10:48.529 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-29T11:10:49.389 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-29T11:10:49.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-29T11:10:49.458 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:49.461 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-29T11:10:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:49.664 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-11-29T11:10:49.665 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-11-29T11:10:49.743 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:49.862 INFO:teuthology.orchestra.run.smithi081.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-29T11:10:49.862 INFO:teuthology.orchestra.run.smithi081.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-29T11:10:49.863 INFO:teuthology.orchestra.run.smithi081.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-29T11:10:49.863 INFO:teuthology.orchestra.run.smithi081.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-29T11:10:49.863 INFO:teuthology.orchestra.run.smithi081.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-29T11:10:49.863 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-11-29T11:10:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-29T11:10:49.863 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-29T11:10:49.864 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-11-29T11:10:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-29T11:10:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-29T11:10:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-29T11:10:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-29T11:10:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: usb-modeswitch-data wpasupplicant 2023-11-29T11:10:49.866 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-11-29T11:10:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-29T11:10:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-29T11:10:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: libengine-pkcs11-openssl 2023-11-29T11:10:49.870 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:49.924 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-11-29T11:10:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-29T11:10:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-29T11:10:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-29T11:10:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-29T11:10:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-29T11:10:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-29T11:10:49.926 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2023-11-29T11:10:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-29T11:10:49.995 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:50.122 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:6 upgraded, 31 newly installed, 0 to remove and 253 not upgraded. 2023-11-29T11:10:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 25.3 MB of archives. 2023-11-29T11:10:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-29T11:10:50.133 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-29T11:10:50.682 INFO:teuthology.orchestra.run.smithi176.stdout:Adding group ceph....done 2023-11-29T11:10:50.756 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-29T11:10:50.757 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-29T11:10:50.759 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-29T11:10:50.771 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-29T11:10:50.774 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-29T11:10:50.872 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-29T11:10:50.875 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-29T11:10:50.882 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-29T11:10:50.887 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-29T11:10:50.887 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-29T11:10:51.054 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-29T11:10:51.093 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user ceph....done 2023-11-29T11:10:51.252 INFO:teuthology.orchestra.run.smithi176.stdout:Setting system user ceph properties....done 2023-11-29T11:10:51.277 INFO:teuthology.orchestra.run.smithi176.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-29T11:10:51.323 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-29T11:10:51.418 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-29T11:10:51.452 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-29T11:10:51.458 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-29T11:10:51.553 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-29T11:10:51.557 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-29T11:10:51.640 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-29T11:10:51.656 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-29T11:10:51.724 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-29T11:10:51.724 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-29T11:10:51.750 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-29T11:10:51.808 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-29T11:10:51.972 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-29T11:10:52.515 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:52.588 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-29T11:10:52.641 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:52.688 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-29T11:10:52.776 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-29T11:10:52.786 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-29T11:10:52.788 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-29T11:10:52.788 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-29T11:10:52.789 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:52.789 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-29T11:10:52.821 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-29T11:10:52.826 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-29T11:10:53.059 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-29T11:10:53.059 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-29T11:10:53.199 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-29T11:10:53.363 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-29T11:10:53.445 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-29T11:10:53.446 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-29T11:10:53.579 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-29T11:10:53.711 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:54.077 INFO:teuthology.orchestra.run.smithi081.stdout:Preconfiguring packages ... 2023-11-29T11:10:54.089 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-29T11:10:54.270 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 25.3 MB in 4s (6,774 kB/s) 2023-11-29T11:10:54.546 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-29T11:10:54.548 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:54.551 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-29T11:10:54.740 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-29T11:10:54.800 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-29T11:10:54.800 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-29T11:10:55.233 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:55.464 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-29T11:10:55.465 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-29T11:10:55.901 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:55.915 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-29T11:10:56.409 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-29T11:10:56.409 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-29T11:10:56.861 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:56.962 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:57.080 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:57.302 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-29T11:10:57.302 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-29T11:10:57.360 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-29T11:10:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-29T11:10:57.488 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-29T11:10:57.731 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:57.866 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:57.920 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-29T11:10:58.016 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-29T11:10:58.159 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-29T11:10:58.286 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-29T11:10:58.411 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-29T11:10:58.437 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-29T11:10:58.722 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-29T11:10:58.873 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-29T11:10:58.877 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-29T11:10:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-29T11:11:01.036 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-29T11:11:01.169 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-29T11:11:01.651 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-29T11:11:01.659 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-29T11:11:01.815 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-29T11:11:02.241 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-29T11:11:02.243 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-29T11:11:02.315 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-29T11:11:02.336 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-29T11:11:02.353 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-29T11:11:02.394 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-29T11:11:02.519 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2023-11-29T11:11:02.520 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2023-11-29T11:11:02.708 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package dump. 2023-11-29T11:11:02.724 INFO:teuthology.orchestra.run.smithi176.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-29T11:11:02.724 INFO:teuthology.orchestra.run.smithi176.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-29T11:11:02.724 INFO:teuthology.orchestra.run.smithi176.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-29T11:11:02.724 INFO:teuthology.orchestra.run.smithi176.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-29T11:11:02.724 INFO:teuthology.orchestra.run.smithi176.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-29T11:11:02.724 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2023-11-29T11:11:02.725 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-29T11:11:02.725 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-29T11:11:02.725 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2023-11-29T11:11:02.725 INFO:teuthology.orchestra.run.smithi176.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-29T11:11:02.725 INFO:teuthology.orchestra.run.smithi176.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-29T11:11:02.726 INFO:teuthology.orchestra.run.smithi176.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-29T11:11:02.726 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-29T11:11:02.726 INFO:teuthology.orchestra.run.smithi176.stdout: usb-modeswitch-data wpasupplicant 2023-11-29T11:11:02.727 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-29T11:11:02.727 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2023-11-29T11:11:02.727 INFO:teuthology.orchestra.run.smithi176.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-29T11:11:02.727 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-29T11:11:02.727 INFO:teuthology.orchestra.run.smithi176.stdout: libengine-pkcs11-openssl 2023-11-29T11:11:02.772 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking dump (0.4b46-6) ... 2023-11-29T11:11:02.789 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2023-11-29T11:11:02.790 INFO:teuthology.orchestra.run.smithi176.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-29T11:11:02.790 INFO:teuthology.orchestra.run.smithi176.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-29T11:11:02.791 INFO:teuthology.orchestra.run.smithi176.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-29T11:11:02.791 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-29T11:11:02.791 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-29T11:11:02.791 INFO:teuthology.orchestra.run.smithi176.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-29T11:11:02.792 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2023-11-29T11:11:02.793 INFO:teuthology.orchestra.run.smithi176.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-29T11:11:02.849 INFO:teuthology.orchestra.run.smithi176.stdout:6 upgraded, 31 newly installed, 0 to remove and 253 not upgraded. 2023-11-29T11:11:02.850 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 25.3 MB of archives. 2023-11-29T11:11:02.850 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-29T11:11:02.850 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-29T11:11:02.980 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-29T11:11:02.981 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-29T11:11:02.981 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-29T11:11:02.986 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-29T11:11:02.987 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-29T11:11:03.004 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-29T11:11:03.005 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-29T11:11:03.006 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-29T11:11:03.007 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-29T11:11:03.007 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-29T11:11:03.013 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-29T11:11:03.014 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-29T11:11:03.015 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-29T11:11:03.016 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-29T11:11:03.030 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-29T11:11:03.030 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-29T11:11:03.035 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-29T11:11:03.037 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-29T11:11:03.047 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-29T11:11:03.047 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-29T11:11:03.061 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-29T11:11:03.061 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-29T11:11:03.067 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package indent. 2023-11-29T11:11:03.068 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-29T11:11:03.078 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-29T11:11:03.085 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:11:03.094 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-29T11:11:03.097 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-29T11:11:03.097 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-29T11:11:03.098 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-29T11:11:03.098 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-29T11:11:03.107 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-29T11:11:03.108 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-29T11:11:03.125 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-29T11:11:03.217 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-29T11:11:03.217 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-29T11:11:03.291 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-29T11:11:03.291 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-29T11:11:03.292 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-29T11:11:03.445 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-29T11:11:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-29T11:11:03.503 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-29T11:11:03.693 INFO:teuthology.orchestra.run.smithi176.stdout:Preconfiguring packages ... 2023-11-29T11:11:03.824 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-29T11:11:03.843 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-29T11:11:03.864 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 25.3 MB in 0s (51.4 MB/s) 2023-11-29T11:11:03.873 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-29T11:11:04.143 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-29T11:11:04.143 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-29T11:11:04.147 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-29T11:11:04.161 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-29T11:11:04.201 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-29T11:11:04.311 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-29T11:11:04.546 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-29T11:11:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:04.604 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-29T11:11:04.899 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-29T11:11:04.916 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:04.948 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-29T11:11:05.260 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-29T11:11:05.277 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:05.318 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-29T11:11:05.634 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-29T11:11:05.704 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-29T11:11:05.723 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-29T11:11:05.762 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-29T11:11:06.266 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-29T11:11:06.288 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-29T11:11:06.443 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-29T11:11:07.046 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-29T11:11:07.050 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-29T11:11:07.208 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-29T11:11:07.321 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-29T11:11:07.342 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:11:07.379 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:07.592 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-29T11:11:07.757 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-29T11:11:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:07.789 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-29T11:11:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-29T11:11:08.118 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-29T11:11:08.118 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-29T11:11:08.136 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:08.167 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-29T11:11:08.404 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-29T11:11:08.421 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-29T11:11:08.461 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-29T11:11:08.575 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-29T11:11:08.580 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-29T11:11:08.705 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-29T11:11:08.974 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-29T11:11:08.992 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-29T11:11:09.031 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-29T11:11:09.211 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-29T11:11:09.343 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-29T11:11:09.419 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package modemmanager. 2023-11-29T11:11:09.436 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:09.487 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-29T11:11:10.091 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package wpasupplicant. 2023-11-29T11:11:10.111 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-29T11:11:10.149 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-29T11:11:10.310 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-29T11:11:10.732 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager. 2023-11-29T11:11:10.750 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-29T11:11:10.791 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-29T11:11:10.815 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-29T11:11:11.336 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-29T11:11:11.354 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-29T11:11:11.394 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-29T11:11:11.514 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ppp. 2023-11-29T11:11:11.531 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-29T11:11:11.731 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package dump. 2023-11-29T11:11:11.748 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-29T11:11:11.780 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-29T11:11:11.789 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking dump (0.4b46-6) ... 2023-11-29T11:11:12.069 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pptp-linux. 2023-11-29T11:11:12.086 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-29T11:11:12.109 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package indent. 2023-11-29T11:11:12.129 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:11:12.162 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-29T11:11:12.167 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-29T11:11:12.487 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-29T11:11:12.506 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-29T11:11:12.523 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-29T11:11:12.540 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-29T11:11:12.545 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-29T11:11:12.598 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-29T11:11:12.824 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-29T11:11:12.842 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-29T11:11:12.873 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-29T11:11:12.917 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-29T11:11:12.938 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-29T11:11:12.976 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-29T11:11:13.168 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-29T11:11:13.184 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-29T11:11:13.226 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-29T11:11:13.255 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-29T11:11:13.273 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:11:13.314 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:13.570 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-29T11:11:13.587 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:13.628 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-29T11:11:13.910 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-common. 2023-11-29T11:11:13.923 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-29T11:11:13.930 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-29T11:11:13.942 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:13.981 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-29T11:11:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-29T11:11:14.020 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-29T11:11:14.251 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-29T11:11:14.269 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:14.301 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-29T11:11:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-12. 2023-11-29T11:11:14.509 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:11:14.553 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:14.703 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-29T11:11:14.722 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-29T11:11:14.761 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-29T11:11:15.117 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-29T11:11:15.134 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-29T11:11:15.172 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-29T11:11:15.484 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-29T11:11:15.503 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:11:15.533 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:16.154 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql. 2023-11-29T11:11:16.172 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-29T11:11:16.212 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-29T11:11:16.278 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-29T11:11:16.298 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:16.439 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client. 2023-11-29T11:11:16.458 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-29T11:11:16.497 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-29T11:11:16.646 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-29T11:11:16.758 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-29T11:11:16.776 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-29T11:11:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-29T11:11:16.965 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-29T11:11:16.983 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:17.024 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-29T11:11:17.052 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-29T11:11:17.070 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-29T11:11:17.110 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-29T11:11:17.251 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-29T11:11:17.270 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-29T11:11:17.301 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-29T11:11:17.489 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-29T11:11:17.507 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-29T11:11:17.557 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-29T11:11:17.812 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-29T11:11:17.831 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-29T11:11:17.870 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-29T11:11:17.871 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-29T11:11:18.086 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-29T11:11:18.232 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package modemmanager. 2023-11-29T11:11:18.250 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-29T11:11:18.301 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-29T11:11:18.404 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:18.522 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-29T11:11:18.673 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-29T11:11:18.799 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-29T11:11:18.888 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package wpasupplicant. 2023-11-29T11:11:18.904 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-29T11:11:18.946 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-29T11:11:19.186 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-29T11:11:19.186 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-29T11:11:19.518 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager. 2023-11-29T11:11:19.535 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-29T11:11:19.600 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-29T11:11:19.677 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:20.350 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ppp. 2023-11-29T11:11:20.367 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-29T11:11:20.587 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-29T11:11:20.642 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-29T11:11:20.708 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-29T11:11:20.834 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-29T11:11:20.960 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-29T11:11:20.979 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pptp-linux. 2023-11-29T11:11:20.996 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-29T11:11:21.037 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-29T11:11:21.374 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-29T11:11:21.392 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-29T11:11:21.442 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-29T11:11:22.019 INFO:teuthology.orchestra.run.smithi081.stdout:Adding user postgres to group ssl-cert 2023-11-29T11:11:22.020 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-29T11:11:22.041 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-29T11:11:22.162 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-29T11:11:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:22.280 INFO:teuthology.orchestra.run.smithi081.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-29T11:11:22.475 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-29T11:11:22.492 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:11:22.550 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:23.001 INFO:teuthology.orchestra.run.smithi081.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-29T11:11:23.001 INFO:teuthology.orchestra.run.smithi081.stdout:Removing obsolete dictionary files: 2023-11-29T11:11:23.129 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-common. 2023-11-29T11:11:23.147 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-29T11:11:23.229 INFO:teuthology.orchestra.run.smithi176.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-29T11:11:23.256 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-29T11:11:23.329 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-29T11:11:23.727 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-12. 2023-11-29T11:11:23.744 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-29T11:11:23.789 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:24.096 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-29T11:11:24.222 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-29T11:11:24.348 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-29T11:11:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-29T11:11:25.422 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql. 2023-11-29T11:11:25.440 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-29T11:11:25.446 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-29T11:11:25.479 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-29T11:11:25.688 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up dump (0.4b46-6) ... 2023-11-29T11:11:25.724 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client. 2023-11-29T11:11:25.741 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-29T11:11:25.785 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-29T11:11:25.807 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-29T11:11:25.848 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-29T11:11:25.974 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-29T11:11:26.034 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-29T11:11:26.052 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-29T11:11:26.092 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-29T11:11:26.100 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-29T11:11:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-29T11:11:26.311 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-29T11:11:26.331 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-29T11:11:26.361 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-29T11:11:26.403 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-29T11:11:26.537 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:26.764 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-29T11:11:26.783 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-29T11:11:26.833 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-29T11:11:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-29T11:11:26.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-29T11:11:27.018 INFO:teuthology.orchestra.run.smithi081.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-29T11:11:27.018 INFO:teuthology.orchestra.run.smithi081.stdout:This user must also own the server process. 2023-11-29T11:11:27.019 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:27.019 INFO:teuthology.orchestra.run.smithi081.stdout:The database cluster will be initialized with locale "en_US". 2023-11-29T11:11:27.019 INFO:teuthology.orchestra.run.smithi081.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-29T11:11:27.019 INFO:teuthology.orchestra.run.smithi081.stdout:The default text search configuration will be set to "english". 2023-11-29T11:11:27.019 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:27.019 INFO:teuthology.orchestra.run.smithi081.stdout:Data page checksums are disabled. 2023-11-29T11:11:27.019 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:27.019 INFO:teuthology.orchestra.run.smithi081.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-29T11:11:27.020 INFO:teuthology.orchestra.run.smithi081.stdout:creating subdirectories ... ok 2023-11-29T11:11:27.020 INFO:teuthology.orchestra.run.smithi081.stdout:selecting dynamic shared memory implementation ... posix 2023-11-29T11:11:27.039 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default max_connections ... 100 2023-11-29T11:11:27.061 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default shared_buffers ... 128MB 2023-11-29T11:11:27.074 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default time zone ... Etc/UTC 2023-11-29T11:11:27.075 INFO:teuthology.orchestra.run.smithi081.stdout:creating configuration files ... ok 2023-11-29T11:11:27.156 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-29T11:11:27.182 INFO:teuthology.orchestra.run.smithi081.stdout:running bootstrap script ... ok 2023-11-29T11:11:27.463 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-29T11:11:27.703 INFO:teuthology.orchestra.run.smithi081.stdout:performing post-bootstrap initialization ... ok 2023-11-29T11:11:27.863 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:27.989 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-29T11:11:28.115 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-29T11:11:28.241 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-29T11:11:28.430 INFO:teuthology.orchestra.run.smithi081.stdout:syncing data to disk ... ok 2023-11-29T11:11:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:28.430 INFO:teuthology.orchestra.run.smithi081.stdout:Success. You can now start the database server using: 2023-11-29T11:11:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: pg_ctlcluster 12 main start 2023-11-29T11:11:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:28.655 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-29T11:11:28.655 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-29T11:11:28.747 INFO:teuthology.orchestra.run.smithi081.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-29T11:11:28.747 INFO:teuthology.orchestra.run.smithi081.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-29T11:11:28.829 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-29T11:11:29.144 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:30.019 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-29T11:11:30.100 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-29T11:11:30.225 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-29T11:11:30.335 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-29T11:11:31.383 INFO:teuthology.orchestra.run.smithi176.stdout:Adding user postgres to group ssl-cert 2023-11-29T11:11:31.640 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:31.641 INFO:teuthology.orchestra.run.smithi176.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-29T11:11:31.881 INFO:teuthology.orchestra.run.smithi176.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-29T11:11:31.881 INFO:teuthology.orchestra.run.smithi176.stdout:Removing obsolete dictionary files: 2023-11-29T11:11:31.911 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-29T11:11:32.037 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-29T11:11:32.163 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-29T11:11:32.202 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-29T11:11:32.331 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-29T11:11:32.457 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-29T11:11:32.608 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-29T11:11:33.170 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-29T11:11:33.295 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-29T11:11:33.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:33.306 INFO:teuthology.orchestra.run.smithi081.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-29T11:11:33.306 INFO:teuthology.orchestra.run.smithi081.stdout:which means they are currently configured by ifupdown: 2023-11-29T11:11:33.306 INFO:teuthology.orchestra.run.smithi081.stdout:- enp3s0f1 2023-11-29T11:11:33.307 INFO:teuthology.orchestra.run.smithi081.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-29T11:11:33.307 INFO:teuthology.orchestra.run.smithi081.stdout:remove their configuration from /etc/network/interfaces. 2023-11-29T11:11:33.307 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:33.421 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-29T11:11:33.462 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-29T11:11:33.556 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-29T11:11:33.793 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-29T11:11:34.335 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-29T11:11:34.526 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-29T11:11:34.794 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up dump (0.4b46-6) ... 2023-11-29T11:11:34.828 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-29T11:11:34.892 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-29T11:11:34.963 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-29T11:11:34.963 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-29T11:11:35.097 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-29T11:11:35.114 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-29T11:11:35.198 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-29T11:11:35.240 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-29T11:11:35.316 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-29T11:11:35.366 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-29T11:11:35.492 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-29T11:11:35.492 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-29T11:11:35.618 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-29T11:11:35.643 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-29T11:11:35.769 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-29T11:11:35.986 INFO:teuthology.orchestra.run.smithi176.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-29T11:11:35.999 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-29T11:11:36.036 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-29T11:11:36.036 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-29T11:11:36.048 INFO:teuthology.orchestra.run.smithi176.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-29T11:11:36.048 INFO:teuthology.orchestra.run.smithi176.stdout:This user must also own the server process. 2023-11-29T11:11:36.049 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:36.049 INFO:teuthology.orchestra.run.smithi176.stdout:The database cluster will be initialized with locale "en_US". 2023-11-29T11:11:36.049 INFO:teuthology.orchestra.run.smithi176.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-29T11:11:36.049 INFO:teuthology.orchestra.run.smithi176.stdout:The default text search configuration will be set to "english". 2023-11-29T11:11:36.049 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:36.049 INFO:teuthology.orchestra.run.smithi176.stdout:Data page checksums are disabled. 2023-11-29T11:11:36.049 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:36.049 INFO:teuthology.orchestra.run.smithi176.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-29T11:11:36.050 INFO:teuthology.orchestra.run.smithi176.stdout:creating subdirectories ... ok 2023-11-29T11:11:36.050 INFO:teuthology.orchestra.run.smithi176.stdout:selecting dynamic shared memory implementation ... posix 2023-11-29T11:11:36.070 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default max_connections ... 100 2023-11-29T11:11:36.092 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default shared_buffers ... 128MB 2023-11-29T11:11:36.106 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default time zone ... Etc/UTC 2023-11-29T11:11:36.107 INFO:teuthology.orchestra.run.smithi176.stdout:creating configuration files ... ok 2023-11-29T11:11:36.215 INFO:teuthology.orchestra.run.smithi176.stdout:running bootstrap script ... ok 2023-11-29T11:11:36.565 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-29T11:11:36.673 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-29T11:11:36.770 INFO:teuthology.orchestra.run.smithi176.stdout:performing post-bootstrap initialization ... ok 2023-11-29T11:11:36.815 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-29T11:11:36.967 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-29T11:11:37.260 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-29T11:11:37.529 INFO:teuthology.orchestra.run.smithi176.stdout:syncing data to disk ... ok 2023-11-29T11:11:37.530 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:37.530 INFO:teuthology.orchestra.run.smithi176.stdout:Success. You can now start the database server using: 2023-11-29T11:11:37.530 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:37.530 INFO:teuthology.orchestra.run.smithi176.stdout: pg_ctlcluster 12 main start 2023-11-29T11:11:37.530 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:37.851 INFO:teuthology.orchestra.run.smithi176.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-29T11:11:37.852 INFO:teuthology.orchestra.run.smithi176.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-29T11:11:37.937 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-29T11:11:40.899 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-29T11:11:41.043 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-29T11:11:41.185 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-29T11:11:41.353 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-29T11:11:41.478 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-29T11:11:41.613 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-29T11:11:42.325 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-29T11:11:42.326 INFO:teuthology.orchestra.run.smithi176.stdout:which means they are currently configured by ifupdown: 2023-11-29T11:11:42.326 INFO:teuthology.orchestra.run.smithi176.stdout:- enp3s0f1 2023-11-29T11:11:42.326 INFO:teuthology.orchestra.run.smithi176.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-29T11:11:42.326 INFO:teuthology.orchestra.run.smithi176.stdout:remove their configuration from /etc/network/interfaces. 2023-11-29T11:11:42.326 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:42.489 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-29T11:11:42.821 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-29T11:11:43.299 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-29T11:11:43.807 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-29T11:11:43.959 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-29T11:11:44.118 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-29T11:11:44.244 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-29T11:11:44.387 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-29T11:11:44.521 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-29T11:11:44.632 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-29T11:11:44.647 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-29T11:11:44.740 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-29T11:11:44.790 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-29T11:11:45.061 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-29T11:11:45.061 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-29T11:11:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-29T11:11:45.540 DEBUG:teuthology.parallel:result is None 2023-11-29T11:11:45.601 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-29T11:11:45.710 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-29T11:11:45.827 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-29T11:11:45.979 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-29T11:11:46.272 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-29T11:11:53.711 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-29T11:11:53.820 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-29T11:11:54.671 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-29T11:11:54.673 DEBUG:teuthology.parallel:result is None 2023-11-29T11:11:54.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-29T11:11:54.906 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2023-11-29T11:11:54.930 INFO:teuthology.orchestra.run.smithi081.stdout:18.0.0-2697-g2f5f6028-1focal 2023-11-29T11:11:54.930 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697-g2f5f6028-1focal 2023-11-29T11:11:54.930 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697-g2f5f6028-1focal is installed. 2023-11-29T11:11:54.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-29T11:11:55.069 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-query -W -f '${Version}' ceph 2023-11-29T11:11:55.093 INFO:teuthology.orchestra.run.smithi176.stdout:18.0.0-2697-g2f5f6028-1focal 2023-11-29T11:11:55.093 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697-g2f5f6028-1focal 2023-11-29T11:11:55.093 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697-g2f5f6028-1focal is installed. 2023-11-29T11:11:55.093 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-29T11:11:55.093 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:55.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-29T11:11:55.110 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:11:55.110 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-29T11:11:55.126 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-29T11:11:55.127 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:55.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-11-29T11:11:55.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-29T11:11:55.199 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:11:55.200 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2023-11-29T11:11:55.215 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-29T11:11:55.230 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-29T11:11:55.231 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:55.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-29T11:11:55.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-29T11:11:55.302 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:11:55.302 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-29T11:11:55.318 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-29T11:11:55.327 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-29T11:11:55.327 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:55.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-11-29T11:11:55.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-29T11:11:55.354 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:11:55.354 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2023-11-29T11:11:55.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-29T11:11:55.396 INFO:teuthology.run_tasks:Running task ceph... 2023-11-29T11:11:55.455 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-29T11:11:55.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-11-29T11:11:55.457 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2023-11-29T11:11:55.473 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-29T11:11:55.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-29T11:11:55.475 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-29T11:11:55.529 INFO:tasks.ceph:Creating extra log directories... 2023-11-29T11:11:55.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-29T11:11:55.532 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-29T11:11:55.551 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-29T11:11:55.551 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-29T11:11:55.551 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-29T11:11:55.551 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:55.551 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-29T11:11:55.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-29T11:11:55.591 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:11:55.591 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-29T11:11:55.598 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-29T11:11:55.681 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-29T11:11:55.681 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-29T11:11:55.681 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607', 'branch': 'wip-neesingh-testing-231123', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7470607', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-231123'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'issue_54557', 'sha1': '7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 10, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1315, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'issue_54557', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '735a43c3d8e74286f980f1d14817fb093cd8147e', 'timestamp': '2023-11-29_10:52:27', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-29T11:11:55.682 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-29T11:11:55.684 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-29T11:11:55.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-11-29T11:11:55.692 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2023-11-29T11:11:55.706 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:55.706 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-11-29T11:11:55.712 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-29T11:11:55.712 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-11-29T11:11:55.718 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-29T11:11:55.718 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T11:11:55.718 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 350 Links: 1 2023-11-29T11:11:55.718 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T11:11:55.718 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-11-29 11:07:14.766945816 +0000 2023-11-29T11:11:55.718 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-11-29 11:07:14.498951992 +0000 2023-11-29T11:11:55.718 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-11-29 11:07:14.498951992 +0000 2023-11-29T11:11:55.718 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-11-29T11:11:55.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-29T11:11:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-11-29T11:11:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-11-29T11:11:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000348278 s, 1.5 MB/s 2023-11-29T11:11:55.733 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-29T11:11:55.784 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-11-29T11:11:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-29T11:11:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T11:11:55.791 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 356 Links: 1 2023-11-29T11:11:55.792 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T11:11:55.792 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-11-29 11:07:15.266934290 +0000 2023-11-29T11:11:55.792 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-11-29 11:07:14.986940745 +0000 2023-11-29T11:11:55.792 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-11-29 11:07:14.986940745 +0000 2023-11-29T11:11:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-11-29T11:11:55.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-29T11:11:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-11-29T11:11:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-11-29T11:11:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000389032 s, 1.3 MB/s 2023-11-29T11:11:55.807 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-29T11:11:55.856 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-11-29T11:11:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-29T11:11:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T11:11:55.863 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-11-29T11:11:55.864 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T11:11:55.864 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-11-29 11:07:15.494929035 +0000 2023-11-29T11:11:55.864 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-11-29 11:07:15.490929128 +0000 2023-11-29T11:11:55.864 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-11-29 11:07:15.490929128 +0000 2023-11-29T11:11:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-11-29T11:11:55.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-29T11:11:55.878 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-11-29T11:11:55.878 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-11-29T11:11:55.878 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000396432 s, 1.3 MB/s 2023-11-29T11:11:55.879 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-29T11:11:55.928 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-11-29T11:11:55.935 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-29T11:11:55.935 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T11:11:55.935 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 369 Links: 1 2023-11-29T11:11:55.935 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T11:11:55.935 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-11-29 11:07:16.270911148 +0000 2023-11-29T11:11:55.935 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-11-29 11:07:15.998917418 +0000 2023-11-29T11:11:55.935 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-11-29 11:07:15.998917418 +0000 2023-11-29T11:11:55.935 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-11-29T11:11:55.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-29T11:11:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-11-29T11:11:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-11-29T11:11:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000426508 s, 1.2 MB/s 2023-11-29T11:11:55.948 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-29T11:11:56.000 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-29T11:11:56.000 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:11:56.000 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2023-11-29T11:11:56.007 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-29T11:11:56.007 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2023-11-29T11:11:56.014 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-29T11:11:56.015 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T11:11:56.015 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-11-29T11:11:56.015 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T11:11:56.015 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-11-29 11:07:14.566485705 +0000 2023-11-29T11:11:56.015 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-11-29 11:07:14.314491505 +0000 2023-11-29T11:11:56.015 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-11-29 11:07:14.314491505 +0000 2023-11-29T11:11:56.015 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2023-11-29T11:11:56.015 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-29T11:11:56.067 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-11-29T11:11:56.068 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-11-29T11:11:56.068 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000367785 s, 1.4 MB/s 2023-11-29T11:11:56.069 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-29T11:11:56.077 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2023-11-29T11:11:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-29T11:11:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T11:11:56.084 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-11-29T11:11:56.084 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T11:11:56.084 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-11-29 11:07:15.098473463 +0000 2023-11-29T11:11:56.084 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-11-29 11:07:14.810480091 +0000 2023-11-29T11:11:56.084 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-11-29 11:07:14.810480091 +0000 2023-11-29T11:11:56.084 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2023-11-29T11:11:56.084 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-29T11:11:56.141 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-11-29T11:11:56.141 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-11-29T11:11:56.142 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000404324 s, 1.3 MB/s 2023-11-29T11:11:56.143 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-29T11:11:56.150 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2023-11-29T11:11:56.156 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-29T11:11:56.156 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T11:11:56.156 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-11-29T11:11:56.156 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T11:11:56.156 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-11-29 11:07:15.322468309 +0000 2023-11-29T11:11:56.156 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-11-29 11:07:15.318468400 +0000 2023-11-29T11:11:56.156 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-11-29 11:07:15.318468400 +0000 2023-11-29T11:11:56.156 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2023-11-29T11:11:56.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-29T11:11:56.213 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-11-29T11:11:56.213 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-11-29T11:11:56.213 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000395852 s, 1.3 MB/s 2023-11-29T11:11:56.214 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-29T11:11:56.223 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2023-11-29T11:11:56.228 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-29T11:11:56.228 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-29T11:11:56.228 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-11-29T11:11:56.228 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T11:11:56.228 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-11-29 11:07:16.126449807 +0000 2023-11-29T11:11:56.229 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-11-29 11:07:15.854456065 +0000 2023-11-29T11:11:56.229 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-11-29 11:07:15.854456065 +0000 2023-11-29T11:11:56.229 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2023-11-29T11:11:56.229 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-29T11:11:56.285 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-11-29T11:11:56.285 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-11-29T11:11:56.286 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000414771 s, 1.2 MB/s 2023-11-29T11:11:56.286 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-29T11:11:56.294 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-29T11:11:56.295 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-29T11:11:56.295 INFO:tasks.ceph:Generating config... 2023-11-29T11:11:56.296 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-29T11:11:56.296 INFO:tasks.ceph:[client] debug client = 20 2023-11-29T11:11:56.296 INFO:tasks.ceph:[client] debug ms = 1 2023-11-29T11:11:56.296 INFO:tasks.ceph:[client] pid file = 2023-11-29T11:11:56.296 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-29T11:11:56.296 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-29T11:11:56.296 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-29T11:11:56.296 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-29T11:11:56.296 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-29T11:11:56.297 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-29T11:11:56.297 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-29T11:11:56.297 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-29T11:11:56.297 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-29T11:11:56.298 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-29T11:11:56.298 INFO:tasks.ceph:Setting up mon.a... 2023-11-29T11:11:56.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-29T11:11:56.340 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2023-11-29T11:11:56.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-29T11:11:56.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-29T11:11:56.461 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2023-11-29T11:11:56.462 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-29T11:11:56.462 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:56.463 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-29T11:11:56.467 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:11:56.553 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:11:56.553 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 8e4db050-5755-42f7-ba76-f62443203ed8 2023-11-29T11:11:56.553 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = pacific 2023-11-29T11:11:56.553 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2023-11-29T11:11:56.553 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 8e4db050-5755-42f7-ba76-f62443203ed8 2023-11-29T11:11:56.553 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2023-11-29T11:11:56.552624+0000 2023-11-29T11:11:56.553 INFO:teuthology.orchestra.run.smithi081.stdout:created 2023-11-29T11:11:56.552624+0000 2023-11-29T11:11:56.554 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 16 (pacific) 2023-11-29T11:11:56.554 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2023-11-29T11:11:56.554 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2023-11-29T11:11:56.554 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2023-11-29T11:11:56.554 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2023-11-29T11:11:56.554 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-29T11:11:56.555 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-29T11:11:56.561 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8e4db050-5755-42f7-ba76-f62443203ed8... 2023-11-29T11:11:56.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-29T11:11:56.565 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-11-29T11:11:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-11-29T11:11:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 8e4db050-5755-42f7-ba76-f62443203ed8 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-11-29T11:11:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-11-29T11:11:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-11-29T11:11:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-11-29T11:11:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-11-29T11:11:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-29T11:11:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-29T11:11:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-11-29T11:11:56.607 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-11-29T11:11:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2023-11-29T11:11:56.610 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.611 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.612 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.81,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 8e4db050-5755-42f7-ba76-f62443203ed8 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.613 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2023-11-29T11:11:56.614 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.615 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 20 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 20 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 10 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2023-11-29T11:11:56.616 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2023-11-29T11:11:56.617 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.618 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2023-11-29T11:11:56.619 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2023-11-29T11:11:56.620 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2023-11-29T11:11:56.621 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2023-11-29T11:11:56.621 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-29T11:11:56.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-29T11:11:56.675 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-29T11:11:56.675 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:56.675 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-29T11:11:56.681 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:56.682 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-29T11:11:56.688 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:11:56.688 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:56.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-29T11:11:56.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-29T11:11:56.711 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:11:56.711 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:11:56.716 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:11:56.717 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:11:56.717 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-29T11:11:56.717 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-29T11:11:56.743 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:11:56.743 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:11:56.749 INFO:tasks.ceph:Setting up mon nodes... 2023-11-29T11:11:56.749 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-29T11:11:56.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-29T11:11:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-29T11:11:56.801 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-29T11:11:56.850 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-29T11:11:56.865 INFO:tasks.ceph:Setting up mds nodes... 2023-11-29T11:11:56.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-29T11:11:56.918 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-29T11:11:56.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-29T11:11:56.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-29T11:11:56.976 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-29T11:11:56.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-29T11:11:57.037 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-29T11:11:57.088 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-29T11:11:57.091 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-29T11:11:57.100 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-29T11:11:57.191 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-29T11:11:57.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-29T11:11:57.208 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-29T11:11:57.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-29T11:11:57.250 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-29T11:11:57.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-29T11:11:57.301 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-29T11:11:57.314 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-29T11:11:57.357 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-29T11:11:57.369 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-29T11:11:57.451 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-29T11:11:57.464 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-29T11:11:57.465 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-29T11:11:57.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-29T11:11:57.481 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-29T11:11:57.481 INFO:tasks.ceph:role: osd.0 2023-11-29T11:11:57.481 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:11:57.481 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-29T11:11:57.998 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T11:11:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T11:11:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T11:11:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-11-29T11:11:57.999 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T11:11:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-11-29T11:11:57.999 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T11:11:57.999 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-29T11:11:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T11:11:57.999 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T11:11:58.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-11-29T11:11:58.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-29T11:11:58.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-29T11:11:58.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:11:58.109 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-11-29T11:11:58.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-29T11:11:58.125 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-29T11:11:58.125 INFO:tasks.ceph:role: osd.1 2023-11-29T11:11:58.126 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:11:58.126 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-29T11:11:58.641 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T11:11:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T11:11:58.644 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-11-29T11:11:58.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-29T11:11:58.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-29T11:11:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-11-29T11:11:58.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:11:58.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-29T11:11:58.772 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-29T11:11:58.772 INFO:tasks.ceph:role: osd.2 2023-11-29T11:11:58.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:11:58.772 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-29T11:11:59.232 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T11:11:59.233 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T11:11:59.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-11-29T11:11:59.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-29T11:11:59.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-29T11:11:59.306 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-11-29T11:11:59.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:11:59.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-29T11:11:59.319 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-29T11:11:59.319 INFO:tasks.ceph:role: osd.3 2023-11-29T11:11:59.319 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:11:59.319 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-29T11:11:59.822 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T11:11:59.823 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T11:11:59.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-11-29T11:11:59.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-29T11:11:59.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-29T11:11:59.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:11:59.898 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-11-29T11:11:59.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:11:59.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:11:59.972+0000 7f283d7a2700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-29T11:11:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:11:59.972+0000 7f283d7a2700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-29T11:11:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:11:59.976+0000 7f283d7a2700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-29T11:11:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:11:59.976+0000 7f283d7a2700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-29T11:11:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:11:59.976+0000 7f283d7a2700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-29T11:11:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:11:59.976+0000 7f283d7a2700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-29T11:12:03.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-29T11:12:03.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:03.328+0000 7f8567608700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-29T11:12:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:03.328+0000 7f8567608700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-29T11:12:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:03.328+0000 7f8567608700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-29T11:12:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:03.328+0000 7f8567608700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-29T11:12:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:03.328+0000 7f8567608700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-29T11:12:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:03.328+0000 7f8567608700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-29T11:12:06.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-29T11:12:06.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:06.636+0000 7f79127e9700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-29T11:12:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:06.636+0000 7f79127e9700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-29T11:12:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:06.636+0000 7f79127e9700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-29T11:12:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:06.636+0000 7f79127e9700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-29T11:12:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:06.636+0000 7f79127e9700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-29T11:12:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:06.640+0000 7f79127e9700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-29T11:12:09.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-29T11:12:09.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:09.756+0000 7fac04c2b700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-29T11:12:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:09.756+0000 7fac04c2b700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-29T11:12:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:09.756+0000 7fac04c2b700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-29T11:12:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:09.756+0000 7fac04c2b700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-29T11:12:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:09.756+0000 7fac04c2b700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-29T11:12:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:09.756+0000 7fac04c2b700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-29T11:12:12.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-29T11:12:12.780 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-29T11:12:12.797 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-29T11:12:12.797 INFO:tasks.ceph:role: osd.4 2023-11-29T11:12:12.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:12:12.798 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-29T11:12:13.377 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T11:12:13.377 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T11:12:13.378 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T11:12:13.378 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2023-11-29T11:12:13.378 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T11:12:13.378 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-11-29T11:12:13.378 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T11:12:13.378 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-29T11:12:13.378 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T11:12:13.378 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T11:12:13.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-11-29T11:12:13.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-29T11:12:13.478 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-29T11:12:13.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:12:13.489 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2023-11-29T11:12:13.490 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-29T11:12:13.501 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-29T11:12:13.501 INFO:tasks.ceph:role: osd.5 2023-11-29T11:12:13.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:12:13.501 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-29T11:12:14.031 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T11:12:14.032 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T11:12:14.033 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-11-29T11:12:14.034 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-29T11:12:14.074 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-29T11:12:14.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:12:14.126 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2023-11-29T11:12:14.126 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-29T11:12:14.138 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-29T11:12:14.138 INFO:tasks.ceph:role: osd.6 2023-11-29T11:12:14.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:12:14.138 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-29T11:12:14.602 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T11:12:14.603 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T11:12:14.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-11-29T11:12:14.605 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-29T11:12:14.666 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-29T11:12:14.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:12:14.679 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2023-11-29T11:12:14.679 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-29T11:12:14.689 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-29T11:12:14.690 INFO:tasks.ceph:role: osd.7 2023-11-29T11:12:14.690 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:12:14.690 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-29T11:12:15.231 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-29T11:12:15.232 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-29T11:12:15.233 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-11-29T11:12:15.233 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-29T11:12:15.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-29T11:12:15.301 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: /sbin/restorecon: command not found 2023-11-29T11:12:15.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:12:15.303 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:15.365 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:15.357+0000 7ff530440700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-29T11:12:15.367 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:15.357+0000 7ff530440700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-29T11:12:15.367 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:15.357+0000 7ff530440700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-29T11:12:15.367 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:15.357+0000 7ff530440700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-29T11:12:15.367 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:15.357+0000 7ff530440700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-29T11:12:15.369 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:15.361+0000 7ff530440700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-29T11:12:18.631 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-29T11:12:18.646 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:18.737 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:18.729+0000 7fdfcf0f8700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-29T11:12:18.737 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:18.729+0000 7fdfcf0f8700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-29T11:12:18.738 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:18.729+0000 7fdfcf0f8700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-29T11:12:18.738 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:18.729+0000 7fdfcf0f8700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-29T11:12:18.738 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:18.729+0000 7fdfcf0f8700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-29T11:12:18.738 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:18.729+0000 7fdfcf0f8700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-29T11:12:21.763 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-29T11:12:21.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:21.821 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:21.813+0000 7fa3ff568700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-29T11:12:21.821 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:21.813+0000 7fa3ff568700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-29T11:12:21.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:21.813+0000 7fa3ff568700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-29T11:12:21.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:21.813+0000 7fa3ff568700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-29T11:12:21.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:21.813+0000 7fa3ff568700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-29T11:12:21.822 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:21.813+0000 7fa3ff568700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-29T11:12:24.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-29T11:12:24.860 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:24.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:24.897+0000 7f33c98cc700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-29T11:12:24.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:24.897+0000 7f33c98cc700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-29T11:12:24.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:24.897+0000 7f33c98cc700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-29T11:12:24.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:24.897+0000 7f33c98cc700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-29T11:12:24.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:24.897+0000 7f33c98cc700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-29T11:12:24.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:24.897+0000 7f33c98cc700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-29T11:12:25.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:12:25.685 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:12:27.894 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-29T11:12:27.907 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-29T11:12:27.907 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:27.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-29T11:12:27.923 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:27.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-29T11:12:27.934 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:27.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-29T11:12:27.992 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:27.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-29T11:12:28.002 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:28.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-29T11:12:28.015 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:28.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-29T11:12:28.071 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:28.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-29T11:12:28.083 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.083 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-29T11:12:28.098 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.098 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-29T11:12:28.107 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.108 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-29T11:12:28.123 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.123 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-29T11:12:28.135 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.135 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-29T11:12:28.194 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-29T11:12:28.203 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.203 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-29T11:12:28.213 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:28.213 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-29T11:12:28.220 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:28.220 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-29T11:12:28.270 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.270 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-29T11:12:28.277 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:28.277 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-29T11:12:28.284 INFO:tasks.ceph:Adding keys to all mons... 2023-11-29T11:12:28.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-29T11:12:28.286 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-29T11:12:28.298 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB8HGdlcf6LLxAAqtoEWzgd41N9uT9tC7bZ/Q== 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB8HGdlSOayNhAAtezph/rP5i/F81/canwMdA== 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB8HGdlIykpOhAAL31egdG19jdsaMglEpIC5w== 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB/HGdl92Q/OhAAXGWXiUvswEMnfzScuUn0cw== 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCDHGdl8TbZExAA2IBrIVdDMSaeGFjE0oBYFw== 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2023-11-29T11:12:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCGHGdlUk9QJhAA3rf+afNjbbsQotcH4YjVQg== 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCJHGdlUPFnLRAAk4y/WOW2lDfYd22+GF2QlA== 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB8HGdlqaiZMhAAPiboTL+csIYuoxSk+ZwfJA== 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9HGdl8qMjBRAAuvMDj+jPn1OjXUEcUl34jg== 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9HGdlKA1GCxAAOzBuOUs7pjJJOOFwZq8npA== 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCPHGdlLLatFRAAz4dG1oXNEITKomtPGnDBmw== 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCSHGdl34DRKxAAt8kHY0+FALSWN612SIOnsQ== 2023-11-29T11:12:28.302 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCVHGdl4zPUMBAAsF8NTRCGqXpRuVduNnWO1A== 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCYHGdlQv/DNRAAFMTV+dTJZ0UZK2eCJiFDuw== 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9HGdlgxnnDhAAfROm0RfwzNurvq62gqmGBQ== 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9HGdlvfbxERAA6d5eRkOBOKhyToZKDKlvYQ== 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9HGdlgjcpFRAAtcxPbxV34mCHxFVoGYmqmg== 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2023-11-29T11:12:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9HGdlDrDHGhAAfy4RAK8qFAj2Sf6GuRGhBw== 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB8HGdlcf6LLxAAqtoEWzgd41N9uT9tC7bZ/Q== 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB8HGdlSOayNhAAtezph/rP5i/F81/canwMdA== 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB8HGdlIykpOhAAL31egdG19jdsaMglEpIC5w== 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB/HGdl92Q/OhAAXGWXiUvswEMnfzScuUn0cw== 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCDHGdl8TbZExAA2IBrIVdDMSaeGFjE0oBYFw== 2023-11-29T11:12:28.305 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCGHGdlUk9QJhAA3rf+afNjbbsQotcH4YjVQg== 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCJHGdlUPFnLRAAk4y/WOW2lDfYd22+GF2QlA== 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB8HGdlqaiZMhAAPiboTL+csIYuoxSk+ZwfJA== 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB9HGdl8qMjBRAAuvMDj+jPn1OjXUEcUl34jg== 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB9HGdlKA1GCxAAOzBuOUs7pjJJOOFwZq8npA== 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCPHGdlLLatFRAAz4dG1oXNEITKomtPGnDBmw== 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCSHGdl34DRKxAAt8kHY0+FALSWN612SIOnsQ== 2023-11-29T11:12:28.306 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCVHGdl4zPUMBAAsF8NTRCGqXpRuVduNnWO1A== 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQCYHGdlQv/DNRAAFMTV+dTJZ0UZK2eCJiFDuw== 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB9HGdlgxnnDhAAfROm0RfwzNurvq62gqmGBQ== 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB9HGdlvfbxERAA6d5eRkOBOKhyToZKDKlvYQ== 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB9HGdlgjcpFRAAtcxPbxV34mCHxFVoGYmqmg== 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2023-11-29T11:12:28.307 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB9HGdlDrDHGhAAfy4RAK8qFAj2Sf6GuRGhBw== 2023-11-29T11:12:28.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-29T11:12:28.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-29T11:12:28.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-29T11:12:28.405 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-29T11:12:28.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-29T11:12:28.457 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-29T11:12:28.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.512 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.561 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.654 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.706 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-29T11:12:28.759 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-29T11:12:28.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-29T11:12:28.810 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-29T11:12:28.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-29T11:12:28.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-29T11:12:28.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.915 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:28.964 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:29.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:29.046 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:29.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:29.099 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-29T11:12:29.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T11:12:29.145 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T11:12:29.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T11:12:29.198 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T11:12:29.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T11:12:29.251 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T11:12:29.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T11:12:29.301 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-29T11:12:29.354 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-29T11:12:29.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-29T11:12:29.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-29T11:12:29.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-29T11:12:29.512 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-29T11:12:29.529 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-29T11:12:29.616 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-29T11:12:29.633 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-29T11:12:29.690 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-29T11:12:29.752 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-29T11:12:29.764 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:29.766 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-29T11:12:29.813 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-29T11:12:29.813 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-29T11:12:29.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-29T11:12:29.815 INFO:tasks.ceph.mon.a:Started 2023-11-29T11:12:29.816 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-29T11:12:29.816 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-29T11:12:29.818 INFO:tasks.ceph.mon.b:Started 2023-11-29T11:12:29.818 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-29T11:12:29.818 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-29T11:12:29.820 INFO:tasks.ceph.mon.c:Started 2023-11-29T11:12:29.820 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-29T11:12:29.820 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-29T11:12:29.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-29T11:12:29.823 INFO:tasks.ceph.mgr.y:Started 2023-11-29T11:12:29.823 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-29T11:12:29.823 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-29T11:12:29.825 INFO:tasks.ceph.mgr.x:Started 2023-11-29T11:12:29.825 INFO:tasks.ceph:Setting crush tunables to default 2023-11-29T11:12:29.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2023-11-29T11:12:29.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f6235034700 1 Processor -- start 2023-11-29T11:12:29.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f6235034700 1 -- start start 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f6235034700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f6235034700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f6235034700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62300b16e0 con 0x7f623006ad50 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f6235034700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623015cac0 con 0x7f623015c6f0 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f6235034700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62300b3780 con 0x7f62300b0bf0 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622f59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f623006ad50 0x7f62300c9380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33040/0 (socket says 172.21.15.81:33040) 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622f59e700 1 -- 172.21.15.81:0/2877586945 learned_addr learned my addr 172.21.15.81:0/2877586945 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-29T11:12:29.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:29.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:29.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:12:29.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-29T11:12:29.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:29.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:29.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:29.947+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:12:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-29T11:12:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-29T11:12:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:12:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.151+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-29T11:12:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-29T11:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:12:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:30.555+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:12:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-29T11:12:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-29T11:12:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:12:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:31.359+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:12:32.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622cd99700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 msgr2=0x7f62300b3240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:12:32.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622cd99700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62300b0bf0 0x7f62300b3240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:32.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622cd99700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 msgr2=0x7f62300cac60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622cd99700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.176:3300/0 conn(0x7f623015c6f0 0x7f62300cac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622cd99700 1 -- 172.21.15.81:0/2877586945 >> v1:172.21.15.81:6789/0 conn(0x7f623006ad50 legacy=0x7f62300c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622cd99700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622cd99700 1 -- 172.21.15.81:0/2877586945 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623015daa0 con 0x7f6210003720 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622cd99700 1 -- 172.21.15.81:0/2877586945 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623015cac0 con 0x7f62100073c0 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:32.947+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-29T11:12:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.151+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.151+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-29T11:12:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.151+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.151+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.151+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-29T11:12:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.555+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.555+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-29T11:12:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.555+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.555+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:33.555+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-29T11:12:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:34.359+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:34.359+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-29T11:12:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:34.359+0000 7f622e59c700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-29T11:12:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:34.359+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-29T11:12:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:34.359+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-29T11:12:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888390294 0 0) 0x7f623015daa0 con 0x7f6210003720 2023-11-29T11:12:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f621c0035d0 con 0x7f6210003720 2023-11-29T11:12:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2409704990 0 0) 0x7f621c0035d0 con 0x7f6210003720 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 msgr2=0x7f6210009850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 --2- 172.21.15.81:0/2877586945 >> v2:172.21.15.81:3300/0 conn(0x7f62100073c0 0x7f6210009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621000af50 con 0x7f6210003720 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f6220009a00 con 0x7f6210003720 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 >> v1:172.21.15.176:6789/0 conn(0x7f6210003720 legacy=0x7f6210005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622f59e700 1 -- 172.21.15.81:0/2877586945 reap_dead start 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f621c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c004870 0x7f621c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c005420 0x7f621c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623015cac0 con 0x7f621c003a70 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c00c2c0 con 0x7f621c004870 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c00c480 con 0x7f621c005420 2023-11-29T11:12:35.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f621c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622f59e700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c005420 0x7f621c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622e59c700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c004870 0x7f621c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c005420 msgr2=0x7f621c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c005420 0x7f621c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c004870 msgr2=0x7f621c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c004870 0x7f621c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622ed9d700 1 -- 172.21.15.81:0/2877586945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0035d0 con 0x7f621c003a70 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622f59e700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c005420 0x7f621c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:35.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.043+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f621c003e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6220004170 tx=0x7f621c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17256394d2c46177 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:35.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220003bc0 con 0x7f621c003a70 2023-11-29T11:12:35.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622000f040 con 0x7f621c003a70 2023-11-29T11:12:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f622dd9b700 1 -- 172.21.15.81:0/2877586945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62200168a0 con 0x7f621c003a70 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 -- 172.21.15.81:0/2877586945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 msgr2=0x7f621c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f621c003e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6220004170 tx=0x7f621c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 -- 172.21.15.81:0/2877586945 shutdown_connections 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c005420 0x7f621c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c004870 0x7f621c004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 --2- 172.21.15.81:0/2877586945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f621c003e60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 -- 172.21.15.81:0/2877586945 >> 172.21.15.81:0/2877586945 conn(0x7f62300cf4a0 msgr2=0x7f62300cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 -- 172.21.15.81:0/2877586945 shutdown_connections 2023-11-29T11:12:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.051+0000 7f6235034700 1 -- 172.21.15.81:0/2877586945 wait complete. 2023-11-29T11:12:35.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f6235034700 1 Processor -- start 2023-11-29T11:12:35.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f6235034700 1 -- start start 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f6235034700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f62300c1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f6235034700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c004870 0x7f623014c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f6235034700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c005420 0x7f62300b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f6235034700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c81a0 con 0x7f621c003a70 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f6235034700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c6e20 con 0x7f621c005420 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f6235034700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c7100 con 0x7f621c004870 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f62300c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f62300c1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43102/0 (socket says 172.21.15.81:43102) 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622ed9d700 1 -- 172.21.15.81:0/2549738327 learned_addr learned my addr 172.21.15.81:0/2549738327 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:35.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622e59c700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c004870 0x7f623014c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622f59e700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c005420 0x7f62300b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622ed9d700 1 -- 172.21.15.81:0/2549738327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c004870 msgr2=0x7f623014c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c004870 0x7f623014c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622ed9d700 1 -- 172.21.15.81:0/2549738327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c005420 msgr2=0x7f62300b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c005420 0x7f62300b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.055+0000 7f622ed9d700 1 -- 172.21.15.81:0/2549738327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300b1c10 con 0x7f621c003a70 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.059+0000 7f622ed9d700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f62300c1690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c290 tx=0x7f6220004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.059+0000 7f62277fe700 1 -- 172.21.15.81:0/2549738327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220003bc0 con 0x7f621c003a70 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.059+0000 7f62277fe700 1 -- 172.21.15.81:0/2549738327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220016da0 con 0x7f621c003a70 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.059+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62300b1930 con 0x7f621c003a70 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.059+0000 7f62277fe700 1 -- 172.21.15.81:0/2549738327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220021660 con 0x7f621c003a70 2023-11-29T11:12:35.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.059+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62300c8e60 con 0x7f621c003a70 2023-11-29T11:12:35.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.059+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62300ca590 con 0x7f621c003a70 2023-11-29T11:12:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.063+0000 7f62277fe700 1 -- 172.21.15.81:0/2549738327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f6220032070 con 0x7f621c003a70 2023-11-29T11:12:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.063+0000 7f62277fe700 1 -- 172.21.15.81:0/2549738327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6220035510 con 0x7f621c003a70 2023-11-29T11:12:35.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.063+0000 7f62277fe700 1 -- 172.21.15.81:0/2549738327 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6220030060 con 0x7f621c003a70 2023-11-29T11:12:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.135+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f62300cd890 con 0x7f621c003a70 2023-11-29T11:12:35.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.143+0000 7f62277fe700 1 -- 172.21.15.81:0/2549738327 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f622001a020 con 0x7f621c003a70 2023-11-29T11:12:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 msgr2=0x7f62300c1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f62300c1690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c290 tx=0x7f6220004af0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 shutdown_connections 2023-11-29T11:12:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f621c005420 0x7f62300b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f621c004870 0x7f623014c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 --2- 172.21.15.81:0/2549738327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c003a70 0x7f62300c1690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 >> 172.21.15.81:0/2549738327 conn(0x7f62300cf4a0 msgr2=0x7f6230152020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 shutdown_connections 2023-11-29T11:12:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:35.147+0000 7f6235034700 1 -- 172.21.15.81:0/2549738327 wait complete. 2023-11-29T11:12:35.150 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2023-11-29T11:12:35.164 INFO:tasks.ceph:check_enable_crimson: False 2023-11-29T11:12:35.164 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-29T11:12:35.164 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:35.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-29T11:12:35.177 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:35.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-29T11:12:35.187 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:35.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-29T11:12:35.197 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:12:35.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-29T11:12:35.210 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:35.210 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-29T11:12:35.228 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:35.228 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-29T11:12:35.249 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:35.247+0000 7f7ea23672c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-29T11:12:35.286 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:35.286 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-29T11:12:35.295 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:12:35.296 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-29T11:12:35.306 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 9ceedc3b-b336-48f1-9c10-c8dbdb875268 0 2023-11-29T11:12:35.424 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270c8f4700 1 Processor -- start 2023-11-29T11:12:35.424 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270c8f4700 1 -- start start 2023-11-29T11:12:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270c8f4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f270004f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270c8f4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f270004f880 0x7f270004fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270c8f4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27000064d0 con 0x7f2700006960 2023-11-29T11:12:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270c8f4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2700050210 con 0x7f270004f880 2023-11-29T11:12:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270c8f4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27000df220 con 0x7f27000dee50 2023-11-29T11:12:35.426 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f2706d9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f270004f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.427 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270659c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f270004f880 0x7f270004fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.427 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270659c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f270004f880 0x7f270004fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50646/0 (socket says 172.21.15.176:50646) 2023-11-29T11:12:35.427 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f2706d9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f270004f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41380/0 (socket says 172.21.15.176:41380) 2023-11-29T11:12:35.427 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270659c700 1 -- 172.21.15.176:0/290136106 learned_addr learned my addr 172.21.15.176:0/290136106 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270659c700 1 -- 172.21.15.176:0/290136106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 msgr2=0x7f270004f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270659c700 1 --2- 172.21.15.176:0/290136106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f270004f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270659c700 1 -- 172.21.15.176:0/290136106 >> v1:172.21.15.176:6789/0 conn(0x7f2700006960 legacy=0x7f2700006de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f270659c700 1 -- 172.21.15.176:0/290136106 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000340b0 con 0x7f270004f880 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.417+0000 7f2706d9d700 1 --2- 172.21.15.176:0/290136106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f270004f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270659c700 1 --2- 172.21.15.176:0/290136106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270004f880 0x7f270004fcd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009910 tx=0x7f26fc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73749e6b8cc88c3f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f2705d9b700 1 -- 172.21.15.176:0/290136106 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc011830 con 0x7f270004f880 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f2705d9b700 1 -- 172.21.15.176:0/290136106 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc011990 con 0x7f270004f880 2023-11-29T11:12:35.428 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f2705d9b700 1 -- 172.21.15.176:0/290136106 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc011d40 con 0x7f270004f880 2023-11-29T11:12:35.429 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 -- 172.21.15.176:0/290136106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270004f880 msgr2=0x7f270004fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.429 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 --2- 172.21.15.176:0/290136106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270004f880 0x7f270004fcd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009910 tx=0x7f26fc009c20 comp rx=0 tx=0).stop 2023-11-29T11:12:35.429 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 -- 172.21.15.176:0/290136106 shutdown_connections 2023-11-29T11:12:35.429 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 --2- 172.21.15.176:0/290136106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270004f880 0x7f270004fcd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.430 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 --2- 172.21.15.176:0/290136106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f270004f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.430 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 -- 172.21.15.176:0/290136106 >> 172.21.15.176:0/290136106 conn(0x7f2700051770 msgr2=0x7f2700051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:35.430 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 -- 172.21.15.176:0/290136106 shutdown_connections 2023-11-29T11:12:35.430 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 -- 172.21.15.176:0/290136106 wait complete. 2023-11-29T11:12:35.430 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 Processor -- start 2023-11-29T11:12:35.430 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 -- start start 2023-11-29T11:12:35.431 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.421+0000 7f270c8f4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2700006960 0x7f27000df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.431 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270c8f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f270004f880 0x7f27000d3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270c8f4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f27000d6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270c8f4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270004cc80 con 0x7f270004f880 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270c8f4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270004c600 con 0x7f2700006960 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270c8f4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27000d4190 con 0x7f27000dee50 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f2706d9d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2700006960 0x7f27000df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f2706d9d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2700006960 0x7f27000df360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50654/0 (socket says 172.21.15.176:50654) 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f2706d9d700 1 -- 172.21.15.176:0/164316232 learned_addr learned my addr 172.21.15.176:0/164316232 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270759e700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f27000d6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.432 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270659c700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f270004f880 0x7f27000d3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.433 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270759e700 1 -- 172.21.15.176:0/164316232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2700006960 msgr2=0x7f27000df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.433 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270759e700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2700006960 0x7f27000df360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270759e700 1 -- 172.21.15.176:0/164316232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f270004f880 msgr2=0x7f27000d3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270759e700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f270004f880 0x7f27000d3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270759e700 1 -- 172.21.15.176:0/164316232 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80094b0 con 0x7f27000dee50 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270759e700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f27000d6f80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2708069bb0 tx=0x7f27080723e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f26ef7fe700 1 -- 172.21.15.176:0/164316232 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708066f30 con 0x7f27000dee50 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f26ef7fe700 1 -- 172.21.15.176:0/164316232 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270804e1f0 con 0x7f27000dee50 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc009570 con 0x7f27000dee50 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f26ef7fe700 1 -- 172.21.15.176:0/164316232 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708067d60 con 0x7f27000dee50 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2700054770 con 0x7f27000dee50 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f26ef7fe700 1 -- 172.21.15.176:0/164316232 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2708092420 con 0x7f27000dee50 2023-11-29T11:12:35.434 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f26ef7fe700 1 -- 172.21.15.176:0/164316232 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2708091710 con 0x7f27000dee50 2023-11-29T11:12:35.435 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.425+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2700054490 con 0x7f27000dee50 2023-11-29T11:12:35.438 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.429+0000 7f26ef7fe700 1 -- 172.21.15.176:0/164316232 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2708097060 con 0x7f27000dee50 2023-11-29T11:12:35.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.505+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9ceedc3b-b336-48f1-9c10-c8dbdb875268", "id": 0} v 0) v1 -- 0x7f2700006160 con 0x7f27000dee50 2023-11-29T11:12:35.524 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f26ef7fe700 1 -- 172.21.15.176:0/164316232 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ceedc3b-b336-48f1-9c10-c8dbdb875268", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f27080926b0 con 0x7f27000dee50 2023-11-29T11:12:35.525 INFO:teuthology.orchestra.run.smithi176.stdout:0 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 msgr2=0x7f27000d6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f27000d6f80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2708069bb0 tx=0x7f27080723e0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 shutdown_connections 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27000dee50 0x7f27000d6f80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f270004f880 0x7f27000d3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 --2- 172.21.15.176:0/164316232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2700006960 0x7f27000df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 >> 172.21.15.176:0/164316232 conn(0x7f2700051770 msgr2=0x7f270003a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 shutdown_connections 2023-11-29T11:12:35.526 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.517+0000 7f270c8f4700 1 -- 172.21.15.176:0/164316232 wait complete. 2023-11-29T11:12:35.541 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 0d2b15bd-daa8-455c-aba9-2539259bc473 1 2023-11-29T11:12:35.657 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f71c1700 1 Processor -- start 2023-11-29T11:12:35.657 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f71c1700 1 -- start start 2023-11-29T11:12:35.659 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f71c1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb8e80e29f0 0x7fb8e8055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.659 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f71c1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8e8038560 0x7fb8e803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.659 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f71c1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e8007360 con 0x7fb8e803b160 2023-11-29T11:12:35.659 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f71c1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80e2dc0 con 0x7fb8e8038560 2023-11-29T11:12:35.659 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f71c1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e8053f70 con 0x7fb8e80e29f0 2023-11-29T11:12:35.659 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f61bf700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb8e80e29f0 0x7fb8e8055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.659 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f61bf700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb8e80e29f0 0x7fb8e8055490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50670/0 (socket says 172.21.15.176:50670) 2023-11-29T11:12:35.660 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f61bf700 1 -- 172.21.15.176:0/3514554528 learned_addr learned my addr 172.21.15.176:0/3514554528 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:35.660 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.649+0000 7fb8f59be700 1 --2- 172.21.15.176:0/3514554528 >> v2:172.21.15.81:3300/0 conn(0x7fb8e8038560 0x7fb8e803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.661 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f61bf700 1 -- 172.21.15.176:0/3514554528 >> v2:172.21.15.81:3300/0 conn(0x7fb8e8038560 msgr2=0x7fb8e803ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:35.661 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f61bf700 1 --2- 172.21.15.176:0/3514554528 >> v2:172.21.15.81:3300/0 conn(0x7fb8e8038560 0x7fb8e803ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.661 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f61bf700 1 -- 172.21.15.176:0/3514554528 >> v1:172.21.15.81:6789/0 conn(0x7fb8e803b160 legacy=0x7fb8e80e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.661 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f61bf700 1 -- 172.21.15.176:0/3514554528 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e803b5a0 con 0x7fb8e80e29f0 2023-11-29T11:12:35.661 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f61bf700 1 --2- 172.21.15.176:0/3514554528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e80e29f0 0x7fb8e8055490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8012210 tx=0x7fb8ec009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40bbd83ed5f5c690 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:35.661 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f51bd700 1 -- 172.21.15.176:0/3514554528 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec011830 con 0x7fb8e80e29f0 2023-11-29T11:12:35.661 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f51bd700 1 -- 172.21.15.176:0/3514554528 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec011990 con 0x7fb8e80e29f0 2023-11-29T11:12:35.661 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f51bd700 1 -- 172.21.15.176:0/3514554528 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec011d20 con 0x7fb8e80e29f0 2023-11-29T11:12:35.662 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f71c1700 1 -- 172.21.15.176:0/3514554528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e80e29f0 msgr2=0x7fb8e8055490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.662 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f71c1700 1 --2- 172.21.15.176:0/3514554528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e80e29f0 0x7fb8e8055490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8012210 tx=0x7fb8ec009bf0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.662 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f71c1700 1 -- 172.21.15.176:0/3514554528 shutdown_connections 2023-11-29T11:12:35.662 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f71c1700 1 --2- 172.21.15.176:0/3514554528 >> v2:172.21.15.81:3300/0 conn(0x7fb8e8038560 0x7fb8e803ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.662 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f71c1700 1 --2- 172.21.15.176:0/3514554528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e80e29f0 0x7fb8e8055490 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.662 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f71c1700 1 -- 172.21.15.176:0/3514554528 >> 172.21.15.176:0/3514554528 conn(0x7fb8e8055c20 msgr2=0x7fb8e8056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:35.663 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f71c1700 1 -- 172.21.15.176:0/3514554528 shutdown_connections 2023-11-29T11:12:35.663 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.653+0000 7fb8f71c1700 1 -- 172.21.15.176:0/3514554528 wait complete. 2023-11-29T11:12:35.664 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f71c1700 1 Processor -- start 2023-11-29T11:12:35.665 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f71c1700 1 -- start start 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f71c1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e8038560 0x7fb8e804ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f71c1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8e803b160 0x7fb8e80ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f71c1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8e80e29f0 0x7fb8e80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f71c1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80e48b0 con 0x7fb8e80e29f0 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f71c1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80e56a0 con 0x7fb8e8038560 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f71c1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80e4a90 con 0x7fb8e803b160 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f61bf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e8038560 0x7fb8e804ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f59be700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8e803b160 0x7fb8e80ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f59be700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8e803b160 0x7fb8e80ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41404/0 (socket says 172.21.15.176:41404) 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.657+0000 7fb8f61bf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e8038560 0x7fb8e804ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50686/0 (socket says 172.21.15.176:50686) 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f59be700 1 -- 172.21.15.176:0/2506914633 learned_addr learned my addr 172.21.15.176:0/2506914633 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:35.668 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f69c0700 1 --2- 172.21.15.176:0/2506914633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8e80e29f0 0x7fb8e80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.669 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f59be700 1 -- 172.21.15.176:0/2506914633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e8038560 msgr2=0x7fb8e804ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.669 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f59be700 1 --2- 172.21.15.176:0/2506914633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e8038560 0x7fb8e804ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.669 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f59be700 1 -- 172.21.15.176:0/2506914633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8e80e29f0 msgr2=0x7fb8e80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.669 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f59be700 1 --2- 172.21.15.176:0/2506914633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8e80e29f0 0x7fb8e80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.669 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f59be700 1 -- 172.21.15.176:0/2506914633 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec009570 con 0x7fb8e803b160 2023-11-29T11:12:35.669 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f59be700 1 --2- 172.21.15.176:0/2506914633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8e803b160 0x7fb8e80ce530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000e9d0 tx=0x7fb8e000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:35.670 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8e6ffd700 1 -- 172.21.15.176:0/2506914633 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0009720 con 0x7fb8e803b160 2023-11-29T11:12:35.670 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8e6ffd700 1 -- 172.21.15.176:0/2506914633 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e000ee70 con 0x7fb8e803b160 2023-11-29T11:12:35.670 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e8007080 con 0x7fb8e803b160 2023-11-29T11:12:35.670 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8e6ffd700 1 -- 172.21.15.176:0/2506914633 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000ca90 con 0x7fb8e803b160 2023-11-29T11:12:35.670 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e8006dc0 con 0x7fb8e803b160 2023-11-29T11:12:35.670 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8e6ffd700 1 -- 172.21.15.176:0/2506914633 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb8e0019030 con 0x7fb8e803b160 2023-11-29T11:12:35.670 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8e6ffd700 1 -- 172.21.15.176:0/2506914633 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb8e00065e0 con 0x7fb8e803b160 2023-11-29T11:12:35.670 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.661+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e80538d0 con 0x7fb8e803b160 2023-11-29T11:12:35.674 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.665+0000 7fb8e6ffd700 1 -- 172.21.15.176:0/2506914633 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb8e0021060 con 0x7fb8e803b160 2023-11-29T11:12:35.752 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.745+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d2b15bd-daa8-455c-aba9-2539259bc473", "id": 1} v 0) v1 -- 0x7fb8e8005550 con 0x7fb8e803b160 2023-11-29T11:12:35.764 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8e6ffd700 1 -- 172.21.15.176:0/2506914633 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d2b15bd-daa8-455c-aba9-2539259bc473", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8e0017070 con 0x7fb8e803b160 2023-11-29T11:12:35.764 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-29T11:12:35.765 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8e803b160 msgr2=0x7fb8e80ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.765 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 --2- 172.21.15.176:0/2506914633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8e803b160 0x7fb8e80ce530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000e9d0 tx=0x7fb8e000ece0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.766 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 shutdown_connections 2023-11-29T11:12:35.766 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 --2- 172.21.15.176:0/2506914633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8e80e29f0 0x7fb8e80cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.766 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 --2- 172.21.15.176:0/2506914633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8e803b160 0x7fb8e80ce530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.766 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 --2- 172.21.15.176:0/2506914633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8e8038560 0x7fb8e804ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.766 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 >> 172.21.15.176:0/2506914633 conn(0x7fb8e8055c20 msgr2=0x7fb8e803e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:35.766 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 shutdown_connections 2023-11-29T11:12:35.766 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.757+0000 7fb8f71c1700 1 -- 172.21.15.176:0/2506914633 wait complete. 2023-11-29T11:12:35.781 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new b47aae37-55ec-499d-91be-b635b08e7cb8 2 2023-11-29T11:12:35.839 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:35.835+0000 7f7ea23672c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-29T11:12:35.895 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56efc0700 1 Processor -- start 2023-11-29T11:12:35.895 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56efc0700 1 -- start start 2023-11-29T11:12:35.896 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:35.891+0000 7f7ea23672c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-29T11:12:35.897 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56efc0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56806ce60 0x7fb5680d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.897 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56efc0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5680cce60 0x7fb56806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.897 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56efc0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680cd2d0 con 0x7fb5680cf470 2023-11-29T11:12:35.897 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56efc0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56815c8b0 con 0x7fb5680cce60 2023-11-29T11:12:35.897 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56efc0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56806d770 con 0x7fb56806ce60 2023-11-29T11:12:35.897 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56dfbe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56806ce60 0x7fb5680d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.897 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56dfbe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56806ce60 0x7fb5680d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41410/0 (socket says 172.21.15.176:41410) 2023-11-29T11:12:35.898 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56dfbe700 1 -- 172.21.15.176:0/911498637 learned_addr learned my addr 172.21.15.176:0/911498637 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:35.898 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56d7bd700 1 --2- 172.21.15.176:0/911498637 >> v2:172.21.15.81:3300/0 conn(0x7fb5680cce60 0x7fb56806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56dfbe700 1 -- 172.21.15.176:0/911498637 >> v2:172.21.15.81:3300/0 conn(0x7fb5680cce60 msgr2=0x7fb56806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56dfbe700 1 --2- 172.21.15.176:0/911498637 >> v2:172.21.15.81:3300/0 conn(0x7fb5680cce60 0x7fb56806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56dfbe700 1 -- 172.21.15.176:0/911498637 >> v1:172.21.15.81:6789/0 conn(0x7fb5680cf470 legacy=0x7fb5680cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56dfbe700 1 -- 172.21.15.176:0/911498637 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56806a7f0 con 0x7fb56806ce60 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56d7bd700 1 --2- 172.21.15.176:0/911498637 >> v2:172.21.15.81:3300/0 conn(0x7fb5680cce60 0x7fb56806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56dfbe700 1 --2- 172.21.15.176:0/911498637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56806ce60 0x7fb5680d31b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb558009910 tx=0x7fb558009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce184029fbdb6e08 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56cfbc700 1 -- 172.21.15.176:0/911498637 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558011830 con 0x7fb56806ce60 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56cfbc700 1 -- 172.21.15.176:0/911498637 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb558011990 con 0x7fb56806ce60 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.889+0000 7fb56cfbc700 1 -- 172.21.15.176:0/911498637 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558011d40 con 0x7fb56806ce60 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- 172.21.15.176:0/911498637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56806ce60 msgr2=0x7fb5680d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 --2- 172.21.15.176:0/911498637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56806ce60 0x7fb5680d31b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb558009910 tx=0x7fb558009c20 comp rx=0 tx=0).stop 2023-11-29T11:12:35.900 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- 172.21.15.176:0/911498637 shutdown_connections 2023-11-29T11:12:35.901 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 --2- 172.21.15.176:0/911498637 >> v2:172.21.15.81:3300/0 conn(0x7fb5680cce60 0x7fb56806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.901 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 --2- 172.21.15.176:0/911498637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56806ce60 0x7fb5680d31b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.901 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- 172.21.15.176:0/911498637 >> 172.21.15.176:0/911498637 conn(0x7fb5680b5760 msgr2=0x7fb5680b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:35.901 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- 172.21.15.176:0/911498637 shutdown_connections 2023-11-29T11:12:35.901 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- 172.21.15.176:0/911498637 wait complete. 2023-11-29T11:12:35.901 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 Processor -- start 2023-11-29T11:12:35.901 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- start start 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56806ce60 0x7fb5680aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5680cce60 0x7fb5680b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5680cf470 0x7fb5680b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b4330 con 0x7fb5680cf470 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b4520 con 0x7fb56806ce60 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56efc0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b4800 con 0x7fb5680cce60 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56dfbe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56806ce60 0x7fb5680aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56d7bd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5680cce60 0x7fb5680b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56d7bd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5680cce60 0x7fb5680b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41420/0 (socket says 172.21.15.176:41420) 2023-11-29T11:12:35.904 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56dfbe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56806ce60 0x7fb5680aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50694/0 (socket says 172.21.15.176:50694) 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56d7bd700 1 -- 172.21.15.176:0/3677016268 learned_addr learned my addr 172.21.15.176:0/3677016268 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56e7bf700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5680cf470 0x7fb5680b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56d7bd700 1 -- 172.21.15.176:0/3677016268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56806ce60 msgr2=0x7fb5680aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56d7bd700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56806ce60 0x7fb5680aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56d7bd700 1 -- 172.21.15.176:0/3677016268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5680cf470 msgr2=0x7fb5680b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56d7bd700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5680cf470 0x7fb5680b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56d7bd700 1 -- 172.21.15.176:0/3677016268 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640094b0 con 0x7fb5680cce60 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.893+0000 7fb56dfbe700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56806ce60 0x7fb5680aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb56d7bd700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5680cce60 0x7fb5680b3df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb56400ebe0 tx=0x7fb56400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb55e7fc700 1 -- 172.21.15.176:0/3677016268 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564009770 con 0x7fb5680cce60 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb55e7fc700 1 -- 172.21.15.176:0/3677016268 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56400c850 con 0x7fb5680cce60 2023-11-29T11:12:35.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb558009570 con 0x7fb5680cce60 2023-11-29T11:12:35.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb55e7fc700 1 -- 172.21.15.176:0/3677016268 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400cbe0 con 0x7fb5680cce60 2023-11-29T11:12:35.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56806adb0 con 0x7fb5680cce60 2023-11-29T11:12:35.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb55e7fc700 1 -- 172.21.15.176:0/3677016268 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb564019030 con 0x7fb5680cce60 2023-11-29T11:12:35.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb55e7fc700 1 -- 172.21.15.176:0/3677016268 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fb564006620 con 0x7fb5680cce60 2023-11-29T11:12:35.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.897+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56806aad0 con 0x7fb5680cce60 2023-11-29T11:12:35.909 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.901+0000 7fb55e7fc700 1 -- 172.21.15.176:0/3677016268 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb564021060 con 0x7fb5680cce60 2023-11-29T11:12:35.988 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.981+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b47aae37-55ec-499d-91be-b635b08e7cb8", "id": 2} v 0) v1 -- 0x7fb56806b090 con 0x7fb5680cce60 2023-11-29T11:12:35.998 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.989+0000 7fb55e7fc700 1 -- 172.21.15.176:0/3677016268 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b47aae37-55ec-499d-91be-b635b08e7cb8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb564017070 con 0x7fb5680cce60 2023-11-29T11:12:35.998 INFO:teuthology.orchestra.run.smithi176.stdout:2 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5680cce60 msgr2=0x7fb5680b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5680cce60 0x7fb5680b3df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb56400ebe0 tx=0x7fb56400eef0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 shutdown_connections 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5680cf470 0x7fb5680b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5680cce60 0x7fb5680b3df0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 --2- 172.21.15.176:0/3677016268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56806ce60 0x7fb5680aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 >> 172.21.15.176:0/3677016268 conn(0x7fb5680b5760 msgr2=0x7fb56806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 shutdown_connections 2023-11-29T11:12:36.000 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:35.993+0000 7fb56efc0700 1 -- 172.21.15.176:0/3677016268 wait complete. 2023-11-29T11:12:36.006 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:36.003+0000 7f7ea23672c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-29T11:12:36.012 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new c622b5f3-ecba-4b16-bb81-180b92cb6468 3 2023-11-29T11:12:36.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb78ed5d700 1 Processor -- start 2023-11-29T11:12:36.122 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb78ed5d700 1 -- start start 2023-11-29T11:12:36.123 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb78ed5d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb788160500 0x7fb7880afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.123 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb78ed5d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78806cbb0 con 0x7fb78815c4a0 2023-11-29T11:12:36.123 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb78ed5d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78806ce90 con 0x7fb7880cef80 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb78ed5d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880ce780 con 0x7fb788160500 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb787fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb788160500 0x7fb7880afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb787fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb788160500 0x7fb7880afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50706/0 (socket says 172.21.15.176:50706) 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb787fff700 1 -- 172.21.15.176:0/2900063068 learned_addr learned my addr 172.21.15.176:0/2900063068 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.113+0000 7fb78d2fa700 1 --1- 172.21.15.176:0/2900063068 >> v1:172.21.15.176:6789/0 conn(0x7fb7880cef80 0x7fb7880cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:56492/0 (socket says 172.21.15.176:56492) 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb787fff700 1 -- 172.21.15.176:0/2900063068 >> v1:172.21.15.176:6789/0 conn(0x7fb7880cef80 legacy=0x7fb7880cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb787fff700 1 -- 172.21.15.176:0/2900063068 >> v1:172.21.15.81:6789/0 conn(0x7fb78815c4a0 legacy=0x7fb78815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb787fff700 1 -- 172.21.15.176:0/2900063068 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880cea60 con 0x7fb788160500 2023-11-29T11:12:36.124 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb787fff700 1 --2- 172.21.15.176:0/2900063068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb788160500 0x7fb7880afc40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb774009910 tx=0x7fb774009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a04303659e1e9d6b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:36.125 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb7877fe700 1 -- 172.21.15.176:0/2900063068 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400ba60 con 0x7fb788160500 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb7877fe700 1 -- 172.21.15.176:0/2900063068 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400bbc0 con 0x7fb788160500 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb7877fe700 1 -- 172.21.15.176:0/2900063068 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774009e60 con 0x7fb788160500 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 -- 172.21.15.176:0/2900063068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb788160500 msgr2=0x7fb7880afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 --2- 172.21.15.176:0/2900063068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb788160500 0x7fb7880afc40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb774009910 tx=0x7fb774009c20 comp rx=0 tx=0).stop 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 -- 172.21.15.176:0/2900063068 shutdown_connections 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 --2- 172.21.15.176:0/2900063068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb788160500 0x7fb7880afc40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 -- 172.21.15.176:0/2900063068 >> 172.21.15.176:0/2900063068 conn(0x7fb7880cdef0 msgr2=0x7fb7880d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 -- 172.21.15.176:0/2900063068 shutdown_connections 2023-11-29T11:12:36.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 -- 172.21.15.176:0/2900063068 wait complete. 2023-11-29T11:12:36.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 Processor -- start 2023-11-29T11:12:36.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.117+0000 7fb78ed5d700 1 -- start start 2023-11-29T11:12:36.130 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7880cef80 0x7fb7880c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.130 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788160500 0x7fb7880b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.130 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7881f1d30 0x7fb7881f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.130 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c72a0 con 0x7fb788160500 2023-11-29T11:12:36.130 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78806e700 con 0x7fb7880cef80 2023-11-29T11:12:36.130 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7881ef720 con 0x7fb7881f1d30 2023-11-29T11:12:36.130 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78caf9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7880cef80 0x7fb7880c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.130 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7881f1d30 0x7fb7881f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78caf9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7880cef80 0x7fb7880c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50712/0 (socket says 172.21.15.176:50712) 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7881f1d30 0x7fb7881f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41450/0 (socket says 172.21.15.176:41450) 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 -- 172.21.15.176:0/3945386984 learned_addr learned my addr 172.21.15.176:0/3945386984 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb787fff700 1 --2- 172.21.15.176:0/3945386984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788160500 0x7fb7880b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 -- 172.21.15.176:0/3945386984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7880cef80 msgr2=0x7fb7880c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 --2- 172.21.15.176:0/3945386984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7880cef80 0x7fb7880c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 -- 172.21.15.176:0/3945386984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788160500 msgr2=0x7fb7880b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 --2- 172.21.15.176:0/3945386984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788160500 0x7fb7880b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 -- 172.21.15.176:0/3945386984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009570 con 0x7fb7881f1d30 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78d2fa700 1 --2- 172.21.15.176:0/3945386984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7881f1d30 0x7fb7881f21b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb78000cbf0 tx=0x7fb78000cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb7857fa700 1 -- 172.21.15.176:0/3945386984 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000aa60 con 0x7fb7881f1d30 2023-11-29T11:12:36.131 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb7857fa700 1 -- 172.21.15.176:0/3945386984 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78000abc0 con 0x7fb7881f1d30 2023-11-29T11:12:36.132 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb788160ae0 con 0x7fb7881f1d30 2023-11-29T11:12:36.132 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb7857fa700 1 -- 172.21.15.176:0/3945386984 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780012400 con 0x7fb7881f1d30 2023-11-29T11:12:36.132 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78806d170 con 0x7fb7881f1d30 2023-11-29T11:12:36.132 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb7857fa700 1 -- 172.21.15.176:0/3945386984 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb780019030 con 0x7fb7881f1d30 2023-11-29T11:12:36.132 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb7857fa700 1 -- 172.21.15.176:0/3945386984 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb7800129f0 con 0x7fb7881f1d30 2023-11-29T11:12:36.132 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.121+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb788160c70 con 0x7fb7881f1d30 2023-11-29T11:12:36.134 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.125+0000 7fb7857fa700 1 -- 172.21.15.176:0/3945386984 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb780017070 con 0x7fb7881f1d30 2023-11-29T11:12:36.144 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:36.137+0000 7faeefd892c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-29T11:12:36.210 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.201+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c622b5f3-ecba-4b16-bb81-180b92cb6468", "id": 3} v 0) v1 -- 0x7fb78806e870 con 0x7fb7881f1d30 2023-11-29T11:12:36.228 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb7857fa700 1 -- 172.21.15.176:0/3945386984 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c622b5f3-ecba-4b16-bb81-180b92cb6468", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb780012560 con 0x7fb7881f1d30 2023-11-29T11:12:36.228 INFO:teuthology.orchestra.run.smithi176.stdout:3 2023-11-29T11:12:36.229 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7881f1d30 msgr2=0x7fb7881f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.229 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 --2- 172.21.15.176:0/3945386984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7881f1d30 0x7fb7881f21b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb78000cbf0 tx=0x7fb78000cf00 comp rx=0 tx=0).stop 2023-11-29T11:12:36.229 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 shutdown_connections 2023-11-29T11:12:36.229 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 --2- 172.21.15.176:0/3945386984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7881f1d30 0x7fb7881f21b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.230 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 --2- 172.21.15.176:0/3945386984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788160500 0x7fb7880b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.230 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 --2- 172.21.15.176:0/3945386984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7880cef80 0x7fb7880c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.230 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 >> 172.21.15.176:0/3945386984 conn(0x7fb7880cdef0 msgr2=0x7fb788157400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.230 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 shutdown_connections 2023-11-29T11:12:36.230 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.213+0000 7fb78ed5d700 1 -- 172.21.15.176:0/3945386984 wait complete. 2023-11-29T11:12:36.230 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:36.227+0000 7f7ea23672c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-29T11:12:36.238 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 488bc6a5-2b9c-40b7-976d-5f54f5a75039 4 2023-11-29T11:12:36.278 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:36.275+0000 7f7ea23672c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-29T11:12:36.348 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5609bdd700 1 Processor -- start 2023-11-29T11:12:36.348 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5609bdd700 1 -- start start 2023-11-29T11:12:36.350 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5609bdd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55fc0e2850 0x7f55fc0530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.350 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5609bdd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc037710 0x7f55fc006820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.350 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5609bdd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0e7300 con 0x7f55fc03b0c0 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5609bdd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0e2c20 con 0x7f55fc0e2850 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5609bdd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0e6780 con 0x7f55fc037710 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56093dc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc037710 0x7f55fc006820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5608bdb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55fc0e2850 0x7f55fc0530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56093dc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc037710 0x7f55fc006820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41458/0 (socket says 172.21.15.176:41458) 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56093dc700 1 -- 172.21.15.176:0/2758462123 learned_addr learned my addr 172.21.15.176:0/2758462123 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56093dc700 1 -- 172.21.15.176:0/2758462123 >> v2:172.21.15.176:3300/0 conn(0x7f55fc0e2850 msgr2=0x7f55fc0530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56093dc700 1 --2- 172.21.15.176:0/2758462123 >> v2:172.21.15.176:3300/0 conn(0x7f55fc0e2850 0x7f55fc0530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56093dc700 1 -- 172.21.15.176:0/2758462123 >> v1:172.21.15.81:6789/0 conn(0x7f55fc03b0c0 legacy=0x7f55fc037000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56093dc700 1 -- 172.21.15.176:0/2758462123 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0e6a60 con 0x7f55fc037710 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5608bdb700 1 --2- 172.21.15.176:0/2758462123 >> v2:172.21.15.176:3300/0 conn(0x7f55fc0e2850 0x7f55fc0530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56093dc700 1 --2- 172.21.15.176:0/2758462123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc037710 0x7f55fc006820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f560404ed50 tx=0x7f56040736f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=654f6a756c7096a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:36.351 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56037fe700 1 -- 172.21.15.176:0/2758462123 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604067660 con 0x7f55fc037710 2023-11-29T11:12:36.352 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56037fe700 1 -- 172.21.15.176:0/2758462123 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56040727d0 con 0x7f55fc037710 2023-11-29T11:12:36.352 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f56037fe700 1 -- 172.21.15.176:0/2758462123 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604072c00 con 0x7f55fc037710 2023-11-29T11:12:36.353 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.341+0000 7f5609bdd700 1 -- 172.21.15.176:0/2758462123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc037710 msgr2=0x7f55fc006820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.353 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 --2- 172.21.15.176:0/2758462123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc037710 0x7f55fc006820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f560404ed50 tx=0x7f56040736f0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.353 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- 172.21.15.176:0/2758462123 shutdown_connections 2023-11-29T11:12:36.353 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 --2- 172.21.15.176:0/2758462123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc037710 0x7f55fc006820 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.353 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 --2- 172.21.15.176:0/2758462123 >> v2:172.21.15.176:3300/0 conn(0x7f55fc0e2850 0x7f55fc0530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.353 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- 172.21.15.176:0/2758462123 >> 172.21.15.176:0/2758462123 conn(0x7f55fc052000 msgr2=0x7f55fc052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.353 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- 172.21.15.176:0/2758462123 shutdown_connections 2023-11-29T11:12:36.353 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- 172.21.15.176:0/2758462123 wait complete. 2023-11-29T11:12:36.354 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 Processor -- start 2023-11-29T11:12:36.354 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- start start 2023-11-29T11:12:36.356 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55fc037710 0x7f55fc178720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc03b0c0 0x7f55fc0d6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc0e2850 0x7f55fc0e3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc04a6e0 con 0x7f55fc0e2850 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0dfa20 con 0x7f55fc037710 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc049df0 con 0x7f55fc03b0c0 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55fc037710 0x7f55fc178720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55fc037710 0x7f55fc178720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50734/0 (socket says 172.21.15.176:50734) 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 -- 172.21.15.176:0/2530843036 learned_addr learned my addr 172.21.15.176:0/2530843036 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5603fff700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc03b0c0 0x7f55fc0d6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f56093dc700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc0e2850 0x7f55fc0e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 -- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc03b0c0 msgr2=0x7f55fc0d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc03b0c0 0x7f55fc0d6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 -- 172.21.15.176:0/2530843036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc0e2850 msgr2=0x7f55fc0e3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.357 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc0e2850 0x7f55fc0e3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 -- 172.21.15.176:0/2530843036 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80094b0 con 0x7f55fc037710 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5603fff700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc03b0c0 0x7f55fc0d6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5608bdb700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55fc037710 0x7f55fc178720 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f55f800ebe0 tx=0x7f55f800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f56017fa700 1 -- 172.21.15.176:0/2530843036 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8009770 con 0x7f55fc037710 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f56017fa700 1 -- 172.21.15.176:0/2530843036 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f800c850 con 0x7f55fc037710 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f56017fa700 1 -- 172.21.15.176:0/2530843036 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800cbe0 con 0x7f55fc037710 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.345+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560404e740 con 0x7f55fc037710 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.349+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc0e7020 con 0x7f55fc037710 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.349+0000 7f56017fa700 1 -- 172.21.15.176:0/2530843036 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f55f8023070 con 0x7f55fc037710 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.349+0000 7f56017fa700 1 -- 172.21.15.176:0/2530843036 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f55f8013bf0 con 0x7f55fc037710 2023-11-29T11:12:36.358 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.349+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc0e6d40 con 0x7f55fc037710 2023-11-29T11:12:36.360 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.353+0000 7f56017fa700 1 -- 172.21.15.176:0/2530843036 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f55f8021060 con 0x7f55fc037710 2023-11-29T11:12:36.435 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.429+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "488bc6a5-2b9c-40b7-976d-5f54f5a75039", "id": 4} v 0) v1 -- 0x7f55fc054690 con 0x7f55fc037710 2023-11-29T11:12:36.446 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.437+0000 7f56017fa700 1 -- 172.21.15.176:0/2530843036 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "488bc6a5-2b9c-40b7-976d-5f54f5a75039", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55f802a0b0 con 0x7f55fc037710 2023-11-29T11:12:36.446 INFO:teuthology.orchestra.run.smithi176.stdout:4 2023-11-29T11:12:36.448 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55fc037710 msgr2=0x7f55fc178720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.448 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55fc037710 0x7f55fc178720 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f55f800ebe0 tx=0x7f55f800eef0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.448 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 shutdown_connections 2023-11-29T11:12:36.448 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc0e2850 0x7f55fc0e3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.448 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55fc03b0c0 0x7f55fc0d6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.448 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 --2- 172.21.15.176:0/2530843036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55fc037710 0x7f55fc178720 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.448 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 >> 172.21.15.176:0/2530843036 conn(0x7f55fc052000 msgr2=0x7f55fc038850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.448 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 shutdown_connections 2023-11-29T11:12:36.449 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.441+0000 7f5609bdd700 1 -- 172.21.15.176:0/2530843036 wait complete. 2023-11-29T11:12:36.456 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:36.451+0000 7f7ea23672c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-29T11:12:36.462 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 5edd51cb-2985-49c4-bdb4-ad87cb1e7e73 5 2023-11-29T11:12:36.521 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:36.519+0000 7f7ea23672c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-29T11:12:36.573 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6423e6700 1 Processor -- start 2023-11-29T11:12:36.573 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6423e6700 1 -- start start 2023-11-29T11:12:36.574 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6423e6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c06ce60 0x7fd63c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.574 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6423e6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c0cd2d0 con 0x7fd63c0cf470 2023-11-29T11:12:36.575 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6423e6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c06a7f0 con 0x7fd63c0cce60 2023-11-29T11:12:36.575 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6423e6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c15c8b0 con 0x7fd63c06ce60 2023-11-29T11:12:36.575 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6413e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c06ce60 0x7fd63c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.575 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd640be3700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd63c0cce60 0x7fd63c06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:56508/0 (socket says 172.21.15.176:56508) 2023-11-29T11:12:36.575 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd640be3700 1 -- 172.21.15.176:0/2047757475 learned_addr learned my addr 172.21.15.176:0/2047757475 (peer_addr_for_me v1:172.21.15.176:0/0) 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd62ffff700 1 -- 172.21.15.176:0/2047757475 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781979537 0 0) 0x7fd63c06a7f0 con 0x7fd63c0cce60 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6413e4700 1 -- 172.21.15.176:0/2047757475 >> v1:172.21.15.176:6789/0 conn(0x7fd63c0cce60 legacy=0x7fd63c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6413e4700 1 -- 172.21.15.176:0/2047757475 >> v1:172.21.15.81:6789/0 conn(0x7fd63c0cf470 legacy=0x7fd63c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.565+0000 7fd6413e4700 1 -- 172.21.15.176:0/2047757475 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c06aad0 con 0x7fd63c06ce60 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6413e4700 1 --2- 172.21.15.176:0/2047757475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c06ce60 0x7fd63c0d31b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd630009880 tx=0x7fd630009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22dd1dfeba448e20 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd62ffff700 1 -- 172.21.15.176:0/2047757475 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630011830 con 0x7fd63c06ce60 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd62ffff700 1 -- 172.21.15.176:0/2047757475 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd630011990 con 0x7fd63c06ce60 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd62ffff700 1 -- 172.21.15.176:0/2047757475 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630011d20 con 0x7fd63c06ce60 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 -- 172.21.15.176:0/2047757475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c06ce60 msgr2=0x7fd63c0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.577 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 --2- 172.21.15.176:0/2047757475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c06ce60 0x7fd63c0d31b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd630009880 tx=0x7fd630009b90 comp rx=0 tx=0).stop 2023-11-29T11:12:36.578 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 -- 172.21.15.176:0/2047757475 shutdown_connections 2023-11-29T11:12:36.578 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 --2- 172.21.15.176:0/2047757475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c06ce60 0x7fd63c0d31b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.578 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 -- 172.21.15.176:0/2047757475 >> 172.21.15.176:0/2047757475 conn(0x7fd63c0b5760 msgr2=0x7fd63c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.578 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 -- 172.21.15.176:0/2047757475 shutdown_connections 2023-11-29T11:12:36.578 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 -- 172.21.15.176:0/2047757475 wait complete. 2023-11-29T11:12:36.578 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 Processor -- start 2023-11-29T11:12:36.578 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.569+0000 7fd6423e6700 1 -- start start 2023-11-29T11:12:36.581 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd63c06ce60 0x7fd63c14c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.581 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c0cce60 0x7fd63c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.581 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63c0cf470 0x7fd63c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c1f2b10 con 0x7fd63c0cf470 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0b34b0 con 0x7fd63c06ce60 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0cdf60 con 0x7fd63c0cce60 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c0cce60 0x7fd63c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c0cce60 0x7fd63c0cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41482/0 (socket says 172.21.15.176:41482) 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 -- 172.21.15.176:0/2975178499 learned_addr learned my addr 172.21.15.176:0/2975178499 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6413e4700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd63c06ce60 0x7fd63c14c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd641be5700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63c0cf470 0x7fd63c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 -- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd63c06ce60 msgr2=0x7fd63c14c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd63c06ce60 0x7fd63c14c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 -- 172.21.15.176:0/2975178499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63c0cf470 msgr2=0x7fd63c0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63c0cf470 0x7fd63c0af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.582 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 -- 172.21.15.176:0/2975178499 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6300094b0 con 0x7fd63c0cce60 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6413e4700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd63c06ce60 0x7fd63c14c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd640be3700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c0cce60 0x7fd63c0cd4a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd63800c4d0 tx=0x7fd63800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd62dffb700 1 -- 172.21.15.176:0/2975178499 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638004ca0 con 0x7fd63c0cce60 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd62dffb700 1 -- 172.21.15.176:0/2975178499 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd638004e00 con 0x7fd63c0cce60 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c06b090 con 0x7fd63c0cce60 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd62dffb700 1 -- 172.21.15.176:0/2975178499 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638007310 con 0x7fd63c0cce60 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c06adb0 con 0x7fd63c0cce60 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd62dffb700 1 -- 172.21.15.176:0/2975178499 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fd63801a020 con 0x7fd63c0cce60 2023-11-29T11:12:36.583 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd62dffb700 1 -- 172.21.15.176:0/2975178499 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd638013940 con 0x7fd63c0cce60 2023-11-29T11:12:36.584 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.573+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c0d0000 con 0x7fd63c0cce60 2023-11-29T11:12:36.584 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:36.583+0000 7f7ea23672c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-29T11:12:36.585 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.577+0000 7fd62dffb700 1 -- 172.21.15.176:0/2975178499 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fd6380075c0 con 0x7fd63c0cce60 2023-11-29T11:12:36.663 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.657+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5edd51cb-2985-49c4-bdb4-ad87cb1e7e73", "id": 5} v 0) v1 -- 0x7fd63c0ce480 con 0x7fd63c0cce60 2023-11-29T11:12:36.674 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.665+0000 7fd62dffb700 1 -- 172.21.15.176:0/2975178499 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5edd51cb-2985-49c4-bdb4-ad87cb1e7e73", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd63c0ce480 con 0x7fd63c0cce60 2023-11-29T11:12:36.674 INFO:teuthology.orchestra.run.smithi176.stdout:5 2023-11-29T11:12:36.676 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c0cce60 msgr2=0x7fd63c0cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.676 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c0cce60 0x7fd63c0cd4a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd63800c4d0 tx=0x7fd63800c890 comp rx=0 tx=0).stop 2023-11-29T11:12:36.676 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 shutdown_connections 2023-11-29T11:12:36.676 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63c0cf470 0x7fd63c0af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.677 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd63c0cce60 0x7fd63c0cd4a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.677 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 --2- 172.21.15.176:0/2975178499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd63c06ce60 0x7fd63c14c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.677 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 >> 172.21.15.176:0/2975178499 conn(0x7fd63c0b5760 msgr2=0x7fd63c0cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.677 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 shutdown_connections 2023-11-29T11:12:36.677 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.669+0000 7fd6423e6700 1 -- 172.21.15.176:0/2975178499 wait complete. 2023-11-29T11:12:36.692 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 8e693d1b-f26c-49d4-b955-1fdc70498cf3 6 2023-11-29T11:12:36.765 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:36.757+0000 7faeefd892c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-29T11:12:36.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.797+0000 7fd6cde38700 1 Processor -- start 2023-11-29T11:12:36.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.797+0000 7fd6cde38700 1 -- start start 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6c8158ee0 0x7fd6c80ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd6c80cd5d0 0x7fd6c80cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c806d1c0 con 0x7fd6c80ce060 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c806e000 con 0x7fd6c8158ee0 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80ce460 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd6c80cd5d0 0x7fd6c80cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd6c80cd5d0 0x7fd6c80cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50752/0 (socket says 172.21.15.176:50752) 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c7fff700 1 -- 172.21.15.176:0/1964388164 learned_addr learned my addr 172.21.15.176:0/1964388164 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cce36700 1 --2- 172.21.15.176:0/1964388164 >> v2:172.21.15.81:3300/0 conn(0x7fd6c8158ee0 0x7fd6c80ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.809 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c7fff700 1 -- 172.21.15.176:0/1964388164 >> v2:172.21.15.81:3300/0 conn(0x7fd6c8158ee0 msgr2=0x7fd6c80ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:36.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c7fff700 1 --2- 172.21.15.176:0/1964388164 >> v2:172.21.15.81:3300/0 conn(0x7fd6c8158ee0 0x7fd6c80ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c7fff700 1 -- 172.21.15.176:0/1964388164 >> v1:172.21.15.81:6789/0 conn(0x7fd6c80ce060 legacy=0x7fd6c815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:36.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c7fff700 1 -- 172.21.15.176:0/1964388164 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c80ca3a0 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c7fff700 1 --2- 172.21.15.176:0/1964388164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80cd5d0 0x7fd6c80cdb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6c815d8f0 tx=0x7fd6b4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53d1f870acd4be98 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:36.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c77fe700 1 -- 172.21.15.176:0/1964388164 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4005e50 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c77fe700 1 -- 172.21.15.176:0/1964388164 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4004030 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6c77fe700 1 -- 172.21.15.176:0/1964388164 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40043c0 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 -- 172.21.15.176:0/1964388164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80cd5d0 msgr2=0x7fd6c80cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 --2- 172.21.15.176:0/1964388164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80cd5d0 0x7fd6c80cdb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6c815d8f0 tx=0x7fd6b4009bf0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 -- 172.21.15.176:0/1964388164 shutdown_connections 2023-11-29T11:12:36.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 --2- 172.21.15.176:0/1964388164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c80cd5d0 0x7fd6c80cdb20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 --2- 172.21.15.176:0/1964388164 >> v2:172.21.15.81:3300/0 conn(0x7fd6c8158ee0 0x7fd6c80ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 -- 172.21.15.176:0/1964388164 >> 172.21.15.176:0/1964388164 conn(0x7fd6c80d0240 msgr2=0x7fd6c80cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 -- 172.21.15.176:0/1964388164 shutdown_connections 2023-11-29T11:12:36.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.801+0000 7fd6cde38700 1 -- 172.21.15.176:0/1964388164 wait complete. 2023-11-29T11:12:36.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cde38700 1 Processor -- start 2023-11-29T11:12:36.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cde38700 1 -- start start 2023-11-29T11:12:36.816 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cde38700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6c80cd5d0 0x7fd6c8150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.816 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cde38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c80ce060 0x7fd6c8157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.816 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cde38700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c8158ee0 0x7fd6c8152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:36.816 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cde38700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c81582d0 con 0x7fd6c80ce060 2023-11-29T11:12:36.816 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cde38700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8157ab0 con 0x7fd6c8158ee0 2023-11-29T11:12:36.816 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cde38700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c81569d0 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.816 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cce36700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6c80cd5d0 0x7fd6c8150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.816 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cce36700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6c80cd5d0 0x7fd6c8150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41492/0 (socket says 172.21.15.176:41492) 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cce36700 1 -- 172.21.15.176:0/3457604470 learned_addr learned my addr 172.21.15.176:0/3457604470 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6cd637700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c8158ee0 0x7fd6c8152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.805+0000 7fd6c7fff700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c80ce060 0x7fd6c8157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cce36700 1 -- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c8158ee0 msgr2=0x7fd6c8152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cce36700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c8158ee0 0x7fd6c8152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cce36700 1 -- 172.21.15.176:0/3457604470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c80ce060 msgr2=0x7fd6c8157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cce36700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c80ce060 0x7fd6c8157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cce36700 1 -- 172.21.15.176:0/3457604470 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009520 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cd637700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c8158ee0 0x7fd6c8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cce36700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6c80cd5d0 0x7fd6c8150bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00e760 tx=0x7fd6bc00ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6c57fa700 1 -- 172.21.15.176:0/3457604470 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00c070 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6c57fa700 1 -- 172.21.15.176:0/3457604470 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc013610 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c806cc00 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6c57fa700 1 -- 172.21.15.176:0/3457604470 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc013980 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.817 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c806c920 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.818 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6c57fa700 1 -- 172.21.15.176:0/3457604470 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fd6bc023070 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.818 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6c57fa700 1 -- 172.21.15.176:0/3457604470 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd6bc01c400 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.818 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.809+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c806cee0 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.820 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.813+0000 7fd6c57fa700 1 -- 172.21.15.176:0/3457604470 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fd6bc03bb00 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.824 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:36.817+0000 7faeefd892c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-29T11:12:36.895 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.889+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e693d1b-f26c-49d4-b955-1fdc70498cf3", "id": 6} v 0) v1 -- 0x7fd6c8072c20 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6c57fa700 1 -- 172.21.15.176:0/3457604470 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e693d1b-f26c-49d4-b955-1fdc70498cf3", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd6bc02a070 con 0x7fd6c80cd5d0 2023-11-29T11:12:36.906 INFO:teuthology.orchestra.run.smithi176.stdout:6 2023-11-29T11:12:36.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6c80cd5d0 msgr2=0x7fd6c8150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:36.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6cde38700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6c80cd5d0 0x7fd6c8150bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00e760 tx=0x7fd6bc00ea70 comp rx=0 tx=0).stop 2023-11-29T11:12:36.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 shutdown_connections 2023-11-29T11:12:36.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6cde38700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6c8158ee0 0x7fd6c8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6cde38700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6c80ce060 0x7fd6c8157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6cde38700 1 --2- 172.21.15.176:0/3457604470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6c80cd5d0 0x7fd6c8150bf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:36.907 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 >> 172.21.15.176:0/3457604470 conn(0x7fd6c80d0240 msgr2=0x7fd6c806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:36.908 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.897+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 shutdown_connections 2023-11-29T11:12:36.908 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:36.901+0000 7fd6cde38700 1 -- 172.21.15.176:0/3457604470 wait complete. 2023-11-29T11:12:36.920 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 7ef978b7-a25c-49d4-8fe6-54fff58f713c 7 2023-11-29T11:12:36.936 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:36.929+0000 7faeefd892c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-29T11:12:36.997 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:36.995+0000 7f7ea23672c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-29T11:12:37.025 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a8ed700 1 Processor -- start 2023-11-29T11:12:37.025 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a8ed700 1 -- start start 2023-11-29T11:12:37.026 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a8ed700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68840cfdd0 0x7f68840b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a8ed700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f68840b2570 0x7f68840cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a8ed700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68840cac70 con 0x7f68840cc590 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a8ed700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688406c8e0 con 0x7f68840b2570 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a8ed700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68840b29f0 con 0x7f68840cfdd0 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f68890ea700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68840cfdd0 0x7f68840b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a0ec700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f68840b2570 0x7f68840cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f68890ea700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68840cfdd0 0x7f68840b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41494/0 (socket says 172.21.15.176:41494) 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f68890ea700 1 -- 172.21.15.176:0/3819982185 learned_addr learned my addr 172.21.15.176:0/3819982185 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f68898eb700 1 --1- 172.21.15.176:0/3819982185 >> v1:172.21.15.176:6789/0 conn(0x7f68840cc590 0x7f68840b0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:56522/0 (socket says 172.21.15.176:56522) 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a0ec700 1 -- 172.21.15.176:0/3819982185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68840cfdd0 msgr2=0x7f68840b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a0ec700 1 --2- 172.21.15.176:0/3819982185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68840cfdd0 0x7f68840b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a0ec700 1 -- 172.21.15.176:0/3819982185 >> v1:172.21.15.176:6789/0 conn(0x7f68840cc590 legacy=0x7f68840b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.027 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a0ec700 1 -- 172.21.15.176:0/3819982185 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840d0340 con 0x7f68840b2570 2023-11-29T11:12:37.028 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f688a0ec700 1 --2- 172.21.15.176:0/3819982185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840cea40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f687c009d90 tx=0x7f687c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83e8b1e8b44fb98e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:37.028 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f68888e9700 1 -- 172.21.15.176:0/3819982185 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c00e070 con 0x7f68840b2570 2023-11-29T11:12:37.028 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f68888e9700 1 -- 172.21.15.176:0/3819982185 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c00bb20 con 0x7f68840b2570 2023-11-29T11:12:37.028 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.017+0000 7f68888e9700 1 -- 172.21.15.176:0/3819982185 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c012430 con 0x7f68840b2570 2023-11-29T11:12:37.028 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- 172.21.15.176:0/3819982185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 msgr2=0x7f68840cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.029 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 --2- 172.21.15.176:0/3819982185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840cea40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f687c009d90 tx=0x7f687c00b330 comp rx=0 tx=0).stop 2023-11-29T11:12:37.029 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- 172.21.15.176:0/3819982185 shutdown_connections 2023-11-29T11:12:37.029 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 --2- 172.21.15.176:0/3819982185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840cea40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.029 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 --2- 172.21.15.176:0/3819982185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68840cfdd0 0x7f68840b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.029 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- 172.21.15.176:0/3819982185 >> 172.21.15.176:0/3819982185 conn(0x7f68840cd0a0 msgr2=0x7f68840cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:37.029 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- 172.21.15.176:0/3819982185 shutdown_connections 2023-11-29T11:12:37.029 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- 172.21.15.176:0/3819982185 wait complete. 2023-11-29T11:12:37.029 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 Processor -- start 2023-11-29T11:12:37.030 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- start start 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68840cfdd0 0x7f68841f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68841f2390 0x7f68841f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840b49e0 con 0x7f68840cfdd0 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68840b54b0 con 0x7f68840b2570 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a8ed700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68841f4ce0 con 0x7f68841f2390 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f68898eb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f68898eb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:50768/0 (socket says 172.21.15.176:50768) 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f68898eb700 1 -- 172.21.15.176:0/2882206934 learned_addr learned my addr 172.21.15.176:0/2882206934 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f688a0ec700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68841f2390 0x7f68841f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.031 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.021+0000 7f68890ea700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68840cfdd0 0x7f68841f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f68898eb700 1 -- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68841f2390 msgr2=0x7f68841f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f68898eb700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68841f2390 0x7f68841f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f68898eb700 1 -- 172.21.15.176:0/2882206934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68840cfdd0 msgr2=0x7f68841f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f68898eb700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68840cfdd0 0x7f68841f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f68898eb700 1 -- 172.21.15.176:0/2882206934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c009a70 con 0x7f68840b2570 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f688a0ec700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68841f2390 0x7f68841f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f68898eb700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840b44a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f688000c500 tx=0x7f688000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f687a7fc700 1 -- 172.21.15.176:0/2882206934 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880005cd0 con 0x7f68840b2570 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f687a7fc700 1 -- 172.21.15.176:0/2882206934 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688000ce90 con 0x7f68840b2570 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f687a7fc700 1 -- 172.21.15.176:0/2882206934 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800072d0 con 0x7f68840b2570 2023-11-29T11:12:37.033 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688406d4b0 con 0x7f68840b2570 2023-11-29T11:12:37.034 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688406d1d0 con 0x7f68840b2570 2023-11-29T11:12:37.034 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f687a7fc700 1 -- 172.21.15.176:0/2882206934 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f6880019030 con 0x7f68840b2570 2023-11-29T11:12:37.034 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.025+0000 7f687a7fc700 1 -- 172.21.15.176:0/2882206934 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6880012a60 con 0x7f68840b2570 2023-11-29T11:12:37.035 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.029+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68840ce520 con 0x7f68840b2570 2023-11-29T11:12:37.038 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.029+0000 7f687a7fc700 1 -- 172.21.15.176:0/2882206934 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6880021060 con 0x7f68840b2570 2023-11-29T11:12:37.113 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.105+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7ef978b7-a25c-49d4-8fe6-54fff58f713c", "id": 7} v 0) v1 -- 0x7f6884072c20 con 0x7f68840b2570 2023-11-29T11:12:37.114 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:37.111+0000 7f7ea23672c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-29T11:12:37.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.117+0000 7f687a7fc700 1 -- 172.21.15.176:0/2882206934 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ef978b7-a25c-49d4-8fe6-54fff58f713c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6880017070 con 0x7f68840b2570 2023-11-29T11:12:37.126 INFO:teuthology.orchestra.run.smithi176.stdout:7 2023-11-29T11:12:37.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.117+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 msgr2=0x7f68840b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.117+0000 7f688a8ed700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840b44a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f688000c500 tx=0x7f688000c810 comp rx=0 tx=0).stop 2023-11-29T11:12:37.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.117+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 shutdown_connections 2023-11-29T11:12:37.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.117+0000 7f688a8ed700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68841f2390 0x7f68841f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.117+0000 7f688a8ed700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68840cfdd0 0x7f68841f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.117+0000 7f688a8ed700 1 --2- 172.21.15.176:0/2882206934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68840b2570 0x7f68840b44a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.128 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.117+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 >> 172.21.15.176:0/2882206934 conn(0x7f68840cd0a0 msgr2=0x7f688415b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:37.128 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.121+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 shutdown_connections 2023-11-29T11:12:37.128 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-29T11:12:37.121+0000 7f688a8ed700 1 -- 172.21.15.176:0/2882206934 wait complete. 2023-11-29T11:12:37.140 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-29T11:12:37.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-29T11:12:37.142 INFO:tasks.ceph.osd.0:Started 2023-11-29T11:12:37.142 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-29T11:12:37.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-29T11:12:37.146 INFO:tasks.ceph.osd.1:Started 2023-11-29T11:12:37.147 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-29T11:12:37.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-29T11:12:37.149 INFO:tasks.ceph.osd.2:Started 2023-11-29T11:12:37.149 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-29T11:12:37.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-29T11:12:37.151 INFO:tasks.ceph.osd.3:Started 2023-11-29T11:12:37.151 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-29T11:12:37.151 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-29T11:12:37.169 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:37.161+0000 7faeefd892c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-29T11:12:37.171 INFO:tasks.ceph.osd.4:Started 2023-11-29T11:12:37.171 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-29T11:12:37.171 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-29T11:12:37.173 INFO:tasks.ceph.osd.5:Started 2023-11-29T11:12:37.173 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-29T11:12:37.173 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-29T11:12:37.175 INFO:tasks.ceph.osd.6:Started 2023-11-29T11:12:37.175 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-29T11:12:37.176 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-29T11:12:37.178 INFO:tasks.ceph.osd.7:Started 2023-11-29T11:12:37.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:12:37.222 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:37.213+0000 7faeefd892c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-29T11:12:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 Processor -- start 2023-11-29T11:12:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- start start 2023-11-29T11:12:37.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda800ab850 0x7fda80145460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda80069ce0 con 0x7fda8006cd50 2023-11-29T11:12:37.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda80069fc0 con 0x7fda80145090 2023-11-29T11:12:37.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8006a2a0 con 0x7fda800ab850 2023-11-29T11:12:37.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda853fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda800ab850 0x7fda80145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda77fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fda8006cd50 0x7fda8006ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33058/0 (socket says 172.21.15.81:33058) 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda77fff700 1 -- 172.21.15.81:0/768711103 learned_addr learned my addr 172.21.15.81:0/768711103 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda853fd700 1 -- 172.21.15.81:0/768711103 >> v1:172.21.15.176:6789/0 conn(0x7fda80145090 legacy=0x7fda8006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda853fd700 1 -- 172.21.15.81:0/768711103 >> v1:172.21.15.81:6789/0 conn(0x7fda8006cd50 legacy=0x7fda8006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda853fd700 1 -- 172.21.15.81:0/768711103 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8006a580 con 0x7fda800ab850 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda853fd700 1 --2- 172.21.15.81:0/768711103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda80145460 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fda78009d90 tx=0x7fda7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419c9cf69b98cca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda777fe700 1 -- 172.21.15.81:0/768711103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7800e070 con 0x7fda800ab850 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda777fe700 1 -- 172.21.15.81:0/768711103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7800bbd0 con 0x7fda800ab850 2023-11-29T11:12:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda777fe700 1 -- 172.21.15.81:0/768711103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78012430 con 0x7fda800ab850 2023-11-29T11:12:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- 172.21.15.81:0/768711103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 msgr2=0x7fda80145460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 --2- 172.21.15.81:0/768711103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda80145460 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fda78009d90 tx=0x7fda7800b330 comp rx=0 tx=0).stop 2023-11-29T11:12:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- 172.21.15.81:0/768711103 shutdown_connections 2023-11-29T11:12:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 --2- 172.21.15.81:0/768711103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda80145460 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- 172.21.15.81:0/768711103 >> 172.21.15.81:0/768711103 conn(0x7fda8006e000 msgr2=0x7fda800b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- 172.21.15.81:0/768711103 shutdown_connections 2023-11-29T11:12:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.299+0000 7fda85bfe700 1 -- 172.21.15.81:0/768711103 wait complete. 2023-11-29T11:12:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda85bfe700 1 Processor -- start 2023-11-29T11:12:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda85bfe700 1 -- start start 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda85bfe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda8006cd50 0x7fda800af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda85bfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda801f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda85bfe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda80145090 0x7fda80139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda85bfe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda801e1550 con 0x7fda800ab850 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda85bfe700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda801f2210 con 0x7fda80145090 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda85bfe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda801f24f0 con 0x7fda8006cd50 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda801f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda801f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43136/0 (socket says 172.21.15.81:43136) 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 -- 172.21.15.81:0/169092577 learned_addr learned my addr 172.21.15.81:0/169092577 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda84bfc700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda8006cd50 0x7fda800af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda853fd700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda80145090 0x7fda80139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 -- 172.21.15.81:0/169092577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda8006cd50 msgr2=0x7fda800af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda8006cd50 0x7fda800af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 -- 172.21.15.81:0/169092577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda80145090 msgr2=0x7fda80139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda80145090 0x7fda80139f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 -- 172.21.15.81:0/169092577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78009a70 con 0x7fda800ab850 2023-11-29T11:12:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.303+0000 7fda77fff700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda801f18f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fda7000c520 tx=0x7fda7000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.307+0000 7fda757fa700 1 -- 172.21.15.81:0/169092577 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70005d90 con 0x7fda800ab850 2023-11-29T11:12:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.307+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda800b2850 con 0x7fda800ab850 2023-11-29T11:12:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.307+0000 7fda757fa700 1 -- 172.21.15.81:0/169092577 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda700070d0 con 0x7fda800ab850 2023-11-29T11:12:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.307+0000 7fda757fa700 1 -- 172.21.15.81:0/169092577 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70007440 con 0x7fda800ab850 2023-11-29T11:12:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.307+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8006a860 con 0x7fda800ab850 2023-11-29T11:12:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.307+0000 7fda757fa700 1 -- 172.21.15.81:0/169092577 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fda70019030 con 0x7fda800ab850 2023-11-29T11:12:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.307+0000 7fda757fa700 1 -- 172.21.15.81:0/169092577 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fda70012ad0 con 0x7fda800ab850 2023-11-29T11:12:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.307+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda800b29e0 con 0x7fda800ab850 2023-11-29T11:12:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.311+0000 7fda757fa700 1 -- 172.21.15.81:0/169092577 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fda70021060 con 0x7fda800ab850 2023-11-29T11:12:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.379+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda80072c20 con 0x7fda800ab850 2023-11-29T11:12:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.379+0000 7fda757fa700 1 -- 172.21.15.81:0/169092577 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fda70017070 con 0x7fda800ab850 2023-11-29T11:12:37.383 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:37.384 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:37.114273+0000","last_up_change":"0.000000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:12:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 msgr2=0x7fda801f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda801f18f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fda7000c520 tx=0x7fda7000c830 comp rx=0 tx=0).stop 2023-11-29T11:12:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 shutdown_connections 2023-11-29T11:12:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda80145090 0x7fda80139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda800ab850 0x7fda801f18f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 --2- 172.21.15.81:0/169092577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda8006cd50 0x7fda800af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 >> 172.21.15.81:0/169092577 conn(0x7fda8006e000 msgr2=0x7fda800b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 shutdown_connections 2023-11-29T11:12:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:37.383+0000 7fda85bfe700 1 -- 172.21.15.81:0/169092577 wait complete. 2023-11-29T11:12:37.397 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-29T11:12:37.397 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-29T11:12:37.410 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:37.401+0000 7faeefd892c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-29T11:12:37.472 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:37.465+0000 7faeefd892c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-29T11:12:37.523 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-11-29T11:12:37.519+0000 7efdb557c700 -1 Falling back to public interface 2023-11-29T11:12:37.523 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-11-29T11:12:37.519+0000 7f67c7e41700 -1 Falling back to public interface 2023-11-29T11:12:37.523 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-11-29T11:12:37.519+0000 7fe848dc1700 -1 Falling back to public interface 2023-11-29T11:12:37.535 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:37.529+0000 7faeefd892c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-29T11:12:37.541 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-11-29T11:12:37.539+0000 7fb08d973700 -1 Falling back to public interface 2023-11-29T11:12:37.584 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-11-29T11:12:37.577+0000 7efc38e51700 -1 Falling back to public interface 2023-11-29T11:12:37.593 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-11-29T11:12:37.585+0000 7fba4779c700 -1 Falling back to public interface 2023-11-29T11:12:37.754 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:37.751+0000 7f7ea23672c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-29T11:12:37.797 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-11-29T11:12:37.789+0000 7ff23d5da700 -1 Falling back to public interface 2023-11-29T11:12:37.808 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-11-29T11:12:37.801+0000 7f08e2852700 -1 Falling back to public interface 2023-11-29T11:12:37.918 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:37.915+0000 7f7ea23672c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-29T11:12:37.919 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:37.913+0000 7faeefd892c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-29T11:12:38.035 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:38.025+0000 7faeefd892c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-29T11:12:38.091 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:38.087+0000 7f7ea23672c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-29T11:12:38.146 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:38.143+0000 7f7ea23672c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-29T11:12:38.202 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-29T11:12:38.301 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99ffff700 1 Processor -- start 2023-11-29T11:12:38.301 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99ffff700 1 -- start start 2023-11-29T11:12:38.302 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a015c660 0x7fc9a0071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:38.302 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a006d470 con 0x7fc9a00d3360 2023-11-29T11:12:38.302 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a006d750 con 0x7fc9a00d2180 2023-11-29T11:12:38.303 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a006da30 con 0x7fc9a015c660 2023-11-29T11:12:38.303 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99e7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc9a00d3360 0x7fc9a00d1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33064/0 (socket says 172.21.15.81:33064) 2023-11-29T11:12:38.303 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99e7fc700 1 -- 172.21.15.81:0/3031712234 learned_addr learned my addr 172.21.15.81:0/3031712234 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:38.303 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99effd700 1 --2- 172.21.15.81:0/3031712234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a015c660 0x7fc9a0071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:38.304 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99dffb700 1 -- 172.21.15.81:0/3031712234 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739075887 0 0) 0x7fc9a006d470 con 0x7fc9a00d3360 2023-11-29T11:12:38.304 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99dffb700 1 -- 172.21.15.81:0/3031712234 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9880035d0 con 0x7fc9a00d3360 2023-11-29T11:12:38.304 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99effd700 1 -- 172.21.15.81:0/3031712234 >> v1:172.21.15.176:6789/0 conn(0x7fc9a00d2180 legacy=0x7fc9a00afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:38.304 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99effd700 1 -- 172.21.15.81:0/3031712234 >> v1:172.21.15.81:6789/0 conn(0x7fc9a00d3360 legacy=0x7fc9a00d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:38.304 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99effd700 1 -- 172.21.15.81:0/3031712234 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00af480 con 0x7fc9a015c660 2023-11-29T11:12:38.304 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99effd700 1 --2- 172.21.15.81:0/3031712234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a015c660 0x7fc9a0071be0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc998009e10 tx=0x7fc99800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df3ca2a68ed96c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:38.304 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99dffb700 1 -- 172.21.15.81:0/3031712234 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800e070 con 0x7fc9a015c660 2023-11-29T11:12:38.304 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99dffb700 1 -- 172.21.15.81:0/3031712234 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998003a40 con 0x7fc9a015c660 2023-11-29T11:12:38.305 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.299+0000 7fc99dffb700 1 -- 172.21.15.81:0/3031712234 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998003df0 con 0x7fc9a015c660 2023-11-29T11:12:38.305 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- 172.21.15.81:0/3031712234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a015c660 msgr2=0x7fc9a0071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:38.305 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 --2- 172.21.15.81:0/3031712234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a015c660 0x7fc9a0071be0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc998009e10 tx=0x7fc99800b330 comp rx=0 tx=0).stop 2023-11-29T11:12:38.305 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- 172.21.15.81:0/3031712234 shutdown_connections 2023-11-29T11:12:38.306 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 --2- 172.21.15.81:0/3031712234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a015c660 0x7fc9a0071be0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:38.306 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- 172.21.15.81:0/3031712234 >> 172.21.15.81:0/3031712234 conn(0x7fc9a00d2850 msgr2=0x7fc9a00d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:38.306 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- 172.21.15.81:0/3031712234 shutdown_connections 2023-11-29T11:12:38.306 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- 172.21.15.81:0/3031712234 wait complete. 2023-11-29T11:12:38.306 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 Processor -- start 2023-11-29T11:12:38.306 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- start start 2023-11-29T11:12:38.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a00d2180 0x7fc9a009bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:38.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a00d3360 0x7fc9a00c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:38.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a015c660 0x7fc9a015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:38.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0159d50 con 0x7fc9a00d3360 2023-11-29T11:12:38.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00cb920 con 0x7fc9a015c660 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a009c280 con 0x7fc9a00d2180 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a00d3360 0x7fc9a00c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a00d3360 0x7fc9a00c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43152/0 (socket says 172.21.15.81:43152) 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99e7fc700 1 -- 172.21.15.81:0/167749842 learned_addr learned my addr 172.21.15.81:0/167749842 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99effd700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a00d2180 0x7fc9a009bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99f7fe700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a015c660 0x7fc9a015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99e7fc700 1 -- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a00d2180 msgr2=0x7fc9a009bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99e7fc700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a00d2180 0x7fc9a009bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99e7fc700 1 -- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a015c660 msgr2=0x7fc9a015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99e7fc700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a015c660 0x7fc9a015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:38.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99e7fc700 1 -- 172.21.15.81:0/167749842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009a70 con 0x7fc9a00d3360 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.303+0000 7fc99f7fe700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a015c660 0x7fc9a015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc99e7fc700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a00d3360 0x7fc9a00c6380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc99400c730 tx=0x7fc99400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc9877fe700 1 -- 172.21.15.81:0/167749842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994005d90 con 0x7fc9a00d3360 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc9877fe700 1 -- 172.21.15.81:0/167749842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9940070d0 con 0x7fc9a00d3360 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a0072120 con 0x7fc9a00d3360 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc9877fe700 1 -- 172.21.15.81:0/167749842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994007480 con 0x7fc9a00d3360 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a00af760 con 0x7fc9a00d3360 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc9877fe700 1 -- 172.21.15.81:0/167749842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc994019030 con 0x7fc9a00d3360 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc9877fe700 1 -- 172.21.15.81:0/167749842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc99401c440 con 0x7fc9a00d3360 2023-11-29T11:12:38.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.307+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a00b0390 con 0x7fc9a00d3360 2023-11-29T11:12:38.313 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.311+0000 7fc9877fe700 1 -- 172.21.15.81:0/167749842 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc994017070 con 0x7fc9a00d3360 2023-11-29T11:12:38.374 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.371+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a00d0b80 con 0x7fc9a00d3360 2023-11-29T11:12:38.375 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.371+0000 7fc9877fe700 1 -- 172.21.15.81:0/167749842 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc9940075e0 con 0x7fc9a00d3360 2023-11-29T11:12:38.376 INFO:teuthology.misc.health.smithi081.stdout: 2023-11-29T11:12:38.376 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:37.114273+0000","last_up_change":"0.000000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a00d3360 msgr2=0x7fc9a00c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a00d3360 0x7fc9a00c6380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc99400c730 tx=0x7fc99400ca40 comp rx=0 tx=0).stop 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 shutdown_connections 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a015c660 0x7fc9a015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a00d3360 0x7fc9a00c6380 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 --2- 172.21.15.81:0/167749842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a00d2180 0x7fc9a009bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 >> 172.21.15.81:0/167749842 conn(0x7fc9a00d2850 msgr2=0x7fc9a015b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 shutdown_connections 2023-11-29T11:12:38.378 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:38.375+0000 7fc99ffff700 1 -- 172.21.15.81:0/167749842 wait complete. 2023-11-29T11:12:38.392 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-29T11:12:38.585 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:38.577+0000 7faeefd892c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-29T11:12:38.756 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:38.749+0000 7faeefd892c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-29T11:12:38.839 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:38.835+0000 7f7ea23672c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-29T11:12:38.909 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:38.907+0000 7f7ea23672c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-29T11:12:38.933 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:38.925+0000 7faeefd892c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-29T11:12:38.988 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:38.981+0000 7faeefd892c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-29T11:12:39.077 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:39.075+0000 7f7ea23672c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-29T11:12:39.143 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:39.139+0000 7f7ea23672c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-29T11:12:39.365 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:39.363+0000 7f7ea23672c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-29T11:12:39.541 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:39.539+0000 7f7ea23672c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-29T11:12:39.615 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:39.611+0000 7f7ea23672c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-29T11:12:39.704 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:39.697+0000 7faeefd892c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-29T11:12:39.775 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:39.765+0000 7faeefd892c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-29T11:12:39.927 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:39.921+0000 7faeefd892c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-29T11:12:39.991 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:39.985+0000 7faeefd892c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-29T11:12:40.214 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:40.205+0000 7faeefd892c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-29T11:12:40.385 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:40.377+0000 7faeefd892c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-29T11:12:40.389 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:40.387+0000 7f7ea23672c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-29T11:12:40.456 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:40.449+0000 7faeefd892c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-29T11:12:40.668 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-11-29T11:12:40.661+0000 7fba4779c700 -1 osd.4 0 log_to_monitors true 2023-11-29T11:12:40.975 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-11-29T11:12:40.971+0000 7f67c7e41700 -1 osd.1 0 log_to_monitors true 2023-11-29T11:12:41.151 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-11-29T11:12:41.147+0000 7efdb557c700 -1 osd.0 0 log_to_monitors true 2023-11-29T11:12:41.209 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-11-29T11:12:41.207+0000 7fb08d973700 -1 osd.3 0 log_to_monitors true 2023-11-29T11:12:41.232 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-29T11:12:41.225+0000 7faeefd892c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-29T11:12:41.426 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-11-29T11:12:41.423+0000 7fe848dc1700 -1 osd.2 0 log_to_monitors true 2023-11-29T11:12:41.428 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:41.427+0000 7f7e88bd8700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-29T11:12:41.435 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-11-29T11:12:41.431+0000 7f7e88bd8700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-29T11:12:41.440 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-11-29T11:12:41.433+0000 7efc38e51700 -1 osd.7 0 log_to_monitors true 2023-11-29T11:12:41.648 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-11-29T11:12:41.641+0000 7f08e2852700 -1 osd.5 0 log_to_monitors true 2023-11-29T11:12:41.663 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-11-29T11:12:41.653+0000 7ff23d5da700 -1 osd.6 0 log_to_monitors true 2023-11-29T11:12:44.017 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-11-29T11:12:44.009+0000 7efc34c90700 -1 osd.7 0 waiting for initial osdmap 2023-11-29T11:12:44.044 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-11-29T11:12:44.037+0000 7fba435db700 -1 osd.4 0 waiting for initial osdmap 2023-11-29T11:12:44.092 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-11-29T11:12:44.085+0000 7fba3b08a700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-29T11:12:44.093 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-11-29T11:12:44.085+0000 7efc2c73f700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-29T11:12:44.715 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-11-29T11:12:44.711+0000 7fe844c00700 -1 osd.2 0 waiting for initial osdmap 2023-11-29T11:12:44.726 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-11-29T11:12:44.723+0000 7fe83c6af700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-29T11:12:44.759 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-11-29T11:12:44.755+0000 7fb0897b2700 -1 osd.3 0 waiting for initial osdmap 2023-11-29T11:12:44.765 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-11-29T11:12:44.763+0000 7fb081261700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-29T11:12:44.794 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-11-29T11:12:44.791+0000 7f67c3c80700 -1 osd.1 0 waiting for initial osdmap 2023-11-29T11:12:44.800 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-11-29T11:12:44.795+0000 7f67bb72f700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-29T11:12:44.803 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-11-29T11:12:44.799+0000 7efdb1d42700 -1 osd.0 0 waiting for initial osdmap 2023-11-29T11:12:44.808 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-11-29T11:12:44.807+0000 7efda8e6a700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-29T11:12:44.897 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-11-29T11:12:44.889+0000 7f08df018700 -1 osd.5 0 waiting for initial osdmap 2023-11-29T11:12:44.904 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-11-29T11:12:44.897+0000 7f08d6140700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-29T11:12:44.945 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-11-29T11:12:44.937+0000 7ff239419700 -1 osd.6 0 waiting for initial osdmap 2023-11-29T11:12:44.952 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-11-29T11:12:44.945+0000 7ff230ec8700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-29T11:12:45.198 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-29T11:12:45.306 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.303+0000 7f8e27fff700 1 Processor -- start 2023-11-29T11:12:45.306 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.303+0000 7f8e27fff700 1 -- start start 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.303+0000 7f8e27fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8e280c5220 0x7f8e2815d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e280ae6c0 0x7f8e280cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e280719f0 con 0x7f8e28158c60 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2815d790 con 0x7f8e280ae6c0 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e28159030 con 0x7f8e280c5220 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e26ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8e28158c60 0x7f8e280c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45590/0 (socket says 172.21.15.81:45590) 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e26ffd700 1 -- 172.21.15.81:0/2808940432 learned_addr learned my addr 172.21.15.81:0/2808940432 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e1e7fc700 1 --2- 172.21.15.81:0/2808940432 >> v2:172.21.15.176:3300/0 conn(0x7f8e280c5220 0x7f8e2815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e277fe700 1 --2- 172.21.15.81:0/2808940432 >> v2:172.21.15.81:3300/0 conn(0x7f8e280ae6c0 0x7f8e280cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.309 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e267fc700 1 -- 172.21.15.81:0/2808940432 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167331513 0 0) 0x7f8e280719f0 con 0x7f8e28158c60 2023-11-29T11:12:45.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e267fc700 1 -- 172.21.15.81:0/2808940432 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e140035d0 con 0x7f8e28158c60 2023-11-29T11:12:45.310 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e267fc700 1 -- 172.21.15.81:0/2808940432 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2759349142 0 0) 0x7f8e140035d0 con 0x7f8e28158c60 2023-11-29T11:12:45.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e277fe700 1 -- 172.21.15.81:0/2808940432 >> v2:172.21.15.176:3300/0 conn(0x7f8e280c5220 msgr2=0x7f8e2815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:45.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e277fe700 1 --2- 172.21.15.81:0/2808940432 >> v2:172.21.15.176:3300/0 conn(0x7f8e280c5220 0x7f8e2815d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e277fe700 1 -- 172.21.15.81:0/2808940432 >> v1:172.21.15.81:6789/0 conn(0x7f8e28158c60 legacy=0x7f8e280c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e277fe700 1 -- 172.21.15.81:0/2808940432 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280710c0 con 0x7f8e280ae6c0 2023-11-29T11:12:45.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e277fe700 1 --2- 172.21.15.81:0/2808940432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e280ae6c0 0x7f8e280cd820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e28070ed0 tx=0x7f8e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdf4b091bf3f9b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:45.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e267fc700 1 -- 172.21.15.81:0/2808940432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000e070 con 0x7f8e280ae6c0 2023-11-29T11:12:45.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e267fc700 1 -- 172.21.15.81:0/2808940432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e20003a40 con 0x7f8e280ae6c0 2023-11-29T11:12:45.311 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e267fc700 1 -- 172.21.15.81:0/2808940432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18001670 con 0x7f8e280ae6c0 2023-11-29T11:12:45.312 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 -- 172.21.15.81:0/2808940432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e280ae6c0 msgr2=0x7f8e280cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.312 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 --2- 172.21.15.81:0/2808940432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e280ae6c0 0x7f8e280cd820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e28070ed0 tx=0x7f8e2000b330 comp rx=0 tx=0).stop 2023-11-29T11:12:45.312 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 -- 172.21.15.81:0/2808940432 shutdown_connections 2023-11-29T11:12:45.312 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 --2- 172.21.15.81:0/2808940432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e280ae6c0 0x7f8e280cd820 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.312 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 --2- 172.21.15.81:0/2808940432 >> v2:172.21.15.176:3300/0 conn(0x7f8e280c5220 0x7f8e2815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.312 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 -- 172.21.15.81:0/2808940432 >> 172.21.15.81:0/2808940432 conn(0x7f8e280b1120 msgr2=0x7f8e280b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:45.312 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 -- 172.21.15.81:0/2808940432 shutdown_connections 2023-11-29T11:12:45.312 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.307+0000 7f8e27fff700 1 -- 172.21.15.81:0/2808940432 wait complete. 2023-11-29T11:12:45.315 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.311+0000 7f8e27fff700 1 Processor -- start 2023-11-29T11:12:45.315 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.311+0000 7f8e27fff700 1 -- start start 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e280ae6c0 0x7f8e2814e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e280c5220 0x7f8e2814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e28158c60 0x7f8e280ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28159750 con 0x7f8e28158c60 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28159a30 con 0x7f8e280ae6c0 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28159d10 con 0x7f8e280c5220 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e28158c60 0x7f8e280ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e28158c60 0x7f8e280ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57602/0 (socket says 172.21.15.81:57602) 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e26ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e280ae6c0 0x7f8e2814e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 -- 172.21.15.81:0/269712206 learned_addr learned my addr 172.21.15.81:0/269712206 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e1e7fc700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e280c5220 0x7f8e2814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.318 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 -- 172.21.15.81:0/269712206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e280c5220 msgr2=0x7f8e2814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.319 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e280c5220 0x7f8e2814fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.319 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 -- 172.21.15.81:0/269712206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e280ae6c0 msgr2=0x7f8e2814e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.319 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e280ae6c0 0x7f8e2814e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.319 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 -- 172.21.15.81:0/269712206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20009a70 con 0x7f8e28158c60 2023-11-29T11:12:45.319 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e277fe700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e28158c60 0x7f8e280ca9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000b370 tx=0x7f8e20004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:45.320 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e24ff9700 1 -- 172.21.15.81:0/269712206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20004540 con 0x7f8e28158c60 2023-11-29T11:12:45.320 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e24ff9700 1 -- 172.21.15.81:0/269712206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e200046e0 con 0x7f8e28158c60 2023-11-29T11:12:45.320 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e24ff9700 1 -- 172.21.15.81:0/269712206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20012430 con 0x7f8e28158c60 2023-11-29T11:12:45.320 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e28071680 con 0x7f8e28158c60 2023-11-29T11:12:45.320 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e280713a0 con 0x7f8e28158c60 2023-11-29T11:12:45.320 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2806f860 con 0x7f8e28158c60 2023-11-29T11:12:45.320 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.315+0000 7f8e24ff9700 1 -- 172.21.15.81:0/269712206 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f8e20012590 con 0x7f8e28158c60 2023-11-29T11:12:45.321 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.319+0000 7f8e24ff9700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e08064e90 0x7f8e08067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.321 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.319+0000 7f8e26ffd700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e08064e90 0x7f8e08067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.321 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.319+0000 7f8e24ff9700 1 -- 172.21.15.81:0/269712206 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f8e20083140 con 0x7f8e28158c60 2023-11-29T11:12:45.321 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.319+0000 7f8e26ffd700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e08064e90 0x7f8e08067340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8e18000f60 tx=0x7f8e18001e00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:45.326 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.323+0000 7f8e24ff9700 1 -- 172.21.15.81:0/269712206 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8e200518e0 con 0x7f8e28158c60 2023-11-29T11:12:45.489 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.487+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e28067f70 con 0x7f8e28158c60 2023-11-29T11:12:45.490 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.487+0000 7f8e24ff9700 1 -- 172.21.15.81:0/269712206 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10440 (secure 0 0 0) 0x7f8e20054f00 con 0x7f8e28158c60 2023-11-29T11:12:45.490 INFO:teuthology.misc.health.smithi081.stdout: 2023-11-29T11:12:45.491 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":14,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:45.058147+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:12:45.493 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e08064e90 msgr2=0x7f8e08067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.493 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e08064e90 0x7f8e08067340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8e18000f60 tx=0x7f8e18001e00 comp rx=0 tx=0).stop 2023-11-29T11:12:45.493 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e28158c60 msgr2=0x7f8e280ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.493 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e28158c60 0x7f8e280ca9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000b370 tx=0x7f8e20004af0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.493 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 shutdown_connections 2023-11-29T11:12:45.494 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e08064e90 0x7f8e08067340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.494 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e28158c60 0x7f8e280ca9d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.494 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e280c5220 0x7f8e2814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.494 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 --2- 172.21.15.81:0/269712206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e280ae6c0 0x7f8e2814e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.494 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 >> 172.21.15.81:0/269712206 conn(0x7f8e280b1120 msgr2=0x7f8e281581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:45.494 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 shutdown_connections 2023-11-29T11:12:45.494 INFO:teuthology.misc.health.smithi081.stderr:2023-11-29T11:12:45.491+0000 7f8e27fff700 1 -- 172.21.15.81:0/269712206 wait complete. 2023-11-29T11:12:45.506 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-29T11:12:45.506 INFO:tasks.ceph:Creating RBD pool 2023-11-29T11:12:45.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-29T11:12:45.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f97409d0700 1 Processor -- start 2023-11-29T11:12:45.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f97409d0700 1 -- start start 2023-11-29T11:12:45.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f97409d0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f973c06ce60 0x7f973c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f97409d0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0cd300 con 0x7f973c0cf470 2023-11-29T11:12:45.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f97409d0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c06a7f0 con 0x7f973c0cce60 2023-11-29T11:12:45.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f97409d0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c15c8b0 con 0x7f973c06ce60 2023-11-29T11:12:45.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f973b59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f973c0cf470 0x7f973c0cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45600/0 (socket says 172.21.15.81:45600) 2023-11-29T11:12:45.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f973b59e700 1 -- 172.21.15.81:0/130481978 learned_addr learned my addr 172.21.15.81:0/130481978 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:45.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f973ad9d700 1 --2- 172.21.15.81:0/130481978 >> v2:172.21.15.81:3300/0 conn(0x7f973c06ce60 0x7f973c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f9739d9b700 1 -- 172.21.15.81:0/130481978 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129133100 0 0) 0x7f9734001490 con 0x7f973c0cf470 2023-11-29T11:12:45.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f9739d9b700 1 -- 172.21.15.81:0/130481978 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97280035d0 con 0x7f973c0cf470 2023-11-29T11:12:45.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f973ad9d700 1 -- 172.21.15.81:0/130481978 >> v1:172.21.15.176:6789/0 conn(0x7f973c0cce60 legacy=0x7f973c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f973ad9d700 1 -- 172.21.15.81:0/130481978 >> v1:172.21.15.81:6789/0 conn(0x7f973c0cf470 legacy=0x7f973c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f973ad9d700 1 -- 172.21.15.81:0/130481978 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c06aad0 con 0x7f973c06ce60 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.615+0000 7f973ad9d700 1 --2- 172.21.15.81:0/130481978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c06ce60 0x7f973c0d31b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9724009880 tx=0x7f9724009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fc0d7d81c6eb2e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f9739d9b700 1 -- 172.21.15.81:0/130481978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011830 con 0x7f973c06ce60 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f9739d9b700 1 -- 172.21.15.81:0/130481978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724011990 con 0x7f973c06ce60 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f9739d9b700 1 -- 172.21.15.81:0/130481978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011d20 con 0x7f973c06ce60 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 -- 172.21.15.81:0/130481978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c06ce60 msgr2=0x7f973c0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 --2- 172.21.15.81:0/130481978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c06ce60 0x7f973c0d31b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9724009880 tx=0x7f9724009b90 comp rx=0 tx=0).stop 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 -- 172.21.15.81:0/130481978 shutdown_connections 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 --2- 172.21.15.81:0/130481978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c06ce60 0x7f973c0d31b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 -- 172.21.15.81:0/130481978 >> 172.21.15.81:0/130481978 conn(0x7f973c0b5760 msgr2=0x7f973c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 -- 172.21.15.81:0/130481978 shutdown_connections 2023-11-29T11:12:45.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 -- 172.21.15.81:0/130481978 wait complete. 2023-11-29T11:12:45.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 Processor -- start 2023-11-29T11:12:45.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.619+0000 7f97409d0700 1 -- start start 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f973c06ce60 0x7f973c0c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f973c0cce60 0x7f973c144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c0cf470 0x7f973c144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1f1c50 con 0x7f973c0cf470 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0b0170 con 0x7f973c06ce60 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0b0450 con 0x7f973c0cce60 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c0cf470 0x7f973c144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c0cf470 0x7f973c144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57622/0 (socket says 172.21.15.81:57622) 2023-11-29T11:12:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 -- 172.21.15.81:0/2634720508 learned_addr learned my addr 172.21.15.81:0/2634720508 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973ad9d700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f973c06ce60 0x7f973c0c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973a59c700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f973c0cce60 0x7f973c144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 -- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f973c0cce60 msgr2=0x7f973c144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f973c0cce60 0x7f973c144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 -- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f973c06ce60 msgr2=0x7f973c0c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f973c06ce60 0x7f973c0c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 -- 172.21.15.81:0/2634720508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240094b0 con 0x7f973c0cf470 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973ad9d700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f973c06ce60 0x7f973c0c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f973b59e700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c0cf470 0x7f973c144f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f973400cae0 tx=0x7f973400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97337fe700 1 -- 172.21.15.81:0/2634720508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734007480 con 0x7f973c0cf470 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97337fe700 1 -- 172.21.15.81:0/2634720508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97340075e0 con 0x7f973c0cf470 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c06b090 con 0x7f973c0cf470 2023-11-29T11:12:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97337fe700 1 -- 172.21.15.81:0/2634720508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734007970 con 0x7f973c0cf470 2023-11-29T11:12:45.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c06adb0 con 0x7f973c0cf470 2023-11-29T11:12:45.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.623+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c0d0000 con 0x7f973c0cf470 2023-11-29T11:12:45.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.627+0000 7f97337fe700 1 -- 172.21.15.81:0/2634720508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f9734019030 con 0x7f973c0cf470 2023-11-29T11:12:45.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.627+0000 7f97337fe700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f971c064e90 0x7f971c067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:45.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.627+0000 7f973ad9d700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f971c064e90 0x7f971c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:45.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.627+0000 7f97337fe700 1 -- 172.21.15.81:0/2634720508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9734080f00 con 0x7f973c0cf470 2023-11-29T11:12:45.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.627+0000 7f973ad9d700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f971c064e90 0x7f971c067340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97240090b0 tx=0x7f9724008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:45.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.631+0000 7f97337fe700 1 -- 172.21.15.81:0/2634720508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f973404f690 con 0x7f973c0cf470 2023-11-29T11:12:45.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:45.791+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f973c0cd300 con 0x7f973c0cf470 2023-11-29T11:12:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.071+0000 7f97337fe700 1 -- 172.21.15.81:0/2634720508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f973c0cd300 con 0x7f973c0cf470 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f971c064e90 msgr2=0x7f971c067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f971c064e90 0x7f971c067340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97240090b0 tx=0x7f9724008030 comp rx=0 tx=0).stop 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c0cf470 msgr2=0x7f973c144f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c0cf470 0x7f973c144f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f973400cae0 tx=0x7f973400cb10 comp rx=0 tx=0).stop 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 shutdown_connections 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f971c064e90 0x7f971c067340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973c0cf470 0x7f973c144f70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f973c0cce60 0x7f973c144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 --2- 172.21.15.81:0/2634720508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f973c06ce60 0x7f973c0c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 >> 172.21.15.81:0/2634720508 conn(0x7f973c0b5760 msgr2=0x7f973c0b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 shutdown_connections 2023-11-29T11:12:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.075+0000 7f97409d0700 1 -- 172.21.15.81:0/2634720508 wait complete. 2023-11-29T11:12:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'rbd' created 2023-11-29T11:12:46.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-29T11:12:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.211+0000 7f6689cc4700 1 Processor -- start 2023-11-29T11:12:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.211+0000 7f6689cc4700 1 -- start start 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6689cc4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f668406a4c0 0x7f668406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6689cc4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f66840cf0e0 0x7f66840cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6689cc4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840cfa40 con 0x7f66840b1ae0 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6689cc4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840d0ab0 con 0x7f668406a4c0 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6689cc4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668406a9c0 con 0x7f66840cf0e0 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6683fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f668406a4c0 0x7f668406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6683fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f668406a4c0 0x7f668406d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57628/0 (socket says 172.21.15.81:57628) 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6683fff700 1 -- 172.21.15.81:0/1549812789 learned_addr learned my addr 172.21.15.81:0/1549812789 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f66894c3700 1 --2- 172.21.15.81:0/1549812789 >> v2:172.21.15.176:3300/0 conn(0x7f66840cf0e0 0x7f66840cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6683fff700 1 -- 172.21.15.81:0/1549812789 >> v2:172.21.15.176:3300/0 conn(0x7f66840cf0e0 msgr2=0x7f66840cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6683fff700 1 --2- 172.21.15.81:0/1549812789 >> v2:172.21.15.176:3300/0 conn(0x7f66840cf0e0 0x7f66840cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6683fff700 1 -- 172.21.15.81:0/1549812789 >> v1:172.21.15.176:6789/0 conn(0x7f66840b1ae0 legacy=0x7f66840d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6683fff700 1 -- 172.21.15.81:0/1549812789 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668406aca0 con 0x7f668406a4c0 2023-11-29T11:12:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6683fff700 1 --2- 172.21.15.81:0/1549812789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f668406a4c0 0x7f668406d8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66840b6440 tx=0x7f666c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a1db4cdc048673 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f66837fe700 1 -- 172.21.15.81:0/1549812789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c011830 con 0x7f668406a4c0 2023-11-29T11:12:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f66837fe700 1 -- 172.21.15.81:0/1549812789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c011990 con 0x7f668406a4c0 2023-11-29T11:12:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f66837fe700 1 -- 172.21.15.81:0/1549812789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c011d20 con 0x7f668406a4c0 2023-11-29T11:12:46.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6689cc4700 1 -- 172.21.15.81:0/1549812789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f668406a4c0 msgr2=0x7f668406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:46.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.215+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1549812789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f668406a4c0 0x7f668406d8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f66840b6440 tx=0x7f666c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 -- 172.21.15.81:0/1549812789 shutdown_connections 2023-11-29T11:12:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1549812789 >> v2:172.21.15.176:3300/0 conn(0x7f66840cf0e0 0x7f66840cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1549812789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f668406a4c0 0x7f668406d8e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 -- 172.21.15.81:0/1549812789 >> 172.21.15.81:0/1549812789 conn(0x7f668409bbd0 msgr2=0x7f66840b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 -- 172.21.15.81:0/1549812789 shutdown_connections 2023-11-29T11:12:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 -- 172.21.15.81:0/1549812789 wait complete. 2023-11-29T11:12:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 Processor -- start 2023-11-29T11:12:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 -- start start 2023-11-29T11:12:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f668406a4c0 0x7f66840c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66840b1ae0 0x7f668409dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66840cf0e0 0x7f668414fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668409e190 con 0x7f66840b1ae0 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668409e3f0 con 0x7f66840cf0e0 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.219+0000 7f6689cc4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668409e6d0 con 0x7f668406a4c0 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66840b1ae0 0x7f668409dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66840b1ae0 0x7f668409dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57640/0 (socket says 172.21.15.81:57640) 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 -- 172.21.15.81:0/1089873901 learned_addr learned my addr 172.21.15.81:0/1089873901 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f66894c3700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66840cf0e0 0x7f668414fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6688cc2700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f668406a4c0 0x7f66840c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 -- 172.21.15.81:0/1089873901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f668406a4c0 msgr2=0x7f66840c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f668406a4c0 0x7f66840c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 -- 172.21.15.81:0/1089873901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66840cf0e0 msgr2=0x7f668414fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66840cf0e0 0x7f668414fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 -- 172.21.15.81:0/1089873901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009570 con 0x7f66840b1ae0 2023-11-29T11:12:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6683fff700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66840b1ae0 0x7f668409dc50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f666c000c00 tx=0x7f666c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f66817fa700 1 -- 172.21.15.81:0/1089873901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c004510 con 0x7f66840b1ae0 2023-11-29T11:12:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f66817fa700 1 -- 172.21.15.81:0/1089873901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c01e070 con 0x7f66840b1ae0 2023-11-29T11:12:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66840b4380 con 0x7f66840b1ae0 2023-11-29T11:12:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f66817fa700 1 -- 172.21.15.81:0/1089873901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0038e0 con 0x7f66840b1ae0 2023-11-29T11:12:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668406af80 con 0x7f66840b1ae0 2023-11-29T11:12:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.223+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66840b1eb0 con 0x7f66840b1ae0 2023-11-29T11:12:46.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.227+0000 7f66817fa700 1 -- 172.21.15.81:0/1089873901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f666c00f050 con 0x7f66840b1ae0 2023-11-29T11:12:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.227+0000 7f66817fa700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6664064e90 0x7f6664067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.227+0000 7f66817fa700 1 -- 172.21.15.81:0/1089873901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4813+0+0 (secure 0 0 0) 0x7f666c0827b0 con 0x7f66840b1ae0 2023-11-29T11:12:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.227+0000 7f6688cc2700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6664064e90 0x7f6664067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.227+0000 7f6688cc2700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6664064e90 0x7f6664067340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6674000f60 tx=0x7f6674009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:46.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.235+0000 7f66817fa700 1 -- 172.21.15.81:0/1089873901 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f666c050e00 con 0x7f66840b1ae0 2023-11-29T11:12:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:46.399+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6684072500 con 0x7f66840b1ae0 2023-11-29T11:12:47.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.079+0000 7f66817fa700 1 -- 172.21.15.81:0/1089873901 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f666c054420 con 0x7f66840b1ae0 2023-11-29T11:12:47.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6664064e90 msgr2=0x7f6664067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6664064e90 0x7f6664067340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6674000f60 tx=0x7f6674009040 comp rx=0 tx=0).stop 2023-11-29T11:12:47.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66840b1ae0 msgr2=0x7f668409dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66840b1ae0 0x7f668409dc50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f666c000c00 tx=0x7f666c004770 comp rx=0 tx=0).stop 2023-11-29T11:12:47.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 shutdown_connections 2023-11-29T11:12:47.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6664064e90 0x7f6664067340 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66840cf0e0 0x7f668414fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66840b1ae0 0x7f668409dc50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 --2- 172.21.15.81:0/1089873901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f668406a4c0 0x7f66840c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 >> 172.21.15.81:0/1089873901 conn(0x7f668409bbd0 msgr2=0x7f66840b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:47.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 shutdown_connections 2023-11-29T11:12:47.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.083+0000 7f6689cc4700 1 -- 172.21.15.81:0/1089873901 wait complete. 2023-11-29T11:12:47.089 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-29T11:12:47.102 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-29T11:12:47.103 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-29T11:12:47.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-29T11:12:47.105 INFO:tasks.ceph.mds.a:Started 2023-11-29T11:12:47.105 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-29T11:12:47.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-29T11:12:47.109 INFO:tasks.ceph.mds.c:Started 2023-11-29T11:12:47.109 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-29T11:12:47.109 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-29T11:12:47.111 INFO:tasks.ceph.mds.b:Started 2023-11-29T11:12:47.111 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-29T11:12:47.111 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-29T11:12:47.113 INFO:tasks.ceph.mds.d:Started 2023-11-29T11:12:47.113 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-29T11:12:47.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:12:47.178 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:12:47.191 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:12:47.191 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:12:47.192 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-29T11:12:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.227+0000 7f2b6f4f0700 1 Processor -- start 2023-11-29T11:12:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- start start 2023-11-29T11:12:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b68154600 0x7f2b6815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6815e300 con 0x7f2b6806c650 2023-11-29T11:12:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6806ced0 con 0x7f2b6806abe0 2023-11-29T11:12:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6815d9d0 con 0x7f2b68154600 2023-11-29T11:12:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6dced700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2b6806c650 0x7f2b6806a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45614/0 (socket says 172.21.15.81:45614) 2023-11-29T11:12:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6dced700 1 -- 172.21.15.81:0/1536075328 learned_addr learned my addr 172.21.15.81:0/1536075328 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6e4ee700 1 --2- 172.21.15.81:0/1536075328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b68154600 0x7f2b6815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6d4ec700 1 -- 172.21.15.81:0/1536075328 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938612529 0 0) 0x7f2b6815e300 con 0x7f2b6806c650 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6d4ec700 1 -- 172.21.15.81:0/1536075328 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b540035d0 con 0x7f2b6806c650 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6d4ec700 1 -- 172.21.15.81:0/1536075328 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876629723 0 0) 0x7f2b6806ced0 con 0x7f2b6806abe0 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6d4ec700 1 -- 172.21.15.81:0/1536075328 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b6815e300 con 0x7f2b6806abe0 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6e4ee700 1 -- 172.21.15.81:0/1536075328 >> v1:172.21.15.176:6789/0 conn(0x7f2b6806abe0 legacy=0x7f2b6815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6e4ee700 1 -- 172.21.15.81:0/1536075328 >> v1:172.21.15.81:6789/0 conn(0x7f2b6806c650 legacy=0x7f2b6806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6e4ee700 1 -- 172.21.15.81:0/1536075328 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6815dcb0 con 0x7f2b68154600 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6e4ee700 1 --2- 172.21.15.81:0/1536075328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b68154600 0x7f2b6815aec0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009880 tx=0x7f2b64009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d871d500d10c5d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6d4ec700 1 -- 172.21.15.81:0/1536075328 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64011830 con 0x7f2b68154600 2023-11-29T11:12:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6d4ec700 1 -- 172.21.15.81:0/1536075328 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64011990 con 0x7f2b68154600 2023-11-29T11:12:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6d4ec700 1 -- 172.21.15.81:0/1536075328 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64011d20 con 0x7f2b68154600 2023-11-29T11:12:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/1536075328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b68154600 msgr2=0x7f2b6815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 --2- 172.21.15.81:0/1536075328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b68154600 0x7f2b6815aec0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009880 tx=0x7f2b64009b90 comp rx=0 tx=0).stop 2023-11-29T11:12:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/1536075328 shutdown_connections 2023-11-29T11:12:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 --2- 172.21.15.81:0/1536075328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b68154600 0x7f2b6815aec0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/1536075328 >> 172.21.15.81:0/1536075328 conn(0x7f2b6806ec40 msgr2=0x7f2b680b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/1536075328 shutdown_connections 2023-11-29T11:12:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.231+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/1536075328 wait complete. 2023-11-29T11:12:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 Processor -- start 2023-11-29T11:12:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 -- start start 2023-11-29T11:12:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b6806abe0 0x7f2b68153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b6806c650 0x7f2b68151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b68151a90 0x7f2b68156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68152280 con 0x7f2b6806c650 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68152560 con 0x7f2b68151a90 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68152840 con 0x7f2b6806abe0 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b6806c650 0x7f2b68151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b6806c650 0x7f2b68151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57668/0 (socket says 172.21.15.81:57668) 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 -- 172.21.15.81:0/3330332331 learned_addr learned my addr 172.21.15.81:0/3330332331 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6ecef700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b68151a90 0x7f2b68156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6e4ee700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b6806abe0 0x7f2b68153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 -- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b6806abe0 msgr2=0x7f2b68153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b6806abe0 0x7f2b68153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 -- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b68151a90 msgr2=0x7f2b68156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b68151a90 0x7f2b68156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 -- 172.21.15.81:0/3330332331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640094b0 con 0x7f2b6806c650 2023-11-29T11:12:47.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6ecef700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b68151a90 0x7f2b68156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:47.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6dced700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b6806c650 0x7f2b68151550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800c4d0 tx=0x7f2b5800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b5effd700 1 -- 172.21.15.81:0/3330332331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58005d90 con 0x7f2b6806c650 2023-11-29T11:12:47.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6815e790 con 0x7f2b6806c650 2023-11-29T11:12:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b5effd700 1 -- 172.21.15.81:0/3330332331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b580070d0 con 0x7f2b6806c650 2023-11-29T11:12:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6815df90 con 0x7f2b6806c650 2023-11-29T11:12:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b5effd700 1 -- 172.21.15.81:0/3330332331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58007440 con 0x7f2b6806c650 2023-11-29T11:12:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.235+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6806caa0 con 0x7f2b6806c650 2023-11-29T11:12:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.239+0000 7f2b5effd700 1 -- 172.21.15.81:0/3330332331 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f2b58019030 con 0x7f2b6806c650 2023-11-29T11:12:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.239+0000 7f2b5effd700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b4c064e90 0x7f2b4c067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.239+0000 7f2b5effd700 1 -- 172.21.15.81:0/3330332331 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2b58080e00 con 0x7f2b6806c650 2023-11-29T11:12:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.239+0000 7f2b6e4ee700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b4c064e90 0x7f2b4c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.239+0000 7f2b6e4ee700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b4c064e90 0x7f2b4c067340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b640090b0 tx=0x7f2b6401c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.247+0000 7f2b5effd700 1 -- 172.21.15.81:0/3330332331 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2b5804a400 con 0x7f2b6806c650 2023-11-29T11:12:47.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.411+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b68072c20 con 0x7f2b6806c650 2023-11-29T11:12:47.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.411+0000 7f2b5effd700 1 -- 172.21.15.81:0/3330332331 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14129 (secure 0 0 0) 0x7f2b5804f380 con 0x7f2b6806c650 2023-11-29T11:12:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:47.415 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:47.065931+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b4c064e90 msgr2=0x7f2b4c067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b4c064e90 0x7f2b4c067340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b640090b0 tx=0x7f2b6401c040 comp rx=0 tx=0).stop 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b6806c650 msgr2=0x7f2b68151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b6806c650 0x7f2b68151550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800c4d0 tx=0x7f2b5800c890 comp rx=0 tx=0).stop 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 shutdown_connections 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b4c064e90 0x7f2b4c067340 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b68151a90 0x7f2b68156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b6806c650 0x7f2b68151550 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 --2- 172.21.15.81:0/3330332331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b6806abe0 0x7f2b68153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 >> 172.21.15.81:0/3330332331 conn(0x7f2b6806ec40 msgr2=0x7f2b680c56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 shutdown_connections 2023-11-29T11:12:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.415+0000 7f2b6f4f0700 1 -- 172.21.15.81:0/3330332331 wait complete. 2023-11-29T11:12:47.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:12:47.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:12:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.543+0000 7f215656b700 1 Processor -- start 2023-11-29T11:12:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.543+0000 7f215656b700 1 -- start start 2023-11-29T11:12:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f215006a4c0 0x7f215006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f21500cf0e0 0x7f21500cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500cfa80 con 0x7f21500b1ae0 2023-11-29T11:12:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21500d0ab0 con 0x7f21500cf0e0 2023-11-29T11:12:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215006a9c0 con 0x7f215006a4c0 2023-11-29T11:12:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2154d68700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f215006a4c0 0x7f215006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2155569700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f21500b1ae0 0x7f21500d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:55252/0 (socket says 172.21.15.81:55252) 2023-11-29T11:12:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2155569700 1 -- 172.21.15.81:0/2234808455 learned_addr learned my addr 172.21.15.81:0/2234808455 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2155d6a700 1 --2- 172.21.15.81:0/2234808455 >> v2:172.21.15.176:3300/0 conn(0x7f21500cf0e0 0x7f21500cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2147fff700 1 -- 172.21.15.81:0/2234808455 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718279578 0 0) 0x7f21500cfa80 con 0x7f21500b1ae0 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2147fff700 1 -- 172.21.15.81:0/2234808455 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f213c0035d0 con 0x7f21500b1ae0 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2154d68700 1 -- 172.21.15.81:0/2234808455 >> v2:172.21.15.176:3300/0 conn(0x7f21500cf0e0 msgr2=0x7f21500cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2154d68700 1 --2- 172.21.15.81:0/2234808455 >> v2:172.21.15.176:3300/0 conn(0x7f21500cf0e0 0x7f21500cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2154d68700 1 -- 172.21.15.81:0/2234808455 >> v1:172.21.15.176:6789/0 conn(0x7f21500b1ae0 legacy=0x7f21500d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2154d68700 1 -- 172.21.15.81:0/2234808455 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215006aca0 con 0x7f215006a4c0 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2155d6a700 1 --2- 172.21.15.81:0/2234808455 >> v2:172.21.15.176:3300/0 conn(0x7f21500cf0e0 0x7f21500cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2154d68700 1 --2- 172.21.15.81:0/2234808455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f215006a4c0 0x7f215006d8e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2140009850 tx=0x7f2140009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc74273069a3f404 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2147fff700 1 -- 172.21.15.81:0/2234808455 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140011830 con 0x7f215006a4c0 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2147fff700 1 -- 172.21.15.81:0/2234808455 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140011990 con 0x7f215006a4c0 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f2147fff700 1 -- 172.21.15.81:0/2234808455 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140011d40 con 0x7f215006a4c0 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 -- 172.21.15.81:0/2234808455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f215006a4c0 msgr2=0x7f215006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 --2- 172.21.15.81:0/2234808455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f215006a4c0 0x7f215006d8e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2140009850 tx=0x7f2140009b60 comp rx=0 tx=0).stop 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 -- 172.21.15.81:0/2234808455 shutdown_connections 2023-11-29T11:12:47.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 --2- 172.21.15.81:0/2234808455 >> v2:172.21.15.176:3300/0 conn(0x7f21500cf0e0 0x7f21500cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.547+0000 7f215656b700 1 --2- 172.21.15.81:0/2234808455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f215006a4c0 0x7f215006d8e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 -- 172.21.15.81:0/2234808455 >> 172.21.15.81:0/2234808455 conn(0x7f215009bbd0 msgr2=0x7f21500b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 -- 172.21.15.81:0/2234808455 shutdown_connections 2023-11-29T11:12:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 -- 172.21.15.81:0/2234808455 wait complete. 2023-11-29T11:12:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 Processor -- start 2023-11-29T11:12:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 -- start start 2023-11-29T11:12:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215006a4c0 0x7f215014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21500b1ae0 0x7f21500b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21500cf0e0 0x7f21500c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21500b36d0 con 0x7f21500b1ae0 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21500b2ac0 con 0x7f215006a4c0 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f215656b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21500b2da0 con 0x7f21500cf0e0 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f2154d68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21500b1ae0 0x7f21500b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f2154d68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21500b1ae0 0x7f21500b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57684/0 (socket says 172.21.15.81:57684) 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f2154d68700 1 -- 172.21.15.81:0/3044366137 learned_addr learned my addr 172.21.15.81:0/3044366137 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f2155d6a700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21500cf0e0 0x7f21500c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.551+0000 7f2155569700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215006a4c0 0x7f215014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2154d68700 1 -- 172.21.15.81:0/3044366137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21500cf0e0 msgr2=0x7f21500c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2154d68700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21500cf0e0 0x7f21500c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2154d68700 1 -- 172.21.15.81:0/3044366137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215006a4c0 msgr2=0x7f215014dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2154d68700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215006a4c0 0x7f215014dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2154d68700 1 -- 172.21.15.81:0/3044366137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2148009a70 con 0x7f21500b1ae0 2023-11-29T11:12:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2154d68700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21500b1ae0 0x7f21500b2100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2140014040 tx=0x7f2140004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2145ffb700 1 -- 172.21.15.81:0/3044366137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400044d0 con 0x7f21500b1ae0 2023-11-29T11:12:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2145ffb700 1 -- 172.21.15.81:0/3044366137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214001e070 con 0x7f21500b1ae0 2023-11-29T11:12:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21400094b0 con 0x7f21500b1ae0 2023-11-29T11:12:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2145ffb700 1 -- 172.21.15.81:0/3044366137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140003900 con 0x7f21500b1ae0 2023-11-29T11:12:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21500b4380 con 0x7f21500b1ae0 2023-11-29T11:12:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215006af80 con 0x7f21500b1ae0 2023-11-29T11:12:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.555+0000 7f2145ffb700 1 -- 172.21.15.81:0/3044366137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f214000f050 con 0x7f21500b1ae0 2023-11-29T11:12:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.559+0000 7f2145ffb700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2134064e90 0x7f2134067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.559+0000 7f2155569700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2134064e90 0x7f2134067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.559+0000 7f2145ffb700 1 -- 172.21.15.81:0/3044366137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2140020070 con 0x7f21500b1ae0 2023-11-29T11:12:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.559+0000 7f2155569700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2134064e90 0x7f2134067340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f214c007fd0 tx=0x7f214c007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.567+0000 7f2145ffb700 1 -- 172.21.15.81:0/3044366137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f21400512b0 con 0x7f21500b1ae0 2023-11-29T11:12:47.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.727+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21500b1eb0 con 0x7f21500b1ae0 2023-11-29T11:12:47.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.727+0000 7f2145ffb700 1 -- 172.21.15.81:0/3044366137 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f21400150a0 con 0x7f21500b1ae0 2023-11-29T11:12:47.730 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:12:47.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2134064e90 msgr2=0x7f2134067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2134064e90 0x7f2134067340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f214c007fd0 tx=0x7f214c007de0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21500b1ae0 msgr2=0x7f21500b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21500b1ae0 0x7f21500b2100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2140014040 tx=0x7f2140004770 comp rx=0 tx=0).stop 2023-11-29T11:12:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 shutdown_connections 2023-11-29T11:12:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2134064e90 0x7f2134067340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21500cf0e0 0x7f21500c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21500b1ae0 0x7f21500b2100 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 --2- 172.21.15.81:0/3044366137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f215006a4c0 0x7f215014dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 >> 172.21.15.81:0/3044366137 conn(0x7f215009bbd0 msgr2=0x7f215015bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 shutdown_connections 2023-11-29T11:12:47.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.731+0000 7f215656b700 1 -- 172.21.15.81:0/3044366137 wait complete. 2023-11-29T11:12:47.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:12:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559ffff700 1 Processor -- start 2023-11-29T11:12:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559ffff700 1 -- start start 2023-11-29T11:12:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 0x7f55a015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55a009bdb0 0x7f55a015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a00b2db0 con 0x7f55a00cbb30 2023-11-29T11:12:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a00b3240 con 0x7f55a009bdb0 2023-11-29T11:12:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a006d840 con 0x7f55a00b00e0 2023-11-29T11:12:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559effd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 0x7f55a015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559e7fc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55a009bdb0 0x7f55a015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559e7fc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55a009bdb0 0x7f55a015d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58262/0 (socket says 172.21.15.81:58262) 2023-11-29T11:12:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559e7fc700 1 -- 172.21.15.81:0/544253942 learned_addr learned my addr 172.21.15.81:0/544253942 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.867+0000 7f559f7fe700 1 --1- 172.21.15.81:0/544253942 >> v1:172.21.15.176:6789/0 conn(0x7f55a00cbb30 0x7f55a00ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:55258/0 (socket says 172.21.15.81:55258) 2023-11-29T11:12:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559e7fc700 1 -- 172.21.15.81:0/544253942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 msgr2=0x7f55a015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559e7fc700 1 --2- 172.21.15.81:0/544253942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 0x7f55a015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559e7fc700 1 -- 172.21.15.81:0/544253942 >> v1:172.21.15.176:6789/0 conn(0x7f55a00cbb30 legacy=0x7f55a00ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559e7fc700 1 -- 172.21.15.81:0/544253942 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a006d560 con 0x7f55a009bdb0 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559e7fc700 1 --2- 172.21.15.81:0/544253942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 0x7f55a015d820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f559000d150 tx=0x7f559000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea0ee6eb487cc326 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559dffb700 1 -- 172.21.15.81:0/544253942 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590010070 con 0x7f55a009bdb0 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559dffb700 1 -- 172.21.15.81:0/544253942 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559000dd10 con 0x7f55a009bdb0 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559dffb700 1 -- 172.21.15.81:0/544253942 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559000b310 con 0x7f55a009bdb0 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- 172.21.15.81:0/544253942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 msgr2=0x7f55a015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 --2- 172.21.15.81:0/544253942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 0x7f55a015d820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f559000d150 tx=0x7f559000d460 comp rx=0 tx=0).stop 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- 172.21.15.81:0/544253942 shutdown_connections 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 --2- 172.21.15.81:0/544253942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 0x7f55a015d820 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 --2- 172.21.15.81:0/544253942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 0x7f55a015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- 172.21.15.81:0/544253942 >> 172.21.15.81:0/544253942 conn(0x7f55a00cae70 msgr2=0x7f55a00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- 172.21.15.81:0/544253942 shutdown_connections 2023-11-29T11:12:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- 172.21.15.81:0/544253942 wait complete. 2023-11-29T11:12:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 Processor -- start 2023-11-29T11:12:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- start start 2023-11-29T11:12:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 0x7f55a014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 0x7f55a014a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a00cbb30 0x7f55a00c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00c9b50 con 0x7f55a00cbb30 2023-11-29T11:12:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a01e3900 con 0x7f55a009bdb0 2023-11-29T11:12:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.871+0000 7f559ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a014b900 con 0x7f55a00b00e0 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a00cbb30 0x7f55a00c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a00cbb30 0x7f55a00c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57694/0 (socket says 172.21.15.81:57694) 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 -- 172.21.15.81:0/3103589773 learned_addr learned my addr 172.21.15.81:0/3103589773 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559effd700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 0x7f55a014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559e7fc700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 0x7f55a014a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 -- 172.21.15.81:0/3103589773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 msgr2=0x7f55a014a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 0x7f55a014a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 -- 172.21.15.81:0/3103589773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 msgr2=0x7f55a014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 0x7f55a014b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 -- 172.21.15.81:0/3103589773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559000bd40 con 0x7f55a00cbb30 2023-11-29T11:12:47.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559f7fe700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a00cbb30 0x7f55a00c6110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f559800c3f0 tx=0x7f559800c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f55977fe700 1 -- 172.21.15.81:0/3103589773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598004a90 con 0x7f55a00cbb30 2023-11-29T11:12:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f55977fe700 1 -- 172.21.15.81:0/3103589773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598004bf0 con 0x7f55a00cbb30 2023-11-29T11:12:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a00ac3d0 con 0x7f55a00cbb30 2023-11-29T11:12:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f55977fe700 1 -- 172.21.15.81:0/3103589773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55980070d0 con 0x7f55a00cbb30 2023-11-29T11:12:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a00ac0f0 con 0x7f55a00cbb30 2023-11-29T11:12:47.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a006cbe0 con 0x7f55a00cbb30 2023-11-29T11:12:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.875+0000 7f55977fe700 1 -- 172.21.15.81:0/3103589773 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f5598010070 con 0x7f55a00cbb30 2023-11-29T11:12:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.879+0000 7f55977fe700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5580064e90 0x7f5580067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.879+0000 7f55977fe700 1 -- 172.21.15.81:0/3103589773 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f5598080fe0 con 0x7f55a00cbb30 2023-11-29T11:12:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.879+0000 7f559effd700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5580064e90 0x7f5580067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.879+0000 7f559effd700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5580064e90 0x7f5580067340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5588009bf0 tx=0x7f5588009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:47.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:47.887+0000 7f55977fe700 1 -- 172.21.15.81:0/3103589773 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f559804f530 con 0x7f55a00cbb30 2023-11-29T11:12:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.039+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55a00cf360 con 0x7f55a00cbb30 2023-11-29T11:12:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f55977fe700 1 -- 172.21.15.81:0/3103589773 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5598052b50 con 0x7f55a00cbb30 2023-11-29T11:12:48.045 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:12:48.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5580064e90 msgr2=0x7f5580067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5580064e90 0x7f5580067340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5588009bf0 tx=0x7f5588009240 comp rx=0 tx=0).stop 2023-11-29T11:12:48.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a00cbb30 msgr2=0x7f55a00c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a00cbb30 0x7f55a00c6110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f559800c3f0 tx=0x7f559800c700 comp rx=0 tx=0).stop 2023-11-29T11:12:48.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 shutdown_connections 2023-11-29T11:12:48.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5580064e90 0x7f5580067340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a00cbb30 0x7f55a00c6110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00b00e0 0x7f55a014a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 --2- 172.21.15.81:0/3103589773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a009bdb0 0x7f55a014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 >> 172.21.15.81:0/3103589773 conn(0x7f55a00cae70 msgr2=0x7f55a006ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 shutdown_connections 2023-11-29T11:12:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.043+0000 7f559ffff700 1 -- 172.21.15.81:0/3103589773 wait complete. 2023-11-29T11:12:48.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:12:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5bc84d700 1 Processor -- start 2023-11-29T11:12:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5bc84d700 1 -- start start 2023-11-29T11:12:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5bc84d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5b80cf050 0x7fb5b806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5bc84d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5b806a530 0x7fb5b80cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5bc84d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b80b4c10 0x7fb5b80cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5bc84d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b815c6d0 con 0x7fb5b80cf050 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5bc84d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b806a9d0 con 0x7fb5b806a530 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5bc84d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b80cf960 con 0x7fb5b80b4c10 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5b80cf050 0x7fb5b806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b6ffd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5b806a530 0x7fb5b80cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b6ffd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5b806a530 0x7fb5b80cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58280/0 (socket says 172.21.15.81:58280) 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b6ffd700 1 -- 172.21.15.81:0/1679399326 learned_addr learned my addr 172.21.15.81:0/1679399326 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b7fff700 1 --2- 172.21.15.81:0/1679399326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b80b4c10 0x7fb5b80cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b77fe700 1 -- 172.21.15.81:0/1679399326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b80b4c10 msgr2=0x7fb5b80cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b77fe700 1 --2- 172.21.15.81:0/1679399326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b80b4c10 0x7fb5b80cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b77fe700 1 -- 172.21.15.81:0/1679399326 >> v2:172.21.15.176:3300/0 conn(0x7fb5b806a530 msgr2=0x7fb5b80cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b77fe700 1 --2- 172.21.15.81:0/1679399326 >> v2:172.21.15.176:3300/0 conn(0x7fb5b806a530 0x7fb5b80cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b77fe700 1 -- 172.21.15.81:0/1679399326 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b806ac60 con 0x7fb5b80cf050 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b6ffd700 1 --2- 172.21.15.81:0/1679399326 >> v2:172.21.15.176:3300/0 conn(0x7fb5b806a530 0x7fb5b80cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.171+0000 7fb5b77fe700 1 --2- 172.21.15.81:0/1679399326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b806d7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80d38d0 tx=0x7fb5a8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba7d434801df889 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5b67fc700 1 -- 172.21.15.81:0/1679399326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8011830 con 0x7fb5b80cf050 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5b67fc700 1 -- 172.21.15.81:0/1679399326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a8011990 con 0x7fb5b80cf050 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5b67fc700 1 -- 172.21.15.81:0/1679399326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8011d20 con 0x7fb5b80cf050 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 -- 172.21.15.81:0/1679399326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 msgr2=0x7fb5b806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/1679399326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b806d7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80d38d0 tx=0x7fb5a8009b30 comp rx=0 tx=0).stop 2023-11-29T11:12:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 -- 172.21.15.81:0/1679399326 shutdown_connections 2023-11-29T11:12:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/1679399326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b80b4c10 0x7fb5b80cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/1679399326 >> v2:172.21.15.176:3300/0 conn(0x7fb5b806a530 0x7fb5b80cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/1679399326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b806d7d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 -- 172.21.15.81:0/1679399326 >> 172.21.15.81:0/1679399326 conn(0x7fb5b809bb30 msgr2=0x7fb5b80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 -- 172.21.15.81:0/1679399326 shutdown_connections 2023-11-29T11:12:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 -- 172.21.15.81:0/1679399326 wait complete. 2023-11-29T11:12:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 Processor -- start 2023-11-29T11:12:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.175+0000 7fb5bc84d700 1 -- start start 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5bc84d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b806a530 0x7fb5b815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5bc84d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5b80b4c10 0x7fb5b815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5bc84d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b80b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5bc84d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b815d790 con 0x7fb5b80cf050 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5bc84d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b815da70 con 0x7fb5b80b4c10 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5bc84d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b815dd50 con 0x7fb5b806a530 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b6ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5b80b4c10 0x7fb5b815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b80b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b6ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5b80b4c10 0x7fb5b815f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58294/0 (socket says 172.21.15.81:58294) 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b6ffd700 1 -- 172.21.15.81:0/2754619614 learned_addr learned my addr 172.21.15.81:0/2754619614 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b80b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57714/0 (socket says 172.21.15.81:57714) 2023-11-29T11:12:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b77fe700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b806a530 0x7fb5b815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b7fff700 1 -- 172.21.15.81:0/2754619614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b806a530 msgr2=0x7fb5b815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b7fff700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b806a530 0x7fb5b815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b7fff700 1 -- 172.21.15.81:0/2754619614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5b80b4c10 msgr2=0x7fb5b815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b7fff700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5b80b4c10 0x7fb5b815f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b7fff700 1 -- 172.21.15.81:0/2754619614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac009570 con 0x7fb5b80cf050 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5b7fff700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b80b0cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000efc0 tx=0x7fb5b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb59ffff700 1 -- 172.21.15.81:0/2754619614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000cc90 con 0x7fb5b80cf050 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb59ffff700 1 -- 172.21.15.81:0/2754619614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b000f040 con 0x7fb5b80cf050 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a80094b0 con 0x7fb5b80cf050 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb59ffff700 1 -- 172.21.15.81:0/2754619614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b00146c0 con 0x7fb5b80cf050 2023-11-29T11:12:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.179+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b80b4410 con 0x7fb5b80cf050 2023-11-29T11:12:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.183+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b806af40 con 0x7fb5b80cf050 2023-11-29T11:12:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.183+0000 7fb59ffff700 1 -- 172.21.15.81:0/2754619614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7fb5b0014820 con 0x7fb5b80cf050 2023-11-29T11:12:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.183+0000 7fb59ffff700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5a4064e90 0x7fb5a4067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.183+0000 7fb5b77fe700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5a4064e90 0x7fb5a4067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.183+0000 7fb59ffff700 1 -- 172.21.15.81:0/2754619614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb5b0082620 con 0x7fb5b80cf050 2023-11-29T11:12:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.183+0000 7fb5b77fe700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5a4064e90 0x7fb5a4067340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8000c00 tx=0x7fb5a8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.191+0000 7fb59ffff700 1 -- 172.21.15.81:0/2754619614 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb5b0050b60 con 0x7fb5b80cf050 2023-11-29T11:12:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.391+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5b80b46f0 con 0x7fb5b80cf050 2023-11-29T11:12:48.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.391+0000 7fb59ffff700 1 -- 172.21.15.81:0/2754619614 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7fb5b0018090 con 0x7fb5b80cf050 2023-11-29T11:12:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:48.395 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-29T11:12:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5a4064e90 msgr2=0x7fb5a4067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5a4064e90 0x7fb5a4067340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8000c00 tx=0x7fb5a8008030 comp rx=0 tx=0).stop 2023-11-29T11:12:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 msgr2=0x7fb5b80b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b80b0cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000efc0 tx=0x7fb5b000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 shutdown_connections 2023-11-29T11:12:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5a4064e90 0x7fb5a4067340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5b80cf050 0x7fb5b80b0cf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5b80b4c10 0x7fb5b815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 --2- 172.21.15.81:0/2754619614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5b806a530 0x7fb5b815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 >> 172.21.15.81:0/2754619614 conn(0x7fb5b809bb30 msgr2=0x7fb5b80b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:48.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 shutdown_connections 2023-11-29T11:12:48.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.395+0000 7fb5bc84d700 1 -- 172.21.15.81:0/2754619614 wait complete. 2023-11-29T11:12:48.398 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2023-11-29T11:12:48.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:12:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 Processor -- start 2023-11-29T11:12:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 -- start start 2023-11-29T11:12:48.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c145090 0x7fe14c145460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe14c06cd50 0x7fe14c06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c069ce0 con 0x7fe14c0ab850 2023-11-29T11:12:48.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c069fc0 con 0x7fe14c06cd50 2023-11-29T11:12:48.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c06a2a0 con 0x7fe14c145090 2023-11-29T11:12:48.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15189b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe14c0ab850 0x7fe14c06c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45616/0 (socket says 172.21.15.81:45616) 2023-11-29T11:12:48.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15189b700 1 -- 172.21.15.81:0/2701872090 learned_addr learned my addr 172.21.15.81:0/2701872090 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:48.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15289d700 1 --2- 172.21.15.81:0/2701872090 >> v2:172.21.15.176:3300/0 conn(0x7fe14c06cd50 0x7fe14c06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15209c700 1 --2- 172.21.15.81:0/2701872090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c145090 0x7fe14c145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15109a700 1 -- 172.21.15.81:0/2701872090 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123635309 0 0) 0x7fe14c069ce0 con 0x7fe14c0ab850 2023-11-29T11:12:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15109a700 1 -- 172.21.15.81:0/2701872090 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1380035d0 con 0x7fe14c0ab850 2023-11-29T11:12:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15209c700 1 -- 172.21.15.81:0/2701872090 >> v2:172.21.15.176:3300/0 conn(0x7fe14c06cd50 msgr2=0x7fe14c06ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15209c700 1 --2- 172.21.15.81:0/2701872090 >> v2:172.21.15.176:3300/0 conn(0x7fe14c06cd50 0x7fe14c06ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15209c700 1 -- 172.21.15.81:0/2701872090 >> v1:172.21.15.81:6789/0 conn(0x7fe14c0ab850 legacy=0x7fe14c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15209c700 1 -- 172.21.15.81:0/2701872090 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c06a580 con 0x7fe14c145090 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15209c700 1 --2- 172.21.15.81:0/2701872090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c145090 0x7fe14c145460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe144009d90 tx=0x7fe14400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ed1ee9c15f1506 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15109a700 1 -- 172.21.15.81:0/2701872090 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400e070 con 0x7fe14c145090 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15109a700 1 -- 172.21.15.81:0/2701872090 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14400bb20 con 0x7fe14c145090 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15109a700 1 -- 172.21.15.81:0/2701872090 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400be90 con 0x7fe14c145090 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 -- 172.21.15.81:0/2701872090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c145090 msgr2=0x7fe14c145460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 --2- 172.21.15.81:0/2701872090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c145090 0x7fe14c145460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe144009d90 tx=0x7fe14400b330 comp rx=0 tx=0).stop 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 -- 172.21.15.81:0/2701872090 shutdown_connections 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 --2- 172.21.15.81:0/2701872090 >> v2:172.21.15.176:3300/0 conn(0x7fe14c06cd50 0x7fe14c06ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 --2- 172.21.15.81:0/2701872090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c145090 0x7fe14c145460 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.515+0000 7fe15309e700 1 -- 172.21.15.81:0/2701872090 >> 172.21.15.81:0/2701872090 conn(0x7fe14c06e000 msgr2=0x7fe14c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 -- 172.21.15.81:0/2701872090 shutdown_connections 2023-11-29T11:12:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 -- 172.21.15.81:0/2701872090 wait complete. 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 Processor -- start 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 -- start start 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c06cd50 0x7fe14c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c0ab850 0x7fe14c0c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe14c145090 0x7fe14c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0afc80 con 0x7fe14c145090 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0abe80 con 0x7fe14c0ab850 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0af3e0 con 0x7fe14c06cd50 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe14c145090 0x7fe14c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe14c145090 0x7fe14c0ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57738/0 (socket says 172.21.15.81:57738) 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 -- 172.21.15.81:0/1680533235 learned_addr learned my addr 172.21.15.81:0/1680533235 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15209c700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c06cd50 0x7fe14c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15189b700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c0ab850 0x7fe14c0c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 -- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c06cd50 msgr2=0x7fe14c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c06cd50 0x7fe14c0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 -- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c0ab850 msgr2=0x7fe14c0c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c0ab850 0x7fe14c0c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 -- 172.21.15.81:0/1680533235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144009a70 con 0x7fe14c145090 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15189b700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c0ab850 0x7fe14c0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15289d700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe14c145090 0x7fe14c0ce0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe14800e930 tx=0x7fe14800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe13effd700 1 -- 172.21.15.81:0/1680533235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480096e0 con 0x7fe14c145090 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe13effd700 1 -- 172.21.15.81:0/1680533235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14800c850 con 0x7fe14c145090 2023-11-29T11:12:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0b2850 con 0x7fe14c145090 2023-11-29T11:12:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe13effd700 1 -- 172.21.15.81:0/1680533235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14800cbe0 con 0x7fe14c145090 2023-11-29T11:12:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.519+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c06a860 con 0x7fe14c145090 2023-11-29T11:12:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.523+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c0b29e0 con 0x7fe14c145090 2023-11-29T11:12:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.523+0000 7fe13effd700 1 -- 172.21.15.81:0/1680533235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7fe148019030 con 0x7fe14c145090 2023-11-29T11:12:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.523+0000 7fe13effd700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe130064e90 0x7fe130067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.523+0000 7fe13effd700 1 -- 172.21.15.81:0/1680533235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe148081ab0 con 0x7fe14c145090 2023-11-29T11:12:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.523+0000 7fe15209c700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe130064e90 0x7fe130067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.523+0000 7fe15209c700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe130064e90 0x7fe130067340 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe144014040 tx=0x7fe144011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.527+0000 7fe13effd700 1 -- 172.21.15.81:0/1680533235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe14804ff70 con 0x7fe14c145090 2023-11-29T11:12:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.687+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe14c072c20 con 0x7fe14c145090 2023-11-29T11:12:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe13effd700 1 -- 172.21.15.81:0/1680533235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14124 (secure 0 0 0) 0x7fe148053590 con 0x7fe14c145090 2023-11-29T11:12:48.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:48.694 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:48.075134+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:12:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe130064e90 msgr2=0x7fe130067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe130064e90 0x7fe130067340 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe144014040 tx=0x7fe144011000 comp rx=0 tx=0).stop 2023-11-29T11:12:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe14c145090 msgr2=0x7fe14c0ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe14c145090 0x7fe14c0ce0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe14800e930 tx=0x7fe14800ecf0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 shutdown_connections 2023-11-29T11:12:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe130064e90 0x7fe130067340 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe14c145090 0x7fe14c0ce0f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c0ab850 0x7fe14c0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 --2- 172.21.15.81:0/1680533235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe14c06cd50 0x7fe14c0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 >> 172.21.15.81:0/1680533235 conn(0x7fe14c06e000 msgr2=0x7fe14c0b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 shutdown_connections 2023-11-29T11:12:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.691+0000 7fe15309e700 1 -- 172.21.15.81:0/1680533235 wait complete. 2023-11-29T11:12:48.708 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:12:48.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:12:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd295ced700 1 Processor -- start 2023-11-29T11:12:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd295ced700 1 -- start start 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd295ced700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd2880e2b30 0x7fd288056820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd295ced700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2880097c0 0x7fd28800c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd295ced700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 0x7fd288038980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd295ced700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2880e71f0 con 0x7fd2880097c0 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd295ced700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28800cd50 con 0x7fd2880e2b30 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd295ced700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880e65b0 con 0x7fd28800c930 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd28ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2880097c0 0x7fd28800c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd28ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2880097c0 0x7fd28800c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57742/0 (socket says 172.21.15.81:57742) 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd28ffff700 1 -- 172.21.15.81:0/3603378822 learned_addr learned my addr 172.21.15.81:0/3603378822 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.823+0000 7fd294ceb700 1 --2- 172.21.15.81:0/3603378822 >> v2:172.21.15.176:3300/0 conn(0x7fd2880e2b30 0x7fd288056820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd2954ec700 1 --2- 172.21.15.81:0/3603378822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 0x7fd288038980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28ffff700 1 -- 172.21.15.81:0/3603378822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 msgr2=0x7fd288038980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28ffff700 1 --2- 172.21.15.81:0/3603378822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 0x7fd288038980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28ffff700 1 -- 172.21.15.81:0/3603378822 >> v2:172.21.15.176:3300/0 conn(0x7fd2880e2b30 msgr2=0x7fd288056820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28ffff700 1 --2- 172.21.15.81:0/3603378822 >> v2:172.21.15.176:3300/0 conn(0x7fd2880e2b30 0x7fd288056820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28ffff700 1 -- 172.21.15.81:0/3603378822 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880e6850 con 0x7fd2880097c0 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28ffff700 1 --2- 172.21.15.81:0/3603378822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd28800c3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd288056e60 tx=0x7fd27c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cce0b96a37fb8fa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28f7fe700 1 -- 172.21.15.81:0/3603378822 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00b8a0 con 0x7fd2880097c0 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28f7fe700 1 -- 172.21.15.81:0/3603378822 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c00ba00 con 0x7fd2880097c0 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28f7fe700 1 -- 172.21.15.81:0/3603378822 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00bd90 con 0x7fd2880097c0 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- 172.21.15.81:0/3603378822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 msgr2=0x7fd28800c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 --2- 172.21.15.81:0/3603378822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd28800c3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd288056e60 tx=0x7fd27c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- 172.21.15.81:0/3603378822 shutdown_connections 2023-11-29T11:12:48.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 --2- 172.21.15.81:0/3603378822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 0x7fd288038980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 --2- 172.21.15.81:0/3603378822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd28800c3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 --2- 172.21.15.81:0/3603378822 >> v2:172.21.15.176:3300/0 conn(0x7fd2880e2b30 0x7fd288056820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- 172.21.15.81:0/3603378822 >> 172.21.15.81:0/3603378822 conn(0x7fd288053980 msgr2=0x7fd288053d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:48.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- 172.21.15.81:0/3603378822 shutdown_connections 2023-11-29T11:12:48.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- 172.21.15.81:0/3603378822 wait complete. 2023-11-29T11:12:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 Processor -- start 2023-11-29T11:12:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- start start 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd2880d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 0x7fd2880e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2880e2b30 0x7fd2880d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880e5940 con 0x7fd2880097c0 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880d1910 con 0x7fd2880e2b30 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd295ced700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880e5dd0 con 0x7fd28800c930 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd294ceb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd2880d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd294ceb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd2880d13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57750/0 (socket says 172.21.15.81:57750) 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd294ceb700 1 -- 172.21.15.81:0/3791700213 learned_addr learned my addr 172.21.15.81:0/3791700213 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd28ffff700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 0x7fd2880e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd2954ec700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2880e2b30 0x7fd2880d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd294ceb700 1 -- 172.21.15.81:0/3791700213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 msgr2=0x7fd2880e4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd294ceb700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 0x7fd2880e4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd294ceb700 1 -- 172.21.15.81:0/3791700213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2880e2b30 msgr2=0x7fd2880d9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd294ceb700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2880e2b30 0x7fd2880d9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.827+0000 7fd294ceb700 1 -- 172.21.15.81:0/3791700213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c009570 con 0x7fd2880097c0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd294ceb700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd2880d13d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd290078a50 tx=0x7fd2900723e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd28d7fa700 1 -- 172.21.15.81:0/3791700213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290066f30 con 0x7fd2880097c0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd28d7fa700 1 -- 172.21.15.81:0/3791700213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290067090 con 0x7fd2880097c0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2880e6e10 con 0x7fd2880097c0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd28d7fa700 1 -- 172.21.15.81:0/3791700213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290067d60 con 0x7fd2880097c0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2880e6b30 con 0x7fd2880097c0 2023-11-29T11:12:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd28d7fa700 1 -- 172.21.15.81:0/3791700213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7fd290099020 con 0x7fd2880097c0 2023-11-29T11:12:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28800e7c0 con 0x7fd2880097c0 2023-11-29T11:12:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd28d7fa700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd274064e90 0x7fd274067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd28ffff700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd274064e90 0x7fd274067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd28d7fa700 1 -- 172.21.15.81:0/3791700213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd2900fb0a0 con 0x7fd2880097c0 2023-11-29T11:12:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.831+0000 7fd28ffff700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd274064e90 0x7fd274067340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd27c000c00 tx=0x7fd27c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:48.839+0000 7fd28d7fa700 1 -- 172.21.15.81:0/3791700213 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd2900c94f0 con 0x7fd2880097c0 2023-11-29T11:12:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.007+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2880059c0 con 0x7fd2880097c0 2023-11-29T11:12:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.007+0000 7fd28d7fa700 1 -- 172.21.15.81:0/3791700213 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2900ccb10 con 0x7fd2880097c0 2023-11-29T11:12:49.011 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:12:49.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd274064e90 msgr2=0x7fd274067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd274064e90 0x7fd274067340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd27c000c00 tx=0x7fd27c008030 comp rx=0 tx=0).stop 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 msgr2=0x7fd2880d13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd2880d13d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd290078a50 tx=0x7fd2900723e0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 shutdown_connections 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd274064e90 0x7fd274067340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2880e2b30 0x7fd2880d9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd28800c930 0x7fd2880e4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 --2- 172.21.15.81:0/3791700213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2880097c0 0x7fd2880d13d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 >> 172.21.15.81:0/3791700213 conn(0x7fd288053980 msgr2=0x7fd288055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 shutdown_connections 2023-11-29T11:12:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.011+0000 7fd295ced700 1 -- 172.21.15.81:0/3791700213 wait complete. 2023-11-29T11:12:49.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:12:49.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b2fde700 1 Processor -- start 2023-11-29T11:12:49.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b2fde700 1 -- start start 2023-11-29T11:12:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b2fde700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd7ac15c160 0x7fd7ac06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b2fde700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ac06f990 con 0x7fd7ac0c9c00 2023-11-29T11:12:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b2fde700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ac06ee90 con 0x7fd7ac06ea10 2023-11-29T11:12:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b2fde700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac06a4d0 con 0x7fd7ac15c160 2023-11-29T11:12:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b1fdc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd7ac0c9c00 0x7fd7ac0c9fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45622/0 (socket says 172.21.15.81:45622) 2023-11-29T11:12:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b1fdc700 1 -- 172.21.15.81:0/1806587456 learned_addr learned my addr 172.21.15.81:0/1806587456 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1806587456 >> v2:172.21.15.176:3300/0 conn(0x7fd7ac15c160 0x7fd7ac06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234407168 0 0) 0x7fd7ac06f990 con 0x7fd7ac0c9c00 2023-11-29T11:12:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.135+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7980035d0 con 0x7fd7ac0c9c00 2023-11-29T11:12:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157332723 0 0) 0x7fd7ac06ee90 con 0x7fd7ac06ea10 2023-11-29T11:12:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ac06f990 con 0x7fd7ac06ea10 2023-11-29T11:12:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1472424470 0 0) 0x7fd7980035d0 con 0x7fd7ac0c9c00 2023-11-29T11:12:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 >> v2:172.21.15.176:3300/0 conn(0x7fd7ac15c160 msgr2=0x7fd7ac06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:49.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 --2- 172.21.15.81:0/1806587456 >> v2:172.21.15.176:3300/0 conn(0x7fd7ac15c160 0x7fd7ac06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 >> v1:172.21.15.176:6789/0 conn(0x7fd7ac06ea10 legacy=0x7fd7ac0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac06f0f0 con 0x7fd7ac0c9c00 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fd7a80019f0 con 0x7fd7ac0c9c00 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 >> v1:172.21.15.81:6789/0 conn(0x7fd7ac0c9c00 legacy=0x7fd7ac0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd798003bb0 0x7fd798003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd798004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd798005220 0x7fd79800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac06a4d0 con 0x7fd798004870 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79800c080 con 0x7fd798003bb0 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79800c240 con 0x7fd798005220 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b1fdc700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd798003bb0 0x7fd798003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd798004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b27dd700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd798005220 0x7fd79800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b17db700 1 -- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd798005220 msgr2=0x7fd79800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:49.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd798005220 0x7fd79800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b17db700 1 -- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd798003bb0 msgr2=0x7fd798003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd798003bb0 0x7fd798003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b27dd700 1 -- 172.21.15.81:0/1806587456 reap_dead start 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b17db700 1 -- 172.21.15.81:0/1806587456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7980035d0 con 0x7fd798004870 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b1fdc700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd798003bb0 0x7fd798003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd798004ce0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009b60 tx=0x7fd7980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc63ac23f610391 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c005a40 con 0x7fd798004870 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c005ba0 con 0x7fd798004870 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b0fda700 1 -- 172.21.15.81:0/1806587456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c00e6c0 con 0x7fd798004870 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1806587456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 msgr2=0x7fd798004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd798004ce0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009b60 tx=0x7fd7980058a0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1806587456 shutdown_connections 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 --2- 172.21.15.81:0/1806587456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd798004ce0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1806587456 >> 172.21.15.81:0/1806587456 conn(0x7fd7ac0d0240 msgr2=0x7fd7ac0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:49.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1806587456 shutdown_connections 2023-11-29T11:12:49.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1806587456 wait complete. 2023-11-29T11:12:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 Processor -- start 2023-11-29T11:12:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.139+0000 7fd7b2fde700 1 -- start start 2023-11-29T11:12:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd7ac0c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7ac06b770 0x7fd7ac0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7ac0abec0 0x7fd7ac0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0c47a0 con 0x7fd798004870 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0ae6b0 con 0x7fd7ac0abec0 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0ae0f0 con 0x7fd7ac06b770 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd7ac0c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd7ac0c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57776/0 (socket says 172.21.15.81:57776) 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 -- 172.21.15.81:0/1068522253 learned_addr learned my addr 172.21.15.81:0/1068522253 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b27dd700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7ac0abec0 0x7fd7ac0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7ac06b770 0x7fd7ac0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 -- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7ac06b770 msgr2=0x7fd7ac0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7ac06b770 0x7fd7ac0ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 -- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7ac0abec0 msgr2=0x7fd7ac0b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7ac0abec0 0x7fd7ac0b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 -- 172.21.15.81:0/1068522253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac06f6b0 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7ac06b770 0x7fd7ac0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b1fdc700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd7ac0c9050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8007290 tx=0x7fd7a8007370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7a27fc700 1 -- 172.21.15.81:0/1068522253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800ae80 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac06f3d0 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac0cd910 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7a27fc700 1 -- 172.21.15.81:0/1068522253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a8007b30 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7a27fc700 1 -- 172.21.15.81:0/1068522253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80135f0 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.143+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd794005310 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.147+0000 7fd7a27fc700 1 -- 172.21.15.81:0/1068522253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7fd7a8023070 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.147+0000 7fd7a27fc700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd790064e90 0x7fd790067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.147+0000 7fd7a27fc700 1 -- 172.21.15.81:0/1068522253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd7a8082450 con 0x7fd798004870 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.147+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd790064e90 0x7fd790067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.147+0000 7fd7b17db700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd790064e90 0x7fd790067340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000c00 tx=0x7fd79c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.155+0000 7fd7a27fc700 1 -- 172.21.15.81:0/1068522253 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd7a80508a0 con 0x7fd798004870 2023-11-29T11:12:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.315+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd794005b40 con 0x7fd798004870 2023-11-29T11:12:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7a27fc700 1 -- 172.21.15.81:0/1068522253 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7a800a3f0 con 0x7fd798004870 2023-11-29T11:12:49.321 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:12:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd790064e90 msgr2=0x7fd790067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd790064e90 0x7fd790067340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000c00 tx=0x7fd79c008030 comp rx=0 tx=0).stop 2023-11-29T11:12:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 msgr2=0x7fd7ac0c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd7ac0c9050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8007290 tx=0x7fd7a8007370 comp rx=0 tx=0).stop 2023-11-29T11:12:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 shutdown_connections 2023-11-29T11:12:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd790064e90 0x7fd790067340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7ac0abec0 0x7fd7ac0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7ac06b770 0x7fd7ac0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 --2- 172.21.15.81:0/1068522253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd798004870 0x7fd7ac0c9050 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 >> 172.21.15.81:0/1068522253 conn(0x7fd7ac0d0240 msgr2=0x7fd7ac0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 shutdown_connections 2023-11-29T11:12:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.319+0000 7fd7b2fde700 1 -- 172.21.15.81:0/1068522253 wait complete. 2023-11-29T11:12:49.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-29T11:12:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f426d5cd700 1 Processor -- start 2023-11-29T11:12:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f426d5cd700 1 -- start start 2023-11-29T11:12:49.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f426d5cd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4268154600 0x7f426815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f426d5cd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f426806abe0 0x7f426815b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f426d5cd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426815e300 con 0x7f426806c650 2023-11-29T11:12:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f426d5cd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426806ced0 con 0x7f4268154600 2023-11-29T11:12:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f426d5cd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426815d9d0 con 0x7f426806abe0 2023-11-29T11:12:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f42677fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f426806c650 0x7f426806a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45628/0 (socket says 172.21.15.81:45628) 2023-11-29T11:12:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f42677fe700 1 -- 172.21.15.81:0/3843449181 learned_addr learned my addr 172.21.15.81:0/3843449181 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f426cdcc700 1 --2- 172.21.15.81:0/3843449181 >> v2:172.21.15.176:3300/0 conn(0x7f426806abe0 0x7f426815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f4267fff700 1 --2- 172.21.15.81:0/3843449181 >> v2:172.21.15.81:3300/0 conn(0x7f4268154600 0x7f426815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f4267fff700 1 -- 172.21.15.81:0/3843449181 >> v2:172.21.15.176:3300/0 conn(0x7f426806abe0 msgr2=0x7f426815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f4267fff700 1 --2- 172.21.15.81:0/3843449181 >> v2:172.21.15.176:3300/0 conn(0x7f426806abe0 0x7f426815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f4267fff700 1 -- 172.21.15.81:0/3843449181 >> v1:172.21.15.81:6789/0 conn(0x7f426806c650 legacy=0x7f426806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f4267fff700 1 -- 172.21.15.81:0/3843449181 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426815dcb0 con 0x7f4268154600 2023-11-29T11:12:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.435+0000 7f4267fff700 1 --2- 172.21.15.81:0/3843449181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4268154600 0x7f426815aec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42680cd160 tx=0x7f4258009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7557dc25e35536 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.475+0000 7f4266ffd700 1 -- 172.21.15.81:0/3843449181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258011830 con 0x7f4268154600 2023-11-29T11:12:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.475+0000 7f4266ffd700 1 -- 172.21.15.81:0/3843449181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258011990 con 0x7f4268154600 2023-11-29T11:12:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.475+0000 7f4266ffd700 1 -- 172.21.15.81:0/3843449181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258011d20 con 0x7f4268154600 2023-11-29T11:12:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 -- 172.21.15.81:0/3843449181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4268154600 msgr2=0x7f426815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3843449181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4268154600 0x7f426815aec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42680cd160 tx=0x7f4258009b30 comp rx=0 tx=0).stop 2023-11-29T11:12:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 -- 172.21.15.81:0/3843449181 shutdown_connections 2023-11-29T11:12:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3843449181 >> v2:172.21.15.176:3300/0 conn(0x7f426806abe0 0x7f426815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3843449181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4268154600 0x7f426815aec0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 -- 172.21.15.81:0/3843449181 >> 172.21.15.81:0/3843449181 conn(0x7f426806ec40 msgr2=0x7f42680b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 -- 172.21.15.81:0/3843449181 shutdown_connections 2023-11-29T11:12:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 -- 172.21.15.81:0/3843449181 wait complete. 2023-11-29T11:12:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 Processor -- start 2023-11-29T11:12:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.479+0000 7f426d5cd700 1 -- start start 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426d5cd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426806abe0 0x7f42680b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426d5cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426806c650 0x7f426814c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426d5cd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42680c5890 0x7f4268153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426d5cd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680b3da0 con 0x7f426806c650 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426d5cd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680b4080 con 0x7f426806abe0 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426d5cd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42680b4360 con 0x7f42680c5890 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42680c5890 0x7f4268153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42680c5890 0x7f4268153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:60516/0 (socket says 172.21.15.81:60516) 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 -- 172.21.15.81:0/3564944027 learned_addr learned my addr 172.21.15.81:0/3564944027 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f4267fff700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426806abe0 0x7f42680b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 -- 172.21.15.81:0/3564944027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426806abe0 msgr2=0x7f42680b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426806abe0 0x7f42680b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 -- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426806c650 msgr2=0x7f426814c1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T11:12:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426806c650 0x7f426814c1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 -- 172.21.15.81:0/3564944027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580094b0 con 0x7f42680c5890 2023-11-29T11:12:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.483+0000 7f426cdcc700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42680c5890 0x7f4268153500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f426000c370 tx=0x7f426000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f4264ff9700 1 -- 172.21.15.81:0/3564944027 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000ced0 con 0x7f42680c5890 2023-11-29T11:12:49.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f4264ff9700 1 -- 172.21.15.81:0/3564944027 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426001a410 con 0x7f42680c5890 2023-11-29T11:12:49.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f4264ff9700 1 -- 172.21.15.81:0/3564944027 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426001a7a0 con 0x7f42680c5890 2023-11-29T11:12:49.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426815e790 con 0x7f42680c5890 2023-11-29T11:12:49.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426815df90 con 0x7f42680c5890 2023-11-29T11:12:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f4264ff9700 1 -- 172.21.15.81:0/3564944027 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4260021030 con 0x7f42680c5890 2023-11-29T11:12:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426806cad0 con 0x7f42680c5890 2023-11-29T11:12:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f4264ff9700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064ee0 0x7f4254067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f4264ff9700 1 -- 172.21.15.81:0/3564944027 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4260085f00 con 0x7f42680c5890 2023-11-29T11:12:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f4267fff700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064ee0 0x7f4254067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.491+0000 7f4267fff700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064ee0 0x7f4254067390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f42680ccee0 tx=0x7f4258008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.499+0000 7f4264ff9700 1 -- 172.21.15.81:0/3564944027 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4260054210 con 0x7f42680c5890 2023-11-29T11:12:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.663+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f42680b44a0 con 0x7f42680c5890 2023-11-29T11:12:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.727+0000 7f4264ff9700 1 -- 172.21.15.81:0/3564944027 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+126 (secure 0 0 0) 0x7f42680b44a0 con 0x7f42680c5890 2023-11-29T11:12:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:12:49.731 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064ee0 msgr2=0x7f4254067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064ee0 0x7f4254067390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f42680ccee0 tx=0x7f4258008030 comp rx=0 tx=0).stop 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42680c5890 msgr2=0x7f4268153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42680c5890 0x7f4268153500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f426000c370 tx=0x7f426000c730 comp rx=0 tx=0).stop 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 shutdown_connections 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064ee0 0x7f4254067390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42680c5890 0x7f4268153500 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f426806c650 0x7f426814c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 --2- 172.21.15.81:0/3564944027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f426806abe0 0x7f42680b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 >> 172.21.15.81:0/3564944027 conn(0x7f426806ec40 msgr2=0x7f4268070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 shutdown_connections 2023-11-29T11:12:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.731+0000 7f426d5cd700 1 -- 172.21.15.81:0/3564944027 wait complete. 2023-11-29T11:12:49.751 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-29T11:12:49.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-29T11:12:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3bea63700 1 Processor -- start 2023-11-29T11:12:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3bea63700 1 -- start start 2023-11-29T11:12:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3bea63700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80b8240 0x7fa3b80cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3bea63700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b80d0460 con 0x7fa3b806ce60 2023-11-29T11:12:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3bea63700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b80d2380 con 0x7fa3b80d1e30 2023-11-29T11:12:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3bea63700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80b86c0 con 0x7fa3b80b8240 2023-11-29T11:12:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3bda61700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa3b806ce60 0x7fa3b806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47946/0 (socket says 172.21.15.81:47946) 2023-11-29T11:12:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3bda61700 1 -- 172.21.15.81:0/3013560723 learned_addr learned my addr 172.21.15.81:0/3013560723 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.867+0000 7fa3be262700 1 --2- 172.21.15.81:0/3013560723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80b8240 0x7fa3b80cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bca5f700 1 -- 172.21.15.81:0/3013560723 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289508368 0 0) 0x7fa3b80d0460 con 0x7fa3b806ce60 2023-11-29T11:12:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bca5f700 1 -- 172.21.15.81:0/3013560723 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a40035d0 con 0x7fa3b806ce60 2023-11-29T11:12:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bca5f700 1 -- 172.21.15.81:0/3013560723 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675429648 0 0) 0x7fa3b80d2380 con 0x7fa3b80d1e30 2023-11-29T11:12:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bca5f700 1 -- 172.21.15.81:0/3013560723 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b80d0460 con 0x7fa3b80d1e30 2023-11-29T11:12:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3be262700 1 -- 172.21.15.81:0/3013560723 >> v1:172.21.15.176:6789/0 conn(0x7fa3b80d1e30 legacy=0x7fa3b80cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bca5f700 1 -- 172.21.15.81:0/3013560723 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1658596396 0 0) 0x7fa3a40035d0 con 0x7fa3b806ce60 2023-11-29T11:12:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3be262700 1 -- 172.21.15.81:0/3013560723 >> v1:172.21.15.81:6789/0 conn(0x7fa3b806ce60 legacy=0x7fa3b806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3be262700 1 -- 172.21.15.81:0/3013560723 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b80d2f00 con 0x7fa3b80b8240 2023-11-29T11:12:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3be262700 1 --2- 172.21.15.81:0/3013560723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80b8240 0x7fa3b80cf820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009dc0 tx=0x7fa3b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1767fd78fb15d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bca5f700 1 -- 172.21.15.81:0/3013560723 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000e070 con 0x7fa3b80b8240 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bca5f700 1 -- 172.21.15.81:0/3013560723 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b0003a40 con 0x7fa3b80b8240 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bca5f700 1 -- 172.21.15.81:0/3013560723 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8001670 con 0x7fa3b80b8240 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bea63700 1 -- 172.21.15.81:0/3013560723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80b8240 msgr2=0x7fa3b80cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bea63700 1 --2- 172.21.15.81:0/3013560723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80b8240 0x7fa3b80cf820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009dc0 tx=0x7fa3b000b330 comp rx=0 tx=0).stop 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bea63700 1 -- 172.21.15.81:0/3013560723 shutdown_connections 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bea63700 1 --2- 172.21.15.81:0/3013560723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80b8240 0x7fa3b80cf820 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bea63700 1 -- 172.21.15.81:0/3013560723 >> 172.21.15.81:0/3013560723 conn(0x7fa3b809bbd0 msgr2=0x7fa3b80b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bea63700 1 -- 172.21.15.81:0/3013560723 shutdown_connections 2023-11-29T11:12:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.871+0000 7fa3bea63700 1 -- 172.21.15.81:0/3013560723 wait complete. 2023-11-29T11:12:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 Processor -- start 2023-11-29T11:12:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 -- start start 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3b806ce60 0x7fa3b80c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b80b8240 0x7fa3b80afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80d1e30 0x7fa3b81f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b815e320 con 0x7fa3b80b8240 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80c95c0 con 0x7fa3b806ce60 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b815e5e0 con 0x7fa3b80d1e30 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b80b8240 0x7fa3b80afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b80b8240 0x7fa3b80afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45386/0 (socket says 172.21.15.81:45386) 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 -- 172.21.15.81:0/2076674946 learned_addr learned my addr 172.21.15.81:0/2076674946 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3be262700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80d1e30 0x7fa3b81f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bda61700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3b806ce60 0x7fa3b80c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 -- 172.21.15.81:0/2076674946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80d1e30 msgr2=0x7fa3b81f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80d1e30 0x7fa3b81f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 -- 172.21.15.81:0/2076674946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3b806ce60 msgr2=0x7fa3b80c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3b806ce60 0x7fa3b80c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 -- 172.21.15.81:0/2076674946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009a70 con 0x7fa3b80b8240 2023-11-29T11:12:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bd260700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b80b8240 0x7fa3b80afa80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c490 tx=0x7fa3b400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3ae7fc700 1 -- 172.21.15.81:0/2076674946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400cea0 con 0x7fa3b80b8240 2023-11-29T11:12:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3ae7fc700 1 -- 172.21.15.81:0/2076674946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b40052f0 con 0x7fa3b80b8240 2023-11-29T11:12:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b80d25d0 con 0x7fa3b80b8240 2023-11-29T11:12:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b815c700 con 0x7fa3b80b8240 2023-11-29T11:12:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.875+0000 7fa3ae7fc700 1 -- 172.21.15.81:0/2076674946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40036a0 con 0x7fa3b80b8240 2023-11-29T11:12:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.879+0000 7fa3ae7fc700 1 -- 172.21.15.81:0/2076674946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa3b4019030 con 0x7fa3b80b8240 2023-11-29T11:12:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.879+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b80d28b0 con 0x7fa3b80b8240 2023-11-29T11:12:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.879+0000 7fa3ae7fc700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa39c064ee0 0x7fa39c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.879+0000 7fa3ae7fc700 1 -- 172.21.15.81:0/2076674946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa3b4080cb0 con 0x7fa3b80b8240 2023-11-29T11:12:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.879+0000 7fa3bda61700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa39c064ee0 0x7fa39c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:49.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.879+0000 7fa3bda61700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa39c064ee0 0x7fa39c067390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8001eb0 tx=0x7fa3a8001d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:49.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:49.887+0000 7fa3ae7fc700 1 -- 172.21.15.81:0/2076674946 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa3b404a400 con 0x7fa3b80b8240 2023-11-29T11:12:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.055+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa3b815e7a0 con 0x7fa3b80b8240 2023-11-29T11:12:50.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.951+0000 7fa3ae7fc700 1 -- 172.21.15.81:0/2076674946 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa3b4017020 con 0x7fa3b80b8240 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa39c064ee0 msgr2=0x7fa39c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa39c064ee0 0x7fa39c067390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8001eb0 tx=0x7fa3a8001d60 comp rx=0 tx=0).stop 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b80b8240 msgr2=0x7fa3b80afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b80b8240 0x7fa3b80afa80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c490 tx=0x7fa3b400c7a0 comp rx=0 tx=0).stop 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 shutdown_connections 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa39c064ee0 0x7fa39c067390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3b80d1e30 0x7fa3b81f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b80b8240 0x7fa3b80afa80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 --2- 172.21.15.81:0/2076674946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3b806ce60 0x7fa3b80c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 >> 172.21.15.81:0/2076674946 conn(0x7fa3b809bbd0 msgr2=0x7fa3b80b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 shutdown_connections 2023-11-29T11:12:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:50.959+0000 7fa3bea63700 1 -- 172.21.15.81:0/2076674946 wait complete. 2023-11-29T11:12:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-11-29T11:12:50.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-29T11:12:51.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64bbfff700 1 Processor -- start 2023-11-29T11:12:51.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64bbfff700 1 -- start start 2023-11-29T11:12:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64bbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64bc06b250 0x7f64bc0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64bbfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f64bc0cb350 0x7f64bc162b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64bbfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0ce040 con 0x7f64bc158f10 2023-11-29T11:12:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64bbfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc0c9460 con 0x7f64bc06b250 2023-11-29T11:12:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64bbfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc0c9fe0 con 0x7f64bc0cb350 2023-11-29T11:12:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64baffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f64bc158f10 0x7f64bc0cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47962/0 (socket says 172.21.15.81:47962) 2023-11-29T11:12:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64baffd700 1 -- 172.21.15.81:0/3434631926 learned_addr learned my addr 172.21.15.81:0/3434631926 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64b27fc700 1 --2- 172.21.15.81:0/3434631926 >> v2:172.21.15.81:3300/0 conn(0x7f64bc06b250 0x7f64bc0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64bb7fe700 1 --2- 172.21.15.81:0/3434631926 >> v2:172.21.15.176:3300/0 conn(0x7f64bc0cb350 0x7f64bc162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64ba7fc700 1 -- 172.21.15.81:0/3434631926 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395124381 0 0) 0x7f64ac001110 con 0x7f64bc158f10 2023-11-29T11:12:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64ba7fc700 1 -- 172.21.15.81:0/3434631926 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a80057e0 con 0x7f64bc158f10 2023-11-29T11:12:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64b27fc700 1 -- 172.21.15.81:0/3434631926 >> v2:172.21.15.176:3300/0 conn(0x7f64bc0cb350 msgr2=0x7f64bc162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64b27fc700 1 --2- 172.21.15.81:0/3434631926 >> v2:172.21.15.176:3300/0 conn(0x7f64bc0cb350 0x7f64bc162b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64b27fc700 1 -- 172.21.15.81:0/3434631926 >> v1:172.21.15.81:6789/0 conn(0x7f64bc158f10 legacy=0x7f64bc0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64b27fc700 1 -- 172.21.15.81:0/3434631926 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0cb790 con 0x7f64bc06b250 2023-11-29T11:12:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64b27fc700 1 --2- 172.21.15.81:0/3434631926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc06b250 0x7f64bc0cae10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0cd6a0 tx=0x7f64a4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ab4a10986c8c44 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64ba7fc700 1 -- 172.21.15.81:0/3434631926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4011830 con 0x7f64bc06b250 2023-11-29T11:12:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64ba7fc700 1 -- 172.21.15.81:0/3434631926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a4011990 con 0x7f64bc06b250 2023-11-29T11:12:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.095+0000 7f64ba7fc700 1 -- 172.21.15.81:0/3434631926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4011d20 con 0x7f64bc06b250 2023-11-29T11:12:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 -- 172.21.15.81:0/3434631926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc06b250 msgr2=0x7f64bc0cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3434631926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc06b250 0x7f64bc0cae10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0cd6a0 tx=0x7f64a4009b30 comp rx=0 tx=0).stop 2023-11-29T11:12:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 -- 172.21.15.81:0/3434631926 shutdown_connections 2023-11-29T11:12:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3434631926 >> v2:172.21.15.176:3300/0 conn(0x7f64bc0cb350 0x7f64bc162b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3434631926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc06b250 0x7f64bc0cae10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 -- 172.21.15.81:0/3434631926 >> 172.21.15.81:0/3434631926 conn(0x7f64bc0ce400 msgr2=0x7f64bc0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 -- 172.21.15.81:0/3434631926 shutdown_connections 2023-11-29T11:12:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 -- 172.21.15.81:0/3434631926 wait complete. 2023-11-29T11:12:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 Processor -- start 2023-11-29T11:12:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.099+0000 7f64bbfff700 1 -- start start 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bbfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64bc06b250 0x7f64bc070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc0cb350 0x7f64bc0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bbfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64bc158f10 0x7f64bc0c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc1f1860 con 0x7f64bc0cb350 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bbfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0c5780 con 0x7f64bc158f10 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bbfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc1f1b20 con 0x7f64bc06b250 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64b27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc0cb350 0x7f64bc0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64b27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc0cb350 0x7f64bc0c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45414/0 (socket says 172.21.15.81:45414) 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64b27fc700 1 -- 172.21.15.81:0/3243826233 learned_addr learned my addr 172.21.15.81:0/3243826233 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64baffd700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64bc06b250 0x7f64bc070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:51.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bb7fe700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64bc158f10 0x7f64bc0c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64baffd700 1 -- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64bc158f10 msgr2=0x7f64bc0c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64baffd700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64bc158f10 0x7f64bc0c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64baffd700 1 -- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc0cb350 msgr2=0x7f64bc0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64baffd700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc0cb350 0x7f64bc0c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64baffd700 1 -- 172.21.15.81:0/3243826233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40094b0 con 0x7f64bc06b250 2023-11-29T11:12:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64b27fc700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc0cb350 0x7f64bc0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:51.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64baffd700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64bc06b250 0x7f64bc070fd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00c410 tx=0x7f64ac00c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64b3fff700 1 -- 172.21.15.81:0/3243826233 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac005d90 con 0x7f64bc06b250 2023-11-29T11:12:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64b3fff700 1 -- 172.21.15.81:0/3243826233 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac00ce20 con 0x7f64bc06b250 2023-11-29T11:12:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64b3fff700 1 -- 172.21.15.81:0/3243826233 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac0072f0 con 0x7f64bc06b250 2023-11-29T11:12:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc0c96b0 con 0x7f64bc06b250 2023-11-29T11:12:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.103+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc06dc90 con 0x7f64bc06b250 2023-11-29T11:12:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.107+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc0c9990 con 0x7f64bc06b250 2023-11-29T11:12:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.107+0000 7f64b3fff700 1 -- 172.21.15.81:0/3243826233 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f64ac010070 con 0x7f64bc06b250 2023-11-29T11:12:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.107+0000 7f64b3fff700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f649c064ee0 0x7f649c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:51.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.107+0000 7f64b3fff700 1 -- 172.21.15.81:0/3243826233 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f64ac080a80 con 0x7f64bc06b250 2023-11-29T11:12:51.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.107+0000 7f64b27fc700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f649c064ee0 0x7f649c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.107+0000 7f64b27fc700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f649c064ee0 0x7f649c067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0b3e40 tx=0x7f64a4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:51.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.119+0000 7f64b3fff700 1 -- 172.21.15.81:0/3243826233 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f64ac04ed10 con 0x7f64bc06b250 2023-11-29T11:12:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.279+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f64bc0ce040 con 0x7f64bc06b250 2023-11-29T11:12:51.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.963+0000 7f64b3fff700 1 -- 172.21.15.81:0/3243826233 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f64bc0ce040 con 0x7f64bc06b250 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f649c064ee0 msgr2=0x7f649c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f649c064ee0 0x7f649c067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0b3e40 tx=0x7f64a4008030 comp rx=0 tx=0).stop 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64bc06b250 msgr2=0x7f64bc070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64bc06b250 0x7f64bc070fd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00c410 tx=0x7f64ac00c720 comp rx=0 tx=0).stop 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 shutdown_connections 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f649c064ee0 0x7f649c067390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64bc158f10 0x7f64bc0c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64bc0cb350 0x7f64bc0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.983+0000 7f64bbfff700 1 --2- 172.21.15.81:0/3243826233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64bc06b250 0x7f64bc070fd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.987+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 >> 172.21.15.81:0/3243826233 conn(0x7f64bc0ce400 msgr2=0x7f64bc0b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.987+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 shutdown_connections 2023-11-29T11:12:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:51.987+0000 7f64bbfff700 1 -- 172.21.15.81:0/3243826233 wait complete. 2023-11-29T11:12:51.990 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-11-29T11:12:52.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-29T11:12:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e45be0700 1 Processor -- start 2023-11-29T11:12:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e45be0700 1 -- start start 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e45be0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e400b45f0 0x7f3e400d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e45be0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e40160ac0 0x7f3e400b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e45be0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e400d0740 con 0x7f3e400cd1c0 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e45be0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400d1c90 con 0x7f3e400b45f0 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e45be0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400b4f00 con 0x7f3e40160ac0 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e400b45f0 0x7f3e400d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3e400cd1c0 0x7f3e400b59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47966/0 (socket says 172.21.15.81:47966) 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3ffff700 1 -- 172.21.15.81:0/3138705370 learned_addr learned my addr 172.21.15.81:0/3138705370 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3effd700 1 --2- 172.21.15.81:0/3138705370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e40160ac0 0x7f3e400b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3f7fe700 1 -- 172.21.15.81:0/3138705370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e40160ac0 msgr2=0x7f3e400b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3e7fc700 1 -- 172.21.15.81:0/3138705370 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778803618 0 0) 0x7f3e400d0740 con 0x7f3e400cd1c0 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3f7fe700 1 --2- 172.21.15.81:0/3138705370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e40160ac0 0x7f3e400b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3f7fe700 1 -- 172.21.15.81:0/3138705370 >> v1:172.21.15.81:6789/0 conn(0x7f3e400cd1c0 legacy=0x7f3e400b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3f7fe700 1 -- 172.21.15.81:0/3138705370 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400d0990 con 0x7f3e400b45f0 2023-11-29T11:12:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3f7fe700 1 --2- 172.21.15.81:0/3138705370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e400d1750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009850 tx=0x7f3e28009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e450f1f36da246 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3e7fc700 1 -- 172.21.15.81:0/3138705370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28011830 con 0x7f3e400b45f0 2023-11-29T11:12:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3e7fc700 1 -- 172.21.15.81:0/3138705370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28011990 con 0x7f3e400b45f0 2023-11-29T11:12:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.107+0000 7f3e3e7fc700 1 -- 172.21.15.81:0/3138705370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28011d20 con 0x7f3e400b45f0 2023-11-29T11:12:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 -- 172.21.15.81:0/3138705370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 msgr2=0x7f3e400d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 --2- 172.21.15.81:0/3138705370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e400d1750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009850 tx=0x7f3e28009b60 comp rx=0 tx=0).stop 2023-11-29T11:12:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 -- 172.21.15.81:0/3138705370 shutdown_connections 2023-11-29T11:12:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 --2- 172.21.15.81:0/3138705370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e40160ac0 0x7f3e400b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 --2- 172.21.15.81:0/3138705370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e400d1750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 -- 172.21.15.81:0/3138705370 >> 172.21.15.81:0/3138705370 conn(0x7f3e4006cb40 msgr2=0x7f3e400cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 -- 172.21.15.81:0/3138705370 shutdown_connections 2023-11-29T11:12:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 -- 172.21.15.81:0/3138705370 wait complete. 2023-11-29T11:12:52.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 Processor -- start 2023-11-29T11:12:52.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.111+0000 7f3e45be0700 1 -- start start 2023-11-29T11:12:52.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e401f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cd1c0 0x7f3e40155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e40160ac0 0x7f3e400c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400c7810 con 0x7f3e400b45f0 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e401f2b80 con 0x7f3e40160ac0 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4015b0d0 con 0x7f3e400cd1c0 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e401f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e401f2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45442/0 (socket says 172.21.15.81:45442) 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 -- 172.21.15.81:0/182307893 learned_addr learned my addr 172.21.15.81:0/182307893 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3ffff700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e40160ac0 0x7f3e400c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3effd700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cd1c0 0x7f3e40155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 -- 172.21.15.81:0/182307893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cd1c0 msgr2=0x7f3e40155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cd1c0 0x7f3e40155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 -- 172.21.15.81:0/182307893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e40160ac0 msgr2=0x7f3e400c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e40160ac0 0x7f3e400c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 -- 172.21.15.81:0/182307893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280094b0 con 0x7f3e400b45f0 2023-11-29T11:12:52.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e3f7fe700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e401f2640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e28004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:52.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e37fff700 1 -- 172.21.15.81:0/182307893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280036c0 con 0x7f3e400b45f0 2023-11-29T11:12:52.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e37fff700 1 -- 172.21.15.81:0/182307893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2801f070 con 0x7f3e400b45f0 2023-11-29T11:12:52.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e400d0f50 con 0x7f3e400b45f0 2023-11-29T11:12:52.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e37fff700 1 -- 172.21.15.81:0/182307893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28003a60 con 0x7f3e400b45f0 2023-11-29T11:12:52.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e400d0c70 con 0x7f3e400b45f0 2023-11-29T11:12:52.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.115+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e400d1230 con 0x7f3e400b45f0 2023-11-29T11:12:52.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.119+0000 7f3e37fff700 1 -- 172.21.15.81:0/182307893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3e2800f050 con 0x7f3e400b45f0 2023-11-29T11:12:52.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.119+0000 7f3e37fff700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.119+0000 7f3e37fff700 1 -- 172.21.15.81:0/182307893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3e28021070 con 0x7f3e400b45f0 2023-11-29T11:12:52.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.119+0000 7f3e3effd700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.119+0000 7f3e3effd700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009a80 tx=0x7f3e30003a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:52.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.127+0000 7f3e37fff700 1 -- 172.21.15.81:0/182307893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3e28051fe0 con 0x7f3e400b45f0 2023-11-29T11:12:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.327+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3e40072c20 con 0x7f3e400b45f0 2023-11-29T11:12:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.339+0000 7f3e37fff700 1 -- 172.21.15.81:0/182307893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3e28055600 con 0x7f3e400b45f0 2023-11-29T11:12:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 msgr2=0x7f3e20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009a80 tx=0x7f3e30003a40 comp rx=0 tx=0).stop 2023-11-29T11:12:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 msgr2=0x7f3e401f2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e401f2640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e28004770 comp rx=0 tx=0).stop 2023-11-29T11:12:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 shutdown_connections 2023-11-29T11:12:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009a80 tx=0x7f3e30003a40 comp rx=0 tx=0).stop 2023-11-29T11:12:52.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e40160ac0 0x7f3e400c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cd1c0 0x7f3e40155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 --2- 172.21.15.81:0/182307893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e400b45f0 0x7f3e401f2640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 >> 172.21.15.81:0/182307893 conn(0x7f3e4006cb40 msgr2=0x7f3e400b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:52.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.343+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 shutdown_connections 2023-11-29T11:12:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.347+0000 7f3e45be0700 1 -- 172.21.15.81:0/182307893 wait complete. 2023-11-29T11:12:52.355 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 3 and data pool 4 2023-11-29T11:12:52.373 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-29T11:12:52.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-29T11:12:52.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1e63f700 1 Processor -- start 2023-11-29T11:12:52.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1e63f700 1 -- start start 2023-11-29T11:12:52.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1e63f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb180cac80 0x7fcb180cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1e63f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcb1806bc80 0x7fcb180cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1e63f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb180cb590 con 0x7fcb1806a1a0 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1e63f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1806c240 con 0x7fcb1806bc80 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1e63f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1806c520 con 0x7fcb180cac80 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1ce3c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcb1806a1a0 0x7fcb180b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47982/0 (socket says 172.21.15.81:47982) 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1ce3c700 1 -- 172.21.15.81:0/3596465526 learned_addr learned my addr 172.21.15.81:0/3596465526 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1de3e700 1 --2- 172.21.15.81:0/3596465526 >> v2:172.21.15.176:3300/0 conn(0x7fcb1806bc80 0x7fcb180cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1d63d700 1 --2- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb180cac80 0x7fcb180cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb0ffff700 1 -- 172.21.15.81:0/3596465526 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504166249 0 0) 0x7fcb180cb590 con 0x7fcb1806a1a0 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb0ffff700 1 -- 172.21.15.81:0/3596465526 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb040035d0 con 0x7fcb1806a1a0 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1de3e700 1 -- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb180cac80 msgr2=0x7fcb180cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1de3e700 1 --2- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb180cac80 0x7fcb180cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1de3e700 1 -- 172.21.15.81:0/3596465526 >> v1:172.21.15.81:6789/0 conn(0x7fcb1806a1a0 legacy=0x7fcb180b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1de3e700 1 -- 172.21.15.81:0/3596465526 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1806c800 con 0x7fcb1806bc80 2023-11-29T11:12:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1d63d700 1 --2- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb180cac80 0x7fcb180cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:52.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb1de3e700 1 --2- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806bc80 0x7fcb180cd810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009d90 tx=0x7fcb1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb7d53a69436234 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb0ffff700 1 -- 172.21.15.81:0/3596465526 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000e070 con 0x7fcb1806bc80 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb0ffff700 1 -- 172.21.15.81:0/3596465526 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1000bb20 con 0x7fcb1806bc80 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.471+0000 7fcb0ffff700 1 -- 172.21.15.81:0/3596465526 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000be90 con 0x7fcb1806bc80 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806bc80 msgr2=0x7fcb180cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806bc80 0x7fcb180cd810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009d90 tx=0x7fcb1000b330 comp rx=0 tx=0).stop 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- 172.21.15.81:0/3596465526 shutdown_connections 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806bc80 0x7fcb180cd810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/3596465526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb180cac80 0x7fcb180cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- 172.21.15.81:0/3596465526 >> 172.21.15.81:0/3596465526 conn(0x7fcb180ce400 msgr2=0x7fcb180ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- 172.21.15.81:0/3596465526 shutdown_connections 2023-11-29T11:12:52.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- 172.21.15.81:0/3596465526 wait complete. 2023-11-29T11:12:52.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 Processor -- start 2023-11-29T11:12:52.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- start start 2023-11-29T11:12:52.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806a1a0 0x7fcb181f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb1806bc80 0x7fcb18157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180cac80 0x7fcb180b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18158870 con 0x7fcb180cac80 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18157880 con 0x7fcb1806a1a0 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1e63f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18157230 con 0x7fcb1806bc80 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1d63d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806a1a0 0x7fcb181f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1de3e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180cac80 0x7fcb180b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1d63d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806a1a0 0x7fcb181f0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:42208/0 (socket says 172.21.15.81:42208) 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1d63d700 1 -- 172.21.15.81:0/579270150 learned_addr learned my addr 172.21.15.81:0/579270150 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.475+0000 7fcb1ce3c700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb1806bc80 0x7fcb18157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1de3e700 1 -- 172.21.15.81:0/579270150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb1806bc80 msgr2=0x7fcb18157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1de3e700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb1806bc80 0x7fcb18157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1de3e700 1 -- 172.21.15.81:0/579270150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806a1a0 msgr2=0x7fcb181f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1de3e700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806a1a0 0x7fcb181f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:52.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1de3e700 1 -- 172.21.15.81:0/579270150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb140094b0 con 0x7fcb180cac80 2023-11-29T11:12:52.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1de3e700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180cac80 0x7fcb180b0010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb180b43a0 tx=0x7fcb10004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:52.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb0dffb700 1 -- 172.21.15.81:0/579270150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10007000 con 0x7fcb180cac80 2023-11-29T11:12:52.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb0dffb700 1 -- 172.21.15.81:0/579270150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10012650 con 0x7fcb180cac80 2023-11-29T11:12:52.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb10009a70 con 0x7fcb180cac80 2023-11-29T11:12:52.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb0dffb700 1 -- 172.21.15.81:0/579270150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10012a00 con 0x7fcb180cac80 2023-11-29T11:12:52.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1806cdc0 con 0x7fcb180cac80 2023-11-29T11:12:52.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.479+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1806cae0 con 0x7fcb180cac80 2023-11-29T11:12:52.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.483+0000 7fcb0dffb700 1 -- 172.21.15.81:0/579270150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcb10012b60 con 0x7fcb180cac80 2023-11-29T11:12:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.483+0000 7fcb0dffb700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcafc064ee0 0x7fcafc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.483+0000 7fcb1d63d700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcafc064ee0 0x7fcafc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.483+0000 7fcb0dffb700 1 -- 172.21.15.81:0/579270150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb100842f0 con 0x7fcb180cac80 2023-11-29T11:12:52.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.483+0000 7fcb1d63d700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcafc064ee0 0x7fcafc067390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009e80 tx=0x7fcb14009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:52.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.487+0000 7fcb0dffb700 1 -- 172.21.15.81:0/579270150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcb10052420 con 0x7fcb180cac80 2023-11-29T11:12:52.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:52.659+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fcb1815c490 con 0x7fcb180cac80 2023-11-29T11:12:53.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.347+0000 7fcb0dffb700 1 -- 172.21.15.81:0/579270150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fcb10055a40 con 0x7fcb180cac80 2023-11-29T11:12:53.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcafc064ee0 msgr2=0x7fcafc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:53.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcafc064ee0 0x7fcafc067390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009e80 tx=0x7fcb14009240 comp rx=0 tx=0).stop 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180cac80 msgr2=0x7fcb180b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180cac80 0x7fcb180b0010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb180b43a0 tx=0x7fcb10004af0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 shutdown_connections 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcafc064ee0 0x7fcafc067390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180cac80 0x7fcb180b0010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb1806bc80 0x7fcb18157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 --2- 172.21.15.81:0/579270150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb1806a1a0 0x7fcb181f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 >> 172.21.15.81:0/579270150 conn(0x7fcb180ce400 msgr2=0x7fcb180ad4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 shutdown_connections 2023-11-29T11:12:53.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.355+0000 7fcb1e63f700 1 -- 172.21.15.81:0/579270150 wait complete. 2023-11-29T11:12:53.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-29T11:12:53.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f795975d700 1 Processor -- start 2023-11-29T11:12:53.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f795975d700 1 -- start start 2023-11-29T11:12:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f795975d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f794c0e2980 0x7f794c0e6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f795975d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f794c039090 0x7f794c051d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f795975d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0e2d50 con 0x7f794c056990 2023-11-29T11:12:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f795975d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0e72c0 con 0x7f794c039090 2023-11-29T11:12:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f795975d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0e6d00 con 0x7f794c0e2980 2023-11-29T11:12:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f79537fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f794c056990 0x7f794c038980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47992/0 (socket says 172.21.15.81:47992) 2023-11-29T11:12:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f79537fe700 1 -- 172.21.15.81:0/120814937 learned_addr learned my addr 172.21.15.81:0/120814937 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.499+0000 7f7958f5c700 1 --2- 172.21.15.81:0/120814937 >> v2:172.21.15.81:3300/0 conn(0x7f794c039090 0x7f794c051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7953fff700 1 --2- 172.21.15.81:0/120814937 >> v2:172.21.15.176:3300/0 conn(0x7f794c0e2980 0x7f794c0e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7952ffd700 1 -- 172.21.15.81:0/120814937 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266898249 0 0) 0x7f794c0e2d50 con 0x7f794c056990 2023-11-29T11:12:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7952ffd700 1 -- 172.21.15.81:0/120814937 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c0035d0 con 0x7f794c056990 2023-11-29T11:12:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7958f5c700 1 -- 172.21.15.81:0/120814937 >> v2:172.21.15.176:3300/0 conn(0x7f794c0e2980 msgr2=0x7f794c0e6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7958f5c700 1 --2- 172.21.15.81:0/120814937 >> v2:172.21.15.176:3300/0 conn(0x7f794c0e2980 0x7f794c0e6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7958f5c700 1 -- 172.21.15.81:0/120814937 >> v1:172.21.15.81:6789/0 conn(0x7f794c056990 legacy=0x7f794c038980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7958f5c700 1 -- 172.21.15.81:0/120814937 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0e6fe0 con 0x7f794c039090 2023-11-29T11:12:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7958f5c700 1 --2- 172.21.15.81:0/120814937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c039090 0x7f794c051d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f795402cad0 tx=0x7f795404e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25868405ae71a3e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7952ffd700 1 -- 172.21.15.81:0/120814937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954067660 con 0x7f794c039090 2023-11-29T11:12:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7952ffd700 1 -- 172.21.15.81:0/120814937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79540727d0 con 0x7f794c039090 2023-11-29T11:12:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f7952ffd700 1 -- 172.21.15.81:0/120814937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954072c00 con 0x7f794c039090 2023-11-29T11:12:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f795975d700 1 -- 172.21.15.81:0/120814937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c039090 msgr2=0x7f794c051d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f795975d700 1 --2- 172.21.15.81:0/120814937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c039090 0x7f794c051d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f795402cad0 tx=0x7f795404e8b0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f795975d700 1 -- 172.21.15.81:0/120814937 shutdown_connections 2023-11-29T11:12:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f795975d700 1 --2- 172.21.15.81:0/120814937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c039090 0x7f794c051d60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f795975d700 1 --2- 172.21.15.81:0/120814937 >> v2:172.21.15.176:3300/0 conn(0x7f794c0e2980 0x7f794c0e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f795975d700 1 -- 172.21.15.81:0/120814937 >> 172.21.15.81:0/120814937 conn(0x7f794c053980 msgr2=0x7f794c053d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f795975d700 1 -- 172.21.15.81:0/120814937 shutdown_connections 2023-11-29T11:12:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.503+0000 7f795975d700 1 -- 172.21.15.81:0/120814937 wait complete. 2023-11-29T11:12:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.507+0000 7f795975d700 1 Processor -- start 2023-11-29T11:12:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.507+0000 7f795975d700 1 -- start start 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.507+0000 7f795975d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794c039090 0x7f794c0d6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f795975d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c056990 0x7f794c0dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f795975d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f794c0e2980 0x7f794c0e0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f795975d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0dbe00 con 0x7f794c056990 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f795975d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0e3850 con 0x7f794c0e2980 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f795975d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0d7260 con 0x7f794c039090 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c056990 0x7f794c0dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c056990 0x7f794c0dc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45460/0 (socket says 172.21.15.81:45460) 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 -- 172.21.15.81:0/3430411301 learned_addr learned my addr 172.21.15.81:0/3430411301 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f7958f5c700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f794c0e2980 0x7f794c0e0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f7953fff700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794c039090 0x7f794c0d6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:53.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 -- 172.21.15.81:0/3430411301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794c039090 msgr2=0x7f794c0d6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:53.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794c039090 0x7f794c0d6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 -- 172.21.15.81:0/3430411301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f794c0e2980 msgr2=0x7f794c0e0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f794c0e2980 0x7f794c0e0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 -- 172.21.15.81:0/3430411301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795404e720 con 0x7f794c056990 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f79537fe700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c056990 0x7f794c0dc4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7948005930 tx=0x7f794800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f7950ff9700 1 -- 172.21.15.81:0/3430411301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948005d90 con 0x7f794c056990 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f7950ff9700 1 -- 172.21.15.81:0/3430411301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79480070d0 con 0x7f794c056990 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f7950ff9700 1 -- 172.21.15.81:0/3430411301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948007480 con 0x7f794c056990 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c051840 con 0x7f794c056990 2023-11-29T11:12:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c051560 con 0x7f794c056990 2023-11-29T11:12:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0e69a0 con 0x7f794c056990 2023-11-29T11:12:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.511+0000 7f7950ff9700 1 -- 172.21.15.81:0/3430411301 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7948019030 con 0x7f794c056990 2023-11-29T11:12:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.515+0000 7f7950ff9700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7940064ee0 0x7f7940067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.515+0000 7f7950ff9700 1 -- 172.21.15.81:0/3430411301 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f7948081250 con 0x7f794c056990 2023-11-29T11:12:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.515+0000 7f7953fff700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7940064ee0 0x7f7940067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.515+0000 7f7953fff700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7940064ee0 0x7f7940067390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7944009b50 tx=0x7f7944009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.523+0000 7f7950ff9700 1 -- 172.21.15.81:0/3430411301 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f794804f310 con 0x7f794c056990 2023-11-29T11:12:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:53.679+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f794c055c30 con 0x7f794c056990 2023-11-29T11:12:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.363+0000 7f7950ff9700 1 -- 172.21.15.81:0/3430411301 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f7948052930 con 0x7f794c056990 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7940064ee0 msgr2=0x7f7940067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7940064ee0 0x7f7940067390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7944009b50 tx=0x7f7944009240 comp rx=0 tx=0).stop 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c056990 msgr2=0x7f794c0dc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c056990 0x7f794c0dc4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7948005930 tx=0x7f794800c9e0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 shutdown_connections 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7940064ee0 0x7f7940067390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f794c0e2980 0x7f794c0e0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f794c056990 0x7f794c0dc4d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 --2- 172.21.15.81:0/3430411301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f794c039090 0x7f794c0d6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 >> 172.21.15.81:0/3430411301 conn(0x7f794c053980 msgr2=0x7f794c052b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:55.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 shutdown_connections 2023-11-29T11:12:55.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.375+0000 7f795975d700 1 -- 172.21.15.81:0/3430411301 wait complete. 2023-11-29T11:12:55.381 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2023-11-29T11:12:55.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-29T11:12:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3ab4c4700 1 Processor -- start 2023-11-29T11:12:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3ab4c4700 1 -- start start 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3ab4c4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3a4159ee0 0x7fa3a40cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3ab4c4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa3a415a2b0 0x7fa3a40cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3ab4c4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3ab4c4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40b4fc0 con 0x7fa3a4159ee0 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3ab4c4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a4069c40 con 0x7fa3a415a2b0 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3ab4c4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415da60 con 0x7fa3a40b4600 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3a4159ee0 0x7fa3a40cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3a4159ee0 0x7fa3a40cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45466/0 (socket says 172.21.15.81:45466) 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 -- 172.21.15.81:0/2005821268 learned_addr learned my addr 172.21.15.81:0/2005821268 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a8a5f700 1 --2- 172.21.15.81:0/2005821268 >> v2:172.21.15.176:3300/0 conn(0x7fa3a415a2b0 0x7fa3a40cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9a61700 1 --2- 172.21.15.81:0/2005821268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 -- 172.21.15.81:0/2005821268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 msgr2=0x7fa3a40b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 --2- 172.21.15.81:0/2005821268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 -- 172.21.15.81:0/2005821268 >> v2:172.21.15.176:3300/0 conn(0x7fa3a415a2b0 msgr2=0x7fa3a40cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 --2- 172.21.15.81:0/2005821268 >> v2:172.21.15.176:3300/0 conn(0x7fa3a415a2b0 0x7fa3a40cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 -- 172.21.15.81:0/2005821268 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4069e90 con 0x7fa3a4159ee0 2023-11-29T11:12:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9a61700 1 --2- 172.21.15.81:0/2005821268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:55.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa3a9260700 1 --2- 172.21.15.81:0/2005821268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a40cd1d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40cf5d0 tx=0x7fa3a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cde020b733ae646 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa39bfff700 1 -- 172.21.15.81:0/2005821268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0011830 con 0x7fa3a4159ee0 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa39bfff700 1 -- 172.21.15.81:0/2005821268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0011990 con 0x7fa3a4159ee0 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.507+0000 7fa39bfff700 1 -- 172.21.15.81:0/2005821268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0011d20 con 0x7fa3a4159ee0 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2005821268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 msgr2=0x7fa3a40cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2005821268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a40cd1d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40cf5d0 tx=0x7fa3a0009bf0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2005821268 shutdown_connections 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2005821268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2005821268 >> v2:172.21.15.176:3300/0 conn(0x7fa3a415a2b0 0x7fa3a40cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2005821268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a40cd1d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2005821268 >> 172.21.15.81:0/2005821268 conn(0x7fa3a406cb60 msgr2=0x7fa3a40cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2005821268 shutdown_connections 2023-11-29T11:12:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2005821268 wait complete. 2023-11-29T11:12:55.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 Processor -- start 2023-11-29T11:12:55.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.511+0000 7fa3ab4c4700 1 -- start start 2023-11-29T11:12:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3ab4c4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3ab4c4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a4145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3ab4c4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a415a2b0 0x7fa3a4154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3ab4c4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40c8e50 con 0x7fa3a4159ee0 2023-11-29T11:12:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3ab4c4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a4145f40 con 0x7fa3a415a2b0 2023-11-29T11:12:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3ab4c4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a4146210 con 0x7fa3a40b4600 2023-11-29T11:12:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a4145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a4145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45470/0 (socket says 172.21.15.81:45470) 2023-11-29T11:12:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 -- 172.21.15.81:0/2589809714 learned_addr learned my addr 172.21.15.81:0/2589809714 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a9a61700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a415a2b0 0x7fa3a4154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a9260700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 -- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 msgr2=0x7fa3a40c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 -- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a415a2b0 msgr2=0x7fa3a4154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a415a2b0 0x7fa3a4154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 -- 172.21.15.81:0/2589809714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0009570 con 0x7fa3a4159ee0 2023-11-29T11:12:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a9a61700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a415a2b0 0x7fa3a4154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:12:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3a8a5f700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a4145a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa394009fd0 tx=0x7fa39400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa399ffb700 1 -- 172.21.15.81:0/2589809714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940095a0 con 0x7fa3a4159ee0 2023-11-29T11:12:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa399ffb700 1 -- 172.21.15.81:0/2589809714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa394013680 con 0x7fa3a4159ee0 2023-11-29T11:12:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a406a450 con 0x7fa3a4159ee0 2023-11-29T11:12:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa399ffb700 1 -- 172.21.15.81:0/2589809714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394013a30 con 0x7fa3a4159ee0 2023-11-29T11:12:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.515+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a406a170 con 0x7fa3a4159ee0 2023-11-29T11:12:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.519+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a406a730 con 0x7fa3a4159ee0 2023-11-29T11:12:55.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.519+0000 7fa399ffb700 1 -- 172.21.15.81:0/2589809714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa394023070 con 0x7fa3a4159ee0 2023-11-29T11:12:55.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.519+0000 7fa399ffb700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa388064ee0 0x7fa388067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:55.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.519+0000 7fa3a9260700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa388064ee0 0x7fa388067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:55.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.519+0000 7fa399ffb700 1 -- 172.21.15.81:0/2589809714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fa394082180 con 0x7fa3a4159ee0 2023-11-29T11:12:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.519+0000 7fa3a9260700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa388064ee0 0x7fa388067390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0000c00 tx=0x7fa3a0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:55.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.531+0000 7fa399ffb700 1 -- 172.21.15.81:0/2589809714 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa394050050 con 0x7fa3a4159ee0 2023-11-29T11:12:55.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:55.695+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa3a415be00 con 0x7fa3a4159ee0 2023-11-29T11:12:55.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:12:55.757 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:12:56.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.367+0000 7fa399ffb700 1 -- 172.21.15.81:0/2589809714 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa394053670 con 0x7fa3a4159ee0 2023-11-29T11:12:56.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa388064ee0 msgr2=0x7fa388067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa388064ee0 0x7fa388067390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0000c00 tx=0x7fa3a0008030 comp rx=0 tx=0).stop 2023-11-29T11:12:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 msgr2=0x7fa3a4145a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a4145a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa394009fd0 tx=0x7fa39400eb20 comp rx=0 tx=0).stop 2023-11-29T11:12:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 shutdown_connections 2023-11-29T11:12:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa388064ee0 0x7fa388067390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3a415a2b0 0x7fa3a4154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a4159ee0 0x7fa3a4145a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 --2- 172.21.15.81:0/2589809714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3a40b4600 0x7fa3a40c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 >> 172.21.15.81:0/2589809714 conn(0x7fa3a406cb60 msgr2=0x7fa3a40cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 shutdown_connections 2023-11-29T11:12:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.399+0000 7fa3ab4c4700 1 -- 172.21.15.81:0/2589809714 wait complete. 2023-11-29T11:12:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 5 allow_ec_overwrites to true 2023-11-29T11:12:56.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-29T11:12:56.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8f59e700 1 Processor -- start 2023-11-29T11:12:56.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8f59e700 1 -- start start 2023-11-29T11:12:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4e900cf7f0 0x7f4e9006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9006a9c0 con 0x7f4e900b1ae0 2023-11-29T11:12:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8f59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9006aca0 con 0x7f4e9006a4c0 2023-11-29T11:12:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900d0ab0 con 0x7f4e900cf7f0 2023-11-29T11:12:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4e900b1ae0 0x7f4e900d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48008/0 (socket says 172.21.15.81:48008) 2023-11-29T11:12:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8e59c700 1 -- 172.21.15.81:0/2871519294 learned_addr learned my addr 172.21.15.81:0/2871519294 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8ed9d700 1 --2- 172.21.15.81:0/2871519294 >> v2:172.21.15.176:3300/0 conn(0x7f4e900cf7f0 0x7f4e9006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8d59a700 1 -- 172.21.15.81:0/2871519294 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959758685 0 0) 0x7f4e9006a9c0 con 0x7f4e900b1ae0 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8d59a700 1 -- 172.21.15.81:0/2871519294 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e780035d0 con 0x7f4e900b1ae0 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8ed9d700 1 -- 172.21.15.81:0/2871519294 >> v1:172.21.15.176:6789/0 conn(0x7f4e9006a4c0 legacy=0x7f4e900cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8ed9d700 1 -- 172.21.15.81:0/2871519294 >> v1:172.21.15.81:6789/0 conn(0x7f4e900b1ae0 legacy=0x7f4e900d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.523+0000 7f4e8ed9d700 1 -- 172.21.15.81:0/2871519294 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9006af80 con 0x7f4e900cf7f0 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8ed9d700 1 --2- 172.21.15.81:0/2871519294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 0x7f4e9006d8e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009d90 tx=0x7f4e8800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700911a086a5f50f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8d59a700 1 -- 172.21.15.81:0/2871519294 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800e070 con 0x7f4e900cf7f0 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8d59a700 1 -- 172.21.15.81:0/2871519294 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8800bb20 con 0x7f4e900cf7f0 2023-11-29T11:12:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8d59a700 1 -- 172.21.15.81:0/2871519294 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800be90 con 0x7f4e900cf7f0 2023-11-29T11:12:56.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2871519294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 msgr2=0x7f4e9006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 --2- 172.21.15.81:0/2871519294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 0x7f4e9006d8e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009d90 tx=0x7f4e8800b330 comp rx=0 tx=0).stop 2023-11-29T11:12:56.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2871519294 shutdown_connections 2023-11-29T11:12:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 --2- 172.21.15.81:0/2871519294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 0x7f4e9006d8e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2871519294 >> 172.21.15.81:0/2871519294 conn(0x7f4e9009bbd0 msgr2=0x7f4e900b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2871519294 shutdown_connections 2023-11-29T11:12:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2871519294 wait complete. 2023-11-29T11:12:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 Processor -- start 2023-11-29T11:12:56.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.527+0000 7f4e8f59e700 1 -- start start 2023-11-29T11:12:56.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e9006a4c0 0x7f4e9015d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e900b1ae0 0x7f4e901f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 0x7f4e901f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900a0330 con 0x7f4e900b1ae0 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900c61f0 con 0x7f4e900cf7f0 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9015dad0 con 0x7f4e9006a4c0 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e900b1ae0 0x7f4e901f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e900b1ae0 0x7f4e901f1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45476/0 (socket says 172.21.15.81:45476) 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 -- 172.21.15.81:0/2668117853 learned_addr learned my addr 172.21.15.81:0/2668117853 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8ed9d700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 0x7f4e901f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8e59c700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e9006a4c0 0x7f4e9015d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 -- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e9006a4c0 msgr2=0x7f4e9015d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e9006a4c0 0x7f4e9015d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 -- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 msgr2=0x7f4e901f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 0x7f4e901f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 -- 172.21.15.81:0/2668117853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88009a70 con 0x7f4e900b1ae0 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8ed9d700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 0x7f4e901f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8dd9b700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e900b1ae0 0x7f4e901f1840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c410 tx=0x7f4e8000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e7effd700 1 -- 172.21.15.81:0/2668117853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800052d0 con 0x7f4e900b1ae0 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e900b1eb0 con 0x7f4e900b1ae0 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e7effd700 1 -- 172.21.15.81:0/2668117853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e80005430 con 0x7f4e900b1ae0 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e7effd700 1 -- 172.21.15.81:0/2668117853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800055a0 con 0x7f4e900b1ae0 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e900b4380 con 0x7f4e900b1ae0 2023-11-29T11:12:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e900b60e0 con 0x7f4e900b1ae0 2023-11-29T11:12:56.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.531+0000 7f4e7effd700 1 -- 172.21.15.81:0/2668117853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4e80010050 con 0x7f4e900b1ae0 2023-11-29T11:12:56.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.535+0000 7f4e7effd700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4e70064ee0 0x7f4e70067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.535+0000 7f4e7effd700 1 -- 172.21.15.81:0/2668117853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f4e80081320 con 0x7f4e900b1ae0 2023-11-29T11:12:56.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.535+0000 7f4e8e59c700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4e70064ee0 0x7f4e70067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.535+0000 7f4e8e59c700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4e70064ee0 0x7f4e70067390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e840011e0 tx=0x7f4e84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:56.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.539+0000 7f4e7effd700 1 -- 172.21.15.81:0/2668117853 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4e80049400 con 0x7f4e900b1ae0 2023-11-29T11:12:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.743+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f4e90072500 con 0x7f4e900b1ae0 2023-11-29T11:12:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.751+0000 7f4e7effd700 1 -- 172.21.15.81:0/2668117853 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f4e8004f110 con 0x7f4e900b1ae0 2023-11-29T11:12:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4e70064ee0 msgr2=0x7f4e70067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4e70064ee0 0x7f4e70067390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e840011e0 tx=0x7f4e84009040 comp rx=0 tx=0).stop 2023-11-29T11:12:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e900b1ae0 msgr2=0x7f4e901f1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e900b1ae0 0x7f4e901f1840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c410 tx=0x7f4e8000c7d0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 shutdown_connections 2023-11-29T11:12:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4e70064ee0 0x7f4e70067390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e900cf7f0 0x7f4e901f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e900b1ae0 0x7f4e901f1840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 --2- 172.21.15.81:0/2668117853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e9006a4c0 0x7f4e9015d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 >> 172.21.15.81:0/2668117853 conn(0x7f4e9009bbd0 msgr2=0x7f4e9006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 shutdown_connections 2023-11-29T11:12:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.755+0000 7f4e8f59e700 1 -- 172.21.15.81:0/2668117853 wait complete. 2023-11-29T11:12:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 5 to fsmap 2023-11-29T11:12:56.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:12:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24151f8700 1 Processor -- start 2023-11-29T11:12:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24151f8700 1 -- start start 2023-11-29T11:12:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24151f8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24101606b0 0x7f24100c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24151f8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f24100ceef0 0x7f24100c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24151f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24100ad610 0x7f2410164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24151f8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24100cae70 con 0x7f24100ad610 2023-11-29T11:12:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24151f8700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24100cbc10 con 0x7f24100ceef0 2023-11-29T11:12:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24151f8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24100cb130 con 0x7f24101606b0 2023-11-29T11:12:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24100ad610 0x7f2410164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24100ad610 0x7f2410164040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45484/0 (socket says 172.21.15.81:45484) 2023-11-29T11:12:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 -- 172.21.15.81:0/131056468 learned_addr learned my addr 172.21.15.81:0/131056468 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f240f7fe700 1 --2- 172.21.15.81:0/131056468 >> v2:172.21.15.176:3300/0 conn(0x7f24100ceef0 0x7f24100c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f240ffff700 1 --2- 172.21.15.81:0/131056468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24101606b0 0x7f24100c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 -- 172.21.15.81:0/131056468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24101606b0 msgr2=0x7f24100c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 --2- 172.21.15.81:0/131056468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24101606b0 0x7f24100c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 -- 172.21.15.81:0/131056468 >> v2:172.21.15.176:3300/0 conn(0x7f24100ceef0 msgr2=0x7f24100c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 --2- 172.21.15.81:0/131056468 >> v2:172.21.15.176:3300/0 conn(0x7f24100ceef0 0x7f24100c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 -- 172.21.15.81:0/131056468 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24100cb410 con 0x7f24100ad610 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f24149f7700 1 --2- 172.21.15.81:0/131056468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24100ad610 0x7f2410164040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f24100cbf00 tx=0x7f2400009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177a3dab56e4efcf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f240effd700 1 -- 172.21.15.81:0/131056468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400011830 con 0x7f24100ad610 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f240effd700 1 -- 172.21.15.81:0/131056468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2400011990 con 0x7f24100ad610 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.879+0000 7f240effd700 1 -- 172.21.15.81:0/131056468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400011d20 con 0x7f24100ad610 2023-11-29T11:12:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 -- 172.21.15.81:0/131056468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24100ad610 msgr2=0x7f2410164040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 --2- 172.21.15.81:0/131056468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24100ad610 0x7f2410164040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f24100cbf00 tx=0x7f2400009bf0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 -- 172.21.15.81:0/131056468 shutdown_connections 2023-11-29T11:12:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 --2- 172.21.15.81:0/131056468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24100ad610 0x7f2410164040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 --2- 172.21.15.81:0/131056468 >> v2:172.21.15.176:3300/0 conn(0x7f24100ceef0 0x7f24100c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 --2- 172.21.15.81:0/131056468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24101606b0 0x7f24100c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 -- 172.21.15.81:0/131056468 >> 172.21.15.81:0/131056468 conn(0x7f24100ce3e0 msgr2=0x7f24100ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 -- 172.21.15.81:0/131056468 shutdown_connections 2023-11-29T11:12:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 -- 172.21.15.81:0/131056468 wait complete. 2023-11-29T11:12:56.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 Processor -- start 2023-11-29T11:12:56.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.883+0000 7f24151f8700 1 -- start start 2023-11-29T11:12:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24100ad610 0x7f2410162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24100ceef0 0x7f241015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24101606b0 0x7f241015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241015c5b0 con 0x7f24101606b0 2023-11-29T11:12:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410163110 con 0x7f24100ad610 2023-11-29T11:12:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2410161b30 con 0x7f24100ceef0 2023-11-29T11:12:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24101606b0 0x7f241015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24101606b0 0x7f241015cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45486/0 (socket says 172.21.15.81:45486) 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 -- 172.21.15.81:0/4171734034 learned_addr learned my addr 172.21.15.81:0/4171734034 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f240ffff700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24100ad610 0x7f2410162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f240f7fe700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24100ceef0 0x7f241015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 -- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24100ceef0 msgr2=0x7f241015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24100ceef0 0x7f241015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 -- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24100ad610 msgr2=0x7f2410162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24100ad610 0x7f2410162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 -- 172.21.15.81:0/4171734034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400009570 con 0x7f24101606b0 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f240f7fe700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24100ceef0 0x7f241015b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f240ffff700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24100ad610 0x7f2410162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24149f7700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24101606b0 0x7f241015cb00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f241006f740 tx=0x7f2400004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f240cff9700 1 -- 172.21.15.81:0/4171734034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400004300 con 0x7f24101606b0 2023-11-29T11:12:56.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f240cff9700 1 -- 172.21.15.81:0/4171734034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240001f070 con 0x7f24101606b0 2023-11-29T11:12:56.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24100b36c0 con 0x7f24101606b0 2023-11-29T11:12:56.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f240cff9700 1 -- 172.21.15.81:0/4171734034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000036c0 con 0x7f24101606b0 2023-11-29T11:12:56.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24100cb6f0 con 0x7f24101606b0 2023-11-29T11:12:56.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.887+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2410164580 con 0x7f24101606b0 2023-11-29T11:12:56.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.891+0000 7f240cff9700 1 -- 172.21.15.81:0/4171734034 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f240002a020 con 0x7f24101606b0 2023-11-29T11:12:56.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.891+0000 7f240cff9700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23fc064ee0 0x7f23fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:56.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.891+0000 7f240ffff700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23fc064ee0 0x7f23fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:56.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.891+0000 7f240cff9700 1 -- 172.21.15.81:0/4171734034 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2400083580 con 0x7f24101606b0 2023-11-29T11:12:56.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.891+0000 7f240ffff700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23fc064ee0 0x7f23fc067390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2404009ba0 tx=0x7f2404008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:56.899+0000 7f240cff9700 1 -- 172.21.15.81:0/4171734034 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2400051430 con 0x7f24101606b0 2023-11-29T11:12:57.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24100af050 con 0x7f24101606b0 2023-11-29T11:12:57.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f240cff9700 1 -- 172.21.15.81:0/4171734034 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4644 (secure 0 0 0) 0x7f2400054a50 con 0x7f24101606b0 2023-11-29T11:12:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:57.106 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:12:52.329725+0000","modified":"2023-11-29T11:12:56.745642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-29T11:12:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23fc064ee0 msgr2=0x7f23fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23fc064ee0 0x7f23fc067390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2404009ba0 tx=0x7f2404008040 comp rx=0 tx=0).stop 2023-11-29T11:12:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24101606b0 msgr2=0x7f241015cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24101606b0 0x7f241015cb00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f241006f740 tx=0x7f2400004770 comp rx=0 tx=0).stop 2023-11-29T11:12:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 shutdown_connections 2023-11-29T11:12:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23fc064ee0 0x7f23fc067390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24101606b0 0x7f241015cb00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24100ceef0 0x7f241015b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 --2- 172.21.15.81:0/4171734034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24100ad610 0x7f2410162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 >> 172.21.15.81:0/4171734034 conn(0x7f24100ce3e0 msgr2=0x7f24100af570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 shutdown_connections 2023-11-29T11:12:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.103+0000 7f24151f8700 1 -- 172.21.15.81:0/4171734034 wait complete. 2023-11-29T11:12:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-11-29T11:12:57.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:12:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.219+0000 7ff904a51700 1 Processor -- start 2023-11-29T11:12:57.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.219+0000 7ff904a51700 1 -- start start 2023-11-29T11:12:57.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9001607b0 0x7ff9000cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9000cc730 con 0x7ff9000cd000 2023-11-29T11:12:57.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9000b1f30 con 0x7ff9000cc360 2023-11-29T11:12:57.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9000d04c0 con 0x7ff9001607b0 2023-11-29T11:12:57.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fe59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9001607b0 0x7ff9000cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8ff59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff9000cd000 0x7ff9000afdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48022/0 (socket says 172.21.15.81:48022) 2023-11-29T11:12:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fe59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9001607b0 0x7ff9000cfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45490/0 (socket says 172.21.15.81:45490) 2023-11-29T11:12:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8ff59e700 1 -- 172.21.15.81:0/2512713060 learned_addr learned my addr 172.21.15.81:0/2512713060 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fe59c700 1 -- 172.21.15.81:0/2512713060 >> v1:172.21.15.176:6789/0 conn(0x7ff9000cc360 legacy=0x7ff9000ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fe59c700 1 -- 172.21.15.81:0/2512713060 >> v1:172.21.15.81:6789/0 conn(0x7ff9000cd000 legacy=0x7ff9000afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fdd9b700 1 -- 172.21.15.81:0/2512713060 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266802658 0 0) 0x7ff9000b1f30 con 0x7ff9000cc360 2023-11-29T11:12:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fe59c700 1 -- 172.21.15.81:0/2512713060 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9000d01e0 con 0x7ff9001607b0 2023-11-29T11:12:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fe59c700 1 --2- 172.21.15.81:0/2512713060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9001607b0 0x7ff9000cfbd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009840 tx=0x7ff8f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6736829dba9a0c24 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fdd9b700 1 -- 172.21.15.81:0/2512713060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0005e50 con 0x7ff9001607b0 2023-11-29T11:12:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fdd9b700 1 -- 172.21.15.81:0/2512713060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0006030 con 0x7ff9001607b0 2023-11-29T11:12:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff8fdd9b700 1 -- 172.21.15.81:0/2512713060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00063c0 con 0x7ff9001607b0 2023-11-29T11:12:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 -- 172.21.15.81:0/2512713060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9001607b0 msgr2=0x7ff9000cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 --2- 172.21.15.81:0/2512713060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9001607b0 0x7ff9000cfbd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009840 tx=0x7ff8f0009b50 comp rx=0 tx=0).stop 2023-11-29T11:12:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 -- 172.21.15.81:0/2512713060 shutdown_connections 2023-11-29T11:12:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 --2- 172.21.15.81:0/2512713060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9001607b0 0x7ff9000cfbd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 -- 172.21.15.81:0/2512713060 >> 172.21.15.81:0/2512713060 conn(0x7ff9000b2140 msgr2=0x7ff9000b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 -- 172.21.15.81:0/2512713060 shutdown_connections 2023-11-29T11:12:57.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.223+0000 7ff904a51700 1 -- 172.21.15.81:0/2512713060 wait complete. 2023-11-29T11:12:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 Processor -- start 2023-11-29T11:12:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 -- start start 2023-11-29T11:12:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9000cc360 0x7ff9001538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9000cd000 0x7ff900156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9001607b0 0x7ff9000b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90015c4f0 con 0x7ff9000cc360 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90015c790 con 0x7ff9001607b0 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90015ca70 con 0x7ff9000cd000 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9000cc360 0x7ff9001538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9000cc360 0x7ff9001538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45492/0 (socket says 172.21.15.81:45492) 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 -- 172.21.15.81:0/2090165836 learned_addr learned my addr 172.21.15.81:0/2090165836 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fe59c700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9000cd000 0x7ff900156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8ff59e700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9001607b0 0x7ff9000b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 -- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9000cd000 msgr2=0x7ff900156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9000cd000 0x7ff900156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 -- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9001607b0 msgr2=0x7ff9000b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9001607b0 0x7ff9000b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 -- 172.21.15.81:0/2090165836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0009450 con 0x7ff9000cc360 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8ff59e700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9001607b0 0x7ff9000b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8fed9d700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9000cc360 0x7ff9001538d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400c520 tx=0x7ff8f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8e77fe700 1 -- 172.21.15.81:0/2090165836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f40054e0 con 0x7ff9000cc360 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8e77fe700 1 -- 172.21.15.81:0/2090165836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f40036a0 con 0x7ff9000cc360 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff8e77fe700 1 -- 172.21.15.81:0/2090165836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4003a50 con 0x7ff9000cc360 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90015ffb0 con 0x7ff9000cc360 2023-11-29T11:12:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.227+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90015fcd0 con 0x7ff9000cc360 2023-11-29T11:12:57.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.231+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff900160290 con 0x7ff9000cc360 2023-11-29T11:12:57.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.231+0000 7ff8e77fe700 1 -- 172.21.15.81:0/2090165836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff8f4019030 con 0x7ff9000cc360 2023-11-29T11:12:57.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.231+0000 7ff8e77fe700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ec064ee0 0x7ff8ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.231+0000 7ff8e77fe700 1 -- 172.21.15.81:0/2090165836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff8f4081570 con 0x7ff9000cc360 2023-11-29T11:12:57.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.231+0000 7ff8fe59c700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ec064ee0 0x7ff8ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.231+0000 7ff8fe59c700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ec064ee0 0x7ff8ec067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009840 tx=0x7ff8f0008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.235+0000 7ff8e77fe700 1 -- 172.21.15.81:0/2090165836 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff8f404f420 con 0x7ff9000cc360 2023-11-29T11:12:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.395+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff900072500 con 0x7ff9000cc360 2023-11-29T11:12:57.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff8e77fe700 1 -- 172.21.15.81:0/2090165836 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7ff8f4017090 con 0x7ff9000cc360 2023-11-29T11:12:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:57.406 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:12:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ec064ee0 msgr2=0x7ff8ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ec064ee0 0x7ff8ec067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009840 tx=0x7ff8f0008070 comp rx=0 tx=0).stop 2023-11-29T11:12:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9000cc360 msgr2=0x7ff9001538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9000cc360 0x7ff9001538d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400c520 tx=0x7ff8f400c8e0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 shutdown_connections 2023-11-29T11:12:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ec064ee0 0x7ff8ec067390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9001607b0 0x7ff9000b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9000cd000 0x7ff900156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 --2- 172.21.15.81:0/2090165836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9000cc360 0x7ff9001538d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 >> 172.21.15.81:0/2090165836 conn(0x7ff9000b2140 msgr2=0x7ff90015ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 shutdown_connections 2023-11-29T11:12:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.403+0000 7ff904a51700 1 -- 172.21.15.81:0/2090165836 wait complete. 2023-11-29T11:12:57.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:12:57.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.527+0000 7f45948f7700 1 Processor -- start 2023-11-29T11:12:57.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.527+0000 7f45948f7700 1 -- start start 2023-11-29T11:12:57.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f459006b850 0x7f459016b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45900c2fa0 con 0x7f45900cbef0 2023-11-29T11:12:57.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4590070f50 con 0x7f4590160770 2023-11-29T11:12:57.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4590071e40 con 0x7f459006b850 2023-11-29T11:12:57.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45900cbef0 0x7f45900cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48032/0 (socket says 172.21.15.81:48032) 2023-11-29T11:12:57.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458effd700 1 -- 172.21.15.81:0/1642633705 learned_addr learned my addr 172.21.15.81:0/1642633705 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:12:57.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458ffff700 1 --2- 172.21.15.81:0/1642633705 >> v2:172.21.15.81:3300/0 conn(0x7f459006b850 0x7f459016b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458e7fc700 1 -- 172.21.15.81:0/1642633705 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269389465 0 0) 0x7f4580001490 con 0x7f45900cbef0 2023-11-29T11:12:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458e7fc700 1 -- 172.21.15.81:0/1642633705 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45780035d0 con 0x7f45900cbef0 2023-11-29T11:12:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458ffff700 1 -- 172.21.15.81:0/1642633705 >> v1:172.21.15.176:6789/0 conn(0x7f4590160770 legacy=0x7f45900cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458e7fc700 1 -- 172.21.15.81:0/1642633705 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699921558 0 0) 0x7f45780035d0 con 0x7f45900cbef0 2023-11-29T11:12:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458ffff700 1 -- 172.21.15.81:0/1642633705 >> v1:172.21.15.81:6789/0 conn(0x7f45900cbef0 legacy=0x7f45900cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458ffff700 1 -- 172.21.15.81:0/1642633705 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590071230 con 0x7f459006b850 2023-11-29T11:12:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458ffff700 1 --2- 172.21.15.81:0/1642633705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f459006b850 0x7f459016b140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4588009850 tx=0x7f4588009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab8535b8bf35bca server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458e7fc700 1 -- 172.21.15.81:0/1642633705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580001b80 con 0x7f459006b850 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458e7fc700 1 -- 172.21.15.81:0/1642633705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4588004030 con 0x7f459006b850 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f458e7fc700 1 -- 172.21.15.81:0/1642633705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880043a0 con 0x7f459006b850 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 -- 172.21.15.81:0/1642633705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f459006b850 msgr2=0x7f459016b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 --2- 172.21.15.81:0/1642633705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f459006b850 0x7f459016b140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4588009850 tx=0x7f4588009b60 comp rx=0 tx=0).stop 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 -- 172.21.15.81:0/1642633705 shutdown_connections 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 --2- 172.21.15.81:0/1642633705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f459006b850 0x7f459016b140 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 -- 172.21.15.81:0/1642633705 >> 172.21.15.81:0/1642633705 conn(0x7f459006ec40 msgr2=0x7f45900b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 -- 172.21.15.81:0/1642633705 shutdown_connections 2023-11-29T11:12:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.531+0000 7f45948f7700 1 -- 172.21.15.81:0/1642633705 wait complete. 2023-11-29T11:12:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 Processor -- start 2023-11-29T11:12:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 -- start start 2023-11-29T11:12:57.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f459006b850 0x7f459015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45900cbef0 0x7f45900b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4590160770 0x7f45900bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900b2f90 con 0x7f45900cbef0 2023-11-29T11:12:57.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900b3270 con 0x7f4590160770 2023-11-29T11:12:57.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45900b3550 con 0x7f459006b850 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45900cbef0 0x7f45900b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45900cbef0 0x7f45900b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45508/0 (socket says 172.21.15.81:45508) 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 -- 172.21.15.81:0/2445157505 learned_addr learned my addr 172.21.15.81:0/2445157505 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458ffff700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4590160770 0x7f45900bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458f7fe700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f459006b850 0x7f459015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 -- 172.21.15.81:0/2445157505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f459006b850 msgr2=0x7f459015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f459006b850 0x7f459015d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 -- 172.21.15.81:0/2445157505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4590160770 msgr2=0x7f45900bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4590160770 0x7f45900bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 -- 172.21.15.81:0/2445157505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45880094b0 con 0x7f45900cbef0 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f458effd700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45900cbef0 0x7f45900b25b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4580001ad0 tx=0x7f458000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f4577fff700 1 -- 172.21.15.81:0/2445157505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000ad80 con 0x7f45900cbef0 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45900717f0 con 0x7f45900cbef0 2023-11-29T11:12:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f4577fff700 1 -- 172.21.15.81:0/2445157505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45800070d0 con 0x7f45900cbef0 2023-11-29T11:12:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4590071510 con 0x7f45900cbef0 2023-11-29T11:12:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.535+0000 7f4577fff700 1 -- 172.21.15.81:0/2445157505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580007440 con 0x7f45900cbef0 2023-11-29T11:12:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.539+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4590071ad0 con 0x7f45900cbef0 2023-11-29T11:12:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.539+0000 7f4577fff700 1 -- 172.21.15.81:0/2445157505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4580010070 con 0x7f45900cbef0 2023-11-29T11:12:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.539+0000 7f4577fff700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f457c064ee0 0x7f457c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.539+0000 7f458f7fe700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f457c064ee0 0x7f457c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.539+0000 7f4577fff700 1 -- 172.21.15.81:0/2445157505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4580081fa0 con 0x7f45900cbef0 2023-11-29T11:12:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.539+0000 7f458f7fe700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f457c064ee0 0x7f457c067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45901637d0 tx=0x7f4584009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.547+0000 7f4577fff700 1 -- 172.21.15.81:0/2445157505 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f458004fea0 con 0x7f45900cbef0 2023-11-29T11:12:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.711+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45900c2fa0 con 0x7f45900cbef0 2023-11-29T11:12:57.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f4577fff700 1 -- 172.21.15.81:0/2445157505 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f45900c2fa0 con 0x7f45900cbef0 2023-11-29T11:12:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:57.718 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:12:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f457c064ee0 msgr2=0x7f457c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f457c064ee0 0x7f457c067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45901637d0 tx=0x7f4584009040 comp rx=0 tx=0).stop 2023-11-29T11:12:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45900cbef0 msgr2=0x7f45900b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45900cbef0 0x7f45900b25b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4580001ad0 tx=0x7f458000a340 comp rx=0 tx=0).stop 2023-11-29T11:12:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 shutdown_connections 2023-11-29T11:12:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f457c064ee0 0x7f457c067390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4590160770 0x7f45900bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45900cbef0 0x7f45900b25b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 --2- 172.21.15.81:0/2445157505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f459006b850 0x7f459015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 >> 172.21.15.81:0/2445157505 conn(0x7f459006ec40 msgr2=0x7f45900cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 shutdown_connections 2023-11-29T11:12:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.715+0000 7f45948f7700 1 -- 172.21.15.81:0/2445157505 wait complete. 2023-11-29T11:12:57.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:12:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.859+0000 7fd5cbfff700 1 Processor -- start 2023-11-29T11:12:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.859+0000 7fd5cbfff700 1 -- start start 2023-11-29T11:12:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.859+0000 7fd5cbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5cc158e60 0x7fd5cc0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.859+0000 7fd5cbfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5cc0ad490 0x7fd5cc0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.859+0000 7fd5cbfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc0cd8f0 con 0x7fd5cc0cad50 2023-11-29T11:12:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.859+0000 7fd5cbfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0add00 con 0x7fd5cc158e60 2023-11-29T11:12:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.859+0000 7fd5cbfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0cc4f0 con 0x7fd5cc0ad490 2023-11-29T11:12:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.859+0000 7fd5caffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5cc158e60 0x7fd5cc0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5caffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5cc158e60 0x7fd5cc0c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45514/0 (socket says 172.21.15.81:45514) 2023-11-29T11:12:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5caffd700 1 -- 172.21.15.81:0/208657409 learned_addr learned my addr 172.21.15.81:0/208657409 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5c27fc700 1 --2- 172.21.15.81:0/208657409 >> v2:172.21.15.176:3300/0 conn(0x7fd5cc0ad490 0x7fd5cc0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5caffd700 1 -- 172.21.15.81:0/208657409 >> v2:172.21.15.176:3300/0 conn(0x7fd5cc0ad490 msgr2=0x7fd5cc0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5caffd700 1 --2- 172.21.15.81:0/208657409 >> v2:172.21.15.176:3300/0 conn(0x7fd5cc0ad490 0x7fd5cc0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5caffd700 1 -- 172.21.15.81:0/208657409 >> v1:172.21.15.176:6789/0 conn(0x7fd5cc0cad50 legacy=0x7fd5cc06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5caffd700 1 -- 172.21.15.81:0/208657409 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc06dc60 con 0x7fd5cc158e60 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5caffd700 1 --2- 172.21.15.81:0/208657409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc158e60 0x7fd5cc0c8a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc06f8b0 tx=0x7fd5bc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5792a08f58b88f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5ca7fc700 1 -- 172.21.15.81:0/208657409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc011830 con 0x7fd5cc158e60 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5ca7fc700 1 -- 172.21.15.81:0/208657409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc011990 con 0x7fd5cc158e60 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5ca7fc700 1 -- 172.21.15.81:0/208657409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc011d40 con 0x7fd5cc158e60 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 -- 172.21.15.81:0/208657409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc158e60 msgr2=0x7fd5cc0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/208657409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc158e60 0x7fd5cc0c8a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc06f8b0 tx=0x7fd5bc009c20 comp rx=0 tx=0).stop 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 -- 172.21.15.81:0/208657409 shutdown_connections 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/208657409 >> v2:172.21.15.176:3300/0 conn(0x7fd5cc0ad490 0x7fd5cc0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/208657409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc158e60 0x7fd5cc0c8a30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 -- 172.21.15.81:0/208657409 >> 172.21.15.81:0/208657409 conn(0x7fd5cc0ce3e0 msgr2=0x7fd5cc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 -- 172.21.15.81:0/208657409 shutdown_connections 2023-11-29T11:12:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 -- 172.21.15.81:0/208657409 wait complete. 2023-11-29T11:12:57.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 Processor -- start 2023-11-29T11:12:57.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.863+0000 7fd5cbfff700 1 -- start start 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc0ad490 0x7fd5cc150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0cad50 0x7fd5cc0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc158e60 0x7fd5cc0ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c4390 con 0x7fd5cc0cad50 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cbfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc097b20 con 0x7fd5cc0ad490 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cbfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c31d0 con 0x7fd5cc158e60 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0cad50 0x7fd5cc0ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0cad50 0x7fd5cc0ab220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45522/0 (socket says 172.21.15.81:45522) 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 -- 172.21.15.81:0/1932240875 learned_addr learned my addr 172.21.15.81:0/1932240875 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5caffd700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc0ad490 0x7fd5cc150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cb7fe700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc158e60 0x7fd5cc0ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 -- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc158e60 msgr2=0x7fd5cc0ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc158e60 0x7fd5cc0ab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 -- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc0ad490 msgr2=0x7fd5cc150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc0ad490 0x7fd5cc150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 -- 172.21.15.81:0/1932240875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc009570 con 0x7fd5cc0cad50 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cb7fe700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc158e60 0x7fd5cc0ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5caffd700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc0ad490 0x7fd5cc150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c27fc700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0cad50 0x7fd5cc0ab220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400e9d0 tx=0x7fd5b400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c8ff9700 1 -- 172.21.15.81:0/1932240875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4009720 con 0x7fd5cc0cad50 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c8ff9700 1 -- 172.21.15.81:0/1932240875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b400c850 con 0x7fd5cc0cad50 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc159230 con 0x7fd5cc0cad50 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5c8ff9700 1 -- 172.21.15.81:0/1932240875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400cbc0 con 0x7fd5cc0cad50 2023-11-29T11:12:57.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.867+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc0cde90 con 0x7fd5cc0cad50 2023-11-29T11:12:57.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.871+0000 7fd5c8ff9700 1 -- 172.21.15.81:0/1932240875 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd5b4019030 con 0x7fd5cc0cad50 2023-11-29T11:12:57.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.871+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc06d6a0 con 0x7fd5cc0cad50 2023-11-29T11:12:57.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.871+0000 7fd5c8ff9700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd5ac064ee0 0x7fd5ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.871+0000 7fd5c8ff9700 1 -- 172.21.15.81:0/1932240875 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5b40822b0 con 0x7fd5cc0cad50 2023-11-29T11:12:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.871+0000 7fd5caffd700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd5ac064ee0 0x7fd5ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:57.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.871+0000 7fd5caffd700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd5ac064ee0 0x7fd5ac067390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc014040 tx=0x7fd5bc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:57.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:57.875+0000 7fd5c8ff9700 1 -- 172.21.15.81:0/1932240875 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd5b4050070 con 0x7fd5cc0cad50 2023-11-29T11:12:58.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.075+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5cc066f50 con 0x7fd5cc0cad50 2023-11-29T11:12:58.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.075+0000 7fd5c8ff9700 1 -- 172.21.15.81:0/1932240875 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4644 (secure 0 0 0) 0x7fd5b4053690 con 0x7fd5cc0cad50 2023-11-29T11:12:58.079 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:12:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:12:52.329725+0000","modified":"2023-11-29T11:12:56.745642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd5ac064ee0 msgr2=0x7fd5ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd5ac064ee0 0x7fd5ac067390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc014040 tx=0x7fd5bc008030 comp rx=0 tx=0).stop 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0cad50 msgr2=0x7fd5cc0ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0cad50 0x7fd5cc0ab220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400e9d0 tx=0x7fd5b400ed90 comp rx=0 tx=0).stop 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 shutdown_connections 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd5ac064ee0 0x7fd5ac067390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5cc158e60 0x7fd5cc0ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0cad50 0x7fd5cc0ab220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1932240875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5cc0ad490 0x7fd5cc150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 >> 172.21.15.81:0/1932240875 conn(0x7fd5cc0ce3e0 msgr2=0x7fd5cc1584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:58.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 shutdown_connections 2023-11-29T11:12:58.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.079+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1932240875 wait complete. 2023-11-29T11:12:58.083 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2023-11-29T11:12:58.207 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-11-29T11:12:58.203+0000 7fd6d4139700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:12:58.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:12:52.329725+0000', 'modified': '2023-11-29T11:12:56.745642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3562625855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3562625855}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3562625855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-29T11:12:58.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:12:58.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-29T11:12:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.615+0000 7f0f63c64700 1 Processor -- start 2023-11-29T11:12:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f63c64700 1 -- start start 2023-11-29T11:12:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f63c64700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0f5c0cbfa0 0x7f0f5c0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f63c64700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f5c0c9590 0x7f0f5c06b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f63c64700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c06c3b0 con 0x7f0f5c158890 2023-11-29T11:12:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f63c64700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c06c690 con 0x7f0f5c0c9590 2023-11-29T11:12:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f63c64700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c06c970 con 0x7f0f5c0cbfa0 2023-11-29T11:12:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f62201700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f5c0c9590 0x7f0f5c06b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f62201700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f5c0c9590 0x7f0f5c06b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45536/0 (socket says 172.21.15.81:45536) 2023-11-29T11:12:58.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f62201700 1 -- 172.21.15.81:0/1134628189 learned_addr learned my addr 172.21.15.81:0/1134628189 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:58.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f611ff700 1 --2- 172.21.15.81:0/1134628189 >> v2:172.21.15.176:3300/0 conn(0x7f0f5c0cbfa0 0x7f0f5c0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f62201700 1 -- 172.21.15.81:0/1134628189 >> v2:172.21.15.176:3300/0 conn(0x7f0f5c0cbfa0 msgr2=0x7f0f5c0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f62201700 1 --2- 172.21.15.81:0/1134628189 >> v2:172.21.15.176:3300/0 conn(0x7f0f5c0cbfa0 0x7f0f5c0cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f62201700 1 -- 172.21.15.81:0/1134628189 >> v1:172.21.15.176:6789/0 conn(0x7f0f5c158890 legacy=0x7f0f5c0cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f62201700 1 -- 172.21.15.81:0/1134628189 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c06cc50 con 0x7f0f5c0c9590 2023-11-29T11:12:58.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f62201700 1 --2- 172.21.15.81:0/1134628189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c06b9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c070320 tx=0x7f0f5400ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dea6083d5253b8f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f609fe700 1 -- 172.21.15.81:0/1134628189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400cb70 con 0x7f0f5c0c9590 2023-11-29T11:12:58.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f609fe700 1 -- 172.21.15.81:0/1134628189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400ccd0 con 0x7f0f5c0c9590 2023-11-29T11:12:58.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.619+0000 7f0f609fe700 1 -- 172.21.15.81:0/1134628189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54018620 con 0x7f0f5c0c9590 2023-11-29T11:12:58.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- 172.21.15.81:0/1134628189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 msgr2=0x7f0f5c06b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 --2- 172.21.15.81:0/1134628189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c06b9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c070320 tx=0x7f0f5400ad90 comp rx=0 tx=0).stop 2023-11-29T11:12:58.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- 172.21.15.81:0/1134628189 shutdown_connections 2023-11-29T11:12:58.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 --2- 172.21.15.81:0/1134628189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c06b9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 --2- 172.21.15.81:0/1134628189 >> v2:172.21.15.176:3300/0 conn(0x7f0f5c0cbfa0 0x7f0f5c0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- 172.21.15.81:0/1134628189 >> 172.21.15.81:0/1134628189 conn(0x7f0f5c0b0a90 msgr2=0x7f0f5c0b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:58.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- 172.21.15.81:0/1134628189 shutdown_connections 2023-11-29T11:12:58.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- 172.21.15.81:0/1134628189 wait complete. 2023-11-29T11:12:58.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 Processor -- start 2023-11-29T11:12:58.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- start start 2023-11-29T11:12:58.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c1f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c0cbfa0 0x7f0f5c0c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5c158890 0x7f0f5c0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c7080 con 0x7f0f5c0c9590 2023-11-29T11:12:58.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c3480 con 0x7f0f5c158890 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f63c64700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c3760 con 0x7f0f5c0cbfa0 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f61a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c1f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f61a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c1f1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45538/0 (socket says 172.21.15.81:45538) 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.623+0000 7f0f61a00700 1 -- 172.21.15.81:0/2167355425 learned_addr learned my addr 172.21.15.81:0/2167355425 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f62201700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5c158890 0x7f0f5c0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f611ff700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c0cbfa0 0x7f0f5c0c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f61a00700 1 -- 172.21.15.81:0/2167355425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c0cbfa0 msgr2=0x7f0f5c0c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f61a00700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c0cbfa0 0x7f0f5c0c2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f61a00700 1 -- 172.21.15.81:0/2167355425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5c158890 msgr2=0x7f0f5c0c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f61a00700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5c158890 0x7f0f5c0c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f61a00700 1 -- 172.21.15.81:0/2167355425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5400a710 con 0x7f0f5c0c9590 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f61a00700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c1f1cd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800cbd0 tx=0x7f0f5800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f527fc700 1 -- 172.21.15.81:0/2167355425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58003c20 con 0x7f0f5c0c9590 2023-11-29T11:12:58.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f527fc700 1 -- 172.21.15.81:0/2167355425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58003d80 con 0x7f0f5c0c9590 2023-11-29T11:12:58.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f63c64700 1 -- 172.21.15.81:0/2167355425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c069c40 con 0x7f0f5c0c9590 2023-11-29T11:12:58.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f527fc700 1 -- 172.21.15.81:0/2167355425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800aae0 con 0x7f0f5c0c9590 2023-11-29T11:12:58.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f63c64700 1 -- 172.21.15.81:0/2167355425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c06cf30 con 0x7f0f5c0c9590 2023-11-29T11:12:58.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.627+0000 7f0f527fc700 1 -- 172.21.15.81:0/2167355425 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0f58010050 con 0x7f0f5c0c9590 2023-11-29T11:12:58.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f527fc700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0f40064ee0 0x7f0f40067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f611ff700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0f40064ee0 0x7f0f40067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f527fc700 1 -- 172.21.15.81:0/2167355425 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f58081fa0 con 0x7f0f5c0c9590 2023-11-29T11:12:58.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f611ff700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0f40064ee0 0x7f0f40067390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c1511a0 tx=0x7f0f4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f66ee6740 1 Processor -- start 2023-11-29T11:12:58.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f66ee6740 1 -- start start 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1dae0 0x1dcde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1d710 0x1dce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b68790 0x1dce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c8cae0 con 0x1b68790 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cfcbd0 con 0x1b1dae0 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cf5ed0 con 0x1b1d710 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b68790 0x1dce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b68790 0x1dce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45550/0 (socket says 172.21.15.81:45550) 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 -- 172.21.15.81:0/628253209 learned_addr learned my addr 172.21.15.81:0/628253209 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f61a00700 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1dae0 0x1dcde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f611ff700 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1d710 0x1dce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 -- 172.21.15.81:0/628253209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1d710 msgr2=0x1dce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1d710 0x1dce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 -- 172.21.15.81:0/628253209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1dae0 msgr2=0x1dcde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1dae0 0x1dcde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 -- 172.21.15.81:0/628253209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d1bcc0 con 0x1b68790 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f62201700 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b68790 0x1dce880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c06d790 tx=0x7f0f54012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204426feb3a82576 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f3f7fe700 1 -- 172.21.15.81:0/628253209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5401e040 con 0x1b68790 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f3f7fe700 1 -- 172.21.15.81:0/628253209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f54004240 con 0x1b68790 2023-11-29T11:12:58.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.631+0000 7f0f3f7fe700 1 -- 172.21.15.81:0/628253209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540045f0 con 0x1b68790 2023-11-29T11:12:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 -- 172.21.15.81:0/628253209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b68790 msgr2=0x1dce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b68790 0x1dce880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c06d790 tx=0x7f0f54012000 comp rx=0 tx=0).stop 2023-11-29T11:12:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 -- 172.21.15.81:0/628253209 shutdown_connections 2023-11-29T11:12:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b68790 0x1dce880 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1d710 0x1dce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/628253209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1dae0 0x1dcde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 -- 172.21.15.81:0/628253209 >> 172.21.15.81:0/628253209 conn(0x1b1deb0 msgr2=0x1db6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 -- 172.21.15.81:0/628253209 shutdown_connections 2023-11-29T11:12:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 -- 172.21.15.81:0/628253209 wait complete. 2023-11-29T11:12:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 -- start start 2023-11-29T11:12:58.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 Processor -- start 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1da4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.635+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1da5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b68790 0x1dcb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba2b20 con 0x1b1dae0 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1db8fb0 con 0x1b1d710 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1da5660 con 0x1b68790 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 10 client.0 _ll_register_callbacks cb 0x1d520d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1da5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1da5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45564/0 (socket says 172.21.15.81:45564) 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 -- 172.21.15.81:0/3496717750 learned_addr learned my addr 172.21.15.81:0/3496717750 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f61a00700 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1da4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f62201700 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b68790 0x1dcb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 -- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b68790 msgr2=0x1dcb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b68790 0x1dcb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 -- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 msgr2=0x1da4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1da4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 -- 172.21.15.81:0/3496717750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c06cc50 con 0x1b1dae0 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f62201700 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b68790 0x1dcb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f611ff700 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1da5120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c011ee0 tx=0x7f0f4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563efc96a977a7b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 1 -- 172.21.15.81:0/3496717750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c004230 con 0x1b1dae0 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 1 -- 172.21.15.81:0/3496717750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f4c004390 con 0x1b1dae0 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3496717750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ceef50 con 0x1b1dae0 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 1 -- 172.21.15.81:0/3496717750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f4c015e70 con 0x1b1dae0 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 10 client.4425 fetch_fsmap learned FSMap version 7 2023-11-29T11:12:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3496717750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1b699e0 con 0x1b1dae0 2023-11-29T11:12:58.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 1 -- 172.21.15.81:0/3496717750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ceef50 con 0x1b1dae0 2023-11-29T11:12:58.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 1 -- 172.21.15.81:0/3496717750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0f4c0036c0 con 0x1b1dae0 2023-11-29T11:12:58.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-11-29T11:12:58.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 10 client.4425 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 20 client.4425 populate_metadata read hostname 'smithi081' 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x1db4f00 0x1da2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 4 client.4425 mds_command: new command op to 4278 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3496717750 --> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ceec70 con 0x1db4f00 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f61a00700 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x1db4f00 0x1da2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 10 client.4425 ms_handle_connect on v2:172.21.15.81:6836/3562625855 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f61a00700 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x1db4f00 0x1da2c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40f8bf3991c2fc5d server_cookie=e29029e643208904 in_seq=0 out_seq=0 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 1 -- 172.21.15.81:0/3496717750 <== mds.0 v2:172.21.15.81:6836/3562625855 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1ceec70 con 0x1db4f00 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f3cff9700 10 client.4425 handle_command_reply: tid=0 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.639+0000 7f0f66ee6740 1 client.4425 shutdown 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3496717750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 msgr2=0x1da5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1da5120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c011ee0 tx=0x7f0f4c004770 comp rx=0 tx=0).stop 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3496717750 shutdown_connections 2023-11-29T11:12:58.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x1db4f00 0x1da2c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b68790 0x1dcb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1da5120 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3496717750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1da4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3496717750 >> 172.21.15.81:0/3496717750 conn(0x1b1deb0 msgr2=0x1dcf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f3cff9700 0 client.4425 ms_handle_reset on v2:172.21.15.81:6836/3562625855 2023-11-29T11:12:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3496717750 shutdown_connections 2023-11-29T11:12:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3496717750 wait complete. 2023-11-29T11:12:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.643+0000 7f0f66ee6740 20 client.4425 trim_cache size 0 max 16384 2023-11-29T11:12:58.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f66ee6740 1 Processor -- start 2023-11-29T11:12:58.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f66ee6740 1 -- start start 2023-11-29T11:12:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1deb0 0x1db3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1de4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1de4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c8c130 con 0x1b1dae0 2023-11-29T11:12:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cf32d0 con 0x1b1d710 2023-11-29T11:12:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cf8a30 con 0x1b1deb0 2023-11-29T11:12:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1de4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1de4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45580/0 (socket says 172.21.15.81:45580) 2023-11-29T11:12:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 -- 172.21.15.81:0/3879252234 learned_addr learned my addr 172.21.15.81:0/3879252234 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f611ff700 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1de4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f61a00700 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1deb0 0x1db3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 -- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1deb0 msgr2=0x1db3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1deb0 0x1db3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 -- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 msgr2=0x1de4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1de4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 -- 172.21.15.81:0/3879252234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c06a570 con 0x1b1dae0 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f61a00700 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1deb0 0x1db3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f62201700 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1de4dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f54023000 tx=0x7f0f54011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2181ad7b0b42bc39 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.663+0000 7f0f3ffff700 1 -- 172.21.15.81:0/3879252234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5401e040 con 0x1b1dae0 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f3ffff700 1 -- 172.21.15.81:0/3879252234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f54006d20 con 0x1b1dae0 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f3ffff700 1 -- 172.21.15.81:0/3879252234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540045d0 con 0x1b1dae0 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3879252234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 msgr2=0x1de4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1de4dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f54023000 tx=0x7f0f54011000 comp rx=0 tx=0).stop 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3879252234 shutdown_connections 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1dae0 0x1de4dd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1de4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/3879252234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1deb0 0x1db3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3879252234 >> 172.21.15.81:0/3879252234 conn(0x1da5290 msgr2=0x1db3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3879252234 shutdown_connections 2023-11-29T11:12:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- 172.21.15.81:0/3879252234 wait complete. 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- start start 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 Processor -- start 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1e33b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1dae0 0x1dea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1deb0 0x1deaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ccbde0 con 0x1b1deb0 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dea5c0 con 0x1b1d710 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1de57a0 con 0x1b1dae0 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 10 client.0 _ll_register_callbacks cb 0x1ca22d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1deb0 0x1deaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f61a00700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1e33b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1deb0 0x1deaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45596/0 (socket says 172.21.15.81:45596) 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 -- 172.21.15.81:0/2319515489 learned_addr learned my addr 172.21.15.81:0/2319515489 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f611ff700 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1dae0 0x1dea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 -- 172.21.15.81:0/2319515489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1dae0 msgr2=0x1dea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1dae0 0x1dea9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 -- 172.21.15.81:0/2319515489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 msgr2=0x1e33b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1e33b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 -- 172.21.15.81:0/2319515489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1d1bcc0 con 0x1b1deb0 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f62201700 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1deb0 0x1deaf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0f54024000 tx=0x7f0f540047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6e92340cc7a051 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:12:58.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f3cff9700 1 -- 172.21.15.81:0/2319515489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5401e040 con 0x1b1deb0 2023-11-29T11:12:58.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f3cff9700 1 -- 172.21.15.81:0/2319515489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f54003b90 con 0x1b1deb0 2023-11-29T11:12:58.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.667+0000 7f0f66ee6740 1 -- 172.21.15.81:0/2319515489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f54004240 con 0x1b1deb0 2023-11-29T11:12:58.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f3cff9700 1 -- 172.21.15.81:0/2319515489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f54003d70 con 0x1b1deb0 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 10 client.4431 fetch_fsmap learned FSMap version 7 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 -- 172.21.15.81:0/2319515489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1ca2a20 con 0x1b1deb0 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f3cff9700 1 -- 172.21.15.81:0/2319515489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f54004240 con 0x1b1deb0 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f3cff9700 1 -- 172.21.15.81:0/2319515489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0f54035070 con 0x1b1deb0 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 10 client.4431 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 20 client.4431 populate_metadata read hostname 'smithi081' 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x1b68790 0x1deb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 4 client.4431 mds_command: new command op to 4278 tid=0[{"prefix": "status"}] 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 -- 172.21.15.81:0/2319515489 --> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1b9a260 con 0x1b68790 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f61a00700 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x1b68790 0x1deb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f3cff9700 10 client.4431 ms_handle_connect on v2:172.21.15.81:6836/3562625855 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f61a00700 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x1b68790 0x1deb470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0ccf6025d24d4b5 server_cookie=5ae77e1c3c746d95 in_seq=0 out_seq=0 2023-11-29T11:12:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f3cff9700 1 -- 172.21.15.81:0/2319515489 <== mds.0 v2:172.21.15.81:6836/3562625855 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1b9a260 con 0x1b68790 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f3cff9700 10 client.4431 handle_command_reply: tid=0 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 client.4431 shutdown 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 -- 172.21.15.81:0/2319515489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1deb0 msgr2=0x1deaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1deb0 0x1deaf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0f54024000 tx=0x7f0f540047e0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 -- 172.21.15.81:0/2319515489 shutdown_connections 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x1b68790 0x1deb470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b1deb0 0x1deaf30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f3cff9700 0 client.4431 ms_handle_reset on v2:172.21.15.81:6836/3562625855 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b1dae0 0x1dea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 --2- 172.21.15.81:0/2319515489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b1d710 0x1e33b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 -- 172.21.15.81:0/2319515489 >> 172.21.15.81:0/2319515489 conn(0x1da5290 msgr2=0x1da57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 -- 172.21.15.81:0/2319515489 shutdown_connections 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 1 -- 172.21.15.81:0/2319515489 wait complete. 2023-11-29T11:12:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f66ee6740 20 client.4431 trim_cache size 0 max 16384 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4278, 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.3398357169999997, 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 26, 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 25, 2023-11-29T11:12:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.481588863000001 2023-11-29T11:12:58.679 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:12:58.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 -- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0f40064ee0 msgr2=0x7f0f40067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0f40064ee0 0x7f0f40067390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c1511a0 tx=0x7f0f4c008040 comp rx=0 tx=0).stop 2023-11-29T11:12:58.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 -- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 msgr2=0x7f0f5c1f1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c1f1cd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800cbd0 tx=0x7f0f5800cee0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 -- 172.21.15.81:0/2167355425 shutdown_connections 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0f40064ee0 0x7f0f40067390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5c158890 0x7f0f5c0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c0cbfa0 0x7f0f5c0c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 --2- 172.21.15.81:0/2167355425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c0c9590 0x7f0f5c1f1cd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.671+0000 7f0f63c64700 1 -- 172.21.15.81:0/2167355425 >> 172.21.15.81:0/2167355425 conn(0x7f0f5c0b0a90 msgr2=0x7f0f5c151fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.675+0000 7f0f63c64700 1 -- 172.21.15.81:0/2167355425 shutdown_connections 2023-11-29T11:12:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.675+0000 7f0f63c64700 1 -- 172.21.15.81:0/2167355425 wait complete. 2023-11-29T11:12:58.693 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-29T11:12:58.693 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-29T11:12:58.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:12:58.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd9e4700 1 Processor -- start 2023-11-29T11:12:58.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd9e4700 1 -- start start 2023-11-29T11:12:58.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd9e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 0x7f23d806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd9e4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f23d806ce00 0x7f23d80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd9e4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23d80b3820 0x7f23d80cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd9e4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d80b3cc0 con 0x7f23d80b3820 2023-11-29T11:12:58.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd9e4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d806b0c0 con 0x7f23d806ce00 2023-11-29T11:12:58.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd9e4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d815a2d0 con 0x7f23d8159f00 2023-11-29T11:12:58.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23d80b3820 0x7f23d80cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23d80b3820 0x7f23d80cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45610/0 (socket says 172.21.15.81:45610) 2023-11-29T11:12:58.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 -- 172.21.15.81:0/3919807158 learned_addr learned my addr 172.21.15.81:0/3919807158 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:58.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23d7fff700 1 --2- 172.21.15.81:0/3919807158 >> v2:172.21.15.176:3300/0 conn(0x7f23d806ce00 0x7f23d80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dc9e2700 1 --2- 172.21.15.81:0/3919807158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 0x7f23d806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 -- 172.21.15.81:0/3919807158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 msgr2=0x7f23d806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 --2- 172.21.15.81:0/3919807158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 0x7f23d806c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 -- 172.21.15.81:0/3919807158 >> v2:172.21.15.176:3300/0 conn(0x7f23d806ce00 msgr2=0x7f23d80b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:12:58.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 --2- 172.21.15.81:0/3919807158 >> v2:172.21.15.176:3300/0 conn(0x7f23d806ce00 0x7f23d80b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 -- 172.21.15.81:0/3919807158 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d806a020 con 0x7f23d80b3820 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23dd1e3700 1 --2- 172.21.15.81:0/3919807158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d80cad60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23d80cbea0 tx=0x7f23d0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05073b6a27b9ee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23d77fe700 1 -- 172.21.15.81:0/3919807158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0011830 con 0x7f23d80b3820 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23d77fe700 1 -- 172.21.15.81:0/3919807158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0011990 con 0x7f23d80b3820 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.803+0000 7f23d77fe700 1 -- 172.21.15.81:0/3919807158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0011d40 con 0x7f23d80b3820 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- 172.21.15.81:0/3919807158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 msgr2=0x7f23d80cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/3919807158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d80cad60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23d80cbea0 tx=0x7f23d0009c20 comp rx=0 tx=0).stop 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- 172.21.15.81:0/3919807158 shutdown_connections 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/3919807158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d80cad60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/3919807158 >> v2:172.21.15.176:3300/0 conn(0x7f23d806ce00 0x7f23d80b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/3919807158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 0x7f23d806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- 172.21.15.81:0/3919807158 >> 172.21.15.81:0/3919807158 conn(0x7f23d80ce3e0 msgr2=0x7f23d80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- 172.21.15.81:0/3919807158 shutdown_connections 2023-11-29T11:12:58.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- 172.21.15.81:0/3919807158 wait complete. 2023-11-29T11:12:58.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 Processor -- start 2023-11-29T11:12:58.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- start start 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d806ce00 0x7f23d815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d81f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 0x7f23d81f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d815d3d0 con 0x7f23d80b3820 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d81f60d0 con 0x7f23d806ce00 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd9e4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80c35f0 con 0x7f23d8159f00 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d81f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d81f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45622/0 (socket says 172.21.15.81:45622) 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23d7fff700 1 -- 172.21.15.81:0/1016409087 learned_addr learned my addr 172.21.15.81:0/1016409087 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dc9e2700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d806ce00 0x7f23d815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.807+0000 7f23dd1e3700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 0x7f23d81f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d7fff700 1 -- 172.21.15.81:0/1016409087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 msgr2=0x7f23d81f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d7fff700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 0x7f23d81f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d7fff700 1 -- 172.21.15.81:0/1016409087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d806ce00 msgr2=0x7f23d815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d7fff700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d806ce00 0x7f23d815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d7fff700 1 -- 172.21.15.81:0/1016409087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0009570 con 0x7f23d80b3820 2023-11-29T11:12:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d7fff700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d81f5b90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009d10 tx=0x7f23c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d57fa700 1 -- 172.21.15.81:0/1016409087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c800cdc0 con 0x7f23d80b3820 2023-11-29T11:12:58.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d57fa700 1 -- 172.21.15.81:0/1016409087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c800f040 con 0x7f23d80b3820 2023-11-29T11:12:58.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d806a5e0 con 0x7f23d80b3820 2023-11-29T11:12:58.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23d57fa700 1 -- 172.21.15.81:0/1016409087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80146a0 con 0x7f23d80b3820 2023-11-29T11:12:58.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d806a300 con 0x7f23d80b3820 2023-11-29T11:12:58.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.811+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d806a8a0 con 0x7f23d80b3820 2023-11-29T11:12:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.815+0000 7f23d57fa700 1 -- 172.21.15.81:0/1016409087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f23c8014800 con 0x7f23d80b3820 2023-11-29T11:12:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.815+0000 7f23d57fa700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23c0064ee0 0x7f23c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:12:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.815+0000 7f23d57fa700 1 -- 172.21.15.81:0/1016409087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23c8082c30 con 0x7f23d80b3820 2023-11-29T11:12:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.815+0000 7f23dc9e2700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23c0064ee0 0x7f23c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:12:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.815+0000 7f23dc9e2700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23c0064ee0 0x7f23c0067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009980 tx=0x7f23c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:12:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:58.823+0000 7f23d57fa700 1 -- 172.21.15.81:0/1016409087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23c80509f0 con 0x7f23d80b3820 2023-11-29T11:12:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.019+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f23d8072500 con 0x7f23d80b3820 2023-11-29T11:12:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.019+0000 7f23d57fa700 1 -- 172.21.15.81:0/1016409087 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f23c8009e60 con 0x7f23d80b3820 2023-11-29T11:12:59.023 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-29T11:12:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23c0064ee0 msgr2=0x7f23c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23c0064ee0 0x7f23c0067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009980 tx=0x7f23c4008040 comp rx=0 tx=0).stop 2023-11-29T11:12:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 msgr2=0x7f23d81f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:12:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d81f5b90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009d10 tx=0x7f23c800c3a0 comp rx=0 tx=0).stop 2023-11-29T11:12:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 shutdown_connections 2023-11-29T11:12:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23c0064ee0 0x7f23c0067390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23d8159f00 0x7f23d81f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23d80b3820 0x7f23d81f5b90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 --2- 172.21.15.81:0/1016409087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23d806ce00 0x7f23d815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:12:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 >> 172.21.15.81:0/1016409087 conn(0x7f23d80ce3e0 msgr2=0x7f23d8159330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:12:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 shutdown_connections 2023-11-29T11:12:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:12:59.023+0000 7f23dd9e4700 1 -- 172.21.15.81:0/1016409087 wait complete. 2023-11-29T11:12:59.037 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-29T11:12:59.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:12:59.037 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:12:59.037 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-29T11:12:59.037 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-29T11:12:59.037 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-29T11:12:59.037 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-29T11:12:59.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:12:59.038 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-29T11:12:59.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.038 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:12:59.046 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42587sec preferred_lft 42587sec 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:12:59.047 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:12:59.048 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-29T11:12:59.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.048 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:12:59.048 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:12:59.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-11-29T11:12:59.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-11-29T11:12:59.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-11-29T11:12:59.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-29T11:12:59.049 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:12:59.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.093 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:12:59.104 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:12:59.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.105 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:12:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:12:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:12:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:12:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:12:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:12:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:12:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:12:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:12:59.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.137 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:12:59.137 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:12:59.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:12:59.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:12:59.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:12:59.137 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:12:59.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.223 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:12:59.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.230 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-11-29T11:12:59.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.235 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:12:59.236 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:12:59.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-29T11:12:59.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-29T11:12:59.236 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:12:59.265 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-29T11:12:59.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.266 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:12:59.266 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:12:59.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-29T11:12:59.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-29T11:12:59.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-29T11:12:59.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-29T11:12:59.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-29T11:12:59.266 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:12:59.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.376 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:12:59.376 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:12:59.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:12:59.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-11-29T11:12:59.376 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:12:59.402 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-29T11:12:59.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:12:59.403 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-29T11:12:59.409 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-29T11:12:59.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:12:59.409 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-29T11:12:59.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:12:59.425 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:12:59.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:12:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:12:59.437 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:12:59.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.437 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:12:59.444 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:12:59.444 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2023-11-29T11:12:59.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:12:59.504 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:12:59.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:12:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:12:59.513 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:12:59.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:12:59.514 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:12:59.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2023-11-29T11:12:59.575+0000 7fef19302640 -1 init, newargv = 0x5584653dee00 newargc=15 2023-11-29T11:12:59.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[42964]: starting ceph client 2023-11-29T11:12:59.590 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[42964]: starting fuse 2023-11-29T11:13:00.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:13:00.681 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:00.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:00.696 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:00.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:00.696 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:13:00.702 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:13:00.702 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:13:00.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:13:00.702 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:13:00.702 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:13:00.702 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:13:00.702 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:13:00.702 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:13:00.703 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:13:00.704 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:13:00.704 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:13:00.704 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:00.704 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2023-11-29T11:13:00.704 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:13:00.826 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.42964.asok 2023-11-29T11:13:01.011 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42964.asok 2023-11-29T11:13:01.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:01.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42964.asok status 2023-11-29T11:13:01.114 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:13:01.114 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:13:01.114 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:13:01.114 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:13:01.114 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2023-11-29T11:13:01.114 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "42964", 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4440, 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4440 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:13:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2295841840 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2295841840 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4440 192.168.0.1:0/2295841840", 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2295841840", 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 7, 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 26, 2023-11-29T11:13:01.116 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:13:01.117 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:13:01.117 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:13:01.117 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:13:01.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:01.124 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:13:01.124 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-29T11:13:01.130 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:13:01.130 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-29T11:13:01.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:01.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-29T11:13:01.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:01.189 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-29T11:13:01.239 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2023-11-29T11:13:01.239 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-29T11:13:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:01.240 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:13:01.240 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:01.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5acad54700 1 Processor -- start 2023-11-29T11:13:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5acad54700 1 -- start start 2023-11-29T11:13:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5acad54700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ac41607b0 0x7f5ac40cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5acad54700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac40cc430 0x7f5ac40ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5acad54700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac415c520 con 0x7f5ac415c150 2023-11-29T11:13:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5acad54700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40ca680 con 0x7f5ac41607b0 2023-11-29T11:13:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5acad54700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40ca960 con 0x7f5ac40cc430 2023-11-29T11:13:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac9d52700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ac415c150 0x7f5ac40c9e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38830/0 (socket says 172.21.15.81:38830) 2023-11-29T11:13:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac9d52700 1 -- 172.21.15.81:0/1642804668 learned_addr learned my addr 172.21.15.81:0/1642804668 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac9551700 1 --2- 172.21.15.81:0/1642804668 >> v2:172.21.15.81:3300/0 conn(0x7f5ac41607b0 0x7f5ac40cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5aca553700 1 --2- 172.21.15.81:0/1642804668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac40cc430 0x7f5ac40ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac8d50700 1 -- 172.21.15.81:0/1642804668 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150879996 0 0) 0x7f5ac415c520 con 0x7f5ac415c150 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac8d50700 1 -- 172.21.15.81:0/1642804668 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab00035d0 con 0x7f5ac415c150 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac9551700 1 -- 172.21.15.81:0/1642804668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac40cc430 msgr2=0x7f5ac40ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac9551700 1 --2- 172.21.15.81:0/1642804668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac40cc430 0x7f5ac40ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac9551700 1 -- 172.21.15.81:0/1642804668 >> v1:172.21.15.81:6789/0 conn(0x7f5ac415c150 legacy=0x7f5ac40c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac9551700 1 -- 172.21.15.81:0/1642804668 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40cd840 con 0x7f5ac41607b0 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.362+0000 7f5ac9551700 1 --2- 172.21.15.81:0/1642804668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac41607b0 0x7f5ac40cbef0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009850 tx=0x7f5ab8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f48d94e9248231 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5ac8d50700 1 -- 172.21.15.81:0/1642804668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8011830 con 0x7f5ac41607b0 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5ac8d50700 1 -- 172.21.15.81:0/1642804668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8011990 con 0x7f5ac41607b0 2023-11-29T11:13:01.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5ac8d50700 1 -- 172.21.15.81:0/1642804668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8011d00 con 0x7f5ac41607b0 2023-11-29T11:13:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 -- 172.21.15.81:0/1642804668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac41607b0 msgr2=0x7f5ac40cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 --2- 172.21.15.81:0/1642804668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac41607b0 0x7f5ac40cbef0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009850 tx=0x7f5ab8009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 -- 172.21.15.81:0/1642804668 shutdown_connections 2023-11-29T11:13:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 --2- 172.21.15.81:0/1642804668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac40cc430 0x7f5ac40ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 --2- 172.21.15.81:0/1642804668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac41607b0 0x7f5ac40cbef0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 -- 172.21.15.81:0/1642804668 >> 172.21.15.81:0/1642804668 conn(0x7f5ac406ec40 msgr2=0x7f5ac40b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 -- 172.21.15.81:0/1642804668 shutdown_connections 2023-11-29T11:13:01.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 -- 172.21.15.81:0/1642804668 wait complete. 2023-11-29T11:13:01.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 Processor -- start 2023-11-29T11:13:01.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.366+0000 7f5acad54700 1 -- start start 2023-11-29T11:13:01.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac40cc430 0x7f5ac40c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac415c150 0x7f5ac41f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac4157a30 0x7f5ac40c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac41f2970 con 0x7f5ac415c150 2023-11-29T11:13:01.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40c79d0 con 0x7f5ac40cc430 2023-11-29T11:13:01.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40c6dc0 con 0x7f5ac4157a30 2023-11-29T11:13:01.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac415c150 0x7f5ac41f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac415c150 0x7f5ac41f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51636/0 (socket says 172.21.15.81:51636) 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 -- 172.21.15.81:0/4153260570 learned_addr learned my addr 172.21.15.81:0/4153260570 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9d52700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac40cc430 0x7f5ac40c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5aca553700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac4157a30 0x7f5ac40c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 -- 172.21.15.81:0/4153260570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac4157a30 msgr2=0x7f5ac40c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac4157a30 0x7f5ac40c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 -- 172.21.15.81:0/4153260570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac40cc430 msgr2=0x7f5ac40c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac40cc430 0x7f5ac40c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 -- 172.21.15.81:0/4153260570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab80094b0 con 0x7f5ac415c150 2023-11-29T11:13:01.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ac9551700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac415c150 0x7f5ac41f2430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80090b0 tx=0x7f5ab8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:01.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ab67fc700 1 -- 172.21.15.81:0/4153260570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80044d0 con 0x7f5ac415c150 2023-11-29T11:13:01.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ab67fc700 1 -- 172.21.15.81:0/4153260570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab801f070 con 0x7f5ac415c150 2023-11-29T11:13:01.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac40cde00 con 0x7f5ac415c150 2023-11-29T11:13:01.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5ab67fc700 1 -- 172.21.15.81:0/4153260570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8003900 con 0x7f5ac415c150 2023-11-29T11:13:01.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac40cdb20 con 0x7f5ac415c150 2023-11-29T11:13:01.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.370+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac40cc8b0 con 0x7f5ac415c150 2023-11-29T11:13:01.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.374+0000 7f5ab67fc700 1 -- 172.21.15.81:0/4153260570 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ab800f050 con 0x7f5ac415c150 2023-11-29T11:13:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.374+0000 7f5ab67fc700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5aa8064ee0 0x7f5aa8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.374+0000 7f5ab67fc700 1 -- 172.21.15.81:0/4153260570 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ab8021070 con 0x7f5ac415c150 2023-11-29T11:13:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.374+0000 7f5ac9d52700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5aa8064ee0 0x7f5aa8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.374+0000 7f5ac9d52700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5aa8064ee0 0x7f5aa8067390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0005cb0 tx=0x7f5ac0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.382+0000 7f5ab67fc700 1 -- 172.21.15.81:0/4153260570 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ab8051710 con 0x7f5ac415c150 2023-11-29T11:13:01.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.546+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ac40727d0 con 0x7f5ac415c150 2023-11-29T11:13:01.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.550+0000 7f5ab67fc700 1 -- 172.21.15.81:0/4153260570 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f5ab8015090 con 0x7f5ac415c150 2023-11-29T11:13:01.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:01.556 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5aa8064ee0 msgr2=0x7f5aa8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5aa8064ee0 0x7f5aa8067390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0005cb0 tx=0x7f5ac0009040 comp rx=0 tx=0).stop 2023-11-29T11:13:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac415c150 msgr2=0x7f5ac41f2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac415c150 0x7f5ac41f2430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80090b0 tx=0x7f5ab8004770 comp rx=0 tx=0).stop 2023-11-29T11:13:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 shutdown_connections 2023-11-29T11:13:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5aa8064ee0 0x7f5aa8067390 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ac4157a30 0x7f5ac40c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ac415c150 0x7f5ac41f2430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 --2- 172.21.15.81:0/4153260570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ac40cc430 0x7f5ac40c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 >> 172.21.15.81:0/4153260570 conn(0x7f5ac406ec40 msgr2=0x7f5ac40b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 shutdown_connections 2023-11-29T11:13:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.554+0000 7f5acad54700 1 -- 172.21.15.81:0/4153260570 wait complete. 2023-11-29T11:13:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:01.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 Processor -- start 2023-11-29T11:13:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 -- start start 2023-11-29T11:13:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f32b406ce60 0x7f32b40d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32b40cf470 0x7f32b40cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b40cd300 con 0x7f32b40cce60 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b415c8b0 con 0x7f32b40cf470 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b406a7f0 con 0x7f32b406ce60 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32b40cf470 0x7f32b40cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32b40cf470 0x7f32b40cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51648/0 (socket says 172.21.15.81:51648) 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b2d9d700 1 -- 172.21.15.81:0/3042686431 learned_addr learned my addr 172.21.15.81:0/3042686431 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b259c700 1 --2- 172.21.15.81:0/3042686431 >> v2:172.21.15.176:3300/0 conn(0x7f32b406ce60 0x7f32b40d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b2d9d700 1 -- 172.21.15.81:0/3042686431 >> v2:172.21.15.176:3300/0 conn(0x7f32b406ce60 msgr2=0x7f32b40d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b2d9d700 1 --2- 172.21.15.81:0/3042686431 >> v2:172.21.15.176:3300/0 conn(0x7f32b406ce60 0x7f32b40d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b2d9d700 1 -- 172.21.15.81:0/3042686431 >> v1:172.21.15.81:6789/0 conn(0x7f32b40cce60 legacy=0x7f32b406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b2d9d700 1 -- 172.21.15.81:0/3042686431 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b406aad0 con 0x7f32b40cf470 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b259c700 1 --2- 172.21.15.81:0/3042686431 >> v2:172.21.15.176:3300/0 conn(0x7f32b406ce60 0x7f32b40d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b2d9d700 1 --2- 172.21.15.81:0/3042686431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40cf470 0x7f32b40cf8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009e50 tx=0x7f32ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d371579a1eb097b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:01.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b1d9b700 1 -- 172.21.15.81:0/3042686431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00e070 con 0x7f32b40cf470 2023-11-29T11:13:01.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b1d9b700 1 -- 172.21.15.81:0/3042686431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac00b980 con 0x7f32b40cf470 2023-11-29T11:13:01.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b1d9b700 1 -- 172.21.15.81:0/3042686431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00bd30 con 0x7f32b40cf470 2023-11-29T11:13:01.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 -- 172.21.15.81:0/3042686431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40cf470 msgr2=0x7f32b40cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.682+0000 7f32b359e700 1 --2- 172.21.15.81:0/3042686431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40cf470 0x7f32b40cf8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009e50 tx=0x7f32ac00b330 comp rx=0 tx=0).stop 2023-11-29T11:13:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 -- 172.21.15.81:0/3042686431 shutdown_connections 2023-11-29T11:13:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 --2- 172.21.15.81:0/3042686431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40cf470 0x7f32b40cf8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 --2- 172.21.15.81:0/3042686431 >> v2:172.21.15.176:3300/0 conn(0x7f32b406ce60 0x7f32b40d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 -- 172.21.15.81:0/3042686431 >> 172.21.15.81:0/3042686431 conn(0x7f32b40b5760 msgr2=0x7f32b40b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 -- 172.21.15.81:0/3042686431 shutdown_connections 2023-11-29T11:13:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 -- 172.21.15.81:0/3042686431 wait complete. 2023-11-29T11:13:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 Processor -- start 2023-11-29T11:13:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 -- start start 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b406ce60 0x7f32b40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32b40cce60 0x7f32b41f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32b40cf470 0x7f32b4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b40c9a80 con 0x7f32b406ce60 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b415a4d0 con 0x7f32b40cf470 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b40b4940 con 0x7f32b40cce60 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b406ce60 0x7f32b40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b406ce60 0x7f32b40b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51664/0 (socket says 172.21.15.81:51664) 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b259c700 1 -- 172.21.15.81:0/3222468446 learned_addr learned my addr 172.21.15.81:0/3222468446 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32b2d9d700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32b40cf470 0x7f32b4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.686+0000 7f32a9d9b700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32b40cce60 0x7f32b41f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b259c700 1 -- 172.21.15.81:0/3222468446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32b40cce60 msgr2=0x7f32b41f16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b259c700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32b40cce60 0x7f32b41f16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b259c700 1 -- 172.21.15.81:0/3222468446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32b40cf470 msgr2=0x7f32b4159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b259c700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32b40cf470 0x7f32b4159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b259c700 1 -- 172.21.15.81:0/3222468446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac009b30 con 0x7f32b406ce60 2023-11-29T11:13:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b259c700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b406ce60 0x7f32b40b3090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f32a400e810 tx=0x7f32a400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32ab7fe700 1 -- 172.21.15.81:0/3222468446 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400c070 con 0x7f32b406ce60 2023-11-29T11:13:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32ab7fe700 1 -- 172.21.15.81:0/3222468446 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a4013610 con 0x7f32b406ce60 2023-11-29T11:13:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b406b090 con 0x7f32b406ce60 2023-11-29T11:13:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32ab7fe700 1 -- 172.21.15.81:0/3222468446 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40139a0 con 0x7f32b406ce60 2023-11-29T11:13:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b406adb0 con 0x7f32b406ce60 2023-11-29T11:13:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.690+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b40b6470 con 0x7f32b406ce60 2023-11-29T11:13:01.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.694+0000 7f32ab7fe700 1 -- 172.21.15.81:0/3222468446 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f32a4023070 con 0x7f32b406ce60 2023-11-29T11:13:01.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.694+0000 7f32ab7fe700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3294064ee0 0x7f3294067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:01.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.694+0000 7f32ab7fe700 1 -- 172.21.15.81:0/3222468446 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32a4081e80 con 0x7f32b406ce60 2023-11-29T11:13:01.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.694+0000 7f32a9d9b700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3294064ee0 0x7f3294067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:01.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.694+0000 7f32a9d9b700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3294064ee0 0x7f3294067390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32b41f5250 tx=0x7f329c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.702+0000 7f32ab7fe700 1 -- 172.21.15.81:0/3222468446 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f32a404fc50 con 0x7f32b406ce60 2023-11-29T11:13:01.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.862+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f32b40c9cf0 con 0x7f32b406ce60 2023-11-29T11:13:01.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.862+0000 7f32ab7fe700 1 -- 172.21.15.81:0/3222468446 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f32a4053270 con 0x7f32b406ce60 2023-11-29T11:13:01.866 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3294064ee0 msgr2=0x7f3294067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3294064ee0 0x7f3294067390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32b41f5250 tx=0x7f329c009040 comp rx=0 tx=0).stop 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b406ce60 msgr2=0x7f32b40b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b406ce60 0x7f32b40b3090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f32a400e810 tx=0x7f32a400eb20 comp rx=0 tx=0).stop 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 shutdown_connections 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3294064ee0 0x7f3294067390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32b40cf470 0x7f32b4159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32b40cce60 0x7f32b41f16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 --2- 172.21.15.81:0/3222468446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b406ce60 0x7f32b40b3090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 >> 172.21.15.81:0/3222468446 conn(0x7f32b40b5760 msgr2=0x7f32b415bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 shutdown_connections 2023-11-29T11:13:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.866+0000 7f32b359e700 1 -- 172.21.15.81:0/3222468446 wait complete. 2023-11-29T11:13:01.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.998+0000 7f7ad7fff700 1 Processor -- start 2023-11-29T11:13:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.998+0000 7f7ad7fff700 1 -- start start 2023-11-29T11:13:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.998+0000 7f7ad7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7ad80cf7f0 0x7f7ad806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:01.998+0000 7f7ad7fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad806a9c0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad806aca0 con 0x7f7ad80b1ae0 2023-11-29T11:13:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad80d0ab0 con 0x7f7ad80cf7f0 2023-11-29T11:13:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad67fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ad806a4c0 0x7f7ad80cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38840/0 (socket says 172.21.15.81:38840) 2023-11-29T11:13:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad67fc700 1 -- 172.21.15.81:0/3959891787 learned_addr learned my addr 172.21.15.81:0/3959891787 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad77fe700 1 --2- 172.21.15.81:0/3959891787 >> v2:172.21.15.176:3300/0 conn(0x7f7ad80cf7f0 0x7f7ad806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad5ffb700 1 -- 172.21.15.81:0/3959891787 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422572499 0 0) 0x7f7ad806a9c0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad5ffb700 1 -- 172.21.15.81:0/3959891787 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ac40035d0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad77fe700 1 -- 172.21.15.81:0/3959891787 >> v1:172.21.15.176:6789/0 conn(0x7f7ad80b1ae0 legacy=0x7f7ad80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad77fe700 1 -- 172.21.15.81:0/3959891787 >> v1:172.21.15.81:6789/0 conn(0x7f7ad806a4c0 legacy=0x7f7ad80cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad77fe700 1 -- 172.21.15.81:0/3959891787 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad806af80 con 0x7f7ad80cf7f0 2023-11-29T11:13:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad77fe700 1 --2- 172.21.15.81:0/3959891787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80cf7f0 0x7f7ad806d8e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009d90 tx=0x7f7ad000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e14216bfeee5ae9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad5ffb700 1 -- 172.21.15.81:0/3959891787 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000e070 con 0x7f7ad80cf7f0 2023-11-29T11:13:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad5ffb700 1 -- 172.21.15.81:0/3959891787 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad000bb20 con 0x7f7ad80cf7f0 2023-11-29T11:13:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad5ffb700 1 -- 172.21.15.81:0/3959891787 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000be90 con 0x7f7ad80cf7f0 2023-11-29T11:13:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 -- 172.21.15.81:0/3959891787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80cf7f0 msgr2=0x7f7ad806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 --2- 172.21.15.81:0/3959891787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80cf7f0 0x7f7ad806d8e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009d90 tx=0x7f7ad000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 -- 172.21.15.81:0/3959891787 shutdown_connections 2023-11-29T11:13:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 --2- 172.21.15.81:0/3959891787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80cf7f0 0x7f7ad806d8e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 -- 172.21.15.81:0/3959891787 >> 172.21.15.81:0/3959891787 conn(0x7f7ad809bbd0 msgr2=0x7f7ad80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:02.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 -- 172.21.15.81:0/3959891787 shutdown_connections 2023-11-29T11:13:02.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.002+0000 7f7ad7fff700 1 -- 172.21.15.81:0/3959891787 wait complete. 2023-11-29T11:13:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 Processor -- start 2023-11-29T11:13:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 -- start start 2023-11-29T11:13:02.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad806a4c0 0x7f7ad80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80b1ae0 0x7f7ad8152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad80cf7f0 0x7f7ad80b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad815c970 con 0x7f7ad806a4c0 2023-11-29T11:13:02.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad80c6690 con 0x7f7ad80b1ae0 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad81529a0 con 0x7f7ad80cf7f0 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad806a4c0 0x7f7ad80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad806a4c0 0x7f7ad80c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51672/0 (socket says 172.21.15.81:51672) 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 -- 172.21.15.81:0/2710000554 learned_addr learned my addr 172.21.15.81:0/2710000554 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad67fc700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80b1ae0 0x7f7ad8152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad77fe700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad80cf7f0 0x7f7ad80b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 -- 172.21.15.81:0/2710000554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad80cf7f0 msgr2=0x7f7ad80b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad80cf7f0 0x7f7ad80b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 -- 172.21.15.81:0/2710000554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80b1ae0 msgr2=0x7f7ad8152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80b1ae0 0x7f7ad8152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 -- 172.21.15.81:0/2710000554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad0009a70 con 0x7f7ad806a4c0 2023-11-29T11:13:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad6ffd700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad806a4c0 0x7f7ad80c6150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000c500 tx=0x7f7ac000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7acf7fe700 1 -- 172.21.15.81:0/2710000554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00052d0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7acf7fe700 1 -- 172.21.15.81:0/2710000554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac0005430 con 0x7f7ad806a4c0 2023-11-29T11:13:02.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7acf7fe700 1 -- 172.21.15.81:0/2710000554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00055a0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad80b1eb0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.006+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad80b4380 con 0x7f7ad806a4c0 2023-11-29T11:13:02.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.010+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad80b60e0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.010+0000 7f7acf7fe700 1 -- 172.21.15.81:0/2710000554 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7ac0019030 con 0x7f7ad806a4c0 2023-11-29T11:13:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.010+0000 7f7acf7fe700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ab8064ee0 0x7f7ab8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.010+0000 7f7acf7fe700 1 -- 172.21.15.81:0/2710000554 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ac00813c0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.010+0000 7f7ad67fc700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ab8064ee0 0x7f7ab8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.010+0000 7f7ad67fc700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ab8064ee0 0x7f7ab8067390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80d1dc0 tx=0x7f7ac8007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.018+0000 7f7acf7fe700 1 -- 172.21.15.81:0/2710000554 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7ac004f270 con 0x7f7ad806a4c0 2023-11-29T11:13:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.178+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ad815c6d0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.178+0000 7f7acf7fe700 1 -- 172.21.15.81:0/2710000554 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ad815c6d0 con 0x7f7ad806a4c0 2023-11-29T11:13:02.183 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ab8064ee0 msgr2=0x7f7ab8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ab8064ee0 0x7f7ab8067390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80d1dc0 tx=0x7f7ac8007de0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad806a4c0 msgr2=0x7f7ad80c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad806a4c0 0x7f7ad80c6150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000c500 tx=0x7f7ac000c810 comp rx=0 tx=0).stop 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 shutdown_connections 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ab8064ee0 0x7f7ab8067390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ad80cf7f0 0x7f7ad80b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ad80b1ae0 0x7f7ad8152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 --2- 172.21.15.81:0/2710000554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad806a4c0 0x7f7ad80c6150 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 >> 172.21.15.81:0/2710000554 conn(0x7f7ad809bbd0 msgr2=0x7f7ad80d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 shutdown_connections 2023-11-29T11:13:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.182+0000 7f7ad7fff700 1 -- 172.21.15.81:0/2710000554 wait complete. 2023-11-29T11:13:02.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb314f78700 1 Processor -- start 2023-11-29T11:13:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb314f78700 1 -- start start 2023-11-29T11:13:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb314f78700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3100b00e0 0x7fb31015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb314f78700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb31009bdb0 0x7fb31015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb314f78700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100b2db0 con 0x7fb3100cbb30 2023-11-29T11:13:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb314f78700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3100b3240 con 0x7fb3100b00e0 2023-11-29T11:13:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb314f78700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31006d840 con 0x7fb31009bdb0 2023-11-29T11:13:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3100b00e0 0x7fb31015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3100b00e0 0x7fb31015d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51686/0 (socket says 172.21.15.81:51686) 2023-11-29T11:13:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30f7fe700 1 -- 172.21.15.81:0/4272238319 learned_addr learned my addr 172.21.15.81:0/4272238319 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:02.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30effd700 1 --2- 172.21.15.81:0/4272238319 >> v2:172.21.15.176:3300/0 conn(0x7fb31009bdb0 0x7fb31015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30f7fe700 1 -- 172.21.15.81:0/4272238319 >> v2:172.21.15.176:3300/0 conn(0x7fb31009bdb0 msgr2=0x7fb31015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30f7fe700 1 --2- 172.21.15.81:0/4272238319 >> v2:172.21.15.176:3300/0 conn(0x7fb31009bdb0 0x7fb31015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30f7fe700 1 -- 172.21.15.81:0/4272238319 >> v1:172.21.15.176:6789/0 conn(0x7fb3100cbb30 legacy=0x7fb3100ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30f7fe700 1 -- 172.21.15.81:0/4272238319 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31006d560 con 0x7fb3100b00e0 2023-11-29T11:13:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30f7fe700 1 --2- 172.21.15.81:0/4272238319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100b00e0 0x7fb31015d2e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb3100aca50 tx=0x7fb2f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a661de6a2d298fa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30e7fc700 1 -- 172.21.15.81:0/4272238319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8011830 con 0x7fb3100b00e0 2023-11-29T11:13:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30e7fc700 1 -- 172.21.15.81:0/4272238319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f8011990 con 0x7fb3100b00e0 2023-11-29T11:13:02.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.314+0000 7fb30e7fc700 1 -- 172.21.15.81:0/4272238319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8011d20 con 0x7fb3100b00e0 2023-11-29T11:13:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 -- 172.21.15.81:0/4272238319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100b00e0 msgr2=0x7fb31015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 --2- 172.21.15.81:0/4272238319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100b00e0 0x7fb31015d2e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb3100aca50 tx=0x7fb2f8009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 -- 172.21.15.81:0/4272238319 shutdown_connections 2023-11-29T11:13:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 --2- 172.21.15.81:0/4272238319 >> v2:172.21.15.176:3300/0 conn(0x7fb31009bdb0 0x7fb31015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 --2- 172.21.15.81:0/4272238319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100b00e0 0x7fb31015d2e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 -- 172.21.15.81:0/4272238319 >> 172.21.15.81:0/4272238319 conn(0x7fb3100cae70 msgr2=0x7fb3100cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 -- 172.21.15.81:0/4272238319 shutdown_connections 2023-11-29T11:13:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 -- 172.21.15.81:0/4272238319 wait complete. 2023-11-29T11:13:02.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 Processor -- start 2023-11-29T11:13:02.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.318+0000 7fb314f78700 1 -- start start 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb31009bdb0 0x7fb310153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3100b00e0 0x7fb31015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100cbb30 0x7fb310159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310154590 con 0x7fb3100cbb30 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31015da60 con 0x7fb31009bdb0 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31015dd40 con 0x7fb3100b00e0 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100cbb30 0x7fb310159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100cbb30 0x7fb310159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51690/0 (socket says 172.21.15.81:51690) 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 -- 172.21.15.81:0/3172090122 learned_addr learned my addr 172.21.15.81:0/3172090122 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30effd700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3100b00e0 0x7fb31015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30f7fe700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb31009bdb0 0x7fb310153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 -- 172.21.15.81:0/3172090122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3100b00e0 msgr2=0x7fb31015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3100b00e0 0x7fb31015eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 -- 172.21.15.81:0/3172090122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb31009bdb0 msgr2=0x7fb310153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb31009bdb0 0x7fb310153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 -- 172.21.15.81:0/3172090122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009570 con 0x7fb3100cbb30 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb30ffff700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100cbb30 0x7fb310159f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb30800cb50 tx=0x7fb30800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb307fff700 1 -- 172.21.15.81:0/3172090122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308003c20 con 0x7fb3100cbb30 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb307fff700 1 -- 172.21.15.81:0/3172090122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb308003d80 con 0x7fb3100cbb30 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3100ac3d0 con 0x7fb3100cbb30 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb307fff700 1 -- 172.21.15.81:0/3172090122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30800aac0 con 0x7fb3100cbb30 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3100ac0f0 con 0x7fb3100cbb30 2023-11-29T11:13:02.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31006cbe0 con 0x7fb3100cbb30 2023-11-29T11:13:02.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.322+0000 7fb307fff700 1 -- 172.21.15.81:0/3172090122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb308010050 con 0x7fb3100cbb30 2023-11-29T11:13:02.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.326+0000 7fb307fff700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2f0064ee0 0x7fb2f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.326+0000 7fb307fff700 1 -- 172.21.15.81:0/3172090122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb3080820e0 con 0x7fb3100cbb30 2023-11-29T11:13:02.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.326+0000 7fb30f7fe700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2f0064ee0 0x7fb2f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.326+0000 7fb30f7fe700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2f0064ee0 0x7fb2f0067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009c30 tx=0x7fb2f8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.330+0000 7fb307fff700 1 -- 172.21.15.81:0/3172090122 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb30804fea0 con 0x7fb3100cbb30 2023-11-29T11:13:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.490+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb310072550 con 0x7fb3100cbb30 2023-11-29T11:13:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.490+0000 7fb307fff700 1 -- 172.21.15.81:0/3172090122 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3080534c0 con 0x7fb3100cbb30 2023-11-29T11:13:02.496 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2f0064ee0 msgr2=0x7fb2f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2f0064ee0 0x7fb2f0067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009c30 tx=0x7fb2f8008030 comp rx=0 tx=0).stop 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100cbb30 msgr2=0x7fb310159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100cbb30 0x7fb310159f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb30800cb50 tx=0x7fb30800ce60 comp rx=0 tx=0).stop 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 shutdown_connections 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2f0064ee0 0x7fb2f0067390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3100cbb30 0x7fb310159f20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3100b00e0 0x7fb31015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 --2- 172.21.15.81:0/3172090122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb31009bdb0 0x7fb310153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 >> 172.21.15.81:0/3172090122 conn(0x7fb3100cae70 msgr2=0x7fb3100b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 shutdown_connections 2023-11-29T11:13:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.494+0000 7fb314f78700 1 -- 172.21.15.81:0/3172090122 wait complete. 2023-11-29T11:13:02.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.618+0000 7f6d8b59e700 1 Processor -- start 2023-11-29T11:13:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.618+0000 7f6d8b59e700 1 -- start start 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d8c0cbb30 0x7f6d8c1645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8c0b2db0 con 0x7f6d8c0b00e0 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8c15e100 con 0x7f6d8c09bdb0 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c0b3240 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d8c0cbb30 0x7f6d8c1645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d8c0cbb30 0x7f6d8c1645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51700/0 (socket says 172.21.15.81:51700) 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8ad9d700 1 -- 172.21.15.81:0/571173841 learned_addr learned my addr 172.21.15.81:0/571173841 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6d8c0b00e0 0x7f6d8c15d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38844/0 (socket says 172.21.15.81:38844) 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8ad9d700 1 -- 172.21.15.81:0/571173841 >> v1:172.21.15.176:6789/0 conn(0x7f6d8c09bdb0 legacy=0x7f6d8c15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8ad9d700 1 -- 172.21.15.81:0/571173841 >> v1:172.21.15.81:6789/0 conn(0x7f6d8c0b00e0 legacy=0x7f6d8c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8ad9d700 1 -- 172.21.15.81:0/571173841 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c06d840 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8ad9d700 1 --2- 172.21.15.81:0/571173841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c1645a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009e50 tx=0x7f6d8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f657c870224bec server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d89d9b700 1 -- 172.21.15.81:0/571173841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400e070 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d89d9b700 1 -- 172.21.15.81:0/571173841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d84003a40 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d89d9b700 1 -- 172.21.15.81:0/571173841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84003df0 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 -- 172.21.15.81:0/571173841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 msgr2=0x7f6d8c1645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 --2- 172.21.15.81:0/571173841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c1645a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009e50 tx=0x7f6d8400b330 comp rx=0 tx=0).stop 2023-11-29T11:13:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 -- 172.21.15.81:0/571173841 shutdown_connections 2023-11-29T11:13:02.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 --2- 172.21.15.81:0/571173841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c1645a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 -- 172.21.15.81:0/571173841 >> 172.21.15.81:0/571173841 conn(0x7f6d8c0cae70 msgr2=0x7f6d8c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 -- 172.21.15.81:0/571173841 shutdown_connections 2023-11-29T11:13:02.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.622+0000 7f6d8b59e700 1 -- 172.21.15.81:0/571173841 wait complete. 2023-11-29T11:13:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8b59e700 1 Processor -- start 2023-11-29T11:13:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8b59e700 1 -- start start 2023-11-29T11:13:02.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c09bdb0 0x7f6d8c14cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b00e0 0x7f6d8c09a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c0989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c099830 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c099550 con 0x7f6d8c0b00e0 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c099d30 con 0x7f6d8c09bdb0 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c0989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c0989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51708/0 (socket says 172.21.15.81:51708) 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8ad9d700 1 -- 172.21.15.81:0/1758575131 learned_addr learned my addr 172.21.15.81:0/1758575131 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.626+0000 7f6d8a59c700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c09bdb0 0x7f6d8c14cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d83fff700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b00e0 0x7f6d8c09a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8ad9d700 1 -- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c09bdb0 msgr2=0x7f6d8c14cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8ad9d700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c09bdb0 0x7f6d8c14cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8ad9d700 1 -- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b00e0 msgr2=0x7f6d8c09a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8ad9d700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b00e0 0x7f6d8c09a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8ad9d700 1 -- 172.21.15.81:0/1758575131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84009b30 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d83fff700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b00e0 0x7f6d8c09a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8ad9d700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c0989e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c06f640 tx=0x7f6d84004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d82ffd700 1 -- 172.21.15.81:0/1758575131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84004440 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d82ffd700 1 -- 172.21.15.81:0/1758575131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d840045a0 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d82ffd700 1 -- 172.21.15.81:0/1758575131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84004950 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8c0ac0f0 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c06d560 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.630+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c0ac3d0 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.634+0000 7f6d82ffd700 1 -- 172.21.15.81:0/1758575131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6d8402c070 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.634+0000 7f6d82ffd700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d70064ee0 0x7f6d70067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.634+0000 7f6d82ffd700 1 -- 172.21.15.81:0/1758575131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6d84083480 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.634+0000 7f6d8a59c700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d70064ee0 0x7f6d70067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.634+0000 7f6d8a59c700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d70064ee0 0x7f6d70067390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c06c010 tx=0x7f6d74007f30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.638+0000 7f6d82ffd700 1 -- 172.21.15.81:0/1758575131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6d84051330 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.794+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d8c072500 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.794+0000 7f6d82ffd700 1 -- 172.21.15.81:0/1758575131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d84054950 con 0x7f6d8c0cbb30 2023-11-29T11:13:02.800 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:02.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d70064ee0 msgr2=0x7f6d70067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d70064ee0 0x7f6d70067390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c06c010 tx=0x7f6d74007f30 comp rx=0 tx=0).stop 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 msgr2=0x7f6d8c0989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c0989e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c06f640 tx=0x7f6d84004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 shutdown_connections 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d70064ee0 0x7f6d70067390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cbb30 0x7f6d8c0989e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b00e0 0x7f6d8c09a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 --2- 172.21.15.81:0/1758575131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c09bdb0 0x7f6d8c14cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 >> 172.21.15.81:0/1758575131 conn(0x7f6d8c0cae70 msgr2=0x7f6d8c155020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 shutdown_connections 2023-11-29T11:13:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.798+0000 7f6d8b59e700 1 -- 172.21.15.81:0/1758575131 wait complete. 2023-11-29T11:13:02.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 Processor -- start 2023-11-29T11:13:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- start start 2023-11-29T11:13:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9640ce230 0x7fc9640ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96406d1c0 con 0x7fc964158ee0 2023-11-29T11:13:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640ca3a0 con 0x7fc9640cd5d0 2023-11-29T11:13:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96406e000 con 0x7fc9640ce230 2023-11-29T11:13:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc9637fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9640ce230 0x7fc9640ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc963fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc964158ee0 0x7fc9640cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38846/0 (socket says 172.21.15.81:38846) 2023-11-29T11:13:02.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc963fff700 1 -- 172.21.15.81:0/1477136133 learned_addr learned my addr 172.21.15.81:0/1477136133 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc9637fe700 1 -- 172.21.15.81:0/1477136133 >> v1:172.21.15.176:6789/0 conn(0x7fc9640cd5d0 legacy=0x7fc9640cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc9637fe700 1 -- 172.21.15.81:0/1477136133 >> v1:172.21.15.81:6789/0 conn(0x7fc964158ee0 legacy=0x7fc9640cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc9637fe700 1 -- 172.21.15.81:0/1477136133 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96406c920 con 0x7fc9640ce230 2023-11-29T11:13:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc962ffd700 1 -- 172.21.15.81:0/1477136133 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654665628 0 0) 0x7fc954001110 con 0x7fc964158ee0 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc9637fe700 1 --2- 172.21.15.81:0/1477136133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9640ce230 0x7fc9640ae760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc958009840 tx=0x7fc958009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cbe735fa45346f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc962ffd700 1 -- 172.21.15.81:0/1477136133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958005e50 con 0x7fc9640ce230 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc962ffd700 1 -- 172.21.15.81:0/1477136133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958004030 con 0x7fc9640ce230 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc962ffd700 1 -- 172.21.15.81:0/1477136133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580043c0 con 0x7fc9640ce230 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- 172.21.15.81:0/1477136133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9640ce230 msgr2=0x7fc9640ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 --2- 172.21.15.81:0/1477136133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9640ce230 0x7fc9640ae760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc958009840 tx=0x7fc958009b50 comp rx=0 tx=0).stop 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- 172.21.15.81:0/1477136133 shutdown_connections 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 --2- 172.21.15.81:0/1477136133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9640ce230 0x7fc9640ae760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- 172.21.15.81:0/1477136133 >> 172.21.15.81:0/1477136133 conn(0x7fc9640d0240 msgr2=0x7fc9640cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- 172.21.15.81:0/1477136133 shutdown_connections 2023-11-29T11:13:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.934+0000 7fc969433700 1 -- 172.21.15.81:0/1477136133 wait complete. 2023-11-29T11:13:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 Processor -- start 2023-11-29T11:13:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 -- start start 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9640cd5d0 0x7fc9640b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9640ce230 0x7fc9640c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc964158ee0 0x7fc964151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640b2de0 con 0x7fc964158ee0 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640c75d0 con 0x7fc9640ce230 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640c3060 con 0x7fc9640cd5d0 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc964158ee0 0x7fc964151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc964158ee0 0x7fc964151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51720/0 (socket says 172.21.15.81:51720) 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 -- 172.21.15.81:0/2459592980 learned_addr learned my addr 172.21.15.81:0/2459592980 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc9637fe700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9640ce230 0x7fc9640c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc963fff700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9640cd5d0 0x7fc9640b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 -- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9640cd5d0 msgr2=0x7fc9640b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9640cd5d0 0x7fc9640b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 -- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9640ce230 msgr2=0x7fc9640c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9640ce230 0x7fc9640c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 -- 172.21.15.81:0/2459592980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009450 con 0x7fc964158ee0 2023-11-29T11:13:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc9637fe700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9640ce230 0x7fc9640c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc968c32700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc964158ee0 0x7fc964151be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00b970 tx=0x7fc95c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc960ff9700 1 -- 172.21.15.81:0/2459592980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00c9b0 con 0x7fc964158ee0 2023-11-29T11:13:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc960ff9700 1 -- 172.21.15.81:0/2459592980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00cb10 con 0x7fc964158ee0 2023-11-29T11:13:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96406cee0 con 0x7fc964158ee0 2023-11-29T11:13:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.938+0000 7fc960ff9700 1 -- 172.21.15.81:0/2459592980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c014440 con 0x7fc964158ee0 2023-11-29T11:13:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.942+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96406cc00 con 0x7fc964158ee0 2023-11-29T11:13:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.942+0000 7fc960ff9700 1 -- 172.21.15.81:0/2459592980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc95c01b030 con 0x7fc964158ee0 2023-11-29T11:13:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.942+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9640ca640 con 0x7fc964158ee0 2023-11-29T11:13:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.942+0000 7fc960ff9700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc950064f10 0x7fc9500673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.942+0000 7fc960ff9700 1 -- 172.21.15.81:0/2459592980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc95c081cd0 con 0x7fc964158ee0 2023-11-29T11:13:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.942+0000 7fc963fff700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc950064f10 0x7fc9500673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.942+0000 7fc963fff700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc950064f10 0x7fc9500673c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc954000f60 tx=0x7fc954007a60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:02.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:02.950+0000 7fc960ff9700 1 -- 172.21.15.81:0/2459592980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc95c04fb20 con 0x7fc964158ee0 2023-11-29T11:13:03.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.110+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc964072c20 con 0x7fc964158ee0 2023-11-29T11:13:03.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.110+0000 7fc960ff9700 1 -- 172.21.15.81:0/2459592980 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc95c053140 con 0x7fc964158ee0 2023-11-29T11:13:03.116 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc950064f10 msgr2=0x7fc9500673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc950064f10 0x7fc9500673c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc954000f60 tx=0x7fc954007a60 comp rx=0 tx=0).stop 2023-11-29T11:13:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc964158ee0 msgr2=0x7fc964151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc964158ee0 0x7fc964151be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00b970 tx=0x7fc95c00bd30 comp rx=0 tx=0).stop 2023-11-29T11:13:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 shutdown_connections 2023-11-29T11:13:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc950064f10 0x7fc9500673c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc964158ee0 0x7fc964151be0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9640ce230 0x7fc9640c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 --2- 172.21.15.81:0/2459592980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9640cd5d0 0x7fc9640b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 >> 172.21.15.81:0/2459592980 conn(0x7fc9640d0240 msgr2=0x7fc9640cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 shutdown_connections 2023-11-29T11:13:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.114+0000 7fc969433700 1 -- 172.21.15.81:0/2459592980 wait complete. 2023-11-29T11:13:03.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 Processor -- start 2023-11-29T11:13:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- start start 2023-11-29T11:13:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97181606b0 0x7f97180c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97180ad610 0x7f97180c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97180cae70 con 0x7f97180ceef0 2023-11-29T11:13:03.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97180cbc10 con 0x7f97180ad610 2023-11-29T11:13:03.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97180cb130 con 0x7f97181606b0 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f9717fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97180ad610 0x7f97180c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f9717fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97180ad610 0x7f97180c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58486/0 (socket says 172.21.15.81:58486) 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f9717fff700 1 -- 172.21.15.81:0/2656308741 learned_addr learned my addr 172.21.15.81:0/2656308741 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f97177fe700 1 --2- 172.21.15.81:0/2656308741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97181606b0 0x7f97180c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f9717fff700 1 -- 172.21.15.81:0/2656308741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97181606b0 msgr2=0x7f97180c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f9717fff700 1 --2- 172.21.15.81:0/2656308741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97181606b0 0x7f97180c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f9717fff700 1 -- 172.21.15.81:0/2656308741 >> v1:172.21.15.176:6789/0 conn(0x7f97180ceef0 legacy=0x7f9718164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f9717fff700 1 -- 172.21.15.81:0/2656308741 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180cb410 con 0x7f97180ad610 2023-11-29T11:13:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f9717fff700 1 --2- 172.21.15.81:0/2656308741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97180ad610 0x7f97180c18f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9710009910 tx=0x7f9710009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79e065fc0f0f341a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f97167fc700 1 -- 172.21.15.81:0/2656308741 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710011830 con 0x7f97180ad610 2023-11-29T11:13:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f97167fc700 1 -- 172.21.15.81:0/2656308741 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710011990 con 0x7f97180ad610 2023-11-29T11:13:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f97167fc700 1 -- 172.21.15.81:0/2656308741 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710011d40 con 0x7f97180ad610 2023-11-29T11:13:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- 172.21.15.81:0/2656308741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97180ad610 msgr2=0x7f97180c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 --2- 172.21.15.81:0/2656308741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97180ad610 0x7f97180c18f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9710009910 tx=0x7f9710009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- 172.21.15.81:0/2656308741 shutdown_connections 2023-11-29T11:13:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 --2- 172.21.15.81:0/2656308741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97180ad610 0x7f97180c18f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 --2- 172.21.15.81:0/2656308741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97181606b0 0x7f97180c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- 172.21.15.81:0/2656308741 >> 172.21.15.81:0/2656308741 conn(0x7f97180ce3e0 msgr2=0x7f97180ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- 172.21.15.81:0/2656308741 shutdown_connections 2023-11-29T11:13:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.242+0000 7f971cd34700 1 -- 172.21.15.81:0/2656308741 wait complete. 2023-11-29T11:13:03.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 Processor -- start 2023-11-29T11:13:03.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 -- start start 2023-11-29T11:13:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97180ad610 0x7f97180b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97180ceef0 0x7f971815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97181606b0 0x7f97181f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180ade40 con 0x7f97180ad610 2023-11-29T11:13:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971815df50 con 0x7f97181606b0 2023-11-29T11:13:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97180aee50 con 0x7f97180ceef0 2023-11-29T11:13:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97180ad610 0x7f97180b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97180ad610 0x7f97180b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51736/0 (socket says 172.21.15.81:51736) 2023-11-29T11:13:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 -- 172.21.15.81:0/3416287537 learned_addr learned my addr 172.21.15.81:0/3416287537 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f9716ffd700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97180ceef0 0x7f971815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f9717fff700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97181606b0 0x7f97181f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 -- 172.21.15.81:0/3416287537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97180ceef0 msgr2=0x7f971815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97180ceef0 0x7f971815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 -- 172.21.15.81:0/3416287537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97181606b0 msgr2=0x7f97181f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97181606b0 0x7f97181f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 -- 172.21.15.81:0/3416287537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710009570 con 0x7f97180ad610 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f97177fe700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97180ad610 0x7f97180b5f60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f970800efc0 tx=0x7f970800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f970ffff700 1 -- 172.21.15.81:0/3416287537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800cb50 con 0x7f97180ad610 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f970ffff700 1 -- 172.21.15.81:0/3416287537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800f040 con 0x7f97180ad610 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971806ac50 con 0x7f97180ad610 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f970ffff700 1 -- 172.21.15.81:0/3416287537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708014480 con 0x7f97180ad610 2023-11-29T11:13:03.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.246+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97180cb6f0 con 0x7f97180ad610 2023-11-29T11:13:03.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.250+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97180b3680 con 0x7f97180ad610 2023-11-29T11:13:03.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.250+0000 7f970ffff700 1 -- 172.21.15.81:0/3416287537 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f97080145e0 con 0x7f97180ad610 2023-11-29T11:13:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.250+0000 7f970ffff700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96f8064ee0 0x7f96f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.250+0000 7f9716ffd700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96f8064ee0 0x7f96f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.250+0000 7f970ffff700 1 -- 172.21.15.81:0/3416287537 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9708082a80 con 0x7f97180ad610 2023-11-29T11:13:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.250+0000 7f9716ffd700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96f8064ee0 0x7f96f8067390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f97180b64a0 tx=0x7f9700009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.258+0000 7f970ffff700 1 -- 172.21.15.81:0/3416287537 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9708050930 con 0x7f97180ad610 2023-11-29T11:13:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.434+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9718072500 con 0x7f97180ad610 2023-11-29T11:13:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f970ffff700 1 -- 172.21.15.81:0/3416287537 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9708053f50 con 0x7f97180ad610 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96f8064ee0 msgr2=0x7f96f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96f8064ee0 0x7f96f8067390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f97180b64a0 tx=0x7f9700009040 comp rx=0 tx=0).stop 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97180ad610 msgr2=0x7f97180b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97180ad610 0x7f97180b5f60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f970800efc0 tx=0x7f970800c0c0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 shutdown_connections 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96f8064ee0 0x7f96f8067390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97181606b0 0x7f97181f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97180ceef0 0x7f971815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 --2- 172.21.15.81:0/3416287537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97180ad610 0x7f97180b5f60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 >> 172.21.15.81:0/3416287537 conn(0x7f97180ce3e0 msgr2=0x7f971806bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 shutdown_connections 2023-11-29T11:13:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.438+0000 7f971cd34700 1 -- 172.21.15.81:0/3416287537 wait complete. 2023-11-29T11:13:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:03.455 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:13:03.455 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:03.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:03.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 Processor -- start 2023-11-29T11:13:03.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- start start 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea00160680 0x7fea00071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00069c40 0x7fea000cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fea000b0c30 0x7fea000cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea000cc420 con 0x7fea00160680 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea000cc6c0 con 0x7fea000b0c30 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000cc9a0 con 0x7fea00069c40 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea00160680 0x7fea00071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea00160680 0x7fea00071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51748/0 (socket says 172.21.15.81:51748) 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 -- 172.21.15.81:0/3013716195 learned_addr learned my addr 172.21.15.81:0/3013716195 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:03.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9fe7fc700 1 --2- 172.21.15.81:0/3013716195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00069c40 0x7fea000cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9ff7fe700 1 --2- 172.21.15.81:0/3013716195 >> v2:172.21.15.176:3300/0 conn(0x7fea000b0c30 0x7fea000cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 -- 172.21.15.81:0/3013716195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00069c40 msgr2=0x7fea000cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 --2- 172.21.15.81:0/3013716195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00069c40 0x7fea000cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 -- 172.21.15.81:0/3013716195 >> v2:172.21.15.176:3300/0 conn(0x7fea000b0c30 msgr2=0x7fea000cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 --2- 172.21.15.81:0/3013716195 >> v2:172.21.15.176:3300/0 conn(0x7fea000b0c30 0x7fea000cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 -- 172.21.15.81:0/3013716195 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000705c0 con 0x7fea00160680 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9ff7fe700 1 --2- 172.21.15.81:0/3013716195 >> v2:172.21.15.176:3300/0 conn(0x7fea000b0c30 0x7fea000cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9feffd700 1 --2- 172.21.15.81:0/3013716195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00160680 0x7fea00071260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fea000c8d90 tx=0x7fe9e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21775c48c0ba6c15 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9fdffb700 1 -- 172.21.15.81:0/3013716195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800b8a0 con 0x7fea00160680 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9fdffb700 1 -- 172.21.15.81:0/3013716195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e800ba00 con 0x7fea00160680 2023-11-29T11:13:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fe9fdffb700 1 -- 172.21.15.81:0/3013716195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800bd90 con 0x7fea00160680 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- 172.21.15.81:0/3013716195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00160680 msgr2=0x7fea00071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 --2- 172.21.15.81:0/3013716195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00160680 0x7fea00071260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fea000c8d90 tx=0x7fe9e8009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- 172.21.15.81:0/3013716195 shutdown_connections 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 --2- 172.21.15.81:0/3013716195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00069c40 0x7fea000cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 --2- 172.21.15.81:0/3013716195 >> v2:172.21.15.176:3300/0 conn(0x7fea000b0c30 0x7fea000cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 --2- 172.21.15.81:0/3013716195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea00160680 0x7fea00071260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- 172.21.15.81:0/3013716195 >> 172.21.15.81:0/3013716195 conn(0x7fea0006caf0 msgr2=0x7fea000ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- 172.21.15.81:0/3013716195 shutdown_connections 2023-11-29T11:13:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.614+0000 7fea05394700 1 -- 172.21.15.81:0/3013716195 wait complete. 2023-11-29T11:13:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fea05394700 1 Processor -- start 2023-11-29T11:13:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fea05394700 1 -- start start 2023-11-29T11:13:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fea05394700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea00069c40 0x7fea00153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fea05394700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea000b0c30 0x7fea00163710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fea05394700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00160680 0x7fea001f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fea05394700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea00161740 con 0x7fea000b0c30 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fea05394700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea00161c40 con 0x7fea00069c40 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fea05394700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000c5e40 con 0x7fea00160680 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea000b0c30 0x7fea00163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9feffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea00069c40 0x7fea00153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9ff7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00160680 0x7fea001f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea000b0c30 0x7fea00163710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51752/0 (socket says 172.21.15.81:51752) 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9ff7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00160680 0x7fea001f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:33536/0 (socket says 172.21.15.81:33536) 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9feffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea00069c40 0x7fea00153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58510/0 (socket says 172.21.15.81:58510) 2023-11-29T11:13:03.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/2562559507 learned_addr learned my addr 172.21.15.81:0/2562559507 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:03.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/2562559507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00160680 msgr2=0x7fea001f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9fe7fc700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00160680 0x7fea001f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/2562559507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea00069c40 msgr2=0x7fea00153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9fe7fc700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea00069c40 0x7fea00153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.618+0000 7fe9fe7fc700 1 -- 172.21.15.81:0/2562559507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8009570 con 0x7fea000b0c30 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.622+0000 7fe9fe7fc700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea000b0c30 0x7fea00163710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8007e40 tx=0x7fe9f800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.622+0000 7fe9f77fe700 1 -- 172.21.15.81:0/2562559507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800ed30 con 0x7fea000b0c30 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.622+0000 7fe9f77fe700 1 -- 172.21.15.81:0/2562559507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8014420 con 0x7fea000b0c30 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.622+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea000c9750 con 0x7fea000b0c30 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.622+0000 7fe9f77fe700 1 -- 172.21.15.81:0/2562559507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80147d0 con 0x7fea000b0c30 2023-11-29T11:13:03.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.622+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea00071940 con 0x7fea000b0c30 2023-11-29T11:13:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.622+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea00160a50 con 0x7fea000b0c30 2023-11-29T11:13:03.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.622+0000 7fe9f77fe700 1 -- 172.21.15.81:0/2562559507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe9f8012050 con 0x7fea000b0c30 2023-11-29T11:13:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.626+0000 7fe9f77fe700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9e0064ee0 0x7fe9e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.626+0000 7fe9feffd700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9e0064ee0 0x7fe9e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.626+0000 7fe9f77fe700 1 -- 172.21.15.81:0/2562559507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe9f80826c0 con 0x7fea000b0c30 2023-11-29T11:13:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.626+0000 7fe9feffd700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9e0064ee0 0x7fe9e0067390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000c00 tx=0x7fe9e8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.630+0000 7fe9f77fe700 1 -- 172.21.15.81:0/2562559507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe9f8050570 con 0x7fea000b0c30 2023-11-29T11:13:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.794+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea00072500 con 0x7fea000b0c30 2023-11-29T11:13:03.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fe9f77fe700 1 -- 172.21.15.81:0/2562559507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fe9f8053b90 con 0x7fea000b0c30 2023-11-29T11:13:03.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:03.802 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9e0064ee0 msgr2=0x7fe9e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9e0064ee0 0x7fe9e0067390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000c00 tx=0x7fe9e8008030 comp rx=0 tx=0).stop 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea000b0c30 msgr2=0x7fea00163710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea000b0c30 0x7fea00163710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8007e40 tx=0x7fe9f800e3c0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 shutdown_connections 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9e0064ee0 0x7fe9e0067390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea00160680 0x7fea001f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea000b0c30 0x7fea00163710 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 --2- 172.21.15.81:0/2562559507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea00069c40 0x7fea00153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 >> 172.21.15.81:0/2562559507 conn(0x7fea0006caf0 msgr2=0x7fea0015a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 shutdown_connections 2023-11-29T11:13:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.798+0000 7fea05394700 1 -- 172.21.15.81:0/2562559507 wait complete. 2023-11-29T11:13:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:03.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:03.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.930+0000 7fc5ea7c0700 1 Processor -- start 2023-11-29T11:13:03.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.930+0000 7fc5ea7c0700 1 -- start start 2023-11-29T11:13:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.930+0000 7fc5ea7c0700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc5e40b04b0 0x7fc5e4164430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.930+0000 7fc5ea7c0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e415df90 con 0x7fc5e40b00e0 2023-11-29T11:13:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.930+0000 7fc5ea7c0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e406d700 con 0x7fc5e40cbb30 2023-11-29T11:13:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.930+0000 7fc5ea7c0700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e409c150 con 0x7fc5e40b04b0 2023-11-29T11:13:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e97be700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc5e40b00e0 0x7fc5e415d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38858/0 (socket says 172.21.15.81:38858) 2023-11-29T11:13:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e97be700 1 -- 172.21.15.81:0/628642898 learned_addr learned my addr 172.21.15.81:0/628642898 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e9fbf700 1 --2- 172.21.15.81:0/628642898 >> v2:172.21.15.176:3300/0 conn(0x7fc5e40b04b0 0x7fc5e4164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e3fff700 1 -- 172.21.15.81:0/628642898 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596788059 0 0) 0x7fc5e415df90 con 0x7fc5e40b00e0 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e3fff700 1 -- 172.21.15.81:0/628642898 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5cc0035d0 con 0x7fc5e40b00e0 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e9fbf700 1 -- 172.21.15.81:0/628642898 >> v1:172.21.15.176:6789/0 conn(0x7fc5e40cbb30 legacy=0x7fc5e415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e9fbf700 1 -- 172.21.15.81:0/628642898 >> v1:172.21.15.81:6789/0 conn(0x7fc5e40b00e0 legacy=0x7fc5e415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e9fbf700 1 -- 172.21.15.81:0/628642898 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40ac260 con 0x7fc5e40b04b0 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e9fbf700 1 --2- 172.21.15.81:0/628642898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4164430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009d90 tx=0x7fc5dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806167f2f45b72d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e3fff700 1 -- 172.21.15.81:0/628642898 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc00e070 con 0x7fc5e40b04b0 2023-11-29T11:13:03.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e3fff700 1 -- 172.21.15.81:0/628642898 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc00bb20 con 0x7fc5e40b04b0 2023-11-29T11:13:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5e3fff700 1 -- 172.21.15.81:0/628642898 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc012430 con 0x7fc5e40b04b0 2023-11-29T11:13:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/628642898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40b04b0 msgr2=0x7fc5e4164430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5ea7c0700 1 --2- 172.21.15.81:0/628642898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4164430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009d90 tx=0x7fc5dc00b330 comp rx=0 tx=0).stop 2023-11-29T11:13:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/628642898 shutdown_connections 2023-11-29T11:13:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5ea7c0700 1 --2- 172.21.15.81:0/628642898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4164430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/628642898 >> 172.21.15.81:0/628642898 conn(0x7fc5e40cae70 msgr2=0x7fc5e40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/628642898 shutdown_connections 2023-11-29T11:13:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.934+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/628642898 wait complete. 2023-11-29T11:13:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 Processor -- start 2023-11-29T11:13:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 -- start start 2023-11-29T11:13:03.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5e40b00e0 0x7fc5e4071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40cbb30 0x7fc5e40c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4070580 con 0x7fc5e40b04b0 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4070860 con 0x7fc5e40cbb30 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4070b40 con 0x7fc5e40b00e0 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4148730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51762/0 (socket says 172.21.15.81:51762) 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 -- 172.21.15.81:0/428792694 learned_addr learned my addr 172.21.15.81:0/428792694 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e97be700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5e40b00e0 0x7fc5e4071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e9fbf700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40cbb30 0x7fc5e40c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 -- 172.21.15.81:0/428792694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5e40b00e0 msgr2=0x7fc5e4071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5e40b00e0 0x7fc5e4071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 -- 172.21.15.81:0/428792694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40cbb30 msgr2=0x7fc5e40c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40cbb30 0x7fc5e40c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 -- 172.21.15.81:0/428792694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc009a70 con 0x7fc5e40b04b0 2023-11-29T11:13:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e8fbd700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4148730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800c4d0 tx=0x7fc5d800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e1ffb700 1 -- 172.21.15.81:0/428792694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80052d0 con 0x7fc5e40b04b0 2023-11-29T11:13:03.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e1ffb700 1 -- 172.21.15.81:0/428792694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d8005430 con 0x7fc5e40b04b0 2023-11-29T11:13:03.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e409bdb0 con 0x7fc5e40b04b0 2023-11-29T11:13:03.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5e1ffb700 1 -- 172.21.15.81:0/428792694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80055a0 con 0x7fc5e40b04b0 2023-11-29T11:13:03.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.938+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e40cc660 con 0x7fc5e40b04b0 2023-11-29T11:13:03.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.942+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e40cc9f0 con 0x7fc5e40b04b0 2023-11-29T11:13:03.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.942+0000 7fc5e1ffb700 1 -- 172.21.15.81:0/428792694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc5d8019030 con 0x7fc5e40b04b0 2023-11-29T11:13:03.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.942+0000 7fc5e1ffb700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5d0064f10 0x7fc5d00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:03.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.942+0000 7fc5e1ffb700 1 -- 172.21.15.81:0/428792694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc5d8081340 con 0x7fc5e40b04b0 2023-11-29T11:13:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.942+0000 7fc5e97be700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5d0064f10 0x7fc5d00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.942+0000 7fc5e97be700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5d0064f10 0x7fc5d00673c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4007fd0 tx=0x7fc5d4007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:03.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:03.950+0000 7fc5e1ffb700 1 -- 172.21.15.81:0/428792694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc5d804f1f0 con 0x7fc5e40b04b0 2023-11-29T11:13:04.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.114+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc5e4072500 con 0x7fc5e40b04b0 2023-11-29T11:13:04.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.114+0000 7fc5e1ffb700 1 -- 172.21.15.81:0/428792694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5d8052810 con 0x7fc5e40b04b0 2023-11-29T11:13:04.118 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5d0064f10 msgr2=0x7fc5d00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5d0064f10 0x7fc5d00673c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4007fd0 tx=0x7fc5d4007de0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5e40b04b0 msgr2=0x7fc5e4148730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4148730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800c4d0 tx=0x7fc5d800c7e0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 shutdown_connections 2023-11-29T11:13:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5d0064f10 0x7fc5d00673c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5e40cbb30 0x7fc5e40c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5e40b04b0 0x7fc5e4148730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 --2- 172.21.15.81:0/428792694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5e40b00e0 0x7fc5e4071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 >> 172.21.15.81:0/428792694 conn(0x7fc5e40cae70 msgr2=0x7fc5e406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 shutdown_connections 2023-11-29T11:13:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.118+0000 7fc5ea7c0700 1 -- 172.21.15.81:0/428792694 wait complete. 2023-11-29T11:13:04.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:04.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa509cf700 1 Processor -- start 2023-11-29T11:13:04.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa509cf700 1 -- start start 2023-11-29T11:13:04.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa509cf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffa4c06ce60 0x7ffa4c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa509cf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 0x7ffa4c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa509cf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c0cd2d0 con 0x7ffa4c0cf470 2023-11-29T11:13:04.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa509cf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c15c8b0 con 0x7ffa4c06ce60 2023-11-29T11:13:04.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa509cf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c06d770 con 0x7ffa4c0cce60 2023-11-29T11:13:04.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffa4c06ce60 0x7ffa4c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4b59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffa4c0cf470 0x7ffa4c0cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38870/0 (socket says 172.21.15.81:38870) 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4b59e700 1 -- 172.21.15.81:0/3342390445 learned_addr learned my addr 172.21.15.81:0/3342390445 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4a59c700 1 --2- 172.21.15.81:0/3342390445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 0x7ffa4c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa49d9b700 1 -- 172.21.15.81:0/3342390445 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235483480 0 0) 0x7ffa4c0cd2d0 con 0x7ffa4c0cf470 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa49d9b700 1 -- 172.21.15.81:0/3342390445 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa340035d0 con 0x7ffa4c0cf470 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4ad9d700 1 -- 172.21.15.81:0/3342390445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 msgr2=0x7ffa4c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4ad9d700 1 --2- 172.21.15.81:0/3342390445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 0x7ffa4c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4ad9d700 1 -- 172.21.15.81:0/3342390445 >> v1:172.21.15.81:6789/0 conn(0x7ffa4c0cf470 legacy=0x7ffa4c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4ad9d700 1 -- 172.21.15.81:0/3342390445 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c06a7f0 con 0x7ffa4c06ce60 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa4ad9d700 1 --2- 172.21.15.81:0/3342390445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0d31b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009850 tx=0x7ffa3c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadac2dd54f668f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.250+0000 7ffa49d9b700 1 -- 172.21.15.81:0/3342390445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c011830 con 0x7ffa4c06ce60 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa49d9b700 1 -- 172.21.15.81:0/3342390445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c011990 con 0x7ffa4c06ce60 2023-11-29T11:13:04.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa49d9b700 1 -- 172.21.15.81:0/3342390445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c011d40 con 0x7ffa4c06ce60 2023-11-29T11:13:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- 172.21.15.81:0/3342390445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 msgr2=0x7ffa4c0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 --2- 172.21.15.81:0/3342390445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0d31b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009850 tx=0x7ffa3c009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- 172.21.15.81:0/3342390445 shutdown_connections 2023-11-29T11:13:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 --2- 172.21.15.81:0/3342390445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 0x7ffa4c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 --2- 172.21.15.81:0/3342390445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0d31b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- 172.21.15.81:0/3342390445 >> 172.21.15.81:0/3342390445 conn(0x7ffa4c0b5760 msgr2=0x7ffa4c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- 172.21.15.81:0/3342390445 shutdown_connections 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- 172.21.15.81:0/3342390445 wait complete. 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 Processor -- start 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- start start 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 0x7ffa4c0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa4c0cf470 0x7ffa4c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0b4090 con 0x7ffa4c06ce60 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c152860 con 0x7ffa4c0cf470 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa509cf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0ca860 con 0x7ffa4c0cce60 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa4ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa4ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51774/0 (socket says 172.21.15.81:51774) 2023-11-29T11:13:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa4ad9d700 1 -- 172.21.15.81:0/875762207 learned_addr learned my addr 172.21.15.81:0/875762207 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa4b59e700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa4c0cf470 0x7ffa4c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa4a59c700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 0x7ffa4c0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.254+0000 7ffa4ad9d700 1 -- 172.21.15.81:0/875762207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 msgr2=0x7ffa4c0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa4ad9d700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 0x7ffa4c0b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa4ad9d700 1 -- 172.21.15.81:0/875762207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa4c0cf470 msgr2=0x7ffa4c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa4ad9d700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa4c0cf470 0x7ffa4c0b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa4ad9d700 1 -- 172.21.15.81:0/875762207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0094b0 con 0x7ffa4c06ce60 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa4ad9d700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0b30d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c014040 tx=0x7ffa3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa337fe700 1 -- 172.21.15.81:0/875762207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c004510 con 0x7ffa4c06ce60 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa337fe700 1 -- 172.21.15.81:0/875762207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c01e070 con 0x7ffa4c06ce60 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa337fe700 1 -- 172.21.15.81:0/875762207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c003900 con 0x7ffa4c06ce60 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c06adb0 con 0x7ffa4c06ce60 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c06aad0 con 0x7ffa4c06ce60 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4c06b090 con 0x7ffa4c06ce60 2023-11-29T11:13:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa337fe700 1 -- 172.21.15.81:0/875762207 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffa3c00f050 con 0x7ffa4c06ce60 2023-11-29T11:13:04.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa337fe700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa38064ee0 0x7ffa38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa337fe700 1 -- 172.21.15.81:0/875762207 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa3c082f30 con 0x7ffa4c06ce60 2023-11-29T11:13:04.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.258+0000 7ffa4a59c700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa38064ee0 0x7ffa38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.262+0000 7ffa4a59c700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa38064ee0 0x7ffa38067390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c08a090 tx=0x7ffa40009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.266+0000 7ffa337fe700 1 -- 172.21.15.81:0/875762207 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffa3c0b3400 con 0x7ffa4c06ce60 2023-11-29T11:13:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa4c072c20 con 0x7ffa4c06ce60 2023-11-29T11:13:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa337fe700 1 -- 172.21.15.81:0/875762207 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa3c0200a0 con 0x7ffa4c06ce60 2023-11-29T11:13:04.438 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa38064ee0 msgr2=0x7ffa38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa38064ee0 0x7ffa38067390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c08a090 tx=0x7ffa40009240 comp rx=0 tx=0).stop 2023-11-29T11:13:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 msgr2=0x7ffa4c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0b30d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c014040 tx=0x7ffa3c004770 comp rx=0 tx=0).stop 2023-11-29T11:13:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 shutdown_connections 2023-11-29T11:13:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa38064ee0 0x7ffa38067390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa4c0cf470 0x7ffa4c0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa4c0cce60 0x7ffa4c0b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 --2- 172.21.15.81:0/875762207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa4c06ce60 0x7ffa4c0b30d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 >> 172.21.15.81:0/875762207 conn(0x7ffa4c0b5760 msgr2=0x7ffa4c069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 shutdown_connections 2023-11-29T11:13:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.434+0000 7ffa509cf700 1 -- 172.21.15.81:0/875762207 wait complete. 2023-11-29T11:13:04.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:04.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.558+0000 7ff611370700 1 Processor -- start 2023-11-29T11:13:04.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.558+0000 7ff611370700 1 -- start start 2023-11-29T11:13:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff60c158ee0 0x7ff60c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff60c0ce230 0x7ff60c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c06d1c0 con 0x7ff60c0cd5d0 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c06e000 con 0x7ff60c0ce230 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0ca3a0 con 0x7ff60c158ee0 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff610b6f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff60c0ce230 0x7ff60c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff60b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff60c0cd5d0 0x7ff60c0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38874/0 (socket says 172.21.15.81:38874) 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff60b7fe700 1 -- 172.21.15.81:0/4120305428 learned_addr learned my addr 172.21.15.81:0/4120305428 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff60bfff700 1 --2- 172.21.15.81:0/4120305428 >> v2:172.21.15.176:3300/0 conn(0x7ff60c158ee0 0x7ff60c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff610b6f700 1 -- 172.21.15.81:0/4120305428 >> v2:172.21.15.176:3300/0 conn(0x7ff60c158ee0 msgr2=0x7ff60c0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff610b6f700 1 --2- 172.21.15.81:0/4120305428 >> v2:172.21.15.176:3300/0 conn(0x7ff60c158ee0 0x7ff60c0ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff610b6f700 1 -- 172.21.15.81:0/4120305428 >> v1:172.21.15.81:6789/0 conn(0x7ff60c0cd5d0 legacy=0x7ff60c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff610b6f700 1 -- 172.21.15.81:0/4120305428 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c06c920 con 0x7ff60c0ce230 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff60affd700 1 -- 172.21.15.81:0/4120305428 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120426823 0 0) 0x7ff5fc001290 con 0x7ff60c0cd5d0 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff610b6f700 1 --2- 172.21.15.81:0/4120305428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0cab60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0ccec0 tx=0x7ff60400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d76037688201c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff60affd700 1 -- 172.21.15.81:0/4120305428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400e070 con 0x7ff60c0ce230 2023-11-29T11:13:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff60affd700 1 -- 172.21.15.81:0/4120305428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400bb20 con 0x7ff60c0ce230 2023-11-29T11:13:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff60affd700 1 -- 172.21.15.81:0/4120305428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604012430 con 0x7ff60c0ce230 2023-11-29T11:13:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 -- 172.21.15.81:0/4120305428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 msgr2=0x7ff60c0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 --2- 172.21.15.81:0/4120305428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0cab60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0ccec0 tx=0x7ff60400b330 comp rx=0 tx=0).stop 2023-11-29T11:13:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 -- 172.21.15.81:0/4120305428 shutdown_connections 2023-11-29T11:13:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 --2- 172.21.15.81:0/4120305428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0cab60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 --2- 172.21.15.81:0/4120305428 >> v2:172.21.15.176:3300/0 conn(0x7ff60c158ee0 0x7ff60c0ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 -- 172.21.15.81:0/4120305428 >> 172.21.15.81:0/4120305428 conn(0x7ff60c0d0240 msgr2=0x7ff60c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 -- 172.21.15.81:0/4120305428 shutdown_connections 2023-11-29T11:13:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.562+0000 7ff611370700 1 -- 172.21.15.81:0/4120305428 wait complete. 2023-11-29T11:13:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff611370700 1 Processor -- start 2023-11-29T11:13:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff611370700 1 -- start start 2023-11-29T11:13:04.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff611370700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff60c0cd5d0 0x7ff60c1ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff611370700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff611370700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff60c158ee0 0x7ff60c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff611370700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1efb90 con 0x7ff60c0ce230 2023-11-29T11:13:04.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff611370700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1f3510 con 0x7ff60c158ee0 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff611370700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1f37f0 con 0x7ff60c0cd5d0 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51796/0 (socket says 172.21.15.81:51796) 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff60b7fe700 1 -- 172.21.15.81:0/3375036418 learned_addr learned my addr 172.21.15.81:0/3375036418 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff610b6f700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff60c158ee0 0x7ff60c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.566+0000 7ff60bfff700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff60c0cd5d0 0x7ff60c1ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff60b7fe700 1 -- 172.21.15.81:0/3375036418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff60c0cd5d0 msgr2=0x7ff60c1ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff60b7fe700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff60c0cd5d0 0x7ff60c1ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff60b7fe700 1 -- 172.21.15.81:0/3375036418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff60c158ee0 msgr2=0x7ff60c0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff60b7fe700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff60c158ee0 0x7ff60c0b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff60b7fe700 1 -- 172.21.15.81:0/3375036418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604009a70 con 0x7ff60c0ce230 2023-11-29T11:13:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff60b7fe700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0c6ff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00c520 tx=0x7ff5fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff608ff9700 1 -- 172.21.15.81:0/3375036418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0074e0 con 0x7ff60c0ce230 2023-11-29T11:13:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff608ff9700 1 -- 172.21.15.81:0/3375036418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc007640 con 0x7ff60c0ce230 2023-11-29T11:13:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c06cee0 con 0x7ff60c0ce230 2023-11-29T11:13:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff608ff9700 1 -- 172.21.15.81:0/3375036418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc005a70 con 0x7ff60c0ce230 2023-11-29T11:13:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c06cc00 con 0x7ff60c0ce230 2023-11-29T11:13:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.570+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c0ca640 con 0x7ff60c0ce230 2023-11-29T11:13:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.574+0000 7ff608ff9700 1 -- 172.21.15.81:0/3375036418 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff5fc019030 con 0x7ff60c0ce230 2023-11-29T11:13:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.574+0000 7ff608ff9700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff5f8064ee0 0x7ff5f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.574+0000 7ff608ff9700 1 -- 172.21.15.81:0/3375036418 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff5fc081280 con 0x7ff60c0ce230 2023-11-29T11:13:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.574+0000 7ff60bfff700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff5f8064ee0 0x7ff5f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.574+0000 7ff60bfff700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff5f8064ee0 0x7ff5f8067390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff60c15c540 tx=0x7ff600009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.578+0000 7ff608ff9700 1 -- 172.21.15.81:0/3375036418 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff5fc04f130 con 0x7ff60c0ce230 2023-11-29T11:13:04.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.742+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff60c06d1c0 con 0x7ff60c0ce230 2023-11-29T11:13:04.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.742+0000 7ff608ff9700 1 -- 172.21.15.81:0/3375036418 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff60c06d1c0 con 0x7ff60c0ce230 2023-11-29T11:13:04.748 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:04.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff5f8064ee0 msgr2=0x7ff5f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff5f8064ee0 0x7ff5f8067390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff60c15c540 tx=0x7ff600009240 comp rx=0 tx=0).stop 2023-11-29T11:13:04.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 msgr2=0x7ff60c0c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0c6ff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00c520 tx=0x7ff5fc00c830 comp rx=0 tx=0).stop 2023-11-29T11:13:04.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 shutdown_connections 2023-11-29T11:13:04.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff5f8064ee0 0x7ff5f8067390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff60c158ee0 0x7ff60c0b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff60c0ce230 0x7ff60c0c6ff0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 --2- 172.21.15.81:0/3375036418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff60c0cd5d0 0x7ff60c1ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 >> 172.21.15.81:0/3375036418 conn(0x7ff60c0d0240 msgr2=0x7ff60c1535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:04.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 shutdown_connections 2023-11-29T11:13:04.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.746+0000 7ff611370700 1 -- 172.21.15.81:0/3375036418 wait complete. 2023-11-29T11:13:04.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.886+0000 7f892d041700 1 Processor -- start 2023-11-29T11:13:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.886+0000 7f892d041700 1 -- start start 2023-11-29T11:13:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.886+0000 7f892d041700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f892806a4c0 0x7f892806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.886+0000 7f892d041700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892806a9c0 con 0x7f89280b1ae0 2023-11-29T11:13:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.886+0000 7f892d041700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892806aca0 con 0x7f89280cf0e0 2023-11-29T11:13:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.886+0000 7f892d041700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89280d0ab0 con 0x7f892806a4c0 2023-11-29T11:13:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.886+0000 7f8927fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f89280b1ae0 0x7f89280d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38884/0 (socket says 172.21.15.81:38884) 2023-11-29T11:13:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.886+0000 7f8927fff700 1 -- 172.21.15.81:0/4096573368 learned_addr learned my addr 172.21.15.81:0/4096573368 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f89277fe700 1 --2- 172.21.15.81:0/4096573368 >> v2:172.21.15.176:3300/0 conn(0x7f892806a4c0 0x7f892806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f8926ffd700 1 -- 172.21.15.81:0/4096573368 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736779802 0 0) 0x7f892806a9c0 con 0x7f89280b1ae0 2023-11-29T11:13:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f8926ffd700 1 -- 172.21.15.81:0/4096573368 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89100035d0 con 0x7f89280b1ae0 2023-11-29T11:13:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f89277fe700 1 -- 172.21.15.81:0/4096573368 >> v1:172.21.15.176:6789/0 conn(0x7f89280cf0e0 legacy=0x7f89280cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f89277fe700 1 -- 172.21.15.81:0/4096573368 >> v1:172.21.15.81:6789/0 conn(0x7f89280b1ae0 legacy=0x7f89280d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f89277fe700 1 -- 172.21.15.81:0/4096573368 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892806af80 con 0x7f892806a4c0 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f89277fe700 1 --2- 172.21.15.81:0/4096573368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892806a4c0 0x7f892806d8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8918009850 tx=0x7f8918009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54c0643772e6bc13 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f8926ffd700 1 -- 172.21.15.81:0/4096573368 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918011830 con 0x7f892806a4c0 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f8926ffd700 1 -- 172.21.15.81:0/4096573368 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918011990 con 0x7f892806a4c0 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f8926ffd700 1 -- 172.21.15.81:0/4096573368 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918011d40 con 0x7f892806a4c0 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 -- 172.21.15.81:0/4096573368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892806a4c0 msgr2=0x7f892806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 --2- 172.21.15.81:0/4096573368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892806a4c0 0x7f892806d8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8918009850 tx=0x7f8918009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 -- 172.21.15.81:0/4096573368 shutdown_connections 2023-11-29T11:13:04.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 --2- 172.21.15.81:0/4096573368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892806a4c0 0x7f892806d8e0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8918009850 tx=0x7f8918009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:04.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 -- 172.21.15.81:0/4096573368 >> 172.21.15.81:0/4096573368 conn(0x7f892809bbd0 msgr2=0x7f89280b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:04.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 -- 172.21.15.81:0/4096573368 shutdown_connections 2023-11-29T11:13:04.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 -- 172.21.15.81:0/4096573368 wait complete. 2023-11-29T11:13:04.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 Processor -- start 2023-11-29T11:13:04.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.890+0000 7f892d041700 1 -- start start 2023-11-29T11:13:04.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892d041700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89280b1ae0 0x7f8928159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892d041700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89280cf0e0 0x7f89280c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892d041700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89280c7e40 0x7f89280c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892d041700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280c82c0 con 0x7f89280b1ae0 2023-11-29T11:13:04.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892d041700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892809c5b0 con 0x7f89280c7e40 2023-11-29T11:13:04.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892d041700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89280c75d0 con 0x7f89280cf0e0 2023-11-29T11:13:04.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89280b1ae0 0x7f8928159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89280b1ae0 0x7f8928159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51808/0 (socket says 172.21.15.81:51808) 2023-11-29T11:13:04.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 -- 172.21.15.81:0/620950454 learned_addr learned my addr 172.21.15.81:0/620950454 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892c840700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89280c7e40 0x7f89280c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f89277fe700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89280cf0e0 0x7f89280c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 -- 172.21.15.81:0/620950454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89280cf0e0 msgr2=0x7f89280c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89280cf0e0 0x7f89280c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 -- 172.21.15.81:0/620950454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89280c7e40 msgr2=0x7f89280c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89280c7e40 0x7f89280c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 -- 172.21.15.81:0/620950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89180094b0 con 0x7f89280b1ae0 2023-11-29T11:13:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8927fff700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89280b1ae0 0x7f8928159220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f891c00c4d0 tx=0x7f891c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8924ff9700 1 -- 172.21.15.81:0/620950454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c005d90 con 0x7f89280b1ae0 2023-11-29T11:13:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8924ff9700 1 -- 172.21.15.81:0/620950454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c0070d0 con 0x7f89280b1ae0 2023-11-29T11:13:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89280b1eb0 con 0x7f89280b1ae0 2023-11-29T11:13:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f8924ff9700 1 -- 172.21.15.81:0/620950454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c007480 con 0x7f89280b1ae0 2023-11-29T11:13:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.894+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89280b4380 con 0x7f89280b1ae0 2023-11-29T11:13:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.898+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89280b60e0 con 0x7f89280b1ae0 2023-11-29T11:13:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.898+0000 7f8924ff9700 1 -- 172.21.15.81:0/620950454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f891c019030 con 0x7f89280b1ae0 2023-11-29T11:13:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.898+0000 7f8924ff9700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8914064ee0 0x7f8914067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.898+0000 7f8924ff9700 1 -- 172.21.15.81:0/620950454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f891c081490 con 0x7f89280b1ae0 2023-11-29T11:13:04.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.898+0000 7f89277fe700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8914064ee0 0x7f8914067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:04.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.898+0000 7f89277fe700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8914064ee0 0x7f8914067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f892806a890 tx=0x7f8918008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:04.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:04.906+0000 7f8924ff9700 1 -- 172.21.15.81:0/620950454 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f891c04f340 con 0x7f89280b1ae0 2023-11-29T11:13:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.066+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8928072500 con 0x7f89280b1ae0 2023-11-29T11:13:05.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f8924ff9700 1 -- 172.21.15.81:0/620950454 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f891c052960 con 0x7f89280b1ae0 2023-11-29T11:13:05.073 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:05.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8914064ee0 msgr2=0x7f8914067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8914064ee0 0x7f8914067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f892806a890 tx=0x7f8918008030 comp rx=0 tx=0).stop 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89280b1ae0 msgr2=0x7f8928159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89280b1ae0 0x7f8928159220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f891c00c4d0 tx=0x7f891c00c7e0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 shutdown_connections 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8914064ee0 0x7f8914067390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89280c7e40 0x7f89280c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89280cf0e0 0x7f89280c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 --2- 172.21.15.81:0/620950454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89280b1ae0 0x7f8928159220 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 >> 172.21.15.81:0/620950454 conn(0x7f892809bbd0 msgr2=0x7f89280b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 shutdown_connections 2023-11-29T11:13:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.070+0000 7f892d041700 1 -- 172.21.15.81:0/620950454 wait complete. 2023-11-29T11:13:05.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe7324700 1 Processor -- start 2023-11-29T11:13:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe7324700 1 -- start start 2023-11-29T11:13:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe7324700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9fe00b1ae0 0x7f9fe006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe7324700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fe00cf0e0 0x7f9fe00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe7324700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe00cfa40 con 0x7f9fe006a4c0 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe7324700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe00d0ab0 con 0x7f9fe00cf0e0 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe7324700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe006a9c0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe6b23700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fe00cf0e0 0x7f9fe00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe6b23700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fe00cf0e0 0x7f9fe00cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51814/0 (socket says 172.21.15.81:51814) 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.206+0000 7f9fe6b23700 1 -- 172.21.15.81:0/65666104 learned_addr learned my addr 172.21.15.81:0/65666104 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe6322700 1 --2- 172.21.15.81:0/65666104 >> v2:172.21.15.176:3300/0 conn(0x7f9fe00b1ae0 0x7f9fe006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe6b23700 1 -- 172.21.15.81:0/65666104 >> v2:172.21.15.176:3300/0 conn(0x7f9fe00b1ae0 msgr2=0x7f9fe006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe6b23700 1 --2- 172.21.15.81:0/65666104 >> v2:172.21.15.176:3300/0 conn(0x7f9fe00b1ae0 0x7f9fe006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe6b23700 1 -- 172.21.15.81:0/65666104 >> v1:172.21.15.176:6789/0 conn(0x7f9fe006a4c0 legacy=0x7f9fe00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe6b23700 1 -- 172.21.15.81:0/65666104 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe006aca0 con 0x7f9fe00cf0e0 2023-11-29T11:13:05.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe6b23700 1 --2- 172.21.15.81:0/65666104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00cf0e0 0x7f9fe00cf500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00b8870 tx=0x7f9fd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa364f08fe2fe77 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:05.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe5320700 1 -- 172.21.15.81:0/65666104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800e070 con 0x7f9fe00cf0e0 2023-11-29T11:13:05.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe5320700 1 -- 172.21.15.81:0/65666104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd800b910 con 0x7f9fe00cf0e0 2023-11-29T11:13:05.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe5320700 1 -- 172.21.15.81:0/65666104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800bcc0 con 0x7f9fe00cf0e0 2023-11-29T11:13:05.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe7324700 1 -- 172.21.15.81:0/65666104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00cf0e0 msgr2=0x7f9fe00cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe7324700 1 --2- 172.21.15.81:0/65666104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00cf0e0 0x7f9fe00cf500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00b8870 tx=0x7f9fd800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe7324700 1 -- 172.21.15.81:0/65666104 shutdown_connections 2023-11-29T11:13:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe7324700 1 --2- 172.21.15.81:0/65666104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00cf0e0 0x7f9fe00cf500 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe7324700 1 --2- 172.21.15.81:0/65666104 >> v2:172.21.15.176:3300/0 conn(0x7f9fe00b1ae0 0x7f9fe006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe7324700 1 -- 172.21.15.81:0/65666104 >> 172.21.15.81:0/65666104 conn(0x7f9fe009bbd0 msgr2=0x7f9fe00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe7324700 1 -- 172.21.15.81:0/65666104 shutdown_connections 2023-11-29T11:13:05.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.210+0000 7f9fe7324700 1 -- 172.21.15.81:0/65666104 wait complete. 2023-11-29T11:13:05.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 Processor -- start 2023-11-29T11:13:05.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 -- start start 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe006a4c0 0x7f9fe00c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00b1ae0 0x7f9fe01f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe00cf0e0 0x7f9fe00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00c91f0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00c8260 con 0x7f9fe00cf0e0 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00c8820 con 0x7f9fe006a4c0 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00b1ae0 0x7f9fe01f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00b1ae0 0x7f9fe01f15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51818/0 (socket says 172.21.15.81:51818) 2023-11-29T11:13:05.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 -- 172.21.15.81:0/2392638973 learned_addr learned my addr 172.21.15.81:0/2392638973 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:05.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe6b23700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe00cf0e0 0x7f9fe00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe6322700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe006a4c0 0x7f9fe00c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 -- 172.21.15.81:0/2392638973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe006a4c0 msgr2=0x7f9fe00c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe006a4c0 0x7f9fe00c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 -- 172.21.15.81:0/2392638973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe00cf0e0 msgr2=0x7f9fe00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe00cf0e0 0x7f9fe00c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 -- 172.21.15.81:0/2392638973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009b30 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe5b21700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00b1ae0 0x7f9fe01f15d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400c530 tx=0x7f9fd400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fd2ffd700 1 -- 172.21.15.81:0/2392638973 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400cea0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fd2ffd700 1 -- 172.21.15.81:0/2392638973 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd40052d0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe00b4380 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fd2ffd700 1 -- 172.21.15.81:0/2392638973 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40036a0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.214+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe006af80 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.218+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe00b1eb0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.218+0000 7f9fd2ffd700 1 -- 172.21.15.81:0/2392638973 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9fd4019030 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.218+0000 7f9fd2ffd700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9fc4064ee0 0x7f9fc4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.218+0000 7f9fd2ffd700 1 -- 172.21.15.81:0/2392638973 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9fd40812f0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.218+0000 7f9fe6322700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9fc4064ee0 0x7f9fc4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.218+0000 7f9fe6322700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9fc4064ee0 0x7f9fc4067390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009bf0 tx=0x7f9fdc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:05.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.230+0000 7f9fd2ffd700 1 -- 172.21.15.81:0/2392638973 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9fd404f1a0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9fe00c89b0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fd2ffd700 1 -- 172.21.15.81:0/2392638973 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9fd40527c0 con 0x7f9fe00b1ae0 2023-11-29T11:13:05.394 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:05.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9fc4064ee0 msgr2=0x7f9fc4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9fc4064ee0 0x7f9fc4067390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009bf0 tx=0x7f9fdc009240 comp rx=0 tx=0).stop 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00b1ae0 msgr2=0x7f9fe01f15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00b1ae0 0x7f9fe01f15d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400c530 tx=0x7f9fd400c840 comp rx=0 tx=0).stop 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 shutdown_connections 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9fc4064ee0 0x7f9fc4067390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fe00cf0e0 0x7f9fe00c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fe00b1ae0 0x7f9fe01f15d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 --2- 172.21.15.81:0/2392638973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fe006a4c0 0x7f9fe00c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 >> 172.21.15.81:0/2392638973 conn(0x7f9fe009bbd0 msgr2=0x7f9fe00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 shutdown_connections 2023-11-29T11:13:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.390+0000 7f9fe7324700 1 -- 172.21.15.81:0/2392638973 wait complete. 2023-11-29T11:13:05.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 Processor -- start 2023-11-29T11:13:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- start start 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1dc0cf050 0x7fc1dc06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 0x7fc1dc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1dc15c6d0 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1dc06a9a0 con 0x7fc1dc0cf050 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0cf960 con 0x7fc1dc06a530 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e1fee700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1dc0cf050 0x7fc1dc06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e27ef700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc1dc0b4c10 0x7fc1dc0cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38888/0 (socket says 172.21.15.81:38888) 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e1fee700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1dc0cf050 0x7fc1dc06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51832/0 (socket says 172.21.15.81:51832) 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e27ef700 1 -- 172.21.15.81:0/2337638399 learned_addr learned my addr 172.21.15.81:0/2337638399 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e17ed700 1 --2- 172.21.15.81:0/2337638399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 0x7fc1dc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e1fee700 1 -- 172.21.15.81:0/2337638399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 msgr2=0x7fc1dc0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e1fee700 1 --2- 172.21.15.81:0/2337638399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 0x7fc1dc0cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e1fee700 1 -- 172.21.15.81:0/2337638399 >> v1:172.21.15.81:6789/0 conn(0x7fc1dc0b4c10 legacy=0x7fc1dc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e1fee700 1 -- 172.21.15.81:0/2337638399 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc06ac60 con 0x7fc1dc0cf050 2023-11-29T11:13:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e1fee700 1 --2- 172.21.15.81:0/2337638399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0cf050 0x7fc1dc06d7d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009d90 tx=0x7fc1d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0278f79a9de6e18 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e0fec700 1 -- 172.21.15.81:0/2337638399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800e070 con 0x7fc1dc0cf050 2023-11-29T11:13:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e0fec700 1 -- 172.21.15.81:0/2337638399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d800bbd0 con 0x7fc1dc0cf050 2023-11-29T11:13:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e0fec700 1 -- 172.21.15.81:0/2337638399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8012430 con 0x7fc1dc0cf050 2023-11-29T11:13:05.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/2337638399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0cf050 msgr2=0x7fc1dc06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/2337638399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0cf050 0x7fc1dc06d7d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009d90 tx=0x7fc1d800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:05.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/2337638399 shutdown_connections 2023-11-29T11:13:05.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/2337638399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 0x7fc1dc0cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/2337638399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0cf050 0x7fc1dc06d7d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/2337638399 >> 172.21.15.81:0/2337638399 conn(0x7fc1dc09bb30 msgr2=0x7fc1dc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:05.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/2337638399 shutdown_connections 2023-11-29T11:13:05.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.522+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/2337638399 wait complete. 2023-11-29T11:13:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.526+0000 7fc1e2ff0700 1 Processor -- start 2023-11-29T11:13:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.526+0000 7fc1e2ff0700 1 -- start start 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.526+0000 7fc1e2ff0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 0x7fc1dc15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.526+0000 7fc1e2ff0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0b4c10 0x7fc1dc0c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.526+0000 7fc1e2ff0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc0cf050 0x7fc1dc0c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e2ff0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc15d7d0 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e2ff0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc15dab0 con 0x7fc1dc0cf050 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e2ff0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc15dd90 con 0x7fc1dc06a530 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0b4c10 0x7fc1dc0c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0b4c10 0x7fc1dc0c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51846/0 (socket says 172.21.15.81:51846) 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 -- 172.21.15.81:0/730612796 learned_addr learned my addr 172.21.15.81:0/730612796 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e1fee700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 0x7fc1dc15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e27ef700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc0cf050 0x7fc1dc0c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 -- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 msgr2=0x7fc1dc15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 0x7fc1dc15a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 -- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc0cf050 msgr2=0x7fc1dc0c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc0cf050 0x7fc1dc0c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 -- 172.21.15.81:0/730612796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8009a70 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e27ef700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc0cf050 0x7fc1dc0c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e17ed700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0b4c10 0x7fc1dc0c8210 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00e760 tx=0x7fc1cc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1d27fc700 1 -- 172.21.15.81:0/730612796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc013610 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1d27fc700 1 -- 172.21.15.81:0/730612796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc013770 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc0b4410 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1d27fc700 1 -- 172.21.15.81:0/730612796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc013ae0 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc06af40 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1dc0b46f0 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1d27fc700 1 -- 172.21.15.81:0/730612796 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc1cc023070 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1d27fc700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1c8064ee0 0x7fc1c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1d27fc700 1 -- 172.21.15.81:0/730612796 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc1cc081dc0 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.530+0000 7fc1e1fee700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1c8064ee0 0x7fc1c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.534+0000 7fc1e1fee700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1c8064ee0 0x7fc1c8067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8000f80 tx=0x7fc1d8011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:05.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.538+0000 7fc1d27fc700 1 -- 172.21.15.81:0/730612796 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc1cc04fc70 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.706+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1dc072500 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.706+0000 7fc1d27fc700 1 -- 172.21.15.81:0/730612796 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc1cc00f040 con 0x7fc1dc0b4c10 2023-11-29T11:13:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1c8064ee0 msgr2=0x7fc1c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1c8064ee0 0x7fc1c8067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8000f80 tx=0x7fc1d8011000 comp rx=0 tx=0).stop 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0b4c10 msgr2=0x7fc1dc0c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0b4c10 0x7fc1dc0c8210 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00e760 tx=0x7fc1cc00ea70 comp rx=0 tx=0).stop 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 shutdown_connections 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1c8064ee0 0x7fc1c8067390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1dc0cf050 0x7fc1dc0c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1dc0b4c10 0x7fc1dc0c8210 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 --2- 172.21.15.81:0/730612796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1dc06a530 0x7fc1dc15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 >> 172.21.15.81:0/730612796 conn(0x7fc1dc09bb30 msgr2=0x7fc1dc06cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 shutdown_connections 2023-11-29T11:13:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:05.710+0000 7fc1e2ff0700 1 -- 172.21.15.81:0/730612796 wait complete. 2023-11-29T11:13:05.716 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:05.727 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:13:05.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:05.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-29T11:13:05.758 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[42964]: fuse finished with error 0 and tester_r 0 2023-11-29T11:13:05.760 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:13:11.862 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:13:11.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:11.862 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-29T11:13:11.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8e0c36700 1 Processor -- start 2023-11-29T11:13:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8e0c36700 1 -- start start 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8e0c36700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe8dc158520 0x7fe8dc1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8e0c36700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc06cd50 0x7fe8dc0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8e0c36700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8dc0cc0a0 con 0x7fe8dc071690 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8e0c36700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8dc06d1c0 con 0x7fe8dc158520 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8e0c36700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc0cb240 con 0x7fe8dc06cd50 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8daffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe8dc071690 0x7fe8dc0c9370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42840/0 (socket says 172.21.15.81:42840) 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.094+0000 7fe8daffd700 1 -- 172.21.15.81:0/1687727819 learned_addr learned my addr 172.21.15.81:0/1687727819 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8dbfff700 1 --2- 172.21.15.81:0/1687727819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc06cd50 0x7fe8dc0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8db7fe700 1 --2- 172.21.15.81:0/1687727819 >> v2:172.21.15.176:3300/0 conn(0x7fe8dc158520 0x7fe8dc1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8da7fc700 1 -- 172.21.15.81:0/1687727819 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987778669 0 0) 0x7fe8dc0cc0a0 con 0x7fe8dc071690 2023-11-29T11:13:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8da7fc700 1 -- 172.21.15.81:0/1687727819 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c40035d0 con 0x7fe8dc071690 2023-11-29T11:13:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8dbfff700 1 -- 172.21.15.81:0/1687727819 >> v2:172.21.15.176:3300/0 conn(0x7fe8dc158520 msgr2=0x7fe8dc1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8dbfff700 1 --2- 172.21.15.81:0/1687727819 >> v2:172.21.15.176:3300/0 conn(0x7fe8dc158520 0x7fe8dc1588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8dbfff700 1 -- 172.21.15.81:0/1687727819 >> v1:172.21.15.81:6789/0 conn(0x7fe8dc071690 legacy=0x7fe8dc0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8dbfff700 1 -- 172.21.15.81:0/1687727819 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc0cb520 con 0x7fe8dc06cd50 2023-11-29T11:13:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8dbfff700 1 --2- 172.21.15.81:0/1687727819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc06cd50 0x7fe8dc0ccb00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009d90 tx=0x7fe8d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b03fd09d9a4a6d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8da7fc700 1 -- 172.21.15.81:0/1687727819 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400e070 con 0x7fe8dc06cd50 2023-11-29T11:13:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8da7fc700 1 -- 172.21.15.81:0/1687727819 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400bb20 con 0x7fe8dc06cd50 2023-11-29T11:13:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8da7fc700 1 -- 172.21.15.81:0/1687727819 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4012430 con 0x7fe8dc06cd50 2023-11-29T11:13:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 -- 172.21.15.81:0/1687727819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc06cd50 msgr2=0x7fe8dc0ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/1687727819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc06cd50 0x7fe8dc0ccb00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009d90 tx=0x7fe8d400b330 comp rx=0 tx=0).stop 2023-11-29T11:13:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 -- 172.21.15.81:0/1687727819 shutdown_connections 2023-11-29T11:13:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/1687727819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc06cd50 0x7fe8dc0ccb00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/1687727819 >> v2:172.21.15.176:3300/0 conn(0x7fe8dc158520 0x7fe8dc1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 -- 172.21.15.81:0/1687727819 >> 172.21.15.81:0/1687727819 conn(0x7fe8dc0b08b0 msgr2=0x7fe8dc0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 -- 172.21.15.81:0/1687727819 shutdown_connections 2023-11-29T11:13:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 -- 172.21.15.81:0/1687727819 wait complete. 2023-11-29T11:13:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.098+0000 7fe8e0c36700 1 Processor -- start 2023-11-29T11:13:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 -- start start 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8dc06cd50 0x7fe8dc1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc071690 0x7fe8dc146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc158520 0x7fe8dc0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc15a000 con 0x7fe8dc06cd50 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc147210 con 0x7fe8dc071690 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc158f60 con 0x7fe8dc158520 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8dc06cd50 0x7fe8dc1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8dc06cd50 0x7fe8dc1588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44632/0 (socket says 172.21.15.81:44632) 2023-11-29T11:13:12.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8dbfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc158520 0x7fe8dc0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 -- 172.21.15.81:0/2402896537 learned_addr learned my addr 172.21.15.81:0/2402896537 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:12.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8daffd700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc071690 0x7fe8dc146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 -- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc158520 msgr2=0x7fe8dc0c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc158520 0x7fe8dc0c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 -- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc071690 msgr2=0x7fe8dc146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc071690 0x7fe8dc146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 -- 172.21.15.81:0/2402896537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009a70 con 0x7fe8dc06cd50 2023-11-29T11:13:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8daffd700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc071690 0x7fe8dc146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8dbfff700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc158520 0x7fe8dc0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8db7fe700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8dc06cd50 0x7fe8dc1588f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00e870 tx=0x7fe8cc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8c3fff700 1 -- 172.21.15.81:0/2402896537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0095a0 con 0x7fe8dc06cd50 2023-11-29T11:13:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8c3fff700 1 -- 172.21.15.81:0/2402896537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc013680 con 0x7fe8dc06cd50 2023-11-29T11:13:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc0cbae0 con 0x7fe8dc06cd50 2023-11-29T11:13:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8c3fff700 1 -- 172.21.15.81:0/2402896537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0139f0 con 0x7fe8dc06cd50 2023-11-29T11:13:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.102+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc0cb800 con 0x7fe8dc06cd50 2023-11-29T11:13:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.106+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc0cbdc0 con 0x7fe8dc06cd50 2023-11-29T11:13:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.106+0000 7fe8c3fff700 1 -- 172.21.15.81:0/2402896537 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe8cc019030 con 0x7fe8dc06cd50 2023-11-29T11:13:12.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.106+0000 7fe8c3fff700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe8c8064ee0 0x7fe8c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.106+0000 7fe8c3fff700 1 -- 172.21.15.81:0/2402896537 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe8cc0826a0 con 0x7fe8dc06cd50 2023-11-29T11:13:12.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.106+0000 7fe8daffd700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe8c8064ee0 0x7fe8c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.106+0000 7fe8daffd700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe8c8064ee0 0x7fe8c8067390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0cd5d0 tx=0x7fe8d0007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.110+0000 7fe8c3fff700 1 -- 172.21.15.81:0/2402896537 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe8cc050550 con 0x7fe8dc06cd50 2023-11-29T11:13:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.274+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8dc072500 con 0x7fe8dc06cd50 2023-11-29T11:13:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.274+0000 7fe8c3fff700 1 -- 172.21.15.81:0/2402896537 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fe8cc059090 con 0x7fe8dc06cd50 2023-11-29T11:13:12.280 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:12.280 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:12.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe8c8064ee0 msgr2=0x7fe8c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe8c8064ee0 0x7fe8c8067390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0cd5d0 tx=0x7fe8d0007de0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8dc06cd50 msgr2=0x7fe8dc1588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8dc06cd50 0x7fe8dc1588f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00e870 tx=0x7fe8cc00eb80 comp rx=0 tx=0).stop 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 shutdown_connections 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe8c8064ee0 0x7fe8c8067390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8dc158520 0x7fe8dc0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc071690 0x7fe8dc146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 --2- 172.21.15.81:0/2402896537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8dc06cd50 0x7fe8dc1588f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 >> 172.21.15.81:0/2402896537 conn(0x7fe8dc0b08b0 msgr2=0x7fe8dc0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.278+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 shutdown_connections 2023-11-29T11:13:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.282+0000 7fe8e0c36700 1 -- 172.21.15.81:0/2402896537 wait complete. 2023-11-29T11:13:12.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:12.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc3580700 1 Processor -- start 2023-11-29T11:13:12.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc3580700 1 -- start start 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc3580700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3cbc0cf050 0x7f3cbc06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc3580700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3cbc06a530 0x7f3cbc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc3580700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0b4c10 0x7f3cbc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc3580700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc15c6d0 con 0x7f3cbc06a530 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc3580700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc06a9d0 con 0x7f3cbc0cf050 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc3580700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0cf960 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc1d7d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3cbc06a530 0x7f3cbc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc1d7d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3cbc06a530 0x7f3cbc0cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44642/0 (socket says 172.21.15.81:44642) 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc1d7d700 1 -- 172.21.15.81:0/2513350569 learned_addr learned my addr 172.21.15.81:0/2513350569 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc257e700 1 --2- 172.21.15.81:0/2513350569 >> v2:172.21.15.176:3300/0 conn(0x7f3cbc0cf050 0x7f3cbc06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc2d7f700 1 --2- 172.21.15.81:0/2513350569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0b4c10 0x7f3cbc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc1d7d700 1 -- 172.21.15.81:0/2513350569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0b4c10 msgr2=0x7f3cbc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc1d7d700 1 --2- 172.21.15.81:0/2513350569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0b4c10 0x7f3cbc0cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc1d7d700 1 -- 172.21.15.81:0/2513350569 >> v2:172.21.15.176:3300/0 conn(0x7f3cbc0cf050 msgr2=0x7f3cbc06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc1d7d700 1 --2- 172.21.15.81:0/2513350569 >> v2:172.21.15.176:3300/0 conn(0x7f3cbc0cf050 0x7f3cbc06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.406+0000 7f3cc1d7d700 1 -- 172.21.15.81:0/2513350569 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc06ac60 con 0x7f3cbc06a530 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc1d7d700 1 --2- 172.21.15.81:0/2513350569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc06a530 0x7f3cbc0cf420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc08b9c0 tx=0x7f3cac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1a335dd3e1e38 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc157c700 1 -- 172.21.15.81:0/2513350569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00b8a0 con 0x7f3cbc06a530 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc157c700 1 -- 172.21.15.81:0/2513350569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00ba00 con 0x7f3cbc06a530 2023-11-29T11:13:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc157c700 1 -- 172.21.15.81:0/2513350569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00bd90 con 0x7f3cbc06a530 2023-11-29T11:13:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 -- 172.21.15.81:0/2513350569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc06a530 msgr2=0x7f3cbc0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 --2- 172.21.15.81:0/2513350569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc06a530 0x7f3cbc0cf420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc08b9c0 tx=0x7f3cac009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 -- 172.21.15.81:0/2513350569 shutdown_connections 2023-11-29T11:13:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 --2- 172.21.15.81:0/2513350569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0b4c10 0x7f3cbc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 --2- 172.21.15.81:0/2513350569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc06a530 0x7f3cbc0cf420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 --2- 172.21.15.81:0/2513350569 >> v2:172.21.15.176:3300/0 conn(0x7f3cbc0cf050 0x7f3cbc06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 -- 172.21.15.81:0/2513350569 >> 172.21.15.81:0/2513350569 conn(0x7f3cbc09bb30 msgr2=0x7f3cbc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 -- 172.21.15.81:0/2513350569 shutdown_connections 2023-11-29T11:13:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 -- 172.21.15.81:0/2513350569 wait complete. 2023-11-29T11:13:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 Processor -- start 2023-11-29T11:13:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.410+0000 7f3cc3580700 1 -- start start 2023-11-29T11:13:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cbc06a530 0x7f3cbc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc0b4c10 0x7f3cbc1f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0cf050 0x7f3cbc1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc1f48b0 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c6300 con 0x7f3cbc06a530 2023-11-29T11:13:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c8890 con 0x7f3cbc0cf050 2023-11-29T11:13:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc1d7d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc0b4c10 0x7f3cbc1f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc257e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cbc06a530 0x7f3cbc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc257e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cbc06a530 0x7f3cbc0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:36740/0 (socket says 172.21.15.81:36740) 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc1d7d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc0b4c10 0x7f3cbc1f1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44644/0 (socket says 172.21.15.81:44644) 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc257e700 1 -- 172.21.15.81:0/406041569 learned_addr learned my addr 172.21.15.81:0/406041569 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc2d7f700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0cf050 0x7f3cbc1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc1d7d700 1 -- 172.21.15.81:0/406041569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0cf050 msgr2=0x7f3cbc1f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc1d7d700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0cf050 0x7f3cbc1f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc1d7d700 1 -- 172.21.15.81:0/406041569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cbc06a530 msgr2=0x7f3cbc0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc1d7d700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cbc06a530 0x7f3cbc0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc1d7d700 1 -- 172.21.15.81:0/406041569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac009570 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc1d7d700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc0b4c10 0x7f3cbc1f1530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cac016000 tx=0x7f3cac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cb2ffd700 1 -- 172.21.15.81:0/406041569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00bee0 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cb2ffd700 1 -- 172.21.15.81:0/406041569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac01f070 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc0b4410 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cb2ffd700 1 -- 172.21.15.81:0/406041569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac003900 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc06af40 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc0b46f0 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.414+0000 7f3cb2ffd700 1 -- 172.21.15.81:0/406041569 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3cac02a020 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.418+0000 7f3cb2ffd700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3ca0064ee0 0x7f3ca0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.418+0000 7f3cc257e700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3ca0064ee0 0x7f3ca0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.418+0000 7f3cb2ffd700 1 -- 172.21.15.81:0/406041569 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3cac083790 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.418+0000 7f3cc257e700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3ca0064ee0 0x7f3ca0067390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8007a90 tx=0x7f3cb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.422+0000 7f3cb2ffd700 1 -- 172.21.15.81:0/406041569 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3cac051640 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.590+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cbc072500 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.590+0000 7f3cb2ffd700 1 -- 172.21.15.81:0/406041569 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f3cac054c60 con 0x7f3cbc0b4c10 2023-11-29T11:13:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:12.596 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3ca0064ee0 msgr2=0x7f3ca0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3ca0064ee0 0x7f3ca0067390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8007a90 tx=0x7f3cb8008040 comp rx=0 tx=0).stop 2023-11-29T11:13:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc0b4c10 msgr2=0x7f3cbc1f1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc0b4c10 0x7f3cbc1f1530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cac016000 tx=0x7f3cac004770 comp rx=0 tx=0).stop 2023-11-29T11:13:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 shutdown_connections 2023-11-29T11:13:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3ca0064ee0 0x7f3ca0067390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cbc0cf050 0x7f3cbc1f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cbc0b4c10 0x7f3cbc1f1530 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 --2- 172.21.15.81:0/406041569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cbc06a530 0x7f3cbc0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 >> 172.21.15.81:0/406041569 conn(0x7f3cbc09bb30 msgr2=0x7f3cbc0657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 shutdown_connections 2023-11-29T11:13:12.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.594+0000 7f3cc3580700 1 -- 172.21.15.81:0/406041569 wait complete. 2023-11-29T11:13:12.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-29T11:13:12.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215e9df700 1 Processor -- start 2023-11-29T11:13:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215e9df700 1 -- start start 2023-11-29T11:13:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215e9df700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f215806e000 0x7f2158158220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215e9df700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21580abff0 con 0x7f21580b0580 2023-11-29T11:13:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215e9df700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21580ab470 con 0x7f21580aaf40 2023-11-29T11:13:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215e9df700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21580ab750 con 0x7f215806e000 2023-11-29T11:13:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215d9dd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f215806e000 0x7f2158158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215e1de700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f21580b0580 0x7f2158163030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42854/0 (socket says 172.21.15.81:42854) 2023-11-29T11:13:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215e1de700 1 -- 172.21.15.81:0/2834329791 learned_addr learned my addr 172.21.15.81:0/2834329791 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215c9db700 1 -- 172.21.15.81:0/2834329791 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657852434 0 0) 0x7f21580ab470 con 0x7f21580aaf40 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.722+0000 7f215d9dd700 1 -- 172.21.15.81:0/2834329791 >> v1:172.21.15.176:6789/0 conn(0x7f21580aaf40 legacy=0x7f21580afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215d9dd700 1 -- 172.21.15.81:0/2834329791 >> v1:172.21.15.81:6789/0 conn(0x7f21580b0580 legacy=0x7f2158163030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215d9dd700 1 -- 172.21.15.81:0/2834329791 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21580aba30 con 0x7f215806e000 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215d9dd700 1 --2- 172.21.15.81:0/2834329791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f2158158220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f214c009850 tx=0x7f214c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb6abd85ac16e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215c9db700 1 -- 172.21.15.81:0/2834329791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c004290 con 0x7f215806e000 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215c9db700 1 -- 172.21.15.81:0/2834329791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c0043f0 con 0x7f215806e000 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215c9db700 1 -- 172.21.15.81:0/2834329791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c0038c0 con 0x7f215806e000 2023-11-29T11:13:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- 172.21.15.81:0/2834329791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 msgr2=0x7f2158158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 --2- 172.21.15.81:0/2834329791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f2158158220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f214c009850 tx=0x7f214c009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- 172.21.15.81:0/2834329791 shutdown_connections 2023-11-29T11:13:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 --2- 172.21.15.81:0/2834329791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f2158158220 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- 172.21.15.81:0/2834329791 >> 172.21.15.81:0/2834329791 conn(0x7f21580cae70 msgr2=0x7f21580cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- 172.21.15.81:0/2834329791 shutdown_connections 2023-11-29T11:13:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- 172.21.15.81:0/2834329791 wait complete. 2023-11-29T11:13:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 Processor -- start 2023-11-29T11:13:12.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- start start 2023-11-29T11:13:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f215809a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21580aaf40 0x7f21581f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21580b0580 0x7f2158070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21580c4cf0 con 0x7f215806e000 2023-11-29T11:13:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2158098d80 con 0x7f21580b0580 2023-11-29T11:13:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.726+0000 7f215e9df700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215809a9d0 con 0x7f21580aaf40 2023-11-29T11:13:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f215809a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f215809a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44666/0 (socket says 172.21.15.81:44666) 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 -- 172.21.15.81:0/863082828 learned_addr learned my addr 172.21.15.81:0/863082828 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215e1de700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21580b0580 0x7f2158070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d1dc700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21580aaf40 0x7f21581f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 -- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21580aaf40 msgr2=0x7f21581f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21580aaf40 0x7f21581f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 -- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21580b0580 msgr2=0x7f2158070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21580b0580 0x7f2158070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 -- 172.21.15.81:0/863082828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0094b0 con 0x7f215806e000 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215e1de700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21580b0580 0x7f2158070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d1dc700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21580aaf40 0x7f21581f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215d9dd700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f215809a490 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f214c009ba0 tx=0x7f214c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f214a7fc700 1 -- 172.21.15.81:0/863082828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c003e60 con 0x7f215806e000 2023-11-29T11:13:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f214a7fc700 1 -- 172.21.15.81:0/863082828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c011630 con 0x7f215806e000 2023-11-29T11:13:12.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21580ac500 con 0x7f215806e000 2023-11-29T11:13:12.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f214a7fc700 1 -- 172.21.15.81:0/863082828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c0119e0 con 0x7f215806e000 2023-11-29T11:13:12.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21580abd10 con 0x7f215806e000 2023-11-29T11:13:12.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21580ac690 con 0x7f215806e000 2023-11-29T11:13:12.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.730+0000 7f214a7fc700 1 -- 172.21.15.81:0/863082828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f214c02b070 con 0x7f215806e000 2023-11-29T11:13:12.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.734+0000 7f214a7fc700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f213c064ee0 0x7f213c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:12.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.734+0000 7f214a7fc700 1 -- 172.21.15.81:0/863082828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f214c082cb0 con 0x7f215806e000 2023-11-29T11:13:12.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.734+0000 7f215d1dc700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f213c064ee0 0x7f213c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:12.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.734+0000 7f215d1dc700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f213c064ee0 0x7f213c067390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21580c1b00 tx=0x7f2154009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:12.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.738+0000 7f214a7fc700 1 -- 172.21.15.81:0/863082828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f214c050b60 con 0x7f215806e000 2023-11-29T11:13:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:12.930+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f21580c2220 con 0x7f215806e000 2023-11-29T11:13:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.010+0000 7f214a7fc700 1 -- 172.21.15.81:0/863082828 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f214c054180 con 0x7f215806e000 2023-11-29T11:13:13.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f213c064ee0 msgr2=0x7f213c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:13.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f213c064ee0 0x7f213c067390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21580c1b00 tx=0x7f2154009040 comp rx=0 tx=0).stop 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 msgr2=0x7f215809a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f215809a490 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f214c009ba0 tx=0x7f214c004770 comp rx=0 tx=0).stop 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 shutdown_connections 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f213c064ee0 0x7f213c067390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21580b0580 0x7f2158070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21580aaf40 0x7f21581f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 --2- 172.21.15.81:0/863082828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215806e000 0x7f215809a490 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 >> 172.21.15.81:0/863082828 conn(0x7f21580cae70 msgr2=0x7f21580cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 shutdown_connections 2023-11-29T11:13:13.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.014+0000 7f215e9df700 1 -- 172.21.15.81:0/863082828 wait complete. 2023-11-29T11:13:13.035 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-29T11:13:13.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-29T11:13:13.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54ffff700 1 Processor -- start 2023-11-29T11:13:13.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54ffff700 1 -- start start 2023-11-29T11:13:13.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc55006ce60 0x7fc5500b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:13.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc5500d1e30 0x7fc55006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:13.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5500d0460 con 0x7fc55006a3a0 2023-11-29T11:13:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5500d3390 con 0x7fc55006ce60 2023-11-29T11:13:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5500d2380 con 0x7fc5500d1e30 2023-11-29T11:13:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc55006a3a0 0x7fc55006a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42858/0 (socket says 172.21.15.81:42858) 2023-11-29T11:13:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc55006ce60 0x7fc5500b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54f7fe700 1 -- 172.21.15.81:0/181229202 learned_addr learned my addr 172.21.15.81:0/181229202 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54e7fc700 1 --2- 172.21.15.81:0/181229202 >> v2:172.21.15.176:3300/0 conn(0x7fc5500d1e30 0x7fc55006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54dffb700 1 -- 172.21.15.81:0/181229202 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378833310 0 0) 0x7fc5500d0460 con 0x7fc55006a3a0 2023-11-29T11:13:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54dffb700 1 -- 172.21.15.81:0/181229202 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5380035d0 con 0x7fc55006a3a0 2023-11-29T11:13:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54effd700 1 -- 172.21.15.81:0/181229202 >> v2:172.21.15.176:3300/0 conn(0x7fc5500d1e30 msgr2=0x7fc55006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54effd700 1 --2- 172.21.15.81:0/181229202 >> v2:172.21.15.176:3300/0 conn(0x7fc5500d1e30 0x7fc55006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54effd700 1 -- 172.21.15.81:0/181229202 >> v1:172.21.15.81:6789/0 conn(0x7fc55006a3a0 legacy=0x7fc55006a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54effd700 1 -- 172.21.15.81:0/181229202 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500d2f00 con 0x7fc55006ce60 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.150+0000 7fc54e7fc700 1 --2- 172.21.15.81:0/181229202 >> v2:172.21.15.176:3300/0 conn(0x7fc5500d1e30 0x7fc55006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54effd700 1 --2- 172.21.15.81:0/181229202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5500b8240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc550066b40 tx=0x7fc544009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351a3dd2c73991c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54dffb700 1 -- 172.21.15.81:0/181229202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544011830 con 0x7fc55006ce60 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54dffb700 1 -- 172.21.15.81:0/181229202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc544011990 con 0x7fc55006ce60 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54dffb700 1 -- 172.21.15.81:0/181229202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544011d00 con 0x7fc55006ce60 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54ffff700 1 -- 172.21.15.81:0/181229202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 msgr2=0x7fc5500b8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54ffff700 1 --2- 172.21.15.81:0/181229202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5500b8240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc550066b40 tx=0x7fc544009b30 comp rx=0 tx=0).stop 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54ffff700 1 -- 172.21.15.81:0/181229202 shutdown_connections 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54ffff700 1 --2- 172.21.15.81:0/181229202 >> v2:172.21.15.176:3300/0 conn(0x7fc5500d1e30 0x7fc55006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54ffff700 1 --2- 172.21.15.81:0/181229202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5500b8240 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54ffff700 1 -- 172.21.15.81:0/181229202 >> 172.21.15.81:0/181229202 conn(0x7fc55009bbd0 msgr2=0x7fc5500b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:13.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54ffff700 1 -- 172.21.15.81:0/181229202 shutdown_connections 2023-11-29T11:13:13.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.154+0000 7fc54ffff700 1 -- 172.21.15.81:0/181229202 wait complete. 2023-11-29T11:13:13.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54ffff700 1 Processor -- start 2023-11-29T11:13:13.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54ffff700 1 -- start start 2023-11-29T11:13:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55006a3a0 0x7fc55015b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5501f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5500d1e30 0x7fc55015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500cf5e0 con 0x7fc55006ce60 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55015c8c0 con 0x7fc5500d1e30 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55015b5a0 con 0x7fc55006a3a0 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5501f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5501f1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44682/0 (socket says 172.21.15.81:44682) 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 -- 172.21.15.81:0/1697225380 learned_addr learned my addr 172.21.15.81:0/1697225380 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54f7fe700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5500d1e30 0x7fc55015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54effd700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55006a3a0 0x7fc55015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 -- 172.21.15.81:0/1697225380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55006a3a0 msgr2=0x7fc55015b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55006a3a0 0x7fc55015b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 -- 172.21.15.81:0/1697225380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5500d1e30 msgr2=0x7fc55015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5500d1e30 0x7fc55015edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 -- 172.21.15.81:0/1697225380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5440094b0 con 0x7fc55006ce60 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.158+0000 7fc54e7fc700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5501f1720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc54000e810 tx=0x7fc54000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc5377fe700 1 -- 172.21.15.81:0/1697225380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540004230 con 0x7fc55006ce60 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc5377fe700 1 -- 172.21.15.81:0/1697225380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc540004390 con 0x7fc55006ce60 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55006d770 con 0x7fc55006ce60 2023-11-29T11:13:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc5377fe700 1 -- 172.21.15.81:0/1697225380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400036c0 con 0x7fc55006ce60 2023-11-29T11:13:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5500d0120 con 0x7fc55006ce60 2023-11-29T11:13:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55015c6e0 con 0x7fc55006ce60 2023-11-29T11:13:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc5377fe700 1 -- 172.21.15.81:0/1697225380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc540022070 con 0x7fc55006ce60 2023-11-29T11:13:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc5377fe700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064ee0 0x7fc53c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc5377fe700 1 -- 172.21.15.81:0/1697225380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc540081a90 con 0x7fc55006ce60 2023-11-29T11:13:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.162+0000 7fc54effd700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064ee0 0x7fc53c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:13.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.166+0000 7fc54effd700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064ee0 0x7fc53c067390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc544000c00 tx=0x7fc544008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.170+0000 7fc5377fe700 1 -- 172.21.15.81:0/1697225380 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc54004f940 con 0x7fc55006ce60 2023-11-29T11:13:13.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:13.370+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc550072500 con 0x7fc55006ce60 2023-11-29T11:13:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.018+0000 7fc5377fe700 1 -- 172.21.15.81:0/1697225380 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc540052f60 con 0x7fc55006ce60 2023-11-29T11:13:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064ee0 msgr2=0x7fc53c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064ee0 0x7fc53c067390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc544000c00 tx=0x7fc544008030 comp rx=0 tx=0).stop 2023-11-29T11:13:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 msgr2=0x7fc5501f1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5501f1720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc54000e810 tx=0x7fc54000eb20 comp rx=0 tx=0).stop 2023-11-29T11:13:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 shutdown_connections 2023-11-29T11:13:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064ee0 0x7fc53c067390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5500d1e30 0x7fc55015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55006ce60 0x7fc5501f1720 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 --2- 172.21.15.81:0/1697225380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55006a3a0 0x7fc55015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 >> 172.21.15.81:0/1697225380 conn(0x7fc55009bbd0 msgr2=0x7fc55015bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 shutdown_connections 2023-11-29T11:13:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.026+0000 7fc54ffff700 1 -- 172.21.15.81:0/1697225380 wait complete. 2023-11-29T11:13:14.046 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-29T11:13:14.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:13:14.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96bfff700 1 Processor -- start 2023-11-29T11:13:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96bfff700 1 -- start start 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96bfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe96c1606b0 0x7fe96c0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe96c0ad610 0x7fe96c0c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0cae70 con 0x7fe96c0ceef0 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0cbc10 con 0x7fe96c0ad610 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96bfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c0cb130 con 0x7fe96c1606b0 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe96c0ad610 0x7fe96c0c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe96c0ad610 0x7fe96c0c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44686/0 (socket says 172.21.15.81:44686) 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96b7fe700 1 -- 172.21.15.81:0/4200968084 learned_addr learned my addr 172.21.15.81:0/4200968084 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96affd700 1 --2- 172.21.15.81:0/4200968084 >> v2:172.21.15.176:3300/0 conn(0x7fe96c1606b0 0x7fe96c0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96b7fe700 1 -- 172.21.15.81:0/4200968084 >> v2:172.21.15.176:3300/0 conn(0x7fe96c1606b0 msgr2=0x7fe96c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96b7fe700 1 --2- 172.21.15.81:0/4200968084 >> v2:172.21.15.176:3300/0 conn(0x7fe96c1606b0 0x7fe96c0c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96b7fe700 1 -- 172.21.15.81:0/4200968084 >> v1:172.21.15.176:6789/0 conn(0x7fe96c0ceef0 legacy=0x7fe96c164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96b7fe700 1 -- 172.21.15.81:0/4200968084 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0cb410 con 0x7fe96c0ad610 2023-11-29T11:13:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96affd700 1 --2- 172.21.15.81:0/4200968084 >> v2:172.21.15.176:3300/0 conn(0x7fe96c1606b0 0x7fe96c0c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe96b7fe700 1 --2- 172.21.15.81:0/4200968084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c0ad610 0x7fe96c0c18f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0b34a0 tx=0x7fe95c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e702873912022f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe969ffb700 1 -- 172.21.15.81:0/4200968084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00b8a0 con 0x7fe96c0ad610 2023-11-29T11:13:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe969ffb700 1 -- 172.21.15.81:0/4200968084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c00ba00 con 0x7fe96c0ad610 2023-11-29T11:13:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.162+0000 7fe969ffb700 1 -- 172.21.15.81:0/4200968084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00bd90 con 0x7fe96c0ad610 2023-11-29T11:13:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 -- 172.21.15.81:0/4200968084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c0ad610 msgr2=0x7fe96c0c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 --2- 172.21.15.81:0/4200968084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c0ad610 0x7fe96c0c18f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0b34a0 tx=0x7fe95c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 -- 172.21.15.81:0/4200968084 shutdown_connections 2023-11-29T11:13:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 --2- 172.21.15.81:0/4200968084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c0ad610 0x7fe96c0c18f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 --2- 172.21.15.81:0/4200968084 >> v2:172.21.15.176:3300/0 conn(0x7fe96c1606b0 0x7fe96c0c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 -- 172.21.15.81:0/4200968084 >> 172.21.15.81:0/4200968084 conn(0x7fe96c0ce3e0 msgr2=0x7fe96c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 -- 172.21.15.81:0/4200968084 shutdown_connections 2023-11-29T11:13:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 -- 172.21.15.81:0/4200968084 wait complete. 2023-11-29T11:13:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 Processor -- start 2023-11-29T11:13:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.166+0000 7fe96bfff700 1 -- start start 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe96c0ad610 0x7fe96c0c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe96c0ceef0 0x7fe96c158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c1606b0 0x7fe96c160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c159130 con 0x7fe96c1606b0 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c15acf0 con 0x7fe96c0ad610 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c15afb0 con 0x7fe96c0ceef0 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c1606b0 0x7fe96c160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c1606b0 0x7fe96c160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44700/0 (socket says 172.21.15.81:44700) 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 -- 172.21.15.81:0/757276095 learned_addr learned my addr 172.21.15.81:0/757276095 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96affd700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe96c0ad610 0x7fe96c0c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96a7fc700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe96c0ceef0 0x7fe96c158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 -- 172.21.15.81:0/757276095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe96c0ceef0 msgr2=0x7fe96c158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe96c0ceef0 0x7fe96c158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 -- 172.21.15.81:0/757276095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe96c0ad610 msgr2=0x7fe96c0c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe96c0ad610 0x7fe96c0c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 -- 172.21.15.81:0/757276095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c009570 con 0x7fe96c1606b0 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96b7fe700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c1606b0 0x7fe96c160a80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe95c014040 tx=0x7fe95c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe963fff700 1 -- 172.21.15.81:0/757276095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0038c0 con 0x7fe96c1606b0 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe963fff700 1 -- 172.21.15.81:0/757276095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c01e070 con 0x7fe96c1606b0 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c06ac50 con 0x7fe96c1606b0 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe963fff700 1 -- 172.21.15.81:0/757276095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c003c60 con 0x7fe96c1606b0 2023-11-29T11:13:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c0cb6f0 con 0x7fe96c1606b0 2023-11-29T11:13:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.170+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c0b36c0 con 0x7fe96c1606b0 2023-11-29T11:13:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.174+0000 7fe963fff700 1 -- 172.21.15.81:0/757276095 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe95c00f050 con 0x7fe96c1606b0 2023-11-29T11:13:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.174+0000 7fe963fff700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe94c064f10 0x7fe94c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.174+0000 7fe963fff700 1 -- 172.21.15.81:0/757276095 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe95c020070 con 0x7fe96c1606b0 2023-11-29T11:13:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.174+0000 7fe96affd700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe94c064f10 0x7fe94c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.174+0000 7fe96affd700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe94c064f10 0x7fe94c0673c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe964009fd0 tx=0x7fe9640097f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.178+0000 7fe963fff700 1 -- 172.21.15.81:0/757276095 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe95c051690 con 0x7fe96c1606b0 2023-11-29T11:13:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.382+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe96c072500 con 0x7fe96c1606b0 2023-11-29T11:13:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe963fff700 1 -- 172.21.15.81:0/757276095 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4644 (secure 0 0 0) 0x7fe95c054cb0 con 0x7fe96c1606b0 2023-11-29T11:13:14.389 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:14.389 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:12:52.329725+0000","modified":"2023-11-29T11:13:14.009106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-29T11:13:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe94c064f10 msgr2=0x7fe94c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe94c064f10 0x7fe94c0673c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe964009fd0 tx=0x7fe9640097f0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c1606b0 msgr2=0x7fe96c160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c1606b0 0x7fe96c160a80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe95c014040 tx=0x7fe95c004770 comp rx=0 tx=0).stop 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 shutdown_connections 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe94c064f10 0x7fe94c0673c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c1606b0 0x7fe96c160a80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe96c0ceef0 0x7fe96c158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 --2- 172.21.15.81:0/757276095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe96c0ad610 0x7fe96c0c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 >> 172.21.15.81:0/757276095 conn(0x7fe96c0ce3e0 msgr2=0x7fe96c070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 shutdown_connections 2023-11-29T11:13:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.386+0000 7fe96bfff700 1 -- 172.21.15.81:0/757276095 wait complete. 2023-11-29T11:13:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-11-29T11:13:14.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.506+0000 7f3f255f7700 1 Processor -- start 2023-11-29T11:13:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.506+0000 7f3f255f7700 1 -- start start 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.506+0000 7f3f255f7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f200cc360 0x7f3f200cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.506+0000 7f3f255f7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3f201607b0 0x7f3f200ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.506+0000 7f3f255f7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f200cd000 0x7f3f200cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.506+0000 7f3f255f7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f200d04c0 con 0x7f3f200cd000 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.506+0000 7f3f255f7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f200cd9c0 con 0x7f3f201607b0 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.506+0000 7f3f255f7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200cc730 con 0x7f3f200cc360 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f200cd000 0x7f3f200cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f200cd000 0x7f3f200cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44706/0 (socket says 172.21.15.81:44706) 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 -- 172.21.15.81:0/888065554 learned_addr learned my addr 172.21.15.81:0/888065554 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f177fe700 1 --2- 172.21.15.81:0/888065554 >> v2:172.21.15.176:3300/0 conn(0x7f3f201607b0 0x7f3f200ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f1ffff700 1 --2- 172.21.15.81:0/888065554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f200cc360 0x7f3f200cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 -- 172.21.15.81:0/888065554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f200cc360 msgr2=0x7f3f200cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 --2- 172.21.15.81:0/888065554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f200cc360 0x7f3f200cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 -- 172.21.15.81:0/888065554 >> v2:172.21.15.176:3300/0 conn(0x7f3f201607b0 msgr2=0x7f3f200ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 --2- 172.21.15.81:0/888065554 >> v2:172.21.15.176:3300/0 conn(0x7f3f201607b0 0x7f3f200ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 -- 172.21.15.81:0/888065554 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f200b1f30 con 0x7f3f200cd000 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f177fe700 1 --2- 172.21.15.81:0/888065554 >> v2:172.21.15.176:3300/0 conn(0x7f3f201607b0 0x7f3f200ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f24df6700 1 --2- 172.21.15.81:0/888065554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200cd480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3f2006b270 tx=0x7f3f1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5234123be8635443 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f1f7fe700 1 -- 172.21.15.81:0/888065554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800e070 con 0x7f3f200cd000 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f1f7fe700 1 -- 172.21.15.81:0/888065554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1800b9c0 con 0x7f3f200cd000 2023-11-29T11:13:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f1f7fe700 1 -- 172.21.15.81:0/888065554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800bd70 con 0x7f3f200cd000 2023-11-29T11:13:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 -- 172.21.15.81:0/888065554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 msgr2=0x7f3f200cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 --2- 172.21.15.81:0/888065554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200cd480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3f2006b270 tx=0x7f3f1800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 -- 172.21.15.81:0/888065554 shutdown_connections 2023-11-29T11:13:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 --2- 172.21.15.81:0/888065554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200cd480 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 --2- 172.21.15.81:0/888065554 >> v2:172.21.15.176:3300/0 conn(0x7f3f201607b0 0x7f3f200ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 --2- 172.21.15.81:0/888065554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f200cc360 0x7f3f200cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 -- 172.21.15.81:0/888065554 >> 172.21.15.81:0/888065554 conn(0x7f3f200b2140 msgr2=0x7f3f200b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 -- 172.21.15.81:0/888065554 shutdown_connections 2023-11-29T11:13:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.510+0000 7f3f255f7700 1 -- 172.21.15.81:0/888065554 wait complete. 2023-11-29T11:13:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 Processor -- start 2023-11-29T11:13:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 -- start start 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f200cc360 0x7f3f200ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f201607b0 0x7f3f2014daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200ae8a0 con 0x7f3f200cd000 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200abda0 con 0x7f3f200cc360 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2014edb0 con 0x7f3f201607b0 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44716/0 (socket says 172.21.15.81:44716) 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 -- 172.21.15.81:0/1559933941 learned_addr learned my addr 172.21.15.81:0/1559933941 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f1ffff700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f200cc360 0x7f3f200ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f24df6700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f201607b0 0x7f3f2014daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 -- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f201607b0 msgr2=0x7f3f2014daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f201607b0 0x7f3f2014daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 -- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f200cc360 msgr2=0x7f3f200ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f200cc360 0x7f3f200ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 -- 172.21.15.81:0/1559933941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18009b30 con 0x7f3f200cd000 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f1ffff700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f200cc360 0x7f3f200ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f177fe700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200ab860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800e810 tx=0x7f3f0800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f1d7fa700 1 -- 172.21.15.81:0/1559933941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08005c40 con 0x7f3f200cd000 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f1d7fa700 1 -- 172.21.15.81:0/1559933941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f08005da0 con 0x7f3f200cd000 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f200d01e0 con 0x7f3f200cd000 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f1d7fa700 1 -- 172.21.15.81:0/1559933941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08004250 con 0x7f3f200cd000 2023-11-29T11:13:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.514+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f200ce740 con 0x7f3f200cd000 2023-11-29T11:13:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.518+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2015fcd0 con 0x7f3f200cd000 2023-11-29T11:13:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.518+0000 7f3f1d7fa700 1 -- 172.21.15.81:0/1559933941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3f08022070 con 0x7f3f200cd000 2023-11-29T11:13:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.518+0000 7f3f1d7fa700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f00064ee0 0x7f3f00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.518+0000 7f3f1d7fa700 1 -- 172.21.15.81:0/1559933941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f08082010 con 0x7f3f200cd000 2023-11-29T11:13:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.518+0000 7f3f1ffff700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f00064ee0 0x7f3f00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.518+0000 7f3f1ffff700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f00064ee0 0x7f3f00067390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3f10007a70 tx=0x7f3f10008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.526+0000 7f3f1d7fa700 1 -- 172.21.15.81:0/1559933941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3f0804fe40 con 0x7f3f200cd000 2023-11-29T11:13:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.686+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f20072500 con 0x7f3f200cd000 2023-11-29T11:13:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.690+0000 7f3f1d7fa700 1 -- 172.21.15.81:0/1559933941 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f3f08053460 con 0x7f3f200cd000 2023-11-29T11:13:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:14.695 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f00064ee0 msgr2=0x7f3f00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f00064ee0 0x7f3f00067390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3f10007a70 tx=0x7f3f10008040 comp rx=0 tx=0).stop 2023-11-29T11:13:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 msgr2=0x7f3f200ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200ab860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800e810 tx=0x7f3f0800ebd0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 shutdown_connections 2023-11-29T11:13:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f00064ee0 0x7f3f00067390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f201607b0 0x7f3f2014daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200cd000 0x7f3f200ab860 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 --2- 172.21.15.81:0/1559933941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f200cc360 0x7f3f200ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 >> 172.21.15.81:0/1559933941 conn(0x7f3f200b2140 msgr2=0x7f3f2015e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:14.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 shutdown_connections 2023-11-29T11:13:14.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.694+0000 7f3f255f7700 1 -- 172.21.15.81:0/1559933941 wait complete. 2023-11-29T11:13:14.710 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-29T11:13:14.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:13:14.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b4aa33700 1 Processor -- start 2023-11-29T11:13:14.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b4aa33700 1 -- start start 2023-11-29T11:13:14.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b4aa33700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b44159e70 0x7f1b4406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b4aa33700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b44069c40 0x7f1b440cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b4aa33700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1b4406cee0 0x7f1b440cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b4aa33700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4406ace0 con 0x7f1b44159e70 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b4aa33700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4406a0d0 con 0x7f1b4406cee0 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b4aa33700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4406a3b0 con 0x7f1b44069c40 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b49a31700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b44159e70 0x7f1b4406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b49a31700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b44159e70 0x7f1b4406c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44720/0 (socket says 172.21.15.81:44720) 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.810+0000 7f1b49a31700 1 -- 172.21.15.81:0/2298434402 learned_addr learned my addr 172.21.15.81:0/2298434402 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b49230700 1 --2- 172.21.15.81:0/2298434402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b44069c40 0x7f1b440cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4a232700 1 --2- 172.21.15.81:0/2298434402 >> v2:172.21.15.176:3300/0 conn(0x7f1b4406cee0 0x7f1b440cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b49a31700 1 -- 172.21.15.81:0/2298434402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b44069c40 msgr2=0x7f1b440cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:14.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b49a31700 1 --2- 172.21.15.81:0/2298434402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b44069c40 0x7f1b440cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b49a31700 1 -- 172.21.15.81:0/2298434402 >> v2:172.21.15.176:3300/0 conn(0x7f1b4406cee0 msgr2=0x7f1b440cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:14.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b49a31700 1 --2- 172.21.15.81:0/2298434402 >> v2:172.21.15.176:3300/0 conn(0x7f1b4406cee0 0x7f1b440cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b49a31700 1 -- 172.21.15.81:0/2298434402 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4406a690 con 0x7f1b44159e70 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b49230700 1 --2- 172.21.15.81:0/2298434402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b44069c40 0x7f1b440cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b49a31700 1 --2- 172.21.15.81:0/2298434402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b4406c9a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b440b12c0 tx=0x7f1b34009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed8efbe4d6626a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b48a2f700 1 -- 172.21.15.81:0/2298434402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34011830 con 0x7f1b44159e70 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b48a2f700 1 -- 172.21.15.81:0/2298434402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34011990 con 0x7f1b44159e70 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b48a2f700 1 -- 172.21.15.81:0/2298434402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34011d20 con 0x7f1b44159e70 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 -- 172.21.15.81:0/2298434402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 msgr2=0x7f1b4406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/2298434402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b4406c9a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b440b12c0 tx=0x7f1b34009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 -- 172.21.15.81:0/2298434402 shutdown_connections 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/2298434402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b44069c40 0x7f1b440cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/2298434402 >> v2:172.21.15.176:3300/0 conn(0x7f1b4406cee0 0x7f1b440cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/2298434402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b4406c9a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 -- 172.21.15.81:0/2298434402 >> 172.21.15.81:0/2298434402 conn(0x7f1b440ce3e0 msgr2=0x7f1b440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 -- 172.21.15.81:0/2298434402 shutdown_connections 2023-11-29T11:13:14.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.814+0000 7f1b4aa33700 1 -- 172.21.15.81:0/2298434402 wait complete. 2023-11-29T11:13:14.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4aa33700 1 Processor -- start 2023-11-29T11:13:14.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4aa33700 1 -- start start 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4aa33700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b44069c40 0x7f1b4415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4aa33700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b4406cee0 0x7f1b440acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4aa33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b44157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4aa33700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b440ad470 con 0x7f1b44159e70 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4aa33700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4415c370 con 0x7f1b44069c40 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4aa33700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4415c650 con 0x7f1b4406cee0 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b44157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b44157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44736/0 (socket says 172.21.15.81:44736) 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 -- 172.21.15.81:0/764821759 learned_addr learned my addr 172.21.15.81:0/764821759 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b49230700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b4406cee0 0x7f1b440acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b49a31700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b44069c40 0x7f1b4415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 -- 172.21.15.81:0/764821759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b4406cee0 msgr2=0x7f1b440acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b4406cee0 0x7f1b440acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 -- 172.21.15.81:0/764821759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b44069c40 msgr2=0x7f1b4415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:14.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b44069c40 0x7f1b4415bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:14.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 -- 172.21.15.81:0/764821759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400094b0 con 0x7f1b44159e70 2023-11-29T11:13:14.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b4a232700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b44157520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00efc0 tx=0x7f1b3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b3a7fc700 1 -- 172.21.15.81:0/764821759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c009ea0 con 0x7f1b44159e70 2023-11-29T11:13:14.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.818+0000 7f1b3a7fc700 1 -- 172.21.15.81:0/764821759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c00f040 con 0x7f1b44159e70 2023-11-29T11:13:14.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b34009570 con 0x7f1b44159e70 2023-11-29T11:13:14.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b3a7fc700 1 -- 172.21.15.81:0/764821759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c00ced0 con 0x7f1b44159e70 2023-11-29T11:13:14.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4415a240 con 0x7f1b44159e70 2023-11-29T11:13:14.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4406a970 con 0x7f1b44159e70 2023-11-29T11:13:14.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b3a7fc700 1 -- 172.21.15.81:0/764821759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1b3c014480 con 0x7f1b44159e70 2023-11-29T11:13:14.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b3a7fc700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b28064ee0 0x7f1b28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:14.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b49a31700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b28064ee0 0x7f1b28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:14.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b3a7fc700 1 -- 172.21.15.81:0/764821759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b3c082a00 con 0x7f1b44159e70 2023-11-29T11:13:14.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.822+0000 7f1b49a31700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b28064ee0 0x7f1b28067390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b34000c00 tx=0x7f1b34008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:14.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.830+0000 7f1b3a7fc700 1 -- 172.21.15.81:0/764821759 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1b3c050850 con 0x7f1b44159e70 2023-11-29T11:13:14.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:14.990+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b440b32e0 con 0x7f1b28064ee0 2023-11-29T11:13:15.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.010+0000 7f1b3a7fc700 1 -- 172.21.15.81:0/764821759 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367440 (secure 0 0 0) 0x7f1b440b32e0 con 0x7f1b28064ee0 2023-11-29T11:13:15.020 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b28064ee0 msgr2=0x7f1b28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b28064ee0 0x7f1b28067390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b34000c00 tx=0x7f1b34008030 comp rx=0 tx=0).stop 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 msgr2=0x7f1b44157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b44157520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00efc0 tx=0x7f1b3c00c3a0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 shutdown_connections 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b28064ee0 0x7f1b28067390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b44159e70 0x7f1b44157520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b4406cee0 0x7f1b440acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 --2- 172.21.15.81:0/764821759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b44069c40 0x7f1b4415bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 >> 172.21.15.81:0/764821759 conn(0x7f1b440ce3e0 msgr2=0x7f1b440c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 shutdown_connections 2023-11-29T11:13:15.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.018+0000 7f1b4aa33700 1 -- 172.21.15.81:0/764821759 wait complete. 2023-11-29T11:13:15.024 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:13:15.037 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-29T11:13:14.430391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67364,"kb_used_data":3364,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907356,"statfs":{"total":773094113280,"available":773025132544,"internally_reserved":0,"allocated":3444736,"data_stored":2092668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1749,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004775"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397456+0000","last_change":"2023-11-29T11:12:56.392727+0000","last_active":"2023-11-29T11:12:56.397456+0000","last_peered":"2023-11-29T11:12:56.397456+0000","last_clean":"2023-11-29T11:12:56.397456+0000","last_became_active":"2023-11-29T11:12:56.392278+0000","last_became_peered":"2023-11-29T11:12:56.392278+0000","last_unstale":"2023-11-29T11:12:56.397456+0000","last_undegraded":"2023-11-29T11:12:56.397456+0000","last_fullsized":"2023-11-29T11:12:56.397456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:05.548254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384796+0000","last_change":"2023-11-29T11:12:51.981171+0000","last_active":"2023-11-29T11:12:56.384796+0000","last_peered":"2023-11-29T11:12:56.384796+0000","last_clean":"2023-11-29T11:12:56.384796+0000","last_became_active":"2023-11-29T11:12:51.979647+0000","last_became_peered":"2023-11-29T11:12:51.979647+0000","last_unstale":"2023-11-29T11:12:56.384796+0000","last_undegraded":"2023-11-29T11:12:56.384796+0000","last_fullsized":"2023-11-29T11:12:56.384796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379179+0000","last_change":"2023-11-29T11:12:52.373329+0000","last_active":"2023-11-29T11:12:56.379179+0000","last_peered":"2023-11-29T11:12:56.379179+0000","last_clean":"2023-11-29T11:12:56.379179+0000","last_became_active":"2023-11-29T11:12:52.373080+0000","last_became_peered":"2023-11-29T11:12:52.373080+0000","last_unstale":"2023-11-29T11:12:56.379179+0000","last_undegraded":"2023-11-29T11:12:56.379179+0000","last_fullsized":"2023-11-29T11:12:56.379179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:33.415072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399892+0000","last_change":"2023-11-29T11:12:56.393396+0000","last_active":"2023-11-29T11:12:56.399892+0000","last_peered":"2023-11-29T11:12:56.399892+0000","last_clean":"2023-11-29T11:12:56.399892+0000","last_became_active":"2023-11-29T11:12:56.392958+0000","last_became_peered":"2023-11-29T11:12:56.392958+0000","last_unstale":"2023-11-29T11:12:56.399892+0000","last_undegraded":"2023-11-29T11:12:56.399892+0000","last_fullsized":"2023-11-29T11:12:56.399892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:08:53.005631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374292+0000","last_change":"2023-11-29T11:12:51.984861+0000","last_active":"2023-11-29T11:12:56.374292+0000","last_peered":"2023-11-29T11:12:56.374292+0000","last_clean":"2023-11-29T11:12:56.374292+0000","last_became_active":"2023-11-29T11:12:51.984221+0000","last_became_peered":"2023-11-29T11:12:51.984221+0000","last_unstale":"2023-11-29T11:12:56.374292+0000","last_undegraded":"2023-11-29T11:12:56.374292+0000","last_fullsized":"2023-11-29T11:12:56.374292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:03:52.716864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368510+0000","last_change":"2023-11-29T11:12:52.361315+0000","last_active":"2023-11-29T11:12:56.368510+0000","last_peered":"2023-11-29T11:12:56.368510+0000","last_clean":"2023-11-29T11:12:56.368510+0000","last_became_active":"2023-11-29T11:12:52.361046+0000","last_became_peered":"2023-11-29T11:12:52.361046+0000","last_unstale":"2023-11-29T11:12:56.368510+0000","last_undegraded":"2023-11-29T11:12:56.368510+0000","last_fullsized":"2023-11-29T11:12:56.368510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:48.301408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402905+0000","last_change":"2023-11-29T11:12:56.397174+0000","last_active":"2023-11-29T11:12:56.402905+0000","last_peered":"2023-11-29T11:12:56.402905+0000","last_clean":"2023-11-29T11:12:56.402905+0000","last_became_active":"2023-11-29T11:12:56.395990+0000","last_became_peered":"2023-11-29T11:12:56.395990+0000","last_unstale":"2023-11-29T11:12:56.402905+0000","last_undegraded":"2023-11-29T11:12:56.402905+0000","last_fullsized":"2023-11-29T11:12:56.402905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:32:53.734519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384497+0000","last_change":"2023-11-29T11:12:51.984821+0000","last_active":"2023-11-29T11:12:56.384497+0000","last_peered":"2023-11-29T11:12:56.384497+0000","last_clean":"2023-11-29T11:12:56.384497+0000","last_became_active":"2023-11-29T11:12:51.984531+0000","last_became_peered":"2023-11-29T11:12:51.984531+0000","last_unstale":"2023-11-29T11:12:56.384497+0000","last_undegraded":"2023-11-29T11:12:56.384497+0000","last_fullsized":"2023-11-29T11:12:56.384497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:54.630966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381153+0000","last_change":"2023-11-29T11:12:52.369059+0000","last_active":"2023-11-29T11:12:56.381153+0000","last_peered":"2023-11-29T11:12:56.381153+0000","last_clean":"2023-11-29T11:12:56.381153+0000","last_became_active":"2023-11-29T11:12:52.368705+0000","last_became_peered":"2023-11-29T11:12:52.368705+0000","last_unstale":"2023-11-29T11:12:56.381153+0000","last_undegraded":"2023-11-29T11:12:56.381153+0000","last_fullsized":"2023-11-29T11:12:56.381153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:53:43.004864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401291+0000","last_change":"2023-11-29T11:12:56.394933+0000","last_active":"2023-11-29T11:12:56.401291+0000","last_peered":"2023-11-29T11:12:56.401291+0000","last_clean":"2023-11-29T11:12:56.401291+0000","last_became_active":"2023-11-29T11:12:56.394448+0000","last_became_peered":"2023-11-29T11:12:56.394448+0000","last_unstale":"2023-11-29T11:12:56.401291+0000","last_undegraded":"2023-11-29T11:12:56.401291+0000","last_fullsized":"2023-11-29T11:12:56.401291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:51.264472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383467+0000","last_change":"2023-11-29T11:12:51.984966+0000","last_active":"2023-11-29T11:12:56.383467+0000","last_peered":"2023-11-29T11:12:56.383467+0000","last_clean":"2023-11-29T11:12:56.383467+0000","last_became_active":"2023-11-29T11:12:51.984504+0000","last_became_peered":"2023-11-29T11:12:51.984504+0000","last_unstale":"2023-11-29T11:12:56.383467+0000","last_undegraded":"2023-11-29T11:12:56.383467+0000","last_fullsized":"2023-11-29T11:12:56.383467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:27:55.174112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380063+0000","last_change":"2023-11-29T11:12:52.369471+0000","last_active":"2023-11-29T11:12:56.380063+0000","last_peered":"2023-11-29T11:12:56.380063+0000","last_clean":"2023-11-29T11:12:56.380063+0000","last_became_active":"2023-11-29T11:12:52.369037+0000","last_became_peered":"2023-11-29T11:12:52.369037+0000","last_unstale":"2023-11-29T11:12:56.380063+0000","last_undegraded":"2023-11-29T11:12:56.380063+0000","last_fullsized":"2023-11-29T11:12:56.380063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:58:11.106615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397379+0000","last_change":"2023-11-29T11:12:56.392830+0000","last_active":"2023-11-29T11:12:56.397379+0000","last_peered":"2023-11-29T11:12:56.397379+0000","last_clean":"2023-11-29T11:12:56.397379+0000","last_became_active":"2023-11-29T11:12:56.392385+0000","last_became_peered":"2023-11-29T11:12:56.392385+0000","last_unstale":"2023-11-29T11:12:56.397379+0000","last_undegraded":"2023-11-29T11:12:56.397379+0000","last_fullsized":"2023-11-29T11:12:56.397379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385374+0000","last_change":"2023-11-29T11:12:51.978019+0000","last_active":"2023-11-29T11:12:56.385374+0000","last_peered":"2023-11-29T11:12:56.385374+0000","last_clean":"2023-11-29T11:12:56.385374+0000","last_became_active":"2023-11-29T11:12:51.977720+0000","last_became_peered":"2023-11-29T11:12:51.977720+0000","last_unstale":"2023-11-29T11:12:56.385374+0000","last_undegraded":"2023-11-29T11:12:56.385374+0000","last_fullsized":"2023-11-29T11:12:56.385374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:01.519677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374628+0000","last_change":"2023-11-29T11:12:52.366401+0000","last_active":"2023-11-29T11:12:56.374628+0000","last_peered":"2023-11-29T11:12:56.374628+0000","last_clean":"2023-11-29T11:12:56.374628+0000","last_became_active":"2023-11-29T11:12:52.366140+0000","last_became_peered":"2023-11-29T11:12:52.366140+0000","last_unstale":"2023-11-29T11:12:56.374628+0000","last_undegraded":"2023-11-29T11:12:56.374628+0000","last_fullsized":"2023-11-29T11:12:56.374628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:49.550223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397485+0000","last_change":"2023-11-29T11:12:56.390565+0000","last_active":"2023-11-29T11:12:56.397485+0000","last_peered":"2023-11-29T11:12:56.397485+0000","last_clean":"2023-11-29T11:12:56.397485+0000","last_became_active":"2023-11-29T11:12:56.389869+0000","last_became_peered":"2023-11-29T11:12:56.389869+0000","last_unstale":"2023-11-29T11:12:56.397485+0000","last_undegraded":"2023-11-29T11:12:56.397485+0000","last_fullsized":"2023-11-29T11:12:56.397485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:08:27.735011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381346+0000","last_change":"2023-11-29T11:12:51.979373+0000","last_active":"2023-11-29T11:12:56.381346+0000","last_peered":"2023-11-29T11:12:56.381346+0000","last_clean":"2023-11-29T11:12:56.381346+0000","last_became_active":"2023-11-29T11:12:51.979051+0000","last_became_peered":"2023-11-29T11:12:51.979051+0000","last_unstale":"2023-11-29T11:12:56.381346+0000","last_undegraded":"2023-11-29T11:12:56.381346+0000","last_fullsized":"2023-11-29T11:12:56.381346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.373881+0000","last_change":"2023-11-29T11:12:52.365896+0000","last_active":"2023-11-29T11:12:56.373881+0000","last_peered":"2023-11-29T11:12:56.373881+0000","last_clean":"2023-11-29T11:12:56.373881+0000","last_became_active":"2023-11-29T11:12:52.365622+0000","last_became_peered":"2023-11-29T11:12:52.365622+0000","last_unstale":"2023-11-29T11:12:56.373881+0000","last_undegraded":"2023-11-29T11:12:56.373881+0000","last_fullsized":"2023-11-29T11:12:56.373881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:29.530084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399062+0000","last_change":"2023-11-29T11:12:56.391160+0000","last_active":"2023-11-29T11:12:56.399062+0000","last_peered":"2023-11-29T11:12:56.399062+0000","last_clean":"2023-11-29T11:12:56.399062+0000","last_became_active":"2023-11-29T11:12:56.390771+0000","last_became_peered":"2023-11-29T11:12:56.390771+0000","last_unstale":"2023-11-29T11:12:56.399062+0000","last_undegraded":"2023-11-29T11:12:56.399062+0000","last_fullsized":"2023-11-29T11:12:56.399062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:28:19.746284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.386885+0000","last_change":"2023-11-29T11:12:51.987080+0000","last_active":"2023-11-29T11:12:56.386885+0000","last_peered":"2023-11-29T11:12:56.386885+0000","last_clean":"2023-11-29T11:12:56.386885+0000","last_became_active":"2023-11-29T11:12:51.986730+0000","last_became_peered":"2023-11-29T11:12:51.986730+0000","last_unstale":"2023-11-29T11:12:56.386885+0000","last_undegraded":"2023-11-29T11:12:56.386885+0000","last_fullsized":"2023-11-29T11:12:56.386885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:01.519677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385050+0000","last_change":"2023-11-29T11:12:52.367490+0000","last_active":"2023-11-29T11:12:56.385050+0000","last_peered":"2023-11-29T11:12:56.385050+0000","last_clean":"2023-11-29T11:12:56.385050+0000","last_became_active":"2023-11-29T11:12:52.367253+0000","last_became_peered":"2023-11-29T11:12:52.367253+0000","last_unstale":"2023-11-29T11:12:56.385050+0000","last_undegraded":"2023-11-29T11:12:56.385050+0000","last_fullsized":"2023-11-29T11:12:56.385050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:12.463644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.395950+0000","last_change":"2023-11-29T11:12:56.390849+0000","last_active":"2023-11-29T11:12:56.395950+0000","last_peered":"2023-11-29T11:12:56.395950+0000","last_clean":"2023-11-29T11:12:56.395950+0000","last_became_active":"2023-11-29T11:12:56.390401+0000","last_became_peered":"2023-11-29T11:12:56.390401+0000","last_unstale":"2023-11-29T11:12:56.395950+0000","last_undegraded":"2023-11-29T11:12:56.395950+0000","last_fullsized":"2023-11-29T11:12:56.395950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368794+0000","last_change":"2023-11-29T11:12:51.985928+0000","last_active":"2023-11-29T11:12:56.368794+0000","last_peered":"2023-11-29T11:12:56.368794+0000","last_clean":"2023-11-29T11:12:56.368794+0000","last_became_active":"2023-11-29T11:12:51.985417+0000","last_became_peered":"2023-11-29T11:12:51.985417+0000","last_unstale":"2023-11-29T11:12:56.368794+0000","last_undegraded":"2023-11-29T11:12:56.368794+0000","last_fullsized":"2023-11-29T11:12:56.368794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370624+0000","last_change":"2023-11-29T11:12:52.359182+0000","last_active":"2023-11-29T11:12:56.370624+0000","last_peered":"2023-11-29T11:12:56.370624+0000","last_clean":"2023-11-29T11:12:56.370624+0000","last_became_active":"2023-11-29T11:12:52.358870+0000","last_became_peered":"2023-11-29T11:12:52.358870+0000","last_unstale":"2023-11-29T11:12:56.370624+0000","last_undegraded":"2023-11-29T11:12:56.370624+0000","last_fullsized":"2023-11-29T11:12:56.370624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:47:38.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368358+0000","last_change":"2023-11-29T11:12:52.357426+0000","last_active":"2023-11-29T11:12:56.368358+0000","last_peered":"2023-11-29T11:12:56.368358+0000","last_clean":"2023-11-29T11:12:56.368358+0000","last_became_active":"2023-11-29T11:12:52.357165+0000","last_became_peered":"2023-11-29T11:12:52.357165+0000","last_unstale":"2023-11-29T11:12:56.368358+0000","last_undegraded":"2023-11-29T11:12:56.368358+0000","last_fullsized":"2023-11-29T11:12:56.368358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:37.215861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384878+0000","last_change":"2023-11-29T11:12:51.981423+0000","last_active":"2023-11-29T11:12:56.384878+0000","last_peered":"2023-11-29T11:12:56.384878+0000","last_clean":"2023-11-29T11:12:56.384878+0000","last_became_active":"2023-11-29T11:12:51.981102+0000","last_became_peered":"2023-11-29T11:12:51.981102+0000","last_unstale":"2023-11-29T11:12:56.384878+0000","last_undegraded":"2023-11-29T11:12:56.384878+0000","last_fullsized":"2023-11-29T11:12:56.384878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:34:18.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.393001+0000","last_change":"2023-11-29T11:12:56.388444+0000","last_active":"2023-11-29T11:12:56.393001+0000","last_peered":"2023-11-29T11:12:56.393001+0000","last_clean":"2023-11-29T11:12:56.393001+0000","last_became_active":"2023-11-29T11:12:56.388033+0000","last_became_peered":"2023-11-29T11:12:56.388033+0000","last_unstale":"2023-11-29T11:12:56.393001+0000","last_undegraded":"2023-11-29T11:12:56.393001+0000","last_fullsized":"2023-11-29T11:12:56.393001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:29.691459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368852+0000","last_change":"2023-11-29T11:12:52.365695+0000","last_active":"2023-11-29T11:12:56.368852+0000","last_peered":"2023-11-29T11:12:56.368852+0000","last_clean":"2023-11-29T11:12:56.368852+0000","last_became_active":"2023-11-29T11:12:52.365402+0000","last_became_peered":"2023-11-29T11:12:52.365402+0000","last_unstale":"2023-11-29T11:12:56.368852+0000","last_undegraded":"2023-11-29T11:12:56.368852+0000","last_fullsized":"2023-11-29T11:12:56.368852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384074+0000","last_change":"2023-11-29T11:12:51.978492+0000","last_active":"2023-11-29T11:12:56.384074+0000","last_peered":"2023-11-29T11:12:56.384074+0000","last_clean":"2023-11-29T11:12:56.384074+0000","last_became_active":"2023-11-29T11:12:51.978133+0000","last_became_peered":"2023-11-29T11:12:51.978133+0000","last_unstale":"2023-11-29T11:12:56.384074+0000","last_undegraded":"2023-11-29T11:12:56.384074+0000","last_fullsized":"2023-11-29T11:12:56.384074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:24:13.769187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401152+0000","last_change":"2023-11-29T11:12:56.393246+0000","last_active":"2023-11-29T11:12:56.401152+0000","last_peered":"2023-11-29T11:12:56.401152+0000","last_clean":"2023-11-29T11:12:56.401152+0000","last_became_active":"2023-11-29T11:12:56.392790+0000","last_became_peered":"2023-11-29T11:12:56.392790+0000","last_unstale":"2023-11-29T11:12:56.401152+0000","last_undegraded":"2023-11-29T11:12:56.401152+0000","last_fullsized":"2023-11-29T11:12:56.401152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:06:44.806489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380906+0000","last_change":"2023-11-29T11:12:51.986109+0000","last_active":"2023-11-29T11:12:56.380906+0000","last_peered":"2023-11-29T11:12:56.380906+0000","last_clean":"2023-11-29T11:12:56.380906+0000","last_became_active":"2023-11-29T11:12:51.985826+0000","last_became_peered":"2023-11-29T11:12:51.985826+0000","last_unstale":"2023-11-29T11:12:56.380906+0000","last_undegraded":"2023-11-29T11:12:56.380906+0000","last_fullsized":"2023-11-29T11:12:56.380906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:02:48.630613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387087+0000","last_change":"2023-11-29T11:12:52.356463+0000","last_active":"2023-11-29T11:12:56.387087+0000","last_peered":"2023-11-29T11:12:56.387087+0000","last_clean":"2023-11-29T11:12:56.387087+0000","last_became_active":"2023-11-29T11:12:52.356197+0000","last_became_peered":"2023-11-29T11:12:52.356197+0000","last_unstale":"2023-11-29T11:12:56.387087+0000","last_undegraded":"2023-11-29T11:12:56.387087+0000","last_fullsized":"2023-11-29T11:12:56.387087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:24:54.414088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400777+0000","last_change":"2023-11-29T11:12:56.390106+0000","last_active":"2023-11-29T11:12:56.400777+0000","last_peered":"2023-11-29T11:12:56.400777+0000","last_clean":"2023-11-29T11:12:56.400777+0000","last_became_active":"2023-11-29T11:12:56.389286+0000","last_became_peered":"2023-11-29T11:12:56.389286+0000","last_unstale":"2023-11-29T11:12:56.400777+0000","last_undegraded":"2023-11-29T11:12:56.400777+0000","last_fullsized":"2023-11-29T11:12:56.400777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:20:15.664819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'9","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-29T11:13:01.224105+0000","last_change":"2023-11-29T11:12:51.981433+0000","last_active":"2023-11-29T11:13:01.224105+0000","last_peered":"2023-11-29T11:13:01.224105+0000","last_clean":"2023-11-29T11:13:01.224105+0000","last_became_active":"2023-11-29T11:12:51.981169+0000","last_became_peered":"2023-11-29T11:12:51.981169+0000","last_unstale":"2023-11-29T11:13:01.224105+0000","last_undegraded":"2023-11-29T11:13:01.224105+0000","last_fullsized":"2023-11-29T11:13:01.224105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380175+0000","last_change":"2023-11-29T11:12:52.372116+0000","last_active":"2023-11-29T11:12:56.380175+0000","last_peered":"2023-11-29T11:12:56.380175+0000","last_clean":"2023-11-29T11:12:56.380175+0000","last_became_active":"2023-11-29T11:12:52.371831+0000","last_became_peered":"2023-11-29T11:12:52.371831+0000","last_unstale":"2023-11-29T11:12:56.380175+0000","last_undegraded":"2023-11-29T11:12:56.380175+0000","last_fullsized":"2023-11-29T11:12:56.380175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.396928+0000","last_change":"2023-11-29T11:12:56.391717+0000","last_active":"2023-11-29T11:12:56.396928+0000","last_peered":"2023-11-29T11:12:56.396928+0000","last_clean":"2023-11-29T11:12:56.396928+0000","last_became_active":"2023-11-29T11:12:56.391290+0000","last_became_peered":"2023-11-29T11:12:56.391290+0000","last_unstale":"2023-11-29T11:12:56.396928+0000","last_undegraded":"2023-11-29T11:12:56.396928+0000","last_fullsized":"2023-11-29T11:12:56.396928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:42:59.881221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387181+0000","last_change":"2023-11-29T11:12:52.352949+0000","last_active":"2023-11-29T11:12:56.387181+0000","last_peered":"2023-11-29T11:12:56.387181+0000","last_clean":"2023-11-29T11:12:56.387181+0000","last_became_active":"2023-11-29T11:12:52.350912+0000","last_became_peered":"2023-11-29T11:12:52.350912+0000","last_unstale":"2023-11-29T11:12:56.387181+0000","last_undegraded":"2023-11-29T11:12:56.387181+0000","last_fullsized":"2023-11-29T11:12:56.387181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:42.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370718+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:12:56.370718+0000","last_peered":"2023-11-29T11:12:56.370718+0000","last_clean":"2023-11-29T11:12:56.370718+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:12:56.370718+0000","last_undegraded":"2023-11-29T11:12:56.370718+0000","last_fullsized":"2023-11-29T11:12:56.370718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384623+0000","last_change":"2023-11-29T11:12:51.986760+0000","last_active":"2023-11-29T11:12:56.384623+0000","last_peered":"2023-11-29T11:12:56.384623+0000","last_clean":"2023-11-29T11:12:56.384623+0000","last_became_active":"2023-11-29T11:12:51.986475+0000","last_became_peered":"2023-11-29T11:12:51.986475+0000","last_unstale":"2023-11-29T11:12:56.384623+0000","last_undegraded":"2023-11-29T11:12:56.384623+0000","last_fullsized":"2023-11-29T11:12:56.384623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:41:14.704468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400660+0000","last_change":"2023-11-29T11:12:56.395998+0000","last_active":"2023-11-29T11:12:56.400660+0000","last_peered":"2023-11-29T11:12:56.400660+0000","last_clean":"2023-11-29T11:12:56.400660+0000","last_became_active":"2023-11-29T11:12:56.395301+0000","last_became_peered":"2023-11-29T11:12:56.395301+0000","last_unstale":"2023-11-29T11:12:56.400660+0000","last_undegraded":"2023-11-29T11:12:56.400660+0000","last_fullsized":"2023-11-29T11:12:56.400660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:05.548254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385217+0000","last_change":"2023-11-29T11:12:52.359555+0000","last_active":"2023-11-29T11:12:56.385217+0000","last_peered":"2023-11-29T11:12:56.385217+0000","last_clean":"2023-11-29T11:12:56.385217+0000","last_became_active":"2023-11-29T11:12:52.359291+0000","last_became_peered":"2023-11-29T11:12:52.359291+0000","last_unstale":"2023-11-29T11:12:56.385217+0000","last_undegraded":"2023-11-29T11:12:56.385217+0000","last_fullsized":"2023-11-29T11:12:56.385217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:42.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370551+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:12:56.370551+0000","last_peered":"2023-11-29T11:12:56.370551+0000","last_clean":"2023-11-29T11:12:56.370551+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:12:56.370551+0000","last_undegraded":"2023-11-29T11:12:56.370551+0000","last_fullsized":"2023-11-29T11:12:56.370551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387434+0000","last_change":"2023-11-29T11:12:51.981231+0000","last_active":"2023-11-29T11:12:56.387434+0000","last_peered":"2023-11-29T11:12:56.387434+0000","last_clean":"2023-11-29T11:12:56.387434+0000","last_became_active":"2023-11-29T11:12:51.980989+0000","last_became_peered":"2023-11-29T11:12:51.980989+0000","last_unstale":"2023-11-29T11:12:56.387434+0000","last_undegraded":"2023-11-29T11:12:56.387434+0000","last_fullsized":"2023-11-29T11:12:56.387434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:34:18.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.393030+0000","last_change":"2023-11-29T11:12:56.389787+0000","last_active":"2023-11-29T11:12:56.393030+0000","last_peered":"2023-11-29T11:12:56.393030+0000","last_clean":"2023-11-29T11:12:56.393030+0000","last_became_active":"2023-11-29T11:12:56.389396+0000","last_became_peered":"2023-11-29T11:12:56.389396+0000","last_unstale":"2023-11-29T11:12:56.393030+0000","last_undegraded":"2023-11-29T11:12:56.393030+0000","last_fullsized":"2023-11-29T11:12:56.393030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:12:42.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368569+0000","last_change":"2023-11-29T11:12:52.365743+0000","last_active":"2023-11-29T11:12:56.368569+0000","last_peered":"2023-11-29T11:12:56.368569+0000","last_clean":"2023-11-29T11:12:56.368569+0000","last_became_active":"2023-11-29T11:12:52.365463+0000","last_became_peered":"2023-11-29T11:12:52.365463+0000","last_unstale":"2023-11-29T11:12:56.368569+0000","last_undegraded":"2023-11-29T11:12:56.368569+0000","last_fullsized":"2023-11-29T11:12:56.368569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381399+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:12:56.381399+0000","last_peered":"2023-11-29T11:12:56.381399+0000","last_clean":"2023-11-29T11:12:56.381399+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:12:56.381399+0000","last_undegraded":"2023-11-29T11:12:56.381399+0000","last_fullsized":"2023-11-29T11:12:56.381399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374706+0000","last_change":"2023-11-29T11:12:51.984839+0000","last_active":"2023-11-29T11:12:56.374706+0000","last_peered":"2023-11-29T11:12:56.374706+0000","last_clean":"2023-11-29T11:12:56.374706+0000","last_became_active":"2023-11-29T11:12:51.984536+0000","last_became_peered":"2023-11-29T11:12:51.984536+0000","last_unstale":"2023-11-29T11:12:56.374706+0000","last_undegraded":"2023-11-29T11:12:56.374706+0000","last_fullsized":"2023-11-29T11:12:56.374706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397672+0000","last_change":"2023-11-29T11:12:56.391636+0000","last_active":"2023-11-29T11:12:56.397672+0000","last_peered":"2023-11-29T11:12:56.397672+0000","last_clean":"2023-11-29T11:12:56.397672+0000","last_became_active":"2023-11-29T11:12:56.389855+0000","last_became_peered":"2023-11-29T11:12:56.389855+0000","last_unstale":"2023-11-29T11:12:56.397672+0000","last_undegraded":"2023-11-29T11:12:56.397672+0000","last_fullsized":"2023-11-29T11:12:56.397672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:00:51.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382757+0000","last_change":"2023-11-29T11:12:52.361676+0000","last_active":"2023-11-29T11:12:56.382757+0000","last_peered":"2023-11-29T11:12:56.382757+0000","last_clean":"2023-11-29T11:12:56.382757+0000","last_became_active":"2023-11-29T11:12:52.361408+0000","last_became_peered":"2023-11-29T11:12:52.361408+0000","last_unstale":"2023-11-29T11:12:56.382757+0000","last_undegraded":"2023-11-29T11:12:56.382757+0000","last_fullsized":"2023-11-29T11:12:56.382757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:41:41.650921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.371995+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:12:56.371995+0000","last_peered":"2023-11-29T11:12:56.371995+0000","last_clean":"2023-11-29T11:12:56.371995+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:12:56.371995+0000","last_undegraded":"2023-11-29T11:12:56.371995+0000","last_fullsized":"2023-11-29T11:12:56.371995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.956128+0000","last_change":"2023-11-29T11:12:51.981177+0000","last_active":"2023-11-29T11:12:56.956128+0000","last_peered":"2023-11-29T11:12:56.956128+0000","last_clean":"2023-11-29T11:12:56.956128+0000","last_became_active":"2023-11-29T11:12:51.980121+0000","last_became_peered":"2023-11-29T11:12:51.980121+0000","last_unstale":"2023-11-29T11:12:56.956128+0000","last_undegraded":"2023-11-29T11:12:56.956128+0000","last_fullsized":"2023-11-29T11:12:56.956128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400853+0000","last_change":"2023-11-29T11:12:56.394701+0000","last_active":"2023-11-29T11:12:56.400853+0000","last_peered":"2023-11-29T11:12:56.400853+0000","last_clean":"2023-11-29T11:12:56.400853+0000","last_became_active":"2023-11-29T11:12:56.394337+0000","last_became_peered":"2023-11-29T11:12:56.394337+0000","last_unstale":"2023-11-29T11:12:56.400853+0000","last_undegraded":"2023-11-29T11:12:56.400853+0000","last_fullsized":"2023-11-29T11:12:56.400853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:04:27.759167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385139+0000","last_change":"2023-11-29T11:12:52.365115+0000","last_active":"2023-11-29T11:12:56.385139+0000","last_peered":"2023-11-29T11:12:56.385139+0000","last_clean":"2023-11-29T11:12:56.385139+0000","last_became_active":"2023-11-29T11:12:52.364854+0000","last_became_peered":"2023-11-29T11:12:52.364854+0000","last_unstale":"2023-11-29T11:12:56.385139+0000","last_undegraded":"2023-11-29T11:12:56.385139+0000","last_fullsized":"2023-11-29T11:12:56.385139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383734+0000","last_change":"2023-11-29T11:12:51.983363+0000","last_active":"2023-11-29T11:12:56.383734+0000","last_peered":"2023-11-29T11:12:56.383734+0000","last_clean":"2023-11-29T11:12:56.383734+0000","last_became_active":"2023-11-29T11:12:51.983081+0000","last_became_peered":"2023-11-29T11:12:51.983081+0000","last_unstale":"2023-11-29T11:12:56.383734+0000","last_undegraded":"2023-11-29T11:12:56.383734+0000","last_fullsized":"2023-11-29T11:12:56.383734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381251+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:12:56.381251+0000","last_peered":"2023-11-29T11:12:56.381251+0000","last_clean":"2023-11-29T11:12:56.381251+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:12:56.381251+0000","last_undegraded":"2023-11-29T11:12:56.381251+0000","last_fullsized":"2023-11-29T11:12:56.381251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387003+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:12:56.387003+0000","last_peered":"2023-11-29T11:12:56.387003+0000","last_clean":"2023-11-29T11:12:56.387003+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:12:56.387003+0000","last_undegraded":"2023-11-29T11:12:56.387003+0000","last_fullsized":"2023-11-29T11:12:56.387003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402840+0000","last_change":"2023-11-29T11:12:56.396251+0000","last_active":"2023-11-29T11:12:56.402840+0000","last_peered":"2023-11-29T11:12:56.402840+0000","last_clean":"2023-11-29T11:12:56.402840+0000","last_became_active":"2023-11-29T11:12:56.395546+0000","last_became_peered":"2023-11-29T11:12:56.395546+0000","last_unstale":"2023-11-29T11:12:56.402840+0000","last_undegraded":"2023-11-29T11:12:56.402840+0000","last_fullsized":"2023-11-29T11:12:56.402840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:58:06.239886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387775+0000","last_change":"2023-11-29T11:12:52.350524+0000","last_active":"2023-11-29T11:12:56.387775+0000","last_peered":"2023-11-29T11:12:56.387775+0000","last_clean":"2023-11-29T11:12:56.387775+0000","last_became_active":"2023-11-29T11:12:52.350253+0000","last_became_peered":"2023-11-29T11:12:52.350253+0000","last_unstale":"2023-11-29T11:12:56.387775+0000","last_undegraded":"2023-11-29T11:12:56.387775+0000","last_fullsized":"2023-11-29T11:12:56.387775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:44:33.817076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384800+0000","last_change":"2023-11-29T11:12:51.980818+0000","last_active":"2023-11-29T11:12:56.384800+0000","last_peered":"2023-11-29T11:12:56.384800+0000","last_clean":"2023-11-29T11:12:56.384800+0000","last_became_active":"2023-11-29T11:12:51.980515+0000","last_became_peered":"2023-11-29T11:12:51.980515+0000","last_unstale":"2023-11-29T11:12:56.384800+0000","last_undegraded":"2023-11-29T11:12:56.384800+0000","last_fullsized":"2023-11-29T11:12:56.384800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:32.597395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382028+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:12:56.382028+0000","last_peered":"2023-11-29T11:12:56.382028+0000","last_clean":"2023-11-29T11:12:56.382028+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:12:56.382028+0000","last_undegraded":"2023-11-29T11:12:56.382028+0000","last_fullsized":"2023-11-29T11:12:56.382028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399365+0000","last_change":"2023-11-29T11:12:56.392369+0000","last_active":"2023-11-29T11:12:56.399365+0000","last_peered":"2023-11-29T11:12:56.399365+0000","last_clean":"2023-11-29T11:12:56.399365+0000","last_became_active":"2023-11-29T11:12:56.392008+0000","last_became_peered":"2023-11-29T11:12:56.392008+0000","last_unstale":"2023-11-29T11:12:56.399365+0000","last_undegraded":"2023-11-29T11:12:56.399365+0000","last_fullsized":"2023-11-29T11:12:56.399365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:20:17.395683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387330+0000","last_change":"2023-11-29T11:12:52.356824+0000","last_active":"2023-11-29T11:12:56.387330+0000","last_peered":"2023-11-29T11:12:56.387330+0000","last_clean":"2023-11-29T11:12:56.387330+0000","last_became_active":"2023-11-29T11:12:52.356541+0000","last_became_peered":"2023-11-29T11:12:52.356541+0000","last_unstale":"2023-11-29T11:12:56.387330+0000","last_undegraded":"2023-11-29T11:12:56.387330+0000","last_fullsized":"2023-11-29T11:12:56.387330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380364+0000","last_change":"2023-11-29T11:12:51.978041+0000","last_active":"2023-11-29T11:12:56.380364+0000","last_peered":"2023-11-29T11:12:56.380364+0000","last_clean":"2023-11-29T11:12:56.380364+0000","last_became_active":"2023-11-29T11:12:51.976160+0000","last_became_peered":"2023-11-29T11:12:51.976160+0000","last_unstale":"2023-11-29T11:12:56.380364+0000","last_undegraded":"2023-11-29T11:12:56.380364+0000","last_fullsized":"2023-11-29T11:12:56.380364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:41.431586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382670+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:12:56.382670+0000","last_peered":"2023-11-29T11:12:56.382670+0000","last_clean":"2023-11-29T11:12:56.382670+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:12:56.382670+0000","last_undegraded":"2023-11-29T11:12:56.382670+0000","last_fullsized":"2023-11-29T11:12:56.382670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400638+0000","last_change":"2023-11-29T11:12:56.395788+0000","last_active":"2023-11-29T11:12:56.400638+0000","last_peered":"2023-11-29T11:12:56.400638+0000","last_clean":"2023-11-29T11:12:56.400638+0000","last_became_active":"2023-11-29T11:12:56.395401+0000","last_became_peered":"2023-11-29T11:12:56.395401+0000","last_unstale":"2023-11-29T11:12:56.400638+0000","last_undegraded":"2023-11-29T11:12:56.400638+0000","last_fullsized":"2023-11-29T11:12:56.400638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:31:52.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370253+0000","last_change":"2023-11-29T11:12:52.368029+0000","last_active":"2023-11-29T11:12:56.370253+0000","last_peered":"2023-11-29T11:12:56.370253+0000","last_clean":"2023-11-29T11:12:56.370253+0000","last_became_active":"2023-11-29T11:12:52.366907+0000","last_became_peered":"2023-11-29T11:12:52.366907+0000","last_unstale":"2023-11-29T11:12:56.370253+0000","last_undegraded":"2023-11-29T11:12:56.370253+0000","last_fullsized":"2023-11-29T11:12:56.370253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:00:46.482908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368761+0000","last_change":"2023-11-29T11:12:51.986466+0000","last_active":"2023-11-29T11:12:56.368761+0000","last_peered":"2023-11-29T11:12:56.368761+0000","last_clean":"2023-11-29T11:12:56.368761+0000","last_became_active":"2023-11-29T11:12:51.986194+0000","last_became_peered":"2023-11-29T11:12:51.986194+0000","last_unstale":"2023-11-29T11:12:56.368761+0000","last_undegraded":"2023-11-29T11:12:56.368761+0000","last_fullsized":"2023-11-29T11:12:56.368761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381335+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:12:56.381335+0000","last_peered":"2023-11-29T11:12:56.381335+0000","last_clean":"2023-11-29T11:12:56.381335+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:12:56.381335+0000","last_undegraded":"2023-11-29T11:12:56.381335+0000","last_fullsized":"2023-11-29T11:12:56.381335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401333+0000","last_change":"2023-11-29T11:12:56.396640+0000","last_active":"2023-11-29T11:12:56.401333+0000","last_peered":"2023-11-29T11:12:56.401333+0000","last_clean":"2023-11-29T11:12:56.401333+0000","last_became_active":"2023-11-29T11:12:56.396277+0000","last_became_peered":"2023-11-29T11:12:56.396277+0000","last_unstale":"2023-11-29T11:12:56.401333+0000","last_undegraded":"2023-11-29T11:12:56.401333+0000","last_fullsized":"2023-11-29T11:12:56.401333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:31:52.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387675+0000","last_change":"2023-11-29T11:12:52.365021+0000","last_active":"2023-11-29T11:12:56.387675+0000","last_peered":"2023-11-29T11:12:56.387675+0000","last_clean":"2023-11-29T11:12:56.387675+0000","last_became_active":"2023-11-29T11:12:52.364752+0000","last_became_peered":"2023-11-29T11:12:52.364752+0000","last_unstale":"2023-11-29T11:12:56.387675+0000","last_undegraded":"2023-11-29T11:12:56.387675+0000","last_fullsized":"2023-11-29T11:12:56.387675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:12.463644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369013+0000","last_change":"2023-11-29T11:12:51.984597+0000","last_active":"2023-11-29T11:12:56.369013+0000","last_peered":"2023-11-29T11:12:56.369013+0000","last_clean":"2023-11-29T11:12:56.369013+0000","last_became_active":"2023-11-29T11:12:51.984208+0000","last_became_peered":"2023-11-29T11:12:51.984208+0000","last_unstale":"2023-11-29T11:12:56.369013+0000","last_undegraded":"2023-11-29T11:12:56.369013+0000","last_fullsized":"2023-11-29T11:12:56.369013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:24:12.113243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397643+0000","last_change":"2023-11-29T11:12:56.390938+0000","last_active":"2023-11-29T11:12:56.397643+0000","last_peered":"2023-11-29T11:12:56.397643+0000","last_clean":"2023-11-29T11:12:56.397643+0000","last_became_active":"2023-11-29T11:12:56.390579+0000","last_became_peered":"2023-11-29T11:12:56.390579+0000","last_unstale":"2023-11-29T11:12:56.397643+0000","last_undegraded":"2023-11-29T11:12:56.397643+0000","last_fullsized":"2023-11-29T11:12:56.397643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:51:56.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380950+0000","last_change":"2023-11-29T11:12:52.371660+0000","last_active":"2023-11-29T11:12:56.380950+0000","last_peered":"2023-11-29T11:12:56.380950+0000","last_clean":"2023-11-29T11:12:56.380950+0000","last_became_active":"2023-11-29T11:12:52.371313+0000","last_became_peered":"2023-11-29T11:12:52.371313+0000","last_unstale":"2023-11-29T11:12:56.380950+0000","last_undegraded":"2023-11-29T11:12:56.380950+0000","last_fullsized":"2023-11-29T11:12:56.380950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382856+0000","last_change":"2023-11-29T11:12:51.980977+0000","last_active":"2023-11-29T11:12:56.382856+0000","last_peered":"2023-11-29T11:12:56.382856+0000","last_clean":"2023-11-29T11:12:56.382856+0000","last_became_active":"2023-11-29T11:12:51.980717+0000","last_became_peered":"2023-11-29T11:12:51.980717+0000","last_unstale":"2023-11-29T11:12:56.382856+0000","last_undegraded":"2023-11-29T11:12:56.382856+0000","last_fullsized":"2023-11-29T11:12:56.382856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402799+0000","last_change":"2023-11-29T11:12:56.395925+0000","last_active":"2023-11-29T11:12:56.402799+0000","last_peered":"2023-11-29T11:12:56.402799+0000","last_clean":"2023-11-29T11:12:56.402799+0000","last_became_active":"2023-11-29T11:12:56.393269+0000","last_became_peered":"2023-11-29T11:12:56.393269+0000","last_unstale":"2023-11-29T11:12:56.402799+0000","last_undegraded":"2023-11-29T11:12:56.402799+0000","last_fullsized":"2023-11-29T11:12:56.402799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:47.489953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381227+0000","last_change":"2023-11-29T11:12:52.356759+0000","last_active":"2023-11-29T11:12:56.381227+0000","last_peered":"2023-11-29T11:12:56.381227+0000","last_clean":"2023-11-29T11:12:56.381227+0000","last_became_active":"2023-11-29T11:12:52.356301+0000","last_became_peered":"2023-11-29T11:12:52.356301+0000","last_unstale":"2023-11-29T11:12:56.381227+0000","last_undegraded":"2023-11-29T11:12:56.381227+0000","last_fullsized":"2023-11-29T11:12:56.381227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:24:15.072528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369086+0000","last_change":"2023-11-29T11:12:51.981944+0000","last_active":"2023-11-29T11:12:56.369086+0000","last_peered":"2023-11-29T11:12:56.369086+0000","last_clean":"2023-11-29T11:12:56.369086+0000","last_became_active":"2023-11-29T11:12:51.981620+0000","last_became_peered":"2023-11-29T11:12:51.981620+0000","last_unstale":"2023-11-29T11:12:56.369086+0000","last_undegraded":"2023-11-29T11:12:56.369086+0000","last_fullsized":"2023-11-29T11:12:56.369086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:54.630966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397493+0000","last_change":"2023-11-29T11:12:56.393149+0000","last_active":"2023-11-29T11:12:56.397493+0000","last_peered":"2023-11-29T11:12:56.397493+0000","last_clean":"2023-11-29T11:12:56.397493+0000","last_became_active":"2023-11-29T11:12:56.392696+0000","last_became_peered":"2023-11-29T11:12:56.392696+0000","last_unstale":"2023-11-29T11:12:56.397493+0000","last_undegraded":"2023-11-29T11:12:56.397493+0000","last_fullsized":"2023-11-29T11:12:56.397493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:53:46.404557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380298+0000","last_change":"2023-11-29T11:12:52.369003+0000","last_active":"2023-11-29T11:12:56.380298+0000","last_peered":"2023-11-29T11:12:56.380298+0000","last_clean":"2023-11-29T11:12:56.380298+0000","last_became_active":"2023-11-29T11:12:52.368615+0000","last_became_peered":"2023-11-29T11:12:52.368615+0000","last_unstale":"2023-11-29T11:12:56.380298+0000","last_undegraded":"2023-11-29T11:12:56.380298+0000","last_fullsized":"2023-11-29T11:12:56.380298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:23:46.973175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370121+0000","last_change":"2023-11-29T11:12:51.985684+0000","last_active":"2023-11-29T11:12:56.370121+0000","last_peered":"2023-11-29T11:12:56.370121+0000","last_clean":"2023-11-29T11:12:56.370121+0000","last_became_active":"2023-11-29T11:12:51.985365+0000","last_became_peered":"2023-11-29T11:12:51.985365+0000","last_unstale":"2023-11-29T11:12:56.370121+0000","last_undegraded":"2023-11-29T11:12:56.370121+0000","last_fullsized":"2023-11-29T11:12:56.370121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:41.431586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399198+0000","last_change":"2023-11-29T11:12:56.390266+0000","last_active":"2023-11-29T11:12:56.399198+0000","last_peered":"2023-11-29T11:12:56.399198+0000","last_clean":"2023-11-29T11:12:56.399198+0000","last_became_active":"2023-11-29T11:12:56.389828+0000","last_became_peered":"2023-11-29T11:12:56.389828+0000","last_unstale":"2023-11-29T11:12:56.399198+0000","last_undegraded":"2023-11-29T11:12:56.399198+0000","last_fullsized":"2023-11-29T11:12:56.399198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:36.814765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385128+0000","last_change":"2023-11-29T11:12:52.359364+0000","last_active":"2023-11-29T11:12:56.385128+0000","last_peered":"2023-11-29T11:12:56.385128+0000","last_clean":"2023-11-29T11:12:56.385128+0000","last_became_active":"2023-11-29T11:12:52.358958+0000","last_became_peered":"2023-11-29T11:12:52.358958+0000","last_unstale":"2023-11-29T11:12:56.385128+0000","last_undegraded":"2023-11-29T11:12:56.385128+0000","last_fullsized":"2023-11-29T11:12:56.385128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383366+0000","last_change":"2023-11-29T11:12:51.986410+0000","last_active":"2023-11-29T11:12:56.383366+0000","last_peered":"2023-11-29T11:12:56.383366+0000","last_clean":"2023-11-29T11:12:56.383366+0000","last_became_active":"2023-11-29T11:12:51.986045+0000","last_became_peered":"2023-11-29T11:12:51.986045+0000","last_unstale":"2023-11-29T11:12:56.383366+0000","last_undegraded":"2023-11-29T11:12:56.383366+0000","last_fullsized":"2023-11-29T11:12:56.383366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:06:56.628542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.396923+0000","last_change":"2023-11-29T11:12:56.389886+0000","last_active":"2023-11-29T11:12:56.396923+0000","last_peered":"2023-11-29T11:12:56.396923+0000","last_clean":"2023-11-29T11:12:56.396923+0000","last_became_active":"2023-11-29T11:12:56.389457+0000","last_became_peered":"2023-11-29T11:12:56.389457+0000","last_unstale":"2023-11-29T11:12:56.396923+0000","last_undegraded":"2023-11-29T11:12:56.396923+0000","last_fullsized":"2023-11-29T11:12:56.396923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:32.929777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368896+0000","last_change":"2023-11-29T11:12:52.367726+0000","last_active":"2023-11-29T11:12:56.368896+0000","last_peered":"2023-11-29T11:12:56.368896+0000","last_clean":"2023-11-29T11:12:56.368896+0000","last_became_active":"2023-11-29T11:12:52.366804+0000","last_became_peered":"2023-11-29T11:12:52.366804+0000","last_unstale":"2023-11-29T11:12:56.368896+0000","last_undegraded":"2023-11-29T11:12:56.368896+0000","last_fullsized":"2023-11-29T11:12:56.368896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:17:42.639576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381008+0000","last_change":"2023-11-29T11:12:51.983384+0000","last_active":"2023-11-29T11:12:56.381008+0000","last_peered":"2023-11-29T11:12:56.381008+0000","last_clean":"2023-11-29T11:12:56.381008+0000","last_became_active":"2023-11-29T11:12:51.983089+0000","last_became_peered":"2023-11-29T11:12:51.983089+0000","last_unstale":"2023-11-29T11:12:56.381008+0000","last_undegraded":"2023-11-29T11:12:56.381008+0000","last_fullsized":"2023-11-29T11:12:56.381008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:03:52.716864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399333+0000","last_change":"2023-11-29T11:12:56.391089+0000","last_active":"2023-11-29T11:12:56.399333+0000","last_peered":"2023-11-29T11:12:56.399333+0000","last_clean":"2023-11-29T11:12:56.399333+0000","last_became_active":"2023-11-29T11:12:56.390703+0000","last_became_peered":"2023-11-29T11:12:56.390703+0000","last_unstale":"2023-11-29T11:12:56.399333+0000","last_undegraded":"2023-11-29T11:12:56.399333+0000","last_fullsized":"2023-11-29T11:12:56.399333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:40.615554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379572+0000","last_change":"2023-11-29T11:12:52.360602+0000","last_active":"2023-11-29T11:12:56.379572+0000","last_peered":"2023-11-29T11:12:56.379572+0000","last_clean":"2023-11-29T11:12:56.379572+0000","last_became_active":"2023-11-29T11:12:52.360297+0000","last_became_peered":"2023-11-29T11:12:52.360297+0000","last_unstale":"2023-11-29T11:12:56.379572+0000","last_undegraded":"2023-11-29T11:12:56.379572+0000","last_fullsized":"2023-11-29T11:12:56.379572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:42:56.481528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381711+0000","last_change":"2023-11-29T11:12:51.985395+0000","last_active":"2023-11-29T11:12:56.381711+0000","last_peered":"2023-11-29T11:12:56.381711+0000","last_clean":"2023-11-29T11:12:56.381711+0000","last_became_active":"2023-11-29T11:12:51.985039+0000","last_became_peered":"2023-11-29T11:12:51.985039+0000","last_unstale":"2023-11-29T11:12:56.381711+0000","last_undegraded":"2023-11-29T11:12:56.381711+0000","last_fullsized":"2023-11-29T11:12:56.381711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:47.682887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.404204+0000","last_change":"2023-11-29T11:12:56.398067+0000","last_active":"2023-11-29T11:12:56.404204+0000","last_peered":"2023-11-29T11:12:56.404204+0000","last_clean":"2023-11-29T11:12:56.404204+0000","last_became_active":"2023-11-29T11:12:56.397483+0000","last_became_peered":"2023-11-29T11:12:56.397483+0000","last_unstale":"2023-11-29T11:12:56.404204+0000","last_undegraded":"2023-11-29T11:12:56.404204+0000","last_fullsized":"2023-11-29T11:12:56.404204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:51.701101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382817+0000","last_change":"2023-11-29T11:12:52.356144+0000","last_active":"2023-11-29T11:12:56.382817+0000","last_peered":"2023-11-29T11:12:56.382817+0000","last_clean":"2023-11-29T11:12:56.382817+0000","last_became_active":"2023-11-29T11:12:52.355872+0000","last_became_peered":"2023-11-29T11:12:52.355872+0000","last_unstale":"2023-11-29T11:12:56.382817+0000","last_undegraded":"2023-11-29T11:12:56.382817+0000","last_fullsized":"2023-11-29T11:12:56.382817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:50:29.425278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382282+0000","last_change":"2023-11-29T11:12:51.985298+0000","last_active":"2023-11-29T11:12:56.382282+0000","last_peered":"2023-11-29T11:12:56.382282+0000","last_clean":"2023-11-29T11:12:56.382282+0000","last_became_active":"2023-11-29T11:12:51.984926+0000","last_became_peered":"2023-11-29T11:12:51.984926+0000","last_unstale":"2023-11-29T11:12:56.382282+0000","last_undegraded":"2023-11-29T11:12:56.382282+0000","last_fullsized":"2023-11-29T11:12:56.382282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:36.656157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401387+0000","last_change":"2023-11-29T11:12:56.396907+0000","last_active":"2023-11-29T11:12:56.401387+0000","last_peered":"2023-11-29T11:12:56.401387+0000","last_clean":"2023-11-29T11:12:56.401387+0000","last_became_active":"2023-11-29T11:12:56.396549+0000","last_became_peered":"2023-11-29T11:12:56.396549+0000","last_unstale":"2023-11-29T11:12:56.401387+0000","last_undegraded":"2023-11-29T11:12:56.401387+0000","last_fullsized":"2023-11-29T11:12:56.401387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402989+0000","last_change":"2023-11-29T11:12:56.400298+0000","last_active":"2023-11-29T11:12:56.402989+0000","last_peered":"2023-11-29T11:12:56.402989+0000","last_clean":"2023-11-29T11:12:56.402989+0000","last_became_active":"2023-11-29T11:12:56.399859+0000","last_became_peered":"2023-11-29T11:12:56.399859+0000","last_unstale":"2023-11-29T11:12:56.402989+0000","last_undegraded":"2023-11-29T11:12:56.402989+0000","last_fullsized":"2023-11-29T11:12:56.402989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:58:42.333539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368372+0000","last_change":"2023-11-29T11:12:51.975809+0000","last_active":"2023-11-29T11:12:56.368372+0000","last_peered":"2023-11-29T11:12:56.368372+0000","last_clean":"2023-11-29T11:12:56.368372+0000","last_became_active":"2023-11-29T11:12:51.975519+0000","last_became_peered":"2023-11-29T11:12:51.975519+0000","last_unstale":"2023-11-29T11:12:56.368372+0000","last_undegraded":"2023-11-29T11:12:56.368372+0000","last_fullsized":"2023-11-29T11:12:56.368372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:27:55.174112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374809+0000","last_change":"2023-11-29T11:12:52.365673+0000","last_active":"2023-11-29T11:12:56.374809+0000","last_peered":"2023-11-29T11:12:56.374809+0000","last_clean":"2023-11-29T11:12:56.374809+0000","last_became_active":"2023-11-29T11:12:52.365394+0000","last_became_peered":"2023-11-29T11:12:52.365394+0000","last_unstale":"2023-11-29T11:12:56.374809+0000","last_undegraded":"2023-11-29T11:12:56.374809+0000","last_fullsized":"2023-11-29T11:12:56.374809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400814+0000","last_change":"2023-11-29T11:12:56.391998+0000","last_active":"2023-11-29T11:12:56.400814+0000","last_peered":"2023-11-29T11:12:56.400814+0000","last_clean":"2023-11-29T11:12:56.400814+0000","last_became_active":"2023-11-29T11:12:56.391600+0000","last_became_peered":"2023-11-29T11:12:56.391600+0000","last_unstale":"2023-11-29T11:12:56.400814+0000","last_undegraded":"2023-11-29T11:12:56.400814+0000","last_fullsized":"2023-11-29T11:12:56.400814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:43:20.599589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382545+0000","last_change":"2023-11-29T11:12:51.985807+0000","last_active":"2023-11-29T11:12:56.382545+0000","last_peered":"2023-11-29T11:12:56.382545+0000","last_clean":"2023-11-29T11:12:56.382545+0000","last_became_active":"2023-11-29T11:12:51.985137+0000","last_became_peered":"2023-11-29T11:12:51.985137+0000","last_unstale":"2023-11-29T11:12:56.382545+0000","last_undegraded":"2023-11-29T11:12:56.382545+0000","last_fullsized":"2023-11-29T11:12:56.382545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:50:57.222111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385212+0000","last_change":"2023-11-29T11:12:52.369387+0000","last_active":"2023-11-29T11:12:56.385212+0000","last_peered":"2023-11-29T11:12:56.385212+0000","last_clean":"2023-11-29T11:12:56.385212+0000","last_became_active":"2023-11-29T11:12:52.369149+0000","last_became_peered":"2023-11-29T11:12:52.369149+0000","last_unstale":"2023-11-29T11:12:56.385212+0000","last_undegraded":"2023-11-29T11:12:56.385212+0000","last_fullsized":"2023-11-29T11:12:56.385212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384642+0000","last_change":"2023-11-29T11:12:51.980655+0000","last_active":"2023-11-29T11:12:56.384642+0000","last_peered":"2023-11-29T11:12:56.384642+0000","last_clean":"2023-11-29T11:12:56.384642+0000","last_became_active":"2023-11-29T11:12:51.979444+0000","last_became_peered":"2023-11-29T11:12:51.979444+0000","last_unstale":"2023-11-29T11:12:56.384642+0000","last_undegraded":"2023-11-29T11:12:56.384642+0000","last_fullsized":"2023-11-29T11:12:56.384642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:32.597395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384347+0000","last_change":"2023-11-29T11:12:52.364984+0000","last_active":"2023-11-29T11:12:56.384347+0000","last_peered":"2023-11-29T11:12:56.384347+0000","last_clean":"2023-11-29T11:12:56.384347+0000","last_became_active":"2023-11-29T11:12:52.364646+0000","last_became_peered":"2023-11-29T11:12:52.364646+0000","last_unstale":"2023-11-29T11:12:56.384347+0000","last_undegraded":"2023-11-29T11:12:56.384347+0000","last_fullsized":"2023-11-29T11:12:56.384347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:03:33.514623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400841+0000","last_change":"2023-11-29T11:12:56.391838+0000","last_active":"2023-11-29T11:12:56.400841+0000","last_peered":"2023-11-29T11:12:56.400841+0000","last_clean":"2023-11-29T11:12:56.400841+0000","last_became_active":"2023-11-29T11:12:56.390070+0000","last_became_peered":"2023-11-29T11:12:56.390070+0000","last_unstale":"2023-11-29T11:12:56.400841+0000","last_undegraded":"2023-11-29T11:12:56.400841+0000","last_fullsized":"2023-11-29T11:12:56.400841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:08:17.216618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380625+0000","last_change":"2023-11-29T11:12:51.985954+0000","last_active":"2023-11-29T11:12:56.380625+0000","last_peered":"2023-11-29T11:12:56.380625+0000","last_clean":"2023-11-29T11:12:56.380625+0000","last_became_active":"2023-11-29T11:12:51.984970+0000","last_became_peered":"2023-11-29T11:12:51.984970+0000","last_unstale":"2023-11-29T11:12:56.380625+0000","last_undegraded":"2023-11-29T11:12:56.380625+0000","last_fullsized":"2023-11-29T11:12:56.380625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:05:41.981906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.373298+0000","last_change":"2023-11-29T11:12:52.361389+0000","last_active":"2023-11-29T11:12:56.373298+0000","last_peered":"2023-11-29T11:12:56.373298+0000","last_clean":"2023-11-29T11:12:56.373298+0000","last_became_active":"2023-11-29T11:12:52.361124+0000","last_became_peered":"2023-11-29T11:12:52.361124+0000","last_unstale":"2023-11-29T11:12:56.373298+0000","last_undegraded":"2023-11-29T11:12:56.373298+0000","last_fullsized":"2023-11-29T11:12:56.373298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402966+0000","last_change":"2023-11-29T11:12:56.400109+0000","last_active":"2023-11-29T11:12:56.402966+0000","last_peered":"2023-11-29T11:12:56.402966+0000","last_clean":"2023-11-29T11:12:56.402966+0000","last_became_active":"2023-11-29T11:12:56.397857+0000","last_became_peered":"2023-11-29T11:12:56.397857+0000","last_unstale":"2023-11-29T11:12:56.402966+0000","last_undegraded":"2023-11-29T11:12:56.402966+0000","last_fullsized":"2023-11-29T11:12:56.402966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:48:31.563968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368339+0000","last_change":"2023-11-29T11:12:52.368059+0000","last_active":"2023-11-29T11:12:56.368339+0000","last_peered":"2023-11-29T11:12:56.368339+0000","last_clean":"2023-11-29T11:12:56.368339+0000","last_became_active":"2023-11-29T11:12:52.367696+0000","last_became_peered":"2023-11-29T11:12:52.367696+0000","last_unstale":"2023-11-29T11:12:56.368339+0000","last_undegraded":"2023-11-29T11:12:56.368339+0000","last_fullsized":"2023-11-29T11:12:56.368339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:47:39.444454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368288+0000","last_change":"2023-11-29T11:12:52.357396+0000","last_active":"2023-11-29T11:12:56.368288+0000","last_peered":"2023-11-29T11:12:56.368288+0000","last_clean":"2023-11-29T11:12:56.368288+0000","last_became_active":"2023-11-29T11:12:52.357150+0000","last_became_peered":"2023-11-29T11:12:52.357150+0000","last_unstale":"2023-11-29T11:12:56.368288+0000","last_undegraded":"2023-11-29T11:12:56.368288+0000","last_fullsized":"2023-11-29T11:12:56.368288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:37.039342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381253+0000","last_change":"2023-11-29T11:12:52.371840+0000","last_active":"2023-11-29T11:12:56.381253+0000","last_peered":"2023-11-29T11:12:56.381253+0000","last_clean":"2023-11-29T11:12:56.381253+0000","last_became_active":"2023-11-29T11:12:52.371439+0000","last_became_peered":"2023-11-29T11:12:52.371439+0000","last_unstale":"2023-11-29T11:12:56.381253+0000","last_undegraded":"2023-11-29T11:12:56.381253+0000","last_fullsized":"2023-11-29T11:12:56.381253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:37.039342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369559+0000","last_change":"2023-11-29T11:12:52.364323+0000","last_active":"2023-11-29T11:12:56.369559+0000","last_peered":"2023-11-29T11:12:56.369559+0000","last_clean":"2023-11-29T11:12:56.369559+0000","last_became_active":"2023-11-29T11:12:52.364156+0000","last_became_peered":"2023-11-29T11:12:52.364156+0000","last_unstale":"2023-11-29T11:12:56.369559+0000","last_undegraded":"2023-11-29T11:12:56.369559+0000","last_fullsized":"2023-11-29T11:12:56.369559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387198+0000","last_change":"2023-11-29T11:12:52.365212+0000","last_active":"2023-11-29T11:12:56.387198+0000","last_peered":"2023-11-29T11:12:56.387198+0000","last_clean":"2023-11-29T11:12:56.387198+0000","last_became_active":"2023-11-29T11:12:52.364966+0000","last_became_peered":"2023-11-29T11:12:52.364966+0000","last_unstale":"2023-11-29T11:12:56.387198+0000","last_undegraded":"2023-11-29T11:12:56.387198+0000","last_fullsized":"2023-11-29T11:12:56.387198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:37.666038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383761+0000","last_change":"2023-11-29T11:12:52.365967+0000","last_active":"2023-11-29T11:12:56.383761+0000","last_peered":"2023-11-29T11:12:56.383761+0000","last_clean":"2023-11-29T11:12:56.383761+0000","last_became_active":"2023-11-29T11:12:52.365701+0000","last_became_peered":"2023-11-29T11:12:52.365701+0000","last_unstale":"2023-11-29T11:12:56.383761+0000","last_undegraded":"2023-11-29T11:12:56.383761+0000","last_fullsized":"2023-11-29T11:12:56.383761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:13:33.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387884+0000","last_change":"2023-11-29T11:12:52.357675+0000","last_active":"2023-11-29T11:12:56.387884+0000","last_peered":"2023-11-29T11:12:56.387884+0000","last_clean":"2023-11-29T11:12:56.387884+0000","last_became_active":"2023-11-29T11:12:52.356554+0000","last_became_peered":"2023-11-29T11:12:52.356554+0000","last_unstale":"2023-11-29T11:12:56.387884+0000","last_undegraded":"2023-11-29T11:12:56.387884+0000","last_fullsized":"2023-11-29T11:12:56.387884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:48.692769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387575+0000","last_change":"2023-11-29T11:12:52.355949+0000","last_active":"2023-11-29T11:12:56.387575+0000","last_peered":"2023-11-29T11:12:56.387575+0000","last_clean":"2023-11-29T11:12:56.387575+0000","last_became_active":"2023-11-29T11:12:52.355707+0000","last_became_peered":"2023-11-29T11:12:52.355707+0000","last_unstale":"2023-11-29T11:12:56.387575+0000","last_undegraded":"2023-11-29T11:12:56.387575+0000","last_fullsized":"2023-11-29T11:12:56.387575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:37:21.284939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381161+0000","last_change":"2023-11-29T11:12:52.370097+0000","last_active":"2023-11-29T11:12:56.381161+0000","last_peered":"2023-11-29T11:12:56.381161+0000","last_clean":"2023-11-29T11:12:56.381161+0000","last_became_active":"2023-11-29T11:12:52.369728+0000","last_became_peered":"2023-11-29T11:12:52.369728+0000","last_unstale":"2023-11-29T11:12:56.381161+0000","last_undegraded":"2023-11-29T11:12:56.381161+0000","last_fullsized":"2023-11-29T11:12:56.381161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368286+0000","last_change":"2023-11-29T11:12:52.362045+0000","last_active":"2023-11-29T11:12:56.368286+0000","last_peered":"2023-11-29T11:12:56.368286+0000","last_clean":"2023-11-29T11:12:56.368286+0000","last_became_active":"2023-11-29T11:12:52.361805+0000","last_became_peered":"2023-11-29T11:12:52.361805+0000","last_unstale":"2023-11-29T11:12:56.368286+0000","last_undegraded":"2023-11-29T11:12:56.368286+0000","last_fullsized":"2023-11-29T11:12:56.368286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:33.415072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384559+0000","last_change":"2023-11-29T11:12:52.366412+0000","last_active":"2023-11-29T11:12:56.384559+0000","last_peered":"2023-11-29T11:12:56.384559+0000","last_clean":"2023-11-29T11:12:56.384559+0000","last_became_active":"2023-11-29T11:12:52.366126+0000","last_became_peered":"2023-11-29T11:12:52.366126+0000","last_unstale":"2023-11-29T11:12:56.384559+0000","last_undegraded":"2023-11-29T11:12:56.384559+0000","last_fullsized":"2023-11-29T11:12:56.384559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380508+0000","last_change":"2023-11-29T11:12:52.370183+0000","last_active":"2023-11-29T11:12:56.380508+0000","last_peered":"2023-11-29T11:12:56.380508+0000","last_clean":"2023-11-29T11:12:56.380508+0000","last_became_active":"2023-11-29T11:12:52.369892+0000","last_became_peered":"2023-11-29T11:12:52.369892+0000","last_unstale":"2023-11-29T11:12:56.380508+0000","last_undegraded":"2023-11-29T11:12:56.380508+0000","last_fullsized":"2023-11-29T11:12:56.380508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380211+0000","last_change":"2023-11-29T11:12:52.371780+0000","last_active":"2023-11-29T11:12:56.380211+0000","last_peered":"2023-11-29T11:12:56.380211+0000","last_clean":"2023-11-29T11:12:56.380211+0000","last_became_active":"2023-11-29T11:12:52.371499+0000","last_became_peered":"2023-11-29T11:12:52.371499+0000","last_unstale":"2023-11-29T11:12:56.380211+0000","last_undegraded":"2023-11-29T11:12:56.380211+0000","last_fullsized":"2023-11-29T11:12:56.380211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:29.530084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374798+0000","last_change":"2023-11-29T11:12:52.374635+0000","last_active":"2023-11-29T11:12:56.374798+0000","last_peered":"2023-11-29T11:12:56.374798+0000","last_clean":"2023-11-29T11:12:56.374798+0000","last_became_active":"2023-11-29T11:12:52.374355+0000","last_became_peered":"2023-11-29T11:12:52.374355+0000","last_unstale":"2023-11-29T11:12:56.374798+0000","last_undegraded":"2023-11-29T11:12:56.374798+0000","last_fullsized":"2023-11-29T11:12:56.374798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:33.607277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380843+0000","last_change":"2023-11-29T11:12:52.357862+0000","last_active":"2023-11-29T11:12:56.380843+0000","last_peered":"2023-11-29T11:12:56.380843+0000","last_clean":"2023-11-29T11:12:56.380843+0000","last_became_active":"2023-11-29T11:12:52.357481+0000","last_became_peered":"2023-11-29T11:12:52.357481+0000","last_unstale":"2023-11-29T11:12:56.380843+0000","last_undegraded":"2023-11-29T11:12:56.380843+0000","last_fullsized":"2023-11-29T11:12:56.380843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:48.301408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384706+0000","last_change":"2023-11-29T11:12:52.369352+0000","last_active":"2023-11-29T11:12:56.384706+0000","last_peered":"2023-11-29T11:12:56.384706+0000","last_clean":"2023-11-29T11:12:56.384706+0000","last_became_active":"2023-11-29T11:12:52.369088+0000","last_became_peered":"2023-11-29T11:12:52.369088+0000","last_unstale":"2023-11-29T11:12:56.384706+0000","last_undegraded":"2023-11-29T11:12:56.384706+0000","last_fullsized":"2023-11-29T11:12:56.384706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379103+0000","last_change":"2023-11-29T11:12:52.360140+0000","last_active":"2023-11-29T11:12:56.379103+0000","last_peered":"2023-11-29T11:12:56.379103+0000","last_clean":"2023-11-29T11:12:56.379103+0000","last_became_active":"2023-11-29T11:12:52.359850+0000","last_became_peered":"2023-11-29T11:12:52.359850+0000","last_unstale":"2023-11-29T11:12:56.379103+0000","last_undegraded":"2023-11-29T11:12:56.379103+0000","last_fullsized":"2023-11-29T11:12:56.379103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:58.881146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382463+0000","last_change":"2023-11-29T11:12:52.364490+0000","last_active":"2023-11-29T11:12:56.382463+0000","last_peered":"2023-11-29T11:12:56.382463+0000","last_clean":"2023-11-29T11:12:56.382463+0000","last_became_active":"2023-11-29T11:12:52.364230+0000","last_became_peered":"2023-11-29T11:12:52.364230+0000","last_unstale":"2023-11-29T11:12:56.382463+0000","last_undegraded":"2023-11-29T11:12:56.382463+0000","last_fullsized":"2023-11-29T11:12:56.382463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382900+0000","last_change":"2023-11-29T11:12:52.355458+0000","last_active":"2023-11-29T11:12:56.382900+0000","last_peered":"2023-11-29T11:12:56.382900+0000","last_clean":"2023-11-29T11:12:56.382900+0000","last_became_active":"2023-11-29T11:12:52.355112+0000","last_became_peered":"2023-11-29T11:12:52.355112+0000","last_unstale":"2023-11-29T11:12:56.382900+0000","last_undegraded":"2023-11-29T11:12:56.382900+0000","last_fullsized":"2023-11-29T11:12:56.382900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:15:39.290136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374499+0000","last_change":"2023-11-29T11:12:52.362310+0000","last_active":"2023-11-29T11:12:56.374499+0000","last_peered":"2023-11-29T11:12:56.374499+0000","last_clean":"2023-11-29T11:12:56.374499+0000","last_became_active":"2023-11-29T11:12:52.362044+0000","last_became_peered":"2023-11-29T11:12:52.362044+0000","last_unstale":"2023-11-29T11:12:56.374499+0000","last_undegraded":"2023-11-29T11:12:56.374499+0000","last_fullsized":"2023-11-29T11:12:56.374499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:26.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374336+0000","last_change":"2023-11-29T11:12:52.363035+0000","last_active":"2023-11-29T11:12:56.374336+0000","last_peered":"2023-11-29T11:12:56.374336+0000","last_clean":"2023-11-29T11:12:56.374336+0000","last_became_active":"2023-11-29T11:12:52.362777+0000","last_became_peered":"2023-11-29T11:12:52.362777+0000","last_unstale":"2023-11-29T11:12:56.374336+0000","last_undegraded":"2023-11-29T11:12:56.374336+0000","last_fullsized":"2023-11-29T11:12:56.374336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:42.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381131+0000","last_change":"2023-11-29T11:12:52.357340+0000","last_active":"2023-11-29T11:12:56.381131+0000","last_peered":"2023-11-29T11:12:56.381131+0000","last_clean":"2023-11-29T11:12:56.381131+0000","last_became_active":"2023-11-29T11:12:52.356936+0000","last_became_peered":"2023-11-29T11:12:52.356936+0000","last_unstale":"2023-11-29T11:12:56.381131+0000","last_undegraded":"2023-11-29T11:12:56.381131+0000","last_fullsized":"2023-11-29T11:12:56.381131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:20:13.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383892+0000","last_change":"2023-11-29T11:12:52.354108+0000","last_active":"2023-11-29T11:12:56.383892+0000","last_peered":"2023-11-29T11:12:56.383892+0000","last_clean":"2023-11-29T11:12:56.383892+0000","last_became_active":"2023-11-29T11:12:52.353534+0000","last_became_peered":"2023-11-29T11:12:52.353534+0000","last_unstale":"2023-11-29T11:12:56.383892+0000","last_undegraded":"2023-11-29T11:12:56.383892+0000","last_fullsized":"2023-11-29T11:12:56.383892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:14:34.234715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384606+0000","last_change":"2023-11-29T11:12:52.369656+0000","last_active":"2023-11-29T11:12:56.384606+0000","last_peered":"2023-11-29T11:12:56.384606+0000","last_clean":"2023-11-29T11:12:56.384606+0000","last_became_active":"2023-11-29T11:12:52.368839+0000","last_became_peered":"2023-11-29T11:12:52.368839+0000","last_unstale":"2023-11-29T11:12:56.384606+0000","last_undegraded":"2023-11-29T11:12:56.384606+0000","last_fullsized":"2023-11-29T11:12:56.384606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:37.215861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382726+0000","last_change":"2023-11-29T11:12:52.355392+0000","last_active":"2023-11-29T11:12:56.382726+0000","last_peered":"2023-11-29T11:12:56.382726+0000","last_clean":"2023-11-29T11:12:56.382726+0000","last_became_active":"2023-11-29T11:12:52.355084+0000","last_became_peered":"2023-11-29T11:12:52.355084+0000","last_unstale":"2023-11-29T11:12:56.382726+0000","last_undegraded":"2023-11-29T11:12:56.382726+0000","last_fullsized":"2023-11-29T11:12:56.382726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:54:14.472430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382377+0000","last_change":"2023-11-29T11:12:52.363068+0000","last_active":"2023-11-29T11:12:56.382377+0000","last_peered":"2023-11-29T11:12:56.382377+0000","last_clean":"2023-11-29T11:12:56.382377+0000","last_became_active":"2023-11-29T11:12:52.362728+0000","last_became_peered":"2023-11-29T11:12:52.362728+0000","last_unstale":"2023-11-29T11:12:56.382377+0000","last_undegraded":"2023-11-29T11:12:56.382377+0000","last_fullsized":"2023-11-29T11:12:56.382377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380636+0000","last_change":"2023-11-29T11:12:52.360412+0000","last_active":"2023-11-29T11:12:56.380636+0000","last_peered":"2023-11-29T11:12:56.380636+0000","last_clean":"2023-11-29T11:12:56.380636+0000","last_became_active":"2023-11-29T11:12:52.357967+0000","last_became_peered":"2023-11-29T11:12:52.357967+0000","last_unstale":"2023-11-29T11:12:56.380636+0000","last_undegraded":"2023-11-29T11:12:56.380636+0000","last_fullsized":"2023-11-29T11:12:56.380636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:46:49.933331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385349+0000","last_change":"2023-11-29T11:12:52.370887+0000","last_active":"2023-11-29T11:12:56.385349+0000","last_peered":"2023-11-29T11:12:56.385349+0000","last_clean":"2023-11-29T11:12:56.385349+0000","last_became_active":"2023-11-29T11:12:52.370640+0000","last_became_peered":"2023-11-29T11:12:52.370640+0000","last_unstale":"2023-11-29T11:12:56.385349+0000","last_undegraded":"2023-11-29T11:12:56.385349+0000","last_fullsized":"2023-11-29T11:12:56.385349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370091+0000","last_change":"2023-11-29T11:12:52.367091+0000","last_active":"2023-11-29T11:12:56.370091+0000","last_peered":"2023-11-29T11:12:56.370091+0000","last_clean":"2023-11-29T11:12:56.370091+0000","last_became_active":"2023-11-29T11:12:52.366750+0000","last_became_peered":"2023-11-29T11:12:52.366750+0000","last_unstale":"2023-11-29T11:12:56.370091+0000","last_undegraded":"2023-11-29T11:12:56.370091+0000","last_fullsized":"2023-11-29T11:12:56.370091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:15:10.149279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380743+0000","last_change":"2023-11-29T11:12:52.361017+0000","last_active":"2023-11-29T11:12:56.380743+0000","last_peered":"2023-11-29T11:12:56.380743+0000","last_clean":"2023-11-29T11:12:56.380743+0000","last_became_active":"2023-11-29T11:12:52.359867+0000","last_became_peered":"2023-11-29T11:12:52.359867+0000","last_unstale":"2023-11-29T11:12:56.380743+0000","last_undegraded":"2023-11-29T11:12:56.380743+0000","last_fullsized":"2023-11-29T11:12:56.380743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:41.227959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383793+0000","last_change":"2023-11-29T11:12:52.359305+0000","last_active":"2023-11-29T11:12:56.383793+0000","last_peered":"2023-11-29T11:12:56.383793+0000","last_clean":"2023-11-29T11:12:56.383793+0000","last_became_active":"2023-11-29T11:12:52.359005+0000","last_became_peered":"2023-11-29T11:12:52.359005+0000","last_unstale":"2023-11-29T11:12:56.383793+0000","last_undegraded":"2023-11-29T11:12:56.383793+0000","last_fullsized":"2023-11-29T11:12:56.383793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:20:17.165426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374196+0000","last_change":"2023-11-29T11:12:52.372896+0000","last_active":"2023-11-29T11:12:56.374196+0000","last_peered":"2023-11-29T11:12:56.374196+0000","last_clean":"2023-11-29T11:12:56.374196+0000","last_became_active":"2023-11-29T11:12:52.372584+0000","last_became_peered":"2023-11-29T11:12:52.372584+0000","last_unstale":"2023-11-29T11:12:56.374196+0000","last_undegraded":"2023-11-29T11:12:56.374196+0000","last_fullsized":"2023-11-29T11:12:56.374196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:51.526860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9268,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362572,"statfs":{"total":96636764160,"available":96627273728,"internally_reserved":0,"allocated":897024,"data_stored":707312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":112983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8156,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363684,"statfs":{"total":96636764160,"available":96628412416,"internally_reserved":0,"allocated":282624,"data_stored":113619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363608,"statfs":{"total":96636764160,"available":96628334592,"internally_reserved":0,"allocated":294912,"data_stored":116784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":113073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":112983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9240,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362600,"statfs":{"total":96636764160,"available":96627302400,"internally_reserved":0,"allocated":868352,"data_stored":703351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":112563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:13:15.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:13:15.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 Processor -- start 2023-11-29T11:13:15.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- start start 2023-11-29T11:13:15.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dd280 0x7f366c050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c052bf0 con 0x7f366c0dfb70 2023-11-29T11:13:15.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c0528c0 con 0x7f366c036e80 2023-11-29T11:13:15.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0dd650 con 0x7f366c0dd280 2023-11-29T11:13:15.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f3671d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f366c0dfb70 0x7f366c036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42866/0 (socket says 172.21.15.81:42866) 2023-11-29T11:13:15.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f3671d9b700 1 -- 172.21.15.81:0/2347230825 learned_addr learned my addr 172.21.15.81:0/2347230825 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:15.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367259c700 1 --2- 172.21.15.81:0/2347230825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dd280 0x7f366c050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367159a700 1 -- 172.21.15.81:0/2347230825 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246044682 0 0) 0x7f366c052bf0 con 0x7f366c0dfb70 2023-11-29T11:13:15.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367159a700 1 -- 172.21.15.81:0/2347230825 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f365c0035d0 con 0x7f366c0dfb70 2023-11-29T11:13:15.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367159a700 1 -- 172.21.15.81:0/2347230825 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321923576 0 0) 0x7f366c0528c0 con 0x7f366c036e80 2023-11-29T11:13:15.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367159a700 1 -- 172.21.15.81:0/2347230825 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f366c052bf0 con 0x7f366c036e80 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367159a700 1 -- 172.21.15.81:0/2347230825 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 300105811 0 0) 0x7f365c0035d0 con 0x7f366c0dfb70 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367259c700 1 -- 172.21.15.81:0/2347230825 >> v1:172.21.15.176:6789/0 conn(0x7f366c036e80 legacy=0x7f366c053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367259c700 1 -- 172.21.15.81:0/2347230825 >> v1:172.21.15.81:6789/0 conn(0x7f366c0dfb70 legacy=0x7f366c036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367259c700 1 -- 172.21.15.81:0/2347230825 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0e0430 con 0x7f366c0dd280 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367259c700 1 --2- 172.21.15.81:0/2347230825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dd280 0x7f366c050760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3664009880 tx=0x7f3664009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6d52d9aeff94f21 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367159a700 1 -- 172.21.15.81:0/2347230825 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668001670 con 0x7f366c0dd280 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367159a700 1 -- 172.21.15.81:0/2347230825 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664004030 con 0x7f366c0dd280 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367159a700 1 -- 172.21.15.81:0/2347230825 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640043a0 con 0x7f366c0dd280 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- 172.21.15.81:0/2347230825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dd280 msgr2=0x7f366c050760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 --2- 172.21.15.81:0/2347230825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dd280 0x7f366c050760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3664009880 tx=0x7f3664009b90 comp rx=0 tx=0).stop 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- 172.21.15.81:0/2347230825 shutdown_connections 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 --2- 172.21.15.81:0/2347230825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dd280 0x7f366c050760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- 172.21.15.81:0/2347230825 >> 172.21.15.81:0/2347230825 conn(0x7f366c051770 msgr2=0x7f366c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:15.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- 172.21.15.81:0/2347230825 shutdown_connections 2023-11-29T11:13:15.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.154+0000 7f367359e700 1 -- 172.21.15.81:0/2347230825 wait complete. 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 Processor -- start 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 -- start start 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366c036e80 0x7f366c0d74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366c0dd280 0x7f366c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dfb70 0x7f366c006f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c04ec60 con 0x7f366c036e80 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c039160 con 0x7f366c0dd280 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0385c0 con 0x7f366c0dfb70 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366c036e80 0x7f366c0d74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366c036e80 0x7f366c0d74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44740/0 (socket says 172.21.15.81:44740) 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 -- 172.21.15.81:0/3223375970 learned_addr learned my addr 172.21.15.81:0/3223375970 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f3671d9b700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366c0dd280 0x7f366c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f3672d9d700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dfb70 0x7f366c006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 -- 172.21.15.81:0/3223375970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dfb70 msgr2=0x7f366c006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dfb70 0x7f366c006f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 -- 172.21.15.81:0/3223375970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366c0dd280 msgr2=0x7f366c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366c0dd280 0x7f366c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 -- 172.21.15.81:0/3223375970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640094b0 con 0x7f366c036e80 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367259c700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366c036e80 0x7f366c0d74d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f366c00bf50 tx=0x7f3664004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f3662ffd700 1 -- 172.21.15.81:0/3223375970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664003c50 con 0x7f366c036e80 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f3662ffd700 1 -- 172.21.15.81:0/3223375970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664003dd0 con 0x7f366c036e80 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c0e09f0 con 0x7f366c036e80 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f3662ffd700 1 -- 172.21.15.81:0/3223375970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664011870 con 0x7f366c036e80 2023-11-29T11:13:15.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.158+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c0e0710 con 0x7f366c036e80 2023-11-29T11:13:15.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.162+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c0dffa0 con 0x7f366c036e80 2023-11-29T11:13:15.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.162+0000 7f3662ffd700 1 -- 172.21.15.81:0/3223375970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f366400f050 con 0x7f366c036e80 2023-11-29T11:13:15.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.162+0000 7f3662ffd700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3654064f10 0x7f36540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.162+0000 7f3671d9b700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3654064f10 0x7f36540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.162+0000 7f3662ffd700 1 -- 172.21.15.81:0/3223375970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36640834e0 con 0x7f366c036e80 2023-11-29T11:13:15.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.162+0000 7f3671d9b700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3654064f10 0x7f36540673c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f366c177230 tx=0x7f3668001d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.166+0000 7f3662ffd700 1 -- 172.21.15.81:0/3223375970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f36640512a0 con 0x7f366c036e80 2023-11-29T11:13:15.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.326+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f366c005570 con 0x7f3654064f10 2023-11-29T11:13:15.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.342+0000 7f3662ffd700 1 -- 172.21.15.81:0/3223375970 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367440 (secure 0 0 0) 0x7f366c005570 con 0x7f3654064f10 2023-11-29T11:13:15.351 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:15.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.346+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3654064f10 msgr2=0x7f36540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.346+0000 7f367359e700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3654064f10 0x7f36540673c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f366c177230 tx=0x7f3668001d60 comp rx=0 tx=0).stop 2023-11-29T11:13:15.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.346+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366c036e80 msgr2=0x7f366c0d74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.346+0000 7f367359e700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366c036e80 0x7f366c0d74d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f366c00bf50 tx=0x7f3664004770 comp rx=0 tx=0).stop 2023-11-29T11:13:15.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.346+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 shutdown_connections 2023-11-29T11:13:15.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.346+0000 7f367359e700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3654064f10 0x7f36540673c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.346+0000 7f367359e700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f366c0dfb70 0x7f366c006f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.346+0000 7f367359e700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366c0dd280 0x7f366c0069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.350+0000 7f367359e700 1 --2- 172.21.15.81:0/3223375970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f366c036e80 0x7f366c0d74d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.350+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 >> 172.21.15.81:0/3223375970 conn(0x7f366c051770 msgr2=0x7f366c0dc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:15.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.350+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 shutdown_connections 2023-11-29T11:13:15.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.350+0000 7f367359e700 1 -- 172.21.15.81:0/3223375970 wait complete. 2023-11-29T11:13:15.355 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:13:15.368 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-11-29T11:13:14.430391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67364,"kb_used_data":3364,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907356,"statfs":{"total":773094113280,"available":773025132544,"internally_reserved":0,"allocated":3444736,"data_stored":2092668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1749,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004775"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397456+0000","last_change":"2023-11-29T11:12:56.392727+0000","last_active":"2023-11-29T11:12:56.397456+0000","last_peered":"2023-11-29T11:12:56.397456+0000","last_clean":"2023-11-29T11:12:56.397456+0000","last_became_active":"2023-11-29T11:12:56.392278+0000","last_became_peered":"2023-11-29T11:12:56.392278+0000","last_unstale":"2023-11-29T11:12:56.397456+0000","last_undegraded":"2023-11-29T11:12:56.397456+0000","last_fullsized":"2023-11-29T11:12:56.397456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:05.548254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384796+0000","last_change":"2023-11-29T11:12:51.981171+0000","last_active":"2023-11-29T11:12:56.384796+0000","last_peered":"2023-11-29T11:12:56.384796+0000","last_clean":"2023-11-29T11:12:56.384796+0000","last_became_active":"2023-11-29T11:12:51.979647+0000","last_became_peered":"2023-11-29T11:12:51.979647+0000","last_unstale":"2023-11-29T11:12:56.384796+0000","last_undegraded":"2023-11-29T11:12:56.384796+0000","last_fullsized":"2023-11-29T11:12:56.384796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379179+0000","last_change":"2023-11-29T11:12:52.373329+0000","last_active":"2023-11-29T11:12:56.379179+0000","last_peered":"2023-11-29T11:12:56.379179+0000","last_clean":"2023-11-29T11:12:56.379179+0000","last_became_active":"2023-11-29T11:12:52.373080+0000","last_became_peered":"2023-11-29T11:12:52.373080+0000","last_unstale":"2023-11-29T11:12:56.379179+0000","last_undegraded":"2023-11-29T11:12:56.379179+0000","last_fullsized":"2023-11-29T11:12:56.379179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:33.415072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399892+0000","last_change":"2023-11-29T11:12:56.393396+0000","last_active":"2023-11-29T11:12:56.399892+0000","last_peered":"2023-11-29T11:12:56.399892+0000","last_clean":"2023-11-29T11:12:56.399892+0000","last_became_active":"2023-11-29T11:12:56.392958+0000","last_became_peered":"2023-11-29T11:12:56.392958+0000","last_unstale":"2023-11-29T11:12:56.399892+0000","last_undegraded":"2023-11-29T11:12:56.399892+0000","last_fullsized":"2023-11-29T11:12:56.399892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:08:53.005631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374292+0000","last_change":"2023-11-29T11:12:51.984861+0000","last_active":"2023-11-29T11:12:56.374292+0000","last_peered":"2023-11-29T11:12:56.374292+0000","last_clean":"2023-11-29T11:12:56.374292+0000","last_became_active":"2023-11-29T11:12:51.984221+0000","last_became_peered":"2023-11-29T11:12:51.984221+0000","last_unstale":"2023-11-29T11:12:56.374292+0000","last_undegraded":"2023-11-29T11:12:56.374292+0000","last_fullsized":"2023-11-29T11:12:56.374292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:03:52.716864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368510+0000","last_change":"2023-11-29T11:12:52.361315+0000","last_active":"2023-11-29T11:12:56.368510+0000","last_peered":"2023-11-29T11:12:56.368510+0000","last_clean":"2023-11-29T11:12:56.368510+0000","last_became_active":"2023-11-29T11:12:52.361046+0000","last_became_peered":"2023-11-29T11:12:52.361046+0000","last_unstale":"2023-11-29T11:12:56.368510+0000","last_undegraded":"2023-11-29T11:12:56.368510+0000","last_fullsized":"2023-11-29T11:12:56.368510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:48.301408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402905+0000","last_change":"2023-11-29T11:12:56.397174+0000","last_active":"2023-11-29T11:12:56.402905+0000","last_peered":"2023-11-29T11:12:56.402905+0000","last_clean":"2023-11-29T11:12:56.402905+0000","last_became_active":"2023-11-29T11:12:56.395990+0000","last_became_peered":"2023-11-29T11:12:56.395990+0000","last_unstale":"2023-11-29T11:12:56.402905+0000","last_undegraded":"2023-11-29T11:12:56.402905+0000","last_fullsized":"2023-11-29T11:12:56.402905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:32:53.734519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384497+0000","last_change":"2023-11-29T11:12:51.984821+0000","last_active":"2023-11-29T11:12:56.384497+0000","last_peered":"2023-11-29T11:12:56.384497+0000","last_clean":"2023-11-29T11:12:56.384497+0000","last_became_active":"2023-11-29T11:12:51.984531+0000","last_became_peered":"2023-11-29T11:12:51.984531+0000","last_unstale":"2023-11-29T11:12:56.384497+0000","last_undegraded":"2023-11-29T11:12:56.384497+0000","last_fullsized":"2023-11-29T11:12:56.384497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:54.630966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381153+0000","last_change":"2023-11-29T11:12:52.369059+0000","last_active":"2023-11-29T11:12:56.381153+0000","last_peered":"2023-11-29T11:12:56.381153+0000","last_clean":"2023-11-29T11:12:56.381153+0000","last_became_active":"2023-11-29T11:12:52.368705+0000","last_became_peered":"2023-11-29T11:12:52.368705+0000","last_unstale":"2023-11-29T11:12:56.381153+0000","last_undegraded":"2023-11-29T11:12:56.381153+0000","last_fullsized":"2023-11-29T11:12:56.381153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:53:43.004864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401291+0000","last_change":"2023-11-29T11:12:56.394933+0000","last_active":"2023-11-29T11:12:56.401291+0000","last_peered":"2023-11-29T11:12:56.401291+0000","last_clean":"2023-11-29T11:12:56.401291+0000","last_became_active":"2023-11-29T11:12:56.394448+0000","last_became_peered":"2023-11-29T11:12:56.394448+0000","last_unstale":"2023-11-29T11:12:56.401291+0000","last_undegraded":"2023-11-29T11:12:56.401291+0000","last_fullsized":"2023-11-29T11:12:56.401291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:51.264472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383467+0000","last_change":"2023-11-29T11:12:51.984966+0000","last_active":"2023-11-29T11:12:56.383467+0000","last_peered":"2023-11-29T11:12:56.383467+0000","last_clean":"2023-11-29T11:12:56.383467+0000","last_became_active":"2023-11-29T11:12:51.984504+0000","last_became_peered":"2023-11-29T11:12:51.984504+0000","last_unstale":"2023-11-29T11:12:56.383467+0000","last_undegraded":"2023-11-29T11:12:56.383467+0000","last_fullsized":"2023-11-29T11:12:56.383467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:27:55.174112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380063+0000","last_change":"2023-11-29T11:12:52.369471+0000","last_active":"2023-11-29T11:12:56.380063+0000","last_peered":"2023-11-29T11:12:56.380063+0000","last_clean":"2023-11-29T11:12:56.380063+0000","last_became_active":"2023-11-29T11:12:52.369037+0000","last_became_peered":"2023-11-29T11:12:52.369037+0000","last_unstale":"2023-11-29T11:12:56.380063+0000","last_undegraded":"2023-11-29T11:12:56.380063+0000","last_fullsized":"2023-11-29T11:12:56.380063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:58:11.106615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397379+0000","last_change":"2023-11-29T11:12:56.392830+0000","last_active":"2023-11-29T11:12:56.397379+0000","last_peered":"2023-11-29T11:12:56.397379+0000","last_clean":"2023-11-29T11:12:56.397379+0000","last_became_active":"2023-11-29T11:12:56.392385+0000","last_became_peered":"2023-11-29T11:12:56.392385+0000","last_unstale":"2023-11-29T11:12:56.397379+0000","last_undegraded":"2023-11-29T11:12:56.397379+0000","last_fullsized":"2023-11-29T11:12:56.397379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385374+0000","last_change":"2023-11-29T11:12:51.978019+0000","last_active":"2023-11-29T11:12:56.385374+0000","last_peered":"2023-11-29T11:12:56.385374+0000","last_clean":"2023-11-29T11:12:56.385374+0000","last_became_active":"2023-11-29T11:12:51.977720+0000","last_became_peered":"2023-11-29T11:12:51.977720+0000","last_unstale":"2023-11-29T11:12:56.385374+0000","last_undegraded":"2023-11-29T11:12:56.385374+0000","last_fullsized":"2023-11-29T11:12:56.385374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:01.519677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374628+0000","last_change":"2023-11-29T11:12:52.366401+0000","last_active":"2023-11-29T11:12:56.374628+0000","last_peered":"2023-11-29T11:12:56.374628+0000","last_clean":"2023-11-29T11:12:56.374628+0000","last_became_active":"2023-11-29T11:12:52.366140+0000","last_became_peered":"2023-11-29T11:12:52.366140+0000","last_unstale":"2023-11-29T11:12:56.374628+0000","last_undegraded":"2023-11-29T11:12:56.374628+0000","last_fullsized":"2023-11-29T11:12:56.374628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:49.550223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397485+0000","last_change":"2023-11-29T11:12:56.390565+0000","last_active":"2023-11-29T11:12:56.397485+0000","last_peered":"2023-11-29T11:12:56.397485+0000","last_clean":"2023-11-29T11:12:56.397485+0000","last_became_active":"2023-11-29T11:12:56.389869+0000","last_became_peered":"2023-11-29T11:12:56.389869+0000","last_unstale":"2023-11-29T11:12:56.397485+0000","last_undegraded":"2023-11-29T11:12:56.397485+0000","last_fullsized":"2023-11-29T11:12:56.397485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:08:27.735011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381346+0000","last_change":"2023-11-29T11:12:51.979373+0000","last_active":"2023-11-29T11:12:56.381346+0000","last_peered":"2023-11-29T11:12:56.381346+0000","last_clean":"2023-11-29T11:12:56.381346+0000","last_became_active":"2023-11-29T11:12:51.979051+0000","last_became_peered":"2023-11-29T11:12:51.979051+0000","last_unstale":"2023-11-29T11:12:56.381346+0000","last_undegraded":"2023-11-29T11:12:56.381346+0000","last_fullsized":"2023-11-29T11:12:56.381346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.373881+0000","last_change":"2023-11-29T11:12:52.365896+0000","last_active":"2023-11-29T11:12:56.373881+0000","last_peered":"2023-11-29T11:12:56.373881+0000","last_clean":"2023-11-29T11:12:56.373881+0000","last_became_active":"2023-11-29T11:12:52.365622+0000","last_became_peered":"2023-11-29T11:12:52.365622+0000","last_unstale":"2023-11-29T11:12:56.373881+0000","last_undegraded":"2023-11-29T11:12:56.373881+0000","last_fullsized":"2023-11-29T11:12:56.373881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:29.530084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399062+0000","last_change":"2023-11-29T11:12:56.391160+0000","last_active":"2023-11-29T11:12:56.399062+0000","last_peered":"2023-11-29T11:12:56.399062+0000","last_clean":"2023-11-29T11:12:56.399062+0000","last_became_active":"2023-11-29T11:12:56.390771+0000","last_became_peered":"2023-11-29T11:12:56.390771+0000","last_unstale":"2023-11-29T11:12:56.399062+0000","last_undegraded":"2023-11-29T11:12:56.399062+0000","last_fullsized":"2023-11-29T11:12:56.399062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:28:19.746284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.386885+0000","last_change":"2023-11-29T11:12:51.987080+0000","last_active":"2023-11-29T11:12:56.386885+0000","last_peered":"2023-11-29T11:12:56.386885+0000","last_clean":"2023-11-29T11:12:56.386885+0000","last_became_active":"2023-11-29T11:12:51.986730+0000","last_became_peered":"2023-11-29T11:12:51.986730+0000","last_unstale":"2023-11-29T11:12:56.386885+0000","last_undegraded":"2023-11-29T11:12:56.386885+0000","last_fullsized":"2023-11-29T11:12:56.386885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:01.519677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385050+0000","last_change":"2023-11-29T11:12:52.367490+0000","last_active":"2023-11-29T11:12:56.385050+0000","last_peered":"2023-11-29T11:12:56.385050+0000","last_clean":"2023-11-29T11:12:56.385050+0000","last_became_active":"2023-11-29T11:12:52.367253+0000","last_became_peered":"2023-11-29T11:12:52.367253+0000","last_unstale":"2023-11-29T11:12:56.385050+0000","last_undegraded":"2023-11-29T11:12:56.385050+0000","last_fullsized":"2023-11-29T11:12:56.385050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:12.463644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.395950+0000","last_change":"2023-11-29T11:12:56.390849+0000","last_active":"2023-11-29T11:12:56.395950+0000","last_peered":"2023-11-29T11:12:56.395950+0000","last_clean":"2023-11-29T11:12:56.395950+0000","last_became_active":"2023-11-29T11:12:56.390401+0000","last_became_peered":"2023-11-29T11:12:56.390401+0000","last_unstale":"2023-11-29T11:12:56.395950+0000","last_undegraded":"2023-11-29T11:12:56.395950+0000","last_fullsized":"2023-11-29T11:12:56.395950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368794+0000","last_change":"2023-11-29T11:12:51.985928+0000","last_active":"2023-11-29T11:12:56.368794+0000","last_peered":"2023-11-29T11:12:56.368794+0000","last_clean":"2023-11-29T11:12:56.368794+0000","last_became_active":"2023-11-29T11:12:51.985417+0000","last_became_peered":"2023-11-29T11:12:51.985417+0000","last_unstale":"2023-11-29T11:12:56.368794+0000","last_undegraded":"2023-11-29T11:12:56.368794+0000","last_fullsized":"2023-11-29T11:12:56.368794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370624+0000","last_change":"2023-11-29T11:12:52.359182+0000","last_active":"2023-11-29T11:12:56.370624+0000","last_peered":"2023-11-29T11:12:56.370624+0000","last_clean":"2023-11-29T11:12:56.370624+0000","last_became_active":"2023-11-29T11:12:52.358870+0000","last_became_peered":"2023-11-29T11:12:52.358870+0000","last_unstale":"2023-11-29T11:12:56.370624+0000","last_undegraded":"2023-11-29T11:12:56.370624+0000","last_fullsized":"2023-11-29T11:12:56.370624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:47:38.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368358+0000","last_change":"2023-11-29T11:12:52.357426+0000","last_active":"2023-11-29T11:12:56.368358+0000","last_peered":"2023-11-29T11:12:56.368358+0000","last_clean":"2023-11-29T11:12:56.368358+0000","last_became_active":"2023-11-29T11:12:52.357165+0000","last_became_peered":"2023-11-29T11:12:52.357165+0000","last_unstale":"2023-11-29T11:12:56.368358+0000","last_undegraded":"2023-11-29T11:12:56.368358+0000","last_fullsized":"2023-11-29T11:12:56.368358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:37.215861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384878+0000","last_change":"2023-11-29T11:12:51.981423+0000","last_active":"2023-11-29T11:12:56.384878+0000","last_peered":"2023-11-29T11:12:56.384878+0000","last_clean":"2023-11-29T11:12:56.384878+0000","last_became_active":"2023-11-29T11:12:51.981102+0000","last_became_peered":"2023-11-29T11:12:51.981102+0000","last_unstale":"2023-11-29T11:12:56.384878+0000","last_undegraded":"2023-11-29T11:12:56.384878+0000","last_fullsized":"2023-11-29T11:12:56.384878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:34:18.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.393001+0000","last_change":"2023-11-29T11:12:56.388444+0000","last_active":"2023-11-29T11:12:56.393001+0000","last_peered":"2023-11-29T11:12:56.393001+0000","last_clean":"2023-11-29T11:12:56.393001+0000","last_became_active":"2023-11-29T11:12:56.388033+0000","last_became_peered":"2023-11-29T11:12:56.388033+0000","last_unstale":"2023-11-29T11:12:56.393001+0000","last_undegraded":"2023-11-29T11:12:56.393001+0000","last_fullsized":"2023-11-29T11:12:56.393001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:29.691459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368852+0000","last_change":"2023-11-29T11:12:52.365695+0000","last_active":"2023-11-29T11:12:56.368852+0000","last_peered":"2023-11-29T11:12:56.368852+0000","last_clean":"2023-11-29T11:12:56.368852+0000","last_became_active":"2023-11-29T11:12:52.365402+0000","last_became_peered":"2023-11-29T11:12:52.365402+0000","last_unstale":"2023-11-29T11:12:56.368852+0000","last_undegraded":"2023-11-29T11:12:56.368852+0000","last_fullsized":"2023-11-29T11:12:56.368852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384074+0000","last_change":"2023-11-29T11:12:51.978492+0000","last_active":"2023-11-29T11:12:56.384074+0000","last_peered":"2023-11-29T11:12:56.384074+0000","last_clean":"2023-11-29T11:12:56.384074+0000","last_became_active":"2023-11-29T11:12:51.978133+0000","last_became_peered":"2023-11-29T11:12:51.978133+0000","last_unstale":"2023-11-29T11:12:56.384074+0000","last_undegraded":"2023-11-29T11:12:56.384074+0000","last_fullsized":"2023-11-29T11:12:56.384074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:24:13.769187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401152+0000","last_change":"2023-11-29T11:12:56.393246+0000","last_active":"2023-11-29T11:12:56.401152+0000","last_peered":"2023-11-29T11:12:56.401152+0000","last_clean":"2023-11-29T11:12:56.401152+0000","last_became_active":"2023-11-29T11:12:56.392790+0000","last_became_peered":"2023-11-29T11:12:56.392790+0000","last_unstale":"2023-11-29T11:12:56.401152+0000","last_undegraded":"2023-11-29T11:12:56.401152+0000","last_fullsized":"2023-11-29T11:12:56.401152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:06:44.806489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380906+0000","last_change":"2023-11-29T11:12:51.986109+0000","last_active":"2023-11-29T11:12:56.380906+0000","last_peered":"2023-11-29T11:12:56.380906+0000","last_clean":"2023-11-29T11:12:56.380906+0000","last_became_active":"2023-11-29T11:12:51.985826+0000","last_became_peered":"2023-11-29T11:12:51.985826+0000","last_unstale":"2023-11-29T11:12:56.380906+0000","last_undegraded":"2023-11-29T11:12:56.380906+0000","last_fullsized":"2023-11-29T11:12:56.380906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:02:48.630613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387087+0000","last_change":"2023-11-29T11:12:52.356463+0000","last_active":"2023-11-29T11:12:56.387087+0000","last_peered":"2023-11-29T11:12:56.387087+0000","last_clean":"2023-11-29T11:12:56.387087+0000","last_became_active":"2023-11-29T11:12:52.356197+0000","last_became_peered":"2023-11-29T11:12:52.356197+0000","last_unstale":"2023-11-29T11:12:56.387087+0000","last_undegraded":"2023-11-29T11:12:56.387087+0000","last_fullsized":"2023-11-29T11:12:56.387087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:24:54.414088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400777+0000","last_change":"2023-11-29T11:12:56.390106+0000","last_active":"2023-11-29T11:12:56.400777+0000","last_peered":"2023-11-29T11:12:56.400777+0000","last_clean":"2023-11-29T11:12:56.400777+0000","last_became_active":"2023-11-29T11:12:56.389286+0000","last_became_peered":"2023-11-29T11:12:56.389286+0000","last_unstale":"2023-11-29T11:12:56.400777+0000","last_undegraded":"2023-11-29T11:12:56.400777+0000","last_fullsized":"2023-11-29T11:12:56.400777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:20:15.664819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'9","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-29T11:13:01.224105+0000","last_change":"2023-11-29T11:12:51.981433+0000","last_active":"2023-11-29T11:13:01.224105+0000","last_peered":"2023-11-29T11:13:01.224105+0000","last_clean":"2023-11-29T11:13:01.224105+0000","last_became_active":"2023-11-29T11:12:51.981169+0000","last_became_peered":"2023-11-29T11:12:51.981169+0000","last_unstale":"2023-11-29T11:13:01.224105+0000","last_undegraded":"2023-11-29T11:13:01.224105+0000","last_fullsized":"2023-11-29T11:13:01.224105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380175+0000","last_change":"2023-11-29T11:12:52.372116+0000","last_active":"2023-11-29T11:12:56.380175+0000","last_peered":"2023-11-29T11:12:56.380175+0000","last_clean":"2023-11-29T11:12:56.380175+0000","last_became_active":"2023-11-29T11:12:52.371831+0000","last_became_peered":"2023-11-29T11:12:52.371831+0000","last_unstale":"2023-11-29T11:12:56.380175+0000","last_undegraded":"2023-11-29T11:12:56.380175+0000","last_fullsized":"2023-11-29T11:12:56.380175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.396928+0000","last_change":"2023-11-29T11:12:56.391717+0000","last_active":"2023-11-29T11:12:56.396928+0000","last_peered":"2023-11-29T11:12:56.396928+0000","last_clean":"2023-11-29T11:12:56.396928+0000","last_became_active":"2023-11-29T11:12:56.391290+0000","last_became_peered":"2023-11-29T11:12:56.391290+0000","last_unstale":"2023-11-29T11:12:56.396928+0000","last_undegraded":"2023-11-29T11:12:56.396928+0000","last_fullsized":"2023-11-29T11:12:56.396928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:42:59.881221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387181+0000","last_change":"2023-11-29T11:12:52.352949+0000","last_active":"2023-11-29T11:12:56.387181+0000","last_peered":"2023-11-29T11:12:56.387181+0000","last_clean":"2023-11-29T11:12:56.387181+0000","last_became_active":"2023-11-29T11:12:52.350912+0000","last_became_peered":"2023-11-29T11:12:52.350912+0000","last_unstale":"2023-11-29T11:12:56.387181+0000","last_undegraded":"2023-11-29T11:12:56.387181+0000","last_fullsized":"2023-11-29T11:12:56.387181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:42.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370718+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:12:56.370718+0000","last_peered":"2023-11-29T11:12:56.370718+0000","last_clean":"2023-11-29T11:12:56.370718+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:12:56.370718+0000","last_undegraded":"2023-11-29T11:12:56.370718+0000","last_fullsized":"2023-11-29T11:12:56.370718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384623+0000","last_change":"2023-11-29T11:12:51.986760+0000","last_active":"2023-11-29T11:12:56.384623+0000","last_peered":"2023-11-29T11:12:56.384623+0000","last_clean":"2023-11-29T11:12:56.384623+0000","last_became_active":"2023-11-29T11:12:51.986475+0000","last_became_peered":"2023-11-29T11:12:51.986475+0000","last_unstale":"2023-11-29T11:12:56.384623+0000","last_undegraded":"2023-11-29T11:12:56.384623+0000","last_fullsized":"2023-11-29T11:12:56.384623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:41:14.704468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400660+0000","last_change":"2023-11-29T11:12:56.395998+0000","last_active":"2023-11-29T11:12:56.400660+0000","last_peered":"2023-11-29T11:12:56.400660+0000","last_clean":"2023-11-29T11:12:56.400660+0000","last_became_active":"2023-11-29T11:12:56.395301+0000","last_became_peered":"2023-11-29T11:12:56.395301+0000","last_unstale":"2023-11-29T11:12:56.400660+0000","last_undegraded":"2023-11-29T11:12:56.400660+0000","last_fullsized":"2023-11-29T11:12:56.400660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:05.548254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385217+0000","last_change":"2023-11-29T11:12:52.359555+0000","last_active":"2023-11-29T11:12:56.385217+0000","last_peered":"2023-11-29T11:12:56.385217+0000","last_clean":"2023-11-29T11:12:56.385217+0000","last_became_active":"2023-11-29T11:12:52.359291+0000","last_became_peered":"2023-11-29T11:12:52.359291+0000","last_unstale":"2023-11-29T11:12:56.385217+0000","last_undegraded":"2023-11-29T11:12:56.385217+0000","last_fullsized":"2023-11-29T11:12:56.385217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:42.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370551+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:12:56.370551+0000","last_peered":"2023-11-29T11:12:56.370551+0000","last_clean":"2023-11-29T11:12:56.370551+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:12:56.370551+0000","last_undegraded":"2023-11-29T11:12:56.370551+0000","last_fullsized":"2023-11-29T11:12:56.370551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387434+0000","last_change":"2023-11-29T11:12:51.981231+0000","last_active":"2023-11-29T11:12:56.387434+0000","last_peered":"2023-11-29T11:12:56.387434+0000","last_clean":"2023-11-29T11:12:56.387434+0000","last_became_active":"2023-11-29T11:12:51.980989+0000","last_became_peered":"2023-11-29T11:12:51.980989+0000","last_unstale":"2023-11-29T11:12:56.387434+0000","last_undegraded":"2023-11-29T11:12:56.387434+0000","last_fullsized":"2023-11-29T11:12:56.387434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:34:18.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.393030+0000","last_change":"2023-11-29T11:12:56.389787+0000","last_active":"2023-11-29T11:12:56.393030+0000","last_peered":"2023-11-29T11:12:56.393030+0000","last_clean":"2023-11-29T11:12:56.393030+0000","last_became_active":"2023-11-29T11:12:56.389396+0000","last_became_peered":"2023-11-29T11:12:56.389396+0000","last_unstale":"2023-11-29T11:12:56.393030+0000","last_undegraded":"2023-11-29T11:12:56.393030+0000","last_fullsized":"2023-11-29T11:12:56.393030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:12:42.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368569+0000","last_change":"2023-11-29T11:12:52.365743+0000","last_active":"2023-11-29T11:12:56.368569+0000","last_peered":"2023-11-29T11:12:56.368569+0000","last_clean":"2023-11-29T11:12:56.368569+0000","last_became_active":"2023-11-29T11:12:52.365463+0000","last_became_peered":"2023-11-29T11:12:52.365463+0000","last_unstale":"2023-11-29T11:12:56.368569+0000","last_undegraded":"2023-11-29T11:12:56.368569+0000","last_fullsized":"2023-11-29T11:12:56.368569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381399+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:12:56.381399+0000","last_peered":"2023-11-29T11:12:56.381399+0000","last_clean":"2023-11-29T11:12:56.381399+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:12:56.381399+0000","last_undegraded":"2023-11-29T11:12:56.381399+0000","last_fullsized":"2023-11-29T11:12:56.381399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374706+0000","last_change":"2023-11-29T11:12:51.984839+0000","last_active":"2023-11-29T11:12:56.374706+0000","last_peered":"2023-11-29T11:12:56.374706+0000","last_clean":"2023-11-29T11:12:56.374706+0000","last_became_active":"2023-11-29T11:12:51.984536+0000","last_became_peered":"2023-11-29T11:12:51.984536+0000","last_unstale":"2023-11-29T11:12:56.374706+0000","last_undegraded":"2023-11-29T11:12:56.374706+0000","last_fullsized":"2023-11-29T11:12:56.374706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397672+0000","last_change":"2023-11-29T11:12:56.391636+0000","last_active":"2023-11-29T11:12:56.397672+0000","last_peered":"2023-11-29T11:12:56.397672+0000","last_clean":"2023-11-29T11:12:56.397672+0000","last_became_active":"2023-11-29T11:12:56.389855+0000","last_became_peered":"2023-11-29T11:12:56.389855+0000","last_unstale":"2023-11-29T11:12:56.397672+0000","last_undegraded":"2023-11-29T11:12:56.397672+0000","last_fullsized":"2023-11-29T11:12:56.397672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:00:51.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382757+0000","last_change":"2023-11-29T11:12:52.361676+0000","last_active":"2023-11-29T11:12:56.382757+0000","last_peered":"2023-11-29T11:12:56.382757+0000","last_clean":"2023-11-29T11:12:56.382757+0000","last_became_active":"2023-11-29T11:12:52.361408+0000","last_became_peered":"2023-11-29T11:12:52.361408+0000","last_unstale":"2023-11-29T11:12:56.382757+0000","last_undegraded":"2023-11-29T11:12:56.382757+0000","last_fullsized":"2023-11-29T11:12:56.382757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:41:41.650921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.371995+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:12:56.371995+0000","last_peered":"2023-11-29T11:12:56.371995+0000","last_clean":"2023-11-29T11:12:56.371995+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:12:56.371995+0000","last_undegraded":"2023-11-29T11:12:56.371995+0000","last_fullsized":"2023-11-29T11:12:56.371995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.956128+0000","last_change":"2023-11-29T11:12:51.981177+0000","last_active":"2023-11-29T11:12:56.956128+0000","last_peered":"2023-11-29T11:12:56.956128+0000","last_clean":"2023-11-29T11:12:56.956128+0000","last_became_active":"2023-11-29T11:12:51.980121+0000","last_became_peered":"2023-11-29T11:12:51.980121+0000","last_unstale":"2023-11-29T11:12:56.956128+0000","last_undegraded":"2023-11-29T11:12:56.956128+0000","last_fullsized":"2023-11-29T11:12:56.956128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400853+0000","last_change":"2023-11-29T11:12:56.394701+0000","last_active":"2023-11-29T11:12:56.400853+0000","last_peered":"2023-11-29T11:12:56.400853+0000","last_clean":"2023-11-29T11:12:56.400853+0000","last_became_active":"2023-11-29T11:12:56.394337+0000","last_became_peered":"2023-11-29T11:12:56.394337+0000","last_unstale":"2023-11-29T11:12:56.400853+0000","last_undegraded":"2023-11-29T11:12:56.400853+0000","last_fullsized":"2023-11-29T11:12:56.400853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:04:27.759167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385139+0000","last_change":"2023-11-29T11:12:52.365115+0000","last_active":"2023-11-29T11:12:56.385139+0000","last_peered":"2023-11-29T11:12:56.385139+0000","last_clean":"2023-11-29T11:12:56.385139+0000","last_became_active":"2023-11-29T11:12:52.364854+0000","last_became_peered":"2023-11-29T11:12:52.364854+0000","last_unstale":"2023-11-29T11:12:56.385139+0000","last_undegraded":"2023-11-29T11:12:56.385139+0000","last_fullsized":"2023-11-29T11:12:56.385139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383734+0000","last_change":"2023-11-29T11:12:51.983363+0000","last_active":"2023-11-29T11:12:56.383734+0000","last_peered":"2023-11-29T11:12:56.383734+0000","last_clean":"2023-11-29T11:12:56.383734+0000","last_became_active":"2023-11-29T11:12:51.983081+0000","last_became_peered":"2023-11-29T11:12:51.983081+0000","last_unstale":"2023-11-29T11:12:56.383734+0000","last_undegraded":"2023-11-29T11:12:56.383734+0000","last_fullsized":"2023-11-29T11:12:56.383734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381251+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:12:56.381251+0000","last_peered":"2023-11-29T11:12:56.381251+0000","last_clean":"2023-11-29T11:12:56.381251+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:12:56.381251+0000","last_undegraded":"2023-11-29T11:12:56.381251+0000","last_fullsized":"2023-11-29T11:12:56.381251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387003+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:12:56.387003+0000","last_peered":"2023-11-29T11:12:56.387003+0000","last_clean":"2023-11-29T11:12:56.387003+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:12:56.387003+0000","last_undegraded":"2023-11-29T11:12:56.387003+0000","last_fullsized":"2023-11-29T11:12:56.387003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402840+0000","last_change":"2023-11-29T11:12:56.396251+0000","last_active":"2023-11-29T11:12:56.402840+0000","last_peered":"2023-11-29T11:12:56.402840+0000","last_clean":"2023-11-29T11:12:56.402840+0000","last_became_active":"2023-11-29T11:12:56.395546+0000","last_became_peered":"2023-11-29T11:12:56.395546+0000","last_unstale":"2023-11-29T11:12:56.402840+0000","last_undegraded":"2023-11-29T11:12:56.402840+0000","last_fullsized":"2023-11-29T11:12:56.402840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:58:06.239886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387775+0000","last_change":"2023-11-29T11:12:52.350524+0000","last_active":"2023-11-29T11:12:56.387775+0000","last_peered":"2023-11-29T11:12:56.387775+0000","last_clean":"2023-11-29T11:12:56.387775+0000","last_became_active":"2023-11-29T11:12:52.350253+0000","last_became_peered":"2023-11-29T11:12:52.350253+0000","last_unstale":"2023-11-29T11:12:56.387775+0000","last_undegraded":"2023-11-29T11:12:56.387775+0000","last_fullsized":"2023-11-29T11:12:56.387775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:44:33.817076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384800+0000","last_change":"2023-11-29T11:12:51.980818+0000","last_active":"2023-11-29T11:12:56.384800+0000","last_peered":"2023-11-29T11:12:56.384800+0000","last_clean":"2023-11-29T11:12:56.384800+0000","last_became_active":"2023-11-29T11:12:51.980515+0000","last_became_peered":"2023-11-29T11:12:51.980515+0000","last_unstale":"2023-11-29T11:12:56.384800+0000","last_undegraded":"2023-11-29T11:12:56.384800+0000","last_fullsized":"2023-11-29T11:12:56.384800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:32.597395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382028+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:12:56.382028+0000","last_peered":"2023-11-29T11:12:56.382028+0000","last_clean":"2023-11-29T11:12:56.382028+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:12:56.382028+0000","last_undegraded":"2023-11-29T11:12:56.382028+0000","last_fullsized":"2023-11-29T11:12:56.382028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399365+0000","last_change":"2023-11-29T11:12:56.392369+0000","last_active":"2023-11-29T11:12:56.399365+0000","last_peered":"2023-11-29T11:12:56.399365+0000","last_clean":"2023-11-29T11:12:56.399365+0000","last_became_active":"2023-11-29T11:12:56.392008+0000","last_became_peered":"2023-11-29T11:12:56.392008+0000","last_unstale":"2023-11-29T11:12:56.399365+0000","last_undegraded":"2023-11-29T11:12:56.399365+0000","last_fullsized":"2023-11-29T11:12:56.399365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:20:17.395683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387330+0000","last_change":"2023-11-29T11:12:52.356824+0000","last_active":"2023-11-29T11:12:56.387330+0000","last_peered":"2023-11-29T11:12:56.387330+0000","last_clean":"2023-11-29T11:12:56.387330+0000","last_became_active":"2023-11-29T11:12:52.356541+0000","last_became_peered":"2023-11-29T11:12:52.356541+0000","last_unstale":"2023-11-29T11:12:56.387330+0000","last_undegraded":"2023-11-29T11:12:56.387330+0000","last_fullsized":"2023-11-29T11:12:56.387330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380364+0000","last_change":"2023-11-29T11:12:51.978041+0000","last_active":"2023-11-29T11:12:56.380364+0000","last_peered":"2023-11-29T11:12:56.380364+0000","last_clean":"2023-11-29T11:12:56.380364+0000","last_became_active":"2023-11-29T11:12:51.976160+0000","last_became_peered":"2023-11-29T11:12:51.976160+0000","last_unstale":"2023-11-29T11:12:56.380364+0000","last_undegraded":"2023-11-29T11:12:56.380364+0000","last_fullsized":"2023-11-29T11:12:56.380364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:41.431586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382670+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:12:56.382670+0000","last_peered":"2023-11-29T11:12:56.382670+0000","last_clean":"2023-11-29T11:12:56.382670+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:12:56.382670+0000","last_undegraded":"2023-11-29T11:12:56.382670+0000","last_fullsized":"2023-11-29T11:12:56.382670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400638+0000","last_change":"2023-11-29T11:12:56.395788+0000","last_active":"2023-11-29T11:12:56.400638+0000","last_peered":"2023-11-29T11:12:56.400638+0000","last_clean":"2023-11-29T11:12:56.400638+0000","last_became_active":"2023-11-29T11:12:56.395401+0000","last_became_peered":"2023-11-29T11:12:56.395401+0000","last_unstale":"2023-11-29T11:12:56.400638+0000","last_undegraded":"2023-11-29T11:12:56.400638+0000","last_fullsized":"2023-11-29T11:12:56.400638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:31:52.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370253+0000","last_change":"2023-11-29T11:12:52.368029+0000","last_active":"2023-11-29T11:12:56.370253+0000","last_peered":"2023-11-29T11:12:56.370253+0000","last_clean":"2023-11-29T11:12:56.370253+0000","last_became_active":"2023-11-29T11:12:52.366907+0000","last_became_peered":"2023-11-29T11:12:52.366907+0000","last_unstale":"2023-11-29T11:12:56.370253+0000","last_undegraded":"2023-11-29T11:12:56.370253+0000","last_fullsized":"2023-11-29T11:12:56.370253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:00:46.482908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368761+0000","last_change":"2023-11-29T11:12:51.986466+0000","last_active":"2023-11-29T11:12:56.368761+0000","last_peered":"2023-11-29T11:12:56.368761+0000","last_clean":"2023-11-29T11:12:56.368761+0000","last_became_active":"2023-11-29T11:12:51.986194+0000","last_became_peered":"2023-11-29T11:12:51.986194+0000","last_unstale":"2023-11-29T11:12:56.368761+0000","last_undegraded":"2023-11-29T11:12:56.368761+0000","last_fullsized":"2023-11-29T11:12:56.368761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381335+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:12:56.381335+0000","last_peered":"2023-11-29T11:12:56.381335+0000","last_clean":"2023-11-29T11:12:56.381335+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:12:56.381335+0000","last_undegraded":"2023-11-29T11:12:56.381335+0000","last_fullsized":"2023-11-29T11:12:56.381335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401333+0000","last_change":"2023-11-29T11:12:56.396640+0000","last_active":"2023-11-29T11:12:56.401333+0000","last_peered":"2023-11-29T11:12:56.401333+0000","last_clean":"2023-11-29T11:12:56.401333+0000","last_became_active":"2023-11-29T11:12:56.396277+0000","last_became_peered":"2023-11-29T11:12:56.396277+0000","last_unstale":"2023-11-29T11:12:56.401333+0000","last_undegraded":"2023-11-29T11:12:56.401333+0000","last_fullsized":"2023-11-29T11:12:56.401333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:31:52.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387675+0000","last_change":"2023-11-29T11:12:52.365021+0000","last_active":"2023-11-29T11:12:56.387675+0000","last_peered":"2023-11-29T11:12:56.387675+0000","last_clean":"2023-11-29T11:12:56.387675+0000","last_became_active":"2023-11-29T11:12:52.364752+0000","last_became_peered":"2023-11-29T11:12:52.364752+0000","last_unstale":"2023-11-29T11:12:56.387675+0000","last_undegraded":"2023-11-29T11:12:56.387675+0000","last_fullsized":"2023-11-29T11:12:56.387675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:12.463644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369013+0000","last_change":"2023-11-29T11:12:51.984597+0000","last_active":"2023-11-29T11:12:56.369013+0000","last_peered":"2023-11-29T11:12:56.369013+0000","last_clean":"2023-11-29T11:12:56.369013+0000","last_became_active":"2023-11-29T11:12:51.984208+0000","last_became_peered":"2023-11-29T11:12:51.984208+0000","last_unstale":"2023-11-29T11:12:56.369013+0000","last_undegraded":"2023-11-29T11:12:56.369013+0000","last_fullsized":"2023-11-29T11:12:56.369013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:24:12.113243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397643+0000","last_change":"2023-11-29T11:12:56.390938+0000","last_active":"2023-11-29T11:12:56.397643+0000","last_peered":"2023-11-29T11:12:56.397643+0000","last_clean":"2023-11-29T11:12:56.397643+0000","last_became_active":"2023-11-29T11:12:56.390579+0000","last_became_peered":"2023-11-29T11:12:56.390579+0000","last_unstale":"2023-11-29T11:12:56.397643+0000","last_undegraded":"2023-11-29T11:12:56.397643+0000","last_fullsized":"2023-11-29T11:12:56.397643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:51:56.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380950+0000","last_change":"2023-11-29T11:12:52.371660+0000","last_active":"2023-11-29T11:12:56.380950+0000","last_peered":"2023-11-29T11:12:56.380950+0000","last_clean":"2023-11-29T11:12:56.380950+0000","last_became_active":"2023-11-29T11:12:52.371313+0000","last_became_peered":"2023-11-29T11:12:52.371313+0000","last_unstale":"2023-11-29T11:12:56.380950+0000","last_undegraded":"2023-11-29T11:12:56.380950+0000","last_fullsized":"2023-11-29T11:12:56.380950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382856+0000","last_change":"2023-11-29T11:12:51.980977+0000","last_active":"2023-11-29T11:12:56.382856+0000","last_peered":"2023-11-29T11:12:56.382856+0000","last_clean":"2023-11-29T11:12:56.382856+0000","last_became_active":"2023-11-29T11:12:51.980717+0000","last_became_peered":"2023-11-29T11:12:51.980717+0000","last_unstale":"2023-11-29T11:12:56.382856+0000","last_undegraded":"2023-11-29T11:12:56.382856+0000","last_fullsized":"2023-11-29T11:12:56.382856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402799+0000","last_change":"2023-11-29T11:12:56.395925+0000","last_active":"2023-11-29T11:12:56.402799+0000","last_peered":"2023-11-29T11:12:56.402799+0000","last_clean":"2023-11-29T11:12:56.402799+0000","last_became_active":"2023-11-29T11:12:56.393269+0000","last_became_peered":"2023-11-29T11:12:56.393269+0000","last_unstale":"2023-11-29T11:12:56.402799+0000","last_undegraded":"2023-11-29T11:12:56.402799+0000","last_fullsized":"2023-11-29T11:12:56.402799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:47.489953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381227+0000","last_change":"2023-11-29T11:12:52.356759+0000","last_active":"2023-11-29T11:12:56.381227+0000","last_peered":"2023-11-29T11:12:56.381227+0000","last_clean":"2023-11-29T11:12:56.381227+0000","last_became_active":"2023-11-29T11:12:52.356301+0000","last_became_peered":"2023-11-29T11:12:52.356301+0000","last_unstale":"2023-11-29T11:12:56.381227+0000","last_undegraded":"2023-11-29T11:12:56.381227+0000","last_fullsized":"2023-11-29T11:12:56.381227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:24:15.072528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369086+0000","last_change":"2023-11-29T11:12:51.981944+0000","last_active":"2023-11-29T11:12:56.369086+0000","last_peered":"2023-11-29T11:12:56.369086+0000","last_clean":"2023-11-29T11:12:56.369086+0000","last_became_active":"2023-11-29T11:12:51.981620+0000","last_became_peered":"2023-11-29T11:12:51.981620+0000","last_unstale":"2023-11-29T11:12:56.369086+0000","last_undegraded":"2023-11-29T11:12:56.369086+0000","last_fullsized":"2023-11-29T11:12:56.369086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:54.630966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397493+0000","last_change":"2023-11-29T11:12:56.393149+0000","last_active":"2023-11-29T11:12:56.397493+0000","last_peered":"2023-11-29T11:12:56.397493+0000","last_clean":"2023-11-29T11:12:56.397493+0000","last_became_active":"2023-11-29T11:12:56.392696+0000","last_became_peered":"2023-11-29T11:12:56.392696+0000","last_unstale":"2023-11-29T11:12:56.397493+0000","last_undegraded":"2023-11-29T11:12:56.397493+0000","last_fullsized":"2023-11-29T11:12:56.397493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:53:46.404557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380298+0000","last_change":"2023-11-29T11:12:52.369003+0000","last_active":"2023-11-29T11:12:56.380298+0000","last_peered":"2023-11-29T11:12:56.380298+0000","last_clean":"2023-11-29T11:12:56.380298+0000","last_became_active":"2023-11-29T11:12:52.368615+0000","last_became_peered":"2023-11-29T11:12:52.368615+0000","last_unstale":"2023-11-29T11:12:56.380298+0000","last_undegraded":"2023-11-29T11:12:56.380298+0000","last_fullsized":"2023-11-29T11:12:56.380298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:23:46.973175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370121+0000","last_change":"2023-11-29T11:12:51.985684+0000","last_active":"2023-11-29T11:12:56.370121+0000","last_peered":"2023-11-29T11:12:56.370121+0000","last_clean":"2023-11-29T11:12:56.370121+0000","last_became_active":"2023-11-29T11:12:51.985365+0000","last_became_peered":"2023-11-29T11:12:51.985365+0000","last_unstale":"2023-11-29T11:12:56.370121+0000","last_undegraded":"2023-11-29T11:12:56.370121+0000","last_fullsized":"2023-11-29T11:12:56.370121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:41.431586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399198+0000","last_change":"2023-11-29T11:12:56.390266+0000","last_active":"2023-11-29T11:12:56.399198+0000","last_peered":"2023-11-29T11:12:56.399198+0000","last_clean":"2023-11-29T11:12:56.399198+0000","last_became_active":"2023-11-29T11:12:56.389828+0000","last_became_peered":"2023-11-29T11:12:56.389828+0000","last_unstale":"2023-11-29T11:12:56.399198+0000","last_undegraded":"2023-11-29T11:12:56.399198+0000","last_fullsized":"2023-11-29T11:12:56.399198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:36.814765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385128+0000","last_change":"2023-11-29T11:12:52.359364+0000","last_active":"2023-11-29T11:12:56.385128+0000","last_peered":"2023-11-29T11:12:56.385128+0000","last_clean":"2023-11-29T11:12:56.385128+0000","last_became_active":"2023-11-29T11:12:52.358958+0000","last_became_peered":"2023-11-29T11:12:52.358958+0000","last_unstale":"2023-11-29T11:12:56.385128+0000","last_undegraded":"2023-11-29T11:12:56.385128+0000","last_fullsized":"2023-11-29T11:12:56.385128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383366+0000","last_change":"2023-11-29T11:12:51.986410+0000","last_active":"2023-11-29T11:12:56.383366+0000","last_peered":"2023-11-29T11:12:56.383366+0000","last_clean":"2023-11-29T11:12:56.383366+0000","last_became_active":"2023-11-29T11:12:51.986045+0000","last_became_peered":"2023-11-29T11:12:51.986045+0000","last_unstale":"2023-11-29T11:12:56.383366+0000","last_undegraded":"2023-11-29T11:12:56.383366+0000","last_fullsized":"2023-11-29T11:12:56.383366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:06:56.628542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.396923+0000","last_change":"2023-11-29T11:12:56.389886+0000","last_active":"2023-11-29T11:12:56.396923+0000","last_peered":"2023-11-29T11:12:56.396923+0000","last_clean":"2023-11-29T11:12:56.396923+0000","last_became_active":"2023-11-29T11:12:56.389457+0000","last_became_peered":"2023-11-29T11:12:56.389457+0000","last_unstale":"2023-11-29T11:12:56.396923+0000","last_undegraded":"2023-11-29T11:12:56.396923+0000","last_fullsized":"2023-11-29T11:12:56.396923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:32.929777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368896+0000","last_change":"2023-11-29T11:12:52.367726+0000","last_active":"2023-11-29T11:12:56.368896+0000","last_peered":"2023-11-29T11:12:56.368896+0000","last_clean":"2023-11-29T11:12:56.368896+0000","last_became_active":"2023-11-29T11:12:52.366804+0000","last_became_peered":"2023-11-29T11:12:52.366804+0000","last_unstale":"2023-11-29T11:12:56.368896+0000","last_undegraded":"2023-11-29T11:12:56.368896+0000","last_fullsized":"2023-11-29T11:12:56.368896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:17:42.639576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381008+0000","last_change":"2023-11-29T11:12:51.983384+0000","last_active":"2023-11-29T11:12:56.381008+0000","last_peered":"2023-11-29T11:12:56.381008+0000","last_clean":"2023-11-29T11:12:56.381008+0000","last_became_active":"2023-11-29T11:12:51.983089+0000","last_became_peered":"2023-11-29T11:12:51.983089+0000","last_unstale":"2023-11-29T11:12:56.381008+0000","last_undegraded":"2023-11-29T11:12:56.381008+0000","last_fullsized":"2023-11-29T11:12:56.381008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:03:52.716864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399333+0000","last_change":"2023-11-29T11:12:56.391089+0000","last_active":"2023-11-29T11:12:56.399333+0000","last_peered":"2023-11-29T11:12:56.399333+0000","last_clean":"2023-11-29T11:12:56.399333+0000","last_became_active":"2023-11-29T11:12:56.390703+0000","last_became_peered":"2023-11-29T11:12:56.390703+0000","last_unstale":"2023-11-29T11:12:56.399333+0000","last_undegraded":"2023-11-29T11:12:56.399333+0000","last_fullsized":"2023-11-29T11:12:56.399333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:40.615554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379572+0000","last_change":"2023-11-29T11:12:52.360602+0000","last_active":"2023-11-29T11:12:56.379572+0000","last_peered":"2023-11-29T11:12:56.379572+0000","last_clean":"2023-11-29T11:12:56.379572+0000","last_became_active":"2023-11-29T11:12:52.360297+0000","last_became_peered":"2023-11-29T11:12:52.360297+0000","last_unstale":"2023-11-29T11:12:56.379572+0000","last_undegraded":"2023-11-29T11:12:56.379572+0000","last_fullsized":"2023-11-29T11:12:56.379572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:42:56.481528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381711+0000","last_change":"2023-11-29T11:12:51.985395+0000","last_active":"2023-11-29T11:12:56.381711+0000","last_peered":"2023-11-29T11:12:56.381711+0000","last_clean":"2023-11-29T11:12:56.381711+0000","last_became_active":"2023-11-29T11:12:51.985039+0000","last_became_peered":"2023-11-29T11:12:51.985039+0000","last_unstale":"2023-11-29T11:12:56.381711+0000","last_undegraded":"2023-11-29T11:12:56.381711+0000","last_fullsized":"2023-11-29T11:12:56.381711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:47.682887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.404204+0000","last_change":"2023-11-29T11:12:56.398067+0000","last_active":"2023-11-29T11:12:56.404204+0000","last_peered":"2023-11-29T11:12:56.404204+0000","last_clean":"2023-11-29T11:12:56.404204+0000","last_became_active":"2023-11-29T11:12:56.397483+0000","last_became_peered":"2023-11-29T11:12:56.397483+0000","last_unstale":"2023-11-29T11:12:56.404204+0000","last_undegraded":"2023-11-29T11:12:56.404204+0000","last_fullsized":"2023-11-29T11:12:56.404204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:51.701101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382817+0000","last_change":"2023-11-29T11:12:52.356144+0000","last_active":"2023-11-29T11:12:56.382817+0000","last_peered":"2023-11-29T11:12:56.382817+0000","last_clean":"2023-11-29T11:12:56.382817+0000","last_became_active":"2023-11-29T11:12:52.355872+0000","last_became_peered":"2023-11-29T11:12:52.355872+0000","last_unstale":"2023-11-29T11:12:56.382817+0000","last_undegraded":"2023-11-29T11:12:56.382817+0000","last_fullsized":"2023-11-29T11:12:56.382817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:50:29.425278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382282+0000","last_change":"2023-11-29T11:12:51.985298+0000","last_active":"2023-11-29T11:12:56.382282+0000","last_peered":"2023-11-29T11:12:56.382282+0000","last_clean":"2023-11-29T11:12:56.382282+0000","last_became_active":"2023-11-29T11:12:51.984926+0000","last_became_peered":"2023-11-29T11:12:51.984926+0000","last_unstale":"2023-11-29T11:12:56.382282+0000","last_undegraded":"2023-11-29T11:12:56.382282+0000","last_fullsized":"2023-11-29T11:12:56.382282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:36.656157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401387+0000","last_change":"2023-11-29T11:12:56.396907+0000","last_active":"2023-11-29T11:12:56.401387+0000","last_peered":"2023-11-29T11:12:56.401387+0000","last_clean":"2023-11-29T11:12:56.401387+0000","last_became_active":"2023-11-29T11:12:56.396549+0000","last_became_peered":"2023-11-29T11:12:56.396549+0000","last_unstale":"2023-11-29T11:12:56.401387+0000","last_undegraded":"2023-11-29T11:12:56.401387+0000","last_fullsized":"2023-11-29T11:12:56.401387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402989+0000","last_change":"2023-11-29T11:12:56.400298+0000","last_active":"2023-11-29T11:12:56.402989+0000","last_peered":"2023-11-29T11:12:56.402989+0000","last_clean":"2023-11-29T11:12:56.402989+0000","last_became_active":"2023-11-29T11:12:56.399859+0000","last_became_peered":"2023-11-29T11:12:56.399859+0000","last_unstale":"2023-11-29T11:12:56.402989+0000","last_undegraded":"2023-11-29T11:12:56.402989+0000","last_fullsized":"2023-11-29T11:12:56.402989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:58:42.333539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368372+0000","last_change":"2023-11-29T11:12:51.975809+0000","last_active":"2023-11-29T11:12:56.368372+0000","last_peered":"2023-11-29T11:12:56.368372+0000","last_clean":"2023-11-29T11:12:56.368372+0000","last_became_active":"2023-11-29T11:12:51.975519+0000","last_became_peered":"2023-11-29T11:12:51.975519+0000","last_unstale":"2023-11-29T11:12:56.368372+0000","last_undegraded":"2023-11-29T11:12:56.368372+0000","last_fullsized":"2023-11-29T11:12:56.368372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:27:55.174112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374809+0000","last_change":"2023-11-29T11:12:52.365673+0000","last_active":"2023-11-29T11:12:56.374809+0000","last_peered":"2023-11-29T11:12:56.374809+0000","last_clean":"2023-11-29T11:12:56.374809+0000","last_became_active":"2023-11-29T11:12:52.365394+0000","last_became_peered":"2023-11-29T11:12:52.365394+0000","last_unstale":"2023-11-29T11:12:56.374809+0000","last_undegraded":"2023-11-29T11:12:56.374809+0000","last_fullsized":"2023-11-29T11:12:56.374809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400814+0000","last_change":"2023-11-29T11:12:56.391998+0000","last_active":"2023-11-29T11:12:56.400814+0000","last_peered":"2023-11-29T11:12:56.400814+0000","last_clean":"2023-11-29T11:12:56.400814+0000","last_became_active":"2023-11-29T11:12:56.391600+0000","last_became_peered":"2023-11-29T11:12:56.391600+0000","last_unstale":"2023-11-29T11:12:56.400814+0000","last_undegraded":"2023-11-29T11:12:56.400814+0000","last_fullsized":"2023-11-29T11:12:56.400814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:43:20.599589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382545+0000","last_change":"2023-11-29T11:12:51.985807+0000","last_active":"2023-11-29T11:12:56.382545+0000","last_peered":"2023-11-29T11:12:56.382545+0000","last_clean":"2023-11-29T11:12:56.382545+0000","last_became_active":"2023-11-29T11:12:51.985137+0000","last_became_peered":"2023-11-29T11:12:51.985137+0000","last_unstale":"2023-11-29T11:12:56.382545+0000","last_undegraded":"2023-11-29T11:12:56.382545+0000","last_fullsized":"2023-11-29T11:12:56.382545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:50:57.222111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385212+0000","last_change":"2023-11-29T11:12:52.369387+0000","last_active":"2023-11-29T11:12:56.385212+0000","last_peered":"2023-11-29T11:12:56.385212+0000","last_clean":"2023-11-29T11:12:56.385212+0000","last_became_active":"2023-11-29T11:12:52.369149+0000","last_became_peered":"2023-11-29T11:12:52.369149+0000","last_unstale":"2023-11-29T11:12:56.385212+0000","last_undegraded":"2023-11-29T11:12:56.385212+0000","last_fullsized":"2023-11-29T11:12:56.385212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384642+0000","last_change":"2023-11-29T11:12:51.980655+0000","last_active":"2023-11-29T11:12:56.384642+0000","last_peered":"2023-11-29T11:12:56.384642+0000","last_clean":"2023-11-29T11:12:56.384642+0000","last_became_active":"2023-11-29T11:12:51.979444+0000","last_became_peered":"2023-11-29T11:12:51.979444+0000","last_unstale":"2023-11-29T11:12:56.384642+0000","last_undegraded":"2023-11-29T11:12:56.384642+0000","last_fullsized":"2023-11-29T11:12:56.384642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:32.597395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384347+0000","last_change":"2023-11-29T11:12:52.364984+0000","last_active":"2023-11-29T11:12:56.384347+0000","last_peered":"2023-11-29T11:12:56.384347+0000","last_clean":"2023-11-29T11:12:56.384347+0000","last_became_active":"2023-11-29T11:12:52.364646+0000","last_became_peered":"2023-11-29T11:12:52.364646+0000","last_unstale":"2023-11-29T11:12:56.384347+0000","last_undegraded":"2023-11-29T11:12:56.384347+0000","last_fullsized":"2023-11-29T11:12:56.384347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:03:33.514623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400841+0000","last_change":"2023-11-29T11:12:56.391838+0000","last_active":"2023-11-29T11:12:56.400841+0000","last_peered":"2023-11-29T11:12:56.400841+0000","last_clean":"2023-11-29T11:12:56.400841+0000","last_became_active":"2023-11-29T11:12:56.390070+0000","last_became_peered":"2023-11-29T11:12:56.390070+0000","last_unstale":"2023-11-29T11:12:56.400841+0000","last_undegraded":"2023-11-29T11:12:56.400841+0000","last_fullsized":"2023-11-29T11:12:56.400841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:08:17.216618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380625+0000","last_change":"2023-11-29T11:12:51.985954+0000","last_active":"2023-11-29T11:12:56.380625+0000","last_peered":"2023-11-29T11:12:56.380625+0000","last_clean":"2023-11-29T11:12:56.380625+0000","last_became_active":"2023-11-29T11:12:51.984970+0000","last_became_peered":"2023-11-29T11:12:51.984970+0000","last_unstale":"2023-11-29T11:12:56.380625+0000","last_undegraded":"2023-11-29T11:12:56.380625+0000","last_fullsized":"2023-11-29T11:12:56.380625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:05:41.981906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.373298+0000","last_change":"2023-11-29T11:12:52.361389+0000","last_active":"2023-11-29T11:12:56.373298+0000","last_peered":"2023-11-29T11:12:56.373298+0000","last_clean":"2023-11-29T11:12:56.373298+0000","last_became_active":"2023-11-29T11:12:52.361124+0000","last_became_peered":"2023-11-29T11:12:52.361124+0000","last_unstale":"2023-11-29T11:12:56.373298+0000","last_undegraded":"2023-11-29T11:12:56.373298+0000","last_fullsized":"2023-11-29T11:12:56.373298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402966+0000","last_change":"2023-11-29T11:12:56.400109+0000","last_active":"2023-11-29T11:12:56.402966+0000","last_peered":"2023-11-29T11:12:56.402966+0000","last_clean":"2023-11-29T11:12:56.402966+0000","last_became_active":"2023-11-29T11:12:56.397857+0000","last_became_peered":"2023-11-29T11:12:56.397857+0000","last_unstale":"2023-11-29T11:12:56.402966+0000","last_undegraded":"2023-11-29T11:12:56.402966+0000","last_fullsized":"2023-11-29T11:12:56.402966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:48:31.563968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368339+0000","last_change":"2023-11-29T11:12:52.368059+0000","last_active":"2023-11-29T11:12:56.368339+0000","last_peered":"2023-11-29T11:12:56.368339+0000","last_clean":"2023-11-29T11:12:56.368339+0000","last_became_active":"2023-11-29T11:12:52.367696+0000","last_became_peered":"2023-11-29T11:12:52.367696+0000","last_unstale":"2023-11-29T11:12:56.368339+0000","last_undegraded":"2023-11-29T11:12:56.368339+0000","last_fullsized":"2023-11-29T11:12:56.368339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:47:39.444454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368288+0000","last_change":"2023-11-29T11:12:52.357396+0000","last_active":"2023-11-29T11:12:56.368288+0000","last_peered":"2023-11-29T11:12:56.368288+0000","last_clean":"2023-11-29T11:12:56.368288+0000","last_became_active":"2023-11-29T11:12:52.357150+0000","last_became_peered":"2023-11-29T11:12:52.357150+0000","last_unstale":"2023-11-29T11:12:56.368288+0000","last_undegraded":"2023-11-29T11:12:56.368288+0000","last_fullsized":"2023-11-29T11:12:56.368288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:37.039342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381253+0000","last_change":"2023-11-29T11:12:52.371840+0000","last_active":"2023-11-29T11:12:56.381253+0000","last_peered":"2023-11-29T11:12:56.381253+0000","last_clean":"2023-11-29T11:12:56.381253+0000","last_became_active":"2023-11-29T11:12:52.371439+0000","last_became_peered":"2023-11-29T11:12:52.371439+0000","last_unstale":"2023-11-29T11:12:56.381253+0000","last_undegraded":"2023-11-29T11:12:56.381253+0000","last_fullsized":"2023-11-29T11:12:56.381253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:37.039342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369559+0000","last_change":"2023-11-29T11:12:52.364323+0000","last_active":"2023-11-29T11:12:56.369559+0000","last_peered":"2023-11-29T11:12:56.369559+0000","last_clean":"2023-11-29T11:12:56.369559+0000","last_became_active":"2023-11-29T11:12:52.364156+0000","last_became_peered":"2023-11-29T11:12:52.364156+0000","last_unstale":"2023-11-29T11:12:56.369559+0000","last_undegraded":"2023-11-29T11:12:56.369559+0000","last_fullsized":"2023-11-29T11:12:56.369559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387198+0000","last_change":"2023-11-29T11:12:52.365212+0000","last_active":"2023-11-29T11:12:56.387198+0000","last_peered":"2023-11-29T11:12:56.387198+0000","last_clean":"2023-11-29T11:12:56.387198+0000","last_became_active":"2023-11-29T11:12:52.364966+0000","last_became_peered":"2023-11-29T11:12:52.364966+0000","last_unstale":"2023-11-29T11:12:56.387198+0000","last_undegraded":"2023-11-29T11:12:56.387198+0000","last_fullsized":"2023-11-29T11:12:56.387198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:37.666038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383761+0000","last_change":"2023-11-29T11:12:52.365967+0000","last_active":"2023-11-29T11:12:56.383761+0000","last_peered":"2023-11-29T11:12:56.383761+0000","last_clean":"2023-11-29T11:12:56.383761+0000","last_became_active":"2023-11-29T11:12:52.365701+0000","last_became_peered":"2023-11-29T11:12:52.365701+0000","last_unstale":"2023-11-29T11:12:56.383761+0000","last_undegraded":"2023-11-29T11:12:56.383761+0000","last_fullsized":"2023-11-29T11:12:56.383761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:13:33.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387884+0000","last_change":"2023-11-29T11:12:52.357675+0000","last_active":"2023-11-29T11:12:56.387884+0000","last_peered":"2023-11-29T11:12:56.387884+0000","last_clean":"2023-11-29T11:12:56.387884+0000","last_became_active":"2023-11-29T11:12:52.356554+0000","last_became_peered":"2023-11-29T11:12:52.356554+0000","last_unstale":"2023-11-29T11:12:56.387884+0000","last_undegraded":"2023-11-29T11:12:56.387884+0000","last_fullsized":"2023-11-29T11:12:56.387884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:48.692769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387575+0000","last_change":"2023-11-29T11:12:52.355949+0000","last_active":"2023-11-29T11:12:56.387575+0000","last_peered":"2023-11-29T11:12:56.387575+0000","last_clean":"2023-11-29T11:12:56.387575+0000","last_became_active":"2023-11-29T11:12:52.355707+0000","last_became_peered":"2023-11-29T11:12:52.355707+0000","last_unstale":"2023-11-29T11:12:56.387575+0000","last_undegraded":"2023-11-29T11:12:56.387575+0000","last_fullsized":"2023-11-29T11:12:56.387575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:37:21.284939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381161+0000","last_change":"2023-11-29T11:12:52.370097+0000","last_active":"2023-11-29T11:12:56.381161+0000","last_peered":"2023-11-29T11:12:56.381161+0000","last_clean":"2023-11-29T11:12:56.381161+0000","last_became_active":"2023-11-29T11:12:52.369728+0000","last_became_peered":"2023-11-29T11:12:52.369728+0000","last_unstale":"2023-11-29T11:12:56.381161+0000","last_undegraded":"2023-11-29T11:12:56.381161+0000","last_fullsized":"2023-11-29T11:12:56.381161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368286+0000","last_change":"2023-11-29T11:12:52.362045+0000","last_active":"2023-11-29T11:12:56.368286+0000","last_peered":"2023-11-29T11:12:56.368286+0000","last_clean":"2023-11-29T11:12:56.368286+0000","last_became_active":"2023-11-29T11:12:52.361805+0000","last_became_peered":"2023-11-29T11:12:52.361805+0000","last_unstale":"2023-11-29T11:12:56.368286+0000","last_undegraded":"2023-11-29T11:12:56.368286+0000","last_fullsized":"2023-11-29T11:12:56.368286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:33.415072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384559+0000","last_change":"2023-11-29T11:12:52.366412+0000","last_active":"2023-11-29T11:12:56.384559+0000","last_peered":"2023-11-29T11:12:56.384559+0000","last_clean":"2023-11-29T11:12:56.384559+0000","last_became_active":"2023-11-29T11:12:52.366126+0000","last_became_peered":"2023-11-29T11:12:52.366126+0000","last_unstale":"2023-11-29T11:12:56.384559+0000","last_undegraded":"2023-11-29T11:12:56.384559+0000","last_fullsized":"2023-11-29T11:12:56.384559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380508+0000","last_change":"2023-11-29T11:12:52.370183+0000","last_active":"2023-11-29T11:12:56.380508+0000","last_peered":"2023-11-29T11:12:56.380508+0000","last_clean":"2023-11-29T11:12:56.380508+0000","last_became_active":"2023-11-29T11:12:52.369892+0000","last_became_peered":"2023-11-29T11:12:52.369892+0000","last_unstale":"2023-11-29T11:12:56.380508+0000","last_undegraded":"2023-11-29T11:12:56.380508+0000","last_fullsized":"2023-11-29T11:12:56.380508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380211+0000","last_change":"2023-11-29T11:12:52.371780+0000","last_active":"2023-11-29T11:12:56.380211+0000","last_peered":"2023-11-29T11:12:56.380211+0000","last_clean":"2023-11-29T11:12:56.380211+0000","last_became_active":"2023-11-29T11:12:52.371499+0000","last_became_peered":"2023-11-29T11:12:52.371499+0000","last_unstale":"2023-11-29T11:12:56.380211+0000","last_undegraded":"2023-11-29T11:12:56.380211+0000","last_fullsized":"2023-11-29T11:12:56.380211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:29.530084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374798+0000","last_change":"2023-11-29T11:12:52.374635+0000","last_active":"2023-11-29T11:12:56.374798+0000","last_peered":"2023-11-29T11:12:56.374798+0000","last_clean":"2023-11-29T11:12:56.374798+0000","last_became_active":"2023-11-29T11:12:52.374355+0000","last_became_peered":"2023-11-29T11:12:52.374355+0000","last_unstale":"2023-11-29T11:12:56.374798+0000","last_undegraded":"2023-11-29T11:12:56.374798+0000","last_fullsized":"2023-11-29T11:12:56.374798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:33.607277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380843+0000","last_change":"2023-11-29T11:12:52.357862+0000","last_active":"2023-11-29T11:12:56.380843+0000","last_peered":"2023-11-29T11:12:56.380843+0000","last_clean":"2023-11-29T11:12:56.380843+0000","last_became_active":"2023-11-29T11:12:52.357481+0000","last_became_peered":"2023-11-29T11:12:52.357481+0000","last_unstale":"2023-11-29T11:12:56.380843+0000","last_undegraded":"2023-11-29T11:12:56.380843+0000","last_fullsized":"2023-11-29T11:12:56.380843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:48.301408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384706+0000","last_change":"2023-11-29T11:12:52.369352+0000","last_active":"2023-11-29T11:12:56.384706+0000","last_peered":"2023-11-29T11:12:56.384706+0000","last_clean":"2023-11-29T11:12:56.384706+0000","last_became_active":"2023-11-29T11:12:52.369088+0000","last_became_peered":"2023-11-29T11:12:52.369088+0000","last_unstale":"2023-11-29T11:12:56.384706+0000","last_undegraded":"2023-11-29T11:12:56.384706+0000","last_fullsized":"2023-11-29T11:12:56.384706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379103+0000","last_change":"2023-11-29T11:12:52.360140+0000","last_active":"2023-11-29T11:12:56.379103+0000","last_peered":"2023-11-29T11:12:56.379103+0000","last_clean":"2023-11-29T11:12:56.379103+0000","last_became_active":"2023-11-29T11:12:52.359850+0000","last_became_peered":"2023-11-29T11:12:52.359850+0000","last_unstale":"2023-11-29T11:12:56.379103+0000","last_undegraded":"2023-11-29T11:12:56.379103+0000","last_fullsized":"2023-11-29T11:12:56.379103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:58.881146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382463+0000","last_change":"2023-11-29T11:12:52.364490+0000","last_active":"2023-11-29T11:12:56.382463+0000","last_peered":"2023-11-29T11:12:56.382463+0000","last_clean":"2023-11-29T11:12:56.382463+0000","last_became_active":"2023-11-29T11:12:52.364230+0000","last_became_peered":"2023-11-29T11:12:52.364230+0000","last_unstale":"2023-11-29T11:12:56.382463+0000","last_undegraded":"2023-11-29T11:12:56.382463+0000","last_fullsized":"2023-11-29T11:12:56.382463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382900+0000","last_change":"2023-11-29T11:12:52.355458+0000","last_active":"2023-11-29T11:12:56.382900+0000","last_peered":"2023-11-29T11:12:56.382900+0000","last_clean":"2023-11-29T11:12:56.382900+0000","last_became_active":"2023-11-29T11:12:52.355112+0000","last_became_peered":"2023-11-29T11:12:52.355112+0000","last_unstale":"2023-11-29T11:12:56.382900+0000","last_undegraded":"2023-11-29T11:12:56.382900+0000","last_fullsized":"2023-11-29T11:12:56.382900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:15:39.290136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374499+0000","last_change":"2023-11-29T11:12:52.362310+0000","last_active":"2023-11-29T11:12:56.374499+0000","last_peered":"2023-11-29T11:12:56.374499+0000","last_clean":"2023-11-29T11:12:56.374499+0000","last_became_active":"2023-11-29T11:12:52.362044+0000","last_became_peered":"2023-11-29T11:12:52.362044+0000","last_unstale":"2023-11-29T11:12:56.374499+0000","last_undegraded":"2023-11-29T11:12:56.374499+0000","last_fullsized":"2023-11-29T11:12:56.374499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:26.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374336+0000","last_change":"2023-11-29T11:12:52.363035+0000","last_active":"2023-11-29T11:12:56.374336+0000","last_peered":"2023-11-29T11:12:56.374336+0000","last_clean":"2023-11-29T11:12:56.374336+0000","last_became_active":"2023-11-29T11:12:52.362777+0000","last_became_peered":"2023-11-29T11:12:52.362777+0000","last_unstale":"2023-11-29T11:12:56.374336+0000","last_undegraded":"2023-11-29T11:12:56.374336+0000","last_fullsized":"2023-11-29T11:12:56.374336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:42.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381131+0000","last_change":"2023-11-29T11:12:52.357340+0000","last_active":"2023-11-29T11:12:56.381131+0000","last_peered":"2023-11-29T11:12:56.381131+0000","last_clean":"2023-11-29T11:12:56.381131+0000","last_became_active":"2023-11-29T11:12:52.356936+0000","last_became_peered":"2023-11-29T11:12:52.356936+0000","last_unstale":"2023-11-29T11:12:56.381131+0000","last_undegraded":"2023-11-29T11:12:56.381131+0000","last_fullsized":"2023-11-29T11:12:56.381131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:20:13.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383892+0000","last_change":"2023-11-29T11:12:52.354108+0000","last_active":"2023-11-29T11:12:56.383892+0000","last_peered":"2023-11-29T11:12:56.383892+0000","last_clean":"2023-11-29T11:12:56.383892+0000","last_became_active":"2023-11-29T11:12:52.353534+0000","last_became_peered":"2023-11-29T11:12:52.353534+0000","last_unstale":"2023-11-29T11:12:56.383892+0000","last_undegraded":"2023-11-29T11:12:56.383892+0000","last_fullsized":"2023-11-29T11:12:56.383892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:14:34.234715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384606+0000","last_change":"2023-11-29T11:12:52.369656+0000","last_active":"2023-11-29T11:12:56.384606+0000","last_peered":"2023-11-29T11:12:56.384606+0000","last_clean":"2023-11-29T11:12:56.384606+0000","last_became_active":"2023-11-29T11:12:52.368839+0000","last_became_peered":"2023-11-29T11:12:52.368839+0000","last_unstale":"2023-11-29T11:12:56.384606+0000","last_undegraded":"2023-11-29T11:12:56.384606+0000","last_fullsized":"2023-11-29T11:12:56.384606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:37.215861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382726+0000","last_change":"2023-11-29T11:12:52.355392+0000","last_active":"2023-11-29T11:12:56.382726+0000","last_peered":"2023-11-29T11:12:56.382726+0000","last_clean":"2023-11-29T11:12:56.382726+0000","last_became_active":"2023-11-29T11:12:52.355084+0000","last_became_peered":"2023-11-29T11:12:52.355084+0000","last_unstale":"2023-11-29T11:12:56.382726+0000","last_undegraded":"2023-11-29T11:12:56.382726+0000","last_fullsized":"2023-11-29T11:12:56.382726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:54:14.472430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382377+0000","last_change":"2023-11-29T11:12:52.363068+0000","last_active":"2023-11-29T11:12:56.382377+0000","last_peered":"2023-11-29T11:12:56.382377+0000","last_clean":"2023-11-29T11:12:56.382377+0000","last_became_active":"2023-11-29T11:12:52.362728+0000","last_became_peered":"2023-11-29T11:12:52.362728+0000","last_unstale":"2023-11-29T11:12:56.382377+0000","last_undegraded":"2023-11-29T11:12:56.382377+0000","last_fullsized":"2023-11-29T11:12:56.382377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380636+0000","last_change":"2023-11-29T11:12:52.360412+0000","last_active":"2023-11-29T11:12:56.380636+0000","last_peered":"2023-11-29T11:12:56.380636+0000","last_clean":"2023-11-29T11:12:56.380636+0000","last_became_active":"2023-11-29T11:12:52.357967+0000","last_became_peered":"2023-11-29T11:12:52.357967+0000","last_unstale":"2023-11-29T11:12:56.380636+0000","last_undegraded":"2023-11-29T11:12:56.380636+0000","last_fullsized":"2023-11-29T11:12:56.380636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:46:49.933331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385349+0000","last_change":"2023-11-29T11:12:52.370887+0000","last_active":"2023-11-29T11:12:56.385349+0000","last_peered":"2023-11-29T11:12:56.385349+0000","last_clean":"2023-11-29T11:12:56.385349+0000","last_became_active":"2023-11-29T11:12:52.370640+0000","last_became_peered":"2023-11-29T11:12:52.370640+0000","last_unstale":"2023-11-29T11:12:56.385349+0000","last_undegraded":"2023-11-29T11:12:56.385349+0000","last_fullsized":"2023-11-29T11:12:56.385349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370091+0000","last_change":"2023-11-29T11:12:52.367091+0000","last_active":"2023-11-29T11:12:56.370091+0000","last_peered":"2023-11-29T11:12:56.370091+0000","last_clean":"2023-11-29T11:12:56.370091+0000","last_became_active":"2023-11-29T11:12:52.366750+0000","last_became_peered":"2023-11-29T11:12:52.366750+0000","last_unstale":"2023-11-29T11:12:56.370091+0000","last_undegraded":"2023-11-29T11:12:56.370091+0000","last_fullsized":"2023-11-29T11:12:56.370091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:15:10.149279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380743+0000","last_change":"2023-11-29T11:12:52.361017+0000","last_active":"2023-11-29T11:12:56.380743+0000","last_peered":"2023-11-29T11:12:56.380743+0000","last_clean":"2023-11-29T11:12:56.380743+0000","last_became_active":"2023-11-29T11:12:52.359867+0000","last_became_peered":"2023-11-29T11:12:52.359867+0000","last_unstale":"2023-11-29T11:12:56.380743+0000","last_undegraded":"2023-11-29T11:12:56.380743+0000","last_fullsized":"2023-11-29T11:12:56.380743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:41.227959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383793+0000","last_change":"2023-11-29T11:12:52.359305+0000","last_active":"2023-11-29T11:12:56.383793+0000","last_peered":"2023-11-29T11:12:56.383793+0000","last_clean":"2023-11-29T11:12:56.383793+0000","last_became_active":"2023-11-29T11:12:52.359005+0000","last_became_peered":"2023-11-29T11:12:52.359005+0000","last_unstale":"2023-11-29T11:12:56.383793+0000","last_undegraded":"2023-11-29T11:12:56.383793+0000","last_fullsized":"2023-11-29T11:12:56.383793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:20:17.165426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374196+0000","last_change":"2023-11-29T11:12:52.372896+0000","last_active":"2023-11-29T11:12:56.374196+0000","last_peered":"2023-11-29T11:12:56.374196+0000","last_clean":"2023-11-29T11:12:56.374196+0000","last_became_active":"2023-11-29T11:12:52.372584+0000","last_became_peered":"2023-11-29T11:12:52.372584+0000","last_unstale":"2023-11-29T11:12:56.374196+0000","last_undegraded":"2023-11-29T11:12:56.374196+0000","last_fullsized":"2023-11-29T11:12:56.374196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:51.526860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9268,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362572,"statfs":{"total":96636764160,"available":96627273728,"internally_reserved":0,"allocated":897024,"data_stored":707312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":112983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8156,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363684,"statfs":{"total":96636764160,"available":96628412416,"internally_reserved":0,"allocated":282624,"data_stored":113619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363608,"statfs":{"total":96636764160,"available":96628334592,"internally_reserved":0,"allocated":294912,"data_stored":116784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":113073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":112983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9240,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362600,"statfs":{"total":96636764160,"available":96627302400,"internally_reserved":0,"allocated":868352,"data_stored":703351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":112563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:13:15.373 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-29T11:13:15.374 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-29T11:13:15.374 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-29T11:13:15.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-29T11:13:15.374 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-29T11:13:15.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d5972e700 1 Processor -- start 2023-11-29T11:13:15.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d5972e700 1 -- start start 2023-11-29T11:13:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d5972e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2d5406cae0 0x7f2d540b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d5972e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d54152f80 con 0x7f2d54152bb0 2023-11-29T11:13:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d5972e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d54159a30 con 0x7f2d5406c640 2023-11-29T11:13:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d5972e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5406cf40 con 0x7f2d5406cae0 2023-11-29T11:13:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d53fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d54152bb0 0x7f2d5415caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42882/0 (socket says 172.21.15.81:42882) 2023-11-29T11:13:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d53fff700 1 -- 172.21.15.81:0/1807536401 learned_addr learned my addr 172.21.15.81:0/1807536401 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d58f2d700 1 --2- 172.21.15.81:0/1807536401 >> v2:172.21.15.176:3300/0 conn(0x7f2d5406cae0 0x7f2d540b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d52ffd700 1 -- 172.21.15.81:0/1807536401 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570611239 0 0) 0x7f2d54152f80 con 0x7f2d54152bb0 2023-11-29T11:13:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d52ffd700 1 -- 172.21.15.81:0/1807536401 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d400035d0 con 0x7f2d54152bb0 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d52ffd700 1 -- 172.21.15.81:0/1807536401 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063301487 0 0) 0x7f2d54159a30 con 0x7f2d5406c640 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.486+0000 7f2d52ffd700 1 -- 172.21.15.81:0/1807536401 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d54152f80 con 0x7f2d5406c640 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d58f2d700 1 -- 172.21.15.81:0/1807536401 >> v1:172.21.15.176:6789/0 conn(0x7f2d5406c640 legacy=0x7f2d540b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d52ffd700 1 -- 172.21.15.81:0/1807536401 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2826854328 0 0) 0x7f2d400035d0 con 0x7f2d54152bb0 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d58f2d700 1 -- 172.21.15.81:0/1807536401 >> v1:172.21.15.81:6789/0 conn(0x7f2d54152bb0 legacy=0x7f2d5415caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d58f2d700 1 -- 172.21.15.81:0/1807536401 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d54158eb0 con 0x7f2d5406cae0 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d58f2d700 1 --2- 172.21.15.81:0/1807536401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 0x7f2d540b2730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00aea0 tx=0x7f2d4c00c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac331ebeef855e09 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d52ffd700 1 -- 172.21.15.81:0/1807536401 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c00f070 con 0x7f2d5406cae0 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d52ffd700 1 -- 172.21.15.81:0/1807536401 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c003a40 con 0x7f2d5406cae0 2023-11-29T11:13:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d52ffd700 1 -- 172.21.15.81:0/1807536401 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44001670 con 0x7f2d5406cae0 2023-11-29T11:13:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d5972e700 1 -- 172.21.15.81:0/1807536401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 msgr2=0x7f2d540b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d5972e700 1 --2- 172.21.15.81:0/1807536401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 0x7f2d540b2730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00aea0 tx=0x7f2d4c00c330 comp rx=0 tx=0).stop 2023-11-29T11:13:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d5972e700 1 -- 172.21.15.81:0/1807536401 shutdown_connections 2023-11-29T11:13:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d5972e700 1 --2- 172.21.15.81:0/1807536401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 0x7f2d540b2730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d5972e700 1 -- 172.21.15.81:0/1807536401 >> 172.21.15.81:0/1807536401 conn(0x7f2d5406e000 msgr2=0x7f2d540b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d5972e700 1 -- 172.21.15.81:0/1807536401 shutdown_connections 2023-11-29T11:13:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.490+0000 7f2d5972e700 1 -- 172.21.15.81:0/1807536401 wait complete. 2023-11-29T11:13:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d5972e700 1 Processor -- start 2023-11-29T11:13:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d5972e700 1 -- start start 2023-11-29T11:13:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d5972e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d5406c640 0x7f2d5414f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d5972e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 0x7f2d540c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d5972e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d54152bb0 0x7f2d540c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d5972e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54157d90 con 0x7f2d5406c640 2023-11-29T11:13:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d5972e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5414ff10 con 0x7f2d5406cae0 2023-11-29T11:13:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d5972e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54157180 con 0x7f2d54152bb0 2023-11-29T11:13:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d53fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d5406c640 0x7f2d5414f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d53fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d5406c640 0x7f2d5414f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44756/0 (socket says 172.21.15.81:44756) 2023-11-29T11:13:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.494+0000 7f2d53fff700 1 -- 172.21.15.81:0/2412104857 learned_addr learned my addr 172.21.15.81:0/2412104857 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d58f2d700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d54152bb0 0x7f2d540c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d537fe700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 0x7f2d540c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d53fff700 1 -- 172.21.15.81:0/2412104857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d54152bb0 msgr2=0x7f2d540c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d53fff700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d54152bb0 0x7f2d540c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d53fff700 1 -- 172.21.15.81:0/2412104857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 msgr2=0x7f2d540c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d53fff700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 0x7f2d540c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d53fff700 1 -- 172.21.15.81:0/2412104857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c00ab80 con 0x7f2d5406c640 2023-11-29T11:13:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d53fff700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d5406c640 0x7f2d5414f9d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c750 tx=0x7f2d4400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d50ff9700 1 -- 172.21.15.81:0/2412104857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44004ca0 con 0x7f2d5406c640 2023-11-29T11:13:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d50ff9700 1 -- 172.21.15.81:0/2412104857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d44004e00 con 0x7f2d5406c640 2023-11-29T11:13:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d54159470 con 0x7f2d5406c640 2023-11-29T11:13:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d50ff9700 1 -- 172.21.15.81:0/2412104857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d440072f0 con 0x7f2d5406c640 2023-11-29T11:13:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d54159190 con 0x7f2d5406c640 2023-11-29T11:13:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d54159750 con 0x7f2d5406c640 2023-11-29T11:13:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d50ff9700 1 -- 172.21.15.81:0/2412104857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2d4401a020 con 0x7f2d5406c640 2023-11-29T11:13:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d50ff9700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2d34064ee0 0x7f2d34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d50ff9700 1 -- 172.21.15.81:0/2412104857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d44081d80 con 0x7f2d5406c640 2023-11-29T11:13:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.498+0000 7f2d537fe700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2d34064ee0 0x7f2d34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.502+0000 7f2d537fe700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2d34064ee0 0x7f2d34067390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d540cb210 tx=0x7f2d3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.510+0000 7f2d50ff9700 1 -- 172.21.15.81:0/2412104857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2d4404fce0 con 0x7f2d5406c640 2023-11-29T11:13:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.702+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2d540cea60 con 0x7f2d5406c640 2023-11-29T11:13:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.710+0000 7f2d50ff9700 1 -- 172.21.15.81:0/2412104857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161629 (secure 0 0 0) 0x7f2d44053300 con 0x7f2d5406c640 2023-11-29T11:13:15.716 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2d34064ee0 msgr2=0x7f2d34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2d34064ee0 0x7f2d34067390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d540cb210 tx=0x7f2d3c009040 comp rx=0 tx=0).stop 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d5406c640 msgr2=0x7f2d5414f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d5406c640 0x7f2d5414f9d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c750 tx=0x7f2d4400ca60 comp rx=0 tx=0).stop 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 shutdown_connections 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2d34064ee0 0x7f2d34067390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d54152bb0 0x7f2d540c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5406cae0 0x7f2d540c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 --2- 172.21.15.81:0/2412104857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d5406c640 0x7f2d5414f9d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 >> 172.21.15.81:0/2412104857 conn(0x7f2d5406e000 msgr2=0x7f2d54151df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 shutdown_connections 2023-11-29T11:13:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.714+0000 7f2d5972e700 1 -- 172.21.15.81:0/2412104857 wait complete. 2023-11-29T11:13:15.732 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":36408},{"type":"v1","addr":"172.21.15.81:6833","nonce":36408}]},"active_addr":"172.21.15.81:6833/36408","active_change":"2023-11-29T11:12:40.410123+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4121,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1760069430}]},{"addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2737785450}]},{"addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":138155425}]},{"addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1712795509}]}]} 2023-11-29T11:13:15.735 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-29T11:13:15.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-29T11:13:15.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.842+0000 7fa9aa9a9700 1 Processor -- start 2023-11-29T11:13:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.842+0000 7fa9aa9a9700 1 -- start start 2023-11-29T11:13:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9a40cb470 0x7fa9a4164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a406ace0 con 0x7fa9a4069c40 2023-11-29T11:13:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a406a0d0 con 0x7fa9a4159e70 2023-11-29T11:13:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a406a3b0 con 0x7fa9a40cb470 2023-11-29T11:13:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a91a6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa9a4069c40 0x7fa9a40cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42898/0 (socket says 172.21.15.81:42898) 2023-11-29T11:13:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a91a6700 1 -- 172.21.15.81:0/809087537 learned_addr learned my addr 172.21.15.81:0/809087537 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 --2- 172.21.15.81:0/809087537 >> v2:172.21.15.176:3300/0 conn(0x7fa9a40cb470 0x7fa9a4164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677963019 0 0) 0x7fa9a406ace0 con 0x7fa9a4069c40 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9900035d0 con 0x7fa9a4069c40 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3357023850 0 0) 0x7fa9900035d0 con 0x7fa9a4069c40 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 >> v2:172.21.15.176:3300/0 conn(0x7fa9a40cb470 msgr2=0x7fa9a4164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 --2- 172.21.15.81:0/809087537 >> v2:172.21.15.176:3300/0 conn(0x7fa9a40cb470 0x7fa9a4164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 >> v1:172.21.15.176:6789/0 conn(0x7fa9a4159e70 legacy=0x7fa9a406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a406a690 con 0x7fa9a4069c40 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fa9a00019f0 con 0x7fa9a4069c40 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 >> v1:172.21.15.81:6789/0 conn(0x7fa9a4069c40 legacy=0x7fa9a40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa990003a20 0x7fa990003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990004870 0x7fa990004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa990005220 0x7fa99000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a406a3b0 con 0x7fa990003a20 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99000c080 con 0x7fa990005220 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99000c240 con 0x7fa990004870 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa990005220 0x7fa99000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a99a7700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa990003a20 0x7fa990003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a91a6700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990004870 0x7fa990004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 -- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990004870 msgr2=0x7fa990004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990004870 0x7fa990004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 -- 172.21.15.81:0/809087537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa990003a20 msgr2=0x7fa990003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa990003a20 0x7fa990003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 -- 172.21.15.81:0/809087537 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900035d0 con 0x7fa990005220 2023-11-29T11:13:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 -- 172.21.15.81:0/809087537 reap_dead start 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa1a8700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa990005220 0x7fa99000ba30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009b40 tx=0x7fa9900058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d73be991e298c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00e6c0 con 0x7fa990005220 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99c00e820 con 0x7fa990005220 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9a89a5700 1 -- 172.21.15.81:0/809087537 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00ebb0 con 0x7fa990005220 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa990005220 msgr2=0x7fa99000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa990005220 0x7fa99000ba30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009b40 tx=0x7fa9900058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/809087537 shutdown_connections 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 --2- 172.21.15.81:0/809087537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa990005220 0x7fa99000ba30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/809087537 >> 172.21.15.81:0/809087537 conn(0x7fa9a40ce3e0 msgr2=0x7fa9a40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/809087537 shutdown_connections 2023-11-29T11:13:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.846+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/809087537 wait complete. 2023-11-29T11:13:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa9a9700 1 Processor -- start 2023-11-29T11:13:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa9a9700 1 -- start start 2023-11-29T11:13:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa9a9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990005220 0x7fa9a41efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa9a9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a40b0b40 0x7fa9a40c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa9a9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9a415ade0 0x7fa9a40abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa9a9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a41eff50 con 0x7fa9a415ade0 2023-11-29T11:13:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa9a9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40ad6d0 con 0x7fa9a40b0b40 2023-11-29T11:13:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa9a9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40ad9b0 con 0x7fa990005220 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9a91a6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a40b0b40 0x7fa9a40c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9a99a7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990005220 0x7fa9a41efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9a91a6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a40b0b40 0x7fa9a40c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:36860/0 (socket says 172.21.15.81:36860) 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9a91a6700 1 -- 172.21.15.81:0/3318375345 learned_addr learned my addr 172.21.15.81:0/3318375345 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.850+0000 7fa9aa1a8700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9a415ade0 0x7fa9a40abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9a91a6700 1 -- 172.21.15.81:0/3318375345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990005220 msgr2=0x7fa9a41efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9a91a6700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990005220 0x7fa9a41efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9a91a6700 1 -- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9a415ade0 msgr2=0x7fa9a40abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9a91a6700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9a415ade0 0x7fa9a40abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9a91a6700 1 -- 172.21.15.81:0/3318375345 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a415a240 con 0x7fa9a40b0b40 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9a91a6700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a40b0b40 0x7fa9a40c45c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0007ca0 tx=0x7fa9a000a310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa99a7fc700 1 -- 172.21.15.81:0/3318375345 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000aba0 con 0x7fa9a40b0b40 2023-11-29T11:13:15.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa99a7fc700 1 -- 172.21.15.81:0/3318375345 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a000ad20 con 0x7fa9a40b0b40 2023-11-29T11:13:15.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a406a970 con 0x7fa9a40b0b40 2023-11-29T11:13:15.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa99a7fc700 1 -- 172.21.15.81:0/3318375345 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0013630 con 0x7fa9a40b0b40 2023-11-29T11:13:15.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a40cad60 con 0x7fa9a40b0b40 2023-11-29T11:13:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a4072500 con 0x7fa9a40b0b40 2023-11-29T11:13:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.854+0000 7fa99a7fc700 1 -- 172.21.15.81:0/3318375345 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa9a0023070 con 0x7fa9a40b0b40 2023-11-29T11:13:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.858+0000 7fa99a7fc700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa988064ee0 0x7fa988067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.858+0000 7fa99a7fc700 1 -- 172.21.15.81:0/3318375345 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9a00831d0 con 0x7fa9a40b0b40 2023-11-29T11:13:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.858+0000 7fa9a99a7700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa988064ee0 0x7fa988067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.858+0000 7fa9a99a7700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa988064ee0 0x7fa988067390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa994000c00 tx=0x7fa994009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:15.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:15.866+0000 7fa99a7fc700 1 -- 172.21.15.81:0/3318375345 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa9a0051080 con 0x7fa9a40b0b40 2023-11-29T11:13:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.030+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9a40b4170 con 0x7fa9a40b0b40 2023-11-29T11:13:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.038+0000 7fa99a7fc700 1 -- 172.21.15.81:0/3318375345 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fa9a0017090 con 0x7fa9a40b0b40 2023-11-29T11:13:16.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:16.042 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa988064ee0 msgr2=0x7fa988067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa988064ee0 0x7fa988067390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa994000c00 tx=0x7fa994009040 comp rx=0 tx=0).stop 2023-11-29T11:13:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a40b0b40 msgr2=0x7fa9a40c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a40b0b40 0x7fa9a40c45c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0007ca0 tx=0x7fa9a000a310 comp rx=0 tx=0).stop 2023-11-29T11:13:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 shutdown_connections 2023-11-29T11:13:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa988064ee0 0x7fa988067390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9a415ade0 0x7fa9a40abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a40b0b40 0x7fa9a40c45c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 --2- 172.21.15.81:0/3318375345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa990005220 0x7fa9a41efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 >> 172.21.15.81:0/3318375345 conn(0x7fa9a40ce3e0 msgr2=0x7fa9a40acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 shutdown_connections 2023-11-29T11:13:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.042+0000 7fa9aa9a9700 1 -- 172.21.15.81:0/3318375345 wait complete. 2023-11-29T11:13:16.058 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-29T11:13:16.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866ed64700 1 Processor -- start 2023-11-29T11:13:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866ed64700 1 -- start start 2023-11-29T11:13:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866ed64700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8668159e70 0x7f866806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866ed64700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866806ace0 con 0x7f86680cb470 2023-11-29T11:13:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866ed64700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866806a0d0 con 0x7f8668069c40 2023-11-29T11:13:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866ed64700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866806a3b0 con 0x7f8668159e70 2023-11-29T11:13:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866e563700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f86680cb470 0x7f86680c91d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42910/0 (socket says 172.21.15.81:42910) 2023-11-29T11:13:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866e563700 1 -- 172.21.15.81:0/3052398913 learned_addr learned my addr 172.21.15.81:0/3052398913 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866dd62700 1 --2- 172.21.15.81:0/3052398913 >> v2:172.21.15.176:3300/0 conn(0x7f8668159e70 0x7f866806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866cd60700 1 -- 172.21.15.81:0/3052398913 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683155601 0 0) 0x7f866806ace0 con 0x7f86680cb470 2023-11-29T11:13:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866cd60700 1 -- 172.21.15.81:0/3052398913 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86540035d0 con 0x7f86680cb470 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866cd60700 1 -- 172.21.15.81:0/3052398913 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426364359 0 0) 0x7f866806a0d0 con 0x7f8668069c40 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.166+0000 7f866cd60700 1 -- 172.21.15.81:0/3052398913 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f866806ace0 con 0x7f8668069c40 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866dd62700 1 -- 172.21.15.81:0/3052398913 >> v1:172.21.15.176:6789/0 conn(0x7f8668069c40 legacy=0x7f86680cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866dd62700 1 -- 172.21.15.81:0/3052398913 >> v1:172.21.15.81:6789/0 conn(0x7f86680cb470 legacy=0x7f86680c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866dd62700 1 -- 172.21.15.81:0/3052398913 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866806a690 con 0x7f8668159e70 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866dd62700 1 --2- 172.21.15.81:0/3052398913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 0x7f866806c9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8658009850 tx=0x7f8658009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915d93576774be72 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866cd60700 1 -- 172.21.15.81:0/3052398913 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658011830 con 0x7f8668159e70 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866cd60700 1 -- 172.21.15.81:0/3052398913 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8658011990 con 0x7f8668159e70 2023-11-29T11:13:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866cd60700 1 -- 172.21.15.81:0/3052398913 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658011d00 con 0x7f8668159e70 2023-11-29T11:13:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 -- 172.21.15.81:0/3052398913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 msgr2=0x7f866806c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 --2- 172.21.15.81:0/3052398913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 0x7f866806c9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8658009850 tx=0x7f8658009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 -- 172.21.15.81:0/3052398913 shutdown_connections 2023-11-29T11:13:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 --2- 172.21.15.81:0/3052398913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 0x7f866806c9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 -- 172.21.15.81:0/3052398913 >> 172.21.15.81:0/3052398913 conn(0x7f86680ce3e0 msgr2=0x7f86680ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 -- 172.21.15.81:0/3052398913 shutdown_connections 2023-11-29T11:13:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 -- 172.21.15.81:0/3052398913 wait complete. 2023-11-29T11:13:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 Processor -- start 2023-11-29T11:13:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.170+0000 7f866ed64700 1 -- start start 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8668069c40 0x7f8668158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86680cb470 0x7f86680c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 0x7f86680ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680cdd80 con 0x7f86680cb470 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680c2fc0 con 0x7f8668159e70 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86680c4560 con 0x7f8668069c40 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86680cb470 0x7f86680c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86680cb470 0x7f86680c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44784/0 (socket says 172.21.15.81:44784) 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 -- 172.21.15.81:0/1698776313 learned_addr learned my addr 172.21.15.81:0/1698776313 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866e563700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 0x7f86680ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866dd62700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8668069c40 0x7f8668158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 -- 172.21.15.81:0/1698776313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8668069c40 msgr2=0x7f8668158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8668069c40 0x7f8668158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 -- 172.21.15.81:0/1698776313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 msgr2=0x7f86680ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 0x7f86680ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 -- 172.21.15.81:0/1698776313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580094b0 con 0x7f86680cb470 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866d561700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86680cb470 0x7f86680c4020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8664001ee0 tx=0x7f866400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f865e7fc700 1 -- 172.21.15.81:0/1698776313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400ada0 con 0x7f86680cb470 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f865e7fc700 1 -- 172.21.15.81:0/1698776313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86640020e0 con 0x7f86680cb470 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866815a240 con 0x7f86680cb470 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f865e7fc700 1 -- 172.21.15.81:0/1698776313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664003c60 con 0x7f86680cb470 2023-11-29T11:13:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866806a970 con 0x7f86680cb470 2023-11-29T11:13:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.174+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866806cea0 con 0x7f86680cb470 2023-11-29T11:13:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.178+0000 7f865e7fc700 1 -- 172.21.15.81:0/1698776313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8664010050 con 0x7f86680cb470 2023-11-29T11:13:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.178+0000 7f865e7fc700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f864c064ee0 0x7f864c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.178+0000 7f865e7fc700 1 -- 172.21.15.81:0/1698776313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8664082cd0 con 0x7f86680cb470 2023-11-29T11:13:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.178+0000 7f866dd62700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f864c064ee0 0x7f864c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.178+0000 7f866dd62700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f864c064ee0 0x7f864c067390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86580090b0 tx=0x7f8658008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.182+0000 7f865e7fc700 1 -- 172.21.15.81:0/1698776313 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8664050c20 con 0x7f86680cb470 2023-11-29T11:13:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.346+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8668072500 con 0x7f86680cb470 2023-11-29T11:13:16.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f865e7fc700 1 -- 172.21.15.81:0/1698776313 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f8664054240 con 0x7f86680cb470 2023-11-29T11:13:16.354 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:16.354 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:16.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f864c064ee0 msgr2=0x7f864c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f864c064ee0 0x7f864c067390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86580090b0 tx=0x7f8658008030 comp rx=0 tx=0).stop 2023-11-29T11:13:16.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86680cb470 msgr2=0x7f86680c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86680cb470 0x7f86680c4020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8664001ee0 tx=0x7f866400a340 comp rx=0 tx=0).stop 2023-11-29T11:13:16.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 shutdown_connections 2023-11-29T11:13:16.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f864c064ee0 0x7f864c067390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8668159e70 0x7f86680ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86680cb470 0x7f86680c4020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 --2- 172.21.15.81:0/1698776313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8668069c40 0x7f8668158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 >> 172.21.15.81:0/1698776313 conn(0x7f86680ce3e0 msgr2=0x7f86680cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 shutdown_connections 2023-11-29T11:13:16.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.350+0000 7f866ed64700 1 -- 172.21.15.81:0/1698776313 wait complete. 2023-11-29T11:13:16.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-29T11:13:16.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-29T11:13:16.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-29T11:13:16.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-29T11:13:16.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-29T11:13:16.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-29T11:13:16.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-29T11:13:16.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-29T11:13:16.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.514+0000 7fbb815dd700 1 Processor -- start 2023-11-29T11:13:16.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.514+0000 7fbb815dd700 1 -- start start 2023-11-29T11:13:16.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.514+0000 7f8e8668e700 1 Processor -- start 2023-11-29T11:13:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.514+0000 7f8e8668e700 1 -- start start 2023-11-29T11:13:16.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb7c06f730 0x7fbb7c0719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb7c069c40 0x7fbb7c0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c0cbfb0 con 0x7fbb7c159180 2023-11-29T11:13:16.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7c0cee20 con 0x7fbb7c06f730 2023-11-29T11:13:16.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7c0cf100 con 0x7fbb7c069c40 2023-11-29T11:13:16.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb80ddc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb7c069c40 0x7fbb7c0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb80ddc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb7c069c40 0x7fbb7c0cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:36898/0 (socket says 172.21.15.81:36898) 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb80ddc700 1 -- 172.21.15.81:0/729837203 learned_addr learned my addr 172.21.15.81:0/729837203 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb7b7fe700 1 --2- 172.21.15.81:0/729837203 >> v2:172.21.15.81:3300/0 conn(0x7fbb7c06f730 0x7fbb7c0719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb80ddc700 1 -- 172.21.15.81:0/729837203 >> v2:172.21.15.81:3300/0 conn(0x7fbb7c06f730 msgr2=0x7fbb7c0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb80ddc700 1 --2- 172.21.15.81:0/729837203 >> v2:172.21.15.81:3300/0 conn(0x7fbb7c06f730 0x7fbb7c0719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb80ddc700 1 -- 172.21.15.81:0/729837203 >> v1:172.21.15.176:6789/0 conn(0x7fbb7c159180 legacy=0x7fbb7c071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb80ddc700 1 -- 172.21.15.81:0/729837203 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0cc200 con 0x7fbb7c069c40 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8668e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8e80154600 0x7f8e8015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8668e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e8006c650 0x7f8e8006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8668e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8015e300 con 0x7f8e8006aa10 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8668e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8006ced0 con 0x7f8e8006c650 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8668e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8006ade0 con 0x7f8e80154600 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e85e8d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8e8006aa10 0x7f8e80070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42922/0 (socket says 172.21.15.81:42922) 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e85e8d700 1 -- 172.21.15.81:0/279651034 learned_addr learned my addr 172.21.15.81:0/279651034 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8568c700 1 --2- 172.21.15.81:0/279651034 >> v2:172.21.15.176:3300/0 conn(0x7f8e80154600 0x7f8e8015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e84e8b700 1 --2- 172.21.15.81:0/279651034 >> v2:172.21.15.81:3300/0 conn(0x7f8e8006c650 0x7f8e8006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128917898 0 0) 0x7f8e8015e300 con 0x7f8e8006aa10 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e6c0035d0 con 0x7f8e8006aa10 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2470137139 0 0) 0x7f8e6c0035d0 con 0x7f8e8006aa10 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 >> v2:172.21.15.176:3300/0 conn(0x7f8e80154600 msgr2=0x7f8e8015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 --2- 172.21.15.81:0/279651034 >> v2:172.21.15.176:3300/0 conn(0x7f8e80154600 0x7f8e8015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 >> v2:172.21.15.81:3300/0 conn(0x7f8e8006c650 msgr2=0x7f8e8006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 --2- 172.21.15.81:0/279651034 >> v2:172.21.15.81:3300/0 conn(0x7f8e8006c650 0x7f8e8006a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8015c510 con 0x7f8e8006aa10 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f8e780019f0 con 0x7f8e8006aa10 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 >> v1:172.21.15.81:6789/0 conn(0x7f8e8006aa10 legacy=0x7f8e80070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e6c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c004870 0x7f8e6c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c005220 0x7f8e6c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8006ced0 con 0x7f8e6c003a20 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8006ade0 con 0x7f8e6c005220 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c00bfa0 con 0x7f8e6c004870 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e27fff700 1 Processor -- start 2023-11-29T11:13:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e27fff700 1 -- start start 2023-11-29T11:13:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.514+0000 7f1eeb579700 1 Processor -- start 2023-11-29T11:13:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.514+0000 7fb6564f4700 1 Processor -- start 2023-11-29T11:13:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.514+0000 7fb6564f4700 1 -- start start 2023-11-29T11:13:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6564f4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb650158e60 0x7fb6500c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6564f4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 0x7fb6500cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6564f4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6500cad50 0x7fb6500cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6564f4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500add00 con 0x7fb6500cad50 2023-11-29T11:13:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6564f4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500cb710 con 0x7fb650158e60 2023-11-29T11:13:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6564f4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500cc4f0 con 0x7fb6500ad490 2023-11-29T11:13:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb80ddc700 1 --2- 172.21.15.81:0/729837203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c069c40 0x7fbb7c0cac60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c06fe30 tx=0x7fbb70009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17f340e0e6843e42 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e27fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e280cb340 0x7f0e2806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e27fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0e2806a800 0x7f0e280cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e27fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2806c6c0 con 0x7f0e2806f7c0 2023-11-29T11:13:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e27fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2806dbf0 con 0x7f0e2806a800 2023-11-29T11:13:16.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e27fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e28072240 con 0x7f0e280cb340 2023-11-29T11:13:16.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f1eeb579700 1 -- start start 2023-11-29T11:13:16.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e85e8d700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c005220 0x7f8e6c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6554f2700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb650158e60 0x7fb6500c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e267fc700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f0e2806f7c0 0x7f0e2806a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:59212/0 (socket says 172.21.15.81:59212) 2023-11-29T11:13:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e277fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0e2806a800 0x7f0e280cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e267fc700 1 -- 172.21.15.81:0/1336015722 learned_addr learned my addr 172.21.15.81:0/1336015722 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb654cf1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 0x7fb6500cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6554f2700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb650158e60 0x7fb6500c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:36902/0 (socket says 172.21.15.81:36902) 2023-11-29T11:13:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6554f2700 1 -- 172.21.15.81:0/1027421933 learned_addr learned my addr 172.21.15.81:0/1027421933 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb7affd700 1 -- 172.21.15.81:0/729837203 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70004230 con 0x7fbb7c069c40 2023-11-29T11:13:16.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f611c98c700 1 Processor -- start 2023-11-29T11:13:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb655cf3700 1 --2- 172.21.15.81:0/1027421933 >> v2:172.21.15.81:3300/0 conn(0x7fb6500cad50 0x7fb6500cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb7affd700 1 -- 172.21.15.81:0/729837203 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb70004390 con 0x7fbb7c069c40 2023-11-29T11:13:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb7affd700 1 -- 172.21.15.81:0/729837203 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700036c0 con 0x7fbb7c069c40 2023-11-29T11:13:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8568c700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e6c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e84e8b700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c004870 0x7f8e6c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e26ffd700 1 --2- 172.21.15.81:0/1336015722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e280cb340 0x7f0e2806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f611c98c700 1 -- start start 2023-11-29T11:13:16.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8568c700 1 -- 172.21.15.81:0/279651034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c004870 msgr2=0x7f8e6c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8568c700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c004870 0x7f8e6c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8568c700 1 -- 172.21.15.81:0/279651034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c005220 msgr2=0x7f8e6c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8568c700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c005220 0x7f8e6c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8568c700 1 -- 172.21.15.81:0/279651034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c0035d0 con 0x7f8e6c003a20 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e85e8d700 1 -- 172.21.15.81:0/279651034 reap_dead start 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb654cf1700 1 -- 172.21.15.81:0/1027421933 >> v2:172.21.15.176:3300/0 conn(0x7fb650158e60 msgr2=0x7fb6500c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb654cf1700 1 --2- 172.21.15.81:0/1027421933 >> v2:172.21.15.176:3300/0 conn(0x7fb650158e60 0x7fb6500c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb654cf1700 1 -- 172.21.15.81:0/1027421933 >> v2:172.21.15.81:3300/0 conn(0x7fb6500cad50 msgr2=0x7fb6500cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb654cf1700 1 --2- 172.21.15.81:0/1027421933 >> v2:172.21.15.81:3300/0 conn(0x7fb6500cad50 0x7fb6500cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb654cf1700 1 -- 172.21.15.81:0/1027421933 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500cd8f0 con 0x7fb6500ad490 2023-11-29T11:13:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb6554f2700 1 --2- 172.21.15.81:0/1027421933 >> v2:172.21.15.176:3300/0 conn(0x7fb650158e60 0x7fb6500c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e8568c700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e6c003e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009b50 tx=0x7f8e6c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a0649609d8395b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e277fe700 1 -- 172.21.15.81:0/1336015722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e280cb340 msgr2=0x7f0e2806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e277fe700 1 --2- 172.21.15.81:0/1336015722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e280cb340 0x7f0e2806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e277fe700 1 -- 172.21.15.81:0/1336015722 >> v1:172.21.15.176:6789/0 conn(0x7f0e2806f7c0 legacy=0x7f0e2806a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e277fe700 1 -- 172.21.15.81:0/1336015722 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2806c8f0 con 0x7f0e2806a800 2023-11-29T11:13:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f1eeb579700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1ee40b32e0 0x7f1ee40b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f1eeb579700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee40b3c50 con 0x7f1ee4159f00 2023-11-29T11:13:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f1eeb579700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee415a2d0 con 0x7f1ee40c91d0 2023-11-29T11:13:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f1eeb579700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee406b0c0 con 0x7f1ee40b32e0 2023-11-29T11:13:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c004020 con 0x7f8e6c003a20 2023-11-29T11:13:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c004180 con 0x7f8e6c003a20 2023-11-29T11:13:16.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f8e77fff700 1 -- 172.21.15.81:0/279651034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0044f0 con 0x7f8e6c003a20 2023-11-29T11:13:16.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb654cf1700 1 --2- 172.21.15.81:0/1027421933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 0x7fb6500cbfb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb640009850 tx=0x7fb640009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab63e5f829911eae server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f0e277fe700 1 --2- 172.21.15.81:0/1336015722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806a800 0x7f0e280cbfb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c007140 tx=0x7f0e1c007450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac885675a3a9dca1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 -- 172.21.15.81:0/729837203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c069c40 msgr2=0x7fbb7c0cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 --2- 172.21.15.81:0/729837203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c069c40 0x7fbb7c0cac60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c06fe30 tx=0x7fbb70009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f611c98c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f611806f7c0 0x7f61180cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f611c98c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6118071ca0 0x7f611806a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f611c98c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611806c6c0 con 0x7f61180ceaf0 2023-11-29T11:13:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f611c98c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6118072240 con 0x7f611806f7c0 2023-11-29T11:13:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f611c98c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611806c8f0 con 0x7f6118071ca0 2023-11-29T11:13:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f1ee9d76700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1ee40b32e0 0x7f1ee40b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f1ee9d76700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1ee40b32e0 0x7f1ee40b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:36924/0 (socket says 172.21.15.81:36924) 2023-11-29T11:13:16.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7f1ee9d76700 1 -- 172.21.15.81:0/452805380 learned_addr learned my addr 172.21.15.81:0/452805380 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 -- 172.21.15.81:0/729837203 shutdown_connections 2023-11-29T11:13:16.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 --2- 172.21.15.81:0/729837203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c069c40 0x7fbb7c0cac60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 --2- 172.21.15.81:0/729837203 >> v2:172.21.15.81:3300/0 conn(0x7fbb7c06f730 0x7fbb7c0719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fbb815dd700 1 -- 172.21.15.81:0/729837203 >> 172.21.15.81:0/729837203 conn(0x7fbb7c0b1f90 msgr2=0x7fbb7c0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.518+0000 7fb647fff700 1 -- 172.21.15.81:0/1027421933 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000d920 con 0x7fb6500ad490 2023-11-29T11:13:16.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f61177fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61180ceaf0 0x7f611806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42940/0 (socket says 172.21.15.81:42940) 2023-11-29T11:13:16.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f61177fe700 1 -- 172.21.15.81:0/2301256164 learned_addr learned my addr 172.21.15.81:0/2301256164 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb815dd700 1 -- 172.21.15.81:0/729837203 shutdown_connections 2023-11-29T11:13:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f6117fff700 1 --2- 172.21.15.81:0/2301256164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6118071ca0 0x7f611806a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e25ffb700 1 -- 172.21.15.81:0/1336015722 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00e070 con 0x7f0e2806a800 2023-11-29T11:13:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb647fff700 1 -- 172.21.15.81:0/1027421933 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64000da80 con 0x7fb6500ad490 2023-11-29T11:13:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb647fff700 1 -- 172.21.15.81:0/1027421933 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000de10 con 0x7fb6500ad490 2023-11-29T11:13:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f6116ffd700 1 --2- 172.21.15.81:0/2301256164 >> v2:172.21.15.176:3300/0 conn(0x7f611806f7c0 0x7f61180cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb815dd700 1 -- 172.21.15.81:0/729837203 wait complete. 2023-11-29T11:13:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 -- 172.21.15.81:0/279651034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 msgr2=0x7f8e6c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e6c003e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009b50 tx=0x7f8e6c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e25ffb700 1 -- 172.21.15.81:0/1336015722 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c007ae0 con 0x7f0e2806a800 2023-11-29T11:13:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e25ffb700 1 -- 172.21.15.81:0/1336015722 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c007e70 con 0x7f0e2806a800 2023-11-29T11:13:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1ee9d76700 1 -- 172.21.15.81:0/452805380 >> v1:172.21.15.176:6789/0 conn(0x7f1ee40c91d0 legacy=0x7f1ee40c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1ee9d76700 1 -- 172.21.15.81:0/452805380 >> v1:172.21.15.81:6789/0 conn(0x7f1ee4159f00 legacy=0x7f1ee406c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1ee9d76700 1 -- 172.21.15.81:0/452805380 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee406a020 con 0x7f1ee40b32e0 2023-11-29T11:13:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f61167fc700 1 -- 172.21.15.81:0/2301256164 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841587584 0 0) 0x7f611806c6c0 con 0x7f61180ceaf0 2023-11-29T11:13:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f61167fc700 1 -- 172.21.15.81:0/2301256164 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61000035d0 con 0x7f61180ceaf0 2023-11-29T11:13:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f6117fff700 1 -- 172.21.15.81:0/2301256164 >> v2:172.21.15.176:3300/0 conn(0x7f611806f7c0 msgr2=0x7f61180cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f6117fff700 1 --2- 172.21.15.81:0/2301256164 >> v2:172.21.15.176:3300/0 conn(0x7f611806f7c0 0x7f61180cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f6117fff700 1 -- 172.21.15.81:0/2301256164 >> v1:172.21.15.81:6789/0 conn(0x7f61180ceaf0 legacy=0x7f611806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f6117fff700 1 -- 172.21.15.81:0/2301256164 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611806cbd0 con 0x7f6118071ca0 2023-11-29T11:13:16.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1ee9d76700 1 --2- 172.21.15.81:0/452805380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee40b32e0 0x7f1ee40b3710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009910 tx=0x7f1ee0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580f87e6e709deb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 -- 172.21.15.81:0/1027421933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 msgr2=0x7fb6500cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 --2- 172.21.15.81:0/1027421933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 0x7fb6500cbfb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb640009850 tx=0x7fb640009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f6117fff700 1 --2- 172.21.15.81:0/2301256164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6118071ca0 0x7f611806a0f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6110009d90 tx=0x7f611000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc2a17780e309299 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 -- 172.21.15.81:0/279651034 shutdown_connections 2023-11-29T11:13:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 --2- 172.21.15.81:0/279651034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e6c003e30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 -- 172.21.15.81:0/279651034 >> 172.21.15.81:0/279651034 conn(0x7f8e8006ec40 msgr2=0x7f8e800b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 -- 172.21.15.81:0/1336015722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806a800 msgr2=0x7f0e280cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 --2- 172.21.15.81:0/1336015722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806a800 0x7f0e280cbfb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c007140 tx=0x7f0e1c007450 comp rx=0 tx=0).stop 2023-11-29T11:13:16.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1ee9575700 1 -- 172.21.15.81:0/452805380 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000ba60 con 0x7f1ee40b32e0 2023-11-29T11:13:16.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 -- 172.21.15.81:0/279651034 shutdown_connections 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 -- 172.21.15.81:0/1336015722 shutdown_connections 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 --2- 172.21.15.81:0/1336015722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806a800 0x7f0e280cbfb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 --2- 172.21.15.81:0/1336015722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e280cb340 0x7f0e2806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 -- 172.21.15.81:0/1336015722 >> 172.21.15.81:0/1336015722 conn(0x7f0e280b1f90 msgr2=0x7f0e280ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 -- 172.21.15.81:0/1027421933 shutdown_connections 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 --2- 172.21.15.81:0/1027421933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 0x7fb6500cbfb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 --2- 172.21.15.81:0/1027421933 >> v2:172.21.15.81:3300/0 conn(0x7fb6500cad50 0x7fb6500cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 --2- 172.21.15.81:0/1027421933 >> v2:172.21.15.176:3300/0 conn(0x7fb650158e60 0x7fb6500c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 -- 172.21.15.81:0/1027421933 >> 172.21.15.81:0/1027421933 conn(0x7fb6500ce3e0 msgr2=0x7fb6500ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 -- 172.21.15.81:0/1027421933 shutdown_connections 2023-11-29T11:13:16.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 -- 172.21.15.81:0/279651034 wait complete. 2023-11-29T11:13:16.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1ee9575700 1 -- 172.21.15.81:0/452805380 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee000bbc0 con 0x7f1ee40b32e0 2023-11-29T11:13:16.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1ee9575700 1 -- 172.21.15.81:0/452805380 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0009e60 con 0x7f1ee40b32e0 2023-11-29T11:13:16.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 -- 172.21.15.81:0/1027421933 wait complete. 2023-11-29T11:13:16.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 -- 172.21.15.81:0/1336015722 shutdown_connections 2023-11-29T11:13:16.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 -- 172.21.15.81:0/1336015722 wait complete. 2023-11-29T11:13:16.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1eeb579700 1 -- 172.21.15.81:0/452805380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee40b32e0 msgr2=0x7f1ee40b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1eeb579700 1 --2- 172.21.15.81:0/452805380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee40b32e0 0x7f1ee40b3710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009910 tx=0x7f1ee0009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:16.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb608818700 1 Processor -- start 2023-11-29T11:13:16.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb608818700 1 -- start start 2023-11-29T11:13:16.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb608818700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60406c0b0 0x7fb6040cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb608818700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60415bb50 con 0x7fb6041581f0 2023-11-29T11:13:16.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb608818700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60415c3f0 con 0x7fb60406bc80 2023-11-29T11:13:16.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb608818700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040ad630 con 0x7fb60406c0b0 2023-11-29T11:13:16.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb60259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb6041581f0 0x7fb60406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42942/0 (socket says 172.21.15.81:42942) 2023-11-29T11:13:16.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb60259c700 1 -- 172.21.15.81:0/315459948 learned_addr learned my addr 172.21.15.81:0/315459948 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 Processor -- start 2023-11-29T11:13:16.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f8e8668e700 1 -- start start 2023-11-29T11:13:16.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb602d9d700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60406c0b0 0x7fb6040cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb815dd700 1 Processor -- start 2023-11-29T11:13:16.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb815dd700 1 -- start start 2023-11-29T11:13:16.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 Processor -- start 2023-11-29T11:13:16.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f0e27fff700 1 -- start start 2023-11-29T11:13:16.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1eeb579700 1 -- 172.21.15.81:0/452805380 shutdown_connections 2023-11-29T11:13:16.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1eeb579700 1 --2- 172.21.15.81:0/452805380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee40b32e0 0x7f1ee40b3710 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009910 tx=0x7f1ee0009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:16.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f1eeb579700 1 -- 172.21.15.81:0/452805380 >> 172.21.15.81:0/452805380 conn(0x7f1ee40ce3e0 msgr2=0x7f1ee40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 Processor -- start 2023-11-29T11:13:16.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb6564f4700 1 -- start start 2023-11-29T11:13:16.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb815dd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c069c40 0x7fbb7c0c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f61167fc700 1 -- 172.21.15.81:0/2301256164 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000e070 con 0x7f6118071ca0 2023-11-29T11:13:16.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb815dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c06f730 0x7fbb7c0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb815dd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c159180 0x7fbb7c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb7b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c06f730 0x7fbb7c0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb7b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c06f730 0x7fbb7c0ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44814/0 (socket says 172.21.15.81:44814) 2023-11-29T11:13:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473030696 0 0) 0x7fb60415bb50 con 0x7fb6041581f0 2023-11-29T11:13:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5ec0035d0 con 0x7fb6041581f0 2023-11-29T11:13:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101960603 0 0) 0x7fb60415c3f0 con 0x7fb60406bc80 2023-11-29T11:13:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb60415bb50 con 0x7fb60406bc80 2023-11-29T11:13:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7fbb7bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c069c40 0x7fbb7c0c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb7bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c069c40 0x7fbb7c0c2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:41202/0 (socket says 172.21.15.81:41202) 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb80ddc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c159180 0x7fbb7c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb80ddc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c159180 0x7fbb7c155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:36932/0 (socket says 172.21.15.81:36932) 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb815dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0c38b0 con 0x7fbb7c06f730 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb7b7fe700 1 -- 172.21.15.81:0/3031229504 learned_addr learned my addr 172.21.15.81:0/3031229504 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0af1c0 con 0x7fbb7c159180 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2850637625 0 0) 0x7fb5ec0035d0 con 0x7fb6041581f0 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60406c0b0 msgr2=0x7fb6040cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60406c0b0 0x7fb6040cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 >> v1:172.21.15.176:6789/0 conn(0x7fb60406bc80 legacy=0x7fb6040cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0af4a0 con 0x7fbb7c069c40 2023-11-29T11:13:16.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60406d470 con 0x7fb6041581f0 2023-11-29T11:13:16.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fb5fc005290 con 0x7fb6041581f0 2023-11-29T11:13:16.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 >> v1:172.21.15.81:6789/0 conn(0x7fb6041581f0 legacy=0x7fb60406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5ec004c40 0x7fb5ec005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 0x7fb5ec003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0041c0 0x7fb5ec010040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040ad630 con 0x7fb5ec0041c0 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec010580 con 0x7fb5ec004c40 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0106c0 con 0x7fb5ec003810 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e27fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806a800 0x7f0e280b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e27fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806f7c0 0x7f0e280af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6564f4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 0x7fb6500c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6564f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6500cad50 0x7fb6500c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6564f4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb650158e60 0x7fb6501ece10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8668e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e801489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8668e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e800cd1e0 0x7f8e800ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8668e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e800aefc0 0x7f8e800af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8668e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800c3560 con 0x7f8e6c003a20 2023-11-29T11:13:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8668e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800af9a0 con 0x7f8e800cd1e0 2023-11-29T11:13:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8668e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801491f0 con 0x7f8e800aefc0 2023-11-29T11:13:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f1eeb579700 1 -- 172.21.15.81:0/452805380 shutdown_connections 2023-11-29T11:13:16.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e801489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e801489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44824/0 (socket says 172.21.15.81:44824) 2023-11-29T11:13:16.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 -- 172.21.15.81:0/196904872 learned_addr learned my addr 172.21.15.81:0/196904872 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e27fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e280cb340 0x7f0e281e1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e84e8b700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e800cd1e0 0x7f8e800ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e27fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280aff10 con 0x7f0e2806a800 2023-11-29T11:13:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e27fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281e2430 con 0x7f0e2806f7c0 2023-11-29T11:13:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e27fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280aef30 con 0x7f0e280cb340 2023-11-29T11:13:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6564f4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6501ee390 con 0x7fb6500cad50 2023-11-29T11:13:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6564f4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6501ed700 con 0x7fb650158e60 2023-11-29T11:13:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6564f4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6501ed9e0 con 0x7fb6500ad490 2023-11-29T11:13:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6500cad50 0x7fb6500c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6500cad50 0x7fb6500c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44854/0 (socket says 172.21.15.81:44854) 2023-11-29T11:13:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 -- 172.21.15.81:0/340710357 learned_addr learned my addr 172.21.15.81:0/340710357 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f61167fc700 1 -- 172.21.15.81:0/2301256164 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611000bb20 con 0x7f6118071ca0 2023-11-29T11:13:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.522+0000 7f61167fc700 1 -- 172.21.15.81:0/2301256164 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110012430 con 0x7f6118071ca0 2023-11-29T11:13:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e26ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806a800 0x7f0e280b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 -- 172.21.15.81:0/2301256164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6118071ca0 msgr2=0x7f611806a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 --2- 172.21.15.81:0/2301256164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6118071ca0 0x7f611806a0f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6110009d90 tx=0x7f611000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 -- 172.21.15.81:0/2301256164 shutdown_connections 2023-11-29T11:13:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 --2- 172.21.15.81:0/2301256164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6118071ca0 0x7f611806a0f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 --2- 172.21.15.81:0/2301256164 >> v2:172.21.15.176:3300/0 conn(0x7f611806f7c0 0x7f61180cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 -- 172.21.15.81:0/2301256164 >> 172.21.15.81:0/2301256164 conn(0x7f61180b1f90 msgr2=0x7f61180ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e26ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806a800 0x7f0e280b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44852/0 (socket says 172.21.15.81:44852) 2023-11-29T11:13:16.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e26ffd700 1 -- 172.21.15.81:0/3844431001 learned_addr learned my addr 172.21.15.81:0/3844431001 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb7b7fe700 1 -- 172.21.15.81:0/3031229504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c069c40 msgr2=0x7fbb7c0c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb7b7fe700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c069c40 0x7fbb7c0c2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb7b7fe700 1 -- 172.21.15.81:0/3031229504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c159180 msgr2=0x7fbb7c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb7b7fe700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb7c159180 0x7fbb7c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb7b7fe700 1 -- 172.21.15.81:0/3031229504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70009570 con 0x7fbb7c06f730 2023-11-29T11:13:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 -- 172.21.15.81:0/2301256164 shutdown_connections 2023-11-29T11:13:16.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 -- 172.21.15.81:0/2301256164 wait complete. 2023-11-29T11:13:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e85e8d700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e800aefc0 0x7f8e800af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 -- 172.21.15.81:0/196904872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e800aefc0 msgr2=0x7f8e800af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e800aefc0 0x7f8e800af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 -- 172.21.15.81:0/196904872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e800cd1e0 msgr2=0x7f8e800ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e800cd1e0 0x7f8e800ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 -- 172.21.15.81:0/196904872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8015dcb0 con 0x7f8e6c003a20 2023-11-29T11:13:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e267fc700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806f7c0 0x7f0e280af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb655cf3700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb650158e60 0x7fb6501ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6554f2700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 0x7fb6500c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 -- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 msgr2=0x7fb6500c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6500ad490 0x7fb6500c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 -- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb650158e60 msgr2=0x7fb6501ece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb650158e60 0x7fb6501ece10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 -- 172.21.15.81:0/340710357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb648009b30 con 0x7fb6500cad50 2023-11-29T11:13:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb7b7fe700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c06f730 0x7fbb7c0ae7f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00e730 tx=0x7fbb6c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f1eeb579700 1 -- 172.21.15.81:0/452805380 wait complete. 2023-11-29T11:13:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb601d9b700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 0x7fb5ec003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb654cf1700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6500cad50 0x7fb6500c6560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb640000c00 tx=0x7fb640004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e267fc700 1 -- 172.21.15.81:0/3844431001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e280cb340 msgr2=0x7f0e281e1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e267fc700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e280cb340 0x7f0e281e1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e267fc700 1 -- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806a800 msgr2=0x7f0e280b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e267fc700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806a800 0x7f0e280b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f0e267fc700 1 -- 172.21.15.81:0/3844431001 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c009dd0 con 0x7f0e2806f7c0 2023-11-29T11:13:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60259c700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5ec004c40 0x7fb5ec005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c013610 con 0x7fbb7c06f730 2023-11-29T11:13:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb601d9b700 1 -- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5ec004c40 msgr2=0x7fb5ec005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb601d9b700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5ec004c40 0x7fb5ec005030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb601d9b700 1 -- 172.21.15.81:0/315459948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0041c0 msgr2=0x7fb5ec010040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb601d9b700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0041c0 0x7fb5ec010040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb601d9b700 1 -- 172.21.15.81:0/315459948 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60406d470 con 0x7fb5ec003810 2023-11-29T11:13:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c013770 con 0x7fbb7c06f730 2023-11-29T11:13:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c013b20 con 0x7fbb7c06f730 2023-11-29T11:13:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c0ceaf0 con 0x7fbb7c06f730 2023-11-29T11:13:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f1eeb579700 1 Processor -- start 2023-11-29T11:13:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8568c700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e801489b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c004780 tx=0x7f8e7c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c020070 con 0x7f8e6c003a20 2023-11-29T11:13:16.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c00ed70 con 0x7f8e6c003a20 2023-11-29T11:13:16.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8015d9d0 con 0x7f8e6c003a20 2023-11-29T11:13:16.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8015df90 con 0x7f8e6c003a20 2023-11-29T11:13:16.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c003900 con 0x7f8e6c003a20 2023-11-29T11:13:16.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f1eeb579700 1 -- start start 2023-11-29T11:13:16.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb601d9b700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 0x7fb5ec003c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8001900 tx=0x7fb5ec0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93506326b7fc00ed server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80013c0 con 0x7fb5ec003810 2023-11-29T11:13:16.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f80052d0 con 0x7fb5ec003810 2023-11-29T11:13:16.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64001d070 con 0x7fb6500cad50 2023-11-29T11:13:16.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64000c070 con 0x7fb6500cad50 2023-11-29T11:13:16.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6400094b0 con 0x7fb6500cad50 2023-11-29T11:13:16.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640003b10 con 0x7fb6500cad50 2023-11-29T11:13:16.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6500cde90 con 0x7fb6500cad50 2023-11-29T11:13:16.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 Processor -- start 2023-11-29T11:13:16.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7f611c98c700 1 -- start start 2023-11-29T11:13:16.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f611c98c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f611806f7c0 0x7f6118147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1eeb579700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40c91d0 0x7f1ee41f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1eeb579700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee4159f00 0x7f1ee40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1eeb579700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee40cbfb0 0x7f1ee40cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1eeb579700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee41f9320 con 0x7f1ee40c91d0 2023-11-29T11:13:16.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1eeb579700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee41fa180 con 0x7f1ee4159f00 2023-11-29T11:13:16.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1eeb579700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee41f9570 con 0x7f1ee40cbfb0 2023-11-29T11:13:16.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e60000fc0 con 0x7f8e6c003a20 2023-11-29T11:13:16.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f611c98c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6118071ca0 0x7f61180ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f611c98c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61180ceaf0 0x7f61180ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f61177fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f611806f7c0 0x7f6118147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.526+0000 7fb60159a700 1 -- 172.21.15.81:0/315459948 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8001d30 con 0x7fb5ec003810 2023-11-29T11:13:16.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb608818700 1 -- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 msgr2=0x7fb5ec003c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb608818700 1 --2- 172.21.15.81:0/315459948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 0x7fb5ec003c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8001900 tx=0x7fb5ec0058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb602d9d700 1 -- 172.21.15.81:0/315459948 reap_dead start 2023-11-29T11:13:16.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f611c98c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61180b0430 con 0x7f6118071ca0 2023-11-29T11:13:16.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f611c98c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61180b0710 con 0x7f61180ceaf0 2023-11-29T11:13:16.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f611c98c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6118144880 con 0x7f611806f7c0 2023-11-29T11:13:16.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f61177fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f611806f7c0 0x7f6118147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:41228/0 (socket says 172.21.15.81:41228) 2023-11-29T11:13:16.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f61177fe700 1 -- 172.21.15.81:0/3643148037 learned_addr learned my addr 172.21.15.81:0/3643148037 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f0e267fc700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806f7c0 0x7f0e280af9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000caa0 tx=0x7f0e2000cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb65006dc60 con 0x7fb6500cad50 2023-11-29T11:13:16.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f6117fff700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61180ceaf0 0x7f61180ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee4159f00 0x7f1ee40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb608818700 1 -- 172.21.15.81:0/315459948 shutdown_connections 2023-11-29T11:13:16.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb608818700 1 -- 172.21.15.81:0/315459948 >> 172.21.15.81:0/315459948 conn(0x7fb6040ce460 msgr2=0x7fb6040ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f6116ffd700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6118071ca0 0x7f61180ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee4159f00 0x7f1ee40cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:36996/0 (socket says 172.21.15.81:36996) 2023-11-29T11:13:16.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 -- 172.21.15.81:0/1005172559 learned_addr learned my addr 172.21.15.81:0/1005172559 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20007480 con 0x7f0e2806f7c0 2023-11-29T11:13:16.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e200075e0 con 0x7f0e2806f7c0 2023-11-29T11:13:16.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20007950 con 0x7f0e2806f7c0 2023-11-29T11:13:16.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2806ceb0 con 0x7f0e2806f7c0 2023-11-29T11:13:16.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2806cbd0 con 0x7f0e2806f7c0 2023-11-29T11:13:16.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb608818700 1 -- 172.21.15.81:0/315459948 shutdown_connections 2023-11-29T11:13:16.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb608818700 1 -- 172.21.15.81:0/315459948 wait complete. 2023-11-29T11:13:16.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 -- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee40cbfb0 msgr2=0x7f1ee40cdc20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T11:13:16.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee40cbfb0 0x7f1ee40cdc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 -- 172.21.15.81:0/1005172559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40c91d0 msgr2=0x7f1ee41f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee40c91d0 0x7f1ee41f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 -- 172.21.15.81:0/1005172559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee0009570 con 0x7f1ee4159f00 2023-11-29T11:13:16.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1ee9d76700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee4159f00 0x7f1ee40cd6e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0000c00 tx=0x7f1ee0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c0cc4e0 con 0x7fbb7c06f730 2023-11-29T11:13:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f6117fff700 1 -- 172.21.15.81:0/3643148037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f611806f7c0 msgr2=0x7f6118147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f6117fff700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f611806f7c0 0x7f6118147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f6117fff700 1 -- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6118071ca0 msgr2=0x7f61180ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f6117fff700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6118071ca0 0x7f61180ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f6117fff700 1 -- 172.21.15.81:0/3643148037 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009a70 con 0x7f61180ceaf0 2023-11-29T11:13:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f6117fff700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61180ceaf0 0x7f61180ac810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6110016000 tx=0x7f6110004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8e7c02d030 con 0x7f8e6c003a20 2023-11-29T11:13:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110012630 con 0x7f61180ceaf0 2023-11-29T11:13:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61100127b0 con 0x7f61180ceaf0 2023-11-29T11:13:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110012b60 con 0x7f61180ceaf0 2023-11-29T11:13:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f611c98c700 1 -- 172.21.15.81:0/3643148037 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611806d190 con 0x7f61180ceaf0 2023-11-29T11:13:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f8e75ffb700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e64064f30 0x7f8e640673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f611c98c700 1 -- 172.21.15.81:0/3643148037 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611806ceb0 con 0x7f61180ceaf0 2023-11-29T11:13:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00045d0 con 0x7f1ee4159f00 2023-11-29T11:13:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee001f070 con 0x7f1ee4159f00 2023-11-29T11:13:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00038c0 con 0x7f1ee4159f00 2023-11-29T11:13:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee406a5e0 con 0x7f1ee4159f00 2023-11-29T11:13:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee406a300 con 0x7f1ee4159f00 2023-11-29T11:13:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb608818700 1 Processor -- start 2023-11-29T11:13:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f8e84e8b700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e64064f30 0x7f8e640673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fb608818700 1 -- start start 2023-11-29T11:13:16.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8e7c083350 con 0x7f8e6c003a20 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb6c019030 con 0x7fbb7c06f730 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb7c071ee0 con 0x7fbb7c06f730 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7fbb78ff9700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb68064ee0 0x7fbb68067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbb6c05ae40 con 0x7fbb7c06f730 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb78ff9700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fbb6806eab0 0x7fbb68070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb680715b0 con 0x7fbb6806eab0 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb80ddc700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fbb6806eab0 0x7fbb68070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb6c00c020 con 0x7fbb7c06f730 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb80ddc700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fbb6806eab0 0x7fbb68070ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb7bfff700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb68064ee0 0x7fbb68067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f611c98c700 1 -- 172.21.15.81:0/3643148037 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6118069e40 con 0x7f61180ceaf0 2023-11-29T11:13:16.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f611002d070 con 0x7f61180ceaf0 2023-11-29T11:13:16.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f60fffff700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6100065390 0x7f6100067840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6110083e70 con 0x7f61180ceaf0 2023-11-29T11:13:16.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f60fffff700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f610006efe0 0x7f6100071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6100071ae0 con 0x7f610006efe0 2023-11-29T11:13:16.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6110086490 con 0x7f61180ceaf0 2023-11-29T11:13:16.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8e84e8b700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e64064f30 0x7f8e640673e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e801f4e40 tx=0x7f8e70008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e2806d190 con 0x7f0e2806f7c0 2023-11-29T11:13:16.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0e20019030 con 0x7f0e2806f7c0 2023-11-29T11:13:16.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e0ffff700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e14064f10 0x7f0e140673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e20081900 con 0x7f0e2806f7c0 2023-11-29T11:13:16.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e0ffff700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7f0e1406eb60 0x7f0e14070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e14071660 con 0x7f0e1406eb60 2023-11-29T11:13:16.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e200862a0 con 0x7f0e2806f7c0 2023-11-29T11:13:16.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ee406a8c0 con 0x7f1ee4159f00 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb640003c70 con 0x7fb6500cad50 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb645ffb700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb634064f30 0x7fb6340673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb640083180 con 0x7fb6500cad50 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb6554f2700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb634064f30 0x7fb6340673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb645ffb700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7fb63406ec00 0x7fb634071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb634071700 con 0x7fb63406ec00 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb640083600 con 0x7fb6500cad50 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb6554f2700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb634064f30 0x7fb6340673e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb648009280 tx=0x7fb64800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb608818700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 0x7fb604153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb608818700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6040c4fe0 0x7fb6040b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb608818700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb604156830 0x7fb6040b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb608818700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604155810 con 0x7fb604156830 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb608818700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040cd980 con 0x7fb6040c4fe0 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb608818700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb604154830 con 0x7fb5ec003810 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6040c4fe0 0x7fb6040b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6040c4fe0 0x7fb6040b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37012/0 (socket says 172.21.15.81:37012) 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 -- 172.21.15.81:0/4016098980 learned_addr learned my addr 172.21.15.81:0/4016098980 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb60259c700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 0x7fb604153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 -- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 msgr2=0x7fb604153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5ec003810 0x7fb604153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 -- 172.21.15.81:0/4016098980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb604156830 msgr2=0x7fb6040b0980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb604156830 0x7fb6040b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 -- 172.21.15.81:0/4016098980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60415c080 con 0x7fb6040c4fe0 2023-11-29T11:13:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f61177fe700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6100065390 0x7f6100067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e26ffd700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e14064f10 0x7f0e140673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8e75ffb700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f8e6406eb80 0x7f8e64070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb601d9b700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6040c4fe0 0x7fb6040b0440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c3c0 tx=0x7fb5f8001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1ee000f050 con 0x7f1ee4159f00 2023-11-29T11:13:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8e85e8d700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f8e6406eb80 0x7f8e64070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8006cc0 con 0x7fb6040c4fe0 2023-11-29T11:13:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f6116ffd700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f610006efe0 0x7f6100071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60415bda0 con 0x7fb6040c4fe0 2023-11-29T11:13:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb655cf3700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7fb63406ec00 0x7fb634071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e277fe700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7f0e1406eb60 0x7f0e14070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60406c530 con 0x7fb6040c4fe0 2023-11-29T11:13:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.530+0000 7f8b6f361700 1 Processor -- start 2023-11-29T11:13:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb7bfff700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb68064ee0 0x7fbb68067390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400b450 tx=0x7fbb7400d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e26ffd700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e14064f10 0x7f0e140673c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800b340 tx=0x7f0e1800f040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f1edaffd700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1ec8064f60 0x7f1ec8067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6f361700 1 -- start start 2023-11-29T11:13:16.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f61177fe700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6100065390 0x7f6100067840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f61080011e0 tx=0x7f6108009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6f361700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b6815aa90 0x7f8b68069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6f361700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b680c9ca0 0x7f8b680ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6f361700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b680cd280 con 0x7f8b68161410 2023-11-29T11:13:16.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6f361700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b680ae410 con 0x7f8b680c9ca0 2023-11-29T11:13:16.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8e85e8d700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f8e6406eb80 0x7f8e64070fb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbb680715b0 con 0x7fbb6806eab0 2023-11-29T11:13:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6f361700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680ccd00 con 0x7f8b6815aa90 2023-11-29T11:13:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6e35f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b6815aa90 0x7f8b68069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6e35f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b6815aa90 0x7f8b68069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:41242/0 (socket says 172.21.15.81:41242) 2023-11-29T11:13:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f0e277fe700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7f0e1406eb60 0x7f0e14070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6e35f700 1 -- 172.21.15.81:0/3290236321 learned_addr learned my addr 172.21.15.81:0/3290236321 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6e35f700 1 -- 172.21.15.81:0/3290236321 >> v2:172.21.15.81:3300/0 conn(0x7f8b680c9ca0 msgr2=0x7f8b680ad6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:13:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6eb60700 1 --2- 172.21.15.81:0/3290236321 >> v2:172.21.15.81:3300/0 conn(0x7f8b680c9ca0 0x7f8b680ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6e35f700 1 --2- 172.21.15.81:0/3290236321 >> v2:172.21.15.81:3300/0 conn(0x7f8b680c9ca0 0x7f8b680ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e64071680 con 0x7f8e6406eb80 2023-11-29T11:13:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb655cf3700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7fb63406ec00 0x7fb634071030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e7c0512a0 con 0x7f8e6c003a20 2023-11-29T11:13:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1ee0021070 con 0x7f1ee4159f00 2023-11-29T11:13:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f8006e20 con 0x7fb6040c4fe0 2023-11-29T11:13:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f1eea577700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1ec8064f60 0x7f1ec8067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f1edaffd700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7f1ec806ec30 0x7f1ec8071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ec8071730 con 0x7f1ec806ec30 2023-11-29T11:13:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ee0086330 con 0x7f1ee4159f00 2023-11-29T11:13:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f1eead78700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7f1ec806ec30 0x7f1ec8071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f6116ffd700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f610006efe0 0x7f6100071410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 <== osd.2 v2:172.21.15.81:6800/36539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8e64071680 con 0x7f8e6406eb80 2023-11-29T11:13:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6100071ae0 con 0x7f610006efe0 2023-11-29T11:13:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.534+0000 7f8b6e35f700 1 -- 172.21.15.81:0/3290236321 >> v1:172.21.15.81:6789/0 conn(0x7f8b68161410 legacy=0x7f8b680c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8b6e35f700 1 -- 172.21.15.81:0/3290236321 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b680adbf0 con 0x7f8b6815aa90 2023-11-29T11:13:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8b6eb60700 1 --2- 172.21.15.81:0/3290236321 >> v2:172.21.15.81:3300/0 conn(0x7f8b680c9ca0 0x7f8b680ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f1eea577700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1ec8064f60 0x7f1ec8067410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4001610 tx=0x7f1ed4007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 <== osd.6 v2:172.21.15.176:6816/36813 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb634071700 con 0x7fb63406ec00 2023-11-29T11:13:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8007280 con 0x7fb6040c4fe0 2023-11-29T11:13:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 <== osd.3 v2:172.21.15.81:6824/36540 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0e14071660 con 0x7f0e1406eb60 2023-11-29T11:13:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8b6e35f700 1 --2- 172.21.15.81:0/3290236321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b6815aa90 0x7f8b68069c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009910 tx=0x7f8b58009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a888da96bf6ced11 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8b6d35d700 1 -- 172.21.15.81:0/3290236321 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58004230 con 0x7f8b6815aa90 2023-11-29T11:13:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f1eead78700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7f1ec806ec30 0x7f1ec8071060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8b6d35d700 1 -- 172.21.15.81:0/3290236321 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b58004390 con 0x7f8b6815aa90 2023-11-29T11:13:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8b6d35d700 1 -- 172.21.15.81:0/3290236321 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58009e60 con 0x7f8b6815aa90 2023-11-29T11:13:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1ec8071730 con 0x7f1ec806ec30 2023-11-29T11:13:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8b6f361700 1 -- 172.21.15.81:0/3290236321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b6815aa90 msgr2=0x7f8b68069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.538+0000 7f8b6f361700 1 --2- 172.21.15.81:0/3290236321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b6815aa90 0x7f8b68069c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009910 tx=0x7f8b58009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.542+0000 7f8b6f361700 1 -- 172.21.15.81:0/3290236321 shutdown_connections 2023-11-29T11:13:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.542+0000 7f8b6f361700 1 --2- 172.21.15.81:0/3290236321 >> v2:172.21.15.81:3300/0 conn(0x7f8b680c9ca0 0x7f8b680ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.542+0000 7f8b6f361700 1 --2- 172.21.15.81:0/3290236321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b6815aa90 0x7f8b68069c40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.542+0000 7f8b6f361700 1 -- 172.21.15.81:0/3290236321 >> 172.21.15.81:0/3290236321 conn(0x7f8b680cb2d0 msgr2=0x7f8b680cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb5f8010050 con 0x7fb6040c4fe0 2023-11-29T11:13:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 -- 172.21.15.81:0/3290236321 shutdown_connections 2023-11-29T11:13:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 -- 172.21.15.81:0/3290236321 wait complete. 2023-11-29T11:13:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb5f2ffd700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5e4064fe0 0x7fb5e4067490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5f8093db0 con 0x7fb6040c4fe0 2023-11-29T11:13:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5e8000fc0 con 0x7fb6040c4fe0 2023-11-29T11:13:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb5f2ffd700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7fb5e406eac0 0x7fb5e4070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5e40715c0 con 0x7fb5e406eac0 2023-11-29T11:13:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5f8061bf0 con 0x7fb6040c4fe0 2023-11-29T11:13:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb60259c700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5e4064fe0 0x7fb5e4067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb602d9d700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7fb5e406eac0 0x7fb5e4070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 Processor -- start 2023-11-29T11:13:16.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb60259c700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5e4064fe0 0x7fb5e4067490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc004d00 tx=0x7fb5fc00a040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7fb602d9d700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7fb5e406eac0 0x7fb5e4070ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 -- start start 2023-11-29T11:13:16.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b680c9ca0 0x7f8b6813c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b6815aa90 0x7f8b6814bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b68161410 0x7f8b681392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6814c060 con 0x7f8b680c9ca0 2023-11-29T11:13:16.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6813d6e0 con 0x7f8b6815aa90 2023-11-29T11:13:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6f361700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b681397f0 con 0x7f8b68161410 2023-11-29T11:13:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6e35f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b680c9ca0 0x7f8b6813c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6e35f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b680c9ca0 0x7f8b6813c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44906/0 (socket says 172.21.15.81:44906) 2023-11-29T11:13:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6db5e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b6815aa90 0x7f8b6814bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6db5e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b6815aa90 0x7f8b6814bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37024/0 (socket says 172.21.15.81:37024) 2023-11-29T11:13:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.546+0000 7f8b6db5e700 1 -- 172.21.15.81:0/3653022870 learned_addr learned my addr 172.21.15.81:0/3653022870 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.550+0000 7f8b6eb60700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b68161410 0x7f8b681392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.550+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 <== osd.7 v2:172.21.15.176:6800/36814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb5e40715c0 con 0x7fb5e406eac0 2023-11-29T11:13:16.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.550+0000 7f8b6db5e700 1 -- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b68161410 msgr2=0x7f8b681392b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.550+0000 7f8b6db5e700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b68161410 0x7f8b681392b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.550+0000 7f8b6db5e700 1 -- 172.21.15.81:0/3653022870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b680c9ca0 msgr2=0x7f8b6813c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.550+0000 7f8b6db5e700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b680c9ca0 0x7f8b6813c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.550+0000 7f8b6db5e700 1 -- 172.21.15.81:0/3653022870 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58009570 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.550+0000 7f8b6db5e700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b6815aa90 0x7f8b6814bb20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000bab0 tx=0x7f8b6000bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000c930 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b680ade50 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b68161860 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6000cad0 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000ce80 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b50000fc0 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8b6001b030 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b4c064f30 0x7f8b4c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b60081ad0 con 0x7f8b6815aa90 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f8b4c06ea90 0x7f8b4c070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b4c071590 con 0x7f8b4c06ea90 2023-11-29T11:13:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b600862a0 con 0x7f8b6815aa90 2023-11-29T11:13:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e60002d60 con 0x7f8e6406eb80 2023-11-29T11:13:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.554+0000 7f8b6e35f700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b4c064f30 0x7f8b4c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.558+0000 7f8e75ffb700 1 -- 172.21.15.81:0/196904872 <== osd.2 v2:172.21.15.81:6800/36539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8e60002d60 con 0x7f8e6406eb80 2023-11-29T11:13:16.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.558+0000 7f8b6eb60700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f8b4c06ea90 0x7f8b4c070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.558+0000 7f8b6e35f700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b4c064f30 0x7f8b4c0673e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009910 tx=0x7f8b58008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.558+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb7c1ed300 con 0x7fbb6806eab0 2023-11-29T11:13:16.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.558+0000 7fbb78ff9700 1 -- 172.21.15.81:0/3031229504 <== osd.0 v2:172.21.15.81:6802/36537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb7c1ed300 con 0x7fbb6806eab0 2023-11-29T11:13:16.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.558+0000 7f8b6eb60700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f8b4c06ea90 0x7f8b4c070ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.558+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 <== osd.4 v2:172.21.15.176:6808/36811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8b4c071590 con 0x7f8b4c06ea90 2023-11-29T11:13:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f8e6406eb80 msgr2=0x7f8e64070fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f8e6406eb80 0x7f8e64070fb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fbb6806eab0 msgr2=0x7fbb68070ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fbb6806eab0 0x7fbb68070ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb68064ee0 msgr2=0x7fbb68067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb68064ee0 0x7fbb68067390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400b450 tx=0x7fbb7400d040 comp rx=0 tx=0).stop 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c06f730 msgr2=0x7fbb7c0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 --2- 172.21.15.81:0/3031229504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c06f730 0x7fbb7c0ae7f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00e730 tx=0x7fbb6c00ea40 comp rx=0 tx=0).stop 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb80ddc700 1 -- 172.21.15.81:0/3031229504 reap_dead start 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 shutdown_connections 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 >> 172.21.15.81:0/3031229504 conn(0x7fbb7c0b1f90 msgr2=0x7fbb7c0cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 shutdown_connections 2023-11-29T11:13:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e64064f30 msgr2=0x7f8e640673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7fbb815dd700 1 -- 172.21.15.81:0/3031229504 wait complete. 2023-11-29T11:13:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e64064f30 0x7f8e640673e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e801f4e40 tx=0x7f8e70008040 comp rx=0 tx=0).stop 2023-11-29T11:13:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 msgr2=0x7f8e801489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 --2- 172.21.15.81:0/196904872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c003a20 0x7f8e801489b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c004780 tx=0x7f8e7c0047e0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e85e8d700 1 -- 172.21.15.81:0/196904872 reap_dead start 2023-11-29T11:13:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 shutdown_connections 2023-11-29T11:13:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 >> 172.21.15.81:0/196904872 conn(0x7f8e8006ec40 msgr2=0x7f8e8014ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 shutdown_connections 2023-11-29T11:13:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f8e8668e700 1 -- 172.21.15.81:0/196904872 wait complete. 2023-11-29T11:13:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f611c98c700 1 -- 172.21.15.81:0/3643148037 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6118072500 con 0x7f610006efe0 2023-11-29T11:13:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.562+0000 7f60fffff700 1 -- 172.21.15.81:0/3643148037 <== osd.1 v2:172.21.15.81:6803/36538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6118072500 con 0x7f610006efe0 2023-11-29T11:13:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 -- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f610006efe0 msgr2=0x7f6100071410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb650159230 con 0x7fb63406ec00 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f610006efe0 0x7f6100071410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 -- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6100065390 msgr2=0x7f6100067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6100065390 0x7f6100067840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f61080011e0 tx=0x7f6108009040 comp rx=0 tx=0).stop 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 -- 172.21.15.81:0/3643148037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61180ceaf0 msgr2=0x7f61180ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 --2- 172.21.15.81:0/3643148037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61180ceaf0 0x7f61180ac810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6110016000 tx=0x7f6110004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f6117fff700 1 -- 172.21.15.81:0/3643148037 reap_dead start 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 -- 172.21.15.81:0/3643148037 shutdown_connections 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 -- 172.21.15.81:0/3643148037 >> 172.21.15.81:0/3643148037 conn(0x7f61180b1f90 msgr2=0x7f61180cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 -- 172.21.15.81:0/3643148037 shutdown_connections 2023-11-29T11:13:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f60fdffb700 1 -- 172.21.15.81:0/3643148037 wait complete. 2023-11-29T11:13:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb645ffb700 1 -- 172.21.15.81:0/340710357 <== osd.6 v2:172.21.15.176:6816/36813 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb650159230 con 0x7fb63406ec00 2023-11-29T11:13:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e28072500 con 0x7f0e1406eb60 2023-11-29T11:13:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7fb63406ec00 msgr2=0x7fb634071030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7fb63406ec00 0x7fb634071030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb634064f30 msgr2=0x7fb6340673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb634064f30 0x7fb6340673e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb648009280 tx=0x7fb64800b040 comp rx=0 tx=0).stop 2023-11-29T11:13:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7f0e0ffff700 1 -- 172.21.15.81:0/3844431001 <== osd.3 v2:172.21.15.81:6824/36540 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e28072500 con 0x7f0e1406eb60 2023-11-29T11:13:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6500cad50 msgr2=0x7fb6500c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 --2- 172.21.15.81:0/340710357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6500cad50 0x7fb6500c6560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb640000c00 tx=0x7fb640004770 comp rx=0 tx=0).stop 2023-11-29T11:13:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb655cf3700 1 -- 172.21.15.81:0/340710357 reap_dead start 2023-11-29T11:13:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 shutdown_connections 2023-11-29T11:13:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 >> 172.21.15.81:0/340710357 conn(0x7fb6500ce3e0 msgr2=0x7fb6500c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 shutdown_connections 2023-11-29T11:13:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.566+0000 7fb6564f4700 1 -- 172.21.15.81:0/340710357 wait complete. 2023-11-29T11:13:16.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5e8002d60 con 0x7fb5e406eac0 2023-11-29T11:13:16.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7f0e1406eb60 msgr2=0x7f0e14070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7f0e27fff700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7f0e1406eb60 0x7f0e14070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ee41fa2c0 con 0x7f1ec806ec30 2023-11-29T11:13:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e14064f10 msgr2=0x7f0e140673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7f0e27fff700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e14064f10 0x7f0e140673c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800b340 tx=0x7f0e1800f040 comp rx=0 tx=0).stop 2023-11-29T11:13:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806f7c0 msgr2=0x7f0e280af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7f0e27fff700 1 --2- 172.21.15.81:0/3844431001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e2806f7c0 0x7f0e280af9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000caa0 tx=0x7f0e2000cad0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.570+0000 7f0e277fe700 1 -- 172.21.15.81:0/3844431001 reap_dead start 2023-11-29T11:13:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.574+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 shutdown_connections 2023-11-29T11:13:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.574+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 >> 172.21.15.81:0/3844431001 conn(0x7f0e280b1f90 msgr2=0x7f0e280cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.574+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 shutdown_connections 2023-11-29T11:13:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.574+0000 7f0e27fff700 1 -- 172.21.15.81:0/3844431001 wait complete. 2023-11-29T11:13:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.574+0000 7fb5f2ffd700 1 -- 172.21.15.81:0/4016098980 <== osd.7 v2:172.21.15.176:6800/36814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5e8002d60 con 0x7fb5e406eac0 2023-11-29T11:13:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.574+0000 7f1edaffd700 1 -- 172.21.15.81:0/1005172559 <== osd.5 v2:172.21.15.176:6824/36812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ee41fa2c0 con 0x7f1ec806ec30 2023-11-29T11:13:16.625 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:16.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-29T11:13:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b50002d60 con 0x7f8b4c06ea90 2023-11-29T11:13:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7fb5e406eac0 msgr2=0x7fb5e4070ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7fb608818700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7fb5e406eac0 0x7fb5e4070ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5e4064fe0 msgr2=0x7fb5e4067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7fb608818700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb5e4064fe0 0x7fb5e4067490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc004d00 tx=0x7fb5fc00a040 comp rx=0 tx=0).stop 2023-11-29T11:13:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6040c4fe0 msgr2=0x7fb6040b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7fb608818700 1 --2- 172.21.15.81:0/4016098980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6040c4fe0 0x7fb6040b0440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c3c0 tx=0x7fb5f8001250 comp rx=0 tx=0).stop 2023-11-29T11:13:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7fb602d9d700 1 -- 172.21.15.81:0/4016098980 reap_dead start 2023-11-29T11:13:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7f1ec806ec30 msgr2=0x7f1ec8071060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.578+0000 7f1eeb579700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7f1ec806ec30 0x7f1ec8071060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1ec8064f60 msgr2=0x7f1ec8067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eeb579700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1ec8064f60 0x7f1ec8067410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4001610 tx=0x7f1ed4007a40 comp rx=0 tx=0).stop 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee4159f00 msgr2=0x7f1ee40cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eeb579700 1 --2- 172.21.15.81:0/1005172559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee4159f00 0x7f1ee40cd6e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0000c00 tx=0x7f1ee0004770 comp rx=0 tx=0).stop 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eead78700 1 -- 172.21.15.81:0/1005172559 reap_dead start 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 shutdown_connections 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 >> 172.21.15.81:0/1005172559 conn(0x7f1ee40ce3e0 msgr2=0x7f1ee40ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 shutdown_connections 2023-11-29T11:13:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 >> 172.21.15.81:0/4016098980 conn(0x7fb6040ce460 msgr2=0x7fb6040cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 shutdown_connections 2023-11-29T11:13:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 shutdown_connections 2023-11-29T11:13:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f1eeb579700 1 -- 172.21.15.81:0/1005172559 wait complete. 2023-11-29T11:13:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7fb608818700 1 -- 172.21.15.81:0/4016098980 wait complete. 2023-11-29T11:13:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f8b5effd700 1 -- 172.21.15.81:0/3653022870 <== osd.4 v2:172.21.15.176:6808/36811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b50002d60 con 0x7f8b4c06ea90 2023-11-29T11:13:16.631 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:16.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-29T11:13:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f8b4c06ea90 msgr2=0x7f8b4c070ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.582+0000 7f8b6f361700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f8b4c06ea90 0x7f8b4c070ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.632 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:16.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-29T11:13:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.586+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b4c064f30 msgr2=0x7f8b4c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.586+0000 7f8b6f361700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b4c064f30 0x7f8b4c0673e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009910 tx=0x7f8b58008030 comp rx=0 tx=0).stop 2023-11-29T11:13:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.586+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b6815aa90 msgr2=0x7f8b6814bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.586+0000 7f8b6f361700 1 --2- 172.21.15.81:0/3653022870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b6815aa90 0x7f8b6814bb20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000bab0 tx=0x7f8b6000bdc0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.586+0000 7f8b6eb60700 1 -- 172.21.15.81:0/3653022870 reap_dead start 2023-11-29T11:13:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.590+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 shutdown_connections 2023-11-29T11:13:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.590+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 >> 172.21.15.81:0/3653022870 conn(0x7f8b680cb2d0 msgr2=0x7f8b68162520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.590+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 shutdown_connections 2023-11-29T11:13:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.590+0000 7f8b6f361700 1 -- 172.21.15.81:0/3653022870 wait complete. 2023-11-29T11:13:16.634 INFO:teuthology.orchestra.run.smithi081.stdout:60129542153 2023-11-29T11:13:16.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-29T11:13:16.635 INFO:teuthology.orchestra.run.smithi081.stdout:60129542153 2023-11-29T11:13:16.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-29T11:13:16.636 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:16.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-29T11:13:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:16.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-29T11:13:16.638 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:16.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-29T11:13:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.818+0000 7f790e619700 1 Processor -- start 2023-11-29T11:13:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.818+0000 7fc61abd8700 1 Processor -- start 2023-11-29T11:13:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.818+0000 7fee39624700 1 Processor -- start 2023-11-29T11:13:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.818+0000 7fc61abd8700 1 -- start start 2023-11-29T11:13:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.818+0000 7f790e619700 1 -- start start 2023-11-29T11:13:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a77cf700 1 Processor -- start 2023-11-29T11:13:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee39624700 1 -- start start 2023-11-29T11:13:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a77cf700 1 -- start start 2023-11-29T11:13:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc61abd8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc614071660 0x7fc6140b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc61abd8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc6140ae970 0x7fc6140b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc61abd8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6140b2ca0 con 0x7fc614158d70 2023-11-29T11:13:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc61abd8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc614159140 con 0x7fc614071660 2023-11-29T11:13:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc61abd8700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61415d3f0 con 0x7fc6140ae970 2023-11-29T11:13:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79080b1ca0 0x7f79080b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f79080d2780 0x7f79080d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79080cf070 con 0x7f790806a330 2023-11-29T11:13:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080d3140 con 0x7f79080b1ca0 2023-11-29T11:13:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080b2070 con 0x7f79080d2780 2023-11-29T11:13:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc619bd6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc614158d70 0x7fc614070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42954/0 (socket says 172.21.15.81:42954) 2023-11-29T11:13:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc619bd6700 1 -- 172.21.15.81:0/994040182 learned_addr learned my addr 172.21.15.81:0/994040182 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790d617700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79080b1ca0 0x7f79080b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790d617700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79080b1ca0 0x7f79080b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44914/0 (socket says 172.21.15.81:44914) 2023-11-29T11:13:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790d617700 1 -- 172.21.15.81:0/990875209 learned_addr learned my addr 172.21.15.81:0/990875209 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc6193d5700 1 --2- 172.21.15.81:0/994040182 >> v2:172.21.15.81:3300/0 conn(0x7fc614071660 0x7fc6140b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc61a3d7700 1 --2- 172.21.15.81:0/994040182 >> v2:172.21.15.176:3300/0 conn(0x7fc6140ae970 0x7fc6140b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790de18700 1 --2- 172.21.15.81:0/990875209 >> v2:172.21.15.176:3300/0 conn(0x7f79080d2780 0x7f79080d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790d617700 1 -- 172.21.15.81:0/990875209 >> v2:172.21.15.176:3300/0 conn(0x7f79080d2780 msgr2=0x7f79080d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790d617700 1 --2- 172.21.15.81:0/990875209 >> v2:172.21.15.176:3300/0 conn(0x7f79080d2780 0x7f79080d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790d617700 1 -- 172.21.15.81:0/990875209 >> v1:172.21.15.176:6789/0 conn(0x7f790806a330 legacy=0x7f79080cce40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:13:16.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790d617700 1 -- 172.21.15.81:0/990875209 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790806a8a0 con 0x7f79080b1ca0 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a77cf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006bbb0 0x7fa7a006e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a77cf700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7a006e910 0x7fa7a00ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a77cf700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a006f1c0 con 0x7fa7a006e000 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a77cf700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a01593e0 con 0x7fa7a006e910 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a77cf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a006adf0 con 0x7fa7a006bbb0 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc6193d5700 1 -- 172.21.15.81:0/994040182 >> v2:172.21.15.176:3300/0 conn(0x7fc6140ae970 msgr2=0x7fc6140b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc6193d5700 1 --2- 172.21.15.81:0/994040182 >> v2:172.21.15.176:3300/0 conn(0x7fc6140ae970 0x7fc6140b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc6193d5700 1 -- 172.21.15.81:0/994040182 >> v1:172.21.15.81:6789/0 conn(0x7fc614158d70 legacy=0x7fc614070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc618bd4700 1 -- 172.21.15.81:0/994040182 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265127888 0 0) 0x7fc6140b2ca0 con 0x7fc614158d70 2023-11-29T11:13:16.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc6193d5700 1 -- 172.21.15.81:0/994040182 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61415d6d0 con 0x7fc614071660 2023-11-29T11:13:16.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee39624700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee3406a560 0x7fee340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee39624700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3406d700 con 0x7fee340cee60 2023-11-29T11:13:16.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee39624700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee34072220 con 0x7fee340ca5e0 2023-11-29T11:13:16.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee39624700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee34071610 con 0x7fee3406a560 2023-11-29T11:13:16.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790de18700 1 --2- 172.21.15.81:0/990875209 >> v2:172.21.15.176:3300/0 conn(0x7f79080d2780 0x7f79080d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:16.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee337fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee3406a560 0x7fee340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee327fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee340cee60 0x7fee3415ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42964/0 (socket says 172.21.15.81:42964) 2023-11-29T11:13:16.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee327fc700 1 -- 172.21.15.81:0/894240977 learned_addr learned my addr 172.21.15.81:0/894240977 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790d617700 1 --2- 172.21.15.81:0/990875209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080b1ca0 0x7f79080b6250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79080b56f0 tx=0x7f78f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88e79e64192faa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a4d6a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006bbb0 0x7fa7a006e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc6193d5700 1 --2- 172.21.15.81:0/994040182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 0x7fc6140b3130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc61406d3a0 tx=0x7fc604009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6fbf3ab329895c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a4d6a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006bbb0 0x7fa7a006e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:41252/0 (socket says 172.21.15.81:41252) 2023-11-29T11:13:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a4d6a700 1 -- 172.21.15.81:0/4034072575 learned_addr learned my addr 172.21.15.81:0/4034072575 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195d58700 1 Processor -- start 2023-11-29T11:13:16.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f78fffff700 1 -- 172.21.15.81:0/990875209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8004230 con 0x7f79080b1ca0 2023-11-29T11:13:16.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a5d6c700 1 --2- 172.21.15.81:0/4034072575 >> v2:172.21.15.176:3300/0 conn(0x7fa7a006e910 0x7fa7a00ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee31ffb700 1 -- 172.21.15.81:0/894240977 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628688970 0 0) 0x7fee3406d700 con 0x7fee340cee60 2023-11-29T11:13:16.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee31ffb700 1 -- 172.21.15.81:0/894240977 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee1c0035d0 con 0x7fee340cee60 2023-11-29T11:13:16.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195d58700 1 -- start start 2023-11-29T11:13:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f78fffff700 1 -- 172.21.15.81:0/990875209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8004390 con 0x7f79080b1ca0 2023-11-29T11:13:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f78fffff700 1 -- 172.21.15.81:0/990875209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80036c0 con 0x7f79080b1ca0 2023-11-29T11:13:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee337fe700 1 -- 172.21.15.81:0/894240977 >> v1:172.21.15.176:6789/0 conn(0x7fee340ca5e0 legacy=0x7fee34069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee337fe700 1 -- 172.21.15.81:0/894240977 >> v1:172.21.15.81:6789/0 conn(0x7fee340cee60 legacy=0x7fee3415ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee337fe700 1 -- 172.21.15.81:0/894240977 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340718f0 con 0x7fee3406a560 2023-11-29T11:13:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a4d6a700 1 -- 172.21.15.81:0/4034072575 >> v2:172.21.15.176:3300/0 conn(0x7fa7a006e910 msgr2=0x7fa7a00ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a4d6a700 1 --2- 172.21.15.81:0/4034072575 >> v2:172.21.15.176:3300/0 conn(0x7fa7a006e910 0x7fa7a00ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a4d6a700 1 -- 172.21.15.81:0/4034072575 >> v1:172.21.15.176:6789/0 conn(0x7fa7a006e000 legacy=0x7fa7a00ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a4d6a700 1 -- 172.21.15.81:0/4034072575 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a006b0d0 con 0x7fa7a006bbb0 2023-11-29T11:13:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee337fe700 1 --2- 172.21.15.81:0/894240977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee3406a560 0x7fee340cb6f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee24009850 tx=0x7fee24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cd0b3c5c07971d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa7a4d6a700 1 --2- 172.21.15.81:0/4034072575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006bbb0 0x7fa7a006e3d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009910 tx=0x7fa79c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c9b19de8314b196 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa797fff700 1 -- 172.21.15.81:0/4034072575 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c004230 con 0x7fa7a006bbb0 2023-11-29T11:13:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa797fff700 1 -- 172.21.15.81:0/4034072575 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c004390 con 0x7fa7a006bbb0 2023-11-29T11:13:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fa797fff700 1 -- 172.21.15.81:0/4034072575 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c009e60 con 0x7fa7a006bbb0 2023-11-29T11:13:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 -- 172.21.15.81:0/990875209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080b1ca0 msgr2=0x7f79080b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 --2- 172.21.15.81:0/990875209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080b1ca0 0x7f79080b6250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79080b56f0 tx=0x7f78f8009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f828c859700 1 Processor -- start 2023-11-29T11:13:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee31ffb700 1 -- 172.21.15.81:0/894240977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24004230 con 0x7fee3406a560 2023-11-29T11:13:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f828c859700 1 -- start start 2023-11-29T11:13:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195d58700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f919015c470 0x7f91900ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195d58700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f919006a350 0x7f9190071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195d58700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919015c840 con 0x7f91900cbfb0 2023-11-29T11:13:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195d58700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91900722a0 con 0x7f919006a350 2023-11-29T11:13:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195d58700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91900cc400 con 0x7f919015c470 2023-11-29T11:13:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc618bd4700 1 -- 172.21.15.81:0/994040182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604011830 con 0x7fc614071660 2023-11-29T11:13:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc618bd4700 1 -- 172.21.15.81:0/994040182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc604011990 con 0x7fc614071660 2023-11-29T11:13:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fc618bd4700 1 -- 172.21.15.81:0/994040182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604011d20 con 0x7fc614071660 2023-11-29T11:13:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee31ffb700 1 -- 172.21.15.81:0/894240977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24004390 con 0x7fee3406a560 2023-11-29T11:13:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7fee31ffb700 1 -- 172.21.15.81:0/894240977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240036c0 con 0x7fee3406a560 2023-11-29T11:13:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195557700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f919006a350 0x7f9190071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195557700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f919006a350 0x7f9190071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44940/0 (socket says 172.21.15.81:44940) 2023-11-29T11:13:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9195557700 1 -- 172.21.15.81:0/3240022100 learned_addr learned my addr 172.21.15.81:0/3240022100 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f9194d56700 1 --2- 172.21.15.81:0/3240022100 >> v2:172.21.15.176:3300/0 conn(0x7f919015c470 0x7f91900ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 -- 172.21.15.81:0/990875209 shutdown_connections 2023-11-29T11:13:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 --2- 172.21.15.81:0/990875209 >> v2:172.21.15.176:3300/0 conn(0x7f79080d2780 0x7f79080d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 --2- 172.21.15.81:0/990875209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080b1ca0 0x7f79080b6250 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.822+0000 7f790e619700 1 -- 172.21.15.81:0/990875209 >> 172.21.15.81:0/990875209 conn(0x7f79080b5740 msgr2=0x7f79080b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fa7a77cf700 1 -- 172.21.15.81:0/4034072575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006bbb0 msgr2=0x7fa7a006e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/4034072575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006bbb0 0x7fa7a006e3d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009910 tx=0x7fa79c009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195557700 1 -- 172.21.15.81:0/3240022100 >> v2:172.21.15.176:3300/0 conn(0x7f919015c470 msgr2=0x7f91900ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195557700 1 --2- 172.21.15.81:0/3240022100 >> v2:172.21.15.176:3300/0 conn(0x7f919015c470 0x7f91900ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195557700 1 -- 172.21.15.81:0/3240022100 >> v1:172.21.15.176:6789/0 conn(0x7f91900cbfb0 legacy=0x7f9190069c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-29T11:13:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195557700 1 -- 172.21.15.81:0/3240022100 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91900717d0 con 0x7f919006a350 2023-11-29T11:13:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f790e619700 1 -- 172.21.15.81:0/990875209 shutdown_connections 2023-11-29T11:13:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b92d0700 1 Processor -- start 2023-11-29T11:13:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51953700 1 Processor -- start 2023-11-29T11:13:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fa7a77cf700 1 -- 172.21.15.81:0/4034072575 shutdown_connections 2023-11-29T11:13:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/4034072575 >> v2:172.21.15.176:3300/0 conn(0x7fa7a006e910 0x7fa7a00ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/4034072575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006bbb0 0x7fa7a006e3d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fa7a77cf700 1 -- 172.21.15.81:0/4034072575 >> 172.21.15.81:0/4034072575 conn(0x7fa7a00d0290 msgr2=0x7fa7a00b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195557700 1 --2- 172.21.15.81:0/3240022100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f919006a350 0x7f9190071290 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f919006ea10 tx=0x7f918800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1aac8879ffe00b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b92d0700 1 -- start start 2023-11-29T11:13:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- 172.21.15.81:0/894240977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee3406a560 msgr2=0x7fee340cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 --2- 172.21.15.81:0/894240977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee3406a560 0x7fee340cb6f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee24009850 tx=0x7fee24009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 -- 172.21.15.81:0/994040182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 msgr2=0x7fc6140b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 --2- 172.21.15.81:0/994040182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 0x7fc6140b3130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc61406d3a0 tx=0x7fc604009b30 comp rx=0 tx=0).stop 2023-11-29T11:13:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828c859700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f82880c6bd0 0x7f82880cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828c859700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828c859700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82880cc940 0x7f82880cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 -- 172.21.15.81:0/994040182 shutdown_connections 2023-11-29T11:13:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 --2- 172.21.15.81:0/994040182 >> v2:172.21.15.176:3300/0 conn(0x7fc6140ae970 0x7fc6140b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 --2- 172.21.15.81:0/994040182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 0x7fc6140b3130 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51953700 1 -- start start 2023-11-29T11:13:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 -- 172.21.15.81:0/994040182 >> 172.21.15.81:0/994040182 conn(0x7fc6140b1350 msgr2=0x7fc6140b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f918f7fe700 1 -- 172.21.15.81:0/3240022100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800e070 con 0x7f919006a350 2023-11-29T11:13:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- 172.21.15.81:0/894240977 shutdown_connections 2023-11-29T11:13:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 --2- 172.21.15.81:0/894240977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee3406a560 0x7fee340cb6f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- 172.21.15.81:0/894240977 >> 172.21.15.81:0/894240977 conn(0x7fee340b2010 msgr2=0x7fee340ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f918f7fe700 1 -- 172.21.15.81:0/3240022100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188003a40 con 0x7f919006a350 2023-11-29T11:13:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f918f7fe700 1 -- 172.21.15.81:0/3240022100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188003df0 con 0x7f919006a350 2023-11-29T11:13:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828c859700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82880b2b10 con 0x7f82880cc940 2023-11-29T11:13:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828c859700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82880c6fa0 con 0x7f82880c6bd0 2023-11-29T11:13:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828c859700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82880b21b0 con 0x7f82880cc4f0 2023-11-29T11:13:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- 172.21.15.81:0/894240977 shutdown_connections 2023-11-29T11:13:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82880cc940 0x7f82880cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f8286d9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f82880c6bd0 0x7f82880cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82880cc940 0x7f82880cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44950/0 (socket says 172.21.15.81:44950) 2023-11-29T11:13:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f8286d9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f82880c6bd0 0x7f82880cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37082/0 (socket says 172.21.15.81:37082) 2023-11-29T11:13:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 -- 172.21.15.81:0/2143483654 learned_addr learned my addr 172.21.15.81:0/2143483654 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 -- 172.21.15.81:0/994040182 shutdown_connections 2023-11-29T11:13:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- 172.21.15.81:0/894240977 wait complete. 2023-11-29T11:13:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828659c700 1 --2- 172.21.15.81:0/2143483654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195d58700 1 -- 172.21.15.81:0/3240022100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f919006a350 msgr2=0x7f9190071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195d58700 1 --2- 172.21.15.81:0/3240022100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f919006a350 0x7f9190071290 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f919006ea10 tx=0x7f918800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b92d0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e47b0 0x7f18ac037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b92d0700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f18ac036770 0x7f18ac036b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b92d0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0370d0 con 0x7f18ac0e4b80 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b92d0700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac038240 con 0x7f18ac036770 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b92d0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0067d0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 -- 172.21.15.81:0/2143483654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 msgr2=0x7f82880cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 --2- 172.21.15.81:0/2143483654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 -- 172.21.15.81:0/2143483654 >> v2:172.21.15.176:3300/0 conn(0x7f82880c6bd0 msgr2=0x7f82880cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 --2- 172.21.15.81:0/2143483654 >> v2:172.21.15.176:3300/0 conn(0x7f82880c6bd0 0x7f82880cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 -- 172.21.15.81:0/2143483654 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880b2f30 con 0x7f82880cc940 2023-11-29T11:13:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828759e700 1 --2- 172.21.15.81:0/2143483654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880cc940 0x7f82880cd960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f82880d1690 tx=0x7f828000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe6c281ae3fe3ad server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f8285d9b700 1 -- 172.21.15.81:0/2143483654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000bb10 con 0x7f82880cc940 2023-11-29T11:13:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f8285d9b700 1 -- 172.21.15.81:0/2143483654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828000bc70 con 0x7f82880cc940 2023-11-29T11:13:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f8285d9b700 1 -- 172.21.15.81:0/2143483654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800104d0 con 0x7f82880cc940 2023-11-29T11:13:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f18ac0e4b80 0x7f18ac0060c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42976/0 (socket says 172.21.15.81:42976) 2023-11-29T11:13:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b37fe700 1 -- 172.21.15.81:0/3324669938 learned_addr learned my addr 172.21.15.81:0/3324669938 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 -- 172.21.15.81:0/994040182 wait complete. 2023-11-29T11:13:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b3fff700 1 --2- 172.21.15.81:0/3324669938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e47b0 0x7f18ac037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51953700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feb4c0ca810 0x7feb4c0ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51953700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0c8a30 0x7feb4c06a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b2ffd700 1 -- 172.21.15.81:0/3324669938 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541910169 0 0) 0x7f18ac0370d0 con 0x7f18ac0e4b80 2023-11-29T11:13:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b2ffd700 1 -- 172.21.15.81:0/3324669938 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a40035d0 con 0x7f18ac0e4b80 2023-11-29T11:13:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51953700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c0cabe0 con 0x7feb4c0cf030 2023-11-29T11:13:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51953700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4c0adc00 con 0x7feb4c0ca810 2023-11-29T11:13:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51953700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0b3380 con 0x7feb4c0c8a30 2023-11-29T11:13:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fa7a77cf700 1 -- 172.21.15.81:0/4034072575 shutdown_connections 2023-11-29T11:13:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 Processor -- start 2023-11-29T11:13:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fc61abd8700 1 -- start start 2023-11-29T11:13:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 Processor -- start 2023-11-29T11:13:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- start start 2023-11-29T11:13:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828c859700 1 -- 172.21.15.81:0/2143483654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880cc940 msgr2=0x7f82880cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f828c859700 1 --2- 172.21.15.81:0/2143483654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880cc940 0x7f82880cd960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f82880d1690 tx=0x7f828000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b3fff700 1 -- 172.21.15.81:0/3324669938 >> v2:172.21.15.176:3300/0 conn(0x7f18ac036770 msgr2=0x7f18ac036b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-29T11:13:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b3fff700 1 --2- 172.21.15.81:0/3324669938 >> v2:172.21.15.176:3300/0 conn(0x7f18ac036770 0x7f18ac036b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b2ffd700 1 -- 172.21.15.81:0/3324669938 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1867303058 0 0) 0x7f18a40035d0 con 0x7f18ac0e4b80 2023-11-29T11:13:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b3fff700 1 -- 172.21.15.81:0/3324669938 >> v1:172.21.15.81:6789/0 conn(0x7f18ac0e4b80 legacy=0x7f18ac0060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b3fff700 1 -- 172.21.15.81:0/3324669938 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0510a0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b3fff700 1 --2- 172.21.15.81:0/3324669938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e47b0 0x7f18ac037b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009850 tx=0x7f18a8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e41db596a4863d21 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51152700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb4c0cf030 0x7feb4c071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42992/0 (socket says 172.21.15.81:42992) 2023-11-29T11:13:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb51152700 1 -- 172.21.15.81:0/2591026213 learned_addr learned my addr 172.21.15.81:0/2591026213 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb50951700 1 --2- 172.21.15.81:0/2591026213 >> v2:172.21.15.176:3300/0 conn(0x7feb4c0ca810 0x7feb4c0ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb4bfff700 1 --2- 172.21.15.81:0/2591026213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0c8a30 0x7feb4c06a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb4b7fe700 1 -- 172.21.15.81:0/2591026213 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397619551 0 0) 0x7feb4c0cabe0 con 0x7feb4c0cf030 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb4b7fe700 1 -- 172.21.15.81:0/2591026213 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb340035d0 con 0x7feb4c0cf030 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195d58700 1 -- 172.21.15.81:0/3240022100 shutdown_connections 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195d58700 1 --2- 172.21.15.81:0/3240022100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f919006a350 0x7f9190071290 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195d58700 1 --2- 172.21.15.81:0/3240022100 >> v2:172.21.15.176:3300/0 conn(0x7f919015c470 0x7f91900ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195d58700 1 -- 172.21.15.81:0/3240022100 >> 172.21.15.81:0/3240022100 conn(0x7f91900b1f90 msgr2=0x7f91900ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195d58700 1 -- 172.21.15.81:0/3240022100 shutdown_connections 2023-11-29T11:13:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f9195d58700 1 -- 172.21.15.81:0/3240022100 wait complete. 2023-11-29T11:13:16.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f790e619700 1 -- 172.21.15.81:0/990875209 wait complete. 2023-11-29T11:13:16.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f790e619700 1 Processor -- start 2023-11-29T11:13:16.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb4bfff700 1 -- 172.21.15.81:0/2591026213 >> v2:172.21.15.176:3300/0 conn(0x7feb4c0ca810 msgr2=0x7feb4c0ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:16.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb4bfff700 1 --2- 172.21.15.81:0/2591026213 >> v2:172.21.15.176:3300/0 conn(0x7feb4c0ca810 0x7feb4c0ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb4bfff700 1 -- 172.21.15.81:0/2591026213 >> v1:172.21.15.81:6789/0 conn(0x7feb4c0cf030 legacy=0x7feb4c071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7feb4bfff700 1 -- 172.21.15.81:0/2591026213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c158be0 con 0x7feb4c0c8a30 2023-11-29T11:13:16.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fa7a77cf700 1 -- 172.21.15.81:0/4034072575 wait complete. 2023-11-29T11:13:16.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f790e619700 1 -- start start 2023-11-29T11:13:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b2ffd700 1 -- 172.21.15.81:0/3324669938 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40008d0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b2ffd700 1 -- 172.21.15.81:0/3324669938 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8004030 con 0x7f18ac0e47b0 2023-11-29T11:13:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7f18b2ffd700 1 -- 172.21.15.81:0/3324669938 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80043e0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3406a560 0x7fee34155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee340ca5e0 0x7fee3415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee340cee60 0x7fee3415de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee340ce520 con 0x7fee340cee60 2023-11-29T11:13:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee340cd910 con 0x7fee3406a560 2023-11-29T11:13:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.826+0000 7fee39624700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee340cdbf0 con 0x7fee340ca5e0 2023-11-29T11:13:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb4bfff700 1 --2- 172.21.15.81:0/2591026213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0c8a30 0x7feb4c06a650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb4400f370 tx=0x7feb4400f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b0b11d19b8c826 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee32ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3406a560 0x7fee34155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee32ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3406a560 0x7fee34155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37112/0 (socket says 172.21.15.81:37112) 2023-11-29T11:13:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee32ffd700 1 -- 172.21.15.81:0/1553096930 learned_addr learned my addr 172.21.15.81:0/1553096930 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee327fc700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee340ca5e0 0x7fee3415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee337fe700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee340cee60 0x7fee3415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61abd8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 0x7fc61414c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61abd8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6140ae970 0x7fc614154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61abd8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc614158d70 0x7fc614151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61abd8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61414d770 con 0x7fc614071660 2023-11-29T11:13:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61abd8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc614151fc0 con 0x7fc614158d70 2023-11-29T11:13:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61abd8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61414d460 con 0x7fc6140ae970 2023-11-29T11:13:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee337fe700 1 -- 172.21.15.81:0/1553096930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee340ca5e0 msgr2=0x7fee3415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee337fe700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee340ca5e0 0x7fee3415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee337fe700 1 -- 172.21.15.81:0/1553096930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3406a560 msgr2=0x7fee34155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee337fe700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3406a560 0x7fee34155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f18b92d0700 1 -- 172.21.15.81:0/3324669938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e47b0 msgr2=0x7f18ac037b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f18b92d0700 1 --2- 172.21.15.81:0/3324669938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e47b0 0x7f18ac037b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009850 tx=0x7f18a8009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb4b7fe700 1 -- 172.21.15.81:0/2591026213 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44012070 con 0x7feb4c0c8a30 2023-11-29T11:13:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee337fe700 1 -- 172.21.15.81:0/1553096930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240094b0 con 0x7fee340cee60 2023-11-29T11:13:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb4b7fe700 1 -- 172.21.15.81:0/2591026213 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4400fe70 con 0x7feb4c0c8a30 2023-11-29T11:13:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb4b7fe700 1 -- 172.21.15.81:0/2591026213 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400d2f0 con 0x7feb4c0c8a30 2023-11-29T11:13:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc6193d5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6140ae970 0x7fc614154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc6193d5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6140ae970 0x7fc614154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:41298/0 (socket says 172.21.15.81:41298) 2023-11-29T11:13:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc6193d5700 1 -- 172.21.15.81:0/1552274391 learned_addr learned my addr 172.21.15.81:0/1552274391 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc619bd6700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 0x7fc61414c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f18b92d0700 1 -- 172.21.15.81:0/3324669938 shutdown_connections 2023-11-29T11:13:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f18b92d0700 1 --2- 172.21.15.81:0/3324669938 >> v2:172.21.15.176:3300/0 conn(0x7f18ac036770 0x7f18ac036b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f18b92d0700 1 --2- 172.21.15.81:0/3324669938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e47b0 0x7f18ac037b40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f18b92d0700 1 -- 172.21.15.81:0/3324669938 >> 172.21.15.81:0/3324669938 conn(0x7f18ac051770 msgr2=0x7f18ac051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9195d58700 1 Processor -- start 2023-11-29T11:13:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee337fe700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee340cee60 0x7fee3415de60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee24015000 tx=0x7fee24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 -- 172.21.15.81:0/2143483654 shutdown_connections 2023-11-29T11:13:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 --2- 172.21.15.81:0/2143483654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 --2- 172.21.15.81:0/2143483654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880cc940 0x7f82880cd960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 --2- 172.21.15.81:0/2143483654 >> v2:172.21.15.176:3300/0 conn(0x7f82880c6bd0 0x7f82880cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 -- 172.21.15.81:0/2143483654 >> 172.21.15.81:0/2143483654 conn(0x7f8288069c40 msgr2=0x7f828806a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9195d58700 1 -- start start 2023-11-29T11:13:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790e619700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f790806a330 0x7f79080cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790e619700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79080b1ca0 0x7f79080b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790e619700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080d2780 0x7f790815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61a3d7700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc614158d70 0x7fc614151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc619bd6700 1 -- 172.21.15.81:0/1552274391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6140ae970 msgr2=0x7fc614154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc619bd6700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6140ae970 0x7fc614154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc619bd6700 1 -- 172.21.15.81:0/1552274391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc614158d70 msgr2=0x7fc614151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc619bd6700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc614158d70 0x7fc614151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc619bd6700 1 -- 172.21.15.81:0/1552274391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040094b0 con 0x7fc614071660 2023-11-29T11:13:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 -- 172.21.15.81:0/2143483654 shutdown_connections 2023-11-29T11:13:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080d2780 0x7f790815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080d2780 0x7f790815ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44990/0 (socket says 172.21.15.81:44990) 2023-11-29T11:13:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790d617700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f790806a330 0x7f79080cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790ce16700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79080b1ca0 0x7f79080b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790d617700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f790806a330 0x7f79080cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37136/0 (socket says 172.21.15.81:37136) 2023-11-29T11:13:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 -- 172.21.15.81:0/2143483654 wait complete. 2023-11-29T11:13:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc619bd6700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 0x7fc61414c670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc61000c480 tx=0x7fc61000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb51953700 1 -- 172.21.15.81:0/2591026213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0c8a30 msgr2=0x7feb4c06a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a77cf700 1 Processor -- start 2023-11-29T11:13:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a77cf700 1 -- start start 2023-11-29T11:13:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb51953700 1 --2- 172.21.15.81:0/2591026213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0c8a30 0x7feb4c06a650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb4400f370 tx=0x7feb4400f680 comp rx=0 tx=0).stop 2023-11-29T11:13:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee1b7fe700 1 -- 172.21.15.81:0/1553096930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24006ea0 con 0x7fee340cee60 2023-11-29T11:13:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a77cf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7a006bbb0 0x7fa7a01f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee34071eb0 con 0x7fee340cee60 2023-11-29T11:13:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee1b7fe700 1 -- 172.21.15.81:0/1553096930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24011830 con 0x7fee340cee60 2023-11-29T11:13:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee1b7fe700 1 -- 172.21.15.81:0/1553096930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24011ba0 con 0x7fee340cee60 2023-11-29T11:13:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee34071bd0 con 0x7fee340cee60 2023-11-29T11:13:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc60a7fc700 1 -- 172.21.15.81:0/1552274391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610004ca0 con 0x7fc614071660 2023-11-29T11:13:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc60a7fc700 1 -- 172.21.15.81:0/1552274391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc610004e00 con 0x7fc614071660 2023-11-29T11:13:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc60a7fc700 1 -- 172.21.15.81:0/1552274391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610007310 con 0x7fc614071660 2023-11-29T11:13:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f18b92d0700 1 -- 172.21.15.81:0/3324669938 shutdown_connections 2023-11-29T11:13:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 Processor -- start 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 -- 172.21.15.81:0/86554864 learned_addr learned my addr 172.21.15.81:0/86554864 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080cc790 con 0x7f79080d2780 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080b3c60 con 0x7f790806a330 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79081f9d50 con 0x7f79080b1ca0 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 -- 172.21.15.81:0/86554864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79080b1ca0 msgr2=0x7f79080b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79080b1ca0 0x7f79080b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 -- 172.21.15.81:0/86554864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f790806a330 msgr2=0x7f79080cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f790806a330 0x7f79080cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 -- 172.21.15.81:0/86554864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f8009570 con 0x7f79080d2780 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a77cf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006e000 0x7fa7a015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a77cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a006e910 0x7fa7a0154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a77cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a015bc50 con 0x7fa7a006e910 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a77cf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a015b040 con 0x7fa7a006bbb0 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a77cf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a015b320 con 0x7fa7a006e000 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a556b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7a006bbb0 0x7fa7a01f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a556b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7a006bbb0 0x7fa7a01f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37152/0 (socket says 172.21.15.81:37152) 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a556b700 1 -- 172.21.15.81:0/3749892503 learned_addr learned my addr 172.21.15.81:0/3749892503 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a4d6a700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006e000 0x7fa7a015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a4d6a700 1 -- 172.21.15.81:0/3749892503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7a006bbb0 msgr2=0x7fa7a01f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a4d6a700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7a006bbb0 0x7fa7a01f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a4d6a700 1 -- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a006e910 msgr2=0x7fa7a0154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a4d6a700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a006e910 0x7fa7a0154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fa7a4d6a700 1 -- 172.21.15.81:0/3749892503 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c009570 con 0x7fa7a006e000 2023-11-29T11:13:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb51953700 1 -- 172.21.15.81:0/2591026213 shutdown_connections 2023-11-29T11:13:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb51953700 1 --2- 172.21.15.81:0/2591026213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0c8a30 0x7feb4c06a650 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb51953700 1 --2- 172.21.15.81:0/2591026213 >> v2:172.21.15.176:3300/0 conn(0x7feb4c0ca810 0x7feb4c0ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb51953700 1 -- 172.21.15.81:0/2591026213 >> 172.21.15.81:0/2591026213 conn(0x7feb4c0b1f90 msgr2=0x7feb4c0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb51953700 1 -- 172.21.15.81:0/2591026213 shutdown_connections 2023-11-29T11:13:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f790de18700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080d2780 0x7f790815ba40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7900007e20 tx=0x7f790000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9195d58700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919006a350 0x7f9190153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9195d58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbfb0 0x7f91900c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9195d58700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919015c470 0x7f91901f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7feb51953700 1 -- 172.21.15.81:0/2591026213 wait complete. 2023-11-29T11:13:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9195d58700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190154500 con 0x7f91900cbfb0 2023-11-29T11:13:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9195d58700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190154c40 con 0x7f919006a350 2023-11-29T11:13:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9195d58700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9190154f20 con 0x7f919015c470 2023-11-29T11:13:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f18b92d0700 1 -- 172.21.15.81:0/3324669938 wait complete. 2023-11-29T11:13:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f9194d56700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919006a350 0x7f9190153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9194d56700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919006a350 0x7f9190153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37162/0 (socket says 172.21.15.81:37162) 2023-11-29T11:13:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9194d56700 1 -- 172.21.15.81:0/2522802941 learned_addr learned my addr 172.21.15.81:0/2522802941 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9195557700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919015c470 0x7f91901f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee340c8ab0 con 0x7fee340cee60 2023-11-29T11:13:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fa7a4d6a700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006e000 0x7fa7a015a7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa79c015000 tx=0x7fa79c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f78fdffb700 1 -- 172.21.15.81:0/86554864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000dd20 con 0x7f79080d2780 2023-11-29T11:13:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b92d0700 1 Processor -- start 2023-11-29T11:13:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f78fdffb700 1 -- 172.21.15.81:0/86554864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790000de80 con 0x7f79080d2780 2023-11-29T11:13:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f78fdffb700 1 -- 172.21.15.81:0/86554864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900003c80 con 0x7f79080d2780 2023-11-29T11:13:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790806ae60 con 0x7f79080d2780 2023-11-29T11:13:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6140b2930 con 0x7fc614071660 2023-11-29T11:13:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6140b2650 con 0x7fc614071660 2023-11-29T11:13:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc614072170 con 0x7fc614071660 2023-11-29T11:13:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 -- start start 2023-11-29T11:13:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880c6bd0 0x7f82881ecab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82880cc940 0x7f82880b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790806ab80 con 0x7f79080d2780 2023-11-29T11:13:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82880a8230 con 0x7f82880c6bd0 2023-11-29T11:13:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82880a75f0 con 0x7f82880cc940 2023-11-29T11:13:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.830+0000 7f828c859700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82880a7890 con 0x7f82880cc4f0 2023-11-29T11:13:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f828659c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f828659c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:41336/0 (socket says 172.21.15.81:41336) 2023-11-29T11:13:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f828659c700 1 -- 172.21.15.81:0/970769153 learned_addr learned my addr 172.21.15.81:0/970769153 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f828759e700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82880cc940 0x7f82880b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b92d0700 1 -- start start 2023-11-29T11:13:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9194d56700 1 -- 172.21.15.81:0/2522802941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919015c470 msgr2=0x7f91901f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9194d56700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919015c470 0x7f91901f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9194d56700 1 -- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbfb0 msgr2=0x7f91900c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9194d56700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbfb0 0x7f91900c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9194d56700 1 -- 172.21.15.81:0/2522802941 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009b30 con 0x7f919006a350 2023-11-29T11:13:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fa795ffb700 1 -- 172.21.15.81:0/3749892503 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00bd00 con 0x7fa7a006e000 2023-11-29T11:13:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fa795ffb700 1 -- 172.21.15.81:0/3749892503 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c01f070 con 0x7fa7a006e000 2023-11-29T11:13:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fa795ffb700 1 -- 172.21.15.81:0/3749892503 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c003900 con 0x7fa7a006e000 2023-11-29T11:13:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a006b690 con 0x7fa7a006e000 2023-11-29T11:13:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a006b3b0 con 0x7fa7a006e000 2023-11-29T11:13:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa780005310 con 0x7fa7a006e000 2023-11-29T11:13:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb51953700 1 Processor -- start 2023-11-29T11:13:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb51953700 1 -- start start 2023-11-29T11:13:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb51953700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0c8a30 0x7feb4c0974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb51953700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb4c0ca810 0x7feb4c0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb51953700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0cf030 0x7feb4c071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb51953700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0ae090 con 0x7feb4c0c8a30 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb51953700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0afb80 con 0x7feb4c0ca810 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb51953700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0afe60 con 0x7feb4c0cf030 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b92d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ac036770 0x7f18ac0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b92d0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18ac0e47b0 0x7f18ac04a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b92d0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e4b80 0x7f18ac04ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b92d0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac04c9e0 con 0x7f18ac036770 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b92d0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0dd970 con 0x7f18ac0e47b0 2023-11-29T11:13:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b92d0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac04b290 con 0x7f18ac0e4b80 2023-11-29T11:13:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18ac0e47b0 0x7f18ac04a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18ac0e47b0 0x7f18ac04a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37168/0 (socket says 172.21.15.81:37168) 2023-11-29T11:13:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 -- 172.21.15.81:0/1443559683 learned_addr learned my addr 172.21.15.81:0/1443559683 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e8005310 con 0x7f79080d2780 2023-11-29T11:13:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 -- 172.21.15.81:0/1443559683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e4b80 msgr2=0x7f18ac04ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T11:13:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e4b80 0x7f18ac04ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 -- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ac036770 msgr2=0x7f18ac0dd430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T11:13:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ac036770 0x7f18ac0dd430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 -- 172.21.15.81:0/1443559683 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80094b0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fc60a7fc700 1 -- 172.21.15.81:0/1552274391 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc61001a020 con 0x7fc614071660 2023-11-29T11:13:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f8286d9d700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880c6bd0 0x7f82881ecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f8286d9d700 1 -- 172.21.15.81:0/970769153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 msgr2=0x7f82880b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f8286d9d700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f8286d9d700 1 -- 172.21.15.81:0/970769153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82880cc940 msgr2=0x7f82880b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f8286d9d700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82880cc940 0x7f82880b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f8286d9d700 1 -- 172.21.15.81:0/970769153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280009b30 con 0x7f82880c6bd0 2023-11-29T11:13:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f9194d56700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919006a350 0x7f9190153fc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f918400e9d0 tx=0x7f918400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f8286d9d700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880c6bd0 0x7f82881ecab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f827800e870 tx=0x7f827800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f78fdffb700 1 -- 172.21.15.81:0/86554864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f790002d030 con 0x7f79080d2780 2023-11-29T11:13:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb50951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0c8a30 0x7feb4c0974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb50951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0c8a30 0x7feb4c0974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45018/0 (socket says 172.21.15.81:45018) 2023-11-29T11:13:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb50951700 1 -- 172.21.15.81:0/2053015537 learned_addr learned my addr 172.21.15.81:0/2053015537 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f18b37fe700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18ac0e47b0 0x7f18ac04a710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f18b4066910 tx=0x7f18b4072ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f918d7fa700 1 -- 172.21.15.81:0/2522802941 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918400c850 con 0x7f919006a350 2023-11-29T11:13:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fc60a7fc700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5f8064f60 0x7fc5f8067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fc6193d5700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5f8064f60 0x7fc5f8067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fc60a7fc700 1 -- 172.21.15.81:0/1552274391 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc6100821b0 con 0x7fc614071660 2023-11-29T11:13:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb50951700 1 -- 172.21.15.81:0/2053015537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0cf030 msgr2=0x7feb4c071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb50951700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0cf030 0x7feb4c071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb50951700 1 -- 172.21.15.81:0/2053015537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb4c0ca810 msgr2=0x7feb4c0c46f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T11:13:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb50951700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb4c0ca810 0x7feb4c0c46f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7feb50951700 1 -- 172.21.15.81:0/2053015537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4400f050 con 0x7feb4c0c8a30 2023-11-29T11:13:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f918d7fa700 1 -- 172.21.15.81:0/2522802941 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918400c9b0 con 0x7f919006a350 2023-11-29T11:13:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f918d7fa700 1 -- 172.21.15.81:0/2522802941 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918400cd20 con 0x7f919006a350 2023-11-29T11:13:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7f78fdffb700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f78ec064ee0 0x7f78ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7feb50951700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0c8a30 0x7feb4c0974e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00dbb0 tx=0x7feb3c00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9190071a00 con 0x7f919006a350 2023-11-29T11:13:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f790d617700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f78ec064ee0 0x7f78ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7fc6193d5700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5f8064f60 0x7fc5f8067410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc604000c00 tx=0x7fc604008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919006c1a0 con 0x7f919006a350 2023-11-29T11:13:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f790d617700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f78ec064ee0 0x7f78ec067390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79080b56f0 tx=0x7f78f8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7fa795ffb700 1 -- 172.21.15.81:0/3749892503 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa79c017020 con 0x7fa7a006e000 2023-11-29T11:13:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7fa795ffb700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa784064f30 0x7fa7840673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f18b0ff9700 1 -- 172.21.15.81:0/1443559683 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40722f0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f18b0ff9700 1 -- 172.21.15.81:0/1443559683 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4067b20 con 0x7f18ac0e47b0 2023-11-29T11:13:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f18b0ff9700 1 -- 172.21.15.81:0/1443559683 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4067ed0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac04f4c0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190071ce0 con 0x7f919006a350 2023-11-29T11:13:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7fa7a556b700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa784064f30 0x7fa7840673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac051380 con 0x7f18ac0e47b0 2023-11-29T11:13:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7fa795ffb700 1 -- 172.21.15.81:0/3749892503 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa79c083b50 con 0x7fa7a006e000 2023-11-29T11:13:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f918d7fa700 1 -- 172.21.15.81:0/2522802941 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9184019030 con 0x7f919006a350 2023-11-29T11:13:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f918d7fa700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f917c064ee0 0x7f917c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f918d7fa700 1 -- 172.21.15.81:0/2522802941 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f91840821f0 con 0x7f919006a350 2023-11-29T11:13:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f918ffff700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f917c064ee0 0x7f917c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1894005310 con 0x7f18ac0e47b0 2023-11-29T11:13:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7fa7a556b700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa784064f30 0x7fa7840673e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa790005180 tx=0x7fa790003910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f918ffff700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f917c064ee0 0x7f917c067390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f919006c560 tx=0x7f9180006c50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f826f7fe700 1 -- 172.21.15.81:0/970769153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278013680 con 0x7f82880c6bd0 2023-11-29T11:13:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f78fdffb700 1 -- 172.21.15.81:0/86554864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f790006cdf0 con 0x7f79080d2780 2023-11-29T11:13:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82880b2730 con 0x7f82880c6bd0 2023-11-29T11:13:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7fc60a7fc700 1 -- 172.21.15.81:0/1552274391 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc6100500a0 con 0x7fc614071660 2023-11-29T11:13:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7feb497fa700 1 -- 172.21.15.81:0/2053015537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c015420 con 0x7feb4c0c8a30 2023-11-29T11:13:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82880b2450 con 0x7f82880c6bd0 2023-11-29T11:13:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fee1b7fe700 1 -- 172.21.15.81:0/1553096930 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fee24017020 con 0x7fee340cee60 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fee1b7fe700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee20064fe0 0x7fee20067490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fee1b7fe700 1 -- 172.21.15.81:0/1553096930 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee240834f0 con 0x7fee340cee60 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fee32ffd700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee20064fe0 0x7fee20067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.834+0000 7fee32ffd700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee20064fe0 0x7fee20067490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00f3c0 tx=0x7fee2c0043a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.838+0000 7f18b0ff9700 1 -- 172.21.15.81:0/1443559683 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f18b406b0d0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.842+0000 7f18b0ff9700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1898064f30 0x7f18980673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.842+0000 7f18b3fff700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1898064f30 0x7f18980673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.842+0000 7f18b0ff9700 1 -- 172.21.15.81:0/1443559683 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f18b40fb300 con 0x7f18ac0e47b0 2023-11-29T11:13:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.842+0000 7f18b3fff700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1898064f30 0x7f18980673e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00bce0 tx=0x7f18a8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.842+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c0b38b0 con 0x7feb4c0c8a30 2023-11-29T11:13:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.842+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c0b35d0 con 0x7feb4c0c8a30 2023-11-29T11:13:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.842+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82880cce20 con 0x7f82880c6bd0 2023-11-29T11:13:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.842+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c0b3b90 con 0x7feb4c0c8a30 2023-11-29T11:13:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.846+0000 7fee1b7fe700 1 -- 172.21.15.81:0/1553096930 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fee24051330 con 0x7fee340cee60 2023-11-29T11:13:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.846+0000 7fa795ffb700 1 -- 172.21.15.81:0/3749892503 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa79c0554d0 con 0x7fa7a006e000 2023-11-29T11:13:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.846+0000 7f918d7fa700 1 -- 172.21.15.81:0/2522802941 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f918404ffc0 con 0x7f919006a350 2023-11-29T11:13:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.850+0000 7feb497fa700 1 -- 172.21.15.81:0/2053015537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c005a40 con 0x7feb4c0c8a30 2023-11-29T11:13:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.850+0000 7feb497fa700 1 -- 172.21.15.81:0/2053015537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c005db0 con 0x7feb4c0c8a30 2023-11-29T11:13:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.850+0000 7f826f7fe700 1 -- 172.21.15.81:0/970769153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8278005a40 con 0x7f82880c6bd0 2023-11-29T11:13:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.850+0000 7f826f7fe700 1 -- 172.21.15.81:0/970769153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278005db0 con 0x7f82880c6bd0 2023-11-29T11:13:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.850+0000 7f18b0ff9700 1 -- 172.21.15.81:0/1443559683 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f18b40c90e0 con 0x7f18ac0e47b0 2023-11-29T11:13:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.850+0000 7f78fdffb700 1 -- 172.21.15.81:0/86554864 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7900061040 con 0x7f79080d2780 2023-11-29T11:13:16.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.850+0000 7feb497fa700 1 -- 172.21.15.81:0/2053015537 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb3c015580 con 0x7feb4c0c8a30 2023-11-29T11:13:16.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.850+0000 7feb497fa700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb38064ee0 0x7feb38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.854+0000 7feb497fa700 1 -- 172.21.15.81:0/2053015537 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb3c083280 con 0x7feb4c0c8a30 2023-11-29T11:13:16.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.854+0000 7feb4bfff700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb38064ee0 0x7feb38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.854+0000 7feb4bfff700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb38064ee0 0x7feb38067390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0c1d90 tx=0x7feb4400d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.858+0000 7f826f7fe700 1 -- 172.21.15.81:0/970769153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8278019030 con 0x7f82880c6bd0 2023-11-29T11:13:16.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.858+0000 7f826f7fe700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8274064ee0 0x7f8274067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:16.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.858+0000 7f826f7fe700 1 -- 172.21.15.81:0/970769153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8278082660 con 0x7f82880c6bd0 2023-11-29T11:13:16.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.858+0000 7f828659c700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8274064ee0 0x7f8274067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:16.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.858+0000 7f826f7fe700 1 -- 172.21.15.81:0/970769153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f82780503d0 con 0x7f82880c6bd0 2023-11-29T11:13:16.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.858+0000 7f828659c700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8274064ee0 0x7f8274067390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8288158970 tx=0x7f827c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:16.866+0000 7feb497fa700 1 -- 172.21.15.81:0/2053015537 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb3c050ff0 con 0x7feb4c0c8a30 2023-11-29T11:13:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.146+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9190072500 con 0x7f919006a350 2023-11-29T11:13:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.146+0000 7f918d7fa700 1 -- 172.21.15.81:0/2522802941 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91840535e0 con 0x7f919006a350 2023-11-29T11:13:17.152 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f917c064ee0 msgr2=0x7f917c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f917c064ee0 0x7f917c067390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f919006c560 tx=0x7f9180006c50 comp rx=0 tx=0).stop 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919006a350 msgr2=0x7f9190153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919006a350 0x7f9190153fc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f918400e9d0 tx=0x7f918400ece0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 shutdown_connections 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f917c064ee0 0x7f917c067390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f919015c470 0x7f91901f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbfb0 0x7f91900c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 --2- 172.21.15.81:0/2522802941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919006a350 0x7f9190153fc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 >> 172.21.15.81:0/2522802941 conn(0x7f91900b1f90 msgr2=0x7f91900b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 shutdown_connections 2023-11-29T11:13:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7f9195d58700 1 -- 172.21.15.81:0/2522802941 wait complete. 2023-11-29T11:13:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa780005890 con 0x7fa7a006e000 2023-11-29T11:13:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6140008d0 con 0x7fc614071660 2023-11-29T11:13:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7fa795ffb700 1 -- 172.21.15.81:0/3749892503 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa79c0550c0 con 0x7fa7a006e000 2023-11-29T11:13:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7fc60a7fc700 1 -- 172.21.15.81:0/1552274391 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6100536c0 con 0x7fc614071660 2023-11-29T11:13:17.157 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:17.158 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.150+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee340008d0 con 0x7fee340cee60 2023-11-29T11:13:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5f8064f60 msgr2=0x7fc5f8067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5f8064f60 0x7fc5f8067410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc604000c00 tx=0x7fc604008030 comp rx=0 tx=0).stop 2023-11-29T11:13:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 msgr2=0x7fc61414c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 0x7fc61414c670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc61000c480 tx=0x7fc61000c790 comp rx=0 tx=0).stop 2023-11-29T11:13:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 shutdown_connections 2023-11-29T11:13:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc5f8064f60 0x7fc5f8067410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc614158d70 0x7fc614151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6140ae970 0x7fc614154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 --2- 172.21.15.81:0/1552274391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc614071660 0x7fc61414c670 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 >> 172.21.15.81:0/1552274391 conn(0x7fc6140b1350 msgr2=0x7fc614070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 shutdown_connections 2023-11-29T11:13:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.154+0000 7fc61abd8700 1 -- 172.21.15.81:0/1552274391 wait complete. 2023-11-29T11:13:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8288072c20 con 0x7f82880c6bd0 2023-11-29T11:13:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa784064f30 msgr2=0x7fa7840673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa784064f30 0x7fa7840673e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa790005180 tx=0x7fa790003910 comp rx=0 tx=0).stop 2023-11-29T11:13:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006e000 msgr2=0x7fa7a015a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006e000 0x7fa7a015a7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa79c015000 tx=0x7fa79c004770 comp rx=0 tx=0).stop 2023-11-29T11:13:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fee1b7fe700 1 -- 172.21.15.81:0/1553096930 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee24054950 con 0x7fee340cee60 2023-11-29T11:13:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 shutdown_connections 2023-11-29T11:13:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa784064f30 0x7fa7840673e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a006e910 0x7fa7a0154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7a006e000 0x7fa7a015a7a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 --2- 172.21.15.81:0/3749892503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7a006bbb0 0x7fa7a01f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 >> 172.21.15.81:0/3749892503 conn(0x7fa7a00d0290 msgr2=0x7fa7a00af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7f826f7fe700 1 -- 172.21.15.81:0/970769153 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8278021090 con 0x7f82880c6bd0 2023-11-29T11:13:17.163 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 shutdown_connections 2023-11-29T11:13:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7fa7a77cf700 1 -- 172.21.15.81:0/3749892503 wait complete. 2023-11-29T11:13:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f78e80055c0 con 0x7f79080d2780 2023-11-29T11:13:17.164 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8274064ee0 msgr2=0x7f8274067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8274064ee0 0x7f8274067390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8288158970 tx=0x7f827c008040 comp rx=0 tx=0).stop 2023-11-29T11:13:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880c6bd0 msgr2=0x7f82881ecab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880c6bd0 0x7f82881ecab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f827800e870 tx=0x7f827800eb80 comp rx=0 tx=0).stop 2023-11-29T11:13:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.158+0000 7f78fdffb700 1 -- 172.21.15.81:0/86554864 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f790002b090 con 0x7f79080d2780 2023-11-29T11:13:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 shutdown_connections 2023-11-29T11:13:17.166 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8274064ee0 0x7f8274067390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82880cc940 0x7f82880b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82880cc4f0 0x7f82880b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 --2- 172.21.15.81:0/970769153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82880c6bd0 0x7f82881ecab0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 >> 172.21.15.81:0/970769153 conn(0x7f8288069c40 msgr2=0x7f828806f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 shutdown_connections 2023-11-29T11:13:17.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f828c859700 1 -- 172.21.15.81:0/970769153 wait complete. 2023-11-29T11:13:17.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee20064fe0 msgr2=0x7fee20067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee20064fe0 0x7fee20067490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00f3c0 tx=0x7fee2c0043a0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee340cee60 msgr2=0x7fee3415de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee340cee60 0x7fee3415de60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee24015000 tx=0x7fee24004770 comp rx=0 tx=0).stop 2023-11-29T11:13:17.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1894005890 con 0x7f18ac0e47b0 2023-11-29T11:13:17.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 shutdown_connections 2023-11-29T11:13:17.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee20064fe0 0x7fee20067490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee340cee60 0x7fee3415de60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee340ca5e0 0x7fee3415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 --2- 172.21.15.81:0/1553096930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee3406a560 0x7fee34155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 >> 172.21.15.81:0/1553096930 conn(0x7fee340b2010 msgr2=0x7fee3415f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:17.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 shutdown_connections 2023-11-29T11:13:17.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.162+0000 7fee39624700 1 -- 172.21.15.81:0/1553096930 wait complete. 2023-11-29T11:13:17.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f78ec064ee0 msgr2=0x7f78ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b0ff9700 1 -- 172.21.15.81:0/1443559683 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18b40cc700 con 0x7f18ac0e47b0 2023-11-29T11:13:17.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f78ec064ee0 0x7f78ec067390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79080b56f0 tx=0x7f78f8008030 comp rx=0 tx=0).stop 2023-11-29T11:13:17.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080d2780 msgr2=0x7f790815ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080d2780 0x7f790815ba40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7900007e20 tx=0x7f790000d3b0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.171 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:17.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 shutdown_connections 2023-11-29T11:13:17.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f78ec064ee0 0x7f78ec067390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080d2780 0x7f790815ba40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79080b1ca0 0x7f79080b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 --2- 172.21.15.81:0/86554864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f790806a330 0x7f79080cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 >> 172.21.15.81:0/86554864 conn(0x7f79080b5740 msgr2=0x7f79080cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1898064f30 msgr2=0x7f18980673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1898064f30 0x7f18980673e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00bce0 tx=0x7f18a8008030 comp rx=0 tx=0).stop 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18ac0e47b0 msgr2=0x7f18ac04a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18ac0e47b0 0x7f18ac04a710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f18b4066910 tx=0x7f18b4072ab0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 shutdown_connections 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1898064f30 0x7f18980673e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18ac0e4b80 0x7f18ac04ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18ac0e47b0 0x7f18ac04a710 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 --2- 172.21.15.81:0/1443559683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ac036770 0x7f18ac0dd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 >> 172.21.15.81:0/1443559683 conn(0x7f18ac051770 msgr2=0x7f18ac036030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.166+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 shutdown_connections 2023-11-29T11:13:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.170+0000 7f18b92d0700 1 -- 172.21.15.81:0/1443559683 wait complete. 2023-11-29T11:13:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.170+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 shutdown_connections 2023-11-29T11:13:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.170+0000 7f790e619700 1 -- 172.21.15.81:0/86554864 wait complete. 2023-11-29T11:13:17.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2023-11-29T11:13:17.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.1 2023-11-29T11:13:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.174+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7feb4c072500 con 0x7feb4c0c8a30 2023-11-29T11:13:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.174+0000 7feb497fa700 1 -- 172.21.15.81:0/2053015537 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb3c054610 con 0x7feb4c0c8a30 2023-11-29T11:13:17.178 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb38064ee0 msgr2=0x7feb38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb38064ee0 0x7feb38067390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0c1d90 tx=0x7feb4400d000 comp rx=0 tx=0).stop 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0c8a30 msgr2=0x7feb4c0974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0c8a30 0x7feb4c0974e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00dbb0 tx=0x7feb3c00df70 comp rx=0 tx=0).stop 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 shutdown_connections 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb38064ee0 0x7feb38067390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4c0cf030 0x7feb4c071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb4c0ca810 0x7feb4c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 --2- 172.21.15.81:0/2053015537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c0c8a30 0x7feb4c0974e0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00dbb0 tx=0x7feb3c00df70 comp rx=0 tx=0).stop 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 >> 172.21.15.81:0/2053015537 conn(0x7feb4c0b1f90 msgr2=0x7feb4c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 shutdown_connections 2023-11-29T11:13:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:17.178+0000 7feb51953700 1 -- 172.21.15.81:0/2053015537 wait complete. 2023-11-29T11:13:17.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2023-11-29T11:13:17.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2023-11-29T11:13:17.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.2 2023-11-29T11:13:17.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2023-11-29T11:13:17.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.3 2023-11-29T11:13:17.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.5 2023-11-29T11:13:18.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-29T11:13:18.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-29T11:13:18.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-29T11:13:18.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-29T11:13:18.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-29T11:13:18.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-29T11:13:18.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-29T11:13:18.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-29T11:13:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.314+0000 7f04efede700 1 Processor -- start 2023-11-29T11:13:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.314+0000 7f04efede700 1 -- start start 2023-11-29T11:13:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fbfff700 1 Processor -- start 2023-11-29T11:13:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fbfff700 1 -- start start 2023-11-29T11:13:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fbfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f45fc1584b0 0x7f45fc06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45fc071290 0x7f45fc0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fbfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc071dd0 con 0x7f45fc0cc570 2023-11-29T11:13:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fbfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc06d220 con 0x7f45fc071290 2023-11-29T11:13:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fbfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc06f740 con 0x7f45fc1584b0 2023-11-29T11:13:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45fc0cc570 0x7f45fc069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43006/0 (socket says 172.21.15.81:43006) 2023-11-29T11:13:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fb7fe700 1 -- 172.21.15.81:0/3598302697 learned_addr learned my addr 172.21.15.81:0/3598302697 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45faffd700 1 --2- 172.21.15.81:0/3598302697 >> v2:172.21.15.176:3300/0 conn(0x7f45fc1584b0 0x7f45fc06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04efede700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04e8071a90 0x7f04e8097620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45fa7fc700 1 --2- 172.21.15.81:0/3598302697 >> v2:172.21.15.81:3300/0 conn(0x7f45fc071290 0x7f45fc0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45faffd700 1 -- 172.21.15.81:0/3598302697 >> v2:172.21.15.81:3300/0 conn(0x7f45fc071290 msgr2=0x7f45fc0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45faffd700 1 --2- 172.21.15.81:0/3598302697 >> v2:172.21.15.81:3300/0 conn(0x7f45fc071290 0x7f45fc0cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45faffd700 1 -- 172.21.15.81:0/3598302697 >> v1:172.21.15.81:6789/0 conn(0x7f45fc0cc570 legacy=0x7f45fc069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45faffd700 1 -- 172.21.15.81:0/3598302697 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc072040 con 0x7f45fc1584b0 2023-11-29T11:13:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04efede700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04e8097b60 0x7f04e8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04efede700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e80ceef0 con 0x7f04e80c1af0 2023-11-29T11:13:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04efede700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e8071670 con 0x7f04e8071a90 2023-11-29T11:13:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04efede700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80cf1d0 con 0x7f04e8097b60 2023-11-29T11:13:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f45f9ffb700 1 -- 172.21.15.81:0/3598302697 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250742956 0 0) 0x7f45fc071dd0 con 0x7f45fc0cc570 2023-11-29T11:13:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45faffd700 1 --2- 172.21.15.81:0/3598302697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 0x7f45fc06d650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f45fc06ea30 tx=0x7f45ec00acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce28640442de591c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04edc7a700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f04e80c1af0 0x7f04e80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:59278/0 (socket says 172.21.15.81:59278) 2023-11-29T11:13:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04edc7a700 1 -- 172.21.15.81:0/3066273381 learned_addr learned my addr 172.21.15.81:0/3066273381 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ed479700 1 --2- 172.21.15.81:0/3066273381 >> v2:172.21.15.81:3300/0 conn(0x7f04e8071a90 0x7f04e8097620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ed479700 1 -- 172.21.15.81:0/3066273381 >> v2:172.21.15.176:3300/0 conn(0x7f04e8097b60 msgr2=0x7f04e8069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ed479700 1 --2- 172.21.15.81:0/3066273381 >> v2:172.21.15.176:3300/0 conn(0x7f04e8097b60 0x7f04e8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ed479700 1 -- 172.21.15.81:0/3066273381 >> v1:172.21.15.176:6789/0 conn(0x7f04e80c1af0 legacy=0x7f04e80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45f9ffb700 1 -- 172.21.15.81:0/3598302697 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00cb70 con 0x7f45fc1584b0 2023-11-29T11:13:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45f9ffb700 1 -- 172.21.15.81:0/3598302697 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00ccd0 con 0x7f45fc1584b0 2023-11-29T11:13:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ed479700 1 -- 172.21.15.81:0/3066273381 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8071290 con 0x7f04e8071a90 2023-11-29T11:13:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ed479700 1 --2- 172.21.15.81:0/3066273381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e8071a90 0x7f04e8097620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f04e806e9d0 tx=0x7f04d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6947991c124a945 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ecc78700 1 -- 172.21.15.81:0/3066273381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8004030 con 0x7f04e8071a90 2023-11-29T11:13:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ecc78700 1 -- 172.21.15.81:0/3066273381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d8004190 con 0x7f04e8071a90 2023-11-29T11:13:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.318+0000 7f04ecc78700 1 -- 172.21.15.81:0/3066273381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8004540 con 0x7f04e8071a90 2023-11-29T11:13:18.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45f9ffb700 1 -- 172.21.15.81:0/3598302697 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec018620 con 0x7f45fc1584b0 2023-11-29T11:13:18.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45fbfff700 1 -- 172.21.15.81:0/3598302697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 msgr2=0x7f45fc06d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3598302697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 0x7f45fc06d650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f45fc06ea30 tx=0x7f45ec00acd0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f04efede700 1 -- 172.21.15.81:0/3066273381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e8071a90 msgr2=0x7f04e8097620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45fbfff700 1 -- 172.21.15.81:0/3598302697 shutdown_connections 2023-11-29T11:13:18.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3598302697 >> v2:172.21.15.81:3300/0 conn(0x7f45fc071290 0x7f45fc0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3598302697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 0x7f45fc06d650 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45fbfff700 1 -- 172.21.15.81:0/3598302697 >> 172.21.15.81:0/3598302697 conn(0x7f45fc0b2010 msgr2=0x7f45fc0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f04efede700 1 --2- 172.21.15.81:0/3066273381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e8071a90 0x7f04e8097620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f04e806e9d0 tx=0x7f04d8009b30 comp rx=0 tx=0).stop 2023-11-29T11:13:18.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45fbfff700 1 -- 172.21.15.81:0/3598302697 shutdown_connections 2023-11-29T11:13:18.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f45fbfff700 1 -- 172.21.15.81:0/3598302697 wait complete. 2023-11-29T11:13:18.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f04efede700 1 -- 172.21.15.81:0/3066273381 shutdown_connections 2023-11-29T11:13:18.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f04efede700 1 --2- 172.21.15.81:0/3066273381 >> v2:172.21.15.176:3300/0 conn(0x7f04e8097b60 0x7f04e8069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f04efede700 1 --2- 172.21.15.81:0/3066273381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e8071a90 0x7f04e8097620 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f04efede700 1 -- 172.21.15.81:0/3066273381 >> 172.21.15.81:0/3066273381 conn(0x7f04e80b2010 msgr2=0x7f04e80ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f04efede700 1 -- 172.21.15.81:0/3066273381 shutdown_connections 2023-11-29T11:13:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.322+0000 7f04efede700 1 -- 172.21.15.81:0/3066273381 wait complete. 2023-11-29T11:13:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fbfff700 1 Processor -- start 2023-11-29T11:13:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fbfff700 1 -- start start 2023-11-29T11:13:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc071290 0x7f45fc0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc071290 0x7f45fc0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc071290 0x7f45fc0c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45048/0 (socket says 172.21.15.81:45048) 2023-11-29T11:13:18.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 -- 172.21.15.81:0/3505244939 learned_addr learned my addr 172.21.15.81:0/3505244939 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45fc0cc570 0x7f45fc1e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 0x7f45fc1e2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04efede700 1 Processor -- start 2023-11-29T11:13:18.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04efede700 1 -- start start 2023-11-29T11:13:18.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0c4d00 con 0x7f45fc071290 2023-11-29T11:13:18.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc1e29b0 con 0x7f45fc1584b0 2023-11-29T11:13:18.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc1e2c90 con 0x7f45fc0cc570 2023-11-29T11:13:18.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45fb7fe700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 0x7f45fc1e2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04efede700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04e8071a90 0x7f04e80c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04efede700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04e8097b60 0x7f04e80af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04efede700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e80c1af0 0x7f04e80c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04efede700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c7c20 con 0x7f04e80c1af0 2023-11-29T11:13:18.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04efede700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c5530 con 0x7f04e8097b60 2023-11-29T11:13:18.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04efede700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c7e10 con 0x7f04e8071a90 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e80c1af0 0x7f04e80c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e80c1af0 0x7f04e80c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45064/0 (socket says 172.21.15.81:45064) 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 -- 172.21.15.81:0/1323861708 learned_addr learned my addr 172.21.15.81:0/1323861708 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ed479700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04e8097b60 0x7f04e80af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04edc7a700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04e8071a90 0x7f04e80c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 -- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45fc0cc570 msgr2=0x7f45fc1e1e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45fc0cc570 0x7f45fc1e1e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 -- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 msgr2=0x7f45fc1e2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 0x7f45fc1e2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 -- 172.21.15.81:0/3505244939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec00a650 con 0x7f45fc071290 2023-11-29T11:13:18.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 -- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04e8071a90 msgr2=0x7f04e80c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04e8071a90 0x7f04e80c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 -- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04e8097b60 msgr2=0x7f04e80af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04e8097b60 0x7f04e80af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 -- 172.21.15.81:0/1323861708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80094b0 con 0x7f04e80c1af0 2023-11-29T11:13:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04edc7a700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04e8071a90 0x7f04e80c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04ee47b700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e80c1af0 0x7f04e80c76e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04e400b4d0 tx=0x7f04e400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f45faffd700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc071290 0x7f45fc0c7970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45fc06f880 tx=0x7f45ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.326+0000 7f04de7fc700 1 -- 172.21.15.81:0/1323861708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4011830 con 0x7f04e80c1af0 2023-11-29T11:13:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f45e37fe700 1 -- 172.21.15.81:0/3505244939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec01cc20 con 0x7f45fc071290 2023-11-29T11:13:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f04efede700 1 -- 172.21.15.81:0/1323861708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e8072070 con 0x7f04e80c1af0 2023-11-29T11:13:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f04efede700 1 -- 172.21.15.81:0/1323861708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e8071ee0 con 0x7f04e80c1af0 2023-11-29T11:13:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f04de7fc700 1 -- 172.21.15.81:0/1323861708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e4011990 con 0x7f04e80c1af0 2023-11-29T11:13:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f04de7fc700 1 -- 172.21.15.81:0/1323861708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4011d40 con 0x7f04e80c1af0 2023-11-29T11:13:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc06fa20 con 0x7f45fc071290 2023-11-29T11:13:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f04de7fc700 1 -- 172.21.15.81:0/1323861708 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f04e400f050 con 0x7f04e80c1af0 2023-11-29T11:13:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f04de7fc700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04d4065180 0x7f04d4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f04de7fc700 1 -- 172.21.15.81:0/1323861708 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f04e4081d00 con 0x7f04e80c1af0 2023-11-29T11:13:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc071aa0 con 0x7f45fc071290 2023-11-29T11:13:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f45e37fe700 1 -- 172.21.15.81:0/3505244939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec01cda0 con 0x7f45fc071290 2023-11-29T11:13:18.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.330+0000 7f04edc7a700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04d4065180 0x7f04d4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f04edc7a700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04d4065180 0x7f04d4067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f04e0002130 tx=0x7f04e000f040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f45e37fe700 1 -- 172.21.15.81:0/3505244939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec003900 con 0x7f45fc071290 2023-11-29T11:13:18.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc005310 con 0x7f45fc071290 2023-11-29T11:13:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f04efede700 1 -- 172.21.15.81:0/1323861708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc005310 con 0x7f04e80c1af0 2023-11-29T11:13:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f45e37fe700 1 -- 172.21.15.81:0/3505244939 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f45ec00e040 con 0x7f45fc071290 2023-11-29T11:13:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f45e37fe700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f45e4065130 0x7f45e40675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f45e37fe700 1 -- 172.21.15.81:0/3505244939 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45ec087c80 con 0x7f45fc071290 2023-11-29T11:13:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f45fa7fc700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f45e4065130 0x7f45e40675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.334+0000 7f45fa7fc700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f45e4065130 0x7f45e40675e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0ce8c0 tx=0x7f45f0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.342+0000 7f45e37fe700 1 -- 172.21.15.81:0/3505244939 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f45ec08e080 con 0x7f45fc071290 2023-11-29T11:13:18.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.346+0000 7f04de7fc700 1 -- 172.21.15.81:0/1323861708 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f04e404fb40 con 0x7f04e80c1af0 2023-11-29T11:13:18.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.366+0000 7fa5fcd10700 1 Processor -- start 2023-11-29T11:13:18.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.366+0000 7fa5fcd10700 1 -- start start 2023-11-29T11:13:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.366+0000 7fa5fcd10700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5f80ada60 0x7fa5f80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.366+0000 7fa5fcd10700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f80715c0 con 0x7fa5f80c1ac0 2023-11-29T11:13:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.366+0000 7fa5fcd10700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f806bce0 con 0x7fa5f806b420 2023-11-29T11:13:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.366+0000 7fa5fcd10700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f80cbd40 con 0x7fa5f80ada60 2023-11-29T11:13:18.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.366+0000 7fabc9e8d700 1 Processor -- start 2023-11-29T11:13:18.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5f80ada60 0x7fa5f80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f6ffd700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa5f806b420 0x7fa5f80c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:59294/0 (socket says 172.21.15.81:59294) 2023-11-29T11:13:18.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f6ffd700 1 -- 172.21.15.81:0/2414844892 learned_addr learned my addr 172.21.15.81:0/2414844892 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.366+0000 7fabc9e8d700 1 -- start start 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabc4158070 0x7fabc406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 0x7fabc40ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc4158440 con 0x7fabc406adf0 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc406a960 con 0x7fabc4158070 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc406ceb0 con 0x7fabc406e000 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc8e8b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabc4158070 0x7fabc406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc8e8b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabc4158070 0x7fabc406c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45084/0 (socket says 172.21.15.81:45084) 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc8e8b700 1 -- 172.21.15.81:0/2891117504 learned_addr learned my addr 172.21.15.81:0/2891117504 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f67fc700 1 -- 172.21.15.81:0/2414844892 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759286215 0 0) 0x7fa5f806bce0 con 0x7fa5f806b420 2023-11-29T11:13:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f67fc700 1 -- 172.21.15.81:0/2414844892 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e00035d0 con 0x7fa5f806b420 2023-11-29T11:13:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f77fe700 1 -- 172.21.15.81:0/2414844892 >> v1:172.21.15.176:6789/0 conn(0x7fa5f806b420 legacy=0x7fa5f80c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f77fe700 1 -- 172.21.15.81:0/2414844892 >> v1:172.21.15.81:6789/0 conn(0x7fa5f80c1ac0 legacy=0x7fa5f806c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f77fe700 1 -- 172.21.15.81:0/2414844892 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8071810 con 0x7fa5f80ada60 2023-11-29T11:13:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc8e8b700 1 -- 172.21.15.81:0/2891117504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 msgr2=0x7fabc40ad510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:13:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc3fff700 1 --2- 172.21.15.81:0/2891117504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 0x7fabc40ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f77fe700 1 --2- 172.21.15.81:0/2414844892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80ada60 0x7fa5f80cb800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009850 tx=0x7fa5ec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8062fbb9c7048a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc8e8b700 1 --2- 172.21.15.81:0/2891117504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 0x7fabc40ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc8e8b700 1 -- 172.21.15.81:0/2891117504 >> v1:172.21.15.81:6789/0 conn(0x7fabc406adf0 legacy=0x7fabc40cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc8e8b700 1 -- 172.21.15.81:0/2891117504 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc406d190 con 0x7fabc4158070 2023-11-29T11:13:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c03fff700 1 Processor -- start 2023-11-29T11:13:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc8e8b700 1 --2- 172.21.15.81:0/2891117504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 0x7fabc406c8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009e50 tx=0x7fabbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e61c9c832bb118 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc37fe700 1 -- 172.21.15.81:0/2891117504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00e070 con 0x7fabc4158070 2023-11-29T11:13:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc37fe700 1 -- 172.21.15.81:0/2891117504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00b9c0 con 0x7fabc4158070 2023-11-29T11:13:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc37fe700 1 -- 172.21.15.81:0/2891117504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00bd70 con 0x7fabc4158070 2023-11-29T11:13:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c03fff700 1 -- start start 2023-11-29T11:13:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c03fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c0406f7c0 0x7f1c040cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c03fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1c04071ca0 0x7f1c040cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c03fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0406c6c0 con 0x7f1c040ceaf0 2023-11-29T11:13:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c03fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c04072240 con 0x7f1c0406f7c0 2023-11-29T11:13:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c03fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0406c8f0 con 0x7f1c04071ca0 2023-11-29T11:13:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f67fc700 1 -- 172.21.15.81:0/2414844892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec004230 con 0x7fa5f80ada60 2023-11-29T11:13:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f67fc700 1 -- 172.21.15.81:0/2414844892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec004390 con 0x7fa5f80ada60 2023-11-29T11:13:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5f67fc700 1 -- 172.21.15.81:0/2414844892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0036c0 con 0x7fa5f80ada60 2023-11-29T11:13:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2414844892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80ada60 msgr2=0x7fa5f80cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5fcd10700 1 --2- 172.21.15.81:0/2414844892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80ada60 0x7fa5f80cb800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009850 tx=0x7fa5ec009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 -- 172.21.15.81:0/2891117504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 msgr2=0x7fabc406c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/2891117504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 0x7fabc406c8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009e50 tx=0x7fabbc00b330 comp rx=0 tx=0).stop 2023-11-29T11:13:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c027fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c0406f7c0 0x7f1c040cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c027fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c0406f7c0 0x7f1c040cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45092/0 (socket says 172.21.15.81:45092) 2023-11-29T11:13:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c027fc700 1 -- 172.21.15.81:0/1120336317 learned_addr learned my addr 172.21.15.81:0/1120336317 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2414844892 shutdown_connections 2023-11-29T11:13:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5fcd10700 1 --2- 172.21.15.81:0/2414844892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80ada60 0x7fa5f80cb800 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2414844892 >> 172.21.15.81:0/2414844892 conn(0x7fa5f80b1f90 msgr2=0x7fa5f80ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 -- 172.21.15.81:0/2891117504 shutdown_connections 2023-11-29T11:13:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/2891117504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 0x7fabc40ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/2891117504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 0x7fabc406c8d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 -- 172.21.15.81:0/2891117504 >> 172.21.15.81:0/2891117504 conn(0x7fabc40ce3e0 msgr2=0x7fabc40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 -- 172.21.15.81:0/2891117504 shutdown_connections 2023-11-29T11:13:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c037fe700 1 --2- 172.21.15.81:0/1120336317 >> v2:172.21.15.176:3300/0 conn(0x7f1c04071ca0 0x7f1c040cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2414844892 shutdown_connections 2023-11-29T11:13:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fabc9e8d700 1 -- 172.21.15.81:0/2891117504 wait complete. 2023-11-29T11:13:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c027fc700 1 -- 172.21.15.81:0/1120336317 >> v2:172.21.15.176:3300/0 conn(0x7f1c04071ca0 msgr2=0x7f1c040cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c027fc700 1 --2- 172.21.15.81:0/1120336317 >> v2:172.21.15.176:3300/0 conn(0x7f1c04071ca0 0x7f1c040cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c027fc700 1 -- 172.21.15.81:0/1120336317 >> v1:172.21.15.176:6789/0 conn(0x7f1c040ceaf0 legacy=0x7f1c0406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2414844892 wait complete. 2023-11-29T11:13:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c027fc700 1 -- 172.21.15.81:0/1120336317 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0406cbd0 con 0x7f1c0406f7c0 2023-11-29T11:13:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.370+0000 7f1c037fe700 1 --2- 172.21.15.81:0/1120336317 >> v2:172.21.15.176:3300/0 conn(0x7f1c04071ca0 0x7f1c040cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c027fc700 1 --2- 172.21.15.81:0/1120336317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0406f7c0 0x7f1c040cb340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1c041589c0 tx=0x7f1bf800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ed493e1114a898 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc9e8d700 1 Processor -- start 2023-11-29T11:13:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc9e8d700 1 -- start start 2023-11-29T11:13:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5fcd10700 1 Processor -- start 2023-11-29T11:13:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5fcd10700 1 -- start start 2023-11-29T11:13:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c01ffb700 1 -- 172.21.15.81:0/1120336317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800dbd0 con 0x7f1c0406f7c0 2023-11-29T11:13:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c01ffb700 1 -- 172.21.15.81:0/1120336317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800dd30 con 0x7f1c0406f7c0 2023-11-29T11:13:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c01ffb700 1 -- 172.21.15.81:0/1120336317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800dea0 con 0x7f1c0406f7c0 2023-11-29T11:13:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c03fff700 1 -- 172.21.15.81:0/1120336317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0406f7c0 msgr2=0x7f1c040cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c03fff700 1 --2- 172.21.15.81:0/1120336317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0406f7c0 0x7f1c040cb340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1c041589c0 tx=0x7f1bf800bea0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff048f9d700 1 Processor -- start 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff048f9d700 1 -- start start 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff048f9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff03c0dd140 0x7ff03c050620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff048f9d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c052ab0 con 0x7ff03c036d40 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff048f9d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c052780 con 0x7ff03c0dfa30 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff048f9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03c0dd510 con 0x7ff03c0dd140 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c03fff700 1 -- 172.21.15.81:0/1120336317 shutdown_connections 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c03fff700 1 --2- 172.21.15.81:0/1120336317 >> v2:172.21.15.176:3300/0 conn(0x7f1c04071ca0 0x7f1c040cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c03fff700 1 --2- 172.21.15.81:0/1120336317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0406f7c0 0x7f1c040cb340 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1c041589c0 tx=0x7f1bf800bea0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c03fff700 1 -- 172.21.15.81:0/1120336317 >> 172.21.15.81:0/1120336317 conn(0x7f1c040b1f90 msgr2=0x7f1c040ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c03fff700 1 -- 172.21.15.81:0/1120336317 shutdown_connections 2023-11-29T11:13:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7f1c03fff700 1 -- 172.21.15.81:0/1120336317 wait complete. 2023-11-29T11:13:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff042d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff03c036d40 0x7ff03c052f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43044/0 (socket says 172.21.15.81:43044) 2023-11-29T11:13:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff042d9d700 1 -- 172.21.15.81:0/3352399215 learned_addr learned my addr 172.21.15.81:0/3352399215 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff04259c700 1 --2- 172.21.15.81:0/3352399215 >> v2:172.21.15.81:3300/0 conn(0x7ff03c0dd140 0x7ff03c050620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5fcd10700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f806b420 0x7fa5f8156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5fcd10700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80c1ac0 0x7fa5f815ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5fcd10700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f815f250 0x7fa5f80ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5fcd10700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81f6fa0 con 0x7fa5f80c1ac0 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5fcd10700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8156b70 con 0x7fa5f815f250 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5fcd10700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f815dd20 con 0x7fa5f806b420 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80c1ac0 0x7fa5f815ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80c1ac0 0x7fa5f815ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45110/0 (socket says 172.21.15.81:45110) 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f6ffd700 1 -- 172.21.15.81:0/2489963436 learned_addr learned my addr 172.21.15.81:0/2489963436 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc9e8d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabc406adf0 0x7fabc40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc9e8d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 0x7fabc40979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc9e8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 0x7fabc40c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc9e8d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40c7ed0 con 0x7fabc4158070 2023-11-29T11:13:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc9e8d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4097f00 con 0x7fabc406adf0 2023-11-29T11:13:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc9e8d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40c5a60 con 0x7fabc406e000 2023-11-29T11:13:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f77fe700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f806b420 0x7fa5f8156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f7fff700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f815f250 0x7fa5f80ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 0x7fabc40979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabc406adf0 0x7fabc40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabc406adf0 0x7fabc40c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:37234/0 (socket says 172.21.15.81:37234) 2023-11-29T11:13:18.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 -- 172.21.15.81:0/3296700415 learned_addr learned my addr 172.21.15.81:0/3296700415 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff04159a700 1 -- 172.21.15.81:0/3352399215 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082085026 0 0) 0x7ff03c052780 con 0x7ff03c0dfa30 2023-11-29T11:13:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff04259c700 1 -- 172.21.15.81:0/3352399215 >> v1:172.21.15.176:6789/0 conn(0x7ff03c0dfa30 legacy=0x7ff03c036630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff04259c700 1 -- 172.21.15.81:0/3352399215 >> v1:172.21.15.81:6789/0 conn(0x7ff03c036d40 legacy=0x7ff03c052f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff04259c700 1 -- 172.21.15.81:0/3352399215 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c0e02f0 con 0x7ff03c0dd140 2023-11-29T11:13:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc968c700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 0x7fabc40c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 -- 172.21.15.81:0/3296700415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 msgr2=0x7fabc40979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 0x7fabc40979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 -- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 msgr2=0x7fabc40c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 0x7fabc40c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 -- 172.21.15.81:0/3296700415 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc009b30 con 0x7fabc406adf0 2023-11-29T11:13:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc968c700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 0x7fabc40c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f77fe700 1 -- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f815f250 msgr2=0x7fa5f80ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f77fe700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f815f250 0x7fa5f80ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f77fe700 1 -- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80c1ac0 msgr2=0x7fa5f815ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f77fe700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80c1ac0 0x7fa5f815ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f77fe700 1 -- 172.21.15.81:0/2489963436 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0094b0 con 0x7fa5f806b420 2023-11-29T11:13:18.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff04259c700 1 --2- 172.21.15.81:0/3352399215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0dd140 0x7ff03c050620 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff034009850 tx=0x7ff034009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d847af0b335f121 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fa5f77fe700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f806b420 0x7fa5f8156630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec015000 tx=0x7fa5ec004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7fabc8e8b700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabc406adf0 0x7fabc40c7990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fabc406f6f0 tx=0x7fabbc004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.374+0000 7ff04159a700 1 -- 172.21.15.81:0/3352399215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034011830 con 0x7ff03c0dd140 2023-11-29T11:13:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff04159a700 1 -- 172.21.15.81:0/3352399215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034011990 con 0x7ff03c0dd140 2023-11-29T11:13:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff04159a700 1 -- 172.21.15.81:0/3352399215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034011d20 con 0x7ff03c0dd140 2023-11-29T11:13:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 Processor -- start 2023-11-29T11:13:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 -- start start 2023-11-29T11:13:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fabc17fa700 1 -- 172.21.15.81:0/3296700415 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc004250 con 0x7fabc406adf0 2023-11-29T11:13:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc406a5f0 con 0x7fabc406adf0 2023-11-29T11:13:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc406d470 con 0x7fabc406adf0 2023-11-29T11:13:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff048f9d700 1 -- 172.21.15.81:0/3352399215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0dd140 msgr2=0x7ff03c050620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff048f9d700 1 --2- 172.21.15.81:0/3352399215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0dd140 0x7ff03c050620 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff034009850 tx=0x7ff034009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fa5dffff700 1 -- 172.21.15.81:0/2489963436 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec006ea0 con 0x7fa5f806b420 2023-11-29T11:13:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f8071dd0 con 0x7fa5f806b420 2023-11-29T11:13:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f8071af0 con 0x7fa5f806b420 2023-11-29T11:13:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c04071ca0 0x7f1c041f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c040ceaf0 0x7f1c04098260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c04156ec0 0x7f1c04099f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415a350 con 0x7f1c04156ec0 2023-11-29T11:13:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415a630 con 0x7f1c04071ca0 2023-11-29T11:13:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415a910 con 0x7f1c040ceaf0 2023-11-29T11:13:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c04156ec0 0x7f1c04099f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fabc17fa700 1 -- 172.21.15.81:0/3296700415 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc0043b0 con 0x7fabc406adf0 2023-11-29T11:13:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fabc17fa700 1 -- 172.21.15.81:0/3296700415 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc004760 con 0x7fabc406adf0 2023-11-29T11:13:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff048f9d700 1 -- 172.21.15.81:0/3352399215 shutdown_connections 2023-11-29T11:13:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff048f9d700 1 --2- 172.21.15.81:0/3352399215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0dd140 0x7ff03c050620 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff034009850 tx=0x7ff034009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff048f9d700 1 -- 172.21.15.81:0/3352399215 >> 172.21.15.81:0/3352399215 conn(0x7ff03c051630 msgr2=0x7ff03c051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c04156ec0 0x7f1c04099f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45124/0 (socket says 172.21.15.81:45124) 2023-11-29T11:13:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 -- 172.21.15.81:0/3091307112 learned_addr learned my addr 172.21.15.81:0/3091307112 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 -- 172.21.15.81:0/3091307112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c040ceaf0 msgr2=0x7f1c04098260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c040ceaf0 0x7f1c04098260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 -- 172.21.15.81:0/3091307112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c04071ca0 msgr2=0x7f1c041f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c04071ca0 0x7f1c041f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 -- 172.21.15.81:0/3091307112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf800b820 con 0x7f1c04156ec0 2023-11-29T11:13:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c037fe700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c04156ec0 0x7f1c04099f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc007e70 tx=0x7f1bfc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fa5dffff700 1 -- 172.21.15.81:0/2489963436 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0045d0 con 0x7fa5f806b420 2023-11-29T11:13:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fa5dffff700 1 -- 172.21.15.81:0/2489963436 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec011a30 con 0x7fa5f806b420 2023-11-29T11:13:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff048f9d700 1 -- 172.21.15.81:0/3352399215 shutdown_connections 2023-11-29T11:13:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d8005310 con 0x7fa5f806b420 2023-11-29T11:13:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7ff048f9d700 1 -- 172.21.15.81:0/3352399215 wait complete. 2023-11-29T11:13:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1beb7fe700 1 -- 172.21.15.81:0/3091307112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00de40 con 0x7f1c04156ec0 2023-11-29T11:13:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f3d584ef700 1 Processor -- start 2023-11-29T11:13:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1beb7fe700 1 -- 172.21.15.81:0/3091307112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00f040 con 0x7f1c04156ec0 2023-11-29T11:13:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1beb7fe700 1 -- 172.21.15.81:0/3091307112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc003c80 con 0x7f1c04156ec0 2023-11-29T11:13:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f3d584ef700 1 -- start start 2023-11-29T11:13:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0406d190 con 0x7f1c04156ec0 2023-11-29T11:13:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba4005310 con 0x7fabc406adf0 2023-11-29T11:13:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0406ceb0 con 0x7f1c04156ec0 2023-11-29T11:13:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f3d584ef700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3d50158420 0x7f3d5006a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f3d584ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d500ad5c0 0x7f3d5006b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f3d584ef700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d500cdc10 con 0x7f3d500b3360 2023-11-29T11:13:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f3d584ef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5006a2f0 con 0x7f3d500ad5c0 2023-11-29T11:13:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.378+0000 7f3d584ef700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d50069ce0 con 0x7f3d50158420 2023-11-29T11:13:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55a8a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d500ad5c0 0x7f3d5006b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff048f9d700 1 Processor -- start 2023-11-29T11:13:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55a8a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d500ad5c0 0x7f3d5006b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45128/0 (socket says 172.21.15.81:45128) 2023-11-29T11:13:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55a8a700 1 -- 172.21.15.81:0/3029013243 learned_addr learned my addr 172.21.15.81:0/3029013243 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fabc17fa700 1 -- 172.21.15.81:0/3296700415 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fabbc02b070 con 0x7fabc406adf0 2023-11-29T11:13:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d5628b700 1 --2- 172.21.15.81:0/3029013243 >> v2:172.21.15.176:3300/0 conn(0x7f3d50158420 0x7f3d5006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55a8a700 1 -- 172.21.15.81:0/3029013243 >> v2:172.21.15.176:3300/0 conn(0x7f3d50158420 msgr2=0x7f3d5006a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55a8a700 1 --2- 172.21.15.81:0/3029013243 >> v2:172.21.15.176:3300/0 conn(0x7f3d50158420 0x7f3d5006a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55a8a700 1 -- 172.21.15.81:0/3029013243 >> v1:172.21.15.81:6789/0 conn(0x7f3d500b3360 legacy=0x7f3d5006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55a8a700 1 -- 172.21.15.81:0/3029013243 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500cde60 con 0x7f3d500ad5c0 2023-11-29T11:13:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fabc17fa700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabb0064ee0 0x7fabb0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fabc17fa700 1 -- 172.21.15.81:0/3296700415 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabbc083e10 con 0x7fabc406adf0 2023-11-29T11:13:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55a8a700 1 --2- 172.21.15.81:0/3029013243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500ad5c0 0x7f3d5006b040 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d500ce3c0 tx=0x7f3d4000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b472b8cf5dbe60c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f1beb7fe700 1 -- 172.21.15.81:0/3091307112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1bfc01c030 con 0x7f1c04156ec0 2023-11-29T11:13:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff048f9d700 1 -- start start 2023-11-29T11:13:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff048f9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c036d40 0x7ff03c1748c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fa5dffff700 1 -- 172.21.15.81:0/2489963436 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa5ec017020 con 0x7fa5f806b420 2023-11-29T11:13:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fa5dffff700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa5e4064f10 0x7fa5e40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fa5f6ffd700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa5e4064f10 0x7fa5e40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55289700 1 -- 172.21.15.81:0/3029013243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000dbf0 con 0x7f3d500ad5c0 2023-11-29T11:13:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55289700 1 -- 172.21.15.81:0/3029013243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4000dd50 con 0x7f3d500ad5c0 2023-11-29T11:13:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d55289700 1 -- 172.21.15.81:0/3029013243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40004250 con 0x7f3d500ad5c0 2023-11-29T11:13:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d584ef700 1 -- 172.21.15.81:0/3029013243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500ad5c0 msgr2=0x7f3d5006b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f3d584ef700 1 --2- 172.21.15.81:0/3029013243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500ad5c0 0x7f3d5006b040 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d500ce3c0 tx=0x7f3d4000bea0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fabc3fff700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabb0064ee0 0x7fabb0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fabc3fff700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabb0064ee0 0x7fabb0067390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fabc409c350 tx=0x7fabb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff048f9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03c0dfa30 0x7ff03c175000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff048f9d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff03c04e700 0x7ff03c0e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff048f9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c04bc80 con 0x7ff03c036d40 2023-11-29T11:13:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff048f9d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c174e00 con 0x7ff03c04e700 2023-11-29T11:13:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff048f9d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c0d6000 con 0x7ff03c0dfa30 2023-11-29T11:13:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c036d40 0x7ff03c1748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c036d40 0x7ff03c1748c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45138/0 (socket says 172.21.15.81:45138) 2023-11-29T11:13:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 -- 172.21.15.81:0/999097075 learned_addr learned my addr 172.21.15.81:0/999097075 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff042d9d700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff03c04e700 0x7ff03c0e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff041d9b700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03c0dfa30 0x7ff03c175000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fa5f6ffd700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa5e4064f10 0x7fa5e40673c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0001d50 tx=0x7fa5f0001ce0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f1beb7fe700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bf0064f60 0x7f1bf0067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 -- 172.21.15.81:0/999097075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03c0dfa30 msgr2=0x7ff03c175000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03c0dfa30 0x7ff03c175000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 -- 172.21.15.81:0/999097075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff03c04e700 msgr2=0x7ff03c0e20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff03c04e700 0x7ff03c0e20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 -- 172.21.15.81:0/999097075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0340094b0 con 0x7ff03c036d40 2023-11-29T11:13:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7fa5dffff700 1 -- 172.21.15.81:0/2489963436 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa5ec083db0 con 0x7fa5f806b420 2023-11-29T11:13:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f1beb7fe700 1 -- 172.21.15.81:0/3091307112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1bfc082250 con 0x7f1c04156ec0 2023-11-29T11:13:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7ff04259c700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c036d40 0x7ff03c1748c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff034013000 tx=0x7ff034004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f1c02ffd700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bf0064f60 0x7f1bf0067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.382+0000 7f1c02ffd700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bf0064f60 0x7f1bf0067410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4003e30 tx=0x7f1bf4007a60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 -- 172.21.15.81:0/3029013243 shutdown_connections 2023-11-29T11:13:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 --2- 172.21.15.81:0/3029013243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500ad5c0 0x7f3d5006b040 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 --2- 172.21.15.81:0/3029013243 >> v2:172.21.15.176:3300/0 conn(0x7f3d50158420 0x7f3d5006a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 -- 172.21.15.81:0/3029013243 >> 172.21.15.81:0/3029013243 conn(0x7f3d500ce460 msgr2=0x7f3d500ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c04069e40 con 0x7f1c04156ec0 2023-11-29T11:13:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 -- 172.21.15.81:0/3029013243 shutdown_connections 2023-11-29T11:13:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 -- 172.21.15.81:0/3029013243 wait complete. 2023-11-29T11:13:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 Processor -- start 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 -- start start 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d500ad5c0 0x7f3d500972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500b3360 0x7f3d500ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d50158420 0x7f3d500addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500beee0 con 0x7f3d500b3360 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500b0a80 con 0x7f3d500ad5c0 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d584ef700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500afe70 con 0x7f3d50158420 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500b3360 0x7f3d500ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500b3360 0x7f3d500ab4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45144/0 (socket says 172.21.15.81:45144) 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 -- 172.21.15.81:0/1930215929 learned_addr learned my addr 172.21.15.81:0/1930215929 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d5628b700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d500ad5c0 0x7f3d500972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 -- 172.21.15.81:0/1930215929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d50158420 msgr2=0x7f3d500addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d50158420 0x7f3d500addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 -- 172.21.15.81:0/1930215929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d500ad5c0 msgr2=0x7f3d500972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d500ad5c0 0x7f3d500972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 -- 172.21.15.81:0/1930215929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4000b820 con 0x7f3d500b3360 2023-11-29T11:13:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.386+0000 7f3d55a8a700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500b3360 0x7f3d500ab4e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d40019040 tx=0x7f3d40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff032ffd700 1 -- 172.21.15.81:0/999097075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340036c0 con 0x7ff03c036d40 2023-11-29T11:13:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff032ffd700 1 -- 172.21.15.81:0/999097075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03401f070 con 0x7ff03c036d40 2023-11-29T11:13:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c0e08b0 con 0x7ff03c036d40 2023-11-29T11:13:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff032ffd700 1 -- 172.21.15.81:0/999097075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034003a60 con 0x7ff03c036d40 2023-11-29T11:13:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c0e05d0 con 0x7ff03c036d40 2023-11-29T11:13:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7f1beb7fe700 1 -- 172.21.15.81:0/3091307112 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1bfc050090 con 0x7f1c04156ec0 2023-11-29T11:13:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7fabc17fa700 1 -- 172.21.15.81:0/3296700415 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fabbc051b50 con 0x7fabc406adf0 2023-11-29T11:13:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c0dfea0 con 0x7ff03c036d40 2023-11-29T11:13:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff032ffd700 1 -- 172.21.15.81:0/999097075 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff03400f050 con 0x7ff03c036d40 2023-11-29T11:13:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff032ffd700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff024064f30 0x7ff0240673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff032ffd700 1 -- 172.21.15.81:0/999097075 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff034021070 con 0x7ff03c036d40 2023-11-29T11:13:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff041d9b700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff024064f30 0x7ff0240673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.390+0000 7ff041d9b700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff024064f30 0x7ff0240673e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff03c053ce0 tx=0x7ff038009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.394+0000 7fa5dffff700 1 -- 172.21.15.81:0/2489963436 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa5ec051bf0 con 0x7fa5f806b420 2023-11-29T11:13:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.394+0000 7ff777fff700 1 Processor -- start 2023-11-29T11:13:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff777fff700 1 -- start start 2023-11-29T11:13:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff032ffd700 1 -- 172.21.15.81:0/999097075 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff034051b60 con 0x7ff03c036d40 2023-11-29T11:13:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7f3d46ffd700 1 -- 172.21.15.81:0/1930215929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40003b40 con 0x7f3d500b3360 2023-11-29T11:13:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7f3d46ffd700 1 -- 172.21.15.81:0/1930215929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40003cc0 con 0x7f3d500b3360 2023-11-29T11:13:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d500ce140 con 0x7f3d500b3360 2023-11-29T11:13:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d50069f80 con 0x7f3d500b3360 2023-11-29T11:13:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7f3d46ffd700 1 -- 172.21.15.81:0/1930215929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40021690 con 0x7f3d500b3360 2023-11-29T11:13:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff777fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff770036e80 0x7ff77003a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff777fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff770054770 0x7ff77003a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff777fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7700060c0 con 0x7ff770052280 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff777fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7700070b0 con 0x7ff770054770 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff777fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77003ab80 con 0x7ff770036e80 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff776ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff770052280 0x7ff770036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43068/0 (socket says 172.21.15.81:43068) 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff776ffd700 1 -- 172.21.15.81:0/4117824995 learned_addr learned my addr 172.21.15.81:0/4117824995 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff7777fe700 1 --2- 172.21.15.81:0/4117824995 >> v2:172.21.15.81:3300/0 conn(0x7ff770054770 0x7ff77003a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff7767fc700 1 --2- 172.21.15.81:0/4117824995 >> v2:172.21.15.176:3300/0 conn(0x7ff770036e80 0x7ff77003a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff7777fe700 1 -- 172.21.15.81:0/4117824995 >> v2:172.21.15.176:3300/0 conn(0x7ff770036e80 msgr2=0x7ff77003a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff7777fe700 1 --2- 172.21.15.81:0/4117824995 >> v2:172.21.15.176:3300/0 conn(0x7ff770036e80 0x7ff77003a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff7777fe700 1 -- 172.21.15.81:0/4117824995 >> v1:172.21.15.81:6789/0 conn(0x7ff770052280 legacy=0x7ff770036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff7777fe700 1 -- 172.21.15.81:0/4117824995 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700ded00 con 0x7ff770054770 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff7777fe700 1 --2- 172.21.15.81:0/4117824995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770054770 0x7ff77003a640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff77802cad0 tx=0x7ff77804e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895fa0bb24e67f82 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff775ffb700 1 -- 172.21.15.81:0/4117824995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7780727d0 con 0x7ff770054770 2023-11-29T11:13:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.398+0000 7ff775ffb700 1 -- 172.21.15.81:0/4117824995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff778072970 con 0x7ff770054770 2023-11-29T11:13:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.402+0000 7ff777fff700 1 -- 172.21.15.81:0/4117824995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770054770 msgr2=0x7ff77003a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.402+0000 7ff777fff700 1 --2- 172.21.15.81:0/4117824995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770054770 0x7ff77003a640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff77802cad0 tx=0x7ff77804e8b0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.402+0000 7f3d46ffd700 1 -- 172.21.15.81:0/1930215929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3d40028020 con 0x7f3d500b3360 2023-11-29T11:13:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.402+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d38005310 con 0x7f3d500b3360 2023-11-29T11:13:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.402+0000 7f3d46ffd700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3d34064f30 0x7f3d340673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.402+0000 7f3d46ffd700 1 -- 172.21.15.81:0/1930215929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3d40086400 con 0x7f3d500b3360 2023-11-29T11:13:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.402+0000 7f3d5628b700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3d34064f30 0x7f3d340673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.402+0000 7f3d5628b700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3d34064f30 0x7f3d340673e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009b80 tx=0x7f3d4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 -- 172.21.15.81:0/4117824995 shutdown_connections 2023-11-29T11:13:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 --2- 172.21.15.81:0/4117824995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770054770 0x7ff77003a640 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 --2- 172.21.15.81:0/4117824995 >> v2:172.21.15.176:3300/0 conn(0x7ff770036e80 0x7ff77003a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 -- 172.21.15.81:0/4117824995 >> 172.21.15.81:0/4117824995 conn(0x7ff770051770 msgr2=0x7ff770051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 -- 172.21.15.81:0/4117824995 shutdown_connections 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 -- 172.21.15.81:0/4117824995 wait complete. 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 Processor -- start 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 -- start start 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff770036e80 0x7ff770047e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770052280 0x7ff7700d6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff770054770 0x7ff7700d7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff770049910 con 0x7ff770052280 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700483b0 con 0x7ff770036e80 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff777fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700d7830 con 0x7ff770054770 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff7767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770052280 0x7ff7700d6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff7767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770052280 0x7ff7700d6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45170/0 (socket says 172.21.15.81:45170) 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.406+0000 7ff7767fc700 1 -- 172.21.15.81:0/729548913 learned_addr learned my addr 172.21.15.81:0/729548913 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.410+0000 7ff7767fc700 1 -- 172.21.15.81:0/729548913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff770054770 msgr2=0x7ff7700d7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.410+0000 7ff7767fc700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff770054770 0x7ff7700d7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.410+0000 7ff7767fc700 1 -- 172.21.15.81:0/729548913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff770036e80 msgr2=0x7ff770047e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.410+0000 7ff7767fc700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff770036e80 0x7ff770047e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.410+0000 7ff7767fc700 1 -- 172.21.15.81:0/729548913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77804e720 con 0x7ff770052280 2023-11-29T11:13:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.410+0000 7ff7767fc700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770052280 0x7ff7700d6d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00e810 tx=0x7ff76c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.410+0000 7f3d46ffd700 1 -- 172.21.15.81:0/1930215929 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3d400542d0 con 0x7f3d500b3360 2023-11-29T11:13:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.414+0000 7ff7677fe700 1 -- 172.21.15.81:0/729548913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c004230 con 0x7ff770052280 2023-11-29T11:13:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.414+0000 7ff7677fe700 1 -- 172.21.15.81:0/729548913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c004390 con 0x7ff770052280 2023-11-29T11:13:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.414+0000 7ff7677fe700 1 -- 172.21.15.81:0/729548913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0036c0 con 0x7ff770052280 2023-11-29T11:13:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.414+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700065d0 con 0x7ff770052280 2023-11-29T11:13:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.414+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700062f0 con 0x7ff770052280 2023-11-29T11:13:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.414+0000 7ff7677fe700 1 -- 172.21.15.81:0/729548913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff76c003840 con 0x7ff770052280 2023-11-29T11:13:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.414+0000 7ff7677fe700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff75c064fb0 0x7ff75c067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.418+0000 7ff7677fe700 1 -- 172.21.15.81:0/729548913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff76c082020 con 0x7ff770052280 2023-11-29T11:13:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.418+0000 7ff776ffd700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff75c064fb0 0x7ff75c067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.418+0000 7ff776ffd700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff75c064fb0 0x7ff75c067460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff768001590 tx=0x7ff7680069e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.422+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7700068b0 con 0x7ff770052280 2023-11-29T11:13:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.430+0000 7ff7677fe700 1 -- 172.21.15.81:0/729548913 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff76c053810 con 0x7ff770052280 2023-11-29T11:13:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.638+0000 7f04efede700 1 -- 172.21.15.81:0/1323861708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f04cc0055c0 con 0x7f04e80c1af0 2023-11-29T11:13:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.638+0000 7f04de7fc700 1 -- 172.21.15.81:0/1323861708 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04e4015020 con 0x7f04e80c1af0 2023-11-29T11:13:18.645 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45dc0055c0 con 0x7f45fc071290 2023-11-29T11:13:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 -- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04d4065180 msgr2=0x7f04d4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f45e37fe700 1 -- 172.21.15.81:0/3505244939 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45ec055b10 con 0x7f45fc071290 2023-11-29T11:13:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04d4065180 0x7f04d4067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f04e0002130 tx=0x7f04e000f040 comp rx=0 tx=0).stop 2023-11-29T11:13:18.648 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 -- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e80c1af0 msgr2=0x7f04e80c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e80c1af0 0x7f04e80c76e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04e400b4d0 tx=0x7f04e400b7e0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 -- 172.21.15.81:0/1323861708 shutdown_connections 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04d4065180 0x7f04d4067630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04e80c1af0 0x7f04e80c76e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04e8097b60 0x7f04e80af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 --2- 172.21.15.81:0/1323861708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04e8071a90 0x7f04e80c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 -- 172.21.15.81:0/1323861708 >> 172.21.15.81:0/1323861708 conn(0x7f04e80b2010 msgr2=0x7f04e80c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 -- 172.21.15.81:0/1323861708 shutdown_connections 2023-11-29T11:13:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.642+0000 7f04cbfff700 1 -- 172.21.15.81:0/1323861708 wait complete. 2023-11-29T11:13:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f45e4065130 msgr2=0x7f45e40675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f45e4065130 0x7f45e40675e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0ce8c0 tx=0x7f45f0008040 comp rx=0 tx=0).stop 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc071290 msgr2=0x7f45fc0c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc071290 0x7f45fc0c7970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45fc06f880 tx=0x7f45ec004770 comp rx=0 tx=0).stop 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 shutdown_connections 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f45e4065130 0x7f45e40675e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45fc1584b0 0x7f45fc1e2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45fc0cc570 0x7f45fc1e1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 --2- 172.21.15.81:0/3505244939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc071290 0x7f45fc0c7970 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 >> 172.21.15.81:0/3505244939 conn(0x7f45fc0b2010 msgr2=0x7f45fc0af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 shutdown_connections 2023-11-29T11:13:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.654+0000 7f45fbfff700 1 -- 172.21.15.81:0/3505244939 wait complete. 2023-11-29T11:13:18.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2023-11-29T11:13:18.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.1 2023-11-29T11:13:18.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faba4005890 con 0x7fabc406adf0 2023-11-29T11:13:18.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc17fa700 1 -- 172.21.15.81:0/3296700415 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabbc01f020 con 0x7fabc406adf0 2023-11-29T11:13:18.681 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabb0064ee0 msgr2=0x7fabb0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabb0064ee0 0x7fabb0067390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fabc409c350 tx=0x7fabb8008040 comp rx=0 tx=0).stop 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabc406adf0 msgr2=0x7fabc40c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabc406adf0 0x7fabc40c7990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fabc406f6f0 tx=0x7fabbc004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 shutdown_connections 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabb0064ee0 0x7fabb0067390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc4158070 0x7fabc40c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabc406e000 0x7fabc40979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 --2- 172.21.15.81:0/3296700415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabc406adf0 0x7fabc40c7990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 >> 172.21.15.81:0/3296700415 conn(0x7fabc40ce3e0 msgr2=0x7fabc4071050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 shutdown_connections 2023-11-29T11:13:18.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.678+0000 7fabc9e8d700 1 -- 172.21.15.81:0/3296700415 wait complete. 2023-11-29T11:13:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c04072500 con 0x7f1c04156ec0 2023-11-29T11:13:18.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.5 2023-11-29T11:13:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1beb7fe700 1 -- 172.21.15.81:0/3091307112 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1bfc01a090 con 0x7f1c04156ec0 2023-11-29T11:13:18.698 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa5d8005890 con 0x7fa5f806b420 2023-11-29T11:13:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7fa5dffff700 1 -- 172.21.15.81:0/2489963436 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5ec01f030 con 0x7fa5f806b420 2023-11-29T11:13:18.699 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bf0064f60 msgr2=0x7f1bf0067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bf0064f60 0x7f1bf0067410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4003e30 tx=0x7f1bf4007a60 comp rx=0 tx=0).stop 2023-11-29T11:13:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c04156ec0 msgr2=0x7f1c04099f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c04156ec0 0x7f1c04099f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc007e70 tx=0x7f1bfc00d3b0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 shutdown_connections 2023-11-29T11:13:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bf0064f60 0x7f1bf0067410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c04156ec0 0x7f1c04099f40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c040ceaf0 0x7f1c04098260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 --2- 172.21.15.81:0/3091307112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c04071ca0 0x7f1c041f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 >> 172.21.15.81:0/3091307112 conn(0x7f1c040b1f90 msgr2=0x7f1c04158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 shutdown_connections 2023-11-29T11:13:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.694+0000 7f1c03fff700 1 -- 172.21.15.81:0/3091307112 wait complete. 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa5e4064f10 msgr2=0x7fa5e40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa5e4064f10 0x7fa5e40673c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0001d50 tx=0x7fa5f0001ce0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f806b420 msgr2=0x7fa5f8156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f806b420 0x7fa5f8156630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec015000 tx=0x7fa5ec004770 comp rx=0 tx=0).stop 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 shutdown_connections 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa5e4064f10 0x7fa5e40673c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f815f250 0x7fa5f80ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80c1ac0 0x7fa5f815ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 --2- 172.21.15.81:0/2489963436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f806b420 0x7fa5f8156630 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 >> 172.21.15.81:0/2489963436 conn(0x7fa5f80b1f90 msgr2=0x7fa5f80c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 shutdown_connections 2023-11-29T11:13:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7fa5fcd10700 1 -- 172.21.15.81:0/2489963436 wait complete. 2023-11-29T11:13:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.698+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff03c0053f0 con 0x7ff03c036d40 2023-11-29T11:13:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff032ffd700 1 -- 172.21.15.81:0/999097075 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff034055180 con 0x7ff03c036d40 2023-11-29T11:13:18.705 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2023-11-29T11:13:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff024064f30 msgr2=0x7ff0240673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff024064f30 0x7ff0240673e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff03c053ce0 tx=0x7ff038009040 comp rx=0 tx=0).stop 2023-11-29T11:13:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c036d40 msgr2=0x7ff03c1748c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c036d40 0x7ff03c1748c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff034013000 tx=0x7ff034004770 comp rx=0 tx=0).stop 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 shutdown_connections 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff024064f30 0x7ff0240673e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff03c04e700 0x7ff03c0e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03c0dfa30 0x7ff03c175000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 --2- 172.21.15.81:0/999097075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c036d40 0x7ff03c1748c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 >> 172.21.15.81:0/999097075 conn(0x7ff03c051630 msgr2=0x7ff03c053f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 shutdown_connections 2023-11-29T11:13:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.702+0000 7ff048f9d700 1 -- 172.21.15.81:0/999097075 wait complete. 2023-11-29T11:13:18.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff770049ae0 con 0x7ff770052280 2023-11-29T11:13:18.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff7677fe700 1 -- 172.21.15.81:0/729548913 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff76c00f040 con 0x7ff770052280 2023-11-29T11:13:18.710 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:18.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d380055c0 con 0x7f3d500b3360 2023-11-29T11:13:18.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7f3d46ffd700 1 -- 172.21.15.81:0/1930215929 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d400578f0 con 0x7f3d500b3360 2023-11-29T11:13:18.711 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:18.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff75c064fb0 msgr2=0x7ff75c067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff75c064fb0 0x7ff75c067460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff768001590 tx=0x7ff7680069e0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770052280 msgr2=0x7ff7700d6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770052280 0x7ff7700d6d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00e810 tx=0x7ff76c00ebd0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 shutdown_connections 2023-11-29T11:13:18.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff75c064fb0 0x7ff75c067460 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff770054770 0x7ff7700d7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770052280 0x7ff7700d6d00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 --2- 172.21.15.81:0/729548913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff770036e80 0x7ff770047e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 >> 172.21.15.81:0/729548913 conn(0x7ff770051770 msgr2=0x7ff7700528a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 shutdown_connections 2023-11-29T11:13:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.706+0000 7ff777fff700 1 -- 172.21.15.81:0/729548913 wait complete. 2023-11-29T11:13:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3d34064f30 msgr2=0x7f3d340673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3d34064f30 0x7f3d340673e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009b80 tx=0x7f3d4c008040 comp rx=0 tx=0).stop 2023-11-29T11:13:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500b3360 msgr2=0x7f3d500ab4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500b3360 0x7f3d500ab4e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d40019040 tx=0x7f3d40004770 comp rx=0 tx=0).stop 2023-11-29T11:13:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 shutdown_connections 2023-11-29T11:13:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3d34064f30 0x7f3d340673e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d50158420 0x7f3d500addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d500b3360 0x7f3d500ab4e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 --2- 172.21.15.81:0/1930215929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d500ad5c0 0x7f3d500972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:18.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 >> 172.21.15.81:0/1930215929 conn(0x7f3d500ce460 msgr2=0x7f3d500ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:18.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 shutdown_connections 2023-11-29T11:13:18.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:18.710+0000 7f3d584ef700 1 -- 172.21.15.81:0/1930215929 wait complete. 2023-11-29T11:13:18.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2023-11-29T11:13:18.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2023-11-29T11:13:18.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.2 2023-11-29T11:13:18.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2023-11-29T11:13:18.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.3 2023-11-29T11:13:19.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-29T11:13:19.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-29T11:13:19.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-29T11:13:19.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-29T11:13:19.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-29T11:13:19.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-29T11:13:19.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-29T11:13:19.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-29T11:13:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ff22700 1 Processor -- start 2023-11-29T11:13:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ff22700 1 -- start start 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ff22700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4088069e50 0x7f40880cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ff22700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f408806c760 0x7f408806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ff22700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408806aaf0 con 0x7f40880cae00 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ff22700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4088071c70 con 0x7f4088069e50 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ff22700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40880721d0 con 0x7f408806c760 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408d4bd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4088069e50 0x7f40880cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408d4bd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4088069e50 0x7f40880cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41444/0 (socket says 172.21.15.81:41444) 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408d4bd700 1 -- 172.21.15.81:0/3858347947 learned_addr learned my addr 172.21.15.81:0/3858347947 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408e4bf700 1 --2- 172.21.15.81:0/3858347947 >> v2:172.21.15.176:3300/0 conn(0x7f408806c760 0x7f408806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408d4bd700 1 -- 172.21.15.81:0/3858347947 >> v2:172.21.15.176:3300/0 conn(0x7f408806c760 msgr2=0x7f408806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408d4bd700 1 --2- 172.21.15.81:0/3858347947 >> v2:172.21.15.176:3300/0 conn(0x7f408806c760 0x7f408806cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408d4bd700 1 -- 172.21.15.81:0/3858347947 >> v1:172.21.15.176:6789/0 conn(0x7f40880cae00 legacy=0x7f40880cb1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-29T11:13:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408d4bd700 1 -- 172.21.15.81:0/3858347947 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40881586d0 con 0x7f4088069e50 2023-11-29T11:13:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408d4bd700 1 --2- 172.21.15.81:0/3858347947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880cefc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f40880afee0 tx=0x7f408400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c420b4bf6e08d33 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ccbc700 1 -- 172.21.15.81:0/3858347947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084010070 con 0x7f4088069e50 2023-11-29T11:13:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.802+0000 7f408ccbc700 1 -- 172.21.15.81:0/3858347947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408400d990 con 0x7f4088069e50 2023-11-29T11:13:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ccbc700 1 -- 172.21.15.81:0/3858347947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400dd00 con 0x7f4088069e50 2023-11-29T11:13:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 -- 172.21.15.81:0/3858347947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 msgr2=0x7f40880cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 --2- 172.21.15.81:0/3858347947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880cefc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f40880afee0 tx=0x7f408400d330 comp rx=0 tx=0).stop 2023-11-29T11:13:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 -- 172.21.15.81:0/3858347947 shutdown_connections 2023-11-29T11:13:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 --2- 172.21.15.81:0/3858347947 >> v2:172.21.15.176:3300/0 conn(0x7f408806c760 0x7f408806cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 --2- 172.21.15.81:0/3858347947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880cefc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 -- 172.21.15.81:0/3858347947 >> 172.21.15.81:0/3858347947 conn(0x7f40880b2010 msgr2=0x7f40880ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:19.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 -- 172.21.15.81:0/3858347947 shutdown_connections 2023-11-29T11:13:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 -- 172.21.15.81:0/3858347947 wait complete. 2023-11-29T11:13:19.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 Processor -- start 2023-11-29T11:13:19.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.806+0000 7f408ff22700 1 -- start start 2023-11-29T11:13:19.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408ff22700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408ff22700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f408806c760 0x7f40880af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408ff22700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880cae00 0x7f40880cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408d4bd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f408806c760 0x7f40880af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41460/0 (socket says 172.21.15.81:41460) 2023-11-29T11:13:19.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408d4bd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f408806c760 0x7f40880af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:50646/0 (socket says 172.21.15.81:50646) 2023-11-29T11:13:19.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 -- 172.21.15.81:0/3411572859 learned_addr learned my addr 172.21.15.81:0/3411572859 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408e4bf700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880cae00 0x7f40880cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408ff22700 1 -- 172.21.15.81:0/3411572859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40880af950 con 0x7f4088069e50 2023-11-29T11:13:19.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408ff22700 1 -- 172.21.15.81:0/3411572859 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40880c3010 con 0x7f408806c760 2023-11-29T11:13:19.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408ff22700 1 -- 172.21.15.81:0/3411572859 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40880c32f0 con 0x7f40880cae00 2023-11-29T11:13:19.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 -- 172.21.15.81:0/3411572859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880cae00 msgr2=0x7f40880cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880cae00 0x7f40880cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 -- 172.21.15.81:0/3411572859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f408806c760 msgr2=0x7f40880af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f408806c760 0x7f40880af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 -- 172.21.15.81:0/3411572859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40840085f0 con 0x7f4088069e50 2023-11-29T11:13:19.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.810+0000 7f408dcbe700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880c2900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f407800b4a0 tx=0x7f407800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.814+0000 7f407e7fc700 1 -- 172.21.15.81:0/3411572859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078011830 con 0x7f4088069e50 2023-11-29T11:13:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.814+0000 7f408ff22700 1 -- 172.21.15.81:0/3411572859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408806a780 con 0x7f4088069e50 2023-11-29T11:13:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.814+0000 7f408ff22700 1 -- 172.21.15.81:0/3411572859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4088071ef0 con 0x7f4088069e50 2023-11-29T11:13:19.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.814+0000 7f408ff22700 1 -- 172.21.15.81:0/3411572859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408806f970 con 0x7f4088069e50 2023-11-29T11:13:19.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.814+0000 7f407e7fc700 1 -- 172.21.15.81:0/3411572859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40780119b0 con 0x7f4088069e50 2023-11-29T11:13:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.818+0000 7f407e7fc700 1 -- 172.21.15.81:0/3411572859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078011d60 con 0x7f4088069e50 2023-11-29T11:13:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.818+0000 7f407e7fc700 1 -- 172.21.15.81:0/3411572859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4078021070 con 0x7f4088069e50 2023-11-29T11:13:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.818+0000 7f407e7fc700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f406c065030 0x7f406c0674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.818+0000 7f408d4bd700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f406c065030 0x7f406c0674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.818+0000 7f407e7fc700 1 -- 172.21.15.81:0/3411572859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4078082080 con 0x7f4088069e50 2023-11-29T11:13:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.818+0000 7f408d4bd700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f406c065030 0x7f406c0674e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f408806a280 tx=0x7f4084012000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.826+0000 7f407e7fc700 1 -- 172.21.15.81:0/3411572859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f407804ff10 con 0x7f4088069e50 2023-11-29T11:13:19.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 Processor -- start 2023-11-29T11:13:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 -- start start 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf540cae00 0x7fdf540cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf54069e50 0x7fdf540cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf540b3400 0x7fdf540b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5406aaf0 con 0x7fdf54069e50 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf54071c70 con 0x7fdf540cae00 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf540721d0 con 0x7fdf540b3400 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf599b3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf54069e50 0x7fdf540cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5a1b4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf540cae00 0x7fdf540cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5a1b4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf540cae00 0x7fdf540cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:50662/0 (socket says 172.21.15.81:50662) 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5a1b4700 1 -- 172.21.15.81:0/1566691273 learned_addr learned my addr 172.21.15.81:0/1566691273 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5a9b5700 1 --2- 172.21.15.81:0/1566691273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf540b3400 0x7fdf540b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf599b3700 1 -- 172.21.15.81:0/1566691273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf540b3400 msgr2=0x7fdf540b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf599b3700 1 --2- 172.21.15.81:0/1566691273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf540b3400 0x7fdf540b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf599b3700 1 -- 172.21.15.81:0/1566691273 >> v2:172.21.15.176:3300/0 conn(0x7fdf540cae00 msgr2=0x7fdf540cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf599b3700 1 --2- 172.21.15.81:0/1566691273 >> v2:172.21.15.176:3300/0 conn(0x7fdf540cae00 0x7fdf540cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf599b3700 1 -- 172.21.15.81:0/1566691273 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf541586d0 con 0x7fdf54069e50 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf599b3700 1 --2- 172.21.15.81:0/1566691273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54069e50 0x7fdf540cb1d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf54070ab0 tx=0x7fdf44009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609d76d581554590 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf591b2700 1 -- 172.21.15.81:0/1566691273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44011830 con 0x7fdf54069e50 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf591b2700 1 -- 172.21.15.81:0/1566691273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf44011990 con 0x7fdf54069e50 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.854+0000 7fdf5c418700 1 -- 172.21.15.81:0/1566691273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54069e50 msgr2=0x7fdf540cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1566691273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54069e50 0x7fdf540cb1d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf54070ab0 tx=0x7fdf44009b30 comp rx=0 tx=0).stop 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 -- 172.21.15.81:0/1566691273 shutdown_connections 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1566691273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf540b3400 0x7fdf540b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1566691273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54069e50 0x7fdf540cb1d0 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdf54070ab0 tx=0x7fdf44009b30 comp rx=0 tx=0).stop 2023-11-29T11:13:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1566691273 >> v2:172.21.15.176:3300/0 conn(0x7fdf540cae00 0x7fdf540cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 -- 172.21.15.81:0/1566691273 >> 172.21.15.81:0/1566691273 conn(0x7fdf540b2010 msgr2=0x7fdf540ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 -- 172.21.15.81:0/1566691273 shutdown_connections 2023-11-29T11:13:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 -- 172.21.15.81:0/1566691273 wait complete. 2023-11-29T11:13:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 Processor -- start 2023-11-29T11:13:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 -- start start 2023-11-29T11:13:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf540b3400 0x7fdf540cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf540cae00 0x7fdf540940f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf54093790 0x7fdf540c0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5414ed40 con 0x7fdf540b3400 2023-11-29T11:13:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf540cd9e0 con 0x7fdf540cae00 2023-11-29T11:13:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5c418700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf540cdcc0 con 0x7fdf54093790 2023-11-29T11:13:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a1b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf540b3400 0x7fdf540cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a1b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf540b3400 0x7fdf540cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41482/0 (socket says 172.21.15.81:41482) 2023-11-29T11:13:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a1b4700 1 -- 172.21.15.81:0/1646255264 learned_addr learned my addr 172.21.15.81:0/1646255264 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a9b5700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf54093790 0x7fdf540c0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a1b4700 1 -- 172.21.15.81:0/1646255264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf54093790 msgr2=0x7fdf540c0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a1b4700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf54093790 0x7fdf540c0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a1b4700 1 -- 172.21.15.81:0/1646255264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf540cae00 msgr2=0x7fdf540940f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a1b4700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf540cae00 0x7fdf540940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.858+0000 7fdf5a1b4700 1 -- 172.21.15.81:0/1646255264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440094b0 con 0x7fdf540b3400 2023-11-29T11:13:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf5a1b4700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf540b3400 0x7fdf540cd190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c008ba0 tx=0x7fdf4c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf4affd700 1 -- 172.21.15.81:0/1646255264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00bd20 con 0x7fdf540b3400 2023-11-29T11:13:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf4affd700 1 -- 172.21.15.81:0/1646255264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c00be90 con 0x7fdf540b3400 2023-11-29T11:13:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf4affd700 1 -- 172.21.15.81:0/1646255264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c003c80 con 0x7fdf540b3400 2023-11-29T11:13:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5406a780 con 0x7fdf540b3400 2023-11-29T11:13:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf54071ef0 con 0x7fdf540b3400 2023-11-29T11:13:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572906700 1 Processor -- start 2023-11-29T11:13:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572906700 1 -- start start 2023-11-29T11:13:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf540cb710 con 0x7fdf540b3400 2023-11-29T11:13:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572906700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0ada60 0x7f856c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572906700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f856c06b420 0x7f856c0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572906700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0715c0 con 0x7f856c0c18f0 2023-11-29T11:13:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572906700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0c1d70 con 0x7f856c06b420 2023-11-29T11:13:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572906700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c06bce0 con 0x7f856c0ada60 2023-11-29T11:13:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fbb7b59e700 1 Processor -- start 2023-11-29T11:13:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fbb7b59e700 1 -- start start 2023-11-29T11:13:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572105700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f856c0c18f0 0x7f856c0b3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53904/0 (socket says 172.21.15.81:53904) 2023-11-29T11:13:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8571904700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0ada60 0x7f856c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8572105700 1 -- 172.21.15.81:0/476278811 learned_addr learned my addr 172.21.15.81:0/476278811 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fa96f28b700 1 Processor -- start 2023-11-29T11:13:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf4affd700 1 -- 172.21.15.81:0/1646255264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdf4c01e020 con 0x7fdf540b3400 2023-11-29T11:13:19.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8571904700 1 -- 172.21.15.81:0/476278811 >> v2:172.21.15.176:3300/0 conn(0x7f856c06b420 msgr2=0x7f856c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8571904700 1 --2- 172.21.15.81:0/476278811 >> v2:172.21.15.176:3300/0 conn(0x7f856c06b420 0x7f856c0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8571904700 1 -- 172.21.15.81:0/476278811 >> v1:172.21.15.81:6789/0 conn(0x7f856c0c18f0 legacy=0x7f856c0b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8571904700 1 -- 172.21.15.81:0/476278811 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0cbd40 con 0x7f856c0ada60 2023-11-29T11:13:19.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf4affd700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdf40065080 0x7fdf40067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fdf4affd700 1 -- 172.21.15.81:0/1646255264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf4c082810 con 0x7fdf540b3400 2023-11-29T11:13:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7f8571904700 1 --2- 172.21.15.81:0/476278811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0ada60 0x7f856c0cb800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f855c009850 tx=0x7f855c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4570e437d76bac5e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fbb7b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb7c0ceec0 0x7fbb7c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c15c840 con 0x7fbb7c15c470 2023-11-29T11:13:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c06c1a0 con 0x7fbb7c06a350 2023-11-29T11:13:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7c0cf340 con 0x7fbb7c0ceec0 2023-11-29T11:13:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8570902700 1 -- 172.21.15.81:0/476278811 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c011830 con 0x7f856c0ada60 2023-11-29T11:13:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fdf599b3700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdf40065080 0x7fdf40067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8570902700 1 -- 172.21.15.81:0/476278811 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c011990 con 0x7f856c0ada60 2023-11-29T11:13:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f6040bb1700 1 Processor -- start 2023-11-29T11:13:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8570902700 1 -- 172.21.15.81:0/476278811 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c011d20 con 0x7f856c0ada60 2023-11-29T11:13:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb79d9b700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fbb7c06a350 0x7fbb7c06c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:35298/0 (socket says 172.21.15.81:35298) 2023-11-29T11:13:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb79d9b700 1 -- 172.21.15.81:0/596226148 learned_addr learned my addr 172.21.15.81:0/596226148 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037700923 0 0) 0x7fbb7c06c1a0 con 0x7fbb7c06a350 2023-11-29T11:13:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb640035d0 con 0x7fbb7c06a350 2023-11-29T11:13:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.862+0000 7fa96f28b700 1 -- start start 2023-11-29T11:13:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96f28b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa96806f7c0 0x7fa96806a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96f28b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 0x7fa96806a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96f28b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96806c6c0 con 0x7fa9680cb340 2023-11-29T11:13:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96f28b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa968072240 con 0x7fa96806f7c0 2023-11-29T11:13:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96f28b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96806c8f0 con 0x7fa968071ca0 2023-11-29T11:13:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96da88700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa96806f7c0 0x7fa96806a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96ea8a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 0x7fa96806a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96da88700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa96806f7c0 0x7fa96806a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:50680/0 (socket says 172.21.15.81:50680) 2023-11-29T11:13:19.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96da88700 1 -- 172.21.15.81:0/413783748 learned_addr learned my addr 172.21.15.81:0/413783748 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 -- 172.21.15.81:0/476278811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0ada60 msgr2=0x7f856c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 --2- 172.21.15.81:0/476278811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0ada60 0x7f856c0cb800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f855c009850 tx=0x7f855c009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:19.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7ad9d700 1 --2- 172.21.15.81:0/596226148 >> v2:172.21.15.176:3300/0 conn(0x7fbb7c0ceec0 0x7fbb7c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 -- 172.21.15.81:0/476278811 shutdown_connections 2023-11-29T11:13:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 --2- 172.21.15.81:0/476278811 >> v2:172.21.15.176:3300/0 conn(0x7f856c06b420 0x7f856c0c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 --2- 172.21.15.81:0/476278811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0ada60 0x7f856c0cb800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f6040bb1700 1 -- start start 2023-11-29T11:13:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f6040bb1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c0cb340 0x7f603c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f6040bb1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f603c06f7c0 0x7f603c06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f6040bb1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c06c6c0 con 0x7f603c071ca0 2023-11-29T11:13:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f6040bb1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c06dbf0 con 0x7f603c06f7c0 2023-11-29T11:13:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f6040bb1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c072240 con 0x7f603c0cb340 2023-11-29T11:13:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 -- 172.21.15.81:0/476278811 >> 172.21.15.81:0/476278811 conn(0x7f856c0b1f90 msgr2=0x7f856c0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 900189777 0 0) 0x7fbb640035d0 con 0x7fbb7c06a350 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 >> v2:172.21.15.176:3300/0 conn(0x7fbb7c0ceec0 msgr2=0x7fbb7c0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 --2- 172.21.15.81:0/596226148 >> v2:172.21.15.176:3300/0 conn(0x7fbb7c0ceec0 0x7fbb7c0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 >> v1:172.21.15.81:6789/0 conn(0x7fbb7c15c470 legacy=0x7fbb7c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0722a0 con 0x7fbb7c06a350 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fbb6c001670 con 0x7fbb7c06a350 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 >> v1:172.21.15.176:6789/0 conn(0x7fbb7c06a350 legacy=0x7fbb7c06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb64003a20 0x7fbb64003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb64004870 0x7fbb64004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb64005220 0x7fbb6400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6400c180 con 0x7fbb64005220 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6400c2f0 con 0x7fbb64003a20 2023-11-29T11:13:19.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6400c4b0 con 0x7fbb64004870 2023-11-29T11:13:19.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f603c06f7c0 0x7f603c06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603bfff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f603c071ca0 0x7f603c0cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:35318/0 (socket says 172.21.15.81:35318) 2023-11-29T11:13:19.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f603c06f7c0 0x7f603c06a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41488/0 (socket says 172.21.15.81:41488) 2023-11-29T11:13:19.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603bfff700 1 -- 172.21.15.81:0/634668455 learned_addr learned my addr 172.21.15.81:0/634668455 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:19.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96da88700 1 -- 172.21.15.81:0/413783748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 msgr2=0x7fa96806a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96da88700 1 --2- 172.21.15.81:0/413783748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 0x7fa96806a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96da88700 1 -- 172.21.15.81:0/413783748 >> v1:172.21.15.176:6789/0 conn(0x7fa9680cb340 legacy=0x7fa96806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96da88700 1 -- 172.21.15.81:0/413783748 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96806cbd0 con 0x7fa96806f7c0 2023-11-29T11:13:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603b7fe700 1 --2- 172.21.15.81:0/634668455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c0cb340 0x7f603c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 -- 172.21.15.81:0/476278811 shutdown_connections 2023-11-29T11:13:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7ad9d700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb64005220 0x7fbb6400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb79d9b700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb64004870 0x7fbb64004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603affd700 1 -- 172.21.15.81:0/634668455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c0cb340 msgr2=0x7f603c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603affd700 1 --2- 172.21.15.81:0/634668455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c0cb340 0x7f603c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603affd700 1 -- 172.21.15.81:0/634668455 >> v1:172.21.15.176:6789/0 conn(0x7f603c071ca0 legacy=0x7f603c0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603affd700 1 -- 172.21.15.81:0/634668455 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c06c8f0 con 0x7f603c06f7c0 2023-11-29T11:13:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 -- 172.21.15.81:0/476278811 wait complete. 2023-11-29T11:13:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96da88700 1 --2- 172.21.15.81:0/413783748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa96806a0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa958008910 tx=0x7fa95800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c3460207454c97a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f603affd700 1 --2- 172.21.15.81:0/634668455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c06f7c0 0x7f603c06a0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f603400aea0 tx=0x7f603400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc272ae6ae4a0e16 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96d287700 1 -- 172.21.15.81:0/413783748 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958010070 con 0x7fa96806f7c0 2023-11-29T11:13:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96d287700 1 -- 172.21.15.81:0/413783748 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95800d9d0 con 0x7fa96806f7c0 2023-11-29T11:13:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7ad9d700 1 -- 172.21.15.81:0/596226148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb64004870 msgr2=0x7fbb64004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7ad9d700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb64004870 0x7fbb64004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7ad9d700 1 -- 172.21.15.81:0/596226148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb64003a20 msgr2=0x7fbb64003e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-29T11:13:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7ad9d700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb64003a20 0x7fbb64003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7ad9d700 1 -- 172.21.15.81:0/596226148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0722a0 con 0x7fbb64005220 2023-11-29T11:13:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fbb7ad9d700 1 -- 172.21.15.81:0/596226148 reap_dead start 2023-11-29T11:13:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7fa96d287700 1 -- 172.21.15.81:0/413783748 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95800dd60 con 0x7fa96806f7c0 2023-11-29T11:13:19.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 Processor -- start 2023-11-29T11:13:19.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.866+0000 7f8572906700 1 -- start start 2023-11-29T11:13:19.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 -- 172.21.15.81:0/413783748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 msgr2=0x7fa96806a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 --2- 172.21.15.81:0/413783748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa96806a0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa958008910 tx=0x7fa95800d330 comp rx=0 tx=0).stop 2023-11-29T11:13:19.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fbb7ad9d700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb64005220 0x7fbb6400ba30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009b60 tx=0x7fbb640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bca69985cc74b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 -- 172.21.15.81:0/413783748 shutdown_connections 2023-11-29T11:13:19.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 --2- 172.21.15.81:0/413783748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 0x7fa96806a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 --2- 172.21.15.81:0/413783748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa96806a0f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 -- 172.21.15.81:0/413783748 >> 172.21.15.81:0/413783748 conn(0x7fa9680b1f90 msgr2=0x7fa9680ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:19.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fdf599b3700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdf40065080 0x7fdf40067530 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf5406a280 tx=0x7fdf44010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 -- 172.21.15.81:0/413783748 shutdown_connections 2023-11-29T11:13:19.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 -- 172.21.15.81:0/413783748 wait complete. 2023-11-29T11:13:19.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572906700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856c06b420 0x7f856c0c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572906700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f856c0c18f0 0x7f856c0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572906700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0aeb40 0x7f856c0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572906700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0aefb0 con 0x7f856c06b420 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572906700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c155bb0 con 0x7f856c0c18f0 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572906700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0abac0 con 0x7f856c0aeb40 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856c06b420 0x7f856c0c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856c06b420 0x7f856c0c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41504/0 (socket says 172.21.15.81:41504) 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 -- 172.21.15.81:0/1898953462 learned_addr learned my addr 172.21.15.81:0/1898953462 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572105700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0aeb40 0x7f856c0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571103700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f856c0c18f0 0x7f856c0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 -- 172.21.15.81:0/1898953462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0aeb40 msgr2=0x7f856c0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0aeb40 0x7f856c0c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 -- 172.21.15.81:0/1898953462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f856c0c18f0 msgr2=0x7f856c0ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f856c0c18f0 0x7f856c0ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 -- 172.21.15.81:0/1898953462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0094b0 con 0x7f856c06b420 2023-11-29T11:13:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8571904700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856c06b420 0x7f856c0c1f10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f855c0090b0 tx=0x7f855c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 Processor -- start 2023-11-29T11:13:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fa96f28b700 1 -- start start 2023-11-29T11:13:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f85627fc700 1 -- 172.21.15.81:0/1898953462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c0038c0 con 0x7f856c06b420 2023-11-29T11:13:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f85627fc700 1 -- 172.21.15.81:0/1898953462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c01f070 con 0x7f856c06b420 2023-11-29T11:13:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f85627fc700 1 -- 172.21.15.81:0/1898953462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c003c80 con 0x7f856c06b420 2023-11-29T11:13:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c071af0 con 0x7f856c06b420 2023-11-29T11:13:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c071810 con 0x7f856c06b420 2023-11-29T11:13:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fdf4affd700 1 -- 172.21.15.81:0/1646255264 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdf4c050570 con 0x7fdf540b3400 2023-11-29T11:13:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f603a7fc700 1 -- 172.21.15.81:0/634668455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603400cbc0 con 0x7f603c06f7c0 2023-11-29T11:13:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74003c40 con 0x7fbb64005220 2023-11-29T11:13:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74003da0 con 0x7fbb64005220 2023-11-29T11:13:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fbb7959a700 1 -- 172.21.15.81:0/596226148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74017ba0 con 0x7fbb64005220 2023-11-29T11:13:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f603a7fc700 1 -- 172.21.15.81:0/634668455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603400cd20 con 0x7f603c06f7c0 2023-11-29T11:13:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7f603a7fc700 1 -- 172.21.15.81:0/634668455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034008680 con 0x7f603c06f7c0 2023-11-29T11:13:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fbb7b59e700 1 -- 172.21.15.81:0/596226148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb64005220 msgr2=0x7fbb6400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.870+0000 7fbb7b59e700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb64005220 0x7fbb6400ba30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009b60 tx=0x7fbb640058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 -- 172.21.15.81:0/596226148 shutdown_connections 2023-11-29T11:13:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 --2- 172.21.15.81:0/596226148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb64005220 0x7fbb6400ba30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 -- 172.21.15.81:0/596226148 >> 172.21.15.81:0/596226148 conn(0x7fbb7c0b1f90 msgr2=0x7fbb7c0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 -- 172.21.15.81:0/596226148 shutdown_connections 2023-11-29T11:13:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 -- 172.21.15.81:0/596226148 wait complete. 2023-11-29T11:13:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- 172.21.15.81:0/634668455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c06f7c0 msgr2=0x7f603c06a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 --2- 172.21.15.81:0/634668455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c06f7c0 0x7f603c06a0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f603400aea0 tx=0x7f603400c330 comp rx=0 tx=0).stop 2023-11-29T11:13:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- 172.21.15.81:0/634668455 shutdown_connections 2023-11-29T11:13:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 --2- 172.21.15.81:0/634668455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c06f7c0 0x7f603c06a0f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 --2- 172.21.15.81:0/634668455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c0cb340 0x7f603c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- 172.21.15.81:0/634668455 >> 172.21.15.81:0/634668455 conn(0x7f603c0b1f90 msgr2=0x7f603c0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:19.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c071dd0 con 0x7f856c06b420 2023-11-29T11:13:19.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f85627fc700 1 -- 172.21.15.81:0/1898953462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f855c00f050 con 0x7f856c06b420 2023-11-29T11:13:19.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- 172.21.15.81:0/634668455 shutdown_connections 2023-11-29T11:13:19.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- 172.21.15.81:0/634668455 wait complete. 2023-11-29T11:13:19.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 Processor -- start 2023-11-29T11:13:19.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 Processor -- start 2023-11-29T11:13:19.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 -- start start 2023-11-29T11:13:19.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f85627fc700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8550064ee0 0x7f8550067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f85627fc700 1 -- 172.21.15.81:0/1898953462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f855c021070 con 0x7f856c06b420 2023-11-29T11:13:19.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f8571103700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8550064ee0 0x7f8550067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f8571103700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8550064ee0 0x7f8550067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8568006fd0 tx=0x7f8568008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- start start 2023-11-29T11:13:19.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c06f7c0 0x7f603c0c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f603c071ca0 0x7f603c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0cb340 0x7f603c0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c5330 con 0x7f603c0cb340 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c152180 con 0x7f603c071ca0 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f6040bb1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c156380 con 0x7f603c06f7c0 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb64005220 0x7fbb7c0c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c155060 0x7fbb7c15e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c0ae3d0 0x7fbb7c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c1558e0 con 0x7fbb7c0ae3d0 2023-11-29T11:13:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c15e6d0 con 0x7fbb64005220 2023-11-29T11:13:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c15e900 con 0x7fbb7c155060 2023-11-29T11:13:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb79d9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c155060 0x7fbb7c15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb79d9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c155060 0x7fbb7c15e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:33074/0 (socket says 172.21.15.81:33074) 2023-11-29T11:13:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb79d9b700 1 -- 172.21.15.81:0/3994739780 learned_addr learned my addr 172.21.15.81:0/3994739780 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f603b7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c06f7c0 0x7f603c0c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7f603affd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f603c071ca0 0x7f603c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603b7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c06f7c0 0x7f603c0c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:33082/0 (socket says 172.21.15.81:33082) 2023-11-29T11:13:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603b7fe700 1 -- 172.21.15.81:0/3970320245 learned_addr learned my addr 172.21.15.81:0/3970320245 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603affd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f603c071ca0 0x7f603c0cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:50744/0 (socket says 172.21.15.81:50744) 2023-11-29T11:13:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fbb7a59c700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb64005220 0x7fbb7c0c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fbb79d9b700 1 -- 172.21.15.81:0/3994739780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb64005220 msgr2=0x7fbb7c0c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fbb79d9b700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb64005220 0x7fbb7c0c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fbb79d9b700 1 -- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c0ae3d0 msgr2=0x7fbb7c1544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fbb79d9b700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c0ae3d0 0x7fbb7c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fbb79d9b700 1 -- 172.21.15.81:0/3994739780 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c071ce0 con 0x7fbb7c155060 2023-11-29T11:13:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603b7fe700 1 -- 172.21.15.81:0/3970320245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f603c071ca0 msgr2=0x7f603c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603b7fe700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f603c071ca0 0x7f603c0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603b7fe700 1 -- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0cb340 msgr2=0x7f603c0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603b7fe700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0cb340 0x7f603c0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603b7fe700 1 -- 172.21.15.81:0/3970320245 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603400ab80 con 0x7f603c06f7c0 2023-11-29T11:13:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fbb79d9b700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c155060 0x7fbb7c15e190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c007310 tx=0x7fbb6c007620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f603b7fe700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c06f7c0 0x7f603c0c49c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f603000e790 tx=0x7f603000eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f6023fff700 1 -- 172.21.15.81:0/3970320245 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030013610 con 0x7f603c06f7c0 2023-11-29T11:13:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c06ceb0 con 0x7f603c06f7c0 2023-11-29T11:13:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c06cbd0 con 0x7f603c06f7c0 2023-11-29T11:13:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f6023fff700 1 -- 172.21.15.81:0/3970320245 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6030013770 con 0x7f603c06f7c0 2023-11-29T11:13:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c06d190 con 0x7f603c06f7c0 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96f28b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa968097800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96f28b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 0x7fa9681e13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96f28b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9680cb340 0x7fa9680af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96f28b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968152180 con 0x7fa9680cb340 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96f28b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9681e1ca0 con 0x7fa96806f7c0 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96f28b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9681e1f80 con 0x7fa968071ca0 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa968097800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa968097800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:50726/0 (socket says 172.21.15.81:50726) 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 -- 172.21.15.81:0/1011471490 learned_addr learned my addr 172.21.15.81:0/1011471490 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 -- 172.21.15.81:0/1011471490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 msgr2=0x7fa9681e13a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 0x7fa9681e13a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 -- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9680cb340 msgr2=0x7fa9680af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9680cb340 0x7fa9680af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 -- 172.21.15.81:0/1011471490 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9580085f0 con 0x7fa96806f7c0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96e289700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa968097800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa960001ed0 tx=0x7fa96000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa95effd700 1 -- 172.21.15.81:0/1011471490 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000ade0 con 0x7fa96806f7c0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96806d190 con 0x7fa96806f7c0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96806ceb0 con 0x7fa96806f7c0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa95effd700 1 -- 172.21.15.81:0/1011471490 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9600020d0 con 0x7fa96806f7c0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.874+0000 7fa95effd700 1 -- 172.21.15.81:0/1011471490 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960003c20 con 0x7fa96806f7c0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fa95effd700 1 -- 172.21.15.81:0/1011471490 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa960010050 con 0x7fa96806f7c0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fa95effd700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa94c086ef0 0x7fa94c0893a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fa95effd700 1 -- 172.21.15.81:0/1011471490 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9600821c0 con 0x7fa96806f7c0 2023-11-29T11:13:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fa96da88700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa94c086ef0 0x7fa94c0893a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7fa96da88700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa94c086ef0 0x7fa94c0893a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9681e1330 tx=0x7fa958012000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.878+0000 7f6023fff700 1 -- 172.21.15.81:0/3970320245 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030013ae0 con 0x7f603c06f7c0 2023-11-29T11:13:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7f6023fff700 1 -- 172.21.15.81:0/3970320245 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6030023070 con 0x7f603c06f7c0 2023-11-29T11:13:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7f85627fc700 1 -- 172.21.15.81:0/1898953462 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f855c051100 con 0x7f856c06b420 2023-11-29T11:13:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7f6023fff700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6028064ee0 0x7f6028067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7fbb6affd700 1 -- 172.21.15.81:0/3994739780 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0014a0 con 0x7fbb7c155060 2023-11-29T11:13:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7fbb6affd700 1 -- 172.21.15.81:0/3994739780 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c00f850 con 0x7fbb7c155060 2023-11-29T11:13:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7fbb6affd700 1 -- 172.21.15.81:0/3994739780 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00fc00 con 0x7fbb7c155060 2023-11-29T11:13:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7f6023fff700 1 -- 172.21.15.81:0/3970320245 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f60300821c0 con 0x7f603c06f7c0 2023-11-29T11:13:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7f603affd700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6028064ee0 0x7f6028067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c071a00 con 0x7fbb7c155060 2023-11-29T11:13:19.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c071fc0 con 0x7fbb7c155060 2023-11-29T11:13:19.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7f603affd700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6028064ee0 0x7f6028067390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f603400c370 tx=0x7f603401c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa950005310 con 0x7fa96806f7c0 2023-11-29T11:13:19.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7c072500 con 0x7fbb7c155060 2023-11-29T11:13:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcebfff700 1 Processor -- start 2023-11-29T11:13:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcebfff700 1 -- start start 2023-11-29T11:13:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcebfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efcec15c470 0x7efcec0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcebfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efcec0cbfb0 0x7efcec071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcebfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcebfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcec06a600 con 0x7efcec0cbfb0 2023-11-29T11:13:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcebfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcec15c840 con 0x7efcec15c470 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcebfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec06c1a0 con 0x7efcec069c40 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcea7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efcec0cbfb0 0x7efcec071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcea7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efcec0cbfb0 0x7efcec071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41524/0 (socket says 172.21.15.81:41524) 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcea7fc700 1 -- 172.21.15.81:0/860532688 learned_addr learned my addr 172.21.15.81:0/860532688 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efceaffd700 1 --2- 172.21.15.81:0/860532688 >> v2:172.21.15.176:3300/0 conn(0x7efcec15c470 0x7efcec0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efceb7fe700 1 --2- 172.21.15.81:0/860532688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcea7fc700 1 -- 172.21.15.81:0/860532688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 msgr2=0x7efcec06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcea7fc700 1 --2- 172.21.15.81:0/860532688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcea7fc700 1 -- 172.21.15.81:0/860532688 >> v2:172.21.15.176:3300/0 conn(0x7efcec15c470 msgr2=0x7efcec0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcea7fc700 1 --2- 172.21.15.81:0/860532688 >> v2:172.21.15.176:3300/0 conn(0x7efcec15c470 0x7efcec0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.882+0000 7efcea7fc700 1 -- 172.21.15.81:0/860532688 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec0717d0 con 0x7efcec0cbfb0 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcea7fc700 1 --2- 172.21.15.81:0/860532688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0cbfb0 0x7efcec071290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efcec06ea10 tx=0x7efcdc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c378f479698409 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efce9ffb700 1 -- 172.21.15.81:0/860532688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00ba20 con 0x7efcec0cbfb0 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efce9ffb700 1 -- 172.21.15.81:0/860532688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc00bb80 con 0x7efcec0cbfb0 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efce9ffb700 1 -- 172.21.15.81:0/860532688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc009e60 con 0x7efcec0cbfb0 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- 172.21.15.81:0/860532688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0cbfb0 msgr2=0x7efcec071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 --2- 172.21.15.81:0/860532688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0cbfb0 0x7efcec071290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efcec06ea10 tx=0x7efcdc009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- 172.21.15.81:0/860532688 shutdown_connections 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 --2- 172.21.15.81:0/860532688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 --2- 172.21.15.81:0/860532688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0cbfb0 0x7efcec071290 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 --2- 172.21.15.81:0/860532688 >> v2:172.21.15.176:3300/0 conn(0x7efcec15c470 0x7efcec0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- 172.21.15.81:0/860532688 >> 172.21.15.81:0/860532688 conn(0x7efcec0b1f90 msgr2=0x7efcec0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- 172.21.15.81:0/860532688 shutdown_connections 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- 172.21.15.81:0/860532688 wait complete. 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 Processor -- start 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- start start 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec15c470 0x7efcec1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0c6d20 0x7efcec0c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0c5000 con 0x7efcec0c6d20 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0c5f60 con 0x7efcec15c470 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcebfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec0c6240 con 0x7efcec069c40 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0c6d20 0x7efcec0c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0c6d20 0x7efcec0c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41536/0 (socket says 172.21.15.81:41536) 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 -- 172.21.15.81:0/997264265 learned_addr learned my addr 172.21.15.81:0/997264265 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceaffd700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efcea7fc700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec15c470 0x7efcec1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 -- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 msgr2=0x7efcec0c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec0c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 -- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec15c470 msgr2=0x7efcec1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec15c470 0x7efcec1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 -- 172.21.15.81:0/997264265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc009570 con 0x7efcec0c6d20 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceaffd700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.886+0000 7efceb7fe700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0c6d20 0x7efcec0c1f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efce000d800 tx=0x7efce000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efcd37fe700 1 -- 172.21.15.81:0/997264265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00125f0 con 0x7efcec0c6d20 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec0cc400 con 0x7efcec0c6d20 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efcd37fe700 1 -- 172.21.15.81:0/997264265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce0012770 con 0x7efcec0c6d20 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efcd37fe700 1 -- 172.21.15.81:0/997264265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0012b20 con 0x7efcec0c6d20 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec0722a0 con 0x7efcec0c6d20 2023-11-29T11:13:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7f6023fff700 1 -- 172.21.15.81:0/3970320245 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6030053c20 con 0x7f603c06f7c0 2023-11-29T11:13:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efcd37fe700 1 -- 172.21.15.81:0/997264265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efce0012c80 con 0x7efcec0c6d20 2023-11-29T11:13:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7fbb6affd700 1 -- 172.21.15.81:0/3994739780 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb6c00fd60 con 0x7fbb7c155060 2023-11-29T11:13:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efcd37fe700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efcd4065030 0x7efcd40674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7fbb6affd700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb5c064f60 0x7fbb5c067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efcd37fe700 1 -- 172.21.15.81:0/997264265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efce00823f0 con 0x7efcec0c6d20 2023-11-29T11:13:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7fbb6affd700 1 -- 172.21.15.81:0/3994739780 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbb6c082d10 con 0x7fbb7c155060 2023-11-29T11:13:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7fbb7a59c700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb5c064f60 0x7fbb5c067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efceaffd700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efcd4065030 0x7efcd40674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7fbb7a59c700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb5c064f60 0x7fbb5c067410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb700016e0 tx=0x7fbb70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7efceaffd700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efcd4065030 0x7efcd40674e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efce4009be0 tx=0x7efce4003a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.890+0000 7fa95effd700 1 -- 172.21.15.81:0/1011471490 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa960050070 con 0x7fa96806f7c0 2023-11-29T11:13:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.894+0000 7fbb6affd700 1 -- 172.21.15.81:0/3994739780 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb6c050c60 con 0x7fbb7c155060 2023-11-29T11:13:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.898+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc005310 con 0x7efcec0c6d20 2023-11-29T11:13:19.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f767720a700 1 Processor -- start 2023-11-29T11:13:19.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f767720a700 1 -- start start 2023-11-29T11:13:19.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f767720a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f76700ada60 0x7f76700cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f767720a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767006b420 0x7f76700c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f767720a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76700715c0 con 0x7f76700c18f0 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f767720a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76700c1d70 con 0x7f76700ada60 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f767720a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767006bce0 con 0x7f767006b420 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675a07700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767006b420 0x7f76700c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675a07700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767006b420 0x7f76700c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:33112/0 (socket says 172.21.15.81:33112) 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675a07700 1 -- 172.21.15.81:0/3274268783 learned_addr learned my addr 172.21.15.81:0/3274268783 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675a07700 1 -- 172.21.15.81:0/3274268783 >> v2:172.21.15.176:3300/0 conn(0x7f76700ada60 msgr2=0x7f76700cb800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675a07700 1 --2- 172.21.15.81:0/3274268783 >> v2:172.21.15.176:3300/0 conn(0x7f76700ada60 0x7f76700cb800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675a07700 1 -- 172.21.15.81:0/3274268783 >> v1:172.21.15.81:6789/0 conn(0x7f76700c18f0 legacy=0x7f76700b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675a07700 1 -- 172.21.15.81:0/3274268783 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76700cbd40 con 0x7f767006b420 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675a07700 1 --2- 172.21.15.81:0/3274268783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767006b420 0x7f76700c13b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f766c009910 tx=0x7f766c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29250459d5f08e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675206700 1 -- 172.21.15.81:0/3274268783 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c004230 con 0x7f767006b420 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.902+0000 7f7675206700 1 -- 172.21.15.81:0/3274268783 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c004390 con 0x7f767006b420 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 -- 172.21.15.81:0/3274268783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767006b420 msgr2=0x7f76700c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 --2- 172.21.15.81:0/3274268783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767006b420 0x7f76700c13b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f766c009910 tx=0x7f766c009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:19.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 -- 172.21.15.81:0/3274268783 shutdown_connections 2023-11-29T11:13:19.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 --2- 172.21.15.81:0/3274268783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f767006b420 0x7f76700c13b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 --2- 172.21.15.81:0/3274268783 >> v2:172.21.15.176:3300/0 conn(0x7f76700ada60 0x7f76700cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 -- 172.21.15.81:0/3274268783 >> 172.21.15.81:0/3274268783 conn(0x7f76700b1f90 msgr2=0x7f76700ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:19.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 -- 172.21.15.81:0/3274268783 shutdown_connections 2023-11-29T11:13:19.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7efcd37fe700 1 -- 172.21.15.81:0/997264265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efce0050260 con 0x7efcec0c6d20 2023-11-29T11:13:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 -- 172.21.15.81:0/3274268783 wait complete. 2023-11-29T11:13:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 Processor -- start 2023-11-29T11:13:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.906+0000 7f767720a700 1 -- start start 2023-11-29T11:13:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f767720a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f767006b420 0x7f76700cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f767720a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76700c18f0 0x7f76700abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f767720a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7670162f20 0x7f76701520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f767720a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767014eae0 con 0x7f7670162f20 2023-11-29T11:13:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7676208700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f767006b420 0x7f76700cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f767720a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767014edc0 con 0x7f767006b420 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7675a07700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76700c18f0 0x7f76700abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7676208700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f767006b420 0x7f76700cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:50772/0 (socket says 172.21.15.81:50772) 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7676208700 1 -- 172.21.15.81:0/3049847248 learned_addr learned my addr 172.21.15.81:0/3049847248 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767014f0a0 con 0x7f76700c18f0 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7676a09700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7670162f20 0x7f76701520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7675a07700 1 -- 172.21.15.81:0/3049847248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f767006b420 msgr2=0x7f76700cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7675a07700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f767006b420 0x7f76700cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7675a07700 1 -- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7670162f20 msgr2=0x7f76701520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7675a07700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7670162f20 0x7f76701520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7675a07700 1 -- 172.21.15.81:0/3049847248 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c009570 con 0x7f76700c18f0 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7676a09700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7670162f20 0x7f76701520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7675a07700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76700c18f0 0x7f76700abed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f766c015000 tx=0x7f766c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7666ffd700 1 -- 172.21.15.81:0/3049847248 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c003ad0 con 0x7f76700c18f0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7666ffd700 1 -- 172.21.15.81:0/3049847248 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c003c30 con 0x7f76700c18f0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f7666ffd700 1 -- 172.21.15.81:0/3049847248 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c025470 con 0x7f76700c18f0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7670071af0 con 0x7f76700c18f0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.910+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7670071810 con 0x7f76700c18f0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.914+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7658005310 con 0x7f76700c18f0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.918+0000 7f7666ffd700 1 -- 172.21.15.81:0/3049847248 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f766c017020 con 0x7f76700c18f0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.918+0000 7f7666ffd700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7654064fe0 0x7f7654067490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.918+0000 7f7666ffd700 1 -- 172.21.15.81:0/3049847248 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f766c084490 con 0x7f76700c18f0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.918+0000 7f7676208700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7654064fe0 0x7f7654067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.918+0000 7f7676208700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7654064fe0 0x7f7654067490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7670163340 tx=0x7f76600091c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:19.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:19.922+0000 7f7666ffd700 1 -- 172.21.15.81:0/3049847248 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f766c0522d0 con 0x7f76700c18f0 2023-11-29T11:13:20.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.118+0000 7f408ff22700 1 -- 172.21.15.81:0/3411572859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f40880008d0 con 0x7f4088069e50 2023-11-29T11:13:20.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.118+0000 7f407e7fc700 1 -- 172.21.15.81:0/3411572859 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4078053530 con 0x7f4088069e50 2023-11-29T11:13:20.121 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.118+0000 7f406bfff700 1 -- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f406c065030 msgr2=0x7f406c0674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.118+0000 7f406bfff700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f406c065030 0x7f406c0674e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f408806a280 tx=0x7f4084012000 comp rx=0 tx=0).stop 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.118+0000 7f406bfff700 1 -- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 msgr2=0x7f40880c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.118+0000 7f406bfff700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880c2900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f407800b4a0 tx=0x7f407800b7b0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.122+0000 7f406bfff700 1 -- 172.21.15.81:0/3411572859 shutdown_connections 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.122+0000 7f406bfff700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f406c065030 0x7f406c0674e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.122+0000 7f406bfff700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880cae00 0x7f40880cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.122+0000 7f406bfff700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f408806c760 0x7f40880af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.122+0000 7f406bfff700 1 --2- 172.21.15.81:0/3411572859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4088069e50 0x7f40880c2900 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.122+0000 7f406bfff700 1 -- 172.21.15.81:0/3411572859 >> 172.21.15.81:0/3411572859 conn(0x7f40880b2010 msgr2=0x7f4088156cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.122+0000 7f406bfff700 1 -- 172.21.15.81:0/3411572859 shutdown_connections 2023-11-29T11:13:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.122+0000 7f406bfff700 1 -- 172.21.15.81:0/3411572859 wait complete. 2023-11-29T11:13:20.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2023-11-29T11:13:20.139 DEBUG:teuthology.parallel:result is None 2023-11-29T11:13:20.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.170+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdf540cb500 con 0x7fdf540b3400 2023-11-29T11:13:20.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.170+0000 7fdf4affd700 1 -- 172.21.15.81:0/1646255264 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf4c053b90 con 0x7fdf540b3400 2023-11-29T11:13:20.176 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:20.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdf40065080 msgr2=0x7fdf40067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdf40065080 0x7fdf40067530 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf5406a280 tx=0x7fdf44010000 comp rx=0 tx=0).stop 2023-11-29T11:13:20.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf540b3400 msgr2=0x7fdf540cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf540b3400 0x7fdf540cd190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c008ba0 tx=0x7fdf4c00b3e0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 shutdown_connections 2023-11-29T11:13:20.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdf40065080 0x7fdf40067530 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf54093790 0x7fdf540c0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf540cae00 0x7fdf540940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 --2- 172.21.15.81:0/1646255264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf540b3400 0x7fdf540cd190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 >> 172.21.15.81:0/1646255264 conn(0x7fdf540b2010 msgr2=0x7fdf54156cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 shutdown_connections 2023-11-29T11:13:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.174+0000 7fdf5c418700 1 -- 172.21.15.81:0/1646255264 wait complete. 2023-11-29T11:13:20.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.182+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f856c072500 con 0x7f856c06b420 2023-11-29T11:13:20.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.182+0000 7f85627fc700 1 -- 172.21.15.81:0/1898953462 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f855c023330 con 0x7f856c06b420 2023-11-29T11:13:20.186 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:20.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.182+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7658005890 con 0x7f76700c18f0 2023-11-29T11:13:20.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.182+0000 7f7666ffd700 1 -- 172.21.15.81:0/3049847248 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f766c0558f0 con 0x7f76700c18f0 2023-11-29T11:13:20.188 INFO:teuthology.orchestra.run.smithi081.stdout:60129542153 2023-11-29T11:13:20.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8550064ee0 msgr2=0x7f8550067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8550064ee0 0x7f8550067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8568006fd0 tx=0x7f8568008040 comp rx=0 tx=0).stop 2023-11-29T11:13:20.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856c06b420 msgr2=0x7f856c0c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856c06b420 0x7f856c0c1f10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f855c0090b0 tx=0x7f855c004770 comp rx=0 tx=0).stop 2023-11-29T11:13:20.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 shutdown_connections 2023-11-29T11:13:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8550064ee0 0x7f8550067390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f856c0aeb40 0x7f856c0c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f856c0c18f0 0x7f856c0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 --2- 172.21.15.81:0/1898953462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856c06b420 0x7f856c0c1f10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 >> 172.21.15.81:0/1898953462 conn(0x7f856c0b1f90 msgr2=0x7f856c06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 shutdown_connections 2023-11-29T11:13:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f8572906700 1 -- 172.21.15.81:0/1898953462 wait complete. 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7654064fe0 msgr2=0x7f7654067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7654064fe0 0x7f7654067490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7670163340 tx=0x7f76600091c0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76700c18f0 msgr2=0x7f76700abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76700c18f0 0x7f76700abed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f766c015000 tx=0x7f766c004770 comp rx=0 tx=0).stop 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 shutdown_connections 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7654064fe0 0x7f7654067490 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7670162f20 0x7f76701520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76700c18f0 0x7f76700abed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 --2- 172.21.15.81:0/3049847248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f767006b420 0x7f76700cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 >> 172.21.15.81:0/3049847248 conn(0x7f76700b1f90 msgr2=0x7f76700af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 shutdown_connections 2023-11-29T11:13:20.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.186+0000 7f767720a700 1 -- 172.21.15.81:0/3049847248 wait complete. 2023-11-29T11:13:20.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2023-11-29T11:13:20.193 DEBUG:teuthology.parallel:result is None 2023-11-29T11:13:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.194+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9500055c0 con 0x7fa96806f7c0 2023-11-29T11:13:20.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.1 2023-11-29T11:13:20.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa95effd700 1 -- 172.21.15.81:0/1011471490 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa960053690 con 0x7fa96806f7c0 2023-11-29T11:13:20.201 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:20.201 DEBUG:teuthology.parallel:result is None 2023-11-29T11:13:20.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2023-11-29T11:13:20.202 DEBUG:teuthology.parallel:result is None 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa94c086ef0 msgr2=0x7fa94c0893a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa94c086ef0 0x7fa94c0893a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9681e1330 tx=0x7fa958012000 comp rx=0 tx=0).stop 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 msgr2=0x7fa968097800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa968097800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa960001ed0 tx=0x7fa96000a340 comp rx=0 tx=0).stop 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 shutdown_connections 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa94c086ef0 0x7fa94c0893a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9680cb340 0x7fa9680af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa968071ca0 0x7fa9681e13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 --2- 172.21.15.81:0/1011471490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa96806f7c0 0x7fa968097800 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 >> 172.21.15.81:0/1011471490 conn(0x7fa9680b1f90 msgr2=0x7fa9680c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 shutdown_connections 2023-11-29T11:13:20.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.198+0000 7fa96f28b700 1 -- 172.21.15.81:0/1011471490 wait complete. 2023-11-29T11:13:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.202+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbb7c0ce940 con 0x7fbb7c155060 2023-11-29T11:13:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.202+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f603c1522f0 con 0x7f603c06f7c0 2023-11-29T11:13:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.202+0000 7fbb6affd700 1 -- 172.21.15.81:0/3994739780 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb6c054280 con 0x7fbb7c155060 2023-11-29T11:13:20.207 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.202+0000 7f6023fff700 1 -- 172.21.15.81:0/3970320245 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6030053810 con 0x7f603c06f7c0 2023-11-29T11:13:20.207 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2023-11-29T11:13:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6028064ee0 msgr2=0x7f6028067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6028064ee0 0x7f6028067390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f603400c370 tx=0x7f603401c040 comp rx=0 tx=0).stop 2023-11-29T11:13:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c06f7c0 msgr2=0x7f603c0c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c06f7c0 0x7f603c0c49c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f603000e790 tx=0x7f603000eaa0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 shutdown_connections 2023-11-29T11:13:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6028064ee0 0x7f6028067390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f603c0cb340 0x7f603c0ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f603c071ca0 0x7f603c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 --2- 172.21.15.81:0/3970320245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f603c06f7c0 0x7f603c0c49c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 >> 172.21.15.81:0/3970320245 conn(0x7f603c0b1f90 msgr2=0x7f603c1df1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 shutdown_connections 2023-11-29T11:13:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7f6040bb1700 1 -- 172.21.15.81:0/3970320245 wait complete. 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb5c064f60 msgr2=0x7fbb5c067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb5c064f60 0x7fbb5c067410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb700016e0 tx=0x7fbb70009040 comp rx=0 tx=0).stop 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c155060 msgr2=0x7fbb7c15e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c155060 0x7fbb7c15e190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c007310 tx=0x7fbb6c007620 comp rx=0 tx=0).stop 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 shutdown_connections 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb5c064f60 0x7fbb5c067410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb7c0ae3d0 0x7fbb7c1544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb7c155060 0x7fbb7c15e190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 --2- 172.21.15.81:0/3994739780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb64005220 0x7fbb7c0c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 >> 172.21.15.81:0/3994739780 conn(0x7fbb7c0b1f90 msgr2=0x7fbb7c159230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 shutdown_connections 2023-11-29T11:13:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.206+0000 7fbb7b59e700 1 -- 172.21.15.81:0/3994739780 wait complete. 2023-11-29T11:13:20.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.2 2023-11-29T11:13:20.214 DEBUG:teuthology.parallel:result is None 2023-11-29T11:13:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.214+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efccc0055c0 con 0x7efcec0c6d20 2023-11-29T11:13:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.214+0000 7efcd37fe700 1 -- 172.21.15.81:0/997264265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efce0053880 con 0x7efcec0c6d20 2023-11-29T11:13:20.218 INFO:teuthology.orchestra.run.smithi081.stdout:60129542153 2023-11-29T11:13:20.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2023-11-29T11:13:20.221 DEBUG:teuthology.parallel:result is None 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efcd4065030 msgr2=0x7efcd40674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efcd4065030 0x7efcd40674e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efce4009be0 tx=0x7efce4003a80 comp rx=0 tx=0).stop 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0c6d20 msgr2=0x7efcec0c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0c6d20 0x7efcec0c1f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efce000d800 tx=0x7efce000dbc0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 shutdown_connections 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efcd4065030 0x7efcd40674e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcec0c6d20 0x7efcec0c1f10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec15c470 0x7efcec1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 --2- 172.21.15.81:0/997264265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcec069c40 0x7efcec0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 >> 172.21.15.81:0/997264265 conn(0x7efcec0b1f90 msgr2=0x7efcec06d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 shutdown_connections 2023-11-29T11:13:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.218+0000 7efcebfff700 1 -- 172.21.15.81:0/997264265 wait complete. 2023-11-29T11:13:20.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2023-11-29T11:13:20.225 DEBUG:teuthology.parallel:result is None 2023-11-29T11:13:20.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.3 2023-11-29T11:13:20.231 DEBUG:teuthology.parallel:result is None 2023-11-29T11:13:20.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-29T11:13:20.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:13:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa71002700 1 Processor -- start 2023-11-29T11:13:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa71002700 1 -- start start 2023-11-29T11:13:20.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa71002700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa71002700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c0cd8f0 con 0x7faa6c0ad490 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa71002700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c06dc60 con 0x7faa6c158e60 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa71002700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0add00 con 0x7faa6c0cb460 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa70801700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faa6c0ad490 0x7faa6c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53918/0 (socket says 172.21.15.81:53918) 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa70801700 1 -- 172.21.15.81:0/1106267449 learned_addr learned my addr 172.21.15.81:0/1106267449 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6b7fe700 1 --2- 172.21.15.81:0/1106267449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6affd700 1 -- 172.21.15.81:0/1106267449 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705617962 0 0) 0x7faa6c0cd8f0 con 0x7faa6c0ad490 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6affd700 1 -- 172.21.15.81:0/1106267449 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa540057e0 con 0x7faa6c0ad490 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6affd700 1 -- 172.21.15.81:0/1106267449 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344025628 0 0) 0x7faa6c06dc60 con 0x7faa6c158e60 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6affd700 1 -- 172.21.15.81:0/1106267449 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa6c0cd8f0 con 0x7faa6c158e60 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6b7fe700 1 -- 172.21.15.81:0/1106267449 >> v1:172.21.15.176:6789/0 conn(0x7faa6c158e60 legacy=0x7faa6c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6b7fe700 1 -- 172.21.15.81:0/1106267449 >> v1:172.21.15.81:6789/0 conn(0x7faa6c0ad490 legacy=0x7faa6c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6b7fe700 1 -- 172.21.15.81:0/1106267449 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0cde90 con 0x7faa6c0cb460 2023-11-29T11:13:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6b7fe700 1 --2- 172.21.15.81:0/1106267449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c0c8a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa600098b0 tx=0x7faa60009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c565d93b2d9d5706 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6affd700 1 -- 172.21.15.81:0/1106267449 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60011830 con 0x7faa6c0cb460 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6affd700 1 -- 172.21.15.81:0/1106267449 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60011990 con 0x7faa6c0cb460 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.326+0000 7faa6affd700 1 -- 172.21.15.81:0/1106267449 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60011d00 con 0x7faa6c0cb460 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- 172.21.15.81:0/1106267449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 msgr2=0x7faa6c0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 --2- 172.21.15.81:0/1106267449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c0c8a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa600098b0 tx=0x7faa60009bc0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- 172.21.15.81:0/1106267449 shutdown_connections 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 --2- 172.21.15.81:0/1106267449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c0c8a30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- 172.21.15.81:0/1106267449 >> 172.21.15.81:0/1106267449 conn(0x7faa6c0ce3e0 msgr2=0x7faa6c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- 172.21.15.81:0/1106267449 shutdown_connections 2023-11-29T11:13:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- 172.21.15.81:0/1106267449 wait complete. 2023-11-29T11:13:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 Processor -- start 2023-11-29T11:13:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- start start 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa6c0ad490 0x7faa6c0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c1ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c158e60 0x7faa6c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c155b20 con 0x7faa6c158e60 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c1ed3a0 con 0x7faa6c0ad490 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa71002700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0c1d40 con 0x7faa6c0cb460 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa70801700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c158e60 0x7faa6c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c1ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c1ece60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:33148/0 (socket says 172.21.15.81:33148) 2023-11-29T11:13:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa6b7fe700 1 -- 172.21.15.81:0/982464931 learned_addr learned my addr 172.21.15.81:0/982464931 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.330+0000 7faa6bfff700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa6c0ad490 0x7faa6c0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa6b7fe700 1 -- 172.21.15.81:0/982464931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa6c0ad490 msgr2=0x7faa6c0c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa6b7fe700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa6c0ad490 0x7faa6c0c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa6b7fe700 1 -- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c158e60 msgr2=0x7faa6c15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa6b7fe700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c158e60 0x7faa6c15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa6b7fe700 1 -- 172.21.15.81:0/982464931 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600094b0 con 0x7faa6c0cb460 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa70801700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c158e60 0x7faa6c15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa6b7fe700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c1ece60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa60013000 tx=0x7faa60004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa68ff9700 1 -- 172.21.15.81:0/982464931 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600042c0 con 0x7faa6c0cb460 2023-11-29T11:13:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa68ff9700 1 -- 172.21.15.81:0/982464931 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6001f070 con 0x7faa6c0cb460 2023-11-29T11:13:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa68ff9700 1 -- 172.21.15.81:0/982464931 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600036c0 con 0x7faa6c0cb460 2023-11-29T11:13:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c06d6a0 con 0x7faa6c0cb460 2023-11-29T11:13:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c159230 con 0x7faa6c0cb460 2023-11-29T11:13:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c06d980 con 0x7faa6c0cb460 2023-11-29T11:13:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.334+0000 7faa68ff9700 1 -- 172.21.15.81:0/982464931 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faa6002a020 con 0x7faa6c0cb460 2023-11-29T11:13:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.338+0000 7faa68ff9700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa58064ee0 0x7faa58067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.338+0000 7faa6bfff700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa58064ee0 0x7faa58067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.338+0000 7faa68ff9700 1 -- 172.21.15.81:0/982464931 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faa60083730 con 0x7faa6c0cb460 2023-11-29T11:13:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.338+0000 7faa6bfff700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa58064ee0 0x7faa58067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa5c001850 tx=0x7faa5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.342+0000 7faa68ff9700 1 -- 172.21.15.81:0/982464931 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faa60051570 con 0x7faa6c0cb460 2023-11-29T11:13:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.498+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa6c072500 con 0x7faa58064ee0 2023-11-29T11:13:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.514+0000 7faa68ff9700 1 -- 172.21.15.81:0/982464931 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367404 (secure 0 0 0) 0x7faa6c072500 con 0x7faa58064ee0 2023-11-29T11:13:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa58064ee0 msgr2=0x7faa58067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa58064ee0 0x7faa58067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faa5c001850 tx=0x7faa5c009040 comp rx=0 tx=0).stop 2023-11-29T11:13:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 msgr2=0x7faa6c1ece60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c1ece60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa60013000 tx=0x7faa60004770 comp rx=0 tx=0).stop 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 shutdown_connections 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa58064ee0 0x7faa58067390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c158e60 0x7faa6c15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa6c0cb460 0x7faa6c1ece60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 --2- 172.21.15.81:0/982464931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa6c0ad490 0x7faa6c0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 >> 172.21.15.81:0/982464931 conn(0x7faa6c0ce3e0 msgr2=0x7faa6c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 shutdown_connections 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.522+0000 7faa71002700 1 -- 172.21.15.81:0/982464931 wait complete. 2023-11-29T11:13:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:13:20.538 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-29T11:13:20.432467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67364,"kb_used_data":3364,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907356,"statfs":{"total":773094113280,"available":773025132544,"internally_reserved":0,"allocated":3444736,"data_stored":2092668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004164"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397456+0000","last_change":"2023-11-29T11:12:56.392727+0000","last_active":"2023-11-29T11:12:56.397456+0000","last_peered":"2023-11-29T11:12:56.397456+0000","last_clean":"2023-11-29T11:12:56.397456+0000","last_became_active":"2023-11-29T11:12:56.392278+0000","last_became_peered":"2023-11-29T11:12:56.392278+0000","last_unstale":"2023-11-29T11:12:56.397456+0000","last_undegraded":"2023-11-29T11:12:56.397456+0000","last_fullsized":"2023-11-29T11:12:56.397456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:05.548254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384796+0000","last_change":"2023-11-29T11:12:51.981171+0000","last_active":"2023-11-29T11:12:56.384796+0000","last_peered":"2023-11-29T11:12:56.384796+0000","last_clean":"2023-11-29T11:12:56.384796+0000","last_became_active":"2023-11-29T11:12:51.979647+0000","last_became_peered":"2023-11-29T11:12:51.979647+0000","last_unstale":"2023-11-29T11:12:56.384796+0000","last_undegraded":"2023-11-29T11:12:56.384796+0000","last_fullsized":"2023-11-29T11:12:56.384796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379179+0000","last_change":"2023-11-29T11:12:52.373329+0000","last_active":"2023-11-29T11:12:56.379179+0000","last_peered":"2023-11-29T11:12:56.379179+0000","last_clean":"2023-11-29T11:12:56.379179+0000","last_became_active":"2023-11-29T11:12:52.373080+0000","last_became_peered":"2023-11-29T11:12:52.373080+0000","last_unstale":"2023-11-29T11:12:56.379179+0000","last_undegraded":"2023-11-29T11:12:56.379179+0000","last_fullsized":"2023-11-29T11:12:56.379179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:33.415072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399892+0000","last_change":"2023-11-29T11:12:56.393396+0000","last_active":"2023-11-29T11:12:56.399892+0000","last_peered":"2023-11-29T11:12:56.399892+0000","last_clean":"2023-11-29T11:12:56.399892+0000","last_became_active":"2023-11-29T11:12:56.392958+0000","last_became_peered":"2023-11-29T11:12:56.392958+0000","last_unstale":"2023-11-29T11:12:56.399892+0000","last_undegraded":"2023-11-29T11:12:56.399892+0000","last_fullsized":"2023-11-29T11:12:56.399892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:08:53.005631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374292+0000","last_change":"2023-11-29T11:12:51.984861+0000","last_active":"2023-11-29T11:12:56.374292+0000","last_peered":"2023-11-29T11:12:56.374292+0000","last_clean":"2023-11-29T11:12:56.374292+0000","last_became_active":"2023-11-29T11:12:51.984221+0000","last_became_peered":"2023-11-29T11:12:51.984221+0000","last_unstale":"2023-11-29T11:12:56.374292+0000","last_undegraded":"2023-11-29T11:12:56.374292+0000","last_fullsized":"2023-11-29T11:12:56.374292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:03:52.716864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368510+0000","last_change":"2023-11-29T11:12:52.361315+0000","last_active":"2023-11-29T11:12:56.368510+0000","last_peered":"2023-11-29T11:12:56.368510+0000","last_clean":"2023-11-29T11:12:56.368510+0000","last_became_active":"2023-11-29T11:12:52.361046+0000","last_became_peered":"2023-11-29T11:12:52.361046+0000","last_unstale":"2023-11-29T11:12:56.368510+0000","last_undegraded":"2023-11-29T11:12:56.368510+0000","last_fullsized":"2023-11-29T11:12:56.368510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:48.301408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402905+0000","last_change":"2023-11-29T11:12:56.397174+0000","last_active":"2023-11-29T11:12:56.402905+0000","last_peered":"2023-11-29T11:12:56.402905+0000","last_clean":"2023-11-29T11:12:56.402905+0000","last_became_active":"2023-11-29T11:12:56.395990+0000","last_became_peered":"2023-11-29T11:12:56.395990+0000","last_unstale":"2023-11-29T11:12:56.402905+0000","last_undegraded":"2023-11-29T11:12:56.402905+0000","last_fullsized":"2023-11-29T11:12:56.402905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:32:53.734519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384497+0000","last_change":"2023-11-29T11:12:51.984821+0000","last_active":"2023-11-29T11:12:56.384497+0000","last_peered":"2023-11-29T11:12:56.384497+0000","last_clean":"2023-11-29T11:12:56.384497+0000","last_became_active":"2023-11-29T11:12:51.984531+0000","last_became_peered":"2023-11-29T11:12:51.984531+0000","last_unstale":"2023-11-29T11:12:56.384497+0000","last_undegraded":"2023-11-29T11:12:56.384497+0000","last_fullsized":"2023-11-29T11:12:56.384497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:54.630966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381153+0000","last_change":"2023-11-29T11:12:52.369059+0000","last_active":"2023-11-29T11:12:56.381153+0000","last_peered":"2023-11-29T11:12:56.381153+0000","last_clean":"2023-11-29T11:12:56.381153+0000","last_became_active":"2023-11-29T11:12:52.368705+0000","last_became_peered":"2023-11-29T11:12:52.368705+0000","last_unstale":"2023-11-29T11:12:56.381153+0000","last_undegraded":"2023-11-29T11:12:56.381153+0000","last_fullsized":"2023-11-29T11:12:56.381153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:53:43.004864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401291+0000","last_change":"2023-11-29T11:12:56.394933+0000","last_active":"2023-11-29T11:12:56.401291+0000","last_peered":"2023-11-29T11:12:56.401291+0000","last_clean":"2023-11-29T11:12:56.401291+0000","last_became_active":"2023-11-29T11:12:56.394448+0000","last_became_peered":"2023-11-29T11:12:56.394448+0000","last_unstale":"2023-11-29T11:12:56.401291+0000","last_undegraded":"2023-11-29T11:12:56.401291+0000","last_fullsized":"2023-11-29T11:12:56.401291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:51.264472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383467+0000","last_change":"2023-11-29T11:12:51.984966+0000","last_active":"2023-11-29T11:12:56.383467+0000","last_peered":"2023-11-29T11:12:56.383467+0000","last_clean":"2023-11-29T11:12:56.383467+0000","last_became_active":"2023-11-29T11:12:51.984504+0000","last_became_peered":"2023-11-29T11:12:51.984504+0000","last_unstale":"2023-11-29T11:12:56.383467+0000","last_undegraded":"2023-11-29T11:12:56.383467+0000","last_fullsized":"2023-11-29T11:12:56.383467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:27:55.174112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380063+0000","last_change":"2023-11-29T11:12:52.369471+0000","last_active":"2023-11-29T11:12:56.380063+0000","last_peered":"2023-11-29T11:12:56.380063+0000","last_clean":"2023-11-29T11:12:56.380063+0000","last_became_active":"2023-11-29T11:12:52.369037+0000","last_became_peered":"2023-11-29T11:12:52.369037+0000","last_unstale":"2023-11-29T11:12:56.380063+0000","last_undegraded":"2023-11-29T11:12:56.380063+0000","last_fullsized":"2023-11-29T11:12:56.380063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:58:11.106615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397379+0000","last_change":"2023-11-29T11:12:56.392830+0000","last_active":"2023-11-29T11:12:56.397379+0000","last_peered":"2023-11-29T11:12:56.397379+0000","last_clean":"2023-11-29T11:12:56.397379+0000","last_became_active":"2023-11-29T11:12:56.392385+0000","last_became_peered":"2023-11-29T11:12:56.392385+0000","last_unstale":"2023-11-29T11:12:56.397379+0000","last_undegraded":"2023-11-29T11:12:56.397379+0000","last_fullsized":"2023-11-29T11:12:56.397379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385374+0000","last_change":"2023-11-29T11:12:51.978019+0000","last_active":"2023-11-29T11:12:56.385374+0000","last_peered":"2023-11-29T11:12:56.385374+0000","last_clean":"2023-11-29T11:12:56.385374+0000","last_became_active":"2023-11-29T11:12:51.977720+0000","last_became_peered":"2023-11-29T11:12:51.977720+0000","last_unstale":"2023-11-29T11:12:56.385374+0000","last_undegraded":"2023-11-29T11:12:56.385374+0000","last_fullsized":"2023-11-29T11:12:56.385374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:01.519677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374628+0000","last_change":"2023-11-29T11:12:52.366401+0000","last_active":"2023-11-29T11:12:56.374628+0000","last_peered":"2023-11-29T11:12:56.374628+0000","last_clean":"2023-11-29T11:12:56.374628+0000","last_became_active":"2023-11-29T11:12:52.366140+0000","last_became_peered":"2023-11-29T11:12:52.366140+0000","last_unstale":"2023-11-29T11:12:56.374628+0000","last_undegraded":"2023-11-29T11:12:56.374628+0000","last_fullsized":"2023-11-29T11:12:56.374628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:49.550223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397485+0000","last_change":"2023-11-29T11:12:56.390565+0000","last_active":"2023-11-29T11:12:56.397485+0000","last_peered":"2023-11-29T11:12:56.397485+0000","last_clean":"2023-11-29T11:12:56.397485+0000","last_became_active":"2023-11-29T11:12:56.389869+0000","last_became_peered":"2023-11-29T11:12:56.389869+0000","last_unstale":"2023-11-29T11:12:56.397485+0000","last_undegraded":"2023-11-29T11:12:56.397485+0000","last_fullsized":"2023-11-29T11:12:56.397485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:08:27.735011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381346+0000","last_change":"2023-11-29T11:12:51.979373+0000","last_active":"2023-11-29T11:12:56.381346+0000","last_peered":"2023-11-29T11:12:56.381346+0000","last_clean":"2023-11-29T11:12:56.381346+0000","last_became_active":"2023-11-29T11:12:51.979051+0000","last_became_peered":"2023-11-29T11:12:51.979051+0000","last_unstale":"2023-11-29T11:12:56.381346+0000","last_undegraded":"2023-11-29T11:12:56.381346+0000","last_fullsized":"2023-11-29T11:12:56.381346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.373881+0000","last_change":"2023-11-29T11:12:52.365896+0000","last_active":"2023-11-29T11:12:56.373881+0000","last_peered":"2023-11-29T11:12:56.373881+0000","last_clean":"2023-11-29T11:12:56.373881+0000","last_became_active":"2023-11-29T11:12:52.365622+0000","last_became_peered":"2023-11-29T11:12:52.365622+0000","last_unstale":"2023-11-29T11:12:56.373881+0000","last_undegraded":"2023-11-29T11:12:56.373881+0000","last_fullsized":"2023-11-29T11:12:56.373881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:29.530084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399062+0000","last_change":"2023-11-29T11:12:56.391160+0000","last_active":"2023-11-29T11:12:56.399062+0000","last_peered":"2023-11-29T11:12:56.399062+0000","last_clean":"2023-11-29T11:12:56.399062+0000","last_became_active":"2023-11-29T11:12:56.390771+0000","last_became_peered":"2023-11-29T11:12:56.390771+0000","last_unstale":"2023-11-29T11:12:56.399062+0000","last_undegraded":"2023-11-29T11:12:56.399062+0000","last_fullsized":"2023-11-29T11:12:56.399062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:28:19.746284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.386885+0000","last_change":"2023-11-29T11:12:51.987080+0000","last_active":"2023-11-29T11:12:56.386885+0000","last_peered":"2023-11-29T11:12:56.386885+0000","last_clean":"2023-11-29T11:12:56.386885+0000","last_became_active":"2023-11-29T11:12:51.986730+0000","last_became_peered":"2023-11-29T11:12:51.986730+0000","last_unstale":"2023-11-29T11:12:56.386885+0000","last_undegraded":"2023-11-29T11:12:56.386885+0000","last_fullsized":"2023-11-29T11:12:56.386885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:01.519677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385050+0000","last_change":"2023-11-29T11:12:52.367490+0000","last_active":"2023-11-29T11:12:56.385050+0000","last_peered":"2023-11-29T11:12:56.385050+0000","last_clean":"2023-11-29T11:12:56.385050+0000","last_became_active":"2023-11-29T11:12:52.367253+0000","last_became_peered":"2023-11-29T11:12:52.367253+0000","last_unstale":"2023-11-29T11:12:56.385050+0000","last_undegraded":"2023-11-29T11:12:56.385050+0000","last_fullsized":"2023-11-29T11:12:56.385050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:12.463644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.395950+0000","last_change":"2023-11-29T11:12:56.390849+0000","last_active":"2023-11-29T11:12:56.395950+0000","last_peered":"2023-11-29T11:12:56.395950+0000","last_clean":"2023-11-29T11:12:56.395950+0000","last_became_active":"2023-11-29T11:12:56.390401+0000","last_became_peered":"2023-11-29T11:12:56.390401+0000","last_unstale":"2023-11-29T11:12:56.395950+0000","last_undegraded":"2023-11-29T11:12:56.395950+0000","last_fullsized":"2023-11-29T11:12:56.395950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368794+0000","last_change":"2023-11-29T11:12:51.985928+0000","last_active":"2023-11-29T11:12:56.368794+0000","last_peered":"2023-11-29T11:12:56.368794+0000","last_clean":"2023-11-29T11:12:56.368794+0000","last_became_active":"2023-11-29T11:12:51.985417+0000","last_became_peered":"2023-11-29T11:12:51.985417+0000","last_unstale":"2023-11-29T11:12:56.368794+0000","last_undegraded":"2023-11-29T11:12:56.368794+0000","last_fullsized":"2023-11-29T11:12:56.368794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370624+0000","last_change":"2023-11-29T11:12:52.359182+0000","last_active":"2023-11-29T11:12:56.370624+0000","last_peered":"2023-11-29T11:12:56.370624+0000","last_clean":"2023-11-29T11:12:56.370624+0000","last_became_active":"2023-11-29T11:12:52.358870+0000","last_became_peered":"2023-11-29T11:12:52.358870+0000","last_unstale":"2023-11-29T11:12:56.370624+0000","last_undegraded":"2023-11-29T11:12:56.370624+0000","last_fullsized":"2023-11-29T11:12:56.370624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:47:38.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368358+0000","last_change":"2023-11-29T11:12:52.357426+0000","last_active":"2023-11-29T11:12:56.368358+0000","last_peered":"2023-11-29T11:12:56.368358+0000","last_clean":"2023-11-29T11:12:56.368358+0000","last_became_active":"2023-11-29T11:12:52.357165+0000","last_became_peered":"2023-11-29T11:12:52.357165+0000","last_unstale":"2023-11-29T11:12:56.368358+0000","last_undegraded":"2023-11-29T11:12:56.368358+0000","last_fullsized":"2023-11-29T11:12:56.368358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:37.215861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384878+0000","last_change":"2023-11-29T11:12:51.981423+0000","last_active":"2023-11-29T11:12:56.384878+0000","last_peered":"2023-11-29T11:12:56.384878+0000","last_clean":"2023-11-29T11:12:56.384878+0000","last_became_active":"2023-11-29T11:12:51.981102+0000","last_became_peered":"2023-11-29T11:12:51.981102+0000","last_unstale":"2023-11-29T11:12:56.384878+0000","last_undegraded":"2023-11-29T11:12:56.384878+0000","last_fullsized":"2023-11-29T11:12:56.384878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:34:18.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.393001+0000","last_change":"2023-11-29T11:12:56.388444+0000","last_active":"2023-11-29T11:12:56.393001+0000","last_peered":"2023-11-29T11:12:56.393001+0000","last_clean":"2023-11-29T11:12:56.393001+0000","last_became_active":"2023-11-29T11:12:56.388033+0000","last_became_peered":"2023-11-29T11:12:56.388033+0000","last_unstale":"2023-11-29T11:12:56.393001+0000","last_undegraded":"2023-11-29T11:12:56.393001+0000","last_fullsized":"2023-11-29T11:12:56.393001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:29.691459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368852+0000","last_change":"2023-11-29T11:12:52.365695+0000","last_active":"2023-11-29T11:12:56.368852+0000","last_peered":"2023-11-29T11:12:56.368852+0000","last_clean":"2023-11-29T11:12:56.368852+0000","last_became_active":"2023-11-29T11:12:52.365402+0000","last_became_peered":"2023-11-29T11:12:52.365402+0000","last_unstale":"2023-11-29T11:12:56.368852+0000","last_undegraded":"2023-11-29T11:12:56.368852+0000","last_fullsized":"2023-11-29T11:12:56.368852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384074+0000","last_change":"2023-11-29T11:12:51.978492+0000","last_active":"2023-11-29T11:12:56.384074+0000","last_peered":"2023-11-29T11:12:56.384074+0000","last_clean":"2023-11-29T11:12:56.384074+0000","last_became_active":"2023-11-29T11:12:51.978133+0000","last_became_peered":"2023-11-29T11:12:51.978133+0000","last_unstale":"2023-11-29T11:12:56.384074+0000","last_undegraded":"2023-11-29T11:12:56.384074+0000","last_fullsized":"2023-11-29T11:12:56.384074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:24:13.769187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401152+0000","last_change":"2023-11-29T11:12:56.393246+0000","last_active":"2023-11-29T11:12:56.401152+0000","last_peered":"2023-11-29T11:12:56.401152+0000","last_clean":"2023-11-29T11:12:56.401152+0000","last_became_active":"2023-11-29T11:12:56.392790+0000","last_became_peered":"2023-11-29T11:12:56.392790+0000","last_unstale":"2023-11-29T11:12:56.401152+0000","last_undegraded":"2023-11-29T11:12:56.401152+0000","last_fullsized":"2023-11-29T11:12:56.401152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:06:44.806489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380906+0000","last_change":"2023-11-29T11:12:51.986109+0000","last_active":"2023-11-29T11:12:56.380906+0000","last_peered":"2023-11-29T11:12:56.380906+0000","last_clean":"2023-11-29T11:12:56.380906+0000","last_became_active":"2023-11-29T11:12:51.985826+0000","last_became_peered":"2023-11-29T11:12:51.985826+0000","last_unstale":"2023-11-29T11:12:56.380906+0000","last_undegraded":"2023-11-29T11:12:56.380906+0000","last_fullsized":"2023-11-29T11:12:56.380906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:02:48.630613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387087+0000","last_change":"2023-11-29T11:12:52.356463+0000","last_active":"2023-11-29T11:12:56.387087+0000","last_peered":"2023-11-29T11:12:56.387087+0000","last_clean":"2023-11-29T11:12:56.387087+0000","last_became_active":"2023-11-29T11:12:52.356197+0000","last_became_peered":"2023-11-29T11:12:52.356197+0000","last_unstale":"2023-11-29T11:12:56.387087+0000","last_undegraded":"2023-11-29T11:12:56.387087+0000","last_fullsized":"2023-11-29T11:12:56.387087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:24:54.414088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400777+0000","last_change":"2023-11-29T11:12:56.390106+0000","last_active":"2023-11-29T11:12:56.400777+0000","last_peered":"2023-11-29T11:12:56.400777+0000","last_clean":"2023-11-29T11:12:56.400777+0000","last_became_active":"2023-11-29T11:12:56.389286+0000","last_became_peered":"2023-11-29T11:12:56.389286+0000","last_unstale":"2023-11-29T11:12:56.400777+0000","last_undegraded":"2023-11-29T11:12:56.400777+0000","last_fullsized":"2023-11-29T11:12:56.400777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:20:15.664819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'9","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-29T11:13:01.224105+0000","last_change":"2023-11-29T11:12:51.981433+0000","last_active":"2023-11-29T11:13:01.224105+0000","last_peered":"2023-11-29T11:13:01.224105+0000","last_clean":"2023-11-29T11:13:01.224105+0000","last_became_active":"2023-11-29T11:12:51.981169+0000","last_became_peered":"2023-11-29T11:12:51.981169+0000","last_unstale":"2023-11-29T11:13:01.224105+0000","last_undegraded":"2023-11-29T11:13:01.224105+0000","last_fullsized":"2023-11-29T11:13:01.224105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380175+0000","last_change":"2023-11-29T11:12:52.372116+0000","last_active":"2023-11-29T11:12:56.380175+0000","last_peered":"2023-11-29T11:12:56.380175+0000","last_clean":"2023-11-29T11:12:56.380175+0000","last_became_active":"2023-11-29T11:12:52.371831+0000","last_became_peered":"2023-11-29T11:12:52.371831+0000","last_unstale":"2023-11-29T11:12:56.380175+0000","last_undegraded":"2023-11-29T11:12:56.380175+0000","last_fullsized":"2023-11-29T11:12:56.380175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.396928+0000","last_change":"2023-11-29T11:12:56.391717+0000","last_active":"2023-11-29T11:12:56.396928+0000","last_peered":"2023-11-29T11:12:56.396928+0000","last_clean":"2023-11-29T11:12:56.396928+0000","last_became_active":"2023-11-29T11:12:56.391290+0000","last_became_peered":"2023-11-29T11:12:56.391290+0000","last_unstale":"2023-11-29T11:12:56.396928+0000","last_undegraded":"2023-11-29T11:12:56.396928+0000","last_fullsized":"2023-11-29T11:12:56.396928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:42:59.881221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387181+0000","last_change":"2023-11-29T11:12:52.352949+0000","last_active":"2023-11-29T11:12:56.387181+0000","last_peered":"2023-11-29T11:12:56.387181+0000","last_clean":"2023-11-29T11:12:56.387181+0000","last_became_active":"2023-11-29T11:12:52.350912+0000","last_became_peered":"2023-11-29T11:12:52.350912+0000","last_unstale":"2023-11-29T11:12:56.387181+0000","last_undegraded":"2023-11-29T11:12:56.387181+0000","last_fullsized":"2023-11-29T11:12:56.387181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:42.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370718+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:12:56.370718+0000","last_peered":"2023-11-29T11:12:56.370718+0000","last_clean":"2023-11-29T11:12:56.370718+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:12:56.370718+0000","last_undegraded":"2023-11-29T11:12:56.370718+0000","last_fullsized":"2023-11-29T11:12:56.370718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384623+0000","last_change":"2023-11-29T11:12:51.986760+0000","last_active":"2023-11-29T11:12:56.384623+0000","last_peered":"2023-11-29T11:12:56.384623+0000","last_clean":"2023-11-29T11:12:56.384623+0000","last_became_active":"2023-11-29T11:12:51.986475+0000","last_became_peered":"2023-11-29T11:12:51.986475+0000","last_unstale":"2023-11-29T11:12:56.384623+0000","last_undegraded":"2023-11-29T11:12:56.384623+0000","last_fullsized":"2023-11-29T11:12:56.384623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:41:14.704468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400660+0000","last_change":"2023-11-29T11:12:56.395998+0000","last_active":"2023-11-29T11:12:56.400660+0000","last_peered":"2023-11-29T11:12:56.400660+0000","last_clean":"2023-11-29T11:12:56.400660+0000","last_became_active":"2023-11-29T11:12:56.395301+0000","last_became_peered":"2023-11-29T11:12:56.395301+0000","last_unstale":"2023-11-29T11:12:56.400660+0000","last_undegraded":"2023-11-29T11:12:56.400660+0000","last_fullsized":"2023-11-29T11:12:56.400660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:05.548254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385217+0000","last_change":"2023-11-29T11:12:52.359555+0000","last_active":"2023-11-29T11:12:56.385217+0000","last_peered":"2023-11-29T11:12:56.385217+0000","last_clean":"2023-11-29T11:12:56.385217+0000","last_became_active":"2023-11-29T11:12:52.359291+0000","last_became_peered":"2023-11-29T11:12:52.359291+0000","last_unstale":"2023-11-29T11:12:56.385217+0000","last_undegraded":"2023-11-29T11:12:56.385217+0000","last_fullsized":"2023-11-29T11:12:56.385217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:42.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370551+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:12:56.370551+0000","last_peered":"2023-11-29T11:12:56.370551+0000","last_clean":"2023-11-29T11:12:56.370551+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:12:56.370551+0000","last_undegraded":"2023-11-29T11:12:56.370551+0000","last_fullsized":"2023-11-29T11:12:56.370551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387434+0000","last_change":"2023-11-29T11:12:51.981231+0000","last_active":"2023-11-29T11:12:56.387434+0000","last_peered":"2023-11-29T11:12:56.387434+0000","last_clean":"2023-11-29T11:12:56.387434+0000","last_became_active":"2023-11-29T11:12:51.980989+0000","last_became_peered":"2023-11-29T11:12:51.980989+0000","last_unstale":"2023-11-29T11:12:56.387434+0000","last_undegraded":"2023-11-29T11:12:56.387434+0000","last_fullsized":"2023-11-29T11:12:56.387434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:34:18.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.393030+0000","last_change":"2023-11-29T11:12:56.389787+0000","last_active":"2023-11-29T11:12:56.393030+0000","last_peered":"2023-11-29T11:12:56.393030+0000","last_clean":"2023-11-29T11:12:56.393030+0000","last_became_active":"2023-11-29T11:12:56.389396+0000","last_became_peered":"2023-11-29T11:12:56.389396+0000","last_unstale":"2023-11-29T11:12:56.393030+0000","last_undegraded":"2023-11-29T11:12:56.393030+0000","last_fullsized":"2023-11-29T11:12:56.393030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:12:42.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368569+0000","last_change":"2023-11-29T11:12:52.365743+0000","last_active":"2023-11-29T11:12:56.368569+0000","last_peered":"2023-11-29T11:12:56.368569+0000","last_clean":"2023-11-29T11:12:56.368569+0000","last_became_active":"2023-11-29T11:12:52.365463+0000","last_became_peered":"2023-11-29T11:12:52.365463+0000","last_unstale":"2023-11-29T11:12:56.368569+0000","last_undegraded":"2023-11-29T11:12:56.368569+0000","last_fullsized":"2023-11-29T11:12:56.368569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381399+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:12:56.381399+0000","last_peered":"2023-11-29T11:12:56.381399+0000","last_clean":"2023-11-29T11:12:56.381399+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:12:56.381399+0000","last_undegraded":"2023-11-29T11:12:56.381399+0000","last_fullsized":"2023-11-29T11:12:56.381399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374706+0000","last_change":"2023-11-29T11:12:51.984839+0000","last_active":"2023-11-29T11:12:56.374706+0000","last_peered":"2023-11-29T11:12:56.374706+0000","last_clean":"2023-11-29T11:12:56.374706+0000","last_became_active":"2023-11-29T11:12:51.984536+0000","last_became_peered":"2023-11-29T11:12:51.984536+0000","last_unstale":"2023-11-29T11:12:56.374706+0000","last_undegraded":"2023-11-29T11:12:56.374706+0000","last_fullsized":"2023-11-29T11:12:56.374706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397672+0000","last_change":"2023-11-29T11:12:56.391636+0000","last_active":"2023-11-29T11:12:56.397672+0000","last_peered":"2023-11-29T11:12:56.397672+0000","last_clean":"2023-11-29T11:12:56.397672+0000","last_became_active":"2023-11-29T11:12:56.389855+0000","last_became_peered":"2023-11-29T11:12:56.389855+0000","last_unstale":"2023-11-29T11:12:56.397672+0000","last_undegraded":"2023-11-29T11:12:56.397672+0000","last_fullsized":"2023-11-29T11:12:56.397672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:00:51.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382757+0000","last_change":"2023-11-29T11:12:52.361676+0000","last_active":"2023-11-29T11:12:56.382757+0000","last_peered":"2023-11-29T11:12:56.382757+0000","last_clean":"2023-11-29T11:12:56.382757+0000","last_became_active":"2023-11-29T11:12:52.361408+0000","last_became_peered":"2023-11-29T11:12:52.361408+0000","last_unstale":"2023-11-29T11:12:56.382757+0000","last_undegraded":"2023-11-29T11:12:56.382757+0000","last_fullsized":"2023-11-29T11:12:56.382757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:41:41.650921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.371995+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:12:56.371995+0000","last_peered":"2023-11-29T11:12:56.371995+0000","last_clean":"2023-11-29T11:12:56.371995+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:12:56.371995+0000","last_undegraded":"2023-11-29T11:12:56.371995+0000","last_fullsized":"2023-11-29T11:12:56.371995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.956128+0000","last_change":"2023-11-29T11:12:51.981177+0000","last_active":"2023-11-29T11:12:56.956128+0000","last_peered":"2023-11-29T11:12:56.956128+0000","last_clean":"2023-11-29T11:12:56.956128+0000","last_became_active":"2023-11-29T11:12:51.980121+0000","last_became_peered":"2023-11-29T11:12:51.980121+0000","last_unstale":"2023-11-29T11:12:56.956128+0000","last_undegraded":"2023-11-29T11:12:56.956128+0000","last_fullsized":"2023-11-29T11:12:56.956128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400853+0000","last_change":"2023-11-29T11:12:56.394701+0000","last_active":"2023-11-29T11:12:56.400853+0000","last_peered":"2023-11-29T11:12:56.400853+0000","last_clean":"2023-11-29T11:12:56.400853+0000","last_became_active":"2023-11-29T11:12:56.394337+0000","last_became_peered":"2023-11-29T11:12:56.394337+0000","last_unstale":"2023-11-29T11:12:56.400853+0000","last_undegraded":"2023-11-29T11:12:56.400853+0000","last_fullsized":"2023-11-29T11:12:56.400853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:04:27.759167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385139+0000","last_change":"2023-11-29T11:12:52.365115+0000","last_active":"2023-11-29T11:12:56.385139+0000","last_peered":"2023-11-29T11:12:56.385139+0000","last_clean":"2023-11-29T11:12:56.385139+0000","last_became_active":"2023-11-29T11:12:52.364854+0000","last_became_peered":"2023-11-29T11:12:52.364854+0000","last_unstale":"2023-11-29T11:12:56.385139+0000","last_undegraded":"2023-11-29T11:12:56.385139+0000","last_fullsized":"2023-11-29T11:12:56.385139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383734+0000","last_change":"2023-11-29T11:12:51.983363+0000","last_active":"2023-11-29T11:12:56.383734+0000","last_peered":"2023-11-29T11:12:56.383734+0000","last_clean":"2023-11-29T11:12:56.383734+0000","last_became_active":"2023-11-29T11:12:51.983081+0000","last_became_peered":"2023-11-29T11:12:51.983081+0000","last_unstale":"2023-11-29T11:12:56.383734+0000","last_undegraded":"2023-11-29T11:12:56.383734+0000","last_fullsized":"2023-11-29T11:12:56.383734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381251+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:12:56.381251+0000","last_peered":"2023-11-29T11:12:56.381251+0000","last_clean":"2023-11-29T11:12:56.381251+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:12:56.381251+0000","last_undegraded":"2023-11-29T11:12:56.381251+0000","last_fullsized":"2023-11-29T11:12:56.381251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387003+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:12:56.387003+0000","last_peered":"2023-11-29T11:12:56.387003+0000","last_clean":"2023-11-29T11:12:56.387003+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:12:56.387003+0000","last_undegraded":"2023-11-29T11:12:56.387003+0000","last_fullsized":"2023-11-29T11:12:56.387003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402840+0000","last_change":"2023-11-29T11:12:56.396251+0000","last_active":"2023-11-29T11:12:56.402840+0000","last_peered":"2023-11-29T11:12:56.402840+0000","last_clean":"2023-11-29T11:12:56.402840+0000","last_became_active":"2023-11-29T11:12:56.395546+0000","last_became_peered":"2023-11-29T11:12:56.395546+0000","last_unstale":"2023-11-29T11:12:56.402840+0000","last_undegraded":"2023-11-29T11:12:56.402840+0000","last_fullsized":"2023-11-29T11:12:56.402840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:58:06.239886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387775+0000","last_change":"2023-11-29T11:12:52.350524+0000","last_active":"2023-11-29T11:12:56.387775+0000","last_peered":"2023-11-29T11:12:56.387775+0000","last_clean":"2023-11-29T11:12:56.387775+0000","last_became_active":"2023-11-29T11:12:52.350253+0000","last_became_peered":"2023-11-29T11:12:52.350253+0000","last_unstale":"2023-11-29T11:12:56.387775+0000","last_undegraded":"2023-11-29T11:12:56.387775+0000","last_fullsized":"2023-11-29T11:12:56.387775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:44:33.817076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384800+0000","last_change":"2023-11-29T11:12:51.980818+0000","last_active":"2023-11-29T11:12:56.384800+0000","last_peered":"2023-11-29T11:12:56.384800+0000","last_clean":"2023-11-29T11:12:56.384800+0000","last_became_active":"2023-11-29T11:12:51.980515+0000","last_became_peered":"2023-11-29T11:12:51.980515+0000","last_unstale":"2023-11-29T11:12:56.384800+0000","last_undegraded":"2023-11-29T11:12:56.384800+0000","last_fullsized":"2023-11-29T11:12:56.384800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:32.597395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382028+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:12:56.382028+0000","last_peered":"2023-11-29T11:12:56.382028+0000","last_clean":"2023-11-29T11:12:56.382028+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:12:56.382028+0000","last_undegraded":"2023-11-29T11:12:56.382028+0000","last_fullsized":"2023-11-29T11:12:56.382028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399365+0000","last_change":"2023-11-29T11:12:56.392369+0000","last_active":"2023-11-29T11:12:56.399365+0000","last_peered":"2023-11-29T11:12:56.399365+0000","last_clean":"2023-11-29T11:12:56.399365+0000","last_became_active":"2023-11-29T11:12:56.392008+0000","last_became_peered":"2023-11-29T11:12:56.392008+0000","last_unstale":"2023-11-29T11:12:56.399365+0000","last_undegraded":"2023-11-29T11:12:56.399365+0000","last_fullsized":"2023-11-29T11:12:56.399365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:20:17.395683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387330+0000","last_change":"2023-11-29T11:12:52.356824+0000","last_active":"2023-11-29T11:12:56.387330+0000","last_peered":"2023-11-29T11:12:56.387330+0000","last_clean":"2023-11-29T11:12:56.387330+0000","last_became_active":"2023-11-29T11:12:52.356541+0000","last_became_peered":"2023-11-29T11:12:52.356541+0000","last_unstale":"2023-11-29T11:12:56.387330+0000","last_undegraded":"2023-11-29T11:12:56.387330+0000","last_fullsized":"2023-11-29T11:12:56.387330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380364+0000","last_change":"2023-11-29T11:12:51.978041+0000","last_active":"2023-11-29T11:12:56.380364+0000","last_peered":"2023-11-29T11:12:56.380364+0000","last_clean":"2023-11-29T11:12:56.380364+0000","last_became_active":"2023-11-29T11:12:51.976160+0000","last_became_peered":"2023-11-29T11:12:51.976160+0000","last_unstale":"2023-11-29T11:12:56.380364+0000","last_undegraded":"2023-11-29T11:12:56.380364+0000","last_fullsized":"2023-11-29T11:12:56.380364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:41.431586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382670+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:12:56.382670+0000","last_peered":"2023-11-29T11:12:56.382670+0000","last_clean":"2023-11-29T11:12:56.382670+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:12:56.382670+0000","last_undegraded":"2023-11-29T11:12:56.382670+0000","last_fullsized":"2023-11-29T11:12:56.382670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400638+0000","last_change":"2023-11-29T11:12:56.395788+0000","last_active":"2023-11-29T11:12:56.400638+0000","last_peered":"2023-11-29T11:12:56.400638+0000","last_clean":"2023-11-29T11:12:56.400638+0000","last_became_active":"2023-11-29T11:12:56.395401+0000","last_became_peered":"2023-11-29T11:12:56.395401+0000","last_unstale":"2023-11-29T11:12:56.400638+0000","last_undegraded":"2023-11-29T11:12:56.400638+0000","last_fullsized":"2023-11-29T11:12:56.400638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:31:52.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370253+0000","last_change":"2023-11-29T11:12:52.368029+0000","last_active":"2023-11-29T11:12:56.370253+0000","last_peered":"2023-11-29T11:12:56.370253+0000","last_clean":"2023-11-29T11:12:56.370253+0000","last_became_active":"2023-11-29T11:12:52.366907+0000","last_became_peered":"2023-11-29T11:12:52.366907+0000","last_unstale":"2023-11-29T11:12:56.370253+0000","last_undegraded":"2023-11-29T11:12:56.370253+0000","last_fullsized":"2023-11-29T11:12:56.370253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:00:46.482908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368761+0000","last_change":"2023-11-29T11:12:51.986466+0000","last_active":"2023-11-29T11:12:56.368761+0000","last_peered":"2023-11-29T11:12:56.368761+0000","last_clean":"2023-11-29T11:12:56.368761+0000","last_became_active":"2023-11-29T11:12:51.986194+0000","last_became_peered":"2023-11-29T11:12:51.986194+0000","last_unstale":"2023-11-29T11:12:56.368761+0000","last_undegraded":"2023-11-29T11:12:56.368761+0000","last_fullsized":"2023-11-29T11:12:56.368761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381335+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:12:56.381335+0000","last_peered":"2023-11-29T11:12:56.381335+0000","last_clean":"2023-11-29T11:12:56.381335+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:12:56.381335+0000","last_undegraded":"2023-11-29T11:12:56.381335+0000","last_fullsized":"2023-11-29T11:12:56.381335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401333+0000","last_change":"2023-11-29T11:12:56.396640+0000","last_active":"2023-11-29T11:12:56.401333+0000","last_peered":"2023-11-29T11:12:56.401333+0000","last_clean":"2023-11-29T11:12:56.401333+0000","last_became_active":"2023-11-29T11:12:56.396277+0000","last_became_peered":"2023-11-29T11:12:56.396277+0000","last_unstale":"2023-11-29T11:12:56.401333+0000","last_undegraded":"2023-11-29T11:12:56.401333+0000","last_fullsized":"2023-11-29T11:12:56.401333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:31:52.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387675+0000","last_change":"2023-11-29T11:12:52.365021+0000","last_active":"2023-11-29T11:12:56.387675+0000","last_peered":"2023-11-29T11:12:56.387675+0000","last_clean":"2023-11-29T11:12:56.387675+0000","last_became_active":"2023-11-29T11:12:52.364752+0000","last_became_peered":"2023-11-29T11:12:52.364752+0000","last_unstale":"2023-11-29T11:12:56.387675+0000","last_undegraded":"2023-11-29T11:12:56.387675+0000","last_fullsized":"2023-11-29T11:12:56.387675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:12.463644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369013+0000","last_change":"2023-11-29T11:12:51.984597+0000","last_active":"2023-11-29T11:12:56.369013+0000","last_peered":"2023-11-29T11:12:56.369013+0000","last_clean":"2023-11-29T11:12:56.369013+0000","last_became_active":"2023-11-29T11:12:51.984208+0000","last_became_peered":"2023-11-29T11:12:51.984208+0000","last_unstale":"2023-11-29T11:12:56.369013+0000","last_undegraded":"2023-11-29T11:12:56.369013+0000","last_fullsized":"2023-11-29T11:12:56.369013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:24:12.113243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397643+0000","last_change":"2023-11-29T11:12:56.390938+0000","last_active":"2023-11-29T11:12:56.397643+0000","last_peered":"2023-11-29T11:12:56.397643+0000","last_clean":"2023-11-29T11:12:56.397643+0000","last_became_active":"2023-11-29T11:12:56.390579+0000","last_became_peered":"2023-11-29T11:12:56.390579+0000","last_unstale":"2023-11-29T11:12:56.397643+0000","last_undegraded":"2023-11-29T11:12:56.397643+0000","last_fullsized":"2023-11-29T11:12:56.397643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:51:56.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380950+0000","last_change":"2023-11-29T11:12:52.371660+0000","last_active":"2023-11-29T11:12:56.380950+0000","last_peered":"2023-11-29T11:12:56.380950+0000","last_clean":"2023-11-29T11:12:56.380950+0000","last_became_active":"2023-11-29T11:12:52.371313+0000","last_became_peered":"2023-11-29T11:12:52.371313+0000","last_unstale":"2023-11-29T11:12:56.380950+0000","last_undegraded":"2023-11-29T11:12:56.380950+0000","last_fullsized":"2023-11-29T11:12:56.380950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382856+0000","last_change":"2023-11-29T11:12:51.980977+0000","last_active":"2023-11-29T11:12:56.382856+0000","last_peered":"2023-11-29T11:12:56.382856+0000","last_clean":"2023-11-29T11:12:56.382856+0000","last_became_active":"2023-11-29T11:12:51.980717+0000","last_became_peered":"2023-11-29T11:12:51.980717+0000","last_unstale":"2023-11-29T11:12:56.382856+0000","last_undegraded":"2023-11-29T11:12:56.382856+0000","last_fullsized":"2023-11-29T11:12:56.382856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402799+0000","last_change":"2023-11-29T11:12:56.395925+0000","last_active":"2023-11-29T11:12:56.402799+0000","last_peered":"2023-11-29T11:12:56.402799+0000","last_clean":"2023-11-29T11:12:56.402799+0000","last_became_active":"2023-11-29T11:12:56.393269+0000","last_became_peered":"2023-11-29T11:12:56.393269+0000","last_unstale":"2023-11-29T11:12:56.402799+0000","last_undegraded":"2023-11-29T11:12:56.402799+0000","last_fullsized":"2023-11-29T11:12:56.402799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:47.489953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381227+0000","last_change":"2023-11-29T11:12:52.356759+0000","last_active":"2023-11-29T11:12:56.381227+0000","last_peered":"2023-11-29T11:12:56.381227+0000","last_clean":"2023-11-29T11:12:56.381227+0000","last_became_active":"2023-11-29T11:12:52.356301+0000","last_became_peered":"2023-11-29T11:12:52.356301+0000","last_unstale":"2023-11-29T11:12:56.381227+0000","last_undegraded":"2023-11-29T11:12:56.381227+0000","last_fullsized":"2023-11-29T11:12:56.381227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:24:15.072528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369086+0000","last_change":"2023-11-29T11:12:51.981944+0000","last_active":"2023-11-29T11:12:56.369086+0000","last_peered":"2023-11-29T11:12:56.369086+0000","last_clean":"2023-11-29T11:12:56.369086+0000","last_became_active":"2023-11-29T11:12:51.981620+0000","last_became_peered":"2023-11-29T11:12:51.981620+0000","last_unstale":"2023-11-29T11:12:56.369086+0000","last_undegraded":"2023-11-29T11:12:56.369086+0000","last_fullsized":"2023-11-29T11:12:56.369086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:54.630966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397493+0000","last_change":"2023-11-29T11:12:56.393149+0000","last_active":"2023-11-29T11:12:56.397493+0000","last_peered":"2023-11-29T11:12:56.397493+0000","last_clean":"2023-11-29T11:12:56.397493+0000","last_became_active":"2023-11-29T11:12:56.392696+0000","last_became_peered":"2023-11-29T11:12:56.392696+0000","last_unstale":"2023-11-29T11:12:56.397493+0000","last_undegraded":"2023-11-29T11:12:56.397493+0000","last_fullsized":"2023-11-29T11:12:56.397493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:53:46.404557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380298+0000","last_change":"2023-11-29T11:12:52.369003+0000","last_active":"2023-11-29T11:12:56.380298+0000","last_peered":"2023-11-29T11:12:56.380298+0000","last_clean":"2023-11-29T11:12:56.380298+0000","last_became_active":"2023-11-29T11:12:52.368615+0000","last_became_peered":"2023-11-29T11:12:52.368615+0000","last_unstale":"2023-11-29T11:12:56.380298+0000","last_undegraded":"2023-11-29T11:12:56.380298+0000","last_fullsized":"2023-11-29T11:12:56.380298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:23:46.973175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370121+0000","last_change":"2023-11-29T11:12:51.985684+0000","last_active":"2023-11-29T11:12:56.370121+0000","last_peered":"2023-11-29T11:12:56.370121+0000","last_clean":"2023-11-29T11:12:56.370121+0000","last_became_active":"2023-11-29T11:12:51.985365+0000","last_became_peered":"2023-11-29T11:12:51.985365+0000","last_unstale":"2023-11-29T11:12:56.370121+0000","last_undegraded":"2023-11-29T11:12:56.370121+0000","last_fullsized":"2023-11-29T11:12:56.370121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:41.431586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399198+0000","last_change":"2023-11-29T11:12:56.390266+0000","last_active":"2023-11-29T11:12:56.399198+0000","last_peered":"2023-11-29T11:12:56.399198+0000","last_clean":"2023-11-29T11:12:56.399198+0000","last_became_active":"2023-11-29T11:12:56.389828+0000","last_became_peered":"2023-11-29T11:12:56.389828+0000","last_unstale":"2023-11-29T11:12:56.399198+0000","last_undegraded":"2023-11-29T11:12:56.399198+0000","last_fullsized":"2023-11-29T11:12:56.399198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:36.814765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385128+0000","last_change":"2023-11-29T11:12:52.359364+0000","last_active":"2023-11-29T11:12:56.385128+0000","last_peered":"2023-11-29T11:12:56.385128+0000","last_clean":"2023-11-29T11:12:56.385128+0000","last_became_active":"2023-11-29T11:12:52.358958+0000","last_became_peered":"2023-11-29T11:12:52.358958+0000","last_unstale":"2023-11-29T11:12:56.385128+0000","last_undegraded":"2023-11-29T11:12:56.385128+0000","last_fullsized":"2023-11-29T11:12:56.385128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383366+0000","last_change":"2023-11-29T11:12:51.986410+0000","last_active":"2023-11-29T11:12:56.383366+0000","last_peered":"2023-11-29T11:12:56.383366+0000","last_clean":"2023-11-29T11:12:56.383366+0000","last_became_active":"2023-11-29T11:12:51.986045+0000","last_became_peered":"2023-11-29T11:12:51.986045+0000","last_unstale":"2023-11-29T11:12:56.383366+0000","last_undegraded":"2023-11-29T11:12:56.383366+0000","last_fullsized":"2023-11-29T11:12:56.383366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:06:56.628542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.396923+0000","last_change":"2023-11-29T11:12:56.389886+0000","last_active":"2023-11-29T11:12:56.396923+0000","last_peered":"2023-11-29T11:12:56.396923+0000","last_clean":"2023-11-29T11:12:56.396923+0000","last_became_active":"2023-11-29T11:12:56.389457+0000","last_became_peered":"2023-11-29T11:12:56.389457+0000","last_unstale":"2023-11-29T11:12:56.396923+0000","last_undegraded":"2023-11-29T11:12:56.396923+0000","last_fullsized":"2023-11-29T11:12:56.396923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:32.929777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368896+0000","last_change":"2023-11-29T11:12:52.367726+0000","last_active":"2023-11-29T11:12:56.368896+0000","last_peered":"2023-11-29T11:12:56.368896+0000","last_clean":"2023-11-29T11:12:56.368896+0000","last_became_active":"2023-11-29T11:12:52.366804+0000","last_became_peered":"2023-11-29T11:12:52.366804+0000","last_unstale":"2023-11-29T11:12:56.368896+0000","last_undegraded":"2023-11-29T11:12:56.368896+0000","last_fullsized":"2023-11-29T11:12:56.368896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:17:42.639576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381008+0000","last_change":"2023-11-29T11:12:51.983384+0000","last_active":"2023-11-29T11:12:56.381008+0000","last_peered":"2023-11-29T11:12:56.381008+0000","last_clean":"2023-11-29T11:12:56.381008+0000","last_became_active":"2023-11-29T11:12:51.983089+0000","last_became_peered":"2023-11-29T11:12:51.983089+0000","last_unstale":"2023-11-29T11:12:56.381008+0000","last_undegraded":"2023-11-29T11:12:56.381008+0000","last_fullsized":"2023-11-29T11:12:56.381008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:03:52.716864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399333+0000","last_change":"2023-11-29T11:12:56.391089+0000","last_active":"2023-11-29T11:12:56.399333+0000","last_peered":"2023-11-29T11:12:56.399333+0000","last_clean":"2023-11-29T11:12:56.399333+0000","last_became_active":"2023-11-29T11:12:56.390703+0000","last_became_peered":"2023-11-29T11:12:56.390703+0000","last_unstale":"2023-11-29T11:12:56.399333+0000","last_undegraded":"2023-11-29T11:12:56.399333+0000","last_fullsized":"2023-11-29T11:12:56.399333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:40.615554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379572+0000","last_change":"2023-11-29T11:12:52.360602+0000","last_active":"2023-11-29T11:12:56.379572+0000","last_peered":"2023-11-29T11:12:56.379572+0000","last_clean":"2023-11-29T11:12:56.379572+0000","last_became_active":"2023-11-29T11:12:52.360297+0000","last_became_peered":"2023-11-29T11:12:52.360297+0000","last_unstale":"2023-11-29T11:12:56.379572+0000","last_undegraded":"2023-11-29T11:12:56.379572+0000","last_fullsized":"2023-11-29T11:12:56.379572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:42:56.481528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381711+0000","last_change":"2023-11-29T11:12:51.985395+0000","last_active":"2023-11-29T11:12:56.381711+0000","last_peered":"2023-11-29T11:12:56.381711+0000","last_clean":"2023-11-29T11:12:56.381711+0000","last_became_active":"2023-11-29T11:12:51.985039+0000","last_became_peered":"2023-11-29T11:12:51.985039+0000","last_unstale":"2023-11-29T11:12:56.381711+0000","last_undegraded":"2023-11-29T11:12:56.381711+0000","last_fullsized":"2023-11-29T11:12:56.381711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:47.682887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.404204+0000","last_change":"2023-11-29T11:12:56.398067+0000","last_active":"2023-11-29T11:12:56.404204+0000","last_peered":"2023-11-29T11:12:56.404204+0000","last_clean":"2023-11-29T11:12:56.404204+0000","last_became_active":"2023-11-29T11:12:56.397483+0000","last_became_peered":"2023-11-29T11:12:56.397483+0000","last_unstale":"2023-11-29T11:12:56.404204+0000","last_undegraded":"2023-11-29T11:12:56.404204+0000","last_fullsized":"2023-11-29T11:12:56.404204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:51.701101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382817+0000","last_change":"2023-11-29T11:12:52.356144+0000","last_active":"2023-11-29T11:12:56.382817+0000","last_peered":"2023-11-29T11:12:56.382817+0000","last_clean":"2023-11-29T11:12:56.382817+0000","last_became_active":"2023-11-29T11:12:52.355872+0000","last_became_peered":"2023-11-29T11:12:52.355872+0000","last_unstale":"2023-11-29T11:12:56.382817+0000","last_undegraded":"2023-11-29T11:12:56.382817+0000","last_fullsized":"2023-11-29T11:12:56.382817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:50:29.425278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382282+0000","last_change":"2023-11-29T11:12:51.985298+0000","last_active":"2023-11-29T11:12:56.382282+0000","last_peered":"2023-11-29T11:12:56.382282+0000","last_clean":"2023-11-29T11:12:56.382282+0000","last_became_active":"2023-11-29T11:12:51.984926+0000","last_became_peered":"2023-11-29T11:12:51.984926+0000","last_unstale":"2023-11-29T11:12:56.382282+0000","last_undegraded":"2023-11-29T11:12:56.382282+0000","last_fullsized":"2023-11-29T11:12:56.382282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:36.656157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401387+0000","last_change":"2023-11-29T11:12:56.396907+0000","last_active":"2023-11-29T11:12:56.401387+0000","last_peered":"2023-11-29T11:12:56.401387+0000","last_clean":"2023-11-29T11:12:56.401387+0000","last_became_active":"2023-11-29T11:12:56.396549+0000","last_became_peered":"2023-11-29T11:12:56.396549+0000","last_unstale":"2023-11-29T11:12:56.401387+0000","last_undegraded":"2023-11-29T11:12:56.401387+0000","last_fullsized":"2023-11-29T11:12:56.401387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402989+0000","last_change":"2023-11-29T11:12:56.400298+0000","last_active":"2023-11-29T11:12:56.402989+0000","last_peered":"2023-11-29T11:12:56.402989+0000","last_clean":"2023-11-29T11:12:56.402989+0000","last_became_active":"2023-11-29T11:12:56.399859+0000","last_became_peered":"2023-11-29T11:12:56.399859+0000","last_unstale":"2023-11-29T11:12:56.402989+0000","last_undegraded":"2023-11-29T11:12:56.402989+0000","last_fullsized":"2023-11-29T11:12:56.402989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:58:42.333539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368372+0000","last_change":"2023-11-29T11:12:51.975809+0000","last_active":"2023-11-29T11:12:56.368372+0000","last_peered":"2023-11-29T11:12:56.368372+0000","last_clean":"2023-11-29T11:12:56.368372+0000","last_became_active":"2023-11-29T11:12:51.975519+0000","last_became_peered":"2023-11-29T11:12:51.975519+0000","last_unstale":"2023-11-29T11:12:56.368372+0000","last_undegraded":"2023-11-29T11:12:56.368372+0000","last_fullsized":"2023-11-29T11:12:56.368372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:27:55.174112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374809+0000","last_change":"2023-11-29T11:12:52.365673+0000","last_active":"2023-11-29T11:12:56.374809+0000","last_peered":"2023-11-29T11:12:56.374809+0000","last_clean":"2023-11-29T11:12:56.374809+0000","last_became_active":"2023-11-29T11:12:52.365394+0000","last_became_peered":"2023-11-29T11:12:52.365394+0000","last_unstale":"2023-11-29T11:12:56.374809+0000","last_undegraded":"2023-11-29T11:12:56.374809+0000","last_fullsized":"2023-11-29T11:12:56.374809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400814+0000","last_change":"2023-11-29T11:12:56.391998+0000","last_active":"2023-11-29T11:12:56.400814+0000","last_peered":"2023-11-29T11:12:56.400814+0000","last_clean":"2023-11-29T11:12:56.400814+0000","last_became_active":"2023-11-29T11:12:56.391600+0000","last_became_peered":"2023-11-29T11:12:56.391600+0000","last_unstale":"2023-11-29T11:12:56.400814+0000","last_undegraded":"2023-11-29T11:12:56.400814+0000","last_fullsized":"2023-11-29T11:12:56.400814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:43:20.599589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382545+0000","last_change":"2023-11-29T11:12:51.985807+0000","last_active":"2023-11-29T11:12:56.382545+0000","last_peered":"2023-11-29T11:12:56.382545+0000","last_clean":"2023-11-29T11:12:56.382545+0000","last_became_active":"2023-11-29T11:12:51.985137+0000","last_became_peered":"2023-11-29T11:12:51.985137+0000","last_unstale":"2023-11-29T11:12:56.382545+0000","last_undegraded":"2023-11-29T11:12:56.382545+0000","last_fullsized":"2023-11-29T11:12:56.382545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:50:57.222111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385212+0000","last_change":"2023-11-29T11:12:52.369387+0000","last_active":"2023-11-29T11:12:56.385212+0000","last_peered":"2023-11-29T11:12:56.385212+0000","last_clean":"2023-11-29T11:12:56.385212+0000","last_became_active":"2023-11-29T11:12:52.369149+0000","last_became_peered":"2023-11-29T11:12:52.369149+0000","last_unstale":"2023-11-29T11:12:56.385212+0000","last_undegraded":"2023-11-29T11:12:56.385212+0000","last_fullsized":"2023-11-29T11:12:56.385212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384642+0000","last_change":"2023-11-29T11:12:51.980655+0000","last_active":"2023-11-29T11:12:56.384642+0000","last_peered":"2023-11-29T11:12:56.384642+0000","last_clean":"2023-11-29T11:12:56.384642+0000","last_became_active":"2023-11-29T11:12:51.979444+0000","last_became_peered":"2023-11-29T11:12:51.979444+0000","last_unstale":"2023-11-29T11:12:56.384642+0000","last_undegraded":"2023-11-29T11:12:56.384642+0000","last_fullsized":"2023-11-29T11:12:56.384642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:32.597395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384347+0000","last_change":"2023-11-29T11:12:52.364984+0000","last_active":"2023-11-29T11:12:56.384347+0000","last_peered":"2023-11-29T11:12:56.384347+0000","last_clean":"2023-11-29T11:12:56.384347+0000","last_became_active":"2023-11-29T11:12:52.364646+0000","last_became_peered":"2023-11-29T11:12:52.364646+0000","last_unstale":"2023-11-29T11:12:56.384347+0000","last_undegraded":"2023-11-29T11:12:56.384347+0000","last_fullsized":"2023-11-29T11:12:56.384347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:03:33.514623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400841+0000","last_change":"2023-11-29T11:12:56.391838+0000","last_active":"2023-11-29T11:12:56.400841+0000","last_peered":"2023-11-29T11:12:56.400841+0000","last_clean":"2023-11-29T11:12:56.400841+0000","last_became_active":"2023-11-29T11:12:56.390070+0000","last_became_peered":"2023-11-29T11:12:56.390070+0000","last_unstale":"2023-11-29T11:12:56.400841+0000","last_undegraded":"2023-11-29T11:12:56.400841+0000","last_fullsized":"2023-11-29T11:12:56.400841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:08:17.216618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380625+0000","last_change":"2023-11-29T11:12:51.985954+0000","last_active":"2023-11-29T11:12:56.380625+0000","last_peered":"2023-11-29T11:12:56.380625+0000","last_clean":"2023-11-29T11:12:56.380625+0000","last_became_active":"2023-11-29T11:12:51.984970+0000","last_became_peered":"2023-11-29T11:12:51.984970+0000","last_unstale":"2023-11-29T11:12:56.380625+0000","last_undegraded":"2023-11-29T11:12:56.380625+0000","last_fullsized":"2023-11-29T11:12:56.380625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:05:41.981906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.373298+0000","last_change":"2023-11-29T11:12:52.361389+0000","last_active":"2023-11-29T11:12:56.373298+0000","last_peered":"2023-11-29T11:12:56.373298+0000","last_clean":"2023-11-29T11:12:56.373298+0000","last_became_active":"2023-11-29T11:12:52.361124+0000","last_became_peered":"2023-11-29T11:12:52.361124+0000","last_unstale":"2023-11-29T11:12:56.373298+0000","last_undegraded":"2023-11-29T11:12:56.373298+0000","last_fullsized":"2023-11-29T11:12:56.373298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402966+0000","last_change":"2023-11-29T11:12:56.400109+0000","last_active":"2023-11-29T11:12:56.402966+0000","last_peered":"2023-11-29T11:12:56.402966+0000","last_clean":"2023-11-29T11:12:56.402966+0000","last_became_active":"2023-11-29T11:12:56.397857+0000","last_became_peered":"2023-11-29T11:12:56.397857+0000","last_unstale":"2023-11-29T11:12:56.402966+0000","last_undegraded":"2023-11-29T11:12:56.402966+0000","last_fullsized":"2023-11-29T11:12:56.402966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:48:31.563968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368339+0000","last_change":"2023-11-29T11:12:52.368059+0000","last_active":"2023-11-29T11:12:56.368339+0000","last_peered":"2023-11-29T11:12:56.368339+0000","last_clean":"2023-11-29T11:12:56.368339+0000","last_became_active":"2023-11-29T11:12:52.367696+0000","last_became_peered":"2023-11-29T11:12:52.367696+0000","last_unstale":"2023-11-29T11:12:56.368339+0000","last_undegraded":"2023-11-29T11:12:56.368339+0000","last_fullsized":"2023-11-29T11:12:56.368339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:47:39.444454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368288+0000","last_change":"2023-11-29T11:12:52.357396+0000","last_active":"2023-11-29T11:12:56.368288+0000","last_peered":"2023-11-29T11:12:56.368288+0000","last_clean":"2023-11-29T11:12:56.368288+0000","last_became_active":"2023-11-29T11:12:52.357150+0000","last_became_peered":"2023-11-29T11:12:52.357150+0000","last_unstale":"2023-11-29T11:12:56.368288+0000","last_undegraded":"2023-11-29T11:12:56.368288+0000","last_fullsized":"2023-11-29T11:12:56.368288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:37.039342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381253+0000","last_change":"2023-11-29T11:12:52.371840+0000","last_active":"2023-11-29T11:12:56.381253+0000","last_peered":"2023-11-29T11:12:56.381253+0000","last_clean":"2023-11-29T11:12:56.381253+0000","last_became_active":"2023-11-29T11:12:52.371439+0000","last_became_peered":"2023-11-29T11:12:52.371439+0000","last_unstale":"2023-11-29T11:12:56.381253+0000","last_undegraded":"2023-11-29T11:12:56.381253+0000","last_fullsized":"2023-11-29T11:12:56.381253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:37.039342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369559+0000","last_change":"2023-11-29T11:12:52.364323+0000","last_active":"2023-11-29T11:12:56.369559+0000","last_peered":"2023-11-29T11:12:56.369559+0000","last_clean":"2023-11-29T11:12:56.369559+0000","last_became_active":"2023-11-29T11:12:52.364156+0000","last_became_peered":"2023-11-29T11:12:52.364156+0000","last_unstale":"2023-11-29T11:12:56.369559+0000","last_undegraded":"2023-11-29T11:12:56.369559+0000","last_fullsized":"2023-11-29T11:12:56.369559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387198+0000","last_change":"2023-11-29T11:12:52.365212+0000","last_active":"2023-11-29T11:12:56.387198+0000","last_peered":"2023-11-29T11:12:56.387198+0000","last_clean":"2023-11-29T11:12:56.387198+0000","last_became_active":"2023-11-29T11:12:52.364966+0000","last_became_peered":"2023-11-29T11:12:52.364966+0000","last_unstale":"2023-11-29T11:12:56.387198+0000","last_undegraded":"2023-11-29T11:12:56.387198+0000","last_fullsized":"2023-11-29T11:12:56.387198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:37.666038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383761+0000","last_change":"2023-11-29T11:12:52.365967+0000","last_active":"2023-11-29T11:12:56.383761+0000","last_peered":"2023-11-29T11:12:56.383761+0000","last_clean":"2023-11-29T11:12:56.383761+0000","last_became_active":"2023-11-29T11:12:52.365701+0000","last_became_peered":"2023-11-29T11:12:52.365701+0000","last_unstale":"2023-11-29T11:12:56.383761+0000","last_undegraded":"2023-11-29T11:12:56.383761+0000","last_fullsized":"2023-11-29T11:12:56.383761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:13:33.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387884+0000","last_change":"2023-11-29T11:12:52.357675+0000","last_active":"2023-11-29T11:12:56.387884+0000","last_peered":"2023-11-29T11:12:56.387884+0000","last_clean":"2023-11-29T11:12:56.387884+0000","last_became_active":"2023-11-29T11:12:52.356554+0000","last_became_peered":"2023-11-29T11:12:52.356554+0000","last_unstale":"2023-11-29T11:12:56.387884+0000","last_undegraded":"2023-11-29T11:12:56.387884+0000","last_fullsized":"2023-11-29T11:12:56.387884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:48.692769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387575+0000","last_change":"2023-11-29T11:12:52.355949+0000","last_active":"2023-11-29T11:12:56.387575+0000","last_peered":"2023-11-29T11:12:56.387575+0000","last_clean":"2023-11-29T11:12:56.387575+0000","last_became_active":"2023-11-29T11:12:52.355707+0000","last_became_peered":"2023-11-29T11:12:52.355707+0000","last_unstale":"2023-11-29T11:12:56.387575+0000","last_undegraded":"2023-11-29T11:12:56.387575+0000","last_fullsized":"2023-11-29T11:12:56.387575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:37:21.284939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381161+0000","last_change":"2023-11-29T11:12:52.370097+0000","last_active":"2023-11-29T11:12:56.381161+0000","last_peered":"2023-11-29T11:12:56.381161+0000","last_clean":"2023-11-29T11:12:56.381161+0000","last_became_active":"2023-11-29T11:12:52.369728+0000","last_became_peered":"2023-11-29T11:12:52.369728+0000","last_unstale":"2023-11-29T11:12:56.381161+0000","last_undegraded":"2023-11-29T11:12:56.381161+0000","last_fullsized":"2023-11-29T11:12:56.381161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368286+0000","last_change":"2023-11-29T11:12:52.362045+0000","last_active":"2023-11-29T11:12:56.368286+0000","last_peered":"2023-11-29T11:12:56.368286+0000","last_clean":"2023-11-29T11:12:56.368286+0000","last_became_active":"2023-11-29T11:12:52.361805+0000","last_became_peered":"2023-11-29T11:12:52.361805+0000","last_unstale":"2023-11-29T11:12:56.368286+0000","last_undegraded":"2023-11-29T11:12:56.368286+0000","last_fullsized":"2023-11-29T11:12:56.368286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:33.415072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384559+0000","last_change":"2023-11-29T11:12:52.366412+0000","last_active":"2023-11-29T11:12:56.384559+0000","last_peered":"2023-11-29T11:12:56.384559+0000","last_clean":"2023-11-29T11:12:56.384559+0000","last_became_active":"2023-11-29T11:12:52.366126+0000","last_became_peered":"2023-11-29T11:12:52.366126+0000","last_unstale":"2023-11-29T11:12:56.384559+0000","last_undegraded":"2023-11-29T11:12:56.384559+0000","last_fullsized":"2023-11-29T11:12:56.384559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380508+0000","last_change":"2023-11-29T11:12:52.370183+0000","last_active":"2023-11-29T11:12:56.380508+0000","last_peered":"2023-11-29T11:12:56.380508+0000","last_clean":"2023-11-29T11:12:56.380508+0000","last_became_active":"2023-11-29T11:12:52.369892+0000","last_became_peered":"2023-11-29T11:12:52.369892+0000","last_unstale":"2023-11-29T11:12:56.380508+0000","last_undegraded":"2023-11-29T11:12:56.380508+0000","last_fullsized":"2023-11-29T11:12:56.380508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380211+0000","last_change":"2023-11-29T11:12:52.371780+0000","last_active":"2023-11-29T11:12:56.380211+0000","last_peered":"2023-11-29T11:12:56.380211+0000","last_clean":"2023-11-29T11:12:56.380211+0000","last_became_active":"2023-11-29T11:12:52.371499+0000","last_became_peered":"2023-11-29T11:12:52.371499+0000","last_unstale":"2023-11-29T11:12:56.380211+0000","last_undegraded":"2023-11-29T11:12:56.380211+0000","last_fullsized":"2023-11-29T11:12:56.380211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:29.530084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374798+0000","last_change":"2023-11-29T11:12:52.374635+0000","last_active":"2023-11-29T11:12:56.374798+0000","last_peered":"2023-11-29T11:12:56.374798+0000","last_clean":"2023-11-29T11:12:56.374798+0000","last_became_active":"2023-11-29T11:12:52.374355+0000","last_became_peered":"2023-11-29T11:12:52.374355+0000","last_unstale":"2023-11-29T11:12:56.374798+0000","last_undegraded":"2023-11-29T11:12:56.374798+0000","last_fullsized":"2023-11-29T11:12:56.374798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:33.607277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380843+0000","last_change":"2023-11-29T11:12:52.357862+0000","last_active":"2023-11-29T11:12:56.380843+0000","last_peered":"2023-11-29T11:12:56.380843+0000","last_clean":"2023-11-29T11:12:56.380843+0000","last_became_active":"2023-11-29T11:12:52.357481+0000","last_became_peered":"2023-11-29T11:12:52.357481+0000","last_unstale":"2023-11-29T11:12:56.380843+0000","last_undegraded":"2023-11-29T11:12:56.380843+0000","last_fullsized":"2023-11-29T11:12:56.380843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:48.301408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384706+0000","last_change":"2023-11-29T11:12:52.369352+0000","last_active":"2023-11-29T11:12:56.384706+0000","last_peered":"2023-11-29T11:12:56.384706+0000","last_clean":"2023-11-29T11:12:56.384706+0000","last_became_active":"2023-11-29T11:12:52.369088+0000","last_became_peered":"2023-11-29T11:12:52.369088+0000","last_unstale":"2023-11-29T11:12:56.384706+0000","last_undegraded":"2023-11-29T11:12:56.384706+0000","last_fullsized":"2023-11-29T11:12:56.384706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379103+0000","last_change":"2023-11-29T11:12:52.360140+0000","last_active":"2023-11-29T11:12:56.379103+0000","last_peered":"2023-11-29T11:12:56.379103+0000","last_clean":"2023-11-29T11:12:56.379103+0000","last_became_active":"2023-11-29T11:12:52.359850+0000","last_became_peered":"2023-11-29T11:12:52.359850+0000","last_unstale":"2023-11-29T11:12:56.379103+0000","last_undegraded":"2023-11-29T11:12:56.379103+0000","last_fullsized":"2023-11-29T11:12:56.379103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:58.881146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382463+0000","last_change":"2023-11-29T11:12:52.364490+0000","last_active":"2023-11-29T11:12:56.382463+0000","last_peered":"2023-11-29T11:12:56.382463+0000","last_clean":"2023-11-29T11:12:56.382463+0000","last_became_active":"2023-11-29T11:12:52.364230+0000","last_became_peered":"2023-11-29T11:12:52.364230+0000","last_unstale":"2023-11-29T11:12:56.382463+0000","last_undegraded":"2023-11-29T11:12:56.382463+0000","last_fullsized":"2023-11-29T11:12:56.382463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382900+0000","last_change":"2023-11-29T11:12:52.355458+0000","last_active":"2023-11-29T11:12:56.382900+0000","last_peered":"2023-11-29T11:12:56.382900+0000","last_clean":"2023-11-29T11:12:56.382900+0000","last_became_active":"2023-11-29T11:12:52.355112+0000","last_became_peered":"2023-11-29T11:12:52.355112+0000","last_unstale":"2023-11-29T11:12:56.382900+0000","last_undegraded":"2023-11-29T11:12:56.382900+0000","last_fullsized":"2023-11-29T11:12:56.382900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:15:39.290136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374499+0000","last_change":"2023-11-29T11:12:52.362310+0000","last_active":"2023-11-29T11:12:56.374499+0000","last_peered":"2023-11-29T11:12:56.374499+0000","last_clean":"2023-11-29T11:12:56.374499+0000","last_became_active":"2023-11-29T11:12:52.362044+0000","last_became_peered":"2023-11-29T11:12:52.362044+0000","last_unstale":"2023-11-29T11:12:56.374499+0000","last_undegraded":"2023-11-29T11:12:56.374499+0000","last_fullsized":"2023-11-29T11:12:56.374499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:26.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374336+0000","last_change":"2023-11-29T11:12:52.363035+0000","last_active":"2023-11-29T11:12:56.374336+0000","last_peered":"2023-11-29T11:12:56.374336+0000","last_clean":"2023-11-29T11:12:56.374336+0000","last_became_active":"2023-11-29T11:12:52.362777+0000","last_became_peered":"2023-11-29T11:12:52.362777+0000","last_unstale":"2023-11-29T11:12:56.374336+0000","last_undegraded":"2023-11-29T11:12:56.374336+0000","last_fullsized":"2023-11-29T11:12:56.374336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:42.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381131+0000","last_change":"2023-11-29T11:12:52.357340+0000","last_active":"2023-11-29T11:12:56.381131+0000","last_peered":"2023-11-29T11:12:56.381131+0000","last_clean":"2023-11-29T11:12:56.381131+0000","last_became_active":"2023-11-29T11:12:52.356936+0000","last_became_peered":"2023-11-29T11:12:52.356936+0000","last_unstale":"2023-11-29T11:12:56.381131+0000","last_undegraded":"2023-11-29T11:12:56.381131+0000","last_fullsized":"2023-11-29T11:12:56.381131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:20:13.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383892+0000","last_change":"2023-11-29T11:12:52.354108+0000","last_active":"2023-11-29T11:12:56.383892+0000","last_peered":"2023-11-29T11:12:56.383892+0000","last_clean":"2023-11-29T11:12:56.383892+0000","last_became_active":"2023-11-29T11:12:52.353534+0000","last_became_peered":"2023-11-29T11:12:52.353534+0000","last_unstale":"2023-11-29T11:12:56.383892+0000","last_undegraded":"2023-11-29T11:12:56.383892+0000","last_fullsized":"2023-11-29T11:12:56.383892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:14:34.234715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384606+0000","last_change":"2023-11-29T11:12:52.369656+0000","last_active":"2023-11-29T11:12:56.384606+0000","last_peered":"2023-11-29T11:12:56.384606+0000","last_clean":"2023-11-29T11:12:56.384606+0000","last_became_active":"2023-11-29T11:12:52.368839+0000","last_became_peered":"2023-11-29T11:12:52.368839+0000","last_unstale":"2023-11-29T11:12:56.384606+0000","last_undegraded":"2023-11-29T11:12:56.384606+0000","last_fullsized":"2023-11-29T11:12:56.384606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:37.215861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382726+0000","last_change":"2023-11-29T11:12:52.355392+0000","last_active":"2023-11-29T11:12:56.382726+0000","last_peered":"2023-11-29T11:12:56.382726+0000","last_clean":"2023-11-29T11:12:56.382726+0000","last_became_active":"2023-11-29T11:12:52.355084+0000","last_became_peered":"2023-11-29T11:12:52.355084+0000","last_unstale":"2023-11-29T11:12:56.382726+0000","last_undegraded":"2023-11-29T11:12:56.382726+0000","last_fullsized":"2023-11-29T11:12:56.382726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:54:14.472430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382377+0000","last_change":"2023-11-29T11:12:52.363068+0000","last_active":"2023-11-29T11:12:56.382377+0000","last_peered":"2023-11-29T11:12:56.382377+0000","last_clean":"2023-11-29T11:12:56.382377+0000","last_became_active":"2023-11-29T11:12:52.362728+0000","last_became_peered":"2023-11-29T11:12:52.362728+0000","last_unstale":"2023-11-29T11:12:56.382377+0000","last_undegraded":"2023-11-29T11:12:56.382377+0000","last_fullsized":"2023-11-29T11:12:56.382377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380636+0000","last_change":"2023-11-29T11:12:52.360412+0000","last_active":"2023-11-29T11:12:56.380636+0000","last_peered":"2023-11-29T11:12:56.380636+0000","last_clean":"2023-11-29T11:12:56.380636+0000","last_became_active":"2023-11-29T11:12:52.357967+0000","last_became_peered":"2023-11-29T11:12:52.357967+0000","last_unstale":"2023-11-29T11:12:56.380636+0000","last_undegraded":"2023-11-29T11:12:56.380636+0000","last_fullsized":"2023-11-29T11:12:56.380636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:46:49.933331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385349+0000","last_change":"2023-11-29T11:12:52.370887+0000","last_active":"2023-11-29T11:12:56.385349+0000","last_peered":"2023-11-29T11:12:56.385349+0000","last_clean":"2023-11-29T11:12:56.385349+0000","last_became_active":"2023-11-29T11:12:52.370640+0000","last_became_peered":"2023-11-29T11:12:52.370640+0000","last_unstale":"2023-11-29T11:12:56.385349+0000","last_undegraded":"2023-11-29T11:12:56.385349+0000","last_fullsized":"2023-11-29T11:12:56.385349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370091+0000","last_change":"2023-11-29T11:12:52.367091+0000","last_active":"2023-11-29T11:12:56.370091+0000","last_peered":"2023-11-29T11:12:56.370091+0000","last_clean":"2023-11-29T11:12:56.370091+0000","last_became_active":"2023-11-29T11:12:52.366750+0000","last_became_peered":"2023-11-29T11:12:52.366750+0000","last_unstale":"2023-11-29T11:12:56.370091+0000","last_undegraded":"2023-11-29T11:12:56.370091+0000","last_fullsized":"2023-11-29T11:12:56.370091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:15:10.149279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380743+0000","last_change":"2023-11-29T11:12:52.361017+0000","last_active":"2023-11-29T11:12:56.380743+0000","last_peered":"2023-11-29T11:12:56.380743+0000","last_clean":"2023-11-29T11:12:56.380743+0000","last_became_active":"2023-11-29T11:12:52.359867+0000","last_became_peered":"2023-11-29T11:12:52.359867+0000","last_unstale":"2023-11-29T11:12:56.380743+0000","last_undegraded":"2023-11-29T11:12:56.380743+0000","last_fullsized":"2023-11-29T11:12:56.380743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:41.227959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383793+0000","last_change":"2023-11-29T11:12:52.359305+0000","last_active":"2023-11-29T11:12:56.383793+0000","last_peered":"2023-11-29T11:12:56.383793+0000","last_clean":"2023-11-29T11:12:56.383793+0000","last_became_active":"2023-11-29T11:12:52.359005+0000","last_became_peered":"2023-11-29T11:12:52.359005+0000","last_unstale":"2023-11-29T11:12:56.383793+0000","last_undegraded":"2023-11-29T11:12:56.383793+0000","last_fullsized":"2023-11-29T11:12:56.383793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:20:17.165426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374196+0000","last_change":"2023-11-29T11:12:52.372896+0000","last_active":"2023-11-29T11:12:56.374196+0000","last_peered":"2023-11-29T11:12:56.374196+0000","last_clean":"2023-11-29T11:12:56.374196+0000","last_became_active":"2023-11-29T11:12:52.372584+0000","last_became_peered":"2023-11-29T11:12:52.372584+0000","last_unstale":"2023-11-29T11:12:56.374196+0000","last_undegraded":"2023-11-29T11:12:56.374196+0000","last_fullsized":"2023-11-29T11:12:56.374196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:51.526860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9268,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362572,"statfs":{"total":96636764160,"available":96627273728,"internally_reserved":0,"allocated":897024,"data_stored":707312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":112983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8156,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363684,"statfs":{"total":96636764160,"available":96628412416,"internally_reserved":0,"allocated":282624,"data_stored":113619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363608,"statfs":{"total":96636764160,"available":96628334592,"internally_reserved":0,"allocated":294912,"data_stored":116784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":113073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":112983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9240,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362600,"statfs":{"total":96636764160,"available":96627302400,"internally_reserved":0,"allocated":868352,"data_stored":703351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":112563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:13:20.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:13:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.646+0000 7fe88bfff700 1 Processor -- start 2023-11-29T11:13:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.646+0000 7fe88bfff700 1 -- start start 2023-11-29T11:13:20.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8840dd280 0x7fe884050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe8840dfb70 0x7fe884036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe884052bf0 con 0x7fe884036cb0 2023-11-29T11:13:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8840dd650 con 0x7fe8840dd280 2023-11-29T11:13:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe884037130 con 0x7fe8840dfb70 2023-11-29T11:13:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8840dd280 0x7fe884050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8840dd280 0x7fe884050760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41564/0 (socket says 172.21.15.81:41564) 2023-11-29T11:13:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88affd700 1 -- 172.21.15.81:0/2029668725 learned_addr learned my addr 172.21.15.81:0/2029668725 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88a7fc700 1 --2- 172.21.15.81:0/2029668725 >> v2:172.21.15.176:3300/0 conn(0x7fe8840dfb70 0x7fe884036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88affd700 1 -- 172.21.15.81:0/2029668725 >> v2:172.21.15.176:3300/0 conn(0x7fe8840dfb70 msgr2=0x7fe884036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88affd700 1 --2- 172.21.15.81:0/2029668725 >> v2:172.21.15.176:3300/0 conn(0x7fe8840dfb70 0x7fe884036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88affd700 1 -- 172.21.15.81:0/2029668725 >> v1:172.21.15.176:6789/0 conn(0x7fe884036cb0 legacy=0x7fe8840e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88affd700 1 -- 172.21.15.81:0/2029668725 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8840528c0 con 0x7fe8840dd280 2023-11-29T11:13:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88a7fc700 1 --2- 172.21.15.81:0/2029668725 >> v2:172.21.15.176:3300/0 conn(0x7fe8840dfb70 0x7fe884036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88affd700 1 --2- 172.21.15.81:0/2029668725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dd280 0x7fe884050760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e190 tx=0x7fe880009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9610d896ffb6461f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe889ffb700 1 -- 172.21.15.81:0/2029668725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000b8a0 con 0x7fe8840dd280 2023-11-29T11:13:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe889ffb700 1 -- 172.21.15.81:0/2029668725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88000ba00 con 0x7fe8840dd280 2023-11-29T11:13:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe889ffb700 1 -- 172.21.15.81:0/2029668725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000bd90 con 0x7fe8840dd280 2023-11-29T11:13:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- 172.21.15.81:0/2029668725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dd280 msgr2=0x7fe884050760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 --2- 172.21.15.81:0/2029668725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dd280 0x7fe884050760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e190 tx=0x7fe880009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- 172.21.15.81:0/2029668725 shutdown_connections 2023-11-29T11:13:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 --2- 172.21.15.81:0/2029668725 >> v2:172.21.15.176:3300/0 conn(0x7fe8840dfb70 0x7fe884036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 --2- 172.21.15.81:0/2029668725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dd280 0x7fe884050760 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- 172.21.15.81:0/2029668725 >> 172.21.15.81:0/2029668725 conn(0x7fe884051770 msgr2=0x7fe884051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- 172.21.15.81:0/2029668725 shutdown_connections 2023-11-29T11:13:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- 172.21.15.81:0/2029668725 wait complete. 2023-11-29T11:13:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 Processor -- start 2023-11-29T11:13:20.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.650+0000 7fe88bfff700 1 -- start start 2023-11-29T11:13:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe884036cb0 0x7fe8840d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8840dd280 0x7fe8840d4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dfb70 0x7fe8840d8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840d99a0 con 0x7fe8840dfb70 2023-11-29T11:13:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840d8d90 con 0x7fe884036cb0 2023-11-29T11:13:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840d9070 con 0x7fe8840dd280 2023-11-29T11:13:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dfb70 0x7fe8840d8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dfb70 0x7fe8840d8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41574/0 (socket says 172.21.15.81:41574) 2023-11-29T11:13:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 -- 172.21.15.81:0/696499349 learned_addr learned my addr 172.21.15.81:0/696499349 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88affd700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe884036cb0 0x7fe8840d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88a7fc700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8840dd280 0x7fe8840d4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 -- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8840dd280 msgr2=0x7fe8840d4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8840dd280 0x7fe8840d4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 -- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe884036cb0 msgr2=0x7fe8840d4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe884036cb0 0x7fe8840d4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 -- 172.21.15.81:0/696499349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe880009570 con 0x7fe8840dfb70 2023-11-29T11:13:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88a7fc700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8840dd280 0x7fe8840d4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88affd700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe884036cb0 0x7fe8840d4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88b7fe700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dfb70 0x7fe8840d8690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe88c063ca0 tx=0x7fe88c0723e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe8737fe700 1 -- 172.21.15.81:0/696499349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c066f50 con 0x7fe8840dfb70 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe8737fe700 1 -- 172.21.15.81:0/696499349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c04e220 con 0x7fe8840dfb70 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8840e0710 con 0x7fe8840dfb70 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe8737fe700 1 -- 172.21.15.81:0/696499349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c067d60 con 0x7fe8840dfb70 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.654+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8840e0430 con 0x7fe8840dfb70 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.658+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8840e09f0 con 0x7fe8840dfb70 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.658+0000 7fe8737fe700 1 -- 172.21.15.81:0/696499349 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe88c067ec0 con 0x7fe8840dfb70 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.658+0000 7fe8737fe700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe878064ee0 0x7fe878067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.658+0000 7fe88affd700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe878064ee0 0x7fe878067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.658+0000 7fe8737fe700 1 -- 172.21.15.81:0/696499349 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe88c0fb780 con 0x7fe8840dfb70 2023-11-29T11:13:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.658+0000 7fe88affd700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe878064ee0 0x7fe878067390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe880000c00 tx=0x7fe880008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.666+0000 7fe8737fe700 1 -- 172.21.15.81:0/696499349 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe88c0c95f0 con 0x7fe8840dfb70 2023-11-29T11:13:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.810+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe884005570 con 0x7fe878064ee0 2023-11-29T11:13:20.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.826+0000 7fe8737fe700 1 -- 172.21.15.81:0/696499349 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367404 (secure 0 0 0) 0x7fe884005570 con 0x7fe878064ee0 2023-11-29T11:13:20.837 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:20.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe878064ee0 msgr2=0x7fe878067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe878064ee0 0x7fe878067390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe880000c00 tx=0x7fe880008030 comp rx=0 tx=0).stop 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dfb70 msgr2=0x7fe8840d8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dfb70 0x7fe8840d8690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe88c063ca0 tx=0x7fe88c0723e0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 shutdown_connections 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe878064ee0 0x7fe878067390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840dfb70 0x7fe8840d8690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8840dd280 0x7fe8840d4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 --2- 172.21.15.81:0/696499349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe884036cb0 0x7fe8840d4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 >> 172.21.15.81:0/696499349 conn(0x7fe884051770 msgr2=0x7fe88404fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 shutdown_connections 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.834+0000 7fe88bfff700 1 -- 172.21.15.81:0/696499349 wait complete. 2023-11-29T11:13:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:13:20.850 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-29T11:13:20.432467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67364,"kb_used_data":3364,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907356,"statfs":{"total":773094113280,"available":773025132544,"internally_reserved":0,"allocated":3444736,"data_stored":2092668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004164"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397456+0000","last_change":"2023-11-29T11:12:56.392727+0000","last_active":"2023-11-29T11:12:56.397456+0000","last_peered":"2023-11-29T11:12:56.397456+0000","last_clean":"2023-11-29T11:12:56.397456+0000","last_became_active":"2023-11-29T11:12:56.392278+0000","last_became_peered":"2023-11-29T11:12:56.392278+0000","last_unstale":"2023-11-29T11:12:56.397456+0000","last_undegraded":"2023-11-29T11:12:56.397456+0000","last_fullsized":"2023-11-29T11:12:56.397456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:05.548254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384796+0000","last_change":"2023-11-29T11:12:51.981171+0000","last_active":"2023-11-29T11:12:56.384796+0000","last_peered":"2023-11-29T11:12:56.384796+0000","last_clean":"2023-11-29T11:12:56.384796+0000","last_became_active":"2023-11-29T11:12:51.979647+0000","last_became_peered":"2023-11-29T11:12:51.979647+0000","last_unstale":"2023-11-29T11:12:56.384796+0000","last_undegraded":"2023-11-29T11:12:56.384796+0000","last_fullsized":"2023-11-29T11:12:56.384796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379179+0000","last_change":"2023-11-29T11:12:52.373329+0000","last_active":"2023-11-29T11:12:56.379179+0000","last_peered":"2023-11-29T11:12:56.379179+0000","last_clean":"2023-11-29T11:12:56.379179+0000","last_became_active":"2023-11-29T11:12:52.373080+0000","last_became_peered":"2023-11-29T11:12:52.373080+0000","last_unstale":"2023-11-29T11:12:56.379179+0000","last_undegraded":"2023-11-29T11:12:56.379179+0000","last_fullsized":"2023-11-29T11:12:56.379179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:33.415072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399892+0000","last_change":"2023-11-29T11:12:56.393396+0000","last_active":"2023-11-29T11:12:56.399892+0000","last_peered":"2023-11-29T11:12:56.399892+0000","last_clean":"2023-11-29T11:12:56.399892+0000","last_became_active":"2023-11-29T11:12:56.392958+0000","last_became_peered":"2023-11-29T11:12:56.392958+0000","last_unstale":"2023-11-29T11:12:56.399892+0000","last_undegraded":"2023-11-29T11:12:56.399892+0000","last_fullsized":"2023-11-29T11:12:56.399892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:08:53.005631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374292+0000","last_change":"2023-11-29T11:12:51.984861+0000","last_active":"2023-11-29T11:12:56.374292+0000","last_peered":"2023-11-29T11:12:56.374292+0000","last_clean":"2023-11-29T11:12:56.374292+0000","last_became_active":"2023-11-29T11:12:51.984221+0000","last_became_peered":"2023-11-29T11:12:51.984221+0000","last_unstale":"2023-11-29T11:12:56.374292+0000","last_undegraded":"2023-11-29T11:12:56.374292+0000","last_fullsized":"2023-11-29T11:12:56.374292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:03:52.716864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368510+0000","last_change":"2023-11-29T11:12:52.361315+0000","last_active":"2023-11-29T11:12:56.368510+0000","last_peered":"2023-11-29T11:12:56.368510+0000","last_clean":"2023-11-29T11:12:56.368510+0000","last_became_active":"2023-11-29T11:12:52.361046+0000","last_became_peered":"2023-11-29T11:12:52.361046+0000","last_unstale":"2023-11-29T11:12:56.368510+0000","last_undegraded":"2023-11-29T11:12:56.368510+0000","last_fullsized":"2023-11-29T11:12:56.368510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:48.301408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402905+0000","last_change":"2023-11-29T11:12:56.397174+0000","last_active":"2023-11-29T11:12:56.402905+0000","last_peered":"2023-11-29T11:12:56.402905+0000","last_clean":"2023-11-29T11:12:56.402905+0000","last_became_active":"2023-11-29T11:12:56.395990+0000","last_became_peered":"2023-11-29T11:12:56.395990+0000","last_unstale":"2023-11-29T11:12:56.402905+0000","last_undegraded":"2023-11-29T11:12:56.402905+0000","last_fullsized":"2023-11-29T11:12:56.402905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:32:53.734519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384497+0000","last_change":"2023-11-29T11:12:51.984821+0000","last_active":"2023-11-29T11:12:56.384497+0000","last_peered":"2023-11-29T11:12:56.384497+0000","last_clean":"2023-11-29T11:12:56.384497+0000","last_became_active":"2023-11-29T11:12:51.984531+0000","last_became_peered":"2023-11-29T11:12:51.984531+0000","last_unstale":"2023-11-29T11:12:56.384497+0000","last_undegraded":"2023-11-29T11:12:56.384497+0000","last_fullsized":"2023-11-29T11:12:56.384497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:54.630966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381153+0000","last_change":"2023-11-29T11:12:52.369059+0000","last_active":"2023-11-29T11:12:56.381153+0000","last_peered":"2023-11-29T11:12:56.381153+0000","last_clean":"2023-11-29T11:12:56.381153+0000","last_became_active":"2023-11-29T11:12:52.368705+0000","last_became_peered":"2023-11-29T11:12:52.368705+0000","last_unstale":"2023-11-29T11:12:56.381153+0000","last_undegraded":"2023-11-29T11:12:56.381153+0000","last_fullsized":"2023-11-29T11:12:56.381153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:53:43.004864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401291+0000","last_change":"2023-11-29T11:12:56.394933+0000","last_active":"2023-11-29T11:12:56.401291+0000","last_peered":"2023-11-29T11:12:56.401291+0000","last_clean":"2023-11-29T11:12:56.401291+0000","last_became_active":"2023-11-29T11:12:56.394448+0000","last_became_peered":"2023-11-29T11:12:56.394448+0000","last_unstale":"2023-11-29T11:12:56.401291+0000","last_undegraded":"2023-11-29T11:12:56.401291+0000","last_fullsized":"2023-11-29T11:12:56.401291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:51.264472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383467+0000","last_change":"2023-11-29T11:12:51.984966+0000","last_active":"2023-11-29T11:12:56.383467+0000","last_peered":"2023-11-29T11:12:56.383467+0000","last_clean":"2023-11-29T11:12:56.383467+0000","last_became_active":"2023-11-29T11:12:51.984504+0000","last_became_peered":"2023-11-29T11:12:51.984504+0000","last_unstale":"2023-11-29T11:12:56.383467+0000","last_undegraded":"2023-11-29T11:12:56.383467+0000","last_fullsized":"2023-11-29T11:12:56.383467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:27:55.174112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380063+0000","last_change":"2023-11-29T11:12:52.369471+0000","last_active":"2023-11-29T11:12:56.380063+0000","last_peered":"2023-11-29T11:12:56.380063+0000","last_clean":"2023-11-29T11:12:56.380063+0000","last_became_active":"2023-11-29T11:12:52.369037+0000","last_became_peered":"2023-11-29T11:12:52.369037+0000","last_unstale":"2023-11-29T11:12:56.380063+0000","last_undegraded":"2023-11-29T11:12:56.380063+0000","last_fullsized":"2023-11-29T11:12:56.380063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:58:11.106615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397379+0000","last_change":"2023-11-29T11:12:56.392830+0000","last_active":"2023-11-29T11:12:56.397379+0000","last_peered":"2023-11-29T11:12:56.397379+0000","last_clean":"2023-11-29T11:12:56.397379+0000","last_became_active":"2023-11-29T11:12:56.392385+0000","last_became_peered":"2023-11-29T11:12:56.392385+0000","last_unstale":"2023-11-29T11:12:56.397379+0000","last_undegraded":"2023-11-29T11:12:56.397379+0000","last_fullsized":"2023-11-29T11:12:56.397379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385374+0000","last_change":"2023-11-29T11:12:51.978019+0000","last_active":"2023-11-29T11:12:56.385374+0000","last_peered":"2023-11-29T11:12:56.385374+0000","last_clean":"2023-11-29T11:12:56.385374+0000","last_became_active":"2023-11-29T11:12:51.977720+0000","last_became_peered":"2023-11-29T11:12:51.977720+0000","last_unstale":"2023-11-29T11:12:56.385374+0000","last_undegraded":"2023-11-29T11:12:56.385374+0000","last_fullsized":"2023-11-29T11:12:56.385374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:01.519677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374628+0000","last_change":"2023-11-29T11:12:52.366401+0000","last_active":"2023-11-29T11:12:56.374628+0000","last_peered":"2023-11-29T11:12:56.374628+0000","last_clean":"2023-11-29T11:12:56.374628+0000","last_became_active":"2023-11-29T11:12:52.366140+0000","last_became_peered":"2023-11-29T11:12:52.366140+0000","last_unstale":"2023-11-29T11:12:56.374628+0000","last_undegraded":"2023-11-29T11:12:56.374628+0000","last_fullsized":"2023-11-29T11:12:56.374628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:49.550223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397485+0000","last_change":"2023-11-29T11:12:56.390565+0000","last_active":"2023-11-29T11:12:56.397485+0000","last_peered":"2023-11-29T11:12:56.397485+0000","last_clean":"2023-11-29T11:12:56.397485+0000","last_became_active":"2023-11-29T11:12:56.389869+0000","last_became_peered":"2023-11-29T11:12:56.389869+0000","last_unstale":"2023-11-29T11:12:56.397485+0000","last_undegraded":"2023-11-29T11:12:56.397485+0000","last_fullsized":"2023-11-29T11:12:56.397485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:08:27.735011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381346+0000","last_change":"2023-11-29T11:12:51.979373+0000","last_active":"2023-11-29T11:12:56.381346+0000","last_peered":"2023-11-29T11:12:56.381346+0000","last_clean":"2023-11-29T11:12:56.381346+0000","last_became_active":"2023-11-29T11:12:51.979051+0000","last_became_peered":"2023-11-29T11:12:51.979051+0000","last_unstale":"2023-11-29T11:12:56.381346+0000","last_undegraded":"2023-11-29T11:12:56.381346+0000","last_fullsized":"2023-11-29T11:12:56.381346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.373881+0000","last_change":"2023-11-29T11:12:52.365896+0000","last_active":"2023-11-29T11:12:56.373881+0000","last_peered":"2023-11-29T11:12:56.373881+0000","last_clean":"2023-11-29T11:12:56.373881+0000","last_became_active":"2023-11-29T11:12:52.365622+0000","last_became_peered":"2023-11-29T11:12:52.365622+0000","last_unstale":"2023-11-29T11:12:56.373881+0000","last_undegraded":"2023-11-29T11:12:56.373881+0000","last_fullsized":"2023-11-29T11:12:56.373881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:29.530084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399062+0000","last_change":"2023-11-29T11:12:56.391160+0000","last_active":"2023-11-29T11:12:56.399062+0000","last_peered":"2023-11-29T11:12:56.399062+0000","last_clean":"2023-11-29T11:12:56.399062+0000","last_became_active":"2023-11-29T11:12:56.390771+0000","last_became_peered":"2023-11-29T11:12:56.390771+0000","last_unstale":"2023-11-29T11:12:56.399062+0000","last_undegraded":"2023-11-29T11:12:56.399062+0000","last_fullsized":"2023-11-29T11:12:56.399062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:28:19.746284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.386885+0000","last_change":"2023-11-29T11:12:51.987080+0000","last_active":"2023-11-29T11:12:56.386885+0000","last_peered":"2023-11-29T11:12:56.386885+0000","last_clean":"2023-11-29T11:12:56.386885+0000","last_became_active":"2023-11-29T11:12:51.986730+0000","last_became_peered":"2023-11-29T11:12:51.986730+0000","last_unstale":"2023-11-29T11:12:56.386885+0000","last_undegraded":"2023-11-29T11:12:56.386885+0000","last_fullsized":"2023-11-29T11:12:56.386885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:01.519677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385050+0000","last_change":"2023-11-29T11:12:52.367490+0000","last_active":"2023-11-29T11:12:56.385050+0000","last_peered":"2023-11-29T11:12:56.385050+0000","last_clean":"2023-11-29T11:12:56.385050+0000","last_became_active":"2023-11-29T11:12:52.367253+0000","last_became_peered":"2023-11-29T11:12:52.367253+0000","last_unstale":"2023-11-29T11:12:56.385050+0000","last_undegraded":"2023-11-29T11:12:56.385050+0000","last_fullsized":"2023-11-29T11:12:56.385050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:12.463644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.395950+0000","last_change":"2023-11-29T11:12:56.390849+0000","last_active":"2023-11-29T11:12:56.395950+0000","last_peered":"2023-11-29T11:12:56.395950+0000","last_clean":"2023-11-29T11:12:56.395950+0000","last_became_active":"2023-11-29T11:12:56.390401+0000","last_became_peered":"2023-11-29T11:12:56.390401+0000","last_unstale":"2023-11-29T11:12:56.395950+0000","last_undegraded":"2023-11-29T11:12:56.395950+0000","last_fullsized":"2023-11-29T11:12:56.395950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368794+0000","last_change":"2023-11-29T11:12:51.985928+0000","last_active":"2023-11-29T11:12:56.368794+0000","last_peered":"2023-11-29T11:12:56.368794+0000","last_clean":"2023-11-29T11:12:56.368794+0000","last_became_active":"2023-11-29T11:12:51.985417+0000","last_became_peered":"2023-11-29T11:12:51.985417+0000","last_unstale":"2023-11-29T11:12:56.368794+0000","last_undegraded":"2023-11-29T11:12:56.368794+0000","last_fullsized":"2023-11-29T11:12:56.368794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370624+0000","last_change":"2023-11-29T11:12:52.359182+0000","last_active":"2023-11-29T11:12:56.370624+0000","last_peered":"2023-11-29T11:12:56.370624+0000","last_clean":"2023-11-29T11:12:56.370624+0000","last_became_active":"2023-11-29T11:12:52.358870+0000","last_became_peered":"2023-11-29T11:12:52.358870+0000","last_unstale":"2023-11-29T11:12:56.370624+0000","last_undegraded":"2023-11-29T11:12:56.370624+0000","last_fullsized":"2023-11-29T11:12:56.370624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:47:38.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368358+0000","last_change":"2023-11-29T11:12:52.357426+0000","last_active":"2023-11-29T11:12:56.368358+0000","last_peered":"2023-11-29T11:12:56.368358+0000","last_clean":"2023-11-29T11:12:56.368358+0000","last_became_active":"2023-11-29T11:12:52.357165+0000","last_became_peered":"2023-11-29T11:12:52.357165+0000","last_unstale":"2023-11-29T11:12:56.368358+0000","last_undegraded":"2023-11-29T11:12:56.368358+0000","last_fullsized":"2023-11-29T11:12:56.368358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:37.215861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384878+0000","last_change":"2023-11-29T11:12:51.981423+0000","last_active":"2023-11-29T11:12:56.384878+0000","last_peered":"2023-11-29T11:12:56.384878+0000","last_clean":"2023-11-29T11:12:56.384878+0000","last_became_active":"2023-11-29T11:12:51.981102+0000","last_became_peered":"2023-11-29T11:12:51.981102+0000","last_unstale":"2023-11-29T11:12:56.384878+0000","last_undegraded":"2023-11-29T11:12:56.384878+0000","last_fullsized":"2023-11-29T11:12:56.384878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:34:18.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.393001+0000","last_change":"2023-11-29T11:12:56.388444+0000","last_active":"2023-11-29T11:12:56.393001+0000","last_peered":"2023-11-29T11:12:56.393001+0000","last_clean":"2023-11-29T11:12:56.393001+0000","last_became_active":"2023-11-29T11:12:56.388033+0000","last_became_peered":"2023-11-29T11:12:56.388033+0000","last_unstale":"2023-11-29T11:12:56.393001+0000","last_undegraded":"2023-11-29T11:12:56.393001+0000","last_fullsized":"2023-11-29T11:12:56.393001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:29.691459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368852+0000","last_change":"2023-11-29T11:12:52.365695+0000","last_active":"2023-11-29T11:12:56.368852+0000","last_peered":"2023-11-29T11:12:56.368852+0000","last_clean":"2023-11-29T11:12:56.368852+0000","last_became_active":"2023-11-29T11:12:52.365402+0000","last_became_peered":"2023-11-29T11:12:52.365402+0000","last_unstale":"2023-11-29T11:12:56.368852+0000","last_undegraded":"2023-11-29T11:12:56.368852+0000","last_fullsized":"2023-11-29T11:12:56.368852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384074+0000","last_change":"2023-11-29T11:12:51.978492+0000","last_active":"2023-11-29T11:12:56.384074+0000","last_peered":"2023-11-29T11:12:56.384074+0000","last_clean":"2023-11-29T11:12:56.384074+0000","last_became_active":"2023-11-29T11:12:51.978133+0000","last_became_peered":"2023-11-29T11:12:51.978133+0000","last_unstale":"2023-11-29T11:12:56.384074+0000","last_undegraded":"2023-11-29T11:12:56.384074+0000","last_fullsized":"2023-11-29T11:12:56.384074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:24:13.769187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401152+0000","last_change":"2023-11-29T11:12:56.393246+0000","last_active":"2023-11-29T11:12:56.401152+0000","last_peered":"2023-11-29T11:12:56.401152+0000","last_clean":"2023-11-29T11:12:56.401152+0000","last_became_active":"2023-11-29T11:12:56.392790+0000","last_became_peered":"2023-11-29T11:12:56.392790+0000","last_unstale":"2023-11-29T11:12:56.401152+0000","last_undegraded":"2023-11-29T11:12:56.401152+0000","last_fullsized":"2023-11-29T11:12:56.401152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:06:44.806489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380906+0000","last_change":"2023-11-29T11:12:51.986109+0000","last_active":"2023-11-29T11:12:56.380906+0000","last_peered":"2023-11-29T11:12:56.380906+0000","last_clean":"2023-11-29T11:12:56.380906+0000","last_became_active":"2023-11-29T11:12:51.985826+0000","last_became_peered":"2023-11-29T11:12:51.985826+0000","last_unstale":"2023-11-29T11:12:56.380906+0000","last_undegraded":"2023-11-29T11:12:56.380906+0000","last_fullsized":"2023-11-29T11:12:56.380906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:02:48.630613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387087+0000","last_change":"2023-11-29T11:12:52.356463+0000","last_active":"2023-11-29T11:12:56.387087+0000","last_peered":"2023-11-29T11:12:56.387087+0000","last_clean":"2023-11-29T11:12:56.387087+0000","last_became_active":"2023-11-29T11:12:52.356197+0000","last_became_peered":"2023-11-29T11:12:52.356197+0000","last_unstale":"2023-11-29T11:12:56.387087+0000","last_undegraded":"2023-11-29T11:12:56.387087+0000","last_fullsized":"2023-11-29T11:12:56.387087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:24:54.414088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400777+0000","last_change":"2023-11-29T11:12:56.390106+0000","last_active":"2023-11-29T11:12:56.400777+0000","last_peered":"2023-11-29T11:12:56.400777+0000","last_clean":"2023-11-29T11:12:56.400777+0000","last_became_active":"2023-11-29T11:12:56.389286+0000","last_became_peered":"2023-11-29T11:12:56.389286+0000","last_unstale":"2023-11-29T11:12:56.400777+0000","last_undegraded":"2023-11-29T11:12:56.400777+0000","last_fullsized":"2023-11-29T11:12:56.400777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:20:15.664819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'9","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-29T11:13:01.224105+0000","last_change":"2023-11-29T11:12:51.981433+0000","last_active":"2023-11-29T11:13:01.224105+0000","last_peered":"2023-11-29T11:13:01.224105+0000","last_clean":"2023-11-29T11:13:01.224105+0000","last_became_active":"2023-11-29T11:12:51.981169+0000","last_became_peered":"2023-11-29T11:12:51.981169+0000","last_unstale":"2023-11-29T11:13:01.224105+0000","last_undegraded":"2023-11-29T11:13:01.224105+0000","last_fullsized":"2023-11-29T11:13:01.224105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380175+0000","last_change":"2023-11-29T11:12:52.372116+0000","last_active":"2023-11-29T11:12:56.380175+0000","last_peered":"2023-11-29T11:12:56.380175+0000","last_clean":"2023-11-29T11:12:56.380175+0000","last_became_active":"2023-11-29T11:12:52.371831+0000","last_became_peered":"2023-11-29T11:12:52.371831+0000","last_unstale":"2023-11-29T11:12:56.380175+0000","last_undegraded":"2023-11-29T11:12:56.380175+0000","last_fullsized":"2023-11-29T11:12:56.380175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.396928+0000","last_change":"2023-11-29T11:12:56.391717+0000","last_active":"2023-11-29T11:12:56.396928+0000","last_peered":"2023-11-29T11:12:56.396928+0000","last_clean":"2023-11-29T11:12:56.396928+0000","last_became_active":"2023-11-29T11:12:56.391290+0000","last_became_peered":"2023-11-29T11:12:56.391290+0000","last_unstale":"2023-11-29T11:12:56.396928+0000","last_undegraded":"2023-11-29T11:12:56.396928+0000","last_fullsized":"2023-11-29T11:12:56.396928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:42:59.881221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387181+0000","last_change":"2023-11-29T11:12:52.352949+0000","last_active":"2023-11-29T11:12:56.387181+0000","last_peered":"2023-11-29T11:12:56.387181+0000","last_clean":"2023-11-29T11:12:56.387181+0000","last_became_active":"2023-11-29T11:12:52.350912+0000","last_became_peered":"2023-11-29T11:12:52.350912+0000","last_unstale":"2023-11-29T11:12:56.387181+0000","last_undegraded":"2023-11-29T11:12:56.387181+0000","last_fullsized":"2023-11-29T11:12:56.387181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:42.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370718+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:12:56.370718+0000","last_peered":"2023-11-29T11:12:56.370718+0000","last_clean":"2023-11-29T11:12:56.370718+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:12:56.370718+0000","last_undegraded":"2023-11-29T11:12:56.370718+0000","last_fullsized":"2023-11-29T11:12:56.370718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384623+0000","last_change":"2023-11-29T11:12:51.986760+0000","last_active":"2023-11-29T11:12:56.384623+0000","last_peered":"2023-11-29T11:12:56.384623+0000","last_clean":"2023-11-29T11:12:56.384623+0000","last_became_active":"2023-11-29T11:12:51.986475+0000","last_became_peered":"2023-11-29T11:12:51.986475+0000","last_unstale":"2023-11-29T11:12:56.384623+0000","last_undegraded":"2023-11-29T11:12:56.384623+0000","last_fullsized":"2023-11-29T11:12:56.384623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:41:14.704468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400660+0000","last_change":"2023-11-29T11:12:56.395998+0000","last_active":"2023-11-29T11:12:56.400660+0000","last_peered":"2023-11-29T11:12:56.400660+0000","last_clean":"2023-11-29T11:12:56.400660+0000","last_became_active":"2023-11-29T11:12:56.395301+0000","last_became_peered":"2023-11-29T11:12:56.395301+0000","last_unstale":"2023-11-29T11:12:56.400660+0000","last_undegraded":"2023-11-29T11:12:56.400660+0000","last_fullsized":"2023-11-29T11:12:56.400660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:05.548254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385217+0000","last_change":"2023-11-29T11:12:52.359555+0000","last_active":"2023-11-29T11:12:56.385217+0000","last_peered":"2023-11-29T11:12:56.385217+0000","last_clean":"2023-11-29T11:12:56.385217+0000","last_became_active":"2023-11-29T11:12:52.359291+0000","last_became_peered":"2023-11-29T11:12:52.359291+0000","last_unstale":"2023-11-29T11:12:56.385217+0000","last_undegraded":"2023-11-29T11:12:56.385217+0000","last_fullsized":"2023-11-29T11:12:56.385217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:42.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370551+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:12:56.370551+0000","last_peered":"2023-11-29T11:12:56.370551+0000","last_clean":"2023-11-29T11:12:56.370551+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:12:56.370551+0000","last_undegraded":"2023-11-29T11:12:56.370551+0000","last_fullsized":"2023-11-29T11:12:56.370551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387434+0000","last_change":"2023-11-29T11:12:51.981231+0000","last_active":"2023-11-29T11:12:56.387434+0000","last_peered":"2023-11-29T11:12:56.387434+0000","last_clean":"2023-11-29T11:12:56.387434+0000","last_became_active":"2023-11-29T11:12:51.980989+0000","last_became_peered":"2023-11-29T11:12:51.980989+0000","last_unstale":"2023-11-29T11:12:56.387434+0000","last_undegraded":"2023-11-29T11:12:56.387434+0000","last_fullsized":"2023-11-29T11:12:56.387434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:34:18.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.393030+0000","last_change":"2023-11-29T11:12:56.389787+0000","last_active":"2023-11-29T11:12:56.393030+0000","last_peered":"2023-11-29T11:12:56.393030+0000","last_clean":"2023-11-29T11:12:56.393030+0000","last_became_active":"2023-11-29T11:12:56.389396+0000","last_became_peered":"2023-11-29T11:12:56.389396+0000","last_unstale":"2023-11-29T11:12:56.393030+0000","last_undegraded":"2023-11-29T11:12:56.393030+0000","last_fullsized":"2023-11-29T11:12:56.393030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:12:42.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368569+0000","last_change":"2023-11-29T11:12:52.365743+0000","last_active":"2023-11-29T11:12:56.368569+0000","last_peered":"2023-11-29T11:12:56.368569+0000","last_clean":"2023-11-29T11:12:56.368569+0000","last_became_active":"2023-11-29T11:12:52.365463+0000","last_became_peered":"2023-11-29T11:12:52.365463+0000","last_unstale":"2023-11-29T11:12:56.368569+0000","last_undegraded":"2023-11-29T11:12:56.368569+0000","last_fullsized":"2023-11-29T11:12:56.368569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381399+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:12:56.381399+0000","last_peered":"2023-11-29T11:12:56.381399+0000","last_clean":"2023-11-29T11:12:56.381399+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:12:56.381399+0000","last_undegraded":"2023-11-29T11:12:56.381399+0000","last_fullsized":"2023-11-29T11:12:56.381399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374706+0000","last_change":"2023-11-29T11:12:51.984839+0000","last_active":"2023-11-29T11:12:56.374706+0000","last_peered":"2023-11-29T11:12:56.374706+0000","last_clean":"2023-11-29T11:12:56.374706+0000","last_became_active":"2023-11-29T11:12:51.984536+0000","last_became_peered":"2023-11-29T11:12:51.984536+0000","last_unstale":"2023-11-29T11:12:56.374706+0000","last_undegraded":"2023-11-29T11:12:56.374706+0000","last_fullsized":"2023-11-29T11:12:56.374706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397672+0000","last_change":"2023-11-29T11:12:56.391636+0000","last_active":"2023-11-29T11:12:56.397672+0000","last_peered":"2023-11-29T11:12:56.397672+0000","last_clean":"2023-11-29T11:12:56.397672+0000","last_became_active":"2023-11-29T11:12:56.389855+0000","last_became_peered":"2023-11-29T11:12:56.389855+0000","last_unstale":"2023-11-29T11:12:56.397672+0000","last_undegraded":"2023-11-29T11:12:56.397672+0000","last_fullsized":"2023-11-29T11:12:56.397672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:00:51.883497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382757+0000","last_change":"2023-11-29T11:12:52.361676+0000","last_active":"2023-11-29T11:12:56.382757+0000","last_peered":"2023-11-29T11:12:56.382757+0000","last_clean":"2023-11-29T11:12:56.382757+0000","last_became_active":"2023-11-29T11:12:52.361408+0000","last_became_peered":"2023-11-29T11:12:52.361408+0000","last_unstale":"2023-11-29T11:12:56.382757+0000","last_undegraded":"2023-11-29T11:12:56.382757+0000","last_fullsized":"2023-11-29T11:12:56.382757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:41:41.650921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.371995+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:12:56.371995+0000","last_peered":"2023-11-29T11:12:56.371995+0000","last_clean":"2023-11-29T11:12:56.371995+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:12:56.371995+0000","last_undegraded":"2023-11-29T11:12:56.371995+0000","last_fullsized":"2023-11-29T11:12:56.371995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.956128+0000","last_change":"2023-11-29T11:12:51.981177+0000","last_active":"2023-11-29T11:12:56.956128+0000","last_peered":"2023-11-29T11:12:56.956128+0000","last_clean":"2023-11-29T11:12:56.956128+0000","last_became_active":"2023-11-29T11:12:51.980121+0000","last_became_peered":"2023-11-29T11:12:51.980121+0000","last_unstale":"2023-11-29T11:12:56.956128+0000","last_undegraded":"2023-11-29T11:12:56.956128+0000","last_fullsized":"2023-11-29T11:12:56.956128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:25.800743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400853+0000","last_change":"2023-11-29T11:12:56.394701+0000","last_active":"2023-11-29T11:12:56.400853+0000","last_peered":"2023-11-29T11:12:56.400853+0000","last_clean":"2023-11-29T11:12:56.400853+0000","last_became_active":"2023-11-29T11:12:56.394337+0000","last_became_peered":"2023-11-29T11:12:56.394337+0000","last_unstale":"2023-11-29T11:12:56.400853+0000","last_undegraded":"2023-11-29T11:12:56.400853+0000","last_fullsized":"2023-11-29T11:12:56.400853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:04:27.759167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385139+0000","last_change":"2023-11-29T11:12:52.365115+0000","last_active":"2023-11-29T11:12:56.385139+0000","last_peered":"2023-11-29T11:12:56.385139+0000","last_clean":"2023-11-29T11:12:56.385139+0000","last_became_active":"2023-11-29T11:12:52.364854+0000","last_became_peered":"2023-11-29T11:12:52.364854+0000","last_unstale":"2023-11-29T11:12:56.385139+0000","last_undegraded":"2023-11-29T11:12:56.385139+0000","last_fullsized":"2023-11-29T11:12:56.385139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383734+0000","last_change":"2023-11-29T11:12:51.983363+0000","last_active":"2023-11-29T11:12:56.383734+0000","last_peered":"2023-11-29T11:12:56.383734+0000","last_clean":"2023-11-29T11:12:56.383734+0000","last_became_active":"2023-11-29T11:12:51.983081+0000","last_became_peered":"2023-11-29T11:12:51.983081+0000","last_unstale":"2023-11-29T11:12:56.383734+0000","last_undegraded":"2023-11-29T11:12:56.383734+0000","last_fullsized":"2023-11-29T11:12:56.383734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:50.516978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381251+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:12:56.381251+0000","last_peered":"2023-11-29T11:12:56.381251+0000","last_clean":"2023-11-29T11:12:56.381251+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:12:56.381251+0000","last_undegraded":"2023-11-29T11:12:56.381251+0000","last_fullsized":"2023-11-29T11:12:56.381251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387003+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:12:56.387003+0000","last_peered":"2023-11-29T11:12:56.387003+0000","last_clean":"2023-11-29T11:12:56.387003+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:12:56.387003+0000","last_undegraded":"2023-11-29T11:12:56.387003+0000","last_fullsized":"2023-11-29T11:12:56.387003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402840+0000","last_change":"2023-11-29T11:12:56.396251+0000","last_active":"2023-11-29T11:12:56.402840+0000","last_peered":"2023-11-29T11:12:56.402840+0000","last_clean":"2023-11-29T11:12:56.402840+0000","last_became_active":"2023-11-29T11:12:56.395546+0000","last_became_peered":"2023-11-29T11:12:56.395546+0000","last_unstale":"2023-11-29T11:12:56.402840+0000","last_undegraded":"2023-11-29T11:12:56.402840+0000","last_fullsized":"2023-11-29T11:12:56.402840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:58:06.239886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387775+0000","last_change":"2023-11-29T11:12:52.350524+0000","last_active":"2023-11-29T11:12:56.387775+0000","last_peered":"2023-11-29T11:12:56.387775+0000","last_clean":"2023-11-29T11:12:56.387775+0000","last_became_active":"2023-11-29T11:12:52.350253+0000","last_became_peered":"2023-11-29T11:12:52.350253+0000","last_unstale":"2023-11-29T11:12:56.387775+0000","last_undegraded":"2023-11-29T11:12:56.387775+0000","last_fullsized":"2023-11-29T11:12:56.387775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:44:33.817076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384800+0000","last_change":"2023-11-29T11:12:51.980818+0000","last_active":"2023-11-29T11:12:56.384800+0000","last_peered":"2023-11-29T11:12:56.384800+0000","last_clean":"2023-11-29T11:12:56.384800+0000","last_became_active":"2023-11-29T11:12:51.980515+0000","last_became_peered":"2023-11-29T11:12:51.980515+0000","last_unstale":"2023-11-29T11:12:56.384800+0000","last_undegraded":"2023-11-29T11:12:56.384800+0000","last_fullsized":"2023-11-29T11:12:56.384800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:32.597395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382028+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:12:56.382028+0000","last_peered":"2023-11-29T11:12:56.382028+0000","last_clean":"2023-11-29T11:12:56.382028+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:12:56.382028+0000","last_undegraded":"2023-11-29T11:12:56.382028+0000","last_fullsized":"2023-11-29T11:12:56.382028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399365+0000","last_change":"2023-11-29T11:12:56.392369+0000","last_active":"2023-11-29T11:12:56.399365+0000","last_peered":"2023-11-29T11:12:56.399365+0000","last_clean":"2023-11-29T11:12:56.399365+0000","last_became_active":"2023-11-29T11:12:56.392008+0000","last_became_peered":"2023-11-29T11:12:56.392008+0000","last_unstale":"2023-11-29T11:12:56.399365+0000","last_undegraded":"2023-11-29T11:12:56.399365+0000","last_fullsized":"2023-11-29T11:12:56.399365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:20:17.395683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387330+0000","last_change":"2023-11-29T11:12:52.356824+0000","last_active":"2023-11-29T11:12:56.387330+0000","last_peered":"2023-11-29T11:12:56.387330+0000","last_clean":"2023-11-29T11:12:56.387330+0000","last_became_active":"2023-11-29T11:12:52.356541+0000","last_became_peered":"2023-11-29T11:12:52.356541+0000","last_unstale":"2023-11-29T11:12:56.387330+0000","last_undegraded":"2023-11-29T11:12:56.387330+0000","last_fullsized":"2023-11-29T11:12:56.387330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380364+0000","last_change":"2023-11-29T11:12:51.978041+0000","last_active":"2023-11-29T11:12:56.380364+0000","last_peered":"2023-11-29T11:12:56.380364+0000","last_clean":"2023-11-29T11:12:56.380364+0000","last_became_active":"2023-11-29T11:12:51.976160+0000","last_became_peered":"2023-11-29T11:12:51.976160+0000","last_unstale":"2023-11-29T11:12:56.380364+0000","last_undegraded":"2023-11-29T11:12:56.380364+0000","last_fullsized":"2023-11-29T11:12:56.380364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:41.431586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382670+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:12:56.382670+0000","last_peered":"2023-11-29T11:12:56.382670+0000","last_clean":"2023-11-29T11:12:56.382670+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:12:56.382670+0000","last_undegraded":"2023-11-29T11:12:56.382670+0000","last_fullsized":"2023-11-29T11:12:56.382670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400638+0000","last_change":"2023-11-29T11:12:56.395788+0000","last_active":"2023-11-29T11:12:56.400638+0000","last_peered":"2023-11-29T11:12:56.400638+0000","last_clean":"2023-11-29T11:12:56.400638+0000","last_became_active":"2023-11-29T11:12:56.395401+0000","last_became_peered":"2023-11-29T11:12:56.395401+0000","last_unstale":"2023-11-29T11:12:56.400638+0000","last_undegraded":"2023-11-29T11:12:56.400638+0000","last_fullsized":"2023-11-29T11:12:56.400638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:31:52.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370253+0000","last_change":"2023-11-29T11:12:52.368029+0000","last_active":"2023-11-29T11:12:56.370253+0000","last_peered":"2023-11-29T11:12:56.370253+0000","last_clean":"2023-11-29T11:12:56.370253+0000","last_became_active":"2023-11-29T11:12:52.366907+0000","last_became_peered":"2023-11-29T11:12:52.366907+0000","last_unstale":"2023-11-29T11:12:56.370253+0000","last_undegraded":"2023-11-29T11:12:56.370253+0000","last_fullsized":"2023-11-29T11:12:56.370253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:00:46.482908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368761+0000","last_change":"2023-11-29T11:12:51.986466+0000","last_active":"2023-11-29T11:12:56.368761+0000","last_peered":"2023-11-29T11:12:56.368761+0000","last_clean":"2023-11-29T11:12:56.368761+0000","last_became_active":"2023-11-29T11:12:51.986194+0000","last_became_peered":"2023-11-29T11:12:51.986194+0000","last_unstale":"2023-11-29T11:12:56.368761+0000","last_undegraded":"2023-11-29T11:12:56.368761+0000","last_fullsized":"2023-11-29T11:12:56.368761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381335+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:12:56.381335+0000","last_peered":"2023-11-29T11:12:56.381335+0000","last_clean":"2023-11-29T11:12:56.381335+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:12:56.381335+0000","last_undegraded":"2023-11-29T11:12:56.381335+0000","last_fullsized":"2023-11-29T11:12:56.381335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401333+0000","last_change":"2023-11-29T11:12:56.396640+0000","last_active":"2023-11-29T11:12:56.401333+0000","last_peered":"2023-11-29T11:12:56.401333+0000","last_clean":"2023-11-29T11:12:56.401333+0000","last_became_active":"2023-11-29T11:12:56.396277+0000","last_became_peered":"2023-11-29T11:12:56.396277+0000","last_unstale":"2023-11-29T11:12:56.401333+0000","last_undegraded":"2023-11-29T11:12:56.401333+0000","last_fullsized":"2023-11-29T11:12:56.401333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:31:52.686749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387675+0000","last_change":"2023-11-29T11:12:52.365021+0000","last_active":"2023-11-29T11:12:56.387675+0000","last_peered":"2023-11-29T11:12:56.387675+0000","last_clean":"2023-11-29T11:12:56.387675+0000","last_became_active":"2023-11-29T11:12:52.364752+0000","last_became_peered":"2023-11-29T11:12:52.364752+0000","last_unstale":"2023-11-29T11:12:56.387675+0000","last_undegraded":"2023-11-29T11:12:56.387675+0000","last_fullsized":"2023-11-29T11:12:56.387675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:12.463644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369013+0000","last_change":"2023-11-29T11:12:51.984597+0000","last_active":"2023-11-29T11:12:56.369013+0000","last_peered":"2023-11-29T11:12:56.369013+0000","last_clean":"2023-11-29T11:12:56.369013+0000","last_became_active":"2023-11-29T11:12:51.984208+0000","last_became_peered":"2023-11-29T11:12:51.984208+0000","last_unstale":"2023-11-29T11:12:56.369013+0000","last_undegraded":"2023-11-29T11:12:56.369013+0000","last_fullsized":"2023-11-29T11:12:56.369013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:24:12.113243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397643+0000","last_change":"2023-11-29T11:12:56.390938+0000","last_active":"2023-11-29T11:12:56.397643+0000","last_peered":"2023-11-29T11:12:56.397643+0000","last_clean":"2023-11-29T11:12:56.397643+0000","last_became_active":"2023-11-29T11:12:56.390579+0000","last_became_peered":"2023-11-29T11:12:56.390579+0000","last_unstale":"2023-11-29T11:12:56.397643+0000","last_undegraded":"2023-11-29T11:12:56.397643+0000","last_fullsized":"2023-11-29T11:12:56.397643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:51:56.654044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380950+0000","last_change":"2023-11-29T11:12:52.371660+0000","last_active":"2023-11-29T11:12:56.380950+0000","last_peered":"2023-11-29T11:12:56.380950+0000","last_clean":"2023-11-29T11:12:56.380950+0000","last_became_active":"2023-11-29T11:12:52.371313+0000","last_became_peered":"2023-11-29T11:12:52.371313+0000","last_unstale":"2023-11-29T11:12:56.380950+0000","last_undegraded":"2023-11-29T11:12:56.380950+0000","last_fullsized":"2023-11-29T11:12:56.380950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382856+0000","last_change":"2023-11-29T11:12:51.980977+0000","last_active":"2023-11-29T11:12:56.382856+0000","last_peered":"2023-11-29T11:12:56.382856+0000","last_clean":"2023-11-29T11:12:56.382856+0000","last_became_active":"2023-11-29T11:12:51.980717+0000","last_became_peered":"2023-11-29T11:12:51.980717+0000","last_unstale":"2023-11-29T11:12:56.382856+0000","last_undegraded":"2023-11-29T11:12:56.382856+0000","last_fullsized":"2023-11-29T11:12:56.382856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:48.540341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402799+0000","last_change":"2023-11-29T11:12:56.395925+0000","last_active":"2023-11-29T11:12:56.402799+0000","last_peered":"2023-11-29T11:12:56.402799+0000","last_clean":"2023-11-29T11:12:56.402799+0000","last_became_active":"2023-11-29T11:12:56.393269+0000","last_became_peered":"2023-11-29T11:12:56.393269+0000","last_unstale":"2023-11-29T11:12:56.402799+0000","last_undegraded":"2023-11-29T11:12:56.402799+0000","last_fullsized":"2023-11-29T11:12:56.402799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:47.489953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381227+0000","last_change":"2023-11-29T11:12:52.356759+0000","last_active":"2023-11-29T11:12:56.381227+0000","last_peered":"2023-11-29T11:12:56.381227+0000","last_clean":"2023-11-29T11:12:56.381227+0000","last_became_active":"2023-11-29T11:12:52.356301+0000","last_became_peered":"2023-11-29T11:12:52.356301+0000","last_unstale":"2023-11-29T11:12:56.381227+0000","last_undegraded":"2023-11-29T11:12:56.381227+0000","last_fullsized":"2023-11-29T11:12:56.381227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:24:15.072528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369086+0000","last_change":"2023-11-29T11:12:51.981944+0000","last_active":"2023-11-29T11:12:56.369086+0000","last_peered":"2023-11-29T11:12:56.369086+0000","last_clean":"2023-11-29T11:12:56.369086+0000","last_became_active":"2023-11-29T11:12:51.981620+0000","last_became_peered":"2023-11-29T11:12:51.981620+0000","last_unstale":"2023-11-29T11:12:56.369086+0000","last_undegraded":"2023-11-29T11:12:56.369086+0000","last_fullsized":"2023-11-29T11:12:56.369086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:54.630966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.397493+0000","last_change":"2023-11-29T11:12:56.393149+0000","last_active":"2023-11-29T11:12:56.397493+0000","last_peered":"2023-11-29T11:12:56.397493+0000","last_clean":"2023-11-29T11:12:56.397493+0000","last_became_active":"2023-11-29T11:12:56.392696+0000","last_became_peered":"2023-11-29T11:12:56.392696+0000","last_unstale":"2023-11-29T11:12:56.397493+0000","last_undegraded":"2023-11-29T11:12:56.397493+0000","last_fullsized":"2023-11-29T11:12:56.397493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:53:46.404557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380298+0000","last_change":"2023-11-29T11:12:52.369003+0000","last_active":"2023-11-29T11:12:56.380298+0000","last_peered":"2023-11-29T11:12:56.380298+0000","last_clean":"2023-11-29T11:12:56.380298+0000","last_became_active":"2023-11-29T11:12:52.368615+0000","last_became_peered":"2023-11-29T11:12:52.368615+0000","last_unstale":"2023-11-29T11:12:56.380298+0000","last_undegraded":"2023-11-29T11:12:56.380298+0000","last_fullsized":"2023-11-29T11:12:56.380298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:23:46.973175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370121+0000","last_change":"2023-11-29T11:12:51.985684+0000","last_active":"2023-11-29T11:12:56.370121+0000","last_peered":"2023-11-29T11:12:56.370121+0000","last_clean":"2023-11-29T11:12:56.370121+0000","last_became_active":"2023-11-29T11:12:51.985365+0000","last_became_peered":"2023-11-29T11:12:51.985365+0000","last_unstale":"2023-11-29T11:12:56.370121+0000","last_undegraded":"2023-11-29T11:12:56.370121+0000","last_fullsized":"2023-11-29T11:12:56.370121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:41.431586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399198+0000","last_change":"2023-11-29T11:12:56.390266+0000","last_active":"2023-11-29T11:12:56.399198+0000","last_peered":"2023-11-29T11:12:56.399198+0000","last_clean":"2023-11-29T11:12:56.399198+0000","last_became_active":"2023-11-29T11:12:56.389828+0000","last_became_peered":"2023-11-29T11:12:56.389828+0000","last_unstale":"2023-11-29T11:12:56.399198+0000","last_undegraded":"2023-11-29T11:12:56.399198+0000","last_fullsized":"2023-11-29T11:12:56.399198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:36.814765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385128+0000","last_change":"2023-11-29T11:12:52.359364+0000","last_active":"2023-11-29T11:12:56.385128+0000","last_peered":"2023-11-29T11:12:56.385128+0000","last_clean":"2023-11-29T11:12:56.385128+0000","last_became_active":"2023-11-29T11:12:52.358958+0000","last_became_peered":"2023-11-29T11:12:52.358958+0000","last_unstale":"2023-11-29T11:12:56.385128+0000","last_undegraded":"2023-11-29T11:12:56.385128+0000","last_fullsized":"2023-11-29T11:12:56.385128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383366+0000","last_change":"2023-11-29T11:12:51.986410+0000","last_active":"2023-11-29T11:12:56.383366+0000","last_peered":"2023-11-29T11:12:56.383366+0000","last_clean":"2023-11-29T11:12:56.383366+0000","last_became_active":"2023-11-29T11:12:51.986045+0000","last_became_peered":"2023-11-29T11:12:51.986045+0000","last_unstale":"2023-11-29T11:12:56.383366+0000","last_undegraded":"2023-11-29T11:12:56.383366+0000","last_fullsized":"2023-11-29T11:12:56.383366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:06:56.628542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.396923+0000","last_change":"2023-11-29T11:12:56.389886+0000","last_active":"2023-11-29T11:12:56.396923+0000","last_peered":"2023-11-29T11:12:56.396923+0000","last_clean":"2023-11-29T11:12:56.396923+0000","last_became_active":"2023-11-29T11:12:56.389457+0000","last_became_peered":"2023-11-29T11:12:56.389457+0000","last_unstale":"2023-11-29T11:12:56.396923+0000","last_undegraded":"2023-11-29T11:12:56.396923+0000","last_fullsized":"2023-11-29T11:12:56.396923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:32.929777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368896+0000","last_change":"2023-11-29T11:12:52.367726+0000","last_active":"2023-11-29T11:12:56.368896+0000","last_peered":"2023-11-29T11:12:56.368896+0000","last_clean":"2023-11-29T11:12:56.368896+0000","last_became_active":"2023-11-29T11:12:52.366804+0000","last_became_peered":"2023-11-29T11:12:52.366804+0000","last_unstale":"2023-11-29T11:12:56.368896+0000","last_undegraded":"2023-11-29T11:12:56.368896+0000","last_fullsized":"2023-11-29T11:12:56.368896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:17:42.639576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381008+0000","last_change":"2023-11-29T11:12:51.983384+0000","last_active":"2023-11-29T11:12:56.381008+0000","last_peered":"2023-11-29T11:12:56.381008+0000","last_clean":"2023-11-29T11:12:56.381008+0000","last_became_active":"2023-11-29T11:12:51.983089+0000","last_became_peered":"2023-11-29T11:12:51.983089+0000","last_unstale":"2023-11-29T11:12:56.381008+0000","last_undegraded":"2023-11-29T11:12:56.381008+0000","last_fullsized":"2023-11-29T11:12:56.381008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:03:52.716864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.399333+0000","last_change":"2023-11-29T11:12:56.391089+0000","last_active":"2023-11-29T11:12:56.399333+0000","last_peered":"2023-11-29T11:12:56.399333+0000","last_clean":"2023-11-29T11:12:56.399333+0000","last_became_active":"2023-11-29T11:12:56.390703+0000","last_became_peered":"2023-11-29T11:12:56.390703+0000","last_unstale":"2023-11-29T11:12:56.399333+0000","last_undegraded":"2023-11-29T11:12:56.399333+0000","last_fullsized":"2023-11-29T11:12:56.399333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:40.615554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379572+0000","last_change":"2023-11-29T11:12:52.360602+0000","last_active":"2023-11-29T11:12:56.379572+0000","last_peered":"2023-11-29T11:12:56.379572+0000","last_clean":"2023-11-29T11:12:56.379572+0000","last_became_active":"2023-11-29T11:12:52.360297+0000","last_became_peered":"2023-11-29T11:12:52.360297+0000","last_unstale":"2023-11-29T11:12:56.379572+0000","last_undegraded":"2023-11-29T11:12:56.379572+0000","last_fullsized":"2023-11-29T11:12:56.379572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:42:56.481528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381711+0000","last_change":"2023-11-29T11:12:51.985395+0000","last_active":"2023-11-29T11:12:56.381711+0000","last_peered":"2023-11-29T11:12:56.381711+0000","last_clean":"2023-11-29T11:12:56.381711+0000","last_became_active":"2023-11-29T11:12:51.985039+0000","last_became_peered":"2023-11-29T11:12:51.985039+0000","last_unstale":"2023-11-29T11:12:56.381711+0000","last_undegraded":"2023-11-29T11:12:56.381711+0000","last_fullsized":"2023-11-29T11:12:56.381711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:47.682887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.404204+0000","last_change":"2023-11-29T11:12:56.398067+0000","last_active":"2023-11-29T11:12:56.404204+0000","last_peered":"2023-11-29T11:12:56.404204+0000","last_clean":"2023-11-29T11:12:56.404204+0000","last_became_active":"2023-11-29T11:12:56.397483+0000","last_became_peered":"2023-11-29T11:12:56.397483+0000","last_unstale":"2023-11-29T11:12:56.404204+0000","last_undegraded":"2023-11-29T11:12:56.404204+0000","last_fullsized":"2023-11-29T11:12:56.404204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:51.701101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382817+0000","last_change":"2023-11-29T11:12:52.356144+0000","last_active":"2023-11-29T11:12:56.382817+0000","last_peered":"2023-11-29T11:12:56.382817+0000","last_clean":"2023-11-29T11:12:56.382817+0000","last_became_active":"2023-11-29T11:12:52.355872+0000","last_became_peered":"2023-11-29T11:12:52.355872+0000","last_unstale":"2023-11-29T11:12:56.382817+0000","last_undegraded":"2023-11-29T11:12:56.382817+0000","last_fullsized":"2023-11-29T11:12:56.382817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:50:29.425278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382282+0000","last_change":"2023-11-29T11:12:51.985298+0000","last_active":"2023-11-29T11:12:56.382282+0000","last_peered":"2023-11-29T11:12:56.382282+0000","last_clean":"2023-11-29T11:12:56.382282+0000","last_became_active":"2023-11-29T11:12:51.984926+0000","last_became_peered":"2023-11-29T11:12:51.984926+0000","last_unstale":"2023-11-29T11:12:56.382282+0000","last_undegraded":"2023-11-29T11:12:56.382282+0000","last_fullsized":"2023-11-29T11:12:56.382282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:36.656157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.401387+0000","last_change":"2023-11-29T11:12:56.396907+0000","last_active":"2023-11-29T11:12:56.401387+0000","last_peered":"2023-11-29T11:12:56.401387+0000","last_clean":"2023-11-29T11:12:56.401387+0000","last_became_active":"2023-11-29T11:12:56.396549+0000","last_became_peered":"2023-11-29T11:12:56.396549+0000","last_unstale":"2023-11-29T11:12:56.401387+0000","last_undegraded":"2023-11-29T11:12:56.401387+0000","last_fullsized":"2023-11-29T11:12:56.401387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:13:48.063541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402989+0000","last_change":"2023-11-29T11:12:56.400298+0000","last_active":"2023-11-29T11:12:56.402989+0000","last_peered":"2023-11-29T11:12:56.402989+0000","last_clean":"2023-11-29T11:12:56.402989+0000","last_became_active":"2023-11-29T11:12:56.399859+0000","last_became_peered":"2023-11-29T11:12:56.399859+0000","last_unstale":"2023-11-29T11:12:56.402989+0000","last_undegraded":"2023-11-29T11:12:56.402989+0000","last_fullsized":"2023-11-29T11:12:56.402989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:58:42.333539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368372+0000","last_change":"2023-11-29T11:12:51.975809+0000","last_active":"2023-11-29T11:12:56.368372+0000","last_peered":"2023-11-29T11:12:56.368372+0000","last_clean":"2023-11-29T11:12:56.368372+0000","last_became_active":"2023-11-29T11:12:51.975519+0000","last_became_peered":"2023-11-29T11:12:51.975519+0000","last_unstale":"2023-11-29T11:12:56.368372+0000","last_undegraded":"2023-11-29T11:12:56.368372+0000","last_fullsized":"2023-11-29T11:12:56.368372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:27:55.174112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374809+0000","last_change":"2023-11-29T11:12:52.365673+0000","last_active":"2023-11-29T11:12:56.374809+0000","last_peered":"2023-11-29T11:12:56.374809+0000","last_clean":"2023-11-29T11:12:56.374809+0000","last_became_active":"2023-11-29T11:12:52.365394+0000","last_became_peered":"2023-11-29T11:12:52.365394+0000","last_unstale":"2023-11-29T11:12:56.374809+0000","last_undegraded":"2023-11-29T11:12:56.374809+0000","last_fullsized":"2023-11-29T11:12:56.374809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400814+0000","last_change":"2023-11-29T11:12:56.391998+0000","last_active":"2023-11-29T11:12:56.400814+0000","last_peered":"2023-11-29T11:12:56.400814+0000","last_clean":"2023-11-29T11:12:56.400814+0000","last_became_active":"2023-11-29T11:12:56.391600+0000","last_became_peered":"2023-11-29T11:12:56.391600+0000","last_unstale":"2023-11-29T11:12:56.400814+0000","last_undegraded":"2023-11-29T11:12:56.400814+0000","last_fullsized":"2023-11-29T11:12:56.400814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:43:20.599589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382545+0000","last_change":"2023-11-29T11:12:51.985807+0000","last_active":"2023-11-29T11:12:56.382545+0000","last_peered":"2023-11-29T11:12:56.382545+0000","last_clean":"2023-11-29T11:12:56.382545+0000","last_became_active":"2023-11-29T11:12:51.985137+0000","last_became_peered":"2023-11-29T11:12:51.985137+0000","last_unstale":"2023-11-29T11:12:56.382545+0000","last_undegraded":"2023-11-29T11:12:56.382545+0000","last_fullsized":"2023-11-29T11:12:56.382545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:50:57.222111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385212+0000","last_change":"2023-11-29T11:12:52.369387+0000","last_active":"2023-11-29T11:12:56.385212+0000","last_peered":"2023-11-29T11:12:56.385212+0000","last_clean":"2023-11-29T11:12:56.385212+0000","last_became_active":"2023-11-29T11:12:52.369149+0000","last_became_peered":"2023-11-29T11:12:52.369149+0000","last_unstale":"2023-11-29T11:12:56.385212+0000","last_undegraded":"2023-11-29T11:12:56.385212+0000","last_fullsized":"2023-11-29T11:12:56.385212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384642+0000","last_change":"2023-11-29T11:12:51.980655+0000","last_active":"2023-11-29T11:12:56.384642+0000","last_peered":"2023-11-29T11:12:56.384642+0000","last_clean":"2023-11-29T11:12:56.384642+0000","last_became_active":"2023-11-29T11:12:51.979444+0000","last_became_peered":"2023-11-29T11:12:51.979444+0000","last_unstale":"2023-11-29T11:12:56.384642+0000","last_undegraded":"2023-11-29T11:12:56.384642+0000","last_fullsized":"2023-11-29T11:12:56.384642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:32.597395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384347+0000","last_change":"2023-11-29T11:12:52.364984+0000","last_active":"2023-11-29T11:12:56.384347+0000","last_peered":"2023-11-29T11:12:56.384347+0000","last_clean":"2023-11-29T11:12:56.384347+0000","last_became_active":"2023-11-29T11:12:52.364646+0000","last_became_peered":"2023-11-29T11:12:52.364646+0000","last_unstale":"2023-11-29T11:12:56.384347+0000","last_undegraded":"2023-11-29T11:12:56.384347+0000","last_fullsized":"2023-11-29T11:12:56.384347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:03:33.514623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.400841+0000","last_change":"2023-11-29T11:12:56.391838+0000","last_active":"2023-11-29T11:12:56.400841+0000","last_peered":"2023-11-29T11:12:56.400841+0000","last_clean":"2023-11-29T11:12:56.400841+0000","last_became_active":"2023-11-29T11:12:56.390070+0000","last_became_peered":"2023-11-29T11:12:56.390070+0000","last_unstale":"2023-11-29T11:12:56.400841+0000","last_undegraded":"2023-11-29T11:12:56.400841+0000","last_fullsized":"2023-11-29T11:12:56.400841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:08:17.216618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380625+0000","last_change":"2023-11-29T11:12:51.985954+0000","last_active":"2023-11-29T11:12:56.380625+0000","last_peered":"2023-11-29T11:12:56.380625+0000","last_clean":"2023-11-29T11:12:56.380625+0000","last_became_active":"2023-11-29T11:12:51.984970+0000","last_became_peered":"2023-11-29T11:12:51.984970+0000","last_unstale":"2023-11-29T11:12:56.380625+0000","last_undegraded":"2023-11-29T11:12:56.380625+0000","last_fullsized":"2023-11-29T11:12:56.380625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:50.939939+0000","last_clean_scrub_stamp":"2023-11-29T11:12:50.939939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:05:41.981906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.373298+0000","last_change":"2023-11-29T11:12:52.361389+0000","last_active":"2023-11-29T11:12:56.373298+0000","last_peered":"2023-11-29T11:12:56.373298+0000","last_clean":"2023-11-29T11:12:56.373298+0000","last_became_active":"2023-11-29T11:12:52.361124+0000","last_became_peered":"2023-11-29T11:12:52.361124+0000","last_unstale":"2023-11-29T11:12:56.373298+0000","last_undegraded":"2023-11-29T11:12:56.373298+0000","last_fullsized":"2023-11-29T11:12:56.373298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.402966+0000","last_change":"2023-11-29T11:12:56.400109+0000","last_active":"2023-11-29T11:12:56.402966+0000","last_peered":"2023-11-29T11:12:56.402966+0000","last_clean":"2023-11-29T11:12:56.402966+0000","last_became_active":"2023-11-29T11:12:56.397857+0000","last_became_peered":"2023-11-29T11:12:56.397857+0000","last_unstale":"2023-11-29T11:12:56.402966+0000","last_undegraded":"2023-11-29T11:12:56.402966+0000","last_fullsized":"2023-11-29T11:12:56.402966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:55.349514+0000","last_clean_scrub_stamp":"2023-11-29T11:12:55.349514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:48:31.563968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368339+0000","last_change":"2023-11-29T11:12:52.368059+0000","last_active":"2023-11-29T11:12:56.368339+0000","last_peered":"2023-11-29T11:12:56.368339+0000","last_clean":"2023-11-29T11:12:56.368339+0000","last_became_active":"2023-11-29T11:12:52.367696+0000","last_became_peered":"2023-11-29T11:12:52.367696+0000","last_unstale":"2023-11-29T11:12:56.368339+0000","last_undegraded":"2023-11-29T11:12:56.368339+0000","last_fullsized":"2023-11-29T11:12:56.368339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:47:39.444454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368288+0000","last_change":"2023-11-29T11:12:52.357396+0000","last_active":"2023-11-29T11:12:56.368288+0000","last_peered":"2023-11-29T11:12:56.368288+0000","last_clean":"2023-11-29T11:12:56.368288+0000","last_became_active":"2023-11-29T11:12:52.357150+0000","last_became_peered":"2023-11-29T11:12:52.357150+0000","last_unstale":"2023-11-29T11:12:56.368288+0000","last_undegraded":"2023-11-29T11:12:56.368288+0000","last_fullsized":"2023-11-29T11:12:56.368288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:37.039342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381253+0000","last_change":"2023-11-29T11:12:52.371840+0000","last_active":"2023-11-29T11:12:56.381253+0000","last_peered":"2023-11-29T11:12:56.381253+0000","last_clean":"2023-11-29T11:12:56.381253+0000","last_became_active":"2023-11-29T11:12:52.371439+0000","last_became_peered":"2023-11-29T11:12:52.371439+0000","last_unstale":"2023-11-29T11:12:56.381253+0000","last_undegraded":"2023-11-29T11:12:56.381253+0000","last_fullsized":"2023-11-29T11:12:56.381253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:37.039342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.369559+0000","last_change":"2023-11-29T11:12:52.364323+0000","last_active":"2023-11-29T11:12:56.369559+0000","last_peered":"2023-11-29T11:12:56.369559+0000","last_clean":"2023-11-29T11:12:56.369559+0000","last_became_active":"2023-11-29T11:12:52.364156+0000","last_became_peered":"2023-11-29T11:12:52.364156+0000","last_unstale":"2023-11-29T11:12:56.369559+0000","last_undegraded":"2023-11-29T11:12:56.369559+0000","last_fullsized":"2023-11-29T11:12:56.369559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387198+0000","last_change":"2023-11-29T11:12:52.365212+0000","last_active":"2023-11-29T11:12:56.387198+0000","last_peered":"2023-11-29T11:12:56.387198+0000","last_clean":"2023-11-29T11:12:56.387198+0000","last_became_active":"2023-11-29T11:12:52.364966+0000","last_became_peered":"2023-11-29T11:12:52.364966+0000","last_unstale":"2023-11-29T11:12:56.387198+0000","last_undegraded":"2023-11-29T11:12:56.387198+0000","last_fullsized":"2023-11-29T11:12:56.387198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:37.666038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383761+0000","last_change":"2023-11-29T11:12:52.365967+0000","last_active":"2023-11-29T11:12:56.383761+0000","last_peered":"2023-11-29T11:12:56.383761+0000","last_clean":"2023-11-29T11:12:56.383761+0000","last_became_active":"2023-11-29T11:12:52.365701+0000","last_became_peered":"2023-11-29T11:12:52.365701+0000","last_unstale":"2023-11-29T11:12:56.383761+0000","last_undegraded":"2023-11-29T11:12:56.383761+0000","last_fullsized":"2023-11-29T11:12:56.383761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:13:33.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387884+0000","last_change":"2023-11-29T11:12:52.357675+0000","last_active":"2023-11-29T11:12:56.387884+0000","last_peered":"2023-11-29T11:12:56.387884+0000","last_clean":"2023-11-29T11:12:56.387884+0000","last_became_active":"2023-11-29T11:12:52.356554+0000","last_became_peered":"2023-11-29T11:12:52.356554+0000","last_unstale":"2023-11-29T11:12:56.387884+0000","last_undegraded":"2023-11-29T11:12:56.387884+0000","last_fullsized":"2023-11-29T11:12:56.387884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:48.692769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.387575+0000","last_change":"2023-11-29T11:12:52.355949+0000","last_active":"2023-11-29T11:12:56.387575+0000","last_peered":"2023-11-29T11:12:56.387575+0000","last_clean":"2023-11-29T11:12:56.387575+0000","last_became_active":"2023-11-29T11:12:52.355707+0000","last_became_peered":"2023-11-29T11:12:52.355707+0000","last_unstale":"2023-11-29T11:12:56.387575+0000","last_undegraded":"2023-11-29T11:12:56.387575+0000","last_fullsized":"2023-11-29T11:12:56.387575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:37:21.284939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381161+0000","last_change":"2023-11-29T11:12:52.370097+0000","last_active":"2023-11-29T11:12:56.381161+0000","last_peered":"2023-11-29T11:12:56.381161+0000","last_clean":"2023-11-29T11:12:56.381161+0000","last_became_active":"2023-11-29T11:12:52.369728+0000","last_became_peered":"2023-11-29T11:12:52.369728+0000","last_unstale":"2023-11-29T11:12:56.381161+0000","last_undegraded":"2023-11-29T11:12:56.381161+0000","last_fullsized":"2023-11-29T11:12:56.381161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:35.755198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.368286+0000","last_change":"2023-11-29T11:12:52.362045+0000","last_active":"2023-11-29T11:12:56.368286+0000","last_peered":"2023-11-29T11:12:56.368286+0000","last_clean":"2023-11-29T11:12:56.368286+0000","last_became_active":"2023-11-29T11:12:52.361805+0000","last_became_peered":"2023-11-29T11:12:52.361805+0000","last_unstale":"2023-11-29T11:12:56.368286+0000","last_undegraded":"2023-11-29T11:12:56.368286+0000","last_fullsized":"2023-11-29T11:12:56.368286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:07:33.415072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384559+0000","last_change":"2023-11-29T11:12:52.366412+0000","last_active":"2023-11-29T11:12:56.384559+0000","last_peered":"2023-11-29T11:12:56.384559+0000","last_clean":"2023-11-29T11:12:56.384559+0000","last_became_active":"2023-11-29T11:12:52.366126+0000","last_became_peered":"2023-11-29T11:12:52.366126+0000","last_unstale":"2023-11-29T11:12:56.384559+0000","last_undegraded":"2023-11-29T11:12:56.384559+0000","last_fullsized":"2023-11-29T11:12:56.384559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:46.785288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380508+0000","last_change":"2023-11-29T11:12:52.370183+0000","last_active":"2023-11-29T11:12:56.380508+0000","last_peered":"2023-11-29T11:12:56.380508+0000","last_clean":"2023-11-29T11:12:56.380508+0000","last_became_active":"2023-11-29T11:12:52.369892+0000","last_became_peered":"2023-11-29T11:12:52.369892+0000","last_unstale":"2023-11-29T11:12:56.380508+0000","last_undegraded":"2023-11-29T11:12:56.380508+0000","last_fullsized":"2023-11-29T11:12:56.380508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:59.109399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380211+0000","last_change":"2023-11-29T11:12:52.371780+0000","last_active":"2023-11-29T11:12:56.380211+0000","last_peered":"2023-11-29T11:12:56.380211+0000","last_clean":"2023-11-29T11:12:56.380211+0000","last_became_active":"2023-11-29T11:12:52.371499+0000","last_became_peered":"2023-11-29T11:12:52.371499+0000","last_unstale":"2023-11-29T11:12:56.380211+0000","last_undegraded":"2023-11-29T11:12:56.380211+0000","last_fullsized":"2023-11-29T11:12:56.380211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:29.530084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374798+0000","last_change":"2023-11-29T11:12:52.374635+0000","last_active":"2023-11-29T11:12:56.374798+0000","last_peered":"2023-11-29T11:12:56.374798+0000","last_clean":"2023-11-29T11:12:56.374798+0000","last_became_active":"2023-11-29T11:12:52.374355+0000","last_became_peered":"2023-11-29T11:12:52.374355+0000","last_unstale":"2023-11-29T11:12:56.374798+0000","last_undegraded":"2023-11-29T11:12:56.374798+0000","last_fullsized":"2023-11-29T11:12:56.374798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:29:33.607277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380843+0000","last_change":"2023-11-29T11:12:52.357862+0000","last_active":"2023-11-29T11:12:56.380843+0000","last_peered":"2023-11-29T11:12:56.380843+0000","last_clean":"2023-11-29T11:12:56.380843+0000","last_became_active":"2023-11-29T11:12:52.357481+0000","last_became_peered":"2023-11-29T11:12:52.357481+0000","last_unstale":"2023-11-29T11:12:56.380843+0000","last_undegraded":"2023-11-29T11:12:56.380843+0000","last_fullsized":"2023-11-29T11:12:56.380843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:29:48.301408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384706+0000","last_change":"2023-11-29T11:12:52.369352+0000","last_active":"2023-11-29T11:12:56.384706+0000","last_peered":"2023-11-29T11:12:56.384706+0000","last_clean":"2023-11-29T11:12:56.384706+0000","last_became_active":"2023-11-29T11:12:52.369088+0000","last_became_peered":"2023-11-29T11:12:52.369088+0000","last_unstale":"2023-11-29T11:12:56.384706+0000","last_undegraded":"2023-11-29T11:12:56.384706+0000","last_fullsized":"2023-11-29T11:12:56.384706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.379103+0000","last_change":"2023-11-29T11:12:52.360140+0000","last_active":"2023-11-29T11:12:56.379103+0000","last_peered":"2023-11-29T11:12:56.379103+0000","last_clean":"2023-11-29T11:12:56.379103+0000","last_became_active":"2023-11-29T11:12:52.359850+0000","last_became_peered":"2023-11-29T11:12:52.359850+0000","last_unstale":"2023-11-29T11:12:56.379103+0000","last_undegraded":"2023-11-29T11:12:56.379103+0000","last_fullsized":"2023-11-29T11:12:56.379103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:58.881146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382463+0000","last_change":"2023-11-29T11:12:52.364490+0000","last_active":"2023-11-29T11:12:56.382463+0000","last_peered":"2023-11-29T11:12:56.382463+0000","last_clean":"2023-11-29T11:12:56.382463+0000","last_became_active":"2023-11-29T11:12:52.364230+0000","last_became_peered":"2023-11-29T11:12:52.364230+0000","last_unstale":"2023-11-29T11:12:56.382463+0000","last_undegraded":"2023-11-29T11:12:56.382463+0000","last_fullsized":"2023-11-29T11:12:56.382463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:25:30.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382900+0000","last_change":"2023-11-29T11:12:52.355458+0000","last_active":"2023-11-29T11:12:56.382900+0000","last_peered":"2023-11-29T11:12:56.382900+0000","last_clean":"2023-11-29T11:12:56.382900+0000","last_became_active":"2023-11-29T11:12:52.355112+0000","last_became_peered":"2023-11-29T11:12:52.355112+0000","last_unstale":"2023-11-29T11:12:56.382900+0000","last_undegraded":"2023-11-29T11:12:56.382900+0000","last_fullsized":"2023-11-29T11:12:56.382900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:15:39.290136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374499+0000","last_change":"2023-11-29T11:12:52.362310+0000","last_active":"2023-11-29T11:12:56.374499+0000","last_peered":"2023-11-29T11:12:56.374499+0000","last_clean":"2023-11-29T11:12:56.374499+0000","last_became_active":"2023-11-29T11:12:52.362044+0000","last_became_peered":"2023-11-29T11:12:52.362044+0000","last_unstale":"2023-11-29T11:12:56.374499+0000","last_undegraded":"2023-11-29T11:12:56.374499+0000","last_fullsized":"2023-11-29T11:12:56.374499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:35:26.810625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374336+0000","last_change":"2023-11-29T11:12:52.363035+0000","last_active":"2023-11-29T11:12:56.374336+0000","last_peered":"2023-11-29T11:12:56.374336+0000","last_clean":"2023-11-29T11:12:56.374336+0000","last_became_active":"2023-11-29T11:12:52.362777+0000","last_became_peered":"2023-11-29T11:12:52.362777+0000","last_unstale":"2023-11-29T11:12:56.374336+0000","last_undegraded":"2023-11-29T11:12:56.374336+0000","last_fullsized":"2023-11-29T11:12:56.374336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:53:42.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.381131+0000","last_change":"2023-11-29T11:12:52.357340+0000","last_active":"2023-11-29T11:12:56.381131+0000","last_peered":"2023-11-29T11:12:56.381131+0000","last_clean":"2023-11-29T11:12:56.381131+0000","last_became_active":"2023-11-29T11:12:52.356936+0000","last_became_peered":"2023-11-29T11:12:52.356936+0000","last_unstale":"2023-11-29T11:12:56.381131+0000","last_undegraded":"2023-11-29T11:12:56.381131+0000","last_fullsized":"2023-11-29T11:12:56.381131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:20:13.995990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383892+0000","last_change":"2023-11-29T11:12:52.354108+0000","last_active":"2023-11-29T11:12:56.383892+0000","last_peered":"2023-11-29T11:12:56.383892+0000","last_clean":"2023-11-29T11:12:56.383892+0000","last_became_active":"2023-11-29T11:12:52.353534+0000","last_became_peered":"2023-11-29T11:12:52.353534+0000","last_unstale":"2023-11-29T11:12:56.383892+0000","last_undegraded":"2023-11-29T11:12:56.383892+0000","last_fullsized":"2023-11-29T11:12:56.383892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:14:34.234715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.384606+0000","last_change":"2023-11-29T11:12:52.369656+0000","last_active":"2023-11-29T11:12:56.384606+0000","last_peered":"2023-11-29T11:12:56.384606+0000","last_clean":"2023-11-29T11:12:56.384606+0000","last_became_active":"2023-11-29T11:12:52.368839+0000","last_became_peered":"2023-11-29T11:12:52.368839+0000","last_unstale":"2023-11-29T11:12:56.384606+0000","last_undegraded":"2023-11-29T11:12:56.384606+0000","last_fullsized":"2023-11-29T11:12:56.384606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:49:37.215861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382726+0000","last_change":"2023-11-29T11:12:52.355392+0000","last_active":"2023-11-29T11:12:56.382726+0000","last_peered":"2023-11-29T11:12:56.382726+0000","last_clean":"2023-11-29T11:12:56.382726+0000","last_became_active":"2023-11-29T11:12:52.355084+0000","last_became_peered":"2023-11-29T11:12:52.355084+0000","last_unstale":"2023-11-29T11:12:56.382726+0000","last_undegraded":"2023-11-29T11:12:56.382726+0000","last_fullsized":"2023-11-29T11:12:56.382726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:54:14.472430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.382377+0000","last_change":"2023-11-29T11:12:52.363068+0000","last_active":"2023-11-29T11:12:56.382377+0000","last_peered":"2023-11-29T11:12:56.382377+0000","last_clean":"2023-11-29T11:12:56.382377+0000","last_became_active":"2023-11-29T11:12:52.362728+0000","last_became_peered":"2023-11-29T11:12:52.362728+0000","last_unstale":"2023-11-29T11:12:56.382377+0000","last_undegraded":"2023-11-29T11:12:56.382377+0000","last_fullsized":"2023-11-29T11:12:56.382377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:07.632768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380636+0000","last_change":"2023-11-29T11:12:52.360412+0000","last_active":"2023-11-29T11:12:56.380636+0000","last_peered":"2023-11-29T11:12:56.380636+0000","last_clean":"2023-11-29T11:12:56.380636+0000","last_became_active":"2023-11-29T11:12:52.357967+0000","last_became_peered":"2023-11-29T11:12:52.357967+0000","last_unstale":"2023-11-29T11:12:56.380636+0000","last_undegraded":"2023-11-29T11:12:56.380636+0000","last_fullsized":"2023-11-29T11:12:56.380636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:46:49.933331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.385349+0000","last_change":"2023-11-29T11:12:52.370887+0000","last_active":"2023-11-29T11:12:56.385349+0000","last_peered":"2023-11-29T11:12:56.385349+0000","last_clean":"2023-11-29T11:12:56.385349+0000","last_became_active":"2023-11-29T11:12:52.370640+0000","last_became_peered":"2023-11-29T11:12:52.370640+0000","last_unstale":"2023-11-29T11:12:56.385349+0000","last_undegraded":"2023-11-29T11:12:56.385349+0000","last_fullsized":"2023-11-29T11:12:56.385349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:04:03.902782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.370091+0000","last_change":"2023-11-29T11:12:52.367091+0000","last_active":"2023-11-29T11:12:56.370091+0000","last_peered":"2023-11-29T11:12:56.370091+0000","last_clean":"2023-11-29T11:12:56.370091+0000","last_became_active":"2023-11-29T11:12:52.366750+0000","last_became_peered":"2023-11-29T11:12:52.366750+0000","last_unstale":"2023-11-29T11:12:56.370091+0000","last_undegraded":"2023-11-29T11:12:56.370091+0000","last_fullsized":"2023-11-29T11:12:56.370091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:15:10.149279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.380743+0000","last_change":"2023-11-29T11:12:52.361017+0000","last_active":"2023-11-29T11:12:56.380743+0000","last_peered":"2023-11-29T11:12:56.380743+0000","last_clean":"2023-11-29T11:12:56.380743+0000","last_became_active":"2023-11-29T11:12:52.359867+0000","last_became_peered":"2023-11-29T11:12:52.359867+0000","last_unstale":"2023-11-29T11:12:56.380743+0000","last_undegraded":"2023-11-29T11:12:56.380743+0000","last_fullsized":"2023-11-29T11:12:56.380743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:41.227959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.383793+0000","last_change":"2023-11-29T11:12:52.359305+0000","last_active":"2023-11-29T11:12:56.383793+0000","last_peered":"2023-11-29T11:12:56.383793+0000","last_clean":"2023-11-29T11:12:56.383793+0000","last_became_active":"2023-11-29T11:12:52.359005+0000","last_became_peered":"2023-11-29T11:12:52.359005+0000","last_unstale":"2023-11-29T11:12:56.383793+0000","last_undegraded":"2023-11-29T11:12:56.383793+0000","last_fullsized":"2023-11-29T11:12:56.383793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:20:17.165426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-29T11:12:56.374196+0000","last_change":"2023-11-29T11:12:52.372896+0000","last_active":"2023-11-29T11:12:56.374196+0000","last_peered":"2023-11-29T11:12:56.374196+0000","last_clean":"2023-11-29T11:12:56.374196+0000","last_became_active":"2023-11-29T11:12:52.372584+0000","last_became_peered":"2023-11-29T11:12:52.372584+0000","last_unstale":"2023-11-29T11:12:56.374196+0000","last_undegraded":"2023-11-29T11:12:56.374196+0000","last_fullsized":"2023-11-29T11:12:56.374196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:51.949821+0000","last_clean_scrub_stamp":"2023-11-29T11:12:51.949821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:33:51.526860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9268,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362572,"statfs":{"total":96636764160,"available":96627273728,"internally_reserved":0,"allocated":897024,"data_stored":707312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":112983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8156,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363684,"statfs":{"total":96636764160,"available":96628412416,"internally_reserved":0,"allocated":282624,"data_stored":113619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363608,"statfs":{"total":96636764160,"available":96628334592,"internally_reserved":0,"allocated":294912,"data_stored":116784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":113073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":112983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9240,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362600,"statfs":{"total":96636764160,"available":96627302400,"internally_reserved":0,"allocated":868352,"data_stored":703351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":112563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:13:20.856 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-29T11:13:20.856 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-29T11:13:20.856 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-29T11:13:20.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-29T11:13:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.954+0000 7f0800ad8700 1 Processor -- start 2023-11-29T11:13:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.954+0000 7f0800ad8700 1 -- start start 2023-11-29T11:13:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07fc0cb470 0x7f07fc164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc06ace0 con 0x7f07fc159e70 2023-11-29T11:13:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc06a0d0 con 0x7f07fc069c40 2023-11-29T11:13:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc06a3b0 con 0x7f07fc0cb470 2023-11-29T11:13:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f07fc159e70 0x7f07fc06c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53934/0 (socket says 172.21.15.81:53934) 2023-11-29T11:13:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07fc0cb470 0x7f07fc164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fb7fe700 1 -- 172.21.15.81:0/3348356233 learned_addr learned my addr 172.21.15.81:0/3348356233 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fbfff700 1 -- 172.21.15.81:0/3348356233 >> v1:172.21.15.176:6789/0 conn(0x7f07fc069c40 legacy=0x7f07fc0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fbfff700 1 -- 172.21.15.81:0/3348356233 >> v1:172.21.15.81:6789/0 conn(0x7f07fc159e70 legacy=0x7f07fc06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fbfff700 1 -- 172.21.15.81:0/3348356233 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc06a690 con 0x7f07fc0cb470 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fa7fc700 1 -- 172.21.15.81:0/3348356233 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991113938 0 0) 0x7f07fc06ace0 con 0x7f07fc159e70 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fbfff700 1 --2- 172.21.15.81:0/3348356233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc0cb470 0x7f07fc164a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697eaf8bd274d547 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fa7fc700 1 -- 172.21.15.81:0/3348356233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400e070 con 0x7f07fc0cb470 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fa7fc700 1 -- 172.21.15.81:0/3348356233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f400bbd0 con 0x7f07fc0cb470 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f07fa7fc700 1 -- 172.21.15.81:0/3348356233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4012430 con 0x7f07fc0cb470 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 -- 172.21.15.81:0/3348356233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc0cb470 msgr2=0x7f07fc164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 --2- 172.21.15.81:0/3348356233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc0cb470 0x7f07fc164a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f400b330 comp rx=0 tx=0).stop 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 -- 172.21.15.81:0/3348356233 shutdown_connections 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 --2- 172.21.15.81:0/3348356233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc0cb470 0x7f07fc164a20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 -- 172.21.15.81:0/3348356233 >> 172.21.15.81:0/3348356233 conn(0x7f07fc0ce3e0 msgr2=0x7f07fc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 -- 172.21.15.81:0/3348356233 shutdown_connections 2023-11-29T11:13:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.958+0000 7f0800ad8700 1 -- 172.21.15.81:0/3348356233 wait complete. 2023-11-29T11:13:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 Processor -- start 2023-11-29T11:13:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 -- start start 2023-11-29T11:13:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc069c40 0x7f07fc1f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07fc0cb470 0x7f07fc0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07fc159e70 0x7f07fc0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc15cf40 con 0x7f07fc069c40 2023-11-29T11:13:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc15d220 con 0x7f07fc0cb470 2023-11-29T11:13:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0c54b0 con 0x7f07fc159e70 2023-11-29T11:13:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc069c40 0x7f07fc1f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07faffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07fc0cb470 0x7f07fc0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc069c40 0x7f07fc1f0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41604/0 (socket says 172.21.15.81:41604) 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 -- 172.21.15.81:0/1987781559 learned_addr learned my addr 172.21.15.81:0/1987781559 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fbfff700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07fc159e70 0x7f07fc0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 -- 172.21.15.81:0/1987781559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07fc159e70 msgr2=0x7f07fc0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07fc159e70 0x7f07fc0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 -- 172.21.15.81:0/1987781559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07fc0cb470 msgr2=0x7f07fc0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07fc0cb470 0x7f07fc0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 -- 172.21.15.81:0/1987781559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4009a70 con 0x7f07fc069c40 2023-11-29T11:13:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07fb7fe700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc069c40 0x7f07fc1f0fb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c4a0 tx=0x7f07ec00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07e3fff700 1 -- 172.21.15.81:0/1987781559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004ca0 con 0x7f07fc069c40 2023-11-29T11:13:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07e3fff700 1 -- 172.21.15.81:0/1987781559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec004e00 con 0x7f07fc069c40 2023-11-29T11:13:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc06d0b0 con 0x7f07fc069c40 2023-11-29T11:13:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f07e3fff700 1 -- 172.21.15.81:0/1987781559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec007310 con 0x7f07fc069c40 2023-11-29T11:13:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.962+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc06a970 con 0x7f07fc069c40 2023-11-29T11:13:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.966+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc15a240 con 0x7f07fc069c40 2023-11-29T11:13:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.966+0000 7f07e3fff700 1 -- 172.21.15.81:0/1987781559 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f07ec01a020 con 0x7f07fc069c40 2023-11-29T11:13:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.966+0000 7f07e3fff700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f07e8064ee0 0x7f07e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.966+0000 7f07e3fff700 1 -- 172.21.15.81:0/1987781559 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07ec081b50 con 0x7f07fc069c40 2023-11-29T11:13:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.966+0000 7f07faffd700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f07e8064ee0 0x7f07e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.966+0000 7f07faffd700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f07e8064ee0 0x7f07e8067390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07fc1f4bf0 tx=0x7f07f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:20.974+0000 7f07e3fff700 1 -- 172.21.15.81:0/1987781559 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f07ec04fa00 con 0x7f07fc069c40 2023-11-29T11:13:21.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f07fc15d080 con 0x7f07fc069c40 2023-11-29T11:13:21.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f07e3fff700 1 -- 172.21.15.81:0/1987781559 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f07fc15d080 con 0x7f07fc069c40 2023-11-29T11:13:21.158 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:21.158 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-29T11:13:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f07e8064ee0 msgr2=0x7f07e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f07e8064ee0 0x7f07e8067390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07fc1f4bf0 tx=0x7f07f0009040 comp rx=0 tx=0).stop 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc069c40 msgr2=0x7f07fc1f0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc069c40 0x7f07fc1f0fb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c4a0 tx=0x7f07ec00c7b0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 shutdown_connections 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f07e8064ee0 0x7f07e8067390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07fc159e70 0x7f07fc0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07fc0cb470 0x7f07fc0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 --2- 172.21.15.81:0/1987781559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc069c40 0x7f07fc1f0fb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 >> 172.21.15.81:0/1987781559 conn(0x7f07fc0ce3e0 msgr2=0x7f07fc06c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 shutdown_connections 2023-11-29T11:13:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.154+0000 7f0800ad8700 1 -- 172.21.15.81:0/1987781559 wait complete. 2023-11-29T11:13:21.171 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-29T11:13:21.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff835d91700 1 Processor -- start 2023-11-29T11:13:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff835d91700 1 -- start start 2023-11-29T11:13:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff835d91700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8300b3720 0x7ff83006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff835d91700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300cbe00 con 0x7ff8300b32e0 2023-11-29T11:13:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff835d91700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300cd0f0 con 0x7ff8301584c0 2023-11-29T11:13:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff835d91700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83006dbd0 con 0x7ff8300b3720 2023-11-29T11:13:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff82ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff8300b32e0 0x7ff830069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53942/0 (socket says 172.21.15.81:53942) 2023-11-29T11:13:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff82ffff700 1 -- 172.21.15.81:0/3132791411 learned_addr learned my addr 172.21.15.81:0/3132791411 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.266+0000 7ff835590700 1 --2- 172.21.15.81:0/3132791411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8300b3720 0x7ff83006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff82f7fe700 1 -- 172.21.15.81:0/3132791411 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14816947 0 0) 0x7ff8300cbe00 con 0x7ff8300b32e0 2023-11-29T11:13:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff82f7fe700 1 -- 172.21.15.81:0/3132791411 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff81c0035d0 con 0x7ff8300b32e0 2023-11-29T11:13:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835590700 1 -- 172.21.15.81:0/3132791411 >> v1:172.21.15.176:6789/0 conn(0x7ff8301584c0 legacy=0x7ff8300cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff82f7fe700 1 -- 172.21.15.81:0/3132791411 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951994002 0 0) 0x7ff8300cd0f0 con 0x7ff8301584c0 2023-11-29T11:13:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835590700 1 -- 172.21.15.81:0/3132791411 >> v1:172.21.15.81:6789/0 conn(0x7ff8300b32e0 legacy=0x7ff830069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835590700 1 -- 172.21.15.81:0/3132791411 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300cd3d0 con 0x7ff8300b3720 2023-11-29T11:13:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835590700 1 --2- 172.21.15.81:0/3132791411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8300b3720 0x7ff83006a3e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff828009dc0 tx=0x7ff82800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ac0f2b3f7f8a120 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff82f7fe700 1 -- 172.21.15.81:0/3132791411 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800e070 con 0x7ff8300b3720 2023-11-29T11:13:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff82f7fe700 1 -- 172.21.15.81:0/3132791411 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828003a40 con 0x7ff8300b3720 2023-11-29T11:13:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff82f7fe700 1 -- 172.21.15.81:0/3132791411 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828003db0 con 0x7ff8300b3720 2023-11-29T11:13:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835d91700 1 -- 172.21.15.81:0/3132791411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8300b3720 msgr2=0x7ff83006a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835d91700 1 --2- 172.21.15.81:0/3132791411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8300b3720 0x7ff83006a3e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff828009dc0 tx=0x7ff82800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835d91700 1 -- 172.21.15.81:0/3132791411 shutdown_connections 2023-11-29T11:13:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835d91700 1 --2- 172.21.15.81:0/3132791411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8300b3720 0x7ff83006a3e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835d91700 1 -- 172.21.15.81:0/3132791411 >> 172.21.15.81:0/3132791411 conn(0x7ff8300ce3e0 msgr2=0x7ff8300ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835d91700 1 -- 172.21.15.81:0/3132791411 shutdown_connections 2023-11-29T11:13:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.270+0000 7ff835d91700 1 -- 172.21.15.81:0/3132791411 wait complete. 2023-11-29T11:13:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 Processor -- start 2023-11-29T11:13:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 -- start start 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8300b32e0 0x7ff830071540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8300b3720 0x7ff830148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8301584c0 0x7ff830149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300c9aa0 con 0x7ff8300b3720 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83014dc10 con 0x7ff8300b32e0 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83014de60 con 0x7ff8301584c0 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8300b3720 0x7ff830148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8300b3720 0x7ff830148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41612/0 (socket says 172.21.15.81:41612) 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 -- 172.21.15.81:0/2077211796 learned_addr learned my addr 172.21.15.81:0/2077211796 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff834d8f700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8300b32e0 0x7ff830071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835590700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8301584c0 0x7ff830149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 -- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8301584c0 msgr2=0x7ff830149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8301584c0 0x7ff830149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 -- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8300b32e0 msgr2=0x7ff830071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8300b32e0 0x7ff830071540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 -- 172.21.15.81:0/2077211796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828009a70 con 0x7ff8300b3720 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835590700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8301584c0 0x7ff830149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82ffff700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8300b3720 0x7ff830148c20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff818001200 tx=0x7ff81800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82d7fa700 1 -- 172.21.15.81:0/2077211796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818004ca0 con 0x7ff8300b3720 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82d7fa700 1 -- 172.21.15.81:0/2077211796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff818004e20 con 0x7ff8300b3720 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8300cd990 con 0x7ff8300b3720 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff82d7fa700 1 -- 172.21.15.81:0/2077211796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818007310 con 0x7ff8300b3720 2023-11-29T11:13:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.274+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8300cd6b0 con 0x7ff8300b3720 2023-11-29T11:13:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.278+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8300cdc70 con 0x7ff8300b3720 2023-11-29T11:13:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.278+0000 7ff82d7fa700 1 -- 172.21.15.81:0/2077211796 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff818010070 con 0x7ff8300b3720 2023-11-29T11:13:21.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.278+0000 7ff82d7fa700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff810064ee0 0x7ff810067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.278+0000 7ff82d7fa700 1 -- 172.21.15.81:0/2077211796 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff818081a40 con 0x7ff8300b3720 2023-11-29T11:13:21.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.278+0000 7ff834d8f700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff810064ee0 0x7ff810067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.278+0000 7ff834d8f700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff810064ee0 0x7ff810067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff820000f60 tx=0x7ff820009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.286+0000 7ff82d7fa700 1 -- 172.21.15.81:0/2077211796 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff81804f990 con 0x7ff8300b3720 2023-11-29T11:13:21.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.434+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff830072500 con 0x7ff8300b3720 2023-11-29T11:13:21.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.438+0000 7ff82d7fa700 1 -- 172.21.15.81:0/2077211796 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7ff818052fb0 con 0x7ff8300b3720 2023-11-29T11:13:21.443 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:21.443 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:21.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff810064ee0 msgr2=0x7ff810067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff810064ee0 0x7ff810067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff820000f60 tx=0x7ff820009040 comp rx=0 tx=0).stop 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8300b3720 msgr2=0x7ff830148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8300b3720 0x7ff830148c20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff818001200 tx=0x7ff81800ca60 comp rx=0 tx=0).stop 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 shutdown_connections 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff810064ee0 0x7ff810067390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8301584c0 0x7ff830149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8300b3720 0x7ff830148c20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 --2- 172.21.15.81:0/2077211796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8300b32e0 0x7ff830071540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 >> 172.21.15.81:0/2077211796 conn(0x7ff8300ce3e0 msgr2=0x7ff8300cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 shutdown_connections 2023-11-29T11:13:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.442+0000 7ff835d91700 1 -- 172.21.15.81:0/2077211796 wait complete. 2023-11-29T11:13:21.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:21.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:21.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b2766700 1 Processor -- start 2023-11-29T11:13:21.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b2766700 1 -- start start 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b2766700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b2766700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff6ac06a4c0 0x7ff6ac0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b2766700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6ac0cf0e0 0x7ff6ac0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b2766700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0cfa80 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b2766700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac06a9c0 con 0x7ff6ac06a4c0 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b2766700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac06aca0 con 0x7ff6ac0b1ae0 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6ac0cf0e0 0x7ff6ac0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6ac0cf0e0 0x7ff6ac0cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41618/0 (socket says 172.21.15.81:41618) 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 -- 172.21.15.81:0/1533630012 learned_addr learned my addr 172.21.15.81:0/1533630012 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b0f63700 1 --2- 172.21.15.81:0/1533630012 >> v2:172.21.15.176:3300/0 conn(0x7ff6ac06a4c0 0x7ff6ac0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1764700 1 --2- 172.21.15.81:0/1533630012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 -- 172.21.15.81:0/1533630012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 msgr2=0x7ff6ac06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 --2- 172.21.15.81:0/1533630012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 -- 172.21.15.81:0/1533630012 >> v2:172.21.15.176:3300/0 conn(0x7ff6ac06a4c0 msgr2=0x7ff6ac0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 --2- 172.21.15.81:0/1533630012 >> v2:172.21.15.176:3300/0 conn(0x7ff6ac06a4c0 0x7ff6ac0d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 -- 172.21.15.81:0/1533630012 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac06af80 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b0f63700 1 --2- 172.21.15.81:0/1533630012 >> v2:172.21.15.176:3300/0 conn(0x7ff6ac06a4c0 0x7ff6ac0d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6b1f65700 1 --2- 172.21.15.81:0/1533630012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac0cf540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac08ba60 tx=0x7ff6a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df65f003bd51808 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6a3fff700 1 -- 172.21.15.81:0/1533630012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a400e070 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6a3fff700 1 -- 172.21.15.81:0/1533630012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a400b9c0 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.562+0000 7ff6a3fff700 1 -- 172.21.15.81:0/1533630012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a400bd70 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- 172.21.15.81:0/1533630012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 msgr2=0x7ff6ac0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 --2- 172.21.15.81:0/1533630012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac0cf540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac08ba60 tx=0x7ff6a400b330 comp rx=0 tx=0).stop 2023-11-29T11:13:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- 172.21.15.81:0/1533630012 shutdown_connections 2023-11-29T11:13:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 --2- 172.21.15.81:0/1533630012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac0cf540 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 --2- 172.21.15.81:0/1533630012 >> v2:172.21.15.176:3300/0 conn(0x7ff6ac06a4c0 0x7ff6ac0d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 --2- 172.21.15.81:0/1533630012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- 172.21.15.81:0/1533630012 >> 172.21.15.81:0/1533630012 conn(0x7ff6ac09bbd0 msgr2=0x7ff6ac0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- 172.21.15.81:0/1533630012 shutdown_connections 2023-11-29T11:13:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- 172.21.15.81:0/1533630012 wait complete. 2023-11-29T11:13:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 Processor -- start 2023-11-29T11:13:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- start start 2023-11-29T11:13:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06a4c0 0x7ff6ac15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac159f80 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac158d40 con 0x7ff6ac06a4c0 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b2766700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac159020 con 0x7ff6ac0b1ae0 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b1f65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b1f65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac06d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41624/0 (socket says 172.21.15.81:41624) 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b1f65700 1 -- 172.21.15.81:0/2171434203 learned_addr learned my addr 172.21.15.81:0/2171434203 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b1764700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06a4c0 0x7ff6ac15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.566+0000 7ff6b0f63700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b1f65700 1 -- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 msgr2=0x7ff6ac1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b1f65700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b1f65700 1 -- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06a4c0 msgr2=0x7ff6ac15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b1f65700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06a4c0 0x7ff6ac15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b1f65700 1 -- 172.21.15.81:0/2171434203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009b30 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b0f63700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b1f65700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac06d260 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400b370 tx=0x7ff6a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6a1ffb700 1 -- 172.21.15.81:0/2171434203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4004250 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6a1ffb700 1 -- 172.21.15.81:0/2171434203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a40043b0 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac0b1eb0 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6a1ffb700 1 -- 172.21.15.81:0/2171434203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4004760 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac0b4380 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac0b60e0 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.570+0000 7ff6a1ffb700 1 -- 172.21.15.81:0/2171434203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff6a402b020 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.574+0000 7ff6a1ffb700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff690064f30 0x7ff6900673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.574+0000 7ff6a1ffb700 1 -- 172.21.15.81:0/2171434203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff6a4082eb0 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.574+0000 7ff6b1764700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff690064f30 0x7ff6900673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.574+0000 7ff6b1764700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff690064f30 0x7ff6900673e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8006b40 tx=0x7ff6a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.578+0000 7ff6a1ffb700 1 -- 172.21.15.81:0/2171434203 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff6a4050d60 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.730+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff6ac072500 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.730+0000 7ff6a1ffb700 1 -- 172.21.15.81:0/2171434203 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff6a4054380 con 0x7ff6ac0cf0e0 2023-11-29T11:13:21.734 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.730+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff690064f30 msgr2=0x7ff6900673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.730+0000 7ff6b2766700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff690064f30 0x7ff6900673e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8006b40 tx=0x7ff6a8008040 comp rx=0 tx=0).stop 2023-11-29T11:13:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.730+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 msgr2=0x7ff6ac06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.730+0000 7ff6b2766700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac06d260 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400b370 tx=0x7ff6a4004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.734+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 shutdown_connections 2023-11-29T11:13:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.734+0000 7ff6b2766700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff690064f30 0x7ff6900673e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.734+0000 7ff6b2766700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6ac0cf0e0 0x7ff6ac06d260 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.734+0000 7ff6b2766700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0b1ae0 0x7ff6ac1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.734+0000 7ff6b2766700 1 --2- 172.21.15.81:0/2171434203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06a4c0 0x7ff6ac15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.734+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 >> 172.21.15.81:0/2171434203 conn(0x7ff6ac09bbd0 msgr2=0x7ff6ac15bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.734+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 shutdown_connections 2023-11-29T11:13:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.734+0000 7ff6b2766700 1 -- 172.21.15.81:0/2171434203 wait complete. 2023-11-29T11:13:21.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:21.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.858+0000 7f2fbe635700 1 Processor -- start 2023-11-29T11:13:21.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.858+0000 7f2fbe635700 1 -- start start 2023-11-29T11:13:21.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2fb80cf7f0 0x7f2fb806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb806a9c0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb806aca0 con 0x7f2fb80b1ae0 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb80d0ab0 con 0x7f2fb80cf7f0 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbce32700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2fb806a4c0 0x7f2fb80cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53954/0 (socket says 172.21.15.81:53954) 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbce32700 1 -- 172.21.15.81:0/1617150732 learned_addr learned my addr 172.21.15.81:0/1617150732 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbde34700 1 --2- 172.21.15.81:0/1617150732 >> v2:172.21.15.81:3300/0 conn(0x7f2fb80cf7f0 0x7f2fb806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2faffff700 1 -- 172.21.15.81:0/1617150732 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853992523 0 0) 0x7f2fb806a9c0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2faffff700 1 -- 172.21.15.81:0/1617150732 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa40035d0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbde34700 1 -- 172.21.15.81:0/1617150732 >> v1:172.21.15.176:6789/0 conn(0x7f2fb80b1ae0 legacy=0x7f2fb80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbde34700 1 -- 172.21.15.81:0/1617150732 >> v1:172.21.15.81:6789/0 conn(0x7f2fb806a4c0 legacy=0x7f2fb80cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbde34700 1 -- 172.21.15.81:0/1617150732 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb806af80 con 0x7f2fb80cf7f0 2023-11-29T11:13:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbde34700 1 --2- 172.21.15.81:0/1617150732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb80cf7f0 0x7f2fb806d8e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009850 tx=0x7f2fb0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d11729434ba7f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2faffff700 1 -- 172.21.15.81:0/1617150732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011830 con 0x7f2fb80cf7f0 2023-11-29T11:13:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2faffff700 1 -- 172.21.15.81:0/1617150732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0011990 con 0x7f2fb80cf7f0 2023-11-29T11:13:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2faffff700 1 -- 172.21.15.81:0/1617150732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011d40 con 0x7f2fb80cf7f0 2023-11-29T11:13:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 -- 172.21.15.81:0/1617150732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb80cf7f0 msgr2=0x7f2fb806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 --2- 172.21.15.81:0/1617150732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb80cf7f0 0x7f2fb806d8e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009850 tx=0x7f2fb0009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 -- 172.21.15.81:0/1617150732 shutdown_connections 2023-11-29T11:13:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 --2- 172.21.15.81:0/1617150732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb80cf7f0 0x7f2fb806d8e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 -- 172.21.15.81:0/1617150732 >> 172.21.15.81:0/1617150732 conn(0x7f2fb809bbd0 msgr2=0x7f2fb80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 -- 172.21.15.81:0/1617150732 shutdown_connections 2023-11-29T11:13:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.862+0000 7f2fbe635700 1 -- 172.21.15.81:0/1617150732 wait complete. 2023-11-29T11:13:21.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 Processor -- start 2023-11-29T11:13:21.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 -- start start 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb806a4c0 0x7f2fb815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb80b1ae0 0x7f2fb80b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb80cf7f0 0x7f2fb80b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb815acb0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81f5760 con 0x7f2fb80b1ae0 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81f5a00 con 0x7f2fb80cf7f0 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb806a4c0 0x7f2fb815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb806a4c0 0x7f2fb815a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41642/0 (socket says 172.21.15.81:41642) 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 -- 172.21.15.81:0/2962632346 learned_addr learned my addr 172.21.15.81:0/2962632346 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 -- 172.21.15.81:0/2962632346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb80cf7f0 msgr2=0x7f2fb80b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb80cf7f0 0x7f2fb80b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 -- 172.21.15.81:0/2962632346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb80b1ae0 msgr2=0x7f2fb80b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb80b1ae0 0x7f2fb80b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 -- 172.21.15.81:0/2962632346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00094b0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbd633700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb806a4c0 0x7f2fb815a570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400cbd0 tx=0x7f2fb400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fadffb700 1 -- 172.21.15.81:0/2962632346 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4003c20 con 0x7f2fb806a4c0 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fadffb700 1 -- 172.21.15.81:0/2962632346 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4003d80 con 0x7f2fb806a4c0 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fadffb700 1 -- 172.21.15.81:0/2962632346 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400abf0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb80b1eb0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb80b4380 con 0x7f2fb806a4c0 2023-11-29T11:13:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.866+0000 7f2fadffb700 1 -- 172.21.15.81:0/2962632346 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2fb4010050 con 0x7f2fb806a4c0 2023-11-29T11:13:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.870+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb80b60e0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.870+0000 7f2fadffb700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2f9c064ee0 0x7f2f9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.870+0000 7f2fbce32700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2f9c064ee0 0x7f2f9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.870+0000 7f2fadffb700 1 -- 172.21.15.81:0/2962632346 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2fb40820d0 con 0x7f2fb806a4c0 2023-11-29T11:13:21.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.870+0000 7f2fbce32700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2f9c064ee0 0x7f2f9c067390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2fb81f5d00 tx=0x7f2fa80079e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:21.874+0000 7f2fadffb700 1 -- 172.21.15.81:0/2962632346 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2fb404ff80 con 0x7f2fb806a4c0 2023-11-29T11:13:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.026+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fb8072500 con 0x7f2fb806a4c0 2023-11-29T11:13:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.026+0000 7f2fadffb700 1 -- 172.21.15.81:0/2962632346 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fb40535a0 con 0x7f2fb806a4c0 2023-11-29T11:13:22.032 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2f9c064ee0 msgr2=0x7f2f9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2f9c064ee0 0x7f2f9c067390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2fb81f5d00 tx=0x7f2fa80079e0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb806a4c0 msgr2=0x7f2fb815a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb806a4c0 0x7f2fb815a570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400cbd0 tx=0x7f2fb400cf90 comp rx=0 tx=0).stop 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 shutdown_connections 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2f9c064ee0 0x7f2f9c067390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fb80cf7f0 0x7f2fb80b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb80b1ae0 0x7f2fb80b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 --2- 172.21.15.81:0/2962632346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb806a4c0 0x7f2fb815a570 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 >> 172.21.15.81:0/2962632346 conn(0x7f2fb809bbd0 msgr2=0x7f2fb806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 shutdown_connections 2023-11-29T11:13:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.030+0000 7f2fbe635700 1 -- 172.21.15.81:0/2962632346 wait complete. 2023-11-29T11:13:22.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:22.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff9288eb700 1 Processor -- start 2023-11-29T11:13:22.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff9288eb700 1 -- start start 2023-11-29T11:13:22.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff9288eb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 0x7ff9240c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff9288eb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9240cd3a0 0x7ff9240ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff9288eb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92406a4d0 con 0x7ff924158480 2023-11-29T11:13:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff9288eb700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9240cc490 con 0x7ff9240cd3a0 2023-11-29T11:13:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff922d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff924158480 0x7ff9240cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53968/0 (socket says 172.21.15.81:53968) 2023-11-29T11:13:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff9288eb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92406a720 con 0x7ff924158850 2023-11-29T11:13:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.162+0000 7ff922d9d700 1 -- 172.21.15.81:0/1620330705 learned_addr learned my addr 172.21.15.81:0/1620330705 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:22.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 --2- 172.21.15.81:0/1620330705 >> v2:172.21.15.176:3300/0 conn(0x7ff9240cd3a0 0x7ff9240ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404639604 0 0) 0x7ff92406a4d0 con 0x7ff924158480 2023-11-29T11:13:22.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92259c700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 0x7ff9240c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff90c0046e0 con 0x7ff924158480 2023-11-29T11:13:22.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944143413 0 0) 0x7ff90c0046e0 con 0x7ff924158480 2023-11-29T11:13:22.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 msgr2=0x7ff9240c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 0x7ff9240c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 >> v2:172.21.15.176:3300/0 conn(0x7ff9240cd3a0 msgr2=0x7ff9240ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 --2- 172.21.15.81:0/1620330705 >> v2:172.21.15.176:3300/0 conn(0x7ff9240cd3a0 0x7ff9240ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92406aa00 con 0x7ff924158480 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7ff914005140 con 0x7ff924158480 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 >> v1:172.21.15.81:6789/0 conn(0x7ff924158480 legacy=0x7ff9240cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 0x7ff90c004b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90c0050b0 0x7ff90c005980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff90c005ec0 0x7ff90c006330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240cc490 con 0x7ff90c005ec0 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92406a720 con 0x7ff90c0050b0 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c00cb40 con 0x7ff924158850 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff90c005ec0 0x7ff90c006330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92259c700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90c0050b0 0x7ff90c005980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff922d9d700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 0x7ff90c004b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 -- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 msgr2=0x7ff90c004b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 0x7ff90c004b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 -- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90c0050b0 msgr2=0x7ff90c005980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90c0050b0 0x7ff90c005980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 -- 172.21.15.81:0/1620330705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c0046e0 con 0x7ff90c005ec0 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92259c700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff90c0050b0 0x7ff90c005980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff922d9d700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff924158850 0x7ff90c004b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff90c005ec0 0x7ff90c006330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009fc0 tx=0x7ff90c0069b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c654976a9e4f34 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00ec30 con 0x7ff90c005ec0 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00f040 con 0x7ff90c005ec0 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff921d9b700 1 -- 172.21.15.81:0/1620330705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c014480 con 0x7ff90c005ec0 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff9288eb700 1 -- 172.21.15.81:0/1620330705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff90c005ec0 msgr2=0x7ff90c006330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff9288eb700 1 --2- 172.21.15.81:0/1620330705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff90c005ec0 0x7ff90c006330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009fc0 tx=0x7ff90c0069b0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff92359e700 1 -- 172.21.15.81:0/1620330705 reap_dead start 2023-11-29T11:13:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff9288eb700 1 -- 172.21.15.81:0/1620330705 shutdown_connections 2023-11-29T11:13:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff9288eb700 1 -- 172.21.15.81:0/1620330705 >> 172.21.15.81:0/1620330705 conn(0x7ff92406c660 msgr2=0x7ff92406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff9288eb700 1 -- 172.21.15.81:0/1620330705 shutdown_connections 2023-11-29T11:13:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.166+0000 7ff9288eb700 1 -- 172.21.15.81:0/1620330705 wait complete. 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 Processor -- start 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 -- start start 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90c005ec0 0x7ff92414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9240c9e40 0x7ff9240c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9240c8270 0x7ff9240c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240c8e60 con 0x7ff9240c9e40 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240c93f0 con 0x7ff9240c8270 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240cb2d0 con 0x7ff90c005ec0 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9240c9e40 0x7ff9240c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9240c9e40 0x7ff9240c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41658/0 (socket says 172.21.15.81:41658) 2023-11-29T11:13:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 -- 172.21.15.81:0/1938790528 learned_addr learned my addr 172.21.15.81:0/1938790528 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92359e700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9240c8270 0x7ff9240c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff922d9d700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90c005ec0 0x7ff92414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 -- 172.21.15.81:0/1938790528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90c005ec0 msgr2=0x7ff92414ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90c005ec0 0x7ff92414ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 -- 172.21.15.81:0/1938790528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9240c8270 msgr2=0x7ff9240c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9240c8270 0x7ff9240c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 -- 172.21.15.81:0/1938790528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9240cf1e0 con 0x7ff9240c9e40 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff92259c700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9240c9e40 0x7ff9240c7d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff918010960 tx=0x7ff918010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff90b7fe700 1 -- 172.21.15.81:0/1938790528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918004220 con 0x7ff9240c9e40 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92406ace0 con 0x7ff9240c9e40 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff90b7fe700 1 -- 172.21.15.81:0/1938790528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918004380 con 0x7ff9240c9e40 2023-11-29T11:13:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff90b7fe700 1 -- 172.21.15.81:0/1938790528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9180036c0 con 0x7ff9240c9e40 2023-11-29T11:13:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.170+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9240cf370 con 0x7ff9240c9e40 2023-11-29T11:13:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.174+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9240c8640 con 0x7ff9240c9e40 2023-11-29T11:13:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.174+0000 7ff90b7fe700 1 -- 172.21.15.81:0/1938790528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff918012040 con 0x7ff9240c9e40 2023-11-29T11:13:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.174+0000 7ff90b7fe700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff910064f10 0x7ff9100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.174+0000 7ff90b7fe700 1 -- 172.21.15.81:0/1938790528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff918081df0 con 0x7ff9240c9e40 2023-11-29T11:13:22.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.174+0000 7ff922d9d700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff910064f10 0x7ff9100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.174+0000 7ff922d9d700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff910064f10 0x7ff9100673c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff914004a80 tx=0x7ff914009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.178+0000 7ff90b7fe700 1 -- 172.21.15.81:0/1938790528 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff91804fc20 con 0x7ff9240c9e40 2023-11-29T11:13:22.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.326+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff924071400 con 0x7ff9240c9e40 2023-11-29T11:13:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff90b7fe700 1 -- 172.21.15.81:0/1938790528 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff918053240 con 0x7ff9240c9e40 2023-11-29T11:13:22.367 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff910064f10 msgr2=0x7ff9100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff910064f10 0x7ff9100673c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff914004a80 tx=0x7ff914009040 comp rx=0 tx=0).stop 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9240c9e40 msgr2=0x7ff9240c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9240c9e40 0x7ff9240c7d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff918010960 tx=0x7ff918010c70 comp rx=0 tx=0).stop 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 shutdown_connections 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff910064f10 0x7ff9100673c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9240c8270 0x7ff9240c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9240c9e40 0x7ff9240c7d30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 --2- 172.21.15.81:0/1938790528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff90c005ec0 0x7ff92414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 >> 172.21.15.81:0/1938790528 conn(0x7ff92406c660 msgr2=0x7ff9240b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 shutdown_connections 2023-11-29T11:13:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.330+0000 7ff9288eb700 1 -- 172.21.15.81:0/1938790528 wait complete. 2023-11-29T11:13:22.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 Processor -- start 2023-11-29T11:13:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- start start 2023-11-29T11:13:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc3480d1e30 0x7fc3480b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480d0460 con 0x7fc34806ce60 2023-11-29T11:13:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480d3390 con 0x7fc3480d1e30 2023-11-29T11:13:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480d2380 con 0x7fc3480cf110 2023-11-29T11:13:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34d7ea700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc3480d1e30 0x7fc3480b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34e7ec700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34d7ea700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc3480d1e30 0x7fc3480b8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:50906/0 (socket says 172.21.15.81:50906) 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34d7ea700 1 -- 172.21.15.81:0/823532090 learned_addr learned my addr 172.21.15.81:0/823532090 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34e7ec700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:33242/0 (socket says 172.21.15.81:33242) 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34dfeb700 1 --1- 172.21.15.81:0/823532090 >> v1:172.21.15.176:6789/0 conn(0x7fc34806ce60 0x7fc34806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:35378/0 (socket says 172.21.15.81:35378) 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34d7ea700 1 -- 172.21.15.81:0/823532090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 msgr2=0x7fc3480cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34d7ea700 1 --2- 172.21.15.81:0/823532090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34d7ea700 1 -- 172.21.15.81:0/823532090 >> v1:172.21.15.176:6789/0 conn(0x7fc34806ce60 legacy=0x7fc34806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34d7ea700 1 -- 172.21.15.81:0/823532090 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480d2f00 con 0x7fc3480d1e30 2023-11-29T11:13:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34e7ec700 1 --2- 172.21.15.81:0/823532090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:22.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34d7ea700 1 --2- 172.21.15.81:0/823532090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3480d1e30 0x7fc3480b8240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009910 tx=0x7fc33c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b0793d1f10fe52 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34cfe9700 1 -- 172.21.15.81:0/823532090 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c011830 con 0x7fc3480d1e30 2023-11-29T11:13:22.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34cfe9700 1 -- 172.21.15.81:0/823532090 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c011990 con 0x7fc3480d1e30 2023-11-29T11:13:22.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34cfe9700 1 -- 172.21.15.81:0/823532090 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c011d40 con 0x7fc3480d1e30 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- 172.21.15.81:0/823532090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3480d1e30 msgr2=0x7fc3480b8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 --2- 172.21.15.81:0/823532090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3480d1e30 0x7fc3480b8240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009910 tx=0x7fc33c009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- 172.21.15.81:0/823532090 shutdown_connections 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 --2- 172.21.15.81:0/823532090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 --2- 172.21.15.81:0/823532090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3480d1e30 0x7fc3480b8240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- 172.21.15.81:0/823532090 >> 172.21.15.81:0/823532090 conn(0x7fc34809bbd0 msgr2=0x7fc3480b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- 172.21.15.81:0/823532090 shutdown_connections 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.478+0000 7fc34efed700 1 -- 172.21.15.81:0/823532090 wait complete. 2023-11-29T11:13:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 Processor -- start 2023-11-29T11:13:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 -- start start 2023-11-29T11:13:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34806ce60 0x7fc348154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3480d1e30 0x7fc34815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481546a0 con 0x7fc3480d1e30 2023-11-29T11:13:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc348159050 con 0x7fc34806ce60 2023-11-29T11:13:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481592f0 con 0x7fc3480cf110 2023-11-29T11:13:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3480d1e30 0x7fc34815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3480d1e30 0x7fc34815c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41668/0 (socket says 172.21.15.81:41668) 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 -- 172.21.15.81:0/1864701443 learned_addr learned my addr 172.21.15.81:0/1864701443 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34d7ea700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34dfeb700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34806ce60 0x7fc348154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 -- 172.21.15.81:0/1864701443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 msgr2=0x7fc3480b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 -- 172.21.15.81:0/1864701443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34806ce60 msgr2=0x7fc348154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34806ce60 0x7fc348154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 -- 172.21.15.81:0/1864701443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340009a70 con 0x7fc3480d1e30 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34e7ec700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3480d1e30 0x7fc34815c920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc34000efc0 tx=0x7fc34000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1864701443 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000ca90 con 0x7fc3480d1e30 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1864701443 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34000f040 con 0x7fc3480d1e30 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c009570 con 0x7fc3480d1e30 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1864701443 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000ce10 con 0x7fc3480d1e30 2023-11-29T11:13:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.482+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3480d25d0 con 0x7fc3480d1e30 2023-11-29T11:13:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.486+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3480d2890 con 0x7fc3480d1e30 2023-11-29T11:13:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.486+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1864701443 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc340014480 con 0x7fc3480d1e30 2023-11-29T11:13:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.486+0000 7fc33a7fc700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc32c064f10 0x7fc32c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.486+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1864701443 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3400829a0 con 0x7fc3480d1e30 2023-11-29T11:13:22.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.486+0000 7fc34dfeb700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc32c064f10 0x7fc32c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.486+0000 7fc34dfeb700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc32c064f10 0x7fc32c0673c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc344000f60 tx=0x7fc344007ef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.494+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1864701443 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc340050700 con 0x7fc3480d1e30 2023-11-29T11:13:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.658+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc34815c6e0 con 0x7fc3480d1e30 2023-11-29T11:13:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.658+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1864701443 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc340009d70 con 0x7fc3480d1e30 2023-11-29T11:13:22.664 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc32c064f10 msgr2=0x7fc32c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc32c064f10 0x7fc32c0673c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc344000f60 tx=0x7fc344007ef0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3480d1e30 msgr2=0x7fc34815c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3480d1e30 0x7fc34815c920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc34000efc0 tx=0x7fc34000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 shutdown_connections 2023-11-29T11:13:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc32c064f10 0x7fc32c0673c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3480d1e30 0x7fc34815c920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3480cf110 0x7fc3480b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 --2- 172.21.15.81:0/1864701443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34806ce60 0x7fc348154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 >> 172.21.15.81:0/1864701443 conn(0x7fc34809bbd0 msgr2=0x7fc34815ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 shutdown_connections 2023-11-29T11:13:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.662+0000 7fc34efed700 1 -- 172.21.15.81:0/1864701443 wait complete. 2023-11-29T11:13:22.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.790+0000 7f8eaec47700 1 Processor -- start 2023-11-29T11:13:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.790+0000 7f8eaec47700 1 -- start start 2023-11-29T11:13:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ea8158ee0 0x7f8ea80ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8ea80cd5d0 0x7f8ea80cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea806d1c0 con 0x7f8ea80ce060 2023-11-29T11:13:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea806e000 con 0x7f8ea8158ee0 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea80ce460 con 0x7f8ea80cd5d0 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eadc45700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ea8158ee0 0x7f8ea80ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eadc45700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ea8158ee0 0x7f8ea80ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41684/0 (socket says 172.21.15.81:41684) 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eadc45700 1 -- 172.21.15.81:0/981916042 learned_addr learned my addr 172.21.15.81:0/981916042 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8ead444700 1 --2- 172.21.15.81:0/981916042 >> v2:172.21.15.176:3300/0 conn(0x7f8ea80cd5d0 0x7f8ea80cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eadc45700 1 -- 172.21.15.81:0/981916042 >> v2:172.21.15.176:3300/0 conn(0x7f8ea80cd5d0 msgr2=0x7f8ea80cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eadc45700 1 --2- 172.21.15.81:0/981916042 >> v2:172.21.15.176:3300/0 conn(0x7f8ea80cd5d0 0x7f8ea80cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eadc45700 1 -- 172.21.15.81:0/981916042 >> v1:172.21.15.176:6789/0 conn(0x7f8ea80ce060 legacy=0x7f8ea815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eadc45700 1 -- 172.21.15.81:0/981916042 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80ca3a0 con 0x7f8ea8158ee0 2023-11-29T11:13:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eadc45700 1 --2- 172.21.15.81:0/981916042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea8158ee0 0x7f8ea80ae760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ea815d8f0 tx=0x7f8ea4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd35ddeb423a440 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eacc43700 1 -- 172.21.15.81:0/981916042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400b8a0 con 0x7f8ea8158ee0 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eacc43700 1 -- 172.21.15.81:0/981916042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea400ba00 con 0x7f8ea8158ee0 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eacc43700 1 -- 172.21.15.81:0/981916042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400bd90 con 0x7f8ea8158ee0 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 -- 172.21.15.81:0/981916042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea8158ee0 msgr2=0x7f8ea80ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 --2- 172.21.15.81:0/981916042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea8158ee0 0x7f8ea80ae760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ea815d8f0 tx=0x7f8ea4009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 -- 172.21.15.81:0/981916042 shutdown_connections 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 --2- 172.21.15.81:0/981916042 >> v2:172.21.15.176:3300/0 conn(0x7f8ea80cd5d0 0x7f8ea80cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 --2- 172.21.15.81:0/981916042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea8158ee0 0x7f8ea80ae760 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 -- 172.21.15.81:0/981916042 >> 172.21.15.81:0/981916042 conn(0x7f8ea80d0240 msgr2=0x7f8ea80cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 -- 172.21.15.81:0/981916042 shutdown_connections 2023-11-29T11:13:22.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.794+0000 7f8eaec47700 1 -- 172.21.15.81:0/981916042 wait complete. 2023-11-29T11:13:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eaec47700 1 Processor -- start 2023-11-29T11:13:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eaec47700 1 -- start start 2023-11-29T11:13:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eaec47700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ea80cd5d0 0x7f8ea81edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eaec47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80ce060 0x7f8ea815b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eaec47700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ea8158ee0 0x7f8ea815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eaec47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81f1cb0 con 0x7f8ea80ce060 2023-11-29T11:13:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eaec47700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81f27f0 con 0x7f8ea80cd5d0 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eaec47700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81f1ec0 con 0x7f8ea8158ee0 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8ead444700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80ce060 0x7f8ea815b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8ead444700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80ce060 0x7f8ea815b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41694/0 (socket says 172.21.15.81:41694) 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8ead444700 1 -- 172.21.15.81:0/2150698545 learned_addr learned my addr 172.21.15.81:0/2150698545 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eadc45700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ea80cd5d0 0x7f8ea81edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.798+0000 7f8eae446700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ea8158ee0 0x7f8ea815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8ead444700 1 -- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ea8158ee0 msgr2=0x7f8ea815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8ead444700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ea8158ee0 0x7f8ea815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8ead444700 1 -- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ea80cd5d0 msgr2=0x7f8ea81edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8ead444700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ea80cd5d0 0x7f8ea81edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8ead444700 1 -- 172.21.15.81:0/2150698545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009570 con 0x7f8ea80ce060 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8eadc45700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ea80cd5d0 0x7f8ea81edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8ead444700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80ce060 0x7f8ea815b610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800dfd0 tx=0x7f8e9800fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8e9e7fc700 1 -- 172.21.15.81:0/2150698545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98007ae0 con 0x7f8ea80ce060 2023-11-29T11:13:22.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8e9e7fc700 1 -- 172.21.15.81:0/2150698545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98007c40 con 0x7f8ea80ce060 2023-11-29T11:13:22.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea806cc00 con 0x7f8ea80ce060 2023-11-29T11:13:22.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8e9e7fc700 1 -- 172.21.15.81:0/2150698545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011450 con 0x7f8ea80ce060 2023-11-29T11:13:22.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea806c920 con 0x7f8ea80ce060 2023-11-29T11:13:22.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea806cee0 con 0x7f8ea80ce060 2023-11-29T11:13:22.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8e9e7fc700 1 -- 172.21.15.81:0/2150698545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8e98023070 con 0x7f8ea80ce060 2023-11-29T11:13:22.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8e9e7fc700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e8c064ee0 0x7f8e8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:22.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8e9e7fc700 1 -- 172.21.15.81:0/2150698545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8e98084730 con 0x7f8ea80ce060 2023-11-29T11:13:22.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.802+0000 7f8eadc45700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e8c064ee0 0x7f8e8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:22.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.806+0000 7f8eadc45700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e8c064ee0 0x7f8e8c067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4000c00 tx=0x7f8ea4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.814+0000 7f8e9e7fc700 1 -- 172.21.15.81:0/2150698545 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8e98052610 con 0x7f8ea80ce060 2023-11-29T11:13:22.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.970+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8ea8072c20 con 0x7f8ea80ce060 2023-11-29T11:13:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.970+0000 7f8e9e7fc700 1 -- 172.21.15.81:0/2150698545 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8e98021020 con 0x7f8ea80ce060 2023-11-29T11:13:22.976 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e8c064ee0 msgr2=0x7f8e8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e8c064ee0 0x7f8e8c067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4000c00 tx=0x7f8ea4008030 comp rx=0 tx=0).stop 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80ce060 msgr2=0x7f8ea815b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80ce060 0x7f8ea815b610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800dfd0 tx=0x7f8e9800fde0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 shutdown_connections 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e8c064ee0 0x7f8e8c067390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ea8158ee0 0x7f8ea815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80ce060 0x7f8ea815b610 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 --2- 172.21.15.81:0/2150698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ea80cd5d0 0x7f8ea81edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 >> 172.21.15.81:0/2150698545 conn(0x7f8ea80d0240 msgr2=0x7f8ea8070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 shutdown_connections 2023-11-29T11:13:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:22.974+0000 7f8eaec47700 1 -- 172.21.15.81:0/2150698545 wait complete. 2023-11-29T11:13:22.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:13:23.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8200f700 1 Processor -- start 2023-11-29T11:13:23.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8200f700 1 -- start start 2023-11-29T11:13:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8200f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c154600 0x7f6b7c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8200f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b7c06abe0 0x7f6b7c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8200f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c15e300 con 0x7f6b7c06c650 2023-11-29T11:13:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8200f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c06ced0 con 0x7f6b7c06abe0 2023-11-29T11:13:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8200f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c15d9d0 con 0x7f6b7c154600 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8080c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6b7c06c650 0x7f6b7c06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53970/0 (socket says 172.21.15.81:53970) 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8080c700 1 -- 172.21.15.81:0/481503637 learned_addr learned my addr 172.21.15.81:0/481503637 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8180e700 1 --2- 172.21.15.81:0/481503637 >> v2:172.21.15.176:3300/0 conn(0x7f6b7c06abe0 0x7f6b7c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8100d700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c154600 0x7f6b7c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078095346 0 0) 0x7f6b7c15e300 con 0x7f6b7c06c650 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b640035d0 con 0x7f6b7c06c650 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 543178591 0 0) 0x7f6b640035d0 con 0x7f6b7c06c650 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c154600 msgr2=0x7f6b7c15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c154600 0x7f6b7c15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 >> v2:172.21.15.176:3300/0 conn(0x7f6b7c06abe0 msgr2=0x7f6b7c15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 --2- 172.21.15.81:0/481503637 >> v2:172.21.15.176:3300/0 conn(0x7f6b7c06abe0 0x7f6b7c15b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c15dcb0 con 0x7f6b7c06c650 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f6b70001670 con 0x7f6b7c06c650 2023-11-29T11:13:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 >> v1:172.21.15.81:6789/0 conn(0x7f6b7c06c650 legacy=0x7f6b7c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b64003a20 0x7f6b64003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b64004450 0x7f6b64004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64004f30 0x7f6b6400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c06ced0 con 0x7f6b64003a20 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c15d9d0 con 0x7f6b64004f30 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6400bf70 con 0x7f6b64004450 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8180e700 1 --2- 172.21.15.81:0/481503637 >> v2:172.21.15.176:3300/0 conn(0x7f6b7c06abe0 0x7f6b7c15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8100d700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c154600 0x7f6b7c15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8100d700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b64003a20 0x7f6b64003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8080c700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b64004450 0x7f6b64004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.098+0000 7f6b8180e700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64004f30 0x7f6b6400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8100d700 1 -- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b64004450 msgr2=0x7f6b64004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8100d700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b64004450 0x7f6b64004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8100d700 1 -- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64004f30 msgr2=0x7f6b6400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8100d700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64004f30 0x7f6b6400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8100d700 1 -- 172.21.15.81:0/481503637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b640035d0 con 0x7f6b64003a20 2023-11-29T11:13:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8100d700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b64003a20 0x7f6b64003e30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0d0710 tx=0x7f6b640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256d8174dae6b2dd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74003c40 con 0x7f6b64003a20 2023-11-29T11:13:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7400f040 con 0x7f6b64003a20 2023-11-29T11:13:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b7bfff700 1 -- 172.21.15.81:0/481503637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7400ea60 con 0x7f6b64003a20 2023-11-29T11:13:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8200f700 1 -- 172.21.15.81:0/481503637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b64003a20 msgr2=0x7f6b64003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8200f700 1 --2- 172.21.15.81:0/481503637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b64003a20 0x7f6b64003e30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0d0710 tx=0x7f6b640058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8180e700 1 -- 172.21.15.81:0/481503637 reap_dead start 2023-11-29T11:13:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8200f700 1 -- 172.21.15.81:0/481503637 shutdown_connections 2023-11-29T11:13:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8200f700 1 -- 172.21.15.81:0/481503637 >> 172.21.15.81:0/481503637 conn(0x7f6b7c06ec40 msgr2=0x7f6b7c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8200f700 1 -- 172.21.15.81:0/481503637 shutdown_connections 2023-11-29T11:13:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.102+0000 7f6b8200f700 1 -- 172.21.15.81:0/481503637 wait complete. 2023-11-29T11:13:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8200f700 1 Processor -- start 2023-11-29T11:13:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8200f700 1 -- start start 2023-11-29T11:13:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8200f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64003a20 0x7f6b7c1efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8200f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c15c630 0x7f6b7c14ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8200f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c15d220 0x7f6b7c1524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8200f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c6020 con 0x7f6b7c15c630 2023-11-29T11:13:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8200f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1f00f0 con 0x7f6b64003a20 2023-11-29T11:13:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8200f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c15b590 con 0x7f6b7c15d220 2023-11-29T11:13:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8080c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c15c630 0x7f6b7c14ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8080c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c15c630 0x7f6b7c14ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41708/0 (socket says 172.21.15.81:41708) 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8080c700 1 -- 172.21.15.81:0/2185837712 learned_addr learned my addr 172.21.15.81:0/2185837712 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8100d700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64003a20 0x7f6b7c1efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8180e700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c15d220 0x7f6b7c1524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8080c700 1 -- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c15d220 msgr2=0x7f6b7c1524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8080c700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c15d220 0x7f6b7c1524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8080c700 1 -- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64003a20 msgr2=0x7f6b7c1efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8080c700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64003a20 0x7f6b7c1efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8080c700 1 -- 172.21.15.81:0/2185837712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c15e790 con 0x7f6b7c15c630 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.106+0000 7f6b8100d700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64003a20 0x7f6b7c1efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b8080c700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c15c630 0x7f6b7c14ba50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6b70007340 tx=0x7f6b70007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b79ffb700 1 -- 172.21.15.81:0/2185837712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70007820 con 0x7f6b7c15c630 2023-11-29T11:13:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b79ffb700 1 -- 172.21.15.81:0/2185837712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000f870 con 0x7f6b7c15c630 2023-11-29T11:13:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c15df90 con 0x7f6b7c15c630 2023-11-29T11:13:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c06caa0 con 0x7f6b7c15c630 2023-11-29T11:13:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b79ffb700 1 -- 172.21.15.81:0/2185837712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000fc20 con 0x7f6b7c15c630 2023-11-29T11:13:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c072c20 con 0x7f6b7c15c630 2023-11-29T11:13:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b79ffb700 1 -- 172.21.15.81:0/2185837712 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6b7000fd80 con 0x7f6b7c15c630 2023-11-29T11:13:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b79ffb700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b68064f10 0x7f6b680673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b79ffb700 1 -- 172.21.15.81:0/2185837712 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6b70081d10 con 0x7f6b7c15c630 2023-11-29T11:13:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.110+0000 7f6b8100d700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b68064f10 0x7f6b680673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.114+0000 7f6b8100d700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b68064f10 0x7f6b680673c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6b74016040 tx=0x7f6b74013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.118+0000 7f6b79ffb700 1 -- 172.21.15.81:0/2185837712 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6b7004fbc0 con 0x7f6b7c15c630 2023-11-29T11:13:23.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.310+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b7c0b1ff0 con 0x7f6b7c15c630 2023-11-29T11:13:23.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b79ffb700 1 -- 172.21.15.81:0/2185837712 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4644 (secure 0 0 0) 0x7f6b7001a090 con 0x7f6b7c15c630 2023-11-29T11:13:23.317 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:23.318 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:12:52.329725+0000","modified":"2023-11-29T11:13:14.009106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b68064f10 msgr2=0x7f6b680673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b68064f10 0x7f6b680673c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6b74016040 tx=0x7f6b74013000 comp rx=0 tx=0).stop 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c15c630 msgr2=0x7f6b7c14ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c15c630 0x7f6b7c14ba50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6b70007340 tx=0x7f6b70007700 comp rx=0 tx=0).stop 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 shutdown_connections 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b68064f10 0x7f6b680673c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b7c15d220 0x7f6b7c1524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c15c630 0x7f6b7c14ba50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 --2- 172.21.15.81:0/2185837712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b64003a20 0x7f6b7c1efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 >> 172.21.15.81:0/2185837712 conn(0x7f6b7c06ec40 msgr2=0x7f6b7c14eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 shutdown_connections 2023-11-29T11:13:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.314+0000 7f6b8200f700 1 -- 172.21.15.81:0/2185837712 wait complete. 2023-11-29T11:13:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-11-29T11:13:23.734 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:12:52.329725+0000', 'modified': '2023-11-29T11:13:14.009106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3562625855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3562625855}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3562625855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:13:23.734 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:13:23.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-29T11:13:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 Processor -- start 2023-11-29T11:13:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- start start 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f40800ce960 0x7f408015d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800d3070 0x7f408006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40800ccf60 con 0x7f40800d2500 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800b66a0 con 0x7f40800ce960 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40800b78b0 con 0x7f40800d3070 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408645e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f40800ce960 0x7f408015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408645e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f40800ce960 0x7f408015d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41716/0 (socket says 172.21.15.81:41716) 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408645e700 1 -- 172.21.15.81:0/2061303368 learned_addr learned my addr 172.21.15.81:0/2061303368 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4085c5d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f40800d2500 0x7f40800d2960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53976/0 (socket says 172.21.15.81:53976) 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4086c5f700 1 --2- 172.21.15.81:0/2061303368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800d3070 0x7f408006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408645e700 1 -- 172.21.15.81:0/2061303368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800d3070 msgr2=0x7f408006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408645e700 1 --2- 172.21.15.81:0/2061303368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800d3070 0x7f408006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408645e700 1 -- 172.21.15.81:0/2061303368 >> v1:172.21.15.81:6789/0 conn(0x7f40800d2500 legacy=0x7f40800d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408645e700 1 -- 172.21.15.81:0/2061303368 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800b7b70 con 0x7f40800ce960 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408645e700 1 --2- 172.21.15.81:0/2061303368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800ce960 0x7f408015d230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f407c009910 tx=0x7f407c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cd0de893676666 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408545c700 1 -- 172.21.15.81:0/2061303368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c00ba60 con 0x7f40800ce960 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408545c700 1 -- 172.21.15.81:0/2061303368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00bbc0 con 0x7f40800ce960 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f408545c700 1 -- 172.21.15.81:0/2061303368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c009e60 con 0x7f40800ce960 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- 172.21.15.81:0/2061303368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800ce960 msgr2=0x7f408015d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 --2- 172.21.15.81:0/2061303368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800ce960 0x7f408015d230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f407c009910 tx=0x7f407c009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- 172.21.15.81:0/2061303368 shutdown_connections 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 --2- 172.21.15.81:0/2061303368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800d3070 0x7f408006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 --2- 172.21.15.81:0/2061303368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800ce960 0x7f408015d230 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- 172.21.15.81:0/2061303368 >> 172.21.15.81:0/2061303368 conn(0x7f40800b5860 msgr2=0x7f40800b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- 172.21.15.81:0/2061303368 shutdown_connections 2023-11-29T11:13:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.854+0000 7f4087460700 1 -- 172.21.15.81:0/2061303368 wait complete. 2023-11-29T11:13:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 Processor -- start 2023-11-29T11:13:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 -- start start 2023-11-29T11:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800ce960 0x7f40801f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40800d2500 0x7f40800b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800d3070 0x7f40800c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408014c6a0 con 0x7f40800d3070 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40801f5ca0 con 0x7f40800d2500 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c8940 con 0x7f40800ce960 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800d3070 0x7f40800c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800d3070 0x7f40800c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41722/0 (socket says 172.21.15.81:41722) 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 -- 172.21.15.81:0/2020508600 learned_addr learned my addr 172.21.15.81:0/2020508600 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f408645e700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800ce960 0x7f40801f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4085c5d700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40800d2500 0x7f40800b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 -- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800ce960 msgr2=0x7f40801f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800ce960 0x7f40801f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 -- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40800d2500 msgr2=0x7f40800b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40800d2500 0x7f40800b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 -- 172.21.15.81:0/2020508600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c009570 con 0x7f40800d3070 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4085c5d700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40800d2500 0x7f40800b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f408645e700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800ce960 0x7f40801f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4086c5f700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800d3070 0x7f40800c6440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4078009fd0 tx=0x7f407800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4076ffd700 1 -- 172.21.15.81:0/2020508600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407800ede0 con 0x7f40800d3070 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4076ffd700 1 -- 172.21.15.81:0/2020508600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4078014420 con 0x7f40800d3070 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4087460700 1 -- 172.21.15.81:0/2020508600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40800b8130 con 0x7f40800d3070 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.858+0000 7f4076ffd700 1 -- 172.21.15.81:0/2020508600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40780147d0 con 0x7f40800d3070 2023-11-29T11:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.862+0000 7f4087460700 1 -- 172.21.15.81:0/2020508600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40800b7e50 con 0x7f40800d3070 2023-11-29T11:13:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408b942740 1 Processor -- start 2023-11-29T11:13:23.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f4076ffd700 1 -- 172.21.15.81:0/2020508600 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4078012050 con 0x7f40800d3070 2023-11-29T11:13:23.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408b942740 1 -- start start 2023-11-29T11:13:23.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f4076ffd700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4064064ee0 0x7f4064067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f4076ffd700 1 -- 172.21.15.81:0/2020508600 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4078082780 con 0x7f40800d3070 2023-11-29T11:13:23.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f4085c5d700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4064064ee0 0x7f4064067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408b942740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x206ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408b942740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbc710 0x206d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408b942740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e07790 0x206d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408b942740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2bae0 con 0x1dbcae0 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408b942740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f9bbd0 con 0x1e07790 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408b942740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f94ed0 con 0x1dbc710 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f4085c5d700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4064064ee0 0x7f4064067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f40800b24d0 tx=0x7f4070007df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408645e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x206ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408645e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x206ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41724/0 (socket says 172.21.15.81:41724) 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408645e700 1 -- 172.21.15.81:0/4073632455 learned_addr learned my addr 172.21.15.81:0/4073632455 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f4085c5d700 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbc710 0x206d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f4086c5f700 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e07790 0x206d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408645e700 1 -- 172.21.15.81:0/4073632455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbc710 msgr2=0x206d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408645e700 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbc710 0x206d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408645e700 1 -- 172.21.15.81:0/4073632455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e07790 msgr2=0x206d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408645e700 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e07790 0x206d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.866+0000 7f408645e700 1 -- 172.21.15.81:0/4073632455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fbacc0 con 0x1dbcae0 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408645e700 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x206ce00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f40800d0490 tx=0x7f407c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419037cbc03e8d2c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f4063fff700 1 -- 172.21.15.81:0/4073632455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c00b860 con 0x1dbcae0 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f4063fff700 1 -- 172.21.15.81:0/4073632455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00b9c0 con 0x1dbcae0 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f4063fff700 1 -- 172.21.15.81:0/4073632455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c004240 con 0x1dbcae0 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- 172.21.15.81:0/4073632455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 msgr2=0x206ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x206ce00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f40800d0490 tx=0x7f407c010000 comp rx=0 tx=0).stop 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- 172.21.15.81:0/4073632455 shutdown_connections 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e07790 0x206d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbc710 0x206d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 --2- 172.21.15.81:0/4073632455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x206ce00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- 172.21.15.81:0/4073632455 >> 172.21.15.81:0/4073632455 conn(0x1dbceb0 msgr2=0x2055700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- 172.21.15.81:0/4073632455 shutdown_connections 2023-11-29T11:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- 172.21.15.81:0/4073632455 wait complete. 2023-11-29T11:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- start start 2023-11-29T11:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 Processor -- start 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x202eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 0x20796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2079be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e41b20 con 0x1e07790 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x207a120 con 0x1dbc710 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x207a370 con 0x1dbcae0 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f408b942740 10 client.0 _ll_register_callbacks cb 0x1ff10d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f4086c5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2079be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f4086c5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2079be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41726/0 (socket says 172.21.15.81:41726) 2023-11-29T11:13:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f4086c5f700 1 -- 172.21.15.81:0/2380197815 learned_addr learned my addr 172.21.15.81:0/2380197815 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.870+0000 7f4085c5d700 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 0x20796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408645e700 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x202eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f4086c5f700 1 -- 172.21.15.81:0/2380197815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 msgr2=0x20796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f4086c5f700 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 0x20796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f4086c5f700 1 -- 172.21.15.81:0/2380197815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 msgr2=0x202eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f4086c5f700 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x202eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f4086c5f700 1 -- 172.21.15.81:0/2380197815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40800b7b70 con 0x1e07790 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f4086c5f700 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2079be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f407801d000 tx=0x7f40780537e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf891260a20a16c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 1 -- 172.21.15.81:0/2380197815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407805c170 con 0x1e07790 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 1 -- 172.21.15.81:0/2380197815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4078053250 con 0x1e07790 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 -- 172.21.15.81:0/2380197815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f8df50 con 0x1e07790 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 1 -- 172.21.15.81:0/2380197815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4078053410 con 0x1e07790 2023-11-29T11:13:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 10 client.4857 fetch_fsmap learned FSMap version 9 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 -- 172.21.15.81:0/2380197815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1e089e0 con 0x1e07790 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 1 -- 172.21.15.81:0/2380197815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f8df50 con 0x1e07790 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 1 -- 172.21.15.81:0/2380197815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4078067a30 con 0x1e07790 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 10 client.4857 fetch_fsmap finished waiting for FSMap version 9 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 10 client.4857 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 20 client.4857 populate_metadata read hostname 'smithi081' 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x207bae0 0x2046110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 4 client.4857 mds_command: new command op to 4278 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 -- 172.21.15.81:0/2380197815 --> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f8dc70 con 0x207bae0 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408645e700 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x207bae0 0x2046110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 10 client.4857 ms_handle_connect on v2:172.21.15.81:6836/3562625855 2023-11-29T11:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408645e700 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x207bae0 0x2046110 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5ca692fa05c150 server_cookie=44df02a286d137b7 in_seq=0 out_seq=0 2023-11-29T11:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 1 -- 172.21.15.81:0/2380197815 <== mds.0 v2:172.21.15.81:6836/3562625855 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x7f407c02f5f0 con 0x207bae0 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 10 client.4857 handle_command_reply: tid=0 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 client.4857 shutdown 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 -- 172.21.15.81:0/2380197815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 msgr2=0x2079be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2079be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f407801d000 tx=0x7f40780537e0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 -- 172.21.15.81:0/2380197815 shutdown_connections 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x207bae0 0x2046110 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2079be0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f40617fa700 0 client.4857 ms_handle_reset on v2:172.21.15.81:6836/3562625855 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 0x20796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 --2- 172.21.15.81:0/2380197815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x202eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 -- 172.21.15.81:0/2380197815 >> 172.21.15.81:0/2380197815 conn(0x1dbceb0 msgr2=0x2055650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 -- 172.21.15.81:0/2380197815 shutdown_connections 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.874+0000 7f408b942740 1 -- 172.21.15.81:0/2380197815 wait complete. 2023-11-29T11:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.878+0000 7f408b942740 20 client.4857 trim_cache size 0 max 16384 2023-11-29T11:13:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.894+0000 7f408b942740 1 Processor -- start 2023-11-29T11:13:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.894+0000 7f408b942740 1 -- start start 2023-11-29T11:13:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x20d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 0x20d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2054170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6ade0 con 0x1e07790 2023-11-29T11:13:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f922d0 con 0x1dbc710 2023-11-29T11:13:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f93d60 con 0x1dbcae0 2023-11-29T11:13:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f4086c5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2054170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408645e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x20d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f4086c5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2054170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41732/0 (socket says 172.21.15.81:41732) 2023-11-29T11:13:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f4086c5f700 1 -- 172.21.15.81:0/860116319 learned_addr learned my addr 172.21.15.81:0/860116319 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f4085c5d700 1 --2- 172.21.15.81:0/860116319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 0x20d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408645e700 1 -- 172.21.15.81:0/860116319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 msgr2=0x20d3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408645e700 1 --2- 172.21.15.81:0/860116319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 0x20d3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408645e700 1 -- 172.21.15.81:0/860116319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 msgr2=0x2054170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408645e700 1 --2- 172.21.15.81:0/860116319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2054170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408645e700 1 -- 172.21.15.81:0/860116319 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800c86e0 con 0x1dbc710 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408645e700 1 --2- 172.21.15.81:0/860116319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x20d3790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f40800d0490 tx=0x7f407c0092e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879acdf36a257987 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f4074ff9700 1 -- 172.21.15.81:0/860116319 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c004240 con 0x1dbc710 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f4074ff9700 1 -- 172.21.15.81:0/860116319 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c02b040 con 0x1dbc710 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f4074ff9700 1 -- 172.21.15.81:0/860116319 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c0045c0 con 0x1dbc710 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- 172.21.15.81:0/860116319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 msgr2=0x20d3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- 172.21.15.81:0/860116319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x20d3790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f40800d0490 tx=0x7f407c0092e0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- 172.21.15.81:0/860116319 shutdown_connections 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- 172.21.15.81:0/860116319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e07790 0x2054170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- 172.21.15.81:0/860116319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1dbcae0 0x20d3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- 172.21.15.81:0/860116319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x20d3790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- 172.21.15.81:0/860116319 >> 172.21.15.81:0/860116319 conn(0x1dbceb0 msgr2=0x206a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- 172.21.15.81:0/860116319 shutdown_connections 2023-11-29T11:13:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- 172.21.15.81:0/860116319 wait complete. 2023-11-29T11:13:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- start start 2023-11-29T11:13:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 Processor -- start 2023-11-29T11:13:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x206add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x20d2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e07790 0x20d2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f97a30 con 0x1dbcae0 2023-11-29T11:13:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2083b00 con 0x1dbc710 2023-11-29T11:13:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x20d31d0 con 0x1e07790 2023-11-29T11:13:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.898+0000 7f408b942740 10 client.0 _ll_register_callbacks cb 0x1f412d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f4085c5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x20d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x206add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x206add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:50998/0 (socket says 172.21.15.81:50998) 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 -- 172.21.15.81:0/1261852067 learned_addr learned my addr 172.21.15.81:0/1261852067 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f4085c5d700 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x20d2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41734/0 (socket says 172.21.15.81:41734) 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f4086c5f700 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e07790 0x20d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 -- 172.21.15.81:0/1261852067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e07790 msgr2=0x20d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e07790 0x20d2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 -- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 msgr2=0x20d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x20d2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 -- 172.21.15.81:0/1261852067 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1fbacc0 con 0x1dbc710 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f4085c5d700 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x20d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408645e700 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x206add0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f407c013000 tx=0x7f407c00e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d05f0bd6e062aa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 1 -- 172.21.15.81:0/1261852067 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c004230 con 0x1dbc710 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 -- 172.21.15.81:0/1261852067 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f407c00b9c0 con 0x1dbc710 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 1 -- 172.21.15.81:0/1261852067 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f407c004390 con 0x1dbc710 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 1 -- 172.21.15.81:0/1261852067 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f407c00b3f0 con 0x1dbc710 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 10 client.4858 fetch_fsmap learned FSMap version 9 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 -- 172.21.15.81:0/1261852067 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1f41a20 con 0x1dbc710 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 1 -- 172.21.15.81:0/1261852067 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00b9c0 con 0x1dbc710 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 1 -- 172.21.15.81:0/1261852067 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f407c0036c0 con 0x1dbc710 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 10 client.4858 fetch_fsmap finished waiting for FSMap version 9 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 10 client.4858 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 20 client.4858 populate_metadata read hostname 'smithi081' 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x2089280 0x2089650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 4 client.4858 mds_command: new command op to 4278 tid=0[{"prefix": "status"}] 2023-11-29T11:13:23.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 -- 172.21.15.81:0/1261852067 --> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1e39260 con 0x2089280 2023-11-29T11:13:23.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f4085c5d700 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x2089280 0x2089650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 10 client.4858 ms_handle_connect on v2:172.21.15.81:6836/3562625855 2023-11-29T11:13:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f4085c5d700 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x2089280 0x2089650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d49bc11728f1a51 server_cookie=be71593c8d70d32c in_seq=0 out_seq=0 2023-11-29T11:13:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 1 -- 172.21.15.81:0/1261852067 <== mds.0 v2:172.21.15.81:6836/3562625855 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1e39260 con 0x2089280 2023-11-29T11:13:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 10 client.4858 handle_command_reply: tid=0 2023-11-29T11:13:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 client.4858 shutdown 2023-11-29T11:13:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 -- 172.21.15.81:0/1261852067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 msgr2=0x206add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x206add0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f407c013000 tx=0x7f407c00e000 comp rx=0 tx=0).stop 2023-11-29T11:13:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 -- 172.21.15.81:0/1261852067 shutdown_connections 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:6836/3562625855,v1:172.21.15.81:6837/3562625855] conn(0x2089280 0x2089650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e07790 0x20d2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1dbcae0 0x20d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 --2- 172.21.15.81:0/1261852067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1dbc710 0x206add0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f408b942740 1 -- 172.21.15.81:0/1261852067 >> 172.21.15.81:0/1261852067 conn(0x1dbceb0 msgr2=0x206e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.902+0000 7f40617fa700 0 client.4858 ms_handle_reset on v2:172.21.15.81:6836/3562625855 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f408b942740 1 -- 172.21.15.81:0/1261852067 shutdown_connections 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f408b942740 1 -- 172.21.15.81:0/1261852067 wait complete. 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f408b942740 20 client.4858 trim_cache size 0 max 16384 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:13:23.912 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4278, 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 31.573369580000001, 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 9, 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 26, 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 26, 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 36.715123435000002 2023-11-29T11:13:23.913 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 -- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4064064ee0 msgr2=0x7f4064067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4064064ee0 0x7f4064067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f40800b24d0 tx=0x7f4070007df0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 -- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800d3070 msgr2=0x7f40800c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800d3070 0x7f40800c6440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4078009fd0 tx=0x7f407800e3c0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 -- 172.21.15.81:0/2020508600 shutdown_connections 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4064064ee0 0x7f4064067390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40800d3070 0x7f40800c6440 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40800d2500 0x7f40800b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 --2- 172.21.15.81:0/2020508600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40800ce960 0x7f40801f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:23.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 -- 172.21.15.81:0/2020508600 >> 172.21.15.81:0/2020508600 conn(0x7f40800b5860 msgr2=0x7f4080069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:23.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 -- 172.21.15.81:0/2020508600 shutdown_connections 2023-11-29T11:13:23.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:23.906+0000 7f4087460700 1 -- 172.21.15.81:0/2020508600 wait complete. 2023-11-29T11:13:23.928 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-29T11:13:23.939 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-29T11:13:23.939 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-29T11:13:23.939 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-29T11:13:23.939 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-29T11:13:23.940 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:13:23.940 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-29T11:13:23.940 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-29T11:13:23.940 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-29T11:13:23.940 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-29T11:13:23.940 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-29T11:13:23.940 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-29T11:13:23.940 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-29T11:13:23.940 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-29T11:13:23.940 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-29T11:13:23.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:23.941 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:13:23.948 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-29T11:13:23.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:23.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-29T11:13:23.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:23.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-11-29T11:13:24.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.123 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-29T11:13:24.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-29T11:13:24.151 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2023-11-29T11:13:24.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:13:24.152 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-29T11:13:24.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:13:24.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.266+0000 7ffbab11b700 1 Processor -- start 2023-11-29T11:13:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.266+0000 7ffbab11b700 1 -- start start 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffba4069c40 0x7ffba4071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba40cc420 con 0x7ffba40cd5e0 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba40cc6c0 con 0x7ffba4160680 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba40cc9a0 con 0x7ffba4069c40 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffba40cd5e0 0x7ffba40c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53992/0 (socket says 172.21.15.81:53992) 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba3fff700 1 -- 172.21.15.81:0/1532379261 learned_addr learned my addr 172.21.15.81:0/1532379261 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 --2- 172.21.15.81:0/1532379261 >> v2:172.21.15.176:3300/0 conn(0x7ffba4069c40 0x7ffba4071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761594088 0 0) 0x7ffba40cc420 con 0x7ffba40cd5e0 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb8c0035d0 con 0x7ffba40cd5e0 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1637987883 0 0) 0x7ffb8c0035d0 con 0x7ffba40cd5e0 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 >> v2:172.21.15.176:3300/0 conn(0x7ffba4069c40 msgr2=0x7ffba4071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 --2- 172.21.15.81:0/1532379261 >> v2:172.21.15.176:3300/0 conn(0x7ffba4069c40 0x7ffba4071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 >> v1:172.21.15.176:6789/0 conn(0x7ffba4160680 legacy=0x7ffba40cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba40705c0 con 0x7ffba40cd5e0 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7ffb98001670 con 0x7ffba40cd5e0 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 >> v1:172.21.15.81:6789/0 conn(0x7ffba40cd5e0 legacy=0x7ffba40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8c003a20 0x7ffb8c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb8c004870 0x7ffb8c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffb8c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40cc9a0 con 0x7ffb8c005220 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c00c130 con 0x7ffb8c004870 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c00c2f0 con 0x7ffb8c003a20 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffb8c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba3fff700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb8c004870 0x7ffb8c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba8eb7700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8c003a20 0x7ffb8c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 -- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8c003a20 msgr2=0x7ffb8c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8c003a20 0x7ffb8c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 -- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb8c004870 msgr2=0x7ffb8c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb8c004870 0x7ffb8c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 -- 172.21.15.81:0/1532379261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0035d0 con 0x7ffb8c005220 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba3fff700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb8c004870 0x7ffb8c004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba8eb7700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8c003a20 0x7ffb8c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 -- 172.21.15.81:0/1532379261 reap_dead start 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba96b8700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffb8c00ba30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009b70 tx=0x7ffb8c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6744b88206a472 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94004020 con 0x7ffb8c005220 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb94004180 con 0x7ffb8c005220 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffba37fe700 1 -- 172.21.15.81:0/1532379261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94004530 con 0x7ffb8c005220 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 -- 172.21.15.81:0/1532379261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 msgr2=0x7ffb8c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffb8c00ba30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009b70 tx=0x7ffb8c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 -- 172.21.15.81:0/1532379261 shutdown_connections 2023-11-29T11:13:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 --2- 172.21.15.81:0/1532379261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffb8c00ba30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 -- 172.21.15.81:0/1532379261 >> 172.21.15.81:0/1532379261 conn(0x7ffba406caf0 msgr2=0x7ffba40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 -- 172.21.15.81:0/1532379261 shutdown_connections 2023-11-29T11:13:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.270+0000 7ffbab11b700 1 -- 172.21.15.81:0/1532379261 wait complete. 2023-11-29T11:13:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.274+0000 7ffbab11b700 1 Processor -- start 2023-11-29T11:13:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.274+0000 7ffbab11b700 1 -- start start 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffbab11b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffba4160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffbab11b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba40c8280 0x7ffba41644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffbab11b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba415e880 0x7ffba415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffbab11b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba415f240 con 0x7ffb8c005220 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffbab11b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4162100 con 0x7ffba40c8280 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffbab11b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4161520 con 0x7ffba415e880 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffba4160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffba4160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41754/0 (socket says 172.21.15.81:41754) 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 -- 172.21.15.81:0/1978333608 learned_addr learned my addr 172.21.15.81:0/1978333608 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba3fff700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba40c8280 0x7ffba41644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba96b8700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba415e880 0x7ffba415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 -- 172.21.15.81:0/1978333608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba415e880 msgr2=0x7ffba415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba415e880 0x7ffba415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 -- 172.21.15.81:0/1978333608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba40c8280 msgr2=0x7ffba41644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:24.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba40c8280 0x7ffba41644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 -- 172.21.15.81:0/1978333608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba40c9750 con 0x7ffb8c005220 2023-11-29T11:13:24.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba8eb7700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffba4160cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c002030 tx=0x7ffb9c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba17fa700 1 -- 172.21.15.81:0/1978333608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c003e50 con 0x7ffb8c005220 2023-11-29T11:13:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba17fa700 1 -- 172.21.15.81:0/1978333608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c00b910 con 0x7ffb8c005220 2023-11-29T11:13:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba4071940 con 0x7ffb8c005220 2023-11-29T11:13:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffba17fa700 1 -- 172.21.15.81:0/1978333608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00bcc0 con 0x7ffb8c005220 2023-11-29T11:13:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.278+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba4160a50 con 0x7ffb8c005220 2023-11-29T11:13:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.282+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba4072500 con 0x7ffb8c005220 2023-11-29T11:13:24.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.282+0000 7ffba17fa700 1 -- 172.21.15.81:0/1978333608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffb9c005070 con 0x7ffb8c005220 2023-11-29T11:13:24.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.282+0000 7ffba17fa700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb90064ee0 0x7ffb90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.282+0000 7ffba3fff700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb90064ee0 0x7ffb90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.282+0000 7ffba17fa700 1 -- 172.21.15.81:0/1978333608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb9c083190 con 0x7ffb8c005220 2023-11-29T11:13:24.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.282+0000 7ffba3fff700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb90064ee0 0x7ffb90067390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffb98005b20 tx=0x7ffb98007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.290+0000 7ffba17fa700 1 -- 172.21.15.81:0/1978333608 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffb9c051080 con 0x7ffb8c005220 2023-11-29T11:13:24.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.486+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffba406a8e0 con 0x7ffb8c005220 2023-11-29T11:13:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.490+0000 7ffba17fa700 1 -- 172.21.15.81:0/1978333608 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ffb9c0546a0 con 0x7ffb8c005220 2023-11-29T11:13:24.493 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-29T11:13:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb90064ee0 msgr2=0x7ffb90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb90064ee0 0x7ffb90067390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffb98005b20 tx=0x7ffb98007040 comp rx=0 tx=0).stop 2023-11-29T11:13:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 msgr2=0x7ffba4160cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffba4160cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c002030 tx=0x7ffb9c00b3b0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 shutdown_connections 2023-11-29T11:13:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb90064ee0 0x7ffb90067390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba415e880 0x7ffba415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba40c8280 0x7ffba41644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 --2- 172.21.15.81:0/1978333608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb8c005220 0x7ffba4160cd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 >> 172.21.15.81:0/1978333608 conn(0x7ffba406caf0 msgr2=0x7ffba40c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 shutdown_connections 2023-11-29T11:13:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:24.494+0000 7ffbab11b700 1 -- 172.21.15.81:0/1978333608 wait complete. 2023-11-29T11:13:24.512 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:13:24.513 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:13:24.513 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:13:24.513 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:13:24.513 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:13:24.513 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:13:24.513 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-29T11:13:24.513 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:13:24.513 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:13:24.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.513 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:13:24.518 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:13:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:13:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:13:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42562sec preferred_lft 42562sec 2023-11-29T11:13:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:13:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:24.520 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:13:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:13:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:24.520 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-29T11:13:24.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.520 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:24.520 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:24.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-11-29T11:13:24.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-11-29T11:13:24.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-11-29T11:13:24.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-29T11:13:24.521 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:24.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.607 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:13:24.617 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:13:24.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.619 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:13:24.626 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:13:24.626 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:13:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:13:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:13:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:13:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:13:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:13:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:13:24.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.627 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:24.627 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:24.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:13:24.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:13:24.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:13:24.628 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:24.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.664 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:13:24.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.672 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-11-29T11:13:24.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.719 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:24.719 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:24.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:13:24.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-29T11:13:24.719 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:24.747 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-29T11:13:24.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.747 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:24.747 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:24.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-29T11:13:24.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-29T11:13:24.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-29T11:13:24.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-29T11:13:24.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-29T11:13:24.748 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:24.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.797 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:24.797 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:24.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:13:24.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-11-29T11:13:24.797 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:24.821 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:13:24.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:13:24.822 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:13:24.828 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:13:24.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:13:24.828 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:13:24.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:13:24.847 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:24.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:24.859 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:24.860 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:24.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.860 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:13:24.865 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:13:24.865 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:13:24.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:13:24.927 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:24.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:24.936 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:24.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:24.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:24.937 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:13:25.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:13:24.998+0000 7fa0f7bf4640 -1 init, newargv = 0x56331c0068b0 newargc=15 2023-11-29T11:13:25.004 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45005]: starting ceph client 2023-11-29T11:13:25.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45005]: starting fuse 2023-11-29T11:13:25.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:13:25.811 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:13:26.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:13:26.106 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:26.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:26.164 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:26.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:26.165 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:13:26.172 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:13:26.172 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:13:26.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:13:26.172 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:13:26.172 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:13:26.173 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:13:26.174 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:13:26.174 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:13:26.174 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:13:26.174 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:13:26.174 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:13:26.174 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:26.174 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:13:26.174 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:13:26.255 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.45005.asok 2023-11-29T11:13:26.437 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45005.asok 2023-11-29T11:13:26.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:26.438 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45005.asok status 2023-11-29T11:13:26.539 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:13:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:13:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "45005", 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4875, 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4875 2023-11-29T11:13:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3297098251 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3297098251 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4875 192.168.0.1:0/3297098251", 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/3297098251", 2023-11-29T11:13:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:13:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 9, 2023-11-29T11:13:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 26, 2023-11-29T11:13:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:13:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:13:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:13:26.542 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:13:26.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:13:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.654+0000 7fce9bfff700 1 Processor -- start 2023-11-29T11:13:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.654+0000 7fce9bfff700 1 -- start start 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c13cd60 0x7fce9c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9bfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fce9c13d130 0x7fce9c15da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c15a4a0 con 0x7fce9c15dfd0 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9bfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c15b460 con 0x7fce9c13d130 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c15e550 con 0x7fce9c13cd60 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce927fc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fce9c13d130 0x7fce9c15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9affd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c13cd60 0x7fce9c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9b7fe700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fce9c15dfd0 0x7fce9c06c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:35394/0 (socket says 172.21.15.81:35394) 2023-11-29T11:13:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9b7fe700 1 -- 172.21.15.81:0/3179426026 learned_addr learned my addr 172.21.15.81:0/3179426026 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9a7fc700 1 -- 172.21.15.81:0/3179426026 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287737472 0 0) 0x7fce9c15a4a0 con 0x7fce9c15dfd0 2023-11-29T11:13:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9a7fc700 1 -- 172.21.15.81:0/3179426026 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce880035d0 con 0x7fce9c15dfd0 2023-11-29T11:13:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce927fc700 1 -- 172.21.15.81:0/3179426026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c13cd60 msgr2=0x7fce9c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce927fc700 1 --2- 172.21.15.81:0/3179426026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c13cd60 0x7fce9c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce927fc700 1 -- 172.21.15.81:0/3179426026 >> v1:172.21.15.176:6789/0 conn(0x7fce9c15dfd0 legacy=0x7fce9c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce927fc700 1 -- 172.21.15.81:0/3179426026 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c15e830 con 0x7fce9c13d130 2023-11-29T11:13:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce9affd700 1 --2- 172.21.15.81:0/3179426026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c13cd60 0x7fce9c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.658+0000 7fce927fc700 1 --2- 172.21.15.81:0/3179426026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13d130 0x7fce9c15da90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fce84009850 tx=0x7fce84009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=486b8b26f74c7f28 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9a7fc700 1 -- 172.21.15.81:0/3179426026 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84011830 con 0x7fce9c13d130 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9a7fc700 1 -- 172.21.15.81:0/3179426026 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce84011990 con 0x7fce9c13d130 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9a7fc700 1 -- 172.21.15.81:0/3179426026 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84011d40 con 0x7fce9c13d130 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 -- 172.21.15.81:0/3179426026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13d130 msgr2=0x7fce9c15da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 --2- 172.21.15.81:0/3179426026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13d130 0x7fce9c15da90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fce84009850 tx=0x7fce84009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 -- 172.21.15.81:0/3179426026 shutdown_connections 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 --2- 172.21.15.81:0/3179426026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13d130 0x7fce9c15da90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 --2- 172.21.15.81:0/3179426026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c13cd60 0x7fce9c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 -- 172.21.15.81:0/3179426026 >> 172.21.15.81:0/3179426026 conn(0x7fce9c06e000 msgr2=0x7fce9c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 -- 172.21.15.81:0/3179426026 shutdown_connections 2023-11-29T11:13:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 -- 172.21.15.81:0/3179426026 wait complete. 2023-11-29T11:13:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 Processor -- start 2023-11-29T11:13:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.662+0000 7fce9bfff700 1 -- start start 2023-11-29T11:13:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13cd60 0x7fce9c140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c15dfd0 0x7fce9c157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c13f130 0x7fce9c13f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1f2d50 con 0x7fce9c13f130 2023-11-29T11:13:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1f3030 con 0x7fce9c13cd60 2023-11-29T11:13:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1f3310 con 0x7fce9c15dfd0 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c13f130 0x7fce9c13f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c13f130 0x7fce9c13f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41766/0 (socket says 172.21.15.81:41766) 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 -- 172.21.15.81:0/2657236488 learned_addr learned my addr 172.21.15.81:0/2657236488 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce927fc700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c15dfd0 0x7fce9c157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9affd700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13cd60 0x7fce9c140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 -- 172.21.15.81:0/2657236488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c15dfd0 msgr2=0x7fce9c157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c15dfd0 0x7fce9c157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 -- 172.21.15.81:0/2657236488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13cd60 msgr2=0x7fce9c140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13cd60 0x7fce9c140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 -- 172.21.15.81:0/2657236488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0094b0 con 0x7fce9c13f130 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9b7fe700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c13f130 0x7fce9c13f5b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce9400caa0 tx=0x7fce9400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce93fff700 1 -- 172.21.15.81:0/2657236488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94007480 con 0x7fce9c13f130 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce93fff700 1 -- 172.21.15.81:0/2657236488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce940075e0 con 0x7fce9c13f130 2023-11-29T11:13:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce840094b0 con 0x7fce9c13f130 2023-11-29T11:13:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce93fff700 1 -- 172.21.15.81:0/2657236488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94007970 con 0x7fce9c13f130 2023-11-29T11:13:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c15aa00 con 0x7fce9c13f130 2023-11-29T11:13:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.666+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c15a720 con 0x7fce9c13f130 2023-11-29T11:13:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.670+0000 7fce93fff700 1 -- 172.21.15.81:0/2657236488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fce94019030 con 0x7fce9c13f130 2023-11-29T11:13:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.670+0000 7fce93fff700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce7c064ee0 0x7fce7c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.670+0000 7fce93fff700 1 -- 172.21.15.81:0/2657236488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce940819e0 con 0x7fce9c13f130 2023-11-29T11:13:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.670+0000 7fce9affd700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce7c064ee0 0x7fce7c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.670+0000 7fce9affd700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce7c064ee0 0x7fce7c067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009d80 tx=0x7fce8c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.678+0000 7fce93fff700 1 -- 172.21.15.81:0/2657236488 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fce9404f810 con 0x7fce9c13f130 2023-11-29T11:13:26.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.878+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce9c143830 con 0x7fce9c13f130 2023-11-29T11:13:26.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.878+0000 7fce93fff700 1 -- 172.21.15.81:0/2657236488 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fce94017070 con 0x7fce9c13f130 2023-11-29T11:13:26.884 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-29T11:13:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce7c064ee0 msgr2=0x7fce7c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce7c064ee0 0x7fce7c067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009d80 tx=0x7fce8c009240 comp rx=0 tx=0).stop 2023-11-29T11:13:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c13f130 msgr2=0x7fce9c13f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c13f130 0x7fce9c13f5b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce9400caa0 tx=0x7fce9400cad0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 shutdown_connections 2023-11-29T11:13:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce7c064ee0 0x7fce7c067390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce9c13f130 0x7fce9c13f5b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce9c15dfd0 0x7fce9c157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 --2- 172.21.15.81:0/2657236488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce9c13cd60 0x7fce9c140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 >> 172.21.15.81:0/2657236488 conn(0x7fce9c06e000 msgr2=0x7fce9c15cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 shutdown_connections 2023-11-29T11:13:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:26.882+0000 7fce9bfff700 1 -- 172.21.15.81:0/2657236488 wait complete. 2023-11-29T11:13:26.897 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:13:26.898 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:13:26.898 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:13:26.898 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-29T11:13:26.898 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-29T11:13:26.898 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:13:26.898 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-29T11:13:26.898 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:13:26.898 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-29T11:13:26.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:26.898 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:13:26.903 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:13:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:13:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:13:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42559sec preferred_lft 42559sec 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:13:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:26.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:26.906 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:13:26.919 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:13:26.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:26.921 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:13:26.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:26.974 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:26.974 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:26.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:13:26.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:13:26.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:13:26.974 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:27.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.016 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:13:27.022 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:13:27.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.023 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-11-29T11:13:27.071 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-29T11:13:27.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.071 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:27.071 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:27.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:13:27.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-29T11:13:27.072 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:27.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-29T11:13:27.114 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:13:27.114 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9a:67:f7:4e:3d:65 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9867:f7ff:fe4e:3d65/64 scope link 2023-11-29T11:13:27.115 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:27.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-29T11:13:27.177 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:13:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:13:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:13:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:13:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:27.178 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:13:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9a:67:f7:4e:3d:65 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-29T11:13:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-29T11:13:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9867:f7ff:fe4e:3d65/64 scope link 2023-11-29T11:13:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:27.179 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-29T11:13:27.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.179 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:27.179 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:27.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-29T11:13:27.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-29T11:13:27.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-29T11:13:27.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-29T11:13:27.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-29T11:13:27.180 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:27.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.236 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:13:27.236 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:13:27.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2023-11-29T11:13:27.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2023-11-29T11:13:27.236 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:13:27.262 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-29T11:13:27.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:13:27.262 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-29T11:13:27.311 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-29T11:13:27.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:13:27.311 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-29T11:13:27.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:13:27.334 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:27.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:27.350 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:27.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.351 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:13:27.357 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:13:27.357 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-11-29T11:13:27.357 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2 --client_mountpoint=/) 2023-11-29T11:13:27.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:13:27.374 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:27.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:27.386 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:27.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:27.386 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:13:27.393 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:13:27.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:2023-11-29T11:13:27.446+0000 7fdbaecb8640 -1 init, newargv = 0x56376f6318a0 newargc=15 2023-11-29T11:13:27.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:ceph-fuse[45149]: starting ceph client 2023-11-29T11:13:27.460 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:ceph-fuse[45149]: starting fuse 2023-11-29T11:13:28.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:13:28.513 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:28.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:28.523 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:28.524 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:28.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:28.525 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:13:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:13:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:53 2023-11-29T11:13:28.530 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:13:28.531 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.2")) 2023-11-29T11:13:28.532 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:13:28.658 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.2.45149.asok 2023-11-29T11:13:28.843 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45149.asok 2023-11-29T11:13:28.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:28.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45149.asok status 2023-11-29T11:13:28.948 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:13:28.948 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "2", 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "45149", 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4884, 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4884 2023-11-29T11:13:28.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3474901394 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3474901394 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4884 172.21.15.81:0/3474901394", 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "172.21.15.81:0/3474901394", 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:13:28.950 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 9, 2023-11-29T11:13:28.951 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 26, 2023-11-29T11:13:28.951 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:13:28.951 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:13:28.951 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:13:28.951 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:13:28.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:13:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.062+0000 7fddeab25700 1 Processor -- start 2023-11-29T11:13:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.062+0000 7fddeab25700 1 -- start start 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdde4159e70 0x7fdde406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde40cb470 0x7fdde40c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde406ace0 con 0x7fdde4069c40 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde406a0d0 con 0x7fdde4159e70 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde406a3b0 con 0x7fdde40cb470 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde9b23700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdde4159e70 0x7fdde406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde9b23700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdde4159e70 0x7fdde406c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41770/0 (socket says 172.21.15.81:41770) 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde9b23700 1 -- 172.21.15.81:0/4076023378 learned_addr learned my addr 172.21.15.81:0/4076023378 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde9b23700 1 -- 172.21.15.81:0/4076023378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde40cb470 msgr2=0x7fdde40c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde9b23700 1 --2- 172.21.15.81:0/4076023378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde40cb470 0x7fdde40c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde9b23700 1 -- 172.21.15.81:0/4076023378 >> v1:172.21.15.176:6789/0 conn(0x7fdde4069c40 legacy=0x7fdde40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde9b23700 1 -- 172.21.15.81:0/4076023378 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde406a690 con 0x7fdde4159e70 2023-11-29T11:13:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde9b23700 1 --2- 172.21.15.81:0/4076023378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4159e70 0x7fdde406c9a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009e50 tx=0x7fdde000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47777dac4ddaa79f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde8b21700 1 -- 172.21.15.81:0/4076023378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde000e070 con 0x7fdde4159e70 2023-11-29T11:13:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde8b21700 1 -- 172.21.15.81:0/4076023378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0003a40 con 0x7fdde4159e70 2023-11-29T11:13:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fdde8b21700 1 -- 172.21.15.81:0/4076023378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0003df0 con 0x7fdde4159e70 2023-11-29T11:13:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 -- 172.21.15.81:0/4076023378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4159e70 msgr2=0x7fdde406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 --2- 172.21.15.81:0/4076023378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4159e70 0x7fdde406c9a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009e50 tx=0x7fdde000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 -- 172.21.15.81:0/4076023378 shutdown_connections 2023-11-29T11:13:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 --2- 172.21.15.81:0/4076023378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde40cb470 0x7fdde40c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 --2- 172.21.15.81:0/4076023378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4159e70 0x7fdde406c9a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 -- 172.21.15.81:0/4076023378 >> 172.21.15.81:0/4076023378 conn(0x7fdde40ce3e0 msgr2=0x7fdde40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 -- 172.21.15.81:0/4076023378 shutdown_connections 2023-11-29T11:13:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.066+0000 7fddeab25700 1 -- 172.21.15.81:0/4076023378 wait complete. 2023-11-29T11:13:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 Processor -- start 2023-11-29T11:13:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 -- start start 2023-11-29T11:13:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4069c40 0x7fdde41f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdde40cb470 0x7fdde415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde4159e70 0x7fdde415c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde415b9f0 con 0x7fdde4069c40 2023-11-29T11:13:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde415d300 con 0x7fdde40cb470 2023-11-29T11:13:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde4071d50 con 0x7fdde4159e70 2023-11-29T11:13:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4069c40 0x7fdde41f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4069c40 0x7fdde41f20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41780/0 (socket says 172.21.15.81:41780) 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 -- 172.21.15.81:0/3261899789 learned_addr learned my addr 172.21.15.81:0/3261899789 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddea324700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde4159e70 0x7fdde415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9322700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdde40cb470 0x7fdde415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 -- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde4159e70 msgr2=0x7fdde415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde4159e70 0x7fdde415c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 -- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdde40cb470 msgr2=0x7fdde415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdde40cb470 0x7fdde415c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 -- 172.21.15.81:0/3261899789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0009b30 con 0x7fdde4069c40 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9322700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdde40cb470 0x7fdde415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fdde9b23700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4069c40 0x7fdde41f20c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdde0000f80 tx=0x7fdde0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddda7fc700 1 -- 172.21.15.81:0/3261899789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0004440 con 0x7fdde4069c40 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddda7fc700 1 -- 172.21.15.81:0/3261899789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde00045a0 con 0x7fdde4069c40 2023-11-29T11:13:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde415a240 con 0x7fdde4069c40 2023-11-29T11:13:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddda7fc700 1 -- 172.21.15.81:0/3261899789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0004950 con 0x7fdde4069c40 2023-11-29T11:13:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.070+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde406a970 con 0x7fdde4069c40 2023-11-29T11:13:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.074+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde406cee0 con 0x7fdde4069c40 2023-11-29T11:13:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.074+0000 7fddda7fc700 1 -- 172.21.15.81:0/3261899789 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdde002d070 con 0x7fdde4069c40 2023-11-29T11:13:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.074+0000 7fddda7fc700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fddc8064ee0 0x7fddc8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.074+0000 7fddda7fc700 1 -- 172.21.15.81:0/3261899789 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdde0083be0 con 0x7fdde4069c40 2023-11-29T11:13:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.074+0000 7fdde9322700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fddc8064ee0 0x7fddc8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.074+0000 7fdde9322700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fddc8064ee0 0x7fddc8067390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fddd40017f0 tx=0x7fddd4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.082+0000 7fddda7fc700 1 -- 172.21.15.81:0/3261899789 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdde0051a90 con 0x7fdde4069c40 2023-11-29T11:13:29.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.282+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdde4072240 con 0x7fdde4069c40 2023-11-29T11:13:29.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddda7fc700 1 -- 172.21.15.81:0/3261899789 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdde00550b0 con 0x7fdde4069c40 2023-11-29T11:13:29.289 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fddc8064ee0 msgr2=0x7fddc8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fddc8064ee0 0x7fddc8067390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fddd40017f0 tx=0x7fddd4009040 comp rx=0 tx=0).stop 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4069c40 msgr2=0x7fdde41f20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4069c40 0x7fdde41f20c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdde0000f80 tx=0x7fdde0004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 shutdown_connections 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fddc8064ee0 0x7fddc8067390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdde4159e70 0x7fdde415c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdde40cb470 0x7fdde415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 --2- 172.21.15.81:0/3261899789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde4069c40 0x7fdde41f20c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 >> 172.21.15.81:0/3261899789 conn(0x7fdde40ce3e0 msgr2=0x7fdde40abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 shutdown_connections 2023-11-29T11:13:29.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:29.286+0000 7fddeab25700 1 -- 172.21.15.81:0/3261899789 wait complete. 2023-11-29T11:13:29.304 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:13:29.304 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:13:29.304 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2023-11-29T11:13:29.304 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-29T11:13:29.304 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-29T11:13:29.304 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:13:29.305 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-29T11:13:29.305 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:13:29.305 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-29T11:13:29.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.305 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2023-11-29T11:13:29.313 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:13:29.313 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:13:29.313 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:13:29.313 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:29.313 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-29T11:13:29.313 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:29.313 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42557sec preferred_lft 42557sec 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:50:39:2c:0e brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:13:29.314 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:29.315 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-29T11:13:29.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.315 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:29.315 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:29.315 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2023-11-29T11:13:29.315 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2023-11-29T11:13:29.315 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2023-11-29T11:13:29.315 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-29T11:13:29.315 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:29.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.363 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:13:29.374 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-29T11:13:29.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.375 DEBUG:teuthology.orchestra.run.smithi176:> route 2023-11-29T11:13:29.448 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2023-11-29T11:13:29.448 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:13:29.448 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:13:29.448 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:13:29.448 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:13:29.449 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:13:29.449 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:13:29.449 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:13:29.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.449 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:29.449 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:29.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:13:29.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:13:29.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:13:29.449 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:29.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.488 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-29T11:13:29.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.494 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2023-11-29T11:13:29.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.500 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:29.500 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:29.500 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-29T11:13:29.500 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-29T11:13:29.500 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:29.573 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-29T11:13:29.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.574 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:29.574 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:29.574 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-29T11:13:29.574 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-29T11:13:29.574 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-29T11:13:29.574 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-29T11:13:29.574 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-29T11:13:29.574 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:29.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.646 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:29.647 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:29.647 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2023-11-29T11:13:29.647 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2023-11-29T11:13:29.647 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:29.672 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-29T11:13:29.673 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:13:29.673 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-29T11:13:29.746 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-29T11:13:29.747 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:13:29.747 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-29T11:13:29.753 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2023-11-29T11:13:29.771 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:29.771 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:29.784 INFO:teuthology.orchestra.run.smithi176.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:29.785 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:29.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.786 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2023-11-29T11:13:29.833 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:13:29.833 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_mountpoint=/) 2023-11-29T11:13:29.835 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2023-11-29T11:13:29.850 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:29.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:29.859 INFO:teuthology.orchestra.run.smithi176.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:29.860 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:29.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:29.860 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2023-11-29T11:13:29.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:2023-11-29T11:13:29.925+0000 7f107ac6c640 -1 init, newargv = 0x563c2ed78960 newargc=15 2023-11-29T11:13:29.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:ceph-fuse[41904]: starting ceph client 2023-11-29T11:13:29.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:ceph-fuse[41904]: starting fuse 2023-11-29T11:13:31.015 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2023-11-29T11:13:31.034 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:31.034 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:31.043 INFO:teuthology.orchestra.run.smithi176.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:31.044 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:31.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.045 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2023-11-29T11:13:31.051 INFO:teuthology.orchestra.run.smithi176.stdout:52 2023-11-29T11:13:31.052 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> import glob 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> import re 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> import os 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> import subprocess 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> def _find_admin_socket(client_name): 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> files = glob.glob(asok_path) 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-29T11:13:31.052 DEBUG:teuthology.orchestra.run.smithi176:> 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> # Given a non-glob path, it better be there 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> if "*" not in asok_path: 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> assert(len(files) == 1) 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> return files[0] 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> for f in files: 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> contents = proc_f.read() 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> if mountpoint in contents: 2023-11-29T11:13:31.053 DEBUG:teuthology.orchestra.run.smithi176:> return f 2023-11-29T11:13:31.054 DEBUG:teuthology.orchestra.run.smithi176:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:13:31.054 DEBUG:teuthology.orchestra.run.smithi176:> 2023-11-29T11:13:31.054 DEBUG:teuthology.orchestra.run.smithi176:> print(_find_admin_socket("client.1")) 2023-11-29T11:13:31.054 DEBUG:teuthology.orchestra.run.smithi176:> ' 2023-11-29T11:13:31.180 INFO:teuthology.orchestra.run.smithi176.stdout:/var/run/ceph/ceph-client.1.41904.asok 2023-11-29T11:13:31.364 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41904.asok 2023-11-29T11:13:31.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.365 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41904.asok status 2023-11-29T11:13:31.468 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "metadata": { 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "entity_id": "1", 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "hostname": "smithi176", 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "pid": "41904", 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "root": "/" 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_count": 0, 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_pinned_count": 0, 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "id": 4646, 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "inst": { 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "name": { 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "client", 2023-11-29T11:13:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: "num": 4646 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 1486693377 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: } 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 1486693377 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "inst_str": "client.4646 192.168.0.1:0/1486693377", 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "addr_str": "192.168.0.1:0/1486693377", 2023-11-29T11:13:31.470 INFO:teuthology.orchestra.run.smithi176.stdout: "inode_count": 1, 2023-11-29T11:13:31.471 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_epoch": 9, 2023-11-29T11:13:31.471 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch": 26, 2023-11-29T11:13:31.471 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:13:31.471 INFO:teuthology.orchestra.run.smithi176.stdout: "blocklisted": false, 2023-11-29T11:13:31.471 INFO:teuthology.orchestra.run.smithi176.stdout: "fs_name": "cephfs" 2023-11-29T11:13:31.471 INFO:teuthology.orchestra.run.smithi176.stdout:} 2023-11-29T11:13:31.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:13:31.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2528898700 1 Processor -- start 2023-11-29T11:13:31.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2528898700 1 -- start start 2023-11-29T11:13:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2528898700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f252415d230 0x7f25240d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2528898700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f252406cc50 0x7f252406d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2528898700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25240ccf60 con 0x7f25240ce960 2023-11-29T11:13:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2528898700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25240b66a0 con 0x7f252406cc50 2023-11-29T11:13:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2528898700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252415d690 con 0x7f252415d230 2023-11-29T11:13:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f252406cc50 0x7f252406d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f252406cc50 0x7f252406d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34220/0 (socket says 172.21.15.81:34220) 2023-11-29T11:13:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252359e700 1 -- 172.21.15.81:0/3034106522 learned_addr learned my addr 172.21.15.81:0/3034106522 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252259c700 1 --2- 172.21.15.81:0/3034106522 >> v2:172.21.15.176:3300/0 conn(0x7f252415d230 0x7f25240d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252359e700 1 -- 172.21.15.81:0/3034106522 >> v2:172.21.15.176:3300/0 conn(0x7f252415d230 msgr2=0x7f25240d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252359e700 1 --2- 172.21.15.81:0/3034106522 >> v2:172.21.15.176:3300/0 conn(0x7f252415d230 0x7f25240d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252359e700 1 -- 172.21.15.81:0/3034106522 >> v1:172.21.15.176:6789/0 conn(0x7f25240ce960 legacy=0x7f25240d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252359e700 1 -- 172.21.15.81:0/3034106522 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25240b78b0 con 0x7f252406cc50 2023-11-29T11:13:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f252359e700 1 --2- 172.21.15.81:0/3034106522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f252406d050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f252408c660 tx=0x7f251c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc0c30f538aa64f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2521d9b700 1 -- 172.21.15.81:0/3034106522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c00b8a0 con 0x7f252406cc50 2023-11-29T11:13:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2521d9b700 1 -- 172.21.15.81:0/3034106522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c00ba00 con 0x7f252406cc50 2023-11-29T11:13:31.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.594+0000 7f2521d9b700 1 -- 172.21.15.81:0/3034106522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c00bd90 con 0x7f252406cc50 2023-11-29T11:13:31.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- 172.21.15.81:0/3034106522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 msgr2=0x7f252406d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:31.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 --2- 172.21.15.81:0/3034106522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f252406d050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f252408c660 tx=0x7f251c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- 172.21.15.81:0/3034106522 shutdown_connections 2023-11-29T11:13:31.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 --2- 172.21.15.81:0/3034106522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f252406d050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 --2- 172.21.15.81:0/3034106522 >> v2:172.21.15.176:3300/0 conn(0x7f252415d230 0x7f25240d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- 172.21.15.81:0/3034106522 >> 172.21.15.81:0/3034106522 conn(0x7f25240b5860 msgr2=0x7f25240b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:31.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- 172.21.15.81:0/3034106522 shutdown_connections 2023-11-29T11:13:31.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- 172.21.15.81:0/3034106522 wait complete. 2023-11-29T11:13:31.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 Processor -- start 2023-11-29T11:13:31.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- start start 2023-11-29T11:13:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f25240b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240ce960 0x7f2524150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f252415d230 0x7f25240b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25241f4840 con 0x7f252406cc50 2023-11-29T11:13:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25240b4a80 con 0x7f252415d230 2023-11-29T11:13:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2528898700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25240b4d60 con 0x7f25240ce960 2023-11-29T11:13:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2522d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f25240b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2522d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f25240b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34226/0 (socket says 172.21.15.81:34226) 2023-11-29T11:13:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f2522d9d700 1 -- 172.21.15.81:0/1448801057 learned_addr learned my addr 172.21.15.81:0/1448801057 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.598+0000 7f252259c700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240ce960 0x7f2524150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f252359e700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f252415d230 0x7f25240b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f2522d9d700 1 -- 172.21.15.81:0/1448801057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240ce960 msgr2=0x7f2524150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f2522d9d700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240ce960 0x7f2524150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f2522d9d700 1 -- 172.21.15.81:0/1448801057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f252415d230 msgr2=0x7f25240b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f2522d9d700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f252415d230 0x7f25240b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f2522d9d700 1 -- 172.21.15.81:0/1448801057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c009570 con 0x7f252406cc50 2023-11-29T11:13:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f2522d9d700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f25240b4480 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2514001ed0 tx=0x7f25140021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f251b7fe700 1 -- 172.21.15.81:0/1448801057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514003c20 con 0x7f252406cc50 2023-11-29T11:13:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f251b7fe700 1 -- 172.21.15.81:0/1448801057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2514003d80 con 0x7f252406cc50 2023-11-29T11:13:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f251b7fe700 1 -- 172.21.15.81:0/1448801057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400ab40 con 0x7f252406cc50 2023-11-29T11:13:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f2528898700 1 -- 172.21.15.81:0/1448801057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25240b7e50 con 0x7f252406cc50 2023-11-29T11:13:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f2528898700 1 -- 172.21.15.81:0/1448801057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25240b7b70 con 0x7f252406cc50 2023-11-29T11:13:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f25197fa700 1 -- 172.21.15.81:0/1448801057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2500005310 con 0x7f252406cc50 2023-11-29T11:13:31.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f251b7fe700 1 -- 172.21.15.81:0/1448801057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2514010050 con 0x7f252406cc50 2023-11-29T11:13:31.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.602+0000 7f251b7fe700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2508064ee0 0x7f2508067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:31.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.606+0000 7f251b7fe700 1 -- 172.21.15.81:0/1448801057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2514082060 con 0x7f252406cc50 2023-11-29T11:13:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.606+0000 7f252259c700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2508064ee0 0x7f2508067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.606+0000 7f252259c700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2508064ee0 0x7f2508067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25240b4250 tx=0x7f250c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:31.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.610+0000 7f251b7fe700 1 -- 172.21.15.81:0/1448801057 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f251404ff10 con 0x7f252406cc50 2023-11-29T11:13:31.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.806+0000 7f25197fa700 1 -- 172.21.15.81:0/1448801057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2500005dd0 con 0x7f252406cc50 2023-11-29T11:13:31.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.806+0000 7f251b7fe700 1 -- 172.21.15.81:0/1448801057 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2514053530 con 0x7f252406cc50 2023-11-29T11:13:31.811 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 -- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2508064ee0 msgr2=0x7f2508067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2508064ee0 0x7f2508067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25240b4250 tx=0x7f250c008040 comp rx=0 tx=0).stop 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 -- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 msgr2=0x7f25240b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f25240b4480 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2514001ed0 tx=0x7f25140021e0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 -- 172.21.15.81:0/1448801057 shutdown_connections 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2508064ee0 0x7f2508067390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f252415d230 0x7f25240b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240ce960 0x7f2524150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 --2- 172.21.15.81:0/1448801057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406cc50 0x7f25240b4480 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 -- 172.21.15.81:0/1448801057 >> 172.21.15.81:0/1448801057 conn(0x7f25240b5860 msgr2=0x7f25240afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:31.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 -- 172.21.15.81:0/1448801057 shutdown_connections 2023-11-29T11:13:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:31.810+0000 7f25197fa700 1 -- 172.21.15.81:0/1448801057 wait complete. 2023-11-29T11:13:31.825 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:13:31.825 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:13:31.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2023-11-29T11:13:31.826 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-29T11:13:31.826 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-29T11:13:31.826 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:13:31.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-29T11:13:31.826 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:13:31.826 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-29T11:13:31.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.826 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2023-11-29T11:13:31.834 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:13:31.834 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42555sec preferred_lft 42555sec 2023-11-29T11:13:31.835 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:50:39:2c:0e brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 52:e2:18:cc:1d:0f brd ff:ff:ff:ff:ff:ff 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::74f2:95ff:fe2a:81de/64 scope link 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 52:e2:18:cc:1d:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::50e2:18ff:fecc:1d0f/64 scope link 2023-11-29T11:13:31.836 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:31.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.837 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:13:31.852 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-29T11:13:31.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.854 DEBUG:teuthology.orchestra.run.smithi176:> route 2023-11-29T11:13:31.903 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2023-11-29T11:13:31.903 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:13:31.903 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:13:31.903 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:13:31.903 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:13:31.903 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:13:31.903 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:13:31.904 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:13:31.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.904 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:31.904 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:31.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:13:31.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:13:31.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:13:31.904 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:31.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.941 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-29T11:13:31.948 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-29T11:13:31.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.949 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2023-11-29T11:13:31.997 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-29T11:13:31.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:31.998 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:31.998 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:31.998 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-29T11:13:31.998 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-29T11:13:31.998 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:32.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:32.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-29T11:13:32.038 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:13:32.038 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 82:7a:39:4a:0d:c1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::807a:39ff:fe4a:dc1/64 scope link 2023-11-29T11:13:32.039 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:32.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:32.040 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 82:7a:39:4a:0d:c1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::807a:39ff:fe4a:dc1/64 scope link 2023-11-29T11:13:32.052 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:13:32.053 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-29T11:13:32.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:32.054 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:32.054 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:32.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-29T11:13:32.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-29T11:13:32.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-29T11:13:32.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-29T11:13:32.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-29T11:13:32.054 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:32.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:32.156 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-29T11:13:32.156 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-29T11:13:32.156 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2023-11-29T11:13:32.156 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2023-11-29T11:13:32.156 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-29T11:13:32.181 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-29T11:13:32.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:13:32.181 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-29T11:13:32.187 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-29T11:13:32.187 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:13:32.187 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-29T11:13:32.193 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2023-11-29T11:13:32.252 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:32.253 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:32.262 INFO:teuthology.orchestra.run.smithi176.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:32.263 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:32.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:32.264 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2023-11-29T11:13:32.271 INFO:teuthology.orchestra.run.smithi176.stdout:52 2023-11-29T11:13:32.271 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-11-29T11:13:32.271 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3 --client_mountpoint=/) 2023-11-29T11:13:32.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2023-11-29T11:13:32.334 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:32.334 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:32.342 INFO:teuthology.orchestra.run.smithi176.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:32.343 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:32.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:32.343 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2023-11-29T11:13:32.397 INFO:teuthology.orchestra.run.smithi176.stdout:52 2023-11-29T11:13:32.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi176.stderr:2023-11-29T11:13:32.405+0000 7fa1dc1c0640 -1 init, newargv = 0x55a616bf88b0 newargc=15 2023-11-29T11:13:32.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi176.stderr:ceph-fuse[42018]: starting ceph client 2023-11-29T11:13:32.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi176.stderr:ceph-fuse[42018]: starting fuse 2023-11-29T11:13:33.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2023-11-29T11:13:33.517 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:13:33.517 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:13:33.528 INFO:teuthology.orchestra.run.smithi176.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:13:33.528 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:13:33.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:33.529 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2023-11-29T11:13:33.577 INFO:teuthology.orchestra.run.smithi176.stdout:52 2023-11-29T11:13:33.577 INFO:teuthology.orchestra.run.smithi176.stdout:53 2023-11-29T11:13:33.577 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-11-29T11:13:33.577 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:13:33.577 DEBUG:teuthology.orchestra.run.smithi176:> import glob 2023-11-29T11:13:33.577 DEBUG:teuthology.orchestra.run.smithi176:> import re 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> import os 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> import subprocess 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> def _find_admin_socket(client_name): 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> files = glob.glob(asok_path) 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> # Given a non-glob path, it better be there 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> if "*" not in asok_path: 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> assert(len(files) == 1) 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> return files[0] 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> for f in files: 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:13:33.578 DEBUG:teuthology.orchestra.run.smithi176:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:13:33.579 DEBUG:teuthology.orchestra.run.smithi176:> contents = proc_f.read() 2023-11-29T11:13:33.579 DEBUG:teuthology.orchestra.run.smithi176:> if mountpoint in contents: 2023-11-29T11:13:33.579 DEBUG:teuthology.orchestra.run.smithi176:> return f 2023-11-29T11:13:33.579 DEBUG:teuthology.orchestra.run.smithi176:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:13:33.579 DEBUG:teuthology.orchestra.run.smithi176:> 2023-11-29T11:13:33.579 DEBUG:teuthology.orchestra.run.smithi176:> print(_find_admin_socket("client.3")) 2023-11-29T11:13:33.579 DEBUG:teuthology.orchestra.run.smithi176:> ' 2023-11-29T11:13:33.660 INFO:teuthology.orchestra.run.smithi176.stdout:/var/run/ceph/ceph-client.3.42018.asok 2023-11-29T11:13:33.846 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42018.asok 2023-11-29T11:13:33.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:33.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42018.asok status 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "metadata": { 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "entity_id": "3", 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "hostname": "smithi176", 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "pid": "42018", 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "root": "/" 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_count": 0, 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_pinned_count": 0, 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "id": 4655, 2023-11-29T11:13:33.947 INFO:teuthology.orchestra.run.smithi176.stdout: "inst": { 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "name": { 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "client", 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "num": 4655 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.2:0", 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 1052230544 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: } 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.2:0", 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 1052230544 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "inst_str": "client.4655 192.168.0.2:0/1052230544", 2023-11-29T11:13:33.948 INFO:teuthology.orchestra.run.smithi176.stdout: "addr_str": "192.168.0.2:0/1052230544", 2023-11-29T11:13:33.949 INFO:teuthology.orchestra.run.smithi176.stdout: "inode_count": 1, 2023-11-29T11:13:33.949 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_epoch": 9, 2023-11-29T11:13:33.949 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch": 26, 2023-11-29T11:13:33.949 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:13:33.949 INFO:teuthology.orchestra.run.smithi176.stdout: "blocklisted": false, 2023-11-29T11:13:33.949 INFO:teuthology.orchestra.run.smithi176.stdout: "fs_name": "cephfs" 2023-11-29T11:13:33.949 INFO:teuthology.orchestra.run.smithi176.stdout:} 2023-11-29T11:13:33.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:33.957 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:13:33.957 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:13:33.966 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:13:33.966 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:13:33.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:33.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:13:33.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:33.981 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:13:33.981 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-29T11:13:33.987 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:13:33.987 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-29T11:13:33.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:33.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-29T11:13:34.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:34.003 DEBUG:teuthology.orchestra.run.smithi176:> stat --file-system '--printf=%T 2023-11-29T11:13:34.003 DEBUG:teuthology.orchestra.run.smithi176:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-29T11:13:34.011 INFO:teuthology.orchestra.run.smithi176.stdout:fuseblk 2023-11-29T11:13:34.012 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-29T11:13:34.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:34.012 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-29T11:13:34.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:34.025 DEBUG:teuthology.orchestra.run.smithi176:> stat --file-system '--printf=%T 2023-11-29T11:13:34.025 DEBUG:teuthology.orchestra.run.smithi176:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-29T11:13:34.030 INFO:teuthology.orchestra.run.smithi176.stdout:fuseblk 2023-11-29T11:13:34.030 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-29T11:13:34.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:34.030 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-29T11:13:34.041 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-29T11:13:34.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.174+0000 7f69f31cb700 1 Processor -- start 2023-11-29T11:13:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.174+0000 7f69f31cb700 1 -- start start 2023-11-29T11:13:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69ec0cb2a0 0x7f69ec0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec06ace0 con 0x7f69ec159e70 2023-11-29T11:13:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec0cb720 con 0x7f69ec0cb2a0 2023-11-29T11:13:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec06a0d0 con 0x7f69ec069c40 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f29ca700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69ec0cb2a0 0x7f69ec0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f29ca700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69ec0cb2a0 0x7f69ec0c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34238/0 (socket says 172.21.15.81:34238) 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f29ca700 1 -- 172.21.15.81:0/1635407052 learned_addr learned my addr 172.21.15.81:0/1635407052 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f19c8700 1 --2- 172.21.15.81:0/1635407052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f29ca700 1 -- 172.21.15.81:0/1635407052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 msgr2=0x7f69ec0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f29ca700 1 --2- 172.21.15.81:0/1635407052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f29ca700 1 -- 172.21.15.81:0/1635407052 >> v1:172.21.15.176:6789/0 conn(0x7f69ec159e70 legacy=0x7f69ec06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f29ca700 1 -- 172.21.15.81:0/1635407052 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec06a3b0 con 0x7f69ec0cb2a0 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f19c8700 1 --2- 172.21.15.81:0/1635407052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f29ca700 1 --2- 172.21.15.81:0/1635407052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec0cb2a0 0x7f69ec0c91d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009e50 tx=0x7f69e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadadea3233524af server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f11c7700 1 -- 172.21.15.81:0/1635407052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e400e070 con 0x7f69ec0cb2a0 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f11c7700 1 -- 172.21.15.81:0/1635407052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e400b9c0 con 0x7f69ec0cb2a0 2023-11-29T11:13:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f11c7700 1 -- 172.21.15.81:0/1635407052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e400bd70 con 0x7f69ec0cb2a0 2023-11-29T11:13:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 -- 172.21.15.81:0/1635407052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec0cb2a0 msgr2=0x7f69ec0c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 --2- 172.21.15.81:0/1635407052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec0cb2a0 0x7f69ec0c91d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009e50 tx=0x7f69e400b330 comp rx=0 tx=0).stop 2023-11-29T11:13:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 -- 172.21.15.81:0/1635407052 shutdown_connections 2023-11-29T11:13:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 --2- 172.21.15.81:0/1635407052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec0cb2a0 0x7f69ec0c91d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 --2- 172.21.15.81:0/1635407052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 -- 172.21.15.81:0/1635407052 >> 172.21.15.81:0/1635407052 conn(0x7f69ec0ce3e0 msgr2=0x7f69ec0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 -- 172.21.15.81:0/1635407052 shutdown_connections 2023-11-29T11:13:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.178+0000 7f69f31cb700 1 -- 172.21.15.81:0/1635407052 wait complete. 2023-11-29T11:13:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.182+0000 7f69f31cb700 1 Processor -- start 2023-11-29T11:13:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.182+0000 7f69f31cb700 1 -- start start 2023-11-29T11:13:34.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.182+0000 7f69f31cb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.182+0000 7f69f31cb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ec0cb2a0 0x7f69ec1eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.182+0000 7f69f31cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec159e70 0x7f69ec0af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f31cb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0c2480 con 0x7f69ec159e70 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f31cb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0c2760 con 0x7f69ec0cb2a0 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f31cb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0c2a40 con 0x7f69ec069c40 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec159e70 0x7f69ec0af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec159e70 0x7f69ec0af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34252/0 (socket says 172.21.15.81:34252) 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f19c8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ec0cb2a0 0x7f69ec1eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 -- 172.21.15.81:0/3448112577 learned_addr learned my addr 172.21.15.81:0/3448112577 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f21c9700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 -- 172.21.15.81:0/3448112577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 msgr2=0x7f69ec153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 -- 172.21.15.81:0/3448112577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ec0cb2a0 msgr2=0x7f69ec1eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ec0cb2a0 0x7f69ec1eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 -- 172.21.15.81:0/3448112577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4009b30 con 0x7f69ec159e70 2023-11-29T11:13:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f29ca700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec159e70 0x7f69ec0af630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f69ec06f4b0 tx=0x7f69e4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69e2ffd700 1 -- 172.21.15.81:0/3448112577 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40048c0 con 0x7f69ec159e70 2023-11-29T11:13:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69e2ffd700 1 -- 172.21.15.81:0/3448112577 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e40099b0 con 0x7f69ec159e70 2023-11-29T11:13:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec06a970 con 0x7f69ec159e70 2023-11-29T11:13:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69e2ffd700 1 -- 172.21.15.81:0/3448112577 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e401c680 con 0x7f69ec159e70 2023-11-29T11:13:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec06a690 con 0x7f69ec159e70 2023-11-29T11:13:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec06d0b0 con 0x7f69ec159e70 2023-11-29T11:13:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.186+0000 7f69e2ffd700 1 -- 172.21.15.81:0/3448112577 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f69e4022030 con 0x7f69ec159e70 2023-11-29T11:13:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.190+0000 7f69e2ffd700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d0064ee0 0x7f69d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.190+0000 7f69f21c9700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d0064ee0 0x7f69d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.190+0000 7f69e2ffd700 1 -- 172.21.15.81:0/3448112577 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f69e4083980 con 0x7f69ec159e70 2023-11-29T11:13:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.190+0000 7f69f21c9700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d0064ee0 0x7f69d0067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f69dc001800 tx=0x7f69dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.194+0000 7f69e2ffd700 1 -- 172.21.15.81:0/3448112577 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f69e4051740 con 0x7f69ec159e70 2023-11-29T11:13:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.362+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69ec06b6d0 con 0x7f69ec159e70 2023-11-29T11:13:34.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69e2ffd700 1 -- 172.21.15.81:0/3448112577 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f69e4054d60 con 0x7f69ec159e70 2023-11-29T11:13:34.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:34.369 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d0064ee0 msgr2=0x7f69d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d0064ee0 0x7f69d0067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f69dc001800 tx=0x7f69dc009040 comp rx=0 tx=0).stop 2023-11-29T11:13:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec159e70 msgr2=0x7f69ec0af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec159e70 0x7f69ec0af630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f69ec06f4b0 tx=0x7f69e4004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 shutdown_connections 2023-11-29T11:13:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d0064ee0 0x7f69d0067390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69ec159e70 0x7f69ec0af630 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ec0cb2a0 0x7f69ec1eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 --2- 172.21.15.81:0/3448112577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ec069c40 0x7f69ec153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 >> 172.21.15.81:0/3448112577 conn(0x7f69ec0ce3e0 msgr2=0x7f69ec0c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 shutdown_connections 2023-11-29T11:13:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.366+0000 7f69f31cb700 1 -- 172.21.15.81:0/3448112577 wait complete. 2023-11-29T11:13:34.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:34.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:34.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 Processor -- start 2023-11-29T11:13:34.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 -- start start 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f133c0cc2f0 0x7f133c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c15a3e0 0x7f133c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f133c0b2d30 0x7f133c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c09c0e0 con 0x7f133c0b2d30 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0ccc00 con 0x7f133c0cc2f0 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0b13e0 con 0x7f133c15a3e0 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f133c0b2d30 0x7f133c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f133c0b2d30 0x7f133c069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34258/0 (socket says 172.21.15.81:34258) 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 -- 172.21.15.81:0/4002381810 learned_addr learned my addr 172.21.15.81:0/4002381810 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1340f57700 1 --2- 172.21.15.81:0/4002381810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c15a3e0 0x7f133c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 -- 172.21.15.81:0/4002381810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c15a3e0 msgr2=0x7f133c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341758700 1 --2- 172.21.15.81:0/4002381810 >> v2:172.21.15.176:3300/0 conn(0x7f133c0cc2f0 0x7f133c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 --2- 172.21.15.81:0/4002381810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c15a3e0 0x7f133c0cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 -- 172.21.15.81:0/4002381810 >> v2:172.21.15.176:3300/0 conn(0x7f133c0cc2f0 msgr2=0x7f133c0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 --2- 172.21.15.81:0/4002381810 >> v2:172.21.15.176:3300/0 conn(0x7f133c0cc2f0 0x7f133c0ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 -- 172.21.15.81:0/4002381810 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0b16c0 con 0x7f133c0b2d30 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1340f57700 1 --2- 172.21.15.81:0/4002381810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c15a3e0 0x7f133c0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341758700 1 --2- 172.21.15.81:0/4002381810 >> v2:172.21.15.176:3300/0 conn(0x7f133c0cc2f0 0x7f133c0ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f1341f59700 1 --2- 172.21.15.81:0/4002381810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c069c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f133c0b3410 tx=0x7f133400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd9625d54301d06 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f132ffff700 1 -- 172.21.15.81:0/4002381810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400e070 con 0x7f133c0b2d30 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f132ffff700 1 -- 172.21.15.81:0/4002381810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400b9c0 con 0x7f133c0b2d30 2023-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f132ffff700 1 -- 172.21.15.81:0/4002381810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400bd70 con 0x7f133c0b2d30 2023-11-29T11:13:34.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 -- 172.21.15.81:0/4002381810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 msgr2=0x7f133c069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 --2- 172.21.15.81:0/4002381810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c069c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f133c0b3410 tx=0x7f133400b330 comp rx=0 tx=0).stop 2023-11-29T11:13:34.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 -- 172.21.15.81:0/4002381810 shutdown_connections 2023-11-29T11:13:34.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 --2- 172.21.15.81:0/4002381810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c15a3e0 0x7f133c0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 --2- 172.21.15.81:0/4002381810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c069c40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 --2- 172.21.15.81:0/4002381810 >> v2:172.21.15.176:3300/0 conn(0x7f133c0cc2f0 0x7f133c0ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.502+0000 7f134275a700 1 -- 172.21.15.81:0/4002381810 >> 172.21.15.81:0/4002381810 conn(0x7f133c0cae70 msgr2=0x7f133c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 -- 172.21.15.81:0/4002381810 shutdown_connections 2023-11-29T11:13:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 -- 172.21.15.81:0/4002381810 wait complete. 2023-11-29T11:13:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 Processor -- start 2023-11-29T11:13:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 -- start start 2023-11-29T11:13:34.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c0cc2f0 0x7f133c06fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f133c15a3e0 0x7f133c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0af460 con 0x7f133c0b2d30 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c072140 con 0x7f133c15a3e0 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f134275a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0989e0 con 0x7f133c0cc2f0 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f1341758700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f1341758700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34260/0 (socket says 172.21.15.81:34260) 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f1341758700 1 -- 172.21.15.81:0/150686729 learned_addr learned my addr 172.21.15.81:0/150686729 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f1341f59700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f133c15a3e0 0x7f133c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.506+0000 7f1340f57700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c0cc2f0 0x7f133c06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f1341758700 1 -- 172.21.15.81:0/150686729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c0cc2f0 msgr2=0x7f133c06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f1341758700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c0cc2f0 0x7f133c06fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f1341758700 1 -- 172.21.15.81:0/150686729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f133c15a3e0 msgr2=0x7f133c153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f1341758700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f133c15a3e0 0x7f133c153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f1341758700 1 -- 172.21.15.81:0/150686729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334009b30 con 0x7f133c0b2d30 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f1341758700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c152260 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f133000c7c0 tx=0x7f133000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f132dffb700 1 -- 172.21.15.81:0/150686729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330011800 con 0x7f133c0b2d30 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f132dffb700 1 -- 172.21.15.81:0/150686729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330011960 con 0x7f133c0b2d30 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c0b1c80 con 0x7f133c0b2d30 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f132dffb700 1 -- 172.21.15.81:0/150686729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330011cd0 con 0x7f133c0b2d30 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c0b19a0 con 0x7f133c0b2d30 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c06a180 con 0x7f133c0b2d30 2023-11-29T11:13:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f132dffb700 1 -- 172.21.15.81:0/150686729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1330020070 con 0x7f133c0b2d30 2023-11-29T11:13:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f132dffb700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064f10 0x7f13200673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.510+0000 7f132dffb700 1 -- 172.21.15.81:0/150686729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1330081ee0 con 0x7f133c0b2d30 2023-11-29T11:13:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.514+0000 7f1340f57700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064f10 0x7f13200673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.514+0000 7f1340f57700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064f10 0x7f13200673c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f133c0cab80 tx=0x7f1338008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.518+0000 7f132dffb700 1 -- 172.21.15.81:0/150686729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f133004fd90 con 0x7f133c0b2d30 2023-11-29T11:13:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f133c098c90 con 0x7f133c0b2d30 2023-11-29T11:13:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f132dffb700 1 -- 172.21.15.81:0/150686729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f13300533b0 con 0x7f133c0b2d30 2023-11-29T11:13:34.682 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064f10 msgr2=0x7f13200673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064f10 0x7f13200673c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f133c0cab80 tx=0x7f1338008040 comp rx=0 tx=0).stop 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 msgr2=0x7f133c152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c152260 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f133000c7c0 tx=0x7f133000cad0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 shutdown_connections 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064f10 0x7f13200673c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f133c15a3e0 0x7f133c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f133c0cc2f0 0x7f133c06fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 --2- 172.21.15.81:0/150686729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b2d30 0x7f133c152260 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 >> 172.21.15.81:0/150686729 conn(0x7f133c0cae70 msgr2=0x7f133c158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.678+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 shutdown_connections 2023-11-29T11:13:34.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.682+0000 7f134275a700 1 -- 172.21.15.81:0/150686729 wait complete. 2023-11-29T11:13:34.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70e53d9700 1 Processor -- start 2023-11-29T11:13:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70e53d9700 1 -- start start 2023-11-29T11:13:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70e53d9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f70e00aaf40 0x7f70e00b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70e53d9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00ccd00 con 0x7f70e006b370 2023-11-29T11:13:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70e53d9700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00b19b0 con 0x7f70e015bb80 2023-11-29T11:13:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70e53d9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e00cd510 con 0x7f70e00aaf40 2023-11-29T11:13:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70e4bd8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70e006b370 0x7f70e015c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41140/0 (socket says 172.21.15.81:41140) 2023-11-29T11:13:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70e4bd8700 1 -- 172.21.15.81:0/990762849 learned_addr learned my addr 172.21.15.81:0/990762849 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70df7fe700 1 --2- 172.21.15.81:0/990762849 >> v2:172.21.15.176:3300/0 conn(0x7f70e00aaf40 0x7f70e00b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70deffd700 1 -- 172.21.15.81:0/990762849 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142723624 0 0) 0x7f70e00ccd00 con 0x7f70e006b370 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70deffd700 1 -- 172.21.15.81:0/990762849 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c80035d0 con 0x7f70e006b370 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70df7fe700 1 -- 172.21.15.81:0/990762849 >> v1:172.21.15.176:6789/0 conn(0x7f70e015bb80 legacy=0x7f70e00b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70df7fe700 1 -- 172.21.15.81:0/990762849 >> v1:172.21.15.81:6789/0 conn(0x7f70e006b370 legacy=0x7f70e015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.814+0000 7f70df7fe700 1 -- 172.21.15.81:0/990762849 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00ccf50 con 0x7f70e00aaf40 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70df7fe700 1 --2- 172.21.15.81:0/990762849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e00aaf40 0x7f70e00b2b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009850 tx=0x7f70d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b756bfbae332e64e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70deffd700 1 -- 172.21.15.81:0/990762849 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0011830 con 0x7f70e00aaf40 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70deffd700 1 -- 172.21.15.81:0/990762849 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0011990 con 0x7f70e00aaf40 2023-11-29T11:13:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70deffd700 1 -- 172.21.15.81:0/990762849 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0011d00 con 0x7f70e00aaf40 2023-11-29T11:13:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 -- 172.21.15.81:0/990762849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e00aaf40 msgr2=0x7f70e00b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 --2- 172.21.15.81:0/990762849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e00aaf40 0x7f70e00b2b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009850 tx=0x7f70d0009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 -- 172.21.15.81:0/990762849 shutdown_connections 2023-11-29T11:13:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 --2- 172.21.15.81:0/990762849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e00aaf40 0x7f70e00b2b60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 -- 172.21.15.81:0/990762849 >> 172.21.15.81:0/990762849 conn(0x7f70e00cae70 msgr2=0x7f70e00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 -- 172.21.15.81:0/990762849 shutdown_connections 2023-11-29T11:13:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 -- 172.21.15.81:0/990762849 wait complete. 2023-11-29T11:13:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 Processor -- start 2023-11-29T11:13:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.818+0000 7f70e53d9700 1 -- start start 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e53d9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e006b370 0x7f70e006ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e53d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e00aaf40 0x7f70e014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e53d9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015bb80 0x7f70e00af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e53d9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0071300 con 0x7f70e00aaf40 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e53d9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0070680 con 0x7f70e015bb80 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e53d9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0070960 con 0x7f70e006b370 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e00aaf40 0x7f70e014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e00aaf40 0x7f70e014f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34268/0 (socket says 172.21.15.81:34268) 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 -- 172.21.15.81:0/2108632950 learned_addr learned my addr 172.21.15.81:0/2108632950 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70dffff700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e006b370 0x7f70e006ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e4bd8700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015bb80 0x7f70e00af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 -- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e006b370 msgr2=0x7f70e006ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e006b370 0x7f70e006ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 -- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015bb80 msgr2=0x7f70e00af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015bb80 0x7f70e00af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 -- 172.21.15.81:0/2108632950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00094b0 con 0x7f70e00aaf40 2023-11-29T11:13:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e4bd8700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015bb80 0x7f70e00af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70dffff700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e006b370 0x7f70e006ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70df7fe700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e00aaf40 0x7f70e014f860 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009ba0 tx=0x7f70d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70dcff9700 1 -- 172.21.15.81:0/2108632950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00036c0 con 0x7f70e00aaf40 2023-11-29T11:13:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70dcff9700 1 -- 172.21.15.81:0/2108632950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d001f070 con 0x7f70e00aaf40 2023-11-29T11:13:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e00b1c50 con 0x7f70e00aaf40 2023-11-29T11:13:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70dcff9700 1 -- 172.21.15.81:0/2108632950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0003a60 con 0x7f70e00aaf40 2023-11-29T11:13:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.822+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e00cd230 con 0x7f70e00aaf40 2023-11-29T11:13:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.826+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e00b1f30 con 0x7f70e00aaf40 2023-11-29T11:13:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.826+0000 7f70dcff9700 1 -- 172.21.15.81:0/2108632950 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f70d000f050 con 0x7f70e00aaf40 2023-11-29T11:13:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.826+0000 7f70dcff9700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f70cc064ee0 0x7f70cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.826+0000 7f70dcff9700 1 -- 172.21.15.81:0/2108632950 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f70d0021070 con 0x7f70e00aaf40 2023-11-29T11:13:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.826+0000 7f70dffff700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f70cc064ee0 0x7f70cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.826+0000 7f70dffff700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f70cc064ee0 0x7f70cc067390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f70e00af990 tx=0x7f70d4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:34.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.834+0000 7f70dcff9700 1 -- 172.21.15.81:0/2108632950 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f70d0051610 con 0x7f70e00aaf40 2023-11-29T11:13:34.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.990+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70e0072500 con 0x7f70e00aaf40 2023-11-29T11:13:34.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70dcff9700 1 -- 172.21.15.81:0/2108632950 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70d002a020 con 0x7f70e00aaf40 2023-11-29T11:13:34.997 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:34.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f70cc064ee0 msgr2=0x7f70cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f70cc064ee0 0x7f70cc067390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f70e00af990 tx=0x7f70d4009040 comp rx=0 tx=0).stop 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e00aaf40 msgr2=0x7f70e014f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e00aaf40 0x7f70e014f860 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009ba0 tx=0x7f70d0004770 comp rx=0 tx=0).stop 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 shutdown_connections 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f70cc064ee0 0x7f70cc067390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70e015bb80 0x7f70e00af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e00aaf40 0x7f70e014f860 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 --2- 172.21.15.81:0/2108632950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70e006b370 0x7f70e006ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 >> 172.21.15.81:0/2108632950 conn(0x7f70e00cae70 msgr2=0x7f70e00ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 shutdown_connections 2023-11-29T11:13:35.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:34.994+0000 7f70e53d9700 1 -- 172.21.15.81:0/2108632950 wait complete. 2023-11-29T11:13:35.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:35.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff88e6700 1 Processor -- start 2023-11-29T11:13:35.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff88e6700 1 -- start start 2023-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff88e6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff40d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff88e6700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbff40cce60 0x7fbff406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff88e6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbff40cf470 0x7fbff40cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff88e6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff415c8b0 con 0x7fbff40cf470 2023-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff88e6700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff40cd2d0 con 0x7fbff40cce60 2023-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff88e6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff406d770 con 0x7fbff406ce60 2023-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbff40cf470 0x7fbff40cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbff40cf470 0x7fbff40cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34284/0 (socket says 172.21.15.81:34284) 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 -- 172.21.15.81:0/3115688249 learned_addr learned my addr 172.21.15.81:0/3115688249 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff37fe700 1 --2- 172.21.15.81:0/3115688249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff40d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff2ffd700 1 --2- 172.21.15.81:0/3115688249 >> v2:172.21.15.176:3300/0 conn(0x7fbff40cce60 0x7fbff406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 -- 172.21.15.81:0/3115688249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 msgr2=0x7fbff40d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 --2- 172.21.15.81:0/3115688249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff40d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 -- 172.21.15.81:0/3115688249 >> v2:172.21.15.176:3300/0 conn(0x7fbff40cce60 msgr2=0x7fbff406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 --2- 172.21.15.81:0/3115688249 >> v2:172.21.15.176:3300/0 conn(0x7fbff40cce60 0x7fbff406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 -- 172.21.15.81:0/3115688249 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff406a7f0 con 0x7fbff40cf470 2023-11-29T11:13:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff3fff700 1 --2- 172.21.15.81:0/3115688249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 0x7fbff40cf8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbff4066160 tx=0x7fbfec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae795d3a89ddd11 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.122+0000 7fbff27fc700 1 -- 172.21.15.81:0/3115688249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00e070 con 0x7fbff40cf470 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff27fc700 1 -- 172.21.15.81:0/3115688249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec00b9c0 con 0x7fbff40cf470 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff27fc700 1 -- 172.21.15.81:0/3115688249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00bd70 con 0x7fbff40cf470 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 -- 172.21.15.81:0/3115688249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 msgr2=0x7fbff40cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 --2- 172.21.15.81:0/3115688249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 0x7fbff40cf8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbff4066160 tx=0x7fbfec00b330 comp rx=0 tx=0).stop 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 -- 172.21.15.81:0/3115688249 shutdown_connections 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 --2- 172.21.15.81:0/3115688249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 0x7fbff40cf8f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 --2- 172.21.15.81:0/3115688249 >> v2:172.21.15.176:3300/0 conn(0x7fbff40cce60 0x7fbff406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 --2- 172.21.15.81:0/3115688249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff40d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 -- 172.21.15.81:0/3115688249 >> 172.21.15.81:0/3115688249 conn(0x7fbff40b5760 msgr2=0x7fbff40b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 -- 172.21.15.81:0/3115688249 shutdown_connections 2023-11-29T11:13:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 -- 172.21.15.81:0/3115688249 wait complete. 2023-11-29T11:13:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 Processor -- start 2023-11-29T11:13:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.126+0000 7fbff88e6700 1 -- start start 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbff40cce60 0x7fbff40d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 0x7fbff40d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40c98e0 con 0x7fbff40cf470 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40ca8f0 con 0x7fbff40cce60 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40c9b30 con 0x7fbff406ce60 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff37fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 0x7fbff40d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff37fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff4159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:50692/0 (socket says 172.21.15.81:50692) 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff37fe700 1 -- 172.21.15.81:0/4247954476 learned_addr learned my addr 172.21.15.81:0/4247954476 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:35.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff2ffd700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbff40cce60 0x7fbff40d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff3fff700 1 -- 172.21.15.81:0/4247954476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 msgr2=0x7fbff4159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff3fff700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff4159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff3fff700 1 -- 172.21.15.81:0/4247954476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbff40cce60 msgr2=0x7fbff40d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff3fff700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbff40cce60 0x7fbff40d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff3fff700 1 -- 172.21.15.81:0/4247954476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec009b30 con 0x7fbff40cf470 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff3fff700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 0x7fbff40d0990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbfec015000 tx=0x7fbfec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbfdbfff700 1 -- 172.21.15.81:0/4247954476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec004450 con 0x7fbff40cf470 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbfdbfff700 1 -- 172.21.15.81:0/4247954476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0045b0 con 0x7fbff40cf470 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff406adb0 con 0x7fbff40cf470 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbfdbfff700 1 -- 172.21.15.81:0/4247954476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec004960 con 0x7fbff40cf470 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff406aad0 con 0x7fbff40cf470 2023-11-29T11:13:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.130+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff406b090 con 0x7fbff40cf470 2023-11-29T11:13:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.134+0000 7fbfdbfff700 1 -- 172.21.15.81:0/4247954476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbfec01c410 con 0x7fbff40cf470 2023-11-29T11:13:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.134+0000 7fbfdbfff700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfe0064f10 0x7fbfe00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.134+0000 7fbfdbfff700 1 -- 172.21.15.81:0/4247954476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbfec084290 con 0x7fbff40cf470 2023-11-29T11:13:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.134+0000 7fbff37fe700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfe0064f10 0x7fbfe00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.134+0000 7fbff37fe700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfe0064f10 0x7fbfe00673c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8007b10 tx=0x7fbfe8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.138+0000 7fbfdbfff700 1 -- 172.21.15.81:0/4247954476 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbfec052060 con 0x7fbff40cf470 2023-11-29T11:13:35.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.306+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbff4072c20 con 0x7fbff40cf470 2023-11-29T11:13:35.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.306+0000 7fbfdbfff700 1 -- 172.21.15.81:0/4247954476 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbfec055680 con 0x7fbff40cf470 2023-11-29T11:13:35.310 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.306+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfe0064f10 msgr2=0x7fbfe00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.306+0000 7fbff88e6700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfe0064f10 0x7fbfe00673c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8007b10 tx=0x7fbfe8008040 comp rx=0 tx=0).stop 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.306+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 msgr2=0x7fbff40d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.306+0000 7fbff88e6700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 0x7fbff40d0990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbfec015000 tx=0x7fbfec004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.310+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 shutdown_connections 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.310+0000 7fbff88e6700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfe0064f10 0x7fbfe00673c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.310+0000 7fbff88e6700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff40cf470 0x7fbff40d0990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.310+0000 7fbff88e6700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbff40cce60 0x7fbff40d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.310+0000 7fbff88e6700 1 --2- 172.21.15.81:0/4247954476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbff406ce60 0x7fbff4159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.310+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 >> 172.21.15.81:0/4247954476 conn(0x7fbff40b5760 msgr2=0x7fbff415bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.310+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 shutdown_connections 2023-11-29T11:13:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.310+0000 7fbff88e6700 1 -- 172.21.15.81:0/4247954476 wait complete. 2023-11-29T11:13:35.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:35.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.442+0000 7f416f192700 1 Processor -- start 2023-11-29T11:13:35.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.442+0000 7f416f192700 1 -- start start 2023-11-29T11:13:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41680b6950 0x7f4168166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41680d28e0 con 0x7f41680b4570 2023-11-29T11:13:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41680d1730 con 0x7f416806ad00 2023-11-29T11:13:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41680cd5c0 con 0x7f41680b6950 2023-11-29T11:13:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416cf2e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f41680b4570 0x7f41680b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41148/0 (socket says 172.21.15.81:41148) 2023-11-29T11:13:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416cf2e700 1 -- 172.21.15.81:0/2571947079 learned_addr learned my addr 172.21.15.81:0/2571947079 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:35.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416d72f700 1 --2- 172.21.15.81:0/2571947079 >> v2:172.21.15.176:3300/0 conn(0x7f41680b6950 0x7f4168166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f41677fe700 1 -- 172.21.15.81:0/2571947079 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465204964 0 0) 0x7f415c001110 con 0x7f41680b4570 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f41677fe700 1 -- 172.21.15.81:0/2571947079 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41500035d0 con 0x7f41680b4570 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416d72f700 1 -- 172.21.15.81:0/2571947079 >> v1:172.21.15.176:6789/0 conn(0x7f416806ad00 legacy=0x7f41680ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416d72f700 1 -- 172.21.15.81:0/2571947079 >> v1:172.21.15.81:6789/0 conn(0x7f41680b4570 legacy=0x7f41680b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f41677fe700 1 -- 172.21.15.81:0/2571947079 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3025104463 0 0) 0x7f41500035d0 con 0x7f41680b4570 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416d72f700 1 -- 172.21.15.81:0/2571947079 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680d1170 con 0x7f41680b6950 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416d72f700 1 --2- 172.21.15.81:0/2571947079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b6950 0x7f4168166dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f416000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8295749e3a1ea14 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f41677fe700 1 -- 172.21.15.81:0/2571947079 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416000e070 con 0x7f41680b6950 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f41677fe700 1 -- 172.21.15.81:0/2571947079 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160003a40 con 0x7f41680b6950 2023-11-29T11:13:35.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f41677fe700 1 -- 172.21.15.81:0/2571947079 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c001800 con 0x7f41680b6950 2023-11-29T11:13:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 -- 172.21.15.81:0/2571947079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b6950 msgr2=0x7f4168166dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 --2- 172.21.15.81:0/2571947079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b6950 0x7f4168166dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f416000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 -- 172.21.15.81:0/2571947079 shutdown_connections 2023-11-29T11:13:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 --2- 172.21.15.81:0/2571947079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b6950 0x7f4168166dd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 -- 172.21.15.81:0/2571947079 >> 172.21.15.81:0/2571947079 conn(0x7f416806cac0 msgr2=0x7f41680cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 -- 172.21.15.81:0/2571947079 shutdown_connections 2023-11-29T11:13:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.446+0000 7f416f192700 1 -- 172.21.15.81:0/2571947079 wait complete. 2023-11-29T11:13:35.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416f192700 1 Processor -- start 2023-11-29T11:13:35.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416f192700 1 -- start start 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416f192700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f416806ad00 0x7f4168154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416f192700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b4570 0x7f4168155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416f192700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41680b6950 0x7f41681557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416f192700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41681550a0 con 0x7f41680b6950 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416f192700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680cbf80 con 0x7f41680b4570 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416f192700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416815a2c0 con 0x7f416806ad00 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416d72f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41680b6950 0x7f41681557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416d72f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41680b6950 0x7f41681557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34308/0 (socket says 172.21.15.81:34308) 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416d72f700 1 -- 172.21.15.81:0/4213985144 learned_addr learned my addr 172.21.15.81:0/4213985144 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416cf2e700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f416806ad00 0x7f4168154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f4167fff700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b4570 0x7f4168155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416d72f700 1 -- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f416806ad00 msgr2=0x7f4168154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416d72f700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f416806ad00 0x7f4168154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416d72f700 1 -- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b4570 msgr2=0x7f4168155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.450+0000 7f416d72f700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b4570 0x7f4168155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f416d72f700 1 -- 172.21.15.81:0/4213985144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160009a70 con 0x7f41680b6950 2023-11-29T11:13:35.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f4167fff700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b4570 0x7f4168155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:35.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f416d72f700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41680b6950 0x7f41681557c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f416806d3a0 tx=0x7f4160004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f41657fa700 1 -- 172.21.15.81:0/4213985144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160004640 con 0x7f41680b6950 2023-11-29T11:13:35.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f41657fa700 1 -- 172.21.15.81:0/4213985144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41600047a0 con 0x7f41680b6950 2023-11-29T11:13:35.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41680cd1e0 con 0x7f41680b6950 2023-11-29T11:13:35.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f41657fa700 1 -- 172.21.15.81:0/4213985144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416001d670 con 0x7f41680b6950 2023-11-29T11:13:35.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41680d1450 con 0x7f41680b6950 2023-11-29T11:13:35.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41680b1f90 con 0x7f41680b6950 2023-11-29T11:13:35.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.454+0000 7f41657fa700 1 -- 172.21.15.81:0/4213985144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4160018070 con 0x7f41680b6950 2023-11-29T11:13:35.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.458+0000 7f41657fa700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4154064f10 0x7f41540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.458+0000 7f41657fa700 1 -- 172.21.15.81:0/4213985144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4160083ef0 con 0x7f41680b6950 2023-11-29T11:13:35.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.458+0000 7f416cf2e700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4154064f10 0x7f41540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.458+0000 7f416cf2e700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4154064f10 0x7f41540673c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f41680ccc20 tx=0x7f415c001070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.462+0000 7f41657fa700 1 -- 172.21.15.81:0/4213985144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4160051cb0 con 0x7f41680b6950 2023-11-29T11:13:35.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.630+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41680b16d0 con 0x7f41680b6950 2023-11-29T11:13:35.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.630+0000 7f41657fa700 1 -- 172.21.15.81:0/4213985144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41600552d0 con 0x7f41680b6950 2023-11-29T11:13:35.635 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:35.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4154064f10 msgr2=0x7f41540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4154064f10 0x7f41540673c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f41680ccc20 tx=0x7f415c001070 comp rx=0 tx=0).stop 2023-11-29T11:13:35.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41680b6950 msgr2=0x7f41681557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41680b6950 0x7f41681557c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f416806d3a0 tx=0x7f4160004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 shutdown_connections 2023-11-29T11:13:35.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4154064f10 0x7f41540673c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41680b6950 0x7f41681557c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41680b4570 0x7f4168155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 --2- 172.21.15.81:0/4213985144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f416806ad00 0x7f4168154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 >> 172.21.15.81:0/4213985144 conn(0x7f416806cac0 msgr2=0x7f41680d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:35.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 shutdown_connections 2023-11-29T11:13:35.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.634+0000 7f416f192700 1 -- 172.21.15.81:0/4213985144 wait complete. 2023-11-29T11:13:35.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:35.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb7785ff700 1 Processor -- start 2023-11-29T11:13:35.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb7785ff700 1 -- start start 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb7785ff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb770160ac0 0x7fb7700b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb7785ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7700cd1c0 0x7fb7700b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb7785ff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7700d0740 con 0x7fb7700b45f0 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb7785ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7700b4f00 con 0x7fb7700cd1c0 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb7785ff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700d0990 con 0x7fb770160ac0 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb776b9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7700cd1c0 0x7fb7700b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb776b9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7700cd1c0 0x7fb7700b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34314/0 (socket says 172.21.15.81:34314) 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb776b9c700 1 -- 172.21.15.81:0/1546560313 learned_addr learned my addr 172.21.15.81:0/1546560313 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb775b9a700 1 --2- 172.21.15.81:0/1546560313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb770160ac0 0x7fb7700b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb776b9c700 1 -- 172.21.15.81:0/1546560313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb770160ac0 msgr2=0x7fb7700b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb776b9c700 1 --2- 172.21.15.81:0/1546560313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb770160ac0 0x7fb7700b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb776b9c700 1 -- 172.21.15.81:0/1546560313 >> v1:172.21.15.176:6789/0 conn(0x7fb7700b45f0 legacy=0x7fb7700d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb776b9c700 1 -- 172.21.15.81:0/1546560313 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700d0c70 con 0x7fb7700cd1c0 2023-11-29T11:13:35.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb776b9c700 1 --2- 172.21.15.81:0/1546560313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700cd1c0 0x7fb7700b59c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb768009e50 tx=0x7fb76800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1821701116037251 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb775399700 1 -- 172.21.15.81:0/1546560313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800e070 con 0x7fb7700cd1c0 2023-11-29T11:13:35.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb775399700 1 -- 172.21.15.81:0/1546560313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76800b910 con 0x7fb7700cd1c0 2023-11-29T11:13:35.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.774+0000 7fb775399700 1 -- 172.21.15.81:0/1546560313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800bcc0 con 0x7fb7700cd1c0 2023-11-29T11:13:35.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- 172.21.15.81:0/1546560313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700cd1c0 msgr2=0x7fb7700b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 --2- 172.21.15.81:0/1546560313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700cd1c0 0x7fb7700b59c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb768009e50 tx=0x7fb76800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- 172.21.15.81:0/1546560313 shutdown_connections 2023-11-29T11:13:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 --2- 172.21.15.81:0/1546560313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7700cd1c0 0x7fb7700b59c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 --2- 172.21.15.81:0/1546560313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb770160ac0 0x7fb7700b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- 172.21.15.81:0/1546560313 >> 172.21.15.81:0/1546560313 conn(0x7fb77006cb40 msgr2=0x7fb7700cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- 172.21.15.81:0/1546560313 shutdown_connections 2023-11-29T11:13:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- 172.21.15.81:0/1546560313 wait complete. 2023-11-29T11:13:35.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 Processor -- start 2023-11-29T11:13:35.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- start start 2023-11-29T11:13:35.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7700b45f0 0x7fb77014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7700cd1c0 0x7fb77015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770160ac0 0x7fb77015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77014de90 con 0x7fb770160ac0 2023-11-29T11:13:35.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77015bed0 con 0x7fb7700cd1c0 2023-11-29T11:13:35.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb7785ff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700cb670 con 0x7fb7700b45f0 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb776b9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770160ac0 0x7fb77015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.778+0000 7fb77639b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7700b45f0 0x7fb77014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb776b9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770160ac0 0x7fb77015b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34326/0 (socket says 172.21.15.81:34326) 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb77639b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7700b45f0 0x7fb77014d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:50714/0 (socket says 172.21.15.81:50714) 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb776b9c700 1 -- 172.21.15.81:0/2286607312 learned_addr learned my addr 172.21.15.81:0/2286607312 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb775b9a700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7700cd1c0 0x7fb77015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb77639b700 1 -- 172.21.15.81:0/2286607312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7700cd1c0 msgr2=0x7fb77015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb77639b700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7700cd1c0 0x7fb77015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb77639b700 1 -- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770160ac0 msgr2=0x7fb77015b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb77639b700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770160ac0 0x7fb77015b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb77639b700 1 -- 172.21.15.81:0/2286607312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb768009b30 con 0x7fb7700b45f0 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb77639b700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7700b45f0 0x7fb77014d950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c480 tx=0x7fb76c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb762ffd700 1 -- 172.21.15.81:0/2286607312 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0052d0 con 0x7fb7700b45f0 2023-11-29T11:13:35.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb762ffd700 1 -- 172.21.15.81:0/2286607312 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c005430 con 0x7fb7700b45f0 2023-11-29T11:13:35.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700d1230 con 0x7fb7700b45f0 2023-11-29T11:13:35.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb762ffd700 1 -- 172.21.15.81:0/2286607312 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0055a0 con 0x7fb7700b45f0 2023-11-29T11:13:35.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700d0f50 con 0x7fb7700b45f0 2023-11-29T11:13:35.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.782+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77015c660 con 0x7fb7700b45f0 2023-11-29T11:13:35.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.786+0000 7fb762ffd700 1 -- 172.21.15.81:0/2286607312 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb76c019030 con 0x7fb7700b45f0 2023-11-29T11:13:35.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.786+0000 7fb762ffd700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb754064ee0 0x7fb754067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:35.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.786+0000 7fb762ffd700 1 -- 172.21.15.81:0/2286607312 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb76c0813b0 con 0x7fb7700b45f0 2023-11-29T11:13:35.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.786+0000 7fb775b9a700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb754064ee0 0x7fb754067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:35.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.786+0000 7fb775b9a700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb754064ee0 0x7fb754067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb770159b00 tx=0x7fb764009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:35.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.794+0000 7fb762ffd700 1 -- 172.21.15.81:0/2286607312 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb76c04f1e0 con 0x7fb7700b45f0 2023-11-29T11:13:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.954+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb770072500 con 0x7fb7700b45f0 2023-11-29T11:13:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb762ffd700 1 -- 172.21.15.81:0/2286607312 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb76c052800 con 0x7fb7700b45f0 2023-11-29T11:13:35.962 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb754064ee0 msgr2=0x7fb754067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb754064ee0 0x7fb754067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb770159b00 tx=0x7fb764009240 comp rx=0 tx=0).stop 2023-11-29T11:13:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7700b45f0 msgr2=0x7fb77014d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7700b45f0 0x7fb77014d950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c480 tx=0x7fb76c00c790 comp rx=0 tx=0).stop 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 shutdown_connections 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb754064ee0 0x7fb754067390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb770160ac0 0x7fb77015b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7700cd1c0 0x7fb77015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 --2- 172.21.15.81:0/2286607312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7700b45f0 0x7fb77014d950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 >> 172.21.15.81:0/2286607312 conn(0x7fb77006cb40 msgr2=0x7fb7700d1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 shutdown_connections 2023-11-29T11:13:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:35.958+0000 7fb7785ff700 1 -- 172.21.15.81:0/2286607312 wait complete. 2023-11-29T11:13:35.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:36.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc077fff700 1 Processor -- start 2023-11-29T11:13:36.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc077fff700 1 -- start start 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc077fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc07806a330 0x7fc0780b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc077fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0780d2780 0x7fc0780d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc077fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0780cf070 con 0x7fc0780b1ca0 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc077fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780d3160 con 0x7fc0780d2780 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc077fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780b2070 con 0x7fc07806a330 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc0777fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0780d2780 0x7fc0780d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc0777fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0780d2780 0x7fc0780d2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34340/0 (socket says 172.21.15.81:34340) 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc0777fe700 1 -- 172.21.15.81:0/4280659220 learned_addr learned my addr 172.21.15.81:0/4280659220 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc06ffff700 1 --2- 172.21.15.81:0/4280659220 >> v2:172.21.15.176:3300/0 conn(0x7fc07806a330 0x7fc0780b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc0777fe700 1 -- 172.21.15.81:0/4280659220 >> v2:172.21.15.176:3300/0 conn(0x7fc07806a330 msgr2=0x7fc0780b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc0777fe700 1 --2- 172.21.15.81:0/4280659220 >> v2:172.21.15.176:3300/0 conn(0x7fc07806a330 0x7fc0780b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc0777fe700 1 -- 172.21.15.81:0/4280659220 >> v1:172.21.15.176:6789/0 conn(0x7fc0780b1ca0 legacy=0x7fc0780cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc0777fe700 1 -- 172.21.15.81:0/4280659220 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07806a8a0 con 0x7fc0780d2780 2023-11-29T11:13:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.082+0000 7fc06ffff700 1 --2- 172.21.15.81:0/4280659220 >> v2:172.21.15.176:3300/0 conn(0x7fc07806a330 0x7fc0780b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 --2- 172.21.15.81:0/4280659220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc0780d2c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc07808ad10 tx=0x7fc07000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e59af1baa8a6011 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0767fc700 1 -- 172.21.15.81:0/4280659220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000e070 con 0x7fc0780d2780 2023-11-29T11:13:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0767fc700 1 -- 172.21.15.81:0/4280659220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070003a40 con 0x7fc0780d2780 2023-11-29T11:13:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0767fc700 1 -- 172.21.15.81:0/4280659220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070003df0 con 0x7fc0780d2780 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- 172.21.15.81:0/4280659220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 msgr2=0x7fc0780d2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 --2- 172.21.15.81:0/4280659220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc0780d2c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc07808ad10 tx=0x7fc07000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- 172.21.15.81:0/4280659220 shutdown_connections 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 --2- 172.21.15.81:0/4280659220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc0780d2c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 --2- 172.21.15.81:0/4280659220 >> v2:172.21.15.176:3300/0 conn(0x7fc07806a330 0x7fc0780b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- 172.21.15.81:0/4280659220 >> 172.21.15.81:0/4280659220 conn(0x7fc0780b5740 msgr2=0x7fc0780b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- 172.21.15.81:0/4280659220 shutdown_connections 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- 172.21.15.81:0/4280659220 wait complete. 2023-11-29T11:13:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 Processor -- start 2023-11-29T11:13:36.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- start start 2023-11-29T11:13:36.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc07806a330 0x7fc0780cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0780b1ca0 0x7fc07815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc07815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815c900 con 0x7fc0780d2780 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815e0f0 con 0x7fc07806a330 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc077fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780c73d0 con 0x7fc0780b1ca0 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc07815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc07815da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34356/0 (socket says 172.21.15.81:34356) 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 -- 172.21.15.81:0/3867961207 learned_addr learned my addr 172.21.15.81:0/3867961207 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc076ffd700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc07806a330 0x7fc0780cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc06ffff700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0780b1ca0 0x7fc07815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 -- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0780b1ca0 msgr2=0x7fc07815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0780b1ca0 0x7fc07815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 -- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc07806a330 msgr2=0x7fc0780cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc07806a330 0x7fc0780cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc0777fe700 1 -- 172.21.15.81:0/3867961207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070009b30 con 0x7fc0780d2780 2023-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.086+0000 7fc076ffd700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc07806a330 0x7fc0780cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:36.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc0777fe700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc07815da90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc070009fd0 tx=0x7fc070004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc074ff9700 1 -- 172.21.15.81:0/3867961207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0700042c0 con 0x7fc0780d2780 2023-11-29T11:13:36.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc074ff9700 1 -- 172.21.15.81:0/3867961207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070004420 con 0x7fc0780d2780 2023-11-29T11:13:36.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07806ae60 con 0x7fc0780d2780 2023-11-29T11:13:36.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc074ff9700 1 -- 172.21.15.81:0/3867961207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070004790 con 0x7fc0780d2780 2023-11-29T11:13:36.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07806ab80 con 0x7fc0780d2780 2023-11-29T11:13:36.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07806b140 con 0x7fc0780d2780 2023-11-29T11:13:36.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc074ff9700 1 -- 172.21.15.81:0/3867961207 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc070012430 con 0x7fc0780d2780 2023-11-29T11:13:36.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc074ff9700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc05c064ee0 0x7fc05c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc074ff9700 1 -- 172.21.15.81:0/3867961207 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc070083680 con 0x7fc0780d2780 2023-11-29T11:13:36.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.090+0000 7fc076ffd700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc05c064ee0 0x7fc05c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.094+0000 7fc076ffd700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc05c064ee0 0x7fc05c067390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc068004000 tx=0x7fc068009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.098+0000 7fc074ff9700 1 -- 172.21.15.81:0/3867961207 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc070051450 con 0x7fc0780d2780 2023-11-29T11:13:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.258+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc078072c20 con 0x7fc0780d2780 2023-11-29T11:13:36.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.262+0000 7fc074ff9700 1 -- 172.21.15.81:0/3867961207 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fc070054a70 con 0x7fc0780d2780 2023-11-29T11:13:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:36.267 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.262+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc05c064ee0 msgr2=0x7fc05c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.262+0000 7fc077fff700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc05c064ee0 0x7fc05c067390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc068004000 tx=0x7fc068009040 comp rx=0 tx=0).stop 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.262+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 msgr2=0x7fc07815da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.262+0000 7fc077fff700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc07815da90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc070009fd0 tx=0x7fc070004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.266+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 shutdown_connections 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.266+0000 7fc077fff700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc05c064ee0 0x7fc05c067390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.266+0000 7fc077fff700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0780d2780 0x7fc07815da90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.266+0000 7fc077fff700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0780b1ca0 0x7fc07815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.266+0000 7fc077fff700 1 --2- 172.21.15.81:0/3867961207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc07806a330 0x7fc0780cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.266+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 >> 172.21.15.81:0/3867961207 conn(0x7fc0780b5740 msgr2=0x7fc0780b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.266+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 shutdown_connections 2023-11-29T11:13:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.266+0000 7fc077fff700 1 -- 172.21.15.81:0/3867961207 wait complete. 2023-11-29T11:13:36.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:36.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.394+0000 7f509286c700 1 Processor -- start 2023-11-29T11:13:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.394+0000 7f509286c700 1 -- start start 2023-11-29T11:13:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.394+0000 7f509286c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f508c06ce60 0x7f508c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f508c0cce60 0x7f508c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c0cd300 con 0x7f508c0cf470 2023-11-29T11:13:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c15c8b0 con 0x7f508c06ce60 2023-11-29T11:13:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c06d770 con 0x7f508c0cce60 2023-11-29T11:13:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509186a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f508c06ce60 0x7f508c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f5091069700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f508c0cce60 0x7f508c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509186a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f508c06ce60 0x7f508c0d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34360/0 (socket says 172.21.15.81:34360) 2023-11-29T11:13:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509186a700 1 -- 172.21.15.81:0/1828263953 learned_addr learned my addr 172.21.15.81:0/1828263953 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509206b700 1 --1- 172.21.15.81:0/1828263953 >> v1:172.21.15.81:6789/0 conn(0x7f508c0cf470 0x7f508c0cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41152/0 (socket says 172.21.15.81:41152) 2023-11-29T11:13:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509186a700 1 -- 172.21.15.81:0/1828263953 >> v2:172.21.15.176:3300/0 conn(0x7f508c0cce60 msgr2=0x7f508c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509186a700 1 --2- 172.21.15.81:0/1828263953 >> v2:172.21.15.176:3300/0 conn(0x7f508c0cce60 0x7f508c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509186a700 1 -- 172.21.15.81:0/1828263953 >> v1:172.21.15.81:6789/0 conn(0x7f508c0cf470 legacy=0x7f508c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f5090868700 1 -- 172.21.15.81:0/1828263953 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788156195 0 0) 0x7f5084001490 con 0x7f508c0cf470 2023-11-29T11:13:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509186a700 1 -- 172.21.15.81:0/1828263953 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c06a7f0 con 0x7f508c06ce60 2023-11-29T11:13:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509186a700 1 --2- 172.21.15.81:0/1828263953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c06ce60 0x7f508c0d31b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5088009910 tx=0x7f5088009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1331fba02035f197 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f5090868700 1 -- 172.21.15.81:0/1828263953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088011830 con 0x7f508c06ce60 2023-11-29T11:13:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f5090868700 1 -- 172.21.15.81:0/1828263953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5088011990 con 0x7f508c06ce60 2023-11-29T11:13:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f5090868700 1 -- 172.21.15.81:0/1828263953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088011d40 con 0x7f508c06ce60 2023-11-29T11:13:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 -- 172.21.15.81:0/1828263953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c06ce60 msgr2=0x7f508c0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 --2- 172.21.15.81:0/1828263953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c06ce60 0x7f508c0d31b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5088009910 tx=0x7f5088009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 -- 172.21.15.81:0/1828263953 shutdown_connections 2023-11-29T11:13:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 --2- 172.21.15.81:0/1828263953 >> v2:172.21.15.176:3300/0 conn(0x7f508c0cce60 0x7f508c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 --2- 172.21.15.81:0/1828263953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c06ce60 0x7f508c0d31b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 -- 172.21.15.81:0/1828263953 >> 172.21.15.81:0/1828263953 conn(0x7f508c0b5760 msgr2=0x7f508c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 -- 172.21.15.81:0/1828263953 shutdown_connections 2023-11-29T11:13:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.398+0000 7f509286c700 1 -- 172.21.15.81:0/1828263953 wait complete. 2023-11-29T11:13:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 Processor -- start 2023-11-29T11:13:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 -- start start 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f508c06ce60 0x7f508c1f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0cce60 0x7f508c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f508c0cf470 0x7f508c0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0c9180 con 0x7f508c0cce60 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1ef1e0 con 0x7f508c06ce60 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0b4e10 con 0x7f508c0cf470 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0cce60 0x7f508c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0cce60 0x7f508c0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34374/0 (socket says 172.21.15.81:34374) 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 -- 172.21.15.81:0/2045417068 learned_addr learned my addr 172.21.15.81:0/2045417068 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509186a700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f508c06ce60 0x7f508c1f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509206b700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f508c0cf470 0x7f508c0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 -- 172.21.15.81:0/2045417068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f508c0cf470 msgr2=0x7f508c0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f508c0cf470 0x7f508c0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 -- 172.21.15.81:0/2045417068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f508c06ce60 msgr2=0x7f508c1f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f508c06ce60 0x7f508c1f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 -- 172.21.15.81:0/2045417068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5088009570 con 0x7f508c0cce60 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f5091069700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0cce60 0x7f508c0b48d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f507c00e840 tx=0x7f507c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f50827fc700 1 -- 172.21.15.81:0/2045417068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c0095a0 con 0x7f508c0cce60 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f50827fc700 1 -- 172.21.15.81:0/2045417068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c013680 con 0x7f508c0cce60 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c06adb0 con 0x7f508c0cce60 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f50827fc700 1 -- 172.21.15.81:0/2045417068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c0139f0 con 0x7f508c0cce60 2023-11-29T11:13:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c06aad0 con 0x7f508c0cce60 2023-11-29T11:13:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c06b090 con 0x7f508c0cce60 2023-11-29T11:13:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f50827fc700 1 -- 172.21.15.81:0/2045417068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f507c019030 con 0x7f508c0cce60 2023-11-29T11:13:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.402+0000 7f50827fc700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5070064ee0 0x7f5070067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.406+0000 7f509186a700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5070064ee0 0x7f5070067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.406+0000 7f50827fc700 1 -- 172.21.15.81:0/2045417068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f507c081eb0 con 0x7f508c0cce60 2023-11-29T11:13:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.406+0000 7f509186a700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5070064ee0 0x7f5070067390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5088014040 tx=0x7f5088008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.410+0000 7f50827fc700 1 -- 172.21.15.81:0/2045417068 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f507c04fd00 con 0x7f508c0cce60 2023-11-29T11:13:36.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.566+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f508c072c20 con 0x7f508c0cce60 2023-11-29T11:13:36.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.566+0000 7f50827fc700 1 -- 172.21.15.81:0/2045417068 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f507c053320 con 0x7f508c0cce60 2023-11-29T11:13:36.572 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:36.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5070064ee0 msgr2=0x7f5070067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5070064ee0 0x7f5070067390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5088014040 tx=0x7f5088008030 comp rx=0 tx=0).stop 2023-11-29T11:13:36.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0cce60 msgr2=0x7f508c0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0cce60 0x7f508c0b48d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f507c00e840 tx=0x7f507c00eb50 comp rx=0 tx=0).stop 2023-11-29T11:13:36.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 shutdown_connections 2023-11-29T11:13:36.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5070064ee0 0x7f5070067390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f508c0cf470 0x7f508c0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0cce60 0x7f508c0b48d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 --2- 172.21.15.81:0/2045417068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f508c06ce60 0x7f508c1f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 >> 172.21.15.81:0/2045417068 conn(0x7f508c0b5760 msgr2=0x7f508c0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:36.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 shutdown_connections 2023-11-29T11:13:36.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.570+0000 7f509286c700 1 -- 172.21.15.81:0/2045417068 wait complete. 2023-11-29T11:13:36.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:36.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.702+0000 7fa5628e3700 1 Processor -- start 2023-11-29T11:13:36.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.702+0000 7fa5628e3700 1 -- start start 2023-11-29T11:13:36.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.702+0000 7fa5628e3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa55c0cc2f0 0x7fa55c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.702+0000 7fa5628e3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa55c0b2d30 0x7fa55c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.702+0000 7fa5628e3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c09c0e0 con 0x7fa55c15a3e0 2023-11-29T11:13:36.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.702+0000 7fa5628e3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0b13e0 con 0x7fa55c0cc2f0 2023-11-29T11:13:36.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.702+0000 7fa5628e3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0b16c0 con 0x7fa55c0b2d30 2023-11-29T11:13:36.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5618e1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa55c0cc2f0 0x7fa55c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5618e1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa55c0cc2f0 0x7fa55c0ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34384/0 (socket says 172.21.15.81:34384) 2023-11-29T11:13:36.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5620e2700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa55c0b2d30 0x7fa55c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5618e1700 1 -- 172.21.15.81:0/2135992001 learned_addr learned my addr 172.21.15.81:0/2135992001 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5618e1700 1 -- 172.21.15.81:0/2135992001 >> v2:172.21.15.176:3300/0 conn(0x7fa55c0b2d30 msgr2=0x7fa55c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5618e1700 1 --2- 172.21.15.81:0/2135992001 >> v2:172.21.15.176:3300/0 conn(0x7fa55c0b2d30 0x7fa55c069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5618e1700 1 -- 172.21.15.81:0/2135992001 >> v1:172.21.15.176:6789/0 conn(0x7fa55c15a3e0 legacy=0x7fa55c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5618e1700 1 -- 172.21.15.81:0/2135992001 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0b19a0 con 0x7fa55c0cc2f0 2023-11-29T11:13:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5618e1700 1 --2- 172.21.15.81:0/2135992001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0cc2f0 0x7fa55c0ac280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0adde0 tx=0x7fa550009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d0ccd69130b866 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5608df700 1 -- 172.21.15.81:0/2135992001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550011830 con 0x7fa55c0cc2f0 2023-11-29T11:13:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5608df700 1 -- 172.21.15.81:0/2135992001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550011990 con 0x7fa55c0cc2f0 2023-11-29T11:13:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5608df700 1 -- 172.21.15.81:0/2135992001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550011d20 con 0x7fa55c0cc2f0 2023-11-29T11:13:36.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 -- 172.21.15.81:0/2135992001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0cc2f0 msgr2=0x7fa55c0ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2135992001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0cc2f0 0x7fa55c0ac280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0adde0 tx=0x7fa550009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 -- 172.21.15.81:0/2135992001 shutdown_connections 2023-11-29T11:13:36.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2135992001 >> v2:172.21.15.176:3300/0 conn(0x7fa55c0b2d30 0x7fa55c069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2135992001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0cc2f0 0x7fa55c0ac280 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 -- 172.21.15.81:0/2135992001 >> 172.21.15.81:0/2135992001 conn(0x7fa55c0cae70 msgr2=0x7fa55c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:36.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 -- 172.21.15.81:0/2135992001 shutdown_connections 2023-11-29T11:13:36.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 -- 172.21.15.81:0/2135992001 wait complete. 2023-11-29T11:13:36.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.706+0000 7fa5628e3700 1 Processor -- start 2023-11-29T11:13:36.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 -- start start 2023-11-29T11:13:36.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0b2d30 0x7fa55c1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa55c15a3e0 0x7fa55c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa55c1f26c0 0x7fa55c15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c15c070 con 0x7fa55c0b2d30 2023-11-29T11:13:36.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0c98e0 con 0x7fa55c15a3e0 2023-11-29T11:13:36.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c157ce0 con 0x7fa55c1f26c0 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0b2d30 0x7fa55c1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0b2d30 0x7fa55c1577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34392/0 (socket says 172.21.15.81:34392) 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 -- 172.21.15.81:0/2717925397 learned_addr learned my addr 172.21.15.81:0/2717925397 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5620e2700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa55c1f26c0 0x7fa55c15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5610e0700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa55c15a3e0 0x7fa55c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 -- 172.21.15.81:0/2717925397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa55c1f26c0 msgr2=0x7fa55c15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa55c1f26c0 0x7fa55c15b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 -- 172.21.15.81:0/2717925397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa55c15a3e0 msgr2=0x7fa55c156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa55c15a3e0 0x7fa55c156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 -- 172.21.15.81:0/2717925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550009570 con 0x7fa55c0b2d30 2023-11-29T11:13:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5618e1700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0b2d30 0x7fa55c1577a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa55c066190 tx=0x7fa550004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa55a7fc700 1 -- 172.21.15.81:0/2717925397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5500036c0 con 0x7fa55c0b2d30 2023-11-29T11:13:36.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa55a7fc700 1 -- 172.21.15.81:0/2717925397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55001f070 con 0x7fa55c0b2d30 2023-11-29T11:13:36.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c06a180 con 0x7fa55c0b2d30 2023-11-29T11:13:36.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa55a7fc700 1 -- 172.21.15.81:0/2717925397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550003a60 con 0x7fa55c0b2d30 2023-11-29T11:13:36.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.710+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c0b1c80 con 0x7fa55c0b2d30 2023-11-29T11:13:36.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.714+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c06a310 con 0x7fa55c0b2d30 2023-11-29T11:13:36.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.714+0000 7fa55a7fc700 1 -- 172.21.15.81:0/2717925397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa55000f050 con 0x7fa55c0b2d30 2023-11-29T11:13:36.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.714+0000 7fa55a7fc700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa548064f10 0x7fa5480673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:36.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.714+0000 7fa5610e0700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa548064f10 0x7fa5480673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:36.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.714+0000 7fa55a7fc700 1 -- 172.21.15.81:0/2717925397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa550021070 con 0x7fa55c0b2d30 2023-11-29T11:13:36.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.714+0000 7fa5610e0700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa548064f10 0x7fa5480673c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa55c159540 tx=0x7fa54c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.722+0000 7fa55a7fc700 1 -- 172.21.15.81:0/2717925397 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa5500517b0 con 0x7fa55c0b2d30 2023-11-29T11:13:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa55c072500 con 0x7fa55c0b2d30 2023-11-29T11:13:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa55a7fc700 1 -- 172.21.15.81:0/2717925397 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa550015020 con 0x7fa55c0b2d30 2023-11-29T11:13:36.886 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa548064f10 msgr2=0x7fa5480673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa548064f10 0x7fa5480673c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa55c159540 tx=0x7fa54c009040 comp rx=0 tx=0).stop 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0b2d30 msgr2=0x7fa55c1577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0b2d30 0x7fa55c1577a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa55c066190 tx=0x7fa550004770 comp rx=0 tx=0).stop 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 shutdown_connections 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa548064f10 0x7fa5480673c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa55c1f26c0 0x7fa55c15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa55c15a3e0 0x7fa55c156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 --2- 172.21.15.81:0/2717925397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0b2d30 0x7fa55c1577a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:36.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 >> 172.21.15.81:0/2717925397 conn(0x7fa55c0cae70 msgr2=0x7fa55c06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:36.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 shutdown_connections 2023-11-29T11:13:36.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:36.882+0000 7fa5628e3700 1 -- 172.21.15.81:0/2717925397 wait complete. 2023-11-29T11:13:36.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbeda339700 1 Processor -- start 2023-11-29T11:13:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbeda339700 1 -- start start 2023-11-29T11:13:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbeda339700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed415a140 0x7fbed406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbeda339700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40b1970 0x7fbed40caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbeda339700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed406cce0 con 0x7fbed415e5e0 2023-11-29T11:13:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbeda339700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed415a510 con 0x7fbed415a140 2023-11-29T11:13:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbeda339700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed406cfc0 con 0x7fbed40b1970 2023-11-29T11:13:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbed3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed415a140 0x7fbed406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbed3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed415a140 0x7fbed406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34408/0 (socket says 172.21.15.81:34408) 2023-11-29T11:13:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbed37fe700 1 --1- 172.21.15.81:0/578460687 >> v1:172.21.15.176:6789/0 conn(0x7fbed415e5e0 0x7fbed40b1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:57968/0 (socket says 172.21.15.81:57968) 2023-11-29T11:13:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbed3fff700 1 -- 172.21.15.81:0/578460687 learned_addr learned my addr 172.21.15.81:0/578460687 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.006+0000 7fbed88d6700 1 --2- 172.21.15.81:0/578460687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40b1970 0x7fbed40caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed2ffd700 1 -- 172.21.15.81:0/578460687 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433185862 0 0) 0x7fbed406cce0 con 0x7fbed415e5e0 2023-11-29T11:13:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed2ffd700 1 -- 172.21.15.81:0/578460687 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbebc0035d0 con 0x7fbed415e5e0 2023-11-29T11:13:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed3fff700 1 -- 172.21.15.81:0/578460687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40b1970 msgr2=0x7fbed40caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed3fff700 1 --2- 172.21.15.81:0/578460687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40b1970 0x7fbed40caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed3fff700 1 -- 172.21.15.81:0/578460687 >> v1:172.21.15.176:6789/0 conn(0x7fbed415e5e0 legacy=0x7fbed40b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed3fff700 1 -- 172.21.15.81:0/578460687 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed40ca560 con 0x7fbed415a140 2023-11-29T11:13:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed88d6700 1 --2- 172.21.15.81:0/578460687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40b1970 0x7fbed40caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed3fff700 1 --2- 172.21.15.81:0/578460687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed415a140 0x7fbed406aee0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009910 tx=0x7fbec8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56f79a9dd7d9e61 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed2ffd700 1 -- 172.21.15.81:0/578460687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8011830 con 0x7fbed415a140 2023-11-29T11:13:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed2ffd700 1 -- 172.21.15.81:0/578460687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8011990 con 0x7fbed415a140 2023-11-29T11:13:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbed2ffd700 1 -- 172.21.15.81:0/578460687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8011d40 con 0x7fbed415a140 2023-11-29T11:13:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbeda339700 1 -- 172.21.15.81:0/578460687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed415a140 msgr2=0x7fbed406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbeda339700 1 --2- 172.21.15.81:0/578460687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed415a140 0x7fbed406aee0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009910 tx=0x7fbec8009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbeda339700 1 -- 172.21.15.81:0/578460687 shutdown_connections 2023-11-29T11:13:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbeda339700 1 --2- 172.21.15.81:0/578460687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed40b1970 0x7fbed40caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbeda339700 1 --2- 172.21.15.81:0/578460687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed415a140 0x7fbed406aee0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbeda339700 1 -- 172.21.15.81:0/578460687 >> 172.21.15.81:0/578460687 conn(0x7fbed40cc260 msgr2=0x7fbed40cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbeda339700 1 -- 172.21.15.81:0/578460687 shutdown_connections 2023-11-29T11:13:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.010+0000 7fbeda339700 1 -- 172.21.15.81:0/578460687 wait complete. 2023-11-29T11:13:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbeda339700 1 Processor -- start 2023-11-29T11:13:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbeda339700 1 -- start start 2023-11-29T11:13:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbeda339700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed40b1970 0x7fbed4153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbeda339700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415a140 0x7fbed40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbeda339700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415e5e0 0x7fbed40b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbeda339700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40c8950 con 0x7fbed40b1970 2023-11-29T11:13:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbeda339700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40c7a30 con 0x7fbed415e5e0 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbeda339700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40c7cd0 con 0x7fbed415a140 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed40b1970 0x7fbed4153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed40b1970 0x7fbed4153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34422/0 (socket says 172.21.15.81:34422) 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed3fff700 1 -- 172.21.15.81:0/3944633560 learned_addr learned my addr 172.21.15.81:0/3944633560 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed88d6700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415e5e0 0x7fbed40b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed37fe700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415a140 0x7fbed40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed3fff700 1 -- 172.21.15.81:0/3944633560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415a140 msgr2=0x7fbed40b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed3fff700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415a140 0x7fbed40b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed3fff700 1 -- 172.21.15.81:0/3944633560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415e5e0 msgr2=0x7fbed40b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed3fff700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415e5e0 0x7fbed40b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.014+0000 7fbed3fff700 1 -- 172.21.15.81:0/3944633560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0094b0 con 0x7fbed40b1970 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbed3fff700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed40b1970 0x7fbed4153a90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbec8000c00 tx=0x7fbec8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbed0ff9700 1 -- 172.21.15.81:0/3944633560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8004590 con 0x7fbed40b1970 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbed0ff9700 1 -- 172.21.15.81:0/3944633560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec80036c0 con 0x7fbed40b1970 2023-11-29T11:13:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec8009570 con 0x7fbed40b1970 2023-11-29T11:13:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbed0ff9700 1 -- 172.21.15.81:0/3944633560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8003a70 con 0x7fbed40b1970 2023-11-29T11:13:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed415ea30 con 0x7fbed40b1970 2023-11-29T11:13:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed406c990 con 0x7fbed40b1970 2023-11-29T11:13:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbed0ff9700 1 -- 172.21.15.81:0/3944633560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbec800f050 con 0x7fbed40b1970 2023-11-29T11:13:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbed0ff9700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbec0064ee0 0x7fbec0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.018+0000 7fbed0ff9700 1 -- 172.21.15.81:0/3944633560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbec8021030 con 0x7fbed40b1970 2023-11-29T11:13:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.022+0000 7fbed37fe700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbec0064ee0 0x7fbec0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.022+0000 7fbed37fe700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbec0064ee0 0x7fbec0067390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbed41f3e20 tx=0x7fbec40018d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.026+0000 7fbed0ff9700 1 -- 172.21.15.81:0/3944633560 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbec8051430 con 0x7fbed40b1970 2023-11-29T11:13:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.182+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbed40cafc0 con 0x7fbed40b1970 2023-11-29T11:13:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.182+0000 7fbed0ff9700 1 -- 172.21.15.81:0/3944633560 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbec8015020 con 0x7fbed40b1970 2023-11-29T11:13:37.188 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbec0064ee0 msgr2=0x7fbec0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbec0064ee0 0x7fbec0067390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbed41f3e20 tx=0x7fbec40018d0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed40b1970 msgr2=0x7fbed4153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed40b1970 0x7fbed4153a90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbec8000c00 tx=0x7fbec8004770 comp rx=0 tx=0).stop 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 shutdown_connections 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbec0064ee0 0x7fbec0067390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed415e5e0 0x7fbed40b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed415a140 0x7fbed40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 --2- 172.21.15.81:0/3944633560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed40b1970 0x7fbed4153a90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 >> 172.21.15.81:0/3944633560 conn(0x7fbed40cc260 msgr2=0x7fbed40af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 shutdown_connections 2023-11-29T11:13:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.186+0000 7fbeda339700 1 -- 172.21.15.81:0/3944633560 wait complete. 2023-11-29T11:13:37.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce5fe0700 1 Processor -- start 2023-11-29T11:13:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce5fe0700 1 -- start start 2023-11-29T11:13:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce5fe0700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcce00c13c0 0x7fcce00c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce5fe0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce01642e0 0x7fcce0164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce5fe0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce0160c50 con 0x7fcce0160880 2023-11-29T11:13:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce5fe0700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce00c1d80 con 0x7fcce00c13c0 2023-11-29T11:13:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce5fe0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00b3050 con 0x7fcce01642e0 2023-11-29T11:13:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce4fde700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcce0160880 0x7fcce006aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41156/0 (socket says 172.21.15.81:41156) 2023-11-29T11:13:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce4fde700 1 -- 172.21.15.81:0/3916049165 learned_addr learned my addr 172.21.15.81:0/3916049165 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdffff700 1 --2- 172.21.15.81:0/3916049165 >> v2:172.21.15.176:3300/0 conn(0x7fcce00c13c0 0x7fcce00c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124777855 0 0) 0x7fcce0160c50 con 0x7fcce0160880 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcccc0035d0 con 0x7fcce0160880 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce57df700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce01642e0 0x7fcce0164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56331293 0 0) 0x7fcccc0035d0 con 0x7fcce0160880 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce01642e0 msgr2=0x7fcce0164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce01642e0 0x7fcce0164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 >> v2:172.21.15.176:3300/0 conn(0x7fcce00c13c0 msgr2=0x7fcce00c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 --2- 172.21.15.81:0/3916049165 >> v2:172.21.15.176:3300/0 conn(0x7fcce00c13c0 0x7fcce00c1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce006b630 con 0x7fcce0160880 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fccd0001670 con 0x7fcce0160880 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 >> v1:172.21.15.81:6789/0 conn(0x7fcce0160880 legacy=0x7fcce006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce01642e0 0x7fcccc003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc003fa0 0x7fcccc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcccc004db0 0x7fcccc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00c1d80 con 0x7fcccc004db0 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00b3050 con 0x7fcccc003fa0 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc00ba30 con 0x7fcce01642e0 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce57df700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcccc004db0 0x7fcccc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce4fde700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce01642e0 0x7fcccc003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdffff700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc003fa0 0x7fcccc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce57df700 1 -- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce01642e0 msgr2=0x7fcccc003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce57df700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce01642e0 0x7fcccc003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce57df700 1 -- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc003fa0 msgr2=0x7fcccc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce57df700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc003fa0 0x7fcccc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce57df700 1 -- 172.21.15.81:0/3916049165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc0035d0 con 0x7fcccc004db0 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fccdffff700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc003fa0 0x7fcccc004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.322+0000 7fcce57df700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcccc004db0 0x7fcccc005220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009b70 tx=0x7fcccc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acb87f6a56a789a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800e6c0 con 0x7fcccc004db0 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc800e820 con 0x7fcccc004db0 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fccdf7fe700 1 -- 172.21.15.81:0/3916049165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800eb90 con 0x7fcccc004db0 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- 172.21.15.81:0/3916049165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcccc004db0 msgr2=0x7fcccc005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 --2- 172.21.15.81:0/3916049165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcccc004db0 0x7fcccc005220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009b70 tx=0x7fcccc0058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce57df700 1 -- 172.21.15.81:0/3916049165 reap_dead start 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- 172.21.15.81:0/3916049165 shutdown_connections 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- 172.21.15.81:0/3916049165 >> 172.21.15.81:0/3916049165 conn(0x7fcce00cae70 msgr2=0x7fcce00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:37.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- 172.21.15.81:0/3916049165 shutdown_connections 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- 172.21.15.81:0/3916049165 wait complete. 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 Processor -- start 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- start start 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc004db0 0x7fcce015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b1900 0x7fcce00b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00af120 0x7fcce00af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00b22b0 con 0x7fcce00af120 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce015e0e0 con 0x7fcccc004db0 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce5fe0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00afeb0 con 0x7fcce00b1900 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce57df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00af120 0x7fcce00af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce4fde700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc004db0 0x7fcce015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce57df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00af120 0x7fcce00af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34452/0 (socket says 172.21.15.81:34452) 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fccdffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b1900 0x7fcce00b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.326+0000 7fcce57df700 1 -- 172.21.15.81:0/1160081818 learned_addr learned my addr 172.21.15.81:0/1160081818 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce57df700 1 -- 172.21.15.81:0/1160081818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b1900 msgr2=0x7fcce00b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce57df700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b1900 0x7fcce00b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce57df700 1 -- 172.21.15.81:0/1160081818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc004db0 msgr2=0x7fcce015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce57df700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc004db0 0x7fcce015dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce57df700 1 -- 172.21.15.81:0/1160081818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0069fc0 con 0x7fcce00af120 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fccdffff700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b1900 0x7fcce00b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce4fde700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc004db0 0x7fcce015dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce57df700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00af120 0x7fcce00af5c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0046f0 tx=0x7fccc80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fccdd7fa700 1 -- 172.21.15.81:0/1160081818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800e6c0 con 0x7fcce00af120 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fccdd7fa700 1 -- 172.21.15.81:0/1160081818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc80044a0 con 0x7fcce00af120 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0069ce0 con 0x7fcce00af120 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fccdd7fa700 1 -- 172.21.15.81:0/1160081818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8004610 con 0x7fcce00af120 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce006a2a0 con 0x7fcce00af120 2023-11-29T11:13:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0072500 con 0x7fcce00af120 2023-11-29T11:13:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.330+0000 7fccdd7fa700 1 -- 172.21.15.81:0/1160081818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fccc802c070 con 0x7fcce00af120 2023-11-29T11:13:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.334+0000 7fccdd7fa700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fccc0064f10 0x7fccc00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.334+0000 7fccdd7fa700 1 -- 172.21.15.81:0/1160081818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fccc8000e40 con 0x7fcce00af120 2023-11-29T11:13:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.334+0000 7fcce4fde700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fccc0064f10 0x7fccc00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.334+0000 7fcce4fde700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fccc0064f10 0x7fccc00673c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fccd00017a0 tx=0x7fccd00079a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.338+0000 7fccdd7fa700 1 -- 172.21.15.81:0/1160081818 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fccc8050e50 con 0x7fcce00af120 2023-11-29T11:13:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcce00ce1d0 con 0x7fcce00af120 2023-11-29T11:13:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fccdd7fa700 1 -- 172.21.15.81:0/1160081818 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fccc8054470 con 0x7fcce00af120 2023-11-29T11:13:37.502 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fccc0064f10 msgr2=0x7fccc00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fccc0064f10 0x7fccc00673c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fccd00017a0 tx=0x7fccd00079a0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00af120 msgr2=0x7fcce00af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00af120 0x7fcce00af5c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0046f0 tx=0x7fccc80047e0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 shutdown_connections 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fccc0064f10 0x7fccc00673c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00af120 0x7fcce00af5c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcce00b1900 0x7fcce00b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 --2- 172.21.15.81:0/1160081818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc004db0 0x7fcce015dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 >> 172.21.15.81:0/1160081818 conn(0x7fcce00cae70 msgr2=0x7fcce015f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 shutdown_connections 2023-11-29T11:13:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.498+0000 7fcce5fe0700 1 -- 172.21.15.81:0/1160081818 wait complete. 2023-11-29T11:13:37.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.634+0000 7f54a0dd4700 1 Processor -- start 2023-11-29T11:13:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.634+0000 7f54a0dd4700 1 -- start start 2023-11-29T11:13:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.634+0000 7f54a0dd4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.634+0000 7f54a0dd4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f549c0cf0e0 0x7f549c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.634+0000 7f54a0dd4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c0cfa80 con 0x7f549c0b1ae0 2023-11-29T11:13:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.634+0000 7f54a0dd4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549c0d0ab0 con 0x7f549c0cf0e0 2023-11-29T11:13:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.634+0000 7f54a0dd4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c06a9c0 con 0x7f549c06a4c0 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f549c0cf0e0 0x7f549c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549affd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f549c0cf0e0 0x7f549c0cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34462/0 (socket says 172.21.15.81:34462) 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549bfff700 1 -- 172.21.15.81:0/1106689804 learned_addr learned my addr 172.21.15.81:0/1106689804 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549b7fe700 1 --1- 172.21.15.81:0/1106689804 >> v1:172.21.15.176:6789/0 conn(0x7f549c0b1ae0 0x7f549c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:57982/0 (socket says 172.21.15.81:57982) 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549affd700 1 -- 172.21.15.81:0/1106689804 >> v2:172.21.15.81:3300/0 conn(0x7f549c0cf0e0 msgr2=0x7f549c0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549affd700 1 --2- 172.21.15.81:0/1106689804 >> v2:172.21.15.81:3300/0 conn(0x7f549c0cf0e0 0x7f549c0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549a7fc700 1 -- 172.21.15.81:0/1106689804 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890686921 0 0) 0x7f549c0cfa80 con 0x7f549c0b1ae0 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549affd700 1 -- 172.21.15.81:0/1106689804 >> v1:172.21.15.176:6789/0 conn(0x7f549c0b1ae0 legacy=0x7f549c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549affd700 1 -- 172.21.15.81:0/1106689804 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c06aca0 con 0x7f549c06a4c0 2023-11-29T11:13:37.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549bfff700 1 --2- 172.21.15.81:0/1106689804 >> v2:172.21.15.81:3300/0 conn(0x7f549c0cf0e0 0x7f549c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549affd700 1 --2- 172.21.15.81:0/1106689804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c06d8e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5490009850 tx=0x7f5490009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a657c7c900a0e37 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549a7fc700 1 -- 172.21.15.81:0/1106689804 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490011830 con 0x7f549c06a4c0 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549a7fc700 1 -- 172.21.15.81:0/1106689804 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490011990 con 0x7f549c06a4c0 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f549a7fc700 1 -- 172.21.15.81:0/1106689804 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490011d40 con 0x7f549c06a4c0 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f54a0dd4700 1 -- 172.21.15.81:0/1106689804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 msgr2=0x7f549c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/1106689804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c06d8e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5490009850 tx=0x7f5490009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f54a0dd4700 1 -- 172.21.15.81:0/1106689804 shutdown_connections 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/1106689804 >> v2:172.21.15.81:3300/0 conn(0x7f549c0cf0e0 0x7f549c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/1106689804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c06d8e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f54a0dd4700 1 -- 172.21.15.81:0/1106689804 >> 172.21.15.81:0/1106689804 conn(0x7f549c09bbd0 msgr2=0x7f549c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f54a0dd4700 1 -- 172.21.15.81:0/1106689804 shutdown_connections 2023-11-29T11:13:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.638+0000 7f54a0dd4700 1 -- 172.21.15.81:0/1106689804 wait complete. 2023-11-29T11:13:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 Processor -- start 2023-11-29T11:13:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 -- start start 2023-11-29T11:13:37.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c0c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f549c0b1ae0 0x7f549c147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549c0cf0e0 0x7f549c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0b2950 con 0x7f549c0cf0e0 2023-11-29T11:13:37.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0b2c30 con 0x7f549c0b1ae0 2023-11-29T11:13:37.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0b2f10 con 0x7f549c06a4c0 2023-11-29T11:13:37.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549c0cf0e0 0x7f549c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549c0cf0e0 0x7f549c0b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34474/0 (socket says 172.21.15.81:34474) 2023-11-29T11:13:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549bfff700 1 -- 172.21.15.81:0/307845147 learned_addr learned my addr 172.21.15.81:0/307845147 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549affd700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f549c0b1ae0 0x7f549c147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549b7fe700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c0c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549affd700 1 -- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 msgr2=0x7f549c0c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549affd700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c0c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549affd700 1 -- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549c0cf0e0 msgr2=0x7f549c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549affd700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549c0cf0e0 0x7f549c0b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549affd700 1 -- 172.21.15.81:0/307845147 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494009b30 con 0x7f549c0b1ae0 2023-11-29T11:13:37.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f549affd700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f549c0b1ae0 0x7f549c147990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5490016000 tx=0x7f5490004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f5483fff700 1 -- 172.21.15.81:0/307845147 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490019940 con 0x7f549c0b1ae0 2023-11-29T11:13:37.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f5483fff700 1 -- 172.21.15.81:0/307845147 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549001e070 con 0x7f549c0b1ae0 2023-11-29T11:13:37.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54900094b0 con 0x7f549c0b1ae0 2023-11-29T11:13:37.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f5483fff700 1 -- 172.21.15.81:0/307845147 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490019d20 con 0x7f549c0b1ae0 2023-11-29T11:13:37.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.642+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c0b4380 con 0x7f549c0b1ae0 2023-11-29T11:13:37.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.646+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549c06af80 con 0x7f549c0b1ae0 2023-11-29T11:13:37.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.646+0000 7f5483fff700 1 -- 172.21.15.81:0/307845147 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f549000f050 con 0x7f549c0b1ae0 2023-11-29T11:13:37.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.646+0000 7f5483fff700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5488064ee0 0x7f5488067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.646+0000 7f5483fff700 1 -- 172.21.15.81:0/307845147 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54900831b0 con 0x7f549c0b1ae0 2023-11-29T11:13:37.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.646+0000 7f549b7fe700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5488064ee0 0x7f5488067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.646+0000 7f549b7fe700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5488064ee0 0x7f5488067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f548c000f60 tx=0x7f548c007e00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.658+0000 7f5483fff700 1 -- 172.21.15.81:0/307845147 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5490051080 con 0x7f549c0b1ae0 2023-11-29T11:13:37.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.814+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f549c0b1eb0 con 0x7f549c0b1ae0 2023-11-29T11:13:37.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f5483fff700 1 -- 172.21.15.81:0/307845147 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5490006ce0 con 0x7f549c0b1ae0 2023-11-29T11:13:37.822 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5488064ee0 msgr2=0x7f5488067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5488064ee0 0x7f5488067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f548c000f60 tx=0x7f548c007e00 comp rx=0 tx=0).stop 2023-11-29T11:13:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f549c0b1ae0 msgr2=0x7f549c147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f549c0b1ae0 0x7f549c147990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5490016000 tx=0x7f5490004770 comp rx=0 tx=0).stop 2023-11-29T11:13:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 shutdown_connections 2023-11-29T11:13:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5488064ee0 0x7f5488067390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f549c0cf0e0 0x7f549c0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f549c0b1ae0 0x7f549c147990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 --2- 172.21.15.81:0/307845147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f549c06a4c0 0x7f549c0c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 >> 172.21.15.81:0/307845147 conn(0x7f549c09bbd0 msgr2=0x7f549c15bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 shutdown_connections 2023-11-29T11:13:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.818+0000 7f54a0dd4700 1 -- 172.21.15.81:0/307845147 wait complete. 2023-11-29T11:13:37.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:37.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 Processor -- start 2023-11-29T11:13:37.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- start start 2023-11-29T11:13:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88800c1ac0 0x7f8880069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88800ceef0 0x7f888006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88800cae70 con 0x7f88801606b0 2023-11-29T11:13:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88800cbc10 con 0x7f88800c1ac0 2023-11-29T11:13:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88800cb130 con 0x7f88800ceef0 2023-11-29T11:13:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88800c1ac0 0x7f8880069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88800c1ac0 0x7f8880069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34484/0 (socket says 172.21.15.81:34484) 2023-11-29T11:13:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887f7fe700 1 -- 172.21.15.81:0/621767916 learned_addr learned my addr 172.21.15.81:0/621767916 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88848f3700 1 --2- 172.21.15.81:0/621767916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88800ceef0 0x7f888006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887f7fe700 1 -- 172.21.15.81:0/621767916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88800ceef0 msgr2=0x7f888006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887f7fe700 1 --2- 172.21.15.81:0/621767916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88800ceef0 0x7f888006a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887f7fe700 1 -- 172.21.15.81:0/621767916 >> v1:172.21.15.176:6789/0 conn(0x7f88801606b0 legacy=0x7f88800c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887f7fe700 1 -- 172.21.15.81:0/621767916 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800cb410 con 0x7f88800c1ac0 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887f7fe700 1 --2- 172.21.15.81:0/621767916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880069c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8878009e50 tx=0x7f887800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cce3288578b167 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887effd700 1 -- 172.21.15.81:0/621767916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800e070 con 0x7f88800c1ac0 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887effd700 1 -- 172.21.15.81:0/621767916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800b9c0 con 0x7f88800c1ac0 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f887effd700 1 -- 172.21.15.81:0/621767916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800bd70 con 0x7f88800c1ac0 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- 172.21.15.81:0/621767916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 msgr2=0x7f8880069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 --2- 172.21.15.81:0/621767916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880069c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8878009e50 tx=0x7f887800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- 172.21.15.81:0/621767916 shutdown_connections 2023-11-29T11:13:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 --2- 172.21.15.81:0/621767916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88800ceef0 0x7f888006a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 --2- 172.21.15.81:0/621767916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880069c40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- 172.21.15.81:0/621767916 >> 172.21.15.81:0/621767916 conn(0x7f88800ce3e0 msgr2=0x7f88800ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- 172.21.15.81:0/621767916 shutdown_connections 2023-11-29T11:13:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.946+0000 7f88850f4700 1 -- 172.21.15.81:0/621767916 wait complete. 2023-11-29T11:13:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 Processor -- start 2023-11-29T11:13:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 -- start start 2023-11-29T11:13:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88800ceef0 0x7f88801f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88801606b0 0x7f88800c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888015f090 con 0x7f88800c1ac0 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888015ecf0 con 0x7f88800ceef0 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88801f5bd0 con 0x7f88801606b0 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34500/0 (socket says 172.21.15.81:34500) 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 -- 172.21.15.81:0/3600997586 learned_addr learned my addr 172.21.15.81:0/3600997586 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887f7fe700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88800ceef0 0x7f88801f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88848f3700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88801606b0 0x7f88800c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 -- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88801606b0 msgr2=0x7f88800c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88801606b0 0x7f88800c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 -- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88800ceef0 msgr2=0x7f88801f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88800ceef0 0x7f88801f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 -- 172.21.15.81:0/3600997586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878009b30 con 0x7f88800c1ac0 2023-11-29T11:13:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887f7fe700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88800ceef0 0x7f88801f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887ffff700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880160a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f887000c410 tx=0x7f887000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887cff9700 1 -- 172.21.15.81:0/3600997586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700052d0 con 0x7f88800c1ac0 2023-11-29T11:13:37.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887cff9700 1 -- 172.21.15.81:0/3600997586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8870005430 con 0x7f88800c1ac0 2023-11-29T11:13:37.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88800b36c0 con 0x7f88800c1ac0 2023-11-29T11:13:37.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f887cff9700 1 -- 172.21.15.81:0/3600997586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700055a0 con 0x7f88800c1ac0 2023-11-29T11:13:37.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.950+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88800cb6f0 con 0x7f88800c1ac0 2023-11-29T11:13:37.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.954+0000 7f887cff9700 1 -- 172.21.15.81:0/3600997586 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8870010050 con 0x7f88800c1ac0 2023-11-29T11:13:37.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.954+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88800ad610 con 0x7f88800c1ac0 2023-11-29T11:13:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.954+0000 7f887cff9700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8860064ee0 0x7f8860067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.954+0000 7f887cff9700 1 -- 172.21.15.81:0/3600997586 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8870081160 con 0x7f88800c1ac0 2023-11-29T11:13:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.954+0000 7f887f7fe700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8860064ee0 0x7f8860067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.954+0000 7f887f7fe700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8860064ee0 0x7f8860067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f88800c1eb0 tx=0x7f8878009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:37.958+0000 7f887cff9700 1 -- 172.21.15.81:0/3600997586 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8870049400 con 0x7f88800c1ac0 2023-11-29T11:13:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.122+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f888015f1d0 con 0x7f88800c1ac0 2023-11-29T11:13:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.126+0000 7f887cff9700 1 -- 172.21.15.81:0/3600997586 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f888015f1d0 con 0x7f88800c1ac0 2023-11-29T11:13:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:38.131 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.126+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8860064ee0 msgr2=0x7f8860067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.126+0000 7f88850f4700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8860064ee0 0x7f8860067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f88800c1eb0 tx=0x7f8878009000 comp rx=0 tx=0).stop 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.126+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 msgr2=0x7f8880160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.126+0000 7f88850f4700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880160a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f887000c410 tx=0x7f887000c720 comp rx=0 tx=0).stop 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.130+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 shutdown_connections 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.130+0000 7f88850f4700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8860064ee0 0x7f8860067390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.130+0000 7f88850f4700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88801606b0 0x7f88800c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.130+0000 7f88850f4700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88800ceef0 0x7f88801f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.130+0000 7f88850f4700 1 --2- 172.21.15.81:0/3600997586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88800c1ac0 0x7f8880160a80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.130+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 >> 172.21.15.81:0/3600997586 conn(0x7f88800ce3e0 msgr2=0x7f8880071120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.130+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 shutdown_connections 2023-11-29T11:13:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.130+0000 7f88850f4700 1 -- 172.21.15.81:0/3600997586 wait complete. 2023-11-29T11:13:38.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:38.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12c1950700 1 Processor -- start 2023-11-29T11:13:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12c1950700 1 -- start start 2023-11-29T11:13:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12c1950700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12bc15a360 0x7f12bc0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12c1950700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12bc0d01c0 0x7f12bc0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12c1950700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15dcf0 0x7f12bc15e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12c1950700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0cc890 con 0x7f12bc15a360 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12c1950700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc15e670 con 0x7f12bc0d01c0 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12c1950700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0d0680 con 0x7f12bc15dcf0 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12bc15a360 0x7f12bc0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12bc15a360 0x7f12bc0caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34512/0 (socket says 172.21.15.81:34512) 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 -- 172.21.15.81:0/1910445762 learned_addr learned my addr 172.21.15.81:0/1910445762 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12ba7fc700 1 --2- 172.21.15.81:0/1910445762 >> v2:172.21.15.176:3300/0 conn(0x7f12bc0d01c0 0x7f12bc0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12bb7fe700 1 --2- 172.21.15.81:0/1910445762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15dcf0 0x7f12bc15e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 -- 172.21.15.81:0/1910445762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15dcf0 msgr2=0x7f12bc15e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 --2- 172.21.15.81:0/1910445762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15dcf0 0x7f12bc15e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 -- 172.21.15.81:0/1910445762 >> v2:172.21.15.176:3300/0 conn(0x7f12bc0d01c0 msgr2=0x7f12bc0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 --2- 172.21.15.81:0/1910445762 >> v2:172.21.15.176:3300/0 conn(0x7f12bc0d01c0 0x7f12bc0ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 -- 172.21.15.81:0/1910445762 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0ccaa0 con 0x7f12bc15a360 2023-11-29T11:13:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12baffd700 1 --2- 172.21.15.81:0/1910445762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15a360 0x7f12bc0caec0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f12bc067600 tx=0x7f12ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557a637956494be6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12b9ffb700 1 -- 172.21.15.81:0/1910445762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac011830 con 0x7f12bc15a360 2023-11-29T11:13:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12b9ffb700 1 -- 172.21.15.81:0/1910445762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac011990 con 0x7f12bc15a360 2023-11-29T11:13:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.266+0000 7f12b9ffb700 1 -- 172.21.15.81:0/1910445762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac011d20 con 0x7f12bc15a360 2023-11-29T11:13:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- 172.21.15.81:0/1910445762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15a360 msgr2=0x7f12bc0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 --2- 172.21.15.81:0/1910445762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15a360 0x7f12bc0caec0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f12bc067600 tx=0x7f12ac009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- 172.21.15.81:0/1910445762 shutdown_connections 2023-11-29T11:13:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 --2- 172.21.15.81:0/1910445762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15dcf0 0x7f12bc15e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 --2- 172.21.15.81:0/1910445762 >> v2:172.21.15.176:3300/0 conn(0x7f12bc0d01c0 0x7f12bc0ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 --2- 172.21.15.81:0/1910445762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15a360 0x7f12bc0caec0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- 172.21.15.81:0/1910445762 >> 172.21.15.81:0/1910445762 conn(0x7f12bc0cdf80 msgr2=0x7f12bc0d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- 172.21.15.81:0/1910445762 shutdown_connections 2023-11-29T11:13:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- 172.21.15.81:0/1910445762 wait complete. 2023-11-29T11:13:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 Processor -- start 2023-11-29T11:13:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- start start 2023-11-29T11:13:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12bc0d01c0 0x7f12bc155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15a360 0x7f12bc0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15dcf0 0x7f12bc0c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc156210 con 0x7f12bc15dcf0 2023-11-29T11:13:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0c43a0 con 0x7f12bc0d01c0 2023-11-29T11:13:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12c1950700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0ada40 con 0x7f12bc15a360 2023-11-29T11:13:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15dcf0 0x7f12bc0c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12ba7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15a360 0x7f12bc0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15dcf0 0x7f12bc0c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34518/0 (socket says 172.21.15.81:34518) 2023-11-29T11:13:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12bb7fe700 1 -- 172.21.15.81:0/2572827014 learned_addr learned my addr 172.21.15.81:0/2572827014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.270+0000 7f12baffd700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12bc0d01c0 0x7f12bc155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12ba7fc700 1 -- 172.21.15.81:0/2572827014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12bc0d01c0 msgr2=0x7f12bc155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12ba7fc700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12bc0d01c0 0x7f12bc155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12ba7fc700 1 -- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15dcf0 msgr2=0x7f12bc0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12ba7fc700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15dcf0 0x7f12bc0c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12ba7fc700 1 -- 172.21.15.81:0/2572827014 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac009570 con 0x7f12bc15a360 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12bb7fe700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15dcf0 0x7f12bc0c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12ba7fc700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15a360 0x7f12bc0c6620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12a400e870 tx=0x7f12a400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12b3fff700 1 -- 172.21.15.81:0/2572827014 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4013680 con 0x7f12bc15a360 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc0ccd40 con 0x7f12bc15a360 2023-11-29T11:13:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc0cb400 con 0x7f12bc15a360 2023-11-29T11:13:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12b3fff700 1 -- 172.21.15.81:0/2572827014 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40137e0 con 0x7f12bc15a360 2023-11-29T11:13:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12b3fff700 1 -- 172.21.15.81:0/2572827014 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4013b50 con 0x7f12bc15a360 2023-11-29T11:13:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc0cd020 con 0x7f12bc15a360 2023-11-29T11:13:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.274+0000 7f12b3fff700 1 -- 172.21.15.81:0/2572827014 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f12a4019030 con 0x7f12bc15a360 2023-11-29T11:13:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.278+0000 7f12b3fff700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f129c064ee0 0x7f129c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.278+0000 7f12b3fff700 1 -- 172.21.15.81:0/2572827014 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12a40824b0 con 0x7f12bc15a360 2023-11-29T11:13:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.278+0000 7f12baffd700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f129c064ee0 0x7f129c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.278+0000 7f12baffd700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f129c064ee0 0x7f129c067390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12ac000c00 tx=0x7f12ac008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.286+0000 7f12b3fff700 1 -- 172.21.15.81:0/2572827014 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f12a4050280 con 0x7f12bc15a360 2023-11-29T11:13:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.446+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12bc072500 con 0x7f12bc15a360 2023-11-29T11:13:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12b3fff700 1 -- 172.21.15.81:0/2572827014 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12a40538a0 con 0x7f12bc15a360 2023-11-29T11:13:38.453 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:38.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f129c064ee0 msgr2=0x7f129c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f129c064ee0 0x7f129c067390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12ac000c00 tx=0x7f12ac008030 comp rx=0 tx=0).stop 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15a360 msgr2=0x7f12bc0c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15a360 0x7f12bc0c6620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12a400e870 tx=0x7f12a400eb80 comp rx=0 tx=0).stop 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 shutdown_connections 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f129c064ee0 0x7f129c067390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc15dcf0 0x7f12bc0c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12bc15a360 0x7f12bc0c6620 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 --2- 172.21.15.81:0/2572827014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12bc0d01c0 0x7f12bc155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 >> 172.21.15.81:0/2572827014 conn(0x7f12bc0cdf80 msgr2=0x7f12bc06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 shutdown_connections 2023-11-29T11:13:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.450+0000 7f12c1950700 1 -- 172.21.15.81:0/2572827014 wait complete. 2023-11-29T11:13:38.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05f59e700 1 Processor -- start 2023-11-29T11:13:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05f59e700 1 -- start start 2023-11-29T11:13:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa0600b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa0600cf110 0x7fa0600cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05f59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600d0460 con 0x7fa06006ce60 2023-11-29T11:13:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600d3390 con 0x7fa0600cf110 2023-11-29T11:13:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600d2380 con 0x7fa0600d1e30 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa057fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa0600b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05ed9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa0600cf110 0x7fa0600cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa057fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa0600b8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:50872/0 (socket says 172.21.15.81:50872) 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa057fff700 1 -- 172.21.15.81:0/1167210077 learned_addr learned my addr 172.21.15.81:0/1167210077 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05e59c700 1 --1- 172.21.15.81:0/1167210077 >> v1:172.21.15.176:6789/0 conn(0x7fa06006ce60 0x7fa06006d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:58000/0 (socket says 172.21.15.81:58000) 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa057fff700 1 -- 172.21.15.81:0/1167210077 >> v2:172.21.15.176:3300/0 conn(0x7fa0600cf110 msgr2=0x7fa0600cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa057fff700 1 --2- 172.21.15.81:0/1167210077 >> v2:172.21.15.176:3300/0 conn(0x7fa0600cf110 0x7fa0600cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa057fff700 1 -- 172.21.15.81:0/1167210077 >> v1:172.21.15.176:6789/0 conn(0x7fa06006ce60 legacy=0x7fa06006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa057fff700 1 -- 172.21.15.81:0/1167210077 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600d2f00 con 0x7fa0600d1e30 2023-11-29T11:13:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa057fff700 1 --2- 172.21.15.81:0/1167210077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa0600b8240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa048009910 tx=0x7fa048009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fd678a213ba7932 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05dd9b700 1 -- 172.21.15.81:0/1167210077 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048011830 con 0x7fa0600d1e30 2023-11-29T11:13:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05dd9b700 1 -- 172.21.15.81:0/1167210077 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048011990 con 0x7fa0600d1e30 2023-11-29T11:13:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.582+0000 7fa05dd9b700 1 -- 172.21.15.81:0/1167210077 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048011d40 con 0x7fa0600d1e30 2023-11-29T11:13:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 -- 172.21.15.81:0/1167210077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 msgr2=0x7fa0600b8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 --2- 172.21.15.81:0/1167210077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa0600b8240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa048009910 tx=0x7fa048009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 -- 172.21.15.81:0/1167210077 shutdown_connections 2023-11-29T11:13:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 --2- 172.21.15.81:0/1167210077 >> v2:172.21.15.176:3300/0 conn(0x7fa0600cf110 0x7fa0600cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 --2- 172.21.15.81:0/1167210077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa0600b8240 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 -- 172.21.15.81:0/1167210077 >> 172.21.15.81:0/1167210077 conn(0x7fa06009bbd0 msgr2=0x7fa0600b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 -- 172.21.15.81:0/1167210077 shutdown_connections 2023-11-29T11:13:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 -- 172.21.15.81:0/1167210077 wait complete. 2023-11-29T11:13:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 Processor -- start 2023-11-29T11:13:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.586+0000 7fa05f59e700 1 -- start start 2023-11-29T11:13:38.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06006ce60 0x7fa06015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0600cf110 0x7fa0600b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa060151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa060156c20 con 0x7fa06006ce60 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015ce80 con 0x7fa0600cf110 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601523d0 con 0x7fa0600d1e30 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06006ce60 0x7fa06015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06006ce60 0x7fa06015c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34520/0 (socket says 172.21.15.81:34520) 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 -- 172.21.15.81:0/876238145 learned_addr learned my addr 172.21.15.81:0/876238145 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa057fff700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0600cf110 0x7fa0600b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05ed9d700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa060151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 -- 172.21.15.81:0/876238145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 msgr2=0x7fa060151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa060151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 -- 172.21.15.81:0/876238145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0600cf110 msgr2=0x7fa0600b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0600cf110 0x7fa0600b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 -- 172.21.15.81:0/876238145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048009570 con 0x7fa06006ce60 2023-11-29T11:13:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05e59c700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06006ce60 0x7fa06015c940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c530 tx=0x7fa05000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa056ffd700 1 -- 172.21.15.81:0/876238145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050005cd0 con 0x7fa06006ce60 2023-11-29T11:13:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa056ffd700 1 -- 172.21.15.81:0/876238145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050005e30 con 0x7fa06006ce60 2023-11-29T11:13:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600d25d0 con 0x7fa06006ce60 2023-11-29T11:13:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa056ffd700 1 -- 172.21.15.81:0/876238145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0500072f0 con 0x7fa06006ce60 2023-11-29T11:13:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.590+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06015c700 con 0x7fa06006ce60 2023-11-29T11:13:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.594+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600d28b0 con 0x7fa06006ce60 2023-11-29T11:13:38.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.594+0000 7fa056ffd700 1 -- 172.21.15.81:0/876238145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa050019030 con 0x7fa06006ce60 2023-11-29T11:13:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.594+0000 7fa056ffd700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa044064ee0 0x7fa044067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.594+0000 7fa057fff700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa044064ee0 0x7fa044067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.594+0000 7fa056ffd700 1 -- 172.21.15.81:0/876238145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa0500814d0 con 0x7fa06006ce60 2023-11-29T11:13:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.594+0000 7fa057fff700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa044064ee0 0x7fa044067390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa048009c60 tx=0x7fa048008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.598+0000 7fa056ffd700 1 -- 172.21.15.81:0/876238145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa05004f290 con 0x7fa06006ce60 2023-11-29T11:13:38.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.762+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa060072500 con 0x7fa06006ce60 2023-11-29T11:13:38.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.762+0000 7fa056ffd700 1 -- 172.21.15.81:0/876238145 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa050017020 con 0x7fa06006ce60 2023-11-29T11:13:38.767 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:38.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa044064ee0 msgr2=0x7fa044067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa044064ee0 0x7fa044067390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa048009c60 tx=0x7fa048008030 comp rx=0 tx=0).stop 2023-11-29T11:13:38.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06006ce60 msgr2=0x7fa06015c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06006ce60 0x7fa06015c940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c530 tx=0x7fa05000c840 comp rx=0 tx=0).stop 2023-11-29T11:13:38.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 shutdown_connections 2023-11-29T11:13:38.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa044064ee0 0x7fa044067390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0600d1e30 0x7fa060151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0600cf110 0x7fa0600b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 --2- 172.21.15.81:0/876238145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06006ce60 0x7fa06015c940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 >> 172.21.15.81:0/876238145 conn(0x7fa06009bbd0 msgr2=0x7fa0600cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:38.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 shutdown_connections 2023-11-29T11:13:38.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.766+0000 7fa05f59e700 1 -- 172.21.15.81:0/876238145 wait complete. 2023-11-29T11:13:38.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252b12a700 1 Processor -- start 2023-11-29T11:13:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252b12a700 1 -- start start 2023-11-29T11:13:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252b12a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240aaf40 0x7f252415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252b12a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25240ccd00 con 0x7f25240b2450 2023-11-29T11:13:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252b12a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25240b19b0 con 0x7f252406b370 2023-11-29T11:13:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252b12a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25240b05f0 con 0x7f25240aaf40 2023-11-29T11:13:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252a929700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f25240b2450 0x7f25240b28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41162/0 (socket says 172.21.15.81:41162) 2023-11-29T11:13:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252a929700 1 -- 172.21.15.81:0/255195853 learned_addr learned my addr 172.21.15.81:0/255195853 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252a128700 1 --2- 172.21.15.81:0/255195853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240aaf40 0x7f252415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f2529126700 1 -- 172.21.15.81:0/255195853 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747667470 0 0) 0x7f25240ccd00 con 0x7f25240b2450 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f2529126700 1 -- 172.21.15.81:0/255195853 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f250c0035d0 con 0x7f25240b2450 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f2529126700 1 -- 172.21.15.81:0/255195853 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758116181 0 0) 0x7f25240b19b0 con 0x7f252406b370 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f2529126700 1 -- 172.21.15.81:0/255195853 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25240ccd00 con 0x7f252406b370 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252a128700 1 -- 172.21.15.81:0/255195853 >> v1:172.21.15.176:6789/0 conn(0x7f252406b370 legacy=0x7f25240afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252a128700 1 -- 172.21.15.81:0/255195853 >> v1:172.21.15.81:6789/0 conn(0x7f25240b2450 legacy=0x7f25240b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252a128700 1 -- 172.21.15.81:0/255195853 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25240cd510 con 0x7f25240aaf40 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.894+0000 7f252a128700 1 --2- 172.21.15.81:0/255195853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240aaf40 0x7f252415bb80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2518009880 tx=0x7f2518009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f4fd758e85bf21 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f2529126700 1 -- 172.21.15.81:0/255195853 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518011830 con 0x7f25240aaf40 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f2529126700 1 -- 172.21.15.81:0/255195853 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518011990 con 0x7f25240aaf40 2023-11-29T11:13:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f2529126700 1 -- 172.21.15.81:0/255195853 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518011d20 con 0x7f25240aaf40 2023-11-29T11:13:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 -- 172.21.15.81:0/255195853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240aaf40 msgr2=0x7f252415bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 --2- 172.21.15.81:0/255195853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240aaf40 0x7f252415bb80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2518009880 tx=0x7f2518009b90 comp rx=0 tx=0).stop 2023-11-29T11:13:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 -- 172.21.15.81:0/255195853 shutdown_connections 2023-11-29T11:13:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 --2- 172.21.15.81:0/255195853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240aaf40 0x7f252415bb80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 -- 172.21.15.81:0/255195853 >> 172.21.15.81:0/255195853 conn(0x7f25240cae70 msgr2=0x7f25240cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 -- 172.21.15.81:0/255195853 shutdown_connections 2023-11-29T11:13:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 -- 172.21.15.81:0/255195853 wait complete. 2023-11-29T11:13:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 Processor -- start 2023-11-29T11:13:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 -- start start 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406b370 0x7f252406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.898+0000 7f252b12a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25240aaf40 0x7f2524156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252b12a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240b2450 0x7f252415d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252b12a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252409a0a0 con 0x7f252406b370 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252b12a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252409a230 con 0x7f25240aaf40 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252b12a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25241594d0 con 0x7f25240b2450 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406b370 0x7f252406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406b370 0x7f252406fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34522/0 (socket says 172.21.15.81:34522) 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 -- 172.21.15.81:0/2566821513 learned_addr learned my addr 172.21.15.81:0/2566821513 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a929700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240b2450 0x7f252415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f2529927700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25240aaf40 0x7f2524156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 -- 172.21.15.81:0/2566821513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240b2450 msgr2=0x7f252415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240b2450 0x7f252415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 -- 172.21.15.81:0/2566821513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25240aaf40 msgr2=0x7f2524156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25240aaf40 0x7f2524156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 -- 172.21.15.81:0/2566821513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180094b0 con 0x7f252406b370 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252a128700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406b370 0x7f252406fc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2518013040 tx=0x7f2518004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f2522ffd700 1 -- 172.21.15.81:0/2566821513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251801a8c0 con 0x7f252406b370 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f2522ffd700 1 -- 172.21.15.81:0/2566821513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251801e070 con 0x7f252406b370 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25240cd230 con 0x7f252406b370 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f2522ffd700 1 -- 172.21.15.81:0/2566821513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251801ac60 con 0x7f252406b370 2023-11-29T11:13:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25240ccf50 con 0x7f252406b370 2023-11-29T11:13:38.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25240b1c50 con 0x7f252406b370 2023-11-29T11:13:38.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.902+0000 7f2522ffd700 1 -- 172.21.15.81:0/2566821513 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f251800f050 con 0x7f252406b370 2023-11-29T11:13:38.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.906+0000 7f2522ffd700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2510064ee0 0x7f2510067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:38.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.906+0000 7f2522ffd700 1 -- 172.21.15.81:0/2566821513 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2518083020 con 0x7f252406b370 2023-11-29T11:13:38.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.906+0000 7f2529927700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2510064ee0 0x7f2510067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:38.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.906+0000 7f2529927700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2510064ee0 0x7f2510067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f25241f2980 tx=0x7f2514009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:38.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:38.914+0000 7f2522ffd700 1 -- 172.21.15.81:0/2566821513 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2518050e50 con 0x7f252406b370 2023-11-29T11:13:39.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.078+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2524072500 con 0x7f252406b370 2023-11-29T11:13:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.078+0000 7f2522ffd700 1 -- 172.21.15.81:0/2566821513 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25180200a0 con 0x7f252406b370 2023-11-29T11:13:39.082 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:39.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.078+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2510064ee0 msgr2=0x7f2510067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.078+0000 7f252b12a700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2510064ee0 0x7f2510067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f25241f2980 tx=0x7f2514009040 comp rx=0 tx=0).stop 2023-11-29T11:13:39.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.078+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406b370 msgr2=0x7f252406fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.078+0000 7f252b12a700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406b370 0x7f252406fc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2518013040 tx=0x7f2518004770 comp rx=0 tx=0).stop 2023-11-29T11:13:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.082+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 shutdown_connections 2023-11-29T11:13:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.082+0000 7f252b12a700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2510064ee0 0x7f2510067390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.082+0000 7f252b12a700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25240b2450 0x7f252415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.082+0000 7f252b12a700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25240aaf40 0x7f2524156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.082+0000 7f252b12a700 1 --2- 172.21.15.81:0/2566821513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252406b370 0x7f252406fc40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.082+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 >> 172.21.15.81:0/2566821513 conn(0x7f25240cae70 msgr2=0x7f25240b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.082+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 shutdown_connections 2023-11-29T11:13:39.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.082+0000 7f252b12a700 1 -- 172.21.15.81:0/2566821513 wait complete. 2023-11-29T11:13:39.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.210+0000 7f72894d1700 1 Processor -- start 2023-11-29T11:13:39.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.210+0000 7f72894d1700 1 -- start start 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.210+0000 7f72894d1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f728406a4c0 0x7f728406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.210+0000 7f72894d1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728406a9c0 con 0x7f72840b1ae0 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.210+0000 7f72894d1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728406aca0 con 0x7f72840cf0e0 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.210+0000 7f72894d1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72840d0ab0 con 0x7f728406a4c0 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.210+0000 7f7283fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f72840b1ae0 0x7f72840d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41174/0 (socket says 172.21.15.81:41174) 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.210+0000 7f7283fff700 1 -- 172.21.15.81:0/1429262655 learned_addr learned my addr 172.21.15.81:0/1429262655 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72837fe700 1 --2- 172.21.15.81:0/1429262655 >> v2:172.21.15.176:3300/0 conn(0x7f728406a4c0 0x7f728406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741822705 0 0) 0x7f728406a9c0 con 0x7f72840b1ae0 2023-11-29T11:13:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726c0035d0 con 0x7f72840b1ae0 2023-11-29T11:13:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884266966 0 0) 0x7f726c0035d0 con 0x7f72840b1ae0 2023-11-29T11:13:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 >> v2:172.21.15.176:3300/0 conn(0x7f728406a4c0 msgr2=0x7f728406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 --2- 172.21.15.81:0/1429262655 >> v2:172.21.15.176:3300/0 conn(0x7f728406a4c0 0x7f728406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 >> v1:172.21.15.176:6789/0 conn(0x7f72840cf0e0 legacy=0x7f72840cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728406af80 con 0x7f72840b1ae0 2023-11-29T11:13:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f7278001670 con 0x7f72840b1ae0 2023-11-29T11:13:39.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 >> v1:172.21.15.81:6789/0 conn(0x7f72840b1ae0 legacy=0x7f72840d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c003a20 0x7f726c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c0043c0 0x7f726c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c005070 0x7f726c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72840d0ab0 con 0x7f726c003a20 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7283fff700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c003a20 0x7f726c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c00bfa0 con 0x7f726c005070 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c00c160 con 0x7f726c0043c0 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72837fe700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c0043c0 0x7f726c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7288cd0700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c005070 0x7f726c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7283fff700 1 -- 172.21.15.81:0/1429262655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c0043c0 msgr2=0x7f726c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7283fff700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f726c0043c0 0x7f726c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7283fff700 1 -- 172.21.15.81:0/1429262655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c005070 msgr2=0x7f726c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7283fff700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c005070 0x7f726c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7288cd0700 1 -- 172.21.15.81:0/1429262655 reap_dead start 2023-11-29T11:13:39.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7283fff700 1 -- 172.21.15.81:0/1429262655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0035d0 con 0x7f726c003a20 2023-11-29T11:13:39.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7283fff700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c003a20 0x7f726c003df0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7278005150 tx=0x7f726c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5a935e7f994bc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278005b80 con 0x7f726c003a20 2023-11-29T11:13:39.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7278005d00 con 0x7f726c003a20 2023-11-29T11:13:39.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f7282ffd700 1 -- 172.21.15.81:0/1429262655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278008310 con 0x7f726c003a20 2023-11-29T11:13:39.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72894d1700 1 -- 172.21.15.81:0/1429262655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c003a20 msgr2=0x7f726c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72894d1700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c003a20 0x7f726c003df0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7278005150 tx=0x7f726c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72894d1700 1 -- 172.21.15.81:0/1429262655 shutdown_connections 2023-11-29T11:13:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72894d1700 1 --2- 172.21.15.81:0/1429262655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726c003a20 0x7f726c003df0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72894d1700 1 -- 172.21.15.81:0/1429262655 >> 172.21.15.81:0/1429262655 conn(0x7f728409bbd0 msgr2=0x7f72840b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72894d1700 1 -- 172.21.15.81:0/1429262655 shutdown_connections 2023-11-29T11:13:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.214+0000 7f72894d1700 1 -- 172.21.15.81:0/1429262655 wait complete. 2023-11-29T11:13:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.218+0000 7f72894d1700 1 Processor -- start 2023-11-29T11:13:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.218+0000 7f72894d1700 1 -- start start 2023-11-29T11:13:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c003a20 0x7f728414ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72840d0bf0 0x7f72840d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f728409e940 0x7f728409edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72840d15a0 con 0x7f72840d0bf0 2023-11-29T11:13:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728415cf30 con 0x7f726c003a20 2023-11-29T11:13:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728409f690 con 0x7f728409e940 2023-11-29T11:13:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72840d0bf0 0x7f72840d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72840d0bf0 0x7f72840d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34546/0 (socket says 172.21.15.81:34546) 2023-11-29T11:13:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 -- 172.21.15.81:0/2682687582 learned_addr learned my addr 172.21.15.81:0/2682687582 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f7283fff700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c003a20 0x7f728414ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f7288cd0700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f728409e940 0x7f728409edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 -- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f728409e940 msgr2=0x7f728409edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f728409e940 0x7f728409edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 -- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c003a20 msgr2=0x7f728414ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c003a20 0x7f728414ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 -- 172.21.15.81:0/2682687582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72840b1eb0 con 0x7f72840d0bf0 2023-11-29T11:13:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f7288cd0700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f728409e940 0x7f728409edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72837fe700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72840d0bf0 0x7f72840d1060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7274011630 tx=0x7f7274011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f7280ff9700 1 -- 172.21.15.81:0/2682687582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274015870 con 0x7f72840d0bf0 2023-11-29T11:13:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f7280ff9700 1 -- 172.21.15.81:0/2682687582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72740159d0 con 0x7f72840d0bf0 2023-11-29T11:13:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72840b4380 con 0x7f72840d0bf0 2023-11-29T11:13:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f7280ff9700 1 -- 172.21.15.81:0/2682687582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274015d40 con 0x7f72840d0bf0 2023-11-29T11:13:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72840b60e0 con 0x7f72840d0bf0 2023-11-29T11:13:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.222+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7284072500 con 0x7f72840d0bf0 2023-11-29T11:13:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.226+0000 7f7280ff9700 1 -- 172.21.15.81:0/2682687582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f727401b030 con 0x7f72840d0bf0 2023-11-29T11:13:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.226+0000 7f7280ff9700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7270064ee0 0x7f7270067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.226+0000 7f7280ff9700 1 -- 172.21.15.81:0/2682687582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7274082320 con 0x7f72840d0bf0 2023-11-29T11:13:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.226+0000 7f7283fff700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7270064ee0 0x7f7270067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.226+0000 7f7283fff700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7270064ee0 0x7f7270067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7278015000 tx=0x7f727800a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.230+0000 7f7280ff9700 1 -- 172.21.15.81:0/2682687582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f727404ffd0 con 0x7f72840d0bf0 2023-11-29T11:13:39.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.390+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72840cecb0 con 0x7f72840d0bf0 2023-11-29T11:13:39.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f7280ff9700 1 -- 172.21.15.81:0/2682687582 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72740230a0 con 0x7f72840d0bf0 2023-11-29T11:13:39.397 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7270064ee0 msgr2=0x7f7270067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7270064ee0 0x7f7270067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7278015000 tx=0x7f727800a000 comp rx=0 tx=0).stop 2023-11-29T11:13:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72840d0bf0 msgr2=0x7f72840d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72840d0bf0 0x7f72840d1060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7274011630 tx=0x7f7274011940 comp rx=0 tx=0).stop 2023-11-29T11:13:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 shutdown_connections 2023-11-29T11:13:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7270064ee0 0x7f7270067390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f728409e940 0x7f728409edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72840d0bf0 0x7f72840d1060 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 --2- 172.21.15.81:0/2682687582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f726c003a20 0x7f728414ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 >> 172.21.15.81:0/2682687582 conn(0x7f728409bbd0 msgr2=0x7f72841e7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 shutdown_connections 2023-11-29T11:13:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.394+0000 7f72894d1700 1 -- 172.21.15.81:0/2682687582 wait complete. 2023-11-29T11:13:39.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:39.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.522+0000 7f4831222700 1 Processor -- start 2023-11-29T11:13:39.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.522+0000 7f4831222700 1 -- start start 2023-11-29T11:13:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0ca840 0x7f482c163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c06b4e0 con 0x7f482c0cf0d0 2023-11-29T11:13:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0ce030 con 0x7f482c160450 2023-11-29T11:13:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0ce310 con 0x7f482c0ca840 2023-11-29T11:13:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4830a21700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f482c0cf0d0 0x7f482c0c21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41188/0 (socket says 172.21.15.81:41188) 2023-11-29T11:13:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4830a21700 1 -- 172.21.15.81:0/3228791415 learned_addr learned my addr 172.21.15.81:0/3228791415 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f48237fe700 1 --2- 172.21.15.81:0/3228791415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0ca840 0x7f482c163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f482b7fe700 1 -- 172.21.15.81:0/3228791415 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044994905 0 0) 0x7f4824001490 con 0x7f482c0cf0d0 2023-11-29T11:13:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f482b7fe700 1 -- 172.21.15.81:0/3228791415 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48180035d0 con 0x7f482c0cf0d0 2023-11-29T11:13:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f48237fe700 1 -- 172.21.15.81:0/3228791415 >> v1:172.21.15.176:6789/0 conn(0x7f482c160450 legacy=0x7f482c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f482b7fe700 1 -- 172.21.15.81:0/3228791415 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196767694 0 0) 0x7f482c0ce030 con 0x7f482c160450 2023-11-29T11:13:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f48237fe700 1 -- 172.21.15.81:0/3228791415 >> v1:172.21.15.81:6789/0 conn(0x7f482c0cf0d0 legacy=0x7f482c0c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f48237fe700 1 -- 172.21.15.81:0/3228791415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0ce5f0 con 0x7f482c0ca840 2023-11-29T11:13:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f48237fe700 1 --2- 172.21.15.81:0/3228791415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0ca840 0x7f482c163fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4814009870 tx=0x7f4814009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fdede28421d60bd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f482b7fe700 1 -- 172.21.15.81:0/3228791415 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814005e50 con 0x7f482c0ca840 2023-11-29T11:13:39.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f482b7fe700 1 -- 172.21.15.81:0/3228791415 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4814006030 con 0x7f482c0ca840 2023-11-29T11:13:39.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f482b7fe700 1 -- 172.21.15.81:0/3228791415 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48140063a0 con 0x7f482c0ca840 2023-11-29T11:13:39.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 -- 172.21.15.81:0/3228791415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0ca840 msgr2=0x7f482c163fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 --2- 172.21.15.81:0/3228791415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0ca840 0x7f482c163fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4814009870 tx=0x7f4814009b80 comp rx=0 tx=0).stop 2023-11-29T11:13:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 -- 172.21.15.81:0/3228791415 shutdown_connections 2023-11-29T11:13:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 --2- 172.21.15.81:0/3228791415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0ca840 0x7f482c163fc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 -- 172.21.15.81:0/3228791415 >> 172.21.15.81:0/3228791415 conn(0x7f482c0d0240 msgr2=0x7f482c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 -- 172.21.15.81:0/3228791415 shutdown_connections 2023-11-29T11:13:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.526+0000 7f4831222700 1 -- 172.21.15.81:0/3228791415 wait complete. 2023-11-29T11:13:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4831222700 1 Processor -- start 2023-11-29T11:13:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4831222700 1 -- start start 2023-11-29T11:13:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4831222700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f482c0ca840 0x7f482c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4831222700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0cf0d0 0x7f482c162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4831222700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f482c160450 0x7f482c0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4831222700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b3190 con 0x7f482c160450 2023-11-29T11:13:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4831222700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b25c0 con 0x7f482c0ca840 2023-11-29T11:13:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4831222700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b2860 con 0x7f482c0cf0d0 2023-11-29T11:13:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4830a21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f482c160450 0x7f482c0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4830a21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f482c160450 0x7f482c0b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34556/0 (socket says 172.21.15.81:34556) 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4830a21700 1 -- 172.21.15.81:0/830624488 learned_addr learned my addr 172.21.15.81:0/830624488 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f48237fe700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0cf0d0 0x7f482c162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f482bfff700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f482c0ca840 0x7f482c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4830a21700 1 -- 172.21.15.81:0/830624488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0cf0d0 msgr2=0x7f482c162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4830a21700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0cf0d0 0x7f482c162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4830a21700 1 -- 172.21.15.81:0/830624488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f482c0ca840 msgr2=0x7f482c1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4830a21700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f482c0ca840 0x7f482c1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.530+0000 7f4830a21700 1 -- 172.21.15.81:0/830624488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4814009450 con 0x7f482c160450 2023-11-29T11:13:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f4830a21700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f482c160450 0x7f482c0b3620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f482400ca70 tx=0x7f482400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f48297fa700 1 -- 172.21.15.81:0/830624488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824007480 con 0x7f482c160450 2023-11-29T11:13:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f48297fa700 1 -- 172.21.15.81:0/830624488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824007600 con 0x7f482c160450 2023-11-29T11:13:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c0cebb0 con 0x7f482c160450 2023-11-29T11:13:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f48297fa700 1 -- 172.21.15.81:0/830624488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48240079b0 con 0x7f482c160450 2023-11-29T11:13:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c0ce8d0 con 0x7f482c160450 2023-11-29T11:13:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c160820 con 0x7f482c160450 2023-11-29T11:13:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f48297fa700 1 -- 172.21.15.81:0/830624488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4824019030 con 0x7f482c160450 2023-11-29T11:13:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.534+0000 7f48297fa700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f480c064ee0 0x7f480c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.538+0000 7f48297fa700 1 -- 172.21.15.81:0/830624488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4824081720 con 0x7f482c160450 2023-11-29T11:13:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.538+0000 7f482bfff700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f480c064ee0 0x7f480c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.538+0000 7f482bfff700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f480c064ee0 0x7f480c067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f481c007fd0 tx=0x7f481c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.542+0000 7f48297fa700 1 -- 172.21.15.81:0/830624488 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f482404f5d0 con 0x7f482c160450 2023-11-29T11:13:39.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.702+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f482c066f50 con 0x7f482c160450 2023-11-29T11:13:39.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f48297fa700 1 -- 172.21.15.81:0/830624488 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4824017020 con 0x7f482c160450 2023-11-29T11:13:39.709 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f480c064ee0 msgr2=0x7f480c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f480c064ee0 0x7f480c067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f481c007fd0 tx=0x7f481c009040 comp rx=0 tx=0).stop 2023-11-29T11:13:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f482c160450 msgr2=0x7f482c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f482c160450 0x7f482c0b3620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f482400ca70 tx=0x7f482400caa0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 shutdown_connections 2023-11-29T11:13:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f480c064ee0 0x7f480c067390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f482c160450 0x7f482c0b3620 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f482c0cf0d0 0x7f482c162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 --2- 172.21.15.81:0/830624488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f482c0ca840 0x7f482c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 >> 172.21.15.81:0/830624488 conn(0x7f482c0d0240 msgr2=0x7f482c0af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 shutdown_connections 2023-11-29T11:13:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.706+0000 7f4831222700 1 -- 172.21.15.81:0/830624488 wait complete. 2023-11-29T11:13:39.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bdb56700 1 Processor -- start 2023-11-29T11:13:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bdb56700 1 -- start start 2023-11-29T11:13:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bdb56700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1b81584c0 0x7fd1b80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bdb56700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd1b80b32e0 0x7fd1b80b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bdb56700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80b3c60 con 0x7fd1b806bc80 2023-11-29T11:13:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bdb56700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b806dbd0 con 0x7fd1b81584c0 2023-11-29T11:13:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bdb56700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80cd0f0 con 0x7fd1b80b32e0 2023-11-29T11:13:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bd355700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd1b806bc80 0x7fd1b806c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52520/0 (socket says 172.21.15.81:52520) 2023-11-29T11:13:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bd355700 1 -- 172.21.15.81:0/4055887536 learned_addr learned my addr 172.21.15.81:0/4055887536 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.830+0000 7fd1bcb54700 1 --2- 172.21.15.81:0/4055887536 >> v2:172.21.15.81:3300/0 conn(0x7fd1b81584c0 0x7fd1b80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1b7fff700 1 --2- 172.21.15.81:0/4055887536 >> v2:172.21.15.176:3300/0 conn(0x7fd1b80b32e0 0x7fd1b80b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1b77fe700 1 -- 172.21.15.81:0/4055887536 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532463393 0 0) 0x7fd1b80b3c60 con 0x7fd1b806bc80 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1b77fe700 1 -- 172.21.15.81:0/4055887536 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a00035d0 con 0x7fd1b806bc80 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bcb54700 1 -- 172.21.15.81:0/4055887536 >> v2:172.21.15.176:3300/0 conn(0x7fd1b80b32e0 msgr2=0x7fd1b80b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bcb54700 1 --2- 172.21.15.81:0/4055887536 >> v2:172.21.15.176:3300/0 conn(0x7fd1b80b32e0 0x7fd1b80b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bcb54700 1 -- 172.21.15.81:0/4055887536 >> v1:172.21.15.81:6789/0 conn(0x7fd1b806bc80 legacy=0x7fd1b806c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bcb54700 1 -- 172.21.15.81:0/4055887536 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80cd3d0 con 0x7fd1b81584c0 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bcb54700 1 --2- 172.21.15.81:0/4055887536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b81584c0 0x7fd1b80cb6f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80cae10 tx=0x7fd1ac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc8e2c1d41b303b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1b77fe700 1 -- 172.21.15.81:0/4055887536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011830 con 0x7fd1b81584c0 2023-11-29T11:13:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1b77fe700 1 -- 172.21.15.81:0/4055887536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac011990 con 0x7fd1b81584c0 2023-11-29T11:13:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1b77fe700 1 -- 172.21.15.81:0/4055887536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011d00 con 0x7fd1b81584c0 2023-11-29T11:13:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bdb56700 1 -- 172.21.15.81:0/4055887536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b81584c0 msgr2=0x7fd1b80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/4055887536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b81584c0 0x7fd1b80cb6f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80cae10 tx=0x7fd1ac009b30 comp rx=0 tx=0).stop 2023-11-29T11:13:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bdb56700 1 -- 172.21.15.81:0/4055887536 shutdown_connections 2023-11-29T11:13:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/4055887536 >> v2:172.21.15.176:3300/0 conn(0x7fd1b80b32e0 0x7fd1b80b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/4055887536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b81584c0 0x7fd1b80cb6f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bdb56700 1 -- 172.21.15.81:0/4055887536 >> 172.21.15.81:0/4055887536 conn(0x7fd1b80ce3e0 msgr2=0x7fd1b80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bdb56700 1 -- 172.21.15.81:0/4055887536 shutdown_connections 2023-11-29T11:13:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.834+0000 7fd1bdb56700 1 -- 172.21.15.81:0/4055887536 wait complete. 2023-11-29T11:13:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 Processor -- start 2023-11-29T11:13:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 -- start start 2023-11-29T11:13:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806bc80 0x7fd1b80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1b80b32e0 0x7fd1b80c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1b81584c0 0x7fd1b80c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80c7990 con 0x7fd1b806bc80 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8092830 con 0x7fd1b80b32e0 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80c09f0 con 0x7fd1b81584c0 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806bc80 0x7fd1b80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806bc80 0x7fd1b80b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35740/0 (socket says 172.21.15.81:35740) 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 -- 172.21.15.81:0/3014375855 learned_addr learned my addr 172.21.15.81:0/3014375855 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1b7fff700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1b80b32e0 0x7fd1b80c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bd355700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1b81584c0 0x7fd1b80c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 -- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1b81584c0 msgr2=0x7fd1b80c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1b81584c0 0x7fd1b80c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 -- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1b80b32e0 msgr2=0x7fd1b80c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:39.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1b80b32e0 0x7fd1b80c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 -- 172.21.15.81:0/3014375855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0094b0 con 0x7fd1b806bc80 2023-11-29T11:13:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1b7fff700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1b80b32e0 0x7fd1b80c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bcb54700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806bc80 0x7fd1b80b0280 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0090b0 tx=0x7fd1ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1b57fa700 1 -- 172.21.15.81:0/3014375855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0045d0 con 0x7fd1b806bc80 2023-11-29T11:13:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1b57fa700 1 -- 172.21.15.81:0/3014375855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac01e070 con 0x7fd1b806bc80 2023-11-29T11:13:39.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80cd990 con 0x7fd1b806bc80 2023-11-29T11:13:39.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1b57fa700 1 -- 172.21.15.81:0/3014375855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0038e0 con 0x7fd1b806bc80 2023-11-29T11:13:39.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.838+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b80cd6b0 con 0x7fd1b806bc80 2023-11-29T11:13:39.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.842+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b80cdc70 con 0x7fd1b806bc80 2023-11-29T11:13:39.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.842+0000 7fd1b57fa700 1 -- 172.21.15.81:0/3014375855 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd1ac00f050 con 0x7fd1b806bc80 2023-11-29T11:13:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.842+0000 7fd1b57fa700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd1a4064ee0 0x7fd1a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.842+0000 7fd1b57fa700 1 -- 172.21.15.81:0/3014375855 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd1ac0830e0 con 0x7fd1b806bc80 2023-11-29T11:13:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.842+0000 7fd1b7fff700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd1a4064ee0 0x7fd1a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.842+0000 7fd1b7fff700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd1a4064ee0 0x7fd1a4067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80c74a0 tx=0x7fd1a800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:39.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:39.850+0000 7fd1b57fa700 1 -- 172.21.15.81:0/3014375855 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd1ac050f10 con 0x7fd1b806bc80 2023-11-29T11:13:40.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.018+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1b8072500 con 0x7fd1b806bc80 2023-11-29T11:13:40.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.018+0000 7fd1b57fa700 1 -- 172.21.15.81:0/3014375855 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fd1ac054530 con 0x7fd1b806bc80 2023-11-29T11:13:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:40.024 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:12:56.745122+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:40.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd1a4064ee0 msgr2=0x7fd1a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd1a4064ee0 0x7fd1a4067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80c74a0 tx=0x7fd1a800b040 comp rx=0 tx=0).stop 2023-11-29T11:13:40.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806bc80 msgr2=0x7fd1b80b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806bc80 0x7fd1b80b0280 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0090b0 tx=0x7fd1ac004770 comp rx=0 tx=0).stop 2023-11-29T11:13:40.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 shutdown_connections 2023-11-29T11:13:40.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd1a4064ee0 0x7fd1a4067390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1b81584c0 0x7fd1b80c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1b80b32e0 0x7fd1b80c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 --2- 172.21.15.81:0/3014375855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806bc80 0x7fd1b80b0280 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 >> 172.21.15.81:0/3014375855 conn(0x7fd1b80ce3e0 msgr2=0x7fd1b806c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:40.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 shutdown_connections 2023-11-29T11:13:40.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.022+0000 7fd1bdb56700 1 -- 172.21.15.81:0/3014375855 wait complete. 2023-11-29T11:13:40.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:40.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5ad2f6700 1 Processor -- start 2023-11-29T11:13:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5ad2f6700 1 -- start start 2023-11-29T11:13:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5ad2f6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5a80cf7f0 0x7fe5a806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5ad2f6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a806a9c0 con 0x7fe5a806a4c0 2023-11-29T11:13:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5ad2f6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a806aca0 con 0x7fe5a80b1ae0 2023-11-29T11:13:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5ad2f6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a80d0ab0 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5acaf5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5a80cf7f0 0x7fe5a806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5a77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe5a806a4c0 0x7fe5a80cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52530/0 (socket says 172.21.15.81:52530) 2023-11-29T11:13:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5a77fe700 1 -- 172.21.15.81:0/2751832694 learned_addr learned my addr 172.21.15.81:0/2751832694 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5acaf5700 1 -- 172.21.15.81:0/2751832694 >> v1:172.21.15.176:6789/0 conn(0x7fe5a80b1ae0 legacy=0x7fe5a80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5acaf5700 1 -- 172.21.15.81:0/2751832694 >> v1:172.21.15.81:6789/0 conn(0x7fe5a806a4c0 legacy=0x7fe5a80cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5acaf5700 1 -- 172.21.15.81:0/2751832694 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a806af80 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/2751832694 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923159315 0 0) 0x7fe5a806aca0 con 0x7fe5a80b1ae0 2023-11-29T11:13:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5acaf5700 1 --2- 172.21.15.81:0/2751832694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a806d8e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009850 tx=0x7fe5a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acc746f3eb0cf00 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.154+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/2751832694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0004230 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/2751832694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a0004390 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5a6ffd700 1 -- 172.21.15.81:0/2751832694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00036c0 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/2751832694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 msgr2=0x7fe5a806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 --2- 172.21.15.81:0/2751832694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a806d8e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009850 tx=0x7fe5a0009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/2751832694 shutdown_connections 2023-11-29T11:13:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 --2- 172.21.15.81:0/2751832694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a806d8e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/2751832694 >> 172.21.15.81:0/2751832694 conn(0x7fe5a809bbd0 msgr2=0x7fe5a80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/2751832694 shutdown_connections 2023-11-29T11:13:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/2751832694 wait complete. 2023-11-29T11:13:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 Processor -- start 2023-11-29T11:13:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.158+0000 7fe5ad2f6700 1 -- start start 2023-11-29T11:13:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5ad2f6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5a806a4c0 0x7fe5a815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5ad2f6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5a80b1ae0 0x7fe5a80c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5ad2f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a8150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5ad2f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80c8550 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5ad2f6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a815f850 con 0x7fe5a80b1ae0 2023-11-29T11:13:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5ad2f6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80c8f20 con 0x7fe5a806a4c0 2023-11-29T11:13:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a8150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a8150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35754/0 (socket says 172.21.15.81:35754) 2023-11-29T11:13:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 -- 172.21.15.81:0/3861651849 learned_addr learned my addr 172.21.15.81:0/3861651849 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5a7fff700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5a806a4c0 0x7fe5a815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5a77fe700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5a80b1ae0 0x7fe5a80c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 -- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5a806a4c0 msgr2=0x7fe5a815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5a806a4c0 0x7fe5a815f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 -- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5a80b1ae0 msgr2=0x7fe5a80c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5a80b1ae0 0x7fe5a80c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 -- 172.21.15.81:0/3861651849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00094b0 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5a7fff700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5a806a4c0 0x7fe5a815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5a77fe700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5a80b1ae0 0x7fe5a80c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5acaf5700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a8150c70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00090b0 tx=0x7fe5a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5a4ff9700 1 -- 172.21.15.81:0/3861651849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0003e80 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5a4ff9700 1 -- 172.21.15.81:0/3861651849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a0011630 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5a4ff9700 1 -- 172.21.15.81:0/3861651849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00119c0 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a80b1eb0 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.162+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a80b4380 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.166+0000 7fe5a4ff9700 1 -- 172.21.15.81:0/3861651849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe5a002d070 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.166+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a80b60e0 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.166+0000 7fe5a4ff9700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe588064ee0 0x7fe588067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.166+0000 7fe5a4ff9700 1 -- 172.21.15.81:0/3861651849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5a0082e70 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.166+0000 7fe5a7fff700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe588064ee0 0x7fe588067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.166+0000 7fe5a7fff700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe588064ee0 0x7fe588067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5980012e0 tx=0x7fe598009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.170+0000 7fe5a4ff9700 1 -- 172.21.15.81:0/3861651849 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe5a0050d20 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.326+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5a8072500 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5a4ff9700 1 -- 172.21.15.81:0/3861651849 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe5a002b020 con 0x7fe5a80cf7f0 2023-11-29T11:13:40.334 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe588064ee0 msgr2=0x7fe588067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe588064ee0 0x7fe588067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5980012e0 tx=0x7fe598009040 comp rx=0 tx=0).stop 2023-11-29T11:13:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 msgr2=0x7fe5a8150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a8150c70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00090b0 tx=0x7fe5a0004770 comp rx=0 tx=0).stop 2023-11-29T11:13:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 shutdown_connections 2023-11-29T11:13:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe588064ee0 0x7fe588067390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5a80cf7f0 0x7fe5a8150c70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5a80b1ae0 0x7fe5a80c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 --2- 172.21.15.81:0/3861651849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5a806a4c0 0x7fe5a815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 >> 172.21.15.81:0/3861651849 conn(0x7fe5a809bbd0 msgr2=0x7fe5a80cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 shutdown_connections 2023-11-29T11:13:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.330+0000 7fe5ad2f6700 1 -- 172.21.15.81:0/3861651849 wait complete. 2023-11-29T11:13:40.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:40.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.462+0000 7f1397fff700 1 Processor -- start 2023-11-29T11:13:40.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.462+0000 7f1397fff700 1 -- start start 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.462+0000 7f1397fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13980b1ae0 0x7f139806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.462+0000 7f1397fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139806a4c0 0x7f13980d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.462+0000 7f1397fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f13980cf0e0 0x7f13980cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980cfa80 con 0x7f13980b1ae0 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139806a9c0 con 0x7f13980cf0e0 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139806aca0 con 0x7f139806a4c0 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13980b1ae0 0x7f139806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13980b1ae0 0x7f139806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35758/0 (socket says 172.21.15.81:35758) 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 -- 172.21.15.81:0/3617001408 learned_addr learned my addr 172.21.15.81:0/3617001408 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f13967fc700 1 --2- 172.21.15.81:0/3617001408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139806a4c0 0x7f13980d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f13977fe700 1 --2- 172.21.15.81:0/3617001408 >> v2:172.21.15.176:3300/0 conn(0x7f13980cf0e0 0x7f13980cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 -- 172.21.15.81:0/3617001408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139806a4c0 msgr2=0x7f13980d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 --2- 172.21.15.81:0/3617001408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139806a4c0 0x7f13980d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 -- 172.21.15.81:0/3617001408 >> v2:172.21.15.176:3300/0 conn(0x7f13980cf0e0 msgr2=0x7f13980cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 --2- 172.21.15.81:0/3617001408 >> v2:172.21.15.176:3300/0 conn(0x7f13980cf0e0 0x7f13980cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 -- 172.21.15.81:0/3617001408 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139806af80 con 0x7f13980b1ae0 2023-11-29T11:13:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 --2- 172.21.15.81:0/3617001408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13980b1ae0 0x7f139806d8e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f139808bbc0 tx=0x7f139000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5762bfc8cad82a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1395ffb700 1 -- 172.21.15.81:0/3617001408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000e070 con 0x7f13980b1ae0 2023-11-29T11:13:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1395ffb700 1 -- 172.21.15.81:0/3617001408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000b9c0 con 0x7f13980b1ae0 2023-11-29T11:13:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1395ffb700 1 -- 172.21.15.81:0/3617001408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000bd70 con 0x7f13980b1ae0 2023-11-29T11:13:40.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- 172.21.15.81:0/3617001408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13980b1ae0 msgr2=0x7f139806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 --2- 172.21.15.81:0/3617001408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13980b1ae0 0x7f139806d8e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f139808bbc0 tx=0x7f139000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:40.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- 172.21.15.81:0/3617001408 shutdown_connections 2023-11-29T11:13:40.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 --2- 172.21.15.81:0/3617001408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139806a4c0 0x7f13980d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 --2- 172.21.15.81:0/3617001408 >> v2:172.21.15.176:3300/0 conn(0x7f13980cf0e0 0x7f13980cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 --2- 172.21.15.81:0/3617001408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13980b1ae0 0x7f139806d8e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- 172.21.15.81:0/3617001408 >> 172.21.15.81:0/3617001408 conn(0x7f139809bbd0 msgr2=0x7f13980b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- 172.21.15.81:0/3617001408 shutdown_connections 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- 172.21.15.81:0/3617001408 wait complete. 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 Processor -- start 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- start start 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139806a4c0 0x7f1398158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13980b1ae0 0x7f139815d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13980cf0e0 0x7f139815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13980c65b0 con 0x7f139806a4c0 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139815e160 con 0x7f13980b1ae0 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1397fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13980c6280 con 0x7f13980cf0e0 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139806a4c0 0x7f1398158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139806a4c0 0x7f1398158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35768/0 (socket says 172.21.15.81:35768) 2023-11-29T11:13:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f1396ffd700 1 -- 172.21.15.81:0/439085183 learned_addr learned my addr 172.21.15.81:0/439085183 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.466+0000 7f13967fc700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13980b1ae0 0x7f139815d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f13977fe700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13980cf0e0 0x7f139815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1396ffd700 1 -- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13980cf0e0 msgr2=0x7f139815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1396ffd700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13980cf0e0 0x7f139815e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1396ffd700 1 -- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13980b1ae0 msgr2=0x7f139815d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1396ffd700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13980b1ae0 0x7f139815d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1396ffd700 1 -- 172.21.15.81:0/439085183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390009b30 con 0x7f139806a4c0 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f13977fe700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13980cf0e0 0x7f139815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1396ffd700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139806a4c0 0x7f1398158cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f139000b370 tx=0x7f1390004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f137ffff700 1 -- 172.21.15.81:0/439085183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13900042d0 con 0x7f139806a4c0 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f137ffff700 1 -- 172.21.15.81:0/439085183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1390004450 con 0x7f139806a4c0 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13980b1eb0 con 0x7f139806a4c0 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f137ffff700 1 -- 172.21.15.81:0/439085183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390004800 con 0x7f139806a4c0 2023-11-29T11:13:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13980b4380 con 0x7f139806a4c0 2023-11-29T11:13:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13980b60e0 con 0x7f139806a4c0 2023-11-29T11:13:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f137ffff700 1 -- 172.21.15.81:0/439085183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f139001c440 con 0x7f139806a4c0 2023-11-29T11:13:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f137ffff700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1384064ee0 0x7f1384067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f13967fc700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1384064ee0 0x7f1384067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f137ffff700 1 -- 172.21.15.81:0/439085183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f13900838e0 con 0x7f139806a4c0 2023-11-29T11:13:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.470+0000 7f13967fc700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1384064ee0 0x7f1384067390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13980b5e90 tx=0x7f138c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.478+0000 7f137ffff700 1 -- 172.21.15.81:0/439085183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f13900516d0 con 0x7f139806a4c0 2023-11-29T11:13:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.642+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13980c63c0 con 0x7f139806a4c0 2023-11-29T11:13:40.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.642+0000 7f137ffff700 1 -- 172.21.15.81:0/439085183 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13900200a0 con 0x7f139806a4c0 2023-11-29T11:13:40.648 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1384064ee0 msgr2=0x7f1384067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1384064ee0 0x7f1384067390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13980b5e90 tx=0x7f138c008040 comp rx=0 tx=0).stop 2023-11-29T11:13:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139806a4c0 msgr2=0x7f1398158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139806a4c0 0x7f1398158cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f139000b370 tx=0x7f1390004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 shutdown_connections 2023-11-29T11:13:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1384064ee0 0x7f1384067390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13980cf0e0 0x7f139815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13980b1ae0 0x7f139815d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 --2- 172.21.15.81:0/439085183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139806a4c0 0x7f1398158cf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 >> 172.21.15.81:0/439085183 conn(0x7f139809bbd0 msgr2=0x7f13980af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 shutdown_connections 2023-11-29T11:13:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.646+0000 7f1397fff700 1 -- 172.21.15.81:0/439085183 wait complete. 2023-11-29T11:13:40.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:40.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9f59e700 1 Processor -- start 2023-11-29T11:13:40.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9f59e700 1 -- start start 2023-11-29T11:13:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9da00ae270 0x7f9da00cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 0x7f9da00cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9da00cbc00 0x7f9da00cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da0071a30 con 0x7f9da00ae270 2023-11-29T11:13:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da006c560 con 0x7f9da00cbc00 2023-11-29T11:13:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da006c840 con 0x7f9da00c9430 2023-11-29T11:13:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9da00ae270 0x7f9da00cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9da00ae270 0x7f9da00cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35772/0 (socket says 172.21.15.81:35772) 2023-11-29T11:13:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9e59c700 1 -- 172.21.15.81:0/734092164 learned_addr learned my addr 172.21.15.81:0/734092164 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9ed9d700 1 --2- 172.21.15.81:0/734092164 >> v2:172.21.15.176:3300/0 conn(0x7f9da00cbc00 0x7f9da00cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.782+0000 7f9d9dd9b700 1 --2- 172.21.15.81:0/734092164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 0x7f9da00cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9e59c700 1 -- 172.21.15.81:0/734092164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 msgr2=0x7f9da00cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9e59c700 1 --2- 172.21.15.81:0/734092164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 0x7f9da00cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9e59c700 1 -- 172.21.15.81:0/734092164 >> v2:172.21.15.176:3300/0 conn(0x7f9da00cbc00 msgr2=0x7f9da00cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9e59c700 1 --2- 172.21.15.81:0/734092164 >> v2:172.21.15.176:3300/0 conn(0x7f9da00cbc00 0x7f9da00cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9e59c700 1 -- 172.21.15.81:0/734092164 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da006cb20 con 0x7f9da00ae270 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9e59c700 1 --2- 172.21.15.81:0/734092164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00cae70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9da015fc30 tx=0x7f9d90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93ffc16ea820292 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9d59a700 1 -- 172.21.15.81:0/734092164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90011830 con 0x7f9da00ae270 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9d59a700 1 -- 172.21.15.81:0/734092164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d90011990 con 0x7f9da00ae270 2023-11-29T11:13:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9d59a700 1 -- 172.21.15.81:0/734092164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90011d20 con 0x7f9da00ae270 2023-11-29T11:13:40.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 -- 172.21.15.81:0/734092164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 msgr2=0x7f9da00cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/734092164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00cae70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9da015fc30 tx=0x7f9d90009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 -- 172.21.15.81:0/734092164 shutdown_connections 2023-11-29T11:13:40.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/734092164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 0x7f9da00cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/734092164 >> v2:172.21.15.176:3300/0 conn(0x7f9da00cbc00 0x7f9da00cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/734092164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00cae70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 -- 172.21.15.81:0/734092164 >> 172.21.15.81:0/734092164 conn(0x7f9da00b0990 msgr2=0x7f9da00b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 -- 172.21.15.81:0/734092164 shutdown_connections 2023-11-29T11:13:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.786+0000 7f9d9f59e700 1 -- 172.21.15.81:0/734092164 wait complete. 2023-11-29T11:13:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 Processor -- start 2023-11-29T11:13:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 -- start start 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 0x7f9da00c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da00cbc00 0x7f9da00af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da015abe0 con 0x7f9da00ae270 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00b1d30 con 0x7f9da00cbc00 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00b1fa0 con 0x7f9da00c9430 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35774/0 (socket says 172.21.15.81:35774) 2023-11-29T11:13:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 -- 172.21.15.81:0/3412047721 learned_addr learned my addr 172.21.15.81:0/3412047721 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9dd9b700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 0x7f9da00c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9ed9d700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da00cbc00 0x7f9da00af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 -- 172.21.15.81:0/3412047721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 msgr2=0x7f9da00c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 0x7f9da00c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 -- 172.21.15.81:0/3412047721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da00cbc00 msgr2=0x7f9da00af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da00cbc00 0x7f9da00af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 -- 172.21.15.81:0/3412047721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90009570 con 0x7f9da00ae270 2023-11-29T11:13:40.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9e59c700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00b4880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9da006d6a0 tx=0x7f9d90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d96ffd700 1 -- 172.21.15.81:0/3412047721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90004450 con 0x7f9da00ae270 2023-11-29T11:13:40.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d96ffd700 1 -- 172.21.15.81:0/3412047721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9001e070 con 0x7f9da00ae270 2023-11-29T11:13:40.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da00cb3b0 con 0x7f9da00ae270 2023-11-29T11:13:40.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d96ffd700 1 -- 172.21.15.81:0/3412047721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90003900 con 0x7f9da00ae270 2023-11-29T11:13:40.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.790+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da006ce00 con 0x7f9da00ae270 2023-11-29T11:13:40.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.794+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da00cc080 con 0x7f9da00ae270 2023-11-29T11:13:40.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.794+0000 7f9d96ffd700 1 -- 172.21.15.81:0/3412047721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d9000f050 con 0x7f9da00ae270 2023-11-29T11:13:40.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.794+0000 7f9d96ffd700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d80064ee0 0x7f9d80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:40.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.794+0000 7f9d9dd9b700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d80064ee0 0x7f9d80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:40.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.794+0000 7f9d96ffd700 1 -- 172.21.15.81:0/3412047721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9d900833c0 con 0x7f9da00ae270 2023-11-29T11:13:40.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.798+0000 7f9d9dd9b700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d80064ee0 0x7f9d80067390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9da00ac690 tx=0x7f9d88009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:40.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.802+0000 7f9d96ffd700 1 -- 172.21.15.81:0/3412047721 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9d90051180 con 0x7f9da00ae270 2023-11-29T11:13:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.970+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9da0072500 con 0x7f9da00ae270 2023-11-29T11:13:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.970+0000 7f9d96ffd700 1 -- 172.21.15.81:0/3412047721 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d900547a0 con 0x7f9da00ae270 2023-11-29T11:13:40.975 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d80064ee0 msgr2=0x7f9d80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d80064ee0 0x7f9d80067390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9da00ac690 tx=0x7f9d88009240 comp rx=0 tx=0).stop 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 msgr2=0x7f9da00b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00b4880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9da006d6a0 tx=0x7f9d90004770 comp rx=0 tx=0).stop 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 shutdown_connections 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d80064ee0 0x7f9d80067390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9da00cbc00 0x7f9da00af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9da00c9430 0x7f9da00c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 --2- 172.21.15.81:0/3412047721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00ae270 0x7f9da00b4880 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 >> 172.21.15.81:0/3412047721 conn(0x7f9da00b0990 msgr2=0x7f9da006a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 shutdown_connections 2023-11-29T11:13:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:40.974+0000 7f9d9f59e700 1 -- 172.21.15.81:0/3412047721 wait complete. 2023-11-29T11:13:40.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.098+0000 7f3b4e4fb700 1 Processor -- start 2023-11-29T11:13:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4e4fb700 1 -- start start 2023-11-29T11:13:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4e4fb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b40037b40 0x7f3b400e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4e4fb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b400e0af0 con 0x7f3b400e12a0 2023-11-29T11:13:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4e4fb700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b40050f00 con 0x7f3b400e4f50 2023-11-29T11:13:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4e4fb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b400e45f0 con 0x7f3b40037b40 2023-11-29T11:13:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4d4f9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3b400e12a0 0x7f3b400e1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52542/0 (socket says 172.21.15.81:52542) 2023-11-29T11:13:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4d4f9700 1 -- 172.21.15.81:0/736917754 learned_addr learned my addr 172.21.15.81:0/736917754 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4ccf8700 1 --2- 172.21.15.81:0/736917754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b40037b40 0x7f3b400e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b3ffff700 1 -- 172.21.15.81:0/736917754 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252147918 0 0) 0x7f3b38001110 con 0x7f3b400e12a0 2023-11-29T11:13:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b3ffff700 1 -- 172.21.15.81:0/736917754 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b340035d0 con 0x7f3b400e12a0 2023-11-29T11:13:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b3ffff700 1 -- 172.21.15.81:0/736917754 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997370553 0 0) 0x7f3b40050f00 con 0x7f3b400e4f50 2023-11-29T11:13:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b3ffff700 1 -- 172.21.15.81:0/736917754 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b38001110 con 0x7f3b400e4f50 2023-11-29T11:13:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4ccf8700 1 -- 172.21.15.81:0/736917754 >> v1:172.21.15.176:6789/0 conn(0x7f3b400e4f50 legacy=0x7f3b40036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4ccf8700 1 -- 172.21.15.81:0/736917754 >> v1:172.21.15.81:6789/0 conn(0x7f3b400e12a0 legacy=0x7f3b400e1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4ccf8700 1 -- 172.21.15.81:0/736917754 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b40051150 con 0x7f3b40037b40 2023-11-29T11:13:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b4ccf8700 1 --2- 172.21.15.81:0/736917754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b40037b40 0x7f3b400e4a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009880 tx=0x7f3b44009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b1dc97f150026 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b3ffff700 1 -- 172.21.15.81:0/736917754 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44011830 con 0x7f3b40037b40 2023-11-29T11:13:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b3ffff700 1 -- 172.21.15.81:0/736917754 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44011990 con 0x7f3b40037b40 2023-11-29T11:13:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.102+0000 7f3b3ffff700 1 -- 172.21.15.81:0/736917754 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44011d20 con 0x7f3b40037b40 2023-11-29T11:13:41.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/736917754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b40037b40 msgr2=0x7f3b400e4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 --2- 172.21.15.81:0/736917754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b40037b40 0x7f3b400e4a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009880 tx=0x7f3b44009b90 comp rx=0 tx=0).stop 2023-11-29T11:13:41.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/736917754 shutdown_connections 2023-11-29T11:13:41.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 --2- 172.21.15.81:0/736917754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b40037b40 0x7f3b400e4a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/736917754 >> 172.21.15.81:0/736917754 conn(0x7f3b40051770 msgr2=0x7f3b40051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:41.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/736917754 shutdown_connections 2023-11-29T11:13:41.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/736917754 wait complete. 2023-11-29T11:13:41.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 Processor -- start 2023-11-29T11:13:41.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- start start 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b40037b40 0x7f3b400353e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b400e12a0 0x7f3b400d7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b400e4f50 0x7f3b400341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40035040 con 0x7f3b40037b40 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40035ac0 con 0x7f3b400e12a0 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4e4fb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40035da0 con 0x7f3b400e4f50 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.106+0000 7f3b4d4f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b40037b40 0x7f3b400353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4d4f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b40037b40 0x7f3b400353e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35788/0 (socket says 172.21.15.81:35788) 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4d4f9700 1 -- 172.21.15.81:0/1722189741 learned_addr learned my addr 172.21.15.81:0/1722189741 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4ccf8700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b400e12a0 0x7f3b400d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4dcfa700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b400e4f50 0x7f3b400341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4d4f9700 1 -- 172.21.15.81:0/1722189741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b400e4f50 msgr2=0x7f3b400341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4d4f9700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b400e4f50 0x7f3b400341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4d4f9700 1 -- 172.21.15.81:0/1722189741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b400e12a0 msgr2=0x7f3b400d7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4d4f9700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b400e12a0 0x7f3b400d7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4d4f9700 1 -- 172.21.15.81:0/1722189741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440094b0 con 0x7f3b40037b40 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4d4f9700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b40037b40 0x7f3b400353e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800c700 tx=0x7f3b3800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b3dffb700 1 -- 172.21.15.81:0/1722189741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38005d90 con 0x7f3b40037b40 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b3dffb700 1 -- 172.21.15.81:0/1722189741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b380070d0 con 0x7f3b40037b40 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b3dffb700 1 -- 172.21.15.81:0/1722189741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38007480 con 0x7f3b40037b40 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b400e4210 con 0x7f3b40037b40 2023-11-29T11:13:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b40051430 con 0x7f3b40037b40 2023-11-29T11:13:41.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.110+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b40037f90 con 0x7f3b40037b40 2023-11-29T11:13:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.114+0000 7f3b3dffb700 1 -- 172.21.15.81:0/1722189741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3b38019030 con 0x7f3b40037b40 2023-11-29T11:13:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.114+0000 7f3b3dffb700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b2c064f10 0x7f3b2c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.114+0000 7f3b3dffb700 1 -- 172.21.15.81:0/1722189741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3b38081510 con 0x7f3b40037b40 2023-11-29T11:13:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.114+0000 7f3b4ccf8700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b2c064f10 0x7f3b2c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.114+0000 7f3b4ccf8700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b2c064f10 0x7f3b2c0673c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b44000c00 tx=0x7f3b44010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.118+0000 7f3b3dffb700 1 -- 172.21.15.81:0/1722189741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3b3804f290 con 0x7f3b40037b40 2023-11-29T11:13:41.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.282+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b400e0ad0 con 0x7f3b40037b40 2023-11-29T11:13:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.282+0000 7f3b3dffb700 1 -- 172.21.15.81:0/1722189741 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b380170a0 con 0x7f3b40037b40 2023-11-29T11:13:41.287 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b2c064f10 msgr2=0x7f3b2c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b2c064f10 0x7f3b2c0673c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b44000c00 tx=0x7f3b44010000 comp rx=0 tx=0).stop 2023-11-29T11:13:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b40037b40 msgr2=0x7f3b400353e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b40037b40 0x7f3b400353e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800c700 tx=0x7f3b3800ca10 comp rx=0 tx=0).stop 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 shutdown_connections 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b2c064f10 0x7f3b2c0673c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b400e4f50 0x7f3b400341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b400e12a0 0x7f3b400d7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 --2- 172.21.15.81:0/1722189741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b40037b40 0x7f3b400353e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 >> 172.21.15.81:0/1722189741 conn(0x7f3b40051770 msgr2=0x7f3b400e1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 shutdown_connections 2023-11-29T11:13:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.286+0000 7f3b4e4fb700 1 -- 172.21.15.81:0/1722189741 wait complete. 2023-11-29T11:13:41.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:41.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e6ffa700 1 Processor -- start 2023-11-29T11:13:41.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e6ffa700 1 -- start start 2023-11-29T11:13:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e6ffa700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc1e00b4570 0x7fc1e00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e6ffa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1e006ad00 0x7fc1e00ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e6ffa700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e00d28e0 con 0x7fc1e0069c40 2023-11-29T11:13:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e6ffa700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00cd5c0 con 0x7fc1e006ad00 2023-11-29T11:13:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e6ffa700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00d1730 con 0x7fc1e00b4570 2023-11-29T11:13:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1e006ad00 0x7fc1e00ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e5597700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc1e0069c40 0x7fc1e006a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52546/0 (socket says 172.21.15.81:52546) 2023-11-29T11:13:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e5597700 1 -- 172.21.15.81:0/3173380901 learned_addr learned my addr 172.21.15.81:0/3173380901 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1e4d96700 1 --2- 172.21.15.81:0/3173380901 >> v2:172.21.15.176:3300/0 conn(0x7fc1e00b4570 0x7fc1e00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d7fff700 1 -- 172.21.15.81:0/3173380901 >> v2:172.21.15.176:3300/0 conn(0x7fc1e00b4570 msgr2=0x7fc1e00b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d7fff700 1 --2- 172.21.15.81:0/3173380901 >> v2:172.21.15.176:3300/0 conn(0x7fc1e00b4570 0x7fc1e00b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d7fff700 1 -- 172.21.15.81:0/3173380901 >> v1:172.21.15.81:6789/0 conn(0x7fc1e0069c40 legacy=0x7fc1e006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d7fff700 1 -- 172.21.15.81:0/3173380901 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00b4e80 con 0x7fc1e006ad00 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d77fe700 1 -- 172.21.15.81:0/3173380901 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347084296 0 0) 0x7fc1d8001490 con 0x7fc1e0069c40 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d7fff700 1 --2- 172.21.15.81:0/3173380901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e006ad00 0x7fc1e00ced40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc1e008bd40 tx=0x7fc1d0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c93f545b96f32a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d77fe700 1 -- 172.21.15.81:0/3173380901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0011830 con 0x7fc1e006ad00 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d77fe700 1 -- 172.21.15.81:0/3173380901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0011990 con 0x7fc1e006ad00 2023-11-29T11:13:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.422+0000 7fc1d77fe700 1 -- 172.21.15.81:0/3173380901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0011d20 con 0x7fc1e006ad00 2023-11-29T11:13:41.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3173380901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e006ad00 msgr2=0x7fc1e00ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3173380901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e006ad00 0x7fc1e00ced40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc1e008bd40 tx=0x7fc1d0009b30 comp rx=0 tx=0).stop 2023-11-29T11:13:41.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3173380901 shutdown_connections 2023-11-29T11:13:41.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3173380901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e006ad00 0x7fc1e00ced40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3173380901 >> v2:172.21.15.176:3300/0 conn(0x7fc1e00b4570 0x7fc1e00b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3173380901 >> 172.21.15.81:0/3173380901 conn(0x7fc1e006cac0 msgr2=0x7fc1e00cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:41.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3173380901 shutdown_connections 2023-11-29T11:13:41.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3173380901 wait complete. 2023-11-29T11:13:41.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 Processor -- start 2023-11-29T11:13:41.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.426+0000 7fc1e6ffa700 1 -- start start 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e0069c40 0x7fc1e01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e006ad00 0x7fc1e015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e00b4570 0x7fc1e01f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0150a40 con 0x7fc1e0069c40 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e015d870 con 0x7fc1e006ad00 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01581f0 con 0x7fc1e00b4570 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e0069c40 0x7fc1e01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e0069c40 0x7fc1e01596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35818/0 (socket says 172.21.15.81:35818) 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 -- 172.21.15.81:0/3369821321 learned_addr learned my addr 172.21.15.81:0/3369821321 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1d7fff700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e006ad00 0x7fc1e015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e5597700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e00b4570 0x7fc1e01f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 -- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e00b4570 msgr2=0x7fc1e01f13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e00b4570 0x7fc1e01f13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 -- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e006ad00 msgr2=0x7fc1e015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e006ad00 0x7fc1e015c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 -- 172.21.15.81:0/3369821321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00094b0 con 0x7fc1e0069c40 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e5597700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e00b4570 0x7fc1e01f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e4d96700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e0069c40 0x7fc1e01596a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00e9d0 tx=0x7fc1dc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1d57fa700 1 -- 172.21.15.81:0/3369821321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc009720 con 0x7fc1e0069c40 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1d57fa700 1 -- 172.21.15.81:0/3369821321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc00c850 con 0x7fc1e0069c40 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e00d1450 con 0x7fc1e0069c40 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1d57fa700 1 -- 172.21.15.81:0/3369821321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00cbc0 con 0x7fc1e0069c40 2023-11-29T11:13:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e00d1170 con 0x7fc1e0069c40 2023-11-29T11:13:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.430+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e00cd1e0 con 0x7fc1e0069c40 2023-11-29T11:13:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.434+0000 7fc1d57fa700 1 -- 172.21.15.81:0/3369821321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc1dc019030 con 0x7fc1e0069c40 2023-11-29T11:13:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.434+0000 7fc1d57fa700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1cc064ee0 0x7fc1cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.434+0000 7fc1d57fa700 1 -- 172.21.15.81:0/3369821321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc1dc0822c0 con 0x7fc1e0069c40 2023-11-29T11:13:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.434+0000 7fc1d7fff700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1cc064ee0 0x7fc1cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.434+0000 7fc1d7fff700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1cc064ee0 0x7fc1cc067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009fd0 tx=0x7fc1d0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.438+0000 7fc1d57fa700 1 -- 172.21.15.81:0/3369821321 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc1dc04ffc0 con 0x7fc1e0069c40 2023-11-29T11:13:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc1e01f1910 con 0x7fc1e0069c40 2023-11-29T11:13:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1d57fa700 1 -- 172.21.15.81:0/3369821321 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc1dc0535e0 con 0x7fc1e0069c40 2023-11-29T11:13:41.601 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1cc064ee0 msgr2=0x7fc1cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1cc064ee0 0x7fc1cc067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009fd0 tx=0x7fc1d0008030 comp rx=0 tx=0).stop 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e0069c40 msgr2=0x7fc1e01596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e0069c40 0x7fc1e01596a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00e9d0 tx=0x7fc1dc00ece0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 shutdown_connections 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1cc064ee0 0x7fc1cc067390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e00b4570 0x7fc1e01f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e006ad00 0x7fc1e015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 --2- 172.21.15.81:0/3369821321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e0069c40 0x7fc1e01596a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 >> 172.21.15.81:0/3369821321 conn(0x7fc1e006cac0 msgr2=0x7fc1e00b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 shutdown_connections 2023-11-29T11:13:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.598+0000 7fc1e6ffa700 1 -- 172.21.15.81:0/3369821321 wait complete. 2023-11-29T11:13:41.623 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:13:41.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-29T11:13:41.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f266238a700 1 Processor -- start 2023-11-29T11:13:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f266238a700 1 -- start start 2023-11-29T11:13:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f266238a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c159e70 0x7f265c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f266238a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f265c0cb470 0x7f265c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f266238a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265c06ace0 con 0x7f265c069c40 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f266238a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c06a0d0 con 0x7f265c0cb470 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f266238a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c06a3b0 con 0x7f265c159e70 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f2660b87700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f265c069c40 0x7f265c0cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52556/0 (socket says 172.21.15.81:52556) 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f2660b87700 1 -- 172.21.15.81:0/713761302 learned_addr learned my addr 172.21.15.81:0/713761302 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.729+0000 7f2661b89700 1 --2- 172.21.15.81:0/713761302 >> v2:172.21.15.81:3300/0 conn(0x7f265c0cb470 0x7f265c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661388700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c159e70 0x7f265c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768444967 0 0) 0x7f265c06ace0 con 0x7f265c069c40 2023-11-29T11:13:41.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26480035d0 con 0x7f265c069c40 2023-11-29T11:13:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4215137101 0 0) 0x7f26480035d0 con 0x7f265c069c40 2023-11-29T11:13:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c159e70 msgr2=0x7f265c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c159e70 0x7f265c06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 >> v2:172.21.15.81:3300/0 conn(0x7f265c0cb470 msgr2=0x7f265c0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 --2- 172.21.15.81:0/713761302 >> v2:172.21.15.81:3300/0 conn(0x7f265c0cb470 0x7f265c0c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c06a690 con 0x7f265c069c40 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f26540019f0 con 0x7f265c069c40 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661b89700 1 --2- 172.21.15.81:0/713761302 >> v2:172.21.15.81:3300/0 conn(0x7f265c0cb470 0x7f265c0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 >> v1:172.21.15.81:6789/0 conn(0x7f265c069c40 legacy=0x7f265c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2648003a20 0x7f2648003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c159e70 0x7f2648004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648004db0 0x7f2648005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c06a0d0 con 0x7f2648003a20 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c06a3b0 con 0x7f2648004db0 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264800ba30 con 0x7f265c159e70 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661388700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2648003a20 0x7f2648003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661b89700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648004db0 0x7f2648005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2660b87700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c159e70 0x7f2648004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661388700 1 -- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c159e70 msgr2=0x7f2648004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661388700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c159e70 0x7f2648004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661388700 1 -- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648004db0 msgr2=0x7f2648005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:41.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661388700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648004db0 0x7f2648005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661388700 1 -- 172.21.15.81:0/713761302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480035d0 con 0x7f2648003a20 2023-11-29T11:13:41.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661b89700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648004db0 0x7f2648005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:41.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661388700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2648003a20 0x7f2648003e30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f264c009ba0 tx=0x7f26480058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14b9b53705a6a48 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00e660 con 0x7f2648003a20 2023-11-29T11:13:41.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c00e7c0 con 0x7f2648003a20 2023-11-29T11:13:41.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2653fff700 1 -- 172.21.15.81:0/713761302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00eb30 con 0x7f2648003a20 2023-11-29T11:13:41.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f266238a700 1 -- 172.21.15.81:0/713761302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2648003a20 msgr2=0x7f2648003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f266238a700 1 --2- 172.21.15.81:0/713761302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2648003a20 0x7f2648003e30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f264c009ba0 tx=0x7f26480058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f2661b89700 1 -- 172.21.15.81:0/713761302 reap_dead start 2023-11-29T11:13:41.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f266238a700 1 -- 172.21.15.81:0/713761302 shutdown_connections 2023-11-29T11:13:41.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f266238a700 1 -- 172.21.15.81:0/713761302 >> 172.21.15.81:0/713761302 conn(0x7f265c0ce3e0 msgr2=0x7f265c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:41.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f266238a700 1 -- 172.21.15.81:0/713761302 shutdown_connections 2023-11-29T11:13:41.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.733+0000 7f266238a700 1 -- 172.21.15.81:0/713761302 wait complete. 2023-11-29T11:13:41.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f266238a700 1 Processor -- start 2023-11-29T11:13:41.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f266238a700 1 -- start start 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f266238a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648003a20 0x7f265c0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f266238a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f265c097b50 0x7f265c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f266238a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c0af9e0 0x7f265c0ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f266238a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0c3630 con 0x7f265c097b50 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f266238a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1e4090 con 0x7f2648003a20 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f266238a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1f00b0 con 0x7f265c0af9e0 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f2660b87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f265c097b50 0x7f265c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f2660b87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f265c097b50 0x7f265c0af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35840/0 (socket says 172.21.15.81:35840) 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.737+0000 7f2660b87700 1 -- 172.21.15.81:0/3795910386 learned_addr learned my addr 172.21.15.81:0/3795910386 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2661388700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648003a20 0x7f265c0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2661b89700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c0af9e0 0x7f265c0ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2660b87700 1 -- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c0af9e0 msgr2=0x7f265c0ac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2660b87700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c0af9e0 0x7f265c0ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2660b87700 1 -- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648003a20 msgr2=0x7f265c0ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2660b87700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648003a20 0x7f265c0ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2660b87700 1 -- 172.21.15.81:0/3795910386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c15a240 con 0x7f265c097b50 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2661388700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648003a20 0x7f265c0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2660b87700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f265c097b50 0x7f265c0af4a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2654007110 tx=0x7f26540071f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2651ffb700 1 -- 172.21.15.81:0/3795910386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654007b30 con 0x7f265c097b50 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2651ffb700 1 -- 172.21.15.81:0/3795910386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26540133f0 con 0x7f265c097b50 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c06a970 con 0x7f265c097b50 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2651ffb700 1 -- 172.21.15.81:0/3795910386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654013780 con 0x7f265c097b50 2023-11-29T11:13:41.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c06c9a0 con 0x7f265c097b50 2023-11-29T11:13:41.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2651ffb700 1 -- 172.21.15.81:0/3795910386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f26540138e0 con 0x7f265c097b50 2023-11-29T11:13:41.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c072500 con 0x7f265c097b50 2023-11-29T11:13:41.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2651ffb700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2640064f10 0x7f26400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:41.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2651ffb700 1 -- 172.21.15.81:0/3795910386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2654082d40 con 0x7f265c097b50 2023-11-29T11:13:41.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.741+0000 7f2661388700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2640064f10 0x7f26400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:41.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.745+0000 7f2661388700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2640064f10 0x7f26400673c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f264c000c00 tx=0x7f264c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:41.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.749+0000 7f2651ffb700 1 -- 172.21.15.81:0/3795910386 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2654050b30 con 0x7f265c097b50 2023-11-29T11:13:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:41.969+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f265c1e42e0 con 0x7f265c097b50 2023-11-29T11:13:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.025+0000 7f2651ffb700 1 -- 172.21.15.81:0/3795910386 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v57) v1 ==== 145+0+0 (secure 0 0 0) 0x7f2654054150 con 0x7f265c097b50 2023-11-29T11:13:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2640064f10 msgr2=0x7f26400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2640064f10 0x7f26400673c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f264c000c00 tx=0x7f264c008030 comp rx=0 tx=0).stop 2023-11-29T11:13:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f265c097b50 msgr2=0x7f265c0af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f265c097b50 0x7f265c0af4a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2654007110 tx=0x7f26540071f0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 shutdown_connections 2023-11-29T11:13:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2640064f10 0x7f26400673c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f265c0af9e0 0x7f265c0ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f265c097b50 0x7f265c0af4a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 --2- 172.21.15.81:0/3795910386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2648003a20 0x7f265c0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 >> 172.21.15.81:0/3795910386 conn(0x7f265c0ce3e0 msgr2=0x7f265c0ab310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 shutdown_connections 2023-11-29T11:13:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.029+0000 7f266238a700 1 -- 172.21.15.81:0/3795910386 wait complete. 2023-11-29T11:13:42.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-29T11:13:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b5cc41700 1 Processor -- start 2023-11-29T11:13:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b5cc41700 1 -- start start 2023-11-29T11:13:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b5cc41700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e12a0 0x7f2b50037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b5cc41700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b500e0af0 con 0x7f2b50036770 2023-11-29T11:13:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b5cc41700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b50050f00 con 0x7f2b500e1670 2023-11-29T11:13:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b5cc41700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500e45f0 con 0x7f2b500e12a0 2023-11-29T11:13:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b57fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2b50036770 0x7f2b5004f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52568/0 (socket says 172.21.15.81:52568) 2023-11-29T11:13:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b57fff700 1 -- 172.21.15.81:0/2764265373 learned_addr learned my addr 172.21.15.81:0/2764265373 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b577fe700 1 --2- 172.21.15.81:0/2764265373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e12a0 0x7f2b50037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.169+0000 7f2b567fc700 1 -- 172.21.15.81:0/2764265373 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617616059 0 0) 0x7f2b5804e720 con 0x7f2b50036770 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b567fc700 1 -- 172.21.15.81:0/2764265373 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b400035d0 con 0x7f2b50036770 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b567fc700 1 -- 172.21.15.81:0/2764265373 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123902296 0 0) 0x7f2b50050f00 con 0x7f2b500e1670 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b567fc700 1 -- 172.21.15.81:0/2764265373 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b5804e720 con 0x7f2b500e1670 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b577fe700 1 -- 172.21.15.81:0/2764265373 >> v1:172.21.15.176:6789/0 conn(0x7f2b500e1670 legacy=0x7f2b500e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b577fe700 1 -- 172.21.15.81:0/2764265373 >> v1:172.21.15.81:6789/0 conn(0x7f2b50036770 legacy=0x7f2b5004f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b577fe700 1 -- 172.21.15.81:0/2764265373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50051150 con 0x7f2b500e12a0 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b577fe700 1 --2- 172.21.15.81:0/2764265373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e12a0 0x7f2b50037b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009880 tx=0x7f2b48009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=401387f28437abec server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b567fc700 1 -- 172.21.15.81:0/2764265373 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48011830 con 0x7f2b500e12a0 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b567fc700 1 -- 172.21.15.81:0/2764265373 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b48011990 con 0x7f2b500e12a0 2023-11-29T11:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b567fc700 1 -- 172.21.15.81:0/2764265373 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48011d00 con 0x7f2b500e12a0 2023-11-29T11:13:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 -- 172.21.15.81:0/2764265373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e12a0 msgr2=0x7f2b50037b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 --2- 172.21.15.81:0/2764265373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e12a0 0x7f2b50037b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009880 tx=0x7f2b48009b90 comp rx=0 tx=0).stop 2023-11-29T11:13:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 -- 172.21.15.81:0/2764265373 shutdown_connections 2023-11-29T11:13:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 --2- 172.21.15.81:0/2764265373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e12a0 0x7f2b50037b40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 -- 172.21.15.81:0/2764265373 >> 172.21.15.81:0/2764265373 conn(0x7f2b50051770 msgr2=0x7f2b50051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 -- 172.21.15.81:0/2764265373 shutdown_connections 2023-11-29T11:13:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 -- 172.21.15.81:0/2764265373 wait complete. 2023-11-29T11:13:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 Processor -- start 2023-11-29T11:13:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.173+0000 7f2b5cc41700 1 -- start start 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b5cc41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50036770 0x7f2b50179260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b5cc41700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b500e12a0 0x7f2b50006550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b5cc41700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e1670 0x7f2b500e2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b5cc41700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5017a1e0 con 0x7f2b50036770 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b5cc41700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50179940 con 0x7f2b500e12a0 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b5cc41700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50179c20 con 0x7f2b500e1670 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50036770 0x7f2b50179260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50036770 0x7f2b50179260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35844/0 (socket says 172.21.15.81:35844) 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 -- 172.21.15.81:0/1617905869 learned_addr learned my addr 172.21.15.81:0/1617905869 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b57fff700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e1670 0x7f2b500e2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b56ffd700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b500e12a0 0x7f2b50006550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 -- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e1670 msgr2=0x7f2b500e2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e1670 0x7f2b500e2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 -- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b500e12a0 msgr2=0x7f2b50006550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b500e12a0 0x7f2b50006550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 -- 172.21.15.81:0/1617905869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480094b0 con 0x7f2b50036770 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b56ffd700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b500e12a0 0x7f2b50006550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b577fe700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50036770 0x7f2b50179260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2b480090b0 tx=0x7f2b48004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b3ffff700 1 -- 172.21.15.81:0/1617905869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b480045d0 con 0x7f2b50036770 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b3ffff700 1 -- 172.21.15.81:0/1617905869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b480036c0 con 0x7f2b50036770 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b3ffff700 1 -- 172.21.15.81:0/1617905869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48003a50 con 0x7f2b50036770 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b500e4210 con 0x7f2b50036770 2023-11-29T11:13:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.177+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b50051430 con 0x7f2b50036770 2023-11-29T11:13:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.181+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b500e5120 con 0x7f2b50036770 2023-11-29T11:13:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.181+0000 7f2b3ffff700 1 -- 172.21.15.81:0/1617905869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2b4800f050 con 0x7f2b50036770 2023-11-29T11:13:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.181+0000 7f2b3ffff700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b44064ee0 0x7f2b44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.181+0000 7f2b3ffff700 1 -- 172.21.15.81:0/1617905869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b48083650 con 0x7f2b50036770 2023-11-29T11:13:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.181+0000 7f2b56ffd700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b44064ee0 0x7f2b44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.181+0000 7f2b56ffd700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b44064ee0 0x7f2b44067390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2b500e3420 tx=0x7f2b4c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.185+0000 7f2b3ffff700 1 -- 172.21.15.81:0/1617905869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2b480514c0 con 0x7f2b50036770 2023-11-29T11:13:42.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.349+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2b50005570 con 0x7f2b50036770 2023-11-29T11:13:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.357+0000 7f2b3ffff700 1 -- 172.21.15.81:0/1617905869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2b4802a0c0 con 0x7f2b50036770 2023-11-29T11:13:42.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b44064ee0 msgr2=0x7f2b44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b44064ee0 0x7f2b44067390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2b500e3420 tx=0x7f2b4c009040 comp rx=0 tx=0).stop 2023-11-29T11:13:42.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50036770 msgr2=0x7f2b50179260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50036770 0x7f2b50179260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2b480090b0 tx=0x7f2b48004770 comp rx=0 tx=0).stop 2023-11-29T11:13:42.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 shutdown_connections 2023-11-29T11:13:42.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2b44064ee0 0x7f2b44067390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b500e1670 0x7f2b500e2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b500e12a0 0x7f2b50006550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 --2- 172.21.15.81:0/1617905869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50036770 0x7f2b50179260 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 >> 172.21.15.81:0/1617905869 conn(0x7f2b50051770 msgr2=0x7f2b500ded70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:42.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 shutdown_connections 2023-11-29T11:13:42.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.361+0000 7f2b5cc41700 1 -- 172.21.15.81:0/1617905869 wait complete. 2023-11-29T11:13:42.381 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:13:42.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:13:42.399 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:13:42.417 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:13:42.417 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:13:42.417 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:42.423 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:13:42.423 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:42.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.585+0000 7efc548ca700 1 Processor -- start 2023-11-29T11:13:42.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.585+0000 7efc548ca700 1 -- start start 2023-11-29T11:13:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efc50158ef0 0x7efc500c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 0x7efc500cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efc500cad50 0x7efc500cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500ce290 con 0x7efc50158ef0 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500cb710 con 0x7efc500cad50 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500adcc0 con 0x7efc500ad490 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efc50158ef0 0x7efc500c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efc50158ef0 0x7efc500c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35848/0 (socket says 172.21.15.81:35848) 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 -- 172.21.15.81:0/3921303763 learned_addr learned my addr 172.21.15.81:0/3921303763 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 -- 172.21.15.81:0/3921303763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 msgr2=0x7efc500cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4f59e700 1 --2- 172.21.15.81:0/3921303763 >> v2:172.21.15.176:3300/0 conn(0x7efc500cad50 0x7efc500cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 --2- 172.21.15.81:0/3921303763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 0x7efc500cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 -- 172.21.15.81:0/3921303763 >> v2:172.21.15.176:3300/0 conn(0x7efc500cad50 msgr2=0x7efc500cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 --2- 172.21.15.81:0/3921303763 >> v2:172.21.15.176:3300/0 conn(0x7efc500cad50 0x7efc500cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 -- 172.21.15.81:0/3921303763 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500cde00 con 0x7efc50158ef0 2023-11-29T11:13:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4f59e700 1 --2- 172.21.15.81:0/3921303763 >> v2:172.21.15.176:3300/0 conn(0x7efc500cad50 0x7efc500cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4ed9d700 1 --2- 172.21.15.81:0/3921303763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50158ef0 0x7efc500c8a30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efc40009940 tx=0x7efc40009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c6125ad0a8fa0a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4dd9b700 1 -- 172.21.15.81:0/3921303763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000b9e0 con 0x7efc50158ef0 2023-11-29T11:13:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4dd9b700 1 -- 172.21.15.81:0/3921303763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40009e90 con 0x7efc50158ef0 2023-11-29T11:13:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc4dd9b700 1 -- 172.21.15.81:0/3921303763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000bd60 con 0x7efc50158ef0 2023-11-29T11:13:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 -- 172.21.15.81:0/3921303763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50158ef0 msgr2=0x7efc500c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 --2- 172.21.15.81:0/3921303763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50158ef0 0x7efc500c8a30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efc40009940 tx=0x7efc40009c50 comp rx=0 tx=0).stop 2023-11-29T11:13:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 -- 172.21.15.81:0/3921303763 shutdown_connections 2023-11-29T11:13:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 --2- 172.21.15.81:0/3921303763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 0x7efc500cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 --2- 172.21.15.81:0/3921303763 >> v2:172.21.15.176:3300/0 conn(0x7efc500cad50 0x7efc500cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 --2- 172.21.15.81:0/3921303763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50158ef0 0x7efc500c8a30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 -- 172.21.15.81:0/3921303763 >> 172.21.15.81:0/3921303763 conn(0x7efc500ce3e0 msgr2=0x7efc500ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 -- 172.21.15.81:0/3921303763 shutdown_connections 2023-11-29T11:13:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.589+0000 7efc548ca700 1 -- 172.21.15.81:0/3921303763 wait complete. 2023-11-29T11:13:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 Processor -- start 2023-11-29T11:13:42.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 -- start start 2023-11-29T11:13:42.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 0x7efc500978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc500cad50 0x7efc501509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50158ef0 0x7efc50150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc50165a10 con 0x7efc500cad50 2023-11-29T11:13:42.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc50165200 con 0x7efc50158ef0 2023-11-29T11:13:42.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc50152590 con 0x7efc500ad490 2023-11-29T11:13:42.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc500cad50 0x7efc501509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc500cad50 0x7efc501509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35852/0 (socket says 172.21.15.81:35852) 2023-11-29T11:13:42.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 -- 172.21.15.81:0/427236176 learned_addr learned my addr 172.21.15.81:0/427236176 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:42.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4f59e700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50158ef0 0x7efc50150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4ed9d700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 0x7efc500978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 -- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 msgr2=0x7efc500978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 0x7efc500978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 -- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50158ef0 msgr2=0x7efc50150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50158ef0 0x7efc50150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 -- 172.21.15.81:0/427236176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40009570 con 0x7efc500cad50 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4f59e700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50158ef0 0x7efc50150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc4e59c700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc500cad50 0x7efc501509d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc4400b550 tx=0x7efc4400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc377fe700 1 -- 172.21.15.81:0/427236176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44011830 con 0x7efc500cad50 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc377fe700 1 -- 172.21.15.81:0/427236176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc44011990 con 0x7efc500cad50 2023-11-29T11:13:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5006d910 con 0x7efc500cad50 2023-11-29T11:13:42.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc377fe700 1 -- 172.21.15.81:0/427236176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44011d40 con 0x7efc500cad50 2023-11-29T11:13:42.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.593+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5006d630 con 0x7efc500cad50 2023-11-29T11:13:42.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.597+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5006dbf0 con 0x7efc500cad50 2023-11-29T11:13:42.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.597+0000 7efc377fe700 1 -- 172.21.15.81:0/427236176 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efc44021070 con 0x7efc500cad50 2023-11-29T11:13:42.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.597+0000 7efc377fe700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc3c064ee0 0x7efc3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.597+0000 7efc377fe700 1 -- 172.21.15.81:0/427236176 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efc44081fb0 con 0x7efc500cad50 2023-11-29T11:13:42.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.597+0000 7efc4ed9d700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc3c064ee0 0x7efc3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.597+0000 7efc4ed9d700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc3c064ee0 0x7efc3c067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efc40014040 tx=0x7efc40008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.601+0000 7efc377fe700 1 -- 172.21.15.81:0/427236176 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efc4404fe20 con 0x7efc500cad50 2023-11-29T11:13:42.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.765+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc501523f0 con 0x7efc500cad50 2023-11-29T11:13:42.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc377fe700 1 -- 172.21.15.81:0/427236176 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7efc501523f0 con 0x7efc500cad50 2023-11-29T11:13:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:42.774 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc3c064ee0 msgr2=0x7efc3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc3c064ee0 0x7efc3c067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efc40014040 tx=0x7efc40008030 comp rx=0 tx=0).stop 2023-11-29T11:13:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc500cad50 msgr2=0x7efc501509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc500cad50 0x7efc501509d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc4400b550 tx=0x7efc4400b860 comp rx=0 tx=0).stop 2023-11-29T11:13:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 shutdown_connections 2023-11-29T11:13:42.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc3c064ee0 0x7efc3c067390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc50158ef0 0x7efc50150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc500cad50 0x7efc501509d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 --2- 172.21.15.81:0/427236176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc500ad490 0x7efc500978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 >> 172.21.15.81:0/427236176 conn(0x7efc500ce3e0 msgr2=0x7efc500ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:42.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 shutdown_connections 2023-11-29T11:13:42.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.769+0000 7efc548ca700 1 -- 172.21.15.81:0/427236176 wait complete. 2023-11-29T11:13:42.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:42.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f1881b700 1 Processor -- start 2023-11-29T11:13:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f1881b700 1 -- start start 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f1881b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f1415bb80 0x7f5f140b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f1881b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5f1406b370 0x7f5f1415c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f1881b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f140ccd00 con 0x7f5f140aaf40 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f1881b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140b19b0 con 0x7f5f1415bb80 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f1881b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140cd510 con 0x7f5f1406b370 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f12d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f1415bb80 0x7f5f140b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f12d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f1415bb80 0x7f5f140b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35862/0 (socket says 172.21.15.81:35862) 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f12d9d700 1 -- 172.21.15.81:0/2704809704 learned_addr learned my addr 172.21.15.81:0/2704809704 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f1359e700 1 --2- 172.21.15.81:0/2704809704 >> v2:172.21.15.176:3300/0 conn(0x7f5f1406b370 0x7f5f1415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f12d9d700 1 -- 172.21.15.81:0/2704809704 >> v2:172.21.15.176:3300/0 conn(0x7f5f1406b370 msgr2=0x7f5f1415c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f12d9d700 1 --2- 172.21.15.81:0/2704809704 >> v2:172.21.15.176:3300/0 conn(0x7f5f1406b370 0x7f5f1415c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f12d9d700 1 -- 172.21.15.81:0/2704809704 >> v1:172.21.15.176:6789/0 conn(0x7f5f140aaf40 legacy=0x7f5f140b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.897+0000 7f5f12d9d700 1 -- 172.21.15.81:0/2704809704 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140ccf50 con 0x7f5f1415bb80 2023-11-29T11:13:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f12d9d700 1 --2- 172.21.15.81:0/2704809704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1415bb80 0x7f5f140b2450 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5f140cadb0 tx=0x7f5f0800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de01b5370c3d3cc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f11d9b700 1 -- 172.21.15.81:0/2704809704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800dbf0 con 0x7f5f1415bb80 2023-11-29T11:13:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f11d9b700 1 -- 172.21.15.81:0/2704809704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800dd50 con 0x7f5f1415bb80 2023-11-29T11:13:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f11d9b700 1 -- 172.21.15.81:0/2704809704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08004250 con 0x7f5f1415bb80 2023-11-29T11:13:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 -- 172.21.15.81:0/2704809704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1415bb80 msgr2=0x7f5f140b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 --2- 172.21.15.81:0/2704809704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1415bb80 0x7f5f140b2450 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5f140cadb0 tx=0x7f5f0800bea0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 -- 172.21.15.81:0/2704809704 shutdown_connections 2023-11-29T11:13:42.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 --2- 172.21.15.81:0/2704809704 >> v2:172.21.15.176:3300/0 conn(0x7f5f1406b370 0x7f5f1415c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 --2- 172.21.15.81:0/2704809704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1415bb80 0x7f5f140b2450 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 -- 172.21.15.81:0/2704809704 >> 172.21.15.81:0/2704809704 conn(0x7f5f140cae70 msgr2=0x7f5f140cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:42.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 -- 172.21.15.81:0/2704809704 shutdown_connections 2023-11-29T11:13:42.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 -- 172.21.15.81:0/2704809704 wait complete. 2023-11-29T11:13:42.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 Processor -- start 2023-11-29T11:13:42.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.901+0000 7f5f1881b700 1 -- start start 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1406b370 0x7f5f141e21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f140aaf40 0x7f5f1414d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1415bb80 0x7f5f140c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140989e0 con 0x7f5f140aaf40 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1414dc70 con 0x7f5f1406b370 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140c7900 con 0x7f5f1415bb80 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f140aaf40 0x7f5f1414d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f140aaf40 0x7f5f1414d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35870/0 (socket says 172.21.15.81:35870) 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 -- 172.21.15.81:0/4005631556 learned_addr learned my addr 172.21.15.81:0/4005631556 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f12d9d700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1406b370 0x7f5f141e21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1359e700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1415bb80 0x7f5f140c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 -- 172.21.15.81:0/4005631556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1415bb80 msgr2=0x7f5f140c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1415bb80 0x7f5f140c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 -- 172.21.15.81:0/4005631556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1406b370 msgr2=0x7f5f141e21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:42.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1406b370 0x7f5f141e21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:42.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 -- 172.21.15.81:0/4005631556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0800b820 con 0x7f5f140aaf40 2023-11-29T11:13:42.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1259c700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f140aaf40 0x7f5f1414d730 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5f04001ed0 tx=0x7f5f040021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5efb7fe700 1 -- 172.21.15.81:0/4005631556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04003c20 con 0x7f5f140aaf40 2023-11-29T11:13:42.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5efb7fe700 1 -- 172.21.15.81:0/4005631556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04003d80 con 0x7f5f140aaf40 2023-11-29T11:13:42.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f140b1c50 con 0x7f5f140aaf40 2023-11-29T11:13:42.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5efb7fe700 1 -- 172.21.15.81:0/4005631556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400abf0 con 0x7f5f140aaf40 2023-11-29T11:13:42.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f140cd230 con 0x7f5f140aaf40 2023-11-29T11:13:42.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f140b1f30 con 0x7f5f140aaf40 2023-11-29T11:13:42.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.905+0000 7f5efb7fe700 1 -- 172.21.15.81:0/4005631556 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f04010050 con 0x7f5f140aaf40 2023-11-29T11:13:42.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.909+0000 7f5efb7fe700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064ee0 0x7f5f00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.909+0000 7f5efb7fe700 1 -- 172.21.15.81:0/4005631556 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5f040821a0 con 0x7f5f140aaf40 2023-11-29T11:13:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.909+0000 7f5f12d9d700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064ee0 0x7f5f00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.909+0000 7f5f12d9d700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064ee0 0x7f5f00067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5f08019040 tx=0x7f5f08014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:42.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:42.913+0000 7f5efb7fe700 1 -- 172.21.15.81:0/4005631556 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f0404ff90 con 0x7f5f140aaf40 2023-11-29T11:13:43.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.077+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f14072530 con 0x7f5f140aaf40 2023-11-29T11:13:43.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.077+0000 7f5efb7fe700 1 -- 172.21.15.81:0/4005631556 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f040535b0 con 0x7f5f140aaf40 2023-11-29T11:13:43.084 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064ee0 msgr2=0x7f5f00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064ee0 0x7f5f00067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5f08019040 tx=0x7f5f08014000 comp rx=0 tx=0).stop 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f140aaf40 msgr2=0x7f5f1414d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f140aaf40 0x7f5f1414d730 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5f04001ed0 tx=0x7f5f040021e0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 shutdown_connections 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064ee0 0x7f5f00067390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1415bb80 0x7f5f140c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f140aaf40 0x7f5f1414d730 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 --2- 172.21.15.81:0/4005631556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1406b370 0x7f5f141e21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 >> 172.21.15.81:0/4005631556 conn(0x7f5f140cae70 msgr2=0x7f5f140ac340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 shutdown_connections 2023-11-29T11:13:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.081+0000 7f5f1881b700 1 -- 172.21.15.81:0/4005631556 wait complete. 2023-11-29T11:13:43.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be7fff700 1 Processor -- start 2023-11-29T11:13:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be7fff700 1 -- start start 2023-11-29T11:13:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1be806f010 0x7f1be8161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be8163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be7fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be815a3a0 con 0x7f1be806a6e0 2023-11-29T11:13:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be7fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be80ca430 con 0x7f1be806f010 2023-11-29T11:13:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80ca710 con 0x7f1be80cbaf0 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be67fc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1be806f010 0x7f1be8161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be77fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be8163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be67fc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1be806f010 0x7f1be8161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:35380/0 (socket says 172.21.15.81:35380) 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be67fc700 1 -- 172.21.15.81:0/3107150529 learned_addr learned my addr 172.21.15.81:0/3107150529 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be77fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be8163fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:42014/0 (socket says 172.21.15.81:42014) 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.209+0000 7f1be6ffd700 1 --1- 172.21.15.81:0/3107150529 >> v1:172.21.15.176:6789/0 conn(0x7f1be806a6e0 0x7f1be806aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:53376/0 (socket says 172.21.15.81:53376) 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be67fc700 1 -- 172.21.15.81:0/3107150529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 msgr2=0x7f1be8163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be67fc700 1 --2- 172.21.15.81:0/3107150529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be8163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be67fc700 1 -- 172.21.15.81:0/3107150529 >> v1:172.21.15.176:6789/0 conn(0x7f1be806a6e0 legacy=0x7f1be806aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be67fc700 1 -- 172.21.15.81:0/3107150529 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80ca9f0 con 0x7f1be806f010 2023-11-29T11:13:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be77fe700 1 --2- 172.21.15.81:0/3107150529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be8163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be67fc700 1 --2- 172.21.15.81:0/3107150529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806f010 0x7f1be8161a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009910 tx=0x7f1bd0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=972718ec3310a074 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be5ffb700 1 -- 172.21.15.81:0/3107150529 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0005e50 con 0x7f1be806f010 2023-11-29T11:13:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be5ffb700 1 -- 172.21.15.81:0/3107150529 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0006030 con 0x7f1be806f010 2023-11-29T11:13:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be5ffb700 1 -- 172.21.15.81:0/3107150529 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00063e0 con 0x7f1be806f010 2023-11-29T11:13:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be7fff700 1 -- 172.21.15.81:0/3107150529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806f010 msgr2=0x7f1be8161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be7fff700 1 --2- 172.21.15.81:0/3107150529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806f010 0x7f1be8161a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009910 tx=0x7f1bd0009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be7fff700 1 -- 172.21.15.81:0/3107150529 shutdown_connections 2023-11-29T11:13:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be7fff700 1 --2- 172.21.15.81:0/3107150529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be8163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be7fff700 1 --2- 172.21.15.81:0/3107150529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806f010 0x7f1be8161a60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be7fff700 1 -- 172.21.15.81:0/3107150529 >> 172.21.15.81:0/3107150529 conn(0x7f1be80d0240 msgr2=0x7f1be80cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be7fff700 1 -- 172.21.15.81:0/3107150529 shutdown_connections 2023-11-29T11:13:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.213+0000 7f1be7fff700 1 -- 172.21.15.81:0/3107150529 wait complete. 2023-11-29T11:13:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 Processor -- start 2023-11-29T11:13:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 -- start start 2023-11-29T11:13:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806a6e0 0x7f1be80c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806f010 0x7f1be80b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be81f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be81f0020 con 0x7f1be806f010 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80c87b0 con 0x7f1be806a6e0 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80c8a90 con 0x7f1be80cbaf0 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806f010 0x7f1be80b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806f010 0x7f1be80b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35884/0 (socket says 172.21.15.81:35884) 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 -- 172.21.15.81:0/37494457 learned_addr learned my addr 172.21.15.81:0/37494457 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be6ffd700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806a6e0 0x7f1be80c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be77fe700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be81f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 -- 172.21.15.81:0/37494457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 msgr2=0x7f1be81f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be81f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 -- 172.21.15.81:0/37494457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806a6e0 msgr2=0x7f1be80c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806a6e0 0x7f1be80c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 -- 172.21.15.81:0/37494457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00094b0 con 0x7f1be806f010 2023-11-29T11:13:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be67fc700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806f010 0x7f1be80b3af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0000c00 tx=0x7f1bd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1bdf7fe700 1 -- 172.21.15.81:0/37494457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00068d0 con 0x7f1be806f010 2023-11-29T11:13:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1bdf7fe700 1 -- 172.21.15.81:0/37494457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0020070 con 0x7f1be806f010 2023-11-29T11:13:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd0009520 con 0x7f1be806f010 2023-11-29T11:13:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1bdf7fe700 1 -- 172.21.15.81:0/37494457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0006a30 con 0x7f1be806f010 2023-11-29T11:13:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.217+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be80cafb0 con 0x7f1be806f010 2023-11-29T11:13:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.221+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be80cacd0 con 0x7f1be806f010 2023-11-29T11:13:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.221+0000 7f1bdf7fe700 1 -- 172.21.15.81:0/37494457 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1bd002b020 con 0x7f1be806f010 2023-11-29T11:13:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.221+0000 7f1bdf7fe700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bc8064ee0 0x7f1bc8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.221+0000 7f1bdf7fe700 1 -- 172.21.15.81:0/37494457 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1bd0083940 con 0x7f1be806f010 2023-11-29T11:13:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.221+0000 7f1be6ffd700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bc8064ee0 0x7f1bc8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.225+0000 7f1be6ffd700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bc8064ee0 0x7f1bc8067390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80012e0 tx=0x7f1bd8001a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.233+0000 7f1bdf7fe700 1 -- 172.21.15.81:0/37494457 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1bd0051730 con 0x7f1be806f010 2023-11-29T11:13:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1be80ca070 con 0x7f1be806f010 2023-11-29T11:13:43.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1bdf7fe700 1 -- 172.21.15.81:0/37494457 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1bd0054d50 con 0x7f1be806f010 2023-11-29T11:13:43.402 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bc8064ee0 msgr2=0x7f1bc8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bc8064ee0 0x7f1bc8067390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80012e0 tx=0x7f1bd8001a80 comp rx=0 tx=0).stop 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806f010 msgr2=0x7f1be80b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806f010 0x7f1be80b3af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0000c00 tx=0x7f1bd0004770 comp rx=0 tx=0).stop 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 shutdown_connections 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1bc8064ee0 0x7f1bc8067390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1be80cbaf0 0x7f1be81f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806f010 0x7f1be80b3af0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 --2- 172.21.15.81:0/37494457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1be806a6e0 0x7f1be80c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 >> 172.21.15.81:0/37494457 conn(0x7f1be80d0240 msgr2=0x7f1be8159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 shutdown_connections 2023-11-29T11:13:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.397+0000 7f1be7fff700 1 -- 172.21.15.81:0/37494457 wait complete. 2023-11-29T11:13:43.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.529+0000 7fafde52c700 1 Processor -- start 2023-11-29T11:13:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.529+0000 7fafde52c700 1 -- start start 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.529+0000 7fafde52c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fafd80b4570 0x7fafd80b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.529+0000 7fafde52c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd806ad00 0x7fafd80ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd80d28e0 con 0x7fafd8069c40 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd80cd5c0 con 0x7fafd80b4570 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80d1730 con 0x7fafd806ad00 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fafd80b4570 0x7fafd80b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafdcac9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fafd8069c40 0x7fafd806a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52584/0 (socket says 172.21.15.81:52584) 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafdcac9700 1 -- 172.21.15.81:0/573139853 learned_addr learned my addr 172.21.15.81:0/573139853 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd77fe700 1 --2- 172.21.15.81:0/573139853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd806ad00 0x7fafd80ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd7fff700 1 -- 172.21.15.81:0/573139853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd806ad00 msgr2=0x7fafd80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:43.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd7fff700 1 --2- 172.21.15.81:0/573139853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd806ad00 0x7fafd80ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd7fff700 1 -- 172.21.15.81:0/573139853 >> v1:172.21.15.81:6789/0 conn(0x7fafd8069c40 legacy=0x7fafd806a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd7fff700 1 -- 172.21.15.81:0/573139853 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd80b4e80 con 0x7fafd80b4570 2023-11-29T11:13:43.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd7fff700 1 --2- 172.21.15.81:0/573139853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd80b4940 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009850 tx=0x7fafcc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb0aa45a6341fe7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd6ffd700 1 -- 172.21.15.81:0/573139853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc011830 con 0x7fafd80b4570 2023-11-29T11:13:43.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd6ffd700 1 -- 172.21.15.81:0/573139853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc011990 con 0x7fafd80b4570 2023-11-29T11:13:43.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafd6ffd700 1 -- 172.21.15.81:0/573139853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc011d40 con 0x7fafd80b4570 2023-11-29T11:13:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 -- 172.21.15.81:0/573139853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 msgr2=0x7fafd80b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 --2- 172.21.15.81:0/573139853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd80b4940 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009850 tx=0x7fafcc009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 -- 172.21.15.81:0/573139853 shutdown_connections 2023-11-29T11:13:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 --2- 172.21.15.81:0/573139853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd806ad00 0x7fafd80ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 --2- 172.21.15.81:0/573139853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd80b4940 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 -- 172.21.15.81:0/573139853 >> 172.21.15.81:0/573139853 conn(0x7fafd806cac0 msgr2=0x7fafd80cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 -- 172.21.15.81:0/573139853 shutdown_connections 2023-11-29T11:13:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.533+0000 7fafde52c700 1 -- 172.21.15.81:0/573139853 wait complete. 2023-11-29T11:13:43.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafde52c700 1 Processor -- start 2023-11-29T11:13:43.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafde52c700 1 -- start start 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafde52c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd8069c40 0x7fafd815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafde52c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd806ad00 0x7fafd815cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafde52c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd81f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafde52c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80cc510 con 0x7fafd80b4570 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafde52c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8145df0 con 0x7fafd806ad00 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafde52c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd81460d0 con 0x7fafd8069c40 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafdcac9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd81f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafdcac9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd81f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35904/0 (socket says 172.21.15.81:35904) 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafdcac9700 1 -- 172.21.15.81:0/4294197921 learned_addr learned my addr 172.21.15.81:0/4294197921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafd7fff700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd8069c40 0x7fafd815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafd77fe700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd806ad00 0x7fafd815cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafdcac9700 1 -- 172.21.15.81:0/4294197921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd8069c40 msgr2=0x7fafd815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafdcac9700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd8069c40 0x7fafd815c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafdcac9700 1 -- 172.21.15.81:0/4294197921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd806ad00 msgr2=0x7fafd815cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafdcac9700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd806ad00 0x7fafd815cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.537+0000 7fafdcac9700 1 -- 172.21.15.81:0/4294197921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0094b0 con 0x7fafd80b4570 2023-11-29T11:13:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.541+0000 7fafdcac9700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd81f0af0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fafd000ca80 tx=0x7fafd000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.541+0000 7fafd4ff9700 1 -- 172.21.15.81:0/4294197921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0007480 con 0x7fafd80b4570 2023-11-29T11:13:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.541+0000 7fafd4ff9700 1 -- 172.21.15.81:0/4294197921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd00075e0 con 0x7fafd80b4570 2023-11-29T11:13:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.541+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd80d1450 con 0x7fafd80b4570 2023-11-29T11:13:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.541+0000 7fafd4ff9700 1 -- 172.21.15.81:0/4294197921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0007950 con 0x7fafd80b4570 2023-11-29T11:13:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.541+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd80d1170 con 0x7fafd80b4570 2023-11-29T11:13:43.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.541+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd80cd1e0 con 0x7fafd80b4570 2023-11-29T11:13:43.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.541+0000 7fafd4ff9700 1 -- 172.21.15.81:0/4294197921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fafd0019030 con 0x7fafd80b4570 2023-11-29T11:13:43.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.545+0000 7fafd4ff9700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fafc4064ee0 0x7fafc4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.545+0000 7fafd7fff700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fafc4064ee0 0x7fafc4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.545+0000 7fafd4ff9700 1 -- 172.21.15.81:0/4294197921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafd00816d0 con 0x7fafd80b4570 2023-11-29T11:13:43.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.545+0000 7fafd7fff700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fafc4064ee0 0x7fafc4067390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0090b0 tx=0x7fafcc01c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.549+0000 7fafd4ff9700 1 -- 172.21.15.81:0/4294197921 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fafd004a400 con 0x7fafd80b4570 2023-11-29T11:13:43.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.705+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafd80d28a0 con 0x7fafd80b4570 2023-11-29T11:13:43.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafd4ff9700 1 -- 172.21.15.81:0/4294197921 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafd00170a0 con 0x7fafd80b4570 2023-11-29T11:13:43.713 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fafc4064ee0 msgr2=0x7fafc4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fafc4064ee0 0x7fafc4067390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0090b0 tx=0x7fafcc01c040 comp rx=0 tx=0).stop 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 msgr2=0x7fafd81f0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd81f0af0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fafd000ca80 tx=0x7fafd000cab0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 shutdown_connections 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fafc4064ee0 0x7fafc4067390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd80b4570 0x7fafd81f0af0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd806ad00 0x7fafd815cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 --2- 172.21.15.81:0/4294197921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd8069c40 0x7fafd815c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 >> 172.21.15.81:0/4294197921 conn(0x7fafd806cac0 msgr2=0x7fafd80d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 shutdown_connections 2023-11-29T11:13:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.709+0000 7fafde52c700 1 -- 172.21.15.81:0/4294197921 wait complete. 2023-11-29T11:13:43.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.837+0000 7f6b83fff700 1 Processor -- start 2023-11-29T11:13:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b83fff700 1 -- start start 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b83fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b8415bb80 0x7f6b840b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b83fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 0x7f6b840b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b83fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b8406b370 0x7f6b840b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b83fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b840ccd00 con 0x7f6b8415bb80 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b83fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b840b19b0 con 0x7f6b8406b370 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b83fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840cd510 con 0x7f6b840aaf40 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b8415bb80 0x7f6b840b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b8415bb80 0x7f6b840b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35910/0 (socket says 172.21.15.81:35910) 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 -- 172.21.15.81:0/1477708905 learned_addr learned my addr 172.21.15.81:0/1477708905 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b837fe700 1 --2- 172.21.15.81:0/1477708905 >> v2:172.21.15.176:3300/0 conn(0x7f6b8406b370 0x7f6b840b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b827fc700 1 --2- 172.21.15.81:0/1477708905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 0x7f6b840b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 -- 172.21.15.81:0/1477708905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 msgr2=0x7f6b840b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 --2- 172.21.15.81:0/1477708905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 0x7f6b840b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 -- 172.21.15.81:0/1477708905 >> v2:172.21.15.176:3300/0 conn(0x7f6b8406b370 msgr2=0x7f6b840b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 --2- 172.21.15.81:0/1477708905 >> v2:172.21.15.176:3300/0 conn(0x7f6b8406b370 0x7f6b840b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 -- 172.21.15.81:0/1477708905 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840ccf50 con 0x7f6b8415bb80 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b82ffd700 1 --2- 172.21.15.81:0/1477708905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8415bb80 0x7f6b840b2450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6b84067110 tx=0x7f6b78009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e49d3cc48ec684 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b81ffb700 1 -- 172.21.15.81:0/1477708905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78011830 con 0x7f6b8415bb80 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b81ffb700 1 -- 172.21.15.81:0/1477708905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78011990 con 0x7f6b8415bb80 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.841+0000 7f6b81ffb700 1 -- 172.21.15.81:0/1477708905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78011d20 con 0x7f6b8415bb80 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 -- 172.21.15.81:0/1477708905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8415bb80 msgr2=0x7f6b840b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 --2- 172.21.15.81:0/1477708905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8415bb80 0x7f6b840b2450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6b84067110 tx=0x7f6b78009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 -- 172.21.15.81:0/1477708905 shutdown_connections 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 --2- 172.21.15.81:0/1477708905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 0x7f6b840b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 --2- 172.21.15.81:0/1477708905 >> v2:172.21.15.176:3300/0 conn(0x7f6b8406b370 0x7f6b840b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 --2- 172.21.15.81:0/1477708905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8415bb80 0x7f6b840b2450 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 -- 172.21.15.81:0/1477708905 >> 172.21.15.81:0/1477708905 conn(0x7f6b840cae70 msgr2=0x7f6b840cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 -- 172.21.15.81:0/1477708905 shutdown_connections 2023-11-29T11:13:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 -- 172.21.15.81:0/1477708905 wait complete. 2023-11-29T11:13:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 Processor -- start 2023-11-29T11:13:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.845+0000 7f6b83fff700 1 -- start start 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b83fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8406b370 0x7f6b8409b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b83fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 0x7f6b8414c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b83fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b8415bb80 0x7f6b84154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b83fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8414c6f0 con 0x7f6b8406b370 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b83fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841552b0 con 0x7f6b8415bb80 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b83fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841554e0 con 0x7f6b840aaf40 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8406b370 0x7f6b8409b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8406b370 0x7f6b8409b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35916/0 (socket says 172.21.15.81:35916) 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 -- 172.21.15.81:0/3638954511 learned_addr learned my addr 172.21.15.81:0/3638954511 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b837fe700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b8415bb80 0x7f6b84154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b827fc700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 0x7f6b8414c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 -- 172.21.15.81:0/3638954511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 msgr2=0x7f6b8414c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 0x7f6b8414c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 -- 172.21.15.81:0/3638954511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b8415bb80 msgr2=0x7f6b84154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b8415bb80 0x7f6b84154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 -- 172.21.15.81:0/3638954511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78009570 con 0x7f6b8406b370 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b82ffd700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8406b370 0x7f6b8409b3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6b78000c00 tx=0x7f6b78004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b6b7fe700 1 -- 172.21.15.81:0/3638954511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78004450 con 0x7f6b8406b370 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b6b7fe700 1 -- 172.21.15.81:0/3638954511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7801e070 con 0x7f6b8406b370 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b840b1c50 con 0x7f6b8406b370 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b6b7fe700 1 -- 172.21.15.81:0/3638954511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78003900 con 0x7f6b8406b370 2023-11-29T11:13:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.849+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b840cd230 con 0x7f6b8406b370 2023-11-29T11:13:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.853+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b840b1f30 con 0x7f6b8406b370 2023-11-29T11:13:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.853+0000 7f6b6b7fe700 1 -- 172.21.15.81:0/3638954511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6b7800f050 con 0x7f6b8406b370 2023-11-29T11:13:43.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.853+0000 7f6b6b7fe700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b70064ee0 0x7f6b70067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:43.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.853+0000 7f6b827fc700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b70064ee0 0x7f6b70067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:43.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.853+0000 7f6b6b7fe700 1 -- 172.21.15.81:0/3638954511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b78020070 con 0x7f6b8406b370 2023-11-29T11:13:43.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.853+0000 7f6b827fc700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b70064ee0 0x7f6b70067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b84162600 tx=0x7f6b74009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:43.857+0000 7f6b6b7fe700 1 -- 172.21.15.81:0/3638954511 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6b78051370 con 0x7f6b8406b370 2023-11-29T11:13:44.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.021+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b8406e000 con 0x7f6b8406b370 2023-11-29T11:13:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b6b7fe700 1 -- 172.21.15.81:0/3638954511 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b78054990 con 0x7f6b8406b370 2023-11-29T11:13:44.029 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b70064ee0 msgr2=0x7f6b70067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b70064ee0 0x7f6b70067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b84162600 tx=0x7f6b74009240 comp rx=0 tx=0).stop 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8406b370 msgr2=0x7f6b8409b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8406b370 0x7f6b8409b3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6b78000c00 tx=0x7f6b78004770 comp rx=0 tx=0).stop 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 shutdown_connections 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b70064ee0 0x7f6b70067390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b8415bb80 0x7f6b84154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b840aaf40 0x7f6b8414c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 --2- 172.21.15.81:0/3638954511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b8406b370 0x7f6b8409b3b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 >> 172.21.15.81:0/3638954511 conn(0x7f6b840cae70 msgr2=0x7f6b840ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:44.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 shutdown_connections 2023-11-29T11:13:44.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.025+0000 7f6b83fff700 1 -- 172.21.15.81:0/3638954511 wait complete. 2023-11-29T11:13:44.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.165+0000 7fa9ca734700 1 Processor -- start 2023-11-29T11:13:44.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.165+0000 7fa9ca734700 1 -- start start 2023-11-29T11:13:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.165+0000 7fa9ca734700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158480 0x7fa9c40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.165+0000 7fa9ca734700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9c4158850 0x7fa9c40c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.165+0000 7fa9ca734700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c406a4d0 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.165+0000 7fa9ca734700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c40cc1f0 con 0x7fa9c4158850 2023-11-29T11:13:44.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.165+0000 7fa9ca734700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c40cc490 con 0x7fa9c4158480 2023-11-29T11:13:44.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c9732700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158480 0x7fa9c40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c8f31700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9c4158850 0x7fa9c40c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c8f31700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9c4158850 0x7fa9c40c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:35412/0 (socket says 172.21.15.81:35412) 2023-11-29T11:13:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c8f31700 1 -- 172.21.15.81:0/906645198 learned_addr learned my addr 172.21.15.81:0/906645198 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c9732700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158480 0x7fa9c40cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:42092/0 (socket says 172.21.15.81:42092) 2023-11-29T11:13:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c8f31700 1 -- 172.21.15.81:0/906645198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158480 msgr2=0x7fa9c40cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c8f31700 1 --2- 172.21.15.81:0/906645198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158480 0x7fa9c40cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c8f31700 1 -- 172.21.15.81:0/906645198 >> v1:172.21.15.176:6789/0 conn(0x7fa9c40cd3a0 legacy=0x7fa9c40ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c8f31700 1 -- 172.21.15.81:0/906645198 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c406a720 con 0x7fa9c4158850 2023-11-29T11:13:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9c8f31700 1 --2- 172.21.15.81:0/906645198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158850 0x7fa9c40c9410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009910 tx=0x7fa9b8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d6c2ecbfd45b0f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9b7fff700 1 -- 172.21.15.81:0/906645198 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8011830 con 0x7fa9c4158850 2023-11-29T11:13:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9b7fff700 1 -- 172.21.15.81:0/906645198 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b8011990 con 0x7fa9c4158850 2023-11-29T11:13:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9b7fff700 1 -- 172.21.15.81:0/906645198 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8011d40 con 0x7fa9c4158850 2023-11-29T11:13:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9ca734700 1 -- 172.21.15.81:0/906645198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158850 msgr2=0x7fa9c40c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9ca734700 1 --2- 172.21.15.81:0/906645198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158850 0x7fa9c40c9410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009910 tx=0x7fa9b8009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9ca734700 1 -- 172.21.15.81:0/906645198 shutdown_connections 2023-11-29T11:13:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9ca734700 1 --2- 172.21.15.81:0/906645198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158850 0x7fa9c40c9410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9ca734700 1 --2- 172.21.15.81:0/906645198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158480 0x7fa9c40cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9ca734700 1 -- 172.21.15.81:0/906645198 >> 172.21.15.81:0/906645198 conn(0x7fa9c406c660 msgr2=0x7fa9c406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9ca734700 1 -- 172.21.15.81:0/906645198 shutdown_connections 2023-11-29T11:13:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.169+0000 7fa9ca734700 1 -- 172.21.15.81:0/906645198 wait complete. 2023-11-29T11:13:44.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 Processor -- start 2023-11-29T11:13:44.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 -- start start 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9c40cd3a0 0x7fa9c40c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158480 0x7fa9c4150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158850 0x7fa9c4153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c41527f0 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4151750 con 0x7fa9c4158480 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c4151a30 con 0x7fa9c4158850 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9c40cd3a0 0x7fa9c40c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9c40cd3a0 0x7fa9c40c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35928/0 (socket says 172.21.15.81:35928) 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 -- 172.21.15.81:0/3092718012 learned_addr learned my addr 172.21.15.81:0/3092718012 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c8f31700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158480 0x7fa9c4150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9f33700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158850 0x7fa9c4153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 -- 172.21.15.81:0/3092718012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158850 msgr2=0x7fa9c4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158850 0x7fa9c4153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 -- 172.21.15.81:0/3092718012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158480 msgr2=0x7fa9c4150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158480 0x7fa9c4150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 -- 172.21.15.81:0/3092718012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8009570 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9c9732700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9c40cd3a0 0x7fa9c40c1cd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009cf0 tx=0x7fa9c000af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3092718012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c000ae20 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3092718012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0010040 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c406ace0 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3092718012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0007e10 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.173+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c406aa00 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.177+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c40c9950 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.177+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3092718012 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa9c001e460 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.177+0000 7fa9b5ffb700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a8064ee0 0x7fa9a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.177+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3092718012 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa9c0082840 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.177+0000 7fa9c8f31700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a8064ee0 0x7fa9a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.181+0000 7fa9c8f31700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a8064ee0 0x7fa9a8067390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8000c00 tx=0x7fa9b8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.189+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3092718012 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa9c0050560 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa9c4072c20 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3092718012 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa9c0053b80 con 0x7fa9c40cd3a0 2023-11-29T11:13:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a8064ee0 msgr2=0x7fa9a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a8064ee0 0x7fa9a8067390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8000c00 tx=0x7fa9b8008030 comp rx=0 tx=0).stop 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9c40cd3a0 msgr2=0x7fa9c40c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9c40cd3a0 0x7fa9c40c1cd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009cf0 tx=0x7fa9c000af80 comp rx=0 tx=0).stop 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 shutdown_connections 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a8064ee0 0x7fa9a8067390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c4158850 0x7fa9c4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c4158480 0x7fa9c4150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 --2- 172.21.15.81:0/3092718012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9c40cd3a0 0x7fa9c40c1cd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.349+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 >> 172.21.15.81:0/3092718012 conn(0x7fa9c406c660 msgr2=0x7fa9c40c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.353+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 shutdown_connections 2023-11-29T11:13:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.353+0000 7fa9ca734700 1 -- 172.21.15.81:0/3092718012 wait complete. 2023-11-29T11:13:44.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:44.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.481+0000 7ff4457c6700 1 Processor -- start 2023-11-29T11:13:44.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.481+0000 7ff4457c6700 1 -- start start 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff440069c40 0x7ff44015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff4400c98a0 0x7ff4400c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4400ca200 con 0x7ff4401510d0 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4400c95d0 con 0x7ff440069c40 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4400c8e00 con 0x7ff4400c98a0 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff440069c40 0x7ff44015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff440069c40 0x7ff44015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35930/0 (socket says 172.21.15.81:35930) 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43e7fc700 1 -- 172.21.15.81:0/444264231 learned_addr learned my addr 172.21.15.81:0/444264231 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43f7fe700 1 --2- 172.21.15.81:0/444264231 >> v2:172.21.15.176:3300/0 conn(0x7ff4400c98a0 0x7ff4400c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43e7fc700 1 -- 172.21.15.81:0/444264231 >> v2:172.21.15.176:3300/0 conn(0x7ff4400c98a0 msgr2=0x7ff4400c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43e7fc700 1 --2- 172.21.15.81:0/444264231 >> v2:172.21.15.176:3300/0 conn(0x7ff4400c98a0 0x7ff4400c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43e7fc700 1 -- 172.21.15.81:0/444264231 >> v1:172.21.15.81:6789/0 conn(0x7ff4401510d0 legacy=0x7ff4400b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43e7fc700 1 -- 172.21.15.81:0/444264231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4400c9010 con 0x7ff440069c40 2023-11-29T11:13:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43f7fe700 1 --2- 172.21.15.81:0/444264231 >> v2:172.21.15.176:3300/0 conn(0x7ff4400c98a0 0x7ff4400c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43e7fc700 1 --2- 172.21.15.81:0/444264231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff44015b260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff44015dbc0 tx=0x7ff430009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec5f2d8f07e016a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43dffb700 1 -- 172.21.15.81:0/444264231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000b8a0 con 0x7ff440069c40 2023-11-29T11:13:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43dffb700 1 -- 172.21.15.81:0/444264231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43000ba00 con 0x7ff440069c40 2023-11-29T11:13:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff43dffb700 1 -- 172.21.15.81:0/444264231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000bd90 con 0x7ff440069c40 2023-11-29T11:13:44.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 -- 172.21.15.81:0/444264231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 msgr2=0x7ff44015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 --2- 172.21.15.81:0/444264231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff44015b260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff44015dbc0 tx=0x7ff430009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 -- 172.21.15.81:0/444264231 shutdown_connections 2023-11-29T11:13:44.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 --2- 172.21.15.81:0/444264231 >> v2:172.21.15.176:3300/0 conn(0x7ff4400c98a0 0x7ff4400c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 --2- 172.21.15.81:0/444264231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff44015b260 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 -- 172.21.15.81:0/444264231 >> 172.21.15.81:0/444264231 conn(0x7ff44006caf0 msgr2=0x7ff4400ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:44.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 -- 172.21.15.81:0/444264231 shutdown_connections 2023-11-29T11:13:44.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.485+0000 7ff4457c6700 1 -- 172.21.15.81:0/444264231 wait complete. 2023-11-29T11:13:44.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 Processor -- start 2023-11-29T11:13:44.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 -- start start 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff4400c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4400c98a0 0x7ff44014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4401510d0 0x7ff44015cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400c7840 con 0x7ff440069c40 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44014dd00 con 0x7ff4400c98a0 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401f2f60 con 0x7ff4401510d0 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff4400c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff4400c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35932/0 (socket says 172.21.15.81:35932) 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 -- 172.21.15.81:0/4065772862 learned_addr learned my addr 172.21.15.81:0/4065772862 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43e7fc700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4400c98a0 0x7ff44014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43f7fe700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4401510d0 0x7ff44015cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 -- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4401510d0 msgr2=0x7ff44015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4401510d0 0x7ff44015cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 -- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4400c98a0 msgr2=0x7ff44014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4400c98a0 0x7ff44014cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 -- 172.21.15.81:0/4065772862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430009570 con 0x7ff440069c40 2023-11-29T11:13:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43e7fc700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4400c98a0 0x7ff44014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff43effd700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff4400c7300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c500 tx=0x7ff42800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4377fe700 1 -- 172.21.15.81:0/4065772862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280052d0 con 0x7ff440069c40 2023-11-29T11:13:44.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4377fe700 1 -- 172.21.15.81:0/4065772862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff428005430 con 0x7ff440069c40 2023-11-29T11:13:44.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4377fe700 1 -- 172.21.15.81:0/4065772862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280055a0 con 0x7ff440069c40 2023-11-29T11:13:44.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff440070170 con 0x7ff440069c40 2023-11-29T11:13:44.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.489+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4400c92f0 con 0x7ff440069c40 2023-11-29T11:13:44.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.493+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4401514a0 con 0x7ff440069c40 2023-11-29T11:13:44.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.493+0000 7ff4377fe700 1 -- 172.21.15.81:0/4065772862 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff428010050 con 0x7ff440069c40 2023-11-29T11:13:44.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.493+0000 7ff4377fe700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff420064ee0 0x7ff420067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.493+0000 7ff4377fe700 1 -- 172.21.15.81:0/4065772862 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff428081540 con 0x7ff440069c40 2023-11-29T11:13:44.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.493+0000 7ff43e7fc700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff420064ee0 0x7ff420067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.493+0000 7ff43e7fc700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff420064ee0 0x7ff420067390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff430014040 tx=0x7ff430008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.497+0000 7ff4377fe700 1 -- 172.21.15.81:0/4065772862 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff428049400 con 0x7ff440069c40 2023-11-29T11:13:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.673+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff440072500 con 0x7ff440069c40 2023-11-29T11:13:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.677+0000 7ff4377fe700 1 -- 172.21.15.81:0/4065772862 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff428056e60 con 0x7ff440069c40 2023-11-29T11:13:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff420064ee0 msgr2=0x7ff420067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff420064ee0 0x7ff420067390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff430014040 tx=0x7ff430008030 comp rx=0 tx=0).stop 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 msgr2=0x7ff4400c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff4400c7300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c500 tx=0x7ff42800c8c0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 shutdown_connections 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff420064ee0 0x7ff420067390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4401510d0 0x7ff44015cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4400c98a0 0x7ff44014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 --2- 172.21.15.81:0/4065772862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff440069c40 0x7ff4400c7300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 >> 172.21.15.81:0/4065772862 conn(0x7ff44006caf0 msgr2=0x7ff44015e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 shutdown_connections 2023-11-29T11:13:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.681+0000 7ff4457c6700 1 -- 172.21.15.81:0/4065772862 wait complete. 2023-11-29T11:13:44.687 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:44.703 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:13:44.703 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:44.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.813+0000 7fb1c759e700 1 Processor -- start 2023-11-29T11:13:44.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.813+0000 7fb1c759e700 1 -- start start 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb1c8154600 0x7fb1c815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c815b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c815e300 con 0x7fb1c806c650 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c806ced0 con 0x7fb1c8154600 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c815d9d0 con 0x7fb1c806abe0 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c6d9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c659c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb1c8154600 0x7fb1c815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c5d9b700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fb1c806c650 0x7fb1c806a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:53392/0 (socket says 172.21.15.81:53392) 2023-11-29T11:13:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c5d9b700 1 -- 172.21.15.81:0/2885673140 learned_addr learned my addr 172.21.15.81:0/2885673140 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c559a700 1 -- 172.21.15.81:0/2885673140 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829446753 0 0) 0x7fb1c815e300 con 0x7fb1c806c650 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c559a700 1 -- 172.21.15.81:0/2885673140 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b00035d0 con 0x7fb1c806c650 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c6d9d700 1 -- 172.21.15.81:0/2885673140 >> v2:172.21.15.176:3300/0 conn(0x7fb1c8154600 msgr2=0x7fb1c815aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c6d9d700 1 --2- 172.21.15.81:0/2885673140 >> v2:172.21.15.176:3300/0 conn(0x7fb1c8154600 0x7fb1c815aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c6d9d700 1 -- 172.21.15.81:0/2885673140 >> v1:172.21.15.176:6789/0 conn(0x7fb1c806c650 legacy=0x7fb1c806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c6d9d700 1 -- 172.21.15.81:0/2885673140 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c815dcb0 con 0x7fb1c806abe0 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c659c700 1 --2- 172.21.15.81:0/2885673140 >> v2:172.21.15.176:3300/0 conn(0x7fb1c8154600 0x7fb1c815aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c6d9d700 1 --2- 172.21.15.81:0/2885673140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c815b500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009850 tx=0x7fb1c0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78dc151e8e6e7a88 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c559a700 1 -- 172.21.15.81:0/2885673140 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0011830 con 0x7fb1c806abe0 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c559a700 1 -- 172.21.15.81:0/2885673140 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0011990 con 0x7fb1c806abe0 2023-11-29T11:13:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c559a700 1 -- 172.21.15.81:0/2885673140 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0011d00 con 0x7fb1c806abe0 2023-11-29T11:13:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 -- 172.21.15.81:0/2885673140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 msgr2=0x7fb1c815b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2885673140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c815b500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009850 tx=0x7fb1c0009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 -- 172.21.15.81:0/2885673140 shutdown_connections 2023-11-29T11:13:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2885673140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c815b500 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2885673140 >> v2:172.21.15.176:3300/0 conn(0x7fb1c8154600 0x7fb1c815aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 -- 172.21.15.81:0/2885673140 >> 172.21.15.81:0/2885673140 conn(0x7fb1c806ec40 msgr2=0x7fb1c80b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 -- 172.21.15.81:0/2885673140 shutdown_connections 2023-11-29T11:13:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.817+0000 7fb1c759e700 1 -- 172.21.15.81:0/2885673140 wait complete. 2023-11-29T11:13:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c759e700 1 Processor -- start 2023-11-29T11:13:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c759e700 1 -- start start 2023-11-29T11:13:44.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c80b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c759e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c806c650 0x7fb1c814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c81f3950 0x7fb1c81f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80b3de0 con 0x7fb1c81f3950 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c759e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c814c240 con 0x7fb1c806c650 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80c33b0 con 0x7fb1c806abe0 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c81f3950 0x7fb1c81f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c81f3950 0x7fb1c81f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35944/0 (socket says 172.21.15.81:35944) 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 -- 172.21.15.81:0/2455003316 learned_addr learned my addr 172.21.15.81:0/2455003316 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c659c700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c80b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c5d9b700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c806c650 0x7fb1c814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 -- 172.21.15.81:0/2455003316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 msgr2=0x7fb1c80b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c80b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 -- 172.21.15.81:0/2455003316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c806c650 msgr2=0x7fb1c814bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c806c650 0x7fb1c814bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 -- 172.21.15.81:0/2455003316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80094b0 con 0x7fb1c81f3950 2023-11-29T11:13:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.821+0000 7fb1c6d9d700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c81f3950 0x7fb1c81f2d40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00090b0 tx=0x7fb1c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.825+0000 7fb1b6ffd700 1 -- 172.21.15.81:0/2455003316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0004510 con 0x7fb1c81f3950 2023-11-29T11:13:44.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.825+0000 7fb1b6ffd700 1 -- 172.21.15.81:0/2455003316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c001e070 con 0x7fb1c81f3950 2023-11-29T11:13:44.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.825+0000 7fb1b6ffd700 1 -- 172.21.15.81:0/2455003316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0003900 con 0x7fb1c81f3950 2023-11-29T11:13:44.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.825+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c00094b0 con 0x7fb1c81f3950 2023-11-29T11:13:44.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.825+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c815e790 con 0x7fb1c81f3950 2023-11-29T11:13:44.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.825+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c815df90 con 0x7fb1c81f3950 2023-11-29T11:13:44.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.825+0000 7fb1b6ffd700 1 -- 172.21.15.81:0/2455003316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb1c000f050 con 0x7fb1c81f3950 2023-11-29T11:13:44.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.825+0000 7fb1b6ffd700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb1a8064f10 0x7fb1a80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.829+0000 7fb1b6ffd700 1 -- 172.21.15.81:0/2455003316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb1c0082fe0 con 0x7fb1c81f3950 2023-11-29T11:13:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.829+0000 7fb1c659c700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb1a8064f10 0x7fb1a80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.829+0000 7fb1c659c700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb1a8064f10 0x7fb1a80673c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb1c815d590 tx=0x7fb1b8009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.833+0000 7fb1b6ffd700 1 -- 172.21.15.81:0/2455003316 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb1c00b3400 con 0x7fb1c81f3950 2023-11-29T11:13:45.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.997+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1c806cad0 con 0x7fb1c81f3950 2023-11-29T11:13:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:44.997+0000 7fb1b6ffd700 1 -- 172.21.15.81:0/2455003316 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fb1c0015090 con 0x7fb1c81f3950 2023-11-29T11:13:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:45.005 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb1a8064f10 msgr2=0x7fb1a80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb1a8064f10 0x7fb1a80673c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb1c815d590 tx=0x7fb1b8009240 comp rx=0 tx=0).stop 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c81f3950 msgr2=0x7fb1c81f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c81f3950 0x7fb1c81f2d40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00090b0 tx=0x7fb1c0004770 comp rx=0 tx=0).stop 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 shutdown_connections 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb1a8064f10 0x7fb1a80673c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c81f3950 0x7fb1c81f2d40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1c806c650 0x7fb1c814bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 --2- 172.21.15.81:0/2455003316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1c806abe0 0x7fb1c80b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 >> 172.21.15.81:0/2455003316 conn(0x7fb1c806ec40 msgr2=0x7fb1c80b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 shutdown_connections 2023-11-29T11:13:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.001+0000 7fb1c759e700 1 -- 172.21.15.81:0/2455003316 wait complete. 2023-11-29T11:13:45.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:45.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:45.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5efcead700 1 Processor -- start 2023-11-29T11:13:45.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5efcead700 1 -- start start 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5efcead700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5ef806a4c0 0x7f5ef806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5efcead700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80cf0e0 0x7f5ef80cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5efcead700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef80cfa80 con 0x7f5ef80b1ae0 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5efcead700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef80d0ab0 con 0x7f5ef806a4c0 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5efcead700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef806a9c0 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ef80b1ae0 0x7f5ef80d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52592/0 (socket says 172.21.15.81:52592) 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef77fe700 1 -- 172.21.15.81:0/501694805 learned_addr learned my addr 172.21.15.81:0/501694805 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5eeffff700 1 --2- 172.21.15.81:0/501694805 >> v2:172.21.15.176:3300/0 conn(0x7f5ef806a4c0 0x7f5ef806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef7fff700 1 --2- 172.21.15.81:0/501694805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80cf0e0 0x7f5ef80cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef6ffd700 1 -- 172.21.15.81:0/501694805 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716469751 0 0) 0x7f5ef80cfa80 con 0x7f5ef80b1ae0 2023-11-29T11:13:45.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef6ffd700 1 -- 172.21.15.81:0/501694805 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee40035d0 con 0x7f5ef80b1ae0 2023-11-29T11:13:45.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef6ffd700 1 -- 172.21.15.81:0/501694805 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526314879 0 0) 0x7f5ee40035d0 con 0x7f5ef80b1ae0 2023-11-29T11:13:45.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5eeffff700 1 -- 172.21.15.81:0/501694805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80cf0e0 msgr2=0x7f5ef80cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:45.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5eeffff700 1 --2- 172.21.15.81:0/501694805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80cf0e0 0x7f5ef80cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5eeffff700 1 -- 172.21.15.81:0/501694805 >> v1:172.21.15.81:6789/0 conn(0x7f5ef80b1ae0 legacy=0x7f5ef80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5eeffff700 1 -- 172.21.15.81:0/501694805 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef806aca0 con 0x7f5ef806a4c0 2023-11-29T11:13:45.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5eeffff700 1 --2- 172.21.15.81:0/501694805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 0x7f5ef806d8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009850 tx=0x7f5ee0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63089ea409ad753c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef6ffd700 1 -- 172.21.15.81:0/501694805 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8001670 con 0x7f5ef806a4c0 2023-11-29T11:13:45.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef6ffd700 1 -- 172.21.15.81:0/501694805 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee0004030 con 0x7f5ef806a4c0 2023-11-29T11:13:45.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.141+0000 7f5ef6ffd700 1 -- 172.21.15.81:0/501694805 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00043a0 con 0x7f5ef806a4c0 2023-11-29T11:13:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 -- 172.21.15.81:0/501694805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 msgr2=0x7f5ef806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 --2- 172.21.15.81:0/501694805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 0x7f5ef806d8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009850 tx=0x7f5ee0009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 -- 172.21.15.81:0/501694805 shutdown_connections 2023-11-29T11:13:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 --2- 172.21.15.81:0/501694805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80cf0e0 0x7f5ef80cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 --2- 172.21.15.81:0/501694805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 0x7f5ef806d8e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 -- 172.21.15.81:0/501694805 >> 172.21.15.81:0/501694805 conn(0x7f5ef809bbd0 msgr2=0x7f5ef80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 -- 172.21.15.81:0/501694805 shutdown_connections 2023-11-29T11:13:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 -- 172.21.15.81:0/501694805 wait complete. 2023-11-29T11:13:45.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 Processor -- start 2023-11-29T11:13:45.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.145+0000 7f5efcead700 1 -- start start 2023-11-29T11:13:45.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 0x7f5ef815ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80b1ae0 0x7f5ef8151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef80cf0e0 0x7f5ef815c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8151540 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8158c90 con 0x7f5ef806a4c0 2023-11-29T11:13:45.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80b3920 con 0x7f5ef80b1ae0 2023-11-29T11:13:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef80cf0e0 0x7f5ef815c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef80cf0e0 0x7f5ef815c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35950/0 (socket says 172.21.15.81:35950) 2023-11-29T11:13:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 -- 172.21.15.81:0/2142271195 learned_addr learned my addr 172.21.15.81:0/2142271195 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef77fe700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 0x7f5ef815ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5eeffff700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80b1ae0 0x7f5ef8151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 -- 172.21.15.81:0/2142271195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80b1ae0 msgr2=0x7f5ef8151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80b1ae0 0x7f5ef8151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 -- 172.21.15.81:0/2142271195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 msgr2=0x7f5ef815ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 0x7f5ef815ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 -- 172.21.15.81:0/2142271195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00094b0 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef7fff700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef80cf0e0 0x7f5ef815c6d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000efc0 tx=0x7f5ef000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef4ff9700 1 -- 172.21.15.81:0/2142271195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0009ea0 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef80b4380 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef4ff9700 1 -- 172.21.15.81:0/2142271195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef000f040 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5ef4ff9700 1 -- 172.21.15.81:0/2142271195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000ced0 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef806af80 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.149+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef80b1eb0 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.153+0000 7f5ef4ff9700 1 -- 172.21.15.81:0/2142271195 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ef0014480 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.153+0000 7f5ef4ff9700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5ed8064ee0 0x7f5ed8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.153+0000 7f5ef4ff9700 1 -- 172.21.15.81:0/2142271195 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ef0082cd0 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.153+0000 7f5ef77fe700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5ed8064ee0 0x7f5ed8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.153+0000 7f5ef77fe700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5ed8064ee0 0x7f5ed8067390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80011e0 tx=0x7f5ee8001da0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.161+0000 7f5ef4ff9700 1 -- 172.21.15.81:0/2142271195 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ef0050970 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.317+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ef8072500 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.317+0000 7f5ef4ff9700 1 -- 172.21.15.81:0/2142271195 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ef0053f90 con 0x7f5ef80cf0e0 2023-11-29T11:13:45.324 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5ed8064ee0 msgr2=0x7f5ed8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5ed8064ee0 0x7f5ed8067390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80011e0 tx=0x7f5ee8001da0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef80cf0e0 msgr2=0x7f5ef815c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef80cf0e0 0x7f5ef815c6d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000efc0 tx=0x7f5ef000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 shutdown_connections 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5ed8064ee0 0x7f5ed8067390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ef80cf0e0 0x7f5ef815c6d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ef80b1ae0 0x7f5ef8151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 --2- 172.21.15.81:0/2142271195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ef806a4c0 0x7f5ef815ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 >> 172.21.15.81:0/2142271195 conn(0x7f5ef809bbd0 msgr2=0x7f5ef80d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 shutdown_connections 2023-11-29T11:13:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.321+0000 7f5efcead700 1 -- 172.21.15.81:0/2142271195 wait complete. 2023-11-29T11:13:45.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:45.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.449+0000 7f54bc8e4700 1 Processor -- start 2023-11-29T11:13:45.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.449+0000 7f54bc8e4700 1 -- start start 2023-11-29T11:13:45.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54bc8e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b815c1d0 0x7f54b80cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54bc8e4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54b80ce220 0x7f54b80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54bc8e4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f54b80ccc60 0x7f54b80cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54bc8e4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b80d0130 con 0x7f54b80ce220 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54bc8e4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b80ce6a0 con 0x7f54b80ccc60 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54bc8e4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80cd5e0 con 0x7f54b815c1d0 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54b80ce220 0x7f54b80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54b80ce220 0x7f54b80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35954/0 (socket says 172.21.15.81:35954) 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 -- 172.21.15.81:0/3573405016 learned_addr learned my addr 172.21.15.81:0/3573405016 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b77fe700 1 --2- 172.21.15.81:0/3573405016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b815c1d0 0x7f54b80cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b7fff700 1 --2- 172.21.15.81:0/3573405016 >> v2:172.21.15.176:3300/0 conn(0x7f54b80ccc60 0x7f54b80cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 -- 172.21.15.81:0/3573405016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b815c1d0 msgr2=0x7f54b80cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 --2- 172.21.15.81:0/3573405016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b815c1d0 0x7f54b80cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 -- 172.21.15.81:0/3573405016 >> v2:172.21.15.176:3300/0 conn(0x7f54b80ccc60 msgr2=0x7f54b80cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 --2- 172.21.15.81:0/3573405016 >> v2:172.21.15.176:3300/0 conn(0x7f54b80ccc60 0x7f54b80cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 -- 172.21.15.81:0/3573405016 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80cb750 con 0x7f54b80ce220 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b7fff700 1 --2- 172.21.15.81:0/3573405016 >> v2:172.21.15.176:3300/0 conn(0x7f54b80ccc60 0x7f54b80cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b6ffd700 1 --2- 172.21.15.81:0/3573405016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b80ce220 0x7f54b80cfbf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f54b8067050 tx=0x7f54a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad505feaba537840 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b67fc700 1 -- 172.21.15.81:0/3573405016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8011830 con 0x7f54b80ce220 2023-11-29T11:13:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b67fc700 1 -- 172.21.15.81:0/3573405016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a8011990 con 0x7f54b80ce220 2023-11-29T11:13:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.453+0000 7f54b67fc700 1 -- 172.21.15.81:0/3573405016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8011d20 con 0x7f54b80ce220 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 -- 172.21.15.81:0/3573405016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b80ce220 msgr2=0x7f54b80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/3573405016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b80ce220 0x7f54b80cfbf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f54b8067050 tx=0x7f54a8009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 -- 172.21.15.81:0/3573405016 shutdown_connections 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/3573405016 >> v2:172.21.15.176:3300/0 conn(0x7f54b80ccc60 0x7f54b80cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/3573405016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b80ce220 0x7f54b80cfbf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/3573405016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b815c1d0 0x7f54b80cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 -- 172.21.15.81:0/3573405016 >> 172.21.15.81:0/3573405016 conn(0x7f54b80b2180 msgr2=0x7f54b80b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 -- 172.21.15.81:0/3573405016 shutdown_connections 2023-11-29T11:13:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 -- 172.21.15.81:0/3573405016 wait complete. 2023-11-29T11:13:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 Processor -- start 2023-11-29T11:13:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.457+0000 7f54bc8e4700 1 -- start start 2023-11-29T11:13:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b80ccc60 0x7f54b815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54b80ce220 0x7f54b815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b815c1d0 0x7f54b8148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8156200 con 0x7f54b815c1d0 2023-11-29T11:13:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b815d990 con 0x7f54b80ce220 2023-11-29T11:13:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b815cae0 con 0x7f54b80ccc60 2023-11-29T11:13:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b815c1d0 0x7f54b8148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b815c1d0 0x7f54b8148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35968/0 (socket says 172.21.15.81:35968) 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 -- 172.21.15.81:0/4146375689 learned_addr learned my addr 172.21.15.81:0/4146375689 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b77fe700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b80ccc60 0x7f54b815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b6ffd700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54b80ce220 0x7f54b815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 -- 172.21.15.81:0/4146375689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b80ccc60 msgr2=0x7f54b815de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b80ccc60 0x7f54b815de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 -- 172.21.15.81:0/4146375689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54b80ce220 msgr2=0x7f54b815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54b80ce220 0x7f54b815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 -- 172.21.15.81:0/4146375689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8009570 con 0x7f54b815c1d0 2023-11-29T11:13:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54b7fff700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b815c1d0 0x7f54b8148a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f54b0007df0 tx=0x7f54b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f549ffff700 1 -- 172.21.15.81:0/4146375689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b000dd20 con 0x7f54b815c1d0 2023-11-29T11:13:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f549ffff700 1 -- 172.21.15.81:0/4146375689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b000f040 con 0x7f54b815c1d0 2023-11-29T11:13:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f549ffff700 1 -- 172.21.15.81:0/4146375689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0003c80 con 0x7f54b815c1d0 2023-11-29T11:13:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b80cbd10 con 0x7f54b815c1d0 2023-11-29T11:13:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b80cba30 con 0x7f54b815c1d0 2023-11-29T11:13:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.461+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b80cbff0 con 0x7f54b815c1d0 2023-11-29T11:13:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.465+0000 7f549ffff700 1 -- 172.21.15.81:0/4146375689 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f54b001c030 con 0x7f54b815c1d0 2023-11-29T11:13:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.465+0000 7f549ffff700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54a4064ee0 0x7f54a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.465+0000 7f549ffff700 1 -- 172.21.15.81:0/4146375689 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f54b00824c0 con 0x7f54b815c1d0 2023-11-29T11:13:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.465+0000 7f54b77fe700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54a4064ee0 0x7f54a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.465+0000 7f54b77fe700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54a4064ee0 0x7f54a4067390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009b70 tx=0x7f54ac009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.473+0000 7f549ffff700 1 -- 172.21.15.81:0/4146375689 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f54b00503a0 con 0x7f54b815c1d0 2023-11-29T11:13:45.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.633+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54b8072500 con 0x7f54b815c1d0 2023-11-29T11:13:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f549ffff700 1 -- 172.21.15.81:0/4146375689 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54b001a0a0 con 0x7f54b815c1d0 2023-11-29T11:13:45.641 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54a4064ee0 msgr2=0x7f54a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54a4064ee0 0x7f54a4067390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009b70 tx=0x7f54ac009240 comp rx=0 tx=0).stop 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b815c1d0 msgr2=0x7f54b8148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b815c1d0 0x7f54b8148a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f54b0007df0 tx=0x7f54b000d3b0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 shutdown_connections 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54a4064ee0 0x7f54a4067390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b815c1d0 0x7f54b8148a00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54b80ce220 0x7f54b815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 --2- 172.21.15.81:0/4146375689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54b80ccc60 0x7f54b815de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 >> 172.21.15.81:0/4146375689 conn(0x7f54b80b2180 msgr2=0x7f54b806e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 shutdown_connections 2023-11-29T11:13:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.637+0000 7f54bc8e4700 1 -- 172.21.15.81:0/4146375689 wait complete. 2023-11-29T11:13:45.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.773+0000 7f259ee9b700 1 Processor -- start 2023-11-29T11:13:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.773+0000 7f259ee9b700 1 -- start start 2023-11-29T11:13:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f259806a4c0 0x7f259806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259806a9c0 con 0x7f25980b1ae0 2023-11-29T11:13:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259806aca0 con 0x7f25980cf0e0 2023-11-29T11:13:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25980d0ab0 con 0x7f259806a4c0 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259de99700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f25980b1ae0 0x7f25980d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52608/0 (socket says 172.21.15.81:52608) 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259de99700 1 -- 172.21.15.81:0/3046503300 learned_addr learned my addr 172.21.15.81:0/3046503300 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259d698700 1 --2- 172.21.15.81:0/3046503300 >> v2:172.21.15.176:3300/0 conn(0x7f259806a4c0 0x7f259806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ce97700 1 -- 172.21.15.81:0/3046503300 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88394086 0 0) 0x7f259806a9c0 con 0x7f25980b1ae0 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ce97700 1 -- 172.21.15.81:0/3046503300 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25840035d0 con 0x7f25980b1ae0 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ce97700 1 -- 172.21.15.81:0/3046503300 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703358182 0 0) 0x7f259806aca0 con 0x7f25980cf0e0 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ce97700 1 -- 172.21.15.81:0/3046503300 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f259806a9c0 con 0x7f25980cf0e0 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259d698700 1 -- 172.21.15.81:0/3046503300 >> v1:172.21.15.176:6789/0 conn(0x7f25980cf0e0 legacy=0x7f25980cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259d698700 1 -- 172.21.15.81:0/3046503300 >> v1:172.21.15.81:6789/0 conn(0x7f25980b1ae0 legacy=0x7f25980d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259d698700 1 -- 172.21.15.81:0/3046503300 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259806af80 con 0x7f259806a4c0 2023-11-29T11:13:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259d698700 1 --2- 172.21.15.81:0/3046503300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f259806a4c0 0x7f259806d8e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2594009850 tx=0x7f2594009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efa8c37422d0a37f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ce97700 1 -- 172.21.15.81:0/3046503300 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594011830 con 0x7f259806a4c0 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ce97700 1 -- 172.21.15.81:0/3046503300 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594011990 con 0x7f259806a4c0 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ce97700 1 -- 172.21.15.81:0/3046503300 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594011d00 con 0x7f259806a4c0 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 -- 172.21.15.81:0/3046503300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f259806a4c0 msgr2=0x7f259806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 --2- 172.21.15.81:0/3046503300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f259806a4c0 0x7f259806d8e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2594009850 tx=0x7f2594009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 -- 172.21.15.81:0/3046503300 shutdown_connections 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 --2- 172.21.15.81:0/3046503300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f259806a4c0 0x7f259806d8e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 -- 172.21.15.81:0/3046503300 >> 172.21.15.81:0/3046503300 conn(0x7f259809bbd0 msgr2=0x7f25980b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 -- 172.21.15.81:0/3046503300 shutdown_connections 2023-11-29T11:13:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.777+0000 7f259ee9b700 1 -- 172.21.15.81:0/3046503300 wait complete. 2023-11-29T11:13:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259ee9b700 1 Processor -- start 2023-11-29T11:13:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259ee9b700 1 -- start start 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259ee9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259806a4c0 0x7f259815a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259ee9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25980b1ae0 0x7f259815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259ee9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25980cf0e0 0x7f259815e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259ee9b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259809f870 con 0x7f259806a4c0 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259ee9b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259809f2b0 con 0x7f25980b1ae0 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259ee9b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259809f590 con 0x7f25980cf0e0 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259de99700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259806a4c0 0x7f259815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259de99700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259806a4c0 0x7f259815a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35972/0 (socket says 172.21.15.81:35972) 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259de99700 1 -- 172.21.15.81:0/1068304620 learned_addr learned my addr 172.21.15.81:0/1068304620 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.781+0000 7f259d698700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25980b1ae0 0x7f259815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259e69a700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25980cf0e0 0x7f259815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259de99700 1 -- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25980cf0e0 msgr2=0x7f259815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259de99700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25980cf0e0 0x7f259815e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259de99700 1 -- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25980b1ae0 msgr2=0x7f259815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259de99700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25980b1ae0 0x7f259815dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259de99700 1 -- 172.21.15.81:0/1068304620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940094b0 con 0x7f259806a4c0 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259e69a700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25980cf0e0 0x7f259815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259de99700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259806a4c0 0x7f259815a100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c580 tx=0x7f258c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f258a7fc700 1 -- 172.21.15.81:0/1068304620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c005d90 con 0x7f259806a4c0 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f258a7fc700 1 -- 172.21.15.81:0/1068304620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c0070d0 con 0x7f259806a4c0 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25980b1eb0 con 0x7f259806a4c0 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f258a7fc700 1 -- 172.21.15.81:0/1068304620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c007440 con 0x7f259806a4c0 2023-11-29T11:13:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25980b4380 con 0x7f259806a4c0 2023-11-29T11:13:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25980b60e0 con 0x7f259806a4c0 2023-11-29T11:13:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f258a7fc700 1 -- 172.21.15.81:0/1068304620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f258c019030 con 0x7f259806a4c0 2023-11-29T11:13:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f258a7fc700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f257c064ee0 0x7f257c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f259d698700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f257c064ee0 0x7f257c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.785+0000 7f258a7fc700 1 -- 172.21.15.81:0/1068304620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f258c081460 con 0x7f259806a4c0 2023-11-29T11:13:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.789+0000 7f259d698700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f257c064ee0 0x7f257c067390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25940090b0 tx=0x7f2594008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.789+0000 7f258a7fc700 1 -- 172.21.15.81:0/1068304620 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f258c04a400 con 0x7f259806a4c0 2023-11-29T11:13:45.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.953+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2598072500 con 0x7f259806a4c0 2023-11-29T11:13:45.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f258a7fc700 1 -- 172.21.15.81:0/1068304620 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f258c04f380 con 0x7f259806a4c0 2023-11-29T11:13:45.961 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f257c064ee0 msgr2=0x7f257c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f257c064ee0 0x7f257c067390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25940090b0 tx=0x7f2594008030 comp rx=0 tx=0).stop 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259806a4c0 msgr2=0x7f259815a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259806a4c0 0x7f259815a100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c580 tx=0x7f258c00c940 comp rx=0 tx=0).stop 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 shutdown_connections 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f257c064ee0 0x7f257c067390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25980cf0e0 0x7f259815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25980b1ae0 0x7f259815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 --2- 172.21.15.81:0/1068304620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259806a4c0 0x7f259815a100 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:45.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 >> 172.21.15.81:0/1068304620 conn(0x7f259809bbd0 msgr2=0x7f25980cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 shutdown_connections 2023-11-29T11:13:45.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:45.957+0000 7f259ee9b700 1 -- 172.21.15.81:0/1068304620 wait complete. 2023-11-29T11:13:45.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.089+0000 7f801de03700 1 Processor -- start 2023-11-29T11:13:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.089+0000 7f801de03700 1 -- start start 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f801815bb80 0x7f80180b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f801806b370 0x7f801815c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80180ccd00 con 0x7f80180aaf40 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80180b19b0 con 0x7f801815bb80 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80180cd510 con 0x7f801806b370 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801ce01700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f801815bb80 0x7f80180b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801ce01700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f801815bb80 0x7f80180b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35984/0 (socket says 172.21.15.81:35984) 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801ce01700 1 -- 172.21.15.81:0/3895515570 learned_addr learned my addr 172.21.15.81:0/3895515570 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801d602700 1 --2- 172.21.15.81:0/3895515570 >> v2:172.21.15.176:3300/0 conn(0x7f801806b370 0x7f801815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801ce01700 1 -- 172.21.15.81:0/3895515570 >> v2:172.21.15.176:3300/0 conn(0x7f801806b370 msgr2=0x7f801815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:46.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801ce01700 1 --2- 172.21.15.81:0/3895515570 >> v2:172.21.15.176:3300/0 conn(0x7f801806b370 0x7f801815c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801ce01700 1 -- 172.21.15.81:0/3895515570 >> v1:172.21.15.176:6789/0 conn(0x7f80180aaf40 legacy=0x7f80180b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801ce01700 1 -- 172.21.15.81:0/3895515570 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180ccf50 con 0x7f801815bb80 2023-11-29T11:13:46.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801ce01700 1 --2- 172.21.15.81:0/3895515570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180b2450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f80180cadb0 tx=0x7f8000009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50e2f09982f42bf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f80177fe700 1 -- 172.21.15.81:0/3895515570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000011830 con 0x7f801815bb80 2023-11-29T11:13:46.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f80177fe700 1 -- 172.21.15.81:0/3895515570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000011990 con 0x7f801815bb80 2023-11-29T11:13:46.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f80177fe700 1 -- 172.21.15.81:0/3895515570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000011d40 con 0x7f801815bb80 2023-11-29T11:13:46.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 -- 172.21.15.81:0/3895515570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 msgr2=0x7f80180b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 --2- 172.21.15.81:0/3895515570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180b2450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f80180cadb0 tx=0x7f8000009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:46.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 -- 172.21.15.81:0/3895515570 shutdown_connections 2023-11-29T11:13:46.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 --2- 172.21.15.81:0/3895515570 >> v2:172.21.15.176:3300/0 conn(0x7f801806b370 0x7f801815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 --2- 172.21.15.81:0/3895515570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180b2450 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 -- 172.21.15.81:0/3895515570 >> 172.21.15.81:0/3895515570 conn(0x7f80180cae70 msgr2=0x7f80180cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:46.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 -- 172.21.15.81:0/3895515570 shutdown_connections 2023-11-29T11:13:46.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.093+0000 7f801de03700 1 -- 172.21.15.81:0/3895515570 wait complete. 2023-11-29T11:13:46.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 Processor -- start 2023-11-29T11:13:46.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 -- start start 2023-11-29T11:13:46.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f801806b370 0x7f80180c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80180aaf40 0x7f801814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180c79d0 con 0x7f801815bb80 2023-11-29T11:13:46.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180c6d50 con 0x7f801806b370 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80180c7030 con 0x7f80180aaf40 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35986/0 (socket says 172.21.15.81:35986) 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 -- 172.21.15.81:0/110678475 learned_addr learned my addr 172.21.15.81:0/110678475 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801ce01700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f801806b370 0x7f80180c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f8017fff700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80180aaf40 0x7f801814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 -- 172.21.15.81:0/110678475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80180aaf40 msgr2=0x7f801814e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80180aaf40 0x7f801814e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 -- 172.21.15.81:0/110678475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f801806b370 msgr2=0x7f80180c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f801806b370 0x7f80180c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 -- 172.21.15.81:0/110678475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000009570 con 0x7f801815bb80 2023-11-29T11:13:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801d602700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180ae910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f801000eb60 tx=0x7f801000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f80157fa700 1 -- 172.21.15.81:0/110678475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010009740 con 0x7f801815bb80 2023-11-29T11:13:46.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f80157fa700 1 -- 172.21.15.81:0/110678475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010009e00 con 0x7f801815bb80 2023-11-29T11:13:46.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80180b1c50 con 0x7f801815bb80 2023-11-29T11:13:46.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f80157fa700 1 -- 172.21.15.81:0/110678475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000ca70 con 0x7f801815bb80 2023-11-29T11:13:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.097+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80180cd230 con 0x7f801815bb80 2023-11-29T11:13:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.101+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80180b1f30 con 0x7f801815bb80 2023-11-29T11:13:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.101+0000 7f80157fa700 1 -- 172.21.15.81:0/110678475 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8010019030 con 0x7f801815bb80 2023-11-29T11:13:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.101+0000 7f80157fa700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ff8064ee0 0x7f7ff8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.101+0000 7f80157fa700 1 -- 172.21.15.81:0/110678475 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8010082100 con 0x7f801815bb80 2023-11-29T11:13:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.101+0000 7f801ce01700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ff8064ee0 0x7f7ff8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.101+0000 7f801ce01700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ff8064ee0 0x7f7ff8067390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8000014040 tx=0x7f8000008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.109+0000 7f80157fa700 1 -- 172.21.15.81:0/110678475 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f801004fe90 con 0x7f801815bb80 2023-11-29T11:13:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.269+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80180c7b10 con 0x7f801815bb80 2023-11-29T11:13:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.269+0000 7f80157fa700 1 -- 172.21.15.81:0/110678475 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80180c7b10 con 0x7f801815bb80 2023-11-29T11:13:46.276 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ff8064ee0 msgr2=0x7f7ff8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ff8064ee0 0x7f7ff8067390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8000014040 tx=0x7f8000008030 comp rx=0 tx=0).stop 2023-11-29T11:13:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 msgr2=0x7f80180ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180ae910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f801000eb60 tx=0x7f801000ee70 comp rx=0 tx=0).stop 2023-11-29T11:13:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 shutdown_connections 2023-11-29T11:13:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ff8064ee0 0x7f7ff8067390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801815bb80 0x7f80180ae910 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80180aaf40 0x7f801814e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 --2- 172.21.15.81:0/110678475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f801806b370 0x7f80180c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 >> 172.21.15.81:0/110678475 conn(0x7f80180cae70 msgr2=0x7f80180cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 shutdown_connections 2023-11-29T11:13:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.273+0000 7f801de03700 1 -- 172.21.15.81:0/110678475 wait complete. 2023-11-29T11:13:46.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:46.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 Processor -- start 2023-11-29T11:13:46.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 -- start start 2023-11-29T11:13:46.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb104160980 0x7fb1040cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1040cd6b0 con 0x7fb1040c9fe0 2023-11-29T11:13:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1040b1010 con 0x7fb104160980 2023-11-29T11:13:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040ca460 con 0x7fb1040c8e60 2023-11-29T11:13:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10a0ad700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb104160980 0x7fb1040cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10a0ad700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb104160980 0x7fb1040cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35990/0 (socket says 172.21.15.81:35990) 2023-11-29T11:13:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10a0ad700 1 -- 172.21.15.81:0/3283275361 learned_addr learned my addr 172.21.15.81:0/3283275361 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1098ac700 1 --2- 172.21.15.81:0/3283275361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1098ac700 1 -- 172.21.15.81:0/3283275361 >> v2:172.21.15.81:3300/0 conn(0x7fb104160980 msgr2=0x7fb1040cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1098ac700 1 --2- 172.21.15.81:0/3283275361 >> v2:172.21.15.81:3300/0 conn(0x7fb104160980 0x7fb1040cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1098ac700 1 -- 172.21.15.81:0/3283275361 >> v1:172.21.15.81:6789/0 conn(0x7fb1040c9fe0 legacy=0x7fb104164460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1098ac700 1 -- 172.21.15.81:0/3283275361 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1040ce4f0 con 0x7fb1040c8e60 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10a0ad700 1 --2- 172.21.15.81:0/3283275361 >> v2:172.21.15.81:3300/0 conn(0x7fb104160980 0x7fb1040cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1098ac700 1 --2- 172.21.15.81:0/3283275361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c9aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009850 tx=0x7fb0f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad3e04ae505564d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1090ab700 1 -- 172.21.15.81:0/3283275361 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4011830 con 0x7fb1040c8e60 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1090ab700 1 -- 172.21.15.81:0/3283275361 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4011990 con 0x7fb1040c8e60 2023-11-29T11:13:46.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb1090ab700 1 -- 172.21.15.81:0/3283275361 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4011d40 con 0x7fb1040c8e60 2023-11-29T11:13:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 -- 172.21.15.81:0/3283275361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 msgr2=0x7fb1040c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 --2- 172.21.15.81:0/3283275361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c9aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009850 tx=0x7fb0f4009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 -- 172.21.15.81:0/3283275361 shutdown_connections 2023-11-29T11:13:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 --2- 172.21.15.81:0/3283275361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c9aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 --2- 172.21.15.81:0/3283275361 >> v2:172.21.15.81:3300/0 conn(0x7fb104160980 0x7fb1040cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.413+0000 7fb10c311700 1 -- 172.21.15.81:0/3283275361 >> 172.21.15.81:0/3283275361 conn(0x7fb1040cf4a0 msgr2=0x7fb1040cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 -- 172.21.15.81:0/3283275361 shutdown_connections 2023-11-29T11:13:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 -- 172.21.15.81:0/3283275361 wait complete. 2023-11-29T11:13:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 Processor -- start 2023-11-29T11:13:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 -- start start 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1040c9fe0 0x7fb1040c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb104160980 0x7fb1041f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040c5e20 con 0x7fb104160980 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040c60c0 con 0x7fb1040c9fe0 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10c311700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040c63a0 con 0x7fb1040c8e60 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb104160980 0x7fb1041f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb104160980 0x7fb1041f6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36006/0 (socket says 172.21.15.81:36006) 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 -- 172.21.15.81:0/3633027987 learned_addr learned my addr 172.21.15.81:0/3633027987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a0ad700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb1098ac700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1040c9fe0 0x7fb1040c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 -- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 msgr2=0x7fb1040c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 -- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1040c9fe0 msgr2=0x7fb1040c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1040c9fe0 0x7fb1040c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 -- 172.21.15.81:0/3633027987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100009570 con 0x7fb104160980 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb1098ac700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1040c9fe0 0x7fb1040c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb10a8ae700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb104160980 0x7fb1041f6be0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00cc50 tx=0x7fb0fc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.417+0000 7fb0faffd700 1 -- 172.21.15.81:0/3633027987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc003c20 con 0x7fb104160980 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb0faffd700 1 -- 172.21.15.81:0/3633027987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc003d80 con 0x7fb104160980 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f40094b0 con 0x7fb104160980 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb0faffd700 1 -- 172.21.15.81:0/3633027987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00ab60 con 0x7fb104160980 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1040cd8e0 con 0x7fb104160980 2023-11-29T11:13:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb104160d50 con 0x7fb104160980 2023-11-29T11:13:46.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb0faffd700 1 -- 172.21.15.81:0/3633027987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb0fc010050 con 0x7fb104160980 2023-11-29T11:13:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb0faffd700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0e8064ee0 0x7fb0e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb0faffd700 1 -- 172.21.15.81:0/3633027987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb0fc0821b0 con 0x7fb104160980 2023-11-29T11:13:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb10a0ad700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0e8064ee0 0x7fb0e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.421+0000 7fb10a0ad700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0e8064ee0 0x7fb0e8067390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb100006d50 tx=0x7fb1000092e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.429+0000 7fb0faffd700 1 -- 172.21.15.81:0/3633027987 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb0fc04ff30 con 0x7fb104160980 2023-11-29T11:13:46.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.589+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1040cdbc0 con 0x7fb104160980 2023-11-29T11:13:46.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.589+0000 7fb0faffd700 1 -- 172.21.15.81:0/3633027987 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb0fc053550 con 0x7fb104160980 2023-11-29T11:13:46.595 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0e8064ee0 msgr2=0x7fb0e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0e8064ee0 0x7fb0e8067390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb100006d50 tx=0x7fb1000092e0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb104160980 msgr2=0x7fb1041f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb104160980 0x7fb1041f6be0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00cc50 tx=0x7fb0fc00cf60 comp rx=0 tx=0).stop 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 shutdown_connections 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0e8064ee0 0x7fb0e8067390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb104160980 0x7fb1041f6be0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1040c9fe0 0x7fb1040c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 --2- 172.21.15.81:0/3633027987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1040c8e60 0x7fb1040c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 >> 172.21.15.81:0/3633027987 conn(0x7fb1040cf4a0 msgr2=0x7fb10406a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 shutdown_connections 2023-11-29T11:13:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.593+0000 7fb10c311700 1 -- 172.21.15.81:0/3633027987 wait complete. 2023-11-29T11:13:46.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 Processor -- start 2023-11-29T11:13:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 -- start start 2023-11-29T11:13:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d500c1ac0 0x7f0d50069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500ceef0 0x7f0d5006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d500cae70 con 0x7f0d501606b0 2023-11-29T11:13:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d500cbc10 con 0x7f0d500c1ac0 2023-11-29T11:13:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d500cb130 con 0x7f0d500ceef0 2023-11-29T11:13:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d54eb0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d500c1ac0 0x7f0d50069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d54eb0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d500c1ac0 0x7f0d50069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36022/0 (socket says 172.21.15.81:36022) 2023-11-29T11:13:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d54eb0700 1 -- 172.21.15.81:0/2586161160 learned_addr learned my addr 172.21.15.81:0/2586161160 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d55eb2700 1 --2- 172.21.15.81:0/2586161160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500ceef0 0x7f0d5006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d54eb0700 1 -- 172.21.15.81:0/2586161160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500ceef0 msgr2=0x7f0d5006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d54eb0700 1 --2- 172.21.15.81:0/2586161160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500ceef0 0x7f0d5006a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d54eb0700 1 -- 172.21.15.81:0/2586161160 >> v1:172.21.15.81:6789/0 conn(0x7f0d501606b0 legacy=0x7f0d500c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d54eb0700 1 -- 172.21.15.81:0/2586161160 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d500cb410 con 0x7f0d500c1ac0 2023-11-29T11:13:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d54eb0700 1 --2- 172.21.15.81:0/2586161160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d500c1ac0 0x7f0d50069c40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009910 tx=0x7f0d40009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4406fc7dbd3a8127 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d47fff700 1 -- 172.21.15.81:0/2586161160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000ba60 con 0x7f0d500c1ac0 2023-11-29T11:13:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d47fff700 1 -- 172.21.15.81:0/2586161160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000bbc0 con 0x7f0d500c1ac0 2023-11-29T11:13:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d47fff700 1 -- 172.21.15.81:0/2586161160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40009e60 con 0x7f0d500c1ac0 2023-11-29T11:13:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 -- 172.21.15.81:0/2586161160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d500c1ac0 msgr2=0x7f0d50069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 --2- 172.21.15.81:0/2586161160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d500c1ac0 0x7f0d50069c40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009910 tx=0x7f0d40009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 -- 172.21.15.81:0/2586161160 shutdown_connections 2023-11-29T11:13:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 --2- 172.21.15.81:0/2586161160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500ceef0 0x7f0d5006a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 --2- 172.21.15.81:0/2586161160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d500c1ac0 0x7f0d50069c40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 -- 172.21.15.81:0/2586161160 >> 172.21.15.81:0/2586161160 conn(0x7f0d500ce3e0 msgr2=0x7f0d500ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.729+0000 7f0d566b3700 1 -- 172.21.15.81:0/2586161160 shutdown_connections 2023-11-29T11:13:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 -- 172.21.15.81:0/2586161160 wait complete. 2023-11-29T11:13:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 Processor -- start 2023-11-29T11:13:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 -- start start 2023-11-29T11:13:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500c1ac0 0x7f0d501f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d500ceef0 0x7f0d50070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d501606b0 0x7f0d50071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50152350 con 0x7f0d501606b0 2023-11-29T11:13:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d501639f0 con 0x7f0d500ceef0 2023-11-29T11:13:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d566b3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50163710 con 0x7f0d500c1ac0 2023-11-29T11:13:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d55eb2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d501606b0 0x7f0d50071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d55eb2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d501606b0 0x7f0d50071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36024/0 (socket says 172.21.15.81:36024) 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d55eb2700 1 -- 172.21.15.81:0/512008070 learned_addr learned my addr 172.21.15.81:0/512008070 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d54eb0700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d500ceef0 0x7f0d50070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.733+0000 7f0d556b1700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500c1ac0 0x7f0d501f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d55eb2700 1 -- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500c1ac0 msgr2=0x7f0d501f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d55eb2700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500c1ac0 0x7f0d501f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d55eb2700 1 -- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d500ceef0 msgr2=0x7f0d50070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d55eb2700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d500ceef0 0x7f0d50070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d55eb2700 1 -- 172.21.15.81:0/512008070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40009570 con 0x7f0d501606b0 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d556b1700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500c1ac0 0x7f0d501f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d55eb2700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d501606b0 0x7f0d50071330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0d48007e40 tx=0x7f0d4800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d45ffb700 1 -- 172.21.15.81:0/512008070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800ede0 con 0x7f0d501606b0 2023-11-29T11:13:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d45ffb700 1 -- 172.21.15.81:0/512008070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48014420 con 0x7f0d501606b0 2023-11-29T11:13:46.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d45ffb700 1 -- 172.21.15.81:0/512008070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480147d0 con 0x7f0d501606b0 2023-11-29T11:13:46.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d500b36c0 con 0x7f0d501606b0 2023-11-29T11:13:46.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d500cb6f0 con 0x7f0d501606b0 2023-11-29T11:13:46.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d500ad610 con 0x7f0d501606b0 2023-11-29T11:13:46.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.737+0000 7f0d45ffb700 1 -- 172.21.15.81:0/512008070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0d48012050 con 0x7f0d501606b0 2023-11-29T11:13:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.741+0000 7f0d45ffb700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d34064ee0 0x7f0d34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.741+0000 7f0d45ffb700 1 -- 172.21.15.81:0/512008070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d480827a0 con 0x7f0d501606b0 2023-11-29T11:13:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.741+0000 7f0d556b1700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d34064ee0 0x7f0d34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:46.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.741+0000 7f0d556b1700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d34064ee0 0x7f0d34067390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c000f60 tx=0x7f0d4c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:46.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.749+0000 7f0d45ffb700 1 -- 172.21.15.81:0/512008070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0d48050610 con 0x7f0d501606b0 2023-11-29T11:13:46.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.929+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0d50072500 con 0x7f0d501606b0 2023-11-29T11:13:46.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.929+0000 7f0d45ffb700 1 -- 172.21.15.81:0/512008070 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d48053c30 con 0x7f0d501606b0 2023-11-29T11:13:46.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d34064ee0 msgr2=0x7f0d34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d34064ee0 0x7f0d34067390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c000f60 tx=0x7f0d4c009040 comp rx=0 tx=0).stop 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d501606b0 msgr2=0x7f0d50071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d501606b0 0x7f0d50071330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0d48007e40 tx=0x7f0d4800e3c0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 shutdown_connections 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d34064ee0 0x7f0d34067390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d501606b0 0x7f0d50071330 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d500ceef0 0x7f0d50070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 --2- 172.21.15.81:0/512008070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d500c1ac0 0x7f0d501f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 >> 172.21.15.81:0/512008070 conn(0x7f0d500ce3e0 msgr2=0x7f0d5006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 shutdown_connections 2023-11-29T11:13:46.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:46.933+0000 7f0d566b3700 1 -- 172.21.15.81:0/512008070 wait complete. 2023-11-29T11:13:46.939 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:46.950 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:13:46.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:46.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:13:46.960 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:13:46.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:13:46.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:46.960 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:13:46.968 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:13:46.968 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:46.976 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:13:46.976 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:46.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:47.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67f59e700 1 Processor -- start 2023-11-29T11:13:47.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67f59e700 1 -- start start 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6780e6fe0 0x7fd6780e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6780e7af0 con 0x7fd678037900 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67f59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd678055430 con 0x7fd678054fd0 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd678035210 con 0x7fd6780e6fe0 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6780e6fe0 0x7fd6780e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6780e6fe0 0x7fd6780e7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36040/0 (socket says 172.21.15.81:36040) 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67dd9b700 1 -- 172.21.15.81:0/4088977503 learned_addr learned my addr 172.21.15.81:0/4088977503 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67d59a700 1 -- 172.21.15.81:0/4088977503 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401417331 0 0) 0x7fd6780e7af0 con 0x7fd678037900 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67d59a700 1 -- 172.21.15.81:0/4088977503 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6680035d0 con 0x7fd678037900 2023-11-29T11:13:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67d59a700 1 -- 172.21.15.81:0/4088977503 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786614817 0 0) 0x7fd678055430 con 0x7fd678054fd0 2023-11-29T11:13:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67d59a700 1 -- 172.21.15.81:0/4088977503 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6780e7af0 con 0x7fd678054fd0 2023-11-29T11:13:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67dd9b700 1 -- 172.21.15.81:0/4088977503 >> v1:172.21.15.176:6789/0 conn(0x7fd678054fd0 legacy=0x7fd678053a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67dd9b700 1 -- 172.21.15.81:0/4088977503 >> v1:172.21.15.81:6789/0 conn(0x7fd678037900 legacy=0x7fd678037cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67dd9b700 1 -- 172.21.15.81:0/4088977503 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780e74a0 con 0x7fd6780e6fe0 2023-11-29T11:13:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67dd9b700 1 --2- 172.21.15.81:0/4088977503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6780e6fe0 0x7fd6780e7f80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6800694f0 tx=0x7fd680073710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bec873fbb954735 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67d59a700 1 -- 172.21.15.81:0/4088977503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680067660 con 0x7fd6780e6fe0 2023-11-29T11:13:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67d59a700 1 -- 172.21.15.81:0/4088977503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6800727d0 con 0x7fd6780e6fe0 2023-11-29T11:13:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.121+0000 7fd67d59a700 1 -- 172.21.15.81:0/4088977503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680072b40 con 0x7fd6780e6fe0 2023-11-29T11:13:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- 172.21.15.81:0/4088977503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6780e6fe0 msgr2=0x7fd6780e7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 --2- 172.21.15.81:0/4088977503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6780e6fe0 0x7fd6780e7f80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6800694f0 tx=0x7fd680073710 comp rx=0 tx=0).stop 2023-11-29T11:13:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- 172.21.15.81:0/4088977503 shutdown_connections 2023-11-29T11:13:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 --2- 172.21.15.81:0/4088977503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6780e6fe0 0x7fd6780e7f80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- 172.21.15.81:0/4088977503 >> 172.21.15.81:0/4088977503 conn(0x7fd678052900 msgr2=0x7fd678052d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- 172.21.15.81:0/4088977503 shutdown_connections 2023-11-29T11:13:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- 172.21.15.81:0/4088977503 wait complete. 2023-11-29T11:13:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 Processor -- start 2023-11-29T11:13:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- start start 2023-11-29T11:13:47.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678037900 0x7fd67804c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd678054fd0 0x7fd6780509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780e6fe0 0x7fd678050f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67804ff40 con 0x7fd678054fd0 2023-11-29T11:13:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67804f330 con 0x7fd678037900 2023-11-29T11:13:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67804f610 con 0x7fd6780e6fe0 2023-11-29T11:13:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd678054fd0 0x7fd6780509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67e59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678037900 0x7fd67804c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd678054fd0 0x7fd6780509c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36048/0 (socket says 172.21.15.81:36048) 2023-11-29T11:13:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67dd9b700 1 -- 172.21.15.81:0/2868482992 learned_addr learned my addr 172.21.15.81:0/2868482992 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.125+0000 7fd67ed9d700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780e6fe0 0x7fd678050f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67dd9b700 1 -- 172.21.15.81:0/2868482992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780e6fe0 msgr2=0x7fd678050f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67dd9b700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780e6fe0 0x7fd678050f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67dd9b700 1 -- 172.21.15.81:0/2868482992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678037900 msgr2=0x7fd67804c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67dd9b700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678037900 0x7fd67804c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67dd9b700 1 -- 172.21.15.81:0/2868482992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68004e740 con 0x7fd678054fd0 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67dd9b700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd678054fd0 0x7fd6780509c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd68002cad0 tx=0x7fd6800699b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd66effd700 1 -- 172.21.15.81:0/2868482992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680098070 con 0x7fd678054fd0 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd66effd700 1 -- 172.21.15.81:0/2868482992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680072c10 con 0x7fd678054fd0 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6780354f0 con 0x7fd678054fd0 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd66effd700 1 -- 172.21.15.81:0/2868482992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680066d20 con 0x7fd678054fd0 2023-11-29T11:13:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6780e7780 con 0x7fd678054fd0 2023-11-29T11:13:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd678034ae0 con 0x7fd678054fd0 2023-11-29T11:13:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd66effd700 1 -- 172.21.15.81:0/2868482992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd680066e80 con 0x7fd678054fd0 2023-11-29T11:13:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.129+0000 7fd66effd700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd660064ee0 0x7fd660067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.133+0000 7fd66effd700 1 -- 172.21.15.81:0/2868482992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd6800fbfe0 con 0x7fd678054fd0 2023-11-29T11:13:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.133+0000 7fd67e59c700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd660064ee0 0x7fd660067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.133+0000 7fd67e59c700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd660064ee0 0x7fd660067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd6740011e0 tx=0x7fd674009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.141+0000 7fd66effd700 1 -- 172.21.15.81:0/2868482992 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd6800c9ce0 con 0x7fd678054fd0 2023-11-29T11:13:47.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.305+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd678006ad0 con 0x7fd678054fd0 2023-11-29T11:13:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.309+0000 7fd66effd700 1 -- 172.21.15.81:0/2868482992 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fd6800cd300 con 0x7fd678054fd0 2023-11-29T11:13:47.314 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:47.314 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd660064ee0 msgr2=0x7fd660067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd660064ee0 0x7fd660067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd6740011e0 tx=0x7fd674009040 comp rx=0 tx=0).stop 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd678054fd0 msgr2=0x7fd6780509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd678054fd0 0x7fd6780509c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd68002cad0 tx=0x7fd6800699b0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 shutdown_connections 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd660064ee0 0x7fd660067390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6780e6fe0 0x7fd678050f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd678054fd0 0x7fd6780509c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 --2- 172.21.15.81:0/2868482992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd678037900 0x7fd67804c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 >> 172.21.15.81:0/2868482992 conn(0x7fd678052900 msgr2=0x7fd6780490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 shutdown_connections 2023-11-29T11:13:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.313+0000 7fd67f59e700 1 -- 172.21.15.81:0/2868482992 wait complete. 2023-11-29T11:13:47.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:47.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7eea1d8700 1 Processor -- start 2023-11-29T11:13:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7eea1d8700 1 -- start start 2023-11-29T11:13:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7eea1d8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7ee40b1ae0 0x7f7ee406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7eea1d8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ee406a4c0 0x7f7ee40d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7eea1d8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee406a9c0 con 0x7f7ee40cf0e0 2023-11-29T11:13:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7eea1d8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee406aca0 con 0x7f7ee406a4c0 2023-11-29T11:13:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7eea1d8700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee406af80 con 0x7f7ee40b1ae0 2023-11-29T11:13:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7ee89d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ee406a4c0 0x7f7ee40d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7ee89d5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ee406a4c0 0x7f7ee40d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36062/0 (socket says 172.21.15.81:36062) 2023-11-29T11:13:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.445+0000 7f7ee89d5700 1 -- 172.21.15.81:0/2684482021 learned_addr learned my addr 172.21.15.81:0/2684482021 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ee91d6700 1 --2- 172.21.15.81:0/2684482021 >> v2:172.21.15.176:3300/0 conn(0x7f7ee40b1ae0 0x7f7ee406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ee89d5700 1 -- 172.21.15.81:0/2684482021 >> v2:172.21.15.176:3300/0 conn(0x7f7ee40b1ae0 msgr2=0x7f7ee406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ee89d5700 1 --2- 172.21.15.81:0/2684482021 >> v2:172.21.15.176:3300/0 conn(0x7f7ee40b1ae0 0x7f7ee406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ee89d5700 1 -- 172.21.15.81:0/2684482021 >> v1:172.21.15.176:6789/0 conn(0x7f7ee40cf0e0 legacy=0x7f7ee40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ee89d5700 1 -- 172.21.15.81:0/2684482021 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40b4380 con 0x7f7ee406a4c0 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ee89d5700 1 --2- 172.21.15.81:0/2684482021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee40d03a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40b8870 tx=0x7f7ee0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9087915726c5f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ed7fff700 1 -- 172.21.15.81:0/2684482021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0011830 con 0x7f7ee406a4c0 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ed7fff700 1 -- 172.21.15.81:0/2684482021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0011990 con 0x7f7ee406a4c0 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ed7fff700 1 -- 172.21.15.81:0/2684482021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0011d20 con 0x7f7ee406a4c0 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2684482021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 msgr2=0x7f7ee40d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2684482021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee40d03a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40b8870 tx=0x7f7ee0009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2684482021 shutdown_connections 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2684482021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee40d03a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2684482021 >> v2:172.21.15.176:3300/0 conn(0x7f7ee40b1ae0 0x7f7ee406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2684482021 >> 172.21.15.81:0/2684482021 conn(0x7f7ee409bbd0 msgr2=0x7f7ee40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2684482021 shutdown_connections 2023-11-29T11:13:47.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2684482021 wait complete. 2023-11-29T11:13:47.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 Processor -- start 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- start start 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee4158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ee40b1ae0 0x7f7ee40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ee40cf0e0 0x7f7ee40b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c7810 con 0x7f7ee406a4c0 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c6c00 con 0x7f7ee40b1ae0 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7eea1d8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c6ee0 con 0x7f7ee40cf0e0 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.449+0000 7f7ee91d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee4158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee91d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee4158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36066/0 (socket says 172.21.15.81:36066) 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee91d6700 1 -- 172.21.15.81:0/2967946241 learned_addr learned my addr 172.21.15.81:0/2967946241 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee89d5700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ee40b1ae0 0x7f7ee40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee99d7700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ee40cf0e0 0x7f7ee40b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee91d6700 1 -- 172.21.15.81:0/2967946241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ee40cf0e0 msgr2=0x7f7ee40b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee91d6700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ee40cf0e0 0x7f7ee40b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee91d6700 1 -- 172.21.15.81:0/2967946241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ee40b1ae0 msgr2=0x7f7ee40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee91d6700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ee40b1ae0 0x7f7ee40c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee91d6700 1 -- 172.21.15.81:0/2967946241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009570 con 0x7f7ee406a4c0 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ee91d6700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee4158dd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e840 tx=0x7f7ed800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ed5ffb700 1 -- 172.21.15.81:0/2967946241 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80095a0 con 0x7f7ee406a4c0 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ed5ffb700 1 -- 172.21.15.81:0/2967946241 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800c690 con 0x7f7ee406a4c0 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee40b60e0 con 0x7f7ee406a4c0 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ed5ffb700 1 -- 172.21.15.81:0/2967946241 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800ca00 con 0x7f7ee406a4c0 2023-11-29T11:13:47.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee40b1eb0 con 0x7f7ee406a4c0 2023-11-29T11:13:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee40d08e0 con 0x7f7ee406a4c0 2023-11-29T11:13:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ed5ffb700 1 -- 172.21.15.81:0/2967946241 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7ed8019030 con 0x7f7ee406a4c0 2023-11-29T11:13:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.453+0000 7f7ed5ffb700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ec8064ee0 0x7f7ec8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.457+0000 7f7ed5ffb700 1 -- 172.21.15.81:0/2967946241 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7ed8082120 con 0x7f7ee406a4c0 2023-11-29T11:13:47.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.457+0000 7f7ee89d5700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ec8064ee0 0x7f7ec8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.457+0000 7f7ee89d5700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ec8064ee0 0x7f7ec8067390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0000c00 tx=0x7f7ee0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.461+0000 7f7ed5ffb700 1 -- 172.21.15.81:0/2967946241 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7ed804feb0 con 0x7f7ee406a4c0 2023-11-29T11:13:47.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.617+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7ee4072500 con 0x7f7ee406a4c0 2023-11-29T11:13:47.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.617+0000 7f7ed5ffb700 1 -- 172.21.15.81:0/2967946241 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ed80534d0 con 0x7f7ee406a4c0 2023-11-29T11:13:47.623 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ec8064ee0 msgr2=0x7f7ec8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ec8064ee0 0x7f7ec8067390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0000c00 tx=0x7f7ee0008030 comp rx=0 tx=0).stop 2023-11-29T11:13:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 msgr2=0x7f7ee4158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee4158dd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e840 tx=0x7f7ed800ec00 comp rx=0 tx=0).stop 2023-11-29T11:13:47.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 shutdown_connections 2023-11-29T11:13:47.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7ec8064ee0 0x7f7ec8067390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ee40cf0e0 0x7f7ee40b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ee40b1ae0 0x7f7ee40c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 --2- 172.21.15.81:0/2967946241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406a4c0 0x7f7ee4158dd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 >> 172.21.15.81:0/2967946241 conn(0x7f7ee409bbd0 msgr2=0x7f7ee40d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:47.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 shutdown_connections 2023-11-29T11:13:47.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.621+0000 7f7eea1d8700 1 -- 172.21.15.81:0/2967946241 wait complete. 2023-11-29T11:13:47.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:47.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.749+0000 7fe0b1a90700 1 Processor -- start 2023-11-29T11:13:47.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.749+0000 7fe0b1a90700 1 -- start start 2023-11-29T11:13:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.749+0000 7fe0b1a90700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0ac06a4c0 0x7fe0ac06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.749+0000 7fe0b1a90700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0cf0e0 0x7fe0ac0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.749+0000 7fe0b1a90700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0cfa80 con 0x7fe0ac0b1ae0 2023-11-29T11:13:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.749+0000 7fe0b1a90700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac0d0ab0 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.749+0000 7fe0b1a90700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac06a9c0 con 0x7fe0ac0cf0e0 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0abfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0ac06a4c0 0x7fe0ac06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0abfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0ac06a4c0 0x7fe0ac06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36070/0 (socket says 172.21.15.81:36070) 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0abfff700 1 -- 172.21.15.81:0/1486630945 learned_addr learned my addr 172.21.15.81:0/1486630945 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b128f700 1 --2- 172.21.15.81:0/1486630945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0cf0e0 0x7fe0ac0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0abfff700 1 -- 172.21.15.81:0/1486630945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0cf0e0 msgr2=0x7fe0ac0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0abfff700 1 --2- 172.21.15.81:0/1486630945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0cf0e0 0x7fe0ac0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0abfff700 1 -- 172.21.15.81:0/1486630945 >> v1:172.21.15.81:6789/0 conn(0x7fe0ac0b1ae0 legacy=0x7fe0ac0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0abfff700 1 -- 172.21.15.81:0/1486630945 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac06aca0 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0abfff700 1 --2- 172.21.15.81:0/1486630945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac06d8e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009910 tx=0x7fe0a0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b39ccef929581f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0ab7fe700 1 -- 172.21.15.81:0/1486630945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0011830 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0ab7fe700 1 -- 172.21.15.81:0/1486630945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0011990 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0ab7fe700 1 -- 172.21.15.81:0/1486630945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0011d40 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1486630945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 msgr2=0x7fe0ac06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1486630945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac06d8e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009910 tx=0x7fe0a0009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1486630945 shutdown_connections 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1486630945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0cf0e0 0x7fe0ac0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1486630945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac06d8e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1486630945 >> 172.21.15.81:0/1486630945 conn(0x7fe0ac09bbd0 msgr2=0x7fe0ac0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1486630945 shutdown_connections 2023-11-29T11:13:47.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.753+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1486630945 wait complete. 2023-11-29T11:13:47.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 Processor -- start 2023-11-29T11:13:47.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 -- start start 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac1f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0b1ae0 0x7fe0ac15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac0cf0e0 0x7fe0ac15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac159610 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac1f5a70 con 0x7fe0ac0cf0e0 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac15d360 con 0x7fe0ac0b1ae0 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac1f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac1f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36074/0 (socket says 172.21.15.81:36074) 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 -- 172.21.15.81:0/1916832025 learned_addr learned my addr 172.21.15.81:0/1916832025 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:47.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b128f700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac0cf0e0 0x7fe0ac15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0abfff700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0b1ae0 0x7fe0ac15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 -- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0b1ae0 msgr2=0x7fe0ac15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0b1ae0 0x7fe0ac15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 -- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac0cf0e0 msgr2=0x7fe0ac15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac0cf0e0 0x7fe0ac15db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 -- 172.21.15.81:0/1916832025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0009570 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0abfff700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0b1ae0 0x7fe0ac15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b128f700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac0cf0e0 0x7fe0ac15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b0a8e700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac1f5530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00c500 tx=0x7fe09c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0a97fa700 1 -- 172.21.15.81:0/1916832025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0052d0 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0a97fa700 1 -- 172.21.15.81:0/1916832025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c005430 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0a97fa700 1 -- 172.21.15.81:0/1916832025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0055a0 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac0b4380 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.757+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac06af80 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.761+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac0b1eb0 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.761+0000 7fe0a97fa700 1 -- 172.21.15.81:0/1916832025 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe09c019030 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.761+0000 7fe0a97fa700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe098064ee0 0x7fe098067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:47.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.761+0000 7fe0abfff700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe098064ee0 0x7fe098067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:47.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.761+0000 7fe0a97fa700 1 -- 172.21.15.81:0/1916832025 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe09c081690 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.761+0000 7fe0abfff700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe098064ee0 0x7fe098067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0014040 tx=0x7fe0a0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:47.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.765+0000 7fe0a97fa700 1 -- 172.21.15.81:0/1916832025 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe09c04f410 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.929+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0ac072500 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.929+0000 7fe0a97fa700 1 -- 172.21.15.81:0/1916832025 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe09c052a30 con 0x7fe0ac06a4c0 2023-11-29T11:13:47.935 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:47.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe098064ee0 msgr2=0x7fe098067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe098064ee0 0x7fe098067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0014040 tx=0x7fe0a0008030 comp rx=0 tx=0).stop 2023-11-29T11:13:47.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 msgr2=0x7fe0ac1f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:47.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac1f5530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00c500 tx=0x7fe09c00c8c0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 shutdown_connections 2023-11-29T11:13:47.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe098064ee0 0x7fe098067390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0ac0cf0e0 0x7fe0ac15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0ac0b1ae0 0x7fe0ac15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 --2- 172.21.15.81:0/1916832025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ac06a4c0 0x7fe0ac1f5530 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:47.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 >> 172.21.15.81:0/1916832025 conn(0x7fe0ac09bbd0 msgr2=0x7fe0ac0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:47.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 shutdown_connections 2023-11-29T11:13:47.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:47.933+0000 7fe0b1a90700 1 -- 172.21.15.81:0/1916832025 wait complete. 2023-11-29T11:13:47.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.065+0000 7faa8f59e700 1 Processor -- start 2023-11-29T11:13:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.065+0000 7faa8f59e700 1 -- start start 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faa880e29f0 0x7faa88055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 0x7faa8803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa88007360 con 0x7faa8803b160 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8803b600 con 0x7faa880e29f0 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa880e2dc0 con 0x7faa88038560 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faa8803b160 0x7faa880e64c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52660/0 (socket says 172.21.15.81:52660) 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8ed9d700 1 -- 172.21.15.81:0/3001889381 learned_addr learned my addr 172.21.15.81:0/3001889381 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8dd9b700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 0x7faa8803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8e59c700 1 --2- 172.21.15.81:0/3001889381 >> v2:172.21.15.176:3300/0 conn(0x7faa880e29f0 0x7faa88055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074391049 0 0) 0x7faa88007360 con 0x7faa8803b160 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa7c0035d0 con 0x7faa8803b160 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3397212765 0 0) 0x7faa7c0035d0 con 0x7faa8803b160 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 msgr2=0x7faa8803ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 0x7faa8803ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 >> v2:172.21.15.176:3300/0 conn(0x7faa880e29f0 msgr2=0x7faa88055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 --2- 172.21.15.81:0/3001889381 >> v2:172.21.15.176:3300/0 conn(0x7faa880e29f0 0x7faa88055490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88053f70 con 0x7faa8803b160 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7faa900008d0 con 0x7faa8803b160 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 >> v1:172.21.15.81:6789/0 conn(0x7faa8803b160 legacy=0x7faa880e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 0x7faa7c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c003fd0 0x7faa7c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004db0 0x7faa7c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa880e2dc0 con 0x7faa7c003fd0 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c00ba20 con 0x7faa7c004db0 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c00bb60 con 0x7faa88038560 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8dd9b700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c003fd0 0x7faa7c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8e59c700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 0x7faa7c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8ed9d700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004db0 0x7faa7c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8dd9b700 1 -- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 msgr2=0x7faa7c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8dd9b700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 0x7faa7c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8dd9b700 1 -- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004db0 msgr2=0x7faa7c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8dd9b700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004db0 0x7faa7c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8dd9b700 1 -- 172.21.15.81:0/3001889381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0035d0 con 0x7faa7c003fd0 2023-11-29T11:13:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8e59c700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa88038560 0x7faa7c003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8ed9d700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004db0 0x7faa7c005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8dd9b700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c003fd0 0x7faa7c004870 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa78009b40 tx=0x7faa7c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6eeb3a906f3bca server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800e6c0 con 0x7faa7c003fd0 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7800e820 con 0x7faa7c003fd0 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.069+0000 7faa8d59a700 1 -- 172.21.15.81:0/3001889381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800eb90 con 0x7faa7c003fd0 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8f59e700 1 -- 172.21.15.81:0/3001889381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c003fd0 msgr2=0x7faa7c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8f59e700 1 --2- 172.21.15.81:0/3001889381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c003fd0 0x7faa7c004870 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa78009b40 tx=0x7faa7c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8ed9d700 1 -- 172.21.15.81:0/3001889381 reap_dead start 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8f59e700 1 -- 172.21.15.81:0/3001889381 shutdown_connections 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8f59e700 1 -- 172.21.15.81:0/3001889381 >> 172.21.15.81:0/3001889381 conn(0x7faa88055c20 msgr2=0x7faa88056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8f59e700 1 -- 172.21.15.81:0/3001889381 shutdown_connections 2023-11-29T11:13:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8f59e700 1 -- 172.21.15.81:0/3001889381 wait complete. 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8f59e700 1 Processor -- start 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.073+0000 7faa8f59e700 1 -- start start 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c003fd0 0x7faa880dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa8804dd20 0x7faa880529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa8804e190 0x7faa880e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa880e3bb0 con 0x7faa8804e190 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa88053490 con 0x7faa8804dd20 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa880e3280 con 0x7faa7c003fd0 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa8804e190 0x7faa880e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa8804e190 0x7faa880e53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36100/0 (socket says 172.21.15.81:36100) 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 -- 172.21.15.81:0/1936885444 learned_addr learned my addr 172.21.15.81:0/1936885444 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8e59c700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c003fd0 0x7faa880dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8dd9b700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa8804dd20 0x7faa880529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 -- 172.21.15.81:0/1936885444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c003fd0 msgr2=0x7faa880dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c003fd0 0x7faa880dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 -- 172.21.15.81:0/1936885444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa8804dd20 msgr2=0x7faa880529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa8804dd20 0x7faa880529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 -- 172.21.15.81:0/1936885444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88007080 con 0x7faa8804e190 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8ed9d700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa8804e190 0x7faa880e53c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa90078ed0 tx=0x7faa90072ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa86ffd700 1 -- 172.21.15.81:0/1936885444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90067080 con 0x7faa8804e190 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa86ffd700 1 -- 172.21.15.81:0/1936885444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa90067b20 con 0x7faa8804e190 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa88006dc0 con 0x7faa8804e190 2023-11-29T11:13:48.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa86ffd700 1 -- 172.21.15.81:0/1936885444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90067eb0 con 0x7faa8804e190 2023-11-29T11:13:48.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa88053920 con 0x7faa8804e190 2023-11-29T11:13:48.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.077+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa88005570 con 0x7faa8804e190 2023-11-29T11:13:48.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.081+0000 7faa86ffd700 1 -- 172.21.15.81:0/1936885444 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faa9006b0c0 con 0x7faa8804e190 2023-11-29T11:13:48.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.081+0000 7faa86ffd700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa70064f10 0x7faa700673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.081+0000 7faa86ffd700 1 -- 172.21.15.81:0/1936885444 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faa900fafb0 con 0x7faa8804e190 2023-11-29T11:13:48.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.081+0000 7faa8e59c700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa70064f10 0x7faa700673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.081+0000 7faa8e59c700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa70064f10 0x7faa700673c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa88056750 tx=0x7faa80009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.085+0000 7faa86ffd700 1 -- 172.21.15.81:0/1936885444 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faa900c8dc0 con 0x7faa8804e190 2023-11-29T11:13:48.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.249+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa880077b0 con 0x7faa8804e190 2023-11-29T11:13:48.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.249+0000 7faa86ffd700 1 -- 172.21.15.81:0/1936885444 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa900cc3e0 con 0x7faa8804e190 2023-11-29T11:13:48.255 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa70064f10 msgr2=0x7faa700673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa70064f10 0x7faa700673c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa88056750 tx=0x7faa80009240 comp rx=0 tx=0).stop 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa8804e190 msgr2=0x7faa880e53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa8804e190 0x7faa880e53c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa90078ed0 tx=0x7faa90072ab0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 shutdown_connections 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa70064f10 0x7faa700673c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa8804e190 0x7faa880e53c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa8804dd20 0x7faa880529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 --2- 172.21.15.81:0/1936885444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c003fd0 0x7faa880dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 >> 172.21.15.81:0/1936885444 conn(0x7faa88055c20 msgr2=0x7faa88039f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 shutdown_connections 2023-11-29T11:13:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.253+0000 7faa8f59e700 1 -- 172.21.15.81:0/1936885444 wait complete. 2023-11-29T11:13:48.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.377+0000 7f41cb59e700 1 Processor -- start 2023-11-29T11:13:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.377+0000 7f41cb59e700 1 -- start start 2023-11-29T11:13:48.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f41cc06a4c0 0x7f41cc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc06a9c0 con 0x7f41cc0b1ae0 2023-11-29T11:13:48.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc06aca0 con 0x7f41cc0cf0e0 2023-11-29T11:13:48.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0d0ab0 con 0x7f41cc06a4c0 2023-11-29T11:13:48.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c9d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f41cc06a4c0 0x7f41cc06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41ca59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f41cc0b1ae0 0x7f41cc0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52664/0 (socket says 172.21.15.81:52664) 2023-11-29T11:13:48.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41ca59c700 1 -- 172.21.15.81:0/3650876405 learned_addr learned my addr 172.21.15.81:0/3650876405 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:48.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c9d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f41cc06a4c0 0x7f41cc06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36102/0 (socket says 172.21.15.81:36102) 2023-11-29T11:13:48.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c959a700 1 -- 172.21.15.81:0/3650876405 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465738861 0 0) 0x7f41cc06a9c0 con 0x7f41cc0b1ae0 2023-11-29T11:13:48.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c959a700 1 -- 172.21.15.81:0/3650876405 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b80035d0 con 0x7f41cc0b1ae0 2023-11-29T11:13:48.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c9d9b700 1 -- 172.21.15.81:0/3650876405 >> v1:172.21.15.176:6789/0 conn(0x7f41cc0cf0e0 legacy=0x7f41cc0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c959a700 1 -- 172.21.15.81:0/3650876405 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309092025 0 0) 0x7f41cc06aca0 con 0x7f41cc0cf0e0 2023-11-29T11:13:48.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c9d9b700 1 -- 172.21.15.81:0/3650876405 >> v1:172.21.15.81:6789/0 conn(0x7f41cc0b1ae0 legacy=0x7f41cc0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c9d9b700 1 -- 172.21.15.81:0/3650876405 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc06af80 con 0x7f41cc06a4c0 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c9d9b700 1 --2- 172.21.15.81:0/3650876405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc06d8e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009850 tx=0x7f41b4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebe6842f2662635 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c959a700 1 -- 172.21.15.81:0/3650876405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011830 con 0x7f41cc06a4c0 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c959a700 1 -- 172.21.15.81:0/3650876405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b4011990 con 0x7f41cc06a4c0 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41c959a700 1 -- 172.21.15.81:0/3650876405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011d00 con 0x7f41cc06a4c0 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 -- 172.21.15.81:0/3650876405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 msgr2=0x7f41cc06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 --2- 172.21.15.81:0/3650876405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc06d8e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009850 tx=0x7f41b4009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 -- 172.21.15.81:0/3650876405 shutdown_connections 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 --2- 172.21.15.81:0/3650876405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc06d8e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 -- 172.21.15.81:0/3650876405 >> 172.21.15.81:0/3650876405 conn(0x7f41cc09bbd0 msgr2=0x7f41cc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 -- 172.21.15.81:0/3650876405 shutdown_connections 2023-11-29T11:13:48.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.381+0000 7f41cb59e700 1 -- 172.21.15.81:0/3650876405 wait complete. 2023-11-29T11:13:48.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 Processor -- start 2023-11-29T11:13:48.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 -- start start 2023-11-29T11:13:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41cc0b1ae0 0x7f41cc09f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41cc0cf0e0 0x7f41cc09fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0c6150 con 0x7f41cc06a4c0 2023-11-29T11:13:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0c6360 con 0x7f41cc0cf0e0 2023-11-29T11:13:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0c6640 con 0x7f41cc0b1ae0 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc15bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36116/0 (socket says 172.21.15.81:36116) 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 -- 172.21.15.81:0/58956268 learned_addr learned my addr 172.21.15.81:0/58956268 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41c9d9b700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41cc0b1ae0 0x7f41cc09f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 -- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41cc0b1ae0 msgr2=0x7f41cc09f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41cc0b1ae0 0x7f41cc09f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cad9d700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41cc0cf0e0 0x7f41cc09fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 -- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41cc0cf0e0 msgr2=0x7f41cc09fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41cc0cf0e0 0x7f41cc09fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 -- 172.21.15.81:0/58956268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40094b0 con 0x7f41cc06a4c0 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41c9d9b700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41cc0b1ae0 0x7f41cc09f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cad9d700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41cc0cf0e0 0x7f41cc09fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41ca59c700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc15bfa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f41c400caa0 tx=0x7f41c400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41c2ffd700 1 -- 172.21.15.81:0/58956268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400a7b0 con 0x7f41cc06a4c0 2023-11-29T11:13:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc0b1eb0 con 0x7f41cc06a4c0 2023-11-29T11:13:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41c2ffd700 1 -- 172.21.15.81:0/58956268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c400a910 con 0x7f41cc06a4c0 2023-11-29T11:13:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41c2ffd700 1 -- 172.21.15.81:0/58956268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400aca0 con 0x7f41cc06a4c0 2023-11-29T11:13:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc0b4380 con 0x7f41cc06a4c0 2023-11-29T11:13:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.385+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc0b60e0 con 0x7f41cc06a4c0 2023-11-29T11:13:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.389+0000 7f41c2ffd700 1 -- 172.21.15.81:0/58956268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f41c4019030 con 0x7f41cc06a4c0 2023-11-29T11:13:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.389+0000 7f41c2ffd700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f41ac064ee0 0x7f41ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.389+0000 7f41c2ffd700 1 -- 172.21.15.81:0/58956268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f41c4081ad0 con 0x7f41cc06a4c0 2023-11-29T11:13:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.389+0000 7f41c9d9b700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f41ac064ee0 0x7f41ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.389+0000 7f41c9d9b700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f41ac064ee0 0x7f41ac067390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0c9650 tx=0x7f41b4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.393+0000 7f41c2ffd700 1 -- 172.21.15.81:0/58956268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f41c404a400 con 0x7f41cc06a4c0 2023-11-29T11:13:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.553+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41cc072500 con 0x7f41cc06a4c0 2023-11-29T11:13:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.553+0000 7f41c2ffd700 1 -- 172.21.15.81:0/58956268 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41c4017020 con 0x7f41cc06a4c0 2023-11-29T11:13:48.560 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f41ac064ee0 msgr2=0x7f41ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f41ac064ee0 0x7f41ac067390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0c9650 tx=0x7f41b4008030 comp rx=0 tx=0).stop 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 msgr2=0x7f41cc15bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc15bfa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f41c400caa0 tx=0x7f41c400cb80 comp rx=0 tx=0).stop 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 shutdown_connections 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f41ac064ee0 0x7f41ac067390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41cc0cf0e0 0x7f41cc09fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41cc0b1ae0 0x7f41cc09f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 --2- 172.21.15.81:0/58956268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41cc06a4c0 0x7f41cc15bfa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 >> 172.21.15.81:0/58956268 conn(0x7f41cc09bbd0 msgr2=0x7f41cc0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 shutdown_connections 2023-11-29T11:13:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.557+0000 7f41cb59e700 1 -- 172.21.15.81:0/58956268 wait complete. 2023-11-29T11:13:48.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:48.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.689+0000 7fbb2e1c5700 1 Processor -- start 2023-11-29T11:13:48.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.689+0000 7fbb2e1c5700 1 -- start start 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb280cd3a0 0x7fbb280ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2806a4d0 con 0x7fbb28158480 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280cc490 con 0x7fbb28158850 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2806a720 con 0x7fbb280cd3a0 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2d1c3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbb28158480 0x7fbb280cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52674/0 (socket says 172.21.15.81:52674) 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2d1c3700 1 -- 172.21.15.81:0/185790836 learned_addr learned my addr 172.21.15.81:0/185790836 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2d9c4700 1 --2- 172.21.15.81:0/185790836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb280cd3a0 0x7fbb280ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb1ffff700 1 -- 172.21.15.81:0/185790836 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755251331 0 0) 0x7fbb2806a4d0 con 0x7fbb28158480 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb1ffff700 1 -- 172.21.15.81:0/185790836 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb140035d0 con 0x7fbb28158480 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb1ffff700 1 -- 172.21.15.81:0/185790836 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665046819 0 0) 0x7fbb280cc490 con 0x7fbb28158850 2023-11-29T11:13:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb1ffff700 1 -- 172.21.15.81:0/185790836 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2806a4d0 con 0x7fbb28158850 2023-11-29T11:13:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb1ffff700 1 -- 172.21.15.81:0/185790836 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506501322 0 0) 0x7fbb140035d0 con 0x7fbb28158480 2023-11-29T11:13:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2d9c4700 1 -- 172.21.15.81:0/185790836 >> v1:172.21.15.176:6789/0 conn(0x7fbb28158850 legacy=0x7fbb280c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2d9c4700 1 -- 172.21.15.81:0/185790836 >> v1:172.21.15.81:6789/0 conn(0x7fbb28158480 legacy=0x7fbb280cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2d9c4700 1 -- 172.21.15.81:0/185790836 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2806aa00 con 0x7fbb280cd3a0 2023-11-29T11:13:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2d9c4700 1 --2- 172.21.15.81:0/185790836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb280cd3a0 0x7fbb280ceca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009dc0 tx=0x7fbb2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b484c3859e709b72 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb1ffff700 1 -- 172.21.15.81:0/185790836 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000e070 con 0x7fbb280cd3a0 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb1ffff700 1 -- 172.21.15.81:0/185790836 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20003a40 con 0x7fbb280cd3a0 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb1ffff700 1 -- 172.21.15.81:0/185790836 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240017f0 con 0x7fbb280cd3a0 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/185790836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb280cd3a0 msgr2=0x7fbb280ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 --2- 172.21.15.81:0/185790836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb280cd3a0 0x7fbb280ceca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009dc0 tx=0x7fbb2000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/185790836 shutdown_connections 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 --2- 172.21.15.81:0/185790836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb280cd3a0 0x7fbb280ceca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/185790836 >> 172.21.15.81:0/185790836 conn(0x7fbb2806c660 msgr2=0x7fbb2806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/185790836 shutdown_connections 2023-11-29T11:13:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.693+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/185790836 wait complete. 2023-11-29T11:13:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 Processor -- start 2023-11-29T11:13:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 -- start start 2023-11-29T11:13:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb280cd3a0 0x7fbb280c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb28158480 0x7fbb28142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb28158850 0x7fbb28141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28142c10 con 0x7fbb28158480 2023-11-29T11:13:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280c3a60 con 0x7fbb280cd3a0 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28142940 con 0x7fbb28158850 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb28158480 0x7fbb28142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb28158480 0x7fbb28142400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36128/0 (socket says 172.21.15.81:36128) 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 -- 172.21.15.81:0/2019947508 learned_addr learned my addr 172.21.15.81:0/2019947508 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2d9c4700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb28158850 0x7fbb28141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2d1c3700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb280cd3a0 0x7fbb280c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 -- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb28158850 msgr2=0x7fbb28141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb28158850 0x7fbb28141b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 -- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb280cd3a0 msgr2=0x7fbb280c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb280cd3a0 0x7fbb280c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 -- 172.21.15.81:0/2019947508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20009a70 con 0x7fbb28158480 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2d1c3700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb280cd3a0 0x7fbb280c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2c9c2700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb28158480 0x7fbb28142400 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c530 tx=0x7fbb1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb1dffb700 1 -- 172.21.15.81:0/2019947508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180052d0 con 0x7fbb28158480 2023-11-29T11:13:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb1dffb700 1 -- 172.21.15.81:0/2019947508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18005450 con 0x7fbb28158480 2023-11-29T11:13:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb280cf1e0 con 0x7fbb28158480 2023-11-29T11:13:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb1dffb700 1 -- 172.21.15.81:0/2019947508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180038e0 con 0x7fbb28158480 2023-11-29T11:13:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.697+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2806ace0 con 0x7fbb28158480 2023-11-29T11:13:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.701+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb280cf370 con 0x7fbb28158480 2023-11-29T11:13:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.701+0000 7fbb1dffb700 1 -- 172.21.15.81:0/2019947508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb18019030 con 0x7fbb28158480 2023-11-29T11:13:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.701+0000 7fbb1dffb700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb0c064ee0 0x7fbb0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.701+0000 7fbb1dffb700 1 -- 172.21.15.81:0/2019947508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb18081600 con 0x7fbb28158480 2023-11-29T11:13:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.701+0000 7fbb2d1c3700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb0c064ee0 0x7fbb0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.701+0000 7fbb2d1c3700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb0c064ee0 0x7fbb0c067390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb24000ef0 tx=0x7fbb24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:48.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.705+0000 7fbb1dffb700 1 -- 172.21.15.81:0/2019947508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb1804f380 con 0x7fbb28158480 2023-11-29T11:13:48.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbb28072c20 con 0x7fbb28158480 2023-11-29T11:13:48.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb1dffb700 1 -- 172.21.15.81:0/2019947508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbb180529a0 con 0x7fbb28158480 2023-11-29T11:13:48.874 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb0c064ee0 msgr2=0x7fbb0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb0c064ee0 0x7fbb0c067390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb24000ef0 tx=0x7fbb24009040 comp rx=0 tx=0).stop 2023-11-29T11:13:48.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb28158480 msgr2=0x7fbb28142400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb28158480 0x7fbb28142400 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c530 tx=0x7fbb1800c8f0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 shutdown_connections 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb0c064ee0 0x7fbb0c067390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb28158850 0x7fbb28141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb28158480 0x7fbb28142400 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 --2- 172.21.15.81:0/2019947508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb280cd3a0 0x7fbb280c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 >> 172.21.15.81:0/2019947508 conn(0x7fbb2806c660 msgr2=0x7fbb280b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 shutdown_connections 2023-11-29T11:13:48.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.869+0000 7fbb2e1c5700 1 -- 172.21.15.81:0/2019947508 wait complete. 2023-11-29T11:13:48.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.993+0000 7f059ffff700 1 Processor -- start 2023-11-29T11:13:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.993+0000 7f059ffff700 1 -- start start 2023-11-29T11:13:49.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05a015c780 0x7f05a00cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a00ca490 con 0x7f05a015c3b0 2023-11-29T11:13:49.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a00cdad0 con 0x7f05a00ce4a0 2023-11-29T11:13:49.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a00cd4c0 con 0x7f05a015c780 2023-11-29T11:13:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05a015c780 0x7f05a00cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05a015c780 0x7f05a00cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36136/0 (socket says 172.21.15.81:36136) 2023-11-29T11:13:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059e7fc700 1 -- 172.21.15.81:0/512771987 learned_addr learned my addr 172.21.15.81:0/512771987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059e7fc700 1 -- 172.21.15.81:0/512771987 >> v1:172.21.15.176:6789/0 conn(0x7f05a00ce4a0 legacy=0x7f05a0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059e7fc700 1 -- 172.21.15.81:0/512771987 >> v1:172.21.15.81:6789/0 conn(0x7f05a015c3b0 legacy=0x7f05a00c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059e7fc700 1 -- 172.21.15.81:0/512771987 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a00ca6d0 con 0x7f05a015c780 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059e7fc700 1 --2- 172.21.15.81:0/512771987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00cdf60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0590009910 tx=0x7f0590009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268fb216adaba8db server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059dffb700 1 -- 172.21.15.81:0/512771987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000ba60 con 0x7f05a015c780 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059dffb700 1 -- 172.21.15.81:0/512771987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000bbc0 con 0x7f05a015c780 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059dffb700 1 -- 172.21.15.81:0/512771987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590009e60 con 0x7f05a015c780 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 -- 172.21.15.81:0/512771987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 msgr2=0x7f05a00cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 --2- 172.21.15.81:0/512771987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00cdf60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0590009910 tx=0x7f0590009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 -- 172.21.15.81:0/512771987 shutdown_connections 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 --2- 172.21.15.81:0/512771987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00cdf60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 -- 172.21.15.81:0/512771987 >> 172.21.15.81:0/512771987 conn(0x7f05a00b1d40 msgr2=0x7f05a00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 -- 172.21.15.81:0/512771987 shutdown_connections 2023-11-29T11:13:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:48.997+0000 7f059ffff700 1 -- 172.21.15.81:0/512771987 wait complete. 2023-11-29T11:13:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 Processor -- start 2023-11-29T11:13:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 -- start start 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a00ce4a0 0x7f05a01f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05a015c3b0 0x7f05a00b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00b5140 con 0x7f05a015c780 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0159740 con 0x7f05a00ce4a0 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a01f2130 con 0x7f05a015c3b0 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00c5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36150/0 (socket says 172.21.15.81:36150) 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 -- 172.21.15.81:0/1394306362 learned_addr learned my addr 172.21.15.81:0/1394306362 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059e7fc700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05a015c3b0 0x7f05a00b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059effd700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a00ce4a0 0x7f05a01f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 -- 172.21.15.81:0/1394306362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05a015c3b0 msgr2=0x7f05a00b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05a015c3b0 0x7f05a00b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 -- 172.21.15.81:0/1394306362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a00ce4a0 msgr2=0x7f05a01f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a00ce4a0 0x7f05a01f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 -- 172.21.15.81:0/1394306362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009570 con 0x7f05a015c780 2023-11-29T11:13:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059f7fe700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00c5870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f059800cbc0 tx=0x7f059800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f05877fe700 1 -- 172.21.15.81:0/1394306362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598003c20 con 0x7f05a015c780 2023-11-29T11:13:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a00ca9b0 con 0x7f05a015c780 2023-11-29T11:13:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.001+0000 7f05877fe700 1 -- 172.21.15.81:0/1394306362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0598003d80 con 0x7f05a015c780 2023-11-29T11:13:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.005+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a00cd760 con 0x7f05a015c780 2023-11-29T11:13:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.005+0000 7f05877fe700 1 -- 172.21.15.81:0/1394306362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800aae0 con 0x7f05a015c780 2023-11-29T11:13:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.005+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a00cab40 con 0x7f05a015c780 2023-11-29T11:13:49.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.005+0000 7f05877fe700 1 -- 172.21.15.81:0/1394306362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0598010050 con 0x7f05a015c780 2023-11-29T11:13:49.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.005+0000 7f05877fe700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f058c064ee0 0x7f058c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.005+0000 7f05877fe700 1 -- 172.21.15.81:0/1394306362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0598082060 con 0x7f05a015c780 2023-11-29T11:13:49.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.005+0000 7f059effd700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f058c064ee0 0x7f058c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.009+0000 7f059effd700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f058c064ee0 0x7f058c067390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f05a006a960 tx=0x7f0594009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.013+0000 7f05877fe700 1 -- 172.21.15.81:0/1394306362 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f059804fe50 con 0x7f05a015c780 2023-11-29T11:13:49.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.189+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05a0072500 con 0x7f05a015c780 2023-11-29T11:13:49.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.189+0000 7f05877fe700 1 -- 172.21.15.81:0/1394306362 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0598053470 con 0x7f05a015c780 2023-11-29T11:13:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f058c064ee0 msgr2=0x7f058c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f058c064ee0 0x7f058c067390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f05a006a960 tx=0x7f0594009040 comp rx=0 tx=0).stop 2023-11-29T11:13:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 msgr2=0x7f05a00c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00c5870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f059800cbc0 tx=0x7f059800ced0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 shutdown_connections 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f058c064ee0 0x7f058c067390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a015c780 0x7f05a00c5870 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05a015c3b0 0x7f05a00b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 --2- 172.21.15.81:0/1394306362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05a00ce4a0 0x7f05a01f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 >> 172.21.15.81:0/1394306362 conn(0x7f05a00b1d40 msgr2=0x7f05a00b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 shutdown_connections 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.193+0000 7f059ffff700 1 -- 172.21.15.81:0/1394306362 wait complete. 2023-11-29T11:13:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:49.215 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:13:49.215 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:49.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:49.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.329+0000 7fd5a6ad1700 1 Processor -- start 2023-11-29T11:13:49.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.329+0000 7fd5a6ad1700 1 -- start start 2023-11-29T11:13:49.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5a00ceef0 0x7fd5a006a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00cae70 con 0x7fd5a00c1ac0 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00cbc10 con 0x7fd5a01606b0 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a00cb130 con 0x7fd5a00ceef0 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a52ce700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd5a00c1ac0 0x7fd5a0069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52680/0 (socket says 172.21.15.81:52680) 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a52ce700 1 -- 172.21.15.81:0/201279091 learned_addr learned my addr 172.21.15.81:0/201279091 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a62d0700 1 --2- 172.21.15.81:0/201279091 >> v2:172.21.15.176:3300/0 conn(0x7fd5a00ceef0 0x7fd5a006a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026068709 0 0) 0x7fd5a00cae70 con 0x7fd5a00c1ac0 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd58c0035d0 con 0x7fd5a00c1ac0 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175908697 0 0) 0x7fd58c0035d0 con 0x7fd5a00c1ac0 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 >> v2:172.21.15.176:3300/0 conn(0x7fd5a00ceef0 msgr2=0x7fd5a006a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 --2- 172.21.15.81:0/201279091 >> v2:172.21.15.176:3300/0 conn(0x7fd5a00ceef0 0x7fd5a006a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 >> v1:172.21.15.176:6789/0 conn(0x7fd5a01606b0 legacy=0x7fd5a00c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00cb410 con 0x7fd5a00c1ac0 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fd5980019f0 con 0x7fd5a00c1ac0 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 >> v1:172.21.15.81:6789/0 conn(0x7fd5a00c1ac0 legacy=0x7fd5a0069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd58c003a20 0x7fd58c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c004410 0x7fd58c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd58c0050d0 0x7fd58c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00cb130 con 0x7fd58c003a20 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c00c020 con 0x7fd58c004410 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c00c1e0 con 0x7fd58c0050d0 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a5acf700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd58c003a20 0x7fd58c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a52ce700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c004410 0x7fd58c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a62d0700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd58c0050d0 0x7fd58c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a5acf700 1 -- 172.21.15.81:0/201279091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd58c0050d0 msgr2=0x7fd58c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a5acf700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd58c0050d0 0x7fd58c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a5acf700 1 -- 172.21.15.81:0/201279091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c004410 msgr2=0x7fd58c0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a5acf700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c004410 0x7fd58c0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a5acf700 1 -- 172.21.15.81:0/201279091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c0035d0 con 0x7fd58c003a20 2023-11-29T11:13:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a62d0700 1 -- 172.21.15.81:0/201279091 reap_dead start 2023-11-29T11:13:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a5acf700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd58c003a20 0x7fd58c003df0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd5900017e0 tx=0x7fd58c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f610ccabbd94cb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5900052d0 con 0x7fd58c003a20 2023-11-29T11:13:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590005430 con 0x7fd58c003a20 2023-11-29T11:13:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a4acd700 1 -- 172.21.15.81:0/201279091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5900055a0 con 0x7fd58c003a20 2023-11-29T11:13:49.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/201279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd58c003a20 msgr2=0x7fd58c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd58c003a20 0x7fd58c003df0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd5900017e0 tx=0x7fd58c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/201279091 shutdown_connections 2023-11-29T11:13:49.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 --2- 172.21.15.81:0/201279091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd58c003a20 0x7fd58c003df0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/201279091 >> 172.21.15.81:0/201279091 conn(0x7fd5a00ce3e0 msgr2=0x7fd5a00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:49.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/201279091 shutdown_connections 2023-11-29T11:13:49.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.333+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/201279091 wait complete. 2023-11-29T11:13:49.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a6ad1700 1 Processor -- start 2023-11-29T11:13:49.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a6ad1700 1 -- start start 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a6ad1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c003a20 0x7fd5a01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a6ad1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a01f5a30 0x7fd5a00c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a6ad1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a0161fc0 0x7fd5a00aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a6ad1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01f5f90 con 0x7fd5a0161fc0 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a6ad1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01f6270 con 0x7fd58c003a20 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a6ad1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01f6550 con 0x7fd5a01f5a30 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a62d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a0161fc0 0x7fd5a00aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a62d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a0161fc0 0x7fd5a00aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36166/0 (socket says 172.21.15.81:36166) 2023-11-29T11:13:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a62d0700 1 -- 172.21.15.81:0/4069412297 learned_addr learned my addr 172.21.15.81:0/4069412297 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a5acf700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c003a20 0x7fd5a01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.337+0000 7fd5a52ce700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a01f5a30 0x7fd5a00c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a62d0700 1 -- 172.21.15.81:0/4069412297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a01f5a30 msgr2=0x7fd5a00c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a62d0700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a01f5a30 0x7fd5a00c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a62d0700 1 -- 172.21.15.81:0/4069412297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c003a20 msgr2=0x7fd5a01593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a62d0700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c003a20 0x7fd5a01593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a62d0700 1 -- 172.21.15.81:0/4069412297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00b36c0 con 0x7fd5a0161fc0 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a62d0700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a0161fc0 0x7fd5a00aee90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00ce2c0 tx=0x7fd59c011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5967fc700 1 -- 172.21.15.81:0/4069412297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c004240 con 0x7fd5a0161fc0 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5967fc700 1 -- 172.21.15.81:0/4069412297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c0043a0 con 0x7fd5a0161fc0 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a00cb6f0 con 0x7fd5a0161fc0 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5967fc700 1 -- 172.21.15.81:0/4069412297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0036c0 con 0x7fd5a0161fc0 2023-11-29T11:13:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a00ad610 con 0x7fd5a0161fc0 2023-11-29T11:13:49.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.341+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0072500 con 0x7fd5a0161fc0 2023-11-29T11:13:49.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.345+0000 7fd5967fc700 1 -- 172.21.15.81:0/4069412297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd59c025070 con 0x7fd5a0161fc0 2023-11-29T11:13:49.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.345+0000 7fd5967fc700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd584064ee0 0x7fd584067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.345+0000 7fd5967fc700 1 -- 172.21.15.81:0/4069412297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd59c082800 con 0x7fd5a0161fc0 2023-11-29T11:13:49.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.345+0000 7fd5a5acf700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd584064ee0 0x7fd584067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.345+0000 7fd5a5acf700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd584064ee0 0x7fd584067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd590005040 tx=0x7fd590009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.349+0000 7fd5967fc700 1 -- 172.21.15.81:0/4069412297 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd59c050690 con 0x7fd5a0161fc0 2023-11-29T11:13:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.513+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5a006d1a0 con 0x7fd5a0161fc0 2023-11-29T11:13:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.517+0000 7fd5967fc700 1 -- 172.21.15.81:0/4069412297 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fd59c053cb0 con 0x7fd5a0161fc0 2023-11-29T11:13:49.523 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:49.523 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd584064ee0 msgr2=0x7fd584067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd584064ee0 0x7fd584067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd590005040 tx=0x7fd590009030 comp rx=0 tx=0).stop 2023-11-29T11:13:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a0161fc0 msgr2=0x7fd5a00aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a0161fc0 0x7fd5a00aee90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00ce2c0 tx=0x7fd59c011bb0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 shutdown_connections 2023-11-29T11:13:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd584064ee0 0x7fd584067390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a0161fc0 0x7fd5a00aee90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5a01f5a30 0x7fd5a00c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 --2- 172.21.15.81:0/4069412297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd58c003a20 0x7fd5a01593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 >> 172.21.15.81:0/4069412297 conn(0x7fd5a00ce3e0 msgr2=0x7fd5a00cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 shutdown_connections 2023-11-29T11:13:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.521+0000 7fd5a6ad1700 1 -- 172.21.15.81:0/4069412297 wait complete. 2023-11-29T11:13:49.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:49.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:49.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.645+0000 7faa8341c700 1 Processor -- start 2023-11-29T11:13:49.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.645+0000 7faa8341c700 1 -- start start 2023-11-29T11:13:49.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faa7c15c160 0x7faa7c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c06ea10 0x7faa7c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c06f990 con 0x7faa7c0c9c00 2023-11-29T11:13:49.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c06a4d0 con 0x7faa7c15c160 2023-11-29T11:13:49.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c06ee90 con 0x7faa7c06ea10 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa82c1b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c06ea10 0x7faa7c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa82c1b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c06ea10 0x7faa7c0cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:42368/0 (socket says 172.21.15.81:42368) 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa82c1b700 1 -- 172.21.15.81:0/1071287968 learned_addr learned my addr 172.21.15.81:0/1071287968 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa81c19700 1 --2- 172.21.15.81:0/1071287968 >> v2:172.21.15.176:3300/0 conn(0x7faa7c15c160 0x7faa7c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa81418700 1 -- 172.21.15.81:0/1071287968 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402978416 0 0) 0x7faa7c06f990 con 0x7faa7c0c9c00 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa82c1b700 1 -- 172.21.15.81:0/1071287968 >> v2:172.21.15.176:3300/0 conn(0x7faa7c15c160 msgr2=0x7faa7c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa82c1b700 1 --2- 172.21.15.81:0/1071287968 >> v2:172.21.15.176:3300/0 conn(0x7faa7c15c160 0x7faa7c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa82c1b700 1 -- 172.21.15.81:0/1071287968 >> v1:172.21.15.176:6789/0 conn(0x7faa7c0c9c00 legacy=0x7faa7c0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa82c1b700 1 -- 172.21.15.81:0/1071287968 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c06f0f0 con 0x7faa7c06ea10 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa82c1b700 1 --2- 172.21.15.81:0/1071287968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c06ea10 0x7faa7c0cde30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa70009910 tx=0x7faa70009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76788e0f6f8cc0bf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa81418700 1 -- 172.21.15.81:0/1071287968 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70011830 con 0x7faa7c06ea10 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa81418700 1 -- 172.21.15.81:0/1071287968 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa70011990 con 0x7faa7c06ea10 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa81418700 1 -- 172.21.15.81:0/1071287968 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70011d40 con 0x7faa7c06ea10 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 -- 172.21.15.81:0/1071287968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c06ea10 msgr2=0x7faa7c0cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 --2- 172.21.15.81:0/1071287968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c06ea10 0x7faa7c0cde30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa70009910 tx=0x7faa70009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 -- 172.21.15.81:0/1071287968 shutdown_connections 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 --2- 172.21.15.81:0/1071287968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c06ea10 0x7faa7c0cde30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 --2- 172.21.15.81:0/1071287968 >> v2:172.21.15.176:3300/0 conn(0x7faa7c15c160 0x7faa7c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 -- 172.21.15.81:0/1071287968 >> 172.21.15.81:0/1071287968 conn(0x7faa7c0d0240 msgr2=0x7faa7c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 -- 172.21.15.81:0/1071287968 shutdown_connections 2023-11-29T11:13:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.649+0000 7faa8341c700 1 -- 172.21.15.81:0/1071287968 wait complete. 2023-11-29T11:13:49.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 Processor -- start 2023-11-29T11:13:49.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 -- start start 2023-11-29T11:13:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c06ea10 0x7faa7c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c0c9c00 0x7faa7c0c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c15c160 0x7faa7c0c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c0c56e0 con 0x7faa7c15c160 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c1f2a00 con 0x7faa7c06ea10 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c0b2550 con 0x7faa7c0c9c00 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c15c160 0x7faa7c0c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c15c160 0x7faa7c0c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36170/0 (socket says 172.21.15.81:36170) 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 -- 172.21.15.81:0/862071369 learned_addr learned my addr 172.21.15.81:0/862071369 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8241a700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c06ea10 0x7faa7c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa81c19700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c0c9c00 0x7faa7c0c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 -- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c0c9c00 msgr2=0x7faa7c0c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c0c9c00 0x7faa7c0c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 -- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c06ea10 msgr2=0x7faa7c155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c06ea10 0x7faa7c155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 -- 172.21.15.81:0/862071369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70009570 con 0x7faa7c15c160 2023-11-29T11:13:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8241a700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c06ea10 0x7faa7c155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa82c1b700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c15c160 0x7faa7c0c40f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faa70009f70 tx=0x7faa70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa6effd700 1 -- 172.21.15.81:0/862071369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70004590 con 0x7faa7c15c160 2023-11-29T11:13:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa6effd700 1 -- 172.21.15.81:0/862071369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7001e070 con 0x7faa7c15c160 2023-11-29T11:13:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c06f6b0 con 0x7faa7c15c160 2023-11-29T11:13:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa6effd700 1 -- 172.21.15.81:0/862071369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70003900 con 0x7faa7c15c160 2023-11-29T11:13:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.653+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c06f3d0 con 0x7faa7c15c160 2023-11-29T11:13:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.657+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c0cd910 con 0x7faa7c15c160 2023-11-29T11:13:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.657+0000 7faa6effd700 1 -- 172.21.15.81:0/862071369 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faa7000f050 con 0x7faa7c15c160 2023-11-29T11:13:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.657+0000 7faa6effd700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa60064ee0 0x7faa60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.661+0000 7faa8241a700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa60064ee0 0x7faa60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.661+0000 7faa6effd700 1 -- 172.21.15.81:0/862071369 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faa70020070 con 0x7faa7c15c160 2023-11-29T11:13:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.661+0000 7faa8241a700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa60064ee0 0x7faa60067390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa740012e0 tx=0x7faa74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.665+0000 7faa6effd700 1 -- 172.21.15.81:0/862071369 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faa70051550 con 0x7faa7c15c160 2023-11-29T11:13:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.825+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa7c072c20 con 0x7faa7c15c160 2023-11-29T11:13:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.825+0000 7faa6effd700 1 -- 172.21.15.81:0/862071369 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7faa700150a0 con 0x7faa7c15c160 2023-11-29T11:13:49.831 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa60064ee0 msgr2=0x7faa60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa60064ee0 0x7faa60067390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa740012e0 tx=0x7faa74009040 comp rx=0 tx=0).stop 2023-11-29T11:13:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c15c160 msgr2=0x7faa7c0c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c15c160 0x7faa7c0c40f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faa70009f70 tx=0x7faa70004770 comp rx=0 tx=0).stop 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 shutdown_connections 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa60064ee0 0x7faa60067390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa7c15c160 0x7faa7c0c40f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa7c0c9c00 0x7faa7c0c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 --2- 172.21.15.81:0/862071369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c06ea10 0x7faa7c155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 >> 172.21.15.81:0/862071369 conn(0x7faa7c0d0240 msgr2=0x7faa7c0cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 shutdown_connections 2023-11-29T11:13:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.829+0000 7faa8341c700 1 -- 172.21.15.81:0/862071369 wait complete. 2023-11-29T11:13:49.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:49.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.969+0000 7f6fbbfff700 1 Processor -- start 2023-11-29T11:13:49.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.969+0000 7f6fbbfff700 1 -- start start 2023-11-29T11:13:49.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fbc0b1ae0 0x7f6fbc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc06a9c0 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc06aca0 con 0x7f6fbc06a4c0 2023-11-29T11:13:49.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc0d0ab0 con 0x7f6fbc0b1ae0 2023-11-29T11:13:49.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fbc0b1ae0 0x7f6fbc06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbaffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fbc0b1ae0 0x7f6fbc06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39914/0 (socket says 172.21.15.81:39914) 2023-11-29T11:13:49.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbaffd700 1 -- 172.21.15.81:0/3031910317 learned_addr learned my addr 172.21.15.81:0/3031910317 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:49.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbaffd700 1 -- 172.21.15.81:0/3031910317 >> v1:172.21.15.176:6789/0 conn(0x7f6fbc06a4c0 legacy=0x7f6fbc0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbaffd700 1 -- 172.21.15.81:0/3031910317 >> v1:172.21.15.81:6789/0 conn(0x7f6fbc0cf0e0 legacy=0x7f6fbc0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbaffd700 1 -- 172.21.15.81:0/3031910317 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc06af80 con 0x7f6fbc0b1ae0 2023-11-29T11:13:49.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbaffd700 1 --2- 172.21.15.81:0/3031910317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0b1ae0 0x7f6fbc06d8e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009910 tx=0x7f6fac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92eb1af8c6c764d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fba7fc700 1 -- 172.21.15.81:0/3031910317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00ba60 con 0x7f6fbc0b1ae0 2023-11-29T11:13:49.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fba7fc700 1 -- 172.21.15.81:0/3031910317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac00bbc0 con 0x7f6fbc0b1ae0 2023-11-29T11:13:49.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fba7fc700 1 -- 172.21.15.81:0/3031910317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac009e60 con 0x7f6fbc0b1ae0 2023-11-29T11:13:49.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 -- 172.21.15.81:0/3031910317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0b1ae0 msgr2=0x7f6fbc06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 --2- 172.21.15.81:0/3031910317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0b1ae0 0x7f6fbc06d8e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009910 tx=0x7f6fac009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:49.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 -- 172.21.15.81:0/3031910317 shutdown_connections 2023-11-29T11:13:49.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 --2- 172.21.15.81:0/3031910317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0b1ae0 0x7f6fbc06d8e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 -- 172.21.15.81:0/3031910317 >> 172.21.15.81:0/3031910317 conn(0x7f6fbc09bbd0 msgr2=0x7f6fbc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:49.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 -- 172.21.15.81:0/3031910317 shutdown_connections 2023-11-29T11:13:49.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.973+0000 7f6fbbfff700 1 -- 172.21.15.81:0/3031910317 wait complete. 2023-11-29T11:13:49.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbbfff700 1 Processor -- start 2023-11-29T11:13:49.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbbfff700 1 -- start start 2023-11-29T11:13:49.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbbfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fbc06a4c0 0x7f6fbc15e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbbfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fbc0b1ae0 0x7f6fbc15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0cf0e0 0x7f6fbc1f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc150290 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbbfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc15d190 con 0x7f6fbc0b1ae0 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbbfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc15d470 con 0x7f6fbc06a4c0 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0cf0e0 0x7f6fbc1f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fb27fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fbc0b1ae0 0x7f6fbc15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0cf0e0 0x7f6fbc1f1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39924/0 (socket says 172.21.15.81:39924) 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbb7fe700 1 -- 172.21.15.81:0/879605855 learned_addr learned my addr 172.21.15.81:0/879605855 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.977+0000 7f6fbaffd700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fbc06a4c0 0x7f6fbc15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbb7fe700 1 -- 172.21.15.81:0/879605855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fbc06a4c0 msgr2=0x7f6fbc15e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbb7fe700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fbc06a4c0 0x7f6fbc15e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbb7fe700 1 -- 172.21.15.81:0/879605855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fbc0b1ae0 msgr2=0x7f6fbc15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbb7fe700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fbc0b1ae0 0x7f6fbc15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbb7fe700 1 -- 172.21.15.81:0/879605855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009570 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbaffd700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fbc06a4c0 0x7f6fbc15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbb7fe700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0cf0e0 0x7f6fbc1f1d10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400cc50 tx=0x7f6fb400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fb3fff700 1 -- 172.21.15.81:0/879605855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4003c20 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fb3fff700 1 -- 172.21.15.81:0/879605855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb4003d80 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc0b1eb0 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fb3fff700 1 -- 172.21.15.81:0/879605855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400aab0 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc0b4380 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.981+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc0b60e0 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.985+0000 7f6fb3fff700 1 -- 172.21.15.81:0/879605855 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6fb4010050 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.985+0000 7f6fb3fff700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f9c064ee0 0x7f6f9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:49.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.985+0000 7f6fb3fff700 1 -- 172.21.15.81:0/879605855 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6fb4082040 con 0x7f6fbc0cf0e0 2023-11-29T11:13:49.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.985+0000 7f6fbaffd700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f9c064ee0 0x7f6f9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:49.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.985+0000 7f6fbaffd700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f9c064ee0 0x7f6f9c067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6fac006f80 tx=0x7f6fac008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:49.993+0000 7f6fb3fff700 1 -- 172.21.15.81:0/879605855 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6fb404feb0 con 0x7f6fbc0cf0e0 2023-11-29T11:13:50.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fbc072500 con 0x7f6fbc0cf0e0 2023-11-29T11:13:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fb3fff700 1 -- 172.21.15.81:0/879605855 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fb40534d0 con 0x7f6fbc0cf0e0 2023-11-29T11:13:50.162 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f9c064ee0 msgr2=0x7f6f9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f9c064ee0 0x7f6f9c067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6fac006f80 tx=0x7f6fac008030 comp rx=0 tx=0).stop 2023-11-29T11:13:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0cf0e0 msgr2=0x7f6fbc1f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0cf0e0 0x7f6fbc1f1d10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400cc50 tx=0x7f6fb400cf60 comp rx=0 tx=0).stop 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 shutdown_connections 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f9c064ee0 0x7f6f9c067390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fbc0cf0e0 0x7f6fbc1f1d10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fbc0b1ae0 0x7f6fbc15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 --2- 172.21.15.81:0/879605855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fbc06a4c0 0x7f6fbc15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 >> 172.21.15.81:0/879605855 conn(0x7f6fbc09bbd0 msgr2=0x7f6fbc0cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 shutdown_connections 2023-11-29T11:13:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.157+0000 7f6fbbfff700 1 -- 172.21.15.81:0/879605855 wait complete. 2023-11-29T11:13:50.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.281+0000 7f634144f700 1 Processor -- start 2023-11-29T11:13:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.281+0000 7f634144f700 1 -- start start 2023-11-29T11:13:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f633c06ce60 0x7f633c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c0cce60 0x7f633c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c0cd2d0 con 0x7f633c0cf470 2023-11-29T11:13:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c15c8b0 con 0x7f633c06ce60 2023-11-29T11:13:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c06d770 con 0x7f633c0cce60 2023-11-29T11:13:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f633c06ce60 0x7f633c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f633c06ce60 0x7f633c0d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39938/0 (socket says 172.21.15.81:39938) 2023-11-29T11:13:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633bfff700 1 -- 172.21.15.81:0/2476082028 learned_addr learned my addr 172.21.15.81:0/2476082028 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f6333fff700 1 --2- 172.21.15.81:0/2476082028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c0cce60 0x7f633c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633bfff700 1 -- 172.21.15.81:0/2476082028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c0cce60 msgr2=0x7f633c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633bfff700 1 --2- 172.21.15.81:0/2476082028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c0cce60 0x7f633c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633bfff700 1 -- 172.21.15.81:0/2476082028 >> v1:172.21.15.81:6789/0 conn(0x7f633c0cf470 legacy=0x7f633c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633bfff700 1 -- 172.21.15.81:0/2476082028 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c06a7f0 con 0x7f633c06ce60 2023-11-29T11:13:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633bfff700 1 --2- 172.21.15.81:0/2476082028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c06ce60 0x7f633c0d31b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f632c009910 tx=0x7f632c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e86d1aa305bc9a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633b7fe700 1 -- 172.21.15.81:0/2476082028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c011830 con 0x7f633c06ce60 2023-11-29T11:13:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633b7fe700 1 -- 172.21.15.81:0/2476082028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c011990 con 0x7f633c06ce60 2023-11-29T11:13:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f633b7fe700 1 -- 172.21.15.81:0/2476082028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c011d40 con 0x7f633c06ce60 2023-11-29T11:13:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 -- 172.21.15.81:0/2476082028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c06ce60 msgr2=0x7f633c0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 --2- 172.21.15.81:0/2476082028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c06ce60 0x7f633c0d31b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f632c009910 tx=0x7f632c009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 -- 172.21.15.81:0/2476082028 shutdown_connections 2023-11-29T11:13:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 --2- 172.21.15.81:0/2476082028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c0cce60 0x7f633c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 --2- 172.21.15.81:0/2476082028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c06ce60 0x7f633c0d31b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 -- 172.21.15.81:0/2476082028 >> 172.21.15.81:0/2476082028 conn(0x7f633c0b5760 msgr2=0x7f633c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 -- 172.21.15.81:0/2476082028 shutdown_connections 2023-11-29T11:13:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.285+0000 7f634144f700 1 -- 172.21.15.81:0/2476082028 wait complete. 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 Processor -- start 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 -- start start 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c06ce60 0x7f633c0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c0cce60 0x7f633c15ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f633c0cf470 0x7f633c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c15e600 con 0x7f633c0cce60 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c15da30 con 0x7f633c0cf470 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0c82a0 con 0x7f633c06ce60 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c0cce60 0x7f633c15ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c0cce60 0x7f633c15ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39946/0 (socket says 172.21.15.81:39946) 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 -- 172.21.15.81:0/721144470 learned_addr learned my addr 172.21.15.81:0/721144470 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f633bfff700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c06ce60 0x7f633c0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6340c4e700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f633c0cf470 0x7f633c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 -- 172.21.15.81:0/721144470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c06ce60 msgr2=0x7f633c0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c06ce60 0x7f633c0c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 -- 172.21.15.81:0/721144470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f633c0cf470 msgr2=0x7f633c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f633c0cf470 0x7f633c0c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 -- 172.21.15.81:0/721144470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009570 con 0x7f633c0cce60 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f6333fff700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c0cce60 0x7f633c15ea20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f632400e870 tx=0x7f632400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f63397fa700 1 -- 172.21.15.81:0/721144470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240095a0 con 0x7f633c0cce60 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f63397fa700 1 -- 172.21.15.81:0/721144470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324013680 con 0x7f633c0cce60 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c06adb0 con 0x7f633c0cce60 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f63397fa700 1 -- 172.21.15.81:0/721144470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240139f0 con 0x7f633c0cce60 2023-11-29T11:13:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c06aad0 con 0x7f633c0cce60 2023-11-29T11:13:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.289+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c06b090 con 0x7f633c0cce60 2023-11-29T11:13:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.293+0000 7f63397fa700 1 -- 172.21.15.81:0/721144470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6324019030 con 0x7f633c0cce60 2023-11-29T11:13:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.293+0000 7f63397fa700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f631c064ee0 0x7f631c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.293+0000 7f63397fa700 1 -- 172.21.15.81:0/721144470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6324082000 con 0x7f633c0cce60 2023-11-29T11:13:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.293+0000 7f633bfff700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f631c064ee0 0x7f631c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.293+0000 7f633bfff700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f631c064ee0 0x7f631c067390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f632c000c00 tx=0x7f632c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.301+0000 7f63397fa700 1 -- 172.21.15.81:0/721144470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f632404fdf0 con 0x7f633c0cce60 2023-11-29T11:13:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f633c15e740 con 0x7f633c0cce60 2023-11-29T11:13:50.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f63397fa700 1 -- 172.21.15.81:0/721144470 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f633c15e740 con 0x7f633c0cce60 2023-11-29T11:13:50.466 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f631c064ee0 msgr2=0x7f631c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f631c064ee0 0x7f631c067390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f632c000c00 tx=0x7f632c008030 comp rx=0 tx=0).stop 2023-11-29T11:13:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c0cce60 msgr2=0x7f633c15ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c0cce60 0x7f633c15ea20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f632400e870 tx=0x7f632400eb80 comp rx=0 tx=0).stop 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 shutdown_connections 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f631c064ee0 0x7f631c067390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f633c0cf470 0x7f633c0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c0cce60 0x7f633c15ea20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 --2- 172.21.15.81:0/721144470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f633c06ce60 0x7f633c0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 >> 172.21.15.81:0/721144470 conn(0x7f633c0b5760 msgr2=0x7f633c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 shutdown_connections 2023-11-29T11:13:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.461+0000 7f634144f700 1 -- 172.21.15.81:0/721144470 wait complete. 2023-11-29T11:13:50.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e66368700 1 Processor -- start 2023-11-29T11:13:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e66368700 1 -- start start 2023-11-29T11:13:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e66368700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e6015a3e0 0x7f3e600ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e66368700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600b2d30 0x7f3e60069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e66368700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6009c0e0 con 0x7f3e600cc2f0 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e66368700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e600b13e0 con 0x7f3e6015a3e0 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e66368700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600b16c0 con 0x7f3e600b2d30 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e64b65700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e6015a3e0 0x7f3e600ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e64b65700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e6015a3e0 0x7f3e600ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39956/0 (socket says 172.21.15.81:39956) 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e64b65700 1 -- 172.21.15.81:0/1906557643 learned_addr learned my addr 172.21.15.81:0/1906557643 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e65b67700 1 --2- 172.21.15.81:0/1906557643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600b2d30 0x7f3e60069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e64b65700 1 -- 172.21.15.81:0/1906557643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600b2d30 msgr2=0x7f3e60069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e64b65700 1 --2- 172.21.15.81:0/1906557643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600b2d30 0x7f3e60069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e64b65700 1 -- 172.21.15.81:0/1906557643 >> v1:172.21.15.176:6789/0 conn(0x7f3e600cc2f0 legacy=0x7f3e600cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e64b65700 1 -- 172.21.15.81:0/1906557643 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e600b19a0 con 0x7f3e6015a3e0 2023-11-29T11:13:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.593+0000 7f3e64b65700 1 --2- 172.21.15.81:0/1906557643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600ac280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009e50 tx=0x7f3e5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d10793cf4da84f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e5ffff700 1 -- 172.21.15.81:0/1906557643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000e070 con 0x7f3e6015a3e0 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e5ffff700 1 -- 172.21.15.81:0/1906557643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000b9c0 con 0x7f3e6015a3e0 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e5ffff700 1 -- 172.21.15.81:0/1906557643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000bd70 con 0x7f3e6015a3e0 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e66368700 1 -- 172.21.15.81:0/1906557643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 msgr2=0x7f3e600ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e66368700 1 --2- 172.21.15.81:0/1906557643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600ac280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009e50 tx=0x7f3e5000b330 comp rx=0 tx=0).stop 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e66368700 1 -- 172.21.15.81:0/1906557643 shutdown_connections 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e66368700 1 --2- 172.21.15.81:0/1906557643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600b2d30 0x7f3e60069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e66368700 1 --2- 172.21.15.81:0/1906557643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600ac280 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e66368700 1 -- 172.21.15.81:0/1906557643 >> 172.21.15.81:0/1906557643 conn(0x7f3e600cae70 msgr2=0x7f3e600cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e66368700 1 -- 172.21.15.81:0/1906557643 shutdown_connections 2023-11-29T11:13:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.597+0000 7f3e66368700 1 -- 172.21.15.81:0/1906557643 wait complete. 2023-11-29T11:13:50.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 Processor -- start 2023-11-29T11:13:50.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 -- start start 2023-11-29T11:13:50.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e600b2d30 0x7f3e60152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600cc2f0 0x7f3e600c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600c7240 con 0x7f3e6015a3e0 2023-11-29T11:13:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600af4a0 con 0x7f3e600b2d30 2023-11-29T11:13:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600af780 con 0x7f3e600cc2f0 2023-11-29T11:13:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e64b65700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600cc2f0 0x7f3e600c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39964/0 (socket says 172.21.15.81:39964) 2023-11-29T11:13:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 -- 172.21.15.81:0/1782121652 learned_addr learned my addr 172.21.15.81:0/1782121652 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65366700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e600b2d30 0x7f3e60152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 -- 172.21.15.81:0/1782121652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600cc2f0 msgr2=0x7f3e600c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600cc2f0 0x7f3e600c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 -- 172.21.15.81:0/1782121652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e600b2d30 msgr2=0x7f3e60152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e600b2d30 0x7f3e60152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 -- 172.21.15.81:0/1782121652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009b30 con 0x7f3e6015a3e0 2023-11-29T11:13:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e65b67700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600711a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800d800 tx=0x7f3e5800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e5dffb700 1 -- 172.21.15.81:0/1782121652 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580125f0 con 0x7f3e6015a3e0 2023-11-29T11:13:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e5dffb700 1 -- 172.21.15.81:0/1782121652 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58012790 con 0x7f3e6015a3e0 2023-11-29T11:13:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6006a180 con 0x7f3e6015a3e0 2023-11-29T11:13:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e5dffb700 1 -- 172.21.15.81:0/1782121652 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58012b40 con 0x7f3e6015a3e0 2023-11-29T11:13:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.601+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e600b1c80 con 0x7f3e6015a3e0 2023-11-29T11:13:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.605+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6006a310 con 0x7f3e6015a3e0 2023-11-29T11:13:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.605+0000 7f3e5dffb700 1 -- 172.21.15.81:0/1782121652 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3e58012ca0 con 0x7f3e6015a3e0 2023-11-29T11:13:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.605+0000 7f3e5dffb700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e40064ee0 0x7f3e40067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.605+0000 7f3e5dffb700 1 -- 172.21.15.81:0/1782121652 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3e58082320 con 0x7f3e6015a3e0 2023-11-29T11:13:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.605+0000 7f3e65366700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e40064ee0 0x7f3e40067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.605+0000 7f3e65366700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e40064ee0 0x7f3e40067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3e48000f60 tx=0x7f3e48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.613+0000 7f3e5dffb700 1 -- 172.21.15.81:0/1782121652 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3e58050190 con 0x7f3e6015a3e0 2023-11-29T11:13:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.773+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e600c7380 con 0x7f3e6015a3e0 2023-11-29T11:13:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e5dffb700 1 -- 172.21.15.81:0/1782121652 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e600c7380 con 0x7f3e6015a3e0 2023-11-29T11:13:50.781 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e40064ee0 msgr2=0x7f3e40067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e40064ee0 0x7f3e40067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3e48000f60 tx=0x7f3e48009040 comp rx=0 tx=0).stop 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 msgr2=0x7f3e600711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600711a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800d800 tx=0x7f3e5800db10 comp rx=0 tx=0).stop 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 shutdown_connections 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e40064ee0 0x7f3e40067390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6015a3e0 0x7f3e600711a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e600cc2f0 0x7f3e600c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 --2- 172.21.15.81:0/1782121652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e600b2d30 0x7f3e60152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 >> 172.21.15.81:0/1782121652 conn(0x7f3e600cae70 msgr2=0x7f3e6006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:50.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 shutdown_connections 2023-11-29T11:13:50.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.777+0000 7f3e66368700 1 -- 172.21.15.81:0/1782121652 wait complete. 2023-11-29T11:13:50.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f3940c11700 1 Processor -- start 2023-11-29T11:13:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f3940c11700 1 -- start start 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f3940c11700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f39340dd280 0x7f3934050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f3940c11700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39340dfb70 0x7f3934036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f3940c11700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3934052bf0 con 0x7f3934036cb0 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f3940c11700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39340dd650 con 0x7f39340dfb70 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f3940c11700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3934037130 con 0x7f39340dd280 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39340dfb70 0x7f3934036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39340dfb70 0x7f3934036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39978/0 (socket says 172.21.15.81:39978) 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393affd700 1 -- 172.21.15.81:0/3134114049 learned_addr learned my addr 172.21.15.81:0/3134114049 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393b7fe700 1 --2- 172.21.15.81:0/3134114049 >> v2:172.21.15.176:3300/0 conn(0x7f39340dd280 0x7f3934050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393affd700 1 -- 172.21.15.81:0/3134114049 >> v2:172.21.15.176:3300/0 conn(0x7f39340dd280 msgr2=0x7f3934050760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393affd700 1 --2- 172.21.15.81:0/3134114049 >> v2:172.21.15.176:3300/0 conn(0x7f39340dd280 0x7f3934050760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393affd700 1 -- 172.21.15.81:0/3134114049 >> v1:172.21.15.81:6789/0 conn(0x7f3934036cb0 legacy=0x7f39340e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393a7fc700 1 -- 172.21.15.81:0/3134114049 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925023389 0 0) 0x7f3934052bf0 con 0x7f3934036cb0 2023-11-29T11:13:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393affd700 1 -- 172.21.15.81:0/3134114049 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340528c0 con 0x7f39340dfb70 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393affd700 1 --2- 172.21.15.81:0/3134114049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39340dfb70 0x7f3934036770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f393400bd40 tx=0x7f3928009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c548b4293b3f97e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393a7fc700 1 -- 172.21.15.81:0/3134114049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928011830 con 0x7f39340dfb70 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393a7fc700 1 -- 172.21.15.81:0/3134114049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3928011990 con 0x7f39340dfb70 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.913+0000 7f393a7fc700 1 -- 172.21.15.81:0/3134114049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928011d20 con 0x7f39340dfb70 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 -- 172.21.15.81:0/3134114049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39340dfb70 msgr2=0x7f3934036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 --2- 172.21.15.81:0/3134114049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39340dfb70 0x7f3934036770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f393400bd40 tx=0x7f3928009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 -- 172.21.15.81:0/3134114049 shutdown_connections 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 --2- 172.21.15.81:0/3134114049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39340dfb70 0x7f3934036770 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 --2- 172.21.15.81:0/3134114049 >> v2:172.21.15.176:3300/0 conn(0x7f39340dd280 0x7f3934050760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 -- 172.21.15.81:0/3134114049 >> 172.21.15.81:0/3134114049 conn(0x7f3934051770 msgr2=0x7f3934051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 -- 172.21.15.81:0/3134114049 shutdown_connections 2023-11-29T11:13:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 -- 172.21.15.81:0/3134114049 wait complete. 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 Processor -- start 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.917+0000 7f3940c11700 1 -- start start 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934036cb0 0x7f39340d89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39340dd280 0x7f393404e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39340dfb70 0x7f39340d9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393404ec20 con 0x7f3934036cb0 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39340394d0 con 0x7f39340dfb70 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39340397b0 con 0x7f39340dd280 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934036cb0 0x7f39340d89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934036cb0 0x7f39340d89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39980/0 (socket says 172.21.15.81:39980) 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 -- 172.21.15.81:0/1553406546 learned_addr learned my addr 172.21.15.81:0/1553406546 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393bfff700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39340dfb70 0x7f39340d9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393affd700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39340dd280 0x7f393404e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 -- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39340dd280 msgr2=0x7f393404e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39340dd280 0x7f393404e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 -- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39340dfb70 msgr2=0x7f39340d9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39340dfb70 0x7f39340d9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 -- 172.21.15.81:0/1553406546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928009570 con 0x7f3934036cb0 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393bfff700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39340dfb70 0x7f39340d9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393affd700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39340dd280 0x7f393404e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f393b7fe700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934036cb0 0x7f39340d89e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f393000e9d0 tx=0x7f393000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3927fff700 1 -- 172.21.15.81:0/1553406546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930009720 con 0x7f3934036cb0 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3927fff700 1 -- 172.21.15.81:0/1553406546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000c850 con 0x7f3934036cb0 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39340e0710 con 0x7f3934036cb0 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3927fff700 1 -- 172.21.15.81:0/1553406546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000cbc0 con 0x7f3934036cb0 2023-11-29T11:13:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39340e0430 con 0x7f3934036cb0 2023-11-29T11:13:50.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.921+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39340e09f0 con 0x7f3934036cb0 2023-11-29T11:13:50.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.925+0000 7f3927fff700 1 -- 172.21.15.81:0/1553406546 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3930019030 con 0x7f3934036cb0 2023-11-29T11:13:50.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.925+0000 7f3927fff700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3920064f10 0x7f39200673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:50.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.925+0000 7f393affd700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3920064f10 0x7f39200673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:50.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.925+0000 7f3927fff700 1 -- 172.21.15.81:0/1553406546 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3930082160 con 0x7f3934036cb0 2023-11-29T11:13:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.925+0000 7f393affd700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3920064f10 0x7f39200673c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3934051110 tx=0x7f3928008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:50.933+0000 7f3927fff700 1 -- 172.21.15.81:0/1553406546 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f393004ffd0 con 0x7f3934036cb0 2023-11-29T11:13:51.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.093+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3934005570 con 0x7f3934036cb0 2023-11-29T11:13:51.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.093+0000 7f3927fff700 1 -- 172.21.15.81:0/1553406546 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f39300535f0 con 0x7f3934036cb0 2023-11-29T11:13:51.099 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3920064f10 msgr2=0x7f39200673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3920064f10 0x7f39200673c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3934051110 tx=0x7f3928008030 comp rx=0 tx=0).stop 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934036cb0 msgr2=0x7f39340d89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934036cb0 0x7f39340d89e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f393000e9d0 tx=0x7f393000ed90 comp rx=0 tx=0).stop 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 shutdown_connections 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3920064f10 0x7f39200673c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39340dfb70 0x7f39340d9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39340dd280 0x7f393404e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 --2- 172.21.15.81:0/1553406546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934036cb0 0x7f39340d89e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 >> 172.21.15.81:0/1553406546 conn(0x7f3934051770 msgr2=0x7f3934050540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 shutdown_connections 2023-11-29T11:13:51.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.097+0000 7f3940c11700 1 -- 172.21.15.81:0/1553406546 wait complete. 2023-11-29T11:13:51.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.217+0000 7f04b1571700 1 Processor -- start 2023-11-29T11:13:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.217+0000 7f04b1571700 1 -- start start 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04ac06a6e0 0x7f04ac06aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04ac0cbaf0 0x7f04ac06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac15a3a0 con 0x7f04ac0cb5a0 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac06aff0 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac0ca430 con 0x7f04ac06a6e0 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b0d70700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f04ac0cb5a0 0x7f04ac06e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35200/0 (socket says 172.21.15.81:35200) 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b0d70700 1 -- 172.21.15.81:0/856882191 learned_addr learned my addr 172.21.15.81:0/856882191 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04a37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04ac0cbaf0 0x7f04ac06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04abfff700 1 --2- 172.21.15.81:0/856882191 >> v2:172.21.15.176:3300/0 conn(0x7f04ac06a6e0 0x7f04ac06aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04a37fe700 1 -- 172.21.15.81:0/856882191 >> v2:172.21.15.176:3300/0 conn(0x7f04ac06a6e0 msgr2=0x7f04ac06aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04ab7fe700 1 -- 172.21.15.81:0/856882191 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512106904 0 0) 0x7f04a4001490 con 0x7f04ac0cb5a0 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04a37fe700 1 --2- 172.21.15.81:0/856882191 >> v2:172.21.15.176:3300/0 conn(0x7f04ac06a6e0 0x7f04ac06aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04a37fe700 1 -- 172.21.15.81:0/856882191 >> v1:172.21.15.81:6789/0 conn(0x7f04ac0cb5a0 legacy=0x7f04ac06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04a37fe700 1 -- 172.21.15.81:0/856882191 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0ca710 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04abfff700 1 --2- 172.21.15.81:0/856882191 >> v2:172.21.15.176:3300/0 conn(0x7f04ac06a6e0 0x7f04ac06aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04a37fe700 1 --2- 172.21.15.81:0/856882191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac06e000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f04ac06b410 tx=0x7f0494009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4826bc9e2db8b047 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04ab7fe700 1 -- 172.21.15.81:0/856882191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494011830 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04ab7fe700 1 -- 172.21.15.81:0/856882191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0494011990 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04ab7fe700 1 -- 172.21.15.81:0/856882191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494011d20 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 -- 172.21.15.81:0/856882191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 msgr2=0x7f04ac06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 --2- 172.21.15.81:0/856882191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac06e000 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f04ac06b410 tx=0x7f0494009b20 comp rx=0 tx=0).stop 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 -- 172.21.15.81:0/856882191 shutdown_connections 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 --2- 172.21.15.81:0/856882191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac06e000 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 --2- 172.21.15.81:0/856882191 >> v2:172.21.15.176:3300/0 conn(0x7f04ac06a6e0 0x7f04ac06aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 -- 172.21.15.81:0/856882191 >> 172.21.15.81:0/856882191 conn(0x7f04ac0d0240 msgr2=0x7f04ac0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 -- 172.21.15.81:0/856882191 shutdown_connections 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.221+0000 7f04b1571700 1 -- 172.21.15.81:0/856882191 wait complete. 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 Processor -- start 2023-11-29T11:13:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 -- start start 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac06a6e0 0x7f04ac155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04ac0cb5a0 0x7f04ac0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac0c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0c6d70 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac155b80 con 0x7f04ac0cb5a0 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0ad4c0 con 0x7f04ac06a6e0 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac0c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac0c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40000/0 (socket says 172.21.15.81:40000) 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 -- 172.21.15.81:0/1493034087 learned_addr learned my addr 172.21.15.81:0/1493034087 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04a37fe700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04ac0cb5a0 0x7f04ac0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04abfff700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac06a6e0 0x7f04ac155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 -- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac06a6e0 msgr2=0x7f04ac155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac06a6e0 0x7f04ac155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 -- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04ac0cb5a0 msgr2=0x7f04ac0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04ac0cb5a0 0x7f04ac0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 -- 172.21.15.81:0/1493034087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009450 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04abfff700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac06a6e0 0x7f04ac155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b0d70700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac0c3af0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f04a400cbd0 tx=0x7f04a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04a97fa700 1 -- 172.21.15.81:0/1493034087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a400ab70 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04a97fa700 1 -- 172.21.15.81:0/1493034087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a400acf0 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac0cacd0 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04a97fa700 1 -- 172.21.15.81:0/1493034087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a4007310 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac0ca9f0 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.225+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac0cafb0 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.229+0000 7f04a97fa700 1 -- 172.21.15.81:0/1493034087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f04a401a030 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.229+0000 7f04a97fa700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f048c064ee0 0x7f048c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.229+0000 7f04a97fa700 1 -- 172.21.15.81:0/1493034087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f04a4081df0 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.229+0000 7f04abfff700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f048c064ee0 0x7f048c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.229+0000 7f04abfff700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f048c064ee0 0x7f048c067390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f049c009980 tx=0x7f049c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.237+0000 7f04a97fa700 1 -- 172.21.15.81:0/1493034087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f04a404fb70 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.409+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f04ac0c6f20 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.409+0000 7f04a97fa700 1 -- 172.21.15.81:0/1493034087 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f04ac0c6f20 con 0x7f04ac0cbaf0 2023-11-29T11:13:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f048c064ee0 msgr2=0x7f048c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f048c064ee0 0x7f048c067390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f049c009980 tx=0x7f049c008040 comp rx=0 tx=0).stop 2023-11-29T11:13:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 msgr2=0x7f04ac0c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac0c3af0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f04a400cbd0 tx=0x7f04a400cf90 comp rx=0 tx=0).stop 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 shutdown_connections 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f048c064ee0 0x7f048c067390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ac0cbaf0 0x7f04ac0c3af0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04ac0cb5a0 0x7f04ac0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 --2- 172.21.15.81:0/1493034087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac06a6e0 0x7f04ac155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 >> 172.21.15.81:0/1493034087 conn(0x7f04ac0d0240 msgr2=0x7f04ac0b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 shutdown_connections 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.413+0000 7f04b1571700 1 -- 172.21.15.81:0/1493034087 wait complete. 2023-11-29T11:13:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:51.431 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi176.front.sepia.ceph.com... 2023-11-29T11:13:51.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:51.432 DEBUG:teuthology.orchestra.run.smithi176:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-29T11:13:51.467 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:13:51.468 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:13:51.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:51.468 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-29T11:13:51.527 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:13:51.527 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:51.535 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:13:51.535 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:51.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:51.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef5355f700 1 Processor -- start 2023-11-29T11:13:51.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef5355f700 1 -- start start 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef5355f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef4c15a140 0x7fef4c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef5355f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fef4c0b1970 0x7fef4c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef5355f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c06cce0 con 0x7fef4c15e5e0 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef5355f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4c15a510 con 0x7fef4c15a140 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef5355f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4c06cfc0 con 0x7fef4c0b1970 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef512fb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef4c15a140 0x7fef4c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef512fb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef4c15a140 0x7fef4c06aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40002/0 (socket says 172.21.15.81:40002) 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef512fb700 1 -- 172.21.15.81:0/3346076250 learned_addr learned my addr 172.21.15.81:0/3346076250 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef51afc700 1 --2- 172.21.15.81:0/3346076250 >> v2:172.21.15.176:3300/0 conn(0x7fef4c0b1970 0x7fef4c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef512fb700 1 -- 172.21.15.81:0/3346076250 >> v2:172.21.15.176:3300/0 conn(0x7fef4c0b1970 msgr2=0x7fef4c0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef512fb700 1 --2- 172.21.15.81:0/3346076250 >> v2:172.21.15.176:3300/0 conn(0x7fef4c0b1970 0x7fef4c0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef512fb700 1 -- 172.21.15.81:0/3346076250 >> v1:172.21.15.176:6789/0 conn(0x7fef4c15e5e0 legacy=0x7fef4c0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef512fb700 1 -- 172.21.15.81:0/3346076250 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0ca560 con 0x7fef4c15a140 2023-11-29T11:13:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef51afc700 1 --2- 172.21.15.81:0/3346076250 >> v2:172.21.15.176:3300/0 conn(0x7fef4c0b1970 0x7fef4c0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.689+0000 7fef512fb700 1 --2- 172.21.15.81:0/3346076250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15a140 0x7fef4c06aee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fef4c066fb0 tx=0x7fef48009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29e44487eb597b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef43fff700 1 -- 172.21.15.81:0/3346076250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48004230 con 0x7fef4c15a140 2023-11-29T11:13:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef43fff700 1 -- 172.21.15.81:0/3346076250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48004390 con 0x7fef4c15a140 2023-11-29T11:13:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef43fff700 1 -- 172.21.15.81:0/3346076250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480036c0 con 0x7fef4c15a140 2023-11-29T11:13:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 -- 172.21.15.81:0/3346076250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15a140 msgr2=0x7fef4c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 --2- 172.21.15.81:0/3346076250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15a140 0x7fef4c06aee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fef4c066fb0 tx=0x7fef48009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 -- 172.21.15.81:0/3346076250 shutdown_connections 2023-11-29T11:13:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 --2- 172.21.15.81:0/3346076250 >> v2:172.21.15.176:3300/0 conn(0x7fef4c0b1970 0x7fef4c0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 --2- 172.21.15.81:0/3346076250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15a140 0x7fef4c06aee0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 -- 172.21.15.81:0/3346076250 >> 172.21.15.81:0/3346076250 conn(0x7fef4c0cc260 msgr2=0x7fef4c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 -- 172.21.15.81:0/3346076250 shutdown_connections 2023-11-29T11:13:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 -- 172.21.15.81:0/3346076250 wait complete. 2023-11-29T11:13:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 Processor -- start 2023-11-29T11:13:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.693+0000 7fef5355f700 1 -- start start 2023-11-29T11:13:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4c0b1970 0x7fef4c153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4c15a140 0x7fef4c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15e5e0 0x7fef4c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0c6180 con 0x7fef4c15e5e0 2023-11-29T11:13:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0b3fb0 con 0x7fef4c0b1970 2023-11-29T11:13:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0c58e0 con 0x7fef4c15a140 2023-11-29T11:13:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15e5e0 0x7fef4c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15e5e0 0x7fef4c0c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40010/0 (socket says 172.21.15.81:40010) 2023-11-29T11:13:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef512fb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4c0b1970 0x7fef4c153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 -- 172.21.15.81:0/3610266390 learned_addr learned my addr 172.21.15.81:0/3610266390 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef50afa700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4c15a140 0x7fef4c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 -- 172.21.15.81:0/3610266390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4c15a140 msgr2=0x7fef4c0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4c15a140 0x7fef4c0b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 -- 172.21.15.81:0/3610266390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4c0b1970 msgr2=0x7fef4c153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4c0b1970 0x7fef4c153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 -- 172.21.15.81:0/3610266390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009570 con 0x7fef4c15e5e0 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef51afc700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15e5e0 0x7fef4c0c4f70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fef4400cef0 tx=0x7fef4400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef41ffb700 1 -- 172.21.15.81:0/3610266390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400ad00 con 0x7fef4c15e5e0 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef41ffb700 1 -- 172.21.15.81:0/3610266390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4400ae60 con 0x7fef4c15e5e0 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c15ea30 con 0x7fef4c15e5e0 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef41ffb700 1 -- 172.21.15.81:0/3610266390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44015680 con 0x7fef4c15e5e0 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c06c990 con 0x7fef4c15e5e0 2023-11-29T11:13:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.697+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c0cafc0 con 0x7fef4c15e5e0 2023-11-29T11:13:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.701+0000 7fef41ffb700 1 -- 172.21.15.81:0/3610266390 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fef4401c030 con 0x7fef4c15e5e0 2023-11-29T11:13:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.701+0000 7fef41ffb700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fef30064f10 0x7fef300673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.701+0000 7fef41ffb700 1 -- 172.21.15.81:0/3610266390 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fef440825b0 con 0x7fef4c15e5e0 2023-11-29T11:13:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.701+0000 7fef512fb700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fef30064f10 0x7fef300673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.701+0000 7fef512fb700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fef30064f10 0x7fef300673c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fef4c066fb0 tx=0x7fef48008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.705+0000 7fef41ffb700 1 -- 172.21.15.81:0/3610266390 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef44050330 con 0x7fef4c15e5e0 2023-11-29T11:13:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.869+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef4c0c3090 con 0x7fef4c15e5e0 2023-11-29T11:13:51.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.869+0000 7fef41ffb700 1 -- 172.21.15.81:0/3610266390 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fef44053950 con 0x7fef4c15e5e0 2023-11-29T11:13:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:51.876 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:51.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fef30064f10 msgr2=0x7fef300673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fef30064f10 0x7fef300673c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fef4c066fb0 tx=0x7fef48008030 comp rx=0 tx=0).stop 2023-11-29T11:13:51.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15e5e0 msgr2=0x7fef4c0c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:51.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15e5e0 0x7fef4c0c4f70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fef4400cef0 tx=0x7fef4400cf20 comp rx=0 tx=0).stop 2023-11-29T11:13:51.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 shutdown_connections 2023-11-29T11:13:51.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fef30064f10 0x7fef300673c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef4c15e5e0 0x7fef4c0c4f70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef4c15a140 0x7fef4c0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 --2- 172.21.15.81:0/3610266390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef4c0b1970 0x7fef4c153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:51.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 >> 172.21.15.81:0/3610266390 conn(0x7fef4c0cc260 msgr2=0x7fef4c0b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:51.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 shutdown_connections 2023-11-29T11:13:51.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:51.873+0000 7fef5355f700 1 -- 172.21.15.81:0/3610266390 wait complete. 2023-11-29T11:13:51.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:51.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.005+0000 7f0522fab700 1 Processor -- start 2023-11-29T11:13:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.005+0000 7f0522fab700 1 -- start start 2023-11-29T11:13:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f051c158ee0 0x7f051c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c06d1c0 con 0x7f051c0cd5d0 2023-11-29T11:13:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c0ca3a0 con 0x7f051c0ce230 2023-11-29T11:13:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c06e000 con 0x7f051c158ee0 2023-11-29T11:13:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f05217a8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f051c0cd5d0 0x7f051c0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35206/0 (socket says 172.21.15.81:35206) 2023-11-29T11:13:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f05217a8700 1 -- 172.21.15.81:0/2607344110 learned_addr learned my addr 172.21.15.81:0/2607344110 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0521fa9700 1 --2- 172.21.15.81:0/2607344110 >> v2:172.21.15.81:3300/0 conn(0x7f051c158ee0 0x7f051c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0520fa7700 1 -- 172.21.15.81:0/2607344110 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522870015 0 0) 0x7f0518001290 con 0x7f051c0cd5d0 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0520fa7700 1 -- 172.21.15.81:0/2607344110 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05080057e0 con 0x7f051c0cd5d0 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0520fa7700 1 -- 172.21.15.81:0/2607344110 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141222237 0 0) 0x7f051c0ca3a0 con 0x7f051c0ce230 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0521fa9700 1 -- 172.21.15.81:0/2607344110 >> v1:172.21.15.176:6789/0 conn(0x7f051c0ce230 legacy=0x7f051c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0521fa9700 1 -- 172.21.15.81:0/2607344110 >> v1:172.21.15.81:6789/0 conn(0x7f051c0cd5d0 legacy=0x7f051c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0521fa9700 1 -- 172.21.15.81:0/2607344110 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c06c920 con 0x7f051c158ee0 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0521fa9700 1 --2- 172.21.15.81:0/2607344110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c158ee0 0x7f051c0ae760 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0510009850 tx=0x7f0510009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b314b018da1a771c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0520fa7700 1 -- 172.21.15.81:0/2607344110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510011830 con 0x7f051c158ee0 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0520fa7700 1 -- 172.21.15.81:0/2607344110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0510011990 con 0x7f051c158ee0 2023-11-29T11:13:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0520fa7700 1 -- 172.21.15.81:0/2607344110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510011d00 con 0x7f051c158ee0 2023-11-29T11:13:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 -- 172.21.15.81:0/2607344110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c158ee0 msgr2=0x7f051c0ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 --2- 172.21.15.81:0/2607344110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c158ee0 0x7f051c0ae760 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0510009850 tx=0x7f0510009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 -- 172.21.15.81:0/2607344110 shutdown_connections 2023-11-29T11:13:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 --2- 172.21.15.81:0/2607344110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c158ee0 0x7f051c0ae760 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 -- 172.21.15.81:0/2607344110 >> 172.21.15.81:0/2607344110 conn(0x7f051c0d0240 msgr2=0x7f051c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 -- 172.21.15.81:0/2607344110 shutdown_connections 2023-11-29T11:13:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.009+0000 7f0522fab700 1 -- 172.21.15.81:0/2607344110 wait complete. 2023-11-29T11:13:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 Processor -- start 2023-11-29T11:13:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 -- start start 2023-11-29T11:13:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c0cd5d0 0x7f051c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f051c0ce230 0x7f051c0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f051c158ee0 0x7f051c0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0c7f10 con 0x7f051c0cd5d0 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0c81f0 con 0x7f051c0ce230 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0c84d0 con 0x7f051c158ee0 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c0cd5d0 0x7f051c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c0cd5d0 0x7f051c0b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40028/0 (socket says 172.21.15.81:40028) 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 -- 172.21.15.81:0/2166488313 learned_addr learned my addr 172.21.15.81:0/2166488313 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f05217a8700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f051c0ce230 0x7f051c0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f05227aa700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f051c158ee0 0x7f051c0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 -- 172.21.15.81:0/2166488313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f051c158ee0 msgr2=0x7f051c0b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f051c158ee0 0x7f051c0b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 -- 172.21.15.81:0/2166488313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f051c0ce230 msgr2=0x7f051c0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f051c0ce230 0x7f051c0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 -- 172.21.15.81:0/2166488313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100094b0 con 0x7f051c0cd5d0 2023-11-29T11:13:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0521fa9700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c0cd5d0 0x7f051c0b4d40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f051c070b90 tx=0x7f0510004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f050e7fc700 1 -- 172.21.15.81:0/2166488313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05100036c0 con 0x7f051c0cd5d0 2023-11-29T11:13:52.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f050e7fc700 1 -- 172.21.15.81:0/2166488313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051001f070 con 0x7f051c0cd5d0 2023-11-29T11:13:52.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051c06cee0 con 0x7f051c0cd5d0 2023-11-29T11:13:52.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f050e7fc700 1 -- 172.21.15.81:0/2166488313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510003a20 con 0x7f051c0cd5d0 2023-11-29T11:13:52.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.013+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051c06cc00 con 0x7f051c0cd5d0 2023-11-29T11:13:52.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.017+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051c0ca640 con 0x7f051c0cd5d0 2023-11-29T11:13:52.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.017+0000 7f050e7fc700 1 -- 172.21.15.81:0/2166488313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f051000f050 con 0x7f051c0cd5d0 2023-11-29T11:13:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.017+0000 7f050e7fc700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0500064f10 0x7f05000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.017+0000 7f050e7fc700 1 -- 172.21.15.81:0/2166488313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0510021070 con 0x7f051c0cd5d0 2023-11-29T11:13:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.017+0000 7f05217a8700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0500064f10 0x7f05000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.021+0000 7f05217a8700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0500064f10 0x7f05000673c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0518007fd0 tx=0x7f0518009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.021+0000 7f050e7fc700 1 -- 172.21.15.81:0/2166488313 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0510051990 con 0x7f051c0cd5d0 2023-11-29T11:13:52.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.181+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f051c072c20 con 0x7f051c0cd5d0 2023-11-29T11:13:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.185+0000 7f050e7fc700 1 -- 172.21.15.81:0/2166488313 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05100150a0 con 0x7f051c0cd5d0 2023-11-29T11:13:52.189 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0500064f10 msgr2=0x7f05000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0500064f10 0x7f05000673c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0518007fd0 tx=0x7f0518009040 comp rx=0 tx=0).stop 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c0cd5d0 msgr2=0x7f051c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c0cd5d0 0x7f051c0b4d40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f051c070b90 tx=0x7f0510004770 comp rx=0 tx=0).stop 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 shutdown_connections 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0500064f10 0x7f05000673c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f051c158ee0 0x7f051c0b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f051c0ce230 0x7f051c0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 --2- 172.21.15.81:0/2166488313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c0cd5d0 0x7f051c0b4d40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 >> 172.21.15.81:0/2166488313 conn(0x7f051c0d0240 msgr2=0x7f051c06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 shutdown_connections 2023-11-29T11:13:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.189+0000 7f0522fab700 1 -- 172.21.15.81:0/2166488313 wait complete. 2023-11-29T11:13:52.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.325+0000 7f38dc867700 1 Processor -- start 2023-11-29T11:13:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.325+0000 7f38dc867700 1 -- start start 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f38d80cc590 0x7f38d80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38d80cfdd0 0x7f38d80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 0x7f38d815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d806c8e0 con 0x7f38d80cfdd0 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d80b29f0 con 0x7f38d80cc590 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80cac70 con 0x7f38d80b2570 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38d80cfdd0 0x7f38d80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38d80cfdd0 0x7f38d80b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40042/0 (socket says 172.21.15.81:40042) 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 -- 172.21.15.81:0/3659891380 learned_addr learned my addr 172.21.15.81:0/3659891380 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 -- 172.21.15.81:0/3659891380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 msgr2=0x7f38d815fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 --2- 172.21.15.81:0/3659891380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 0x7f38d815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 -- 172.21.15.81:0/3659891380 >> v2:172.21.15.176:3300/0 conn(0x7f38d80cc590 msgr2=0x7f38d80b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38d77fe700 1 --2- 172.21.15.81:0/3659891380 >> v2:172.21.15.176:3300/0 conn(0x7f38d80cc590 0x7f38d80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 --2- 172.21.15.81:0/3659891380 >> v2:172.21.15.176:3300/0 conn(0x7f38d80cc590 0x7f38d80b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 -- 172.21.15.81:0/3659891380 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80d0340 con 0x7f38d80cfdd0 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38d77fe700 1 --2- 172.21.15.81:0/3659891380 >> v2:172.21.15.176:3300/0 conn(0x7f38d80cc590 0x7f38d80b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38ceffd700 1 --2- 172.21.15.81:0/3659891380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d80b2030 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009910 tx=0x7f38c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfad0b2d74c05574 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38d6ffd700 1 -- 172.21.15.81:0/3659891380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000ba20 con 0x7f38d80cfdd0 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38d6ffd700 1 -- 172.21.15.81:0/3659891380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000bb80 con 0x7f38d80cfdd0 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38d6ffd700 1 -- 172.21.15.81:0/3659891380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0009e60 con 0x7f38d80cfdd0 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 -- 172.21.15.81:0/3659891380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 msgr2=0x7f38d80b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 --2- 172.21.15.81:0/3659891380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d80b2030 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009910 tx=0x7f38c0009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 -- 172.21.15.81:0/3659891380 shutdown_connections 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 --2- 172.21.15.81:0/3659891380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 0x7f38d815fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 --2- 172.21.15.81:0/3659891380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d80b2030 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 --2- 172.21.15.81:0/3659891380 >> v2:172.21.15.176:3300/0 conn(0x7f38d80cc590 0x7f38d80b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 -- 172.21.15.81:0/3659891380 >> 172.21.15.81:0/3659891380 conn(0x7f38d80cd0a0 msgr2=0x7f38d80cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 -- 172.21.15.81:0/3659891380 shutdown_connections 2023-11-29T11:13:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 -- 172.21.15.81:0/3659891380 wait complete. 2023-11-29T11:13:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.329+0000 7f38dc867700 1 Processor -- start 2023-11-29T11:13:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 -- start start 2023-11-29T11:13:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 0x7f38d80ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d81f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38d80c4510 0x7f38d81f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c7430 con 0x7f38d80cfdd0 2023-11-29T11:13:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c6820 con 0x7f38d80c4510 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c6b00 con 0x7f38d80b2570 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d81f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d81f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40048/0 (socket says 172.21.15.81:40048) 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 -- 172.21.15.81:0/631445302 learned_addr learned my addr 172.21.15.81:0/631445302 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38d7fff700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38d80c4510 0x7f38d81f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38d77fe700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 0x7f38d80ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 -- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 msgr2=0x7f38d80ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 0x7f38d80ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 -- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38d80c4510 msgr2=0x7f38d81f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38d80c4510 0x7f38d81f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 -- 172.21.15.81:0/631445302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009570 con 0x7f38d80cfdd0 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38d7fff700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38d80c4510 0x7f38d81f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38ceffd700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d81f4e20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f38d8066210 tx=0x7f38c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38d4ff9700 1 -- 172.21.15.81:0/631445302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0004310 con 0x7f38d80cfdd0 2023-11-29T11:13:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38d4ff9700 1 -- 172.21.15.81:0/631445302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c001f070 con 0x7f38d80cfdd0 2023-11-29T11:13:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d806d4b0 con 0x7f38d80cfdd0 2023-11-29T11:13:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38d4ff9700 1 -- 172.21.15.81:0/631445302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c00036c0 con 0x7f38d80cfdd0 2023-11-29T11:13:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.333+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d806d1d0 con 0x7f38d80cfdd0 2023-11-29T11:13:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.337+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d80ce520 con 0x7f38d80cfdd0 2023-11-29T11:13:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.337+0000 7f38d4ff9700 1 -- 172.21.15.81:0/631445302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f38c002a020 con 0x7f38d80cfdd0 2023-11-29T11:13:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.337+0000 7f38d4ff9700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f38b8064ee0 0x7f38b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.337+0000 7f38d4ff9700 1 -- 172.21.15.81:0/631445302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f38c0083910 con 0x7f38d80cfdd0 2023-11-29T11:13:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.337+0000 7f38d77fe700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f38b8064ee0 0x7f38b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.337+0000 7f38d77fe700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f38b8064ee0 0x7f38b8067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f38c8006fd0 tx=0x7f38c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.345+0000 7f38d4ff9700 1 -- 172.21.15.81:0/631445302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f38c0051690 con 0x7f38d80cfdd0 2023-11-29T11:13:52.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.505+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38d80b45d0 con 0x7f38d80cfdd0 2023-11-29T11:13:52.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.505+0000 7f38d4ff9700 1 -- 172.21.15.81:0/631445302 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38d80b45d0 con 0x7f38d80cfdd0 2023-11-29T11:13:52.512 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:52.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f38b8064ee0 msgr2=0x7f38b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f38b8064ee0 0x7f38b8067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f38c8006fd0 tx=0x7f38c8008040 comp rx=0 tx=0).stop 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 msgr2=0x7f38d81f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d81f4e20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f38d8066210 tx=0x7f38c0004770 comp rx=0 tx=0).stop 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 shutdown_connections 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f38b8064ee0 0x7f38b8067390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38d80c4510 0x7f38d81f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80cfdd0 0x7f38d81f4e20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 --2- 172.21.15.81:0/631445302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38d80b2570 0x7f38d80ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 >> 172.21.15.81:0/631445302 conn(0x7f38d80cd0a0 msgr2=0x7f38d815e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 shutdown_connections 2023-11-29T11:13:52.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.509+0000 7f38dc867700 1 -- 172.21.15.81:0/631445302 wait complete. 2023-11-29T11:13:52.526 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:52.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22ec973700 1 Processor -- start 2023-11-29T11:13:52.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22ec973700 1 -- start start 2023-11-29T11:13:52.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22ec973700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22e80cfdd0 0x7f22e80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22ec973700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e80cac70 con 0x7f22e80cc590 2023-11-29T11:13:52.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22ec973700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e80d0340 con 0x7f22e80b2570 2023-11-29T11:13:52.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22ec973700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e806c8e0 con 0x7f22e80cfdd0 2023-11-29T11:13:52.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f22e80cc590 0x7f22e80b0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35218/0 (socket says 172.21.15.81:35218) 2023-11-29T11:13:52.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e77fe700 1 -- 172.21.15.81:0/1164180332 learned_addr learned my addr 172.21.15.81:0/1164180332 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:52.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e6ffd700 1 --2- 172.21.15.81:0/1164180332 >> v2:172.21.15.81:3300/0 conn(0x7f22e80cfdd0 0x7f22e80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e67fc700 1 -- 172.21.15.81:0/1164180332 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668404429 0 0) 0x7f22e80cac70 con 0x7f22e80cc590 2023-11-29T11:13:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e67fc700 1 -- 172.21.15.81:0/1164180332 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d00035d0 con 0x7f22e80cc590 2023-11-29T11:13:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e67fc700 1 -- 172.21.15.81:0/1164180332 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129908177 0 0) 0x7f22e80d0340 con 0x7f22e80b2570 2023-11-29T11:13:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e67fc700 1 -- 172.21.15.81:0/1164180332 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e80cac70 con 0x7f22e80b2570 2023-11-29T11:13:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e6ffd700 1 -- 172.21.15.81:0/1164180332 >> v1:172.21.15.176:6789/0 conn(0x7f22e80b2570 legacy=0x7f22e80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e6ffd700 1 -- 172.21.15.81:0/1164180332 >> v1:172.21.15.81:6789/0 conn(0x7f22e80cc590 legacy=0x7f22e80b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.645+0000 7f22e6ffd700 1 -- 172.21.15.81:0/1164180332 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e806d1d0 con 0x7f22e80cfdd0 2023-11-29T11:13:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22e6ffd700 1 --2- 172.21.15.81:0/1164180332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80cfdd0 0x7f22e80b2030 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009880 tx=0x7f22dc009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9019142a7cbbf45 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22e67fc700 1 -- 172.21.15.81:0/1164180332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc011830 con 0x7f22e80cfdd0 2023-11-29T11:13:52.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22e67fc700 1 -- 172.21.15.81:0/1164180332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc011990 con 0x7f22e80cfdd0 2023-11-29T11:13:52.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22e67fc700 1 -- 172.21.15.81:0/1164180332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc011d20 con 0x7f22e80cfdd0 2023-11-29T11:13:52.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 -- 172.21.15.81:0/1164180332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80cfdd0 msgr2=0x7f22e80b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 --2- 172.21.15.81:0/1164180332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80cfdd0 0x7f22e80b2030 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009880 tx=0x7f22dc009b90 comp rx=0 tx=0).stop 2023-11-29T11:13:52.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 -- 172.21.15.81:0/1164180332 shutdown_connections 2023-11-29T11:13:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 --2- 172.21.15.81:0/1164180332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80cfdd0 0x7f22e80b2030 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 -- 172.21.15.81:0/1164180332 >> 172.21.15.81:0/1164180332 conn(0x7f22e80cd0a0 msgr2=0x7f22e80cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 -- 172.21.15.81:0/1164180332 shutdown_connections 2023-11-29T11:13:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 -- 172.21.15.81:0/1164180332 wait complete. 2023-11-29T11:13:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 Processor -- start 2023-11-29T11:13:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.649+0000 7f22ec973700 1 -- start start 2023-11-29T11:13:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80b2570 0x7f22e8153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22e80cfdd0 0x7f22e815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22e815e8f0 0x7f22e80d0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80b59b0 con 0x7f22e80b2570 2023-11-29T11:13:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e815f400 con 0x7f22e815e8f0 2023-11-29T11:13:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80b4ac0 con 0x7f22e80cfdd0 2023-11-29T11:13:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80b2570 0x7f22e8153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80b2570 0x7f22e8153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40054/0 (socket says 172.21.15.81:40054) 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 -- 172.21.15.81:0/3263962374 learned_addr learned my addr 172.21.15.81:0/3263962374 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e7fff700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22e815e8f0 0x7f22e80d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 -- 172.21.15.81:0/3263962374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22e80cfdd0 msgr2=0x7f22e815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22e80cfdd0 0x7f22e815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 -- 172.21.15.81:0/3263962374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22e815e8f0 msgr2=0x7f22e80d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22e815e8f0 0x7f22e80d0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 -- 172.21.15.81:0/3263962374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0094b0 con 0x7f22e80b2570 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22e77fe700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80b2570 0x7f22e8153d60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f22d800c580 tx=0x7f22d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22cffff700 1 -- 172.21.15.81:0/3263962374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8005d90 con 0x7f22e80b2570 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22cffff700 1 -- 172.21.15.81:0/3263962374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d80070d0 con 0x7f22e80b2570 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e80ce520 con 0x7f22e80b2570 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22cffff700 1 -- 172.21.15.81:0/3263962374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8007440 con 0x7f22e80b2570 2023-11-29T11:13:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e806d4b0 con 0x7f22e80b2570 2023-11-29T11:13:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e806cdf0 con 0x7f22e80b2570 2023-11-29T11:13:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.653+0000 7f22cffff700 1 -- 172.21.15.81:0/3263962374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f22d8019030 con 0x7f22e80b2570 2023-11-29T11:13:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.657+0000 7f22cffff700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f22d4064ee0 0x7f22d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.657+0000 7f22cffff700 1 -- 172.21.15.81:0/3263962374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f22d80814c0 con 0x7f22e80b2570 2023-11-29T11:13:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.657+0000 7f22e6ffd700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f22d4064ee0 0x7f22d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.657+0000 7f22e6ffd700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f22d4064ee0 0x7f22d4067390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f22e80ca920 tx=0x7f22dc010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.661+0000 7f22cffff700 1 -- 172.21.15.81:0/3263962374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f22d804a400 con 0x7f22e80b2570 2023-11-29T11:13:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.825+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22e8072c20 con 0x7f22e80b2570 2023-11-29T11:13:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22cffff700 1 -- 172.21.15.81:0/3263962374 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22d804f3e0 con 0x7f22e80b2570 2023-11-29T11:13:52.833 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f22d4064ee0 msgr2=0x7f22d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f22d4064ee0 0x7f22d4067390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f22e80ca920 tx=0x7f22dc010000 comp rx=0 tx=0).stop 2023-11-29T11:13:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80b2570 msgr2=0x7f22e8153d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80b2570 0x7f22e8153d60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f22d800c580 tx=0x7f22d800c940 comp rx=0 tx=0).stop 2023-11-29T11:13:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 shutdown_connections 2023-11-29T11:13:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f22d4064ee0 0x7f22d4067390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22e815e8f0 0x7f22e80d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22e80cfdd0 0x7f22e815eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 --2- 172.21.15.81:0/3263962374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e80b2570 0x7f22e8153d60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 >> 172.21.15.81:0/3263962374 conn(0x7f22e80cd0a0 msgr2=0x7f22e80cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 shutdown_connections 2023-11-29T11:13:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.829+0000 7f22ec973700 1 -- 172.21.15.81:0/3263962374 wait complete. 2023-11-29T11:13:52.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa195dba700 1 Processor -- start 2023-11-29T11:13:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa195dba700 1 -- start start 2023-11-29T11:13:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa195dba700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1900b1ae0 0x7fa19006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa195dba700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1900cf0e0 0x7fa1900cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa195dba700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1900cfa40 con 0x7fa19006a4c0 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa195dba700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900d0ab0 con 0x7fa1900b1ae0 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa195dba700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19006a9c0 con 0x7fa1900cf0e0 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa194db8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1900b1ae0 0x7fa19006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa194db8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1900b1ae0 0x7fa19006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40064/0 (socket says 172.21.15.81:40064) 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa194db8700 1 -- 172.21.15.81:0/3483545169 learned_addr learned my addr 172.21.15.81:0/3483545169 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa1955b9700 1 --2- 172.21.15.81:0/3483545169 >> v2:172.21.15.176:3300/0 conn(0x7fa1900cf0e0 0x7fa1900cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa194db8700 1 -- 172.21.15.81:0/3483545169 >> v2:172.21.15.176:3300/0 conn(0x7fa1900cf0e0 msgr2=0x7fa1900cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa194db8700 1 --2- 172.21.15.81:0/3483545169 >> v2:172.21.15.176:3300/0 conn(0x7fa1900cf0e0 0x7fa1900cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa194db8700 1 -- 172.21.15.81:0/3483545169 >> v1:172.21.15.176:6789/0 conn(0x7fa19006a4c0 legacy=0x7fa1900d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa194db8700 1 -- 172.21.15.81:0/3483545169 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19006aca0 con 0x7fa1900b1ae0 2023-11-29T11:13:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa194db8700 1 --2- 172.21.15.81:0/3483545169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900b1ae0 0x7fa19006d8e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa1900b6440 tx=0x7fa178009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38a6e87dc96a2bb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa18f7fe700 1 -- 172.21.15.81:0/3483545169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17800b8a0 con 0x7fa1900b1ae0 2023-11-29T11:13:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa18f7fe700 1 -- 172.21.15.81:0/3483545169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17800ba00 con 0x7fa1900b1ae0 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.957+0000 7fa18f7fe700 1 -- 172.21.15.81:0/3483545169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17800bd90 con 0x7fa1900b1ae0 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 -- 172.21.15.81:0/3483545169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900b1ae0 msgr2=0x7fa19006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 --2- 172.21.15.81:0/3483545169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900b1ae0 0x7fa19006d8e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa1900b6440 tx=0x7fa178009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 -- 172.21.15.81:0/3483545169 shutdown_connections 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 --2- 172.21.15.81:0/3483545169 >> v2:172.21.15.176:3300/0 conn(0x7fa1900cf0e0 0x7fa1900cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 --2- 172.21.15.81:0/3483545169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900b1ae0 0x7fa19006d8e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 -- 172.21.15.81:0/3483545169 >> 172.21.15.81:0/3483545169 conn(0x7fa19009bbd0 msgr2=0x7fa1900b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 -- 172.21.15.81:0/3483545169 shutdown_connections 2023-11-29T11:13:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 -- 172.21.15.81:0/3483545169 wait complete. 2023-11-29T11:13:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 Processor -- start 2023-11-29T11:13:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.961+0000 7fa195dba700 1 -- start start 2023-11-29T11:13:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa19006a4c0 0x7fa1900c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1900b1ae0 0x7fa1901eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900cf0e0 0x7fa1901ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900c83b0 con 0x7fa1900cf0e0 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19015f950 con 0x7fa1900b1ae0 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900c77a0 con 0x7fa19006a4c0 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900cf0e0 0x7fa1901ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900cf0e0 0x7fa1901ef0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40078/0 (socket says 172.21.15.81:40078) 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 -- 172.21.15.81:0/482586752 learned_addr learned my addr 172.21.15.81:0/482586752 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa18ffff700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1900b1ae0 0x7fa1901eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa194db8700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa19006a4c0 0x7fa1900c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 -- 172.21.15.81:0/482586752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa19006a4c0 msgr2=0x7fa1900c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa19006a4c0 0x7fa1900c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 -- 172.21.15.81:0/482586752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1900b1ae0 msgr2=0x7fa1901eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1900b1ae0 0x7fa1901eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 -- 172.21.15.81:0/482586752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa178009570 con 0x7fa1900cf0e0 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa1955b9700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900cf0e0 0x7fa1901ef0d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa188007e40 tx=0x7fa18800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa18d7fa700 1 -- 172.21.15.81:0/482586752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800eea0 con 0x7fa1900cf0e0 2023-11-29T11:13:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa18d7fa700 1 -- 172.21.15.81:0/482586752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188014420 con 0x7fa1900cf0e0 2023-11-29T11:13:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900b4380 con 0x7fa1900cf0e0 2023-11-29T11:13:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa18d7fa700 1 -- 172.21.15.81:0/482586752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880147b0 con 0x7fa1900cf0e0 2023-11-29T11:13:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19006af80 con 0x7fa1900cf0e0 2023-11-29T11:13:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.965+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1900b1eb0 con 0x7fa1900cf0e0 2023-11-29T11:13:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.969+0000 7fa18d7fa700 1 -- 172.21.15.81:0/482586752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa188012050 con 0x7fa1900cf0e0 2023-11-29T11:13:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.969+0000 7fa18d7fa700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa170064ee0 0x7fa170067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.969+0000 7fa194db8700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa170064ee0 0x7fa170067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.969+0000 7fa18d7fa700 1 -- 172.21.15.81:0/482586752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa188082880 con 0x7fa1900cf0e0 2023-11-29T11:13:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.969+0000 7fa194db8700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa170064ee0 0x7fa170067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa178000c00 tx=0x7fa178008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:52.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:52.977+0000 7fa18d7fa700 1 -- 172.21.15.81:0/482586752 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa1880506f0 con 0x7fa1900cf0e0 2023-11-29T11:13:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.141+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa190072500 con 0x7fa1900cf0e0 2023-11-29T11:13:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa18d7fa700 1 -- 172.21.15.81:0/482586752 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa188053d10 con 0x7fa1900cf0e0 2023-11-29T11:13:53.149 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:53.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa170064ee0 msgr2=0x7fa170067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa170064ee0 0x7fa170067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa178000c00 tx=0x7fa178008030 comp rx=0 tx=0).stop 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900cf0e0 msgr2=0x7fa1901ef0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900cf0e0 0x7fa1901ef0d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa188007e40 tx=0x7fa18800e3c0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 shutdown_connections 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa170064ee0 0x7fa170067390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1900cf0e0 0x7fa1901ef0d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1900b1ae0 0x7fa1901eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 --2- 172.21.15.81:0/482586752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa19006a4c0 0x7fa1900c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 >> 172.21.15.81:0/482586752 conn(0x7fa19009bbd0 msgr2=0x7fa19015bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 shutdown_connections 2023-11-29T11:13:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.145+0000 7fa195dba700 1 -- 172.21.15.81:0/482586752 wait complete. 2023-11-29T11:13:53.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.273+0000 7f736637c700 1 Processor -- start 2023-11-29T11:13:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.273+0000 7f736637c700 1 -- start start 2023-11-29T11:13:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73600cca00 0x7f7360166ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600b0910 con 0x7f736015c520 2023-11-29T11:13:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736006a470 con 0x7f73600ac1f0 2023-11-29T11:13:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73600b2250 con 0x7f73600cca00 2023-11-29T11:13:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f7365b7b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73600cca00 0x7f7360166ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736537a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f736015c520 0x7f7360069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35230/0 (socket says 172.21.15.81:35230) 2023-11-29T11:13:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736537a700 1 -- 172.21.15.81:0/387198428 learned_addr learned my addr 172.21.15.81:0/387198428 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f7365b7b700 1 -- 172.21.15.81:0/387198428 >> v1:172.21.15.176:6789/0 conn(0x7f73600ac1f0 legacy=0x7f73600cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f7365b7b700 1 -- 172.21.15.81:0/387198428 >> v1:172.21.15.81:6789/0 conn(0x7f736015c520 legacy=0x7f7360069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f735ffff700 1 -- 172.21.15.81:0/387198428 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255265321 0 0) 0x7f73600b0910 con 0x7f736015c520 2023-11-29T11:13:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f7365b7b700 1 -- 172.21.15.81:0/387198428 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736006a750 con 0x7f73600cca00 2023-11-29T11:13:53.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f7365b7b700 1 --2- 172.21.15.81:0/387198428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f7360166ef0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7358009dc0 tx=0x7f735800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e807b03d024310 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f735ffff700 1 -- 172.21.15.81:0/387198428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800e070 con 0x7f73600cca00 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f735ffff700 1 -- 172.21.15.81:0/387198428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735800bb90 con 0x7f73600cca00 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f735ffff700 1 -- 172.21.15.81:0/387198428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358012430 con 0x7f73600cca00 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 -- 172.21.15.81:0/387198428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 msgr2=0x7f7360166ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 --2- 172.21.15.81:0/387198428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f7360166ef0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7358009dc0 tx=0x7f735800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 -- 172.21.15.81:0/387198428 shutdown_connections 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 --2- 172.21.15.81:0/387198428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f7360166ef0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 -- 172.21.15.81:0/387198428 >> 172.21.15.81:0/387198428 conn(0x7f73600cae70 msgr2=0x7f73600cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 -- 172.21.15.81:0/387198428 shutdown_connections 2023-11-29T11:13:53.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.277+0000 7f736637c700 1 -- 172.21.15.81:0/387198428 wait complete. 2023-11-29T11:13:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 Processor -- start 2023-11-29T11:13:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 -- start start 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73600ac1f0 0x7f736009a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f73600af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736015c520 0x7f736015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600aebb0 con 0x7f73600cca00 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600ae720 con 0x7f736015c520 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600af970 con 0x7f73600ac1f0 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f73600af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f73600af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40098/0 (socket says 172.21.15.81:40098) 2023-11-29T11:13:53.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 -- 172.21.15.81:0/2977050472 learned_addr learned my addr 172.21.15.81:0/2977050472 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:53.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7365b7b700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736015c520 0x7f736015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736537a700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73600ac1f0 0x7f736009a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 -- 172.21.15.81:0/2977050472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73600ac1f0 msgr2=0x7f736009a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73600ac1f0 0x7f736009a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 -- 172.21.15.81:0/2977050472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736015c520 msgr2=0x7f736015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736015c520 0x7f736015a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 -- 172.21.15.81:0/2977050472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7358009a70 con 0x7f73600cca00 2023-11-29T11:13:53.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f7364b79700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f73600af430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f735000c500 tx=0x7f735000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f735dffb700 1 -- 172.21.15.81:0/2977050472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500052d0 con 0x7f73600cca00 2023-11-29T11:13:53.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f735dffb700 1 -- 172.21.15.81:0/2977050472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7350005430 con 0x7f73600cca00 2023-11-29T11:13:53.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736006ad10 con 0x7f73600cca00 2023-11-29T11:13:53.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.281+0000 7f735dffb700 1 -- 172.21.15.81:0/2977050472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500055a0 con 0x7f73600cca00 2023-11-29T11:13:53.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.285+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736006aa30 con 0x7f73600cca00 2023-11-29T11:13:53.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.285+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736006aff0 con 0x7f73600cca00 2023-11-29T11:13:53.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.285+0000 7f735dffb700 1 -- 172.21.15.81:0/2977050472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7350019030 con 0x7f73600cca00 2023-11-29T11:13:53.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.285+0000 7f735dffb700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f734c064ee0 0x7f734c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.285+0000 7f735dffb700 1 -- 172.21.15.81:0/2977050472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f73500818c0 con 0x7f73600cca00 2023-11-29T11:13:53.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.285+0000 7f736537a700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f734c064ee0 0x7f734c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.285+0000 7f736537a700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f734c064ee0 0x7f734c067390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7354000f60 tx=0x7f7354007c40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.293+0000 7f735dffb700 1 -- 172.21.15.81:0/2977050472 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f735004f7d0 con 0x7f73600cca00 2023-11-29T11:13:53.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.453+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7360072500 con 0x7f73600cca00 2023-11-29T11:13:53.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.453+0000 7f735dffb700 1 -- 172.21.15.81:0/2977050472 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7350052df0 con 0x7f73600cca00 2023-11-29T11:13:53.459 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:53.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f734c064ee0 msgr2=0x7f734c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f734c064ee0 0x7f734c067390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7354000f60 tx=0x7f7354007c40 comp rx=0 tx=0).stop 2023-11-29T11:13:53.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 msgr2=0x7f73600af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f73600af430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f735000c500 tx=0x7f735000c8c0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 shutdown_connections 2023-11-29T11:13:53.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f734c064ee0 0x7f734c067390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f736015c520 0x7f736015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73600cca00 0x7f73600af430 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 --2- 172.21.15.81:0/2977050472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73600ac1f0 0x7f736009a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 >> 172.21.15.81:0/2977050472 conn(0x7f73600cae70 msgr2=0x7f7360069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:53.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 shutdown_connections 2023-11-29T11:13:53.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.457+0000 7f736637c700 1 -- 172.21.15.81:0/2977050472 wait complete. 2023-11-29T11:13:53.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:53.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.585+0000 7fbef4e97700 1 Processor -- start 2023-11-29T11:13:53.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.585+0000 7fbef4e97700 1 -- start start 2023-11-29T11:13:53.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef00cf050 0x7fbef006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbef00b4c10 0x7fbef00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef015c6d0 con 0x7fbef006a530 2023-11-29T11:13:53.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef006a9a0 con 0x7fbef00b4c10 2023-11-29T11:13:53.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef006ac60 con 0x7fbef00cf050 2023-11-29T11:13:53.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeef7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef00cf050 0x7fbef006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeeffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbef00b4c10 0x7fbef00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeeeffd700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fbef006a530 0x7fbef00cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:36956/0 (socket says 172.21.15.81:36956) 2023-11-29T11:13:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeeeffd700 1 -- 172.21.15.81:0/3305653171 learned_addr learned my addr 172.21.15.81:0/3305653171 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeeffff700 1 -- 172.21.15.81:0/3305653171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef00cf050 msgr2=0x7fbef006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeeffff700 1 --2- 172.21.15.81:0/3305653171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef00cf050 0x7fbef006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeeffff700 1 -- 172.21.15.81:0/3305653171 >> v1:172.21.15.176:6789/0 conn(0x7fbef006a530 legacy=0x7fbef00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeeffff700 1 -- 172.21.15.81:0/3305653171 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef006af40 con 0x7fbef00b4c10 2023-11-29T11:13:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeeffff700 1 --2- 172.21.15.81:0/3305653171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 0x7fbef00cce20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009d90 tx=0x7fbee800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c3c57cd4a615195 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeee7fc700 1 -- 172.21.15.81:0/3305653171 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800e070 con 0x7fbef00b4c10 2023-11-29T11:13:53.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeee7fc700 1 -- 172.21.15.81:0/3305653171 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee800bb20 con 0x7fbef00b4c10 2023-11-29T11:13:53.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbeee7fc700 1 -- 172.21.15.81:0/3305653171 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8012430 con 0x7fbef00b4c10 2023-11-29T11:13:53.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 -- 172.21.15.81:0/3305653171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 msgr2=0x7fbef00cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 --2- 172.21.15.81:0/3305653171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 0x7fbef00cce20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009d90 tx=0x7fbee800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:53.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 -- 172.21.15.81:0/3305653171 shutdown_connections 2023-11-29T11:13:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 --2- 172.21.15.81:0/3305653171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 0x7fbef00cce20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 --2- 172.21.15.81:0/3305653171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef00cf050 0x7fbef006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 -- 172.21.15.81:0/3305653171 >> 172.21.15.81:0/3305653171 conn(0x7fbef009bb30 msgr2=0x7fbef00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 -- 172.21.15.81:0/3305653171 shutdown_connections 2023-11-29T11:13:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.589+0000 7fbef4e97700 1 -- 172.21.15.81:0/3305653171 wait complete. 2023-11-29T11:13:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 Processor -- start 2023-11-29T11:13:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 -- start start 2023-11-29T11:13:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef006a530 0x7fbef01f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 0x7fbef015d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbef00cf050 0x7fbef015dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01515b0 con 0x7fbef00cf050 2023-11-29T11:13:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01f1c20 con 0x7fbef00b4c10 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef0159010 con 0x7fbef006a530 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbef00cf050 0x7fbef015dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbef00cf050 0x7fbef015dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40112/0 (socket says 172.21.15.81:40112) 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 -- 172.21.15.81:0/105765754 learned_addr learned my addr 172.21.15.81:0/105765754 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeeffd700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 0x7fbef015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeef7fe700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef006a530 0x7fbef01f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 -- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef006a530 msgr2=0x7fbef01f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef006a530 0x7fbef01f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 -- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 msgr2=0x7fbef015d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 0x7fbef015d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 -- 172.21.15.81:0/105765754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee8009a70 con 0x7fbef00cf050 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeeffd700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 0x7fbef015d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbeeffff700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbef00cf050 0x7fbef015dab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbef008c6b0 tx=0x7fbee8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbee7fff700 1 -- 172.21.15.81:0/105765754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8004960 con 0x7fbef00cf050 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbee7fff700 1 -- 172.21.15.81:0/105765754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee8020070 con 0x7fbef00cf050 2023-11-29T11:13:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.593+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef00b46f0 con 0x7fbef00cf050 2023-11-29T11:13:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.597+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef00b4410 con 0x7fbef00cf050 2023-11-29T11:13:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.597+0000 7fbee7fff700 1 -- 172.21.15.81:0/105765754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8027680 con 0x7fbef00cf050 2023-11-29T11:13:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.597+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef006b220 con 0x7fbef00cf050 2023-11-29T11:13:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.597+0000 7fbee7fff700 1 -- 172.21.15.81:0/105765754 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbee80277e0 con 0x7fbef00cf050 2023-11-29T11:13:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.597+0000 7fbee7fff700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbed0064ee0 0x7fbed0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.597+0000 7fbee7fff700 1 -- 172.21.15.81:0/105765754 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbee8022070 con 0x7fbef00cf050 2023-11-29T11:13:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.597+0000 7fbeef7fe700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbed0064ee0 0x7fbed0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.597+0000 7fbeef7fe700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbed0064ee0 0x7fbed0067390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbee0009ae0 tx=0x7fbee0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.605+0000 7fbee7fff700 1 -- 172.21.15.81:0/105765754 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbee80523a0 con 0x7fbef00cf050 2023-11-29T11:13:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbef00c6370 con 0x7fbef00cf050 2023-11-29T11:13:53.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbee7fff700 1 -- 172.21.15.81:0/105765754 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbef00c6370 con 0x7fbef00cf050 2023-11-29T11:13:53.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbed0064ee0 msgr2=0x7fbed0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbed0064ee0 0x7fbed0067390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbee0009ae0 tx=0x7fbee0008040 comp rx=0 tx=0).stop 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbef00cf050 msgr2=0x7fbef015dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbef00cf050 0x7fbef015dab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbef008c6b0 tx=0x7fbee8004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 shutdown_connections 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbed0064ee0 0x7fbed0067390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbef00cf050 0x7fbef015dab0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef00b4c10 0x7fbef015d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 --2- 172.21.15.81:0/105765754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbef006a530 0x7fbef01f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 >> 172.21.15.81:0/105765754 conn(0x7fbef009bb30 msgr2=0x7fbef00d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 shutdown_connections 2023-11-29T11:13:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.781+0000 7fbef4e97700 1 -- 172.21.15.81:0/105765754 wait complete. 2023-11-29T11:13:53.790 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:53.801 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:13:53.801 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:53.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:53.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b31e4700 1 Processor -- start 2023-11-29T11:13:53.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b31e4700 1 -- start start 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b31e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac156c70 0x7f57ac0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b31e4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac06abe0 con 0x7f57ac15d690 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b31e4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac06a900 con 0x7f57ac06a350 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b31e4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac15c9c0 con 0x7f57ac156c70 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57abfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f57ac15d690 0x7f57ac069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35236/0 (socket says 172.21.15.81:35236) 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57abfff700 1 -- 172.21.15.81:0/2819591537 learned_addr learned my addr 172.21.15.81:0/2819591537 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b0f80700 1 --2- 172.21.15.81:0/2819591537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac156c70 0x7f57ac0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57ab7fe700 1 -- 172.21.15.81:0/2819591537 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568054520 0 0) 0x7f579c001490 con 0x7f57ac15d690 2023-11-29T11:13:53.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57ab7fe700 1 -- 172.21.15.81:0/2819591537 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57940035d0 con 0x7f57ac15d690 2023-11-29T11:13:53.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57ab7fe700 1 -- 172.21.15.81:0/2819591537 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784447128 0 0) 0x7f57940035d0 con 0x7f57ac15d690 2023-11-29T11:13:53.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b0f80700 1 -- 172.21.15.81:0/2819591537 >> v1:172.21.15.176:6789/0 conn(0x7f57ac06a350 legacy=0x7f57ac0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b0f80700 1 -- 172.21.15.81:0/2819591537 >> v1:172.21.15.81:6789/0 conn(0x7f57ac15d690 legacy=0x7f57ac069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b0f80700 1 -- 172.21.15.81:0/2819591537 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac15cbb0 con 0x7f57ac156c70 2023-11-29T11:13:53.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57b0f80700 1 --2- 172.21.15.81:0/2819591537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac156c70 0x7f57ac0b4660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009880 tx=0x7f57a0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=471c9e0f3328ace0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57ab7fe700 1 -- 172.21.15.81:0/2819591537 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c001b80 con 0x7f57ac156c70 2023-11-29T11:13:53.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57ab7fe700 1 -- 172.21.15.81:0/2819591537 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0010590 con 0x7f57ac156c70 2023-11-29T11:13:53.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.957+0000 7f57ab7fe700 1 -- 172.21.15.81:0/2819591537 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0010900 con 0x7f57ac156c70 2023-11-29T11:13:53.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- 172.21.15.81:0/2819591537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac156c70 msgr2=0x7f57ac0b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 --2- 172.21.15.81:0/2819591537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac156c70 0x7f57ac0b4660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009880 tx=0x7f57a0009b90 comp rx=0 tx=0).stop 2023-11-29T11:13:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- 172.21.15.81:0/2819591537 shutdown_connections 2023-11-29T11:13:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 --2- 172.21.15.81:0/2819591537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac156c70 0x7f57ac0b4660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- 172.21.15.81:0/2819591537 >> 172.21.15.81:0/2819591537 conn(0x7f57ac06ca90 msgr2=0x7f57ac0cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- 172.21.15.81:0/2819591537 shutdown_connections 2023-11-29T11:13:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- 172.21.15.81:0/2819591537 wait complete. 2023-11-29T11:13:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 Processor -- start 2023-11-29T11:13:53.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- start start 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac06a350 0x7f57ac1f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ac156c70 0x7f57ac0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57ac15d690 0x7f57ac159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac1f2890 con 0x7f57ac156c70 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac1f1cc0 con 0x7f57ac15d690 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b31e4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac1f1f60 con 0x7f57ac06a350 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57abfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ac156c70 0x7f57ac0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57abfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ac156c70 0x7f57ac0c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40114/0 (socket says 172.21.15.81:40114) 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57abfff700 1 -- 172.21.15.81:0/1039460898 learned_addr learned my addr 172.21.15.81:0/1039460898 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b0f80700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac06a350 0x7f57ac1f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.961+0000 7f57b1781700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57ac15d690 0x7f57ac159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57abfff700 1 -- 172.21.15.81:0/1039460898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac06a350 msgr2=0x7f57ac1f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57abfff700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac06a350 0x7f57ac1f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57abfff700 1 -- 172.21.15.81:0/1039460898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57ac15d690 msgr2=0x7f57ac159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57abfff700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57ac15d690 0x7f57ac159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57abfff700 1 -- 172.21.15.81:0/1039460898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00094b0 con 0x7f57ac156c70 2023-11-29T11:13:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57abfff700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ac156c70 0x7f57ac0c6710 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f579c00cc70 tx=0x7f579c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57a97fa700 1 -- 172.21.15.81:0/1039460898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00ade0 con 0x7f57ac156c70 2023-11-29T11:13:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57a97fa700 1 -- 172.21.15.81:0/1039460898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c00ce70 con 0x7f57ac156c70 2023-11-29T11:13:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac15d170 con 0x7f57ac156c70 2023-11-29T11:13:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57a97fa700 1 -- 172.21.15.81:0/1039460898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c0072f0 con 0x7f57ac156c70 2023-11-29T11:13:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac15ce90 con 0x7f57ac156c70 2023-11-29T11:13:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac1f2a40 con 0x7f57ac156c70 2023-11-29T11:13:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57a97fa700 1 -- 172.21.15.81:0/1039460898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f579c010070 con 0x7f57ac156c70 2023-11-29T11:13:53.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57a97fa700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:53.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57b0f80700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:53.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.965+0000 7f57a97fa700 1 -- 172.21.15.81:0/1039460898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f579c081b30 con 0x7f57ac156c70 2023-11-29T11:13:53.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.969+0000 7f57b0f80700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f57a00097d0 tx=0x7f57a0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:53.973+0000 7f57a97fa700 1 -- 172.21.15.81:0/1039460898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f57ac1f2a40 con 0x7f57ac156c70 2023-11-29T11:13:54.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.137+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57ac06abe0 con 0x7f57ac156c70 2023-11-29T11:13:54.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.141+0000 7f57a97fa700 1 -- 172.21.15.81:0/1039460898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f57ac06abe0 con 0x7f57ac156c70 2023-11-29T11:13:54.146 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:54.146 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:54.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 msgr2=0x7f5798067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f57a00097d0 tx=0x7f57a0010000 comp rx=0 tx=0).stop 2023-11-29T11:13:54.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ac156c70 msgr2=0x7f57ac0c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ac156c70 0x7f57ac0c6710 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f579c00cc70 tx=0x7f579c00a340 comp rx=0 tx=0).stop 2023-11-29T11:13:54.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 shutdown_connections 2023-11-29T11:13:54.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57ac15d690 0x7f57ac159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ac156c70 0x7f57ac0c6710 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 --2- 172.21.15.81:0/1039460898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57ac06a350 0x7f57ac1f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 >> 172.21.15.81:0/1039460898 conn(0x7f57ac06ca90 msgr2=0x7f57ac15bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:54.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 shutdown_connections 2023-11-29T11:13:54.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.145+0000 7f57b31e4700 1 -- 172.21.15.81:0/1039460898 wait complete. 2023-11-29T11:13:54.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:54.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e99c0700 1 Processor -- start 2023-11-29T11:13:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e99c0700 1 -- start start 2023-11-29T11:13:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e99c0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40b1ae0 0x7f11e406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e99c0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11e40cf0e0 0x7f11e40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e99c0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40cfa80 con 0x7f11e406a4c0 2023-11-29T11:13:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e99c0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40d0ab0 con 0x7f11e40cf0e0 2023-11-29T11:13:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e99c0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e406a9c0 con 0x7f11e40b1ae0 2023-11-29T11:13:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e91bf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11e40cf0e0 0x7f11e40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e91bf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11e40cf0e0 0x7f11e40cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40130/0 (socket says 172.21.15.81:40130) 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e91bf700 1 -- 172.21.15.81:0/2403712770 learned_addr learned my addr 172.21.15.81:0/2403712770 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e89be700 1 --2- 172.21.15.81:0/2403712770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40b1ae0 0x7f11e406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e91bf700 1 -- 172.21.15.81:0/2403712770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40b1ae0 msgr2=0x7f11e406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e91bf700 1 --2- 172.21.15.81:0/2403712770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40b1ae0 0x7f11e406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e91bf700 1 -- 172.21.15.81:0/2403712770 >> v1:172.21.15.176:6789/0 conn(0x7f11e406a4c0 legacy=0x7f11e40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e91bf700 1 -- 172.21.15.81:0/2403712770 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e406aca0 con 0x7f11e40cf0e0 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e91bf700 1 --2- 172.21.15.81:0/2403712770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e40cf0e0 0x7f11e40cf540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009e50 tx=0x7f11dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb7e91b7f73c8b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e37fe700 1 -- 172.21.15.81:0/2403712770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00e070 con 0x7f11e40cf0e0 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e37fe700 1 -- 172.21.15.81:0/2403712770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc003a40 con 0x7f11e40cf0e0 2023-11-29T11:13:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.277+0000 7f11e37fe700 1 -- 172.21.15.81:0/2403712770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc003df0 con 0x7f11e40cf0e0 2023-11-29T11:13:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 -- 172.21.15.81:0/2403712770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e40cf0e0 msgr2=0x7f11e40cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 --2- 172.21.15.81:0/2403712770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e40cf0e0 0x7f11e40cf540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009e50 tx=0x7f11dc00b330 comp rx=0 tx=0).stop 2023-11-29T11:13:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 -- 172.21.15.81:0/2403712770 shutdown_connections 2023-11-29T11:13:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 --2- 172.21.15.81:0/2403712770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e40cf0e0 0x7f11e40cf540 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 --2- 172.21.15.81:0/2403712770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40b1ae0 0x7f11e406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 -- 172.21.15.81:0/2403712770 >> 172.21.15.81:0/2403712770 conn(0x7f11e409bbd0 msgr2=0x7f11e40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 -- 172.21.15.81:0/2403712770 shutdown_connections 2023-11-29T11:13:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 -- 172.21.15.81:0/2403712770 wait complete. 2023-11-29T11:13:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 Processor -- start 2023-11-29T11:13:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.281+0000 7f11e99c0700 1 -- start start 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e406a4c0 0x7f11e415a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e40b1ae0 0x7f11e409efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40cf0e0 0x7f11e409f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40d2160 con 0x7f11e406a4c0 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e415a5d0 con 0x7f11e40b1ae0 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e415e9d0 con 0x7f11e40cf0e0 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e406a4c0 0x7f11e415a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e406a4c0 0x7f11e415a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40142/0 (socket says 172.21.15.81:40142) 2023-11-29T11:13:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 -- 172.21.15.81:0/4284924000 learned_addr learned my addr 172.21.15.81:0/4284924000 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e3fff700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e40b1ae0 0x7f11e409efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e91bf700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40cf0e0 0x7f11e409f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 -- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40cf0e0 msgr2=0x7f11e409f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40cf0e0 0x7f11e409f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 -- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e40b1ae0 msgr2=0x7f11e409efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e40b1ae0 0x7f11e409efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 -- 172.21.15.81:0/4284924000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc009b30 con 0x7f11e406a4c0 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e91bf700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40cf0e0 0x7f11e409f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e3fff700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e40b1ae0 0x7f11e409efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e89be700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e406a4c0 0x7f11e415a090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f11d400e760 tx=0x7f11d400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e17fa700 1 -- 172.21.15.81:0/4284924000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4013610 con 0x7f11e406a4c0 2023-11-29T11:13:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e17fa700 1 -- 172.21.15.81:0/4284924000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d4013770 con 0x7f11e406a4c0 2023-11-29T11:13:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e40b4380 con 0x7f11e406a4c0 2023-11-29T11:13:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e17fa700 1 -- 172.21.15.81:0/4284924000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4013ae0 con 0x7f11e406a4c0 2023-11-29T11:13:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e406af80 con 0x7f11e406a4c0 2023-11-29T11:13:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.285+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e40b1eb0 con 0x7f11e406a4c0 2023-11-29T11:13:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.289+0000 7f11e17fa700 1 -- 172.21.15.81:0/4284924000 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f11d4019030 con 0x7f11e406a4c0 2023-11-29T11:13:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.289+0000 7f11e17fa700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11d0064ee0 0x7f11d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.289+0000 7f11e3fff700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11d0064ee0 0x7f11d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.289+0000 7f11e17fa700 1 -- 172.21.15.81:0/4284924000 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11d4082250 con 0x7f11e406a4c0 2023-11-29T11:13:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.289+0000 7f11e3fff700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11d0064ee0 0x7f11d0067390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f11e40d2610 tx=0x7f11d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.293+0000 7f11e17fa700 1 -- 172.21.15.81:0/4284924000 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f11d4050060 con 0x7f11e406a4c0 2023-11-29T11:13:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.453+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11e4072500 con 0x7f11e406a4c0 2023-11-29T11:13:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.453+0000 7f11e17fa700 1 -- 172.21.15.81:0/4284924000 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f11d4053680 con 0x7f11e406a4c0 2023-11-29T11:13:54.460 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11d0064ee0 msgr2=0x7f11d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11d0064ee0 0x7f11d0067390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f11e40d2610 tx=0x7f11d8008040 comp rx=0 tx=0).stop 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e406a4c0 msgr2=0x7f11e415a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e406a4c0 0x7f11e415a090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f11d400e760 tx=0x7f11d400eb20 comp rx=0 tx=0).stop 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 shutdown_connections 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11d0064ee0 0x7f11d0067390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11e40cf0e0 0x7f11e409f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11e40b1ae0 0x7f11e409efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 --2- 172.21.15.81:0/4284924000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11e406a4c0 0x7f11e415a090 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 >> 172.21.15.81:0/4284924000 conn(0x7f11e409bbd0 msgr2=0x7f11e40d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 shutdown_connections 2023-11-29T11:13:54.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.457+0000 7f11e99c0700 1 -- 172.21.15.81:0/4284924000 wait complete. 2023-11-29T11:13:54.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:54.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.589+0000 7fcb93fff700 1 Processor -- start 2023-11-29T11:13:54.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.589+0000 7fcb93fff700 1 -- start start 2023-11-29T11:13:54.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.589+0000 7fcb93fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb94070fc0 0x7fcb94071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.589+0000 7fcb93fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcb9406e000 0x7fcb940cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb940cdf50 con 0x7fcb940d0170 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940718d0 con 0x7fcb94070fc0 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940c5420 con 0x7fcb9406e000 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb92ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb94070fc0 0x7fcb94071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb92ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb94070fc0 0x7fcb94071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40150/0 (socket says 172.21.15.81:40150) 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb92ffd700 1 -- 172.21.15.81:0/1492911045 learned_addr learned my addr 172.21.15.81:0/1492911045 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb8a7fc700 1 --2- 172.21.15.81:0/1492911045 >> v2:172.21.15.176:3300/0 conn(0x7fcb9406e000 0x7fcb940cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb92ffd700 1 -- 172.21.15.81:0/1492911045 >> v2:172.21.15.176:3300/0 conn(0x7fcb9406e000 msgr2=0x7fcb940cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb92ffd700 1 --2- 172.21.15.81:0/1492911045 >> v2:172.21.15.176:3300/0 conn(0x7fcb9406e000 0x7fcb940cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb92ffd700 1 -- 172.21.15.81:0/1492911045 >> v1:172.21.15.176:6789/0 conn(0x7fcb940d0170 legacy=0x7fcb940ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb92ffd700 1 -- 172.21.15.81:0/1492911045 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940c5700 con 0x7fcb94070fc0 2023-11-29T11:13:54.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb92ffd700 1 --2- 172.21.15.81:0/1492911045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb94070fc0 0x7fcb94071390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcb9415c8e0 tx=0x7fcb8400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3bcd8b83788de8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb927fc700 1 -- 172.21.15.81:0/1492911045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400dd30 con 0x7fcb94070fc0 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb927fc700 1 -- 172.21.15.81:0/1492911045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400de90 con 0x7fcb94070fc0 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb927fc700 1 -- 172.21.15.81:0/1492911045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84010690 con 0x7fcb94070fc0 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- 172.21.15.81:0/1492911045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb94070fc0 msgr2=0x7fcb94071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1492911045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb94070fc0 0x7fcb94071390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcb9415c8e0 tx=0x7fcb8400be90 comp rx=0 tx=0).stop 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- 172.21.15.81:0/1492911045 shutdown_connections 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1492911045 >> v2:172.21.15.176:3300/0 conn(0x7fcb9406e000 0x7fcb940cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1492911045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb94070fc0 0x7fcb94071390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- 172.21.15.81:0/1492911045 >> 172.21.15.81:0/1492911045 conn(0x7fcb940b1e20 msgr2=0x7fcb940cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- 172.21.15.81:0/1492911045 shutdown_connections 2023-11-29T11:13:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- 172.21.15.81:0/1492911045 wait complete. 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 Processor -- start 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.593+0000 7fcb93fff700 1 -- start start 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb93fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9406e000 0x7fcb9406aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb93fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb94070fc0 0x7fcb941562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb941567f0 0x7fcb94148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb93fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941f58a0 con 0x7fcb941567f0 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb93fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94156c60 con 0x7fcb9406e000 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb93fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941f4f90 con 0x7fcb94070fc0 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb941567f0 0x7fcb94148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb941567f0 0x7fcb94148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40158/0 (socket says 172.21.15.81:40158) 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 -- 172.21.15.81:0/1318549403 learned_addr learned my addr 172.21.15.81:0/1318549403 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb92ffd700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9406e000 0x7fcb9406aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb8a7fc700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb94070fc0 0x7fcb941562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 -- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb94070fc0 msgr2=0x7fcb941562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb94070fc0 0x7fcb941562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 -- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9406e000 msgr2=0x7fcb9406aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9406e000 0x7fcb9406aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 -- 172.21.15.81:0/1318549403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8400b810 con 0x7fcb941567f0 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb92ffd700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9406e000 0x7fcb9406aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb937fe700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb941567f0 0x7fcb94148ee0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00cbc0 tx=0x7fcb8c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb90ff9700 1 -- 172.21.15.81:0/1318549403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c003c20 con 0x7fcb941567f0 2023-11-29T11:13:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb90ff9700 1 -- 172.21.15.81:0/1318549403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c003d80 con 0x7fcb941567f0 2023-11-29T11:13:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb940cdb70 con 0x7fcb941567f0 2023-11-29T11:13:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb90ff9700 1 -- 172.21.15.81:0/1318549403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00aae0 con 0x7fcb941567f0 2023-11-29T11:13:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.597+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb940c59e0 con 0x7fcb941567f0 2023-11-29T11:13:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.601+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9406e470 con 0x7fcb941567f0 2023-11-29T11:13:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.601+0000 7fcb90ff9700 1 -- 172.21.15.81:0/1318549403 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcb8c010050 con 0x7fcb941567f0 2023-11-29T11:13:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.601+0000 7fcb90ff9700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb74064f30 0x7fcb740673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.601+0000 7fcb90ff9700 1 -- 172.21.15.81:0/1318549403 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcb8c082070 con 0x7fcb941567f0 2023-11-29T11:13:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.601+0000 7fcb92ffd700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb74064f30 0x7fcb740673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.601+0000 7fcb92ffd700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb74064f30 0x7fcb740673e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb84000c00 tx=0x7fcb84013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.609+0000 7fcb90ff9700 1 -- 172.21.15.81:0/1318549403 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcb8c04fe70 con 0x7fcb941567f0 2023-11-29T11:13:54.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.773+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb94072500 con 0x7fcb941567f0 2023-11-29T11:13:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.773+0000 7fcb90ff9700 1 -- 172.21.15.81:0/1318549403 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb8c053490 con 0x7fcb941567f0 2023-11-29T11:13:54.779 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb74064f30 msgr2=0x7fcb740673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb74064f30 0x7fcb740673e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcb84000c00 tx=0x7fcb84013000 comp rx=0 tx=0).stop 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb941567f0 msgr2=0x7fcb94148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb941567f0 0x7fcb94148ee0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00cbc0 tx=0x7fcb8c00ced0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 shutdown_connections 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb74064f30 0x7fcb740673e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb941567f0 0x7fcb94148ee0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb94070fc0 0x7fcb941562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 --2- 172.21.15.81:0/1318549403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb9406e000 0x7fcb9406aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 >> 172.21.15.81:0/1318549403 conn(0x7fcb940b1e20 msgr2=0x7fcb940ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 shutdown_connections 2023-11-29T11:13:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.777+0000 7fcb93fff700 1 -- 172.21.15.81:0/1318549403 wait complete. 2023-11-29T11:13:54.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:54.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 Processor -- start 2023-11-29T11:13:54.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- start start 2023-11-29T11:13:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87401548c0 0x7f8740069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87400b06f0 0x7f87400b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874006a180 con 0x7f874015def0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87400b10d0 con 0x7f87401548c0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400b47b0 con 0x7f87400b06f0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87401548c0 0x7f8740069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87401548c0 0x7f8740069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40166/0 (socket says 172.21.15.81:40166) 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873effd700 1 -- 172.21.15.81:0/503578919 learned_addr learned my addr 172.21.15.81:0/503578919 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873f7fe700 1 --2- 172.21.15.81:0/503578919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87400b06f0 0x7f87400b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873effd700 1 -- 172.21.15.81:0/503578919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87400b06f0 msgr2=0x7f87400b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873effd700 1 --2- 172.21.15.81:0/503578919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87400b06f0 0x7f87400b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873effd700 1 -- 172.21.15.81:0/503578919 >> v1:172.21.15.176:6789/0 conn(0x7f874015def0 legacy=0x7f874015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873effd700 1 -- 172.21.15.81:0/503578919 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874015e420 con 0x7f87401548c0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873effd700 1 --2- 172.21.15.81:0/503578919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87401548c0 0x7f8740069c40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8728009910 tx=0x7f8728009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349ab3dbdec24ada server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873dffb700 1 -- 172.21.15.81:0/503578919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011830 con 0x7f87401548c0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873dffb700 1 -- 172.21.15.81:0/503578919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728011990 con 0x7f87401548c0 2023-11-29T11:13:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f873dffb700 1 -- 172.21.15.81:0/503578919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011d40 con 0x7f87401548c0 2023-11-29T11:13:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- 172.21.15.81:0/503578919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87401548c0 msgr2=0x7f8740069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 --2- 172.21.15.81:0/503578919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87401548c0 0x7f8740069c40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8728009910 tx=0x7f8728009c20 comp rx=0 tx=0).stop 2023-11-29T11:13:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- 172.21.15.81:0/503578919 shutdown_connections 2023-11-29T11:13:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 --2- 172.21.15.81:0/503578919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87400b06f0 0x7f87400b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 --2- 172.21.15.81:0/503578919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87401548c0 0x7f8740069c40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- 172.21.15.81:0/503578919 >> 172.21.15.81:0/503578919 conn(0x7f87400cf4a0 msgr2=0x7f87400cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- 172.21.15.81:0/503578919 shutdown_connections 2023-11-29T11:13:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.909+0000 7f87455e0700 1 -- 172.21.15.81:0/503578919 wait complete. 2023-11-29T11:13:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.913+0000 7f87455e0700 1 Processor -- start 2023-11-29T11:13:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.913+0000 7f87455e0700 1 -- start start 2023-11-29T11:13:54.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87400b06f0 0x7f874014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87401548c0 0x7f87400cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874015def0 0x7f87400cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874014dd00 con 0x7f874015def0 2023-11-29T11:13:54.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87401e3e60 con 0x7f87400b06f0 2023-11-29T11:13:54.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87401e4140 con 0x7f87401548c0 2023-11-29T11:13:54.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874015def0 0x7f87400cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873effd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87400b06f0 0x7f874014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873e7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87401548c0 0x7f87400cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873effd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87400b06f0 0x7f874014d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:39384/0 (socket says 172.21.15.81:39384) 2023-11-29T11:13:54.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874015def0 0x7f87400cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40168/0 (socket says 172.21.15.81:40168) 2023-11-29T11:13:54.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873e7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87401548c0 0x7f87400cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:59016/0 (socket says 172.21.15.81:59016) 2023-11-29T11:13:54.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873effd700 1 -- 172.21.15.81:0/1784130165 learned_addr learned my addr 172.21.15.81:0/1784130165 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:54.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873f7fe700 1 -- 172.21.15.81:0/1784130165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87401548c0 msgr2=0x7f87400cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873f7fe700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87401548c0 0x7f87400cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873f7fe700 1 -- 172.21.15.81:0/1784130165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87400b06f0 msgr2=0x7f874014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873f7fe700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87400b06f0 0x7f874014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873f7fe700 1 -- 172.21.15.81:0/1784130165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728009570 con 0x7f874015def0 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873e7fc700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87401548c0 0x7f87400cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873effd700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87400b06f0 0x7f874014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f873f7fe700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874015def0 0x7f87400cd910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f873800e860 tx=0x7f873800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87377fe700 1 -- 172.21.15.81:0/1784130165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738013680 con 0x7f874015def0 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87377fe700 1 -- 172.21.15.81:0/1784130165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87380137e0 con 0x7f874015def0 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874015e9e0 con 0x7f874015def0 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87377fe700 1 -- 172.21.15.81:0/1784130165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738013b90 con 0x7f874015def0 2023-11-29T11:13:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874015e700 con 0x7f874015def0 2023-11-29T11:13:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.917+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874015ecc0 con 0x7f874015def0 2023-11-29T11:13:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.921+0000 7f87377fe700 1 -- 172.21.15.81:0/1784130165 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8738019030 con 0x7f874015def0 2023-11-29T11:13:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.921+0000 7f87377fe700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8720064ee0 0x7f8720067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.921+0000 7f87377fe700 1 -- 172.21.15.81:0/1784130165 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8738082030 con 0x7f874015def0 2023-11-29T11:13:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.921+0000 7f873effd700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8720064ee0 0x7f8720067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.921+0000 7f873effd700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8720064ee0 0x7f8720067390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8728009150 tx=0x7f8728008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:54.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:54.929+0000 7f87377fe700 1 -- 172.21.15.81:0/1784130165 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f873804fdc0 con 0x7f874015def0 2023-11-29T11:13:55.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.089+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87400b1340 con 0x7f874015def0 2023-11-29T11:13:55.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.089+0000 7f87377fe700 1 -- 172.21.15.81:0/1784130165 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87380533e0 con 0x7f874015def0 2023-11-29T11:13:55.095 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:55.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8720064ee0 msgr2=0x7f8720067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8720064ee0 0x7f8720067390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8728009150 tx=0x7f8728008030 comp rx=0 tx=0).stop 2023-11-29T11:13:55.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874015def0 msgr2=0x7f87400cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874015def0 0x7f87400cd910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f873800e860 tx=0x7f873800eb70 comp rx=0 tx=0).stop 2023-11-29T11:13:55.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 shutdown_connections 2023-11-29T11:13:55.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8720064ee0 0x7f8720067390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f874015def0 0x7f87400cd910 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87401548c0 0x7f87400cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 --2- 172.21.15.81:0/1784130165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87400b06f0 0x7f874014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 >> 172.21.15.81:0/1784130165 conn(0x7f87400cf4a0 msgr2=0x7f87400719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:55.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 shutdown_connections 2023-11-29T11:13:55.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.093+0000 7f87455e0700 1 -- 172.21.15.81:0/1784130165 wait complete. 2023-11-29T11:13:55.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b41701700 1 Processor -- start 2023-11-29T11:13:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b41701700 1 -- start start 2023-11-29T11:13:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b41701700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b41701700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9b3c0cbb30 0x7f9b3c15d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b41701700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c06d700 con 0x7f9b3c0b04b0 2023-11-29T11:13:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b41701700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c09c150 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b41701700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0ac050 con 0x7f9b3c0b00e0 2023-11-29T11:13:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3b7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9b3c0cbb30 0x7f9b3c15d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b40f00700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f9b3c0b04b0 0x7f9b3c0ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:36992/0 (socket says 172.21.15.81:36992) 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b40f00700 1 -- 172.21.15.81:0/1335080403 learned_addr learned my addr 172.21.15.81:0/1335080403 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c15d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:59020/0 (socket says 172.21.15.81:59020) 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3b7fe700 1 -- 172.21.15.81:0/1335080403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 msgr2=0x7f9b3c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3b7fe700 1 --2- 172.21.15.81:0/1335080403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3b7fe700 1 -- 172.21.15.81:0/1335080403 >> v1:172.21.15.176:6789/0 conn(0x7f9b3c0b04b0 legacy=0x7f9b3c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3b7fe700 1 -- 172.21.15.81:0/1335080403 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0ac260 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3affd700 1 -- 172.21.15.81:0/1335080403 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605558539 0 0) 0x7f9b3c06d700 con 0x7f9b3c0b04b0 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.229+0000 7f9b3bfff700 1 --2- 172.21.15.81:0/1335080403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b3b7fe700 1 --2- 172.21.15.81:0/1335080403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c15d6b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009850 tx=0x7f9b30009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77aeb8f40128158a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b3affd700 1 -- 172.21.15.81:0/1335080403 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30011830 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b3affd700 1 -- 172.21.15.81:0/1335080403 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b30011990 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b3affd700 1 -- 172.21.15.81:0/1335080403 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30011d40 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- 172.21.15.81:0/1335080403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0cbb30 msgr2=0x7f9b3c15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 --2- 172.21.15.81:0/1335080403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c15d6b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009850 tx=0x7f9b30009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- 172.21.15.81:0/1335080403 shutdown_connections 2023-11-29T11:13:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 --2- 172.21.15.81:0/1335080403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c15d6b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 --2- 172.21.15.81:0/1335080403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- 172.21.15.81:0/1335080403 >> 172.21.15.81:0/1335080403 conn(0x7f9b3c0cae70 msgr2=0x7f9b3c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- 172.21.15.81:0/1335080403 shutdown_connections 2023-11-29T11:13:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- 172.21.15.81:0/1335080403 wait complete. 2023-11-29T11:13:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 Processor -- start 2023-11-29T11:13:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- start start 2023-11-29T11:13:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c0714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b04b0 0x7f9b3c0c3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c3e50 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c4130 con 0x7f9b3c0b04b0 2023-11-29T11:13:55.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b41701700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c4410 con 0x7f9b3c0b00e0 2023-11-29T11:13:55.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b40f00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b40f00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c1551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40178/0 (socket says 172.21.15.81:40178) 2023-11-29T11:13:55.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b40f00700 1 -- 172.21.15.81:0/1714280029 learned_addr learned my addr 172.21.15.81:0/1714280029 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:55.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b3b7fe700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b04b0 0x7f9b3c0c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.233+0000 7f9b3bfff700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c0714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b40f00700 1 -- 172.21.15.81:0/1714280029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 msgr2=0x7f9b3c0714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b40f00700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c0714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b40f00700 1 -- 172.21.15.81:0/1714280029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b04b0 msgr2=0x7f9b3c0c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b40f00700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b04b0 0x7f9b3c0c3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b40f00700 1 -- 172.21.15.81:0/1714280029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c0094b0 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b40f00700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c1551b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9b34002230 tx=0x7f9b3400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b38ff9700 1 -- 172.21.15.81:0/1714280029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400aac0 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b38ff9700 1 -- 172.21.15.81:0/1714280029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3400ac40 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b38ff9700 1 -- 172.21.15.81:0/1714280029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340070d0 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b300094b0 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c09bdb0 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c0cc660 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.237+0000 7f9b38ff9700 1 -- 172.21.15.81:0/1714280029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9b34010070 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.241+0000 7f9b38ff9700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064ee0 0x7f9b28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.241+0000 7f9b38ff9700 1 -- 172.21.15.81:0/1714280029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b34081b10 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.241+0000 7f9b3bfff700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064ee0 0x7f9b28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.241+0000 7f9b3bfff700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064ee0 0x7f9b28067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009d80 tx=0x7f9b2c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.245+0000 7f9b38ff9700 1 -- 172.21.15.81:0/1714280029 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9b3404f920 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.409+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b3c0cc9f0 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.409+0000 7f9b38ff9700 1 -- 172.21.15.81:0/1714280029 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b34018020 con 0x7f9b3c0cbb30 2023-11-29T11:13:55.416 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064ee0 msgr2=0x7f9b28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064ee0 0x7f9b28067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009d80 tx=0x7f9b2c009240 comp rx=0 tx=0).stop 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0cbb30 msgr2=0x7f9b3c1551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c1551b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9b34002230 tx=0x7f9b3400cf50 comp rx=0 tx=0).stop 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 shutdown_connections 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064ee0 0x7f9b28067390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0cbb30 0x7f9b3c1551b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0b04b0 0x7f9b3c0c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 --2- 172.21.15.81:0/1714280029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0b00e0 0x7f9b3c0714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 >> 172.21.15.81:0/1714280029 conn(0x7f9b3c0cae70 msgr2=0x7f9b3c06be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 shutdown_connections 2023-11-29T11:13:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.413+0000 7f9b41701700 1 -- 172.21.15.81:0/1714280029 wait complete. 2023-11-29T11:13:55.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:55.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc9189700 1 Processor -- start 2023-11-29T11:13:55.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc9189700 1 -- start start 2023-11-29T11:13:55.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc9189700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 0x7f2fc406aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc9189700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc4160c50 con 0x7f2fc406b000 2023-11-29T11:13:55.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc9189700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40b3050 con 0x7f2fc40c1ad0 2023-11-29T11:13:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc9189700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc406b450 con 0x7f2fc4160880 2023-11-29T11:13:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2fc406b000 0x7f2fc40c13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35246/0 (socket says 172.21.15.81:35246) 2023-11-29T11:13:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc37fe700 1 -- 172.21.15.81:0/3081645887 learned_addr learned my addr 172.21.15.81:0/3081645887 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 0x7f2fc406aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209278220 0 0) 0x7f2fc4160c50 con 0x7f2fc406b000 2023-11-29T11:13:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb00035d0 con 0x7f2fc406b000 2023-11-29T11:13:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734098658 0 0) 0x7f2fc40b3050 con 0x7f2fc40c1ad0 2023-11-29T11:13:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc4160c50 con 0x7f2fc40c1ad0 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3909594831 0 0) 0x7f2fb00035d0 con 0x7f2fc406b000 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 msgr2=0x7f2fc406aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 0x7f2fc406aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 >> v1:172.21.15.176:6789/0 conn(0x7f2fc40c1ad0 legacy=0x7f2fc41642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc406b630 con 0x7f2fc406b000 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f2fb4001670 con 0x7f2fc406b000 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 0x7f2fc406aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 >> v1:172.21.15.81:6789/0 conn(0x7f2fc406b000 legacy=0x7f2fc40c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 0x7f2fb0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb0004120 0x7f2fb0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fb0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc406b450 con 0x7f2fb0004db0 2023-11-29T11:13:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000bae0 con 0x7f2fb0004120 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000bca0 con 0x7f2fc4160880 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc8988700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fb0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 0x7f2fb0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc37fe700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb0004120 0x7f2fb0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc8988700 1 -- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 msgr2=0x7f2fb0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc8988700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc4160880 0x7f2fb0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc8988700 1 -- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb0004120 msgr2=0x7f2fb0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc8988700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fb0004120 0x7f2fb0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.549+0000 7f2fc8988700 1 -- 172.21.15.81:0/3081645887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0094b0 con 0x7f2fb0004db0 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc8988700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fb0005220 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40aaff0 tx=0x7f2fb00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262f07169a393a78 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc001f30 con 0x7f2fb0004db0 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00ce50 con 0x7f2fb0004db0 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc2ffd700 1 -- 172.21.15.81:0/3081645887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc003c60 con 0x7f2fb0004db0 2023-11-29T11:13:55.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc9189700 1 -- 172.21.15.81:0/3081645887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 msgr2=0x7f2fb0005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc9189700 1 --2- 172.21.15.81:0/3081645887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fb0005220 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40aaff0 tx=0x7f2fb00058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc8988700 1 -- 172.21.15.81:0/3081645887 reap_dead start 2023-11-29T11:13:55.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc9189700 1 -- 172.21.15.81:0/3081645887 shutdown_connections 2023-11-29T11:13:55.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc9189700 1 -- 172.21.15.81:0/3081645887 >> 172.21.15.81:0/3081645887 conn(0x7f2fc40cae70 msgr2=0x7f2fc40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:55.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc9189700 1 -- 172.21.15.81:0/3081645887 shutdown_connections 2023-11-29T11:13:55.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc9189700 1 -- 172.21.15.81:0/3081645887 wait complete. 2023-11-29T11:13:55.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc9189700 1 Processor -- start 2023-11-29T11:13:55.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.553+0000 7f2fc9189700 1 -- start start 2023-11-29T11:13:55.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fc41f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc414d000 0x7f2fc41f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fc41f6c60 0x7f2fc415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41f6aa0 con 0x7f2fb0004db0 2023-11-29T11:13:55.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40c4da0 con 0x7f2fc41f6c60 2023-11-29T11:13:55.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc414d4e0 con 0x7f2fc414d000 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fc41f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fc41f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40186/0 (socket says 172.21.15.81:40186) 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 -- 172.21.15.81:0/3825915499 learned_addr learned my addr 172.21.15.81:0/3825915499 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc8988700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fc41f6c60 0x7f2fc415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc37fe700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc414d000 0x7f2fc41f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 -- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc414d000 msgr2=0x7f2fc41f87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc414d000 0x7f2fc41f87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 -- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fc41f6c60 msgr2=0x7f2fc415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fc41f6c60 0x7f2fc415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 -- 172.21.15.81:0/3825915499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4069fc0 con 0x7f2fb0004db0 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc37fe700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc414d000 0x7f2fc41f87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc3fff700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fc41f6560 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2fac011900 tx=0x7f2fac011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc0ff9700 1 -- 172.21.15.81:0/3825915499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00fae0 con 0x7f2fb0004db0 2023-11-29T11:13:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc0ff9700 1 -- 172.21.15.81:0/3825915499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac00fc40 con 0x7f2fb0004db0 2023-11-29T11:13:55.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc4069ce0 con 0x7f2fb0004db0 2023-11-29T11:13:55.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc0ff9700 1 -- 172.21.15.81:0/3825915499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac011ea0 con 0x7f2fb0004db0 2023-11-29T11:13:55.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc406a2a0 con 0x7f2fb0004db0 2023-11-29T11:13:55.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4072500 con 0x7f2fb0004db0 2023-11-29T11:13:55.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc0ff9700 1 -- 172.21.15.81:0/3825915499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2fac012040 con 0x7f2fb0004db0 2023-11-29T11:13:55.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc0ff9700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2fa4064ee0 0x7f2fa4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc0ff9700 1 -- 172.21.15.81:0/3825915499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2fac082920 con 0x7f2fb0004db0 2023-11-29T11:13:55.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.557+0000 7f2fc37fe700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2fa4064ee0 0x7f2fa4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.561+0000 7f2fc37fe700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2fa4064ee0 0x7f2fa4067390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4001050 tx=0x7f2fb4001170 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.565+0000 7f2fc0ff9700 1 -- 172.21.15.81:0/3825915499 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2fac050790 con 0x7f2fb0004db0 2023-11-29T11:13:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.721+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2fc40ce1d0 con 0x7f2fb0004db0 2023-11-29T11:13:55.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.721+0000 7f2fc0ff9700 1 -- 172.21.15.81:0/3825915499 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2fac053db0 con 0x7f2fb0004db0 2023-11-29T11:13:55.728 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:55.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2fa4064ee0 msgr2=0x7f2fa4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2fa4064ee0 0x7f2fa4067390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4001050 tx=0x7f2fb4001170 comp rx=0 tx=0).stop 2023-11-29T11:13:55.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 msgr2=0x7f2fc41f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fc41f6560 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2fac011900 tx=0x7f2fac011cc0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 shutdown_connections 2023-11-29T11:13:55.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2fa4064ee0 0x7f2fa4067390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fc41f6c60 0x7f2fc415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2fc414d000 0x7f2fc41f87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 --2- 172.21.15.81:0/3825915499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fb0004db0 0x7f2fc41f6560 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 >> 172.21.15.81:0/3825915499 conn(0x7f2fc40cae70 msgr2=0x7f2fc4071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:55.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 shutdown_connections 2023-11-29T11:13:55.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.725+0000 7f2fc9189700 1 -- 172.21.15.81:0/3825915499 wait complete. 2023-11-29T11:13:55.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.853+0000 7f87de7fa700 1 Processor -- start 2023-11-29T11:13:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.853+0000 7f87de7fa700 1 -- start start 2023-11-29T11:13:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87d8158e60 0x7f87d80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d80cd8f0 con 0x7f87d80cad50 2023-11-29T11:13:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d80add00 con 0x7f87d8158e60 2023-11-29T11:13:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80cc4f0 con 0x7f87d80ad490 2023-11-29T11:13:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87dd7f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87d8158e60 0x7f87d80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87ddff9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87d80cad50 0x7f87d806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35252/0 (socket says 172.21.15.81:35252) 2023-11-29T11:13:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87ddff9700 1 -- 172.21.15.81:0/783937107 learned_addr learned my addr 172.21.15.81:0/783937107 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87dcff7700 1 --2- 172.21.15.81:0/783937107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87cbfff700 1 -- 172.21.15.81:0/783937107 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792572368 0 0) 0x7f87d80cd8f0 con 0x7f87d80cad50 2023-11-29T11:13:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87cbfff700 1 -- 172.21.15.81:0/783937107 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c40035d0 con 0x7f87d80cad50 2023-11-29T11:13:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87dd7f8700 1 -- 172.21.15.81:0/783937107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 msgr2=0x7f87d80cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87dd7f8700 1 --2- 172.21.15.81:0/783937107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d80cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87dd7f8700 1 -- 172.21.15.81:0/783937107 >> v1:172.21.15.81:6789/0 conn(0x7f87d80cad50 legacy=0x7f87d806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87dd7f8700 1 -- 172.21.15.81:0/783937107 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d806dc60 con 0x7f87d8158e60 2023-11-29T11:13:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87dcff7700 1 --2- 172.21.15.81:0/783937107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d80cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:55.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87dd7f8700 1 --2- 172.21.15.81:0/783937107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d80c8a30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f87d40098b0 tx=0x7f87d4009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881118081441b05 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87cbfff700 1 -- 172.21.15.81:0/783937107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4011830 con 0x7f87d8158e60 2023-11-29T11:13:55.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87cbfff700 1 -- 172.21.15.81:0/783937107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4011990 con 0x7f87d8158e60 2023-11-29T11:13:55.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87cbfff700 1 -- 172.21.15.81:0/783937107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4011d20 con 0x7f87d8158e60 2023-11-29T11:13:55.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 -- 172.21.15.81:0/783937107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 msgr2=0x7f87d80c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 --2- 172.21.15.81:0/783937107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d80c8a30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f87d40098b0 tx=0x7f87d4009bc0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 -- 172.21.15.81:0/783937107 shutdown_connections 2023-11-29T11:13:55.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 --2- 172.21.15.81:0/783937107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d80cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 --2- 172.21.15.81:0/783937107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d80c8a30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 -- 172.21.15.81:0/783937107 >> 172.21.15.81:0/783937107 conn(0x7f87d80ce3e0 msgr2=0x7f87d80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:55.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 -- 172.21.15.81:0/783937107 shutdown_connections 2023-11-29T11:13:55.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.857+0000 7f87de7fa700 1 -- 172.21.15.81:0/783937107 wait complete. 2023-11-29T11:13:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 Processor -- start 2023-11-29T11:13:55.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 -- start start 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87d80cad50 0x7f87d814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d81522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8071c90 con 0x7f87d8158e60 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80721c0 con 0x7f87d80cad50 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8071ee0 con 0x7f87d80ad490 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d81522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d81522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40210/0 (socket says 172.21.15.81:40210) 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 -- 172.21.15.81:0/1105802339 learned_addr learned my addr 172.21.15.81:0/1105802339 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87dcff7700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87d80cad50 0x7f87d814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87dd7f8700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 -- 172.21.15.81:0/1105802339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 msgr2=0x7f87d814de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d814de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 -- 172.21.15.81:0/1105802339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87d80cad50 msgr2=0x7f87d814e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87d80cad50 0x7f87d814e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 -- 172.21.15.81:0/1105802339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0094b0 con 0x7f87d8158e60 2023-11-29T11:13:55.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87ddff9700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d81522c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f87d000cb40 tx=0x7f87d000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:13:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87c9ffb700 1 -- 172.21.15.81:0/1105802339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0007500 con 0x7f87d8158e60 2023-11-29T11:13:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87c9ffb700 1 -- 172.21.15.81:0/1105802339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d0007660 con 0x7f87d8158e60 2023-11-29T11:13:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87c9ffb700 1 -- 172.21.15.81:0/1105802339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00079f0 con 0x7f87d8158e60 2023-11-29T11:13:55.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d40094b0 con 0x7f87d8158e60 2023-11-29T11:13:55.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.861+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d8159230 con 0x7f87d8158e60 2023-11-29T11:13:55.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.865+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d80cde90 con 0x7f87d8158e60 2023-11-29T11:13:55.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.865+0000 7f87c9ffb700 1 -- 172.21.15.81:0/1105802339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f87d0019030 con 0x7f87d8158e60 2023-11-29T11:13:55.872 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:13:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.865+0000 7f87c9ffb700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87bc064ee0 0x7f87bc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.865+0000 7f87c9ffb700 1 -- 172.21.15.81:0/1105802339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87d0081ac0 con 0x7f87d8158e60 2023-11-29T11:13:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.865+0000 7f87dd7f8700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87bc064ee0 0x7f87bc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.869+0000 7f87dd7f8700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87bc064ee0 0x7f87bc067390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f87d40090b0 tx=0x7f87d4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:55.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:55.873+0000 7f87c9ffb700 1 -- 172.21.15.81:0/1105802339 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f87d004f8d0 con 0x7f87d8158e60 2023-11-29T11:13:56.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.045+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f87d806d6a0 con 0x7f87d8158e60 2023-11-29T11:13:56.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87c9ffb700 1 -- 172.21.15.81:0/1105802339 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f87d0052ef0 con 0x7f87d8158e60 2023-11-29T11:13:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87bc064ee0 msgr2=0x7f87bc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87bc064ee0 0x7f87bc067390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f87d40090b0 tx=0x7f87d4008030 comp rx=0 tx=0).stop 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 msgr2=0x7f87d81522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d81522c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f87d000cb40 tx=0x7f87d000cb70 comp rx=0 tx=0).stop 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 shutdown_connections 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87bc064ee0 0x7f87bc067390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8158e60 0x7f87d81522c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87d80cad50 0x7f87d814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 --2- 172.21.15.81:0/1105802339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87d80ad490 0x7f87d814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 >> 172.21.15.81:0/1105802339 conn(0x7f87d80ce3e0 msgr2=0x7f87d806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 shutdown_connections 2023-11-29T11:13:56.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.049+0000 7f87de7fa700 1 -- 172.21.15.81:0/1105802339 wait complete. 2023-11-29T11:13:56.057 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:56.068 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:13:56.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:56.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-29T11:13:56.082 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:13:56.082 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:13:56.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:13:56.082 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-29T11:13:56.087 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:13:56.087 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:56.095 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:13:56.095 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:56.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.257+0000 7f5b6ef46700 1 Processor -- start 2023-11-29T11:13:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.257+0000 7f5b6ef46700 1 -- start start 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.257+0000 7f5b6ef46700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b68069c40 0x7f5b680cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5b680cb2a0 0x7f5b680c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6806ace0 con 0x7f5b68159e70 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680cb6e0 con 0x7f5b68069c40 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6806a0d0 con 0x7f5b680cb2a0 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6d743700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b68069c40 0x7f5b680cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6d743700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b68069c40 0x7f5b680cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40224/0 (socket says 172.21.15.81:40224) 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6d743700 1 -- 172.21.15.81:0/572096788 learned_addr learned my addr 172.21.15.81:0/572096788 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6d743700 1 -- 172.21.15.81:0/572096788 >> v2:172.21.15.176:3300/0 conn(0x7f5b680cb2a0 msgr2=0x7f5b680c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6e745700 1 --2- 172.21.15.81:0/572096788 >> v2:172.21.15.176:3300/0 conn(0x7f5b680cb2a0 0x7f5b680c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6d743700 1 --2- 172.21.15.81:0/572096788 >> v2:172.21.15.176:3300/0 conn(0x7f5b680cb2a0 0x7f5b680c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6d743700 1 -- 172.21.15.81:0/572096788 >> v1:172.21.15.176:6789/0 conn(0x7f5b68159e70 legacy=0x7f5b6806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6d743700 1 -- 172.21.15.81:0/572096788 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6806a3b0 con 0x7f5b68069c40 2023-11-29T11:13:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6e745700 1 --2- 172.21.15.81:0/572096788 >> v2:172.21.15.176:3300/0 conn(0x7f5b680cb2a0 0x7f5b680c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6d743700 1 --2- 172.21.15.81:0/572096788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b68069c40 0x7f5b680cad60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5b680afe60 tx=0x7f5b5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2483e5ae8ca958b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6cf42700 1 -- 172.21.15.81:0/572096788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800e070 con 0x7f5b68069c40 2023-11-29T11:13:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6cf42700 1 -- 172.21.15.81:0/572096788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58003a40 con 0x7f5b68069c40 2023-11-29T11:13:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6cf42700 1 -- 172.21.15.81:0/572096788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58003df0 con 0x7f5b68069c40 2023-11-29T11:13:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- 172.21.15.81:0/572096788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b68069c40 msgr2=0x7f5b680cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/572096788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b68069c40 0x7f5b680cad60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5b680afe60 tx=0x7f5b5800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- 172.21.15.81:0/572096788 shutdown_connections 2023-11-29T11:13:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/572096788 >> v2:172.21.15.176:3300/0 conn(0x7f5b680cb2a0 0x7f5b680c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/572096788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b68069c40 0x7f5b680cad60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- 172.21.15.81:0/572096788 >> 172.21.15.81:0/572096788 conn(0x7f5b680ce3e0 msgr2=0x7f5b680ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- 172.21.15.81:0/572096788 shutdown_connections 2023-11-29T11:13:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- 172.21.15.81:0/572096788 wait complete. 2023-11-29T11:13:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 Processor -- start 2023-11-29T11:13:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.261+0000 7f5b6ef46700 1 -- start start 2023-11-29T11:13:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6ef46700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b68069c40 0x7f5b681585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6ef46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b680cb2a0 0x7f5b681f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6ef46700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b68159e70 0x7f5b680c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6ef46700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680abc00 con 0x7f5b680cb2a0 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6ef46700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680abee0 con 0x7f5b68069c40 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6ef46700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680ac1c0 con 0x7f5b68159e70 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b680cb2a0 0x7f5b681f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b680cb2a0 0x7f5b681f22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40236/0 (socket says 172.21.15.81:40236) 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 -- 172.21.15.81:0/2769935405 learned_addr learned my addr 172.21.15.81:0/2769935405 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6df44700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b68069c40 0x7f5b681585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6e745700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b68159e70 0x7f5b680c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 -- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b68159e70 msgr2=0x7f5b680c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b68159e70 0x7f5b680c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 -- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b68069c40 msgr2=0x7f5b681585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b68069c40 0x7f5b681585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 -- 172.21.15.81:0/2769935405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58009b30 con 0x7f5b680cb2a0 2023-11-29T11:13:56.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6e745700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b68159e70 0x7f5b680c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:56.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6d743700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b680cb2a0 0x7f5b681f22c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5b58000f80 tx=0x7f5b58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b667fc700 1 -- 172.21.15.81:0/2769935405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58004440 con 0x7f5b680cb2a0 2023-11-29T11:13:56.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b667fc700 1 -- 172.21.15.81:0/2769935405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b580045a0 con 0x7f5b680cb2a0 2023-11-29T11:13:56.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6806a970 con 0x7f5b680cb2a0 2023-11-29T11:13:56.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b667fc700 1 -- 172.21.15.81:0/2769935405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58004950 con 0x7f5b680cb2a0 2023-11-29T11:13:56.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.265+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6806a690 con 0x7f5b680cb2a0 2023-11-29T11:13:56.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.269+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6806d0b0 con 0x7f5b680cb2a0 2023-11-29T11:13:56.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.269+0000 7f5b667fc700 1 -- 172.21.15.81:0/2769935405 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5b58022030 con 0x7f5b680cb2a0 2023-11-29T11:13:56.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.269+0000 7f5b667fc700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b54064ee0 0x7f5b54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.269+0000 7f5b667fc700 1 -- 172.21.15.81:0/2769935405 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5b580835f0 con 0x7f5b680cb2a0 2023-11-29T11:13:56.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.269+0000 7f5b6df44700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b54064ee0 0x7f5b54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.269+0000 7f5b6df44700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b54064ee0 0x7f5b54067390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009980 tx=0x7f5b5c0090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.273+0000 7f5b667fc700 1 -- 172.21.15.81:0/2769935405 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5b580513e0 con 0x7f5b680cb2a0 2023-11-29T11:13:56.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.445+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b680ac9c0 con 0x7f5b680cb2a0 2023-11-29T11:13:56.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b667fc700 1 -- 172.21.15.81:0/2769935405 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f5b680ac9c0 con 0x7f5b680cb2a0 2023-11-29T11:13:56.454 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:56.454 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:56.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b54064ee0 msgr2=0x7f5b54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b54064ee0 0x7f5b54067390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009980 tx=0x7f5b5c0090e0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b680cb2a0 msgr2=0x7f5b681f22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b680cb2a0 0x7f5b681f22c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5b58000f80 tx=0x7f5b58004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 shutdown_connections 2023-11-29T11:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b54064ee0 0x7f5b54067390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b68159e70 0x7f5b680c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b680cb2a0 0x7f5b681f22c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 --2- 172.21.15.81:0/2769935405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b68069c40 0x7f5b681585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 >> 172.21.15.81:0/2769935405 conn(0x7f5b680ce3e0 msgr2=0x7f5b680ae9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 shutdown_connections 2023-11-29T11:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.449+0000 7f5b6ef46700 1 -- 172.21.15.81:0/2769935405 wait complete. 2023-11-29T11:13:56.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:56.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:56.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4759e700 1 Processor -- start 2023-11-29T11:13:56.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4759e700 1 -- start start 2023-11-29T11:13:56.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb480cd370 0x7fbb480cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4759e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb480ce220 0x7fbb480cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb480d0130 con 0x7fbb4815c1d0 2023-11-29T11:13:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb480cb750 con 0x7fbb480cd370 2023-11-29T11:13:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4759e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb480cba30 con 0x7fbb480ce220 2023-11-29T11:13:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb45d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb480cd370 0x7fbb480cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbb4815c1d0 0x7fbb480ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35262/0 (socket says 172.21.15.81:35262) 2023-11-29T11:13:56.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.589+0000 7fbb4659c700 1 -- 172.21.15.81:0/3124466895 learned_addr learned my addr 172.21.15.81:0/3124466895 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb46d9d700 1 --2- 172.21.15.81:0/3124466895 >> v2:172.21.15.176:3300/0 conn(0x7fbb480ce220 0x7fbb480cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb45d9b700 1 -- 172.21.15.81:0/3124466895 >> v2:172.21.15.176:3300/0 conn(0x7fbb480ce220 msgr2=0x7fbb480cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb45d9b700 1 --2- 172.21.15.81:0/3124466895 >> v2:172.21.15.176:3300/0 conn(0x7fbb480ce220 0x7fbb480cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb45d9b700 1 -- 172.21.15.81:0/3124466895 >> v1:172.21.15.81:6789/0 conn(0x7fbb4815c1d0 legacy=0x7fbb480ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb45d9b700 1 -- 172.21.15.81:0/3124466895 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480cbd10 con 0x7fbb480cd370 2023-11-29T11:13:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4559a700 1 -- 172.21.15.81:0/3124466895 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688620551 0 0) 0x7fbb480d0130 con 0x7fbb4815c1d0 2023-11-29T11:13:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb45d9b700 1 --2- 172.21.15.81:0/3124466895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480cd370 0x7fbb480cc510 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbb480b6790 tx=0x7fbb3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232e1d1044343e02 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4559a700 1 -- 172.21.15.81:0/3124466895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800e070 con 0x7fbb480cd370 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4559a700 1 -- 172.21.15.81:0/3124466895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3800bb20 con 0x7fbb480cd370 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4559a700 1 -- 172.21.15.81:0/3124466895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38012430 con 0x7fbb480cd370 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4759e700 1 -- 172.21.15.81:0/3124466895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480cd370 msgr2=0x7fbb480cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3124466895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480cd370 0x7fbb480cc510 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbb480b6790 tx=0x7fbb3800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4759e700 1 -- 172.21.15.81:0/3124466895 shutdown_connections 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3124466895 >> v2:172.21.15.176:3300/0 conn(0x7fbb480ce220 0x7fbb480cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3124466895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480cd370 0x7fbb480cc510 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4759e700 1 -- 172.21.15.81:0/3124466895 >> 172.21.15.81:0/3124466895 conn(0x7fbb480b2180 msgr2=0x7fbb480b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4759e700 1 -- 172.21.15.81:0/3124466895 shutdown_connections 2023-11-29T11:13:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.593+0000 7fbb4759e700 1 -- 172.21.15.81:0/3124466895 wait complete. 2023-11-29T11:13:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 Processor -- start 2023-11-29T11:13:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 -- start start 2023-11-29T11:13:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb480cd370 0x7fbb48155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480ce220 0x7fbb480b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb4815c1d0 0x7fbb4815e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480b4850 con 0x7fbb480ce220 2023-11-29T11:13:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb481556c0 con 0x7fbb480cd370 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480b39c0 con 0x7fbb4815c1d0 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480ce220 0x7fbb480b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480ce220 0x7fbb480b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40252/0 (socket says 172.21.15.81:40252) 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 -- 172.21.15.81:0/3425135064 learned_addr learned my addr 172.21.15.81:0/3425135064 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4659c700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb480cd370 0x7fbb48155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb46d9d700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb4815c1d0 0x7fbb4815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 -- 172.21.15.81:0/3425135064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb4815c1d0 msgr2=0x7fbb4815e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb4815c1d0 0x7fbb4815e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 -- 172.21.15.81:0/3425135064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb480cd370 msgr2=0x7fbb48155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb480cd370 0x7fbb48155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 -- 172.21.15.81:0/3425135064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38009a70 con 0x7fbb480ce220 2023-11-29T11:13:56.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb45d9b700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480ce220 0x7fbb480b3480 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbb4806afc0 tx=0x7fbb38004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb36ffd700 1 -- 172.21.15.81:0/3425135064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38012430 con 0x7fbb480ce220 2023-11-29T11:13:56.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb36ffd700 1 -- 172.21.15.81:0/3425135064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb38020070 con 0x7fbb480ce220 2023-11-29T11:13:56.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb480ce5f0 con 0x7fbb480ce220 2023-11-29T11:13:56.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb36ffd700 1 -- 172.21.15.81:0/3425135064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38004280 con 0x7fbb480ce220 2023-11-29T11:13:56.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.597+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb480cbff0 con 0x7fbb480ce220 2023-11-29T11:13:56.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.601+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb480d0360 con 0x7fbb480ce220 2023-11-29T11:13:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.601+0000 7fbb36ffd700 1 -- 172.21.15.81:0/3425135064 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb380043e0 con 0x7fbb480ce220 2023-11-29T11:13:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.601+0000 7fbb36ffd700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb28064ee0 0x7fbb28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.601+0000 7fbb36ffd700 1 -- 172.21.15.81:0/3425135064 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb38022070 con 0x7fbb480ce220 2023-11-29T11:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.601+0000 7fbb4659c700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb28064ee0 0x7fbb28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.601+0000 7fbb4659c700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb28064ee0 0x7fbb28067390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c000f60 tx=0x7fbb3c007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.609+0000 7fbb36ffd700 1 -- 172.21.15.81:0/3425135064 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb38052030 con 0x7fbb480ce220 2023-11-29T11:13:56.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb4806d910 con 0x7fbb480ce220 2023-11-29T11:13:56.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb36ffd700 1 -- 172.21.15.81:0/3425135064 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb38012e60 con 0x7fbb480ce220 2023-11-29T11:13:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb28064ee0 msgr2=0x7fbb28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb28064ee0 0x7fbb28067390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c000f60 tx=0x7fbb3c007e90 comp rx=0 tx=0).stop 2023-11-29T11:13:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480ce220 msgr2=0x7fbb480b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480ce220 0x7fbb480b3480 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbb4806afc0 tx=0x7fbb38004af0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 shutdown_connections 2023-11-29T11:13:56.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb28064ee0 0x7fbb28067390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb4815c1d0 0x7fbb4815e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb480ce220 0x7fbb480b3480 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 --2- 172.21.15.81:0/3425135064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb480cd370 0x7fbb48155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.773+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 >> 172.21.15.81:0/3425135064 conn(0x7fbb480b2180 msgr2=0x7fbb4806e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:56.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.777+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 shutdown_connections 2023-11-29T11:13:56.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.777+0000 7fbb4759e700 1 -- 172.21.15.81:0/3425135064 wait complete. 2023-11-29T11:13:56.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:56.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f0682401700 1 Processor -- start 2023-11-29T11:13:56.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f0682401700 1 -- start start 2023-11-29T11:13:56.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f0682401700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f067c15c1d0 0x7f067c0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f0682401700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f067c0cd370 0x7f067c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f0682401700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067c0d0130 con 0x7f067c0ce220 2023-11-29T11:13:56.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f0682401700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c0ce6a0 con 0x7f067c15c1d0 2023-11-29T11:13:56.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f0682401700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c0cb750 con 0x7f067c0cd370 2023-11-29T11:13:56.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f06813ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f067c15c1d0 0x7f067c0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f06813ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f067c15c1d0 0x7f067c0cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40256/0 (socket says 172.21.15.81:40256) 2023-11-29T11:13:56.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f06813ff700 1 -- 172.21.15.81:0/652751718 learned_addr learned my addr 172.21.15.81:0/652751718 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:56.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.913+0000 7f0681c00700 1 --2- 172.21.15.81:0/652751718 >> v2:172.21.15.176:3300/0 conn(0x7f067c0cd370 0x7f067c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f06813ff700 1 -- 172.21.15.81:0/652751718 >> v2:172.21.15.176:3300/0 conn(0x7f067c0cd370 msgr2=0x7f067c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:56.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f06813ff700 1 --2- 172.21.15.81:0/652751718 >> v2:172.21.15.176:3300/0 conn(0x7f067c0cd370 0x7f067c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f06813ff700 1 -- 172.21.15.81:0/652751718 >> v1:172.21.15.176:6789/0 conn(0x7f067c0ce220 legacy=0x7f067c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f06813ff700 1 -- 172.21.15.81:0/652751718 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c0cba30 con 0x7f067c15c1d0 2023-11-29T11:13:56.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0681c00700 1 --2- 172.21.15.81:0/652751718 >> v2:172.21.15.176:3300/0 conn(0x7f067c0cd370 0x7f067c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:56.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f06813ff700 1 --2- 172.21.15.81:0/652751718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c15c1d0 0x7f067c0cc510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f067c0c76b0 tx=0x7f0678009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bb526e41572a1f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0673fff700 1 -- 172.21.15.81:0/652751718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678011830 con 0x7f067c15c1d0 2023-11-29T11:13:56.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0673fff700 1 -- 172.21.15.81:0/652751718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678011990 con 0x7f067c15c1d0 2023-11-29T11:13:56.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0673fff700 1 -- 172.21.15.81:0/652751718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678011d20 con 0x7f067c15c1d0 2023-11-29T11:13:56.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- 172.21.15.81:0/652751718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c15c1d0 msgr2=0x7f067c0cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 --2- 172.21.15.81:0/652751718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c15c1d0 0x7f067c0cc510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f067c0c76b0 tx=0x7f0678009bf0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- 172.21.15.81:0/652751718 shutdown_connections 2023-11-29T11:13:56.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 --2- 172.21.15.81:0/652751718 >> v2:172.21.15.176:3300/0 conn(0x7f067c0cd370 0x7f067c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 --2- 172.21.15.81:0/652751718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c15c1d0 0x7f067c0cc510 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- 172.21.15.81:0/652751718 >> 172.21.15.81:0/652751718 conn(0x7f067c0b2180 msgr2=0x7f067c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:56.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- 172.21.15.81:0/652751718 shutdown_connections 2023-11-29T11:13:56.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- 172.21.15.81:0/652751718 wait complete. 2023-11-29T11:13:56.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 Processor -- start 2023-11-29T11:13:56.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- start start 2023-11-29T11:13:56.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f067c0cd370 0x7f067c147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c0ce220 0x7f067c0afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f067c15c1d0 0x7f067c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0b5110 con 0x7f067c0ce220 2023-11-29T11:13:56.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0b47b0 con 0x7f067c15c1d0 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0682401700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0b4a50 con 0x7f067c0cd370 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.917+0000 7f0680bfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c0ce220 0x7f067c0afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0680bfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c0ce220 0x7f067c0afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40266/0 (socket says 172.21.15.81:40266) 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0680bfe700 1 -- 172.21.15.81:0/3514782738 learned_addr learned my addr 172.21.15.81:0/3514782738 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f06813ff700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f067c0cd370 0x7f067c147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0681c00700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f067c15c1d0 0x7f067c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0680bfe700 1 -- 172.21.15.81:0/3514782738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f067c0cd370 msgr2=0x7f067c147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0680bfe700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f067c0cd370 0x7f067c147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0680bfe700 1 -- 172.21.15.81:0/3514782738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f067c15c1d0 msgr2=0x7f067c0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0680bfe700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f067c15c1d0 0x7f067c0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0680bfe700 1 -- 172.21.15.81:0/3514782738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0674009a70 con 0x7f067c0ce220 2023-11-29T11:13:56.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0680bfe700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c0ce220 0x7f067c0afb40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f066c00c500 tx=0x7f066c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0671ffb700 1 -- 172.21.15.81:0/3514782738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c0052d0 con 0x7f067c0ce220 2023-11-29T11:13:56.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0671ffb700 1 -- 172.21.15.81:0/3514782738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c005430 con 0x7f067c0ce220 2023-11-29T11:13:56.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0678009570 con 0x7f067c0ce220 2023-11-29T11:13:56.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0671ffb700 1 -- 172.21.15.81:0/3514782738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c0055a0 con 0x7f067c0ce220 2023-11-29T11:13:56.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c0cbff0 con 0x7f067c0ce220 2023-11-29T11:13:56.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.921+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067c0cbd10 con 0x7f067c0ce220 2023-11-29T11:13:56.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.925+0000 7f0671ffb700 1 -- 172.21.15.81:0/3514782738 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f066c019030 con 0x7f067c0ce220 2023-11-29T11:13:56.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.925+0000 7f0671ffb700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0660064ee0 0x7f0660067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:56.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.925+0000 7f0671ffb700 1 -- 172.21.15.81:0/3514782738 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f066c081540 con 0x7f067c0ce220 2023-11-29T11:13:56.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.925+0000 7f06813ff700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0660064ee0 0x7f0660067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:56.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.925+0000 7f06813ff700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0660064ee0 0x7f0660067390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0678000c00 tx=0x7f0678008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:56.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:56.933+0000 7f0671ffb700 1 -- 172.21.15.81:0/3514782738 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f066c04f2c0 con 0x7f067c0ce220 2023-11-29T11:13:57.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.093+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f067c0d0360 con 0x7f067c0ce220 2023-11-29T11:13:57.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.093+0000 7f0671ffb700 1 -- 172.21.15.81:0/3514782738 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f066c0528e0 con 0x7f067c0ce220 2023-11-29T11:13:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0660064ee0 msgr2=0x7f0660067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0660064ee0 0x7f0660067390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0678000c00 tx=0x7f0678008030 comp rx=0 tx=0).stop 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c0ce220 msgr2=0x7f067c0afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c0ce220 0x7f067c0afb40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f066c00c500 tx=0x7f066c00c810 comp rx=0 tx=0).stop 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 shutdown_connections 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0660064ee0 0x7f0660067390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f067c15c1d0 0x7f067c0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f067c0ce220 0x7f067c0afb40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 --2- 172.21.15.81:0/3514782738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f067c0cd370 0x7f067c147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 >> 172.21.15.81:0/3514782738 conn(0x7f067c0b2180 msgr2=0x7f067c06c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 shutdown_connections 2023-11-29T11:13:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.097+0000 7f0682401700 1 -- 172.21.15.81:0/3514782738 wait complete. 2023-11-29T11:13:57.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:57.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.229+0000 7f7803fff700 1 Processor -- start 2023-11-29T11:13:57.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.229+0000 7f7803fff700 1 -- start start 2023-11-29T11:13:57.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77fc0550a0 0x7f77fc051700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc04fb40 con 0x7f77fc054520 2023-11-29T11:13:57.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc053ad0 con 0x7f77fc0dee60 2023-11-29T11:13:57.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc0df230 con 0x7f77fc0550a0 2023-11-29T11:13:57.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f78027fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77fc0550a0 0x7f77fc051700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f78037fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f77fc054520 0x7f77fc037000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35278/0 (socket says 172.21.15.81:35278) 2023-11-29T11:13:57.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f78037fe700 1 -- 172.21.15.81:0/2475275191 learned_addr learned my addr 172.21.15.81:0/2475275191 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:57.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f78027fc700 1 -- 172.21.15.81:0/2475275191 >> v1:172.21.15.176:6789/0 conn(0x7f77fc0dee60 legacy=0x7f77fc0383d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f78027fc700 1 -- 172.21.15.81:0/2475275191 >> v1:172.21.15.81:6789/0 conn(0x7f77fc054520 legacy=0x7f77fc037000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f78027fc700 1 -- 172.21.15.81:0/2475275191 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc008180 con 0x7f77fc0550a0 2023-11-29T11:13:57.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f78027fc700 1 --2- 172.21.15.81:0/2475275191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc051700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009850 tx=0x7f77f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff980d8cb12b63 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7801ffb700 1 -- 172.21.15.81:0/2475275191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011830 con 0x7f77fc0550a0 2023-11-29T11:13:57.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7801ffb700 1 -- 172.21.15.81:0/2475275191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4011990 con 0x7f77fc0550a0 2023-11-29T11:13:57.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7801ffb700 1 -- 172.21.15.81:0/2475275191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011d20 con 0x7f77fc0550a0 2023-11-29T11:13:57.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 -- 172.21.15.81:0/2475275191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 msgr2=0x7f77fc051700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 --2- 172.21.15.81:0/2475275191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc051700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009850 tx=0x7f77f4009b60 comp rx=0 tx=0).stop 2023-11-29T11:13:57.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 -- 172.21.15.81:0/2475275191 shutdown_connections 2023-11-29T11:13:57.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 --2- 172.21.15.81:0/2475275191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc051700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.233+0000 7f7803fff700 1 -- 172.21.15.81:0/2475275191 >> 172.21.15.81:0/2475275191 conn(0x7f77fc052000 msgr2=0x7f77fc052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:57.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 -- 172.21.15.81:0/2475275191 shutdown_connections 2023-11-29T11:13:57.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 -- 172.21.15.81:0/2475275191 wait complete. 2023-11-29T11:13:57.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 Processor -- start 2023-11-29T11:13:57.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 -- start start 2023-11-29T11:13:57.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77fc054520 0x7f77fc04ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc04b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77fc0dee60 0x7f77fc04b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc04d3f0 con 0x7f77fc0550a0 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc03aab0 con 0x7f77fc0dee60 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc03ad90 con 0x7f77fc054520 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc04b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc04b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40278/0 (socket says 172.21.15.81:40278) 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 -- 172.21.15.81:0/2040348792 learned_addr learned my addr 172.21.15.81:0/2040348792 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78037fe700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77fc0dee60 0x7f77fc04b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7802ffd700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77fc054520 0x7f77fc04ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 -- 172.21.15.81:0/2040348792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77fc054520 msgr2=0x7f77fc04ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77fc054520 0x7f77fc04ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 -- 172.21.15.81:0/2040348792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77fc0dee60 msgr2=0x7f77fc04b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77fc0dee60 0x7f77fc04b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 -- 172.21.15.81:0/2040348792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40094b0 con 0x7f77fc0550a0 2023-11-29T11:13:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f78027fc700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc04b220 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00e760 tx=0x7f77f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f77fb7fe700 1 -- 172.21.15.81:0/2040348792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40036c0 con 0x7f77fc0550a0 2023-11-29T11:13:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f77fb7fe700 1 -- 172.21.15.81:0/2040348792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4003820 con 0x7f77fc0550a0 2023-11-29T11:13:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc050070 con 0x7f77fc0550a0 2023-11-29T11:13:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f77fb7fe700 1 -- 172.21.15.81:0/2040348792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4003bd0 con 0x7f77fc0550a0 2023-11-29T11:13:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.237+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc04fd90 con 0x7f77fc0550a0 2023-11-29T11:13:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.241+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc053d20 con 0x7f77fc0550a0 2023-11-29T11:13:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.241+0000 7f77fb7fe700 1 -- 172.21.15.81:0/2040348792 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f77f402d070 con 0x7f77fc0550a0 2023-11-29T11:13:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.241+0000 7f77fb7fe700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77e4064ee0 0x7f77e4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.241+0000 7f77fb7fe700 1 -- 172.21.15.81:0/2040348792 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f77f4021030 con 0x7f77fc0550a0 2023-11-29T11:13:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.241+0000 7f7802ffd700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77e4064ee0 0x7f77e4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.241+0000 7f7802ffd700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77e4064ee0 0x7f77e4067390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77ec000f60 tx=0x7f77ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.249+0000 7f77fb7fe700 1 -- 172.21.15.81:0/2040348792 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f77f40517f0 con 0x7f77fc0550a0 2023-11-29T11:13:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.409+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77fc0059c0 con 0x7f77fc0550a0 2023-11-29T11:13:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.409+0000 7f77fb7fe700 1 -- 172.21.15.81:0/2040348792 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77f4054e10 con 0x7f77fc0550a0 2023-11-29T11:13:57.416 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77e4064ee0 msgr2=0x7f77e4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77e4064ee0 0x7f77e4067390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77ec000f60 tx=0x7f77ec009040 comp rx=0 tx=0).stop 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 msgr2=0x7f77fc04b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc04b220 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00e760 tx=0x7f77f4004770 comp rx=0 tx=0).stop 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 shutdown_connections 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77e4064ee0 0x7f77e4067390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77fc0dee60 0x7f77fc04b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc0550a0 0x7f77fc04b220 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 --2- 172.21.15.81:0/2040348792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77fc054520 0x7f77fc04ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 >> 172.21.15.81:0/2040348792 conn(0x7f77fc052000 msgr2=0x7f77fc0db850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 shutdown_connections 2023-11-29T11:13:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.413+0000 7f7803fff700 1 -- 172.21.15.81:0/2040348792 wait complete. 2023-11-29T11:13:57.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:57.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bffff700 1 Processor -- start 2023-11-29T11:13:57.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bffff700 1 -- start start 2023-11-29T11:13:57.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f87c00b00e0 0x7f87c015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c009bdb0 0x7f87c015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87c00cbb30 0x7f87c015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00b2db0 con 0x7f87c00cbb30 2023-11-29T11:13:57.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00b3240 con 0x7f87c00b00e0 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c006d840 con 0x7f87c009bdb0 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87c00cbb30 0x7f87c015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87c00cbb30 0x7f87c015dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40284/0 (socket says 172.21.15.81:40284) 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 -- 172.21.15.81:0/2594119428 learned_addr learned my addr 172.21.15.81:0/2594119428 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87beffd700 1 --2- 172.21.15.81:0/2594119428 >> v2:172.21.15.176:3300/0 conn(0x7f87c00b00e0 0x7f87c015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87be7fc700 1 --2- 172.21.15.81:0/2594119428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c009bdb0 0x7f87c015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 -- 172.21.15.81:0/2594119428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c009bdb0 msgr2=0x7f87c015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 --2- 172.21.15.81:0/2594119428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c009bdb0 0x7f87c015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 -- 172.21.15.81:0/2594119428 >> v2:172.21.15.176:3300/0 conn(0x7f87c00b00e0 msgr2=0x7f87c015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 --2- 172.21.15.81:0/2594119428 >> v2:172.21.15.176:3300/0 conn(0x7f87c00b00e0 0x7f87c015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 -- 172.21.15.81:0/2594119428 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c006d560 con 0x7f87c00cbb30 2023-11-29T11:13:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.553+0000 7f87bf7fe700 1 --2- 172.21.15.81:0/2594119428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c00cbb30 0x7f87c015dd60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87c006fbf0 tx=0x7f87b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96683edfd2513293 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bdffb700 1 -- 172.21.15.81:0/2594119428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800e070 con 0x7f87c00cbb30 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bdffb700 1 -- 172.21.15.81:0/2594119428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800b910 con 0x7f87c00cbb30 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bdffb700 1 -- 172.21.15.81:0/2594119428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800bcc0 con 0x7f87c00cbb30 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- 172.21.15.81:0/2594119428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c00cbb30 msgr2=0x7f87c015dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 --2- 172.21.15.81:0/2594119428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c00cbb30 0x7f87c015dd60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87c006fbf0 tx=0x7f87b800b330 comp rx=0 tx=0).stop 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- 172.21.15.81:0/2594119428 shutdown_connections 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 --2- 172.21.15.81:0/2594119428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c009bdb0 0x7f87c015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 --2- 172.21.15.81:0/2594119428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c00cbb30 0x7f87c015dd60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 --2- 172.21.15.81:0/2594119428 >> v2:172.21.15.176:3300/0 conn(0x7f87c00b00e0 0x7f87c015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- 172.21.15.81:0/2594119428 >> 172.21.15.81:0/2594119428 conn(0x7f87c00cae70 msgr2=0x7f87c00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- 172.21.15.81:0/2594119428 shutdown_connections 2023-11-29T11:13:57.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- 172.21.15.81:0/2594119428 wait complete. 2023-11-29T11:13:57.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 Processor -- start 2023-11-29T11:13:57.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- start start 2023-11-29T11:13:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c009bdb0 0x7f87c015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c00b00e0 0x7f87c00c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c00cbb30 0x7f87c0158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c015a370 con 0x7f87c009bdb0 2023-11-29T11:13:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c015a650 con 0x7f87c00cbb30 2023-11-29T11:13:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c015a930 con 0x7f87c00b00e0 2023-11-29T11:13:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c009bdb0 0x7f87c015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c009bdb0 0x7f87c015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40294/0 (socket says 172.21.15.81:40294) 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 -- 172.21.15.81:0/1674156284 learned_addr learned my addr 172.21.15.81:0/1674156284 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87bf7fe700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c00cbb30 0x7f87c0158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87be7fc700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c00b00e0 0x7f87c00c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 -- 172.21.15.81:0/1674156284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c00b00e0 msgr2=0x7f87c00c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c00b00e0 0x7f87c00c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 -- 172.21.15.81:0/1674156284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c00cbb30 msgr2=0x7f87c0158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c00cbb30 0x7f87c0158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 -- 172.21.15.81:0/1674156284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009b30 con 0x7f87c009bdb0 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.557+0000 7f87beffd700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c009bdb0 0x7f87c015b410 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e9d0 tx=0x7f87b400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.561+0000 7f87a77fe700 1 -- 172.21.15.81:0/1674156284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4009720 con 0x7f87c009bdb0 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.561+0000 7f87a77fe700 1 -- 172.21.15.81:0/1674156284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b400ee70 con 0x7f87c009bdb0 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.561+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00ac3d0 con 0x7f87c009bdb0 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.561+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c00ac0f0 con 0x7f87c009bdb0 2023-11-29T11:13:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.561+0000 7f87a77fe700 1 -- 172.21.15.81:0/1674156284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b400ca50 con 0x7f87c009bdb0 2023-11-29T11:13:57.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.561+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c00cc9f0 con 0x7f87c009bdb0 2023-11-29T11:13:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.561+0000 7f87a77fe700 1 -- 172.21.15.81:0/1674156284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f87b4019030 con 0x7f87c009bdb0 2023-11-29T11:13:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.565+0000 7f87a77fe700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87ac064ee0 0x7f87ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.565+0000 7f87a77fe700 1 -- 172.21.15.81:0/1674156284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87b40827e0 con 0x7f87c009bdb0 2023-11-29T11:13:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.565+0000 7f87be7fc700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87ac064ee0 0x7f87ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.565+0000 7f87be7fc700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87ac064ee0 0x7f87ac067390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cabe0 tx=0x7f87b0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.569+0000 7f87a77fe700 1 -- 172.21.15.81:0/1674156284 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f87b4054120 con 0x7f87c009bdb0 2023-11-29T11:13:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.725+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87c0072500 con 0x7f87c009bdb0 2023-11-29T11:13:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.725+0000 7f87a77fe700 1 -- 172.21.15.81:0/1674156284 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87b4017020 con 0x7f87c009bdb0 2023-11-29T11:13:57.732 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87ac064ee0 msgr2=0x7f87ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87ac064ee0 0x7f87ac067390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cabe0 tx=0x7f87b0009240 comp rx=0 tx=0).stop 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c009bdb0 msgr2=0x7f87c015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c009bdb0 0x7f87c015b410 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e9d0 tx=0x7f87b400ece0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 shutdown_connections 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87ac064ee0 0x7f87ac067390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c00cbb30 0x7f87c0158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87c00b00e0 0x7f87c00c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 --2- 172.21.15.81:0/1674156284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c009bdb0 0x7f87c015b410 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 >> 172.21.15.81:0/1674156284 conn(0x7f87c00cae70 msgr2=0x7f87c0069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 shutdown_connections 2023-11-29T11:13:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.729+0000 7f87bffff700 1 -- 172.21.15.81:0/1674156284 wait complete. 2023-11-29T11:13:57.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:13:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3d0ce2700 1 Processor -- start 2023-11-29T11:13:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3d0ce2700 1 -- start start 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3d0ce2700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb3cc0b1e60 0x7fb3cc0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3d0ce2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 0x7fb3cc06d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3d0ce2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0cf180 con 0x7fb3cc06d980 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3d0ce2700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc0cf460 con 0x7fb3cc0b1e60 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3d0ce2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0cf740 con 0x7fb3cc06cc50 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3caffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb3cc06d980 0x7fb3cc06ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35294/0 (socket says 172.21.15.81:35294) 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3caffd700 1 -- 172.21.15.81:0/4234080583 learned_addr learned my addr 172.21.15.81:0/4234080583 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cbfff700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 0x7fb3cc06d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cb7fe700 1 --2- 172.21.15.81:0/4234080583 >> v2:172.21.15.176:3300/0 conn(0x7fb3cc0b1e60 0x7fb3cc0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722062468 0 0) 0x7fb3cc0cf180 con 0x7fb3cc06d980 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b40035d0 con 0x7fb3cc06d980 2023-11-29T11:13:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830375550 0 0) 0x7fb3b40035d0 con 0x7fb3cc06d980 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 msgr2=0x7fb3cc06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 0x7fb3cc06d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 >> v2:172.21.15.176:3300/0 conn(0x7fb3cc0b1e60 msgr2=0x7fb3cc0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 --2- 172.21.15.81:0/4234080583 >> v2:172.21.15.176:3300/0 conn(0x7fb3cc0b1e60 0x7fb3cc0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0cfa20 con 0x7fb3cc06d980 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fb3bc001670 con 0x7fb3cc06d980 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 >> v1:172.21.15.81:6789/0 conn(0x7fb3cc06d980 legacy=0x7fb3cc06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3b4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b4004450 0x7fb3b4004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 0x7fb3b4004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0cf460 con 0x7fb3b4003a20 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0cf740 con 0x7fb3b4004450 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b400ba30 con 0x7fb3cc06cc50 2023-11-29T11:13:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cb7fe700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3b4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3caffd700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b4004450 0x7fb3b4004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cbfff700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 0x7fb3b4004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cb7fe700 1 -- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 msgr2=0x7fb3b4004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cb7fe700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 0x7fb3b4004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cb7fe700 1 -- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b4004450 msgr2=0x7fb3b4004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cb7fe700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3b4004450 0x7fb3b4004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cb7fe700 1 -- 172.21.15.81:0/4234080583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b40035d0 con 0x7fb3b4003a20 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.853+0000 7fb3cbfff700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc06cc50 0x7fb3b4004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3cb7fe700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3b4003e30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009b70 tx=0x7fb3b40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8aafda9413e8ea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000e6c0 con 0x7fb3b4003a20 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c000e820 con 0x7fb3b4003a20 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3ca7fc700 1 -- 172.21.15.81:0/4234080583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000eb90 con 0x7fb3b4003a20 2023-11-29T11:13:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/4234080583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 msgr2=0x7fb3b4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3d0ce2700 1 --2- 172.21.15.81:0/4234080583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3b4003e30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009b70 tx=0x7fb3b40058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3cbfff700 1 -- 172.21.15.81:0/4234080583 reap_dead start 2023-11-29T11:13:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/4234080583 shutdown_connections 2023-11-29T11:13:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/4234080583 >> 172.21.15.81:0/4234080583 conn(0x7fb3cc089f70 msgr2=0x7fb3cc09bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/4234080583 shutdown_connections 2023-11-29T11:13:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/4234080583 wait complete. 2023-11-29T11:13:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3d0ce2700 1 Processor -- start 2023-11-29T11:13:57.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.857+0000 7fb3d0ce2700 1 -- start start 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3cc1f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc0c6040 0x7fb3cc145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3cc146500 0x7fb3cc15fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c7f70 con 0x7fb3b4003a20 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c8250 con 0x7fb3cc146500 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c8530 con 0x7fb3cc0c6040 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3cc1f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3cc1f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40316/0 (socket says 172.21.15.81:40316) 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 -- 172.21.15.81:0/3974204451 learned_addr learned my addr 172.21.15.81:0/3974204451 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:57.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cbfff700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3cc146500 0x7fb3cc15fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3caffd700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc0c6040 0x7fb3cc145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 -- 172.21.15.81:0/3974204451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc0c6040 msgr2=0x7fb3cc145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc0c6040 0x7fb3cc145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 -- 172.21.15.81:0/3974204451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3cc146500 msgr2=0x7fb3cc15fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3cc146500 0x7fb3cc15fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 -- 172.21.15.81:0/3974204451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0cffe0 con 0x7fb3b4003a20 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3cb7fe700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3cc1f1370 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40056f0 tx=0x7fb3c00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3974204451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000e6c0 con 0x7fb3b4003a20 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3974204451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0013d80 con 0x7fb3b4003a20 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc0cfd00 con 0x7fb3b4003a20 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3974204451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0004270 con 0x7fb3b4003a20 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc06d0d0 con 0x7fb3b4003a20 2023-11-29T11:13:57.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.861+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc0b87a0 con 0x7fb3b4003a20 2023-11-29T11:13:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.865+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3974204451 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb3c002b020 con 0x7fb3b4003a20 2023-11-29T11:13:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.865+0000 7fb3b3fff700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b8064ee0 0x7fb3b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.865+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3974204451 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb3c0083910 con 0x7fb3b4003a20 2023-11-29T11:13:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.865+0000 7fb3caffd700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b8064ee0 0x7fb3b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:57.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.865+0000 7fb3caffd700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b8064ee0 0x7fb3b8067390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc151450 tx=0x7fb3bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:57.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:57.869+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3974204451 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb3c0051690 con 0x7fb3b4003a20 2023-11-29T11:13:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.029+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb3cc072500 con 0x7fb3b4003a20 2023-11-29T11:13:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.029+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3974204451 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb3c0054cb0 con 0x7fb3b4003a20 2023-11-29T11:13:58.036 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b8064ee0 msgr2=0x7fb3b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b8064ee0 0x7fb3b8067390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc151450 tx=0x7fb3bc009040 comp rx=0 tx=0).stop 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 msgr2=0x7fb3cc1f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3cc1f1370 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40056f0 tx=0x7fb3c00047e0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 shutdown_connections 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b8064ee0 0x7fb3b8067390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3cc146500 0x7fb3cc15fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3cc0c6040 0x7fb3cc145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 --2- 172.21.15.81:0/3974204451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b4003a20 0x7fb3cc1f1370 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 >> 172.21.15.81:0/3974204451 conn(0x7fb3cc089f70 msgr2=0x7fb3cc0b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 shutdown_connections 2023-11-29T11:13:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.033+0000 7fb3d0ce2700 1 -- 172.21.15.81:0/3974204451 wait complete. 2023-11-29T11:13:58.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:13:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 Processor -- start 2023-11-29T11:13:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- start start 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff98c0ce960 0x7ff98c15d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 0x7ff98c0d2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff98c0d2e70 0x7ff98c06a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0d32d0 con 0x7ff98c0d2e70 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0b66a0 con 0x7ff98c0ce960 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0ccf60 con 0x7ff98c0d2500 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff98c0d2e70 0x7ff98c06a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff98c0d2e70 0x7ff98c06a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40330/0 (socket says 172.21.15.81:40330) 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 -- 172.21.15.81:0/1091595560 learned_addr learned my addr 172.21.15.81:0/1091595560 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99080a700 1 --2- 172.21.15.81:0/1091595560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 0x7ff98c0d2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99100b700 1 --2- 172.21.15.81:0/1091595560 >> v2:172.21.15.176:3300/0 conn(0x7ff98c0ce960 0x7ff98c15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 -- 172.21.15.81:0/1091595560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 msgr2=0x7ff98c0d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 --2- 172.21.15.81:0/1091595560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 0x7ff98c0d2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 -- 172.21.15.81:0/1091595560 >> v2:172.21.15.176:3300/0 conn(0x7ff98c0ce960 msgr2=0x7ff98c15d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 --2- 172.21.15.81:0/1091595560 >> v2:172.21.15.176:3300/0 conn(0x7ff98c0ce960 0x7ff98c15d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 -- 172.21.15.81:0/1091595560 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0b78b0 con 0x7ff98c0d2e70 2023-11-29T11:13:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99180c700 1 --2- 172.21.15.81:0/1091595560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0d2e70 0x7ff98c06a330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff98c08ad00 tx=0x7ff98400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829d3d3e37ccbf71 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff983fff700 1 -- 172.21.15.81:0/1091595560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400e070 con 0x7ff98c0d2e70 2023-11-29T11:13:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff983fff700 1 -- 172.21.15.81:0/1091595560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98400b980 con 0x7ff98c0d2e70 2023-11-29T11:13:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff983fff700 1 -- 172.21.15.81:0/1091595560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400bd30 con 0x7ff98c0d2e70 2023-11-29T11:13:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- 172.21.15.81:0/1091595560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0d2e70 msgr2=0x7ff98c06a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 --2- 172.21.15.81:0/1091595560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0d2e70 0x7ff98c06a330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff98c08ad00 tx=0x7ff98400b330 comp rx=0 tx=0).stop 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- 172.21.15.81:0/1091595560 shutdown_connections 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 --2- 172.21.15.81:0/1091595560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 0x7ff98c0d2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 --2- 172.21.15.81:0/1091595560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0d2e70 0x7ff98c06a330 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 --2- 172.21.15.81:0/1091595560 >> v2:172.21.15.176:3300/0 conn(0x7ff98c0ce960 0x7ff98c15d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- 172.21.15.81:0/1091595560 >> 172.21.15.81:0/1091595560 conn(0x7ff98c0b5860 msgr2=0x7ff98c0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- 172.21.15.81:0/1091595560 shutdown_connections 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.161+0000 7ff99200d700 1 -- 172.21.15.81:0/1091595560 wait complete. 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 Processor -- start 2023-11-29T11:13:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 -- start start 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0ce960 0x7ff98c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 0x7ff98c159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d2e70 0x7ff98c159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c14d600 con 0x7ff98c0ce960 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0cca30 con 0x7ff98c0d2e70 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c14eba0 con 0x7ff98c0d2500 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0ce960 0x7ff98c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0ce960 0x7ff98c0cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40342/0 (socket says 172.21.15.81:40342) 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 -- 172.21.15.81:0/519676480 learned_addr learned my addr 172.21.15.81:0/519676480 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99180c700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d2e70 0x7ff98c159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99080a700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 0x7ff98c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 -- 172.21.15.81:0/519676480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 msgr2=0x7ff98c159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 0x7ff98c159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 -- 172.21.15.81:0/519676480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d2e70 msgr2=0x7ff98c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d2e70 0x7ff98c159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 -- 172.21.15.81:0/519676480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984009b30 con 0x7ff98c0ce960 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99100b700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0ce960 0x7ff98c0cc4f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff98800e810 tx=0x7ff98800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff981ffb700 1 -- 172.21.15.81:0/519676480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98800c070 con 0x7ff98c0ce960 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff981ffb700 1 -- 172.21.15.81:0/519676480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988013610 con 0x7ff98c0ce960 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c0b7e50 con 0x7ff98c0ce960 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.165+0000 7ff981ffb700 1 -- 172.21.15.81:0/519676480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880139a0 con 0x7ff98c0ce960 2023-11-29T11:13:58.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.169+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c0b7b70 con 0x7ff98c0ce960 2023-11-29T11:13:58.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.169+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98c0b8130 con 0x7ff98c0ce960 2023-11-29T11:13:58.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.169+0000 7ff981ffb700 1 -- 172.21.15.81:0/519676480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff988023070 con 0x7ff98c0ce960 2023-11-29T11:13:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.169+0000 7ff981ffb700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff970064ee0 0x7ff970067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.169+0000 7ff981ffb700 1 -- 172.21.15.81:0/519676480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff988081e30 con 0x7ff98c0ce960 2023-11-29T11:13:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.169+0000 7ff99080a700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff970064ee0 0x7ff970067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.173+0000 7ff99080a700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff970064ee0 0x7ff970067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff98c06a660 tx=0x7ff97c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.177+0000 7ff981ffb700 1 -- 172.21.15.81:0/519676480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff98804fca0 con 0x7ff98c0ce960 2023-11-29T11:13:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.353+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff98c072500 con 0x7ff98c0ce960 2023-11-29T11:13:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff981ffb700 1 -- 172.21.15.81:0/519676480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff9880532c0 con 0x7ff98c0ce960 2023-11-29T11:13:58.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff970064ee0 msgr2=0x7ff970067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff970064ee0 0x7ff970067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff98c06a660 tx=0x7ff97c008040 comp rx=0 tx=0).stop 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0ce960 msgr2=0x7ff98c0cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0ce960 0x7ff98c0cc4f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff98800e810 tx=0x7ff98800eb20 comp rx=0 tx=0).stop 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 shutdown_connections 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff970064ee0 0x7ff970067390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff98c0d2e70 0x7ff98c159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff98c0d2500 0x7ff98c159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 --2- 172.21.15.81:0/519676480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff98c0ce960 0x7ff98c0cc4f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 >> 172.21.15.81:0/519676480 conn(0x7ff98c0b5860 msgr2=0x7ff98c0b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 shutdown_connections 2023-11-29T11:13:58.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.357+0000 7ff99200d700 1 -- 172.21.15.81:0/519676480 wait complete. 2023-11-29T11:13:58.365 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:13:58.375 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:13:58.375 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:13:58.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:13:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.493+0000 7f33d14c5700 1 Processor -- start 2023-11-29T11:13:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.493+0000 7f33d14c5700 1 -- start start 2023-11-29T11:13:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15d650 0x7f33cc0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f33cc159c00 0x7f33cc0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc0cc9b0 con 0x7f33cc0cc020 2023-11-29T11:13:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc0cd720 con 0x7f33cc159c00 2023-11-29T11:13:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0cd990 con 0x7f33cc15d650 2023-11-29T11:13:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33c3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f33cc0cc020 0x7f33cc1594f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35308/0 (socket says 172.21.15.81:35308) 2023-11-29T11:13:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33c3fff700 1 -- 172.21.15.81:0/3532509825 learned_addr learned my addr 172.21.15.81:0/3532509825 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 --2- 172.21.15.81:0/3532509825 >> v2:172.21.15.176:3300/0 conn(0x7f33cc159c00 0x7f33cc0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cbfff700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15d650 0x7f33cc0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733054100 0 0) 0x7f33b4001110 con 0x7f33cc0cc020 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b80035d0 con 0x7f33cc0cc020 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281974850 0 0) 0x7f33b80035d0 con 0x7f33cc0cc020 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15d650 msgr2=0x7f33cc0ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15d650 0x7f33cc0ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 >> v2:172.21.15.176:3300/0 conn(0x7f33cc159c00 msgr2=0x7f33cc0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 --2- 172.21.15.81:0/3532509825 >> v2:172.21.15.176:3300/0 conn(0x7f33cc159c00 0x7f33cc0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc0cdc70 con 0x7f33cc0cc020 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f33b4001800 con 0x7f33cc0cc020 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 >> v1:172.21.15.81:6789/0 conn(0x7f33cc0cc020 legacy=0x7f33cc1594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15d650 0x7f33b8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8003fa0 0x7f33b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33b8004db0 0x7f33b8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0cd720 con 0x7f33b8004db0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0cd990 con 0x7f33b8003fa0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b800ba30 con 0x7f33cc15d650 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33b8004db0 0x7f33b8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cbfff700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15d650 0x7f33b8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33c3fff700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8003fa0 0x7f33b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 -- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15d650 msgr2=0x7f33b8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15d650 0x7f33b8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 -- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8003fa0 msgr2=0x7f33b8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8003fa0 0x7f33b8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 -- 172.21.15.81:0/3532509825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80035d0 con 0x7f33b8004db0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33b8004db0 0x7f33b8005220 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009fc0 tx=0x7f33b80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642d570528a46572 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400ec30 con 0x7f33b8004db0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c400f040 con 0x7f33b8004db0 2023-11-29T11:13:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33cb7fe700 1 -- 172.21.15.81:0/3532509825 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4014480 con 0x7f33b8004db0 2023-11-29T11:13:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 -- 172.21.15.81:0/3532509825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33b8004db0 msgr2=0x7f33b8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 --2- 172.21.15.81:0/3532509825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33b8004db0 0x7f33b8005220 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009fc0 tx=0x7f33b80058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d0cc4700 1 -- 172.21.15.81:0/3532509825 reap_dead start 2023-11-29T11:13:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 -- 172.21.15.81:0/3532509825 shutdown_connections 2023-11-29T11:13:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 -- 172.21.15.81:0/3532509825 >> 172.21.15.81:0/3532509825 conn(0x7f33cc06ec40 msgr2=0x7f33cc0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 -- 172.21.15.81:0/3532509825 shutdown_connections 2023-11-29T11:13:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.497+0000 7f33d14c5700 1 -- 172.21.15.81:0/3532509825 wait complete. 2023-11-29T11:13:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d14c5700 1 Processor -- start 2023-11-29T11:13:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d14c5700 1 -- start start 2023-11-29T11:13:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d14c5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8004db0 0x7f33cc14ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d14c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33cc15a650 0x7f33cc0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d14c5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15aac0 0x7f33cc0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d14c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc14f160 con 0x7f33cc15a650 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d14c5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0af150 con 0x7f33b8004db0 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d14c5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc14f3c0 con 0x7f33cc15aac0 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33cc15a650 0x7f33cc0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33cc15a650 0x7f33cc0afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40360/0 (socket says 172.21.15.81:40360) 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33c3fff700 1 -- 172.21.15.81:0/401597027 learned_addr learned my addr 172.21.15.81:0/401597027 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33d0cc4700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15aac0 0x7f33cc0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33cbfff700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8004db0 0x7f33cc14ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33c3fff700 1 -- 172.21.15.81:0/401597027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15aac0 msgr2=0x7f33cc0b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33c3fff700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15aac0 0x7f33cc0b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33c3fff700 1 -- 172.21.15.81:0/401597027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8004db0 msgr2=0x7f33cc14ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33c3fff700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8004db0 0x7f33cc14ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.501+0000 7f33c3fff700 1 -- 172.21.15.81:0/401597027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc15a250 con 0x7f33cc15a650 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.505+0000 7f33c3fff700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33cc15a650 0x7f33cc0afbf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f33b4001050 tx=0x7f33b40075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.505+0000 7f33c97fa700 1 -- 172.21.15.81:0/401597027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4000ed0 con 0x7f33cc15a650 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.505+0000 7f33c97fa700 1 -- 172.21.15.81:0/401597027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b400f690 con 0x7f33cc15a650 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.505+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc0cdf50 con 0x7f33cc15a650 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.505+0000 7f33c97fa700 1 -- 172.21.15.81:0/401597027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b400fa20 con 0x7f33cc15a650 2023-11-29T11:13:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.505+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc0ce470 con 0x7f33cc15a650 2023-11-29T11:13:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.505+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33cc072c20 con 0x7f33cc15a650 2023-11-29T11:13:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.505+0000 7f33c97fa700 1 -- 172.21.15.81:0/401597027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f33b400fb80 con 0x7f33cc15a650 2023-11-29T11:13:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.509+0000 7f33c97fa700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f33ac064f10 0x7f33ac0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.509+0000 7f33c97fa700 1 -- 172.21.15.81:0/401597027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f33b4082110 con 0x7f33cc15a650 2023-11-29T11:13:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.509+0000 7f33cbfff700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f33ac064f10 0x7f33ac0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.509+0000 7f33cbfff700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f33ac064f10 0x7f33ac0673c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f33cc15bd20 tx=0x7f33bc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.513+0000 7f33c97fa700 1 -- 172.21.15.81:0/401597027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f33b404ff80 con 0x7f33cc15a650 2023-11-29T11:13:58.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.677+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33cc0cc9b0 con 0x7f33cc15a650 2023-11-29T11:13:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33c97fa700 1 -- 172.21.15.81:0/401597027 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f33cc0cc9b0 con 0x7f33cc15a650 2023-11-29T11:13:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:13:58.685 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:13:58.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f33ac064f10 msgr2=0x7f33ac0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f33ac064f10 0x7f33ac0673c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f33cc15bd20 tx=0x7f33bc009240 comp rx=0 tx=0).stop 2023-11-29T11:13:58.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33cc15a650 msgr2=0x7f33cc0afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33cc15a650 0x7f33cc0afbf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f33b4001050 tx=0x7f33b40075f0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 shutdown_connections 2023-11-29T11:13:58.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f33ac064f10 0x7f33ac0673c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33cc15aac0 0x7f33cc0b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33cc15a650 0x7f33cc0afbf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 --2- 172.21.15.81:0/401597027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33b8004db0 0x7f33cc14ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 >> 172.21.15.81:0/401597027 conn(0x7f33cc06ec40 msgr2=0x7f33cc06be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:58.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 shutdown_connections 2023-11-29T11:13:58.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.681+0000 7f33d14c5700 1 -- 172.21.15.81:0/401597027 wait complete. 2023-11-29T11:13:58.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:13:58.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:13:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943b59e700 1 Processor -- start 2023-11-29T11:13:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943b59e700 1 -- start start 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f943c0d31b0 0x7f943c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 0x7f943c0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c06a7f0 con 0x7f943c06ce60 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0d3650 con 0x7f943c0d31b0 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c15c8b0 con 0x7f943c0cf470 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f943c06ce60 0x7f943c06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35312/0 (socket says 172.21.15.81:35312) 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943a59c700 1 -- 172.21.15.81:0/57881868 learned_addr learned my addr 172.21.15.81:0/57881868 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943ad9d700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 0x7f943c0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f9439d9b700 1 --2- 172.21.15.81:0/57881868 >> v2:172.21.15.176:3300/0 conn(0x7f943c0d31b0 0x7f943c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582056864 0 0) 0x7f943c06a7f0 con 0x7f943c06ce60 2023-11-29T11:13:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94240035d0 con 0x7f943c06ce60 2023-11-29T11:13:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1022318516 0 0) 0x7f94240035d0 con 0x7f943c06ce60 2023-11-29T11:13:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 msgr2=0x7f943c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 0x7f943c0cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 >> v2:172.21.15.176:3300/0 conn(0x7f943c0d31b0 msgr2=0x7f943c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 --2- 172.21.15.81:0/57881868 >> v2:172.21.15.176:3300/0 conn(0x7f943c0d31b0 0x7f943c0cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c06aad0 con 0x7f943c06ce60 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f942c001670 con 0x7f943c06ce60 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943ad9d700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 0x7f943c0cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 >> v1:172.21.15.81:6789/0 conn(0x7f943c06ce60 legacy=0x7f943c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9424003a20 0x7f9424003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 0x7f9424004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 0x7f9424005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0d3650 con 0x7f9424003a20 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c15c8b0 con 0x7f9424004450 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.813+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942400ba30 con 0x7f943c0cf470 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943a59c700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9424003a20 0x7f9424003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f9439d9b700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 0x7f9424004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943ad9d700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 0x7f9424005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f9439d9b700 1 -- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 msgr2=0x7f9424005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f9439d9b700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c0cf470 0x7f9424005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f9439d9b700 1 -- 172.21.15.81:0/57881868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9424003a20 msgr2=0x7f9424003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f9439d9b700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9424003a20 0x7f9424003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f9439d9b700 1 -- 172.21.15.81:0/57881868 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434009a70 con 0x7f9424004450 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f9439d9b700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 0x7f9424004910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9430009b70 tx=0x7f94240058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=455eee74a177d8ee server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000e6c0 con 0x7f9424004450 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943000e820 con 0x7f9424004450 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943959a700 1 -- 172.21.15.81:0/57881868 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000eb90 con 0x7f9424004450 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943b59e700 1 -- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 msgr2=0x7f9424004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943b59e700 1 --2- 172.21.15.81:0/57881868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 0x7f9424004910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9430009b70 tx=0x7f94240058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943ad9d700 1 -- 172.21.15.81:0/57881868 reap_dead start 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943b59e700 1 -- 172.21.15.81:0/57881868 shutdown_connections 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943b59e700 1 -- 172.21.15.81:0/57881868 >> 172.21.15.81:0/57881868 conn(0x7f943c0b5760 msgr2=0x7f943c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943b59e700 1 -- 172.21.15.81:0/57881868 shutdown_connections 2023-11-29T11:13:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.817+0000 7f943b59e700 1 -- 172.21.15.81:0/57881868 wait complete. 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 Processor -- start 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 -- start start 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 0x7f943c0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c0c6300 0x7f943c0b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c1594e0 0x7f943c159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c151800 con 0x7f943c0c6300 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c159e90 con 0x7f9424004450 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c1e3a10 con 0x7f943c1594e0 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c0c6300 0x7f943c0b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c0c6300 0x7f943c0b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40374/0 (socket says 172.21.15.81:40374) 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 -- 172.21.15.81:0/2116900154 learned_addr learned my addr 172.21.15.81:0/2116900154 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943a59c700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 0x7f943c0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943ad9d700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c1594e0 0x7f943c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 -- 172.21.15.81:0/2116900154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c1594e0 msgr2=0x7f943c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c1594e0 0x7f943c159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 -- 172.21.15.81:0/2116900154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 msgr2=0x7f943c0c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 0x7f943c0c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 -- 172.21.15.81:0/2116900154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c06b090 con 0x7f943c0c6300 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f9439d9b700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c0c6300 0x7f943c0b3d30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f94300090b0 tx=0x7f94300047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f942affd700 1 -- 172.21.15.81:0/2116900154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430021070 con 0x7f943c0c6300 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f942affd700 1 -- 172.21.15.81:0/2116900154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94300044a0 con 0x7f943c0c6300 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c06adb0 con 0x7f943c0c6300 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f942affd700 1 -- 172.21.15.81:0/2116900154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000e6c0 con 0x7f943c0c6300 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.821+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0b6470 con 0x7f943c0c6300 2023-11-29T11:13:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.825+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c06a7f0 con 0x7f943c0c6300 2023-11-29T11:13:58.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.825+0000 7f942affd700 1 -- 172.21.15.81:0/2116900154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f943002e030 con 0x7f943c0c6300 2023-11-29T11:13:58.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.825+0000 7f942affd700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f941c064f10 0x7f941c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:58.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.825+0000 7f943a59c700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f941c064f10 0x7f941c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:58.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.825+0000 7f942affd700 1 -- 172.21.15.81:0/2116900154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f94300836d0 con 0x7f943c0c6300 2023-11-29T11:13:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.825+0000 7f943a59c700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f941c064f10 0x7f941c0673c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f942c001c90 tx=0x7f942c001b20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:58.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.833+0000 7f942affd700 1 -- 172.21.15.81:0/2116900154 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9430051450 con 0x7f943c0c6300 2023-11-29T11:13:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f943c072c20 con 0x7f943c0c6300 2023-11-29T11:13:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f942affd700 1 -- 172.21.15.81:0/2116900154 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9430054a70 con 0x7f943c0c6300 2023-11-29T11:13:58.994 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:13:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f941c064f10 msgr2=0x7f941c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f941c064f10 0x7f941c0673c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f942c001c90 tx=0x7f942c001b20 comp rx=0 tx=0).stop 2023-11-29T11:13:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c0c6300 msgr2=0x7f943c0b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c0c6300 0x7f943c0b3d30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f94300090b0 tx=0x7f94300047e0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 shutdown_connections 2023-11-29T11:13:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f941c064f10 0x7f941c0673c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f943c1594e0 0x7f943c159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c0c6300 0x7f943c0b3d30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 --2- 172.21.15.81:0/2116900154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9424004450 0x7f943c0c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 >> 172.21.15.81:0/2116900154 conn(0x7f943c0b5760 msgr2=0x7f943c15a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 shutdown_connections 2023-11-29T11:13:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:58.989+0000 7f943b59e700 1 -- 172.21.15.81:0/2116900154 wait complete. 2023-11-29T11:13:59.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:13:59.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.125+0000 7fd2a3fff700 1 Processor -- start 2023-11-29T11:13:59.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.125+0000 7fd2a3fff700 1 -- start start 2023-11-29T11:13:59.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 0x7fd2a40c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a406a4d0 con 0x7fd2a4158480 2023-11-29T11:13:59.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a3fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a40cc490 con 0x7fd2a40cd3a0 2023-11-29T11:13:59.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a406a720 con 0x7fd2a4158850 2023-11-29T11:13:59.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd2a4158480 0x7fd2a40cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35320/0 (socket says 172.21.15.81:35320) 2023-11-29T11:13:59.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a2ffd700 1 -- 172.21.15.81:0/4230624547 learned_addr learned my addr 172.21.15.81:0/4230624547 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 0x7fd2a40c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775884515 0 0) 0x7fd2a406a4d0 con 0x7fd2a4158480 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2900046e0 con 0x7fd2a4158480 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2330252685 0 0) 0x7fd2900046e0 con 0x7fd2a4158480 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 msgr2=0x7fd2a40c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 0x7fd2a40c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 >> v1:172.21.15.176:6789/0 conn(0x7fd2a40cd3a0 legacy=0x7fd2a40ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a406aa00 con 0x7fd2a4158480 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fd29c001b70 con 0x7fd2a4158480 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 0x7fd2a40c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 >> v1:172.21.15.81:6789/0 conn(0x7fd2a4158480 legacy=0x7fd2a40cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 0x7fd290004b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290005150 0x7fd290005980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd290005ec0 0x7fd290006330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a406a720 con 0x7fd290005150 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29000cc50 con 0x7fd290005ec0 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29000ce10 con 0x7fd2a4158850 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290005150 0x7fd290005980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a2ffd700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 0x7fd290004b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a37fe700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd290005ec0 0x7fd290006330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a27fc700 1 -- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 msgr2=0x7fd290004b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 0x7fd290004b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a27fc700 1 -- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd290005ec0 msgr2=0x7fd290006330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd290005ec0 0x7fd290006330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a27fc700 1 -- 172.21.15.81:0/4230624547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2900046e0 con 0x7fd290005150 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a2ffd700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a4158850 0x7fd290004b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.129+0000 7fd2a37fe700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd290005ec0 0x7fd290006330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290005150 0x7fd290005980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd294009930 tx=0x7fd2900069b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280e221e4f8be30e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29400c070 con 0x7fd290005150 2023-11-29T11:13:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd294004230 con 0x7fd290005150 2023-11-29T11:13:59.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a1ffb700 1 -- 172.21.15.81:0/4230624547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294009540 con 0x7fd290005150 2023-11-29T11:13:59.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- 172.21.15.81:0/4230624547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290005150 msgr2=0x7fd290005980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 --2- 172.21.15.81:0/4230624547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd290005150 0x7fd290005980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd294009930 tx=0x7fd2900069b0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a37fe700 1 -- 172.21.15.81:0/4230624547 reap_dead start 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- 172.21.15.81:0/4230624547 shutdown_connections 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- 172.21.15.81:0/4230624547 >> 172.21.15.81:0/4230624547 conn(0x7fd2a406c660 msgr2=0x7fd2a406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- 172.21.15.81:0/4230624547 shutdown_connections 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- 172.21.15.81:0/4230624547 wait complete. 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 Processor -- start 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- start start 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd290005150 0x7fd2a40c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2a414fcd0 0x7fd2a4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a4153060 0x7fd2a414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40c20f0 con 0x7fd2a414fcd0 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a41534d0 con 0x7fd2a4153060 2023-11-29T11:13:59.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a414ec30 con 0x7fd290005150 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2a414fcd0 0x7fd2a4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2a414fcd0 0x7fd2a4152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40390/0 (socket says 172.21.15.81:40390) 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a27fc700 1 -- 172.21.15.81:0/1359172976 learned_addr learned my addr 172.21.15.81:0/1359172976 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a2ffd700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd290005150 0x7fd2a40c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.133+0000 7fd2a37fe700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a4153060 0x7fd2a414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd2a27fc700 1 -- 172.21.15.81:0/1359172976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd290005150 msgr2=0x7fd2a40c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd290005150 0x7fd2a40c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd2a27fc700 1 -- 172.21.15.81:0/1359172976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a4153060 msgr2=0x7fd2a414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a4153060 0x7fd2a414dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd2a27fc700 1 -- 172.21.15.81:0/1359172976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a40cf3b0 con 0x7fd2a414fcd0 2023-11-29T11:13:59.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd2a27fc700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2a414fcd0 0x7fd2a4152b20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd294009f20 tx=0x7fd2940047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd29b7fe700 1 -- 172.21.15.81:0/1359172976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294009540 con 0x7fd2a414fcd0 2023-11-29T11:13:59.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd29b7fe700 1 -- 172.21.15.81:0/1359172976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd294021070 con 0x7fd2a414fcd0 2023-11-29T11:13:59.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a406ace0 con 0x7fd2a414fcd0 2023-11-29T11:13:59.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd29b7fe700 1 -- 172.21.15.81:0/1359172976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294003dd0 con 0x7fd2a414fcd0 2023-11-29T11:13:59.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.137+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a40cf540 con 0x7fd2a414fcd0 2023-11-29T11:13:59.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.141+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a4072c20 con 0x7fd2a414fcd0 2023-11-29T11:13:59.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.141+0000 7fd29b7fe700 1 -- 172.21.15.81:0/1359172976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd29402c020 con 0x7fd2a414fcd0 2023-11-29T11:13:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.141+0000 7fd29b7fe700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd284064f10 0x7fd2840673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.141+0000 7fd29b7fe700 1 -- 172.21.15.81:0/1359172976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd294083540 con 0x7fd2a414fcd0 2023-11-29T11:13:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.141+0000 7fd2a2ffd700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd284064f10 0x7fd2840673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.141+0000 7fd2a2ffd700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd284064f10 0x7fd2840673c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd29c001620 tx=0x7fd29c0013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.149+0000 7fd29b7fe700 1 -- 172.21.15.81:0/1359172976 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd294051330 con 0x7fd2a414fcd0 2023-11-29T11:13:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.309+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2a4071400 con 0x7fd2a414fcd0 2023-11-29T11:13:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd29b7fe700 1 -- 172.21.15.81:0/1359172976 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd294054950 con 0x7fd2a414fcd0 2023-11-29T11:13:59.317 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:13:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd284064f10 msgr2=0x7fd2840673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd284064f10 0x7fd2840673c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd29c001620 tx=0x7fd29c0013a0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2a414fcd0 msgr2=0x7fd2a4152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2a414fcd0 0x7fd2a4152b20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd294009f20 tx=0x7fd2940047e0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 shutdown_connections 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd284064f10 0x7fd2840673c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a4153060 0x7fd2a414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2a414fcd0 0x7fd2a4152b20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 --2- 172.21.15.81:0/1359172976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd290005150 0x7fd2a40c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 >> 172.21.15.81:0/1359172976 conn(0x7fd2a406c660 msgr2=0x7fd2a4155000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 shutdown_connections 2023-11-29T11:13:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.313+0000 7fd2a3fff700 1 -- 172.21.15.81:0/1359172976 wait complete. 2023-11-29T11:13:59.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:13:59.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.445+0000 7f9c9cf90700 1 Processor -- start 2023-11-29T11:13:59.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.445+0000 7f9c9cf90700 1 -- start start 2023-11-29T11:13:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.445+0000 7f9c9cf90700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c980b1ae0 0x7f9c9806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.445+0000 7f9c9cf90700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9806a9c0 con 0x7f9c980cf0e0 2023-11-29T11:13:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c9cf90700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9806aca0 con 0x7f9c9806a4c0 2023-11-29T11:13:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c9cf90700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980d0ab0 con 0x7f9c980b1ae0 2023-11-29T11:13:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c97fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9c980cf0e0 0x7f9c980b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35324/0 (socket says 172.21.15.81:35324) 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c97fff700 1 -- 172.21.15.81:0/292207516 learned_addr learned my addr 172.21.15.81:0/292207516 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c977fe700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c980b1ae0 0x7f9c9806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967634238 0 0) 0x7f9c9806a9c0 con 0x7f9c980cf0e0 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c840035d0 con 0x7f9c980cf0e0 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541943185 0 0) 0x7f9c9806aca0 con 0x7f9c9806a4c0 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c9806a9c0 con 0x7f9c9806a4c0 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830094534 0 0) 0x7f9c840035d0 con 0x7f9c980cf0e0 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c980b1ae0 msgr2=0x7f9c9806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c980b1ae0 0x7f9c9806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 >> v1:172.21.15.176:6789/0 conn(0x7f9c9806a4c0 legacy=0x7f9c980d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9806af80 con 0x7f9c980cf0e0 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f9c900019f0 con 0x7f9c980cf0e0 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 >> v1:172.21.15.81:6789/0 conn(0x7f9c980cf0e0 legacy=0x7f9c980b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c84003be0 0x7f9c84003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c84004870 0x7f9c84004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c980b1ae0 0x7f9c84005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980d0ab0 con 0x7f9c84003be0 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8400bae0 con 0x7f9c84004870 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8400bc50 con 0x7f9c980b1ae0 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c977fe700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c84003be0 0x7f9c84003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c96ffd700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c84004870 0x7f9c84004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c97fff700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c980b1ae0 0x7f9c84005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c977fe700 1 -- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c980b1ae0 msgr2=0x7f9c84005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c977fe700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c980b1ae0 0x7f9c84005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c977fe700 1 -- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c84004870 msgr2=0x7f9c84004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c977fe700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c84004870 0x7f9c84004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c977fe700 1 -- 172.21.15.81:0/292207516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840035d0 con 0x7f9c84003be0 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c977fe700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c84003be0 0x7f9c84003fd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009b70 tx=0x7f9c840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe628d6df6e002de server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000e6c0 con 0x7f9c84003be0 2023-11-29T11:13:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8000e820 con 0x7f9c84003be0 2023-11-29T11:13:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c967fc700 1 -- 172.21.15.81:0/292207516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000eb90 con 0x7f9c84003be0 2023-11-29T11:13:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c9cf90700 1 -- 172.21.15.81:0/292207516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c84003be0 msgr2=0x7f9c84003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c9cf90700 1 --2- 172.21.15.81:0/292207516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c84003be0 0x7f9c84003fd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009b70 tx=0x7f9c840058a0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c97fff700 1 -- 172.21.15.81:0/292207516 reap_dead start 2023-11-29T11:13:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c9cf90700 1 -- 172.21.15.81:0/292207516 shutdown_connections 2023-11-29T11:13:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.449+0000 7f9c9cf90700 1 -- 172.21.15.81:0/292207516 >> 172.21.15.81:0/292207516 conn(0x7f9c9809bbd0 msgr2=0x7f9c980b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.453+0000 7f9c9cf90700 1 -- 172.21.15.81:0/292207516 shutdown_connections 2023-11-29T11:13:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.453+0000 7f9c9cf90700 1 -- 172.21.15.81:0/292207516 wait complete. 2023-11-29T11:13:59.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.453+0000 7f9c9cf90700 1 Processor -- start 2023-11-29T11:13:59.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.453+0000 7f9c9cf90700 1 -- start start 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c9cf90700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9814f3e0 0x7f9c9815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c9cf90700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c980c6130 0x7f9c98152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c9cf90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9814f7b0 0x7f9c9815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c9cf90700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98155910 con 0x7f9c9814f7b0 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c9cf90700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9815d8d0 con 0x7f9c980c6130 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c9cf90700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980c65c0 con 0x7f9c9814f3e0 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c977fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9814f3e0 0x7f9c9815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9814f7b0 0x7f9c9815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c96ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c980c6130 0x7f9c98152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c977fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9814f3e0 0x7f9c9815d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:59264/0 (socket says 172.21.15.81:59264) 2023-11-29T11:13:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c977fe700 1 -- 172.21.15.81:0/3643239983 learned_addr learned my addr 172.21.15.81:0/3643239983 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c97fff700 1 -- 172.21.15.81:0/3643239983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9814f3e0 msgr2=0x7f9c9815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c97fff700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9814f3e0 0x7f9c9815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c97fff700 1 -- 172.21.15.81:0/3643239983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c980c6130 msgr2=0x7f9c98152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c97fff700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c980c6130 0x7f9c98152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c97fff700 1 -- 172.21.15.81:0/3643239983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980b1eb0 con 0x7f9c9814f7b0 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c977fe700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9814f3e0 0x7f9c9815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c96ffd700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c980c6130 0x7f9c98152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c97fff700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9814f7b0 0x7f9c9815aa30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9c9808b820 tx=0x7f9c90007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c8ffff700 1 -- 172.21.15.81:0/3643239983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000e830 con 0x7f9c9814f7b0 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c8ffff700 1 -- 172.21.15.81:0/3643239983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9000e9b0 con 0x7f9c9814f7b0 2023-11-29T11:13:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c980b4380 con 0x7f9c9814f7b0 2023-11-29T11:13:59.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c8ffff700 1 -- 172.21.15.81:0/3643239983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000ed60 con 0x7f9c9814f7b0 2023-11-29T11:13:59.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.457+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c980b60e0 con 0x7f9c9814f7b0 2023-11-29T11:13:59.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.461+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c98072500 con 0x7f9c9814f7b0 2023-11-29T11:13:59.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.461+0000 7f9c8ffff700 1 -- 172.21.15.81:0/3643239983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9c9001d460 con 0x7f9c9814f7b0 2023-11-29T11:13:59.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.461+0000 7f9c8ffff700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c78064ee0 0x7f9c78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.461+0000 7f9c8ffff700 1 -- 172.21.15.81:0/3643239983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9c900824d0 con 0x7f9c9814f7b0 2023-11-29T11:13:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.461+0000 7f9c977fe700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c78064ee0 0x7f9c78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.461+0000 7f9c977fe700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c78064ee0 0x7f9c78067390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9c80000c00 tx=0x7f9c8001f040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.469+0000 7f9c8ffff700 1 -- 172.21.15.81:0/3643239983 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9c900501f0 con 0x7f9c9814f7b0 2023-11-29T11:13:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.629+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c980ce8f0 con 0x7f9c9814f7b0 2023-11-29T11:13:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.629+0000 7f9c8ffff700 1 -- 172.21.15.81:0/3643239983 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c90053810 con 0x7f9c9814f7b0 2023-11-29T11:13:59.636 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:13:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c78064ee0 msgr2=0x7f9c78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c78064ee0 0x7f9c78067390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9c80000c00 tx=0x7f9c8001f040 comp rx=0 tx=0).stop 2023-11-29T11:13:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9814f7b0 msgr2=0x7f9c9815aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9814f7b0 0x7f9c9815aa30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9c9808b820 tx=0x7f9c90007cb0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 shutdown_connections 2023-11-29T11:13:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c78064ee0 0x7f9c78067390 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9814f7b0 0x7f9c9815aa30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c980c6130 0x7f9c98152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 --2- 172.21.15.81:0/3643239983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9814f3e0 0x7f9c9815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 >> 172.21.15.81:0/3643239983 conn(0x7f9c9809bbd0 msgr2=0x7f9c980d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 shutdown_connections 2023-11-29T11:13:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.633+0000 7f9c9cf90700 1 -- 172.21.15.81:0/3643239983 wait complete. 2023-11-29T11:13:59.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:13:59.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.765+0000 7fc08942c700 1 Processor -- start 2023-11-29T11:13:59.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.765+0000 7fc08942c700 1 -- start start 2023-11-29T11:13:59.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.765+0000 7fc08942c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0840b00e0 0x7fc08415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.765+0000 7fc08942c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0840cbb30 0x7fc08406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.765+0000 7fc08942c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0840b2db0 con 0x7fc08409bdb0 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.765+0000 7fc08942c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0840b3240 con 0x7fc0840cbb30 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.765+0000 7fc08942c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08406d840 con 0x7fc0840b00e0 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.765+0000 7fc088c2b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0840cbb30 0x7fc08406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc088c2b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0840cbb30 0x7fc08406bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58938/0 (socket says 172.21.15.81:58938) 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc0837fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc08409bdb0 0x7fc08415d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39014/0 (socket says 172.21.15.81:39014) 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc088c2b700 1 -- 172.21.15.81:0/980083209 learned_addr learned my addr 172.21.15.81:0/980083209 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc083fff700 1 --2- 172.21.15.81:0/980083209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0840b00e0 0x7fc08415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc088c2b700 1 -- 172.21.15.81:0/980083209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0840b00e0 msgr2=0x7fc08415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc088c2b700 1 --2- 172.21.15.81:0/980083209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0840b00e0 0x7fc08415d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc088c2b700 1 -- 172.21.15.81:0/980083209 >> v1:172.21.15.81:6789/0 conn(0x7fc08409bdb0 legacy=0x7fc08415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc088c2b700 1 -- 172.21.15.81:0/980083209 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08406d560 con 0x7fc0840cbb30 2023-11-29T11:13:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc083fff700 1 --2- 172.21.15.81:0/980083209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0840b00e0 0x7fc08415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:13:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc088c2b700 1 --2- 172.21.15.81:0/980083209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840cbb30 0x7fc08406bbd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009e50 tx=0x7fc07c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c74c57fbadc58a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc082ffd700 1 -- 172.21.15.81:0/980083209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00e070 con 0x7fc0840cbb30 2023-11-29T11:13:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc082ffd700 1 -- 172.21.15.81:0/980083209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c00b9c0 con 0x7fc0840cbb30 2023-11-29T11:13:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc082ffd700 1 -- 172.21.15.81:0/980083209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00bd70 con 0x7fc0840cbb30 2023-11-29T11:13:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 -- 172.21.15.81:0/980083209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840cbb30 msgr2=0x7fc08406bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 --2- 172.21.15.81:0/980083209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840cbb30 0x7fc08406bbd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009e50 tx=0x7fc07c00b330 comp rx=0 tx=0).stop 2023-11-29T11:13:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 -- 172.21.15.81:0/980083209 shutdown_connections 2023-11-29T11:13:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 --2- 172.21.15.81:0/980083209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840cbb30 0x7fc08406bbd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 --2- 172.21.15.81:0/980083209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0840b00e0 0x7fc08415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 -- 172.21.15.81:0/980083209 >> 172.21.15.81:0/980083209 conn(0x7fc0840cae70 msgr2=0x7fc0840cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 -- 172.21.15.81:0/980083209 shutdown_connections 2023-11-29T11:13:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 -- 172.21.15.81:0/980083209 wait complete. 2023-11-29T11:13:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 Processor -- start 2023-11-29T11:13:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.769+0000 7fc08942c700 1 -- start start 2023-11-29T11:13:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08409bdb0 0x7fc084158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840b00e0 0x7fc08414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0840cbb30 0x7fc08415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc084157700 con 0x7fc0840b00e0 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841579e0 con 0x7fc0840cbb30 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc084157cc0 con 0x7fc08409bdb0 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840b00e0 0x7fc08414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840b00e0 0x7fc08414c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58946/0 (socket says 172.21.15.81:58946) 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 -- 172.21.15.81:0/2965149124 learned_addr learned my addr 172.21.15.81:0/2965149124 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc083fff700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08409bdb0 0x7fc084158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc088c2b700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0840cbb30 0x7fc08415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 -- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08409bdb0 msgr2=0x7fc084158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08409bdb0 0x7fc084158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 -- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0840cbb30 msgr2=0x7fc08415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0840cbb30 0x7fc08415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 -- 172.21.15.81:0/2965149124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c009b30 con 0x7fc0840b00e0 2023-11-29T11:13:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc083fff700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08409bdb0 0x7fc084158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc088c2b700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0840cbb30 0x7fc08415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:13:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc0837fe700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840b00e0 0x7fc08414c800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc07800c460 tx=0x7fc07800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc080ff9700 1 -- 172.21.15.81:0/2965149124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078005cd0 con 0x7fc0840b00e0 2023-11-29T11:13:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc080ff9700 1 -- 172.21.15.81:0/2965149124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078005e30 con 0x7fc0840b00e0 2023-11-29T11:13:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0840ac3d0 con 0x7fc0840b00e0 2023-11-29T11:13:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc080ff9700 1 -- 172.21.15.81:0/2965149124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780072d0 con 0x7fc0840b00e0 2023-11-29T11:13:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0840ac0f0 con 0x7fc0840b00e0 2023-11-29T11:13:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.773+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0840cc9f0 con 0x7fc0840b00e0 2023-11-29T11:13:59.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.777+0000 7fc080ff9700 1 -- 172.21.15.81:0/2965149124 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc078019030 con 0x7fc0840b00e0 2023-11-29T11:13:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.777+0000 7fc080ff9700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc070064ee0 0x7fc070067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:13:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.777+0000 7fc083fff700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc070064ee0 0x7fc070067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:13:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.777+0000 7fc080ff9700 1 -- 172.21.15.81:0/2965149124 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc078081490 con 0x7fc0840b00e0 2023-11-29T11:13:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.777+0000 7fc083fff700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc070064ee0 0x7fc070067390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc074006fd0 tx=0x7fc074008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:13:59.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.785+0000 7fc080ff9700 1 -- 172.21.15.81:0/2965149124 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc07804a400 con 0x7fc0840b00e0 2023-11-29T11:13:59.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.945+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0840b1bc0 con 0x7fc0840b00e0 2023-11-29T11:13:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc080ff9700 1 -- 172.21.15.81:0/2965149124 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc078017020 con 0x7fc0840b00e0 2023-11-29T11:13:59.953 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:13:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc070064ee0 msgr2=0x7fc070067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc070064ee0 0x7fc070067390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc074006fd0 tx=0x7fc074008040 comp rx=0 tx=0).stop 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840b00e0 msgr2=0x7fc08414c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840b00e0 0x7fc08414c800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc07800c460 tx=0x7fc07800c820 comp rx=0 tx=0).stop 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 shutdown_connections 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc070064ee0 0x7fc070067390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0840cbb30 0x7fc08415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0840b00e0 0x7fc08414c800 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 --2- 172.21.15.81:0/2965149124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc08409bdb0 0x7fc084158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 >> 172.21.15.81:0/2965149124 conn(0x7fc0840cae70 msgr2=0x7fc084069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 shutdown_connections 2023-11-29T11:13:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:13:59.949+0000 7fc08942c700 1 -- 172.21.15.81:0/2965149124 wait complete. 2023-11-29T11:13:59.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:14:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813ffff700 1 Processor -- start 2023-11-29T11:14:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813ffff700 1 -- start start 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81400b1ae0 0x7f814006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f814006a4c0 0x7f81400d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81400cf0e0 0x7f81400cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400cfa80 con 0x7f81400b1ae0 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814006a9c0 con 0x7f81400cf0e0 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814006aca0 con 0x7f814006a4c0 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81400b1ae0 0x7f814006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81400b1ae0 0x7f814006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58948/0 (socket says 172.21.15.81:58948) 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.077+0000 7f813effd700 1 -- 172.21.15.81:0/630143058 learned_addr learned my addr 172.21.15.81:0/630143058 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813f7fe700 1 --2- 172.21.15.81:0/630143058 >> v2:172.21.15.176:3300/0 conn(0x7f81400cf0e0 0x7f81400cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813e7fc700 1 --2- 172.21.15.81:0/630143058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f814006a4c0 0x7f81400d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813effd700 1 -- 172.21.15.81:0/630143058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f814006a4c0 msgr2=0x7f81400d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813effd700 1 --2- 172.21.15.81:0/630143058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f814006a4c0 0x7f81400d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813effd700 1 -- 172.21.15.81:0/630143058 >> v2:172.21.15.176:3300/0 conn(0x7f81400cf0e0 msgr2=0x7f81400cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813effd700 1 --2- 172.21.15.81:0/630143058 >> v2:172.21.15.176:3300/0 conn(0x7f81400cf0e0 0x7f81400cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813effd700 1 -- 172.21.15.81:0/630143058 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814006af80 con 0x7f81400b1ae0 2023-11-29T11:14:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813effd700 1 --2- 172.21.15.81:0/630143058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400b1ae0 0x7f814006d8e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f814008bbc0 tx=0x7f8134009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6fdfe5c1ecde1d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813dffb700 1 -- 172.21.15.81:0/630143058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134011830 con 0x7f81400b1ae0 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813dffb700 1 -- 172.21.15.81:0/630143058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8134011990 con 0x7f81400b1ae0 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813dffb700 1 -- 172.21.15.81:0/630143058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134011d20 con 0x7f81400b1ae0 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 -- 172.21.15.81:0/630143058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400b1ae0 msgr2=0x7f814006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 --2- 172.21.15.81:0/630143058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400b1ae0 0x7f814006d8e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f814008bbc0 tx=0x7f8134009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 -- 172.21.15.81:0/630143058 shutdown_connections 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 --2- 172.21.15.81:0/630143058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f814006a4c0 0x7f81400d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 --2- 172.21.15.81:0/630143058 >> v2:172.21.15.176:3300/0 conn(0x7f81400cf0e0 0x7f81400cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 --2- 172.21.15.81:0/630143058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81400b1ae0 0x7f814006d8e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 -- 172.21.15.81:0/630143058 >> 172.21.15.81:0/630143058 conn(0x7f814009bbd0 msgr2=0x7f81400b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 -- 172.21.15.81:0/630143058 shutdown_connections 2023-11-29T11:14:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 -- 172.21.15.81:0/630143058 wait complete. 2023-11-29T11:14:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.081+0000 7f813ffff700 1 Processor -- start 2023-11-29T11:14:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 -- start start 2023-11-29T11:14:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814006a4c0 0x7f814015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81400b1ae0 0x7f814014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81400cf0e0 0x7f814014afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814014a7e0 con 0x7f814006a4c0 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814014c1f0 con 0x7f81400b1ae0 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814014b5e0 con 0x7f81400cf0e0 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814006a4c0 0x7f814015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814006a4c0 0x7f814015ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58962/0 (socket says 172.21.15.81:58962) 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 -- 172.21.15.81:0/1842203532 learned_addr learned my addr 172.21.15.81:0/1842203532 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813f7fe700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81400cf0e0 0x7f814014afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 -- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81400cf0e0 msgr2=0x7f814014afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81400cf0e0 0x7f814014afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813e7fc700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81400b1ae0 0x7f814014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 -- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81400b1ae0 msgr2=0x7f814014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81400b1ae0 0x7f814014aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 -- 172.21.15.81:0/1842203532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134009570 con 0x7f814006a4c0 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813f7fe700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81400cf0e0 0x7f814014afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813e7fc700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81400b1ae0 0x7f814014aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813effd700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814006a4c0 0x7f814015ef80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8134009860 tx=0x7f8134004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f81277fe700 1 -- 172.21.15.81:0/1842203532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134011d80 con 0x7f814006a4c0 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f81277fe700 1 -- 172.21.15.81:0/1842203532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8134004040 con 0x7f814006a4c0 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81400b1eb0 con 0x7f814006a4c0 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f81277fe700 1 -- 172.21.15.81:0/1842203532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340043f0 con 0x7f814006a4c0 2023-11-29T11:14:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.085+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81400b4380 con 0x7f814006a4c0 2023-11-29T11:14:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.089+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81400b60e0 con 0x7f814006a4c0 2023-11-29T11:14:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.089+0000 7f81277fe700 1 -- 172.21.15.81:0/1842203532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8134033030 con 0x7f814006a4c0 2023-11-29T11:14:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.089+0000 7f81277fe700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f812c064ee0 0x7f812c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.089+0000 7f81277fe700 1 -- 172.21.15.81:0/1842203532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f813408b770 con 0x7f814006a4c0 2023-11-29T11:14:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.089+0000 7f813e7fc700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f812c064ee0 0x7f812c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.089+0000 7f813e7fc700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f812c064ee0 0x7f812c067390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81400b5a20 tx=0x7f8130008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.097+0000 7f81277fe700 1 -- 172.21.15.81:0/1842203532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8134059560 con 0x7f814006a4c0 2023-11-29T11:14:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.261+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8140072500 con 0x7f814006a4c0 2023-11-29T11:14:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.261+0000 7f81277fe700 1 -- 172.21.15.81:0/1842203532 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8134015020 con 0x7f814006a4c0 2023-11-29T11:14:00.267 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f812c064ee0 msgr2=0x7f812c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f812c064ee0 0x7f812c067390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81400b5a20 tx=0x7f8130008040 comp rx=0 tx=0).stop 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814006a4c0 msgr2=0x7f814015ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814006a4c0 0x7f814015ef80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8134009860 tx=0x7f8134004770 comp rx=0 tx=0).stop 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 shutdown_connections 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f812c064ee0 0x7f812c067390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81400cf0e0 0x7f814014afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81400b1ae0 0x7f814014aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 --2- 172.21.15.81:0/1842203532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814006a4c0 0x7f814015ef80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 >> 172.21.15.81:0/1842203532 conn(0x7f814009bbd0 msgr2=0x7f814015bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 shutdown_connections 2023-11-29T11:14:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.265+0000 7f813ffff700 1 -- 172.21.15.81:0/1842203532 wait complete. 2023-11-29T11:14:00.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:14:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.385+0000 7fbc45997700 1 Processor -- start 2023-11-29T11:14:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.385+0000 7fbc45997700 1 -- start start 2023-11-29T11:14:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc45997700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbc401510d0 0x7fbc4015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc45997700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc40069c40 0x7fbc400b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc45997700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc400c98a0 0x7fbc400c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc45997700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc400c95d0 con 0x7fbc40069c40 2023-11-29T11:14:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc45997700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc400c8e00 con 0x7fbc401510d0 2023-11-29T11:14:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc45997700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400ca240 con 0x7fbc400c98a0 2023-11-29T11:14:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc40069c40 0x7fbc400b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc40069c40 0x7fbc400b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58970/0 (socket says 172.21.15.81:58970) 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 -- 172.21.15.81:0/2682639222 learned_addr learned my addr 172.21.15.81:0/2682639222 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3effd700 1 --2- 172.21.15.81:0/2682639222 >> v2:172.21.15.176:3300/0 conn(0x7fbc401510d0 0x7fbc4015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3f7fe700 1 --2- 172.21.15.81:0/2682639222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc400c98a0 0x7fbc400c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 -- 172.21.15.81:0/2682639222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc400c98a0 msgr2=0x7fbc400c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 --2- 172.21.15.81:0/2682639222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc400c98a0 0x7fbc400c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 -- 172.21.15.81:0/2682639222 >> v2:172.21.15.176:3300/0 conn(0x7fbc401510d0 msgr2=0x7fbc4015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 --2- 172.21.15.81:0/2682639222 >> v2:172.21.15.176:3300/0 conn(0x7fbc401510d0 0x7fbc4015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 -- 172.21.15.81:0/2682639222 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400b1170 con 0x7fbc40069c40 2023-11-29T11:14:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3e7fc700 1 --2- 172.21.15.81:0/2682639222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc40069c40 0x7fbc400b0c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbc400cf8b0 tx=0x7fbc30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47eb7ceb4affad4c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.389+0000 7fbc3dffb700 1 -- 172.21.15.81:0/2682639222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3000ba20 con 0x7fbc40069c40 2023-11-29T11:14:00.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc3dffb700 1 -- 172.21.15.81:0/2682639222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3000bb80 con 0x7fbc40069c40 2023-11-29T11:14:00.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc3dffb700 1 -- 172.21.15.81:0/2682639222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30009e60 con 0x7fbc40069c40 2023-11-29T11:14:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 -- 172.21.15.81:0/2682639222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc40069c40 msgr2=0x7fbc400b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 --2- 172.21.15.81:0/2682639222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc40069c40 0x7fbc400b0c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbc400cf8b0 tx=0x7fbc30009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 -- 172.21.15.81:0/2682639222 shutdown_connections 2023-11-29T11:14:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 --2- 172.21.15.81:0/2682639222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc400c98a0 0x7fbc400c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 --2- 172.21.15.81:0/2682639222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc40069c40 0x7fbc400b0c30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 --2- 172.21.15.81:0/2682639222 >> v2:172.21.15.176:3300/0 conn(0x7fbc401510d0 0x7fbc4015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 -- 172.21.15.81:0/2682639222 >> 172.21.15.81:0/2682639222 conn(0x7fbc4006caf0 msgr2=0x7fbc400ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:00.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 -- 172.21.15.81:0/2682639222 shutdown_connections 2023-11-29T11:14:00.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 -- 172.21.15.81:0/2682639222 wait complete. 2023-11-29T11:14:00.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 Processor -- start 2023-11-29T11:14:00.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.393+0000 7fbc45997700 1 -- start start 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc400c98a0 0x7fbc4014dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc401510d0 0x7fbc400c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc400c8960 0x7fbc4006a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401f1710 con 0x7fbc400c8960 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401f0a90 con 0x7fbc400c98a0 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401f0d70 con 0x7fbc401510d0 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc400c8960 0x7fbc4006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc400c8960 0x7fbc4006a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58984/0 (socket says 172.21.15.81:58984) 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 -- 172.21.15.81:0/822713909 learned_addr learned my addr 172.21.15.81:0/822713909 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3effd700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc400c98a0 0x7fbc4014dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3e7fc700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc401510d0 0x7fbc400c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 -- 172.21.15.81:0/822713909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc401510d0 msgr2=0x7fbc400c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc401510d0 0x7fbc400c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 -- 172.21.15.81:0/822713909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc400c98a0 msgr2=0x7fbc4014dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc400c98a0 0x7fbc4014dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 -- 172.21.15.81:0/822713909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30009570 con 0x7fbc400c8960 2023-11-29T11:14:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3f7fe700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc400c8960 0x7fbc4006a010 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbc38007e60 tx=0x7fbc3800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc27fff700 1 -- 172.21.15.81:0/822713909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800ede0 con 0x7fbc400c8960 2023-11-29T11:14:00.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc400c92f0 con 0x7fbc400c8960 2023-11-29T11:14:00.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc27fff700 1 -- 172.21.15.81:0/822713909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38014420 con 0x7fbc400c8960 2023-11-29T11:14:00.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc27fff700 1 -- 172.21.15.81:0/822713909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380147d0 con 0x7fbc400c8960 2023-11-29T11:14:00.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc400c9010 con 0x7fbc400c8960 2023-11-29T11:14:00.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc40070170 con 0x7fbc400c8960 2023-11-29T11:14:00.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc27fff700 1 -- 172.21.15.81:0/822713909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc38012050 con 0x7fbc400c8960 2023-11-29T11:14:00.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc27fff700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbc2c064ee0 0x7fbc2c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc27fff700 1 -- 172.21.15.81:0/822713909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc38082810 con 0x7fbc400c8960 2023-11-29T11:14:00.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.397+0000 7fbc3effd700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbc2c064ee0 0x7fbc2c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.401+0000 7fbc3effd700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbc2c064ee0 0x7fbc2c067390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400b9d0 tx=0x7fbc34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.401+0000 7fbc27fff700 1 -- 172.21.15.81:0/822713909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbc38050600 con 0x7fbc400c8960 2023-11-29T11:14:00.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.573+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc40072500 con 0x7fbc400c8960 2023-11-29T11:14:00.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.573+0000 7fbc27fff700 1 -- 172.21.15.81:0/822713909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc38053c20 con 0x7fbc400c8960 2023-11-29T11:14:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbc2c064ee0 msgr2=0x7fbc2c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbc2c064ee0 0x7fbc2c067390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400b9d0 tx=0x7fbc34008040 comp rx=0 tx=0).stop 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc400c8960 msgr2=0x7fbc4006a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc400c8960 0x7fbc4006a010 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbc38007e60 tx=0x7fbc3800e3c0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 shutdown_connections 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbc2c064ee0 0x7fbc2c067390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc400c8960 0x7fbc4006a010 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc401510d0 0x7fbc400c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 --2- 172.21.15.81:0/822713909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc400c98a0 0x7fbc4014dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 >> 172.21.15.81:0/822713909 conn(0x7fbc4006caf0 msgr2=0x7fbc400b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 shutdown_connections 2023-11-29T11:14:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.577+0000 7fbc45997700 1 -- 172.21.15.81:0/822713909 wait complete. 2023-11-29T11:14:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:14:00.594 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi176.front.sepia.ceph.com... 2023-11-29T11:14:00.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:00.594 DEBUG:teuthology.orchestra.run.smithi176:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-29T11:14:00.611 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:14:00.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:14:00.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:00.611 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-29T11:14:00.662 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-29T11:14:00.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:00.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.777+0000 7fe584adc700 1 Processor -- start 2023-11-29T11:14:00.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.777+0000 7fe584adc700 1 -- start start 2023-11-29T11:14:00.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.777+0000 7fe584adc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe580158e60 0x7fe5800c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.777+0000 7fe584adc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 0x7fe5800cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.777+0000 7fe584adc700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800cd8f0 con 0x7fe5800ad490 2023-11-29T11:14:00.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.777+0000 7fe584adc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5800add00 con 0x7fe580158e60 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.777+0000 7fe584adc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800cc4f0 con 0x7fe5800cb460 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.777+0000 7fe57f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe580158e60 0x7fe5800c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe580158e60 0x7fe5800c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59000/0 (socket says 172.21.15.81:59000) 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57f7fe700 1 -- 172.21.15.81:0/254540931 learned_addr learned my addr 172.21.15.81:0/254540931 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57ffff700 1 --2- 172.21.15.81:0/254540931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 0x7fe5800cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57f7fe700 1 -- 172.21.15.81:0/254540931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 msgr2=0x7fe5800cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57f7fe700 1 --2- 172.21.15.81:0/254540931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 0x7fe5800cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57f7fe700 1 -- 172.21.15.81:0/254540931 >> v1:172.21.15.176:6789/0 conn(0x7fe5800ad490 legacy=0x7fe5800cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57f7fe700 1 -- 172.21.15.81:0/254540931 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58006dc60 con 0x7fe580158e60 2023-11-29T11:14:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57f7fe700 1 --2- 172.21.15.81:0/254540931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c8a30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe570009910 tx=0x7fe570009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffde5d22c008f69 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57effd700 1 -- 172.21.15.81:0/254540931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57000ba60 con 0x7fe580158e60 2023-11-29T11:14:00.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57effd700 1 -- 172.21.15.81:0/254540931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57000bbc0 con 0x7fe580158e60 2023-11-29T11:14:00.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe57effd700 1 -- 172.21.15.81:0/254540931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570009e60 con 0x7fe580158e60 2023-11-29T11:14:00.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 -- 172.21.15.81:0/254540931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 msgr2=0x7fe5800c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 --2- 172.21.15.81:0/254540931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c8a30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe570009910 tx=0x7fe570009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 -- 172.21.15.81:0/254540931 shutdown_connections 2023-11-29T11:14:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 --2- 172.21.15.81:0/254540931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 0x7fe5800cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 --2- 172.21.15.81:0/254540931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c8a30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 -- 172.21.15.81:0/254540931 >> 172.21.15.81:0/254540931 conn(0x7fe5800ce3e0 msgr2=0x7fe5800ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 -- 172.21.15.81:0/254540931 shutdown_connections 2023-11-29T11:14:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 -- 172.21.15.81:0/254540931 wait complete. 2023-11-29T11:14:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.781+0000 7fe584adc700 1 Processor -- start 2023-11-29T11:14:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 -- start start 2023-11-29T11:14:00.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5800ad490 0x7fe580157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 0x7fe5800c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580071e80 con 0x7fe580158e60 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800c5650 con 0x7fe5800ad490 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800c5930 con 0x7fe5800cb460 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59002/0 (socket says 172.21.15.81:59002) 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 -- 172.21.15.81:0/1291935206 learned_addr learned my addr 172.21.15.81:0/1291935206 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57f7fe700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5800ad490 0x7fe580157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe577fff700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 0x7fe5800c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 -- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 msgr2=0x7fe5800c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 0x7fe5800c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 -- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5800ad490 msgr2=0x7fe580157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5800ad490 0x7fe580157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 -- 172.21.15.81:0/1291935206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe570009570 con 0x7fe580158e60 2023-11-29T11:14:00.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57f7fe700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5800ad490 0x7fe580157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57ffff700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c4120 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe578007e40 tx=0x7fe57800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57cff9700 1 -- 172.21.15.81:0/1291935206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800eea0 con 0x7fe580158e60 2023-11-29T11:14:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57cff9700 1 -- 172.21.15.81:0/1291935206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe578014420 con 0x7fe580158e60 2023-11-29T11:14:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe580159230 con 0x7fe580158e60 2023-11-29T11:14:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe57cff9700 1 -- 172.21.15.81:0/1291935206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5780147b0 con 0x7fe580158e60 2023-11-29T11:14:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5800cde90 con 0x7fe580158e60 2023-11-29T11:14:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.785+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58006d6a0 con 0x7fe580158e60 2023-11-29T11:14:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.789+0000 7fe57cff9700 1 -- 172.21.15.81:0/1291935206 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe578012050 con 0x7fe580158e60 2023-11-29T11:14:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.789+0000 7fe57cff9700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe564064ee0 0x7fe564067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:00.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.789+0000 7fe57f7fe700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe564064ee0 0x7fe564067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.789+0000 7fe57cff9700 1 -- 172.21.15.81:0/1291935206 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe5780837b0 con 0x7fe580158e60 2023-11-29T11:14:00.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.789+0000 7fe57f7fe700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe564064ee0 0x7fe564067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe570000c00 tx=0x7fe570008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.797+0000 7fe57cff9700 1 -- 172.21.15.81:0/1291935206 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe5780515b0 con 0x7fe580158e60 2023-11-29T11:14:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.997+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe580072500 con 0x7fe580158e60 2023-11-29T11:14:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:00.997+0000 7fe57cff9700 1 -- 172.21.15.81:0/1291935206 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4644 (secure 0 0 0) 0x7fe578054bd0 con 0x7fe580158e60 2023-11-29T11:14:01.003 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:01.003 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:12:52.329725+0000","modified":"2023-11-29T11:13:14.009106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-29T11:14:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe564064ee0 msgr2=0x7fe564067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe564064ee0 0x7fe564067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe570000c00 tx=0x7fe570008030 comp rx=0 tx=0).stop 2023-11-29T11:14:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 msgr2=0x7fe5800c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c4120 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe578007e40 tx=0x7fe57800e3c0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 shutdown_connections 2023-11-29T11:14:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe564064ee0 0x7fe564067390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe580158e60 0x7fe5800c4120 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5800cb460 0x7fe5800c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 --2- 172.21.15.81:0/1291935206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5800ad490 0x7fe580157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 >> 172.21.15.81:0/1291935206 conn(0x7fe5800ce3e0 msgr2=0x7fe5800c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 shutdown_connections 2023-11-29T11:14:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.001+0000 7fe584adc700 1 -- 172.21.15.81:0/1291935206 wait complete. 2023-11-29T11:14:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-11-29T11:14:01.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408ffff700 1 Processor -- start 2023-11-29T11:14:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408ffff700 1 -- start start 2023-11-29T11:14:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f40900ce960 0x7f409015d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d3070 0x7f409006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40900ccf60 con 0x7f40900d2500 2023-11-29T11:14:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40900b66a0 con 0x7f40900ce960 2023-11-29T11:14:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40900b78b0 con 0x7f40900d3070 2023-11-29T11:14:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408f7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d3070 0x7f409006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408f7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d3070 0x7f409006cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:53440/0 (socket says 172.21.15.81:53440) 2023-11-29T11:14:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f4087fff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f40900d2500 0x7f40900d2960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:45578/0 (socket says 172.21.15.81:45578) 2023-11-29T11:14:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408effd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f40900ce960 0x7f409015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408f7fe700 1 -- 172.21.15.81:0/3348162131 learned_addr learned my addr 172.21.15.81:0/3348162131 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408e7fc700 1 -- 172.21.15.81:0/3348162131 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124610088 0 0) 0x7f40900ccf60 con 0x7f40900d2500 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408e7fc700 1 -- 172.21.15.81:0/3348162131 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f407c0035d0 con 0x7f40900d2500 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408effd700 1 -- 172.21.15.81:0/3348162131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d3070 msgr2=0x7f409006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408effd700 1 --2- 172.21.15.81:0/3348162131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d3070 0x7f409006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408effd700 1 -- 172.21.15.81:0/3348162131 >> v1:172.21.15.176:6789/0 conn(0x7f40900d2500 legacy=0x7f40900d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408effd700 1 -- 172.21.15.81:0/3348162131 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40900b7b70 con 0x7f40900ce960 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408f7fe700 1 --2- 172.21.15.81:0/3348162131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d3070 0x7f409006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408effd700 1 --2- 172.21.15.81:0/3348162131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900ce960 0x7f409015d230 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4080009850 tx=0x7f4080009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b037a7b76afedbe server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408e7fc700 1 -- 172.21.15.81:0/3348162131 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080011830 con 0x7f40900ce960 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408e7fc700 1 -- 172.21.15.81:0/3348162131 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4080011990 con 0x7f40900ce960 2023-11-29T11:14:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.125+0000 7f408e7fc700 1 -- 172.21.15.81:0/3348162131 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080011d40 con 0x7f40900ce960 2023-11-29T11:14:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- 172.21.15.81:0/3348162131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900ce960 msgr2=0x7f409015d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 --2- 172.21.15.81:0/3348162131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900ce960 0x7f409015d230 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4080009850 tx=0x7f4080009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- 172.21.15.81:0/3348162131 shutdown_connections 2023-11-29T11:14:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 --2- 172.21.15.81:0/3348162131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d3070 0x7f409006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 --2- 172.21.15.81:0/3348162131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900ce960 0x7f409015d230 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- 172.21.15.81:0/3348162131 >> 172.21.15.81:0/3348162131 conn(0x7f40900b5860 msgr2=0x7f40900b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- 172.21.15.81:0/3348162131 shutdown_connections 2023-11-29T11:14:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- 172.21.15.81:0/3348162131 wait complete. 2023-11-29T11:14:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 Processor -- start 2023-11-29T11:14:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- start start 2023-11-29T11:14:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40900ce960 0x7f409014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d2500 0x7f409009f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900d3070 0x7f409009f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900b3530 con 0x7f40900ce960 2023-11-29T11:14:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409009fb80 con 0x7f40900d3070 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409009fe60 con 0x7f40900d2500 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40900ce960 0x7f409014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40900ce960 0x7f409014fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59004/0 (socket says 172.21.15.81:59004) 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408effd700 1 -- 172.21.15.81:0/1959011099 learned_addr learned my addr 172.21.15.81:0/1959011099 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f408f7fe700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900d3070 0x7f409009f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.129+0000 7f4087fff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d2500 0x7f409009f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408effd700 1 -- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d2500 msgr2=0x7f409009f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408effd700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d2500 0x7f409009f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408effd700 1 -- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900d3070 msgr2=0x7f409009f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408effd700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900d3070 0x7f409009f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408effd700 1 -- 172.21.15.81:0/1959011099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088009b30 con 0x7f40900ce960 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f4087fff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d2500 0x7f409009f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408effd700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40900ce960 0x7f409014fc50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f40800090b0 tx=0x7f4080004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f40877fe700 1 -- 172.21.15.81:0/1959011099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080004380 con 0x7f40900ce960 2023-11-29T11:14:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f40877fe700 1 -- 172.21.15.81:0/1959011099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408001f070 con 0x7f40900ce960 2023-11-29T11:14:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40800094b0 con 0x7f40900ce960 2023-11-29T11:14:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f40877fe700 1 -- 172.21.15.81:0/1959011099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40800036c0 con 0x7f40900ce960 2023-11-29T11:14:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40900b8130 con 0x7f40900ce960 2023-11-29T11:14:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.133+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40900b7e50 con 0x7f40900ce960 2023-11-29T11:14:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.137+0000 7f40877fe700 1 -- 172.21.15.81:0/1959011099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f408002a020 con 0x7f40900ce960 2023-11-29T11:14:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.137+0000 7f40877fe700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4070064f10 0x7f40700673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.137+0000 7f4087fff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4070064f10 0x7f40700673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.137+0000 7f40877fe700 1 -- 172.21.15.81:0/1959011099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f40800835f0 con 0x7f40900ce960 2023-11-29T11:14:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.137+0000 7f4087fff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4070064f10 0x7f40700673c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f40900d0f20 tx=0x7f4078007cc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.145+0000 7f40877fe700 1 -- 172.21.15.81:0/1959011099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4080051460 con 0x7f40900ce960 2023-11-29T11:14:01.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.305+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40900b83e0 con 0x7f40900ce960 2023-11-29T11:14:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f40877fe700 1 -- 172.21.15.81:0/1959011099 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f4080015090 con 0x7f40900ce960 2023-11-29T11:14:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:01.314 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4070064f10 msgr2=0x7f40700673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4070064f10 0x7f40700673c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f40900d0f20 tx=0x7f4078007cc0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40900ce960 msgr2=0x7f409014fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40900ce960 0x7f409014fc50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f40800090b0 tx=0x7f4080004770 comp rx=0 tx=0).stop 2023-11-29T11:14:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 shutdown_connections 2023-11-29T11:14:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4070064f10 0x7f40700673c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40900d3070 0x7f409009f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40900d2500 0x7f409009f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 --2- 172.21.15.81:0/1959011099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40900ce960 0x7f409014fc50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 >> 172.21.15.81:0/1959011099 conn(0x7f40900b5860 msgr2=0x7f40900d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 shutdown_connections 2023-11-29T11:14:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.309+0000 7f408ffff700 1 -- 172.21.15.81:0/1959011099 wait complete. 2023-11-29T11:14:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:12:50.097703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:12:51.324606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-29T11:12:54.394893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-29T11:14:01.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:14:01.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49b59e700 1 Processor -- start 2023-11-29T11:14:01.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49b59e700 1 -- start start 2023-11-29T11:14:01.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c06a4d0 0x7ff49c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff49c0cb300 0x7ff49c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c06aa40 con 0x7ff49c1585c0 2023-11-29T11:14:01.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c15c2a0 con 0x7ff49c0cb300 2023-11-29T11:14:01.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0c9b40 con 0x7ff49c06a4d0 2023-11-29T11:14:01.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff49c0cb300 0x7ff49c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff49c1585c0 0x7ff49c0c9430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39024/0 (socket says 172.21.15.81:39024) 2023-11-29T11:14:01.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.445+0000 7ff49a59c700 1 -- 172.21.15.81:0/282199083 learned_addr learned my addr 172.21.15.81:0/282199083 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:01.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff499d9b700 1 --2- 172.21.15.81:0/282199083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c06a4d0 0x7ff49c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49ad9d700 1 -- 172.21.15.81:0/282199083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c06a4d0 msgr2=0x7ff49c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49ad9d700 1 --2- 172.21.15.81:0/282199083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c06a4d0 0x7ff49c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49ad9d700 1 -- 172.21.15.81:0/282199083 >> v1:172.21.15.81:6789/0 conn(0x7ff49c1585c0 legacy=0x7ff49c0c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49ad9d700 1 -- 172.21.15.81:0/282199083 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c06ad20 con 0x7ff49c0cb300 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49959a700 1 -- 172.21.15.81:0/282199083 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034831455 0 0) 0x7ff49c06aa40 con 0x7ff49c1585c0 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49ad9d700 1 --2- 172.21.15.81:0/282199083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c0cb300 0x7ff49c0cd100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff494009d90 tx=0x7ff49400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7b832065d05665 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49959a700 1 -- 172.21.15.81:0/282199083 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49400bdd0 con 0x7ff49c0cb300 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49959a700 1 -- 172.21.15.81:0/282199083 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff494009e80 con 0x7ff49c0cb300 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49959a700 1 -- 172.21.15.81:0/282199083 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940106c0 con 0x7ff49c0cb300 2023-11-29T11:14:01.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49b59e700 1 -- 172.21.15.81:0/282199083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c0cb300 msgr2=0x7ff49c0cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49b59e700 1 --2- 172.21.15.81:0/282199083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c0cb300 0x7ff49c0cd100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff494009d90 tx=0x7ff49400b330 comp rx=0 tx=0).stop 2023-11-29T11:14:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49b59e700 1 -- 172.21.15.81:0/282199083 shutdown_connections 2023-11-29T11:14:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49b59e700 1 --2- 172.21.15.81:0/282199083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c0cb300 0x7ff49c0cd100 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49b59e700 1 --2- 172.21.15.81:0/282199083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c06a4d0 0x7ff49c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49b59e700 1 -- 172.21.15.81:0/282199083 >> 172.21.15.81:0/282199083 conn(0x7ff49c0b0990 msgr2=0x7ff49c0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49b59e700 1 -- 172.21.15.81:0/282199083 shutdown_connections 2023-11-29T11:14:01.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.449+0000 7ff49b59e700 1 -- 172.21.15.81:0/282199083 wait complete. 2023-11-29T11:14:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49b59e700 1 Processor -- start 2023-11-29T11:14:01.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49b59e700 1 -- start start 2023-11-29T11:14:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c06a4d0 0x7ff49c0c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff49c0cb300 0x7ff49c0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c1585c0 0x7ff49c0cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1f14b0 con 0x7ff49c06a4d0 2023-11-29T11:14:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0c90c0 con 0x7ff49c0cb300 2023-11-29T11:14:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1f1940 con 0x7ff49c1585c0 2023-11-29T11:14:01.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c06a4d0 0x7ff49c0c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c06a4d0 0x7ff49c0c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59014/0 (socket says 172.21.15.81:59014) 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49a59c700 1 -- 172.21.15.81:0/284355557 learned_addr learned my addr 172.21.15.81:0/284355557 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff499d9b700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff49c0cb300 0x7ff49c0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49ad9d700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c1585c0 0x7ff49c0cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49a59c700 1 -- 172.21.15.81:0/284355557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c1585c0 msgr2=0x7ff49c0cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49a59c700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c1585c0 0x7ff49c0cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49a59c700 1 -- 172.21.15.81:0/284355557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff49c0cb300 msgr2=0x7ff49c0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49a59c700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff49c0cb300 0x7ff49c0c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.453+0000 7ff49a59c700 1 -- 172.21.15.81:0/284355557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff494009a70 con 0x7ff49c06a4d0 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff49a59c700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c06a4d0 0x7ff49c0c4e00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c4e0 tx=0x7ff49000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff48affd700 1 -- 172.21.15.81:0/284355557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490004ca0 con 0x7ff49c06a4d0 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff48affd700 1 -- 172.21.15.81:0/284355557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff490004e20 con 0x7ff49c06a4d0 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c06b2e0 con 0x7ff49c06a4d0 2023-11-29T11:14:01.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff48affd700 1 -- 172.21.15.81:0/284355557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490007310 con 0x7ff49c06a4d0 2023-11-29T11:14:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c06b000 con 0x7ff49c06a4d0 2023-11-29T11:14:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c071570 con 0x7ff49c06a4d0 2023-11-29T11:14:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff48affd700 1 -- 172.21.15.81:0/284355557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff49001a020 con 0x7ff49c06a4d0 2023-11-29T11:14:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff48affd700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff47c064ee0 0x7ff47c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff48affd700 1 -- 172.21.15.81:0/284355557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff490081c80 con 0x7ff49c06a4d0 2023-11-29T11:14:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.457+0000 7ff499d9b700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff47c064ee0 0x7ff47c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.461+0000 7ff499d9b700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff47c064ee0 0x7ff47c067390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0b44a0 tx=0x7ff48c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.465+0000 7ff48affd700 1 -- 172.21.15.81:0/284355557 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff49004fa90 con 0x7ff49c06a4d0 2023-11-29T11:14:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.629+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff49c072500 con 0x7ff49c06a4d0 2023-11-29T11:14:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.629+0000 7ff48affd700 1 -- 172.21.15.81:0/284355557 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff4900530b0 con 0x7ff49c06a4d0 2023-11-29T11:14:01.636 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff47c064ee0 msgr2=0x7ff47c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff47c064ee0 0x7ff47c067390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0b44a0 tx=0x7ff48c008040 comp rx=0 tx=0).stop 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c06a4d0 msgr2=0x7ff49c0c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c06a4d0 0x7ff49c0c4e00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c4e0 tx=0x7ff49000c7f0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 shutdown_connections 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff47c064ee0 0x7ff47c067390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff49c1585c0 0x7ff49c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff49c0cb300 0x7ff49c0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 --2- 172.21.15.81:0/284355557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c06a4d0 0x7ff49c0c4e00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 >> 172.21.15.81:0/284355557 conn(0x7ff49c0b0990 msgr2=0x7ff49c0cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 shutdown_connections 2023-11-29T11:14:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.633+0000 7ff49b59e700 1 -- 172.21.15.81:0/284355557 wait complete. 2023-11-29T11:14:01.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:14:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e96aa1700 1 Processor -- start 2023-11-29T11:14:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e96aa1700 1 -- start start 2023-11-29T11:14:01.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e96aa1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e90158890 0x7f0e900cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e96aa1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0e900c9590 0x7f0e9006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e96aa1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9006c3b0 con 0x7f0e900cb890 2023-11-29T11:14:01.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e96aa1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9006c690 con 0x7f0e90158890 2023-11-29T11:14:01.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e9483d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e90158890 0x7f0e900cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e96aa1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9006c970 con 0x7f0e900c9590 2023-11-29T11:14:01.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e9483d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e90158890 0x7f0e900cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59016/0 (socket says 172.21.15.81:59016) 2023-11-29T11:14:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.765+0000 7f0e9483d700 1 -- 172.21.15.81:0/3888492983 learned_addr learned my addr 172.21.15.81:0/3888492983 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e8ffff700 1 --2- 172.21.15.81:0/3888492983 >> v2:172.21.15.176:3300/0 conn(0x7f0e900c9590 0x7f0e9006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e9483d700 1 -- 172.21.15.81:0/3888492983 >> v2:172.21.15.176:3300/0 conn(0x7f0e900c9590 msgr2=0x7f0e9006b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e9483d700 1 --2- 172.21.15.81:0/3888492983 >> v2:172.21.15.176:3300/0 conn(0x7f0e900c9590 0x7f0e9006b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e9483d700 1 -- 172.21.15.81:0/3888492983 >> v1:172.21.15.176:6789/0 conn(0x7f0e900cb890 legacy=0x7f0e9006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e9483d700 1 -- 172.21.15.81:0/3888492983 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9006cc50 con 0x7f0e90158890 2023-11-29T11:14:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e9483d700 1 --2- 172.21.15.81:0/3888492983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900cd520 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0e90070320 tx=0x7f0e84009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba1712a99972935 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/3888492983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84011830 con 0x7f0e90158890 2023-11-29T11:14:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/3888492983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e84011990 con 0x7f0e90158890 2023-11-29T11:14:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e8f7fe700 1 -- 172.21.15.81:0/3888492983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84011d20 con 0x7f0e90158890 2023-11-29T11:14:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e96aa1700 1 -- 172.21.15.81:0/3888492983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 msgr2=0x7f0e900cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/3888492983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900cd520 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0e90070320 tx=0x7f0e84009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e96aa1700 1 -- 172.21.15.81:0/3888492983 shutdown_connections 2023-11-29T11:14:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/3888492983 >> v2:172.21.15.176:3300/0 conn(0x7f0e900c9590 0x7f0e9006b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/3888492983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900cd520 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e96aa1700 1 -- 172.21.15.81:0/3888492983 >> 172.21.15.81:0/3888492983 conn(0x7f0e900b0a90 msgr2=0x7f0e900b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e96aa1700 1 -- 172.21.15.81:0/3888492983 shutdown_connections 2023-11-29T11:14:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.769+0000 7f0e96aa1700 1 -- 172.21.15.81:0/3888492983 wait complete. 2023-11-29T11:14:01.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.773+0000 7f0e96aa1700 1 Processor -- start 2023-11-29T11:14:01.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.773+0000 7f0e96aa1700 1 -- start start 2023-11-29T11:14:01.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.773+0000 7f0e96aa1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e900c9590 0x7f0e90152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.773+0000 7f0e96aa1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e900cb890 0x7f0e900c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.773+0000 7f0e96aa1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.773+0000 7f0e96aa1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90159310 con 0x7f0e90158890 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.773+0000 7f0e96aa1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90158d90 con 0x7f0e900cb890 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.773+0000 7f0e96aa1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9015bd30 con 0x7f0e900c9590 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59018/0 (socket says 172.21.15.81:59018) 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 -- 172.21.15.81:0/4259756309 learned_addr learned my addr 172.21.15.81:0/4259756309 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9483d700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e900c9590 0x7f0e90152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e8ffff700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e900cb890 0x7f0e900c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 -- 172.21.15.81:0/4259756309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e900c9590 msgr2=0x7f0e90152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e900c9590 0x7f0e90152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 -- 172.21.15.81:0/4259756309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e900cb890 msgr2=0x7f0e900c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e900cb890 0x7f0e900c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 -- 172.21.15.81:0/4259756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84009570 con 0x7f0e90158890 2023-11-29T11:14:01.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e9503e700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900c9f90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800ee40 tx=0x7f0e8800c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e8d7fa700 1 -- 172.21.15.81:0/4259756309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88003a20 con 0x7f0e90158890 2023-11-29T11:14:01.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e8d7fa700 1 -- 172.21.15.81:0/4259756309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e88003b80 con 0x7f0e90158890 2023-11-29T11:14:01.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e900cbce0 con 0x7f0e90158890 2023-11-29T11:14:01.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9006cf30 con 0x7f0e90158890 2023-11-29T11:14:01.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e8d7fa700 1 -- 172.21.15.81:0/4259756309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880050d0 con 0x7f0e90158890 2023-11-29T11:14:01.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e900cbe70 con 0x7f0e90158890 2023-11-29T11:14:01.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e8d7fa700 1 -- 172.21.15.81:0/4259756309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0e88021070 con 0x7f0e90158890 2023-11-29T11:14:01.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.777+0000 7f0e8d7fa700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e74064ee0 0x7f0e74067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:01.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.781+0000 7f0e9483d700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e74064ee0 0x7f0e74067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:01.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.781+0000 7f0e8d7fa700 1 -- 172.21.15.81:0/4259756309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0e880847b0 con 0x7f0e90158890 2023-11-29T11:14:01.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.781+0000 7f0e9483d700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e74064ee0 0x7f0e74067390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0e84000c00 tx=0x7f0e84008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:01.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.785+0000 7f0e8d7fa700 1 -- 172.21.15.81:0/4259756309 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0e880525a0 con 0x7f0e90158890 2023-11-29T11:14:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e9015bef0 con 0x7f0e90158890 2023-11-29T11:14:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e8d7fa700 1 -- 172.21.15.81:0/4259756309 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e8801f0a0 con 0x7f0e90158890 2023-11-29T11:14:01.954 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e74064ee0 msgr2=0x7f0e74067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e74064ee0 0x7f0e74067390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0e84000c00 tx=0x7f0e84008030 comp rx=0 tx=0).stop 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 msgr2=0x7f0e900c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900c9f90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800ee40 tx=0x7f0e8800c550 comp rx=0 tx=0).stop 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 shutdown_connections 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0e74064ee0 0x7f0e74067390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e90158890 0x7f0e900c9f90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e900cb890 0x7f0e900c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 --2- 172.21.15.81:0/4259756309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e900c9590 0x7f0e90152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 >> 172.21.15.81:0/4259756309 conn(0x7f0e900b0a90 msgr2=0x7f0e900b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 shutdown_connections 2023-11-29T11:14:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:01.949+0000 7f0e96aa1700 1 -- 172.21.15.81:0/4259756309 wait complete. 2023-11-29T11:14:01.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:14:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.081+0000 7fb3c897d700 1 Processor -- start 2023-11-29T11:14:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.081+0000 7fb3c897d700 1 -- start start 2023-11-29T11:14:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.081+0000 7fb3c897d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb3c40b1ae0 0x7fb3c406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.081+0000 7fb3c897d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c40d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.081+0000 7fb3c897d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c406a9c0 con 0x7fb3c40cf0e0 2023-11-29T11:14:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.081+0000 7fb3c897d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c406aca0 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.081+0000 7fb3c897d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c406af80 con 0x7fb3c406a4c0 2023-11-29T11:14:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c259c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c40d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c359e700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fb3c40cf0e0 0x7fb3c40b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:45596/0 (socket says 172.21.15.81:45596) 2023-11-29T11:14:02.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c2d9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb3c40b1ae0 0x7fb3c406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c359e700 1 -- 172.21.15.81:0/2221312616 learned_addr learned my addr 172.21.15.81:0/2221312616 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c1d9b700 1 -- 172.21.15.81:0/2221312616 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710778495 0 0) 0x7fb3c406a9c0 con 0x7fb3c40cf0e0 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c1d9b700 1 -- 172.21.15.81:0/2221312616 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3ac0035d0 con 0x7fb3c40cf0e0 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c259c700 1 -- 172.21.15.81:0/2221312616 >> v2:172.21.15.176:3300/0 conn(0x7fb3c40b1ae0 msgr2=0x7fb3c406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c259c700 1 --2- 172.21.15.81:0/2221312616 >> v2:172.21.15.176:3300/0 conn(0x7fb3c40b1ae0 0x7fb3c406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c259c700 1 -- 172.21.15.81:0/2221312616 >> v1:172.21.15.176:6789/0 conn(0x7fb3c40cf0e0 legacy=0x7fb3c40b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c259c700 1 -- 172.21.15.81:0/2221312616 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40b4380 con 0x7fb3c406a4c0 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c2d9d700 1 --2- 172.21.15.81:0/2221312616 >> v2:172.21.15.176:3300/0 conn(0x7fb3c40b1ae0 0x7fb3c406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c259c700 1 --2- 172.21.15.81:0/2221312616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c40d03a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009850 tx=0x7fb3b4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77021895f9319fad server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c1d9b700 1 -- 172.21.15.81:0/2221312616 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4011830 con 0x7fb3c406a4c0 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c1d9b700 1 -- 172.21.15.81:0/2221312616 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4011990 con 0x7fb3c406a4c0 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c1d9b700 1 -- 172.21.15.81:0/2221312616 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4011d40 con 0x7fb3c406a4c0 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c897d700 1 -- 172.21.15.81:0/2221312616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 msgr2=0x7fb3c40d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2221312616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c40d03a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009850 tx=0x7fb3b4009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c897d700 1 -- 172.21.15.81:0/2221312616 shutdown_connections 2023-11-29T11:14:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2221312616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c40d03a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2221312616 >> v2:172.21.15.176:3300/0 conn(0x7fb3c40b1ae0 0x7fb3c406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c897d700 1 -- 172.21.15.81:0/2221312616 >> 172.21.15.81:0/2221312616 conn(0x7fb3c409bbd0 msgr2=0x7fb3c40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c897d700 1 -- 172.21.15.81:0/2221312616 shutdown_connections 2023-11-29T11:14:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.085+0000 7fb3c897d700 1 -- 172.21.15.81:0/2221312616 wait complete. 2023-11-29T11:14:02.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c897d700 1 Processor -- start 2023-11-29T11:14:02.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c897d700 1 -- start start 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c897d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c41f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c897d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c40b1ae0 0x7fb3c40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c897d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3c40cf0e0 0x7fb3c415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c897d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40c96c0 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c897d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c41f29e0 con 0x7fb3c40cf0e0 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c897d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c41f1dd0 con 0x7fb3c406a4c0 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c40b1ae0 0x7fb3c40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c40b1ae0 0x7fb3c40c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59026/0 (socket says 172.21.15.81:59026) 2023-11-29T11:14:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 -- 172.21.15.81:0/2952661570 learned_addr learned my addr 172.21.15.81:0/2952661570 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c359e700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3c40cf0e0 0x7fb3c415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c2d9d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c41f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 -- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 msgr2=0x7fb3c41f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c41f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 -- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3c40cf0e0 msgr2=0x7fb3c415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3c40cf0e0 0x7fb3c415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 -- 172.21.15.81:0/2952661570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b80094b0 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c2d9d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c41f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3c259c700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c40b1ae0 0x7fb3c40c9180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4014040 tx=0x7fb3b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.089+0000 7fb3ab7fe700 1 -- 172.21.15.81:0/2952661570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4004590 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3ab7fe700 1 -- 172.21.15.81:0/2952661570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b401e070 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b40094b0 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3ab7fe700 1 -- 172.21.15.81:0/2952661570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4003900 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c40b60e0 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c40b1eb0 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3ab7fe700 1 -- 172.21.15.81:0/2952661570 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb3b400f050 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3ab7fe700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b0064ee0 0x7fb3b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3ab7fe700 1 -- 172.21.15.81:0/2952661570 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb3b4020070 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3c2d9d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b0064ee0 0x7fb3b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.093+0000 7fb3c2d9d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b0064ee0 0x7fb3b0067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3c415a700 tx=0x7fb3b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.101+0000 7fb3ab7fe700 1 -- 172.21.15.81:0/2952661570 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb3b4051390 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3c40d08e0 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3ab7fe700 1 -- 172.21.15.81:0/2952661570 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3b4006ce0 con 0x7fb3c40b1ae0 2023-11-29T11:14:02.265 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:14:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b0064ee0 msgr2=0x7fb3b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b0064ee0 0x7fb3b0067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb3c415a700 tx=0x7fb3b8008040 comp rx=0 tx=0).stop 2023-11-29T11:14:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c40b1ae0 msgr2=0x7fb3c40c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c40b1ae0 0x7fb3c40c9180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4014040 tx=0x7fb3b4004770 comp rx=0 tx=0).stop 2023-11-29T11:14:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 shutdown_connections 2023-11-29T11:14:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb3b0064ee0 0x7fb3b0067390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3c40cf0e0 0x7fb3c415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c40b1ae0 0x7fb3c40c9180 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 --2- 172.21.15.81:0/2952661570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3c406a4c0 0x7fb3c41f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 >> 172.21.15.81:0/2952661570 conn(0x7fb3c409bbd0 msgr2=0x7fb3c415bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 shutdown_connections 2023-11-29T11:14:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.261+0000 7fb3c897d700 1 -- 172.21.15.81:0/2952661570 wait complete. 2023-11-29T11:14:02.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:14:02.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f534ab68700 1 Processor -- start 2023-11-29T11:14:02.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f534ab68700 1 -- start start 2023-11-29T11:14:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f534ab68700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5344159fa0 0x7f53440b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f534ab68700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534415a370 con 0x7f53440cd710 2023-11-29T11:14:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f534ab68700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53440cff70 con 0x7f53440b1300 2023-11-29T11:14:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f534ab68700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440d0250 con 0x7f5344159fa0 2023-11-29T11:14:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f534a367700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53440cd710 0x7f53440b0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39036/0 (socket says 172.21.15.81:39036) 2023-11-29T11:14:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f534a367700 1 -- 172.21.15.81:0/2892494899 learned_addr learned my addr 172.21.15.81:0/2892494899 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:02.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f5349b66700 1 --2- 172.21.15.81:0/2892494899 >> v2:172.21.15.176:3300/0 conn(0x7f5344159fa0 0x7f53440b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128418497 0 0) 0x7f534415a370 con 0x7f53440cd710 2023-11-29T11:14:02.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53300035d0 con 0x7f53440cd710 2023-11-29T11:14:02.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.389+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477467262 0 0) 0x7f53300035d0 con 0x7f53440cd710 2023-11-29T11:14:02.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 >> v2:172.21.15.176:3300/0 conn(0x7f5344159fa0 msgr2=0x7f53440b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:02.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 --2- 172.21.15.81:0/2892494899 >> v2:172.21.15.176:3300/0 conn(0x7f5344159fa0 0x7f53440b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 >> v1:172.21.15.176:6789/0 conn(0x7f53440b1300 legacy=0x7f53440cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53440afaa0 con 0x7f53440cd710 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f533c0019f0 con 0x7f53440cd710 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 >> v1:172.21.15.81:6789/0 conn(0x7f53440cd710 legacy=0x7f53440b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f5330003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5330004870 0x7f5330004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5330005220 0x7f533000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440d0250 con 0x7f5330003a20 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533000c0a0 con 0x7f5330005220 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533000c260 con 0x7f5330004870 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5349b66700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f5330003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534a367700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5330005220 0x7f533000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5349365700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5330004870 0x7f5330004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5349b66700 1 -- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5330004870 msgr2=0x7f5330004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5349b66700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5330004870 0x7f5330004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5349b66700 1 -- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5330005220 msgr2=0x7f533000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5349b66700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5330005220 0x7f533000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5349b66700 1 -- 172.21.15.81:0/2892494899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300035d0 con 0x7f5330003a20 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534a367700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5330005220 0x7f533000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534a367700 1 -- 172.21.15.81:0/2892494899 reap_dead start 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5349b66700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f5330003e30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5334009b70 tx=0x7f53300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da16d92d3bc07fd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400e6c0 con 0x7f5330003a20 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533400e820 con 0x7f5330003a20 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f5348b64700 1 -- 172.21.15.81:0/2892494899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400eb90 con 0x7f5330003a20 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534ab68700 1 -- 172.21.15.81:0/2892494899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 msgr2=0x7f5330003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534ab68700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f5330003e30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5334009b70 tx=0x7f53300058a0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534ab68700 1 -- 172.21.15.81:0/2892494899 shutdown_connections 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534ab68700 1 --2- 172.21.15.81:0/2892494899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f5330003e30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534ab68700 1 -- 172.21.15.81:0/2892494899 >> 172.21.15.81:0/2892494899 conn(0x7f53440b2180 msgr2=0x7f53440b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:02.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534ab68700 1 -- 172.21.15.81:0/2892494899 shutdown_connections 2023-11-29T11:14:02.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.393+0000 7f534ab68700 1 -- 172.21.15.81:0/2892494899 wait complete. 2023-11-29T11:14:02.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 Processor -- start 2023-11-29T11:14:02.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 -- start start 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f534414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53440c7720 0x7f53440c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f534406e980 0x7f534406edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c80b0 con 0x7f5330003a20 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534406f330 con 0x7f53440c7720 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c4180 con 0x7f534406e980 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f534414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f534414e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59038/0 (socket says 172.21.15.81:59038) 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 -- 172.21.15.81:0/180310909 learned_addr learned my addr 172.21.15.81:0/180310909 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534a367700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f534406e980 0x7f534406edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349365700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53440c7720 0x7f53440c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 -- 172.21.15.81:0/180310909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f534406e980 msgr2=0x7f534406edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f534406e980 0x7f534406edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 -- 172.21.15.81:0/180310909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53440c7720 msgr2=0x7f53440c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53440c7720 0x7f53440c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 -- 172.21.15.81:0/180310909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53440b0060 con 0x7f5330003a20 2023-11-29T11:14:02.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f5349b66700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f534414e0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f533400e4b0 tx=0x7f53340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f533a7fc700 1 -- 172.21.15.81:0/180310909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400e6c0 con 0x7f5330003a20 2023-11-29T11:14:02.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f533a7fc700 1 -- 172.21.15.81:0/180310909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334003af0 con 0x7f5330003a20 2023-11-29T11:14:02.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f533a7fc700 1 -- 172.21.15.81:0/180310909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334003ea0 con 0x7f5330003a20 2023-11-29T11:14:02.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.397+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53440afd80 con 0x7f5330003a20 2023-11-29T11:14:02.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.401+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53440cd000 con 0x7f5330003a20 2023-11-29T11:14:02.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.401+0000 7f533a7fc700 1 -- 172.21.15.81:0/180310909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f533402b030 con 0x7f5330003a20 2023-11-29T11:14:02.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.401+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5344072500 con 0x7f5330003a20 2023-11-29T11:14:02.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.401+0000 7f533a7fc700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5328064f10 0x7f53280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.401+0000 7f5349365700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5328064f10 0x7f53280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.401+0000 7f533a7fc700 1 -- 172.21.15.81:0/180310909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5334083650 con 0x7f5330003a20 2023-11-29T11:14:02.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.401+0000 7f5349365700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5328064f10 0x7f53280673c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f534415d6b0 tx=0x7f5340009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.409+0000 7f533a7fc700 1 -- 172.21.15.81:0/180310909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f53340513d0 con 0x7f5330003a20 2023-11-29T11:14:02.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f53440c8290 con 0x7f5330003a20 2023-11-29T11:14:02.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f533a7fc700 1 -- 172.21.15.81:0/180310909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f53340549f0 con 0x7f5330003a20 2023-11-29T11:14:02.578 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:14:02.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5328064f10 msgr2=0x7f53280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5328064f10 0x7f53280673c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f534415d6b0 tx=0x7f5340009040 comp rx=0 tx=0).stop 2023-11-29T11:14:02.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 msgr2=0x7f534414e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f534414e0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f533400e4b0 tx=0x7f53340047e0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 shutdown_connections 2023-11-29T11:14:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5328064f10 0x7f53280673c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f534406e980 0x7f534406edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53440c7720 0x7f53440c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 --2- 172.21.15.81:0/180310909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5330003a20 0x7f534414e0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 >> 172.21.15.81:0/180310909 conn(0x7f53440b2180 msgr2=0x7f53440b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 shutdown_connections 2023-11-29T11:14:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.573+0000 7f534ab68700 1 -- 172.21.15.81:0/180310909 wait complete. 2023-11-29T11:14:02.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-29T11:14:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd42147a700 1 Processor -- start 2023-11-29T11:14:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd42147a700 1 -- start start 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd42147a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c06aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd42147a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd41c06b000 0x7fd41c0c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd42147a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd41c0c1900 0x7fd41c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd42147a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c06b450 con 0x7fd41c06b000 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd42147a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c160c50 con 0x7fd41c0c1900 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd42147a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0c1d60 con 0x7fd41c160880 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd41c06b000 0x7fd41c0c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd41c06b000 0x7fd41c0c13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59040/0 (socket says 172.21.15.81:59040) 2023-11-29T11:14:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 -- 172.21.15.81:0/2888995535 learned_addr learned my addr 172.21.15.81:0/2888995535 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd420c79700 1 --2- 172.21.15.81:0/2888995535 >> v2:172.21.15.176:3300/0 conn(0x7fd41c0c1900 0x7fd41c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41bfff700 1 --2- 172.21.15.81:0/2888995535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c06aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 -- 172.21.15.81:0/2888995535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 msgr2=0x7fd41c06aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 --2- 172.21.15.81:0/2888995535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c06aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 -- 172.21.15.81:0/2888995535 >> v2:172.21.15.176:3300/0 conn(0x7fd41c0c1900 msgr2=0x7fd41c0afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 --2- 172.21.15.81:0/2888995535 >> v2:172.21.15.176:3300/0 conn(0x7fd41c0c1900 0x7fd41c0afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 -- 172.21.15.81:0/2888995535 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0b3050 con 0x7fd41c06b000 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41b7fe700 1 --2- 172.21.15.81:0/2888995535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c0c13c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0b4450 tx=0x7fd404009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1530cff41f188 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41affd700 1 -- 172.21.15.81:0/2888995535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400b8a0 con 0x7fd41c06b000 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41affd700 1 -- 172.21.15.81:0/2888995535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400ba00 con 0x7fd41c06b000 2023-11-29T11:14:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.709+0000 7fd41affd700 1 -- 172.21.15.81:0/2888995535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400bd90 con 0x7fd41c06b000 2023-11-29T11:14:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 -- 172.21.15.81:0/2888995535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 msgr2=0x7fd41c0c13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 --2- 172.21.15.81:0/2888995535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c0c13c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0b4450 tx=0x7fd404009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 -- 172.21.15.81:0/2888995535 shutdown_connections 2023-11-29T11:14:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 --2- 172.21.15.81:0/2888995535 >> v2:172.21.15.176:3300/0 conn(0x7fd41c0c1900 0x7fd41c0afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 --2- 172.21.15.81:0/2888995535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c0c13c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 --2- 172.21.15.81:0/2888995535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c06aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 -- 172.21.15.81:0/2888995535 >> 172.21.15.81:0/2888995535 conn(0x7fd41c0cae70 msgr2=0x7fd41c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 -- 172.21.15.81:0/2888995535 shutdown_connections 2023-11-29T11:14:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 -- 172.21.15.81:0/2888995535 wait complete. 2023-11-29T11:14:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 Processor -- start 2023-11-29T11:14:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.713+0000 7fd42147a700 1 -- start start 2023-11-29T11:14:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c0c1900 0x7fd41c1f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1f77c0 con 0x7fd41c06b000 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1f6b90 con 0x7fd41c0c1900 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1f6e70 con 0x7fd41c160880 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c1f6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59052/0 (socket says 172.21.15.81:59052) 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 -- 172.21.15.81:0/185828792 learned_addr learned my addr 172.21.15.81:0/185828792 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd420c79700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41b7fe700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c0c1900 0x7fd41c1f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 -- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 msgr2=0x7fd41c0ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c0ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 -- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c0c1900 msgr2=0x7fd41c1f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c0c1900 0x7fd41c1f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 -- 172.21.15.81:0/185828792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404009570 con 0x7fd41c06b000 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd420c79700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c0ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd41bfff700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c1f6010 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00d800 tx=0x7fd40c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd418ff9700 1 -- 172.21.15.81:0/185828792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0125f0 con 0x7fd41c06b000 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd418ff9700 1 -- 172.21.15.81:0/185828792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c012750 con 0x7fd41c06b000 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c069ce0 con 0x7fd41c06b000 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd418ff9700 1 -- 172.21.15.81:0/185828792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c012ac0 con 0x7fd41c06b000 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c06b630 con 0x7fd41c06b000 2023-11-29T11:14:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.717+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c069fc0 con 0x7fd41c06b000 2023-11-29T11:14:02.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.721+0000 7fd418ff9700 1 -- 172.21.15.81:0/185828792 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd40c012c20 con 0x7fd41c06b000 2023-11-29T11:14:02.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.721+0000 7fd418ff9700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd3fc064ee0 0x7fd3fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:02.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.721+0000 7fd418ff9700 1 -- 172.21.15.81:0/185828792 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd40c082360 con 0x7fd41c06b000 2023-11-29T11:14:02.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.721+0000 7fd41b7fe700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd3fc064ee0 0x7fd3fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:02.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.721+0000 7fd41b7fe700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd3fc064ee0 0x7fd3fc067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd404014040 tx=0x7fd404008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:02.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.729+0000 7fd418ff9700 1 -- 172.21.15.81:0/185828792 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd40c0501d0 con 0x7fd41c06b000 2023-11-29T11:14:02.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd41c072500 con 0x7fd41c06b000 2023-11-29T11:14:02.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd418ff9700 1 -- 172.21.15.81:0/185828792 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd40c0537f0 con 0x7fd41c06b000 2023-11-29T11:14:02.891 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:14:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd3fc064ee0 msgr2=0x7fd3fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd3fc064ee0 0x7fd3fc067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd404014040 tx=0x7fd404008030 comp rx=0 tx=0).stop 2023-11-29T11:14:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 msgr2=0x7fd41c1f6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c1f6010 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00d800 tx=0x7fd40c00db10 comp rx=0 tx=0).stop 2023-11-29T11:14:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 shutdown_connections 2023-11-29T11:14:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd3fc064ee0 0x7fd3fc067390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd41c160880 0x7fd41c0ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.885+0000 7fd42147a700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c0c1900 0x7fd41c1f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.889+0000 7fd42147a700 1 --2- 172.21.15.81:0/185828792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd41c06b000 0x7fd41c1f6010 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.889+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 >> 172.21.15.81:0/185828792 conn(0x7fd41c0cae70 msgr2=0x7fd41c06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.889+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 shutdown_connections 2023-11-29T11:14:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:02.889+0000 7fd42147a700 1 -- 172.21.15.81:0/185828792 wait complete. 2023-11-29T11:14:02.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 Processor -- start 2023-11-29T11:14:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- start start 2023-11-29T11:14:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00f406a350 0x7f00f41671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40d0760 con 0x7f00f40b8250 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40cd270 con 0x7f00f406a800 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40cd550 con 0x7f00f406a350 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00f9f3b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f00f40b8250 0x7f00f40cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39050/0 (socket says 172.21.15.81:39050) 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00f9f3b700 1 -- 172.21.15.81:0/3459638347 learned_addr learned my addr 172.21.15.81:0/3459638347 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fa73c700 1 --2- 172.21.15.81:0/3459638347 >> v2:172.21.15.81:3300/0 conn(0x7f00f406a350 0x7f00f41671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00f8f39700 1 -- 172.21.15.81:0/3459638347 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320068230 0 0) 0x7f00f40d0760 con 0x7f00f40b8250 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fa73c700 1 -- 172.21.15.81:0/3459638347 >> v1:172.21.15.176:6789/0 conn(0x7f00f406a800 legacy=0x7f00f4069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fa73c700 1 -- 172.21.15.81:0/3459638347 >> v1:172.21.15.81:6789/0 conn(0x7f00f40b8250 legacy=0x7f00f40cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fa73c700 1 -- 172.21.15.81:0/3459638347 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40d0a00 con 0x7f00f406a350 2023-11-29T11:14:03.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fa73c700 1 --2- 172.21.15.81:0/3459638347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a350 0x7f00f41671b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009d90 tx=0x7f00ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2eb8d6c219f15c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00f8f39700 1 -- 172.21.15.81:0/3459638347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00e070 con 0x7f00f406a350 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00f8f39700 1 -- 172.21.15.81:0/3459638347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec00bbd0 con 0x7f00f406a350 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00f8f39700 1 -- 172.21.15.81:0/3459638347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec012430 con 0x7f00f406a350 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- 172.21.15.81:0/3459638347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a350 msgr2=0x7f00f41671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 --2- 172.21.15.81:0/3459638347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a350 0x7f00f41671b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009d90 tx=0x7f00ec00b330 comp rx=0 tx=0).stop 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- 172.21.15.81:0/3459638347 shutdown_connections 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 --2- 172.21.15.81:0/3459638347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a350 0x7f00f41671b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- 172.21.15.81:0/3459638347 >> 172.21.15.81:0/3459638347 conn(0x7f00f406beb0 msgr2=0x7f00f406c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- 172.21.15.81:0/3459638347 shutdown_connections 2023-11-29T11:14:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.017+0000 7f00fc19f700 1 -- 172.21.15.81:0/3459638347 wait complete. 2023-11-29T11:14:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.021+0000 7f00fc19f700 1 Processor -- start 2023-11-29T11:14:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.021+0000 7f00fc19f700 1 -- start start 2023-11-29T11:14:03.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fc19f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00f406a350 0x7f00f4158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fc19f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00f406a800 0x7f00f415d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fc19f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f40b8250 0x7f00f415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fc19f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415ddc0 con 0x7f00f40b8250 2023-11-29T11:14:03.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fc19f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415e060 con 0x7f00f406a350 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fc19f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415e340 con 0x7f00f406a800 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f40b8250 0x7f00f415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f40b8250 0x7f00f415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59064/0 (socket says 172.21.15.81:59064) 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 -- 172.21.15.81:0/3380117596 learned_addr learned my addr 172.21.15.81:0/3380117596 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00f9f3b700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00f406a350 0x7f00f4158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00f973a700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00f406a800 0x7f00f415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 -- 172.21.15.81:0/3380117596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00f406a800 msgr2=0x7f00f415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00f406a800 0x7f00f415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 -- 172.21.15.81:0/3380117596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00f406a350 msgr2=0x7f00f4158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00f406a350 0x7f00f4158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 -- 172.21.15.81:0/3380117596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009a70 con 0x7f00f40b8250 2023-11-29T11:14:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fa73c700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f40b8250 0x7f00f415f100 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f00ec014040 tx=0x7f00ec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00ea7fc700 1 -- 172.21.15.81:0/3380117596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec012430 con 0x7f00f40b8250 2023-11-29T11:14:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00ea7fc700 1 -- 172.21.15.81:0/3380117596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec020070 con 0x7f00f40b8250 2023-11-29T11:14:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f40cd830 con 0x7f00f40b8250 2023-11-29T11:14:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00ea7fc700 1 -- 172.21.15.81:0/3380117596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec004280 con 0x7f00f40b8250 2023-11-29T11:14:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.025+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f40b8620 con 0x7f00f40b8250 2023-11-29T11:14:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.029+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f40d1f30 con 0x7f00f40b8250 2023-11-29T11:14:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.029+0000 7f00ea7fc700 1 -- 172.21.15.81:0/3380117596 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f00ec02e070 con 0x7f00f40b8250 2023-11-29T11:14:03.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.029+0000 7f00ea7fc700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f00d8064ee0 0x7f00d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.029+0000 7f00ea7fc700 1 -- 172.21.15.81:0/3380117596 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f00ec022070 con 0x7f00f40b8250 2023-11-29T11:14:03.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.029+0000 7f00f9f3b700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f00d8064ee0 0x7f00d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.029+0000 7f00f9f3b700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f00d8064ee0 0x7f00d8067390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00e4000f60 tx=0x7f00e4004a70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.037+0000 7f00ea7fc700 1 -- 172.21.15.81:0/3380117596 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f00ec051de0 con 0x7f00f40b8250 2023-11-29T11:14:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.233+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00f4072500 con 0x7f00f40b8250 2023-11-29T11:14:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00ea7fc700 1 -- 172.21.15.81:0/3380117596 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4644 (secure 0 0 0) 0x7f00ec055400 con 0x7f00f40b8250 2023-11-29T11:14:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:03.241 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:12:52.329725+0000","modified":"2023-11-29T11:13:14.009106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-29T11:14:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f00d8064ee0 msgr2=0x7f00d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f00d8064ee0 0x7f00d8067390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00e4000f60 tx=0x7f00e4004a70 comp rx=0 tx=0).stop 2023-11-29T11:14:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f40b8250 msgr2=0x7f00f415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f40b8250 0x7f00f415f100 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f00ec014040 tx=0x7f00ec004af0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 shutdown_connections 2023-11-29T11:14:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f00d8064ee0 0x7f00d8067390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f40b8250 0x7f00f415f100 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00f406a800 0x7f00f415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 --2- 172.21.15.81:0/3380117596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00f406a350 0x7f00f4158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 >> 172.21.15.81:0/3380117596 conn(0x7f00f406beb0 msgr2=0x7f00f40b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 shutdown_connections 2023-11-29T11:14:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.237+0000 7f00fc19f700 1 -- 172.21.15.81:0/3380117596 wait complete. 2023-11-29T11:14:03.246 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-11-29T11:14:03.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0729ecd700 1 Processor -- start 2023-11-29T11:14:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0729ecd700 1 -- start start 2023-11-29T11:14:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0729ecd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f07240cf050 0x7f072406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0729ecd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0729ecd700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072415c6d0 con 0x7f072406a530 2023-11-29T11:14:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0729ecd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072406a9d0 con 0x7f07240cf050 2023-11-29T11:14:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0729ecd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072406ac60 con 0x7f07240b4c10 2023-11-29T11:14:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f07296cc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0728ecb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f07240cf050 0x7f072406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0728ecb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f07240cf050 0x7f072406d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58124/0 (socket says 172.21.15.81:58124) 2023-11-29T11:14:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0723fff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f072406a530 0x7f07240cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:45626/0 (socket says 172.21.15.81:45626) 2023-11-29T11:14:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0728ecb700 1 -- 172.21.15.81:0/1219500042 learned_addr learned my addr 172.21.15.81:0/1219500042 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0728ecb700 1 -- 172.21.15.81:0/1219500042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 msgr2=0x7f07240cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0728ecb700 1 --2- 172.21.15.81:0/1219500042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0728ecb700 1 -- 172.21.15.81:0/1219500042 >> v1:172.21.15.176:6789/0 conn(0x7f072406a530 legacy=0x7f07240cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0728ecb700 1 -- 172.21.15.81:0/1219500042 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072406af40 con 0x7f07240cf050 2023-11-29T11:14:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f07296cc700 1 --2- 172.21.15.81:0/1219500042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.357+0000 7f0728ecb700 1 --2- 172.21.15.81:0/1219500042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 0x7f072406d7d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0714009910 tx=0x7f0714009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adccd1660c5e78f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f07237fe700 1 -- 172.21.15.81:0/1219500042 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714011830 con 0x7f07240cf050 2023-11-29T11:14:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f07237fe700 1 -- 172.21.15.81:0/1219500042 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714011990 con 0x7f07240cf050 2023-11-29T11:14:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f07237fe700 1 -- 172.21.15.81:0/1219500042 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714011d40 con 0x7f07240cf050 2023-11-29T11:14:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 -- 172.21.15.81:0/1219500042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 msgr2=0x7f072406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 --2- 172.21.15.81:0/1219500042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 0x7f072406d7d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0714009910 tx=0x7f0714009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 -- 172.21.15.81:0/1219500042 shutdown_connections 2023-11-29T11:14:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 --2- 172.21.15.81:0/1219500042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 --2- 172.21.15.81:0/1219500042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 0x7f072406d7d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 -- 172.21.15.81:0/1219500042 >> 172.21.15.81:0/1219500042 conn(0x7f072409bb30 msgr2=0x7f07240b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 -- 172.21.15.81:0/1219500042 shutdown_connections 2023-11-29T11:14:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 -- 172.21.15.81:0/1219500042 wait complete. 2023-11-29T11:14:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 Processor -- start 2023-11-29T11:14:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.361+0000 7f0729ecd700 1 -- start start 2023-11-29T11:14:03.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072406a530 0x7f0724149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 0x7f07240afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240c8dd0 con 0x7f072406a530 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240c81c0 con 0x7f07240cf050 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07240c84a0 con 0x7f07240b4c10 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072406a530 0x7f0724149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072406a530 0x7f0724149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59068/0 (socket says 172.21.15.81:59068) 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 -- 172.21.15.81:0/3427842032 learned_addr learned my addr 172.21.15.81:0/3427842032 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f07296cc700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 0x7f07240afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0723fff700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 -- 172.21.15.81:0/3427842032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 msgr2=0x7f07240c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 -- 172.21.15.81:0/3427842032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 msgr2=0x7f07240afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 0x7f07240afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 -- 172.21.15.81:0/3427842032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c009a70 con 0x7f072406a530 2023-11-29T11:14:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0728ecb700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072406a530 0x7f0724149010 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0714000c00 tx=0x7f0714004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f07217fa700 1 -- 172.21.15.81:0/3427842032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714004450 con 0x7f072406a530 2023-11-29T11:14:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f07217fa700 1 -- 172.21.15.81:0/3427842032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07140045d0 con 0x7f072406a530 2023-11-29T11:14:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0714009570 con 0x7f072406a530 2023-11-29T11:14:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f07217fa700 1 -- 172.21.15.81:0/3427842032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714003900 con 0x7f072406a530 2023-11-29T11:14:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07240b46f0 con 0x7f072406a530 2023-11-29T11:14:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07240b4410 con 0x7f072406a530 2023-11-29T11:14:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.365+0000 7f07217fa700 1 -- 172.21.15.81:0/3427842032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f071402d070 con 0x7f072406a530 2023-11-29T11:14:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.369+0000 7f07217fa700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0710064f10 0x7f07100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.369+0000 7f07217fa700 1 -- 172.21.15.81:0/3427842032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0714021030 con 0x7f072406a530 2023-11-29T11:14:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.369+0000 7f0723fff700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0710064f10 0x7f07100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.369+0000 7f0723fff700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0710064f10 0x7f07100673c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07240c7f40 tx=0x7f0718007ef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.373+0000 7f07217fa700 1 -- 172.21.15.81:0/3427842032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0714051440 con 0x7f072406a530 2023-11-29T11:14:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.541+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f072406b1f0 con 0x7f072406a530 2023-11-29T11:14:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.541+0000 7f07217fa700 1 -- 172.21.15.81:0/3427842032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f071402b090 con 0x7f072406a530 2023-11-29T11:14:03.549 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:03.549 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:03.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0710064f10 msgr2=0x7f07100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0710064f10 0x7f07100673c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07240c7f40 tx=0x7f0718007ef0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072406a530 msgr2=0x7f0724149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072406a530 0x7f0724149010 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0714000c00 tx=0x7f0714004770 comp rx=0 tx=0).stop 2023-11-29T11:14:03.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 shutdown_connections 2023-11-29T11:14:03.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0710064f10 0x7f07100673c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07240cf050 0x7f07240afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07240b4c10 0x7f07240c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 --2- 172.21.15.81:0/3427842032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f072406a530 0x7f0724149010 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 >> 172.21.15.81:0/3427842032 conn(0x7f072409bb30 msgr2=0x7f07240b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:03.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 shutdown_connections 2023-11-29T11:14:03.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.545+0000 7f0729ecd700 1 -- 172.21.15.81:0/3427842032 wait complete. 2023-11-29T11:14:03.564 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T11:14:03.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bb59e700 1 Processor -- start 2023-11-29T11:14:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bb59e700 1 -- start start 2023-11-29T11:14:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bb59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc06c0a0 0x7f14bc06c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14bc06cbb0 0x7f14bc15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bb59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc06d000 con 0x7f14bc0ca310 2023-11-29T11:14:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bb59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc06c4f0 con 0x7f14bc06cbb0 2023-11-29T11:14:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bb59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0cdeb0 con 0x7f14bc06c0a0 2023-11-29T11:14:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14bc06cbb0 0x7f14bc15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14bc06cbb0 0x7f14bc15b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59072/0 (socket says 172.21.15.81:59072) 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bad9d700 1 -- 172.21.15.81:0/4278170725 learned_addr learned my addr 172.21.15.81:0/4278170725 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14b9d9b700 1 --2- 172.21.15.81:0/4278170725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc06c0a0 0x7f14bc06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bad9d700 1 -- 172.21.15.81:0/4278170725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc06c0a0 msgr2=0x7f14bc06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bad9d700 1 --2- 172.21.15.81:0/4278170725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc06c0a0 0x7f14bc06c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bad9d700 1 -- 172.21.15.81:0/4278170725 >> v1:172.21.15.81:6789/0 conn(0x7f14bc0ca310 legacy=0x7f14bc069eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bad9d700 1 -- 172.21.15.81:0/4278170725 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0cca10 con 0x7f14bc06cbb0 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14bad9d700 1 --2- 172.21.15.81:0/4278170725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06cbb0 0x7f14bc15b9f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009910 tx=0x7f14b4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c507cef3f4de72 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14b959a700 1 -- 172.21.15.81:0/4278170725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400ba60 con 0x7f14bc06cbb0 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14b959a700 1 -- 172.21.15.81:0/4278170725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b400bbc0 con 0x7f14bc06cbb0 2023-11-29T11:14:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.669+0000 7f14b959a700 1 -- 172.21.15.81:0/4278170725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4009e60 con 0x7f14bc06cbb0 2023-11-29T11:14:03.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 -- 172.21.15.81:0/4278170725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06cbb0 msgr2=0x7f14bc15b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4278170725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06cbb0 0x7f14bc15b9f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009910 tx=0x7f14b4009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:03.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 -- 172.21.15.81:0/4278170725 shutdown_connections 2023-11-29T11:14:03.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4278170725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06cbb0 0x7f14bc15b9f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4278170725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc06c0a0 0x7f14bc06c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 -- 172.21.15.81:0/4278170725 >> 172.21.15.81:0/4278170725 conn(0x7f14bc0ce3e0 msgr2=0x7f14bc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:03.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 -- 172.21.15.81:0/4278170725 shutdown_connections 2023-11-29T11:14:03.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 -- 172.21.15.81:0/4278170725 wait complete. 2023-11-29T11:14:03.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 Processor -- start 2023-11-29T11:14:03.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.673+0000 7f14bb59e700 1 -- start start 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06c0a0 0x7f14bc097770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bb59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06cbb0 0x7f14bc149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bb59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc0ca310 0x7f14bc0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc1e5dd0 con 0x7f14bc06c0a0 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bb59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc15c050 con 0x7f14bc06cbb0 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bb59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc15a7c0 con 0x7f14bc0ca310 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06c0a0 0x7f14bc097770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06c0a0 0x7f14bc097770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59086/0 (socket says 172.21.15.81:59086) 2023-11-29T11:14:03.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 -- 172.21.15.81:0/4250511684 learned_addr learned my addr 172.21.15.81:0/4250511684 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:03.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14b9d9b700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06cbb0 0x7f14bc149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bad9d700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc0ca310 0x7f14bc0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 -- 172.21.15.81:0/4250511684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc0ca310 msgr2=0x7f14bc0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc0ca310 0x7f14bc0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 -- 172.21.15.81:0/4250511684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06cbb0 msgr2=0x7f14bc149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06cbb0 0x7f14bc149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 -- 172.21.15.81:0/4250511684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4009570 con 0x7f14bc06c0a0 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14ba59c700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06c0a0 0x7f14bc097770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c560 tx=0x7f14b000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14aaffd700 1 -- 172.21.15.81:0/4250511684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00052d0 con 0x7f14bc06c0a0 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14aaffd700 1 -- 172.21.15.81:0/4250511684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b000ce90 con 0x7f14bc06c0a0 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc06a950 con 0x7f14bc06c0a0 2023-11-29T11:14:03.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14aaffd700 1 -- 172.21.15.81:0/4250511684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00036a0 con 0x7f14bc06c0a0 2023-11-29T11:14:03.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.677+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc06a670 con 0x7f14bc06c0a0 2023-11-29T11:14:03.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.681+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc06ac30 con 0x7f14bc06c0a0 2023-11-29T11:14:03.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.681+0000 7f14aaffd700 1 -- 172.21.15.81:0/4250511684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f14b0019030 con 0x7f14bc06c0a0 2023-11-29T11:14:03.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.681+0000 7f14aaffd700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f149c064ee0 0x7f149c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:03.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.681+0000 7f14aaffd700 1 -- 172.21.15.81:0/4250511684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f14b0081300 con 0x7f14bc06c0a0 2023-11-29T11:14:03.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.681+0000 7f14b9d9b700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f149c064ee0 0x7f149c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:03.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.681+0000 7f14b9d9b700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f149c064ee0 0x7f149c067390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f14bc158d30 tx=0x7f14ac0098a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.689+0000 7f14aaffd700 1 -- 172.21.15.81:0/4250511684 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f14b004f080 con 0x7f14bc06c0a0 2023-11-29T11:14:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.885+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14bc06d000 con 0x7f14bc06c0a0 2023-11-29T11:14:03.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14aaffd700 1 -- 172.21.15.81:0/4250511684 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4644 (secure 0 0 0) 0x7f14bc06d000 con 0x7f14bc06c0a0 2023-11-29T11:14:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:03.894 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:12:52.329725+0000","modified":"2023-11-29T11:13:14.009106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-29T11:14:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f149c064ee0 msgr2=0x7f149c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f149c064ee0 0x7f149c067390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f14bc158d30 tx=0x7f14ac0098a0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06c0a0 msgr2=0x7f14bc097770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06c0a0 0x7f14bc097770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c560 tx=0x7f14b000c870 comp rx=0 tx=0).stop 2023-11-29T11:14:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 shutdown_connections 2023-11-29T11:14:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f149c064ee0 0x7f149c067390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14bc0ca310 0x7f14bc0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14bc06cbb0 0x7f14bc149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 --2- 172.21.15.81:0/4250511684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc06c0a0 0x7f14bc097770 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 >> 172.21.15.81:0/4250511684 conn(0x7f14bc0ce3e0 msgr2=0x7f14bc0c76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 shutdown_connections 2023-11-29T11:14:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:03.889+0000 7f14bb59e700 1 -- 172.21.15.81:0/4250511684 wait complete. 2023-11-29T11:14:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-11-29T11:14:03.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc340f59700 1 Processor -- start 2023-11-29T11:14:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc340f59700 1 -- start start 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc340f59700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3340dee50 0x7fc33404f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc340f59700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33404f880 0x7fc33404fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc340f59700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3340064d0 con 0x7fc334006960 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc340f59700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc334050210 con 0x7fc3340dee50 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc340f59700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340df220 con 0x7fc33404f880 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc33b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3340dee50 0x7fc33404f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc33b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3340dee50 0x7fc33404f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59088/0 (socket says 172.21.15.81:59088) 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc33b7fe700 1 -- 172.21.15.81:0/1032670748 learned_addr learned my addr 172.21.15.81:0/1032670748 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc33affd700 1 --2- 172.21.15.81:0/1032670748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33404f880 0x7fc33404fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc33b7fe700 1 -- 172.21.15.81:0/1032670748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33404f880 msgr2=0x7fc33404fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc33b7fe700 1 --2- 172.21.15.81:0/1032670748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33404f880 0x7fc33404fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc33b7fe700 1 -- 172.21.15.81:0/1032670748 >> v1:172.21.15.176:6789/0 conn(0x7fc334006960 legacy=0x7fc334006de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.017+0000 7fc33b7fe700 1 -- 172.21.15.81:0/1032670748 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3340340b0 con 0x7fc3340dee50 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc33b7fe700 1 --2- 172.21.15.81:0/1032670748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3340dee50 0x7fc33404f340 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc328009910 tx=0x7fc328009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a62cac2ce5a4f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1032670748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328011830 con 0x7fc3340dee50 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1032670748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc328011990 con 0x7fc3340dee50 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc33a7fc700 1 -- 172.21.15.81:0/1032670748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328011d40 con 0x7fc3340dee50 2023-11-29T11:14:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc340f59700 1 -- 172.21.15.81:0/1032670748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3340dee50 msgr2=0x7fc33404f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc340f59700 1 --2- 172.21.15.81:0/1032670748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3340dee50 0x7fc33404f340 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc328009910 tx=0x7fc328009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:04.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc340f59700 1 -- 172.21.15.81:0/1032670748 shutdown_connections 2023-11-29T11:14:04.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc340f59700 1 --2- 172.21.15.81:0/1032670748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc33404f880 0x7fc33404fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc340f59700 1 --2- 172.21.15.81:0/1032670748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3340dee50 0x7fc33404f340 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc340f59700 1 -- 172.21.15.81:0/1032670748 >> 172.21.15.81:0/1032670748 conn(0x7fc334051770 msgr2=0x7fc334051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:04.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc340f59700 1 -- 172.21.15.81:0/1032670748 shutdown_connections 2023-11-29T11:14:04.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.021+0000 7fc340f59700 1 -- 172.21.15.81:0/1032670748 wait complete. 2023-11-29T11:14:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 Processor -- start 2023-11-29T11:14:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 -- start start 2023-11-29T11:14:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc334006960 0x7fc33404a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33404f880 0x7fc334051b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3340dee50 0x7fc334052080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33404ddf0 con 0x7fc33404f880 2023-11-29T11:14:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340d29f0 con 0x7fc334006960 2023-11-29T11:14:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340d2cd0 con 0x7fc3340dee50 2023-11-29T11:14:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33404f880 0x7fc334051b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33b7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc334006960 0x7fc33404a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33404f880 0x7fc334051b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59102/0 (socket says 172.21.15.81:59102) 2023-11-29T11:14:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33affd700 1 -- 172.21.15.81:0/1660892289 learned_addr learned my addr 172.21.15.81:0/1660892289 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33bfff700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3340dee50 0x7fc334052080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33b7fe700 1 -- 172.21.15.81:0/1660892289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3340dee50 msgr2=0x7fc334052080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33b7fe700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3340dee50 0x7fc334052080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33b7fe700 1 -- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33404f880 msgr2=0x7fc334051b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33b7fe700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33404f880 0x7fc334051b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33b7fe700 1 -- 172.21.15.81:0/1660892289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009570 con 0x7fc334006960 2023-11-29T11:14:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33affd700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33404f880 0x7fc334051b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc33b7fe700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc334006960 0x7fc33404a9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc328016000 tx=0x7fc328004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc327fff700 1 -- 172.21.15.81:0/1660892289 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328004510 con 0x7fc334006960 2023-11-29T11:14:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc327fff700 1 -- 172.21.15.81:0/1660892289 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32801e070 con 0x7fc334006960 2023-11-29T11:14:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc327fff700 1 -- 172.21.15.81:0/1660892289 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280038c0 con 0x7fc334006960 2023-11-29T11:14:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc334054770 con 0x7fc334006960 2023-11-29T11:14:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.025+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc334054490 con 0x7fc334006960 2023-11-29T11:14:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.029+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc334006160 con 0x7fc334006960 2023-11-29T11:14:04.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.029+0000 7fc327fff700 1 -- 172.21.15.81:0/1660892289 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc32800f050 con 0x7fc334006960 2023-11-29T11:14:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.029+0000 7fc327fff700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc320064ee0 0x7fc320067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.029+0000 7fc327fff700 1 -- 172.21.15.81:0/1660892289 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc328083120 con 0x7fc334006960 2023-11-29T11:14:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.029+0000 7fc33affd700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc320064ee0 0x7fc320067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.029+0000 7fc33affd700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc320064ee0 0x7fc320067390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc334036550 tx=0x7fc330009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.041+0000 7fc327fff700 1 -- 172.21.15.81:0/1660892289 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc328050f90 con 0x7fc334006960 2023-11-29T11:14:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.237+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc334005570 con 0x7fc334006960 2023-11-29T11:14:04.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.237+0000 7fc327fff700 1 -- 172.21.15.81:0/1660892289 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4644 (secure 0 0 0) 0x7fc3280545b0 con 0x7fc334006960 2023-11-29T11:14:04.245 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:04.245 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/196764735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":196764735},{"type":"v1","addr":"172.21.15.176:6834","nonce":196764735}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3645307516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":3645307516},{"type":"v1","addr":"172.21.15.176:6835","nonce":3645307516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/899748659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":899748659},{"type":"v1","addr":"172.21.15.81:6835","nonce":899748659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:12:52.329725+0000","modified":"2023-11-29T11:13:14.009106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3562625855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3562625855},{"type":"v1","addr":"172.21.15.81:6837","nonce":3562625855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-29T11:14:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc320064ee0 msgr2=0x7fc320067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc320064ee0 0x7fc320067390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc334036550 tx=0x7fc330009240 comp rx=0 tx=0).stop 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc334006960 msgr2=0x7fc33404a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc334006960 0x7fc33404a9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc328016000 tx=0x7fc328004770 comp rx=0 tx=0).stop 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 shutdown_connections 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc320064ee0 0x7fc320067390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3340dee50 0x7fc334052080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33404f880 0x7fc334051b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 --2- 172.21.15.81:0/1660892289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc334006960 0x7fc33404a9f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 >> 172.21.15.81:0/1660892289 conn(0x7fc334051770 msgr2=0x7fc3340dc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 shutdown_connections 2023-11-29T11:14:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.241+0000 7fc340f59700 1 -- 172.21.15.81:0/1660892289 wait complete. 2023-11-29T11:14:04.249 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2023-11-29T11:14:04.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e5c8c2700 1 Processor -- start 2023-11-29T11:14:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e5c8c2700 1 -- start start 2023-11-29T11:14:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e5c8c2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e50036e80 0x7f9e500f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e5c8c2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e50053df0 con 0x7f9e500e6e60 2023-11-29T11:14:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e5c8c2700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5004fa50 con 0x7f9e500512b0 2023-11-29T11:14:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e5c8c2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e500486b0 con 0x7f9e50036e80 2023-11-29T11:14:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e56d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9e500e6e60 0x7f9e5004f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39058/0 (socket says 172.21.15.81:39058) 2023-11-29T11:14:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e56d9d700 1 -- 172.21.15.81:0/461713205 learned_addr learned my addr 172.21.15.81:0/461713205 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e5759e700 1 --2- 172.21.15.81:0/461713205 >> v2:172.21.15.81:3300/0 conn(0x7f9e50036e80 0x7f9e500f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e55d9b700 1 -- 172.21.15.81:0/461713205 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946118584 0 0) 0x7f9e50053df0 con 0x7f9e500e6e60 2023-11-29T11:14:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.369+0000 7f9e55d9b700 1 -- 172.21.15.81:0/461713205 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e400035d0 con 0x7f9e500e6e60 2023-11-29T11:14:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5759e700 1 -- 172.21.15.81:0/461713205 >> v1:172.21.15.176:6789/0 conn(0x7f9e500512b0 legacy=0x7f9e50036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5759e700 1 -- 172.21.15.81:0/461713205 >> v1:172.21.15.81:6789/0 conn(0x7f9e500e6e60 legacy=0x7f9e5004f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5759e700 1 -- 172.21.15.81:0/461713205 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e50033a80 con 0x7f9e50036e80 2023-11-29T11:14:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5759e700 1 --2- 172.21.15.81:0/461713205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500f18a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9e5802cad0 tx=0x7f9e5804e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2dee9930635ab5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e55d9b700 1 -- 172.21.15.81:0/461713205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58067660 con 0x7f9e50036e80 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e55d9b700 1 -- 172.21.15.81:0/461713205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e580727d0 con 0x7f9e50036e80 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e55d9b700 1 -- 172.21.15.81:0/461713205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58072bc0 con 0x7f9e50036e80 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/461713205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 msgr2=0x7f9e500f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 --2- 172.21.15.81:0/461713205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500f18a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9e5802cad0 tx=0x7f9e5804e8b0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/461713205 shutdown_connections 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 --2- 172.21.15.81:0/461713205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500f18a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/461713205 >> 172.21.15.81:0/461713205 conn(0x7f9e50051770 msgr2=0x7f9e50051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/461713205 shutdown_connections 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/461713205 wait complete. 2023-11-29T11:14:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 Processor -- start 2023-11-29T11:14:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.373+0000 7f9e5c8c2700 1 -- start start 2023-11-29T11:14:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e500512b0 0x7f9e50048820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e500e6e60 0x7f9e500e22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500cc620 con 0x7f9e50036e80 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5004be60 con 0x7f9e500e6e60 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5004c140 con 0x7f9e500512b0 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59120/0 (socket says 172.21.15.81:59120) 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 -- 172.21.15.81:0/1056764890 learned_addr learned my addr 172.21.15.81:0/1056764890 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5759e700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e500e6e60 0x7f9e500e22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5659c700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e500512b0 0x7f9e50048820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 -- 172.21.15.81:0/1056764890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e500512b0 msgr2=0x7f9e50048820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e500512b0 0x7f9e50048820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 -- 172.21.15.81:0/1056764890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e500e6e60 msgr2=0x7f9e500e22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e500e6e60 0x7f9e500e22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 -- 172.21.15.81:0/1056764890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5804e720 con 0x7f9e50036e80 2023-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e56d9d700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500cc0e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c4d0 tx=0x7f9e4c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e3f7fe700 1 -- 172.21.15.81:0/1056764890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c005d90 con 0x7f9e50036e80 2023-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e3f7fe700 1 -- 172.21.15.81:0/1056764890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c0070d0 con 0x7f9e50036e80 2023-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e50034040 con 0x7f9e50036e80 2023-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e3f7fe700 1 -- 172.21.15.81:0/1056764890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c007480 con 0x7f9e50036e80 2023-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e50033d60 con 0x7f9e50036e80 2023-11-29T11:14:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e50034320 con 0x7f9e50036e80 2023-11-29T11:14:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.377+0000 7f9e3f7fe700 1 -- 172.21.15.81:0/1056764890 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9e4c019030 con 0x7f9e50036e80 2023-11-29T11:14:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.381+0000 7f9e3f7fe700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9e44064ee0 0x7f9e44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.381+0000 7f9e5659c700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9e44064ee0 0x7f9e44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.381+0000 7f9e3f7fe700 1 -- 172.21.15.81:0/1056764890 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9e4c0815d0 con 0x7f9e50036e80 2023-11-29T11:14:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.381+0000 7f9e5659c700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9e44064ee0 0x7f9e44067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e500337f0 tx=0x7f9e48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.385+0000 7f9e3f7fe700 1 -- 172.21.15.81:0/1056764890 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9e4c04f2c0 con 0x7f9e50036e80 2023-11-29T11:14:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.545+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e50005570 con 0x7f9e50036e80 2023-11-29T11:14:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.549+0000 7f9e3f7fe700 1 -- 172.21.15.81:0/1056764890 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f9e4c017090 con 0x7f9e50036e80 2023-11-29T11:14:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:13:42.013520+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:12:50.097703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-29T11:12:51.324606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-29T11:12:54.394893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.35","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9e44064ee0 msgr2=0x7f9e44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9e44064ee0 0x7f9e44067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e500337f0 tx=0x7f9e48009040 comp rx=0 tx=0).stop 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 msgr2=0x7f9e500cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500cc0e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c4d0 tx=0x7f9e4c00c7e0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 shutdown_connections 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9e44064ee0 0x7f9e44067390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e500e6e60 0x7f9e500e22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e500512b0 0x7f9e50048820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 --2- 172.21.15.81:0/1056764890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e50036e80 0x7f9e500cc0e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 >> 172.21.15.81:0/1056764890 conn(0x7f9e50051770 msgr2=0x7f9e50052c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:04.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 shutdown_connections 2023-11-29T11:14:04.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.553+0000 7f9e5c8c2700 1 -- 172.21.15.81:0/1056764890 wait complete. 2023-11-29T11:14:04.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:14:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.677+0000 7f89fbfff700 1 Processor -- start 2023-11-29T11:14:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.677+0000 7f89fbfff700 1 -- start start 2023-11-29T11:14:04.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.677+0000 7f89fbfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f89fc0cf050 0x7f89fc06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.677+0000 7f89fbfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89fc06a530 0x7f89fc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.677+0000 7f89fbfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 0x7f89fc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.677+0000 7f89fbfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc15c6d0 con 0x7f89fc06a530 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.677+0000 7f89fbfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc06a9d0 con 0x7f89fc0cf050 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.677+0000 7f89fbfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0cf960 con 0x7f89fc0b4c10 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89fc06a530 0x7f89fc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89fc06a530 0x7f89fc0cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59134/0 (socket says 172.21.15.81:59134) 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 -- 172.21.15.81:0/1089600479 learned_addr learned my addr 172.21.15.81:0/1089600479 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89faffd700 1 --2- 172.21.15.81:0/1089600479 >> v2:172.21.15.176:3300/0 conn(0x7f89fc0cf050 0x7f89fc06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fb7fe700 1 --2- 172.21.15.81:0/1089600479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 0x7f89fc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 -- 172.21.15.81:0/1089600479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 msgr2=0x7f89fc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 --2- 172.21.15.81:0/1089600479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 0x7f89fc0cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 -- 172.21.15.81:0/1089600479 >> v2:172.21.15.176:3300/0 conn(0x7f89fc0cf050 msgr2=0x7f89fc06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 --2- 172.21.15.81:0/1089600479 >> v2:172.21.15.176:3300/0 conn(0x7f89fc0cf050 0x7f89fc06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 -- 172.21.15.81:0/1089600479 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc06ac60 con 0x7f89fc06a530 2023-11-29T11:14:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89faffd700 1 --2- 172.21.15.81:0/1089600479 >> v2:172.21.15.176:3300/0 conn(0x7f89fc0cf050 0x7f89fc06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fa7fc700 1 --2- 172.21.15.81:0/1089600479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc06a530 0x7f89fc0cf420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f89fc08b9c0 tx=0x7f89ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdbad489f2ee19f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89f9ffb700 1 -- 172.21.15.81:0/1089600479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00b8a0 con 0x7f89fc06a530 2023-11-29T11:14:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89f9ffb700 1 -- 172.21.15.81:0/1089600479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00ba00 con 0x7f89fc06a530 2023-11-29T11:14:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89f9ffb700 1 -- 172.21.15.81:0/1089600479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00bd90 con 0x7f89fc06a530 2023-11-29T11:14:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 -- 172.21.15.81:0/1089600479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc06a530 msgr2=0x7f89fc0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 --2- 172.21.15.81:0/1089600479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc06a530 0x7f89fc0cf420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f89fc08b9c0 tx=0x7f89ec009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 -- 172.21.15.81:0/1089600479 shutdown_connections 2023-11-29T11:14:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 --2- 172.21.15.81:0/1089600479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 0x7f89fc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 --2- 172.21.15.81:0/1089600479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc06a530 0x7f89fc0cf420 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 --2- 172.21.15.81:0/1089600479 >> v2:172.21.15.176:3300/0 conn(0x7f89fc0cf050 0x7f89fc06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 -- 172.21.15.81:0/1089600479 >> 172.21.15.81:0/1089600479 conn(0x7f89fc09bb30 msgr2=0x7f89fc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 -- 172.21.15.81:0/1089600479 shutdown_connections 2023-11-29T11:14:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.681+0000 7f89fbfff700 1 -- 172.21.15.81:0/1089600479 wait complete. 2023-11-29T11:14:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fbfff700 1 Processor -- start 2023-11-29T11:14:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fbfff700 1 -- start start 2023-11-29T11:14:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fbfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89fc06a530 0x7f89fc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fbfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 0x7f89fc1f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc0cf050 0x7f89fc1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc1f48b0 con 0x7f89fc0cf050 2023-11-29T11:14:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fbfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0c6300 con 0x7f89fc06a530 2023-11-29T11:14:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fbfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0c8890 con 0x7f89fc0b4c10 2023-11-29T11:14:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc0cf050 0x7f89fc1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc0cf050 0x7f89fc1f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59142/0 (socket says 172.21.15.81:59142) 2023-11-29T11:14:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fb7fe700 1 -- 172.21.15.81:0/2669434315 learned_addr learned my addr 172.21.15.81:0/2669434315 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89fa7fc700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 0x7f89fc1f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.685+0000 7f89faffd700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89fc06a530 0x7f89fc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fb7fe700 1 -- 172.21.15.81:0/2669434315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 msgr2=0x7f89fc1f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fb7fe700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 0x7f89fc1f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fb7fe700 1 -- 172.21.15.81:0/2669434315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89fc06a530 msgr2=0x7f89fc0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fb7fe700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89fc06a530 0x7f89fc0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fb7fe700 1 -- 172.21.15.81:0/2669434315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009570 con 0x7f89fc0cf050 2023-11-29T11:14:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fb7fe700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc0cf050 0x7f89fc1f4370 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f89f4007e60 tx=0x7f89f400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89f37fe700 1 -- 172.21.15.81:0/2669434315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f400ed30 con 0x7f89fc0cf050 2023-11-29T11:14:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89f37fe700 1 -- 172.21.15.81:0/2669434315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f4014420 con 0x7f89fc0cf050 2023-11-29T11:14:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc0b4410 con 0x7f89fc0cf050 2023-11-29T11:14:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89f37fe700 1 -- 172.21.15.81:0/2669434315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40147d0 con 0x7f89fc0cf050 2023-11-29T11:14:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc06af40 con 0x7f89fc0cf050 2023-11-29T11:14:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc0b46f0 con 0x7f89fc0cf050 2023-11-29T11:14:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.689+0000 7f89f37fe700 1 -- 172.21.15.81:0/2669434315 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f89f4012050 con 0x7f89fc0cf050 2023-11-29T11:14:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.693+0000 7f89f37fe700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f89dc064ee0 0x7f89dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.693+0000 7f89f37fe700 1 -- 172.21.15.81:0/2669434315 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f89f4082670 con 0x7f89fc0cf050 2023-11-29T11:14:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.693+0000 7f89faffd700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f89dc064ee0 0x7f89dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.693+0000 7f89faffd700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f89dc064ee0 0x7f89dc067390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f89e40044b0 tx=0x7f89e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.701+0000 7f89f37fe700 1 -- 172.21.15.81:0/2669434315 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f89f40504e0 con 0x7f89fc0cf050 2023-11-29T11:14:04.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:04.901+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f89fc072500 con 0x7f89fc0cf050 2023-11-29T11:14:05.179 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:14:05.173+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:14:05.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.189+0000 7f89f37fe700 1 -- 172.21.15.81:0/2669434315 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f89f4053b00 con 0x7f89fc0cf050 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f89dc064ee0 msgr2=0x7f89dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f89dc064ee0 0x7f89dc067390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f89e40044b0 tx=0x7f89e4008040 comp rx=0 tx=0).stop 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc0cf050 msgr2=0x7f89fc1f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc0cf050 0x7f89fc1f4370 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f89f4007e60 tx=0x7f89f400e3c0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 shutdown_connections 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f89dc064ee0 0x7f89dc067390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89fc0cf050 0x7f89fc1f4370 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89fc0b4c10 0x7f89fc1f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 --2- 172.21.15.81:0/2669434315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89fc06a530 0x7f89fc0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 >> 172.21.15.81:0/2669434315 conn(0x7f89fc09bb30 msgr2=0x7f89fc0657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 shutdown_connections 2023-11-29T11:14:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.193+0000 7f89fbfff700 1 -- 172.21.15.81:0/2669434315 wait complete. 2023-11-29T11:14:05.200 INFO:tasks.ceph.mds.c.smithi081.stderr: -4194> 2023-11-29T11:12:58.203+0000 7fd6d4139700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:14:05.200 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:14:05.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T11:14:05.236 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:14:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.329+0000 7f286d08f700 1 Processor -- start 2023-11-29T11:14:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.329+0000 7f286d08f700 1 -- start start 2023-11-29T11:14:05.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.329+0000 7f286d08f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2868158480 0x7f28680cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:05.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.329+0000 7f286d08f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28680cd3a0 0x7f28680ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.329+0000 7f286d08f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286806a4d0 con 0x7f2868158850 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680cc1f0 con 0x7f2868158480 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28680cc490 con 0x7f28680cd3a0 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f2867fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2868158480 0x7f28680cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286c88e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28680cd3a0 0x7f28680ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f2867fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2868158480 0x7f28680cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58218/0 (socket says 172.21.15.81:58218) 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f28677fe700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2868158850 0x7f28680c9410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:45654/0 (socket says 172.21.15.81:45654) 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f2867fff700 1 -- 172.21.15.81:0/1868689399 learned_addr learned my addr 172.21.15.81:0/1868689399 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286c88e700 1 -- 172.21.15.81:0/1868689399 >> v2:172.21.15.176:3300/0 conn(0x7f2868158480 msgr2=0x7f28680cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286c88e700 1 --2- 172.21.15.81:0/1868689399 >> v2:172.21.15.176:3300/0 conn(0x7f2868158480 0x7f28680cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286c88e700 1 -- 172.21.15.81:0/1868689399 >> v1:172.21.15.176:6789/0 conn(0x7f2868158850 legacy=0x7f28680c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286c88e700 1 -- 172.21.15.81:0/1868689399 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286806a720 con 0x7f28680cd3a0 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286c88e700 1 --2- 172.21.15.81:0/1868689399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28680cd3a0 0x7f28680ceca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f286000aea0 tx=0x7f286000c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e50f4c1b0a87404 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f2866ffd700 1 -- 172.21.15.81:0/1868689399 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000f070 con 0x7f28680cd3a0 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f2866ffd700 1 -- 172.21.15.81:0/1868689399 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000a2e0 con 0x7f28680cd3a0 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f2866ffd700 1 -- 172.21.15.81:0/1868689399 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000cb50 con 0x7f28680cd3a0 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 -- 172.21.15.81:0/1868689399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28680cd3a0 msgr2=0x7f28680ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 --2- 172.21.15.81:0/1868689399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28680cd3a0 0x7f28680ceca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f286000aea0 tx=0x7f286000c330 comp rx=0 tx=0).stop 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 -- 172.21.15.81:0/1868689399 shutdown_connections 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 --2- 172.21.15.81:0/1868689399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28680cd3a0 0x7f28680ceca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 --2- 172.21.15.81:0/1868689399 >> v2:172.21.15.176:3300/0 conn(0x7f2868158480 0x7f28680cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 -- 172.21.15.81:0/1868689399 >> 172.21.15.81:0/1868689399 conn(0x7f286806c660 msgr2=0x7f286806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 -- 172.21.15.81:0/1868689399 shutdown_connections 2023-11-29T11:14:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.333+0000 7f286d08f700 1 -- 172.21.15.81:0/1868689399 wait complete. 2023-11-29T11:14:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286d08f700 1 Processor -- start 2023-11-29T11:14:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286d08f700 1 -- start start 2023-11-29T11:14:05.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286d08f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28680cd3a0 0x7f28680c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286d08f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2868158480 0x7f28680b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286d08f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2868158850 0x7f28680b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286d08f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286814acf0 con 0x7f2868158850 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286d08f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680b4030 con 0x7f28680cd3a0 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286d08f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28680c6470 con 0x7f2868158480 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2868158850 0x7f28680b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2868158850 0x7f28680b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59160/0 (socket says 172.21.15.81:59160) 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 -- 172.21.15.81:0/1842078797 learned_addr learned my addr 172.21.15.81:0/1842078797 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f2867fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28680cd3a0 0x7f28680c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f28677fe700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2868158480 0x7f28680b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 -- 172.21.15.81:0/1842078797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2868158480 msgr2=0x7f28680b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2868158480 0x7f28680b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 -- 172.21.15.81:0/1842078797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28680cd3a0 msgr2=0x7f28680c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28680cd3a0 0x7f28680c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 -- 172.21.15.81:0/1842078797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286000ab80 con 0x7f2868158850 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f286c88e700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2868158850 0x7f28680b3af0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f286000c680 tx=0x7f2860004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.337+0000 7f2864ff9700 1 -- 172.21.15.81:0/1842078797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860007000 con 0x7f2868158850 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f2864ff9700 1 -- 172.21.15.81:0/1842078797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860004250 con 0x7f2868158850 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286806ace0 con 0x7f2868158850 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f2864ff9700 1 -- 172.21.15.81:0/1842078797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600045e0 con 0x7f2868158850 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286806aa00 con 0x7f2868158850 2023-11-29T11:14:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28680cf1e0 con 0x7f2868158850 2023-11-29T11:14:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f2864ff9700 1 -- 172.21.15.81:0/1842078797 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2860004740 con 0x7f2868158850 2023-11-29T11:14:05.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f2864ff9700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2854064ee0 0x7f2854067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:05.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f2864ff9700 1 -- 172.21.15.81:0/1842078797 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f2860083900 con 0x7f2868158850 2023-11-29T11:14:05.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.341+0000 7f2867fff700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2854064ee0 0x7f2854067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:05.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.345+0000 7f2867fff700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2854064ee0 0x7f2854067390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2858009bf0 tx=0x7f2858009290 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.349+0000 7f2864ff9700 1 -- 172.21.15.81:0/1842078797 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2860051750 con 0x7f2868158850 2023-11-29T11:14:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:05.549+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2868072c20 con 0x7f2868158850 2023-11-29T11:14:06.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.197+0000 7f2864ff9700 1 -- 172.21.15.81:0/1842078797 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2860054d70 con 0x7f2868158850 2023-11-29T11:14:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2854064ee0 msgr2=0x7f2854067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2854064ee0 0x7f2854067390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2858009bf0 tx=0x7f2858009290 comp rx=0 tx=0).stop 2023-11-29T11:14:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2868158850 msgr2=0x7f28680b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2868158850 0x7f28680b3af0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f286000c680 tx=0x7f2860004af0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 shutdown_connections 2023-11-29T11:14:06.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2854064ee0 0x7f2854067390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2868158850 0x7f28680b3af0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2868158480 0x7f28680b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 --2- 172.21.15.81:0/1842078797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28680cd3a0 0x7f28680c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 >> 172.21.15.81:0/1842078797 conn(0x7f286806c660 msgr2=0x7f286806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 shutdown_connections 2023-11-29T11:14:06.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.205+0000 7f286d08f700 1 -- 172.21.15.81:0/1842078797 wait complete. 2023-11-29T11:14:06.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T11:14:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb23b2f700 1 Processor -- start 2023-11-29T11:14:06.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb23b2f700 1 -- start start 2023-11-29T11:14:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb23b2f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb1c158fc0 0x7fbb1c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb23b2f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb1c0ce770 0x7fbb1c06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:06.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb23b2f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c0b1bf0 con 0x7fbb1c0b17a0 2023-11-29T11:14:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb23b2f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c159390 con 0x7fbb1c0ce770 2023-11-29T11:14:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb23b2f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c15d700 con 0x7fbb1c158fc0 2023-11-29T11:14:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb220cc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb1c0ce770 0x7fbb1c06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb210ca700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbb1c0b17a0 0x7fbb1c0ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39074/0 (socket says 172.21.15.81:39074) 2023-11-29T11:14:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb210ca700 1 -- 172.21.15.81:0/3995083057 learned_addr learned my addr 172.21.15.81:0/3995083057 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:06.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.389+0000 7fbb218cb700 1 --2- 172.21.15.81:0/3995083057 >> v2:172.21.15.176:3300/0 conn(0x7fbb1c158fc0 0x7fbb1c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb220cc700 1 -- 172.21.15.81:0/3995083057 >> v2:172.21.15.176:3300/0 conn(0x7fbb1c158fc0 msgr2=0x7fbb1c0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb220cc700 1 --2- 172.21.15.81:0/3995083057 >> v2:172.21.15.176:3300/0 conn(0x7fbb1c158fc0 0x7fbb1c0b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb220cc700 1 -- 172.21.15.81:0/3995083057 >> v1:172.21.15.81:6789/0 conn(0x7fbb1c0b17a0 legacy=0x7fbb1c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb208c9700 1 -- 172.21.15.81:0/3995083057 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026751832 0 0) 0x7fbb0c001110 con 0x7fbb1c0b17a0 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb220cc700 1 -- 172.21.15.81:0/3995083057 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c15caf0 con 0x7fbb1c0ce770 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb220cc700 1 --2- 172.21.15.81:0/3995083057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c0ce770 0x7fbb1c06bb10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b21a0 tx=0x7fbb1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d96ddcae11cb656 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb208c9700 1 -- 172.21.15.81:0/3995083057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1400e070 con 0x7fbb1c0ce770 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb208c9700 1 -- 172.21.15.81:0/3995083057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1400bb20 con 0x7fbb1c0ce770 2023-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb208c9700 1 -- 172.21.15.81:0/3995083057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14012430 con 0x7fbb1c0ce770 2023-11-29T11:14:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3995083057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c0ce770 msgr2=0x7fbb1c06bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:06.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3995083057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c0ce770 0x7fbb1c06bb10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b21a0 tx=0x7fbb1400b330 comp rx=0 tx=0).stop 2023-11-29T11:14:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3995083057 shutdown_connections 2023-11-29T11:14:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3995083057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c0ce770 0x7fbb1c06bb10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3995083057 >> v2:172.21.15.176:3300/0 conn(0x7fbb1c158fc0 0x7fbb1c0b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3995083057 >> 172.21.15.81:0/3995083057 conn(0x7fbb1c0cc260 msgr2=0x7fbb1c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3995083057 shutdown_connections 2023-11-29T11:14:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3995083057 wait complete. 2023-11-29T11:14:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 Processor -- start 2023-11-29T11:14:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.393+0000 7fbb23b2f700 1 -- start start 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb1c0b17a0 0x7fbb1c0c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb1c0ce770 0x7fbb1c149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c158fc0 0x7fbb1c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0c6dc0 con 0x7fbb1c158fc0 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c15a2b0 con 0x7fbb1c0b17a0 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c15a590 con 0x7fbb1c0ce770 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c158fc0 0x7fbb1c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c158fc0 0x7fbb1c06a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59190/0 (socket says 172.21.15.81:59190) 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 -- 172.21.15.81:0/3823987889 learned_addr learned my addr 172.21.15.81:0/3823987889 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb218cb700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb1c0b17a0 0x7fbb1c0c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:06.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb210ca700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb1c0ce770 0x7fbb1c149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:06.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 -- 172.21.15.81:0/3823987889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb1c0ce770 msgr2=0x7fbb1c149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:06.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb1c0ce770 0x7fbb1c149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 -- 172.21.15.81:0/3823987889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb1c0b17a0 msgr2=0x7fbb1c0c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb1c0b17a0 0x7fbb1c0c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 -- 172.21.15.81:0/3823987889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14009a70 con 0x7fbb1c158fc0 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb220cc700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c158fc0 0x7fbb1c06a4d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c069ef0 tx=0x7fbb14004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb127fc700 1 -- 172.21.15.81:0/3823987889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14012430 con 0x7fbb1c158fc0 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb127fc700 1 -- 172.21.15.81:0/3823987889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14020070 con 0x7fbb1c158fc0 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c15d0b0 con 0x7fbb1c158fc0 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb127fc700 1 -- 172.21.15.81:0/3823987889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14004280 con 0x7fbb1c158fc0 2023-11-29T11:14:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c15cdd0 con 0x7fbb1c158fc0 2023-11-29T11:14:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c15d390 con 0x7fbb1c158fc0 2023-11-29T11:14:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.397+0000 7fbb127fc700 1 -- 172.21.15.81:0/3823987889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb140043e0 con 0x7fbb1c158fc0 2023-11-29T11:14:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.401+0000 7fbb127fc700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb00064f10 0x7fbb000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.401+0000 7fbb218cb700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb00064f10 0x7fbb000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.401+0000 7fbb127fc700 1 -- 172.21.15.81:0/3823987889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fbb14022070 con 0x7fbb1c158fc0 2023-11-29T11:14:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.401+0000 7fbb218cb700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb00064f10 0x7fbb000673c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009bf0 tx=0x7fbb18009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.405+0000 7fbb127fc700 1 -- 172.21.15.81:0/3823987889 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb14052290 con 0x7fbb1c158fc0 2023-11-29T11:14:06.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:06.569+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb1c072c20 con 0x7fbb1c158fc0 2023-11-29T11:14:07.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.213+0000 7fbb127fc700 1 -- 172.21.15.81:0/3823987889 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbb140558b0 con 0x7fbb1c158fc0 2023-11-29T11:14:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.221+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb00064f10 msgr2=0x7fbb000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.221+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb00064f10 0x7fbb000673c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009bf0 tx=0x7fbb18009240 comp rx=0 tx=0).stop 2023-11-29T11:14:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.221+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c158fc0 msgr2=0x7fbb1c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.221+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c158fc0 0x7fbb1c06a4d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c069ef0 tx=0x7fbb14004af0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.229+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 shutdown_connections 2023-11-29T11:14:07.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.229+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb00064f10 0x7fbb000673c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.229+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1c158fc0 0x7fbb1c06a4d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.229+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb1c0ce770 0x7fbb1c149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.229+0000 7fbb23b2f700 1 --2- 172.21.15.81:0/3823987889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb1c0b17a0 0x7fbb1c0c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.229+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 >> 172.21.15.81:0/3823987889 conn(0x7fbb1c0cc260 msgr2=0x7fbb1c0cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:07.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.229+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 shutdown_connections 2023-11-29T11:14:07.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.229+0000 7fbb23b2f700 1 -- 172.21.15.81:0/3823987889 wait complete. 2023-11-29T11:14:07.237 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-11-29T11:14:07.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T11:14:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 Processor -- start 2023-11-29T11:14:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 -- start start 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40b39d0 0x7f90c40cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90c40c13d0 0x7f90c40c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c406b420 con 0x7f90c4160420 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40c1d90 con 0x7f90c40c13d0 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41607f0 con 0x7f90c40b39d0 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c9dbd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90c40c13d0 0x7f90c40c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c9dbd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90c40c13d0 0x7f90c40c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59204/0 (socket says 172.21.15.81:59204) 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c9dbd700 1 -- 172.21.15.81:0/3275954118 learned_addr learned my addr 172.21.15.81:0/3275954118 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c8dbb700 1 --2- 172.21.15.81:0/3275954118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40b39d0 0x7f90c40cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c9dbd700 1 -- 172.21.15.81:0/3275954118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40b39d0 msgr2=0x7f90c40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c9dbd700 1 --2- 172.21.15.81:0/3275954118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40b39d0 0x7f90c40cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c9dbd700 1 -- 172.21.15.81:0/3275954118 >> v1:172.21.15.176:6789/0 conn(0x7f90c4160420 legacy=0x7f90c4164880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c9dbd700 1 -- 172.21.15.81:0/3275954118 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c406aef0 con 0x7f90c40c13d0 2023-11-29T11:14:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c8dbb700 1 --2- 172.21.15.81:0/3275954118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40b39d0 0x7f90c40cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90c9dbd700 1 --2- 172.21.15.81:0/3275954118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40c13d0 0x7f90c40c1850 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009910 tx=0x7f90bc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91016f8fa6830e43 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90bbfff700 1 -- 172.21.15.81:0/3275954118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004230 con 0x7f90c40c13d0 2023-11-29T11:14:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90bbfff700 1 -- 172.21.15.81:0/3275954118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc004390 con 0x7f90c40c13d0 2023-11-29T11:14:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90bbfff700 1 -- 172.21.15.81:0/3275954118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc009e60 con 0x7f90c40c13d0 2023-11-29T11:14:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 -- 172.21.15.81:0/3275954118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40c13d0 msgr2=0x7f90c40c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 --2- 172.21.15.81:0/3275954118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40c13d0 0x7f90c40c1850 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009910 tx=0x7f90bc009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 -- 172.21.15.81:0/3275954118 shutdown_connections 2023-11-29T11:14:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 --2- 172.21.15.81:0/3275954118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40c13d0 0x7f90c40c1850 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 --2- 172.21.15.81:0/3275954118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40b39d0 0x7f90c40cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.361+0000 7f90ca5be700 1 -- 172.21.15.81:0/3275954118 >> 172.21.15.81:0/3275954118 conn(0x7f90c40ce400 msgr2=0x7f90c40ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 -- 172.21.15.81:0/3275954118 shutdown_connections 2023-11-29T11:14:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 -- 172.21.15.81:0/3275954118 wait complete. 2023-11-29T11:14:07.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 Processor -- start 2023-11-29T11:14:07.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 -- start start 2023-11-29T11:14:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40b39d0 0x7f90c41f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40c13d0 0x7f90c40c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c4160420 0x7f90c4071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c406fda0 con 0x7f90c40b39d0 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41f6630 con 0x7f90c4160420 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90ca5be700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41f6910 con 0x7f90c40c13d0 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90c95bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40b39d0 0x7f90c41f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90c95bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40b39d0 0x7f90c41f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59212/0 (socket says 172.21.15.81:59212) 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90c95bc700 1 -- 172.21.15.81:0/2682338914 learned_addr learned my addr 172.21.15.81:0/2682338914 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90c8dbb700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40c13d0 0x7f90c40c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.365+0000 7f90c9dbd700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c4160420 0x7f90c4071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90c95bc700 1 -- 172.21.15.81:0/2682338914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40c13d0 msgr2=0x7f90c40c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90c95bc700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40c13d0 0x7f90c40c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90c95bc700 1 -- 172.21.15.81:0/2682338914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c4160420 msgr2=0x7f90c4071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90c95bc700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c4160420 0x7f90c4071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90c95bc700 1 -- 172.21.15.81:0/2682338914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009570 con 0x7f90c40b39d0 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90c95bc700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40b39d0 0x7f90c41f6030 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f90b400b4a0 tx=0x7f90b400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90b9ffb700 1 -- 172.21.15.81:0/2682338914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4011830 con 0x7f90c40b39d0 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90b9ffb700 1 -- 172.21.15.81:0/2682338914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4011990 con 0x7f90c40b39d0 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c4164080 con 0x7f90c40b39d0 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90b9ffb700 1 -- 172.21.15.81:0/2682338914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4011d40 con 0x7f90c40b39d0 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c406b140 con 0x7f90c40b39d0 2023-11-29T11:14:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c4164360 con 0x7f90c40b39d0 2023-11-29T11:14:07.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90b9ffb700 1 -- 172.21.15.81:0/2682338914 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f90b400f050 con 0x7f90c40b39d0 2023-11-29T11:14:07.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90b9ffb700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90a8064ee0 0x7f90a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:07.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90b9ffb700 1 -- 172.21.15.81:0/2682338914 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f90b4081a90 con 0x7f90c40b39d0 2023-11-29T11:14:07.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.369+0000 7f90c8dbb700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90a8064ee0 0x7f90a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.373+0000 7f90c8dbb700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90a8064ee0 0x7f90a8067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f90c40cbd00 tx=0x7f90c0007810 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.377+0000 7f90b9ffb700 1 -- 172.21.15.81:0/2682338914 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f90b404fa60 con 0x7f90c40b39d0 2023-11-29T11:14:07.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:07.553+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90c4072500 con 0x7f90c40b39d0 2023-11-29T11:14:08.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.221+0000 7f90b9ffb700 1 -- 172.21.15.81:0/2682338914 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f90b4053080 con 0x7f90c40b39d0 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90a8064ee0 msgr2=0x7f90a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90a8064ee0 0x7f90a8067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f90c40cbd00 tx=0x7f90c0007810 comp rx=0 tx=0).stop 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40b39d0 msgr2=0x7f90c41f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40b39d0 0x7f90c41f6030 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f90b400b4a0 tx=0x7f90b400b7b0 comp rx=0 tx=0).stop 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 shutdown_connections 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90a8064ee0 0x7f90a8067390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c4160420 0x7f90c4071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90c40c13d0 0x7f90c40c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 --2- 172.21.15.81:0/2682338914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c40b39d0 0x7f90c41f6030 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 >> 172.21.15.81:0/2682338914 conn(0x7f90c40ce400 msgr2=0x7f90c40adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 shutdown_connections 2023-11-29T11:14:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.229+0000 7f90ca5be700 1 -- 172.21.15.81:0/2682338914 wait complete. 2023-11-29T11:14:08.236 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-11-29T11:14:08.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-29T11:14:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.357+0000 7f295359e700 1 Processor -- start 2023-11-29T11:14:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.357+0000 7f295359e700 1 -- start start 2023-11-29T11:14:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.357+0000 7f295359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.357+0000 7f295359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29540d0370 con 0x7f295415a2c0 2023-11-29T11:14:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.357+0000 7f295359e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295415a770 con 0x7f29540b29e0 2023-11-29T11:14:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.357+0000 7f295359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29540d0650 con 0x7f2954159ef0 2023-11-29T11:14:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2949d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f295415a2c0 0x7f29540b22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39090/0 (socket says 172.21.15.81:39090) 2023-11-29T11:14:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2949d9b700 1 -- 172.21.15.81:0/1060325264 learned_addr learned my addr 172.21.15.81:0/1060325264 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295259c700 1 --2- 172.21.15.81:0/1060325264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2951d9b700 1 -- 172.21.15.81:0/1060325264 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565463143 0 0) 0x7f29540d0370 con 0x7f295415a2c0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2951d9b700 1 -- 172.21.15.81:0/1060325264 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29400035d0 con 0x7f295415a2c0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2951d9b700 1 -- 172.21.15.81:0/1060325264 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422889193 0 0) 0x7f295415a770 con 0x7f29540b29e0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2951d9b700 1 -- 172.21.15.81:0/1060325264 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29540d0370 con 0x7f29540b29e0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295259c700 1 -- 172.21.15.81:0/1060325264 >> v1:172.21.15.176:6789/0 conn(0x7f29540b29e0 legacy=0x7f295415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295259c700 1 -- 172.21.15.81:0/1060325264 >> v1:172.21.15.81:6789/0 conn(0x7f295415a2c0 legacy=0x7f29540b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295259c700 1 -- 172.21.15.81:0/1060325264 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295415aa50 con 0x7f2954159ef0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295259c700 1 --2- 172.21.15.81:0/1060325264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540cfa70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2944009880 tx=0x7f2944009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4bfd07ca7256434 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2951d9b700 1 -- 172.21.15.81:0/1060325264 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944004230 con 0x7f2954159ef0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2951d9b700 1 -- 172.21.15.81:0/1060325264 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2944004390 con 0x7f2954159ef0 2023-11-29T11:14:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f2951d9b700 1 -- 172.21.15.81:0/1060325264 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440036c0 con 0x7f2954159ef0 2023-11-29T11:14:08.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295359e700 1 -- 172.21.15.81:0/1060325264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 msgr2=0x7f29540cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:08.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295359e700 1 --2- 172.21.15.81:0/1060325264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540cfa70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2944009880 tx=0x7f2944009b90 comp rx=0 tx=0).stop 2023-11-29T11:14:08.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295359e700 1 -- 172.21.15.81:0/1060325264 shutdown_connections 2023-11-29T11:14:08.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295359e700 1 --2- 172.21.15.81:0/1060325264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540cfa70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:08.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295359e700 1 -- 172.21.15.81:0/1060325264 >> 172.21.15.81:0/1060325264 conn(0x7f29540cd2b0 msgr2=0x7f29540cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:08.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295359e700 1 -- 172.21.15.81:0/1060325264 shutdown_connections 2023-11-29T11:14:08.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.361+0000 7f295359e700 1 -- 172.21.15.81:0/1060325264 wait complete. 2023-11-29T11:14:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.365+0000 7f295359e700 1 Processor -- start 2023-11-29T11:14:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.365+0000 7f295359e700 1 -- start start 2023-11-29T11:14:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b29e0 0x7f29541f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295415a2c0 0x7f2954158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:08.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295415ae30 con 0x7f295415a2c0 2023-11-29T11:14:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540c5230 con 0x7f29540b29e0 2023-11-29T11:14:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2954158680 con 0x7f2954159ef0 2023-11-29T11:14:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295415a2c0 0x7f2954158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295415a2c0 0x7f2954158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59226/0 (socket says 172.21.15.81:59226) 2023-11-29T11:14:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 -- 172.21.15.81:0/4004421080 learned_addr learned my addr 172.21.15.81:0/4004421080 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295259c700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b29e0 0x7f29541f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2949d9b700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 -- 172.21.15.81:0/4004421080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 msgr2=0x7f29540c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 -- 172.21.15.81:0/4004421080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b29e0 msgr2=0x7f29541f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b29e0 0x7f29541f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 -- 172.21.15.81:0/4004421080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440094b0 con 0x7f295415a2c0 2023-11-29T11:14:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f2952d9d700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295415a2c0 0x7f2954158140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f294c00cbd0 tx=0x7f294c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f294b7fe700 1 -- 172.21.15.81:0/4004421080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c003e50 con 0x7f295415a2c0 2023-11-29T11:14:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f294b7fe700 1 -- 172.21.15.81:0/4004421080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c00a650 con 0x7f295415a2c0 2023-11-29T11:14:08.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29540d0140 con 0x7f295415a2c0 2023-11-29T11:14:08.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f294b7fe700 1 -- 172.21.15.81:0/4004421080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c00aa00 con 0x7f295415a2c0 2023-11-29T11:14:08.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29540cffb0 con 0x7f295415a2c0 2023-11-29T11:14:08.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295415b250 con 0x7f295415a2c0 2023-11-29T11:14:08.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.369+0000 7f294b7fe700 1 -- 172.21.15.81:0/4004421080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f294c019030 con 0x7f295415a2c0 2023-11-29T11:14:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.373+0000 7f294b7fe700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2934064ee0 0x7f2934067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.373+0000 7f294b7fe700 1 -- 172.21.15.81:0/4004421080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f294c0816c0 con 0x7f295415a2c0 2023-11-29T11:14:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.373+0000 7f295259c700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2934064ee0 0x7f2934067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.373+0000 7f295259c700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2934064ee0 0x7f2934067390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2944009880 tx=0x7f2944008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:08.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.377+0000 7f294b7fe700 1 -- 172.21.15.81:0/4004421080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f294c04f870 con 0x7f295415a2c0 2023-11-29T11:14:08.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:08.545+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f29540676e0 con 0x7f295415a2c0 2023-11-29T11:14:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.245+0000 7f294b7fe700 1 -- 172.21.15.81:0/4004421080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f294c052e90 con 0x7f295415a2c0 2023-11-29T11:14:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.249+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2934064ee0 msgr2=0x7f2934067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2934064ee0 0x7f2934067390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2944009880 tx=0x7f2944008030 comp rx=0 tx=0).stop 2023-11-29T11:14:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295415a2c0 msgr2=0x7f2954158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295415a2c0 0x7f2954158140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f294c00cbd0 tx=0x7f294c00cee0 comp rx=0 tx=0).stop 2023-11-29T11:14:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 shutdown_connections 2023-11-29T11:14:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2934064ee0 0x7f2934067390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295415a2c0 0x7f2954158140 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2954159ef0 0x7f29540c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 --2- 172.21.15.81:0/4004421080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29540b29e0 0x7f29541f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 >> 172.21.15.81:0/4004421080 conn(0x7f29540cd2b0 msgr2=0x7f29540b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 shutdown_connections 2023-11-29T11:14:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.253+0000 7f295359e700 1 -- 172.21.15.81:0/4004421080 wait complete. 2023-11-29T11:14:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2023-11-29T11:14:09.274 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-29T11:14:09.274 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-29T11:14:09.274 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T11:14:09.275 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:14:09.275 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-29T11:14:09.275 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-29T11:14:09.275 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T11:14:09.275 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:14:09.275 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-29T11:14:09.275 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-29T11:14:09.275 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T11:14:09.275 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:14:09.276 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-29T11:14:09.276 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-29T11:14:09.276 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T11:14:09.276 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:14:09.285 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T11:14:09.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-29T11:14:09.287 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T11:14:09.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-29T11:14:09.288 INFO:tasks.ceph.mds.a:Started 2023-11-29T11:14:09.288 DEBUG:teuthology.parallel:result is None 2023-11-29T11:14:09.289 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T11:14:09.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-29T11:14:09.289 INFO:tasks.ceph.mds.c:Started 2023-11-29T11:14:09.290 DEBUG:teuthology.parallel:result is None 2023-11-29T11:14:09.291 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T11:14:09.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-29T11:14:09.291 INFO:tasks.ceph.mds.b:Started 2023-11-29T11:14:09.292 DEBUG:teuthology.parallel:result is None 2023-11-29T11:14:09.292 INFO:tasks.ceph.mds.d:Started 2023-11-29T11:14:09.293 DEBUG:teuthology.parallel:result is None 2023-11-29T11:14:09.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-29T11:14:09.362 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:14:09.363 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:14:09.365 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:14:09.371 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-29T11:14:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.401+0000 7fc56d0c3700 1 Processor -- start 2023-11-29T11:14:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.401+0000 7fc56d0c3700 1 -- start start 2023-11-29T11:14:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56d0c3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc568069c40 0x7fc568163b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56d0c3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680cbfb0 con 0x7fc568159180 2023-11-29T11:14:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56d0c3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680720b0 con 0x7fc56806f730 2023-11-29T11:14:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56d0c3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5680cbc70 con 0x7fc568069c40 2023-11-29T11:14:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc567fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc568159180 0x7fc568071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39110/0 (socket says 172.21.15.81:39110) 2023-11-29T11:14:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc567fff700 1 -- 172.21.15.81:0/2034204067 learned_addr learned my addr 172.21.15.81:0/2034204067 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56c8c2700 1 --2- 172.21.15.81:0/2034204067 >> v2:172.21.15.81:3300/0 conn(0x7fc568069c40 0x7fc568163b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56c8c2700 1 -- 172.21.15.81:0/2034204067 >> v1:172.21.15.176:6789/0 conn(0x7fc56806f730 legacy=0x7fc5680719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56c8c2700 1 -- 172.21.15.81:0/2034204067 >> v1:172.21.15.81:6789/0 conn(0x7fc568159180 legacy=0x7fc568071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56c8c2700 1 -- 172.21.15.81:0/2034204067 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680cee20 con 0x7fc568069c40 2023-11-29T11:14:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.405+0000 7fc56c8c2700 1 --2- 172.21.15.81:0/2034204067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568069c40 0x7fc568163b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc560009d90 tx=0x7fc56000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649bdb5ad64e671a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:09.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.409+0000 7fc566ffd700 1 -- 172.21.15.81:0/2034204067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000e070 con 0x7fc568069c40 2023-11-29T11:14:09.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.409+0000 7fc566ffd700 1 -- 172.21.15.81:0/2034204067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000bbd0 con 0x7fc568069c40 2023-11-29T11:14:09.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.409+0000 7fc566ffd700 1 -- 172.21.15.81:0/2034204067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560012430 con 0x7fc568069c40 2023-11-29T11:14:09.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 -- 172.21.15.81:0/2034204067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568069c40 msgr2=0x7fc568163b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 --2- 172.21.15.81:0/2034204067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568069c40 0x7fc568163b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc560009d90 tx=0x7fc56000b330 comp rx=0 tx=0).stop 2023-11-29T11:14:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 -- 172.21.15.81:0/2034204067 shutdown_connections 2023-11-29T11:14:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 --2- 172.21.15.81:0/2034204067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568069c40 0x7fc568163b90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 -- 172.21.15.81:0/2034204067 >> 172.21.15.81:0/2034204067 conn(0x7fc5680b1f90 msgr2=0x7fc5680ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 -- 172.21.15.81:0/2034204067 shutdown_connections 2023-11-29T11:14:09.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 -- 172.21.15.81:0/2034204067 wait complete. 2023-11-29T11:14:09.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 Processor -- start 2023-11-29T11:14:09.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.413+0000 7fc56d0c3700 1 -- start start 2023-11-29T11:14:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc568069c40 0x7fc568097a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56806f730 0x7fc5681550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568159180 0x7fc568155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680cd4f0 con 0x7fc568159180 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56815c460 con 0x7fc568069c40 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680c5550 con 0x7fc56806f730 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56806f730 0x7fc5681550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56806f730 0x7fc5681550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:53720/0 (socket says 172.21.15.81:53720) 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 -- 172.21.15.81:0/1932582247 learned_addr learned my addr 172.21.15.81:0/1932582247 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56c8c2700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568159180 0x7fc568155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc567fff700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc568069c40 0x7fc568097a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 -- 172.21.15.81:0/1932582247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc568069c40 msgr2=0x7fc568097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc568069c40 0x7fc568097a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 -- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568159180 msgr2=0x7fc568155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568159180 0x7fc568155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 -- 172.21.15.81:0/1932582247 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc560009a70 con 0x7fc56806f730 2023-11-29T11:14:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc5677fe700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56806f730 0x7fc5681550c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc558001c10 tx=0x7fc558014330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc564ff9700 1 -- 172.21.15.81:0/1932582247 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558017070 con 0x7fc56806f730 2023-11-29T11:14:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc564ff9700 1 -- 172.21.15.81:0/1932582247 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5580050d0 con 0x7fc56806f730 2023-11-29T11:14:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5680cc200 con 0x7fc56806f730 2023-11-29T11:14:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc564ff9700 1 -- 172.21.15.81:0/1932582247 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558005460 con 0x7fc56806f730 2023-11-29T11:14:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5680cf100 con 0x7fc56806f730 2023-11-29T11:14:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc564ff9700 1 -- 172.21.15.81:0/1932582247 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc558022020 con 0x7fc56806f730 2023-11-29T11:14:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5680cc4e0 con 0x7fc56806f730 2023-11-29T11:14:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.417+0000 7fc564ff9700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc548064ee0 0x7fc548067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.421+0000 7fc564ff9700 1 -- 172.21.15.81:0/1932582247 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc5580896d0 con 0x7fc56806f730 2023-11-29T11:14:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.421+0000 7fc567fff700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc548064ee0 0x7fc548067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.421+0000 7fc567fff700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc548064ee0 0x7fc548067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc550009d40 tx=0x7fc55000c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.425+0000 7fc564ff9700 1 -- 172.21.15.81:0/1932582247 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc558057960 con 0x7fc56806f730 2023-11-29T11:14:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:09.593+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc5680c5690 con 0x7fc56806f730 2023-11-29T11:14:10.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.417+0000 7fc564ff9700 1 -- 172.21.15.81:0/1932582247 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc5680c5690 con 0x7fc56806f730 2023-11-29T11:14:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc548064ee0 msgr2=0x7fc548067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc548064ee0 0x7fc548067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc550009d40 tx=0x7fc55000c040 comp rx=0 tx=0).stop 2023-11-29T11:14:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56806f730 msgr2=0x7fc5681550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56806f730 0x7fc5681550c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc558001c10 tx=0x7fc558014330 comp rx=0 tx=0).stop 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 shutdown_connections 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc548064ee0 0x7fc548067390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc568159180 0x7fc568155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56806f730 0x7fc5681550c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 --2- 172.21.15.81:0/1932582247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc568069c40 0x7fc568097a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 >> 172.21.15.81:0/1932582247 conn(0x7fc5680b1f90 msgr2=0x7fc5680b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 shutdown_connections 2023-11-29T11:14:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.421+0000 7fc56d0c3700 1 -- 172.21.15.81:0/1932582247 wait complete. 2023-11-29T11:14:10.430 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-11-29T11:14:10.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-29T11:14:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.557+0000 7f02e748b700 1 Processor -- start 2023-11-29T11:14:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.557+0000 7f02e748b700 1 -- start start 2023-11-29T11:14:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e748b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02e015d650 0x7f02e00ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e748b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00cd720 con 0x7f02e0159c00 2023-11-29T11:14:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e748b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00cd990 con 0x7f02e00cc020 2023-11-29T11:14:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e748b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e015a040 con 0x7f02e015d650 2023-11-29T11:14:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e6c8a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f02e0159c00 0x7f02e006bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51908/0 (socket says 172.21.15.81:51908) 2023-11-29T11:14:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e6c8a700 1 -- 172.21.15.81:0/583982881 learned_addr learned my addr 172.21.15.81:0/583982881 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e6489700 1 --2- 172.21.15.81:0/583982881 >> v2:172.21.15.176:3300/0 conn(0x7f02e015d650 0x7f02e00ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510138400 0 0) 0x7f02e00cd990 con 0x7f02e00cc020 2023-11-29T11:14:10.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02cc0035d0 con 0x7f02e00cc020 2023-11-29T11:14:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325372453 0 0) 0x7f02e00cd720 con 0x7f02e0159c00 2023-11-29T11:14:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e00cd990 con 0x7f02e0159c00 2023-11-29T11:14:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1143954871 0 0) 0x7f02e00cd990 con 0x7f02e0159c00 2023-11-29T11:14:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 >> v2:172.21.15.176:3300/0 conn(0x7f02e015d650 msgr2=0x7f02e00ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 --2- 172.21.15.81:0/583982881 >> v2:172.21.15.176:3300/0 conn(0x7f02e015d650 0x7f02e00ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 >> v1:172.21.15.176:6789/0 conn(0x7f02e00cc020 legacy=0x7f02e01594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00cdc70 con 0x7f02e0159c00 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f02d8001970 con 0x7f02e0159c00 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 >> v1:172.21.15.81:6789/0 conn(0x7f02e0159c00 legacy=0x7f02e006bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02cc005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc003810 0x7f02cc003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0041c0 0x7f02cc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d0001230 con 0x7f02cc004c40 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e015a040 con 0x7f02cc0041c0 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc00c1b0 con 0x7f02cc003810 2023-11-29T11:14:10.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.561+0000 7f02e6489700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02cc005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e5c88700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc003810 0x7f02cc003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e6489700 1 -- 172.21.15.81:0/583982881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc003810 msgr2=0x7f02cc003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e6489700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc003810 0x7f02cc003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e6489700 1 -- 172.21.15.81:0/583982881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0041c0 msgr2=0x7f02cc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e6489700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0041c0 0x7f02cc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e6489700 1 -- 172.21.15.81:0/583982881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00cd990 con 0x7f02cc004c40 2023-11-29T11:14:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e6c8a700 1 -- 172.21.15.81:0/583982881 reap_dead start 2023-11-29T11:14:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e5c88700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc003810 0x7f02cc003c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e6489700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02cc005010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0098b0 tx=0x7f02cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a09bac88165fa69 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00c070 con 0x7f02cc004c40 2023-11-29T11:14:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc013610 con 0x7f02cc004c40 2023-11-29T11:14:10.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e5487700 1 -- 172.21.15.81:0/583982881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0139c0 con 0x7f02cc004c40 2023-11-29T11:14:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e748b700 1 -- 172.21.15.81:0/583982881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 msgr2=0x7f02cc005010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e748b700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02cc005010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0098b0 tx=0x7f02cc0058a0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e748b700 1 -- 172.21.15.81:0/583982881 shutdown_connections 2023-11-29T11:14:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e748b700 1 --2- 172.21.15.81:0/583982881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02cc005010 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e748b700 1 -- 172.21.15.81:0/583982881 >> 172.21.15.81:0/583982881 conn(0x7f02e006ec40 msgr2=0x7f02e00b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e748b700 1 -- 172.21.15.81:0/583982881 shutdown_connections 2023-11-29T11:14:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.565+0000 7f02e748b700 1 -- 172.21.15.81:0/583982881 wait complete. 2023-11-29T11:14:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e748b700 1 Processor -- start 2023-11-29T11:14:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e748b700 1 -- start start 2023-11-29T11:14:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e748b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02e015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e748b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e00b5170 0x7f02e00c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e748b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e00c4190 0x7f02e00c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e748b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00b55e0 con 0x7f02cc004c40 2023-11-29T11:14:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e748b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e015bd00 con 0x7f02e00b5170 2023-11-29T11:14:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e748b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00c3a30 con 0x7f02e00c4190 2023-11-29T11:14:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02e015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02e015ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38270/0 (socket says 172.21.15.81:38270) 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 -- 172.21.15.81:0/855419034 learned_addr learned my addr 172.21.15.81:0/855419034 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6c8a700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e00c4190 0x7f02e00c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e5c88700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e00b5170 0x7f02e00c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 -- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e00c4190 msgr2=0x7f02e00c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e00c4190 0x7f02e00c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 -- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e00b5170 msgr2=0x7f02e00c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e00b5170 0x7f02e00c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 -- 172.21.15.81:0/855419034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e015a250 con 0x7f02cc004c40 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e5c88700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e00b5170 0x7f02e00c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02e6489700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02e015ab20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00c100 tx=0x7f02dc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.569+0000 7f02d6ffd700 1 -- 172.21.15.81:0/855419034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc013b90 con 0x7f02cc004c40 2023-11-29T11:14:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02d6ffd700 1 -- 172.21.15.81:0/855419034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc013d10 con 0x7f02cc004c40 2023-11-29T11:14:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e00cdf50 con 0x7f02cc004c40 2023-11-29T11:14:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02d6ffd700 1 -- 172.21.15.81:0/855419034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc003900 con 0x7f02cc004c40 2023-11-29T11:14:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e00ce470 con 0x7f02cc004c40 2023-11-29T11:14:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e00ce810 con 0x7f02cc004c40 2023-11-29T11:14:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02d6ffd700 1 -- 172.21.15.81:0/855419034 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f02dc025070 con 0x7f02cc004c40 2023-11-29T11:14:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02d6ffd700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02c4064ee0 0x7f02c4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02d6ffd700 1 -- 172.21.15.81:0/855419034 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f02dc082d90 con 0x7f02cc004c40 2023-11-29T11:14:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02e5c88700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02c4064ee0 0x7f02c4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.573+0000 7f02e5c88700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02c4064ee0 0x7f02c4067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f02e00ae880 tx=0x7f02d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.581+0000 7f02d6ffd700 1 -- 172.21.15.81:0/855419034 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f02dc051140 con 0x7f02cc004c40 2023-11-29T11:14:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.797+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f02e0072c20 con 0x7f02cc004c40 2023-11-29T11:14:10.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.797+0000 7f02d6ffd700 1 -- 172.21.15.81:0/855419034 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f02dc054760 con 0x7f02cc004c40 2023-11-29T11:14:10.804 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:10.804 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlSOayNhAAtezph/rP5i/F81/canwMdA==", 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdl8qMjBRAAuvMDj+jPn1OjXUEcUl34jg==", 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlIykpOhAAL31egdG19jdsaMglEpIC5w==", 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlKA1GCxAAOzBuOUs7pjJJOOFwZq8npA==", 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/HGdl92Q/OhAAXGWXiUvswEMnfzScuUn0cw==", 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDHGdl8TbZExAA2IBrIVdDMSaeGFjE0oBYFw==", 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-11-29T11:14:10.808 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCGHGdlUk9QJhAA3rf+afNjbbsQotcH4YjVQg==", 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJHGdlUPFnLRAAk4y/WOW2lDfYd22+GF2QlA==", 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCPHGdlLLatFRAAz4dG1oXNEITKomtPGnDBmw==", 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCSHGdl34DRKxAAt8kHY0+FALSWN612SIOnsQ==", 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:14:10.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCVHGdl4zPUMBAAsF8NTRCGqXpRuVduNnWO1A==", 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-11-29T11:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCYHGdlQv/DNRAAFMTV+dTJZ0UZK2eCJiFDuw==", 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgxnnDhAAfROm0RfwzNurvq62gqmGBQ==", 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:14:10.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgjcpFRAAtcxPbxV34mCHxFVoGYmqmg==", 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlvfbxERAA6d5eRkOBOKhyToZKDKlvYQ==", 2023-11-29T11:14:10.813 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlDrDHGhAAfy4RAK8qFAj2Sf6GuRGhBw==", 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:14:10.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlW+ELKBAAoMzxY7NGqIJ1SNfaQ/4qVQ==", 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2023-11-29T11:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCjHGdlRuwGARAASqZG4SeLHRJEfrwV4UI3mg==", 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCjHGdl7AQHARAA2H651zFnUmarqgIJwnEqpg==", 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCjHGdlURsHARAAGOTNdJ9hUZQY+TO/kFFCcg==", 2023-11-29T11:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCjHGdl6DEHARAAXOozzQuro2O3To2fXALdcg==", 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCjHGdl/EoHARAAq1sKTzkGoqLZSpl7ju9SGw==", 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCjHGdlyWEHARAACgdkJ6g2AdEQ+XiAAs4zwA==", 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlqaiZMhAAPiboTL+csIYuoxSk+ZwfJA==", 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:14:10.818 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlcf6LLxAAqtoEWzgd41N9uT9tC7bZ/Q==", 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-11-29T11:14:10.819 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02c4064ee0 msgr2=0x7f02c4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02c4064ee0 0x7f02c4067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f02e00ae880 tx=0x7f02d0009040 comp rx=0 tx=0).stop 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 msgr2=0x7f02e015ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02e015ab20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00c100 tx=0x7f02dc0047e0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 shutdown_connections 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02c4064ee0 0x7f02c4067390 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e00c4190 0x7f02e00c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e00b5170 0x7f02e00c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 --2- 172.21.15.81:0/855419034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc004c40 0x7f02e015ab20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 >> 172.21.15.81:0/855419034 conn(0x7f02e006ec40 msgr2=0x7f02e0156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 shutdown_connections 2023-11-29T11:14:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.801+0000 7f02e748b700 1 -- 172.21.15.81:0/855419034 wait complete. 2023-11-29T11:14:10.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-29T11:14:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.929+0000 7f11c49d7700 1 Processor -- start 2023-11-29T11:14:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.929+0000 7f11c49d7700 1 -- start start 2023-11-29T11:14:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11c00b09a0 0x7f11c00cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00b3480 0x7f11c00cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c00ce3a0 con 0x7f11c00cd000 2023-11-29T11:14:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c00d02c0 con 0x7f11c00b09a0 2023-11-29T11:14:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00b0e10 con 0x7f11c00b3480 2023-11-29T11:14:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11be59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11c00b09a0 0x7f11c00cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11bed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f11c00cd000 0x7f11c00cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51916/0 (socket says 172.21.15.81:51916) 2023-11-29T11:14:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11bed9d700 1 -- 172.21.15.81:0/703755494 learned_addr learned my addr 172.21.15.81:0/703755494 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11bf59e700 1 --2- 172.21.15.81:0/703755494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00b3480 0x7f11c00cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11be59c700 1 -- 172.21.15.81:0/703755494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00b3480 msgr2=0x7f11c00cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11be59c700 1 --2- 172.21.15.81:0/703755494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00b3480 0x7f11c00cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11be59c700 1 -- 172.21.15.81:0/703755494 >> v1:172.21.15.81:6789/0 conn(0x7f11c00cd000 legacy=0x7f11c00cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11bdd9b700 1 -- 172.21.15.81:0/703755494 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79871405 0 0) 0x7f11c00ce3a0 con 0x7f11c00cd000 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11be59c700 1 -- 172.21.15.81:0/703755494 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c00ce640 con 0x7f11c00b09a0 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11be59c700 1 --2- 172.21.15.81:0/703755494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00cfd80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009840 tx=0x7f11b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab06c12fe50674d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11bdd9b700 1 -- 172.21.15.81:0/703755494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0005e50 con 0x7f11c00b09a0 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11bdd9b700 1 -- 172.21.15.81:0/703755494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b0006030 con 0x7f11c00b09a0 2023-11-29T11:14:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11bdd9b700 1 -- 172.21.15.81:0/703755494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00063c0 con 0x7f11c00b09a0 2023-11-29T11:14:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 -- 172.21.15.81:0/703755494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 msgr2=0x7f11c00cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 --2- 172.21.15.81:0/703755494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00cfd80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009840 tx=0x7f11b0009b50 comp rx=0 tx=0).stop 2023-11-29T11:14:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 -- 172.21.15.81:0/703755494 shutdown_connections 2023-11-29T11:14:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 --2- 172.21.15.81:0/703755494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00b3480 0x7f11c00cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 --2- 172.21.15.81:0/703755494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00cfd80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 -- 172.21.15.81:0/703755494 >> 172.21.15.81:0/703755494 conn(0x7f11c00b2140 msgr2=0x7f11c00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 -- 172.21.15.81:0/703755494 shutdown_connections 2023-11-29T11:14:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.933+0000 7f11c49d7700 1 -- 172.21.15.81:0/703755494 wait complete. 2023-11-29T11:14:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 Processor -- start 2023-11-29T11:14:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 -- start start 2023-11-29T11:14:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11c00b3480 0x7f11c006f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00cd000 0x7f11c00cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c01ef820 con 0x7f11c00b09a0 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c006fae0 con 0x7f11c00b3480 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c01ef1d0 con 0x7f11c00cd000 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38296/0 (socket says 172.21.15.81:38296) 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 -- 172.21.15.81:0/2125894736 learned_addr learned my addr 172.21.15.81:0/2125894736 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bf59e700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00cd000 0x7f11c00cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11be59c700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11c00b3480 0x7f11c006f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 -- 172.21.15.81:0/2125894736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00cd000 msgr2=0x7f11c00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00cd000 0x7f11c00cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 -- 172.21.15.81:0/2125894736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11c00b3480 msgr2=0x7f11c006f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11c00b3480 0x7f11c006f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 -- 172.21.15.81:0/2125894736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009450 con 0x7f11c00b09a0 2023-11-29T11:14:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11bed9d700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00ca260 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c580 tx=0x7f11b400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11a77fe700 1 -- 172.21.15.81:0/2125894736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4004ca0 con 0x7f11c00b09a0 2023-11-29T11:14:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11a77fe700 1 -- 172.21.15.81:0/2125894736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b4004e20 con 0x7f11c00b09a0 2023-11-29T11:14:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c00cec00 con 0x7f11c00b09a0 2023-11-29T11:14:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11a77fe700 1 -- 172.21.15.81:0/2125894736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4007310 con 0x7f11c00b09a0 2023-11-29T11:14:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.937+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c00ce920 con 0x7f11c00b09a0 2023-11-29T11:14:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.941+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c015d6a0 con 0x7f11c00b09a0 2023-11-29T11:14:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.941+0000 7f11a77fe700 1 -- 172.21.15.81:0/2125894736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f11b401a020 con 0x7f11c00b09a0 2023-11-29T11:14:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.941+0000 7f11a77fe700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11ac064ee0 0x7f11ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.941+0000 7f11a77fe700 1 -- 172.21.15.81:0/2125894736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f11b40818a0 con 0x7f11c00b09a0 2023-11-29T11:14:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.941+0000 7f11be59c700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11ac064ee0 0x7f11ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.945+0000 7f11be59c700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11ac064ee0 0x7f11ac067390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009b90 tx=0x7f11b0008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:10.949+0000 7f11a77fe700 1 -- 172.21.15.81:0/2125894736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f11b404fb60 con 0x7f11c00b09a0 2023-11-29T11:14:11.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.177+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f11c0072500 con 0x7f11c00b09a0 2023-11-29T11:14:11.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.181+0000 7f11a77fe700 1 -- 172.21.15.81:0/2125894736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f11b4053180 con 0x7f11c00b09a0 2023-11-29T11:14:11.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11ac064ee0 msgr2=0x7f11ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11ac064ee0 0x7f11ac067390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009b90 tx=0x7f11b0008070 comp rx=0 tx=0).stop 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 msgr2=0x7f11c00ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00ca260 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c580 tx=0x7f11b400c890 comp rx=0 tx=0).stop 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 shutdown_connections 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11ac064ee0 0x7f11ac067390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11c00cd000 0x7f11c00cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11c00b3480 0x7f11c006f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 --2- 172.21.15.81:0/2125894736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c00b09a0 0x7f11c00ca260 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 >> 172.21.15.81:0/2125894736 conn(0x7f11c00b2140 msgr2=0x7f11c006e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 shutdown_connections 2023-11-29T11:14:11.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.185+0000 7f11c49d7700 1 -- 172.21.15.81:0/2125894736 wait complete. 2023-11-29T11:14:11.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-29T11:14:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2cea9ae700 1 Processor -- start 2023-11-29T11:14:11.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2cea9ae700 1 -- start start 2023-11-29T11:14:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2cea9ae700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2ce4153420 0x7f2ce40c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2cea9ae700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce41537f0 0x7f2ce40ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2cea9ae700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce40cad30 con 0x7f2ce415cb50 2023-11-29T11:14:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2cea9ae700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40cdda0 con 0x7f2ce4153420 2023-11-29T11:14:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2cea9ae700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b0cd0 con 0x7f2ce41537f0 2023-11-29T11:14:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2ce37fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce41537f0 0x7f2ce40ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2ce3fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2ce4153420 0x7f2ce40c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2ce8f4b700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2ce415cb50 0x7f2ce4159560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:43790/0 (socket says 172.21.15.81:43790) 2023-11-29T11:14:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2ce37fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce41537f0 0x7f2ce40ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:41954/0 (socket says 172.21.15.81:41954) 2023-11-29T11:14:11.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.313+0000 7f2ce8f4b700 1 -- 172.21.15.81:0/1786559440 learned_addr learned my addr 172.21.15.81:0/1786559440 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:11.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce2ffd700 1 -- 172.21.15.81:0/1786559440 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10295537 0 0) 0x7f2ce40cad30 con 0x7f2ce415cb50 2023-11-29T11:14:11.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce37fe700 1 -- 172.21.15.81:0/1786559440 >> v2:172.21.15.176:3300/0 conn(0x7f2ce4153420 msgr2=0x7f2ce40c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:11.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce37fe700 1 --2- 172.21.15.81:0/1786559440 >> v2:172.21.15.176:3300/0 conn(0x7f2ce4153420 0x7f2ce40c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce37fe700 1 -- 172.21.15.81:0/1786559440 >> v1:172.21.15.176:6789/0 conn(0x7f2ce415cb50 legacy=0x7f2ce4159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce37fe700 1 -- 172.21.15.81:0/1786559440 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40caa00 con 0x7f2ce41537f0 2023-11-29T11:14:11.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce37fe700 1 --2- 172.21.15.81:0/1786559440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce41537f0 0x7f2ce40ce050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400baf0 tx=0x7f2cd400be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f60c005743a8ae50 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:11.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce2ffd700 1 -- 172.21.15.81:0/1786559440 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400dc70 con 0x7f2ce41537f0 2023-11-29T11:14:11.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce2ffd700 1 -- 172.21.15.81:0/1786559440 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd400ddd0 con 0x7f2ce41537f0 2023-11-29T11:14:11.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2ce2ffd700 1 -- 172.21.15.81:0/1786559440 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4010690 con 0x7f2ce41537f0 2023-11-29T11:14:11.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 -- 172.21.15.81:0/1786559440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce41537f0 msgr2=0x7f2ce40ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/1786559440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce41537f0 0x7f2ce40ce050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400baf0 tx=0x7f2cd400be00 comp rx=0 tx=0).stop 2023-11-29T11:14:11.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 -- 172.21.15.81:0/1786559440 shutdown_connections 2023-11-29T11:14:11.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/1786559440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce41537f0 0x7f2ce40ce050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/1786559440 >> v2:172.21.15.176:3300/0 conn(0x7f2ce4153420 0x7f2ce40c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 -- 172.21.15.81:0/1786559440 >> 172.21.15.81:0/1786559440 conn(0x7f2ce406caf0 msgr2=0x7f2ce40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:11.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 -- 172.21.15.81:0/1786559440 shutdown_connections 2023-11-29T11:14:11.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 -- 172.21.15.81:0/1786559440 wait complete. 2023-11-29T11:14:11.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 Processor -- start 2023-11-29T11:14:11.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.317+0000 7f2cea9ae700 1 -- start start 2023-11-29T11:14:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4153420 0x7f2ce4150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce41537f0 0x7f2ce4150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce415cb50 0x7f2ce40b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40c7850 con 0x7f2ce4153420 2023-11-29T11:14:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b2290 con 0x7f2ce41537f0 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b2570 con 0x7f2ce415cb50 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4153420 0x7f2ce4150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4153420 0x7f2ce4150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38300/0 (socket says 172.21.15.81:38300) 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce37fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce41537f0 0x7f2ce4150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 -- 172.21.15.81:0/3841128536 learned_addr learned my addr 172.21.15.81:0/3841128536 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce8f4b700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce415cb50 0x7f2ce40b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 -- 172.21.15.81:0/3841128536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce415cb50 msgr2=0x7f2ce40b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce415cb50 0x7f2ce40b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 -- 172.21.15.81:0/3841128536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce41537f0 msgr2=0x7f2ce4150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce41537f0 0x7f2ce4150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 -- 172.21.15.81:0/3841128536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd400b750 con 0x7f2ce4153420 2023-11-29T11:14:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce3fff700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4153420 0x7f2ce4150ca0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00e9d0 tx=0x7f2cdc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:11.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce0ff9700 1 -- 172.21.15.81:0/3841128536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc009720 con 0x7f2ce4153420 2023-11-29T11:14:11.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce40b0f70 con 0x7f2ce4153420 2023-11-29T11:14:11.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce0ff9700 1 -- 172.21.15.81:0/3841128536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc00ee70 con 0x7f2ce4153420 2023-11-29T11:14:11.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2ce0ff9700 1 -- 172.21.15.81:0/3841128536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc00ca50 con 0x7f2ce4153420 2023-11-29T11:14:11.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40ce590 con 0x7f2ce4153420 2023-11-29T11:14:11.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.321+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce40b1250 con 0x7f2ce4153420 2023-11-29T11:14:11.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.325+0000 7f2ce0ff9700 1 -- 172.21.15.81:0/3841128536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2cdc019030 con 0x7f2ce4153420 2023-11-29T11:14:11.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.325+0000 7f2ce0ff9700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2cc4064ee0 0x7f2cc4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.325+0000 7f2ce0ff9700 1 -- 172.21.15.81:0/3841128536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2cdc081ca0 con 0x7f2ce4153420 2023-11-29T11:14:11.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.325+0000 7f2ce37fe700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2cc4064ee0 0x7f2cc4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.325+0000 7f2ce37fe700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2cc4064ee0 0x7f2cc4067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400b2c0 tx=0x7f2cd4013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.333+0000 7f2ce0ff9700 1 -- 172.21.15.81:0/3841128536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2cdc04fee0 con 0x7f2ce4153420 2023-11-29T11:14:11.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.553+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f2ce4072500 con 0x7f2ce4153420 2023-11-29T11:14:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.561+0000 7f2ce0ff9700 1 -- 172.21.15.81:0/3841128536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2cdc053500 con 0x7f2ce4153420 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2cc4064ee0 msgr2=0x7f2cc4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2cc4064ee0 0x7f2cc4067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400b2c0 tx=0x7f2cd4013000 comp rx=0 tx=0).stop 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4153420 msgr2=0x7f2ce4150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4153420 0x7f2ce4150ca0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00e9d0 tx=0x7f2cdc00ece0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 shutdown_connections 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2cc4064ee0 0x7f2cc4067390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ce415cb50 0x7f2ce40b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ce41537f0 0x7f2ce4150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 --2- 172.21.15.81:0/3841128536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4153420 0x7f2ce4150ca0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 >> 172.21.15.81:0/3841128536 conn(0x7f2ce406caf0 msgr2=0x7f2ce406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 shutdown_connections 2023-11-29T11:14:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.565+0000 7f2cea9ae700 1 -- 172.21.15.81:0/3841128536 wait complete. 2023-11-29T11:14:11.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-29T11:14:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.689+0000 7fa2e6220700 1 Processor -- start 2023-11-29T11:14:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.689+0000 7fa2e6220700 1 -- start start 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.689+0000 7fa2e6220700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2e00cb460 0x7fa2e00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.689+0000 7fa2e6220700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa2e00ad490 0x7fa2e00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.689+0000 7fa2e6220700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e00cd8f0 con 0x7fa2e0158e60 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.689+0000 7fa2e6220700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00add00 con 0x7fa2e00cb460 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00cc4f0 con 0x7fa2e00ad490 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e4a1d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2e00cb460 0x7fa2e00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e4a1d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2e00cb460 0x7fa2e00c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38310/0 (socket says 172.21.15.81:38310) 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e4a1d700 1 -- 172.21.15.81:0/3338025898 learned_addr learned my addr 172.21.15.81:0/3338025898 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e5a1f700 1 --2- 172.21.15.81:0/3338025898 >> v2:172.21.15.176:3300/0 conn(0x7fa2e00ad490 0x7fa2e00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e4a1d700 1 -- 172.21.15.81:0/3338025898 >> v2:172.21.15.176:3300/0 conn(0x7fa2e00ad490 msgr2=0x7fa2e00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e4a1d700 1 --2- 172.21.15.81:0/3338025898 >> v2:172.21.15.176:3300/0 conn(0x7fa2e00ad490 0x7fa2e00cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e4a1d700 1 -- 172.21.15.81:0/3338025898 >> v1:172.21.15.176:6789/0 conn(0x7fa2e0158e60 legacy=0x7fa2e00cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e4a1d700 1 -- 172.21.15.81:0/3338025898 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e006dc60 con 0x7fa2e00cb460 2023-11-29T11:14:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e4a1d700 1 --2- 172.21.15.81:0/3338025898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c8a30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00afe60 tx=0x7fa2d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8809fdda6fcc87bf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2dffff700 1 -- 172.21.15.81:0/3338025898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000e070 con 0x7fa2e00cb460 2023-11-29T11:14:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2dffff700 1 -- 172.21.15.81:0/3338025898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000b8d0 con 0x7fa2e00cb460 2023-11-29T11:14:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2dffff700 1 -- 172.21.15.81:0/3338025898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000bc80 con 0x7fa2e00cb460 2023-11-29T11:14:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 -- 172.21.15.81:0/3338025898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 msgr2=0x7fa2e00c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 --2- 172.21.15.81:0/3338025898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c8a30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00afe60 tx=0x7fa2d000b330 comp rx=0 tx=0).stop 2023-11-29T11:14:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 -- 172.21.15.81:0/3338025898 shutdown_connections 2023-11-29T11:14:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 --2- 172.21.15.81:0/3338025898 >> v2:172.21.15.176:3300/0 conn(0x7fa2e00ad490 0x7fa2e00cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 --2- 172.21.15.81:0/3338025898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c8a30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 -- 172.21.15.81:0/3338025898 >> 172.21.15.81:0/3338025898 conn(0x7fa2e00ce3e0 msgr2=0x7fa2e00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 -- 172.21.15.81:0/3338025898 shutdown_connections 2023-11-29T11:14:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.693+0000 7fa2e6220700 1 -- 172.21.15.81:0/3338025898 wait complete. 2023-11-29T11:14:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 Processor -- start 2023-11-29T11:14:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 -- start start 2023-11-29T11:14:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2e00ad490 0x7fa2e00ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2e0158e60 0x7fa2e00c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00c7440 con 0x7fa2e00cb460 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00c63a0 con 0x7fa2e0158e60 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00c6680 con 0x7fa2e00ad490 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38326/0 (socket says 172.21.15.81:38326) 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 -- 172.21.15.81:0/2284858106 learned_addr learned my addr 172.21.15.81:0/2284858106 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e521e700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2e00ad490 0x7fa2e00ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e5a1f700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2e0158e60 0x7fa2e00c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 -- 172.21.15.81:0/2284858106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2e00ad490 msgr2=0x7fa2e00ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2e00ad490 0x7fa2e00ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 -- 172.21.15.81:0/2284858106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2e0158e60 msgr2=0x7fa2e00c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2e0158e60 0x7fa2e00c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 -- 172.21.15.81:0/2284858106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0009b30 con 0x7fa2e00cb460 2023-11-29T11:14:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e4a1d700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c3f50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000b370 tx=0x7fa2d0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2ddffb700 1 -- 172.21.15.81:0/2284858106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0004880 con 0x7fa2e00cb460 2023-11-29T11:14:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2ddffb700 1 -- 172.21.15.81:0/2284858106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d00092e0 con 0x7fa2e00cb460 2023-11-29T11:14:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e0159230 con 0x7fa2e00cb460 2023-11-29T11:14:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2ddffb700 1 -- 172.21.15.81:0/2284858106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d001c680 con 0x7fa2e00cb460 2023-11-29T11:14:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.697+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e00cde90 con 0x7fa2e00cb460 2023-11-29T11:14:11.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.701+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e006d6a0 con 0x7fa2e00cb460 2023-11-29T11:14:11.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.701+0000 7fa2ddffb700 1 -- 172.21.15.81:0/2284858106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa2d0022030 con 0x7fa2e00cb460 2023-11-29T11:14:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.701+0000 7fa2ddffb700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa2cc064ee0 0x7fa2cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.701+0000 7fa2ddffb700 1 -- 172.21.15.81:0/2284858106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa2d00833e0 con 0x7fa2e00cb460 2023-11-29T11:14:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.701+0000 7fa2e521e700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa2cc064ee0 0x7fa2cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.705+0000 7fa2e521e700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa2cc064ee0 0x7fa2cc067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0156c70 tx=0x7fa2d4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.709+0000 7fa2ddffb700 1 -- 172.21.15.81:0/2284858106 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa2d0051790 con 0x7fa2e00cb460 2023-11-29T11:14:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.929+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa2e00cb8e0 con 0x7fa2e00cb460 2023-11-29T11:14:11.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.937+0000 7fa2ddffb700 1 -- 172.21.15.81:0/2284858106 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa2d0054db0 con 0x7fa2e00cb460 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa2cc064ee0 msgr2=0x7fa2cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa2cc064ee0 0x7fa2cc067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0156c70 tx=0x7fa2d4009040 comp rx=0 tx=0).stop 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 msgr2=0x7fa2e00c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c3f50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000b370 tx=0x7fa2d0004af0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 shutdown_connections 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa2cc064ee0 0x7fa2cc067390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2e0158e60 0x7fa2e00c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e00cb460 0x7fa2e00c3f50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 --2- 172.21.15.81:0/2284858106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2e00ad490 0x7fa2e00ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 >> 172.21.15.81:0/2284858106 conn(0x7fa2e00ce3e0 msgr2=0x7fa2e006a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 shutdown_connections 2023-11-29T11:14:11.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:11.941+0000 7fa2e6220700 1 -- 172.21.15.81:0/2284858106 wait complete. 2023-11-29T11:14:11.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-29T11:14:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.065+0000 7fc0c3fff700 1 Processor -- start 2023-11-29T11:14:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.065+0000 7fc0c3fff700 1 -- start start 2023-11-29T11:14:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.065+0000 7fc0c3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c4159d70 0x7fc0c40cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.065+0000 7fc0c3fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc0c40cdaa0 0x7fc0c40b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.065+0000 7fc0c3fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c415a140 con 0x7fc0c40b1070 2023-11-29T11:14:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.065+0000 7fc0c3fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c406d590 con 0x7fc0c40cdaa0 2023-11-29T11:14:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.065+0000 7fc0c3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40b1ed0 con 0x7fc0c4159d70 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c2ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c4159d70 0x7fc0c40cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c37fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc0c40cdaa0 0x7fc0c40b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c2ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c4159d70 0x7fc0c40cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:41978/0 (socket says 172.21.15.81:41978) 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c2ffd700 1 -- 172.21.15.81:0/2742143632 learned_addr learned my addr 172.21.15.81:0/2742143632 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c2ffd700 1 -- 172.21.15.81:0/2742143632 >> v2:172.21.15.176:3300/0 conn(0x7fc0c40cdaa0 msgr2=0x7fc0c40b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c2ffd700 1 --2- 172.21.15.81:0/2742143632 >> v2:172.21.15.176:3300/0 conn(0x7fc0c40cdaa0 0x7fc0c40b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c2ffd700 1 -- 172.21.15.81:0/2742143632 >> v1:172.21.15.176:6789/0 conn(0x7fc0c40b1070 legacy=0x7fc0c40cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c2ffd700 1 -- 172.21.15.81:0/2742143632 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c415d1d0 con 0x7fc0c4159d70 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c37fe700 1 --2- 172.21.15.81:0/2742143632 >> v2:172.21.15.176:3300/0 conn(0x7fc0c40cdaa0 0x7fc0c40b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c2ffd700 1 --2- 172.21.15.81:0/2742143632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c4159d70 0x7fc0c40cac70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009910 tx=0x7fc0b4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d72b13103d386178 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c27fc700 1 -- 172.21.15.81:0/2742143632 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4011830 con 0x7fc0c4159d70 2023-11-29T11:14:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c27fc700 1 -- 172.21.15.81:0/2742143632 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4011990 con 0x7fc0c4159d70 2023-11-29T11:14:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c27fc700 1 -- 172.21.15.81:0/2742143632 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4011d40 con 0x7fc0c4159d70 2023-11-29T11:14:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2742143632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c4159d70 msgr2=0x7fc0c40cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2742143632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c4159d70 0x7fc0c40cac70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009910 tx=0x7fc0b4009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2742143632 shutdown_connections 2023-11-29T11:14:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2742143632 >> v2:172.21.15.176:3300/0 conn(0x7fc0c40cdaa0 0x7fc0c40b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2742143632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c4159d70 0x7fc0c40cac70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2742143632 >> 172.21.15.81:0/2742143632 conn(0x7fc0c4069c40 msgr2=0x7fc0c406a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2742143632 shutdown_connections 2023-11-29T11:14:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.069+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2742143632 wait complete. 2023-11-29T11:14:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c3fff700 1 Processor -- start 2023-11-29T11:14:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c3fff700 1 -- start start 2023-11-29T11:14:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c40b1070 0x7fc0c40c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0c40cdaa0 0x7fc0c415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c4159d70 0x7fc0c415ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40c87e0 con 0x7fc0c4159d70 2023-11-29T11:14:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40c8ac0 con 0x7fc0c40cdaa0 2023-11-29T11:14:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40c8da0 con 0x7fc0c40b1070 2023-11-29T11:14:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c4159d70 0x7fc0c415ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c4159d70 0x7fc0c415ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38336/0 (socket says 172.21.15.81:38336) 2023-11-29T11:14:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c37fe700 1 -- 172.21.15.81:0/2782285531 learned_addr learned my addr 172.21.15.81:0/2782285531 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0bbfff700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0c40cdaa0 0x7fc0c415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c2ffd700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c40b1070 0x7fc0c40c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c37fe700 1 -- 172.21.15.81:0/2782285531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c40b1070 msgr2=0x7fc0c40c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c37fe700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c40b1070 0x7fc0c40c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c37fe700 1 -- 172.21.15.81:0/2782285531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0c40cdaa0 msgr2=0x7fc0c415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c37fe700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0c40cdaa0 0x7fc0c415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.073+0000 7fc0c37fe700 1 -- 172.21.15.81:0/2782285531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc009a70 con 0x7fc0c4159d70 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c37fe700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c4159d70 0x7fc0c415ba70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00efc0 tx=0x7fc0bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c0ff9700 1 -- 172.21.15.81:0/2782285531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00ca90 con 0x7fc0c4159d70 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c0ff9700 1 -- 172.21.15.81:0/2782285531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc00f040 con 0x7fc0c4159d70 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b4009570 con 0x7fc0c4159d70 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c0ff9700 1 -- 172.21.15.81:0/2782285531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00ce50 con 0x7fc0c4159d70 2023-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c406d1b0 con 0x7fc0c4159d70 2023-11-29T11:14:12.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c415d4b0 con 0x7fc0c4159d70 2023-11-29T11:14:12.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c0ff9700 1 -- 172.21.15.81:0/2782285531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc0bc014480 con 0x7fc0c4159d70 2023-11-29T11:14:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c0ff9700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc0a4064ee0 0x7fc0a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c2ffd700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc0a4064ee0 0x7fc0a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c0ff9700 1 -- 172.21.15.81:0/2782285531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc0bc082410 con 0x7fc0c4159d70 2023-11-29T11:14:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.077+0000 7fc0c2ffd700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc0a4064ee0 0x7fc0a4067390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009c60 tx=0x7fc0b4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.085+0000 7fc0c0ff9700 1 -- 172.21.15.81:0/2782285531 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc0bc050760 con 0x7fc0c4159d70 2023-11-29T11:14:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.297+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc0c406ce60 con 0x7fc0c4159d70 2023-11-29T11:14:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.305+0000 7fc0c0ff9700 1 -- 172.21.15.81:0/2782285531 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc0bc053d80 con 0x7fc0c4159d70 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc0a4064ee0 msgr2=0x7fc0a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc0a4064ee0 0x7fc0a4067390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009c60 tx=0x7fc0b4008030 comp rx=0 tx=0).stop 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c4159d70 msgr2=0x7fc0c415ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c4159d70 0x7fc0c415ba70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00efc0 tx=0x7fc0bc00c3a0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 shutdown_connections 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc0a4064ee0 0x7fc0a4067390 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c4159d70 0x7fc0c415ba70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0c40cdaa0 0x7fc0c415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 --2- 172.21.15.81:0/2782285531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0c40b1070 0x7fc0c40c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 >> 172.21.15.81:0/2782285531 conn(0x7fc0c4069c40 msgr2=0x7fc0c406e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 shutdown_connections 2023-11-29T11:14:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.309+0000 7fc0c3fff700 1 -- 172.21.15.81:0/2782285531 wait complete. 2023-11-29T11:14:12.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-29T11:14:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.437+0000 7f0b6cb98700 1 Processor -- start 2023-11-29T11:14:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.437+0000 7f0b6cb98700 1 -- start start 2023-11-29T11:14:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b6cb98700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b680b32e0 0x7f0b680b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b6cb98700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b6806a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b6cb98700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680cbe00 con 0x7f0b681584c0 2023-11-29T11:14:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b6cb98700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6806dbd0 con 0x7f0b680b32e0 2023-11-29T11:14:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b6cb98700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680b3c60 con 0x7f0b68069cd0 2023-11-29T11:14:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b677fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0b681584c0 0x7f0b680cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51924/0 (socket says 172.21.15.81:51924) 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b677fe700 1 -- 172.21.15.81:0/1216948209 learned_addr learned my addr 172.21.15.81:0/1216948209 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b66ffd700 1 --2- 172.21.15.81:0/1216948209 >> v2:172.21.15.81:3300/0 conn(0x7f0b680b32e0 0x7f0b680b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b67fff700 1 --2- 172.21.15.81:0/1216948209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b6806a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b667fc700 1 -- 172.21.15.81:0/1216948209 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582569675 0 0) 0x7f0b680cbe00 con 0x7f0b681584c0 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b667fc700 1 -- 172.21.15.81:0/1216948209 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b500035d0 con 0x7f0b681584c0 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b66ffd700 1 -- 172.21.15.81:0/1216948209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 msgr2=0x7f0b6806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b66ffd700 1 --2- 172.21.15.81:0/1216948209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b6806a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b66ffd700 1 -- 172.21.15.81:0/1216948209 >> v1:172.21.15.81:6789/0 conn(0x7f0b681584c0 legacy=0x7f0b680cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b66ffd700 1 -- 172.21.15.81:0/1216948209 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680cd0f0 con 0x7f0b680b32e0 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b67fff700 1 --2- 172.21.15.81:0/1216948209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b6806a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b66ffd700 1 --2- 172.21.15.81:0/1216948209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b3720 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009850 tx=0x7f0b5c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59480cedad99e39 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b667fc700 1 -- 172.21.15.81:0/1216948209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011830 con 0x7f0b680b32e0 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b667fc700 1 -- 172.21.15.81:0/1216948209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c011990 con 0x7f0b680b32e0 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b667fc700 1 -- 172.21.15.81:0/1216948209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011d00 con 0x7f0b680b32e0 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b6cb98700 1 -- 172.21.15.81:0/1216948209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 msgr2=0x7f0b680b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/1216948209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b3720 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009850 tx=0x7f0b5c009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.441+0000 7f0b6cb98700 1 -- 172.21.15.81:0/1216948209 shutdown_connections 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.445+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/1216948209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b6806a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.445+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/1216948209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b3720 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.445+0000 7f0b6cb98700 1 -- 172.21.15.81:0/1216948209 >> 172.21.15.81:0/1216948209 conn(0x7f0b680ce3e0 msgr2=0x7f0b680ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.445+0000 7f0b6cb98700 1 -- 172.21.15.81:0/1216948209 shutdown_connections 2023-11-29T11:14:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.445+0000 7f0b6cb98700 1 -- 172.21.15.81:0/1216948209 wait complete. 2023-11-29T11:14:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.445+0000 7f0b6cb98700 1 Processor -- start 2023-11-29T11:14:12.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.445+0000 7f0b6cb98700 1 -- start start 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b6cb98700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b68151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b6cb98700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b6cb98700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b681584c0 0x7f0b68070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b6cb98700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681640a0 con 0x7f0b680b32e0 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b6cb98700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68151540 con 0x7f0b681584c0 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b6cb98700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680b0c00 con 0x7f0b68069cd0 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38356/0 (socket says 172.21.15.81:38356) 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 -- 172.21.15.81:0/2720596314 learned_addr learned my addr 172.21.15.81:0/2720596314 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b677fe700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b68151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b67fff700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b681584c0 0x7f0b68070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 -- 172.21.15.81:0/2720596314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 msgr2=0x7f0b68151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b68151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 -- 172.21.15.81:0/2720596314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b681584c0 msgr2=0x7f0b68070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b681584c0 0x7f0b68070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 -- 172.21.15.81:0/2720596314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009a70 con 0x7f0b680b32e0 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b66ffd700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b0320 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0090b0 tx=0x7f0b5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b4ffff700 1 -- 172.21.15.81:0/2720596314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c004550 con 0x7f0b680b32e0 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b4ffff700 1 -- 172.21.15.81:0/2720596314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c01f070 con 0x7f0b680b32e0 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0094b0 con 0x7f0b680b32e0 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b4ffff700 1 -- 172.21.15.81:0/2720596314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c003900 con 0x7f0b680b32e0 2023-11-29T11:14:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.449+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b680cd6b0 con 0x7f0b680b32e0 2023-11-29T11:14:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.453+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b680cd3d0 con 0x7f0b680b32e0 2023-11-29T11:14:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.453+0000 7f0b4ffff700 1 -- 172.21.15.81:0/2720596314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0b5c00f050 con 0x7f0b680b32e0 2023-11-29T11:14:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.453+0000 7f0b4ffff700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b54064ee0 0x7f0b54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.453+0000 7f0b4ffff700 1 -- 172.21.15.81:0/2720596314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0b5c021070 con 0x7f0b680b32e0 2023-11-29T11:14:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.453+0000 7f0b677fe700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b54064ee0 0x7f0b54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.453+0000 7f0b677fe700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b54064ee0 0x7f0b54067390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b58007fd0 tx=0x7f0b58000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.461+0000 7f0b4ffff700 1 -- 172.21.15.81:0/2720596314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0b5c0517d0 con 0x7f0b680b32e0 2023-11-29T11:14:12.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.681+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0b680cd990 con 0x7f0b680b32e0 2023-11-29T11:14:12.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b4ffff700 1 -- 172.21.15.81:0/2720596314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0b5c054df0 con 0x7f0b680b32e0 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b54064ee0 msgr2=0x7f0b54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b54064ee0 0x7f0b54067390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b58007fd0 tx=0x7f0b58000bc0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 msgr2=0x7f0b680b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b0320 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0090b0 tx=0x7f0b5c004770 comp rx=0 tx=0).stop 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 shutdown_connections 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b54064ee0 0x7f0b54067390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b681584c0 0x7f0b68070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b680b32e0 0x7f0b680b0320 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 --2- 172.21.15.81:0/2720596314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68069cd0 0x7f0b68151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 >> 172.21.15.81:0/2720596314 conn(0x7f0b680ce3e0 msgr2=0x7f0b680ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 shutdown_connections 2023-11-29T11:14:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.689+0000 7f0b6cb98700 1 -- 172.21.15.81:0/2720596314 wait complete. 2023-11-29T11:14:12.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-29T11:14:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb28b1a700 1 Processor -- start 2023-11-29T11:14:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb28b1a700 1 -- start start 2023-11-29T11:14:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb28b1a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240cb460 0x7fcb240c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb28b1a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb240ad490 0x7fcb240cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb28b1a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb240cd8f0 con 0x7fcb24158e60 2023-11-29T11:14:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb28b1a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb240add00 con 0x7fcb240ad490 2023-11-29T11:14:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb28b1a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240cc4f0 con 0x7fcb240cb460 2023-11-29T11:14:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb23fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb240ad490 0x7fcb240cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb23fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb240ad490 0x7fcb240cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38370/0 (socket says 172.21.15.81:38370) 2023-11-29T11:14:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb22ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240cb460 0x7fcb240c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb23fff700 1 -- 172.21.15.81:0/917937767 learned_addr learned my addr 172.21.15.81:0/917937767 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb23fff700 1 -- 172.21.15.81:0/917937767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240cb460 msgr2=0x7fcb240c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb23fff700 1 --2- 172.21.15.81:0/917937767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240cb460 0x7fcb240c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb23fff700 1 -- 172.21.15.81:0/917937767 >> v1:172.21.15.176:6789/0 conn(0x7fcb24158e60 legacy=0x7fcb240cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb23fff700 1 -- 172.21.15.81:0/917937767 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2406dc60 con 0x7fcb240ad490 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb23fff700 1 --2- 172.21.15.81:0/917937767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb240cbfb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009eb0 tx=0x7fcb1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e55ed6e1d5742bf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb227fc700 1 -- 172.21.15.81:0/917937767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00e070 con 0x7fcb240ad490 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb227fc700 1 -- 172.21.15.81:0/917937767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c00b890 con 0x7fcb240ad490 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.813+0000 7fcb227fc700 1 -- 172.21.15.81:0/917937767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00bc40 con 0x7fcb240ad490 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 -- 172.21.15.81:0/917937767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 msgr2=0x7fcb240cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/917937767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb240cbfb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009eb0 tx=0x7fcb1c00b330 comp rx=0 tx=0).stop 2023-11-29T11:14:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 -- 172.21.15.81:0/917937767 shutdown_connections 2023-11-29T11:14:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/917937767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb240cbfb0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/917937767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240cb460 0x7fcb240c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 -- 172.21.15.81:0/917937767 >> 172.21.15.81:0/917937767 conn(0x7fcb240ce3e0 msgr2=0x7fcb240ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 -- 172.21.15.81:0/917937767 shutdown_connections 2023-11-29T11:14:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 -- 172.21.15.81:0/917937767 wait complete. 2023-11-29T11:14:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 Processor -- start 2023-11-29T11:14:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.817+0000 7fcb28b1a700 1 -- start start 2023-11-29T11:14:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb24156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb240cb460 0x7fcb241ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb24158e60 0x7fcb2406a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb241ef7c0 con 0x7fcb240ad490 2023-11-29T11:14:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb241569a0 con 0x7fcb240cb460 2023-11-29T11:14:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb241ef200 con 0x7fcb24158e60 2023-11-29T11:14:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb24156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb24156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38378/0 (socket says 172.21.15.81:38378) 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 -- 172.21.15.81:0/3458629426 learned_addr learned my addr 172.21.15.81:0/3458629426 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb22ffd700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb240cb460 0x7fcb241ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 -- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb24158e60 msgr2=0x7fcb2406a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb23fff700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb24158e60 0x7fcb2406a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb24158e60 0x7fcb2406a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 -- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb240cb460 msgr2=0x7fcb241ee7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb240cb460 0x7fcb241ee7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 -- 172.21.15.81:0/3458629426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c009b30 con 0x7fcb240ad490 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb22ffd700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb240cb460 0x7fcb241ee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb23fff700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb24158e60 0x7fcb2406a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb237fe700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb24156460 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400c500 tx=0x7fcb1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb1bfff700 1 -- 172.21.15.81:0/3458629426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140052d0 con 0x7fcb240ad490 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb1bfff700 1 -- 172.21.15.81:0/3458629426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb14005430 con 0x7fcb240ad490 2023-11-29T11:14:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb1bfff700 1 -- 172.21.15.81:0/3458629426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140055a0 con 0x7fcb240ad490 2023-11-29T11:14:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb24159230 con 0x7fcb240ad490 2023-11-29T11:14:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb240cde90 con 0x7fcb240ad490 2023-11-29T11:14:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2406d6a0 con 0x7fcb240ad490 2023-11-29T11:14:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.821+0000 7fcb1bfff700 1 -- 172.21.15.81:0/3458629426 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcb14019030 con 0x7fcb240ad490 2023-11-29T11:14:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.825+0000 7fcb1bfff700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb04064ee0 0x7fcb04067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:12.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.825+0000 7fcb22ffd700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb04064ee0 0x7fcb04067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:12.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.825+0000 7fcb1bfff700 1 -- 172.21.15.81:0/3458629426 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcb140810c0 con 0x7fcb240ad490 2023-11-29T11:14:12.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.825+0000 7fcb22ffd700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb04064ee0 0x7fcb04067390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcb241f2ed0 tx=0x7fcb0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:12.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:12.833+0000 7fcb1bfff700 1 -- 172.21.15.81:0/3458629426 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcb1404f410 con 0x7fcb240ad490 2023-11-29T11:14:13.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.033+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fcb24072500 con 0x7fcb240ad490 2023-11-29T11:14:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.041+0000 7fcb1bfff700 1 -- 172.21.15.81:0/3458629426 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcb140170a0 con 0x7fcb240ad490 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb04064ee0 msgr2=0x7fcb04067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb04064ee0 0x7fcb04067390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcb241f2ed0 tx=0x7fcb0c008040 comp rx=0 tx=0).stop 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 msgr2=0x7fcb24156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb24156460 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400c500 tx=0x7fcb1400c8c0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 shutdown_connections 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb04064ee0 0x7fcb04067390 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb24158e60 0x7fcb2406a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb240cb460 0x7fcb241ee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 --2- 172.21.15.81:0/3458629426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb240ad490 0x7fcb24156460 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 >> 172.21.15.81:0/3458629426 conn(0x7fcb240ce3e0 msgr2=0x7fcb240ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 shutdown_connections 2023-11-29T11:14:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.045+0000 7fcb28b1a700 1 -- 172.21.15.81:0/3458629426 wait complete. 2023-11-29T11:14:13.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:13.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.165+0000 7ff88a367700 1 Processor -- start 2023-11-29T11:14:13.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.165+0000 7ff88a367700 1 -- start start 2023-11-29T11:14:13.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff88406a6e0 0x7ff88406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff8840cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88406aff0 con 0x7ff88415a470 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88406cb80 con 0x7ff88406a6e0 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88406ce60 con 0x7ff8840d01d0 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889365700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff88406a6e0 0x7ff88406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889b66700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff88415a470 0x7ff8840c3070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51940/0 (socket says 172.21.15.81:51940) 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889b66700 1 -- 172.21.15.81:0/84335916 learned_addr learned my addr 172.21.15.81:0/84335916 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889365700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff88406a6e0 0x7ff88406aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38390/0 (socket says 172.21.15.81:38390) 2023-11-29T11:14:13.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff888b64700 1 --2- 172.21.15.81:0/84335916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff8840cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889365700 1 -- 172.21.15.81:0/84335916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 msgr2=0x7ff8840cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889365700 1 --2- 172.21.15.81:0/84335916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff8840cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889365700 1 -- 172.21.15.81:0/84335916 >> v1:172.21.15.81:6789/0 conn(0x7ff88415a470 legacy=0x7ff8840c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff87bfff700 1 -- 172.21.15.81:0/84335916 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577854268 0 0) 0x7ff88406aff0 con 0x7ff88415a470 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889365700 1 -- 172.21.15.81:0/84335916 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840ce5b0 con 0x7ff88406a6e0 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff889365700 1 --2- 172.21.15.81:0/84335916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff88406aab0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff880009850 tx=0x7ff880009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c96629537ec6549 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff87bfff700 1 -- 172.21.15.81:0/84335916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880011830 con 0x7ff88406a6e0 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff87bfff700 1 -- 172.21.15.81:0/84335916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff880011990 con 0x7ff88406a6e0 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff87bfff700 1 -- 172.21.15.81:0/84335916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880011d40 con 0x7ff88406a6e0 2023-11-29T11:14:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 -- 172.21.15.81:0/84335916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 msgr2=0x7ff88406aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 --2- 172.21.15.81:0/84335916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff88406aab0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff880009850 tx=0x7ff880009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 -- 172.21.15.81:0/84335916 shutdown_connections 2023-11-29T11:14:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 --2- 172.21.15.81:0/84335916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff8840cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 --2- 172.21.15.81:0/84335916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff88406aab0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 -- 172.21.15.81:0/84335916 >> 172.21.15.81:0/84335916 conn(0x7ff8840b1d40 msgr2=0x7ff8840cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 -- 172.21.15.81:0/84335916 shutdown_connections 2023-11-29T11:14:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.169+0000 7ff88a367700 1 -- 172.21.15.81:0/84335916 wait complete. 2023-11-29T11:14:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 Processor -- start 2023-11-29T11:14:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 -- start start 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff8840c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff88415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88415a470 0x7ff88415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88415be90 con 0x7ff88406a6e0 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88415b280 con 0x7ff88415a470 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88415b560 con 0x7ff8840d01d0 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff8840c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff8840c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38394/0 (socket says 172.21.15.81:38394) 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 -- 172.21.15.81:0/3013604073 learned_addr learned my addr 172.21.15.81:0/3013604073 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889b66700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88415a470 0x7ff88415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff888b64700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff88415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 -- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 msgr2=0x7ff88415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff88415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 -- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88415a470 msgr2=0x7ff88415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88415a470 0x7ff88415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 -- 172.21.15.81:0/3013604073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8800094b0 con 0x7ff88406a6e0 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff888b64700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff88415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889b66700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88415a470 0x7ff88415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff889365700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff8840c8f90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff880000c00 tx=0x7ff880004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff879ffb700 1 -- 172.21.15.81:0/3013604073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88001aac0 con 0x7ff88406a6e0 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff879ffb700 1 -- 172.21.15.81:0/3013604073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88001f070 con 0x7ff88406a6e0 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88406c930 con 0x7ff88406a6e0 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.173+0000 7ff879ffb700 1 -- 172.21.15.81:0/3013604073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88001ae60 con 0x7ff88406a6e0 2023-11-29T11:14:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.177+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88406c7a0 con 0x7ff88406a6e0 2023-11-29T11:14:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.177+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8840c3780 con 0x7ff88406a6e0 2023-11-29T11:14:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.177+0000 7ff879ffb700 1 -- 172.21.15.81:0/3013604073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff88000f050 con 0x7ff88406a6e0 2023-11-29T11:14:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.177+0000 7ff879ffb700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff868064ee0 0x7ff868067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.177+0000 7ff888b64700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff868064ee0 0x7ff868067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.177+0000 7ff879ffb700 1 -- 172.21.15.81:0/3013604073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff880082f90 con 0x7ff88406a6e0 2023-11-29T11:14:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.181+0000 7ff888b64700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff868064ee0 0x7ff868067390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8840b50d0 tx=0x7ff874008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.185+0000 7ff879ffb700 1 -- 172.21.15.81:0/3013604073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff8800511d0 con 0x7ff88406a6e0 2023-11-29T11:14:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.341+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff884072500 con 0x7ff88406a6e0 2023-11-29T11:14:13.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.341+0000 7ff879ffb700 1 -- 172.21.15.81:0/3013604073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14318 (secure 0 0 0) 0x7ff880015090 con 0x7ff88406a6e0 2023-11-29T11:14:13.347 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:13.347 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:10.411185+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff868064ee0 msgr2=0x7ff868067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff868064ee0 0x7ff868067390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8840b50d0 tx=0x7ff874008040 comp rx=0 tx=0).stop 2023-11-29T11:14:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 msgr2=0x7ff8840c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff8840c8f90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff880000c00 tx=0x7ff880004770 comp rx=0 tx=0).stop 2023-11-29T11:14:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 shutdown_connections 2023-11-29T11:14:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff868064ee0 0x7ff868067390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff88415a470 0x7ff88415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8840d01d0 0x7ff88415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 --2- 172.21.15.81:0/3013604073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88406a6e0 0x7ff8840c8f90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 >> 172.21.15.81:0/3013604073 conn(0x7ff8840b1d40 msgr2=0x7ff8840afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 shutdown_connections 2023-11-29T11:14:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.345+0000 7ff88a367700 1 -- 172.21.15.81:0/3013604073 wait complete. 2023-11-29T11:14:13.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:14:13.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:14:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318bfff700 1 Processor -- start 2023-11-29T11:14:13.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318bfff700 1 -- start start 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f318c15c520 0x7f318c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318bfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f318c0ac1f0 0x7f318c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c0b0910 con 0x7f318c0cc830 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0b2250 con 0x7f318c15c520 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318bfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0ccc70 con 0x7f318c0ac1f0 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f318c0cc830 0x7f318c0aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51952/0 (socket says 172.21.15.81:51952) 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318b7fe700 1 -- 172.21.15.81:0/2725682551 learned_addr learned my addr 172.21.15.81:0/2725682551 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318affd700 1 --2- 172.21.15.81:0/2725682551 >> v2:172.21.15.81:3300/0 conn(0x7f318c15c520 0x7f318c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318a7fc700 1 --2- 172.21.15.81:0/2725682551 >> v2:172.21.15.176:3300/0 conn(0x7f318c0ac1f0 0x7f318c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f3189ffb700 1 -- 172.21.15.81:0/2725682551 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510545868 0 0) 0x7f318c0b0910 con 0x7f318c0cc830 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f3189ffb700 1 -- 172.21.15.81:0/2725682551 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31740035d0 con 0x7f318c0cc830 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318affd700 1 -- 172.21.15.81:0/2725682551 >> v2:172.21.15.176:3300/0 conn(0x7f318c0ac1f0 msgr2=0x7f318c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318affd700 1 --2- 172.21.15.81:0/2725682551 >> v2:172.21.15.176:3300/0 conn(0x7f318c0ac1f0 0x7f318c0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318affd700 1 -- 172.21.15.81:0/2725682551 >> v1:172.21.15.81:6789/0 conn(0x7f318c0cc830 legacy=0x7f318c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318affd700 1 -- 172.21.15.81:0/2725682551 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c06a470 con 0x7f318c15c520 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f318affd700 1 --2- 172.21.15.81:0/2725682551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c15c520 0x7f318c069c40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f317c009850 tx=0x7f317c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dc9af5b31325dd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f3189ffb700 1 -- 172.21.15.81:0/2725682551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c011830 con 0x7f318c15c520 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f3189ffb700 1 -- 172.21.15.81:0/2725682551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c011990 con 0x7f318c15c520 2023-11-29T11:14:13.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.465+0000 7f3189ffb700 1 -- 172.21.15.81:0/2725682551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c011d00 con 0x7f318c15c520 2023-11-29T11:14:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- 172.21.15.81:0/2725682551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c15c520 msgr2=0x7f318c069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 --2- 172.21.15.81:0/2725682551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c15c520 0x7f318c069c40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f317c009850 tx=0x7f317c009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- 172.21.15.81:0/2725682551 shutdown_connections 2023-11-29T11:14:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 --2- 172.21.15.81:0/2725682551 >> v2:172.21.15.176:3300/0 conn(0x7f318c0ac1f0 0x7f318c0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 --2- 172.21.15.81:0/2725682551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c15c520 0x7f318c069c40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- 172.21.15.81:0/2725682551 >> 172.21.15.81:0/2725682551 conn(0x7f318c0cae70 msgr2=0x7f318c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:13.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- 172.21.15.81:0/2725682551 shutdown_connections 2023-11-29T11:14:13.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- 172.21.15.81:0/2725682551 wait complete. 2023-11-29T11:14:13.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 Processor -- start 2023-11-29T11:14:13.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- start start 2023-11-29T11:14:13.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c0ac1f0 0x7f318c09adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318c0cc830 0x7f318c0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c15c520 0x7f318c0b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c09b330 con 0x7f318c0ac1f0 2023-11-29T11:14:13.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c15d6a0 con 0x7f318c15c520 2023-11-29T11:14:13.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0af230 con 0x7f318c0cc830 2023-11-29T11:14:13.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.469+0000 7f318affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c0ac1f0 0x7f318c09adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c0ac1f0 0x7f318c09adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38412/0 (socket says 172.21.15.81:38412) 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318affd700 1 -- 172.21.15.81:0/3995388674 learned_addr learned my addr 172.21.15.81:0/3995388674 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318a7fc700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318c0cc830 0x7f318c0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318b7fe700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c15c520 0x7f318c0b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318affd700 1 -- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318c0cc830 msgr2=0x7f318c0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318affd700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318c0cc830 0x7f318c0b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318affd700 1 -- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c15c520 msgr2=0x7f318c0b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318affd700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c15c520 0x7f318c0b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318affd700 1 -- 172.21.15.81:0/3995388674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c0094b0 con 0x7f318c0ac1f0 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318a7fc700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318c0cc830 0x7f318c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318affd700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c0ac1f0 0x7f318c09adf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f317c0090b0 tx=0x7f317c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f31737fe700 1 -- 172.21.15.81:0/3995388674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c0036c0 con 0x7f318c0ac1f0 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f31737fe700 1 -- 172.21.15.81:0/3995388674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c01f070 con 0x7f318c0ac1f0 2023-11-29T11:14:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f31737fe700 1 -- 172.21.15.81:0/3995388674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c003a20 con 0x7f318c0ac1f0 2023-11-29T11:14:13.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c06aa30 con 0x7f318c0ac1f0 2023-11-29T11:14:13.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c06a750 con 0x7f318c0ac1f0 2023-11-29T11:14:13.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c06ad10 con 0x7f318c0ac1f0 2023-11-29T11:14:13.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f31737fe700 1 -- 172.21.15.81:0/3995388674 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f317c00f050 con 0x7f318c0ac1f0 2023-11-29T11:14:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.473+0000 7f31737fe700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3178064ee0 0x7f3178067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.477+0000 7f31737fe700 1 -- 172.21.15.81:0/3995388674 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f317c021070 con 0x7f318c0ac1f0 2023-11-29T11:14:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.477+0000 7f318a7fc700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3178064ee0 0x7f3178067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.477+0000 7f318a7fc700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3178064ee0 0x7f3178067390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f318c099ba0 tx=0x7f3180008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.481+0000 7f31737fe700 1 -- 172.21.15.81:0/3995388674 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f317c051910 con 0x7f318c0ac1f0 2023-11-29T11:14:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.629+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f318c072500 con 0x7f318c0ac1f0 2023-11-29T11:14:13.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.629+0000 7f31737fe700 1 -- 172.21.15.81:0/3995388674 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f317c054f30 con 0x7f318c0ac1f0 2023-11-29T11:14:13.635 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:14:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3178064ee0 msgr2=0x7f3178067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3178064ee0 0x7f3178067390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f318c099ba0 tx=0x7f3180008040 comp rx=0 tx=0).stop 2023-11-29T11:14:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c0ac1f0 msgr2=0x7f318c09adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c0ac1f0 0x7f318c09adf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f317c0090b0 tx=0x7f317c004770 comp rx=0 tx=0).stop 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 shutdown_connections 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3178064ee0 0x7f3178067390 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c15c520 0x7f318c0b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318c0cc830 0x7f318c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 --2- 172.21.15.81:0/3995388674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f318c0ac1f0 0x7f318c09adf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 >> 172.21.15.81:0/3995388674 conn(0x7f318c0cae70 msgr2=0x7f318c0c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 shutdown_connections 2023-11-29T11:14:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.633+0000 7f318bfff700 1 -- 172.21.15.81:0/3995388674 wait complete. 2023-11-29T11:14:13.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:14:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bff4e0700 1 Processor -- start 2023-11-29T11:14:13.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bff4e0700 1 -- start start 2023-11-29T11:14:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bff4e0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf8160ac0 0x7f8bf80b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bff4e0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80d0740 con 0x7f8bf80b45f0 2023-11-29T11:14:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bff4e0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80b4f00 con 0x7f8bf80cd1c0 2023-11-29T11:14:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bff4e0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80d0990 con 0x7f8bf8160ac0 2023-11-29T11:14:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bfd27c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8bf80b45f0 0x7f8bf80d1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51954/0 (socket says 172.21.15.81:51954) 2023-11-29T11:14:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bfd27c700 1 -- 172.21.15.81:0/2543564088 learned_addr learned my addr 172.21.15.81:0/2543564088 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bfca7b700 1 --2- 172.21.15.81:0/2543564088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf8160ac0 0x7f8bf80b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8beffff700 1 -- 172.21.15.81:0/2543564088 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174488093 0 0) 0x7f8bf80d0740 con 0x7f8bf80b45f0 2023-11-29T11:14:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8beffff700 1 -- 172.21.15.81:0/2543564088 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be40035d0 con 0x7f8bf80b45f0 2023-11-29T11:14:13.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8beffff700 1 -- 172.21.15.81:0/2543564088 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650080471 0 0) 0x7f8bf80b4f00 con 0x7f8bf80cd1c0 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8beffff700 1 -- 172.21.15.81:0/2543564088 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf80d0740 con 0x7f8bf80cd1c0 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bfca7b700 1 -- 172.21.15.81:0/2543564088 >> v1:172.21.15.176:6789/0 conn(0x7f8bf80cd1c0 legacy=0x7f8bf80b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bfca7b700 1 -- 172.21.15.81:0/2543564088 >> v1:172.21.15.81:6789/0 conn(0x7f8bf80b45f0 legacy=0x7f8bf80d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8beffff700 1 -- 172.21.15.81:0/2543564088 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 544520521 0 0) 0x7f8be40035d0 con 0x7f8bf80b45f0 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.757+0000 7f8bfca7b700 1 -- 172.21.15.81:0/2543564088 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80d0c70 con 0x7f8bf8160ac0 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bfca7b700 1 --2- 172.21.15.81:0/2543564088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf8160ac0 0x7f8bf80b49c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009880 tx=0x7f8bf4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb4b64f9587a3da4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8beffff700 1 -- 172.21.15.81:0/2543564088 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8001670 con 0x7f8bf8160ac0 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8beffff700 1 -- 172.21.15.81:0/2543564088 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4004030 con 0x7f8bf8160ac0 2023-11-29T11:14:13.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8beffff700 1 -- 172.21.15.81:0/2543564088 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40043a0 con 0x7f8bf8160ac0 2023-11-29T11:14:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 -- 172.21.15.81:0/2543564088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf8160ac0 msgr2=0x7f8bf80b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 --2- 172.21.15.81:0/2543564088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf8160ac0 0x7f8bf80b49c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009880 tx=0x7f8bf4009b90 comp rx=0 tx=0).stop 2023-11-29T11:14:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 -- 172.21.15.81:0/2543564088 shutdown_connections 2023-11-29T11:14:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 --2- 172.21.15.81:0/2543564088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf8160ac0 0x7f8bf80b49c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 -- 172.21.15.81:0/2543564088 >> 172.21.15.81:0/2543564088 conn(0x7f8bf806cb40 msgr2=0x7f8bf80cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 -- 172.21.15.81:0/2543564088 shutdown_connections 2023-11-29T11:14:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 -- 172.21.15.81:0/2543564088 wait complete. 2023-11-29T11:14:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 Processor -- start 2023-11-29T11:14:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.761+0000 7f8bff4e0700 1 -- start start 2023-11-29T11:14:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bff4e0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf80b45f0 0x7f8bf815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bff4e0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bf80cd1c0 0x7f8bf81f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bff4e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf8160ac0 0x7f8bf8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bff4e0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81f61a0 con 0x7f8bf8160ac0 2023-11-29T11:14:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bff4e0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf814e890 con 0x7f8bf80cd1c0 2023-11-29T11:14:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bff4e0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf815a160 con 0x7f8bf80b45f0 2023-11-29T11:14:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf8160ac0 0x7f8bf8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf8160ac0 0x7f8bf8152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38420/0 (socket says 172.21.15.81:38420) 2023-11-29T11:14:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 -- 172.21.15.81:0/4134544492 learned_addr learned my addr 172.21.15.81:0/4134544492 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfca7b700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bf80cd1c0 0x7f8bf81f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfd27c700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf80b45f0 0x7f8bf815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 -- 172.21.15.81:0/4134544492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf80b45f0 msgr2=0x7f8bf815a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf80b45f0 0x7f8bf815a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 -- 172.21.15.81:0/4134544492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bf80cd1c0 msgr2=0x7f8bf81f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bf80cd1c0 0x7f8bf81f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 -- 172.21.15.81:0/4134544492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf40094b0 con 0x7f8bf8160ac0 2023-11-29T11:14:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bfda7d700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf8160ac0 0x7f8bf8152fd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000cc20 tx=0x7f8bf000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bedffb700 1 -- 172.21.15.81:0/4134544492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0003c20 con 0x7f8bf8160ac0 2023-11-29T11:14:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bedffb700 1 -- 172.21.15.81:0/4134544492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf0003d80 con 0x7f8bf8160ac0 2023-11-29T11:14:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf80d1230 con 0x7f8bf8160ac0 2023-11-29T11:14:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bedffb700 1 -- 172.21.15.81:0/4134544492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000aae0 con 0x7f8bf8160ac0 2023-11-29T11:14:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.765+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf80d0f50 con 0x7f8bf8160ac0 2023-11-29T11:14:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.769+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf815c660 con 0x7f8bf8160ac0 2023-11-29T11:14:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.769+0000 7f8bedffb700 1 -- 172.21.15.81:0/4134544492 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8bf0010050 con 0x7f8bf8160ac0 2023-11-29T11:14:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.769+0000 7f8bedffb700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bdc064ee0 0x7f8bdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.769+0000 7f8bedffb700 1 -- 172.21.15.81:0/4134544492 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8bf0081b70 con 0x7f8bf8160ac0 2023-11-29T11:14:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.769+0000 7f8bfd27c700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bdc064ee0 0x7f8bdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.769+0000 7f8bfd27c700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bdc064ee0 0x7f8bdc067390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8be8004a80 tx=0x7f8be8000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:13.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.777+0000 7f8bedffb700 1 -- 172.21.15.81:0/4134544492 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8bf004ff20 con 0x7f8bf8160ac0 2023-11-29T11:14:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.925+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bf81f5c40 con 0x7f8bf8160ac0 2023-11-29T11:14:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.925+0000 7f8bedffb700 1 -- 172.21.15.81:0/4134544492 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bf0053540 con 0x7f8bf8160ac0 2023-11-29T11:14:13.933 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bdc064ee0 msgr2=0x7f8bdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bdc064ee0 0x7f8bdc067390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8be8004a80 tx=0x7f8be8000bc0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf8160ac0 msgr2=0x7f8bf8152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf8160ac0 0x7f8bf8152fd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000cc20 tx=0x7f8bf000cf30 comp rx=0 tx=0).stop 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 shutdown_connections 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bdc064ee0 0x7f8bdc067390 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bf8160ac0 0x7f8bf8152fd0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bf80cd1c0 0x7f8bf81f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 --2- 172.21.15.81:0/4134544492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bf80b45f0 0x7f8bf815a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 >> 172.21.15.81:0/4134544492 conn(0x7f8bf806cb40 msgr2=0x7f8bf80b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 shutdown_connections 2023-11-29T11:14:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:13.929+0000 7f8bff4e0700 1 -- 172.21.15.81:0/4134544492 wait complete. 2023-11-29T11:14:13.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-29T11:14:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feecdb94700 1 Processor -- start 2023-11-29T11:14:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feecdb94700 1 -- start start 2023-11-29T11:14:14.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feecdb94700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feec81584c0 0x7feec80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feecdb94700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feec806ace0 0x7feec80b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feecdb94700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec80b3c60 con 0x7feec80b32e0 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feecdb94700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec806dbd0 con 0x7feec81584c0 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feecdb94700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec80cd0f0 con 0x7feec806ace0 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feeccb92700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feec81584c0 0x7feec80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feebffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feec80b32e0 0x7feec806bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51958/0 (socket says 172.21.15.81:51958) 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feebffff700 1 -- 172.21.15.81:0/2699839146 learned_addr learned my addr 172.21.15.81:0/2699839146 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feecd393700 1 --2- 172.21.15.81:0/2699839146 >> v2:172.21.15.176:3300/0 conn(0x7feec806ace0 0x7feec80b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feebf7fe700 1 -- 172.21.15.81:0/2699839146 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066743583 0 0) 0x7feec80b3c60 con 0x7feec80b32e0 2023-11-29T11:14:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.049+0000 7feebf7fe700 1 -- 172.21.15.81:0/2699839146 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb00035d0 con 0x7feec80b32e0 2023-11-29T11:14:14.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feeccb92700 1 -- 172.21.15.81:0/2699839146 >> v2:172.21.15.176:3300/0 conn(0x7feec806ace0 msgr2=0x7feec80b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feeccb92700 1 --2- 172.21.15.81:0/2699839146 >> v2:172.21.15.176:3300/0 conn(0x7feec806ace0 0x7feec80b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feebf7fe700 1 -- 172.21.15.81:0/2699839146 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508149587 0 0) 0x7feeb00035d0 con 0x7feec80b32e0 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feeccb92700 1 -- 172.21.15.81:0/2699839146 >> v1:172.21.15.81:6789/0 conn(0x7feec80b32e0 legacy=0x7feec806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feeccb92700 1 -- 172.21.15.81:0/2699839146 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80cd3d0 con 0x7feec81584c0 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecd393700 1 --2- 172.21.15.81:0/2699839146 >> v2:172.21.15.176:3300/0 conn(0x7feec806ace0 0x7feec80b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feeccb92700 1 --2- 172.21.15.81:0/2699839146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec81584c0 0x7feec80cb6f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feec80b4410 tx=0x7feec4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a87059762e5d9cf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feebf7fe700 1 -- 172.21.15.81:0/2699839146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4011830 con 0x7feec81584c0 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feebf7fe700 1 -- 172.21.15.81:0/2699839146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec4011990 con 0x7feec81584c0 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feebf7fe700 1 -- 172.21.15.81:0/2699839146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4011d00 con 0x7feec81584c0 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecdb94700 1 -- 172.21.15.81:0/2699839146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec81584c0 msgr2=0x7feec80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecdb94700 1 --2- 172.21.15.81:0/2699839146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec81584c0 0x7feec80cb6f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feec80b4410 tx=0x7feec4009b30 comp rx=0 tx=0).stop 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecdb94700 1 -- 172.21.15.81:0/2699839146 shutdown_connections 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecdb94700 1 --2- 172.21.15.81:0/2699839146 >> v2:172.21.15.176:3300/0 conn(0x7feec806ace0 0x7feec80b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecdb94700 1 --2- 172.21.15.81:0/2699839146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec81584c0 0x7feec80cb6f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecdb94700 1 -- 172.21.15.81:0/2699839146 >> 172.21.15.81:0/2699839146 conn(0x7feec80ce3e0 msgr2=0x7feec80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecdb94700 1 -- 172.21.15.81:0/2699839146 shutdown_connections 2023-11-29T11:14:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.053+0000 7feecdb94700 1 -- 172.21.15.81:0/2699839146 wait complete. 2023-11-29T11:14:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecdb94700 1 Processor -- start 2023-11-29T11:14:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecdb94700 1 -- start start 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecdb94700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806ace0 0x7feec80c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecdb94700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b32e0 0x7feec80c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecdb94700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec81584c0 0x7feec81f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecdb94700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81f0ee0 con 0x7feec806ace0 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecdb94700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81f0b90 con 0x7feec81584c0 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecdb94700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec80c49e0 con 0x7feec80b32e0 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806ace0 0x7feec80c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806ace0 0x7feec80c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38442/0 (socket says 172.21.15.81:38442) 2023-11-29T11:14:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 -- 172.21.15.81:0/161161730 learned_addr learned my addr 172.21.15.81:0/161161730 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feebffff700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b32e0 0x7feec80c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecd393700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec81584c0 0x7feec81f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 -- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b32e0 msgr2=0x7feec80c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b32e0 0x7feec80c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 -- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec81584c0 msgr2=0x7feec81f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec81584c0 0x7feec81f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 -- 172.21.15.81:0/161161730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009a70 con 0x7feec806ace0 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feecd393700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec81584c0 0x7feec81f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feeccb92700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806ace0 0x7feec80c44a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feec4014040 tx=0x7feec4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.057+0000 7feebd7fa700 1 -- 172.21.15.81:0/161161730 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4004610 con 0x7feec806ace0 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feebd7fa700 1 -- 172.21.15.81:0/161161730 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec401e070 con 0x7feec806ace0 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec40094b0 con 0x7feec806ace0 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feebd7fa700 1 -- 172.21.15.81:0/161161730 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4003900 con 0x7feec806ace0 2023-11-29T11:14:14.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80cd990 con 0x7feec806ace0 2023-11-29T11:14:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec80cd6b0 con 0x7feec806ace0 2023-11-29T11:14:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feebd7fa700 1 -- 172.21.15.81:0/161161730 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feec400f050 con 0x7feec806ace0 2023-11-29T11:14:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feebd7fa700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feeb4064ee0 0x7feeb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feebffff700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feeb4064ee0 0x7feeb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feebd7fa700 1 -- 172.21.15.81:0/161161730 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7feec4082ad0 con 0x7feec806ace0 2023-11-29T11:14:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.061+0000 7feebffff700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feeb4064ee0 0x7feeb4067390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feec81ee6f0 tx=0x7feeb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:14.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.069+0000 7feebd7fa700 1 -- 172.21.15.81:0/161161730 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feec4050e80 con 0x7feec806ace0 2023-11-29T11:14:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.233+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feec80cdc70 con 0x7feec806ace0 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.233+0000 7feebd7fa700 1 -- 172.21.15.81:0/161161730 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7feec40544a0 con 0x7feec806ace0 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:14:14.239 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-11-29T11:14:14.240 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-11-29T11:14:14.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:14.240 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:14:14.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feeb4064ee0 msgr2=0x7feeb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feeb4064ee0 0x7feeb4067390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feec81ee6f0 tx=0x7feeb8009040 comp rx=0 tx=0).stop 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806ace0 msgr2=0x7feec80c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806ace0 0x7feec80c44a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feec4014040 tx=0x7feec4004770 comp rx=0 tx=0).stop 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 shutdown_connections 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feeb4064ee0 0x7feeb4067390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec81584c0 0x7feec81f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b32e0 0x7feec80c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 --2- 172.21.15.81:0/161161730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806ace0 0x7feec80c44a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 >> 172.21.15.81:0/161161730 conn(0x7feec80ce3e0 msgr2=0x7feec8157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 shutdown_connections 2023-11-29T11:14:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.237+0000 7feecdb94700 1 -- 172.21.15.81:0/161161730 wait complete. 2023-11-29T11:14:14.253 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-29T11:14:14.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-29T11:14:14.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a80b0f700 1 Processor -- start 2023-11-29T11:14:14.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a80b0f700 1 -- start start 2023-11-29T11:14:14.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a80b0f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c0b33d0 0x7f7a7c0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a80b0f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a7c06ac50 0x7f7a7c06b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a80b0f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c06b5b0 con 0x7f7a7c160520 2023-11-29T11:14:14.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a80b0f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0b3d90 con 0x7f7a7c06ac50 2023-11-29T11:14:14.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a80b0f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0b2350 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7ad9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a7c06ac50 0x7f7a7c06b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a79d9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c0b33d0 0x7f7a7c0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7ad9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a7c06ac50 0x7f7a7c06b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:54960/0 (socket says 172.21.15.81:54960) 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7ad9d700 1 -- 172.21.15.81:0/1708562399 learned_addr learned my addr 172.21.15.81:0/1708562399 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7ad9d700 1 -- 172.21.15.81:0/1708562399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c0b33d0 msgr2=0x7f7a7c0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7ad9d700 1 --2- 172.21.15.81:0/1708562399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c0b33d0 0x7f7a7c0b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7ad9d700 1 -- 172.21.15.81:0/1708562399 >> v1:172.21.15.176:6789/0 conn(0x7f7a7c160520 legacy=0x7f7a7c0b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7ad9d700 1 -- 172.21.15.81:0/1708562399 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0b2630 con 0x7f7a7c06ac50 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7ad9d700 1 --2- 172.21.15.81:0/1708562399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c06ac50 0x7f7a7c06b070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009e50 tx=0x7f7a7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb5e435d65f6df0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7959a700 1 -- 172.21.15.81:0/1708562399 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400e070 con 0x7f7a7c06ac50 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7959a700 1 -- 172.21.15.81:0/1708562399 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7400b910 con 0x7f7a7c06ac50 2023-11-29T11:14:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.373+0000 7f7a7959a700 1 -- 172.21.15.81:0/1708562399 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400bcc0 con 0x7f7a7c06ac50 2023-11-29T11:14:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1708562399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c06ac50 msgr2=0x7f7a7c06b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1708562399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c06ac50 0x7f7a7c06b070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009e50 tx=0x7f7a7400b330 comp rx=0 tx=0).stop 2023-11-29T11:14:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1708562399 shutdown_connections 2023-11-29T11:14:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1708562399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c06ac50 0x7f7a7c06b070 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1708562399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c0b33d0 0x7f7a7c0b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1708562399 >> 172.21.15.81:0/1708562399 conn(0x7f7a7c0ce7d0 msgr2=0x7f7a7c0cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1708562399 shutdown_connections 2023-11-29T11:14:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1708562399 wait complete. 2023-11-29T11:14:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 Processor -- start 2023-11-29T11:14:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.377+0000 7f7a80b0f700 1 -- start start 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a7c06ac50 0x7f7a7c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c0b33d0 0x7f7a7c1f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c160520 0x7f7a7c1f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0cba20 con 0x7f7a7c06ac50 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1f6840 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1f6b20 con 0x7f7a7c160520 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a7a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a7c06ac50 0x7f7a7c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a79d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c0b33d0 0x7f7a7c1f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a7a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a7c06ac50 0x7f7a7c15c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38444/0 (socket says 172.21.15.81:38444) 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a79d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c0b33d0 0x7f7a7c1f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:54976/0 (socket says 172.21.15.81:54976) 2023-11-29T11:14:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a7a59c700 1 -- 172.21.15.81:0/1021135504 learned_addr learned my addr 172.21.15.81:0/1021135504 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a7ad9d700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c160520 0x7f7a7c1f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a79d9b700 1 -- 172.21.15.81:0/1021135504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c160520 msgr2=0x7f7a7c1f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a79d9b700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c160520 0x7f7a7c1f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a79d9b700 1 -- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a7c06ac50 msgr2=0x7f7a7c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a79d9b700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a7c06ac50 0x7f7a7c15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a79d9b700 1 -- 172.21.15.81:0/1021135504 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74009b30 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a79d9b700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c0b33d0 0x7f7a7c1f5d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00e900 tx=0x7f7a6c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a6affd700 1 -- 172.21.15.81:0/1021135504 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c013680 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a6affd700 1 -- 172.21.15.81:0/1021135504 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c0137e0 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c0b2bf0 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a6affd700 1 -- 172.21.15.81:0/1021135504 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c013b50 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0b2910 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c0b2ed0 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.381+0000 7f7a6affd700 1 -- 172.21.15.81:0/1021135504 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a6c019030 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.385+0000 7f7a6affd700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a5c064ee0 0x7f7a5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.385+0000 7f7a6affd700 1 -- 172.21.15.81:0/1021135504 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7a6c081ed0 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.385+0000 7f7a7a59c700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a5c064ee0 0x7f7a5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.385+0000 7f7a7a59c700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a5c064ee0 0x7f7a5c067390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7a700018a0 tx=0x7f7a70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.393+0000 7f7a6affd700 1 -- 172.21.15.81:0/1021135504 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7a6c053d50 con 0x7f7a7c0b33d0 2023-11-29T11:14:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:14.553+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7a7c072500 con 0x7f7a7c0b33d0 2023-11-29T11:14:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.449+0000 7f7a6affd700 1 -- 172.21.15.81:0/1021135504 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7a6c0170b0 con 0x7f7a7c0b33d0 2023-11-29T11:14:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a5c064ee0 msgr2=0x7f7a5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a5c064ee0 0x7f7a5c067390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7a700018a0 tx=0x7f7a70009040 comp rx=0 tx=0).stop 2023-11-29T11:14:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c0b33d0 msgr2=0x7f7a7c1f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c0b33d0 0x7f7a7c1f5d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00e900 tx=0x7f7a6c00ec10 comp rx=0 tx=0).stop 2023-11-29T11:14:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 shutdown_connections 2023-11-29T11:14:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a5c064ee0 0x7f7a5c067390 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c160520 0x7f7a7c1f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7c0b33d0 0x7f7a7c1f5d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 --2- 172.21.15.81:0/1021135504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a7c06ac50 0x7f7a7c15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 >> 172.21.15.81:0/1021135504 conn(0x7f7a7c0ce7d0 msgr2=0x7f7a7c071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 shutdown_connections 2023-11-29T11:14:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.457+0000 7f7a80b0f700 1 -- 172.21.15.81:0/1021135504 wait complete. 2023-11-29T11:14:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-11-29T11:14:15.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-29T11:14:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4bfff700 1 Processor -- start 2023-11-29T11:14:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4bfff700 1 -- start start 2023-11-29T11:14:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c06a4c0 0x7fde4c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4bfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fde4c0cf0e0 0x7fde4c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c0cfa80 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4bfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c0d0ab0 con 0x7fde4c0cf0e0 2023-11-29T11:14:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c06a9c0 con 0x7fde4c06a4c0 2023-11-29T11:14:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4b7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fde4c0cf0e0 0x7fde4c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4a7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c06a4c0 0x7fde4c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4b7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fde4c0cf0e0 0x7fde4c0cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:54986/0 (socket says 172.21.15.81:54986) 2023-11-29T11:14:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4b7fe700 1 -- 172.21.15.81:0/3102651577 learned_addr learned my addr 172.21.15.81:0/3102651577 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4b7fe700 1 -- 172.21.15.81:0/3102651577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c06a4c0 msgr2=0x7fde4c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4b7fe700 1 --2- 172.21.15.81:0/3102651577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c06a4c0 0x7fde4c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4b7fe700 1 -- 172.21.15.81:0/3102651577 >> v1:172.21.15.176:6789/0 conn(0x7fde4c0b1ae0 legacy=0x7fde4c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4b7fe700 1 -- 172.21.15.81:0/3102651577 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c06aca0 con 0x7fde4c0cf0e0 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.593+0000 7fde4a7fc700 1 --2- 172.21.15.81:0/3102651577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c06a4c0 0x7fde4c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4b7fe700 1 --2- 172.21.15.81:0/3102651577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c0cf0e0 0x7fde4c0cf540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde44009e50 tx=0x7fde4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75378b3f4e517f56 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde49ffb700 1 -- 172.21.15.81:0/3102651577 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400e070 con 0x7fde4c0cf0e0 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde49ffb700 1 -- 172.21.15.81:0/3102651577 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4400b910 con 0x7fde4c0cf0e0 2023-11-29T11:14:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde49ffb700 1 -- 172.21.15.81:0/3102651577 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400bcc0 con 0x7fde4c0cf0e0 2023-11-29T11:14:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4bfff700 1 -- 172.21.15.81:0/3102651577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c0cf0e0 msgr2=0x7fde4c0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4bfff700 1 --2- 172.21.15.81:0/3102651577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c0cf0e0 0x7fde4c0cf540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde44009e50 tx=0x7fde4400b330 comp rx=0 tx=0).stop 2023-11-29T11:14:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4bfff700 1 -- 172.21.15.81:0/3102651577 shutdown_connections 2023-11-29T11:14:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4bfff700 1 --2- 172.21.15.81:0/3102651577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c0cf0e0 0x7fde4c0cf540 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4bfff700 1 --2- 172.21.15.81:0/3102651577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c06a4c0 0x7fde4c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4bfff700 1 -- 172.21.15.81:0/3102651577 >> 172.21.15.81:0/3102651577 conn(0x7fde4c09bbd0 msgr2=0x7fde4c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4bfff700 1 -- 172.21.15.81:0/3102651577 shutdown_connections 2023-11-29T11:14:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.597+0000 7fde4bfff700 1 -- 172.21.15.81:0/3102651577 wait complete. 2023-11-29T11:14:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 Processor -- start 2023-11-29T11:14:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 -- start start 2023-11-29T11:14:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c06a4c0 0x7fde4c14c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c0b1ae0 0x7fde4c1f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0cf0e0 0x7fde4c0d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c149740 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c14c670 con 0x7fde4c06a4c0 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c1f5fc0 con 0x7fde4c0cf0e0 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c0b1ae0 0x7fde4c1f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c0b1ae0 0x7fde4c1f5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38460/0 (socket says 172.21.15.81:38460) 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4affd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c06a4c0 0x7fde4c14c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 -- 172.21.15.81:0/2070992452 learned_addr learned my addr 172.21.15.81:0/2070992452 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4b7fe700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0cf0e0 0x7fde4c0d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 -- 172.21.15.81:0/2070992452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0cf0e0 msgr2=0x7fde4c0d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0cf0e0 0x7fde4c0d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 -- 172.21.15.81:0/2070992452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c06a4c0 msgr2=0x7fde4c14c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c06a4c0 0x7fde4c14c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 -- 172.21.15.81:0/2070992452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde400094b0 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4a7fc700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c0b1ae0 0x7fde4c1f5a80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fde4000e9b0 tx=0x7fde4000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde33fff700 1 -- 172.21.15.81:0/2070992452 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000ee50 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde44009b30 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde33fff700 1 -- 172.21.15.81:0/2070992452 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4000c850 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde33fff700 1 -- 172.21.15.81:0/2070992452 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000cc00 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.601+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c0b4380 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.605+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c06af80 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.605+0000 7fde33fff700 1 -- 172.21.15.81:0/2070992452 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fde40019030 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.605+0000 7fde33fff700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde38064ee0 0x7fde38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.605+0000 7fde33fff700 1 -- 172.21.15.81:0/2070992452 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fde40081950 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.605+0000 7fde4affd700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde38064ee0 0x7fde38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:15.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.605+0000 7fde4affd700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde38064ee0 0x7fde38067390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fde3c000f60 tx=0x7fde3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.609+0000 7fde33fff700 1 -- 172.21.15.81:0/2070992452 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fde4004fb30 con 0x7fde4c0b1ae0 2023-11-29T11:14:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:15.773+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fde4c0b1eb0 con 0x7fde4c0b1ae0 2023-11-29T11:14:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.461+0000 7fde33fff700 1 -- 172.21.15.81:0/2070992452 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7fde40053150 con 0x7fde4c0b1ae0 2023-11-29T11:14:16.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.477+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde38064ee0 msgr2=0x7fde38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.477+0000 7fde4bfff700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde38064ee0 0x7fde38067390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fde3c000f60 tx=0x7fde3c009040 comp rx=0 tx=0).stop 2023-11-29T11:14:16.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.477+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c0b1ae0 msgr2=0x7fde4c1f5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.477+0000 7fde4bfff700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c0b1ae0 0x7fde4c1f5a80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fde4000e9b0 tx=0x7fde4000ecc0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.481+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 shutdown_connections 2023-11-29T11:14:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.481+0000 7fde4bfff700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde38064ee0 0x7fde38067390 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.481+0000 7fde4bfff700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4c0cf0e0 0x7fde4c0d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.481+0000 7fde4bfff700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c0b1ae0 0x7fde4c1f5a80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.481+0000 7fde4bfff700 1 --2- 172.21.15.81:0/2070992452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde4c06a4c0 0x7fde4c14c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.481+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 >> 172.21.15.81:0/2070992452 conn(0x7fde4c09bbd0 msgr2=0x7fde4c0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.481+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 shutdown_connections 2023-11-29T11:14:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.481+0000 7fde4bfff700 1 -- 172.21.15.81:0/2070992452 wait complete. 2023-11-29T11:14:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-11-29T11:14:16.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-29T11:14:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.609+0000 7f6a8759e700 1 Processor -- start 2023-11-29T11:14:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.609+0000 7f6a8759e700 1 -- start start 2023-11-29T11:14:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a88159fa0 0x7f6a880b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a880cd710 0x7f6a880cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8815a370 con 0x7f6a880b1300 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a880cf770 con 0x7f6a880cd710 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880cff70 con 0x7f6a88159fa0 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a86d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a880cd710 0x7f6a880cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a7dd9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6a880b1300 0x7f6a880cd000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51966/0 (socket says 172.21.15.81:51966) 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a7dd9b700 1 -- 172.21.15.81:0/230690677 learned_addr learned my addr 172.21.15.81:0/230690677 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8659c700 1 --2- 172.21.15.81:0/230690677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a88159fa0 0x7f6a880b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a86d9d700 1 -- 172.21.15.81:0/230690677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a88159fa0 msgr2=0x7f6a880b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a86d9d700 1 --2- 172.21.15.81:0/230690677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a88159fa0 0x7f6a880b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a86d9d700 1 -- 172.21.15.81:0/230690677 >> v1:172.21.15.81:6789/0 conn(0x7f6a880b1300 legacy=0x7f6a880cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a85d9b700 1 -- 172.21.15.81:0/230690677 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189877946 0 0) 0x7f6a8815a370 con 0x7f6a880b1300 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a86d9d700 1 -- 172.21.15.81:0/230690677 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880d0250 con 0x7f6a880cd710 2023-11-29T11:14:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8659c700 1 --2- 172.21.15.81:0/230690677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a88159fa0 0x7f6a880b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a86d9d700 1 --2- 172.21.15.81:0/230690677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880cd710 0x7f6a880cf230 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009d90 tx=0x7f6a8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a470b86c36f74915 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a85d9b700 1 -- 172.21.15.81:0/230690677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000e070 con 0x7f6a880cd710 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a85d9b700 1 -- 172.21.15.81:0/230690677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000bbd0 con 0x7f6a880cd710 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a85d9b700 1 -- 172.21.15.81:0/230690677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80012430 con 0x7f6a880cd710 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 -- 172.21.15.81:0/230690677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880cd710 msgr2=0x7f6a880cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 --2- 172.21.15.81:0/230690677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880cd710 0x7f6a880cf230 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009d90 tx=0x7f6a8000b330 comp rx=0 tx=0).stop 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 -- 172.21.15.81:0/230690677 shutdown_connections 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 --2- 172.21.15.81:0/230690677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880cd710 0x7f6a880cf230 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 --2- 172.21.15.81:0/230690677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a88159fa0 0x7f6a880b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 -- 172.21.15.81:0/230690677 >> 172.21.15.81:0/230690677 conn(0x7f6a880b2180 msgr2=0x7f6a880b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 -- 172.21.15.81:0/230690677 shutdown_connections 2023-11-29T11:14:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.613+0000 7f6a8759e700 1 -- 172.21.15.81:0/230690677 wait complete. 2023-11-29T11:14:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.617+0000 7f6a8759e700 1 Processor -- start 2023-11-29T11:14:16.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.617+0000 7f6a8759e700 1 -- start start 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880b1300 0x7f6a880b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a880cd710 0x7f6a881f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a88159fa0 0x7f6a880c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8815bb10 con 0x7f6a880b1300 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8815a900 con 0x7f6a88159fa0 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8815abe0 con 0x7f6a880cd710 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880b1300 0x7f6a880b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880b1300 0x7f6a880b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38472/0 (socket says 172.21.15.81:38472) 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 -- 172.21.15.81:0/1071822304 learned_addr learned my addr 172.21.15.81:0/1071822304 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:16.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7dd9b700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a880cd710 0x7f6a881f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a86d9d700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a88159fa0 0x7f6a880c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 -- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a880cd710 msgr2=0x7f6a881f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a880cd710 0x7f6a881f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 -- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a88159fa0 msgr2=0x7f6a880c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a88159fa0 0x7f6a880c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 -- 172.21.15.81:0/1071822304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009a70 con 0x7f6a880b1300 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7dd9b700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a880cd710 0x7f6a881f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a86d9d700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a88159fa0 0x7f6a880c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8659c700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880b1300 0x7f6a880b3e60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800e810 tx=0x7f6a7800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7f7fe700 1 -- 172.21.15.81:0/1071822304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78013610 con 0x7f6a880b1300 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7f7fe700 1 -- 172.21.15.81:0/1071822304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78013770 con 0x7f6a880b1300 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7f7fe700 1 -- 172.21.15.81:0/1071822304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78013b00 con 0x7f6a880b1300 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a880afd80 con 0x7f6a880b1300 2023-11-29T11:14:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a880afaa0 con 0x7f6a880b1300 2023-11-29T11:14:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a880b0060 con 0x7f6a880b1300 2023-11-29T11:14:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7f7fe700 1 -- 172.21.15.81:0/1071822304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6a78023070 con 0x7f6a880b1300 2023-11-29T11:14:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7f7fe700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6a68064ee0 0x7f6a68067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7f7fe700 1 -- 172.21.15.81:0/1071822304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f6a78081bd0 con 0x7f6a880b1300 2023-11-29T11:14:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.621+0000 7f6a7dd9b700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6a68064ee0 0x7f6a68067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.625+0000 7f6a7dd9b700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6a68064ee0 0x7f6a68067390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a880cef60 tx=0x7f6a70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.629+0000 7f6a7f7fe700 1 -- 172.21.15.81:0/1071822304 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6a7804fbb0 con 0x7f6a880b1300 2023-11-29T11:14:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.821+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6a88072500 con 0x7f6a880b1300 2023-11-29T11:14:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.833+0000 7f6a7f7fe700 1 -- 172.21.15.81:0/1071822304 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6a780531d0 con 0x7f6a880b1300 2023-11-29T11:14:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6a68064ee0 msgr2=0x7f6a68067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6a68064ee0 0x7f6a68067390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a880cef60 tx=0x7f6a70009040 comp rx=0 tx=0).stop 2023-11-29T11:14:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880b1300 msgr2=0x7f6a880b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880b1300 0x7f6a880b3e60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800e810 tx=0x7f6a7800ebd0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 shutdown_connections 2023-11-29T11:14:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6a68064ee0 0x7f6a68067390 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a880cef60 tx=0x7f6a70009040 comp rx=0 tx=0).stop 2023-11-29T11:14:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a88159fa0 0x7f6a880c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a880cd710 0x7f6a881f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 --2- 172.21.15.81:0/1071822304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a880b1300 0x7f6a880b3e60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.841+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 >> 172.21.15.81:0/1071822304 conn(0x7f6a880b2180 msgr2=0x7f6a880b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.853+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 shutdown_connections 2023-11-29T11:14:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.853+0000 7f6a8759e700 1 -- 172.21.15.81:0/1071822304 wait complete. 2023-11-29T11:14:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 6 and data pool 7 2023-11-29T11:14:16.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.969+0000 7fb0d736d700 1 Processor -- start 2023-11-29T11:14:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.969+0000 7fb0d736d700 1 -- start start 2023-11-29T11:14:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.969+0000 7fb0d736d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0d00cbef0 0x7fb0d00cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.969+0000 7fb0d736d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d00c2fa0 con 0x7fb0d006a840 2023-11-29T11:14:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d0070f50 con 0x7fb0d0160770 2023-11-29T11:14:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d0071e40 con 0x7fb0d00cbef0 2023-11-29T11:14:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5b6a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0d00cbef0 0x7fb0d00cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5b6a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0d00cbef0 0x7fb0d00cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38476/0 (socket says 172.21.15.81:38476) 2023-11-29T11:14:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5b6a700 1 -- 172.21.15.81:0/1592016596 learned_addr learned my addr 172.21.15.81:0/1592016596 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5b6a700 1 -- 172.21.15.81:0/1592016596 >> v1:172.21.15.176:6789/0 conn(0x7fb0d0160770 legacy=0x7fb0d00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5b6a700 1 -- 172.21.15.81:0/1592016596 >> v1:172.21.15.81:6789/0 conn(0x7fb0d006a840 legacy=0x7fb0d006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5b6a700 1 -- 172.21.15.81:0/1592016596 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0071230 con 0x7fb0d00cbef0 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5b6a700 1 --2- 172.21.15.81:0/1592016596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00cc350 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009910 tx=0x7fb0c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a709b326432578 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5369700 1 -- 172.21.15.81:0/1592016596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000ba60 con 0x7fb0d00cbef0 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5369700 1 -- 172.21.15.81:0/1592016596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c000bbc0 con 0x7fb0d00cbef0 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d5369700 1 -- 172.21.15.81:0/1592016596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0009e60 con 0x7fb0d00cbef0 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 -- 172.21.15.81:0/1592016596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 msgr2=0x7fb0d00cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 --2- 172.21.15.81:0/1592016596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00cc350 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009910 tx=0x7fb0c0009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 -- 172.21.15.81:0/1592016596 shutdown_connections 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 --2- 172.21.15.81:0/1592016596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00cc350 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 -- 172.21.15.81:0/1592016596 >> 172.21.15.81:0/1592016596 conn(0x7fb0d006ec40 msgr2=0x7fb0d00b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 -- 172.21.15.81:0/1592016596 shutdown_connections 2023-11-29T11:14:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 -- 172.21.15.81:0/1592016596 wait complete. 2023-11-29T11:14:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 Processor -- start 2023-11-29T11:14:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.973+0000 7fb0d736d700 1 -- start start 2023-11-29T11:14:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d006a840 0x7fb0d00b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d0160770 0x7fb0d00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01e8540 con 0x7fb0d00cbef0 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01e8820 con 0x7fb0d0160770 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01e8b00 con 0x7fb0d006a840 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38480/0 (socket says 172.21.15.81:38480) 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 -- 172.21.15.81:0/3064004144 learned_addr learned my addr 172.21.15.81:0/3064004144 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d636b700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d006a840 0x7fb0d00b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d6b6c700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d0160770 0x7fb0d00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 -- 172.21.15.81:0/3064004144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d006a840 msgr2=0x7fb0d00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d006a840 0x7fb0d00b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 -- 172.21.15.81:0/3064004144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d0160770 msgr2=0x7fb0d00b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d0160770 0x7fb0d00b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 -- 172.21.15.81:0/3064004144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c0009570 con 0x7fb0d00cbef0 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d5b6a700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00b2a40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0000c00 tx=0x7fb0c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0c6ffd700 1 -- 172.21.15.81:0/3064004144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0004610 con 0x7fb0d00cbef0 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0c6ffd700 1 -- 172.21.15.81:0/3064004144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c001f070 con 0x7fb0d00cbef0 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0c6ffd700 1 -- 172.21.15.81:0/3064004144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00038e0 con 0x7fb0d00cbef0 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d00717f0 con 0x7fb0d00cbef0 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d0071510 con 0x7fb0d00cbef0 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.977+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d0071ad0 con 0x7fb0d00cbef0 2023-11-29T11:14:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.981+0000 7fb0c6ffd700 1 -- 172.21.15.81:0/3064004144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb0c000f050 con 0x7fb0d00cbef0 2023-11-29T11:14:16.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.981+0000 7fb0c6ffd700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0b4064f10 0x7fb0b40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:16.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.981+0000 7fb0c6ffd700 1 -- 172.21.15.81:0/3064004144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb0c0021070 con 0x7fb0d00cbef0 2023-11-29T11:14:16.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.981+0000 7fb0d636b700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0b4064f10 0x7fb0b40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.981+0000 7fb0d636b700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0b4064f10 0x7fb0b40673c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00ae850 tx=0x7fb0cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:16.985+0000 7fb0c6ffd700 1 -- 172.21.15.81:0/3064004144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb0c0051910 con 0x7fb0d00cbef0 2023-11-29T11:14:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.149+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0d0072c20 con 0x7fb0d00cbef0 2023-11-29T11:14:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0c6ffd700 1 -- 172.21.15.81:0/3064004144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17987 (secure 0 0 0) 0x7fb0c0054f30 con 0x7fb0d00cbef0 2023-11-29T11:14:17.158 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:17.158 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:16.825478+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:14:14.596602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-29T11:14:15.817550+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0b4064f10 msgr2=0x7fb0b40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0b4064f10 0x7fb0b40673c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00ae850 tx=0x7fb0cc009040 comp rx=0 tx=0).stop 2023-11-29T11:14:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 msgr2=0x7fb0d00b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00b2a40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0000c00 tx=0x7fb0c0004770 comp rx=0 tx=0).stop 2023-11-29T11:14:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 shutdown_connections 2023-11-29T11:14:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb0b4064f10 0x7fb0b40673c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0d0160770 0x7fb0d00b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d00cbef0 0x7fb0d00b2a40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 --2- 172.21.15.81:0/3064004144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0d006a840 0x7fb0d00b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 >> 172.21.15.81:0/3064004144 conn(0x7fb0d006ec40 msgr2=0x7fb0d015fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 shutdown_connections 2023-11-29T11:14:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.153+0000 7fb0d736d700 1 -- 172.21.15.81:0/3064004144 wait complete. 2023-11-29T11:14:17.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a2b59e700 1 Processor -- start 2023-11-29T11:14:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a2b59e700 1 -- start start 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a2b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1a2c0cb460 0x7f1a2c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a2b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c0cd8f0 con 0x7f1a2c0ad490 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a2b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c06dc60 con 0x7f1a2c158e60 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a2b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c0add00 con 0x7f1a2c0cb460 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a2ad9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a2c0ad490 0x7f1a2c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51986/0 (socket says 172.21.15.81:51986) 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a2ad9d700 1 -- 172.21.15.81:0/893126976 learned_addr learned my addr 172.21.15.81:0/893126976 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a23fff700 1 --2- 172.21.15.81:0/893126976 >> v2:172.21.15.176:3300/0 conn(0x7f1a2c0cb460 0x7f1a2c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.281+0000 7f1a29d9b700 1 -- 172.21.15.81:0/893126976 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842938502 0 0) 0x7f1a2c0cd8f0 con 0x7f1a2c0ad490 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a29d9b700 1 -- 172.21.15.81:0/893126976 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a180057e0 con 0x7f1a2c0ad490 2023-11-29T11:14:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a23fff700 1 -- 172.21.15.81:0/893126976 >> v1:172.21.15.176:6789/0 conn(0x7f1a2c158e60 legacy=0x7f1a2c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a23fff700 1 -- 172.21.15.81:0/893126976 >> v1:172.21.15.81:6789/0 conn(0x7f1a2c0ad490 legacy=0x7f1a2c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a23fff700 1 -- 172.21.15.81:0/893126976 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0cde90 con 0x7f1a2c0cb460 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a23fff700 1 --2- 172.21.15.81:0/893126976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c0c8a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009850 tx=0x7f1a14009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=166e8cce8e02b7da server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a29d9b700 1 -- 172.21.15.81:0/893126976 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14011830 con 0x7f1a2c0cb460 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a29d9b700 1 -- 172.21.15.81:0/893126976 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a14011990 con 0x7f1a2c0cb460 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a29d9b700 1 -- 172.21.15.81:0/893126976 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14011d40 con 0x7f1a2c0cb460 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 -- 172.21.15.81:0/893126976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0cb460 msgr2=0x7f1a2c0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 --2- 172.21.15.81:0/893126976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c0c8a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009850 tx=0x7f1a14009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 -- 172.21.15.81:0/893126976 shutdown_connections 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 --2- 172.21.15.81:0/893126976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c0c8a30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 -- 172.21.15.81:0/893126976 >> 172.21.15.81:0/893126976 conn(0x7f1a2c0ce3e0 msgr2=0x7f1a2c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 -- 172.21.15.81:0/893126976 shutdown_connections 2023-11-29T11:14:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 -- 172.21.15.81:0/893126976 wait complete. 2023-11-29T11:14:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 Processor -- start 2023-11-29T11:14:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.285+0000 7f1a2b59e700 1 -- start start 2023-11-29T11:14:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0ad490 0x7f1a2c1ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a2c158e60 0x7f1a2c071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c1579e0 con 0x7f1a2c0cb460 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0c63c0 con 0x7f1a2c0ad490 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0c34d0 con 0x7f1a2c158e60 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a23fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a23fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38492/0 (socket says 172.21.15.81:38492) 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a23fff700 1 -- 172.21.15.81:0/743627212 learned_addr learned my addr 172.21.15.81:0/743627212 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2ad9d700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a2c158e60 0x7f1a2c071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2a59c700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0ad490 0x7f1a2c1ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2ad9d700 1 -- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0ad490 msgr2=0x7f1a2c1ed1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2ad9d700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0ad490 0x7f1a2c1ed1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2ad9d700 1 -- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0cb460 msgr2=0x7f1a2c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2ad9d700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2ad9d700 1 -- 172.21.15.81:0/743627212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140094b0 con 0x7f1a2c158e60 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a23fff700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2ad9d700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a2c158e60 0x7f1a2c071330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400cab0 tx=0x7f1a2400cae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a22ffd700 1 -- 172.21.15.81:0/743627212 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24007480 con 0x7f1a2c158e60 2023-11-29T11:14:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a22ffd700 1 -- 172.21.15.81:0/743627212 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a240075e0 con 0x7f1a2c158e60 2023-11-29T11:14:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c06d6a0 con 0x7f1a2c158e60 2023-11-29T11:14:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a22ffd700 1 -- 172.21.15.81:0/743627212 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24007950 con 0x7f1a2c158e60 2023-11-29T11:14:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.289+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c159230 con 0x7f1a2c158e60 2023-11-29T11:14:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.293+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c06d980 con 0x7f1a2c158e60 2023-11-29T11:14:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.293+0000 7f1a22ffd700 1 -- 172.21.15.81:0/743627212 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1a24019030 con 0x7f1a2c158e60 2023-11-29T11:14:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.293+0000 7f1a22ffd700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a0c064ee0 0x7f1a0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.293+0000 7f1a2a59c700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a0c064ee0 0x7f1a0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.293+0000 7f1a22ffd700 1 -- 172.21.15.81:0/743627212 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1a24081790 con 0x7f1a2c158e60 2023-11-29T11:14:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.293+0000 7f1a2a59c700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a0c064ee0 0x7f1a0c067390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000f60 tx=0x7f1a1c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:17.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.305+0000 7f1a22ffd700 1 -- 172.21.15.81:0/743627212 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1a2404a400 con 0x7f1a2c158e60 2023-11-29T11:14:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.469+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a2c0c6530 con 0x7f1a2c158e60 2023-11-29T11:14:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.473+0000 7f1a22ffd700 1 -- 172.21.15.81:0/743627212 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17987 (secure 0 0 0) 0x7f1a2c0c6530 con 0x7f1a2c158e60 2023-11-29T11:14:17.481 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:17.481 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:16.825478+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:14:14.596602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-29T11:14:15.817550+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a0c064ee0 msgr2=0x7f1a0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a0c064ee0 0x7f1a0c067390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000f60 tx=0x7f1a1c009040 comp rx=0 tx=0).stop 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a2c158e60 msgr2=0x7f1a2c071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a2c158e60 0x7f1a2c071330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400cab0 tx=0x7f1a2400cae0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 shutdown_connections 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a0c064ee0 0x7f1a0c067390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a2c158e60 0x7f1a2c071330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0cb460 0x7f1a2c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 --2- 172.21.15.81:0/743627212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a2c0ad490 0x7f1a2c1ed1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 >> 172.21.15.81:0/743627212 conn(0x7f1a2c0ce3e0 msgr2=0x7f1a2c0afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 shutdown_connections 2023-11-29T11:14:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.477+0000 7f1a2b59e700 1 -- 172.21.15.81:0/743627212 wait complete. 2023-11-29T11:14:17.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-29T11:14:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.609+0000 7f1c2e699700 1 Processor -- start 2023-11-29T11:14:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.609+0000 7f1c2e699700 1 -- start start 2023-11-29T11:14:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2e699700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c2806f010 0x7f1c28161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2e699700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2815a3a0 con 0x7f1c280cbaf0 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2e699700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c280ca430 con 0x7f1c2806a6e0 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2e699700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280ca710 con 0x7f1c2806f010 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2de98700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c280cbaf0 0x7f1c28163fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51988/0 (socket says 172.21.15.81:51988) 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2de98700 1 -- 172.21.15.81:0/4210536031 learned_addr learned my addr 172.21.15.81:0/4210536031 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2ce96700 1 --2- 172.21.15.81:0/4210536031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c2806f010 0x7f1c28161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c1ffff700 1 -- 172.21.15.81:0/4210536031 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373404134 0 0) 0x7f1c20001490 con 0x7f1c280cbaf0 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c1ffff700 1 -- 172.21.15.81:0/4210536031 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c140035d0 con 0x7f1c280cbaf0 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c1ffff700 1 -- 172.21.15.81:0/4210536031 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322476931 0 0) 0x7f1c280ca430 con 0x7f1c2806a6e0 2023-11-29T11:14:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c1ffff700 1 -- 172.21.15.81:0/4210536031 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c20001490 con 0x7f1c2806a6e0 2023-11-29T11:14:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c1ffff700 1 -- 172.21.15.81:0/4210536031 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2339354287 0 0) 0x7f1c140035d0 con 0x7f1c280cbaf0 2023-11-29T11:14:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2ce96700 1 -- 172.21.15.81:0/4210536031 >> v1:172.21.15.176:6789/0 conn(0x7f1c2806a6e0 legacy=0x7f1c2806aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2ce96700 1 -- 172.21.15.81:0/4210536031 >> v1:172.21.15.81:6789/0 conn(0x7f1c280cbaf0 legacy=0x7f1c28163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2ce96700 1 -- 172.21.15.81:0/4210536031 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280ca9f0 con 0x7f1c2806f010 2023-11-29T11:14:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c2ce96700 1 --2- 172.21.15.81:0/4210536031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c2806f010 0x7f1c28161a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c180097f0 tx=0x7f1c18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae2b1294631dcea server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c1ffff700 1 -- 172.21.15.81:0/4210536031 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20001b80 con 0x7f1c2806f010 2023-11-29T11:14:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c1ffff700 1 -- 172.21.15.81:0/4210536031 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c18004030 con 0x7f1c2806f010 2023-11-29T11:14:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.613+0000 7f1c1ffff700 1 -- 172.21.15.81:0/4210536031 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240015f0 con 0x7f1c2806f010 2023-11-29T11:14:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 -- 172.21.15.81:0/4210536031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c2806f010 msgr2=0x7f1c28161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 --2- 172.21.15.81:0/4210536031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c2806f010 0x7f1c28161a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c180097f0 tx=0x7f1c18009b80 comp rx=0 tx=0).stop 2023-11-29T11:14:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 -- 172.21.15.81:0/4210536031 shutdown_connections 2023-11-29T11:14:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 --2- 172.21.15.81:0/4210536031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c2806f010 0x7f1c28161a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 -- 172.21.15.81:0/4210536031 >> 172.21.15.81:0/4210536031 conn(0x7f1c280d0240 msgr2=0x7f1c280cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 -- 172.21.15.81:0/4210536031 shutdown_connections 2023-11-29T11:14:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 -- 172.21.15.81:0/4210536031 wait complete. 2023-11-29T11:14:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 Processor -- start 2023-11-29T11:14:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.617+0000 7f1c2e699700 1 -- start start 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2e699700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2806a6e0 0x7f1c280acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2e699700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c2806f010 0x7f1c281f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2e699700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c280cbaf0 0x7f1c281f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2e699700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280ae140 con 0x7f1c2806f010 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2e699700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c281f4f50 con 0x7f1c2806a6e0 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2e699700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280ad8a0 con 0x7f1c280cbaf0 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2ce96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c2806f010 0x7f1c281f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2d697700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2806a6e0 0x7f1c280acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2d697700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2806a6e0 0x7f1c280acae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:55038/0 (socket says 172.21.15.81:55038) 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2d697700 1 -- 172.21.15.81:0/60804202 learned_addr learned my addr 172.21.15.81:0/60804202 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2de98700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c280cbaf0 0x7f1c281f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2ce96700 1 -- 172.21.15.81:0/60804202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c280cbaf0 msgr2=0x7f1c281f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2ce96700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c280cbaf0 0x7f1c281f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2ce96700 1 -- 172.21.15.81:0/60804202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2806a6e0 msgr2=0x7f1c280acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2ce96700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2806a6e0 0x7f1c280acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2ce96700 1 -- 172.21.15.81:0/60804202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18009450 con 0x7f1c2806f010 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2ce96700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c2806f010 0x7f1c281f0f80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1c18014000 tx=0x7f1c18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c1dffb700 1 -- 172.21.15.81:0/60804202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18010590 con 0x7f1c2806f010 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c1dffb700 1 -- 172.21.15.81:0/60804202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c180106f0 con 0x7f1c2806f010 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c280cafb0 con 0x7f1c2806f010 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c1dffb700 1 -- 172.21.15.81:0/60804202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18010aa0 con 0x7f1c2806f010 2023-11-29T11:14:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.621+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c280cacd0 con 0x7f1c2806f010 2023-11-29T11:14:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.625+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c280ca070 con 0x7f1c2806f010 2023-11-29T11:14:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.625+0000 7f1c1dffb700 1 -- 172.21.15.81:0/60804202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c1800f050 con 0x7f1c2806f010 2023-11-29T11:14:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.625+0000 7f1c1dffb700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c0c064ee0 0x7f1c0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.625+0000 7f1c2d697700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c0c064ee0 0x7f1c0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.625+0000 7f1c1dffb700 1 -- 172.21.15.81:0/60804202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1c18006e40 con 0x7f1c2806f010 2023-11-29T11:14:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.625+0000 7f1c2d697700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c0c064ee0 0x7f1c0c067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1c24001eb0 tx=0x7f1c24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:17.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.633+0000 7f1c1dffb700 1 -- 172.21.15.81:0/60804202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c180515a0 con 0x7f1c2806f010 2023-11-29T11:14:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:17.837+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1c281f4d20 con 0x7f1c2806f010 2023-11-29T11:14:18.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.845+0000 7f1c1dffb700 1 -- 172.21.15.81:0/60804202 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1c18054bc0 con 0x7f1c2806f010 2023-11-29T11:14:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c0c064ee0 msgr2=0x7f1c0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c0c064ee0 0x7f1c0c067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1c24001eb0 tx=0x7f1c24009040 comp rx=0 tx=0).stop 2023-11-29T11:14:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c2806f010 msgr2=0x7f1c281f0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c2806f010 0x7f1c281f0f80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1c18014000 tx=0x7f1c18004770 comp rx=0 tx=0).stop 2023-11-29T11:14:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 shutdown_connections 2023-11-29T11:14:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c0c064ee0 0x7f1c0c067390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c280cbaf0 0x7f1c281f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c2806f010 0x7f1c281f0f80 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 --2- 172.21.15.81:0/60804202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c2806a6e0 0x7f1c280acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 >> 172.21.15.81:0/60804202 conn(0x7f1c280d0240 msgr2=0x7f1c280c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 shutdown_connections 2023-11-29T11:14:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.849+0000 7f1c2e699700 1 -- 172.21.15.81:0/60804202 wait complete. 2023-11-29T11:14:18.873 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-29T11:14:18.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-29T11:14:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7647fff700 1 Processor -- start 2023-11-29T11:14:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7647fff700 1 -- start start 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7647fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 0x7f764815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7647fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f764809bdb0 0x7f764815d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7647fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76480b2db0 con 0x7f76480cbb30 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7647fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480b3240 con 0x7f764809bdb0 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7647fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764806d840 con 0x7f76480b00e0 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f76467fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f764809bdb0 0x7f764815d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f76467fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f764809bdb0 0x7f764815d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38514/0 (socket says 172.21.15.81:38514) 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f76467fc700 1 -- 172.21.15.81:0/2256958419 learned_addr learned my addr 172.21.15.81:0/2256958419 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7646ffd700 1 --2- 172.21.15.81:0/2256958419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 0x7f764815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f76467fc700 1 -- 172.21.15.81:0/2256958419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 msgr2=0x7f764815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f76467fc700 1 --2- 172.21.15.81:0/2256958419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 0x7f764815d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f76467fc700 1 -- 172.21.15.81:0/2256958419 >> v1:172.21.15.176:6789/0 conn(0x7f76480cbb30 legacy=0x7f76480ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f76467fc700 1 -- 172.21.15.81:0/2256958419 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764806d560 con 0x7f764809bdb0 2023-11-29T11:14:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f76467fc700 1 --2- 172.21.15.81:0/2256958419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f764815d820 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7630009910 tx=0x7f7630009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7296e33c5928d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7645ffb700 1 -- 172.21.15.81:0/2256958419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630011830 con 0x7f764809bdb0 2023-11-29T11:14:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7645ffb700 1 -- 172.21.15.81:0/2256958419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630011990 con 0x7f764809bdb0 2023-11-29T11:14:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:18.997+0000 7f7645ffb700 1 -- 172.21.15.81:0/2256958419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630011d40 con 0x7f764809bdb0 2023-11-29T11:14:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- 172.21.15.81:0/2256958419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 msgr2=0x7f764815d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 --2- 172.21.15.81:0/2256958419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f764815d820 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7630009910 tx=0x7f7630009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- 172.21.15.81:0/2256958419 shutdown_connections 2023-11-29T11:14:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 --2- 172.21.15.81:0/2256958419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f764815d820 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 --2- 172.21.15.81:0/2256958419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 0x7f764815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- 172.21.15.81:0/2256958419 >> 172.21.15.81:0/2256958419 conn(0x7f76480cae70 msgr2=0x7f76480cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- 172.21.15.81:0/2256958419 shutdown_connections 2023-11-29T11:14:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- 172.21.15.81:0/2256958419 wait complete. 2023-11-29T11:14:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 Processor -- start 2023-11-29T11:14:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- start start 2023-11-29T11:14:19.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f76480ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:19.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 0x7f76480c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:19.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76480cbb30 0x7f7648151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:19.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480c5a00 con 0x7f764809bdb0 2023-11-29T11:14:19.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76480c5bf0 con 0x7f76480cbb30 2023-11-29T11:14:19.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7647fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480c5ed0 con 0x7f76480b00e0 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7646ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f76480ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7646ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f76480ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38518/0 (socket says 172.21.15.81:38518) 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f7646ffd700 1 -- 172.21.15.81:0/171907254 learned_addr learned my addr 172.21.15.81:0/171907254 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f76477fe700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76480cbb30 0x7f7648151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.001+0000 7f76467fc700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 0x7f76480c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7646ffd700 1 -- 172.21.15.81:0/171907254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 msgr2=0x7f76480c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7646ffd700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 0x7f76480c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7646ffd700 1 -- 172.21.15.81:0/171907254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76480cbb30 msgr2=0x7f7648151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7646ffd700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76480cbb30 0x7f7648151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7646ffd700 1 -- 172.21.15.81:0/171907254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630009570 con 0x7f764809bdb0 2023-11-29T11:14:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7646ffd700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f76480ca5f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f764000efc0 tx=0x7f764000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f763f7fe700 1 -- 172.21.15.81:0/171907254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764000cd10 con 0x7f764809bdb0 2023-11-29T11:14:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f763f7fe700 1 -- 172.21.15.81:0/171907254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764000f040 con 0x7f764809bdb0 2023-11-29T11:14:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76480ac3d0 con 0x7f764809bdb0 2023-11-29T11:14:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f763f7fe700 1 -- 172.21.15.81:0/171907254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400146a0 con 0x7f764809bdb0 2023-11-29T11:14:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76480ac0f0 con 0x7f764809bdb0 2023-11-29T11:14:19.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764806cbe0 con 0x7f764809bdb0 2023-11-29T11:14:19.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.005+0000 7f763f7fe700 1 -- 172.21.15.81:0/171907254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7640014800 con 0x7f764809bdb0 2023-11-29T11:14:19.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.009+0000 7f763f7fe700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7628064ee0 0x7f7628067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:19.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.009+0000 7f763f7fe700 1 -- 172.21.15.81:0/171907254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7640082960 con 0x7f764809bdb0 2023-11-29T11:14:19.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.009+0000 7f76467fc700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7628064ee0 0x7f7628067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:19.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.009+0000 7f76467fc700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7628064ee0 0x7f7628067390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f764809c1a0 tx=0x7f7630008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:19.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.017+0000 7f763f7fe700 1 -- 172.21.15.81:0/171907254 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7640050940 con 0x7f764809bdb0 2023-11-29T11:14:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.213+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7648072500 con 0x7f764809bdb0 2023-11-29T11:14:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.857+0000 7f763f7fe700 1 -- 172.21.15.81:0/171907254 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7640053f60 con 0x7f764809bdb0 2023-11-29T11:14:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7628064ee0 msgr2=0x7f7628067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7628064ee0 0x7f7628067390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f764809c1a0 tx=0x7f7630008030 comp rx=0 tx=0).stop 2023-11-29T11:14:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 msgr2=0x7f76480ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:19.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f76480ca5f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f764000efc0 tx=0x7f764000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 shutdown_connections 2023-11-29T11:14:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7628064ee0 0x7f7628067390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76480cbb30 0x7f7648151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76480b00e0 0x7f76480c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 --2- 172.21.15.81:0/171907254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f764809bdb0 0x7f76480ca5f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 >> 172.21.15.81:0/171907254 conn(0x7f76480cae70 msgr2=0x7f764806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 shutdown_connections 2023-11-29T11:14:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.861+0000 7f7647fff700 1 -- 172.21.15.81:0/171907254 wait complete. 2023-11-29T11:14:19.882 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-29T11:14:19.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:19.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55b59e700 1 Processor -- start 2023-11-29T11:14:19.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55b59e700 1 -- start start 2023-11-29T11:14:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc55c0ad490 0x7fc55c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c0cd8f0 con 0x7fc55c158e60 2023-11-29T11:14:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c06dc60 con 0x7fc55c0cb460 2023-11-29T11:14:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55c0add00 con 0x7fc55c0ad490 2023-11-29T11:14:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc55c158e60 0x7fc55c0cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47530/0 (socket says 172.21.15.81:47530) 2023-11-29T11:14:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55a59c700 1 -- 172.21.15.81:0/397209123 learned_addr learned my addr 172.21.15.81:0/397209123 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:20.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/397209123 >> v2:172.21.15.176:3300/0 conn(0x7fc55c0ad490 0x7fc55c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55959a700 1 -- 172.21.15.81:0/397209123 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556265457 0 0) 0x7fc55c0cd8f0 con 0x7fc55c158e60 2023-11-29T11:14:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55959a700 1 -- 172.21.15.81:0/397209123 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5440035d0 con 0x7fc55c158e60 2023-11-29T11:14:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55ad9d700 1 -- 172.21.15.81:0/397209123 >> v1:172.21.15.176:6789/0 conn(0x7fc55c0cb460 legacy=0x7fc55c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.993+0000 7fc55ad9d700 1 -- 172.21.15.81:0/397209123 >> v1:172.21.15.81:6789/0 conn(0x7fc55c158e60 legacy=0x7fc55c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55ad9d700 1 -- 172.21.15.81:0/397209123 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c0cde90 con 0x7fc55c0ad490 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/397209123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c0ad490 0x7fc55c0c8a30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc554009d90 tx=0x7fc55400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2ddd2d217031af4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55959a700 1 -- 172.21.15.81:0/397209123 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55400e070 con 0x7fc55c0ad490 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55959a700 1 -- 172.21.15.81:0/397209123 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55400bb20 con 0x7fc55c0ad490 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55959a700 1 -- 172.21.15.81:0/397209123 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554012430 con 0x7fc55c0ad490 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- 172.21.15.81:0/397209123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c0ad490 msgr2=0x7fc55c0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 --2- 172.21.15.81:0/397209123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c0ad490 0x7fc55c0c8a30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc554009d90 tx=0x7fc55400b330 comp rx=0 tx=0).stop 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- 172.21.15.81:0/397209123 shutdown_connections 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 --2- 172.21.15.81:0/397209123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c0ad490 0x7fc55c0c8a30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- 172.21.15.81:0/397209123 >> 172.21.15.81:0/397209123 conn(0x7fc55c0ce3e0 msgr2=0x7fc55c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- 172.21.15.81:0/397209123 shutdown_connections 2023-11-29T11:14:20.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- 172.21.15.81:0/397209123 wait complete. 2023-11-29T11:14:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 Processor -- start 2023-11-29T11:14:20.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- start start 2023-11-29T11:14:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55c0ad490 0x7fc55c154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0cb460 0x7fc55c071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c158e60 0x7fc55c1f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0c54b0 con 0x7fc55c0cb460 2023-11-29T11:14:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0c80b0 con 0x7fc55c158e60 2023-11-29T11:14:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:19.997+0000 7fc55b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0c5690 con 0x7fc55c0ad490 2023-11-29T11:14:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0cb460 0x7fc55c071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0cb460 0x7fc55c071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38516/0 (socket says 172.21.15.81:38516) 2023-11-29T11:14:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 -- 172.21.15.81:0/3929013870 learned_addr learned my addr 172.21.15.81:0/3929013870 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc55a59c700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55c0ad490 0x7fc55c154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c158e60 0x7fc55c1f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 -- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55c0ad490 msgr2=0x7fc55c154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55c0ad490 0x7fc55c154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 -- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c158e60 msgr2=0x7fc55c1f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c158e60 0x7fc55c1f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 -- 172.21.15.81:0/3929013870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc554009a70 con 0x7fc55c0cb460 2023-11-29T11:14:20.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc55ad9d700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c158e60 0x7fc55c1f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc559d9b700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0cb460 0x7fc55c071060 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c4d0 tx=0x7fc54c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc54affd700 1 -- 172.21.15.81:0/3929013870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0052d0 con 0x7fc55c0cb460 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc54affd700 1 -- 172.21.15.81:0/3929013870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c005430 con 0x7fc55c0cb460 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc54affd700 1 -- 172.21.15.81:0/3929013870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0055a0 con 0x7fc55c0cb460 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c06d6a0 con 0x7fc55c0cb460 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c159230 con 0x7fc55c0cb460 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.001+0000 7fc54affd700 1 -- 172.21.15.81:0/3929013870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc54c019030 con 0x7fc55c0cb460 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.005+0000 7fc54affd700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064f10 0x7fc53c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.005+0000 7fc54affd700 1 -- 172.21.15.81:0/3929013870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc54c081200 con 0x7fc55c0cb460 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.005+0000 7fc55a59c700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064f10 0x7fc53c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.005+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c06d980 con 0x7fc55c0cb460 2023-11-29T11:14:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.005+0000 7fc55a59c700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064f10 0x7fc53c0673c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc550007fd0 tx=0x7fc550007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.013+0000 7fc54affd700 1 -- 172.21.15.81:0/3929013870 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc54c04f200 con 0x7fc55c0cb460 2023-11-29T11:14:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.205+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc55c072500 con 0x7fc55c0cb460 2023-11-29T11:14:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.209+0000 7fc54affd700 1 -- 172.21.15.81:0/3929013870 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fc54c017070 con 0x7fc55c0cb460 2023-11-29T11:14:20.213 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:20.213 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:14:16.825795+0000","modified":"2023-11-29T11:14:19.853366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1909362607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1909362607},{"type":"v1","addr":"172.21.15.176:6833","nonce":1909362607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T11:14:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.209+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064f10 msgr2=0x7fc53c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.209+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064f10 0x7fc53c0673c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc550007fd0 tx=0x7fc550007de0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.209+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0cb460 msgr2=0x7fc55c071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.209+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0cb460 0x7fc55c071060 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c4d0 tx=0x7fc54c00c7e0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.213+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 shutdown_connections 2023-11-29T11:14:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.213+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc53c064f10 0x7fc53c0673c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.213+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc55c158e60 0x7fc55c1f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.213+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc55c0cb460 0x7fc55c071060 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.213+0000 7fc55b59e700 1 --2- 172.21.15.81:0/3929013870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc55c0ad490 0x7fc55c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.213+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 >> 172.21.15.81:0/3929013870 conn(0x7fc55c0ce3e0 msgr2=0x7fc55c06a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.213+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 shutdown_connections 2023-11-29T11:14:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.213+0000 7fc55b59e700 1 -- 172.21.15.81:0/3929013870 wait complete. 2023-11-29T11:14:20.219 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-11-29T11:14:20.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:20.261 INFO:tasks.ceph.mds.d.smithi176.stderr:2023-11-29T11:14:20.256+0000 7f4a048f6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:14:20.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15764b3700 1 Processor -- start 2023-11-29T11:14:20.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15764b3700 1 -- start start 2023-11-29T11:14:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15764b3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f157015d650 0x7f15700ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15764b3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1570159c00 0x7f15700cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15764b3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15700cc9b0 con 0x7f15700cc020 2023-11-29T11:14:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15764b3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157015a040 con 0x7f157015d650 2023-11-29T11:14:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15764b3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15700cd720 con 0x7f1570159c00 2023-11-29T11:14:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15754b1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f157015d650 0x7f15700ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15754b1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f157015d650 0x7f15700ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38524/0 (socket says 172.21.15.81:38524) 2023-11-29T11:14:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.341+0000 7f15754b1700 1 -- 172.21.15.81:0/2676521173 learned_addr learned my addr 172.21.15.81:0/2676521173 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f1575cb2700 1 --2- 172.21.15.81:0/2676521173 >> v2:172.21.15.176:3300/0 conn(0x7f1570159c00 0x7f15700cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15754b1700 1 -- 172.21.15.81:0/2676521173 >> v2:172.21.15.176:3300/0 conn(0x7f1570159c00 msgr2=0x7f15700cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15754b1700 1 --2- 172.21.15.81:0/2676521173 >> v2:172.21.15.176:3300/0 conn(0x7f1570159c00 0x7f15700cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15754b1700 1 -- 172.21.15.81:0/2676521173 >> v1:172.21.15.176:6789/0 conn(0x7f15700cc020 legacy=0x7f15701594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15754b1700 1 -- 172.21.15.81:0/2676521173 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700cd990 con 0x7f157015d650 2023-11-29T11:14:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15754b1700 1 --2- 172.21.15.81:0/2676521173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157015d650 0x7f15700ce470 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f15700af100 tx=0x7f156c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ed719f35cae59c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f1567fff700 1 -- 172.21.15.81:0/2676521173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00dd30 con 0x7f157015d650 2023-11-29T11:14:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f1567fff700 1 -- 172.21.15.81:0/2676521173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c00de90 con 0x7f157015d650 2023-11-29T11:14:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f1567fff700 1 -- 172.21.15.81:0/2676521173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c010690 con 0x7f157015d650 2023-11-29T11:14:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- 172.21.15.81:0/2676521173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157015d650 msgr2=0x7f15700ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 --2- 172.21.15.81:0/2676521173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157015d650 0x7f15700ce470 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f15700af100 tx=0x7f156c00be90 comp rx=0 tx=0).stop 2023-11-29T11:14:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- 172.21.15.81:0/2676521173 shutdown_connections 2023-11-29T11:14:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 --2- 172.21.15.81:0/2676521173 >> v2:172.21.15.176:3300/0 conn(0x7f1570159c00 0x7f15700cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 --2- 172.21.15.81:0/2676521173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157015d650 0x7f15700ce470 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- 172.21.15.81:0/2676521173 >> 172.21.15.81:0/2676521173 conn(0x7f157006ec40 msgr2=0x7f15700b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- 172.21.15.81:0/2676521173 shutdown_connections 2023-11-29T11:14:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- 172.21.15.81:0/2676521173 wait complete. 2023-11-29T11:14:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 Processor -- start 2023-11-29T11:14:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- start start 2023-11-29T11:14:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15700cc020 0x7f1570157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1570159c00 0x7f15700cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157015d650 0x7f1570149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1570155bc0 con 0x7f15700cc020 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1570155dd0 con 0x7f1570159c00 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15764b3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15701560b0 con 0x7f157015d650 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15754b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15700cc020 0x7f1570157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15754b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15700cc020 0x7f1570157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38530/0 (socket says 172.21.15.81:38530) 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.345+0000 7f15754b1700 1 -- 172.21.15.81:0/2045292291 learned_addr learned my addr 172.21.15.81:0/2045292291 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f1574cb0700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1570159c00 0x7f15700cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f1575cb2700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157015d650 0x7f1570149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15754b1700 1 -- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157015d650 msgr2=0x7f1570149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15754b1700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157015d650 0x7f1570149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15754b1700 1 -- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1570159c00 msgr2=0x7f15700cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15754b1700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1570159c00 0x7f15700cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15754b1700 1 -- 172.21.15.81:0/2045292291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c00b810 con 0x7f15700cc020 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f1575cb2700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157015d650 0x7f1570149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15754b1700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15700cc020 0x7f1570157840 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1570071fb0 tx=0x7f156c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f1565ffb700 1 -- 172.21.15.81:0/2045292291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c003c90 con 0x7f15700cc020 2023-11-29T11:14:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f1565ffb700 1 -- 172.21.15.81:0/2045292291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c003df0 con 0x7f15700cc020 2023-11-29T11:14:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15700cdf50 con 0x7f15700cc020 2023-11-29T11:14:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f1565ffb700 1 -- 172.21.15.81:0/2045292291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c0106b0 con 0x7f15700cc020 2023-11-29T11:14:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15700cdc70 con 0x7f15700cc020 2023-11-29T11:14:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157015a250 con 0x7f15700cc020 2023-11-29T11:14:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f1565ffb700 1 -- 172.21.15.81:0/2045292291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f156c02c440 con 0x7f15700cc020 2023-11-29T11:14:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.349+0000 7f1565ffb700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1554064ee0 0x7f1554067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.353+0000 7f1565ffb700 1 -- 172.21.15.81:0/2045292291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f156c083a30 con 0x7f15700cc020 2023-11-29T11:14:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.353+0000 7f1574cb0700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1554064ee0 0x7f1554067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.353+0000 7f1574cb0700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1554064ee0 0x7f1554067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15600018a0 tx=0x7f1560009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.361+0000 7f1565ffb700 1 -- 172.21.15.81:0/2045292291 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f156c051a30 con 0x7f15700cc020 2023-11-29T11:14:20.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.525+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1570072c20 con 0x7f15700cc020 2023-11-29T11:14:20.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f1565ffb700 1 -- 172.21.15.81:0/2045292291 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17974 (secure 0 0 0) 0x7f156c055050 con 0x7f15700cc020 2023-11-29T11:14:20.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:20.534 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:17.829695+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:14:14.596602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-29T11:14:15.817550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1554064ee0 msgr2=0x7f1554067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1554064ee0 0x7f1554067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15600018a0 tx=0x7f1560009040 comp rx=0 tx=0).stop 2023-11-29T11:14:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15700cc020 msgr2=0x7f1570157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15700cc020 0x7f1570157840 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1570071fb0 tx=0x7f156c004770 comp rx=0 tx=0).stop 2023-11-29T11:14:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 shutdown_connections 2023-11-29T11:14:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1554064ee0 0x7f1554067390 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f157015d650 0x7f1570149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1570159c00 0x7f15700cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 --2- 172.21.15.81:0/2045292291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15700cc020 0x7f1570157840 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 >> 172.21.15.81:0/2045292291 conn(0x7f157006ec40 msgr2=0x7f157006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 shutdown_connections 2023-11-29T11:14:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.529+0000 7f15764b3700 1 -- 172.21.15.81:0/2045292291 wait complete. 2023-11-29T11:14:20.550 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-29T11:14:20.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:14:20.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c8144b700 1 Processor -- start 2023-11-29T11:14:20.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c8144b700 1 -- start start 2023-11-29T11:14:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c8144b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c7c158e60 0x7f3c7c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c8144b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c8144b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7c0cd8f0 con 0x7f3c7c0ad490 2023-11-29T11:14:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c8144b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7c0add00 con 0x7f3c7c158e60 2023-11-29T11:14:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c8144b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c0cc4f0 con 0x7f3c7c0cb460 2023-11-29T11:14:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c737fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3c7c0ad490 0x7f3c7c0cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47538/0 (socket says 172.21.15.81:47538) 2023-11-29T11:14:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c737fe700 1 -- 172.21.15.81:0/2990730241 learned_addr learned my addr 172.21.15.81:0/2990730241 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c7bfff700 1 --2- 172.21.15.81:0/2990730241 >> v2:172.21.15.176:3300/0 conn(0x7f3c7c158e60 0x7f3c7c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c80c4a700 1 --2- 172.21.15.81:0/2990730241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c7bfff700 1 -- 172.21.15.81:0/2990730241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 msgr2=0x7f3c7c0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.657+0000 7f3c7b7fe700 1 -- 172.21.15.81:0/2990730241 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316790254 0 0) 0x7f3c7c0cd8f0 con 0x7f3c7c0ad490 2023-11-29T11:14:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c7bfff700 1 --2- 172.21.15.81:0/2990730241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c7bfff700 1 -- 172.21.15.81:0/2990730241 >> v1:172.21.15.81:6789/0 conn(0x7f3c7c0ad490 legacy=0x7f3c7c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c7bfff700 1 -- 172.21.15.81:0/2990730241 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c06dc60 con 0x7f3c7c158e60 2023-11-29T11:14:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c7bfff700 1 --2- 172.21.15.81:0/2990730241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 0x7f3c7c0c8a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009850 tx=0x7f3c6c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57da54731e54a2f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c7b7fe700 1 -- 172.21.15.81:0/2990730241 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c011830 con 0x7f3c7c158e60 2023-11-29T11:14:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c7b7fe700 1 -- 172.21.15.81:0/2990730241 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c011990 con 0x7f3c7c158e60 2023-11-29T11:14:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c7b7fe700 1 -- 172.21.15.81:0/2990730241 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c011d40 con 0x7f3c7c158e60 2023-11-29T11:14:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 -- 172.21.15.81:0/2990730241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 msgr2=0x7f3c7c0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 --2- 172.21.15.81:0/2990730241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 0x7f3c7c0c8a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009850 tx=0x7f3c6c009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 -- 172.21.15.81:0/2990730241 shutdown_connections 2023-11-29T11:14:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 --2- 172.21.15.81:0/2990730241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 --2- 172.21.15.81:0/2990730241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 0x7f3c7c0c8a30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 -- 172.21.15.81:0/2990730241 >> 172.21.15.81:0/2990730241 conn(0x7f3c7c0ce3e0 msgr2=0x7f3c7c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 -- 172.21.15.81:0/2990730241 shutdown_connections 2023-11-29T11:14:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 -- 172.21.15.81:0/2990730241 wait complete. 2023-11-29T11:14:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 Processor -- start 2023-11-29T11:14:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.661+0000 7f3c8144b700 1 -- start start 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7c0ad490 0x7f3c7c14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 0x7f3c7c153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c14dd60 con 0x7f3c7c0ad490 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c097480 con 0x7f3c7c158e60 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c097ce0 con 0x7f3c7c0cb460 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7c0ad490 0x7f3c7c14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7c0ad490 0x7f3c7c14fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38546/0 (socket says 172.21.15.81:38546) 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 -- 172.21.15.81:0/176992181 learned_addr learned my addr 172.21.15.81:0/176992181 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c80c4a700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 0x7f3c7c153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c737fe700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 -- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 msgr2=0x7f3c7c070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 -- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 msgr2=0x7f3c7c153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 0x7f3c7c153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 -- 172.21.15.81:0/176992181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0094b0 con 0x7f3c7c0ad490 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c80c4a700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 0x7f3c7c153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c737fe700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c7bfff700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7c0ad490 0x7f3c7c14fa60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009ba0 tx=0x7f3c6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c797fa700 1 -- 172.21.15.81:0/176992181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0036c0 con 0x7f3c7c0ad490 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c797fa700 1 -- 172.21.15.81:0/176992181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c01e070 con 0x7f3c7c0ad490 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7c159230 con 0x7f3c7c0ad490 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c797fa700 1 -- 172.21.15.81:0/176992181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c003a80 con 0x7f3c7c0ad490 2023-11-29T11:14:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7c0cde90 con 0x7f3c7c0ad490 2023-11-29T11:14:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7c06d6a0 con 0x7f3c7c0ad490 2023-11-29T11:14:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.665+0000 7f3c797fa700 1 -- 172.21.15.81:0/176992181 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3c6c00f050 con 0x7f3c7c0ad490 2023-11-29T11:14:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.669+0000 7f3c797fa700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c5c064f10 0x7f3c5c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.669+0000 7f3c737fe700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c5c064f10 0x7f3c5c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.669+0000 7f3c797fa700 1 -- 172.21.15.81:0/176992181 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3c6c082fe0 con 0x7f3c7c0ad490 2023-11-29T11:14:20.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.669+0000 7f3c737fe700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c5c064f10 0x7f3c5c0673c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c1f3040 tx=0x7f3c64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.673+0000 7f3c797fa700 1 -- 172.21.15.81:0/176992181 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3c6c050f30 con 0x7f3c7c0ad490 2023-11-29T11:14:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.829+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c7c14dea0 con 0x7f3c5c064f10 2023-11-29T11:14:20.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.845+0000 7f3c797fa700 1 -- 172.21.15.81:0/176992181 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299089 (secure 0 0 0) 0x7f3c64001450 con 0x7f3c5c064f10 2023-11-29T11:14:20.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c5c064f10 msgr2=0x7f3c5c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c5c064f10 0x7f3c5c0673c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c1f3040 tx=0x7f3c64009040 comp rx=0 tx=0).stop 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7c0ad490 msgr2=0x7f3c7c14fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7c0ad490 0x7f3c7c14fa60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009ba0 tx=0x7f3c6c004770 comp rx=0 tx=0).stop 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 shutdown_connections 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c5c064f10 0x7f3c5c0673c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c7c158e60 0x7f3c7c153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c7c0cb460 0x7f3c7c070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 --2- 172.21.15.81:0/176992181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7c0ad490 0x7f3c7c14fa60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 >> 172.21.15.81:0/176992181 conn(0x7f3c7c0ce3e0 msgr2=0x7f3c7c0abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:20.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 shutdown_connections 2023-11-29T11:14:20.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.849+0000 7f3c8144b700 1 -- 172.21.15.81:0/176992181 wait complete. 2023-11-29T11:14:20.858 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:14:20.871 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-29T11:14:20.454045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69924,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":65408,"kb_avail":754904796,"statfs":{"total":773094113280,"available":773022511104,"internally_reserved":0,"allocated":4558848,"data_stored":2651742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66977792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.005787"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456818+0000","last_change":"2023-11-29T11:14:15.456818+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456818+0000","last_undegraded":"2023-11-29T11:14:15.456818+0000","last_fullsized":"2023-11-29T11:14:15.456818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:15:26.855651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455079+0000","last_change":"2023-11-29T11:14:15.455079+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455079+0000","last_undegraded":"2023-11-29T11:14:15.455079+0000","last_fullsized":"2023-11-29T11:14:15.455079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:13.211183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455608+0000","last_change":"2023-11-29T11:14:15.455608+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455608+0000","last_undegraded":"2023-11-29T11:14:15.455608+0000","last_fullsized":"2023-11-29T11:14:15.455608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.458801+0000","last_change":"2023-11-29T11:14:15.458801+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.458801+0000","last_undegraded":"2023-11-29T11:14:15.458801+0000","last_fullsized":"2023-11-29T11:14:15.458801+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457643+0000","last_change":"2023-11-29T11:14:15.457643+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457643+0000","last_undegraded":"2023-11-29T11:14:15.457643+0000","last_fullsized":"2023-11-29T11:14:15.457643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:34:02.343134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454117+0000","last_change":"2023-11-29T11:14:15.454117+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454117+0000","last_undegraded":"2023-11-29T11:14:15.454117+0000","last_fullsized":"2023-11-29T11:14:15.454117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:33.134223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450635+0000","last_change":"2023-11-29T11:14:15.450635+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450635+0000","last_undegraded":"2023-11-29T11:14:15.450635+0000","last_fullsized":"2023-11-29T11:14:15.450635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:31:18.762036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.461673+0000","last_change":"2023-11-29T11:14:15.461673+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.461673+0000","last_undegraded":"2023-11-29T11:14:15.461673+0000","last_fullsized":"2023-11-29T11:14:15.461673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454109+0000","last_change":"2023-11-29T11:14:15.454109+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454109+0000","last_undegraded":"2023-11-29T11:14:15.454109+0000","last_fullsized":"2023-11-29T11:14:15.454109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:42:47.575238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460498+0000","last_change":"2023-11-29T11:14:15.460498+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460498+0000","last_undegraded":"2023-11-29T11:14:15.460498+0000","last_fullsized":"2023-11-29T11:14:15.460498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457837+0000","last_change":"2023-11-29T11:14:15.457837+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457837+0000","last_undegraded":"2023-11-29T11:14:15.457837+0000","last_fullsized":"2023-11-29T11:14:15.457837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450698+0000","last_change":"2023-11-29T11:14:15.450698+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450698+0000","last_undegraded":"2023-11-29T11:14:15.450698+0000","last_fullsized":"2023-11-29T11:14:15.450698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:07.505515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456543+0000","last_change":"2023-11-29T11:14:15.456543+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456543+0000","last_undegraded":"2023-11-29T11:14:15.456543+0000","last_fullsized":"2023-11-29T11:14:15.456543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:02:20.714555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457010+0000","last_change":"2023-11-29T11:14:15.457010+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457010+0000","last_undegraded":"2023-11-29T11:14:15.457010+0000","last_fullsized":"2023-11-29T11:14:15.457010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:22:41.130861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453890+0000","last_change":"2023-11-29T11:14:15.453890+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453890+0000","last_undegraded":"2023-11-29T11:14:15.453890+0000","last_fullsized":"2023-11-29T11:14:15.453890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:05:03.953716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.461028+0000","last_change":"2023-11-29T11:14:15.461028+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.461028+0000","last_undegraded":"2023-11-29T11:14:15.461028+0000","last_fullsized":"2023-11-29T11:14:15.461028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450669+0000","last_change":"2023-11-29T11:14:15.450669+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450669+0000","last_undegraded":"2023-11-29T11:14:15.450669+0000","last_fullsized":"2023-11-29T11:14:15.450669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:01:09.293879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453871+0000","last_change":"2023-11-29T11:14:15.453871+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453871+0000","last_undegraded":"2023-11-29T11:14:15.453871+0000","last_fullsized":"2023-11-29T11:14:15.453871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:19.727568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450433+0000","last_change":"2023-11-29T11:14:15.450433+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450433+0000","last_undegraded":"2023-11-29T11:14:15.450433+0000","last_fullsized":"2023-11-29T11:14:15.450433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:20:29.370775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454112+0000","last_change":"2023-11-29T11:14:15.454112+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454112+0000","last_undegraded":"2023-11-29T11:14:15.454112+0000","last_fullsized":"2023-11-29T11:14:15.454112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:01:31.133742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454607+0000","last_change":"2023-11-29T11:14:15.454607+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454607+0000","last_undegraded":"2023-11-29T11:14:15.454607+0000","last_fullsized":"2023-11-29T11:14:15.454607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:13:11.883176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450433+0000","last_change":"2023-11-29T11:14:15.450433+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450433+0000","last_undegraded":"2023-11-29T11:14:15.450433+0000","last_fullsized":"2023-11-29T11:14:15.450433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:10:12.008008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460796+0000","last_change":"2023-11-29T11:14:15.460796+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460796+0000","last_undegraded":"2023-11-29T11:14:15.460796+0000","last_fullsized":"2023-11-29T11:14:15.460796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.458313+0000","last_change":"2023-11-29T11:14:15.458313+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.458313+0000","last_undegraded":"2023-11-29T11:14:15.458313+0000","last_fullsized":"2023-11-29T11:14:15.458313+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460438+0000","last_change":"2023-11-29T11:14:15.460438+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460438+0000","last_undegraded":"2023-11-29T11:14:15.460438+0000","last_fullsized":"2023-11-29T11:14:15.460438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568528+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:14:10.568528+0000","last_peered":"2023-11-29T11:14:10.568528+0000","last_clean":"2023-11-29T11:14:10.568528+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:14:10.568528+0000","last_undegraded":"2023-11-29T11:14:10.568528+0000","last_fullsized":"2023-11-29T11:14:10.568528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455623+0000","last_change":"2023-11-29T11:14:15.455623+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455623+0000","last_undegraded":"2023-11-29T11:14:15.455623+0000","last_fullsized":"2023-11-29T11:14:15.455623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:12:45.196257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568493+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:14:10.568493+0000","last_peered":"2023-11-29T11:14:10.568493+0000","last_clean":"2023-11-29T11:14:10.568493+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:14:10.568493+0000","last_undegraded":"2023-11-29T11:14:10.568493+0000","last_fullsized":"2023-11-29T11:14:10.568493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453408+0000","last_change":"2023-11-29T11:14:15.453408+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453408+0000","last_undegraded":"2023-11-29T11:14:15.453408+0000","last_fullsized":"2023-11-29T11:14:15.453408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:52.464556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568888+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:14:10.568888+0000","last_peered":"2023-11-29T11:14:10.568888+0000","last_clean":"2023-11-29T11:14:10.568888+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:14:10.568888+0000","last_undegraded":"2023-11-29T11:14:10.568888+0000","last_fullsized":"2023-11-29T11:14:10.568888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457714+0000","last_change":"2023-11-29T11:14:15.457714+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457714+0000","last_undegraded":"2023-11-29T11:14:15.457714+0000","last_fullsized":"2023-11-29T11:14:15.457714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420744+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:14:10.420744+0000","last_peered":"2023-11-29T11:14:10.420744+0000","last_clean":"2023-11-29T11:14:10.420744+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:14:10.420744+0000","last_undegraded":"2023-11-29T11:14:10.420744+0000","last_fullsized":"2023-11-29T11:14:10.420744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455576+0000","last_change":"2023-11-29T11:14:15.455576+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455576+0000","last_undegraded":"2023-11-29T11:14:15.455576+0000","last_fullsized":"2023-11-29T11:14:15.455576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":177,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420094+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:14:10.420094+0000","last_peered":"2023-11-29T11:14:10.420094+0000","last_clean":"2023-11-29T11:14:10.420094+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:14:10.420094+0000","last_undegraded":"2023-11-29T11:14:10.420094+0000","last_fullsized":"2023-11-29T11:14:10.420094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568815+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:14:10.568815+0000","last_peered":"2023-11-29T11:14:10.568815+0000","last_clean":"2023-11-29T11:14:10.568815+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:14:10.568815+0000","last_undegraded":"2023-11-29T11:14:10.568815+0000","last_fullsized":"2023-11-29T11:14:10.568815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456933+0000","last_change":"2023-11-29T11:14:15.456933+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456933+0000","last_undegraded":"2023-11-29T11:14:15.456933+0000","last_fullsized":"2023-11-29T11:14:15.456933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.419928+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:14:10.419928+0000","last_peered":"2023-11-29T11:14:10.419928+0000","last_clean":"2023-11-29T11:14:10.419928+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:14:10.419928+0000","last_undegraded":"2023-11-29T11:14:10.419928+0000","last_fullsized":"2023-11-29T11:14:10.419928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453840+0000","last_change":"2023-11-29T11:14:15.453840+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453840+0000","last_undegraded":"2023-11-29T11:14:15.453840+0000","last_fullsized":"2023-11-29T11:14:15.453840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:44:40.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420663+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:14:10.420663+0000","last_peered":"2023-11-29T11:14:10.420663+0000","last_clean":"2023-11-29T11:14:10.420663+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:14:10.420663+0000","last_undegraded":"2023-11-29T11:14:10.420663+0000","last_fullsized":"2023-11-29T11:14:10.420663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450641+0000","last_change":"2023-11-29T11:14:15.450641+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450641+0000","last_undegraded":"2023-11-29T11:14:15.450641+0000","last_fullsized":"2023-11-29T11:14:15.450641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:47.288431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.419928+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:14:10.419928+0000","last_peered":"2023-11-29T11:14:10.419928+0000","last_clean":"2023-11-29T11:14:10.419928+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:14:10.419928+0000","last_undegraded":"2023-11-29T11:14:10.419928+0000","last_fullsized":"2023-11-29T11:14:10.419928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":774367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.83899999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.81399999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.028}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.94399999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.753},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.879}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.085},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.91300000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.127},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.1519999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.98099999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.153}]},{"osd":2,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.95099999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.02}]},{"osd":4,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.085}]},{"osd":5,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.228},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.252}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.873}]},{"osd":1,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.024},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.92600000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.339},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1870000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.53}]},{"osd":6,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.4870000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.673}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.1000000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.82699999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.73599999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.05}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.748}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.499},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.84899999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.0660000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.093},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.119}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.073},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.103},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.155}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.038},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.016}]}]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":774367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.752},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.63}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.873}]},{"osd":7,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.98199999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8480,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363360,"statfs":{"total":96636764160,"available":96628080640,"internally_reserved":0,"allocated":417792,"data_stored":183013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.497}]},{"osd":3,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.2450000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.1539999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0389999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:14:20.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:14:20.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.977+0000 7f9509139700 1 Processor -- start 2023-11-29T11:14:20.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.977+0000 7f9509139700 1 -- start start 2023-11-29T11:14:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9504069c40 0x7f95040cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f95040cb2a0 0x7f95040c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950406ace0 con 0x7f9504159e70 2023-11-29T11:14:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95040cb6e0 con 0x7f9504069c40 2023-11-29T11:14:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950406a0d0 con 0x7f95040cb2a0 2023-11-29T11:14:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f95037fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9504069c40 0x7f95040cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f95037fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9504069c40 0x7f95040cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38552/0 (socket says 172.21.15.81:38552) 2023-11-29T11:14:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f95037fe700 1 -- 172.21.15.81:0/1890362616 learned_addr learned my addr 172.21.15.81:0/1890362616 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9508938700 1 --2- 172.21.15.81:0/1890362616 >> v2:172.21.15.176:3300/0 conn(0x7f95040cb2a0 0x7f95040c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f95037fe700 1 -- 172.21.15.81:0/1890362616 >> v2:172.21.15.176:3300/0 conn(0x7f95040cb2a0 msgr2=0x7f95040c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f95037fe700 1 --2- 172.21.15.81:0/1890362616 >> v2:172.21.15.176:3300/0 conn(0x7f95040cb2a0 0x7f95040c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f95037fe700 1 -- 172.21.15.81:0/1890362616 >> v1:172.21.15.176:6789/0 conn(0x7f9504159e70 legacy=0x7f950406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f95037fe700 1 -- 172.21.15.81:0/1890362616 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950406a3b0 con 0x7f9504069c40 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9508938700 1 --2- 172.21.15.81:0/1890362616 >> v2:172.21.15.176:3300/0 conn(0x7f95040cb2a0 0x7f95040c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f95037fe700 1 --2- 172.21.15.81:0/1890362616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95040cad60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f95040afe60 tx=0x7f94fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9568d209d401df7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9502ffd700 1 -- 172.21.15.81:0/1890362616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00e070 con 0x7f9504069c40 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9502ffd700 1 -- 172.21.15.81:0/1890362616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc003a40 con 0x7f9504069c40 2023-11-29T11:14:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9502ffd700 1 -- 172.21.15.81:0/1890362616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc003df0 con 0x7f9504069c40 2023-11-29T11:14:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 -- 172.21.15.81:0/1890362616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 msgr2=0x7f95040cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 --2- 172.21.15.81:0/1890362616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95040cad60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f95040afe60 tx=0x7f94fc00b330 comp rx=0 tx=0).stop 2023-11-29T11:14:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 -- 172.21.15.81:0/1890362616 shutdown_connections 2023-11-29T11:14:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 --2- 172.21.15.81:0/1890362616 >> v2:172.21.15.176:3300/0 conn(0x7f95040cb2a0 0x7f95040c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 --2- 172.21.15.81:0/1890362616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95040cad60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 -- 172.21.15.81:0/1890362616 >> 172.21.15.81:0/1890362616 conn(0x7f95040ce3e0 msgr2=0x7f95040ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 -- 172.21.15.81:0/1890362616 shutdown_connections 2023-11-29T11:14:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 -- 172.21.15.81:0/1890362616 wait complete. 2023-11-29T11:14:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.981+0000 7f9509139700 1 Processor -- start 2023-11-29T11:14:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 -- start start 2023-11-29T11:14:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95041585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95040cb2a0 0x7f95041f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9504159e70 0x7f95040c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040abc00 con 0x7f9504069c40 2023-11-29T11:14:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040abee0 con 0x7f9504159e70 2023-11-29T11:14:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040ac1c0 con 0x7f95040cb2a0 2023-11-29T11:14:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95041585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95041585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38554/0 (socket says 172.21.15.81:38554) 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 -- 172.21.15.81:0/2039360775 learned_addr learned my addr 172.21.15.81:0/2039360775 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9508938700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9504159e70 0x7f95040c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 -- 172.21.15.81:0/2039360775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95040cb2a0 msgr2=0x7f95041f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95040cb2a0 0x7f95041f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 -- 172.21.15.81:0/2039360775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9504159e70 msgr2=0x7f95040c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9504159e70 0x7f95040c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 -- 172.21.15.81:0/2039360775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc009b30 con 0x7f9504069c40 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9503fff700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95041585a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f94f800b4a0 tx=0x7f94f800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9500ff9700 1 -- 172.21.15.81:0/2039360775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8011830 con 0x7f9504069c40 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950406a970 con 0x7f9504069c40 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9500ff9700 1 -- 172.21.15.81:0/2039360775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8011990 con 0x7f9504069c40 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9500ff9700 1 -- 172.21.15.81:0/2039360775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8011d40 con 0x7f9504069c40 2023-11-29T11:14:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950406a690 con 0x7f9504069c40 2023-11-29T11:14:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.985+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950406d0b0 con 0x7f9504069c40 2023-11-29T11:14:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.989+0000 7f9500ff9700 1 -- 172.21.15.81:0/2039360775 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f94f800f050 con 0x7f9504069c40 2023-11-29T11:14:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.989+0000 7f9500ff9700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94f0064ee0 0x7f94f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.989+0000 7f9500ff9700 1 -- 172.21.15.81:0/2039360775 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f94f8081d90 con 0x7f9504069c40 2023-11-29T11:14:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.989+0000 7f95037fe700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94f0064ee0 0x7f94f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.989+0000 7f95037fe700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94f0064ee0 0x7f94f0067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f95040afac0 tx=0x7f94fc010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:20.997+0000 7f9500ff9700 1 -- 172.21.15.81:0/2039360775 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f94f804fc80 con 0x7f9504069c40 2023-11-29T11:14:21.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.153+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95040ac9c0 con 0x7f94f0064ee0 2023-11-29T11:14:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.169+0000 7f9500ff9700 1 -- 172.21.15.81:0/2039360775 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299089 (secure 0 0 0) 0x7f95040ac9c0 con 0x7f94f0064ee0 2023-11-29T11:14:21.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94f0064ee0 msgr2=0x7f94f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94f0064ee0 0x7f94f0067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f95040afac0 tx=0x7f94fc010000 comp rx=0 tx=0).stop 2023-11-29T11:14:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 msgr2=0x7f95041585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95041585a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f94f800b4a0 tx=0x7f94f800b860 comp rx=0 tx=0).stop 2023-11-29T11:14:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 shutdown_connections 2023-11-29T11:14:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94f0064ee0 0x7f94f0067390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9504159e70 0x7f95040c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95040cb2a0 0x7f95041f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 --2- 172.21.15.81:0/2039360775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9504069c40 0x7f95041585a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 >> 172.21.15.81:0/2039360775 conn(0x7f95040ce3e0 msgr2=0x7f95040ae9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 shutdown_connections 2023-11-29T11:14:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.177+0000 7f9509139700 1 -- 172.21.15.81:0/2039360775 wait complete. 2023-11-29T11:14:21.183 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:14:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-29T11:14:20.454045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69924,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":65408,"kb_avail":754904796,"statfs":{"total":773094113280,"available":773022511104,"internally_reserved":0,"allocated":4558848,"data_stored":2651742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66977792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.005787"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456818+0000","last_change":"2023-11-29T11:14:15.456818+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456818+0000","last_undegraded":"2023-11-29T11:14:15.456818+0000","last_fullsized":"2023-11-29T11:14:15.456818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:15:26.855651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455079+0000","last_change":"2023-11-29T11:14:15.455079+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455079+0000","last_undegraded":"2023-11-29T11:14:15.455079+0000","last_fullsized":"2023-11-29T11:14:15.455079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:13.211183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455608+0000","last_change":"2023-11-29T11:14:15.455608+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455608+0000","last_undegraded":"2023-11-29T11:14:15.455608+0000","last_fullsized":"2023-11-29T11:14:15.455608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.458801+0000","last_change":"2023-11-29T11:14:15.458801+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.458801+0000","last_undegraded":"2023-11-29T11:14:15.458801+0000","last_fullsized":"2023-11-29T11:14:15.458801+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457643+0000","last_change":"2023-11-29T11:14:15.457643+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457643+0000","last_undegraded":"2023-11-29T11:14:15.457643+0000","last_fullsized":"2023-11-29T11:14:15.457643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:34:02.343134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454117+0000","last_change":"2023-11-29T11:14:15.454117+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454117+0000","last_undegraded":"2023-11-29T11:14:15.454117+0000","last_fullsized":"2023-11-29T11:14:15.454117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:33.134223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450635+0000","last_change":"2023-11-29T11:14:15.450635+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450635+0000","last_undegraded":"2023-11-29T11:14:15.450635+0000","last_fullsized":"2023-11-29T11:14:15.450635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:31:18.762036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.461673+0000","last_change":"2023-11-29T11:14:15.461673+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.461673+0000","last_undegraded":"2023-11-29T11:14:15.461673+0000","last_fullsized":"2023-11-29T11:14:15.461673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454109+0000","last_change":"2023-11-29T11:14:15.454109+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454109+0000","last_undegraded":"2023-11-29T11:14:15.454109+0000","last_fullsized":"2023-11-29T11:14:15.454109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:42:47.575238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460498+0000","last_change":"2023-11-29T11:14:15.460498+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460498+0000","last_undegraded":"2023-11-29T11:14:15.460498+0000","last_fullsized":"2023-11-29T11:14:15.460498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457837+0000","last_change":"2023-11-29T11:14:15.457837+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457837+0000","last_undegraded":"2023-11-29T11:14:15.457837+0000","last_fullsized":"2023-11-29T11:14:15.457837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450698+0000","last_change":"2023-11-29T11:14:15.450698+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450698+0000","last_undegraded":"2023-11-29T11:14:15.450698+0000","last_fullsized":"2023-11-29T11:14:15.450698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:07.505515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456543+0000","last_change":"2023-11-29T11:14:15.456543+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456543+0000","last_undegraded":"2023-11-29T11:14:15.456543+0000","last_fullsized":"2023-11-29T11:14:15.456543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:02:20.714555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457010+0000","last_change":"2023-11-29T11:14:15.457010+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457010+0000","last_undegraded":"2023-11-29T11:14:15.457010+0000","last_fullsized":"2023-11-29T11:14:15.457010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:22:41.130861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453890+0000","last_change":"2023-11-29T11:14:15.453890+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453890+0000","last_undegraded":"2023-11-29T11:14:15.453890+0000","last_fullsized":"2023-11-29T11:14:15.453890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:05:03.953716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.461028+0000","last_change":"2023-11-29T11:14:15.461028+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.461028+0000","last_undegraded":"2023-11-29T11:14:15.461028+0000","last_fullsized":"2023-11-29T11:14:15.461028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450669+0000","last_change":"2023-11-29T11:14:15.450669+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450669+0000","last_undegraded":"2023-11-29T11:14:15.450669+0000","last_fullsized":"2023-11-29T11:14:15.450669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:01:09.293879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453871+0000","last_change":"2023-11-29T11:14:15.453871+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453871+0000","last_undegraded":"2023-11-29T11:14:15.453871+0000","last_fullsized":"2023-11-29T11:14:15.453871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:19.727568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450433+0000","last_change":"2023-11-29T11:14:15.450433+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450433+0000","last_undegraded":"2023-11-29T11:14:15.450433+0000","last_fullsized":"2023-11-29T11:14:15.450433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:20:29.370775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454112+0000","last_change":"2023-11-29T11:14:15.454112+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454112+0000","last_undegraded":"2023-11-29T11:14:15.454112+0000","last_fullsized":"2023-11-29T11:14:15.454112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:01:31.133742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454607+0000","last_change":"2023-11-29T11:14:15.454607+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454607+0000","last_undegraded":"2023-11-29T11:14:15.454607+0000","last_fullsized":"2023-11-29T11:14:15.454607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:13:11.883176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450433+0000","last_change":"2023-11-29T11:14:15.450433+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450433+0000","last_undegraded":"2023-11-29T11:14:15.450433+0000","last_fullsized":"2023-11-29T11:14:15.450433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:10:12.008008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460796+0000","last_change":"2023-11-29T11:14:15.460796+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460796+0000","last_undegraded":"2023-11-29T11:14:15.460796+0000","last_fullsized":"2023-11-29T11:14:15.460796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.458313+0000","last_change":"2023-11-29T11:14:15.458313+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.458313+0000","last_undegraded":"2023-11-29T11:14:15.458313+0000","last_fullsized":"2023-11-29T11:14:15.458313+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460438+0000","last_change":"2023-11-29T11:14:15.460438+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460438+0000","last_undegraded":"2023-11-29T11:14:15.460438+0000","last_fullsized":"2023-11-29T11:14:15.460438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568528+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:14:10.568528+0000","last_peered":"2023-11-29T11:14:10.568528+0000","last_clean":"2023-11-29T11:14:10.568528+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:14:10.568528+0000","last_undegraded":"2023-11-29T11:14:10.568528+0000","last_fullsized":"2023-11-29T11:14:10.568528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455623+0000","last_change":"2023-11-29T11:14:15.455623+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455623+0000","last_undegraded":"2023-11-29T11:14:15.455623+0000","last_fullsized":"2023-11-29T11:14:15.455623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:12:45.196257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568493+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:14:10.568493+0000","last_peered":"2023-11-29T11:14:10.568493+0000","last_clean":"2023-11-29T11:14:10.568493+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:14:10.568493+0000","last_undegraded":"2023-11-29T11:14:10.568493+0000","last_fullsized":"2023-11-29T11:14:10.568493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453408+0000","last_change":"2023-11-29T11:14:15.453408+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453408+0000","last_undegraded":"2023-11-29T11:14:15.453408+0000","last_fullsized":"2023-11-29T11:14:15.453408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:52.464556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568888+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:14:10.568888+0000","last_peered":"2023-11-29T11:14:10.568888+0000","last_clean":"2023-11-29T11:14:10.568888+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:14:10.568888+0000","last_undegraded":"2023-11-29T11:14:10.568888+0000","last_fullsized":"2023-11-29T11:14:10.568888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457714+0000","last_change":"2023-11-29T11:14:15.457714+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457714+0000","last_undegraded":"2023-11-29T11:14:15.457714+0000","last_fullsized":"2023-11-29T11:14:15.457714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420744+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:14:10.420744+0000","last_peered":"2023-11-29T11:14:10.420744+0000","last_clean":"2023-11-29T11:14:10.420744+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:14:10.420744+0000","last_undegraded":"2023-11-29T11:14:10.420744+0000","last_fullsized":"2023-11-29T11:14:10.420744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455576+0000","last_change":"2023-11-29T11:14:15.455576+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455576+0000","last_undegraded":"2023-11-29T11:14:15.455576+0000","last_fullsized":"2023-11-29T11:14:15.455576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":177,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420094+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:14:10.420094+0000","last_peered":"2023-11-29T11:14:10.420094+0000","last_clean":"2023-11-29T11:14:10.420094+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:14:10.420094+0000","last_undegraded":"2023-11-29T11:14:10.420094+0000","last_fullsized":"2023-11-29T11:14:10.420094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568815+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:14:10.568815+0000","last_peered":"2023-11-29T11:14:10.568815+0000","last_clean":"2023-11-29T11:14:10.568815+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:14:10.568815+0000","last_undegraded":"2023-11-29T11:14:10.568815+0000","last_fullsized":"2023-11-29T11:14:10.568815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456933+0000","last_change":"2023-11-29T11:14:15.456933+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456933+0000","last_undegraded":"2023-11-29T11:14:15.456933+0000","last_fullsized":"2023-11-29T11:14:15.456933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.419928+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:14:10.419928+0000","last_peered":"2023-11-29T11:14:10.419928+0000","last_clean":"2023-11-29T11:14:10.419928+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:14:10.419928+0000","last_undegraded":"2023-11-29T11:14:10.419928+0000","last_fullsized":"2023-11-29T11:14:10.419928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453840+0000","last_change":"2023-11-29T11:14:15.453840+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453840+0000","last_undegraded":"2023-11-29T11:14:15.453840+0000","last_fullsized":"2023-11-29T11:14:15.453840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:44:40.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420663+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:14:10.420663+0000","last_peered":"2023-11-29T11:14:10.420663+0000","last_clean":"2023-11-29T11:14:10.420663+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:14:10.420663+0000","last_undegraded":"2023-11-29T11:14:10.420663+0000","last_fullsized":"2023-11-29T11:14:10.420663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450641+0000","last_change":"2023-11-29T11:14:15.450641+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450641+0000","last_undegraded":"2023-11-29T11:14:15.450641+0000","last_fullsized":"2023-11-29T11:14:15.450641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:47.288431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.419928+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:14:10.419928+0000","last_peered":"2023-11-29T11:14:10.419928+0000","last_clean":"2023-11-29T11:14:10.419928+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:14:10.419928+0000","last_undegraded":"2023-11-29T11:14:10.419928+0000","last_fullsized":"2023-11-29T11:14:10.419928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":774367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.83899999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.81399999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.028}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.94399999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.753},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.879}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.085},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.91300000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.127},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.1519999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.98099999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.153}]},{"osd":2,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.95099999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.02}]},{"osd":4,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.085}]},{"osd":5,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.228},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.252}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.873}]},{"osd":1,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.024},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.92600000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.339},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1870000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.53}]},{"osd":6,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.4870000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.673}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.1000000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.82699999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.73599999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.05}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.748}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.499},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.84899999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.0660000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.093},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.119}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.073},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.103},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.155}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.038},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.016}]}]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":774367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.752},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.63}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.873}]},{"osd":7,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.98199999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8480,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363360,"statfs":{"total":96636764160,"available":96628080640,"internally_reserved":0,"allocated":417792,"data_stored":183013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.497}]},{"osd":3,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.2450000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.1539999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0389999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:14:21.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:14:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 Processor -- start 2023-11-29T11:14:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 -- start start 2023-11-29T11:14:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f87640c1ac0 0x7f8764069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f876406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87640cae70 con 0x7f87641606b0 2023-11-29T11:14:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87640cbc10 con 0x7f87640c1ac0 2023-11-29T11:14:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87640cb130 con 0x7f87640ceef0 2023-11-29T11:14:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8763fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f876406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8762ffd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f87640c1ac0 0x7f8764069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8762ffd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f87640c1ac0 0x7f8764069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:60408/0 (socket says 172.21.15.81:60408) 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8762ffd700 1 -- 172.21.15.81:0/931896729 learned_addr learned my addr 172.21.15.81:0/931896729 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8763fff700 1 -- 172.21.15.81:0/931896729 >> v2:172.21.15.176:3300/0 conn(0x7f87640c1ac0 msgr2=0x7f8764069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8763fff700 1 --2- 172.21.15.81:0/931896729 >> v2:172.21.15.176:3300/0 conn(0x7f87640c1ac0 0x7f8764069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8763fff700 1 -- 172.21.15.81:0/931896729 >> v1:172.21.15.176:6789/0 conn(0x7f87641606b0 legacy=0x7f87640c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8763fff700 1 -- 172.21.15.81:0/931896729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640cb410 con 0x7f87640ceef0 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8762ffd700 1 --2- 172.21.15.81:0/931896729 >> v2:172.21.15.176:3300/0 conn(0x7f87640c1ac0 0x7f8764069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8763fff700 1 --2- 172.21.15.81:0/931896729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f876406a180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8754009850 tx=0x7f8754009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ee0b9e56c1794c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f87627fc700 1 -- 172.21.15.81:0/931896729 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754011830 con 0x7f87640ceef0 2023-11-29T11:14:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f87627fc700 1 -- 172.21.15.81:0/931896729 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8754011990 con 0x7f87640ceef0 2023-11-29T11:14:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f87627fc700 1 -- 172.21.15.81:0/931896729 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754011d40 con 0x7f87640ceef0 2023-11-29T11:14:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 -- 172.21.15.81:0/931896729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 msgr2=0x7f876406a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.309+0000 7f8768e01700 1 --2- 172.21.15.81:0/931896729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f876406a180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8754009850 tx=0x7f8754009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 -- 172.21.15.81:0/931896729 shutdown_connections 2023-11-29T11:14:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 --2- 172.21.15.81:0/931896729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f876406a180 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 --2- 172.21.15.81:0/931896729 >> v2:172.21.15.176:3300/0 conn(0x7f87640c1ac0 0x7f8764069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 -- 172.21.15.81:0/931896729 >> 172.21.15.81:0/931896729 conn(0x7f87640ce3e0 msgr2=0x7f87640ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 -- 172.21.15.81:0/931896729 shutdown_connections 2023-11-29T11:14:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 -- 172.21.15.81:0/931896729 wait complete. 2023-11-29T11:14:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 Processor -- start 2023-11-29T11:14:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 -- start start 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640c1ac0 0x7f87640c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f87640c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87641606b0 0x7f876415f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640c3140 con 0x7f87640c1ac0 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8764160a80 con 0x7f87641606b0 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8768e01700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87640c24c0 con 0x7f87640ceef0 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f87637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640c1ac0 0x7f87640c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8762ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f87640c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8762ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f87640c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:52182/0 (socket says 172.21.15.81:52182) 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8762ffd700 1 -- 172.21.15.81:0/567934717 learned_addr learned my addr 172.21.15.81:0/567934717 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8763fff700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87641606b0 0x7f876415f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f87637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640c1ac0 0x7f87640c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38558/0 (socket says 172.21.15.81:38558) 2023-11-29T11:14:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8762ffd700 1 -- 172.21.15.81:0/567934717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87641606b0 msgr2=0x7f876415f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8762ffd700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87641606b0 0x7f876415f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8762ffd700 1 -- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640c1ac0 msgr2=0x7f87640c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8762ffd700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640c1ac0 0x7f87640c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.313+0000 7f8762ffd700 1 -- 172.21.15.81:0/567934717 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c009b30 con 0x7f87640ceef0 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.317+0000 7f8762ffd700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f87640c3560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f875c00efc0 tx=0x7f875c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.317+0000 7f874bfff700 1 -- 172.21.15.81:0/567934717 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00cb00 con 0x7f87640ceef0 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.317+0000 7f874bfff700 1 -- 172.21.15.81:0/567934717 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c00f040 con 0x7f87640ceef0 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.317+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87540094b0 con 0x7f87640ceef0 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.317+0000 7f874bfff700 1 -- 172.21.15.81:0/567934717 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00cea0 con 0x7f87640ceef0 2023-11-29T11:14:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.317+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87640b36c0 con 0x7f87640ceef0 2023-11-29T11:14:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.317+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87640cb6f0 con 0x7f87640ceef0 2023-11-29T11:14:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.317+0000 7f874bfff700 1 -- 172.21.15.81:0/567934717 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f875c014480 con 0x7f87640ceef0 2023-11-29T11:14:21.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.321+0000 7f874bfff700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8750064ee0 0x7f8750067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.321+0000 7f874bfff700 1 -- 172.21.15.81:0/567934717 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f875c0831f0 con 0x7f87640ceef0 2023-11-29T11:14:21.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.321+0000 7f87637fe700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8750064ee0 0x7f8750067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.321+0000 7f87637fe700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8750064ee0 0x7f8750067390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8758000f60 tx=0x7f8758009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.325+0000 7f874bfff700 1 -- 172.21.15.81:0/567934717 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f875c051180 con 0x7f87640ceef0 2023-11-29T11:14:21.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.489+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87640ad610 con 0x7f8750064ee0 2023-11-29T11:14:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.505+0000 7f874bfff700 1 -- 172.21.15.81:0/567934717 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299089 (secure 0 0 0) 0x7f87640ad610 con 0x7f8750064ee0 2023-11-29T11:14:21.512 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8750064ee0 msgr2=0x7f8750067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8750064ee0 0x7f8750067390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8758000f60 tx=0x7f8758009040 comp rx=0 tx=0).stop 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 msgr2=0x7f87640c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f87640c3560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f875c00efc0 tx=0x7f875c00c3a0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 shutdown_connections 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8750064ee0 0x7f8750067390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87641606b0 0x7f876415f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87640ceef0 0x7f87640c3560 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 --2- 172.21.15.81:0/567934717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640c1ac0 0x7f87640c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 >> 172.21.15.81:0/567934717 conn(0x7f87640ce3e0 msgr2=0x7f87640afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 shutdown_connections 2023-11-29T11:14:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.509+0000 7f8768e01700 1 -- 172.21.15.81:0/567934717 wait complete. 2023-11-29T11:14:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:14:21.531 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-29T11:14:20.454045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69924,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":65408,"kb_avail":754904796,"statfs":{"total":773094113280,"available":773022511104,"internally_reserved":0,"allocated":4558848,"data_stored":2651742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66977792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.005787"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456818+0000","last_change":"2023-11-29T11:14:15.456818+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456818+0000","last_undegraded":"2023-11-29T11:14:15.456818+0000","last_fullsized":"2023-11-29T11:14:15.456818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:15:26.855651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455079+0000","last_change":"2023-11-29T11:14:15.455079+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455079+0000","last_undegraded":"2023-11-29T11:14:15.455079+0000","last_fullsized":"2023-11-29T11:14:15.455079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:13.211183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455608+0000","last_change":"2023-11-29T11:14:15.455608+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455608+0000","last_undegraded":"2023-11-29T11:14:15.455608+0000","last_fullsized":"2023-11-29T11:14:15.455608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.458801+0000","last_change":"2023-11-29T11:14:15.458801+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.458801+0000","last_undegraded":"2023-11-29T11:14:15.458801+0000","last_fullsized":"2023-11-29T11:14:15.458801+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457643+0000","last_change":"2023-11-29T11:14:15.457643+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457643+0000","last_undegraded":"2023-11-29T11:14:15.457643+0000","last_fullsized":"2023-11-29T11:14:15.457643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:34:02.343134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454117+0000","last_change":"2023-11-29T11:14:15.454117+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454117+0000","last_undegraded":"2023-11-29T11:14:15.454117+0000","last_fullsized":"2023-11-29T11:14:15.454117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:33.134223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450635+0000","last_change":"2023-11-29T11:14:15.450635+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450635+0000","last_undegraded":"2023-11-29T11:14:15.450635+0000","last_fullsized":"2023-11-29T11:14:15.450635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:31:18.762036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.461673+0000","last_change":"2023-11-29T11:14:15.461673+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.461673+0000","last_undegraded":"2023-11-29T11:14:15.461673+0000","last_fullsized":"2023-11-29T11:14:15.461673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454109+0000","last_change":"2023-11-29T11:14:15.454109+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454109+0000","last_undegraded":"2023-11-29T11:14:15.454109+0000","last_fullsized":"2023-11-29T11:14:15.454109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:42:47.575238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460498+0000","last_change":"2023-11-29T11:14:15.460498+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460498+0000","last_undegraded":"2023-11-29T11:14:15.460498+0000","last_fullsized":"2023-11-29T11:14:15.460498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457837+0000","last_change":"2023-11-29T11:14:15.457837+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457837+0000","last_undegraded":"2023-11-29T11:14:15.457837+0000","last_fullsized":"2023-11-29T11:14:15.457837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450698+0000","last_change":"2023-11-29T11:14:15.450698+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450698+0000","last_undegraded":"2023-11-29T11:14:15.450698+0000","last_fullsized":"2023-11-29T11:14:15.450698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:07.505515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456543+0000","last_change":"2023-11-29T11:14:15.456543+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456543+0000","last_undegraded":"2023-11-29T11:14:15.456543+0000","last_fullsized":"2023-11-29T11:14:15.456543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:02:20.714555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457010+0000","last_change":"2023-11-29T11:14:15.457010+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457010+0000","last_undegraded":"2023-11-29T11:14:15.457010+0000","last_fullsized":"2023-11-29T11:14:15.457010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:22:41.130861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453890+0000","last_change":"2023-11-29T11:14:15.453890+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453890+0000","last_undegraded":"2023-11-29T11:14:15.453890+0000","last_fullsized":"2023-11-29T11:14:15.453890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:05:03.953716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.461028+0000","last_change":"2023-11-29T11:14:15.461028+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.461028+0000","last_undegraded":"2023-11-29T11:14:15.461028+0000","last_fullsized":"2023-11-29T11:14:15.461028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450669+0000","last_change":"2023-11-29T11:14:15.450669+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450669+0000","last_undegraded":"2023-11-29T11:14:15.450669+0000","last_fullsized":"2023-11-29T11:14:15.450669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:01:09.293879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453871+0000","last_change":"2023-11-29T11:14:15.453871+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453871+0000","last_undegraded":"2023-11-29T11:14:15.453871+0000","last_fullsized":"2023-11-29T11:14:15.453871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:19.727568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450433+0000","last_change":"2023-11-29T11:14:15.450433+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450433+0000","last_undegraded":"2023-11-29T11:14:15.450433+0000","last_fullsized":"2023-11-29T11:14:15.450433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:20:29.370775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454112+0000","last_change":"2023-11-29T11:14:15.454112+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454112+0000","last_undegraded":"2023-11-29T11:14:15.454112+0000","last_fullsized":"2023-11-29T11:14:15.454112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:01:31.133742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454607+0000","last_change":"2023-11-29T11:14:15.454607+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454607+0000","last_undegraded":"2023-11-29T11:14:15.454607+0000","last_fullsized":"2023-11-29T11:14:15.454607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:13:11.883176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450433+0000","last_change":"2023-11-29T11:14:15.450433+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450433+0000","last_undegraded":"2023-11-29T11:14:15.450433+0000","last_fullsized":"2023-11-29T11:14:15.450433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:10:12.008008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460796+0000","last_change":"2023-11-29T11:14:15.460796+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460796+0000","last_undegraded":"2023-11-29T11:14:15.460796+0000","last_fullsized":"2023-11-29T11:14:15.460796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.458313+0000","last_change":"2023-11-29T11:14:15.458313+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.458313+0000","last_undegraded":"2023-11-29T11:14:15.458313+0000","last_fullsized":"2023-11-29T11:14:15.458313+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460438+0000","last_change":"2023-11-29T11:14:15.460438+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460438+0000","last_undegraded":"2023-11-29T11:14:15.460438+0000","last_fullsized":"2023-11-29T11:14:15.460438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568528+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:14:10.568528+0000","last_peered":"2023-11-29T11:14:10.568528+0000","last_clean":"2023-11-29T11:14:10.568528+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:14:10.568528+0000","last_undegraded":"2023-11-29T11:14:10.568528+0000","last_fullsized":"2023-11-29T11:14:10.568528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455623+0000","last_change":"2023-11-29T11:14:15.455623+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455623+0000","last_undegraded":"2023-11-29T11:14:15.455623+0000","last_fullsized":"2023-11-29T11:14:15.455623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:12:45.196257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568493+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:14:10.568493+0000","last_peered":"2023-11-29T11:14:10.568493+0000","last_clean":"2023-11-29T11:14:10.568493+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:14:10.568493+0000","last_undegraded":"2023-11-29T11:14:10.568493+0000","last_fullsized":"2023-11-29T11:14:10.568493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453408+0000","last_change":"2023-11-29T11:14:15.453408+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453408+0000","last_undegraded":"2023-11-29T11:14:15.453408+0000","last_fullsized":"2023-11-29T11:14:15.453408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:52.464556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568888+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:14:10.568888+0000","last_peered":"2023-11-29T11:14:10.568888+0000","last_clean":"2023-11-29T11:14:10.568888+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:14:10.568888+0000","last_undegraded":"2023-11-29T11:14:10.568888+0000","last_fullsized":"2023-11-29T11:14:10.568888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457714+0000","last_change":"2023-11-29T11:14:15.457714+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457714+0000","last_undegraded":"2023-11-29T11:14:15.457714+0000","last_fullsized":"2023-11-29T11:14:15.457714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420744+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:14:10.420744+0000","last_peered":"2023-11-29T11:14:10.420744+0000","last_clean":"2023-11-29T11:14:10.420744+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:14:10.420744+0000","last_undegraded":"2023-11-29T11:14:10.420744+0000","last_fullsized":"2023-11-29T11:14:10.420744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455576+0000","last_change":"2023-11-29T11:14:15.455576+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455576+0000","last_undegraded":"2023-11-29T11:14:15.455576+0000","last_fullsized":"2023-11-29T11:14:15.455576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":177,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420094+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:14:10.420094+0000","last_peered":"2023-11-29T11:14:10.420094+0000","last_clean":"2023-11-29T11:14:10.420094+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:14:10.420094+0000","last_undegraded":"2023-11-29T11:14:10.420094+0000","last_fullsized":"2023-11-29T11:14:10.420094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568815+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:14:10.568815+0000","last_peered":"2023-11-29T11:14:10.568815+0000","last_clean":"2023-11-29T11:14:10.568815+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:14:10.568815+0000","last_undegraded":"2023-11-29T11:14:10.568815+0000","last_fullsized":"2023-11-29T11:14:10.568815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456933+0000","last_change":"2023-11-29T11:14:15.456933+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456933+0000","last_undegraded":"2023-11-29T11:14:15.456933+0000","last_fullsized":"2023-11-29T11:14:15.456933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.419928+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:14:10.419928+0000","last_peered":"2023-11-29T11:14:10.419928+0000","last_clean":"2023-11-29T11:14:10.419928+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:14:10.419928+0000","last_undegraded":"2023-11-29T11:14:10.419928+0000","last_fullsized":"2023-11-29T11:14:10.419928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453840+0000","last_change":"2023-11-29T11:14:15.453840+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453840+0000","last_undegraded":"2023-11-29T11:14:15.453840+0000","last_fullsized":"2023-11-29T11:14:15.453840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:44:40.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420663+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:14:10.420663+0000","last_peered":"2023-11-29T11:14:10.420663+0000","last_clean":"2023-11-29T11:14:10.420663+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:14:10.420663+0000","last_undegraded":"2023-11-29T11:14:10.420663+0000","last_fullsized":"2023-11-29T11:14:10.420663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450641+0000","last_change":"2023-11-29T11:14:15.450641+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450641+0000","last_undegraded":"2023-11-29T11:14:15.450641+0000","last_fullsized":"2023-11-29T11:14:15.450641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:47.288431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.419928+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:14:10.419928+0000","last_peered":"2023-11-29T11:14:10.419928+0000","last_clean":"2023-11-29T11:14:10.419928+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:14:10.419928+0000","last_undegraded":"2023-11-29T11:14:10.419928+0000","last_fullsized":"2023-11-29T11:14:10.419928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":774367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.83899999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.81399999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.028}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.94399999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.753},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.879}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.085},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.91300000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.127},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.1519999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.98099999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.153}]},{"osd":2,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.95099999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.02}]},{"osd":4,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.085}]},{"osd":5,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.228},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.252}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.873}]},{"osd":1,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.024},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.92600000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.339},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1870000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.53}]},{"osd":6,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.4870000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.673}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.1000000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.82699999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.73599999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.05}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.748}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.499},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.84899999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.0660000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.093},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.119}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.073},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.103},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.155}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.038},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.016}]}]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":774367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.752},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.63}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.873}]},{"osd":7,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.98199999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8480,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363360,"statfs":{"total":96636764160,"available":96628080640,"internally_reserved":0,"allocated":417792,"data_stored":183013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.497}]},{"osd":3,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.2450000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.1539999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0389999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:14:21.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-11-29T11:14:21.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-11-29T11:14:21.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-11-29T11:14:21.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-11-29T11:14:21.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-29T11:14:21.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.456818+0000', 'last_change': '2023-11-29T11:14:15.456818+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.456818+0000', 'last_undegraded': '2023-11-29T11:14:15.456818+0000', 'last_fullsized': '2023-11-29T11:14:15.456818+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T16:15:26.855651+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.455079+0000', 'last_change': '2023-11-29T11:14:15.455079+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.455079+0000', 'last_undegraded': '2023-11-29T11:14:15.455079+0000', 'last_fullsized': '2023-11-29T11:14:15.455079+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T22:02:13.211183+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.455608+0000', 'last_change': '2023-11-29T11:14:15.455608+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.455608+0000', 'last_undegraded': '2023-11-29T11:14:15.455608+0000', 'last_fullsized': '2023-11-29T11:14:15.455608+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-29T11:14:21.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.458801+0000', 'last_change': '2023-11-29T11:14:15.458801+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.458801+0000', 'last_undegraded': '2023-11-29T11:14:15.458801+0000', 'last_fullsized': '2023-11-29T11:14:15.458801+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.457643+0000', 'last_change': '2023-11-29T11:14:15.457643+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.457643+0000', 'last_undegraded': '2023-11-29T11:14:15.457643+0000', 'last_fullsized': '2023-11-29T11:14:15.457643+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T22:34:02.343134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.454117+0000', 'last_change': '2023-11-29T11:14:15.454117+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.454117+0000', 'last_undegraded': '2023-11-29T11:14:15.454117+0000', 'last_fullsized': '2023-11-29T11:14:15.454117+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T23:06:33.134223+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.450635+0000', 'last_change': '2023-11-29T11:14:15.450635+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.450635+0000', 'last_undegraded': '2023-11-29T11:14:15.450635+0000', 'last_fullsized': '2023-11-29T11:14:15.450635+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T16:31:18.762036+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.461673+0000', 'last_change': '2023-11-29T11:14:15.461673+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.461673+0000', 'last_undegraded': '2023-11-29T11:14:15.461673+0000', 'last_fullsized': '2023-11-29T11:14:15.461673+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.454109+0000', 'last_change': '2023-11-29T11:14:15.454109+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.454109+0000', 'last_undegraded': '2023-11-29T11:14:15.454109+0000', 'last_fullsized': '2023-11-29T11:14:15.454109+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T16:42:47.575238+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.460498+0000', 'last_change': '2023-11-29T11:14:15.460498+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.460498+0000', 'last_undegraded': '2023-11-29T11:14:15.460498+0000', 'last_fullsized': '2023-11-29T11:14:15.460498+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.457837+0000', 'last_change': '2023-11-29T11:14:15.457837+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.457837+0000', 'last_undegraded': '2023-11-29T11:14:15.457837+0000', 'last_fullsized': '2023-11-29T11:14:15.457837+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.450698+0000', 'last_change': '2023-11-29T11:14:15.450698+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.450698+0000', 'last_undegraded': '2023-11-29T11:14:15.450698+0000', 'last_fullsized': '2023-11-29T11:14:15.450698+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T23:06:07.505515+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-11-29T11:14:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.456543+0000', 'last_change': '2023-11-29T11:14:15.456543+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.456543+0000', 'last_undegraded': '2023-11-29T11:14:15.456543+0000', 'last_fullsized': '2023-11-29T11:14:15.456543+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T14:02:20.714555+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.457010+0000', 'last_change': '2023-11-29T11:14:15.457010+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.457010+0000', 'last_undegraded': '2023-11-29T11:14:15.457010+0000', 'last_fullsized': '2023-11-29T11:14:15.457010+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T13:22:41.130861+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.453890+0000', 'last_change': '2023-11-29T11:14:15.453890+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.453890+0000', 'last_undegraded': '2023-11-29T11:14:15.453890+0000', 'last_fullsized': '2023-11-29T11:14:15.453890+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T18:05:03.953716+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-11-29T11:14:21.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.461028+0000', 'last_change': '2023-11-29T11:14:15.461028+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.461028+0000', 'last_undegraded': '2023-11-29T11:14:15.461028+0000', 'last_fullsized': '2023-11-29T11:14:15.461028+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.450669+0000', 'last_change': '2023-11-29T11:14:15.450669+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.450669+0000', 'last_undegraded': '2023-11-29T11:14:15.450669+0000', 'last_fullsized': '2023-11-29T11:14:15.450669+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T21:01:09.293879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-29T11:14:21.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.453871+0000', 'last_change': '2023-11-29T11:14:15.453871+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.453871+0000', 'last_undegraded': '2023-11-29T11:14:15.453871+0000', 'last_fullsized': '2023-11-29T11:14:15.453871+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T15:18:19.727568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.450433+0000', 'last_change': '2023-11-29T11:14:15.450433+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.450433+0000', 'last_undegraded': '2023-11-29T11:14:15.450433+0000', 'last_fullsized': '2023-11-29T11:14:15.450433+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T12:20:29.370775+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.454112+0000', 'last_change': '2023-11-29T11:14:15.454112+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.454112+0000', 'last_undegraded': '2023-11-29T11:14:15.454112+0000', 'last_fullsized': '2023-11-29T11:14:15.454112+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T15:01:31.133742+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-29T11:14:21.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.454607+0000', 'last_change': '2023-11-29T11:14:15.454607+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.454607+0000', 'last_undegraded': '2023-11-29T11:14:15.454607+0000', 'last_fullsized': '2023-11-29T11:14:15.454607+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T18:13:11.883176+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.450433+0000', 'last_change': '2023-11-29T11:14:15.450433+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.450433+0000', 'last_undegraded': '2023-11-29T11:14:15.450433+0000', 'last_fullsized': '2023-11-29T11:14:15.450433+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T13:10:12.008008+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.460796+0000', 'last_change': '2023-11-29T11:14:15.460796+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.460796+0000', 'last_undegraded': '2023-11-29T11:14:15.460796+0000', 'last_fullsized': '2023-11-29T11:14:15.460796+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-29T11:14:21.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.458313+0000', 'last_change': '2023-11-29T11:14:15.458313+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.458313+0000', 'last_undegraded': '2023-11-29T11:14:15.458313+0000', 'last_fullsized': '2023-11-29T11:14:15.458313+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.460438+0000', 'last_change': '2023-11-29T11:14:15.460438+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.460438+0000', 'last_undegraded': '2023-11-29T11:14:15.460438+0000', 'last_fullsized': '2023-11-29T11:14:15.460438+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.455623+0000', 'last_change': '2023-11-29T11:14:15.455623+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.455623+0000', 'last_undegraded': '2023-11-29T11:14:15.455623+0000', 'last_fullsized': '2023-11-29T11:14:15.455623+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T23:12:45.196257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.453408+0000', 'last_change': '2023-11-29T11:14:15.453408+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.453408+0000', 'last_undegraded': '2023-11-29T11:14:15.453408+0000', 'last_fullsized': '2023-11-29T11:14:15.453408+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T21:35:52.464556+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.457714+0000', 'last_change': '2023-11-29T11:14:15.457714+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.457714+0000', 'last_undegraded': '2023-11-29T11:14:15.457714+0000', 'last_fullsized': '2023-11-29T11:14:15.457714+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.455576+0000', 'last_change': '2023-11-29T11:14:15.455576+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.455576+0000', 'last_undegraded': '2023-11-29T11:14:15.455576+0000', 'last_fullsized': '2023-11-29T11:14:15.455576+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.456933+0000', 'last_change': '2023-11-29T11:14:15.456933+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.456933+0000', 'last_undegraded': '2023-11-29T11:14:15.456933+0000', 'last_fullsized': '2023-11-29T11:14:15.456933+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.453840+0000', 'last_change': '2023-11-29T11:14:15.453840+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.453840+0000', 'last_undegraded': '2023-11-29T11:14:15.453840+0000', 'last_fullsized': '2023-11-29T11:14:15.453840+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T17:44:40.678113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:14:16.446022+0000', 'last_change': '2023-11-29T11:14:16.446022+0000', 'last_active': '2023-11-29T11:14:16.446022+0000', 'last_peered': '2023-11-29T11:14:16.446022+0000', 'last_clean': '2023-11-29T11:14:16.446022+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:16.446022+0000', 'last_undegraded': '2023-11-29T11:14:16.446022+0000', 'last_fullsized': '2023-11-29T11:14:16.446022+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:16.446022+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-29T11:14:21.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2023-11-29T11:14:15.450641+0000', 'last_change': '2023-11-29T11:14:15.450641+0000', 'last_active': '2023-11-29T11:14:15.434955+0000', 'last_peered': '2023-11-29T11:14:15.434955+0000', 'last_clean': '2023-11-29T11:14:15.434955+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:14:15.450641+0000', 'last_undegraded': '2023-11-29T11:14:15.450641+0000', 'last_fullsized': '2023-11-29T11:14:15.450641+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'last_clean_scrub_stamp': '2023-11-29T11:14:15.434955+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T21:10:47.288431+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-29T11:14:21.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-29T11:14:21.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.657+0000 7f65f3fff700 1 Processor -- start 2023-11-29T11:14:21.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.657+0000 7f65f3fff700 1 -- start start 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.657+0000 7f65f3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65f40cf050 0x7f65f406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.657+0000 7f65f3fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f65f406a530 0x7f65f40cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.657+0000 7f65f3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f415c6d0 con 0x7f65f40b4c10 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.657+0000 7f65f3fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f406a9d0 con 0x7f65f40cf050 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.657+0000 7f65f3fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40cf960 con 0x7f65f406a530 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f65f40b4c10 0x7f65f40cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47550/0 (socket says 172.21.15.81:47550) 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f37fe700 1 -- 172.21.15.81:0/643406819 learned_addr learned my addr 172.21.15.81:0/643406819 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f2ffd700 1 --2- 172.21.15.81:0/643406819 >> v2:172.21.15.81:3300/0 conn(0x7f65f40cf050 0x7f65f406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f27fc700 1 --2- 172.21.15.81:0/643406819 >> v2:172.21.15.176:3300/0 conn(0x7f65f406a530 0x7f65f40cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f2ffd700 1 -- 172.21.15.81:0/643406819 >> v2:172.21.15.176:3300/0 conn(0x7f65f406a530 msgr2=0x7f65f40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f2ffd700 1 --2- 172.21.15.81:0/643406819 >> v2:172.21.15.176:3300/0 conn(0x7f65f406a530 0x7f65f40cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f2ffd700 1 -- 172.21.15.81:0/643406819 >> v1:172.21.15.81:6789/0 conn(0x7f65f40b4c10 legacy=0x7f65f40cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f2ffd700 1 -- 172.21.15.81:0/643406819 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f406ac60 con 0x7f65f40cf050 2023-11-29T11:14:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f2ffd700 1 --2- 172.21.15.81:0/643406819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f406d7d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f65f40d38d0 tx=0x7f65e4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3ac244fa663806 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f1ffb700 1 -- 172.21.15.81:0/643406819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4004230 con 0x7f65f40cf050 2023-11-29T11:14:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f1ffb700 1 -- 172.21.15.81:0/643406819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4004390 con 0x7f65f40cf050 2023-11-29T11:14:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f1ffb700 1 -- 172.21.15.81:0/643406819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e40036c0 con 0x7f65f40cf050 2023-11-29T11:14:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 -- 172.21.15.81:0/643406819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 msgr2=0x7f65f406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 --2- 172.21.15.81:0/643406819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f406d7d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f65f40d38d0 tx=0x7f65e4009b30 comp rx=0 tx=0).stop 2023-11-29T11:14:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 -- 172.21.15.81:0/643406819 shutdown_connections 2023-11-29T11:14:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 --2- 172.21.15.81:0/643406819 >> v2:172.21.15.176:3300/0 conn(0x7f65f406a530 0x7f65f40cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 --2- 172.21.15.81:0/643406819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f406d7d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 -- 172.21.15.81:0/643406819 >> 172.21.15.81:0/643406819 conn(0x7f65f409bb30 msgr2=0x7f65f40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:21.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 -- 172.21.15.81:0/643406819 shutdown_connections 2023-11-29T11:14:21.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 -- 172.21.15.81:0/643406819 wait complete. 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 Processor -- start 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.661+0000 7f65f3fff700 1 -- start start 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65f406a530 0x7f65f4150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f40b4c10 0x7f65f4151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f409c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4152e00 con 0x7f65f40cf050 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f41521f0 con 0x7f65f40b4c10 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f41524d0 con 0x7f65f406a530 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f409c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f409c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38578/0 (socket says 172.21.15.81:38578) 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 -- 172.21.15.81:0/3353702116 learned_addr learned my addr 172.21.15.81:0/3353702116 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f27fc700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f40b4c10 0x7f65f4151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f2ffd700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65f406a530 0x7f65f4150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 -- 172.21.15.81:0/3353702116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65f406a530 msgr2=0x7f65f4150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65f406a530 0x7f65f4150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 -- 172.21.15.81:0/3353702116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f40b4c10 msgr2=0x7f65f4151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f40b4c10 0x7f65f4151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 -- 172.21.15.81:0/3353702116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40094b0 con 0x7f65f40cf050 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f37fe700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f409c4a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f65ec002000 tx=0x7f65ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65eb7fe700 1 -- 172.21.15.81:0/3353702116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec00ad40 con 0x7f65f40cf050 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f40b4410 con 0x7f65f40cf050 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65eb7fe700 1 -- 172.21.15.81:0/3353702116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec0070d0 con 0x7f65f40cf050 2023-11-29T11:14:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f406af40 con 0x7f65f40cf050 2023-11-29T11:14:21.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65eb7fe700 1 -- 172.21.15.81:0/3353702116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec00aea0 con 0x7f65f40cf050 2023-11-29T11:14:21.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.665+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f40b46f0 con 0x7f65f40cf050 2023-11-29T11:14:21.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.669+0000 7f65eb7fe700 1 -- 172.21.15.81:0/3353702116 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f65ec010070 con 0x7f65f40cf050 2023-11-29T11:14:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.669+0000 7f65eb7fe700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65d4064ee0 0x7f65d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.669+0000 7f65eb7fe700 1 -- 172.21.15.81:0/3353702116 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f65ec081c20 con 0x7f65f40cf050 2023-11-29T11:14:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.669+0000 7f65f2ffd700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65d4064ee0 0x7f65d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.669+0000 7f65f2ffd700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65d4064ee0 0x7f65d4067390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f65f40d38d0 tx=0x7f65e4013040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.677+0000 7f65eb7fe700 1 -- 172.21.15.81:0/3353702116 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f65ec04fb10 con 0x7f65f40cf050 2023-11-29T11:14:21.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.897+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f65f4072500 con 0x7f65f40cf050 2023-11-29T11:14:21.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.897+0000 7f65eb7fe700 1 -- 172.21.15.81:0/3353702116 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1108 (secure 0 0 0) 0x7f65ec018470 con 0x7f65f40cf050 2023-11-29T11:14:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:21.905 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":106,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1701256365,"num_in_osds":8,"osd_in_since":1701256357,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":71602176,"bytes_avail":773022511104,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5580}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-29T11:13:58.446800+0000","services":{}},"progress_events":{}} 2023-11-29T11:14:21.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65d4064ee0 msgr2=0x7f65d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65d4064ee0 0x7f65d4067390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f65f40d38d0 tx=0x7f65e4013040 comp rx=0 tx=0).stop 2023-11-29T11:14:21.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 msgr2=0x7f65f409c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:21.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f409c4a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f65ec002000 tx=0x7f65ec00a340 comp rx=0 tx=0).stop 2023-11-29T11:14:21.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 shutdown_connections 2023-11-29T11:14:21.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65d4064ee0 0x7f65d4067390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f40cf050 0x7f65f409c4a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f40b4c10 0x7f65f4151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 --2- 172.21.15.81:0/3353702116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65f406a530 0x7f65f4150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:21.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 >> 172.21.15.81:0/3353702116 conn(0x7f65f409bb30 msgr2=0x7f65f40af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:21.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 shutdown_connections 2023-11-29T11:14:21.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:21.901+0000 7f65f3fff700 1 -- 172.21.15.81:0/3353702116 wait complete. 2023-11-29T11:14:21.919 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-29T11:14:21.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:14:22.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34ad596700 1 Processor -- start 2023-11-29T11:14:22.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34ad596700 1 -- start start 2023-11-29T11:14:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34ad596700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a80cf050 0x7f34a806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34ad596700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34a806a530 0x7f34a80cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34ad596700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a815c6d0 con 0x7f34a80b4c10 2023-11-29T11:14:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34ad596700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a806a9a0 con 0x7f34a806a530 2023-11-29T11:14:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34ad596700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80cf960 con 0x7f34a80cf050 2023-11-29T11:14:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34a806a530 0x7f34a80cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34acd95700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f34a80b4c10 0x7f34a80cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47554/0 (socket says 172.21.15.81:47554) 2023-11-29T11:14:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34acd95700 1 -- 172.21.15.81:0/3807057993 learned_addr learned my addr 172.21.15.81:0/3807057993 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a7fff700 1 --2- 172.21.15.81:0/3807057993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a80cf050 0x7f34a806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a77fe700 1 -- 172.21.15.81:0/3807057993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a80cf050 msgr2=0x7f34a806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:22.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a77fe700 1 --2- 172.21.15.81:0/3807057993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a80cf050 0x7f34a806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a77fe700 1 -- 172.21.15.81:0/3807057993 >> v1:172.21.15.81:6789/0 conn(0x7f34a80b4c10 legacy=0x7f34a80cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a6ffd700 1 -- 172.21.15.81:0/3807057993 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599731425 0 0) 0x7f34a815c6d0 con 0x7f34a80b4c10 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a77fe700 1 -- 172.21.15.81:0/3807057993 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a806ac60 con 0x7f34a806a530 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a77fe700 1 --2- 172.21.15.81:0/3807057993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a806a530 0x7f34a80cf420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f349c009850 tx=0x7f349c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc409670f7aa1df4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a6ffd700 1 -- 172.21.15.81:0/3807057993 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011830 con 0x7f34a806a530 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a6ffd700 1 -- 172.21.15.81:0/3807057993 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c011990 con 0x7f34a806a530 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.025+0000 7f34a6ffd700 1 -- 172.21.15.81:0/3807057993 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011d40 con 0x7f34a806a530 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- 172.21.15.81:0/3807057993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a806a530 msgr2=0x7f34a80cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 --2- 172.21.15.81:0/3807057993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a806a530 0x7f34a80cf420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f349c009850 tx=0x7f349c009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- 172.21.15.81:0/3807057993 shutdown_connections 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 --2- 172.21.15.81:0/3807057993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a806a530 0x7f34a80cf420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 --2- 172.21.15.81:0/3807057993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a80cf050 0x7f34a806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- 172.21.15.81:0/3807057993 >> 172.21.15.81:0/3807057993 conn(0x7f34a809bb30 msgr2=0x7f34a80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- 172.21.15.81:0/3807057993 shutdown_connections 2023-11-29T11:14:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- 172.21.15.81:0/3807057993 wait complete. 2023-11-29T11:14:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 Processor -- start 2023-11-29T11:14:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- start start 2023-11-29T11:14:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a806a530 0x7f34a80c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a80b4c10 0x7f34a815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34a80cf050 0x7f34a80b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a81f27e0 con 0x7f34a80b4c10 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a81f1b60 con 0x7f34a80cf050 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34ad596700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a81f1e40 con 0x7f34a806a530 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a80b4c10 0x7f34a815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34a77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a80b4c10 0x7f34a815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38590/0 (socket says 172.21.15.81:38590) 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34a77fe700 1 -- 172.21.15.81:0/272095407 learned_addr learned my addr 172.21.15.81:0/272095407 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.029+0000 7f34a7fff700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a806a530 0x7f34a80c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34acd95700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34a80cf050 0x7f34a80b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a77fe700 1 -- 172.21.15.81:0/272095407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a806a530 msgr2=0x7f34a80c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a77fe700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a806a530 0x7f34a80c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a77fe700 1 -- 172.21.15.81:0/272095407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34a80cf050 msgr2=0x7f34a80b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a77fe700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34a80cf050 0x7f34a80b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a77fe700 1 -- 172.21.15.81:0/272095407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0094b0 con 0x7f34a80b4c10 2023-11-29T11:14:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a77fe700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a80b4c10 0x7f34a815f0a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f349c000c00 tx=0x7f349c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a4ff9700 1 -- 172.21.15.81:0/272095407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c004550 con 0x7f34a80b4c10 2023-11-29T11:14:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a80b4410 con 0x7f34a80b4c10 2023-11-29T11:14:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a4ff9700 1 -- 172.21.15.81:0/272095407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c01f070 con 0x7f34a80b4c10 2023-11-29T11:14:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a4ff9700 1 -- 172.21.15.81:0/272095407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c003900 con 0x7f34a80b4c10 2023-11-29T11:14:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a806af40 con 0x7f34a80b4c10 2023-11-29T11:14:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a80b46f0 con 0x7f34a80b4c10 2023-11-29T11:14:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.033+0000 7f34a4ff9700 1 -- 172.21.15.81:0/272095407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f349c00f050 con 0x7f34a80b4c10 2023-11-29T11:14:22.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.037+0000 7f34a4ff9700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3494064ee0 0x7f3494067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:22.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.037+0000 7f34a4ff9700 1 -- 172.21.15.81:0/272095407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f349c021070 con 0x7f34a80b4c10 2023-11-29T11:14:22.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.037+0000 7f34a7fff700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3494064ee0 0x7f3494067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:22.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.037+0000 7f34a7fff700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3494064ee0 0x7f3494067390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3498011340 tx=0x7f349800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.041+0000 7f34a4ff9700 1 -- 172.21.15.81:0/272095407 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f349c051840 con 0x7f34a80b4c10 2023-11-29T11:14:22.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.201+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34a8072500 con 0x7f3494064ee0 2023-11-29T11:14:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.209+0000 7f34a4ff9700 1 -- 172.21.15.81:0/272095407 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299089 (secure 0 0 0) 0x7f34a8072500 con 0x7f3494064ee0 2023-11-29T11:14:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3494064ee0 msgr2=0x7f3494067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3494064ee0 0x7f3494067390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3498011340 tx=0x7f349800b040 comp rx=0 tx=0).stop 2023-11-29T11:14:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a80b4c10 msgr2=0x7f34a815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a80b4c10 0x7f34a815f0a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f349c000c00 tx=0x7f349c004770 comp rx=0 tx=0).stop 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 shutdown_connections 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3494064ee0 0x7f3494067390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34a80cf050 0x7f34a80b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a80b4c10 0x7f34a815f0a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 --2- 172.21.15.81:0/272095407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34a806a530 0x7f34a80c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 >> 172.21.15.81:0/272095407 conn(0x7f34a809bb30 msgr2=0x7f34a80d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 shutdown_connections 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:22.213+0000 7f34ad596700 1 -- 172.21.15.81:0/272095407 wait complete. 2023-11-29T11:14:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:14:22.233 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-29T11:14:20.454045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69924,"kb_used_data":4452,"kb_used_omap":0,"kb_used_meta":65408,"kb_avail":754904796,"statfs":{"total":773094113280,"available":773022511104,"internally_reserved":0,"allocated":4558848,"data_stored":2651742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66977792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.005787"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456818+0000","last_change":"2023-11-29T11:14:15.456818+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456818+0000","last_undegraded":"2023-11-29T11:14:15.456818+0000","last_fullsized":"2023-11-29T11:14:15.456818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:15:26.855651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455079+0000","last_change":"2023-11-29T11:14:15.455079+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455079+0000","last_undegraded":"2023-11-29T11:14:15.455079+0000","last_fullsized":"2023-11-29T11:14:15.455079+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:13.211183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455608+0000","last_change":"2023-11-29T11:14:15.455608+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455608+0000","last_undegraded":"2023-11-29T11:14:15.455608+0000","last_fullsized":"2023-11-29T11:14:15.455608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.458801+0000","last_change":"2023-11-29T11:14:15.458801+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.458801+0000","last_undegraded":"2023-11-29T11:14:15.458801+0000","last_fullsized":"2023-11-29T11:14:15.458801+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457643+0000","last_change":"2023-11-29T11:14:15.457643+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457643+0000","last_undegraded":"2023-11-29T11:14:15.457643+0000","last_fullsized":"2023-11-29T11:14:15.457643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:34:02.343134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454117+0000","last_change":"2023-11-29T11:14:15.454117+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454117+0000","last_undegraded":"2023-11-29T11:14:15.454117+0000","last_fullsized":"2023-11-29T11:14:15.454117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:33.134223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450635+0000","last_change":"2023-11-29T11:14:15.450635+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450635+0000","last_undegraded":"2023-11-29T11:14:15.450635+0000","last_fullsized":"2023-11-29T11:14:15.450635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:31:18.762036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.461673+0000","last_change":"2023-11-29T11:14:15.461673+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.461673+0000","last_undegraded":"2023-11-29T11:14:15.461673+0000","last_fullsized":"2023-11-29T11:14:15.461673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454109+0000","last_change":"2023-11-29T11:14:15.454109+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454109+0000","last_undegraded":"2023-11-29T11:14:15.454109+0000","last_fullsized":"2023-11-29T11:14:15.454109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:42:47.575238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460498+0000","last_change":"2023-11-29T11:14:15.460498+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460498+0000","last_undegraded":"2023-11-29T11:14:15.460498+0000","last_fullsized":"2023-11-29T11:14:15.460498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457837+0000","last_change":"2023-11-29T11:14:15.457837+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457837+0000","last_undegraded":"2023-11-29T11:14:15.457837+0000","last_fullsized":"2023-11-29T11:14:15.457837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450698+0000","last_change":"2023-11-29T11:14:15.450698+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450698+0000","last_undegraded":"2023-11-29T11:14:15.450698+0000","last_fullsized":"2023-11-29T11:14:15.450698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:07.505515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456543+0000","last_change":"2023-11-29T11:14:15.456543+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456543+0000","last_undegraded":"2023-11-29T11:14:15.456543+0000","last_fullsized":"2023-11-29T11:14:15.456543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:02:20.714555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457010+0000","last_change":"2023-11-29T11:14:15.457010+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457010+0000","last_undegraded":"2023-11-29T11:14:15.457010+0000","last_fullsized":"2023-11-29T11:14:15.457010+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:22:41.130861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453890+0000","last_change":"2023-11-29T11:14:15.453890+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453890+0000","last_undegraded":"2023-11-29T11:14:15.453890+0000","last_fullsized":"2023-11-29T11:14:15.453890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:05:03.953716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.461028+0000","last_change":"2023-11-29T11:14:15.461028+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.461028+0000","last_undegraded":"2023-11-29T11:14:15.461028+0000","last_fullsized":"2023-11-29T11:14:15.461028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450669+0000","last_change":"2023-11-29T11:14:15.450669+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450669+0000","last_undegraded":"2023-11-29T11:14:15.450669+0000","last_fullsized":"2023-11-29T11:14:15.450669+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:01:09.293879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453871+0000","last_change":"2023-11-29T11:14:15.453871+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453871+0000","last_undegraded":"2023-11-29T11:14:15.453871+0000","last_fullsized":"2023-11-29T11:14:15.453871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:19.727568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450433+0000","last_change":"2023-11-29T11:14:15.450433+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450433+0000","last_undegraded":"2023-11-29T11:14:15.450433+0000","last_fullsized":"2023-11-29T11:14:15.450433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:20:29.370775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454112+0000","last_change":"2023-11-29T11:14:15.454112+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454112+0000","last_undegraded":"2023-11-29T11:14:15.454112+0000","last_fullsized":"2023-11-29T11:14:15.454112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:01:31.133742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.454607+0000","last_change":"2023-11-29T11:14:15.454607+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.454607+0000","last_undegraded":"2023-11-29T11:14:15.454607+0000","last_fullsized":"2023-11-29T11:14:15.454607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:13:11.883176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450433+0000","last_change":"2023-11-29T11:14:15.450433+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450433+0000","last_undegraded":"2023-11-29T11:14:15.450433+0000","last_fullsized":"2023-11-29T11:14:15.450433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:10:12.008008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460796+0000","last_change":"2023-11-29T11:14:15.460796+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460796+0000","last_undegraded":"2023-11-29T11:14:15.460796+0000","last_fullsized":"2023-11-29T11:14:15.460796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.458313+0000","last_change":"2023-11-29T11:14:15.458313+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.458313+0000","last_undegraded":"2023-11-29T11:14:15.458313+0000","last_fullsized":"2023-11-29T11:14:15.458313+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.460438+0000","last_change":"2023-11-29T11:14:15.460438+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.460438+0000","last_undegraded":"2023-11-29T11:14:15.460438+0000","last_fullsized":"2023-11-29T11:14:15.460438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568528+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:14:10.568528+0000","last_peered":"2023-11-29T11:14:10.568528+0000","last_clean":"2023-11-29T11:14:10.568528+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:14:10.568528+0000","last_undegraded":"2023-11-29T11:14:10.568528+0000","last_fullsized":"2023-11-29T11:14:10.568528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455623+0000","last_change":"2023-11-29T11:14:15.455623+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455623+0000","last_undegraded":"2023-11-29T11:14:15.455623+0000","last_fullsized":"2023-11-29T11:14:15.455623+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:12:45.196257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568493+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:14:10.568493+0000","last_peered":"2023-11-29T11:14:10.568493+0000","last_clean":"2023-11-29T11:14:10.568493+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:14:10.568493+0000","last_undegraded":"2023-11-29T11:14:10.568493+0000","last_fullsized":"2023-11-29T11:14:10.568493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453408+0000","last_change":"2023-11-29T11:14:15.453408+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453408+0000","last_undegraded":"2023-11-29T11:14:15.453408+0000","last_fullsized":"2023-11-29T11:14:15.453408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:52.464556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568888+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:14:10.568888+0000","last_peered":"2023-11-29T11:14:10.568888+0000","last_clean":"2023-11-29T11:14:10.568888+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:14:10.568888+0000","last_undegraded":"2023-11-29T11:14:10.568888+0000","last_fullsized":"2023-11-29T11:14:10.568888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.457714+0000","last_change":"2023-11-29T11:14:15.457714+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.457714+0000","last_undegraded":"2023-11-29T11:14:15.457714+0000","last_fullsized":"2023-11-29T11:14:15.457714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420744+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:14:10.420744+0000","last_peered":"2023-11-29T11:14:10.420744+0000","last_clean":"2023-11-29T11:14:10.420744+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:14:10.420744+0000","last_undegraded":"2023-11-29T11:14:10.420744+0000","last_fullsized":"2023-11-29T11:14:10.420744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.455576+0000","last_change":"2023-11-29T11:14:15.455576+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.455576+0000","last_undegraded":"2023-11-29T11:14:15.455576+0000","last_fullsized":"2023-11-29T11:14:15.455576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":177,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420094+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:14:10.420094+0000","last_peered":"2023-11-29T11:14:10.420094+0000","last_clean":"2023-11-29T11:14:10.420094+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:14:10.420094+0000","last_undegraded":"2023-11-29T11:14:10.420094+0000","last_fullsized":"2023-11-29T11:14:10.420094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.568815+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:14:10.568815+0000","last_peered":"2023-11-29T11:14:10.568815+0000","last_clean":"2023-11-29T11:14:10.568815+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:14:10.568815+0000","last_undegraded":"2023-11-29T11:14:10.568815+0000","last_fullsized":"2023-11-29T11:14:10.568815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.456933+0000","last_change":"2023-11-29T11:14:15.456933+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.456933+0000","last_undegraded":"2023-11-29T11:14:15.456933+0000","last_fullsized":"2023-11-29T11:14:15.456933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.419928+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:14:10.419928+0000","last_peered":"2023-11-29T11:14:10.419928+0000","last_clean":"2023-11-29T11:14:10.419928+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:14:10.419928+0000","last_undegraded":"2023-11-29T11:14:10.419928+0000","last_fullsized":"2023-11-29T11:14:10.419928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.453840+0000","last_change":"2023-11-29T11:14:15.453840+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.453840+0000","last_undegraded":"2023-11-29T11:14:15.453840+0000","last_fullsized":"2023-11-29T11:14:15.453840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:44:40.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.420663+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:14:10.420663+0000","last_peered":"2023-11-29T11:14:10.420663+0000","last_clean":"2023-11-29T11:14:10.420663+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:14:10.420663+0000","last_undegraded":"2023-11-29T11:14:10.420663+0000","last_fullsized":"2023-11-29T11:14:10.420663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:14:16.446022+0000","last_change":"2023-11-29T11:14:16.446022+0000","last_active":"2023-11-29T11:14:16.446022+0000","last_peered":"2023-11-29T11:14:16.446022+0000","last_clean":"2023-11-29T11:14:16.446022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:16.446022+0000","last_undegraded":"2023-11-29T11:14:16.446022+0000","last_fullsized":"2023-11-29T11:14:16.446022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-11-29T11:14:15.450641+0000","last_change":"2023-11-29T11:14:15.450641+0000","last_active":"2023-11-29T11:14:15.434955+0000","last_peered":"2023-11-29T11:14:15.434955+0000","last_clean":"2023-11-29T11:14:15.434955+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:14:15.450641+0000","last_undegraded":"2023-11-29T11:14:15.450641+0000","last_fullsized":"2023-11-29T11:14:15.450641+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:47.288431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T11:14:10.419928+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:14:10.419928+0000","last_peered":"2023-11-29T11:14:10.419928+0000","last_clean":"2023-11-29T11:14:10.419928+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:14:10.419928+0000","last_undegraded":"2023-11-29T11:14:10.419928+0000","last_fullsized":"2023-11-29T11:14:10.419928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":774367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.83899999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.81399999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.028}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.94399999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.753},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.879}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.085},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.91300000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.127},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.1519999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8420,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363420,"statfs":{"total":96636764160,"available":96628142080,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.98099999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.153}]},{"osd":2,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.95099999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.02}]},{"osd":4,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.085}]},{"osd":5,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.228},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.252}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.873}]},{"osd":1,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.024},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.92600000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.339},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1870000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.53}]},{"osd":6,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.4870000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.673}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.1000000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.82699999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.73599999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.05}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.748}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.499},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.84899999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.0660000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.093},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.119}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8356,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363484,"statfs":{"total":96636764160,"available":96628207616,"internally_reserved":0,"allocated":421888,"data_stored":183999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.073},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.103},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.155}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.038},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.016}]}]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":774367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.752},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.63}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.873}]},{"osd":7,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.98199999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8480,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363360,"statfs":{"total":96636764160,"available":96628080640,"internally_reserved":0,"allocated":417792,"data_stored":183013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.497}]},{"osd":3,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.2450000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.1539999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0389999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:14:25.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:14:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.348+0000 7fd8c9ce9700 1 Processor -- start 2023-11-29T11:14:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.348+0000 7fd8c9ce9700 1 -- start start 2023-11-29T11:14:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8c415c150 0x7fd8c41607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd8c40c9e70 0x7fd8c40cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c415c520 con 0x7fd8c40cc430 2023-11-29T11:14:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c40ca680 con 0x7fd8c415c150 2023-11-29T11:14:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c40ca960 con 0x7fd8c40c9e70 2023-11-29T11:14:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c8ce7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8c415c150 0x7fd8c41607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c94e8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd8c40cc430 0x7fd8c4070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47560/0 (socket says 172.21.15.81:47560) 2023-11-29T11:14:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c94e8700 1 -- 172.21.15.81:0/2559702203 learned_addr learned my addr 172.21.15.81:0/2559702203 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c3fff700 1 --2- 172.21.15.81:0/2559702203 >> v2:172.21.15.176:3300/0 conn(0x7fd8c40c9e70 0x7fd8c40cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c37fe700 1 -- 172.21.15.81:0/2559702203 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638625643 0 0) 0x7fd8c415c520 con 0x7fd8c40cc430 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c37fe700 1 -- 172.21.15.81:0/2559702203 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8ac0035d0 con 0x7fd8c40cc430 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c8ce7700 1 -- 172.21.15.81:0/2559702203 >> v2:172.21.15.176:3300/0 conn(0x7fd8c40c9e70 msgr2=0x7fd8c40cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c8ce7700 1 --2- 172.21.15.81:0/2559702203 >> v2:172.21.15.176:3300/0 conn(0x7fd8c40c9e70 0x7fd8c40cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c8ce7700 1 -- 172.21.15.81:0/2559702203 >> v1:172.21.15.81:6789/0 conn(0x7fd8c40cc430 legacy=0x7fd8c4070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c8ce7700 1 -- 172.21.15.81:0/2559702203 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c40cf330 con 0x7fd8c415c150 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c8ce7700 1 --2- 172.21.15.81:0/2559702203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c415c150 0x7fd8c41607b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40af140 tx=0x7fd8b8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cc61c9c1221143 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c37fe700 1 -- 172.21.15.81:0/2559702203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8011830 con 0x7fd8c415c150 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c37fe700 1 -- 172.21.15.81:0/2559702203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b8011990 con 0x7fd8c415c150 2023-11-29T11:14:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c37fe700 1 -- 172.21.15.81:0/2559702203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8011d00 con 0x7fd8c415c150 2023-11-29T11:14:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/2559702203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c415c150 msgr2=0x7fd8c41607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/2559702203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c415c150 0x7fd8c41607b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40af140 tx=0x7fd8b8009b30 comp rx=0 tx=0).stop 2023-11-29T11:14:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/2559702203 shutdown_connections 2023-11-29T11:14:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/2559702203 >> v2:172.21.15.176:3300/0 conn(0x7fd8c40c9e70 0x7fd8c40cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/2559702203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c415c150 0x7fd8c41607b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/2559702203 >> 172.21.15.81:0/2559702203 conn(0x7fd8c406ec40 msgr2=0x7fd8c40b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/2559702203 shutdown_connections 2023-11-29T11:14:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.352+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/2559702203 wait complete. 2023-11-29T11:14:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c9ce9700 1 Processor -- start 2023-11-29T11:14:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c9ce9700 1 -- start start 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c9ce9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8c40c9e70 0x7fd8c4147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c9ce9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c40cc430 0x7fd8c40b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c9ce9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c415c150 0x7fd8c406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c9ce9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40c9050 con 0x7fd8c40cc430 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c9ce9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41571a0 con 0x7fd8c415c150 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c9ce9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40c83d0 con 0x7fd8c40c9e70 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c40cc430 0x7fd8c40b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c40cc430 0x7fd8c40b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38612/0 (socket says 172.21.15.81:38612) 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c3fff700 1 -- 172.21.15.81:0/3289760464 learned_addr learned my addr 172.21.15.81:0/3289760464 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c8ce7700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8c40c9e70 0x7fd8c4147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.356+0000 7fd8c94e8700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c415c150 0x7fd8c406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c3fff700 1 -- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8c40c9e70 msgr2=0x7fd8c4147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c3fff700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8c40c9e70 0x7fd8c4147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c3fff700 1 -- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c415c150 msgr2=0x7fd8c406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c3fff700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c415c150 0x7fd8c406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c3fff700 1 -- 172.21.15.81:0/3289760464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80094b0 con 0x7fd8c40cc430 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c94e8700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c415c150 0x7fd8c406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c3fff700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c40cc430 0x7fd8c40b4310 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400e9d0 tx=0x7fd8b400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c17fa700 1 -- 172.21.15.81:0/3289760464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4009720 con 0x7fd8c40cc430 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c40cdb20 con 0x7fd8c40cc430 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c17fa700 1 -- 172.21.15.81:0/3289760464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400c850 con 0x7fd8c40cc430 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c17fa700 1 -- 172.21.15.81:0/3289760464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400cbc0 con 0x7fd8c40cc430 2023-11-29T11:14:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c40cd840 con 0x7fd8c40cc430 2023-11-29T11:14:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c40cde00 con 0x7fd8c40cc430 2023-11-29T11:14:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.360+0000 7fd8c17fa700 1 -- 172.21.15.81:0/3289760464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd8b4019030 con 0x7fd8c40cc430 2023-11-29T11:14:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.364+0000 7fd8c17fa700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd8b0064ee0 0x7fd8b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.364+0000 7fd8c17fa700 1 -- 172.21.15.81:0/3289760464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd8b4082060 con 0x7fd8c40cc430 2023-11-29T11:14:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.364+0000 7fd8c8ce7700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd8b0064ee0 0x7fd8b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.364+0000 7fd8c8ce7700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd8b0064ee0 0x7fd8b0067390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8000c00 tx=0x7fd8b8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.368+0000 7fd8c17fa700 1 -- 172.21.15.81:0/3289760464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd8b404ff50 con 0x7fd8c40cc430 2023-11-29T11:14:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.532+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8c4072c20 con 0x7fd8b0064ee0 2023-11-29T11:14:25.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.548+0000 7fd8c17fa700 1 -- 172.21.15.81:0/3289760464 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310026 (secure 0 0 0) 0x7fd8c4072c20 con 0x7fd8b0064ee0 2023-11-29T11:14:25.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:25.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd8b0064ee0 msgr2=0x7fd8b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd8b0064ee0 0x7fd8b0067390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8000c00 tx=0x7fd8b8008030 comp rx=0 tx=0).stop 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c40cc430 msgr2=0x7fd8c40b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c40cc430 0x7fd8c40b4310 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400e9d0 tx=0x7fd8b400ece0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 shutdown_connections 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd8b0064ee0 0x7fd8b0067390 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8c415c150 0x7fd8c406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c40cc430 0x7fd8c40b4310 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 --2- 172.21.15.81:0/3289760464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8c40c9e70 0x7fd8c4147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 >> 172.21.15.81:0/3289760464 conn(0x7fd8c406ec40 msgr2=0x7fd8c406bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 shutdown_connections 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.552+0000 7fd8c9ce9700 1 -- 172.21.15.81:0/3289760464 wait complete. 2023-11-29T11:14:25.563 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:14:25.575 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-11-29T11:14:24.455615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71524,"kb_used_data":4900,"kb_used_omap":0,"kb_used_meta":66560,"kb_avail":754903196,"statfs":{"total":773094113280,"available":773020872704,"internally_reserved":0,"allocated":5017600,"data_stored":2879210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68157440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.994646"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675747+0000","last_change":"2023-11-29T11:14:16.866457+0000","last_active":"2023-11-29T11:14:18.675747+0000","last_peered":"2023-11-29T11:14:18.675747+0000","last_clean":"2023-11-29T11:14:18.675747+0000","last_became_active":"2023-11-29T11:14:16.866196+0000","last_became_peered":"2023-11-29T11:14:16.866196+0000","last_unstale":"2023-11-29T11:14:18.675747+0000","last_undegraded":"2023-11-29T11:14:18.675747+0000","last_fullsized":"2023-11-29T11:14:18.675747+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:34:03.354201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.849094+0000","last_change":"2023-11-29T11:14:16.861568+0000","last_active":"2023-11-29T11:14:17.849094+0000","last_peered":"2023-11-29T11:14:17.849094+0000","last_clean":"2023-11-29T11:14:17.849094+0000","last_became_active":"2023-11-29T11:14:16.861269+0000","last_became_peered":"2023-11-29T11:14:16.861269+0000","last_unstale":"2023-11-29T11:14:17.849094+0000","last_undegraded":"2023-11-29T11:14:17.849094+0000","last_fullsized":"2023-11-29T11:14:17.849094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:23:50.653834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.848162+0000","last_change":"2023-11-29T11:14:16.857095+0000","last_active":"2023-11-29T11:14:17.848162+0000","last_peered":"2023-11-29T11:14:17.848162+0000","last_clean":"2023-11-29T11:14:17.848162+0000","last_became_active":"2023-11-29T11:14:16.856816+0000","last_became_peered":"2023-11-29T11:14:16.856816+0000","last_unstale":"2023-11-29T11:14:17.848162+0000","last_undegraded":"2023-11-29T11:14:17.848162+0000","last_fullsized":"2023-11-29T11:14:17.848162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:54:02.284492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.676445+0000","last_change":"2023-11-29T11:14:16.868284+0000","last_active":"2023-11-29T11:14:18.676445+0000","last_peered":"2023-11-29T11:14:18.676445+0000","last_clean":"2023-11-29T11:14:18.676445+0000","last_became_active":"2023-11-29T11:14:16.868026+0000","last_became_peered":"2023-11-29T11:14:16.868026+0000","last_unstale":"2023-11-29T11:14:18.676445+0000","last_undegraded":"2023-11-29T11:14:18.676445+0000","last_fullsized":"2023-11-29T11:14:18.676445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:42:48.586305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.848150+0000","last_change":"2023-11-29T11:14:16.861574+0000","last_active":"2023-11-29T11:14:17.848150+0000","last_peered":"2023-11-29T11:14:17.848150+0000","last_clean":"2023-11-29T11:14:17.848150+0000","last_became_active":"2023-11-29T11:14:16.860852+0000","last_became_peered":"2023-11-29T11:14:16.860852+0000","last_unstale":"2023-11-29T11:14:17.848150+0000","last_undegraded":"2023-11-29T11:14:17.848150+0000","last_fullsized":"2023-11-29T11:14:17.848150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:51:27.575115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846582+0000","last_change":"2023-11-29T11:14:16.864561+0000","last_active":"2023-11-29T11:14:17.846582+0000","last_peered":"2023-11-29T11:14:17.846582+0000","last_clean":"2023-11-29T11:14:17.846582+0000","last_became_active":"2023-11-29T11:14:16.864265+0000","last_became_peered":"2023-11-29T11:14:16.864265+0000","last_unstale":"2023-11-29T11:14:17.846582+0000","last_undegraded":"2023-11-29T11:14:17.846582+0000","last_fullsized":"2023-11-29T11:14:17.846582+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:20.738635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674653+0000","last_change":"2023-11-29T11:14:16.864753+0000","last_active":"2023-11-29T11:14:18.674653+0000","last_peered":"2023-11-29T11:14:18.674653+0000","last_clean":"2023-11-29T11:14:18.674653+0000","last_became_active":"2023-11-29T11:14:16.864468+0000","last_became_peered":"2023-11-29T11:14:16.864468+0000","last_unstale":"2023-11-29T11:14:18.674653+0000","last_undegraded":"2023-11-29T11:14:18.674653+0000","last_fullsized":"2023-11-29T11:14:18.674653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:44:41.689180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674351+0000","last_change":"2023-11-29T11:14:16.846583+0000","last_active":"2023-11-29T11:14:18.674351+0000","last_peered":"2023-11-29T11:14:18.674351+0000","last_clean":"2023-11-29T11:14:18.674351+0000","last_became_active":"2023-11-29T11:14:16.846299+0000","last_became_peered":"2023-11-29T11:14:16.846299+0000","last_unstale":"2023-11-29T11:14:18.674351+0000","last_undegraded":"2023-11-29T11:14:18.674351+0000","last_fullsized":"2023-11-29T11:14:18.674351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:53.475623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.677809+0000","last_change":"2023-11-29T11:14:16.852646+0000","last_active":"2023-11-29T11:14:18.677809+0000","last_peered":"2023-11-29T11:14:18.677809+0000","last_clean":"2023-11-29T11:14:18.677809+0000","last_became_active":"2023-11-29T11:14:16.852347+0000","last_became_peered":"2023-11-29T11:14:16.852347+0000","last_unstale":"2023-11-29T11:14:18.677809+0000","last_undegraded":"2023-11-29T11:14:18.677809+0000","last_fullsized":"2023-11-29T11:14:18.677809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:20.738635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.677649+0000","last_change":"2023-11-29T11:14:16.868379+0000","last_active":"2023-11-29T11:14:18.677649+0000","last_peered":"2023-11-29T11:14:18.677649+0000","last_clean":"2023-11-29T11:14:18.677649+0000","last_became_active":"2023-11-29T11:14:16.867877+0000","last_became_peered":"2023-11-29T11:14:16.867877+0000","last_unstale":"2023-11-29T11:14:18.677649+0000","last_undegraded":"2023-11-29T11:14:18.677649+0000","last_fullsized":"2023-11-29T11:14:18.677649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:14.282211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.676215+0000","last_change":"2023-11-29T11:14:16.853102+0000","last_active":"2023-11-29T11:14:18.676215+0000","last_peered":"2023-11-29T11:14:18.676215+0000","last_clean":"2023-11-29T11:14:18.676215+0000","last_became_active":"2023-11-29T11:14:16.852859+0000","last_became_peered":"2023-11-29T11:14:16.852859+0000","last_unstale":"2023-11-29T11:14:18.676215+0000","last_undegraded":"2023-11-29T11:14:18.676215+0000","last_fullsized":"2023-11-29T11:14:18.676215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:44:18.825003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.847703+0000","last_change":"2023-11-29T11:14:16.858752+0000","last_active":"2023-11-29T11:14:17.847703+0000","last_peered":"2023-11-29T11:14:17.847703+0000","last_clean":"2023-11-29T11:14:17.847703+0000","last_became_active":"2023-11-29T11:14:16.858135+0000","last_became_peered":"2023-11-29T11:14:16.858135+0000","last_unstale":"2023-11-29T11:14:17.847703+0000","last_undegraded":"2023-11-29T11:14:17.847703+0000","last_fullsized":"2023-11-29T11:14:17.847703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:29:58.926396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.677092+0000","last_change":"2023-11-29T11:14:16.857907+0000","last_active":"2023-11-29T11:14:18.677092+0000","last_peered":"2023-11-29T11:14:18.677092+0000","last_clean":"2023-11-29T11:14:18.677092+0000","last_became_active":"2023-11-29T11:14:16.857688+0000","last_became_peered":"2023-11-29T11:14:16.857688+0000","last_unstale":"2023-11-29T11:14:18.677092+0000","last_undegraded":"2023-11-29T11:14:18.677092+0000","last_fullsized":"2023-11-29T11:14:18.677092+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:57:27.484007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675157+0000","last_change":"2023-11-29T11:14:16.852649+0000","last_active":"2023-11-29T11:14:18.675157+0000","last_peered":"2023-11-29T11:14:18.675157+0000","last_clean":"2023-11-29T11:14:18.675157+0000","last_became_active":"2023-11-29T11:14:16.852389+0000","last_became_peered":"2023-11-29T11:14:16.852389+0000","last_unstale":"2023-11-29T11:14:18.675157+0000","last_undegraded":"2023-11-29T11:14:18.675157+0000","last_fullsized":"2023-11-29T11:14:18.675157+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:37:54.080050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846261+0000","last_change":"2023-11-29T11:14:16.853918+0000","last_active":"2023-11-29T11:14:17.846261+0000","last_peered":"2023-11-29T11:14:17.846261+0000","last_clean":"2023-11-29T11:14:17.846261+0000","last_became_active":"2023-11-29T11:14:16.853262+0000","last_became_peered":"2023-11-29T11:14:16.853262+0000","last_unstale":"2023-11-29T11:14:17.846261+0000","last_undegraded":"2023-11-29T11:14:17.846261+0000","last_fullsized":"2023-11-29T11:14:17.846261+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:14.282211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675117+0000","last_change":"2023-11-29T11:14:16.862151+0000","last_active":"2023-11-29T11:14:18.675117+0000","last_peered":"2023-11-29T11:14:18.675117+0000","last_clean":"2023-11-29T11:14:18.675117+0000","last_became_active":"2023-11-29T11:14:16.861835+0000","last_became_peered":"2023-11-29T11:14:16.861835+0000","last_unstale":"2023-11-29T11:14:18.675117+0000","last_undegraded":"2023-11-29T11:14:18.675117+0000","last_fullsized":"2023-11-29T11:14:18.675117+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:42:29.000853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.848768+0000","last_change":"2023-11-29T11:14:16.851006+0000","last_active":"2023-11-29T11:14:17.848768+0000","last_peered":"2023-11-29T11:14:17.848768+0000","last_clean":"2023-11-29T11:14:17.848768+0000","last_became_active":"2023-11-29T11:14:16.850693+0000","last_became_peered":"2023-11-29T11:14:16.850693+0000","last_unstale":"2023-11-29T11:14:17.848768+0000","last_undegraded":"2023-11-29T11:14:17.848768+0000","last_fullsized":"2023-11-29T11:14:17.848768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:28:20.044997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.848291+0000","last_change":"2023-11-29T11:14:16.854535+0000","last_active":"2023-11-29T11:14:17.848291+0000","last_peered":"2023-11-29T11:14:17.848291+0000","last_clean":"2023-11-29T11:14:17.848291+0000","last_became_active":"2023-11-29T11:14:16.853307+0000","last_became_peered":"2023-11-29T11:14:16.853307+0000","last_unstale":"2023-11-29T11:14:17.848291+0000","last_undegraded":"2023-11-29T11:14:17.848291+0000","last_fullsized":"2023-11-29T11:14:17.848291+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:05:57.004891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674802+0000","last_change":"2023-11-29T11:14:16.864400+0000","last_active":"2023-11-29T11:14:18.674802+0000","last_peered":"2023-11-29T11:14:18.674802+0000","last_clean":"2023-11-29T11:14:18.674802+0000","last_became_active":"2023-11-29T11:14:16.863704+0000","last_became_peered":"2023-11-29T11:14:16.863704+0000","last_unstale":"2023-11-29T11:14:18.674802+0000","last_undegraded":"2023-11-29T11:14:18.674802+0000","last_fullsized":"2023-11-29T11:14:18.674802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:57:12.779259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.677452+0000","last_change":"2023-11-29T11:14:16.862268+0000","last_active":"2023-11-29T11:14:18.677452+0000","last_peered":"2023-11-29T11:14:18.677452+0000","last_clean":"2023-11-29T11:14:18.677452+0000","last_became_active":"2023-11-29T11:14:16.862017+0000","last_became_peered":"2023-11-29T11:14:16.862017+0000","last_unstale":"2023-11-29T11:14:18.677452+0000","last_undegraded":"2023-11-29T11:14:18.677452+0000","last_fullsized":"2023-11-29T11:14:18.677452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:22.962407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846264+0000","last_change":"2023-11-29T11:14:16.865966+0000","last_active":"2023-11-29T11:14:17.846264+0000","last_peered":"2023-11-29T11:14:17.846264+0000","last_clean":"2023-11-29T11:14:17.846264+0000","last_became_active":"2023-11-29T11:14:16.865712+0000","last_became_peered":"2023-11-29T11:14:16.865712+0000","last_unstale":"2023-11-29T11:14:17.846264+0000","last_undegraded":"2023-11-29T11:14:17.846264+0000","last_fullsized":"2023-11-29T11:14:17.846264+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:42:48.586305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675382+0000","last_change":"2023-11-29T11:14:16.868519+0000","last_active":"2023-11-29T11:14:18.675382+0000","last_peered":"2023-11-29T11:14:18.675382+0000","last_clean":"2023-11-29T11:14:18.675382+0000","last_became_active":"2023-11-29T11:14:16.868245+0000","last_became_peered":"2023-11-29T11:14:16.868245+0000","last_unstale":"2023-11-29T11:14:18.675382+0000","last_undegraded":"2023-11-29T11:14:18.675382+0000","last_fullsized":"2023-11-29T11:14:18.675382+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:34:03.354201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.673628+0000","last_change":"2023-11-29T11:14:16.866765+0000","last_active":"2023-11-29T11:14:18.673628+0000","last_peered":"2023-11-29T11:14:18.673628+0000","last_clean":"2023-11-29T11:14:18.673628+0000","last_became_active":"2023-11-29T11:14:16.866446+0000","last_became_peered":"2023-11-29T11:14:16.866446+0000","last_unstale":"2023-11-29T11:14:18.673628+0000","last_undegraded":"2023-11-29T11:14:18.673628+0000","last_fullsized":"2023-11-29T11:14:18.673628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:10:13.019075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.673628+0000","last_change":"2023-11-29T11:14:16.866507+0000","last_active":"2023-11-29T11:14:18.673628+0000","last_peered":"2023-11-29T11:14:18.673628+0000","last_clean":"2023-11-29T11:14:18.673628+0000","last_became_active":"2023-11-29T11:14:16.866188+0000","last_became_peered":"2023-11-29T11:14:16.866188+0000","last_unstale":"2023-11-29T11:14:18.673628+0000","last_undegraded":"2023-11-29T11:14:18.673628+0000","last_fullsized":"2023-11-29T11:14:18.673628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:45:15.653933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674539+0000","last_change":"2023-11-29T11:14:16.864759+0000","last_active":"2023-11-29T11:14:18.674539+0000","last_peered":"2023-11-29T11:14:18.674539+0000","last_clean":"2023-11-29T11:14:18.674539+0000","last_became_active":"2023-11-29T11:14:16.864463+0000","last_became_peered":"2023-11-29T11:14:16.864463+0000","last_unstale":"2023-11-29T11:14:18.674539+0000","last_undegraded":"2023-11-29T11:14:18.674539+0000","last_fullsized":"2023-11-29T11:14:18.674539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:31:19.773103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.677393+0000","last_change":"2023-11-29T11:14:16.857327+0000","last_active":"2023-11-29T11:14:18.677393+0000","last_peered":"2023-11-29T11:14:18.677393+0000","last_clean":"2023-11-29T11:14:18.677393+0000","last_became_active":"2023-11-29T11:14:16.857037+0000","last_became_peered":"2023-11-29T11:14:16.857037+0000","last_unstale":"2023-11-29T11:14:18.677393+0000","last_undegraded":"2023-11-29T11:14:18.677393+0000","last_fullsized":"2023-11-29T11:14:18.677393+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:54:36.584175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.848023+0000","last_change":"2023-11-29T11:14:16.852204+0000","last_active":"2023-11-29T11:14:17.848023+0000","last_peered":"2023-11-29T11:14:17.848023+0000","last_clean":"2023-11-29T11:14:17.848023+0000","last_became_active":"2023-11-29T11:14:16.851941+0000","last_became_peered":"2023-11-29T11:14:16.851941+0000","last_unstale":"2023-11-29T11:14:17.848023+0000","last_undegraded":"2023-11-29T11:14:17.848023+0000","last_fullsized":"2023-11-29T11:14:17.848023+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:51:47.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.847751+0000","last_change":"2023-11-29T11:14:16.858404+0000","last_active":"2023-11-29T11:14:17.847751+0000","last_peered":"2023-11-29T11:14:17.847751+0000","last_clean":"2023-11-29T11:14:17.847751+0000","last_became_active":"2023-11-29T11:14:16.858109+0000","last_became_peered":"2023-11-29T11:14:16.858109+0000","last_unstale":"2023-11-29T11:14:17.847751+0000","last_undegraded":"2023-11-29T11:14:17.847751+0000","last_fullsized":"2023-11-29T11:14:17.847751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:38:32.113901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.673841+0000","last_change":"2023-11-29T11:14:16.863923+0000","last_active":"2023-11-29T11:14:18.673841+0000","last_peered":"2023-11-29T11:14:18.673841+0000","last_clean":"2023-11-29T11:14:18.673841+0000","last_became_active":"2023-11-29T11:14:16.863622+0000","last_became_peered":"2023-11-29T11:14:16.863622+0000","last_unstale":"2023-11-29T11:14:18.673841+0000","last_undegraded":"2023-11-29T11:14:18.673841+0000","last_fullsized":"2023-11-29T11:14:18.673841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:57.095847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.847887+0000","last_change":"2023-11-29T11:14:16.864832+0000","last_active":"2023-11-29T11:14:17.847887+0000","last_peered":"2023-11-29T11:14:17.847887+0000","last_clean":"2023-11-29T11:14:17.847887+0000","last_became_active":"2023-11-29T11:14:16.864535+0000","last_became_peered":"2023-11-29T11:14:16.864535+0000","last_unstale":"2023-11-29T11:14:17.847887+0000","last_undegraded":"2023-11-29T11:14:17.847887+0000","last_fullsized":"2023-11-29T11:14:17.847887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:37:31.526256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846366+0000","last_change":"2023-11-29T11:14:16.854137+0000","last_active":"2023-11-29T11:14:17.846366+0000","last_peered":"2023-11-29T11:14:17.846366+0000","last_clean":"2023-11-29T11:14:17.846366+0000","last_became_active":"2023-11-29T11:14:16.853646+0000","last_became_peered":"2023-11-29T11:14:16.853646+0000","last_unstale":"2023-11-29T11:14:17.846366+0000","last_undegraded":"2023-11-29T11:14:17.846366+0000","last_fullsized":"2023-11-29T11:14:17.846366+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:34.145290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674883+0000","last_change":"2023-11-29T11:14:16.854649+0000","last_active":"2023-11-29T11:14:18.674883+0000","last_peered":"2023-11-29T11:14:18.674883+0000","last_clean":"2023-11-29T11:14:18.674883+0000","last_became_active":"2023-11-29T11:14:16.854401+0000","last_became_peered":"2023-11-29T11:14:16.854401+0000","last_unstale":"2023-11-29T11:14:18.674883+0000","last_undegraded":"2023-11-29T11:14:18.674883+0000","last_fullsized":"2023-11-29T11:14:18.674883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:36:33.973588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.676003+0000","last_change":"2023-11-29T11:14:16.849473+0000","last_active":"2023-11-29T11:14:18.676003+0000","last_peered":"2023-11-29T11:14:18.676003+0000","last_clean":"2023-11-29T11:14:18.676003+0000","last_became_active":"2023-11-29T11:14:16.849045+0000","last_became_peered":"2023-11-29T11:14:16.849045+0000","last_unstale":"2023-11-29T11:14:18.676003+0000","last_undegraded":"2023-11-29T11:14:18.676003+0000","last_fullsized":"2023-11-29T11:14:18.676003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:50.629068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.870576+0000","last_change":"2023-11-29T11:14:16.481671+0000","last_active":"2023-11-29T11:14:16.870576+0000","last_peered":"2023-11-29T11:14:16.870576+0000","last_clean":"2023-11-29T11:14:16.870576+0000","last_became_active":"2023-11-29T11:14:16.481394+0000","last_became_peered":"2023-11-29T11:14:16.481394+0000","last_unstale":"2023-11-29T11:14:16.870576+0000","last_undegraded":"2023-11-29T11:14:16.870576+0000","last_fullsized":"2023-11-29T11:14:16.870576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:15:26.855651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674206+0000","last_change":"2023-11-29T11:14:16.870185+0000","last_active":"2023-11-29T11:14:18.674206+0000","last_peered":"2023-11-29T11:14:18.674206+0000","last_clean":"2023-11-29T11:14:18.674206+0000","last_became_active":"2023-11-29T11:14:16.869885+0000","last_became_peered":"2023-11-29T11:14:16.869885+0000","last_unstale":"2023-11-29T11:14:18.674206+0000","last_undegraded":"2023-11-29T11:14:18.674206+0000","last_fullsized":"2023-11-29T11:14:18.674206+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:49:00.946783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.865523+0000","last_change":"2023-11-29T11:14:16.480964+0000","last_active":"2023-11-29T11:14:16.865523+0000","last_peered":"2023-11-29T11:14:16.865523+0000","last_clean":"2023-11-29T11:14:16.865523+0000","last_became_active":"2023-11-29T11:14:16.479771+0000","last_became_peered":"2023-11-29T11:14:16.479771+0000","last_unstale":"2023-11-29T11:14:16.865523+0000","last_undegraded":"2023-11-29T11:14:16.865523+0000","last_fullsized":"2023-11-29T11:14:16.865523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:13.211183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.847845+0000","last_change":"2023-11-29T11:14:16.852205+0000","last_active":"2023-11-29T11:14:17.847845+0000","last_peered":"2023-11-29T11:14:17.847845+0000","last_clean":"2023-11-29T11:14:17.847845+0000","last_became_active":"2023-11-29T11:14:16.851897+0000","last_became_peered":"2023-11-29T11:14:16.851897+0000","last_unstale":"2023-11-29T11:14:17.847845+0000","last_undegraded":"2023-11-29T11:14:17.847845+0000","last_fullsized":"2023-11-29T11:14:17.847845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:30:22.603973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.852668+0000","last_change":"2023-11-29T11:14:16.484116+0000","last_active":"2023-11-29T11:14:16.852668+0000","last_peered":"2023-11-29T11:14:16.852668+0000","last_clean":"2023-11-29T11:14:16.852668+0000","last_became_active":"2023-11-29T11:14:16.483821+0000","last_became_peered":"2023-11-29T11:14:16.483821+0000","last_unstale":"2023-11-29T11:14:16.852668+0000","last_undegraded":"2023-11-29T11:14:16.852668+0000","last_fullsized":"2023-11-29T11:14:16.852668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675036+0000","last_change":"2023-11-29T11:14:16.871382+0000","last_active":"2023-11-29T11:14:18.675036+0000","last_peered":"2023-11-29T11:14:18.675036+0000","last_clean":"2023-11-29T11:14:18.675036+0000","last_became_active":"2023-11-29T11:14:16.871124+0000","last_became_peered":"2023-11-29T11:14:16.871124+0000","last_unstale":"2023-11-29T11:14:18.675036+0000","last_undegraded":"2023-11-29T11:14:18.675036+0000","last_fullsized":"2023-11-29T11:14:18.675036+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:24:48.526556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.863582+0000","last_change":"2023-11-29T11:14:16.481031+0000","last_active":"2023-11-29T11:14:16.863582+0000","last_peered":"2023-11-29T11:14:16.863582+0000","last_clean":"2023-11-29T11:14:16.863582+0000","last_became_active":"2023-11-29T11:14:16.480755+0000","last_became_peered":"2023-11-29T11:14:16.480755+0000","last_unstale":"2023-11-29T11:14:16.863582+0000","last_undegraded":"2023-11-29T11:14:16.863582+0000","last_fullsized":"2023-11-29T11:14:16.863582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.848173+0000","last_change":"2023-11-29T11:14:16.868854+0000","last_active":"2023-11-29T11:14:17.848173+0000","last_peered":"2023-11-29T11:14:17.848173+0000","last_clean":"2023-11-29T11:14:17.848173+0000","last_became_active":"2023-11-29T11:14:16.868465+0000","last_became_peered":"2023-11-29T11:14:16.868465+0000","last_unstale":"2023-11-29T11:14:17.848173+0000","last_undegraded":"2023-11-29T11:14:17.848173+0000","last_fullsized":"2023-11-29T11:14:17.848173+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:32:01.064587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.848975+0000","last_change":"2023-11-29T11:14:16.478417+0000","last_active":"2023-11-29T11:14:16.848975+0000","last_peered":"2023-11-29T11:14:16.848975+0000","last_clean":"2023-11-29T11:14:16.848975+0000","last_became_active":"2023-11-29T11:14:16.478127+0000","last_became_peered":"2023-11-29T11:14:16.478127+0000","last_unstale":"2023-11-29T11:14:16.848975+0000","last_undegraded":"2023-11-29T11:14:16.848975+0000","last_fullsized":"2023-11-29T11:14:16.848975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:34:02.343134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675772+0000","last_change":"2023-11-29T11:14:16.861541+0000","last_active":"2023-11-29T11:14:18.675772+0000","last_peered":"2023-11-29T11:14:18.675772+0000","last_clean":"2023-11-29T11:14:18.675772+0000","last_became_active":"2023-11-29T11:14:16.861275+0000","last_became_peered":"2023-11-29T11:14:16.861275+0000","last_unstale":"2023-11-29T11:14:18.675772+0000","last_undegraded":"2023-11-29T11:14:18.675772+0000","last_fullsized":"2023-11-29T11:14:18.675772+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:08:27.506968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.850373+0000","last_change":"2023-11-29T11:14:16.487132+0000","last_active":"2023-11-29T11:14:16.850373+0000","last_peered":"2023-11-29T11:14:16.850373+0000","last_clean":"2023-11-29T11:14:16.850373+0000","last_became_active":"2023-11-29T11:14:16.486873+0000","last_became_peered":"2023-11-29T11:14:16.486873+0000","last_unstale":"2023-11-29T11:14:16.850373+0000","last_undegraded":"2023-11-29T11:14:16.850373+0000","last_fullsized":"2023-11-29T11:14:16.850373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:33.134223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674389+0000","last_change":"2023-11-29T11:14:16.846266+0000","last_active":"2023-11-29T11:14:18.674389+0000","last_peered":"2023-11-29T11:14:18.674389+0000","last_clean":"2023-11-29T11:14:18.674389+0000","last_became_active":"2023-11-29T11:14:16.845896+0000","last_became_peered":"2023-11-29T11:14:16.845896+0000","last_unstale":"2023-11-29T11:14:18.674389+0000","last_undegraded":"2023-11-29T11:14:18.674389+0000","last_fullsized":"2023-11-29T11:14:18.674389+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:14.222250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.844642+0000","last_change":"2023-11-29T11:14:16.483331+0000","last_active":"2023-11-29T11:14:16.844642+0000","last_peered":"2023-11-29T11:14:16.844642+0000","last_clean":"2023-11-29T11:14:16.844642+0000","last_became_active":"2023-11-29T11:14:16.483014+0000","last_became_peered":"2023-11-29T11:14:16.483014+0000","last_unstale":"2023-11-29T11:14:16.844642+0000","last_undegraded":"2023-11-29T11:14:16.844642+0000","last_fullsized":"2023-11-29T11:14:16.844642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:31:18.762036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.673501+0000","last_change":"2023-11-29T11:14:16.867308+0000","last_active":"2023-11-29T11:14:18.673501+0000","last_peered":"2023-11-29T11:14:18.673501+0000","last_clean":"2023-11-29T11:14:18.673501+0000","last_became_active":"2023-11-29T11:14:16.867033+0000","last_became_peered":"2023-11-29T11:14:16.867033+0000","last_unstale":"2023-11-29T11:14:18.673501+0000","last_undegraded":"2023-11-29T11:14:18.673501+0000","last_fullsized":"2023-11-29T11:14:18.673501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:33:16.004847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.840511+0000","last_change":"2023-11-29T11:14:16.486835+0000","last_active":"2023-11-29T11:14:16.840511+0000","last_peered":"2023-11-29T11:14:16.840511+0000","last_clean":"2023-11-29T11:14:16.840511+0000","last_became_active":"2023-11-29T11:14:16.486603+0000","last_became_peered":"2023-11-29T11:14:16.486603+0000","last_unstale":"2023-11-29T11:14:16.840511+0000","last_undegraded":"2023-11-29T11:14:16.840511+0000","last_fullsized":"2023-11-29T11:14:16.840511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:52:49.618002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.848432+0000","last_change":"2023-11-29T11:14:16.854090+0000","last_active":"2023-11-29T11:14:17.848432+0000","last_peered":"2023-11-29T11:14:17.848432+0000","last_clean":"2023-11-29T11:14:17.848432+0000","last_became_active":"2023-11-29T11:14:16.853771+0000","last_became_peered":"2023-11-29T11:14:16.853771+0000","last_unstale":"2023-11-29T11:14:17.848432+0000","last_undegraded":"2023-11-29T11:14:17.848432+0000","last_fullsized":"2023-11-29T11:14:17.848432+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:38:35.078015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.838865+0000","last_change":"2023-11-29T11:14:16.482545+0000","last_active":"2023-11-29T11:14:16.838865+0000","last_peered":"2023-11-29T11:14:16.838865+0000","last_clean":"2023-11-29T11:14:16.838865+0000","last_became_active":"2023-11-29T11:14:16.482251+0000","last_became_peered":"2023-11-29T11:14:16.482251+0000","last_unstale":"2023-11-29T11:14:16.838865+0000","last_undegraded":"2023-11-29T11:14:16.838865+0000","last_fullsized":"2023-11-29T11:14:16.838865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:42:47.575238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675901+0000","last_change":"2023-11-29T11:14:16.866491+0000","last_active":"2023-11-29T11:14:18.675901+0000","last_peered":"2023-11-29T11:14:18.675901+0000","last_clean":"2023-11-29T11:14:18.675901+0000","last_became_active":"2023-11-29T11:14:16.866220+0000","last_became_peered":"2023-11-29T11:14:16.866220+0000","last_unstale":"2023-11-29T11:14:18.675901+0000","last_undegraded":"2023-11-29T11:14:18.675901+0000","last_fullsized":"2023-11-29T11:14:18.675901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:13:12.894242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.843253+0000","last_change":"2023-11-29T11:14:16.482726+0000","last_active":"2023-11-29T11:14:16.843253+0000","last_peered":"2023-11-29T11:14:16.843253+0000","last_clean":"2023-11-29T11:14:16.843253+0000","last_became_active":"2023-11-29T11:14:16.482483+0000","last_became_peered":"2023-11-29T11:14:16.482483+0000","last_unstale":"2023-11-29T11:14:16.843253+0000","last_undegraded":"2023-11-29T11:14:16.843253+0000","last_fullsized":"2023-11-29T11:14:16.843253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:56.104602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846465+0000","last_change":"2023-11-29T11:14:16.858863+0000","last_active":"2023-11-29T11:14:17.846465+0000","last_peered":"2023-11-29T11:14:17.846465+0000","last_clean":"2023-11-29T11:14:17.846465+0000","last_became_active":"2023-11-29T11:14:16.858630+0000","last_became_peered":"2023-11-29T11:14:16.858630+0000","last_unstale":"2023-11-29T11:14:17.846465+0000","last_undegraded":"2023-11-29T11:14:17.846465+0000","last_fullsized":"2023-11-29T11:14:17.846465+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:55:51.562664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.870976+0000","last_change":"2023-11-29T11:14:16.484109+0000","last_active":"2023-11-29T11:14:16.870976+0000","last_peered":"2023-11-29T11:14:16.870976+0000","last_clean":"2023-11-29T11:14:16.870976+0000","last_became_active":"2023-11-29T11:14:16.483470+0000","last_became_peered":"2023-11-29T11:14:16.483470+0000","last_unstale":"2023-11-29T11:14:16.870976+0000","last_undegraded":"2023-11-29T11:14:16.870976+0000","last_fullsized":"2023-11-29T11:14:16.870976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675327+0000","last_change":"2023-11-29T11:14:16.864350+0000","last_active":"2023-11-29T11:14:18.675327+0000","last_peered":"2023-11-29T11:14:18.675327+0000","last_clean":"2023-11-29T11:14:18.675327+0000","last_became_active":"2023-11-29T11:14:16.863606+0000","last_became_peered":"2023-11-29T11:14:16.863606+0000","last_unstale":"2023-11-29T11:14:18.675327+0000","last_undegraded":"2023-11-29T11:14:18.675327+0000","last_fullsized":"2023-11-29T11:14:18.675327+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:05:04.964783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.870921+0000","last_change":"2023-11-29T11:14:16.487937+0000","last_active":"2023-11-29T11:14:16.870921+0000","last_peered":"2023-11-29T11:14:16.870921+0000","last_clean":"2023-11-29T11:14:16.870921+0000","last_became_active":"2023-11-29T11:14:16.487652+0000","last_became_peered":"2023-11-29T11:14:16.487652+0000","last_unstale":"2023-11-29T11:14:16.870921+0000","last_undegraded":"2023-11-29T11:14:16.870921+0000","last_fullsized":"2023-11-29T11:14:16.870921+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:07.505515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674333+0000","last_change":"2023-11-29T11:14:16.864617+0000","last_active":"2023-11-29T11:14:18.674333+0000","last_peered":"2023-11-29T11:14:18.674333+0000","last_clean":"2023-11-29T11:14:18.674333+0000","last_became_active":"2023-11-29T11:14:16.863563+0000","last_became_peered":"2023-11-29T11:14:16.863563+0000","last_unstale":"2023-11-29T11:14:18.674333+0000","last_undegraded":"2023-11-29T11:14:18.674333+0000","last_fullsized":"2023-11-29T11:14:18.674333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:48.299498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.862791+0000","last_change":"2023-11-29T11:14:16.484535+0000","last_active":"2023-11-29T11:14:16.862791+0000","last_peered":"2023-11-29T11:14:16.862791+0000","last_clean":"2023-11-29T11:14:16.862791+0000","last_became_active":"2023-11-29T11:14:16.484001+0000","last_became_peered":"2023-11-29T11:14:16.484001+0000","last_unstale":"2023-11-29T11:14:16.862791+0000","last_undegraded":"2023-11-29T11:14:16.862791+0000","last_fullsized":"2023-11-29T11:14:16.862791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:02:20.714555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675654+0000","last_change":"2023-11-29T11:14:16.865179+0000","last_active":"2023-11-29T11:14:18.675654+0000","last_peered":"2023-11-29T11:14:18.675654+0000","last_clean":"2023-11-29T11:14:18.675654+0000","last_became_active":"2023-11-29T11:14:16.864868+0000","last_became_peered":"2023-11-29T11:14:16.864868+0000","last_unstale":"2023-11-29T11:14:18.675654+0000","last_undegraded":"2023-11-29T11:14:18.675654+0000","last_fullsized":"2023-11-29T11:14:18.675654+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:14:20.393997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.855924+0000","last_change":"2023-11-29T11:14:16.481779+0000","last_active":"2023-11-29T11:14:16.855924+0000","last_peered":"2023-11-29T11:14:16.855924+0000","last_clean":"2023-11-29T11:14:16.855924+0000","last_became_active":"2023-11-29T11:14:16.481469+0000","last_became_peered":"2023-11-29T11:14:16.481469+0000","last_unstale":"2023-11-29T11:14:16.855924+0000","last_undegraded":"2023-11-29T11:14:16.855924+0000","last_fullsized":"2023-11-29T11:14:16.855924+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:22:41.130861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846264+0000","last_change":"2023-11-29T11:14:16.857006+0000","last_active":"2023-11-29T11:14:17.846264+0000","last_peered":"2023-11-29T11:14:17.846264+0000","last_clean":"2023-11-29T11:14:17.846264+0000","last_became_active":"2023-11-29T11:14:16.856754+0000","last_became_peered":"2023-11-29T11:14:16.856754+0000","last_unstale":"2023-11-29T11:14:17.846264+0000","last_undegraded":"2023-11-29T11:14:17.846264+0000","last_fullsized":"2023-11-29T11:14:17.846264+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:34:25.745711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.833215+0000","last_change":"2023-11-29T11:14:16.483736+0000","last_active":"2023-11-29T11:14:16.833215+0000","last_peered":"2023-11-29T11:14:16.833215+0000","last_clean":"2023-11-29T11:14:16.833215+0000","last_became_active":"2023-11-29T11:14:16.483258+0000","last_became_peered":"2023-11-29T11:14:16.483258+0000","last_unstale":"2023-11-29T11:14:16.833215+0000","last_undegraded":"2023-11-29T11:14:16.833215+0000","last_fullsized":"2023-11-29T11:14:16.833215+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:05:03.953716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674862+0000","last_change":"2023-11-29T11:14:16.870745+0000","last_active":"2023-11-29T11:14:18.674862+0000","last_peered":"2023-11-29T11:14:18.674862+0000","last_clean":"2023-11-29T11:14:18.674862+0000","last_became_active":"2023-11-29T11:14:16.870465+0000","last_became_peered":"2023-11-29T11:14:16.870465+0000","last_unstale":"2023-11-29T11:14:18.674862+0000","last_undegraded":"2023-11-29T11:14:18.674862+0000","last_fullsized":"2023-11-29T11:14:18.674862+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:24:29.755736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.862119+0000","last_change":"2023-11-29T11:14:16.481257+0000","last_active":"2023-11-29T11:14:16.862119+0000","last_peered":"2023-11-29T11:14:16.862119+0000","last_clean":"2023-11-29T11:14:16.862119+0000","last_became_active":"2023-11-29T11:14:16.481005+0000","last_became_peered":"2023-11-29T11:14:16.481005+0000","last_unstale":"2023-11-29T11:14:16.862119+0000","last_undegraded":"2023-11-29T11:14:16.862119+0000","last_fullsized":"2023-11-29T11:14:16.862119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.677297+0000","last_change":"2023-11-29T11:14:16.857651+0000","last_active":"2023-11-29T11:14:18.677297+0000","last_peered":"2023-11-29T11:14:18.677297+0000","last_clean":"2023-11-29T11:14:18.677297+0000","last_became_active":"2023-11-29T11:14:16.857391+0000","last_became_peered":"2023-11-29T11:14:16.857391+0000","last_unstale":"2023-11-29T11:14:18.677297+0000","last_undegraded":"2023-11-29T11:14:18.677297+0000","last_fullsized":"2023-11-29T11:14:18.677297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:12:15.841595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.860727+0000","last_change":"2023-11-29T11:14:16.482480+0000","last_active":"2023-11-29T11:14:16.860727+0000","last_peered":"2023-11-29T11:14:16.860727+0000","last_clean":"2023-11-29T11:14:16.860727+0000","last_became_active":"2023-11-29T11:14:16.482219+0000","last_became_peered":"2023-11-29T11:14:16.482219+0000","last_unstale":"2023-11-29T11:14:16.860727+0000","last_undegraded":"2023-11-29T11:14:16.860727+0000","last_fullsized":"2023-11-29T11:14:16.860727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:01:09.293879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.677936+0000","last_change":"2023-11-29T11:14:16.851733+0000","last_active":"2023-11-29T11:14:18.677936+0000","last_peered":"2023-11-29T11:14:18.677936+0000","last_clean":"2023-11-29T11:14:18.677936+0000","last_became_active":"2023-11-29T11:14:16.851395+0000","last_became_peered":"2023-11-29T11:14:16.851395+0000","last_unstale":"2023-11-29T11:14:18.677936+0000","last_undegraded":"2023-11-29T11:14:18.677936+0000","last_fullsized":"2023-11-29T11:14:18.677936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:01:07.787017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.853586+0000","last_change":"2023-11-29T11:14:16.487030+0000","last_active":"2023-11-29T11:14:16.853586+0000","last_peered":"2023-11-29T11:14:16.853586+0000","last_clean":"2023-11-29T11:14:16.853586+0000","last_became_active":"2023-11-29T11:14:16.486730+0000","last_became_peered":"2023-11-29T11:14:16.486730+0000","last_unstale":"2023-11-29T11:14:16.853586+0000","last_undegraded":"2023-11-29T11:14:16.853586+0000","last_fullsized":"2023-11-29T11:14:16.853586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:19.727568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.673931+0000","last_change":"2023-11-29T11:14:16.866156+0000","last_active":"2023-11-29T11:14:18.673931+0000","last_peered":"2023-11-29T11:14:18.673931+0000","last_clean":"2023-11-29T11:14:18.673931+0000","last_became_active":"2023-11-29T11:14:16.865331+0000","last_became_peered":"2023-11-29T11:14:16.865331+0000","last_unstale":"2023-11-29T11:14:18.673931+0000","last_undegraded":"2023-11-29T11:14:18.673931+0000","last_fullsized":"2023-11-29T11:14:18.673931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:28:38.806947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.852841+0000","last_change":"2023-11-29T11:14:16.483581+0000","last_active":"2023-11-29T11:14:16.852841+0000","last_peered":"2023-11-29T11:14:16.852841+0000","last_clean":"2023-11-29T11:14:16.852841+0000","last_became_active":"2023-11-29T11:14:16.483000+0000","last_became_peered":"2023-11-29T11:14:16.483000+0000","last_unstale":"2023-11-29T11:14:16.852841+0000","last_undegraded":"2023-11-29T11:14:16.852841+0000","last_fullsized":"2023-11-29T11:14:16.852841+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:20:29.370775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674434+0000","last_change":"2023-11-29T11:14:16.870405+0000","last_active":"2023-11-29T11:14:18.674434+0000","last_peered":"2023-11-29T11:14:18.674434+0000","last_clean":"2023-11-29T11:14:18.674434+0000","last_became_active":"2023-11-29T11:14:16.868042+0000","last_became_peered":"2023-11-29T11:14:16.868042+0000","last_unstale":"2023-11-29T11:14:18.674434+0000","last_undegraded":"2023-11-29T11:14:18.674434+0000","last_fullsized":"2023-11-29T11:14:18.674434+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:20:30.381841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.833685+0000","last_change":"2023-11-29T11:14:16.481532+0000","last_active":"2023-11-29T11:14:16.833685+0000","last_peered":"2023-11-29T11:14:16.833685+0000","last_clean":"2023-11-29T11:14:16.833685+0000","last_became_active":"2023-11-29T11:14:16.481207+0000","last_became_peered":"2023-11-29T11:14:16.481207+0000","last_unstale":"2023-11-29T11:14:16.833685+0000","last_undegraded":"2023-11-29T11:14:16.833685+0000","last_fullsized":"2023-11-29T11:14:16.833685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:01:31.133742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846496+0000","last_change":"2023-11-29T11:14:16.858006+0000","last_active":"2023-11-29T11:14:17.846496+0000","last_peered":"2023-11-29T11:14:17.846496+0000","last_clean":"2023-11-29T11:14:17.846496+0000","last_became_active":"2023-11-29T11:14:16.857752+0000","last_became_peered":"2023-11-29T11:14:16.857752+0000","last_unstale":"2023-11-29T11:14:17.846496+0000","last_undegraded":"2023-11-29T11:14:17.846496+0000","last_fullsized":"2023-11-29T11:14:17.846496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:08:27.506968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.851979+0000","last_change":"2023-11-29T11:14:16.478355+0000","last_active":"2023-11-29T11:14:16.851979+0000","last_peered":"2023-11-29T11:14:16.851979+0000","last_clean":"2023-11-29T11:14:16.851979+0000","last_became_active":"2023-11-29T11:14:16.478080+0000","last_became_peered":"2023-11-29T11:14:16.478080+0000","last_unstale":"2023-11-29T11:14:16.851979+0000","last_undegraded":"2023-11-29T11:14:16.851979+0000","last_fullsized":"2023-11-29T11:14:16.851979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:13:11.883176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675630+0000","last_change":"2023-11-29T11:14:16.852128+0000","last_active":"2023-11-29T11:14:18.675630+0000","last_peered":"2023-11-29T11:14:18.675630+0000","last_clean":"2023-11-29T11:14:18.675630+0000","last_became_active":"2023-11-29T11:14:16.851873+0000","last_became_peered":"2023-11-29T11:14:16.851873+0000","last_unstale":"2023-11-29T11:14:18.675630+0000","last_undegraded":"2023-11-29T11:14:18.675630+0000","last_fullsized":"2023-11-29T11:14:18.675630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:16:15.630717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.844267+0000","last_change":"2023-11-29T11:14:16.477186+0000","last_active":"2023-11-29T11:14:16.844267+0000","last_peered":"2023-11-29T11:14:16.844267+0000","last_clean":"2023-11-29T11:14:16.844267+0000","last_became_active":"2023-11-29T11:14:16.476905+0000","last_became_peered":"2023-11-29T11:14:16.476905+0000","last_unstale":"2023-11-29T11:14:16.844267+0000","last_undegraded":"2023-11-29T11:14:16.844267+0000","last_fullsized":"2023-11-29T11:14:16.844267+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:10:12.008008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675115+0000","last_change":"2023-11-29T11:14:16.865097+0000","last_active":"2023-11-29T11:14:18.675115+0000","last_peered":"2023-11-29T11:14:18.675115+0000","last_clean":"2023-11-29T11:14:18.675115+0000","last_became_active":"2023-11-29T11:14:16.864816+0000","last_became_peered":"2023-11-29T11:14:16.864816+0000","last_unstale":"2023-11-29T11:14:18.675115+0000","last_undegraded":"2023-11-29T11:14:18.675115+0000","last_fullsized":"2023-11-29T11:14:18.675115+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:12:46.207324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.840605+0000","last_change":"2023-11-29T11:14:16.480498+0000","last_active":"2023-11-29T11:14:16.840605+0000","last_peered":"2023-11-29T11:14:16.840605+0000","last_clean":"2023-11-29T11:14:16.840605+0000","last_became_active":"2023-11-29T11:14:16.480224+0000","last_became_peered":"2023-11-29T11:14:16.480224+0000","last_unstale":"2023-11-29T11:14:16.840605+0000","last_undegraded":"2023-11-29T11:14:16.840605+0000","last_fullsized":"2023-11-29T11:14:16.840605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674351+0000","last_change":"2023-11-29T11:14:16.849078+0000","last_active":"2023-11-29T11:14:18.674351+0000","last_peered":"2023-11-29T11:14:18.674351+0000","last_clean":"2023-11-29T11:14:18.674351+0000","last_became_active":"2023-11-29T11:14:16.847670+0000","last_became_peered":"2023-11-29T11:14:16.847670+0000","last_unstale":"2023-11-29T11:14:18.674351+0000","last_undegraded":"2023-11-29T11:14:18.674351+0000","last_fullsized":"2023-11-29T11:14:18.674351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:21:54.084097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.855474+0000","last_change":"2023-11-29T11:14:16.483410+0000","last_active":"2023-11-29T11:14:16.855474+0000","last_peered":"2023-11-29T11:14:16.855474+0000","last_clean":"2023-11-29T11:14:16.855474+0000","last_became_active":"2023-11-29T11:14:16.483126+0000","last_became_peered":"2023-11-29T11:14:16.483126+0000","last_unstale":"2023-11-29T11:14:16.855474+0000","last_undegraded":"2023-11-29T11:14:16.855474+0000","last_fullsized":"2023-11-29T11:14:16.855474+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:19:18.864235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.847928+0000","last_change":"2023-11-29T11:14:16.848719+0000","last_active":"2023-11-29T11:14:17.847928+0000","last_peered":"2023-11-29T11:14:17.847928+0000","last_clean":"2023-11-29T11:14:17.847928+0000","last_became_active":"2023-11-29T11:14:16.848333+0000","last_became_peered":"2023-11-29T11:14:16.848333+0000","last_unstale":"2023-11-29T11:14:17.847928+0000","last_undegraded":"2023-11-29T11:14:17.847928+0000","last_fullsized":"2023-11-29T11:14:17.847928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:01:35.821429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.840834+0000","last_change":"2023-11-29T11:14:16.480800+0000","last_active":"2023-11-29T11:14:16.840834+0000","last_peered":"2023-11-29T11:14:16.840834+0000","last_clean":"2023-11-29T11:14:16.840834+0000","last_became_active":"2023-11-29T11:14:16.479787+0000","last_became_peered":"2023-11-29T11:14:16.479787+0000","last_unstale":"2023-11-29T11:14:16.840834+0000","last_undegraded":"2023-11-29T11:14:16.840834+0000","last_fullsized":"2023-11-29T11:14:16.840834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:16:08.796653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.852951+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:14:16.852951+0000","last_peered":"2023-11-29T11:14:16.852951+0000","last_clean":"2023-11-29T11:14:16.852951+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:14:16.852951+0000","last_undegraded":"2023-11-29T11:14:16.852951+0000","last_fullsized":"2023-11-29T11:14:16.852951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.847449+0000","last_change":"2023-11-29T11:14:16.849917+0000","last_active":"2023-11-29T11:14:17.847449+0000","last_peered":"2023-11-29T11:14:17.847449+0000","last_clean":"2023-11-29T11:14:17.847449+0000","last_became_active":"2023-11-29T11:14:16.849590+0000","last_became_peered":"2023-11-29T11:14:16.849590+0000","last_unstale":"2023-11-29T11:14:17.847449+0000","last_undegraded":"2023-11-29T11:14:17.847449+0000","last_fullsized":"2023-11-29T11:14:17.847449+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:49:51.747054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.839265+0000","last_change":"2023-11-29T11:14:16.483879+0000","last_active":"2023-11-29T11:14:16.839265+0000","last_peered":"2023-11-29T11:14:16.839265+0000","last_clean":"2023-11-29T11:14:16.839265+0000","last_became_active":"2023-11-29T11:14:16.483525+0000","last_became_peered":"2023-11-29T11:14:16.483525+0000","last_unstale":"2023-11-29T11:14:16.839265+0000","last_undegraded":"2023-11-29T11:14:16.839265+0000","last_fullsized":"2023-11-29T11:14:16.839265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:12:45.196257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.852782+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:14:16.852782+0000","last_peered":"2023-11-29T11:14:16.852782+0000","last_clean":"2023-11-29T11:14:16.852782+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:14:16.852782+0000","last_undegraded":"2023-11-29T11:14:16.852782+0000","last_fullsized":"2023-11-29T11:14:16.852782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846349+0000","last_change":"2023-11-29T11:14:16.856925+0000","last_active":"2023-11-29T11:14:17.846349+0000","last_peered":"2023-11-29T11:14:17.846349+0000","last_clean":"2023-11-29T11:14:17.846349+0000","last_became_active":"2023-11-29T11:14:16.856647+0000","last_became_peered":"2023-11-29T11:14:16.856647+0000","last_unstale":"2023-11-29T11:14:17.846349+0000","last_undegraded":"2023-11-29T11:14:17.846349+0000","last_fullsized":"2023-11-29T11:14:17.846349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:56:17.711491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.839109+0000","last_change":"2023-11-29T11:14:16.486756+0000","last_active":"2023-11-29T11:14:16.839109+0000","last_peered":"2023-11-29T11:14:16.839109+0000","last_clean":"2023-11-29T11:14:16.839109+0000","last_became_active":"2023-11-29T11:14:16.485165+0000","last_became_peered":"2023-11-29T11:14:16.485165+0000","last_unstale":"2023-11-29T11:14:16.839109+0000","last_undegraded":"2023-11-29T11:14:16.839109+0000","last_fullsized":"2023-11-29T11:14:16.839109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:35:52.464556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.840213+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:14:16.840213+0000","last_peered":"2023-11-29T11:14:16.840213+0000","last_clean":"2023-11-29T11:14:16.840213+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:14:16.840213+0000","last_undegraded":"2023-11-29T11:14:16.840213+0000","last_fullsized":"2023-11-29T11:14:16.840213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.846569+0000","last_change":"2023-11-29T11:14:16.848385+0000","last_active":"2023-11-29T11:14:17.846569+0000","last_peered":"2023-11-29T11:14:17.846569+0000","last_clean":"2023-11-29T11:14:17.846569+0000","last_became_active":"2023-11-29T11:14:16.848135+0000","last_became_peered":"2023-11-29T11:14:16.848135+0000","last_unstale":"2023-11-29T11:14:17.846569+0000","last_undegraded":"2023-11-29T11:14:17.846569+0000","last_fullsized":"2023-11-29T11:14:17.846569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:44:18.825003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.856213+0000","last_change":"2023-11-29T11:14:16.484817+0000","last_active":"2023-11-29T11:14:16.856213+0000","last_peered":"2023-11-29T11:14:16.856213+0000","last_clean":"2023-11-29T11:14:16.856213+0000","last_became_active":"2023-11-29T11:14:16.484513+0000","last_became_peered":"2023-11-29T11:14:16.484513+0000","last_unstale":"2023-11-29T11:14:16.856213+0000","last_undegraded":"2023-11-29T11:14:16.856213+0000","last_fullsized":"2023-11-29T11:14:16.856213+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:51:46.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.833775+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:14:16.833775+0000","last_peered":"2023-11-29T11:14:16.833775+0000","last_clean":"2023-11-29T11:14:16.833775+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:14:16.833775+0000","last_undegraded":"2023-11-29T11:14:16.833775+0000","last_fullsized":"2023-11-29T11:14:16.833775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.675595+0000","last_change":"2023-11-29T11:14:16.864909+0000","last_active":"2023-11-29T11:14:18.675595+0000","last_peered":"2023-11-29T11:14:18.675595+0000","last_clean":"2023-11-29T11:14:18.675595+0000","last_became_active":"2023-11-29T11:14:16.863798+0000","last_became_peered":"2023-11-29T11:14:16.863798+0000","last_unstale":"2023-11-29T11:14:18.675595+0000","last_undegraded":"2023-11-29T11:14:18.675595+0000","last_fullsized":"2023-11-29T11:14:18.675595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:02:21.725622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.839536+0000","last_change":"2023-11-29T11:14:16.483999+0000","last_active":"2023-11-29T11:14:16.839536+0000","last_peered":"2023-11-29T11:14:16.839536+0000","last_clean":"2023-11-29T11:14:16.839536+0000","last_became_active":"2023-11-29T11:14:16.483610+0000","last_became_peered":"2023-11-29T11:14:16.483610+0000","last_unstale":"2023-11-29T11:14:16.839536+0000","last_undegraded":"2023-11-29T11:14:16.839536+0000","last_fullsized":"2023-11-29T11:14:16.839536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":180,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.855374+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:14:16.855374+0000","last_peered":"2023-11-29T11:14:16.855374+0000","last_clean":"2023-11-29T11:14:16.855374+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:14:16.855374+0000","last_undegraded":"2023-11-29T11:14:16.855374+0000","last_fullsized":"2023-11-29T11:14:16.855374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.839694+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:14:16.839694+0000","last_peered":"2023-11-29T11:14:16.839694+0000","last_clean":"2023-11-29T11:14:16.839694+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:14:16.839694+0000","last_undegraded":"2023-11-29T11:14:16.839694+0000","last_fullsized":"2023-11-29T11:14:16.839694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.676555+0000","last_change":"2023-11-29T11:14:16.852331+0000","last_active":"2023-11-29T11:14:18.676555+0000","last_peered":"2023-11-29T11:14:18.676555+0000","last_clean":"2023-11-29T11:14:18.676555+0000","last_became_active":"2023-11-29T11:14:16.852079+0000","last_became_peered":"2023-11-29T11:14:16.852079+0000","last_unstale":"2023-11-29T11:14:18.676555+0000","last_undegraded":"2023-11-29T11:14:18.676555+0000","last_fullsized":"2023-11-29T11:14:18.676555+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:55:51.562664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.858256+0000","last_change":"2023-11-29T11:14:16.484233+0000","last_active":"2023-11-29T11:14:16.858256+0000","last_peered":"2023-11-29T11:14:16.858256+0000","last_clean":"2023-11-29T11:14:16.858256+0000","last_became_active":"2023-11-29T11:14:16.483828+0000","last_became_peered":"2023-11-29T11:14:16.483828+0000","last_unstale":"2023-11-29T11:14:16.858256+0000","last_undegraded":"2023-11-29T11:14:16.858256+0000","last_fullsized":"2023-11-29T11:14:16.858256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:30:21.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.856004+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:14:16.856004+0000","last_peered":"2023-11-29T11:14:16.856004+0000","last_clean":"2023-11-29T11:14:16.856004+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:14:16.856004+0000","last_undegraded":"2023-11-29T11:14:16.856004+0000","last_fullsized":"2023-11-29T11:14:16.856004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.674294+0000","last_change":"2023-11-29T11:14:16.865925+0000","last_active":"2023-11-29T11:14:18.674294+0000","last_peered":"2023-11-29T11:14:18.674294+0000","last_clean":"2023-11-29T11:14:18.674294+0000","last_became_active":"2023-11-29T11:14:16.865522+0000","last_became_peered":"2023-11-29T11:14:16.865522+0000","last_unstale":"2023-11-29T11:14:18.674294+0000","last_undegraded":"2023-11-29T11:14:18.674294+0000","last_fullsized":"2023-11-29T11:14:18.674294+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:18:35.034199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:17.847114+0000","last_change":"2023-11-29T11:14:16.484671+0000","last_active":"2023-11-29T11:14:17.847114+0000","last_peered":"2023-11-29T11:14:17.847114+0000","last_clean":"2023-11-29T11:14:17.847114+0000","last_became_active":"2023-11-29T11:14:16.484377+0000","last_became_peered":"2023-11-29T11:14:16.484377+0000","last_unstale":"2023-11-29T11:14:17.847114+0000","last_undegraded":"2023-11-29T11:14:17.847114+0000","last_fullsized":"2023-11-29T11:14:17.847114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:44:40.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.844729+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:14:16.844729+0000","last_peered":"2023-11-29T11:14:16.844729+0000","last_clean":"2023-11-29T11:14:16.844729+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:14:16.844729+0000","last_undegraded":"2023-11-29T11:14:16.844729+0000","last_fullsized":"2023-11-29T11:14:16.844729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-29T11:14:18.677805+0000","last_change":"2023-11-29T11:14:16.864427+0000","last_active":"2023-11-29T11:14:18.677805+0000","last_peered":"2023-11-29T11:14:18.677805+0000","last_clean":"2023-11-29T11:14:18.677805+0000","last_became_active":"2023-11-29T11:14:16.864188+0000","last_became_peered":"2023-11-29T11:14:16.864188+0000","last_unstale":"2023-11-29T11:14:18.677805+0000","last_undegraded":"2023-11-29T11:14:18.677805+0000","last_fullsized":"2023-11-29T11:14:18.677805+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:16.446022+0000","last_clean_scrub_stamp":"2023-11-29T11:14:16.446022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:06:34.145290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.855157+0000","last_change":"2023-11-29T11:14:16.474840+0000","last_active":"2023-11-29T11:14:16.855157+0000","last_peered":"2023-11-29T11:14:16.855157+0000","last_clean":"2023-11-29T11:14:16.855157+0000","last_became_active":"2023-11-29T11:14:16.474465+0000","last_became_peered":"2023-11-29T11:14:16.474465+0000","last_unstale":"2023-11-29T11:14:16.855157+0000","last_undegraded":"2023-11-29T11:14:16.855157+0000","last_fullsized":"2023-11-29T11:14:16.855157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:14:15.434955+0000","last_clean_scrub_stamp":"2023-11-29T11:14:15.434955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:47.288431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T11:14:16.855546+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:14:16.855546+0000","last_peered":"2023-11-29T11:14:16.855546+0000","last_clean":"2023-11-29T11:14:16.855546+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:14:16.855546+0000","last_undegraded":"2023-11-29T11:14:16.855546+0000","last_fullsized":"2023-11-29T11:14:16.855546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9756,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362084,"statfs":{"total":96636764160,"available":96626774016,"internally_reserved":0,"allocated":1069056,"data_stored":802308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.89100000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.042}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.075},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.135}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8604,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363236,"statfs":{"total":96636764160,"available":96627953664,"internally_reserved":0,"allocated":479232,"data_stored":212506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.77900000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":1.105},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.97999999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.84099999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.879}]},{"osd":4,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0600000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.022},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0329999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8664,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363176,"statfs":{"total":96636764160,"available":96627892224,"internally_reserved":0,"allocated":475136,"data_stored":211920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.242},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.397}]},{"osd":1,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.367}]},{"osd":2,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.4330000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.294},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78700000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.494},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.89900000000000002}]},{"osd":7,"last update":"Wed Nov 29 11:13:46 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.335}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8736,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363104,"statfs":{"total":96636764160,"available":96627818496,"internally_reserved":0,"allocated":483328,"data_stored":213398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.1000000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.82699999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.73599999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.05}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8736,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363104,"statfs":{"total":96636764160,"available":96627818496,"internally_reserved":0,"allocated":483328,"data_stored":212472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.71099999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.93999999999999995}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.018},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.198}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.087}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.0489999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":487424,"data_stored":213420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73699999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.073},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.103},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.155}]},{"osd":7,"last update":"Wed Nov 29 11:13:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.038},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.016}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9756,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362084,"statfs":{"total":96636764160,"available":96626774016,"internally_reserved":0,"allocated":1069056,"data_stored":802288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.50900000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.024}]},{"osd":3,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.54900000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.091}]},{"osd":5,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.94299999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:13:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0620000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8724,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363116,"statfs":{"total":96636764160,"available":96627830784,"internally_reserved":0,"allocated":471040,"data_stored":210898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45700000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.497},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.145},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.125}]},{"osd":7,"last update":"Wed Nov 29 11:13:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.04}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:14:25.581 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-29T11:14:25.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-29T11:14:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f699f700 1 Processor -- start 2023-11-29T11:14:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f699f700 1 -- start start 2023-11-29T11:14:25.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f699f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f10f0150070 0x7f10f00ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f699f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f00cb510 0x7f10f00cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f699f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10f0159690 0x7f10f0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f699f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f00cec90 con 0x7f10f0159690 2023-11-29T11:14:25.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f699f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f015a3c0 con 0x7f10f0150070 2023-11-29T11:14:25.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f699f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00cdc70 con 0x7f10f00cb510 2023-11-29T11:14:25.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f619e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10f0159690 0x7f10f0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f619e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10f0159690 0x7f10f0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38622/0 (socket says 172.21.15.81:38622) 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f619e700 1 -- 172.21.15.81:0/4060457783 learned_addr learned my addr 172.21.15.81:0/4060457783 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f599d700 1 --2- 172.21.15.81:0/4060457783 >> v2:172.21.15.176:3300/0 conn(0x7f10f0150070 0x7f10f00ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f519c700 1 --2- 172.21.15.81:0/4060457783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f00cb510 0x7f10f00cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f619e700 1 -- 172.21.15.81:0/4060457783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f00cb510 msgr2=0x7f10f00cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f619e700 1 --2- 172.21.15.81:0/4060457783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f00cb510 0x7f10f00cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f619e700 1 -- 172.21.15.81:0/4060457783 >> v2:172.21.15.176:3300/0 conn(0x7f10f0150070 msgr2=0x7f10f00ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f619e700 1 --2- 172.21.15.81:0/4060457783 >> v2:172.21.15.176:3300/0 conn(0x7f10f0150070 0x7f10f00ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f619e700 1 -- 172.21.15.81:0/4060457783 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00cdf50 con 0x7f10f0159690 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.736+0000 7f10f519c700 1 --2- 172.21.15.81:0/4060457783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f00cb510 0x7f10f00cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f619e700 1 --2- 172.21.15.81:0/4060457783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0159aa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f10f00718d0 tx=0x7f10e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6b947b1817f54f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f499b700 1 -- 172.21.15.81:0/4060457783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8011830 con 0x7f10f0159690 2023-11-29T11:14:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f499b700 1 -- 172.21.15.81:0/4060457783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8011990 con 0x7f10f0159690 2023-11-29T11:14:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f499b700 1 -- 172.21.15.81:0/4060457783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8011d20 con 0x7f10f0159690 2023-11-29T11:14:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 -- 172.21.15.81:0/4060457783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 msgr2=0x7f10f0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 --2- 172.21.15.81:0/4060457783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0159aa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f10f00718d0 tx=0x7f10e8009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 -- 172.21.15.81:0/4060457783 shutdown_connections 2023-11-29T11:14:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 --2- 172.21.15.81:0/4060457783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f00cb510 0x7f10f00cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 --2- 172.21.15.81:0/4060457783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0159aa0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 --2- 172.21.15.81:0/4060457783 >> v2:172.21.15.176:3300/0 conn(0x7f10f0150070 0x7f10f00ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 -- 172.21.15.81:0/4060457783 >> 172.21.15.81:0/4060457783 conn(0x7f10f006c6b0 msgr2=0x7f10f006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 -- 172.21.15.81:0/4060457783 shutdown_connections 2023-11-29T11:14:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 -- 172.21.15.81:0/4060457783 wait complete. 2023-11-29T11:14:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 Processor -- start 2023-11-29T11:14:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.740+0000 7f10f699f700 1 -- start start 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f699f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10f00cb510 0x7f10f00c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f699f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f0150070 0x7f10f0152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f699f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f699f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f015d460 con 0x7f10f0159690 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f699f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00c4bd0 con 0x7f10f00cb510 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f699f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00c3fc0 con 0x7f10f0150070 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38638/0 (socket says 172.21.15.81:38638) 2023-11-29T11:14:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 -- 172.21.15.81:0/774434197 learned_addr learned my addr 172.21.15.81:0/774434197 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f599d700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10f00cb510 0x7f10f00c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f519c700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f0150070 0x7f10f0152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 -- 172.21.15.81:0/774434197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f0150070 msgr2=0x7f10f0152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f0150070 0x7f10f0152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 -- 172.21.15.81:0/774434197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10f00cb510 msgr2=0x7f10f00c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10f00cb510 0x7f10f00c3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 -- 172.21.15.81:0/774434197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8009570 con 0x7f10f0159690 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f619e700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0152f60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f10e8014040 tx=0x7f10e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10e27fc700 1 -- 172.21.15.81:0/774434197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8004240 con 0x7f10f0159690 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f00cbea0 con 0x7f10f0159690 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10e27fc700 1 -- 172.21.15.81:0/774434197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e80043a0 con 0x7f10f0159690 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10e27fc700 1 -- 172.21.15.81:0/774434197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e80036c0 con 0x7f10f0159690 2023-11-29T11:14:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.744+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f00ce230 con 0x7f10f0159690 2023-11-29T11:14:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.748+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f0150440 con 0x7f10f0159690 2023-11-29T11:14:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.748+0000 7f10e27fc700 1 -- 172.21.15.81:0/774434197 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f10e802c030 con 0x7f10f0159690 2023-11-29T11:14:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.748+0000 7f10e27fc700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10d4064ee0 0x7f10d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.748+0000 7f10e27fc700 1 -- 172.21.15.81:0/774434197 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f10e8084f20 con 0x7f10f0159690 2023-11-29T11:14:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.748+0000 7f10f599d700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10d4064ee0 0x7f10d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.748+0000 7f10f599d700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10d4064ee0 0x7f10d4067390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f10f00c5c60 tx=0x7f10ec00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:25.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.760+0000 7f10e27fc700 1 -- 172.21.15.81:0/774434197 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f10e80b5400 con 0x7f10f0159690 2023-11-29T11:14:25.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:14:25.924 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:14:25.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.980+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f10f00676e0 con 0x7f10f0159690 2023-11-29T11:14:25.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.988+0000 7f10e27fc700 1 -- 172.21.15.81:0/774434197 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f10e8052f00 con 0x7f10f0159690 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10d4064ee0 msgr2=0x7f10d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10d4064ee0 0x7f10d4067390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f10f00c5c60 tx=0x7f10ec00b040 comp rx=0 tx=0).stop 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 msgr2=0x7f10f0152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0152f60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f10e8014040 tx=0x7f10e8004770 comp rx=0 tx=0).stop 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 shutdown_connections 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10d4064ee0 0x7f10d4067390 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10f0159690 0x7f10f0152f60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10f0150070 0x7f10f0152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 --2- 172.21.15.81:0/774434197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10f00cb510 0x7f10f00c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 >> 172.21.15.81:0/774434197 conn(0x7f10f006c6b0 msgr2=0x7f10f00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 shutdown_connections 2023-11-29T11:14:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:25.992+0000 7f10f699f700 1 -- 172.21.15.81:0/774434197 wait complete. 2023-11-29T11:14:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-11-29T11:14:26.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9ffff700 1 Processor -- start 2023-11-29T11:14:26.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9ffff700 1 -- start start 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ba00b32e0 0x7f8ba00b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8ba0069cd0 0x7f8ba006a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba00cbe00 con 0x7f8ba01584c0 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba006dbd0 con 0x7f8ba00b32e0 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba00b3c60 con 0x7f8ba0069cd0 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ba00b32e0 0x7f8ba00b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ba00b32e0 0x7f8ba00b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38646/0 (socket says 172.21.15.81:38646) 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9e7fc700 1 -- 172.21.15.81:0/3647094779 learned_addr learned my addr 172.21.15.81:0/3647094779 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:26.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9e7fc700 1 -- 172.21.15.81:0/3647094779 >> v2:172.21.15.176:3300/0 conn(0x7f8ba0069cd0 msgr2=0x7f8ba006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9e7fc700 1 --2- 172.21.15.81:0/3647094779 >> v2:172.21.15.176:3300/0 conn(0x7f8ba0069cd0 0x7f8ba006a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9e7fc700 1 -- 172.21.15.81:0/3647094779 >> v1:172.21.15.81:6789/0 conn(0x7f8ba01584c0 legacy=0x7f8ba00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9e7fc700 1 -- 172.21.15.81:0/3647094779 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba00cd0f0 con 0x7f8ba00b32e0 2023-11-29T11:14:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9e7fc700 1 --2- 172.21.15.81:0/3647094779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00b32e0 0x7f8ba00b3720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00b4410 tx=0x7f8b9800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291d49dbdf439b11 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9dffb700 1 -- 172.21.15.81:0/3647094779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98010070 con 0x7f8ba00b32e0 2023-11-29T11:14:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9dffb700 1 -- 172.21.15.81:0/3647094779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9800db80 con 0x7f8ba00b32e0 2023-11-29T11:14:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.112+0000 7f8b9dffb700 1 -- 172.21.15.81:0/3647094779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98016400 con 0x7f8ba00b32e0 2023-11-29T11:14:26.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- 172.21.15.81:0/3647094779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00b32e0 msgr2=0x7f8ba00b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/3647094779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00b32e0 0x7f8ba00b3720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00b4410 tx=0x7f8b9800d430 comp rx=0 tx=0).stop 2023-11-29T11:14:26.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- 172.21.15.81:0/3647094779 shutdown_connections 2023-11-29T11:14:26.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/3647094779 >> v2:172.21.15.176:3300/0 conn(0x7f8ba0069cd0 0x7f8ba006a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/3647094779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00b32e0 0x7f8ba00b3720 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- 172.21.15.81:0/3647094779 >> 172.21.15.81:0/3647094779 conn(0x7f8ba00ce3e0 msgr2=0x7f8ba00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:26.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- 172.21.15.81:0/3647094779 shutdown_connections 2023-11-29T11:14:26.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- 172.21.15.81:0/3647094779 wait complete. 2023-11-29T11:14:26.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 Processor -- start 2023-11-29T11:14:26.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- start start 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ba0069cd0 0x7f8ba01df6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba00b32e0 0x7f8ba0156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba01584c0 0x7f8ba0157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00aec50 con 0x7f8ba01584c0 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00c67a0 con 0x7f8ba00b32e0 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00ae3b0 con 0x7f8ba0069cd0 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba01584c0 0x7f8ba0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba01584c0 0x7f8ba0157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38656/0 (socket says 172.21.15.81:38656) 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9f7fe700 1 -- 172.21.15.81:0/2256807450 learned_addr learned my addr 172.21.15.81:0/2256807450 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:26.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9e7fc700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba00b32e0 0x7f8ba0156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9effd700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ba0069cd0 0x7f8ba01df6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9f7fe700 1 -- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ba0069cd0 msgr2=0x7f8ba01df6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9f7fe700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ba0069cd0 0x7f8ba01df6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9f7fe700 1 -- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba00b32e0 msgr2=0x7f8ba0156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9f7fe700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba00b32e0 0x7f8ba0156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9f7fe700 1 -- 172.21.15.81:0/2256807450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9800bd40 con 0x7f8ba01584c0 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.116+0000 7f8b9e7fc700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba00b32e0 0x7f8ba0156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b9f7fe700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba01584c0 0x7f8ba0157000 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000b4d0 tx=0x7f8b9000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b977fe700 1 -- 172.21.15.81:0/2256807450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90011830 con 0x7f8ba01584c0 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b977fe700 1 -- 172.21.15.81:0/2256807450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b90011990 con 0x7f8ba01584c0 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba00cd6b0 con 0x7f8ba01584c0 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b977fe700 1 -- 172.21.15.81:0/2256807450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90011d40 con 0x7f8ba01584c0 2023-11-29T11:14:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba00cd3d0 con 0x7f8ba01584c0 2023-11-29T11:14:26.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba00cd990 con 0x7f8ba01584c0 2023-11-29T11:14:26.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b977fe700 1 -- 172.21.15.81:0/2256807450 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8b90021070 con 0x7f8ba01584c0 2023-11-29T11:14:26.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b977fe700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b80064ee0 0x7f8b80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b9effd700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b80064ee0 0x7f8b80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.120+0000 7f8b977fe700 1 -- 172.21.15.81:0/2256807450 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8b90081fe0 con 0x7f8ba01584c0 2023-11-29T11:14:26.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.124+0000 7f8b9effd700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b80064ee0 0x7f8b80067390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00c7d30 tx=0x7f8b88009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.128+0000 7f8b977fe700 1 -- 172.21.15.81:0/2256807450 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8b9004ff90 con 0x7f8ba01584c0 2023-11-29T11:14:26.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ba0072500 con 0x7f8ba01584c0 2023-11-29T11:14:26.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b977fe700 1 -- 172.21.15.81:0/2256807450 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f8b90015090 con 0x7f8ba01584c0 2023-11-29T11:14:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:26.335 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:14:16.825795+0000","modified":"2023-11-29T11:14:19.853366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1909362607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1909362607},{"type":"v1","addr":"172.21.15.176:6833","nonce":1909362607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T11:14:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b80064ee0 msgr2=0x7f8b80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b80064ee0 0x7f8b80067390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00c7d30 tx=0x7f8b88009040 comp rx=0 tx=0).stop 2023-11-29T11:14:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba01584c0 msgr2=0x7f8ba0157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba01584c0 0x7f8ba0157000 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000b4d0 tx=0x7f8b9000b890 comp rx=0 tx=0).stop 2023-11-29T11:14:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 shutdown_connections 2023-11-29T11:14:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b80064ee0 0x7f8b80067390 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba01584c0 0x7f8ba0157000 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba00b32e0 0x7f8ba0156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 --2- 172.21.15.81:0/2256807450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ba0069cd0 0x7f8ba01df6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 >> 172.21.15.81:0/2256807450 conn(0x7f8ba00ce3e0 msgr2=0x7f8ba0071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 shutdown_connections 2023-11-29T11:14:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.328+0000 7f8b9ffff700 1 -- 172.21.15.81:0/2256807450 wait complete. 2023-11-29T11:14:26.339 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-11-29T11:14:26.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:14:16.825795+0000', 'modified': '2023-11-29T11:14:19.853366+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5580}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5580': {'gid': 5580, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6833/1909362607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 1909362607}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 1909362607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:14:26.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:14:26.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-29T11:14:26.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.872+0000 7f7cb3316700 1 Processor -- start 2023-11-29T11:14:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.872+0000 7f7cb3316700 1 -- start start 2023-11-29T11:14:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb3316700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7cac158e60 0x7f7cac0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb3316700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac0cd8f0 con 0x7f7cac0cb460 2023-11-29T11:14:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb3316700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac06dc60 con 0x7f7cac0ad490 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb3316700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac0add00 con 0x7f7cac158e60 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb2b15700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7cac0cb460 0x7f7cac06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47568/0 (socket says 172.21.15.81:47568) 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb2b15700 1 -- 172.21.15.81:0/2800894793 learned_addr learned my addr 172.21.15.81:0/2800894793 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb2314700 1 --2- 172.21.15.81:0/2800894793 >> v2:172.21.15.176:3300/0 conn(0x7f7cac158e60 0x7f7cac0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196239770 0 0) 0x7f7cac0cd8f0 con 0x7f7cac0cb460 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c980035d0 con 0x7f7cac0cb460 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791442367 0 0) 0x7f7cac06dc60 con 0x7f7cac0ad490 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cac0cd8f0 con 0x7f7cac0ad490 2023-11-29T11:14:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294777927 0 0) 0x7f7c980035d0 con 0x7f7cac0cb460 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 >> v2:172.21.15.176:3300/0 conn(0x7f7cac158e60 msgr2=0x7f7cac0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 --2- 172.21.15.81:0/2800894793 >> v2:172.21.15.176:3300/0 conn(0x7f7cac158e60 0x7f7cac0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 >> v1:172.21.15.176:6789/0 conn(0x7f7cac0ad490 legacy=0x7f7cac0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0cde90 con 0x7f7cac0cb460 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f7ca40019f0 con 0x7f7cac0cb460 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 >> v1:172.21.15.81:6789/0 conn(0x7f7cac0cb460 legacy=0x7f7cac06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98003c00 0x7f7c98003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c98004870 0x7f7c98004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98005270 0x7f7c9800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac0add00 con 0x7f7c98004870 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9800e390 con 0x7f7c98005270 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9800e550 con 0x7f7c98003c00 2023-11-29T11:14:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c98004870 0x7f7c98004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb2314700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98003c00 0x7f7c98003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98005270 0x7f7c9800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1b13700 1 -- 172.21.15.81:0/2800894793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98003c00 msgr2=0x7f7c98003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c98003c00 0x7f7c98003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1b13700 1 -- 172.21.15.81:0/2800894793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98005270 msgr2=0x7f7c9800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98005270 0x7f7c9800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb2b15700 1 -- 172.21.15.81:0/2800894793 reap_dead start 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1b13700 1 -- 172.21.15.81:0/2800894793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980035d0 con 0x7f7c98004870 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c98004870 0x7f7c98004ce0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c007fd0 tx=0x7f7c980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5cfee387537d74 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c001450 con 0x7f7c98004870 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c006aa0 con 0x7f7c98004870 2023-11-29T11:14:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.876+0000 7f7cb1312700 1 -- 172.21.15.81:0/2800894793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c006e50 con 0x7f7c98004870 2023-11-29T11:14:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 -- 172.21.15.81:0/2800894793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c98004870 msgr2=0x7f7c98004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c98004870 0x7f7c98004ce0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c007fd0 tx=0x7f7c980058a0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 -- 172.21.15.81:0/2800894793 shutdown_connections 2023-11-29T11:14:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 --2- 172.21.15.81:0/2800894793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c98004870 0x7f7c98004ce0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 -- 172.21.15.81:0/2800894793 >> 172.21.15.81:0/2800894793 conn(0x7f7cac0ce3e0 msgr2=0x7f7cac0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 -- 172.21.15.81:0/2800894793 shutdown_connections 2023-11-29T11:14:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 -- 172.21.15.81:0/2800894793 wait complete. 2023-11-29T11:14:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 Processor -- start 2023-11-29T11:14:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.880+0000 7f7cb3316700 1 -- start start 2023-11-29T11:14:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb3316700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98004870 0x7f7cac1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb3316700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac15a3e0 0x7f7cac15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb3316700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cac0ae400 0x7f7cac0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb3316700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac154930 con 0x7f7cac15a3e0 2023-11-29T11:14:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb3316700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac15b0a0 con 0x7f7c98004870 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb3316700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac15b380 con 0x7f7cac0ae400 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb1b13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac15a3e0 0x7f7cac15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98004870 0x7f7cac1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98004870 0x7f7cac1543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:60532/0 (socket says 172.21.15.81:60532) 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 -- 172.21.15.81:0/450796850 learned_addr learned my addr 172.21.15.81:0/450796850 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb1b13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac15a3e0 0x7f7cac15a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38684/0 (socket says 172.21.15.81:38684) 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cac0ae400 0x7f7cac0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 -- 172.21.15.81:0/450796850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cac0ae400 msgr2=0x7f7cac0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cac0ae400 0x7f7cac0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 -- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac15a3e0 msgr2=0x7f7cac15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac15a3e0 0x7f7cac15a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 -- 172.21.15.81:0/450796850 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac06d6a0 con 0x7f7c98004870 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac15a3e0 0x7f7cac15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb2314700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98004870 0x7f7cac1543f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8011a20 tx=0x7f7ca8011d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7ca2ffd700 1 -- 172.21.15.81:0/450796850 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8011ec0 con 0x7f7c98004870 2023-11-29T11:14:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7ca2ffd700 1 -- 172.21.15.81:0/450796850 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800f8c0 con 0x7f7c98004870 2023-11-29T11:14:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb3316700 1 -- 172.21.15.81:0/450796850 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac159230 con 0x7f7c98004870 2023-11-29T11:14:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7ca2ffd700 1 -- 172.21.15.81:0/450796850 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800fc70 con 0x7f7c98004870 2023-11-29T11:14:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.884+0000 7f7cb3316700 1 -- 172.21.15.81:0/450796850 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac06d980 con 0x7f7c98004870 2023-11-29T11:14:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7ca2ffd700 1 -- 172.21.15.81:0/450796850 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7ca8014440 con 0x7f7c98004870 2023-11-29T11:14:26.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7ca2ffd700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c90064ee0 0x7f7c90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7ca2ffd700 1 -- 172.21.15.81:0/450796850 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7ca8082670 con 0x7f7c98004870 2023-11-29T11:14:26.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c90064ee0 0x7f7c90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c90064ee0 0x7f7c90067390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c000c00 tx=0x7f7c9c005040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb77f8740 1 Processor -- start 2023-11-29T11:14:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb77f8740 1 -- start start 2023-11-29T11:14:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b48e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 0x1b49340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b49880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a07ae0 con 0x18e3790 2023-11-29T11:14:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a77bd0 con 0x1898710 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a70ed0 con 0x1898ae0 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2b15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b49880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2b15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b49880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38688/0 (socket says 172.21.15.81:38688) 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2b15700 1 -- 172.21.15.81:0/3511920190 learned_addr learned my addr 172.21.15.81:0/3511920190 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2314700 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b48e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 0x1b49340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2b15700 1 -- 172.21.15.81:0/3511920190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 msgr2=0x1b48e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b48e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2b15700 1 -- 172.21.15.81:0/3511920190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 msgr2=0x1b49340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 0x1b49340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.888+0000 7f7cb2b15700 1 -- 172.21.15.81:0/3511920190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a96cc0 con 0x18e3790 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b49880 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4001a00 tx=0x7f7ca4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d280b864b9008a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7c8ffff700 1 -- 172.21.15.81:0/3511920190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40078c0 con 0x18e3790 2023-11-29T11:14:26.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7c8ffff700 1 -- 172.21.15.81:0/3511920190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca4007a20 con 0x18e3790 2023-11-29T11:14:26.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7c8ffff700 1 -- 172.21.15.81:0/3511920190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4015640 con 0x18e3790 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 -- 172.21.15.81:0/3511920190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 msgr2=0x1b49880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b49880 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4001a00 tx=0x7f7ca4001a30 comp rx=0 tx=0).stop 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 -- 172.21.15.81:0/3511920190 shutdown_connections 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b49880 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 0x1b49340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/3511920190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b48e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 -- 172.21.15.81:0/3511920190 >> 172.21.15.81:0/3511920190 conn(0x1898eb0 msgr2=0x1b31700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 -- 172.21.15.81:0/3511920190 shutdown_connections 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 -- 172.21.15.81:0/3511920190 wait complete. 2023-11-29T11:14:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 -- start start 2023-11-29T11:14:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.892+0000 7f7cb77f8740 1 Processor -- start 2023-11-29T11:14:26.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 0x1b2fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b0a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b0a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x191db20 con 0x18e3790 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b08e80 con 0x1898710 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b09120 con 0x1898ae0 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 10 client.0 _ll_register_callbacks cb 0x1acd0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b0a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b0a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38698/0 (socket says 172.21.15.81:38698) 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 -- 172.21.15.81:0/856749458 learned_addr learned my addr 172.21.15.81:0/856749458 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b0a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2314700 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 0x1b2fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 -- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 msgr2=0x1b0a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b0a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 -- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 msgr2=0x1b2fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 0x1b2fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 -- 172.21.15.81:0/856749458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac0cde90 con 0x18e3790 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b0a940 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4001a70 tx=0x7f7cac0cde00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e530852817d158 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7c8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/856749458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40078c0 con 0x18e3790 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/856749458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7ca40016f0 con 0x18e3790 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 -- 172.21.15.81:0/856749458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a69f50 con 0x18e3790 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/856749458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ca4007b90 con 0x18e3790 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 10 client.5784 fetch_fsmap learned FSMap version 17 2023-11-29T11:14:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 -- 172.21.15.81:0/856749458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x18e49e0 con 0x18e3790 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/856749458 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a69f50 con 0x18e3790 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/856749458 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7ca4012050 con 0x18e3790 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 10 client.5784 fetch_fsmap finished waiting for FSMap version 17 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 10 client.5784 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 20 client.5784 populate_metadata read hostname 'smithi081' 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] conn(0x1b4aaf0 0x1b077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 4 client.5784 mds_command: new command op to 5580 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb77f8740 1 -- 172.21.15.81:0/856749458 --> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a69c70 con 0x1b4aaf0 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2314700 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] conn(0x1b4aaf0 0x1b077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7cb2314700 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] conn(0x1b4aaf0 0x1b077c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d33b06ca4398896 server_cookie=931ae90e4b0c2c21 in_seq=0 out_seq=0 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.896+0000 7f7c8d7fa700 10 client.5784 ms_handle_connect on v2:172.21.15.176:6832/1909362607 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/856749458 <== mds.0 v2:172.21.15.176:6832/1909362607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1a69c70 con 0x1b4aaf0 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7c8d7fa700 10 client.5784 handle_command_reply: tid=0 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 client.5784 shutdown 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 -- 172.21.15.81:0/856749458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 msgr2=0x1b0a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b0a940 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4001a70 tx=0x7f7cac0cde00 comp rx=0 tx=0).stop 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 -- 172.21.15.81:0/856749458 shutdown_connections 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b0a940 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b0a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] conn(0x1b4aaf0 0x1b077c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/856749458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898710 0x1b2fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7c8d7fa700 0 client.5784 ms_handle_reset on v2:172.21.15.176:6832/1909362607 2023-11-29T11:14:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 -- 172.21.15.81:0/856749458 >> 172.21.15.81:0/856749458 conn(0x1898eb0 msgr2=0x1b317d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 -- 172.21.15.81:0/856749458 shutdown_connections 2023-11-29T11:14:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 1 -- 172.21.15.81:0/856749458 wait complete. 2023-11-29T11:14:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.900+0000 7f7cb77f8740 20 client.5784 trim_cache size 0 max 16384 2023-11-29T11:14:26.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 Processor -- start 2023-11-29T11:14:26.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 -- start start 2023-11-29T11:14:26.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898710 0x1b583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898ae0 0x1b05e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b063d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6e6e0 con 0x18e3790 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a73a30 con 0x1898ae0 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a6fd60 con 0x1898710 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38710/0 (socket says 172.21.15.81:38710) 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 -- 172.21.15.81:0/1543779087 learned_addr learned my addr 172.21.15.81:0/1543779087 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2314700 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898710 0x1b583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898ae0 0x1b05e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 -- 172.21.15.81:0/1543779087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898710 msgr2=0x1b583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898710 0x1b583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 -- 172.21.15.81:0/1543779087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898ae0 msgr2=0x1b05e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898ae0 0x1b05e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 -- 172.21.15.81:0/1543779087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0ae1a0 con 0x18e3790 2023-11-29T11:14:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b063d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4001300 tx=0x7f7ca4022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b189341207510680 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7ca0ff9700 1 -- 172.21.15.81:0/1543779087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40078c0 con 0x18e3790 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7ca0ff9700 1 -- 172.21.15.81:0/1543779087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca4007b90 con 0x18e3790 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7ca0ff9700 1 -- 172.21.15.81:0/1543779087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4015de0 con 0x18e3790 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 -- 172.21.15.81:0/1543779087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 msgr2=0x1b063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b063d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4001300 tx=0x7f7ca4022040 comp rx=0 tx=0).stop 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 -- 172.21.15.81:0/1543779087 shutdown_connections 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18e3790 0x1b063d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1898ae0 0x1b05e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/1543779087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898710 0x1b583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 -- 172.21.15.81:0/1543779087 >> 172.21.15.81:0/1543779087 conn(0x1898eb0 msgr2=0x1b5f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.920+0000 7f7cb77f8740 1 -- 172.21.15.81:0/1543779087 shutdown_connections 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 -- 172.21.15.81:0/1543779087 wait complete. 2023-11-29T11:14:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 -- start start 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 Processor -- start 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1898710 0x1baf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b6c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18e3790 0x1bb0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a46de0 con 0x1898710 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a78e60 con 0x18e3790 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b0af90 con 0x1898ae0 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 10 client.0 _ll_register_callbacks cb 0x1a1d2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1898710 0x1baf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1898710 0x1baf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38718/0 (socket says 172.21.15.81:38718) 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 -- 172.21.15.81:0/341594692 learned_addr learned my addr 172.21.15.81:0/341594692 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b6c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2b15700 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18e3790 0x1bb0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 -- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 msgr2=0x1b6c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b6c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 -- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18e3790 msgr2=0x1bb0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18e3790 0x1bb0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 -- 172.21.15.81:0/341594692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x18e49e0 con 0x1898710 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b6c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb2314700 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1898710 0x1baf3f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80540f0 tx=0x7f7ca8082040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17d86aa8a34f009 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7c8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/341594692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8050b00 con 0x1898710 2023-11-29T11:14:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/341594692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7ca807f040 con 0x1898710 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 -- 172.21.15.81:0/341594692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ca4007a20 con 0x1898710 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/341594692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ca8050c60 con 0x1898710 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 10 client.5790 fetch_fsmap learned FSMap version 17 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 -- 172.21.15.81:0/341594692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x1a1da20 con 0x1898710 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/341594692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca4007a20 con 0x1898710 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/341594692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7ca80538e0 con 0x1898710 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 10 client.5790 fetch_fsmap finished waiting for FSMap version 17 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 10 client.5790 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 20 client.5790 populate_metadata read hostname 'smithi081' 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] conn(0x1bb0b20 0x1b65330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 4 client.5790 mds_command: new command op to 5580 tid=0[{"prefix": "status"}] 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb77f8740 1 -- 172.21.15.81:0/341594692 --> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1915260 con 0x1bb0b20 2023-11-29T11:14:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.924+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] conn(0x1bb0b20 0x1b65330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7c8d7fa700 10 client.5790 ms_handle_connect on v2:172.21.15.176:6832/1909362607 2023-11-29T11:14:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb1b13700 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] conn(0x1bb0b20 0x1b65330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54784949f8476aa2 server_cookie=916cee2a475ef880 in_seq=0 out_seq=0 2023-11-29T11:14:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7c8d7fa700 1 -- 172.21.15.81:0/341594692 <== mds.0 v2:172.21.15.176:6832/1909362607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1915260 con 0x1bb0b20 2023-11-29T11:14:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7c8d7fa700 10 client.5790 handle_command_reply: tid=0 2023-11-29T11:14:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 client.5790 shutdown 2023-11-29T11:14:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 -- 172.21.15.81:0/341594692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1898710 msgr2=0x1baf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1898710 0x1baf3f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80540f0 tx=0x7f7ca8082040 comp rx=0 tx=0).stop 2023-11-29T11:14:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 -- 172.21.15.81:0/341594692 shutdown_connections 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:6832/1909362607,v1:172.21.15.176:6833/1909362607] conn(0x1bb0b20 0x1b65330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18e3790 0x1bb0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7c8d7fa700 0 client.5790 ms_handle_reset on v2:172.21.15.176:6832/1909362607 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1898ae0 0x1b6c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 --2- 172.21.15.81:0/341594692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1898710 0x1baf3f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 -- 172.21.15.81:0/341594692 >> 172.21.15.81:0/341594692 conn(0x1898eb0 msgr2=0x1b5f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 -- 172.21.15.81:0/341594692 shutdown_connections 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 1 -- 172.21.15.81:0/341594692 wait complete. 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb77f8740 20 client.5790 trim_cache size 0 max 16384 2023-11-29T11:14:26.939 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5580, 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.103349122999999, 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 17, 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 41, 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 41, 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.564940891999999 2023-11-29T11:14:26.940 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:14:26.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 -- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c90064ee0 msgr2=0x7f7c90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c90064ee0 0x7f7c90067390 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c000c00 tx=0x7f7c9c005040 comp rx=0 tx=0).stop 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 -- 172.21.15.81:0/450796850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98004870 msgr2=0x7f7cac1543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98004870 0x7f7cac1543f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8011a20 tx=0x7f7ca8011d30 comp rx=0 tx=0).stop 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 -- 172.21.15.81:0/450796850 shutdown_connections 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c90064ee0 0x7f7c90067390 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cac0ae400 0x7f7cac0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cac15a3e0 0x7f7cac15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 --2- 172.21.15.81:0/450796850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c98004870 0x7f7cac1543f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 -- 172.21.15.81:0/450796850 >> 172.21.15.81:0/450796850 conn(0x7f7cac0ce3e0 msgr2=0x7f7cac0ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 -- 172.21.15.81:0/450796850 shutdown_connections 2023-11-29T11:14:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:26.928+0000 7f7cb3316700 1 -- 172.21.15.81:0/450796850 wait complete. 2023-11-29T11:14:26.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:14:27.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.060+0000 7fc096f77700 1 Processor -- start 2023-11-29T11:14:27.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.060+0000 7fc096f77700 1 -- start start 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0901510d0 0x7fc09015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0900b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0900b1170 con 0x7fc0900c98a0 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0900c95d0 con 0x7fc0901510d0 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900c8e00 con 0x7fc090069c40 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc094d13700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0901510d0 0x7fc09015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc095514700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc0900c98a0 0x7fc0900c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47570/0 (socket says 172.21.15.81:47570) 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc095514700 1 -- 172.21.15.81:0/3193835902 learned_addr learned my addr 172.21.15.81:0/3193835902 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc08ffff700 1 --2- 172.21.15.81:0/3193835902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0900b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc094d13700 1 -- 172.21.15.81:0/3193835902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 msgr2=0x7fc0900b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc094d13700 1 --2- 172.21.15.81:0/3193835902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0900b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc094d13700 1 -- 172.21.15.81:0/3193835902 >> v1:172.21.15.81:6789/0 conn(0x7fc0900c98a0 legacy=0x7fc0900c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:27.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc08f7fe700 1 -- 172.21.15.81:0/3193835902 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991057699 0 0) 0x7fc0900b1170 con 0x7fc0900c98a0 2023-11-29T11:14:27.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc094d13700 1 -- 172.21.15.81:0/3193835902 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0900c9010 con 0x7fc0901510d0 2023-11-29T11:14:27.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc08ffff700 1 --2- 172.21.15.81:0/3193835902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0900b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:27.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc094d13700 1 --2- 172.21.15.81:0/3193835902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc09015b260 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc080009850 tx=0x7fc080009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d58639076a4e5a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:27.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc08f7fe700 1 -- 172.21.15.81:0/3193835902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011830 con 0x7fc0901510d0 2023-11-29T11:14:27.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc08f7fe700 1 -- 172.21.15.81:0/3193835902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc080011990 con 0x7fc0901510d0 2023-11-29T11:14:27.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc08f7fe700 1 -- 172.21.15.81:0/3193835902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011d40 con 0x7fc0901510d0 2023-11-29T11:14:27.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 -- 172.21.15.81:0/3193835902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 msgr2=0x7fc09015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:27.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 --2- 172.21.15.81:0/3193835902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc09015b260 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc080009850 tx=0x7fc080009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:27.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 -- 172.21.15.81:0/3193835902 shutdown_connections 2023-11-29T11:14:27.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 --2- 172.21.15.81:0/3193835902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0900b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 --2- 172.21.15.81:0/3193835902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc09015b260 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 -- 172.21.15.81:0/3193835902 >> 172.21.15.81:0/3193835902 conn(0x7fc09006caf0 msgr2=0x7fc0900ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:27.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 -- 172.21.15.81:0/3193835902 shutdown_connections 2023-11-29T11:14:27.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.064+0000 7fc096f77700 1 -- 172.21.15.81:0/3193835902 wait complete. 2023-11-29T11:14:27.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc096f77700 1 Processor -- start 2023-11-29T11:14:27.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc096f77700 1 -- start start 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc096f77700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0901516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc096f77700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0900c98a0 0x7fc09014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc096f77700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc090153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc096f77700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09014e9a0 con 0x7fc0901510d0 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc096f77700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900c6ea0 con 0x7fc0900c98a0 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc096f77700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0901546e0 con 0x7fc090069c40 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc095514700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc090153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc095514700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc090153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38738/0 (socket says 172.21.15.81:38738) 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc094d13700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0901516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc095514700 1 -- 172.21.15.81:0/2700597961 learned_addr learned my addr 172.21.15.81:0/2700597961 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc08ffff700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0900c98a0 0x7fc09014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc095514700 1 -- 172.21.15.81:0/2700597961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 msgr2=0x7fc0901516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.068+0000 7fc095514700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0901516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc095514700 1 -- 172.21.15.81:0/2700597961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0900c98a0 msgr2=0x7fc09014e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc095514700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0900c98a0 0x7fc09014e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc095514700 1 -- 172.21.15.81:0/2700597961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780094b0 con 0x7fc0901510d0 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc095514700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc090153e90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc088002230 tx=0x7fc08800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc08d7fa700 1 -- 172.21.15.81:0/2700597961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08800aa60 con 0x7fc0901510d0 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc08d7fa700 1 -- 172.21.15.81:0/2700597961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08800abe0 con 0x7fc0901510d0 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0800094b0 con 0x7fc0901510d0 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc08d7fa700 1 -- 172.21.15.81:0/2700597961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880070d0 con 0x7fc0901510d0 2023-11-29T11:14:27.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc090070170 con 0x7fc0901510d0 2023-11-29T11:14:27.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.072+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0900c92f0 con 0x7fc0901510d0 2023-11-29T11:14:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.076+0000 7fc08d7fa700 1 -- 172.21.15.81:0/2700597961 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc088010070 con 0x7fc0901510d0 2023-11-29T11:14:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.076+0000 7fc08d7fa700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc074064ee0 0x7fc074067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.076+0000 7fc08d7fa700 1 -- 172.21.15.81:0/2700597961 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc0880818e0 con 0x7fc0901510d0 2023-11-29T11:14:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.076+0000 7fc094d13700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc074064ee0 0x7fc074067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.076+0000 7fc094d13700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc074064ee0 0x7fc074067390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc0800090b0 tx=0x7fc080008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.084+0000 7fc08d7fa700 1 -- 172.21.15.81:0/2700597961 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc08804f860 con 0x7fc0901510d0 2023-11-29T11:14:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.276+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc0901514a0 con 0x7fc0901510d0 2023-11-29T11:14:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.276+0000 7fc08d7fa700 1 -- 172.21.15.81:0/2700597961 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc088018060 con 0x7fc0901510d0 2023-11-29T11:14:27.284 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:14:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc074064ee0 msgr2=0x7fc074067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc074064ee0 0x7fc074067390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc0800090b0 tx=0x7fc080008030 comp rx=0 tx=0).stop 2023-11-29T11:14:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 msgr2=0x7fc090153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc090153e90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc088002230 tx=0x7fc08800cf50 comp rx=0 tx=0).stop 2023-11-29T11:14:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 shutdown_connections 2023-11-29T11:14:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc074064ee0 0x7fc074067390 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0901510d0 0x7fc090153e90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0900c98a0 0x7fc09014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 --2- 172.21.15.81:0/2700597961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc090069c40 0x7fc0901516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:27.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 >> 172.21.15.81:0/2700597961 conn(0x7fc09006caf0 msgr2=0x7fc0901502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:27.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 shutdown_connections 2023-11-29T11:14:27.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:27.280+0000 7fc096f77700 1 -- 172.21.15.81:0/2700597961 wait complete. 2023-11-29T11:14:27.303 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:14:27.303 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:14:27.303 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:14:27.303 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:14:27.303 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:14:27.303 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:14:27.304 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:14:27.304 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:14:27.304 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:14:27.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:27.304 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:14:27.310 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:14:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42499sec preferred_lft 42499sec 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:14:27.312 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:14:27.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:27.313 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:14:27.325 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:14:27.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:27.327 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:14:27.377 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:14:27.377 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:14:27.377 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:14:27.377 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:14:27.377 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:14:27.377 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:14:27.377 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:14:27.378 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:14:27.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:27.378 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:14:27.378 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:14:27.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:14:27.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:14:27.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:14:27.378 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:14:27.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:27.418 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:14:27.423 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:14:27.423 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:14:27.424 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:14:27.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:27.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:14:27.479 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:14:27.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:14:27.479 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:14:27.485 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:14:27.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:14:27.485 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:14:27.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:14:27.550 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:14:27.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:14:27.565 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:14:27.566 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:14:27.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:27.567 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:14:27.573 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:14:27.573 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:14:27.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:14:27.591 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:14:27.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:14:27.645 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:14:27.646 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:14:27.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:27.647 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:14:27.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:14:27.656+0000 7f9c875c3640 -1 init, newargv = 0x5564519b0880 newargc=15 2023-11-29T11:14:27.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48913]: starting ceph client 2023-11-29T11:14:27.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48913]: starting fuse 2023-11-29T11:14:28.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:14:28.772 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:14:28.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:14:28.832 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:14:28.833 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:14:28.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:28.834 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:14:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:14:28.842 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:14:28.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:14:28.843 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:14:28.843 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:14:28.843 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:14:28.843 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:14:28.843 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:28.843 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:14:28.843 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:14:28.844 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:14:28.844 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:14:28.844 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:28.844 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:14:28.844 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:14:28.844 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:14:28.844 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:14:28.844 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:28.845 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:14:28.846 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:14:28.925 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.48913.asok 2023-11-29T11:14:29.111 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48913.asok 2023-11-29T11:14:29.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48913.asok status 2023-11-29T11:14:29.257 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:14:29.257 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:14:29.257 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "48913", 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5731, 2023-11-29T11:14:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5731 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1269920155 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:14:29.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1269920155 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.5731 172.21.15.81:0/1269920155", 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "172.21.15.81:0/1269920155", 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 17, 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 41, 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:14:29.260 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:14:29.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.267 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:14:29.267 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:14:29.273 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:14:29.273 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:14:29.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:14:29.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.291 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-11-29T11:14:29.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.313 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-11-29T11:14:29.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.372 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-11-29T11:14:29.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.387 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-11-29T11:14:29.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.404 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-11-29T11:14:29.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:29.463 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-11-29T11:14:29.492 INFO:teuthology.orchestra.run.smithi081.stdout:./ 2023-11-29T11:14:29.492 INFO:teuthology.orchestra.run.smithi081.stdout:./rfile 2023-11-29T11:14:29.492 INFO:teuthology.orchestra.run.smithi081.stdout:./parentdir 2023-11-29T11:14:29.492 INFO:teuthology.orchestra.run.smithi081.stdout:./parentdir/pfile 2023-11-29T11:14:29.492 INFO:teuthology.orchestra.run.smithi081.stdout:./parentdir/childdir 2023-11-29T11:14:29.492 INFO:teuthology.orchestra.run.smithi081.stdout:./parentdir/childdir/cfile 2023-11-29T11:14:29.493 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:14:29.493 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:14:29.493 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:14:29.494 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:29.494 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-11-29T11:14:29.494 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:14:29.564 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:14:29.752 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:14:29.753 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:14:29.753 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:14:29.753 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:29.753 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-11-29T11:14:29.753 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:14:29.819 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627778 2023-11-29T11:14:30.010 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:14:30.010 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:14:30.010 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:14:30.011 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:30.011 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-11-29T11:14:30.011 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:14:30.121 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627776 2023-11-29T11:14:30.308 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:14:30.308 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:14:30.308 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:14:30.308 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:30.309 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-11-29T11:14:30.309 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:14:30.378 INFO:teuthology.orchestra.run.smithi081.stdout:1099511628279 2023-11-29T11:14:30.566 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:14:30.566 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:14:30.566 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:14:30.566 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:30.566 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-11-29T11:14:30.567 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:14:30.636 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627777 2023-11-29T11:14:30.824 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:14:30.824 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:14:30.824 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:14:30.824 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:14:30.824 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-11-29T11:14:30.825 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:14:30.895 INFO:teuthology.orchestra.run.smithi081.stdout:1099511628280 2023-11-29T11:14:31.084 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:14:31.085 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:14:31.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.248+0000 7fd42983d700 1 Processor -- start 2023-11-29T11:14:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.248+0000 7fd42983d700 1 -- start start 2023-11-29T11:14:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.248+0000 7fd42983d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd424159e70 0x7fd42406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.248+0000 7fd42983d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424069c40 0x7fd4240cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.248+0000 7fd42983d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42406ace0 con 0x7fd42406cee0 2023-11-29T11:14:31.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.248+0000 7fd42983d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42406a0d0 con 0x7fd424159e70 2023-11-29T11:14:31.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.248+0000 7fd42983d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42406a3b0 con 0x7fd424069c40 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42883b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd424159e70 0x7fd42406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd41bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424069c40 0x7fd4240cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42903c700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd42406cee0 0x7fd4240b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:39046/0 (socket says 172.21.15.81:39046) 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42903c700 1 -- 172.21.15.81:0/1206892089 learned_addr learned my addr 172.21.15.81:0/1206892089 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd41b7fe700 1 -- 172.21.15.81:0/1206892089 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969352328 0 0) 0x7fd42406ace0 con 0x7fd42406cee0 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd41b7fe700 1 -- 172.21.15.81:0/1206892089 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd40c0035d0 con 0x7fd42406cee0 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42883b700 1 -- 172.21.15.81:0/1206892089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424069c40 msgr2=0x7fd4240cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42883b700 1 --2- 172.21.15.81:0/1206892089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424069c40 0x7fd4240cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42883b700 1 -- 172.21.15.81:0/1206892089 >> v1:172.21.15.176:6789/0 conn(0x7fd42406cee0 legacy=0x7fd4240b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42883b700 1 -- 172.21.15.81:0/1206892089 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42406a690 con 0x7fd424159e70 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42883b700 1 --2- 172.21.15.81:0/1206892089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424159e70 0x7fd42406c9a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd420009850 tx=0x7fd420009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e4f872e95562a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd41b7fe700 1 -- 172.21.15.81:0/1206892089 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420011830 con 0x7fd424159e70 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd41b7fe700 1 -- 172.21.15.81:0/1206892089 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420011990 con 0x7fd424159e70 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd41b7fe700 1 -- 172.21.15.81:0/1206892089 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420011d40 con 0x7fd424159e70 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42983d700 1 -- 172.21.15.81:0/1206892089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424159e70 msgr2=0x7fd42406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42983d700 1 --2- 172.21.15.81:0/1206892089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424159e70 0x7fd42406c9a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd420009850 tx=0x7fd420009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42983d700 1 -- 172.21.15.81:0/1206892089 shutdown_connections 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42983d700 1 --2- 172.21.15.81:0/1206892089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424069c40 0x7fd4240cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42983d700 1 --2- 172.21.15.81:0/1206892089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424159e70 0x7fd42406c9a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42983d700 1 -- 172.21.15.81:0/1206892089 >> 172.21.15.81:0/1206892089 conn(0x7fd4240ce3e0 msgr2=0x7fd4240ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42983d700 1 -- 172.21.15.81:0/1206892089 shutdown_connections 2023-11-29T11:14:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.252+0000 7fd42983d700 1 -- 172.21.15.81:0/1206892089 wait complete. 2023-11-29T11:14:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 Processor -- start 2023-11-29T11:14:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 -- start start 2023-11-29T11:14:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424069c40 0x7fd4240c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd42406cee0 0x7fd4240c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424159e70 0x7fd424157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240c5bb0 con 0x7fd42406cee0 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240c5e90 con 0x7fd424069c40 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240c6170 con 0x7fd424159e70 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd42406cee0 0x7fd4240c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd42406cee0 0x7fd4240c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52420/0 (socket says 172.21.15.81:52420) 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 -- 172.21.15.81:0/2019950025 learned_addr learned my addr 172.21.15.81:0/2019950025 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42883b700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424069c40 0x7fd4240c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42903c700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424159e70 0x7fd424157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 -- 172.21.15.81:0/2019950025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424159e70 msgr2=0x7fd424157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424159e70 0x7fd424157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 -- 172.21.15.81:0/2019950025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424069c40 msgr2=0x7fd4240c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424069c40 0x7fd4240c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 -- 172.21.15.81:0/2019950025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200094b0 con 0x7fd42406cee0 2023-11-29T11:14:31.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd41bfff700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd42406cee0 0x7fd4240c54b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd41400e9d0 tx=0x7fd41400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd4197fa700 1 -- 172.21.15.81:0/2019950025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414009720 con 0x7fd42406cee0 2023-11-29T11:14:31.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd4197fa700 1 -- 172.21.15.81:0/2019950025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41400c850 con 0x7fd42406cee0 2023-11-29T11:14:31.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42415a240 con 0x7fd42406cee0 2023-11-29T11:14:31.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd4197fa700 1 -- 172.21.15.81:0/2019950025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41400cbc0 con 0x7fd42406cee0 2023-11-29T11:14:31.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.256+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42406a970 con 0x7fd42406cee0 2023-11-29T11:14:31.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.260+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4240ca1e0 con 0x7fd42406cee0 2023-11-29T11:14:31.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.260+0000 7fd4197fa700 1 -- 172.21.15.81:0/2019950025 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd414019030 con 0x7fd42406cee0 2023-11-29T11:14:31.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.260+0000 7fd4197fa700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd410064ee0 0x7fd410067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.260+0000 7fd4197fa700 1 -- 172.21.15.81:0/2019950025 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd414081fb0 con 0x7fd42406cee0 2023-11-29T11:14:31.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.260+0000 7fd42883b700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd410064ee0 0x7fd410067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.260+0000 7fd42883b700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd410064ee0 0x7fd410067390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd4200090b0 tx=0x7fd42001c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.264+0000 7fd4197fa700 1 -- 172.21.15.81:0/2019950025 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd41404ff90 con 0x7fd42406cee0 2023-11-29T11:14:31.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.432+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd424072500 con 0x7fd42406cee0 2023-11-29T11:14:31.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.432+0000 7fd4197fa700 1 -- 172.21.15.81:0/2019950025 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17974 (secure 0 0 0) 0x7fd4140535b0 con 0x7fd42406cee0 2023-11-29T11:14:31.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:31.441 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:17.829695+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:14:14.596602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-29T11:14:15.817550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd410064ee0 msgr2=0x7fd410067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd410064ee0 0x7fd410067390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd4200090b0 tx=0x7fd42001c040 comp rx=0 tx=0).stop 2023-11-29T11:14:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd42406cee0 msgr2=0x7fd4240c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd42406cee0 0x7fd4240c54b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd41400e9d0 tx=0x7fd41400ece0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 shutdown_connections 2023-11-29T11:14:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd410064ee0 0x7fd410067390 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd424159e70 0x7fd424157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd42406cee0 0x7fd4240c54b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 --2- 172.21.15.81:0/2019950025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd424069c40 0x7fd4240c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 >> 172.21.15.81:0/2019950025 conn(0x7fd4240ce3e0 msgr2=0x7fd4240af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 shutdown_connections 2023-11-29T11:14:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.436+0000 7fd42983d700 1 -- 172.21.15.81:0/2019950025 wait complete. 2023-11-29T11:14:31.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:14:14.596602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:14:15.817550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:14:31.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:14:31.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.568+0000 7f3dd759e700 1 Processor -- start 2023-11-29T11:14:31.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.568+0000 7f3dd759e700 1 -- start start 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd80b1ae0 0x7f3dd806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3dd806a4c0 0x7f3dd80d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd806a9c0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd806aca0 con 0x7f3dd806a4c0 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd806af80 con 0x7f3dd80b1ae0 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd5d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3dd806a4c0 0x7f3dd80d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd6d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3dd80cf0e0 0x7f3dd80b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33106/0 (socket says 172.21.15.81:33106) 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd5d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3dd806a4c0 0x7f3dd80d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52432/0 (socket says 172.21.15.81:52432) 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd6d9d700 1 -- 172.21.15.81:0/547829677 learned_addr learned my addr 172.21.15.81:0/547829677 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd659c700 1 --2- 172.21.15.81:0/547829677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd80b1ae0 0x7f3dd806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd5d9b700 1 -- 172.21.15.81:0/547829677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd80b1ae0 msgr2=0x7f3dd806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd5d9b700 1 --2- 172.21.15.81:0/547829677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd80b1ae0 0x7f3dd806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd5d9b700 1 -- 172.21.15.81:0/547829677 >> v1:172.21.15.81:6789/0 conn(0x7f3dd80cf0e0 legacy=0x7f3dd80b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd559a700 1 -- 172.21.15.81:0/547829677 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549316496 0 0) 0x7f3dd806a9c0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd5d9b700 1 -- 172.21.15.81:0/547829677 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80b4380 con 0x7f3dd806a4c0 2023-11-29T11:14:31.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd5d9b700 1 --2- 172.21.15.81:0/547829677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd806a4c0 0x7f3dd80d03a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009850 tx=0x7f3dc8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bc86b22f6e550c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd559a700 1 -- 172.21.15.81:0/547829677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8011830 con 0x7f3dd806a4c0 2023-11-29T11:14:31.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd559a700 1 -- 172.21.15.81:0/547829677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8011990 con 0x7f3dd806a4c0 2023-11-29T11:14:31.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd559a700 1 -- 172.21.15.81:0/547829677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8011d40 con 0x7f3dd806a4c0 2023-11-29T11:14:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd759e700 1 -- 172.21.15.81:0/547829677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd806a4c0 msgr2=0x7f3dd80d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.572+0000 7f3dd759e700 1 --2- 172.21.15.81:0/547829677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd806a4c0 0x7f3dd80d03a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009850 tx=0x7f3dc8009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.576+0000 7f3dd759e700 1 -- 172.21.15.81:0/547829677 shutdown_connections 2023-11-29T11:14:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.576+0000 7f3dd759e700 1 --2- 172.21.15.81:0/547829677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd806a4c0 0x7f3dd80d03a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.576+0000 7f3dd759e700 1 --2- 172.21.15.81:0/547829677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd80b1ae0 0x7f3dd806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.576+0000 7f3dd759e700 1 -- 172.21.15.81:0/547829677 >> 172.21.15.81:0/547829677 conn(0x7f3dd809bbd0 msgr2=0x7f3dd80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.576+0000 7f3dd759e700 1 -- 172.21.15.81:0/547829677 shutdown_connections 2023-11-29T11:14:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.576+0000 7f3dd759e700 1 -- 172.21.15.81:0/547829677 wait complete. 2023-11-29T11:14:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.576+0000 7f3dd759e700 1 Processor -- start 2023-11-29T11:14:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.576+0000 7f3dd759e700 1 -- start start 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd806a4c0 0x7f3dd80c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd80b1ae0 0x7f3dd815b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd80cf0e0 0x7f3dd80b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80c8940 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80c84b0 con 0x7f3dd80b1ae0 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80c78a0 con 0x7f3dd806a4c0 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd80cf0e0 0x7f3dd80b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd80cf0e0 0x7f3dd80b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52442/0 (socket says 172.21.15.81:52442) 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 -- 172.21.15.81:0/89190940 learned_addr learned my addr 172.21.15.81:0/89190940 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd659c700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd806a4c0 0x7f3dd80c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd5d9b700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd80b1ae0 0x7f3dd815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 -- 172.21.15.81:0/89190940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd806a4c0 msgr2=0x7f3dd80c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd806a4c0 0x7f3dd80c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 -- 172.21.15.81:0/89190940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd80b1ae0 msgr2=0x7f3dd815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd80b1ae0 0x7f3dd815b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 -- 172.21.15.81:0/89190940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc80094b0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd6d9d700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd80cf0e0 0x7f3dd80b46f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0002230 tx=0x7f3dd000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dc6ffd700 1 -- 172.21.15.81:0/89190940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000aac0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dc6ffd700 1 -- 172.21.15.81:0/89190940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd000ac40 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd80b60e0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dc6ffd700 1 -- 172.21.15.81:0/89190940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00070d0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd80b1eb0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd80d08e0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.580+0000 7f3dc6ffd700 1 -- 172.21.15.81:0/89190940 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3dd001a030 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.584+0000 7f3dc6ffd700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3db8064ee0 0x7f3db8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.584+0000 7f3dc6ffd700 1 -- 172.21.15.81:0/89190940 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3dd0081c30 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.584+0000 7f3dd659c700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3db8064ee0 0x7f3db8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.584+0000 7f3dd659c700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3db8064ee0 0x7f3db8067390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3dd809ff10 tx=0x7f3dcc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.592+0000 7f3dc6ffd700 1 -- 172.21.15.81:0/89190940 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3dd004fc90 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3dd80c8620 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dc6ffd700 1 -- 172.21.15.81:0/89190940 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3dd00180a0 con 0x7f3dd80cf0e0 2023-11-29T11:14:31.754 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3db8064ee0 msgr2=0x7f3db8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3db8064ee0 0x7f3db8067390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3dd809ff10 tx=0x7f3dcc009240 comp rx=0 tx=0).stop 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd80cf0e0 msgr2=0x7f3dd80b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd80cf0e0 0x7f3dd80b46f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0002230 tx=0x7f3dd000cf50 comp rx=0 tx=0).stop 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 shutdown_connections 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3db8064ee0 0x7f3db8067390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dd80cf0e0 0x7f3dd80b46f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dd80b1ae0 0x7f3dd815b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 --2- 172.21.15.81:0/89190940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dd806a4c0 0x7f3dd80c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 >> 172.21.15.81:0/89190940 conn(0x7f3dd809bbd0 msgr2=0x7f3dd80b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 shutdown_connections 2023-11-29T11:14:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.748+0000 7f3dd759e700 1 -- 172.21.15.81:0/89190940 wait complete. 2023-11-29T11:14:31.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:14:31.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f373043a700 1 Processor -- start 2023-11-29T11:14:31.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f373043a700 1 -- start start 2023-11-29T11:14:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f373043a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3728156a70 0x7f37280c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f373043a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3728160700 0x7f3728069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f373043a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37280c8f00 con 0x7f37280ca4e0 2023-11-29T11:14:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f373043a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37280c91e0 con 0x7f3728156a70 2023-11-29T11:14:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f373043a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37280c94c0 con 0x7f3728160700 2023-11-29T11:14:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372e1d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3728156a70 0x7f37280c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372d9d5700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f37280ca4e0 0x7f372815fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33118/0 (socket says 172.21.15.81:33118) 2023-11-29T11:14:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372e1d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3728156a70 0x7f37280c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52458/0 (socket says 172.21.15.81:52458) 2023-11-29T11:14:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372d9d5700 1 -- 172.21.15.81:0/3433503055 learned_addr learned my addr 172.21.15.81:0/3433503055 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372e9d7700 1 --2- 172.21.15.81:0/3433503055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3728160700 0x7f3728069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372e1d6700 1 -- 172.21.15.81:0/3433503055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3728160700 msgr2=0x7f3728069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372e1d6700 1 --2- 172.21.15.81:0/3433503055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3728160700 0x7f3728069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372e1d6700 1 -- 172.21.15.81:0/3433503055 >> v1:172.21.15.81:6789/0 conn(0x7f37280ca4e0 legacy=0x7f372815fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372e1d6700 1 -- 172.21.15.81:0/3433503055 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37280c97a0 con 0x7f3728156a70 2023-11-29T11:14:31.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372e1d6700 1 --2- 172.21.15.81:0/3433503055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37280c9fa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3724009850 tx=0x7f3724009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a62dc1c7736f4ed server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372d1d4700 1 -- 172.21.15.81:0/3433503055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724011830 con 0x7f3728156a70 2023-11-29T11:14:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372d1d4700 1 -- 172.21.15.81:0/3433503055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3724011990 con 0x7f3728156a70 2023-11-29T11:14:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.880+0000 7f372d1d4700 1 -- 172.21.15.81:0/3433503055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724011d20 con 0x7f3728156a70 2023-11-29T11:14:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- 172.21.15.81:0/3433503055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 msgr2=0x7f37280c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 --2- 172.21.15.81:0/3433503055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37280c9fa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3724009850 tx=0x7f3724009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- 172.21.15.81:0/3433503055 shutdown_connections 2023-11-29T11:14:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 --2- 172.21.15.81:0/3433503055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3728160700 0x7f3728069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 --2- 172.21.15.81:0/3433503055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37280c9fa0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- 172.21.15.81:0/3433503055 >> 172.21.15.81:0/3433503055 conn(0x7f37280cf4a0 msgr2=0x7f37280cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- 172.21.15.81:0/3433503055 shutdown_connections 2023-11-29T11:14:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- 172.21.15.81:0/3433503055 wait complete. 2023-11-29T11:14:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 Processor -- start 2023-11-29T11:14:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- start start 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37280ca4e0 0x7f37281420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37281f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728160700 0x7f372815ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3728145a60 con 0x7f3728156a70 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3728142620 con 0x7f3728160700 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37281f5d20 con 0x7f37280ca4e0 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37281f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37281f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52470/0 (socket says 172.21.15.81:52470) 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 -- 172.21.15.81:0/2284153869 learned_addr learned my addr 172.21.15.81:0/2284153869 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372e9d7700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728160700 0x7f372815ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372e1d6700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37280ca4e0 0x7f37281420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 -- 172.21.15.81:0/2284153869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37280ca4e0 msgr2=0x7f37281420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37280ca4e0 0x7f37281420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 -- 172.21.15.81:0/2284153869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728160700 msgr2=0x7f372815ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728160700 0x7f372815ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 -- 172.21.15.81:0/2284153869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240094b0 con 0x7f3728156a70 2023-11-29T11:14:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f372d9d5700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37281f15f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c760 tx=0x7f371c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f371affd700 1 -- 172.21.15.81:0/2284153869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c005d90 con 0x7f3728156a70 2023-11-29T11:14:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f371affd700 1 -- 172.21.15.81:0/2284153869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c0070d0 con 0x7f3728156a70 2023-11-29T11:14:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3728156e40 con 0x7f3728156a70 2023-11-29T11:14:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f371affd700 1 -- 172.21.15.81:0/2284153869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c007440 con 0x7f3728156a70 2023-11-29T11:14:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.884+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37280c9a80 con 0x7f3728156a70 2023-11-29T11:14:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.888+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372806a180 con 0x7f3728156a70 2023-11-29T11:14:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.888+0000 7f371affd700 1 -- 172.21.15.81:0/2284153869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f371c019030 con 0x7f3728156a70 2023-11-29T11:14:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.888+0000 7f371affd700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f370c064ee0 0x7f370c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.888+0000 7f371affd700 1 -- 172.21.15.81:0/2284153869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f371c081210 con 0x7f3728156a70 2023-11-29T11:14:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.888+0000 7f372e1d6700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f370c064ee0 0x7f370c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.888+0000 7f372e1d6700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f370c064ee0 0x7f370c067390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3724000c00 tx=0x7f3724008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:31.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:31.896+0000 7f371affd700 1 -- 172.21.15.81:0/2284153869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f371c04a400 con 0x7f3728156a70 2023-11-29T11:14:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.056+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3728072500 con 0x7f3728156a70 2023-11-29T11:14:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.056+0000 7f371affd700 1 -- 172.21.15.81:0/2284153869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f371c04f320 con 0x7f3728156a70 2023-11-29T11:14:32.062 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:14:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f370c064ee0 msgr2=0x7f370c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f370c064ee0 0x7f370c067390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3724000c00 tx=0x7f3724008030 comp rx=0 tx=0).stop 2023-11-29T11:14:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 msgr2=0x7f37281f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37281f15f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c760 tx=0x7f371c00cb20 comp rx=0 tx=0).stop 2023-11-29T11:14:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 shutdown_connections 2023-11-29T11:14:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f370c064ee0 0x7f370c067390 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3728160700 0x7f372815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3728156a70 0x7f37281f15f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 --2- 172.21.15.81:0/2284153869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37280ca4e0 0x7f37281420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 >> 172.21.15.81:0/2284153869 conn(0x7f37280cf4a0 msgr2=0x7f372815def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 shutdown_connections 2023-11-29T11:14:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.060+0000 7f373043a700 1 -- 172.21.15.81:0/2284153869 wait complete. 2023-11-29T11:14:32.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:14:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.192+0000 7fb893fff700 1 Processor -- start 2023-11-29T11:14:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.192+0000 7fb893fff700 1 -- start start 2023-11-29T11:14:32.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb89406ce60 0x7fb8940d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb8940cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8940cd300 con 0x7fb8940cce60 2023-11-29T11:14:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89415c8b0 con 0x7fb89406ce60 2023-11-29T11:14:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89406a7f0 con 0x7fb8940cf470 2023-11-29T11:14:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb8927fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8940cce60 0x7fb89406d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33132/0 (socket says 172.21.15.81:33132) 2023-11-29T11:14:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb892ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb89406ce60 0x7fb8940d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb8927fc700 1 -- 172.21.15.81:0/55864430 learned_addr learned my addr 172.21.15.81:0/55864430 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb8937fe700 1 --2- 172.21.15.81:0/55864430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb8940cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb891ffb700 1 -- 172.21.15.81:0/55864430 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223982897 0 0) 0x7fb87c001110 con 0x7fb8940cce60 2023-11-29T11:14:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb891ffb700 1 -- 172.21.15.81:0/55864430 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8800035d0 con 0x7fb8940cce60 2023-11-29T11:14:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb892ffd700 1 -- 172.21.15.81:0/55864430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 msgr2=0x7fb8940cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb892ffd700 1 --2- 172.21.15.81:0/55864430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb8940cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb892ffd700 1 -- 172.21.15.81:0/55864430 >> v1:172.21.15.81:6789/0 conn(0x7fb8940cce60 legacy=0x7fb89406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb892ffd700 1 -- 172.21.15.81:0/55864430 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89406aad0 con 0x7fb89406ce60 2023-11-29T11:14:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb8937fe700 1 --2- 172.21.15.81:0/55864430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb8940cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb892ffd700 1 --2- 172.21.15.81:0/55864430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89406ce60 0x7fb8940d31b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb884009880 tx=0x7fb884009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4552ed457af6cf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb891ffb700 1 -- 172.21.15.81:0/55864430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884011830 con 0x7fb89406ce60 2023-11-29T11:14:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb891ffb700 1 -- 172.21.15.81:0/55864430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb884011990 con 0x7fb89406ce60 2023-11-29T11:14:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb891ffb700 1 -- 172.21.15.81:0/55864430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884011d20 con 0x7fb89406ce60 2023-11-29T11:14:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- 172.21.15.81:0/55864430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89406ce60 msgr2=0x7fb8940d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 --2- 172.21.15.81:0/55864430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89406ce60 0x7fb8940d31b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb884009880 tx=0x7fb884009b90 comp rx=0 tx=0).stop 2023-11-29T11:14:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- 172.21.15.81:0/55864430 shutdown_connections 2023-11-29T11:14:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 --2- 172.21.15.81:0/55864430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb8940cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 --2- 172.21.15.81:0/55864430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89406ce60 0x7fb8940d31b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- 172.21.15.81:0/55864430 >> 172.21.15.81:0/55864430 conn(0x7fb8940b5760 msgr2=0x7fb8940b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- 172.21.15.81:0/55864430 shutdown_connections 2023-11-29T11:14:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- 172.21.15.81:0/55864430 wait complete. 2023-11-29T11:14:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 Processor -- start 2023-11-29T11:14:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.196+0000 7fb893fff700 1 -- start start 2023-11-29T11:14:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb893fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8940cce60 0x7fb8940b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb893fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb89414cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb893fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8940c6300 0x7fb8940b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb893fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940c7410 con 0x7fb8940cce60 2023-11-29T11:14:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb893fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940c6800 con 0x7fb8940c6300 2023-11-29T11:14:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb893fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940c6ae0 con 0x7fb8940cf470 2023-11-29T11:14:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8940cce60 0x7fb8940b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8940cce60 0x7fb8940b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52490/0 (socket says 172.21.15.81:52490) 2023-11-29T11:14:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 -- 172.21.15.81:0/4023925995 learned_addr learned my addr 172.21.15.81:0/4023925995 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb8927fc700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb89414cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb8937fe700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8940c6300 0x7fb8940b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 -- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 msgr2=0x7fb89414cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb89414cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 -- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8940c6300 msgr2=0x7fb8940b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8940c6300 0x7fb8940b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 -- 172.21.15.81:0/4023925995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8840094b0 con 0x7fb8940cce60 2023-11-29T11:14:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb8937fe700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8940c6300 0x7fb8940b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb892ffd700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8940cce60 0x7fb8940b4a80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb8840090b0 tx=0x7fb884004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb88b7fe700 1 -- 172.21.15.81:0/4023925995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884004340 con 0x7fb8940cce60 2023-11-29T11:14:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89406b090 con 0x7fb8940cce60 2023-11-29T11:14:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb88b7fe700 1 -- 172.21.15.81:0/4023925995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88401f070 con 0x7fb8940cce60 2023-11-29T11:14:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb88b7fe700 1 -- 172.21.15.81:0/4023925995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8840036c0 con 0x7fb8940cce60 2023-11-29T11:14:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.200+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89406adb0 con 0x7fb8940cce60 2023-11-29T11:14:32.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.204+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8940b6470 con 0x7fb8940cce60 2023-11-29T11:14:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.204+0000 7fb88b7fe700 1 -- 172.21.15.81:0/4023925995 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb88402a020 con 0x7fb8940cce60 2023-11-29T11:14:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.204+0000 7fb88b7fe700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb874064f10 0x7fb8740673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.204+0000 7fb8927fc700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb874064f10 0x7fb8740673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.204+0000 7fb88b7fe700 1 -- 172.21.15.81:0/4023925995 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb884083390 con 0x7fb8940cce60 2023-11-29T11:14:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.204+0000 7fb8927fc700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb874064f10 0x7fb8740673c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb87c007fd0 tx=0x7fb87c007c60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.212+0000 7fb88b7fe700 1 -- 172.21.15.81:0/4023925995 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb884051370 con 0x7fb8940cce60 2023-11-29T11:14:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.376+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb894072c20 con 0x7fb8940cce60 2023-11-29T11:14:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.376+0000 7fb88b7fe700 1 -- 172.21.15.81:0/4023925995 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb884054990 con 0x7fb8940cce60 2023-11-29T11:14:32.383 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:14:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb874064f10 msgr2=0x7fb8740673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb874064f10 0x7fb8740673c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb87c007fd0 tx=0x7fb87c007c60 comp rx=0 tx=0).stop 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8940cce60 msgr2=0x7fb8940b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8940cce60 0x7fb8940b4a80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb8840090b0 tx=0x7fb884004770 comp rx=0 tx=0).stop 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 shutdown_connections 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb874064f10 0x7fb8740673c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8940c6300 0x7fb8940b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8940cf470 0x7fb89414cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 --2- 172.21.15.81:0/4023925995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8940cce60 0x7fb8940b4a80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 >> 172.21.15.81:0/4023925995 conn(0x7fb8940b5760 msgr2=0x7fb894069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 shutdown_connections 2023-11-29T11:14:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.380+0000 7fb893fff700 1 -- 172.21.15.81:0/4023925995 wait complete. 2023-11-29T11:14:32.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:14:32.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.516+0000 7ff39242f700 1 Processor -- start 2023-11-29T11:14:32.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.516+0000 7ff39242f700 1 -- start start 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3840e0870 0x7ff384054c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff38403b520 0x7ff384006d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840547d0 con 0x7ff384034d30 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff384039c40 con 0x7ff3840e0870 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840094b0 con 0x7ff38403b520 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39142d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3840e0870 0x7ff384054c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39142d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3840e0870 0x7ff384054c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52504/0 (socket says 172.21.15.81:52504) 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39142d700 1 -- 172.21.15.81:0/1693845975 learned_addr learned my addr 172.21.15.81:0/1693845975 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff391c2e700 1 --2- 172.21.15.81:0/1693845975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff38403b520 0x7ff384006d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39142d700 1 -- 172.21.15.81:0/1693845975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff38403b520 msgr2=0x7ff384006d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39142d700 1 --2- 172.21.15.81:0/1693845975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff38403b520 0x7ff384006d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39142d700 1 -- 172.21.15.81:0/1693845975 >> v1:172.21.15.176:6789/0 conn(0x7ff384034d30 legacy=0x7ff38403ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39142d700 1 -- 172.21.15.81:0/1693845975 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384009790 con 0x7ff3840e0870 2023-11-29T11:14:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39142d700 1 --2- 172.21.15.81:0/1693845975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3840e0870 0x7ff384054c60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff388009910 tx=0x7ff388009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66864529d835ebe7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff383fff700 1 -- 172.21.15.81:0/1693845975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388004230 con 0x7ff3840e0870 2023-11-29T11:14:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff383fff700 1 -- 172.21.15.81:0/1693845975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff388004390 con 0x7ff3840e0870 2023-11-29T11:14:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff383fff700 1 -- 172.21.15.81:0/1693845975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3880036c0 con 0x7ff3840e0870 2023-11-29T11:14:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 -- 172.21.15.81:0/1693845975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3840e0870 msgr2=0x7ff384054c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 --2- 172.21.15.81:0/1693845975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3840e0870 0x7ff384054c60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff388009910 tx=0x7ff388009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 -- 172.21.15.81:0/1693845975 shutdown_connections 2023-11-29T11:14:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 --2- 172.21.15.81:0/1693845975 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff38403b520 0x7ff384006d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 --2- 172.21.15.81:0/1693845975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3840e0870 0x7ff384054c60 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 -- 172.21.15.81:0/1693845975 >> 172.21.15.81:0/1693845975 conn(0x7ff384038dc0 msgr2=0x7ff3840391c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.520+0000 7ff39242f700 1 -- 172.21.15.81:0/1693845975 shutdown_connections 2023-11-29T11:14:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 -- 172.21.15.81:0/1693845975 wait complete. 2023-11-29T11:14:32.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 Processor -- start 2023-11-29T11:14:32.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 -- start start 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff384034d30 0x7ff3840c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38403b520 0x7ff3840dc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3840e0870 0x7ff3840dca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384038030 con 0x7ff38403b520 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38404c100 con 0x7ff384034d30 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39242f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38404c3e0 con 0x7ff3840e0870 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff390c2c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38403b520 0x7ff3840dc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39142d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff384034d30 0x7ff3840c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39142d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff384034d30 0x7ff3840c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:52322/0 (socket says 172.21.15.81:52322) 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff39142d700 1 -- 172.21.15.81:0/332866988 learned_addr learned my addr 172.21.15.81:0/332866988 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff391c2e700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3840e0870 0x7ff3840dca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff390c2c700 1 -- 172.21.15.81:0/332866988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3840e0870 msgr2=0x7ff3840dca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.524+0000 7ff390c2c700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3840e0870 0x7ff3840dca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff390c2c700 1 -- 172.21.15.81:0/332866988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff384034d30 msgr2=0x7ff3840c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff390c2c700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff384034d30 0x7ff3840c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff390c2c700 1 -- 172.21.15.81:0/332866988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388009570 con 0x7ff38403b520 2023-11-29T11:14:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff390c2c700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38403b520 0x7ff3840dc450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff38400e390 tx=0x7ff37c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff381ffb700 1 -- 172.21.15.81:0/332866988 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c011590 con 0x7ff38403b520 2023-11-29T11:14:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff381ffb700 1 -- 172.21.15.81:0/332866988 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c0116f0 con 0x7ff38403b520 2023-11-29T11:14:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff381ffb700 1 -- 172.21.15.81:0/332866988 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c011aa0 con 0x7ff38403b520 2023-11-29T11:14:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3840e0c40 con 0x7ff38403b520 2023-11-29T11:14:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff384054460 con 0x7ff38403b520 2023-11-29T11:14:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3840398d0 con 0x7ff38403b520 2023-11-29T11:14:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff381ffb700 1 -- 172.21.15.81:0/332866988 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff37c010050 con 0x7ff38403b520 2023-11-29T11:14:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff381ffb700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff370064ee0 0x7ff370067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff381ffb700 1 -- 172.21.15.81:0/332866988 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff37c081b00 con 0x7ff38403b520 2023-11-29T11:14:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.528+0000 7ff39142d700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff370064ee0 0x7ff370067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.532+0000 7ff39142d700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff370064ee0 0x7ff370067390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff388009c60 tx=0x7ff388008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.536+0000 7ff381ffb700 1 -- 172.21.15.81:0/332866988 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff37c04fae0 con 0x7ff38403b520 2023-11-29T11:14:32.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3840059c0 con 0x7ff38403b520 2023-11-29T11:14:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff381ffb700 1 -- 172.21.15.81:0/332866988 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff37c053100 con 0x7ff38403b520 2023-11-29T11:14:32.706 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:14:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff370064ee0 msgr2=0x7ff370067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff370064ee0 0x7ff370067390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff388009c60 tx=0x7ff388008030 comp rx=0 tx=0).stop 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38403b520 msgr2=0x7ff3840dc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38403b520 0x7ff3840dc450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff38400e390 tx=0x7ff37c00c740 comp rx=0 tx=0).stop 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 shutdown_connections 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff370064ee0 0x7ff370067390 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3840e0870 0x7ff3840dca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38403b520 0x7ff3840dc450 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 --2- 172.21.15.81:0/332866988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff384034d30 0x7ff3840c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 >> 172.21.15.81:0/332866988 conn(0x7ff384038dc0 msgr2=0x7ff3840de670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 shutdown_connections 2023-11-29T11:14:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.700+0000 7ff39242f700 1 -- 172.21.15.81:0/332866988 wait complete. 2023-11-29T11:14:32.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:14:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9bab59e700 1 Processor -- start 2023-11-29T11:14:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9bab59e700 1 -- start start 2023-11-29T11:14:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9bab59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bac06d7d0 0x7f9bac06a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9bab59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac06dc70 con 0x7f9bac0cf050 2023-11-29T11:14:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9bab59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac15c6d0 con 0x7f9bac0b4c10 2023-11-29T11:14:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9bab59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac06aa70 con 0x7f9bac06d7d0 2023-11-29T11:14:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9baa59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9bac0cf050 0x7f9bac0cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33148/0 (socket says 172.21.15.81:33148) 2023-11-29T11:14:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9baa59c700 1 -- 172.21.15.81:0/1312368034 learned_addr learned my addr 172.21.15.81:0/1312368034 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba9d9b700 1 --2- 172.21.15.81:0/1312368034 >> v2:172.21.15.81:3300/0 conn(0x7f9bac06d7d0 0x7f9bac06a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba959a700 1 -- 172.21.15.81:0/1312368034 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200403215 0 0) 0x7f9b94001490 con 0x7f9bac0cf050 2023-11-29T11:14:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba959a700 1 -- 172.21.15.81:0/1312368034 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b980035d0 con 0x7f9bac0cf050 2023-11-29T11:14:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba9d9b700 1 -- 172.21.15.81:0/1312368034 >> v1:172.21.15.176:6789/0 conn(0x7f9bac0b4c10 legacy=0x7f9bac0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba9d9b700 1 -- 172.21.15.81:0/1312368034 >> v1:172.21.15.81:6789/0 conn(0x7f9bac0cf050 legacy=0x7f9bac0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba9d9b700 1 -- 172.21.15.81:0/1312368034 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac06ac60 con 0x7f9bac06d7d0 2023-11-29T11:14:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba9d9b700 1 --2- 172.21.15.81:0/1312368034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac06d7d0 0x7f9bac06a530 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009850 tx=0x7f9b9c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ff2d7a520ca04d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba959a700 1 -- 172.21.15.81:0/1312368034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c011830 con 0x7f9bac06d7d0 2023-11-29T11:14:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba959a700 1 -- 172.21.15.81:0/1312368034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c011990 con 0x7f9bac06d7d0 2023-11-29T11:14:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9ba959a700 1 -- 172.21.15.81:0/1312368034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c011d00 con 0x7f9bac06d7d0 2023-11-29T11:14:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9bab59e700 1 -- 172.21.15.81:0/1312368034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac06d7d0 msgr2=0x7f9bac06a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.832+0000 7f9bab59e700 1 --2- 172.21.15.81:0/1312368034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac06d7d0 0x7f9bac06a530 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009850 tx=0x7f9b9c009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 -- 172.21.15.81:0/1312368034 shutdown_connections 2023-11-29T11:14:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 --2- 172.21.15.81:0/1312368034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac06d7d0 0x7f9bac06a530 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 -- 172.21.15.81:0/1312368034 >> 172.21.15.81:0/1312368034 conn(0x7f9bac09bb30 msgr2=0x7f9bac0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 -- 172.21.15.81:0/1312368034 shutdown_connections 2023-11-29T11:14:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 -- 172.21.15.81:0/1312368034 wait complete. 2023-11-29T11:14:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 Processor -- start 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 -- start start 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac06d7d0 0x7f9bac1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac0b4c10 0x7f9bac15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac0cf050 0x7f9bac15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c7ae0 con 0x7f9bac0cf050 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1521d0 con 0x7f9bac0b4c10 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9bab59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac15e450 con 0x7f9bac06d7d0 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9baad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac0cf050 0x7f9bac15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9ba9d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac0b4c10 0x7f9bac15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9baad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac0cf050 0x7f9bac15eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52530/0 (socket says 172.21.15.81:52530) 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9baad9d700 1 -- 172.21.15.81:0/1038262062 learned_addr learned my addr 172.21.15.81:0/1038262062 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.836+0000 7f9baa59c700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac06d7d0 0x7f9bac1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9baad9d700 1 -- 172.21.15.81:0/1038262062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac06d7d0 msgr2=0x7f9bac1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9baad9d700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac06d7d0 0x7f9bac1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9baad9d700 1 -- 172.21.15.81:0/1038262062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac0b4c10 msgr2=0x7f9bac15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9baad9d700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac0b4c10 0x7f9bac15daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9baad9d700 1 -- 172.21.15.81:0/1038262062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c0094b0 con 0x7f9bac0cf050 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9baad9d700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac0cf050 0x7f9bac15eea0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c500 tx=0x7f9ba400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9ba2ffd700 1 -- 172.21.15.81:0/1038262062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40052d0 con 0x7f9bac0cf050 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9ba2ffd700 1 -- 172.21.15.81:0/1038262062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4005430 con 0x7f9bac0cf050 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac0b4410 con 0x7f9bac0cf050 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9ba2ffd700 1 -- 172.21.15.81:0/1038262062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40055a0 con 0x7f9bac0cf050 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac06af40 con 0x7f9bac0cf050 2023-11-29T11:14:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.840+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac0b46f0 con 0x7f9bac0cf050 2023-11-29T11:14:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.844+0000 7f9ba2ffd700 1 -- 172.21.15.81:0/1038262062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ba4010050 con 0x7f9bac0cf050 2023-11-29T11:14:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.844+0000 7f9ba2ffd700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b8c064f10 0x7f9b8c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.844+0000 7f9ba2ffd700 1 -- 172.21.15.81:0/1038262062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9ba4081060 con 0x7f9bac0cf050 2023-11-29T11:14:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.844+0000 7f9baa59c700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b8c064f10 0x7f9b8c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.844+0000 7f9baa59c700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b8c064f10 0x7f9b8c0673c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b940015f0 tx=0x7f9b94001a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:32.852+0000 7f9ba2ffd700 1 -- 172.21.15.81:0/1038262062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ba4049400 con 0x7f9bac0cf050 2023-11-29T11:14:33.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9bac072500 con 0x7f9bac0cf050 2023-11-29T11:14:33.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9ba2ffd700 1 -- 172.21.15.81:0/1038262062 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9ba404efe0 con 0x7f9bac0cf050 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b8c064f10 msgr2=0x7f9b8c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b8c064f10 0x7f9b8c0673c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b940015f0 tx=0x7f9b94001a00 comp rx=0 tx=0).stop 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac0cf050 msgr2=0x7f9bac15eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac0cf050 0x7f9bac15eea0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c500 tx=0x7f9ba400c810 comp rx=0 tx=0).stop 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 shutdown_connections 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b8c064f10 0x7f9b8c0673c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac0cf050 0x7f9bac15eea0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac0b4c10 0x7f9bac15daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 --2- 172.21.15.81:0/1038262062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac06d7d0 0x7f9bac1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 >> 172.21.15.81:0/1038262062 conn(0x7f9bac09bb30 msgr2=0x7f9bac069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 shutdown_connections 2023-11-29T11:14:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.028+0000 7f9bab59e700 1 -- 172.21.15.81:0/1038262062 wait complete. 2023-11-29T11:14:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:14:33.049 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:14:33.049 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:14:33.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.156+0000 7fa291291700 1 Processor -- start 2023-11-29T11:14:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.156+0000 7fa291291700 1 -- start start 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.156+0000 7fa291291700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa28c15c3b0 0x7fa28c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.156+0000 7fa291291700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa28c15c780 0x7fa28c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.156+0000 7fa291291700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0cdad0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.156+0000 7fa291291700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28c0cd4c0 con 0x7fa28c15c3b0 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.156+0000 7fa291291700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28c0ca6d0 con 0x7fa28c15c780 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa28c15c3b0 0x7fa28c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa290a90700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa28c0ce4a0 0x7fa28c071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33150/0 (socket says 172.21.15.81:33150) 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa290a90700 1 -- 172.21.15.81:0/3469387515 learned_addr learned my addr 172.21.15.81:0/3469387515 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28b7fe700 1 --2- 172.21.15.81:0/3469387515 >> v2:172.21.15.176:3300/0 conn(0x7fa28c15c780 0x7fa28c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28affd700 1 -- 172.21.15.81:0/3469387515 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707031388 0 0) 0x7fa28c0cdad0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28affd700 1 -- 172.21.15.81:0/3469387515 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2740035d0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28bfff700 1 -- 172.21.15.81:0/3469387515 >> v2:172.21.15.176:3300/0 conn(0x7fa28c15c780 msgr2=0x7fa28c0cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28bfff700 1 --2- 172.21.15.81:0/3469387515 >> v2:172.21.15.176:3300/0 conn(0x7fa28c15c780 0x7fa28c0cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28bfff700 1 -- 172.21.15.81:0/3469387515 >> v1:172.21.15.81:6789/0 conn(0x7fa28c0ce4a0 legacy=0x7fa28c071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28bfff700 1 -- 172.21.15.81:0/3469387515 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0cd760 con 0x7fa28c15c3b0 2023-11-29T11:14:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28bfff700 1 --2- 172.21.15.81:0/3469387515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c15c3b0 0x7fa28c0c9d80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0723b0 tx=0x7fa280009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9849751f9c57f30 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28affd700 1 -- 172.21.15.81:0/3469387515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280011830 con 0x7fa28c15c3b0 2023-11-29T11:14:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28affd700 1 -- 172.21.15.81:0/3469387515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa280011990 con 0x7fa28c15c3b0 2023-11-29T11:14:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa28affd700 1 -- 172.21.15.81:0/3469387515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280011d20 con 0x7fa28c15c3b0 2023-11-29T11:14:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa291291700 1 -- 172.21.15.81:0/3469387515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c15c3b0 msgr2=0x7fa28c0c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa291291700 1 --2- 172.21.15.81:0/3469387515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c15c3b0 0x7fa28c0c9d80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0723b0 tx=0x7fa280009b30 comp rx=0 tx=0).stop 2023-11-29T11:14:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa291291700 1 -- 172.21.15.81:0/3469387515 shutdown_connections 2023-11-29T11:14:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa291291700 1 --2- 172.21.15.81:0/3469387515 >> v2:172.21.15.176:3300/0 conn(0x7fa28c15c780 0x7fa28c0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa291291700 1 --2- 172.21.15.81:0/3469387515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c15c3b0 0x7fa28c0c9d80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa291291700 1 -- 172.21.15.81:0/3469387515 >> 172.21.15.81:0/3469387515 conn(0x7fa28c0b1d40 msgr2=0x7fa28c0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:33.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa291291700 1 -- 172.21.15.81:0/3469387515 shutdown_connections 2023-11-29T11:14:33.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.160+0000 7fa291291700 1 -- 172.21.15.81:0/3469387515 wait complete. 2023-11-29T11:14:33.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 Processor -- start 2023-11-29T11:14:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 -- start start 2023-11-29T11:14:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c0ce4a0 0x7fa28c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa28c15c3b0 0x7fa28c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa28c15c780 0x7fa28c15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0b3ce0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c1f5e50 con 0x7fa28c15c780 2023-11-29T11:14:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c1f62e0 con 0x7fa28c15c3b0 2023-11-29T11:14:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c0ce4a0 0x7fa28c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c0ce4a0 0x7fa28c158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52552/0 (socket says 172.21.15.81:52552) 2023-11-29T11:14:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 -- 172.21.15.81:0/2150308708 learned_addr learned my addr 172.21.15.81:0/2150308708 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa290a90700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa28c15c780 0x7fa28c15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28b7fe700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa28c15c3b0 0x7fa28c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 -- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa28c15c3b0 msgr2=0x7fa28c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa28c15c3b0 0x7fa28c15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 -- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa28c15c780 msgr2=0x7fa28c15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa28c15c780 0x7fa28c15bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 -- 172.21.15.81:0/2150308708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800094b0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28b7fe700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa28c15c3b0 0x7fa28c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa290a90700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa28c15c780 0x7fa28c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa28bfff700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c0ce4a0 0x7fa28c158d60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa280009b70 tx=0x7fa280004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa288ff9700 1 -- 172.21.15.81:0/2150308708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280004480 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa288ff9700 1 -- 172.21.15.81:0/2150308708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28001f070 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c0cab40 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa288ff9700 1 -- 172.21.15.81:0/2150308708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2800038c0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.164+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c0ca9b0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.168+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c0ca2c0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.168+0000 7fa288ff9700 1 -- 172.21.15.81:0/2150308708 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa28002a020 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.168+0000 7fa288ff9700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa278064f10 0x7fa2780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.168+0000 7fa288ff9700 1 -- 172.21.15.81:0/2150308708 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa2800834c0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.168+0000 7fa28b7fe700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa278064f10 0x7fa2780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.168+0000 7fa28b7fe700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa278064f10 0x7fa2780673c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa28c15a9d0 tx=0x7fa27c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.176+0000 7fa288ff9700 1 -- 172.21.15.81:0/2150308708 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa2800514a0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.340+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa28c072500 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa288ff9700 1 -- 172.21.15.81:0/2150308708 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17974 (secure 0 0 0) 0x7fa280054ac0 con 0x7fa28c0ce4a0 2023-11-29T11:14:33.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:33.350 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:17.829695+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:14:14.596602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-29T11:14:15.817550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa278064f10 msgr2=0x7fa2780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa278064f10 0x7fa2780673c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa28c15a9d0 tx=0x7fa27c008040 comp rx=0 tx=0).stop 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c0ce4a0 msgr2=0x7fa28c158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c0ce4a0 0x7fa28c158d60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa280009b70 tx=0x7fa280004770 comp rx=0 tx=0).stop 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 shutdown_connections 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa278064f10 0x7fa2780673c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa28c15c780 0x7fa28c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa28c15c3b0 0x7fa28c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 --2- 172.21.15.81:0/2150308708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c0ce4a0 0x7fa28c158d60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 >> 172.21.15.81:0/2150308708 conn(0x7fa28c0b1d40 msgr2=0x7fa28c1598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 shutdown_connections 2023-11-29T11:14:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.344+0000 7fa291291700 1 -- 172.21.15.81:0/2150308708 wait complete. 2023-11-29T11:14:33.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:14:14.596602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:14:15.817550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:14:33.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:14:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.472+0000 7f54c1487700 1 Processor -- start 2023-11-29T11:14:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.472+0000 7f54c1487700 1 -- start start 2023-11-29T11:14:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54bc0cd5d0 0x7f54bc0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc06d1c0 con 0x7f54bc0ce230 2023-11-29T11:14:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0ca3a0 con 0x7f54bc158ee0 2023-11-29T11:14:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc06e000 con 0x7f54bc0cd5d0 2023-11-29T11:14:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54b37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f54bc0ce230 0x7f54bc0cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33154/0 (socket says 172.21.15.81:33154) 2023-11-29T11:14:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c0c86700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54bc0cd5d0 0x7f54bc0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54b37fe700 1 -- 172.21.15.81:0/3133716512 learned_addr learned my addr 172.21.15.81:0/3133716512 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c0c86700 1 -- 172.21.15.81:0/3133716512 >> v1:172.21.15.176:6789/0 conn(0x7f54bc158ee0 legacy=0x7f54bc0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c0c86700 1 -- 172.21.15.81:0/3133716512 >> v1:172.21.15.81:6789/0 conn(0x7f54bc0ce230 legacy=0x7f54bc0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54bb7fe700 1 -- 172.21.15.81:0/3133716512 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264005018 0 0) 0x7f54a4001290 con 0x7f54bc0ce230 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c0c86700 1 -- 172.21.15.81:0/3133716512 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc06c920 con 0x7f54bc0cd5d0 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c0c86700 1 --2- 172.21.15.81:0/3133716512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0cd5d0 0x7f54bc0ae760 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009d90 tx=0x7f54b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce8e38787c28829 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54bb7fe700 1 -- 172.21.15.81:0/3133716512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400e070 con 0x7f54bc0cd5d0 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54bb7fe700 1 -- 172.21.15.81:0/3133716512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b400bbd0 con 0x7f54bc0cd5d0 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54bb7fe700 1 -- 172.21.15.81:0/3133716512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4012430 con 0x7f54bc0cd5d0 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 -- 172.21.15.81:0/3133716512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0cd5d0 msgr2=0x7f54bc0ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 --2- 172.21.15.81:0/3133716512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0cd5d0 0x7f54bc0ae760 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009d90 tx=0x7f54b400b330 comp rx=0 tx=0).stop 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 -- 172.21.15.81:0/3133716512 shutdown_connections 2023-11-29T11:14:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 --2- 172.21.15.81:0/3133716512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0cd5d0 0x7f54bc0ae760 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 -- 172.21.15.81:0/3133716512 >> 172.21.15.81:0/3133716512 conn(0x7f54bc0d0240 msgr2=0x7f54bc0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:33.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 -- 172.21.15.81:0/3133716512 shutdown_connections 2023-11-29T11:14:33.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.476+0000 7f54c1487700 1 -- 172.21.15.81:0/3133716512 wait complete. 2023-11-29T11:14:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 Processor -- start 2023-11-29T11:14:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 -- start start 2023-11-29T11:14:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc0cd5d0 0x7f54bc15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0ce230 0x7f54bc070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc158ee0 0x7f54bc071400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc15b3a0 con 0x7f54bc0ce230 2023-11-29T11:14:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc15a7f0 con 0x7f54bc158ee0 2023-11-29T11:14:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1f2de0 con 0x7f54bc0cd5d0 2023-11-29T11:14:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0ce230 0x7f54bc070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0ce230 0x7f54bc070ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52572/0 (socket says 172.21.15.81:52572) 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 -- 172.21.15.81:0/3019355933 learned_addr learned my addr 172.21.15.81:0/3019355933 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c0c86700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc158ee0 0x7f54bc071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54bbfff700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc0cd5d0 0x7f54bc15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 -- 172.21.15.81:0/3019355933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc0cd5d0 msgr2=0x7f54bc15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc0cd5d0 0x7f54bc15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 -- 172.21.15.81:0/3019355933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc158ee0 msgr2=0x7f54bc071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc158ee0 0x7f54bc071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 -- 172.21.15.81:0/3019355933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4009a70 con 0x7f54bc0ce230 2023-11-29T11:14:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b37fe700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0ce230 0x7f54bc070ec0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c4d0 tx=0x7f54a400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b97fa700 1 -- 172.21.15.81:0/3019355933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40074e0 con 0x7f54bc0ce230 2023-11-29T11:14:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b97fa700 1 -- 172.21.15.81:0/3019355933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a4007660 con 0x7f54bc0ce230 2023-11-29T11:14:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc06cee0 con 0x7f54bc0ce230 2023-11-29T11:14:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54b97fa700 1 -- 172.21.15.81:0/3019355933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4005a90 con 0x7f54bc0ce230 2023-11-29T11:14:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.480+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc06cc00 con 0x7f54bc0ce230 2023-11-29T11:14:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.484+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc0ca640 con 0x7f54bc0ce230 2023-11-29T11:14:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.484+0000 7f54b97fa700 1 -- 172.21.15.81:0/3019355933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f54a4019030 con 0x7f54bc0ce230 2023-11-29T11:14:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.484+0000 7f54b97fa700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f549c064ee0 0x7f549c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.484+0000 7f54bbfff700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f549c064ee0 0x7f549c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.484+0000 7f54b97fa700 1 -- 172.21.15.81:0/3019355933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f54a4081090 con 0x7f54bc0ce230 2023-11-29T11:14:33.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.484+0000 7f54bbfff700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f549c064ee0 0x7f549c067390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f54ac000f60 tx=0x7f54ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.492+0000 7f54b97fa700 1 -- 172.21.15.81:0/3019355933 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f54a404f0f0 con 0x7f54bc0ce230 2023-11-29T11:14:33.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.648+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54bc15b4e0 con 0x7f54bc0ce230 2023-11-29T11:14:33.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54b97fa700 1 -- 172.21.15.81:0/3019355933 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54a4017020 con 0x7f54bc0ce230 2023-11-29T11:14:33.658 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:14:33.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f549c064ee0 msgr2=0x7f549c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f549c064ee0 0x7f549c067390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f54ac000f60 tx=0x7f54ac009040 comp rx=0 tx=0).stop 2023-11-29T11:14:33.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0ce230 msgr2=0x7f54bc070ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0ce230 0x7f54bc070ec0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c4d0 tx=0x7f54a400c7e0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 shutdown_connections 2023-11-29T11:14:33.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f549c064ee0 0x7f549c067390 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54bc158ee0 0x7f54bc071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54bc0ce230 0x7f54bc070ec0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 --2- 172.21.15.81:0/3019355933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54bc0cd5d0 0x7f54bc15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 >> 172.21.15.81:0/3019355933 conn(0x7f54bc0d0240 msgr2=0x7f54bc1564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:33.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 shutdown_connections 2023-11-29T11:14:33.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.652+0000 7f54c1487700 1 -- 172.21.15.81:0/3019355933 wait complete. 2023-11-29T11:14:33.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:14:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.780+0000 7f2344a13700 1 Processor -- start 2023-11-29T11:14:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.780+0000 7f2344a13700 1 -- start start 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f23400b1ae0 0x7f234006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f234006a4c0 0x7f23400d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234006a9c0 con 0x7f23400cf0e0 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234006aca0 con 0x7f234006a4c0 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234006af80 con 0x7f23400b1ae0 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f234006a4c0 0x7f23400d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f234006a4c0 0x7f23400d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52584/0 (socket says 172.21.15.81:52584) 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233effd700 1 -- 172.21.15.81:0/3195460649 learned_addr learned my addr 172.21.15.81:0/3195460649 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233ffff700 1 --1- 172.21.15.81:0/3195460649 >> v1:172.21.15.81:6789/0 conn(0x7f23400cf0e0 0x7f23400cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33164/0 (socket says 172.21.15.81:33164) 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233f7fe700 1 --2- 172.21.15.81:0/3195460649 >> v2:172.21.15.176:3300/0 conn(0x7f23400b1ae0 0x7f234006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233effd700 1 -- 172.21.15.81:0/3195460649 >> v2:172.21.15.176:3300/0 conn(0x7f23400b1ae0 msgr2=0x7f234006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233effd700 1 --2- 172.21.15.81:0/3195460649 >> v2:172.21.15.176:3300/0 conn(0x7f23400b1ae0 0x7f234006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233effd700 1 -- 172.21.15.81:0/3195460649 >> v1:172.21.15.81:6789/0 conn(0x7f23400cf0e0 legacy=0x7f23400cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233effd700 1 -- 172.21.15.81:0/3195460649 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23400b4380 con 0x7f234006a4c0 2023-11-29T11:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233effd700 1 --2- 172.21.15.81:0/3195460649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234006a4c0 0x7f23400d03a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f23400b8870 tx=0x7f2330009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bb69d0ef56995 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233e7fc700 1 -- 172.21.15.81:0/3195460649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233000b8a0 con 0x7f234006a4c0 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233e7fc700 1 -- 172.21.15.81:0/3195460649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233000ba00 con 0x7f234006a4c0 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f233e7fc700 1 -- 172.21.15.81:0/3195460649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233000bd90 con 0x7f234006a4c0 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 -- 172.21.15.81:0/3195460649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234006a4c0 msgr2=0x7f23400d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 --2- 172.21.15.81:0/3195460649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234006a4c0 0x7f23400d03a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f23400b8870 tx=0x7f2330009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 -- 172.21.15.81:0/3195460649 shutdown_connections 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 --2- 172.21.15.81:0/3195460649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234006a4c0 0x7f23400d03a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 --2- 172.21.15.81:0/3195460649 >> v2:172.21.15.176:3300/0 conn(0x7f23400b1ae0 0x7f234006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 -- 172.21.15.81:0/3195460649 >> 172.21.15.81:0/3195460649 conn(0x7f234009bbd0 msgr2=0x7f23400b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 -- 172.21.15.81:0/3195460649 shutdown_connections 2023-11-29T11:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.784+0000 7f2344a13700 1 -- 172.21.15.81:0/3195460649 wait complete. 2023-11-29T11:14:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 Processor -- start 2023-11-29T11:14:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 -- start start 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f234006a4c0 0x7f2340148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23400b1ae0 0x7f23400c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23400cf0e0 0x7f234006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23401492a0 con 0x7f23400cf0e0 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400c8520 con 0x7f23400b1ae0 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23400c8ef0 con 0x7f234006a4c0 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23400cf0e0 0x7f234006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23400cf0e0 0x7f234006cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52588/0 (socket says 172.21.15.81:52588) 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 -- 172.21.15.81:0/505772736 learned_addr learned my addr 172.21.15.81:0/505772736 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233f7fe700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f234006a4c0 0x7f2340148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233effd700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23400b1ae0 0x7f23400c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 -- 172.21.15.81:0/505772736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f234006a4c0 msgr2=0x7f2340148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f234006a4c0 0x7f2340148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 -- 172.21.15.81:0/505772736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23400b1ae0 msgr2=0x7f23400c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23400b1ae0 0x7f23400c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 -- 172.21.15.81:0/505772736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330009570 con 0x7f23400cf0e0 2023-11-29T11:14:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f233ffff700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23400cf0e0 0x7f234006cd90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f233800cc00 tx=0x7f233800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2327fff700 1 -- 172.21.15.81:0/505772736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800aba0 con 0x7f23400cf0e0 2023-11-29T11:14:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2327fff700 1 -- 172.21.15.81:0/505772736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233800ad00 con 0x7f23400cf0e0 2023-11-29T11:14:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23400b60e0 con 0x7f23400cf0e0 2023-11-29T11:14:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2327fff700 1 -- 172.21.15.81:0/505772736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338007270 con 0x7f23400cf0e0 2023-11-29T11:14:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.788+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23400b1eb0 con 0x7f23400cf0e0 2023-11-29T11:14:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.792+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23400d08e0 con 0x7f23400cf0e0 2023-11-29T11:14:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.792+0000 7f2327fff700 1 -- 172.21.15.81:0/505772736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2338019030 con 0x7f23400cf0e0 2023-11-29T11:14:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.792+0000 7f2327fff700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f232c064ee0 0x7f232c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.792+0000 7f2327fff700 1 -- 172.21.15.81:0/505772736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2338081bd0 con 0x7f23400cf0e0 2023-11-29T11:14:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.792+0000 7f233f7fe700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f232c064ee0 0x7f232c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.792+0000 7f233f7fe700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f232c064ee0 0x7f232c067390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f233400b9d0 tx=0x7f2334008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:33.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.800+0000 7f2327fff700 1 -- 172.21.15.81:0/505772736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f233804a400 con 0x7f23400cf0e0 2023-11-29T11:14:33.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.956+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2340072500 con 0x7f23400cf0e0 2023-11-29T11:14:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2327fff700 1 -- 172.21.15.81:0/505772736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2338017020 con 0x7f23400cf0e0 2023-11-29T11:14:33.965 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:14:33.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f232c064ee0 msgr2=0x7f232c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f232c064ee0 0x7f232c067390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f233400b9d0 tx=0x7f2334008040 comp rx=0 tx=0).stop 2023-11-29T11:14:33.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23400cf0e0 msgr2=0x7f234006cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:33.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23400cf0e0 0x7f234006cd90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f233800cc00 tx=0x7f233800a060 comp rx=0 tx=0).stop 2023-11-29T11:14:33.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 shutdown_connections 2023-11-29T11:14:33.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f232c064ee0 0x7f232c067390 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23400cf0e0 0x7f234006cd90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23400b1ae0 0x7f23400c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 --2- 172.21.15.81:0/505772736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f234006a4c0 0x7f2340148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 >> 172.21.15.81:0/505772736 conn(0x7f234009bbd0 msgr2=0x7f23400d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 shutdown_connections 2023-11-29T11:14:33.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:33.960+0000 7f2344a13700 1 -- 172.21.15.81:0/505772736 wait complete. 2023-11-29T11:14:33.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:14:34.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.092+0000 7fd666815700 1 Processor -- start 2023-11-29T11:14:34.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.092+0000 7fd666815700 1 -- start start 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd660160850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6600ca6c0 con 0x7fd6600b1970 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6600ca9a0 con 0x7fd66015c140 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd660160d90 con 0x7fd66006a860 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd6600b1970 0x7fd6600cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33178/0 (socket says 172.21.15.81:33178) 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65f7fe700 1 -- 172.21.15.81:0/1282735006 learned_addr learned my addr 172.21.15.81:0/1282735006 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd664db2700 1 --2- 172.21.15.81:0/1282735006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd660160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65effd700 1 -- 172.21.15.81:0/1282735006 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062729897 0 0) 0x7fd6600ca6c0 con 0x7fd6600b1970 2023-11-29T11:14:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65effd700 1 -- 172.21.15.81:0/1282735006 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6400035d0 con 0x7fd6600b1970 2023-11-29T11:14:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65effd700 1 -- 172.21.15.81:0/1282735006 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279061122 0 0) 0x7fd6600ca9a0 con 0x7fd66015c140 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65effd700 1 -- 172.21.15.81:0/1282735006 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6600ca6c0 con 0x7fd66015c140 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65effd700 1 -- 172.21.15.81:0/1282735006 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4110185774 0 0) 0x7fd6400035d0 con 0x7fd6600b1970 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd664db2700 1 -- 172.21.15.81:0/1282735006 >> v1:172.21.15.176:6789/0 conn(0x7fd66015c140 legacy=0x7fd6600b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd664db2700 1 -- 172.21.15.81:0/1282735006 >> v1:172.21.15.81:6789/0 conn(0x7fd6600b1970 legacy=0x7fd6600cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd664db2700 1 -- 172.21.15.81:0/1282735006 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600cac80 con 0x7fd66006a860 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd664db2700 1 --2- 172.21.15.81:0/1282735006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd660160850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd658009880 tx=0x7fd658009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c548242af2a2ee server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65effd700 1 -- 172.21.15.81:0/1282735006 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648001670 con 0x7fd66006a860 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65effd700 1 -- 172.21.15.81:0/1282735006 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd658004030 con 0x7fd66006a860 2023-11-29T11:14:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd65effd700 1 -- 172.21.15.81:0/1282735006 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6580043a0 con 0x7fd66006a860 2023-11-29T11:14:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 -- 172.21.15.81:0/1282735006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 msgr2=0x7fd660160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 --2- 172.21.15.81:0/1282735006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd660160850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd658009880 tx=0x7fd658009b90 comp rx=0 tx=0).stop 2023-11-29T11:14:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 -- 172.21.15.81:0/1282735006 shutdown_connections 2023-11-29T11:14:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 --2- 172.21.15.81:0/1282735006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd660160850 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 -- 172.21.15.81:0/1282735006 >> 172.21.15.81:0/1282735006 conn(0x7fd6600cc260 msgr2=0x7fd6600cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 -- 172.21.15.81:0/1282735006 shutdown_connections 2023-11-29T11:14:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.096+0000 7fd666815700 1 -- 172.21.15.81:0/1282735006 wait complete. 2023-11-29T11:14:34.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd666815700 1 Processor -- start 2023-11-29T11:14:34.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd666815700 1 -- start start 2023-11-29T11:14:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd666815700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd6600af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd666815700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6600b1970 0x7fd6600ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd666815700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd66015c140 0x7fd660155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd666815700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600ae800 con 0x7fd6600b1970 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd666815700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600af820 con 0x7fd66015c140 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd666815700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600afb00 con 0x7fd66006a860 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6600b1970 0x7fd6600ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6600b1970 0x7fd6600ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52600/0 (socket says 172.21.15.81:52600) 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65f7fe700 1 -- 172.21.15.81:0/1977839684 learned_addr learned my addr 172.21.15.81:0/1977839684 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65ffff700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd6600af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd664db2700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd66015c140 0x7fd660155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65f7fe700 1 -- 172.21.15.81:0/1977839684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 msgr2=0x7fd6600af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65f7fe700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd6600af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65f7fe700 1 -- 172.21.15.81:0/1977839684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd66015c140 msgr2=0x7fd660155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65f7fe700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd66015c140 0x7fd660155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.100+0000 7fd65f7fe700 1 -- 172.21.15.81:0/1977839684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580094b0 con 0x7fd6600b1970 2023-11-29T11:14:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd65f7fe700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6600b1970 0x7fd6600ae2c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd64800c750 tx=0x7fd64800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd65cff9700 1 -- 172.21.15.81:0/1977839684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648004ca0 con 0x7fd6600b1970 2023-11-29T11:14:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd65cff9700 1 -- 172.21.15.81:0/1977839684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd648004e20 con 0x7fd6600b1970 2023-11-29T11:14:34.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66015c510 con 0x7fd6600b1970 2023-11-29T11:14:34.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd65cff9700 1 -- 172.21.15.81:0/1977839684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648007310 con 0x7fd6600b1970 2023-11-29T11:14:34.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6600cd980 con 0x7fd6600b1970 2023-11-29T11:14:34.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6600caf60 con 0x7fd6600b1970 2023-11-29T11:14:34.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd65cff9700 1 -- 172.21.15.81:0/1977839684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd64801a020 con 0x7fd6600b1970 2023-11-29T11:14:34.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd65cff9700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd644064ee0 0x7fd644067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd65cff9700 1 -- 172.21.15.81:0/1977839684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd648081db0 con 0x7fd6600b1970 2023-11-29T11:14:34.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.104+0000 7fd65ffff700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd644064ee0 0x7fd644067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.108+0000 7fd65ffff700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd644064ee0 0x7fd644067390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd650001560 tx=0x7fd650009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.112+0000 7fd65cff9700 1 -- 172.21.15.81:0/1977839684 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd648086070 con 0x7fd6600b1970 2023-11-29T11:14:34.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.272+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd660072c20 con 0x7fd6600b1970 2023-11-29T11:14:34.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd65cff9700 1 -- 172.21.15.81:0/1977839684 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd64804fbb0 con 0x7fd6600b1970 2023-11-29T11:14:34.282 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:14:34.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd644064ee0 msgr2=0x7fd644067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd644064ee0 0x7fd644067390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd650001560 tx=0x7fd650009040 comp rx=0 tx=0).stop 2023-11-29T11:14:34.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6600b1970 msgr2=0x7fd6600ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6600b1970 0x7fd6600ae2c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd64800c750 tx=0x7fd64800ca60 comp rx=0 tx=0).stop 2023-11-29T11:14:34.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 shutdown_connections 2023-11-29T11:14:34.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd644064ee0 0x7fd644067390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd66015c140 0x7fd660155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6600b1970 0x7fd6600ae2c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 --2- 172.21.15.81:0/1977839684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd66006a860 0x7fd6600af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 >> 172.21.15.81:0/1977839684 conn(0x7fd6600cc260 msgr2=0x7fd6600cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:34.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 shutdown_connections 2023-11-29T11:14:34.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.276+0000 7fd666815700 1 -- 172.21.15.81:0/1977839684 wait complete. 2023-11-29T11:14:34.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:14:34.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fffff700 1 Processor -- start 2023-11-29T11:14:34.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fffff700 1 -- start start 2023-11-29T11:14:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2000c1840 0x7fe2001649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe200160c50 con 0x7fe200160880 2023-11-29T11:14:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2000b3050 con 0x7fe2000c13c0 2023-11-29T11:14:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20006b630 con 0x7fe2000c1840 2023-11-29T11:14:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1feffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe200160880 0x7fe20006aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33182/0 (socket says 172.21.15.81:33182) 2023-11-29T11:14:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1feffd700 1 -- 172.21.15.81:0/2136456626 learned_addr learned my addr 172.21.15.81:0/2136456626 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1ff7fe700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2000c1840 0x7fe2001649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543379003 0 0) 0x7fe200160c50 con 0x7fe200160880 2023-11-29T11:14:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e80035d0 con 0x7fe200160880 2023-11-29T11:14:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456594771 0 0) 0x7fe2000b3050 con 0x7fe2000c13c0 2023-11-29T11:14:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe200160c50 con 0x7fe2000c13c0 2023-11-29T11:14:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2184828099 0 0) 0x7fe1e80035d0 con 0x7fe200160880 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2000c1840 msgr2=0x7fe2001649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2000c1840 0x7fe2001649f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 >> v1:172.21.15.176:6789/0 conn(0x7fe2000c13c0 legacy=0x7fe2001642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200069ce0 con 0x7fe200160880 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fe1f0001670 con 0x7fe200160880 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 >> v1:172.21.15.81:6789/0 conn(0x7fe200160880 legacy=0x7fe20006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1e8003be0 0x7fe1e8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8004870 0x7fe1e8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2000c1840 0x7fe1e8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20006b630 con 0x7fe1e8004870 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e800bae0 con 0x7fe1e8003be0 2023-11-29T11:14:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e800bc50 con 0x7fe2000c1840 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fe7fc700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8004870 0x7fe1e8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1feffd700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1e8003be0 0x7fe1e8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1ff7fe700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2000c1840 0x7fe1e8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fe7fc700 1 -- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2000c1840 msgr2=0x7fe1e8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fe7fc700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2000c1840 0x7fe1e8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fe7fc700 1 -- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1e8003be0 msgr2=0x7fe1e8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fe7fc700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1e8003be0 0x7fe1e8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fe7fc700 1 -- 172.21.15.81:0/2136456626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80035d0 con 0x7fe1e8004870 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fe7fc700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8004870 0x7fe1e8004ce0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001960 tx=0x7fe1e80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617d0a03aa465bc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4001450 con 0x7fe1e8004870 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f40052f0 con 0x7fe1e8004870 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fdffb700 1 -- 172.21.15.81:0/2136456626 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40036a0 con 0x7fe1e8004870 2023-11-29T11:14:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.408+0000 7fe1fffff700 1 -- 172.21.15.81:0/2136456626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8004870 msgr2=0x7fe1e8004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 --2- 172.21.15.81:0/2136456626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8004870 0x7fe1e8004ce0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001960 tx=0x7fe1e80058a0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1ff7fe700 1 -- 172.21.15.81:0/2136456626 reap_dead start 2023-11-29T11:14:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 -- 172.21.15.81:0/2136456626 shutdown_connections 2023-11-29T11:14:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 -- 172.21.15.81:0/2136456626 >> 172.21.15.81:0/2136456626 conn(0x7fe2000cae70 msgr2=0x7fe2000cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 -- 172.21.15.81:0/2136456626 shutdown_connections 2023-11-29T11:14:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 -- 172.21.15.81:0/2136456626 wait complete. 2023-11-29T11:14:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 Processor -- start 2023-11-29T11:14:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 -- start start 2023-11-29T11:14:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1e8004870 0x7fe2001f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe20015b460 0x7fe20015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2000b2560 0x7fe2000b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015be10 con 0x7fe20015b460 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001f6c00 con 0x7fe2000b2560 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000b2f10 con 0x7fe1e8004870 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe20015b460 0x7fe20015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe20015b460 0x7fe20015b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52618/0 (socket says 172.21.15.81:52618) 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 -- 172.21.15.81:0/3577641384 learned_addr learned my addr 172.21.15.81:0/3577641384 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1feffd700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1e8004870 0x7fe2001f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1ff7fe700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2000b2560 0x7fe2000b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 -- 172.21.15.81:0/3577641384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1e8004870 msgr2=0x7fe2001f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1e8004870 0x7fe2001f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 -- 172.21.15.81:0/3577641384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2000b2560 msgr2=0x7fe2000b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2000b2560 0x7fe2000b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 -- 172.21.15.81:0/3577641384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20006a2a0 con 0x7fe20015b460 2023-11-29T11:14:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.412+0000 7fe1fe7fc700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe20015b460 0x7fe20015b8d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001190 tx=0x7fe1f40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1e77fe700 1 -- 172.21.15.81:0/3577641384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4006d50 con 0x7fe20015b460 2023-11-29T11:14:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1e77fe700 1 -- 172.21.15.81:0/3577641384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4007040 con 0x7fe20015b460 2023-11-29T11:14:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1e77fe700 1 -- 172.21.15.81:0/3577641384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40073f0 con 0x7fe20015b460 2023-11-29T11:14:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe200069fc0 con 0x7fe20015b460 2023-11-29T11:14:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20006a580 con 0x7fe20015b460 2023-11-29T11:14:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe200072500 con 0x7fe20015b460 2023-11-29T11:14:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1e77fe700 1 -- 172.21.15.81:0/3577641384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe1f402e070 con 0x7fe20015b460 2023-11-29T11:14:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1e77fe700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1ec064ee0 0x7fe1ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1e77fe700 1 -- 172.21.15.81:0/3577641384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe1f40830c0 con 0x7fe20015b460 2023-11-29T11:14:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.416+0000 7fe1feffd700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1ec064ee0 0x7fe1ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.420+0000 7fe1feffd700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1ec064ee0 0x7fe1ec067390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0001050 tx=0x7fe1f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.428+0000 7fe1e77fe700 1 -- 172.21.15.81:0/3577641384 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe1f40510a0 con 0x7fe20015b460 2023-11-29T11:14:34.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.588+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2000ce1d0 con 0x7fe20015b460 2023-11-29T11:14:34.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.588+0000 7fe1e77fe700 1 -- 172.21.15.81:0/3577641384 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1f40546c0 con 0x7fe20015b460 2023-11-29T11:14:34.597 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:14:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1ec064ee0 msgr2=0x7fe1ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1ec064ee0 0x7fe1ec067390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0001050 tx=0x7fe1f0009040 comp rx=0 tx=0).stop 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe20015b460 msgr2=0x7fe20015b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe20015b460 0x7fe20015b8d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001190 tx=0x7fe1f40012d0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 shutdown_connections 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1ec064ee0 0x7fe1ec067390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2000b2560 0x7fe2000b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe20015b460 0x7fe20015b8d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 --2- 172.21.15.81:0/3577641384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1e8004870 0x7fe2001f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 >> 172.21.15.81:0/3577641384 conn(0x7fe2000cae70 msgr2=0x7fe2000b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 shutdown_connections 2023-11-29T11:14:34.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.592+0000 7fe1fffff700 1 -- 172.21.15.81:0/3577641384 wait complete. 2023-11-29T11:14:34.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:14:34.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad33d3700 1 Processor -- start 2023-11-29T11:14:34.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad33d3700 1 -- start start 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad33d3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad33d3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbacc0ad490 0x7fbacc0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad33d3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc0cd8f0 con 0x7fbacc158e60 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad33d3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0add00 con 0x7fbacc0ad490 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad33d3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0cc4f0 con 0x7fbacc0cb460 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad23d1700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbacc158e60 0x7fbacc0cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33184/0 (socket says 172.21.15.81:33184) 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad23d1700 1 -- 172.21.15.81:0/1569088540 learned_addr learned my addr 172.21.15.81:0/1569088540 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad2bd2700 1 --2- 172.21.15.81:0/1569088540 >> v2:172.21.15.176:3300/0 conn(0x7fbacc0ad490 0x7fbacc0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad1bd0700 1 --2- 172.21.15.81:0/1569088540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad13cf700 1 -- 172.21.15.81:0/1569088540 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543180262 0 0) 0x7fbacc0cd8f0 con 0x7fbacc158e60 2023-11-29T11:14:34.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad13cf700 1 -- 172.21.15.81:0/1569088540 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab80035d0 con 0x7fbacc158e60 2023-11-29T11:14:34.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad1bd0700 1 -- 172.21.15.81:0/1569088540 >> v2:172.21.15.176:3300/0 conn(0x7fbacc0ad490 msgr2=0x7fbacc0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:34.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad1bd0700 1 --2- 172.21.15.81:0/1569088540 >> v2:172.21.15.176:3300/0 conn(0x7fbacc0ad490 0x7fbacc0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad1bd0700 1 -- 172.21.15.81:0/1569088540 >> v1:172.21.15.81:6789/0 conn(0x7fbacc158e60 legacy=0x7fbacc0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad1bd0700 1 -- 172.21.15.81:0/1569088540 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc06dc60 con 0x7fbacc0cb460 2023-11-29T11:14:34.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.716+0000 7fbad2bd2700 1 --2- 172.21.15.81:0/1569088540 >> v2:172.21.15.176:3300/0 conn(0x7fbacc0ad490 0x7fbacc0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:34.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad1bd0700 1 --2- 172.21.15.81:0/1569088540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc0c8a30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009880 tx=0x7fbac0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=449460efc07fe0ac server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad13cf700 1 -- 172.21.15.81:0/1569088540 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0011830 con 0x7fbacc0cb460 2023-11-29T11:14:34.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad13cf700 1 -- 172.21.15.81:0/1569088540 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac0011990 con 0x7fbacc0cb460 2023-11-29T11:14:34.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad13cf700 1 -- 172.21.15.81:0/1569088540 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0011d20 con 0x7fbacc0cb460 2023-11-29T11:14:34.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 -- 172.21.15.81:0/1569088540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 msgr2=0x7fbacc0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 --2- 172.21.15.81:0/1569088540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc0c8a30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009880 tx=0x7fbac0009b90 comp rx=0 tx=0).stop 2023-11-29T11:14:34.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 -- 172.21.15.81:0/1569088540 shutdown_connections 2023-11-29T11:14:34.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 --2- 172.21.15.81:0/1569088540 >> v2:172.21.15.176:3300/0 conn(0x7fbacc0ad490 0x7fbacc0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 --2- 172.21.15.81:0/1569088540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc0c8a30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 -- 172.21.15.81:0/1569088540 >> 172.21.15.81:0/1569088540 conn(0x7fbacc0ce3e0 msgr2=0x7fbacc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:34.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 -- 172.21.15.81:0/1569088540 shutdown_connections 2023-11-29T11:14:34.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 -- 172.21.15.81:0/1569088540 wait complete. 2023-11-29T11:14:34.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 Processor -- start 2023-11-29T11:14:34.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.720+0000 7fbad33d3700 1 -- start start 2023-11-29T11:14:34.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad33d3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbacc0ad490 0x7fbacc15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad33d3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad33d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc158e60 0x7fbacc071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad33d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0c6260 con 0x7fbacc158e60 2023-11-29T11:14:34.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad33d3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0c5650 con 0x7fbacc0ad490 2023-11-29T11:14:34.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad33d3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0c5930 con 0x7fbacc0cb460 2023-11-29T11:14:34.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad2bd2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc158e60 0x7fbacc071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad1bd0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad1bd0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:49290/0 (socket says 172.21.15.81:49290) 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad1bd0700 1 -- 172.21.15.81:0/2235976448 learned_addr learned my addr 172.21.15.81:0/2235976448 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad23d1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbacc0ad490 0x7fbacc15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad2bd2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc158e60 0x7fbacc071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52632/0 (socket says 172.21.15.81:52632) 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad2bd2700 1 -- 172.21.15.81:0/2235976448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 msgr2=0x7fbacc071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad2bd2700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad2bd2700 1 -- 172.21.15.81:0/2235976448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbacc0ad490 msgr2=0x7fbacc15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad2bd2700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbacc0ad490 0x7fbacc15c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad2bd2700 1 -- 172.21.15.81:0/2235976448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4009a70 con 0x7fbacc158e60 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad1bd0700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:34.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad2bd2700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc158e60 0x7fbacc071840 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbac400efc0 tx=0x7fbac400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbabeffd700 1 -- 172.21.15.81:0/2235976448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4009e80 con 0x7fbacc158e60 2023-11-29T11:14:34.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbabeffd700 1 -- 172.21.15.81:0/2235976448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400f040 con 0x7fbacc158e60 2023-11-29T11:14:34.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac00094b0 con 0x7fbacc158e60 2023-11-29T11:14:34.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbabeffd700 1 -- 172.21.15.81:0/2235976448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac400ccd0 con 0x7fbacc158e60 2023-11-29T11:14:34.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.724+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc159230 con 0x7fbacc158e60 2023-11-29T11:14:34.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.728+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbacc0cde90 con 0x7fbacc158e60 2023-11-29T11:14:34.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.728+0000 7fbabeffd700 1 -- 172.21.15.81:0/2235976448 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbac4014480 con 0x7fbacc158e60 2023-11-29T11:14:34.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.728+0000 7fbabeffd700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbab0064ee0 0x7fbab0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:34.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.728+0000 7fbad23d1700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbab0064ee0 0x7fbab0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:34.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.728+0000 7fbabeffd700 1 -- 172.21.15.81:0/2235976448 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbac4082700 con 0x7fbacc158e60 2023-11-29T11:14:34.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.728+0000 7fbad23d1700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbab0064ee0 0x7fbab0067390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbac8007fd0 tx=0x7fbac8007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:34.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.732+0000 7fbabeffd700 1 -- 172.21.15.81:0/2235976448 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbac4050680 con 0x7fbacc158e60 2023-11-29T11:14:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.908+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbacc15c710 con 0x7fbacc158e60 2023-11-29T11:14:34.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.908+0000 7fbabeffd700 1 -- 172.21.15.81:0/2235976448 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbac4053ca0 con 0x7fbacc158e60 2023-11-29T11:14:34.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbab0064ee0 msgr2=0x7fbab0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbab0064ee0 0x7fbab0067390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbac8007fd0 tx=0x7fbac8007de0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc158e60 msgr2=0x7fbacc071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:34.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc158e60 0x7fbacc071840 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbac400efc0 tx=0x7fbac400c3a0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 shutdown_connections 2023-11-29T11:14:34.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbab0064ee0 0x7fbab0067390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbacc158e60 0x7fbacc071840 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbacc0cb460 0x7fbacc071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 --2- 172.21.15.81:0/2235976448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbacc0ad490 0x7fbacc15c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 >> 172.21.15.81:0/2235976448 conn(0x7fbacc0ce3e0 msgr2=0x7fbacc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 shutdown_connections 2023-11-29T11:14:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:34.912+0000 7fbad33d3700 1 -- 172.21.15.81:0/2235976448 wait complete. 2023-11-29T11:14:34.919 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:14:34.929 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:14:34.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:34.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:14:34.943 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48913]: fuse finished with error 0 and tester_r 0 2023-11-29T11:14:34.945 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:14:41.046 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:14:41.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:41.047 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:14:41.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 Processor -- start 2023-11-29T11:14:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- start start 2023-11-29T11:14:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7c0153420 0x7fc7c00c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00cad30 con 0x7fc7c015cb50 2023-11-29T11:14:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00b0cd0 con 0x7fc7c01537f0 2023-11-29T11:14:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c00cdda0 con 0x7fc7c0153420 2023-11-29T11:14:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7bf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7c0153420 0x7fc7c00c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7bffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc7c015cb50 0x7fc7c015cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40012/0 (socket says 172.21.15.81:40012) 2023-11-29T11:14:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7bf7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7c0153420 0x7fc7c00c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39328/0 (socket says 172.21.15.81:39328) 2023-11-29T11:14:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7bffff700 1 -- 172.21.15.81:0/1923612650 learned_addr learned my addr 172.21.15.81:0/1923612650 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7bf7fe700 1 -- 172.21.15.81:0/1923612650 >> v1:172.21.15.176:6789/0 conn(0x7fc7c01537f0 legacy=0x7fc7c00ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7bf7fe700 1 -- 172.21.15.81:0/1923612650 >> v1:172.21.15.81:6789/0 conn(0x7fc7c015cb50 legacy=0x7fc7c015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7be7fc700 1 -- 172.21.15.81:0/1923612650 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761599295 0 0) 0x7fc7c00cad30 con 0x7fc7c015cb50 2023-11-29T11:14:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7bf7fe700 1 -- 172.21.15.81:0/1923612650 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00caa00 con 0x7fc7c0153420 2023-11-29T11:14:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7bf7fe700 1 --2- 172.21.15.81:0/1923612650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c00c8f50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009850 tx=0x7fc7b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11e3d91ac430a05 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7be7fc700 1 -- 172.21.15.81:0/1923612650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0004230 con 0x7fc7c0153420 2023-11-29T11:14:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7be7fc700 1 -- 172.21.15.81:0/1923612650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b0004390 con 0x7fc7c0153420 2023-11-29T11:14:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7be7fc700 1 -- 172.21.15.81:0/1923612650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00036c0 con 0x7fc7c0153420 2023-11-29T11:14:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- 172.21.15.81:0/1923612650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 msgr2=0x7fc7c00c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 --2- 172.21.15.81:0/1923612650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c00c8f50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009850 tx=0x7fc7b0009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- 172.21.15.81:0/1923612650 shutdown_connections 2023-11-29T11:14:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 --2- 172.21.15.81:0/1923612650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c00c8f50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- 172.21.15.81:0/1923612650 >> 172.21.15.81:0/1923612650 conn(0x7fc7c006caf0 msgr2=0x7fc7c00ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- 172.21.15.81:0/1923612650 shutdown_connections 2023-11-29T11:14:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.164+0000 7fc7c5eff700 1 -- 172.21.15.81:0/1923612650 wait complete. 2023-11-29T11:14:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 Processor -- start 2023-11-29T11:14:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 -- start start 2023-11-29T11:14:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c0143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c01537f0 0x7fc7c0070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c015cb50 0x7fc7c0071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0155260 con 0x7fc7c0153420 2023-11-29T11:14:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00c6b30 con 0x7fc7c015cb50 2023-11-29T11:14:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0143d00 con 0x7fc7c01537f0 2023-11-29T11:14:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c0143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c0143220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39332/0 (socket says 172.21.15.81:39332) 2023-11-29T11:14:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 -- 172.21.15.81:0/3967716242 learned_addr learned my addr 172.21.15.81:0/3967716242 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bffff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c015cb50 0x7fc7c0071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7beffd700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c01537f0 0x7fc7c0070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 -- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c01537f0 msgr2=0x7fc7c0070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c01537f0 0x7fc7c0070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 -- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c015cb50 msgr2=0x7fc7c0071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c015cb50 0x7fc7c0071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 -- 172.21.15.81:0/3967716242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00094b0 con 0x7fc7c0153420 2023-11-29T11:14:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bffff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c015cb50 0x7fc7c0071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7bf7fe700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c0143220 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0004000 tx=0x7fc7b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7a7fff700 1 -- 172.21.15.81:0/3967716242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0006ea0 con 0x7fc7c0153420 2023-11-29T11:14:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7a7fff700 1 -- 172.21.15.81:0/3967716242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b0011830 con 0x7fc7c0153420 2023-11-29T11:14:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c00b1250 con 0x7fc7c0153420 2023-11-29T11:14:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.168+0000 7fc7a7fff700 1 -- 172.21.15.81:0/3967716242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0011ba0 con 0x7fc7c0153420 2023-11-29T11:14:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.172+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c00b0f70 con 0x7fc7c0153420 2023-11-29T11:14:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.172+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c006fff0 con 0x7fc7c0153420 2023-11-29T11:14:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.172+0000 7fc7a7fff700 1 -- 172.21.15.81:0/3967716242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc7b0017020 con 0x7fc7c0153420 2023-11-29T11:14:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.172+0000 7fc7a7fff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc7ac064ee0 0x7fc7ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.172+0000 7fc7a7fff700 1 -- 172.21.15.81:0/3967716242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc7b0083750 con 0x7fc7c0153420 2023-11-29T11:14:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.172+0000 7fc7beffd700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc7ac064ee0 0x7fc7ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.176+0000 7fc7beffd700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc7ac064ee0 0x7fc7ac067390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0071850 tx=0x7fc7b4007ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.180+0000 7fc7a7fff700 1 -- 172.21.15.81:0/3967716242 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc7b00516f0 con 0x7fc7c0153420 2023-11-29T11:14:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.380+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7c0072500 con 0x7fc7c0153420 2023-11-29T11:14:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7a7fff700 1 -- 172.21.15.81:0/3967716242 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fc7b0054d10 con 0x7fc7c0153420 2023-11-29T11:14:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:41.389 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:14:16.825795+0000","modified":"2023-11-29T11:14:19.853366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1909362607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1909362607},{"type":"v1","addr":"172.21.15.176:6833","nonce":1909362607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc7ac064ee0 msgr2=0x7fc7ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc7ac064ee0 0x7fc7ac067390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0071850 tx=0x7fc7b4007ee0 comp rx=0 tx=0).stop 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 msgr2=0x7fc7c0143220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c0143220 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0004000 tx=0x7fc7b0004770 comp rx=0 tx=0).stop 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 shutdown_connections 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc7ac064ee0 0x7fc7ac067390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c015cb50 0x7fc7c0071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c01537f0 0x7fc7c0070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 --2- 172.21.15.81:0/3967716242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c0153420 0x7fc7c0143220 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 >> 172.21.15.81:0/3967716242 conn(0x7fc7c006caf0 msgr2=0x7fc7c00c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 shutdown_connections 2023-11-29T11:14:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:41.384+0000 7fc7c5eff700 1 -- 172.21.15.81:0/3967716242 wait complete. 2023-11-29T11:14:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-11-29T11:14:41.404 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-11-29T11:14:42.434 INFO:teuthology.orchestra.run.smithi176.stdout:{"message":"","return_code":0} 2023-11-29T11:14:42.434 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:14:42.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6d79700 1 Processor -- start 2023-11-29T11:14:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6d79700 1 -- start start 2023-11-29T11:14:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6d79700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c01584c0 0x7fe4c00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6d79700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4c00b32e0 0x7fe4c00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6d79700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe4c006bc80 0x7fe4c006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6d79700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c006dbd0 con 0x7fe4c00b32e0 2023-11-29T11:14:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6d79700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c00b3c30 con 0x7fe4c006bc80 2023-11-29T11:14:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6d79700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00cd0f0 con 0x7fe4c01584c0 2023-11-29T11:14:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4c00b32e0 0x7fe4c00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4c00b32e0 0x7fe4c00b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39348/0 (socket says 172.21.15.81:39348) 2023-11-29T11:14:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 -- 172.21.15.81:0/3313437814 learned_addr learned my addr 172.21.15.81:0/3313437814 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5d77700 1 --2- 172.21.15.81:0/3313437814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c01584c0 0x7fe4c00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6578700 1 --2- 172.21.15.81:0/3313437814 >> v2:172.21.15.176:3300/0 conn(0x7fe4c006bc80 0x7fe4c006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 -- 172.21.15.81:0/3313437814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c01584c0 msgr2=0x7fe4c00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 --2- 172.21.15.81:0/3313437814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c01584c0 0x7fe4c00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 -- 172.21.15.81:0/3313437814 >> v2:172.21.15.176:3300/0 conn(0x7fe4c006bc80 msgr2=0x7fe4c006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 --2- 172.21.15.81:0/3313437814 >> v2:172.21.15.176:3300/0 conn(0x7fe4c006bc80 0x7fe4c006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 -- 172.21.15.81:0/3313437814 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00cd3d0 con 0x7fe4c00b32e0 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c6578700 1 --2- 172.21.15.81:0/3313437814 >> v2:172.21.15.176:3300/0 conn(0x7fe4c006bc80 0x7fe4c006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.540+0000 7fe4c5576700 1 --2- 172.21.15.81:0/3313437814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b36f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe4c006de10 tx=0x7fe4bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caea14a27041e1c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c4d75700 1 -- 172.21.15.81:0/3313437814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00b8a0 con 0x7fe4c00b32e0 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c4d75700 1 -- 172.21.15.81:0/3313437814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00ba00 con 0x7fe4c00b32e0 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c4d75700 1 -- 172.21.15.81:0/3313437814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00bd90 con 0x7fe4c00b32e0 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 -- 172.21.15.81:0/3313437814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 msgr2=0x7fe4c00b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/3313437814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b36f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe4c006de10 tx=0x7fe4bc009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 -- 172.21.15.81:0/3313437814 shutdown_connections 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/3313437814 >> v2:172.21.15.176:3300/0 conn(0x7fe4c006bc80 0x7fe4c006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/3313437814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b36f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/3313437814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c01584c0 0x7fe4c00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 -- 172.21.15.81:0/3313437814 >> 172.21.15.81:0/3313437814 conn(0x7fe4c00ce3e0 msgr2=0x7fe4c00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 -- 172.21.15.81:0/3313437814 shutdown_connections 2023-11-29T11:14:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 -- 172.21.15.81:0/3313437814 wait complete. 2023-11-29T11:14:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 Processor -- start 2023-11-29T11:14:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.544+0000 7fe4c6d79700 1 -- start start 2023-11-29T11:14:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6d79700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c006bc80 0x7fe4c01522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6d79700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6d79700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4c01584c0 0x7fe4c0155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6d79700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00b0d50 con 0x7fe4c00b32e0 2023-11-29T11:14:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6d79700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c01565d0 con 0x7fe4c01584c0 2023-11-29T11:14:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6d79700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c01568b0 con 0x7fe4c006bc80 2023-11-29T11:14:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39360/0 (socket says 172.21.15.81:39360) 2023-11-29T11:14:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 -- 172.21.15.81:0/4146772506 learned_addr learned my addr 172.21.15.81:0/4146772506 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5d77700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c006bc80 0x7fe4c01522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6578700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4c01584c0 0x7fe4c0155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 -- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c006bc80 msgr2=0x7fe4c01522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c006bc80 0x7fe4c01522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 -- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4c01584c0 msgr2=0x7fe4c0155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4c01584c0 0x7fe4c0155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 -- 172.21.15.81:0/4146772506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009570 con 0x7fe4c00b32e0 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6578700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4c01584c0 0x7fe4c0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5d77700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c006bc80 0x7fe4c01522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c5576700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b0810 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe4c006f880 tx=0x7fe4bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4b67fc700 1 -- 172.21.15.81:0/4146772506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0045a0 con 0x7fe4c00b32e0 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4b67fc700 1 -- 172.21.15.81:0/4146772506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc01f070 con 0x7fe4c00b32e0 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c00cd990 con 0x7fe4c00b32e0 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4b67fc700 1 -- 172.21.15.81:0/4146772506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc003900 con 0x7fe4c00b32e0 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.548+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c00cd6b0 con 0x7fe4c00b32e0 2023-11-29T11:14:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.552+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c00cdc70 con 0x7fe4c00b32e0 2023-11-29T11:14:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.552+0000 7fe4b67fc700 1 -- 172.21.15.81:0/4146772506 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe4bc02a020 con 0x7fe4c00b32e0 2023-11-29T11:14:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.552+0000 7fe4b67fc700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe4a4064ee0 0x7fe4a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.552+0000 7fe4b67fc700 1 -- 172.21.15.81:0/4146772506 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe4bc0836e0 con 0x7fe4c00b32e0 2023-11-29T11:14:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.552+0000 7fe4c5d77700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe4a4064ee0 0x7fe4a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.552+0000 7fe4c5d77700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe4a4064ee0 0x7fe4a4067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0007dd0 tx=0x7fe4b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.560+0000 7fe4b67fc700 1 -- 172.21.15.81:0/4146772506 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe4bc051700 con 0x7fe4c00b32e0 2023-11-29T11:14:42.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.756+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4c006cb40 con 0x7fe4c00b32e0 2023-11-29T11:14:42.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.756+0000 7fe4b67fc700 1 -- 172.21.15.81:0/4146772506 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fe4bc054d20 con 0x7fe4c00b32e0 2023-11-29T11:14:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:42.764 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:14:16.825795+0000","modified":"2023-11-29T11:14:19.853366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1909362607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1909362607},{"type":"v1","addr":"172.21.15.176:6833","nonce":1909362607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T11:14:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe4a4064ee0 msgr2=0x7fe4a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe4a4064ee0 0x7fe4a4067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0007dd0 tx=0x7fe4b0008040 comp rx=0 tx=0).stop 2023-11-29T11:14:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 msgr2=0x7fe4c00b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b0810 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe4c006f880 tx=0x7fe4bc004770 comp rx=0 tx=0).stop 2023-11-29T11:14:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 shutdown_connections 2023-11-29T11:14:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe4a4064ee0 0x7fe4a4067390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4c01584c0 0x7fe4c0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00b32e0 0x7fe4c00b0810 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 --2- 172.21.15.81:0/4146772506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4c006bc80 0x7fe4c01522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 >> 172.21.15.81:0/4146772506 conn(0x7fe4c00ce3e0 msgr2=0x7fe4c00ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 shutdown_connections 2023-11-29T11:14:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:42.760+0000 7fe4c6d79700 1 -- 172.21.15.81:0/4146772506 wait complete. 2023-11-29T11:14:42.768 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-11-29T11:14:42.779 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json tag path /parentdir mytag 2023-11-29T11:14:42.911 INFO:teuthology.orchestra.run.smithi176.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-11-29T11:14:42.911 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-11-29T11:14:52.912 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-11-29T11:14:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ef62140 1 Processor -- start 2023-11-29T11:14:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ef62140 1 -- start start 2023-11-29T11:14:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ef62140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd97f160 0x563ecd9f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ef62140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd9f2970 0x563ecd963340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ef62140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecd963880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ef62140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ecda0cef0 con 0x563ecd9f2d40 2023-11-29T11:14:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ef62140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ecda0d190 con 0x563ecd9f2970 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ef62140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ecda0d430 con 0x563ecd97f160 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecd963880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecd963880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51330/0 (socket says 172.21.15.81:51330) 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 -- 172.21.15.81:0/2554328500 learned_addr learned my addr 172.21.15.81:0/2554328500 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342c296700 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd9f2970 0x563ecd963340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342ca97700 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd97f160 0x563ecd9f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 -- 172.21.15.81:0/2554328500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd97f160 msgr2=0x563ecd9f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd97f160 0x563ecd9f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 -- 172.21.15.81:0/2554328500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd9f2970 msgr2=0x563ecd963340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd9f2970 0x563ecd963340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 -- 172.21.15.81:0/2554328500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c005de0 con 0x563ecd9f2d40 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342d298700 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecd963880 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f342400a5b0 tx=0x7f342400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca8f9fbc0c6a315 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342b294700 1 -- 172.21.15.81:0/2554328500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342400f070 con 0x563ecd9f2d40 2023-11-29T11:14:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342b294700 1 -- 172.21.15.81:0/2554328500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3424007600 con 0x563ecd9f2d40 2023-11-29T11:14:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.952+0000 7f342b294700 1 -- 172.21.15.81:0/2554328500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424007990 con 0x563ecd9f2d40 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- 172.21.15.81:0/2554328500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 msgr2=0x563ecd963880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecd963880 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f342400a5b0 tx=0x7f342400a8c0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- 172.21.15.81:0/2554328500 shutdown_connections 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecd963880 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd9f2970 0x563ecd963340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 --2- 172.21.15.81:0/2554328500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd97f160 0x563ecd9f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- 172.21.15.81:0/2554328500 >> 172.21.15.81:0/2554328500 conn(0x563ecd95ffb0 msgr2=0x563ecd938550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- 172.21.15.81:0/2554328500 shutdown_connections 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- 172.21.15.81:0/2554328500 wait complete. 2023-11-29T11:14:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 Processor -- start 2023-11-29T11:14:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- start start 2023-11-29T11:14:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd97f160 0x563ecd95f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd9f2970 0x563ecda986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecda0ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ecda97dc0 con 0x563ecd9f2d40 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ecd95f7b0 con 0x563ecd97f160 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ef62140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ecda98c30 con 0x563ecd9f2970 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342d298700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecda0ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342d298700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecda0ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51346/0 (socket says 172.21.15.81:51346) 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342d298700 1 -- 172.21.15.81:0/2029841655 learned_addr learned my addr 172.21.15.81:0/2029841655 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342ca97700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd97f160 0x563ecd95f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.956+0000 7f342c296700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd9f2970 0x563ecda986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342d298700 1 -- 172.21.15.81:0/2029841655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd9f2970 msgr2=0x563ecda986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342d298700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ecd9f2970 0x563ecda986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342d298700 1 -- 172.21.15.81:0/2029841655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd97f160 msgr2=0x563ecd95f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342d298700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd97f160 0x563ecd95f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342d298700 1 -- 172.21.15.81:0/2029841655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424005e40 con 0x563ecd9f2d40 2023-11-29T11:14:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342ca97700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ecd97f160 0x563ecd95f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342d298700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecda0ba80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x563ecd9647f0 tx=0x7f3424003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342a292700 1 -- 172.21.15.81:0/2029841655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424007e20 con 0x563ecd9f2d40 2023-11-29T11:14:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342a292700 1 -- 172.21.15.81:0/2029841655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342401e630 con 0x563ecd9f2d40 2023-11-29T11:14:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342a292700 1 -- 172.21.15.81:0/2029841655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342401e9e0 con 0x563ecd9f2d40 2023-11-29T11:14:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ecd88e760 con 0x563ecd9f2d40 2023-11-29T11:14:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.960+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ecd874390 con 0x563ecd9f2d40 2023-11-29T11:14:52.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342a292700 1 -- 172.21.15.81:0/2029841655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f342402e070 con 0x563ecd9f2d40 2023-11-29T11:14:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342a292700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f340c063810 0x7f340c065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342a292700 1 -- 172.21.15.81:0/2029841655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3424081ff0 con 0x563ecd9f2d40 2023-11-29T11:14:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ca97700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f340c063810 0x7f340c065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x563ecda0bfc0 0x563ecd9f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) v8 -- 0x563ecdaa1ad0 con 0x563ecda0bfc0 2023-11-29T11:14:52.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342c296700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x563ecda0bfc0 0x563ecd9f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ca97700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f340c063810 0x7f340c065cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f341c015040 tx=0x7f341c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342c296700 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x563ecda0bfc0 0x563ecd9f1c70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342c296700 1 -- 172.21.15.81:0/2029841655 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f341400c9b0 con 0x563ecda0bfc0 2023-11-29T11:14:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x563ecda0bfc0 msgr2=0x563ecd9f1c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:52.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x563ecda0bfc0 0x563ecd9f1c70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f340c063810 msgr2=0x7f340c065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:52.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f340c063810 0x7f340c065cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f341c015040 tx=0x7f341c00f000 comp rx=0 tx=0).stop 2023-11-29T11:14:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 msgr2=0x563ecda0ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 --2- 172.21.15.81:0/2029841655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ecd9f2d40 0x563ecda0ba80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x563ecd9647f0 tx=0x7f3424003020 comp rx=0 tx=0).stop 2023-11-29T11:14:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342d298700 1 -- 172.21.15.81:0/2029841655 reap_dead start 2023-11-29T11:14:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 shutdown_connections 2023-11-29T11:14:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 >> 172.21.15.81:0/2029841655 conn(0x563ecd95ffb0 msgr2=0x563ecd9610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 shutdown_connections 2023-11-29T11:14:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:52.964+0000 7f342ef62140 1 -- 172.21.15.81:0/2029841655 wait complete. 2023-11-29T11:14:52.977 INFO:teuthology.orchestra.run.smithi081.stdout:mytag 2023-11-29T11:14:52.977 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-11-29T11:14:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.056+0000 7f679b95b140 1 Processor -- start 2023-11-29T11:14:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.056+0000 7f679b95b140 1 -- start start 2023-11-29T11:14:53.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f679b95b140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e42a160 0x56530e4b8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f679b95b140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 0x56530e40e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f679b95b140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e49dd40 0x56530e545380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f679b95b140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530e307240 con 0x56530e42a160 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f679b95b140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530e3e3a90 con 0x56530e49dd40 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f679b95b140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x56530e3e3550 con 0x56530e49d970 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e42a160 0x56530e4b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e42a160 0x56530e4b8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51354/0 (socket says 172.21.15.81:51354) 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 -- 172.21.15.81:0/1015117882 learned_addr learned my addr 172.21.15.81:0/1015117882 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6798c8f700 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 0x56530e40e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799c91700 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e49dd40 0x56530e545380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 -- 172.21.15.81:0/1015117882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 msgr2=0x56530e40e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 0x56530e40e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 -- 172.21.15.81:0/1015117882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e49dd40 msgr2=0x56530e545380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e49dd40 0x56530e545380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 -- 172.21.15.81:0/1015117882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784005d20 con 0x56530e42a160 2023-11-29T11:14:53.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f6799490700 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e42a160 0x56530e4b8320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f678c0098b0 tx=0x7f678c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cb89cd0a5d169c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f67937fe700 1 -- 172.21.15.81:0/1015117882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c00f040 con 0x56530e42a160 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f67937fe700 1 -- 172.21.15.81:0/1015117882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c0089b0 con 0x56530e42a160 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.060+0000 7f67937fe700 1 -- 172.21.15.81:0/1015117882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c008d60 con 0x56530e42a160 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- 172.21.15.81:0/1015117882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e42a160 msgr2=0x56530e4b8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e42a160 0x56530e4b8320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f678c0098b0 tx=0x7f678c005a00 comp rx=0 tx=0).stop 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- 172.21.15.81:0/1015117882 shutdown_connections 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e49dd40 0x56530e545380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 0x56530e40e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 --2- 172.21.15.81:0/1015117882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e42a160 0x56530e4b8320 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- 172.21.15.81:0/1015117882 >> 172.21.15.81:0/1015117882 conn(0x56530e40afb0 msgr2=0x56530e425570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- 172.21.15.81:0/1015117882 shutdown_connections 2023-11-29T11:14:53.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- 172.21.15.81:0/1015117882 wait complete. 2023-11-29T11:14:53.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 Processor -- start 2023-11-29T11:14:53.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- start start 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e42a160 0x56530e404160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 0x56530e49cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e49dd40 0x56530e3e2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530e404830 con 0x56530e49dd40 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530e404ad0 con 0x56530e42a160 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f679b95b140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x56530e404d70 con 0x56530e49d970 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f6799c91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e49dd40 0x56530e3e2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f6799c91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e49dd40 0x56530e3e2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51370/0 (socket says 172.21.15.81:51370) 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f6799c91700 1 -- 172.21.15.81:0/3733392813 learned_addr learned my addr 172.21.15.81:0/3733392813 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f6798c8f700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 0x56530e49cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.064+0000 7f6799490700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e42a160 0x56530e404160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f6799c91700 1 -- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 msgr2=0x56530e49cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f6799c91700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56530e49d970 0x56530e49cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f6799c91700 1 -- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e42a160 msgr2=0x56530e404160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f6799c91700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56530e42a160 0x56530e404160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f6799c91700 1 -- 172.21.15.81:0/3733392813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c009510 con 0x56530e49dd40 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f6799c91700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e49dd40 0x56530e3e2920 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f679400e430 tx=0x7f679400e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f67927fc700 1 -- 172.21.15.81:0/3733392813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679400eeb0 con 0x56530e49dd40 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f67927fc700 1 -- 172.21.15.81:0/3733392813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67940060d0 con 0x56530e49dd40 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f67927fc700 1 -- 172.21.15.81:0/3733392813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794004520 con 0x56530e49dd40 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56530e31f390 con 0x56530e49dd40 2023-11-29T11:14:53.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.068+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56530e3128b0 con 0x56530e49dd40 2023-11-29T11:14:53.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f67927fc700 1 -- 172.21.15.81:0/3733392813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6794004680 con 0x56530e49dd40 2023-11-29T11:14:53.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f67927fc700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f677c063810 0x7f677c065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f67927fc700 1 -- 172.21.15.81:0/3733392813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6794080960 con 0x56530e49dd40 2023-11-29T11:14:53.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f6799490700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f677c063810 0x7f677c065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x56530e3e2e60 0x56530e54ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:1 6.7 6:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) v8 -- 0x56530e405750 con 0x56530e3e2e60 2023-11-29T11:14:53.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f6798c8f700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x56530e3e2e60 0x56530e54ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f6799490700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f677c063810 0x7f677c065cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f678c015040 tx=0x7f678c01f040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f6798c8f700 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x56530e3e2e60 0x56530e54ca80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f6798c8f700 1 -- 172.21.15.81:0/3733392813 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f6784019040 con 0x56530e3e2e60 2023-11-29T11:14:53.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x56530e3e2e60 msgr2=0x56530e54ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x56530e3e2e60 0x56530e54ca80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f677c063810 msgr2=0x7f677c065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f677c063810 0x7f677c065cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f678c015040 tx=0x7f678c01f040 comp rx=0 tx=0).stop 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e49dd40 msgr2=0x56530e3e2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 --2- 172.21.15.81:0/3733392813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56530e49dd40 0x56530e3e2920 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f679400e430 tx=0x7f679400e740 comp rx=0 tx=0).stop 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f6799c91700 1 -- 172.21.15.81:0/3733392813 reap_dead start 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 shutdown_connections 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 >> 172.21.15.81:0/3733392813 conn(0x56530e40afb0 msgr2=0x56530e3e1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 shutdown_connections 2023-11-29T11:14:53.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.072+0000 7f679b95b140 1 -- 172.21.15.81:0/3733392813 wait complete. 2023-11-29T11:14:53.085 INFO:teuthology.orchestra.run.smithi081.stdout:mytag 2023-11-29T11:14:53.086 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-11-29T11:14:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.116+0000 7effd5051140 1 Processor -- start 2023-11-29T11:14:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.116+0000 7effd5051140 1 -- start start 2023-11-29T11:14:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f175822d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 0x55f17589da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 0x55f17581d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1758b0030 con 0x55f17580b7e0 2023-11-29T11:14:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1758b0280 con 0x55f175823a90 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1758b0520 con 0x55f175823e60 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f175822d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f175822d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51388/0 (socket says 172.21.15.81:51388) 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 -- 172.21.15.81:0/30444728 learned_addr learned my addr 172.21.15.81:0/30444728 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2385700 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 0x55f17589da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd3387700 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 0x55f17581d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 -- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 msgr2=0x55f17581d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 0x55f17581d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 -- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 msgr2=0x55f17589da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 0x55f17589da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 -- 172.21.15.81:0/30444728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc400a100 con 0x55f17580b7e0 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd3387700 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 0x55f17581d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd2b86700 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f175822d30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7effc400a950 tx=0x7effc4005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30274d0207f8ca5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd1383700 1 -- 172.21.15.81:0/30444728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4012660 con 0x55f17580b7e0 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd1383700 1 -- 172.21.15.81:0/30444728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc40127c0 con 0x55f17580b7e0 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd1383700 1 -- 172.21.15.81:0/30444728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4012b30 con 0x55f17580b7e0 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 -- 172.21.15.81:0/30444728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 msgr2=0x55f175822d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f175822d30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7effc400a950 tx=0x7effc4005d80 comp rx=0 tx=0).stop 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 -- 172.21.15.81:0/30444728 shutdown_connections 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 0x55f17581d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 0x55f17589da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 --2- 172.21.15.81:0/30444728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f175822d30 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 -- 172.21.15.81:0/30444728 >> 172.21.15.81:0/30444728 conn(0x55f175809dc0 msgr2=0x55f1757dedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 -- 172.21.15.81:0/30444728 shutdown_connections 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 -- 172.21.15.81:0/30444728 wait complete. 2023-11-29T11:14:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.120+0000 7effd5051140 1 Processor -- start 2023-11-29T11:14:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 -- start start 2023-11-29T11:14:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f1758af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 0x55f175890ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 0x55f175891400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1757da3b0 con 0x55f17580b7e0 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1757da650 con 0x55f175823a90 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1757da8f0 con 0x55f175823e60 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f1758af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f1758af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51394/0 (socket says 172.21.15.81:51394) 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 -- 172.21.15.81:0/1474700569 learned_addr learned my addr 172.21.15.81:0/1474700569 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2385700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 0x55f175890ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd3387700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 0x55f175891400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 -- 172.21.15.81:0/1474700569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 msgr2=0x55f175891400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f175823e60 0x55f175891400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 -- 172.21.15.81:0/1474700569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 msgr2=0x55f175890ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f175823a90 0x55f175890ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 -- 172.21.15.81:0/1474700569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc400a580 con 0x55f17580b7e0 2023-11-29T11:14:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd2b86700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f1758af5c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7effc4005dc0 tx=0x7effc40033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effcbfff700 1 -- 172.21.15.81:0/1474700569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4009070 con 0x55f17580b7e0 2023-11-29T11:14:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effcbfff700 1 -- 172.21.15.81:0/1474700569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc400dc70 con 0x55f17580b7e0 2023-11-29T11:14:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effcbfff700 1 -- 172.21.15.81:0/1474700569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4005a40 con 0x55f17580b7e0 2023-11-29T11:14:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f17571a390 con 0x55f17580b7e0 2023-11-29T11:14:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.124+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc005de0 con 0x55f17580b7e0 2023-11-29T11:14:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.128+0000 7effcbfff700 1 -- 172.21.15.81:0/1474700569 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7effc402c070 con 0x55f17580b7e0 2023-11-29T11:14:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.128+0000 7effcbfff700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effb4063840 0x7effb4065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.128+0000 7effd2385700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effb4063840 0x7effb4065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.128+0000 7effcbfff700 1 -- 172.21.15.81:0/1474700569 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7effc40825f0 con 0x55f17580b7e0 2023-11-29T11:14:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.128+0000 7effd5051140 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55f175948210 0x55f1759485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.128+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:1 7.36 7:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) v8 -- 0x55f175948b20 con 0x55f175948210 2023-11-29T11:14:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.128+0000 7effd3387700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55f175948210 0x55f1759485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.128+0000 7effd2385700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effb4063840 0x7effb4065cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7effbc000c00 tx=0x7effbc00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd3387700 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55f175948210 0x55f1759485e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd3387700 1 -- 172.21.15.81:0/1474700569 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7effcc009920 con 0x55f175948210 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55f175948210 msgr2=0x55f1759485e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55f175948210 0x55f1759485e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effb4063840 msgr2=0x7effb4065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effb4063840 0x7effb4065cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7effbc000c00 tx=0x7effbc00f000 comp rx=0 tx=0).stop 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 msgr2=0x55f1758af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 --2- 172.21.15.81:0/1474700569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f17580b7e0 0x55f1758af5c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7effc4005dc0 tx=0x7effc40033a0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd3387700 1 -- 172.21.15.81:0/1474700569 reap_dead start 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 shutdown_connections 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 >> 172.21.15.81:0/1474700569 conn(0x55f175809dc0 msgr2=0x55f17580c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 shutdown_connections 2023-11-29T11:14:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.132+0000 7effd5051140 1 -- 172.21.15.81:0/1474700569 wait complete. 2023-11-29T11:14:53.143 INFO:teuthology.orchestra.run.smithi081.stdout:mytag 2023-11-29T11:14:53.144 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-11-29T11:14:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407e6c5140 1 Processor -- start 2023-11-29T11:14:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407e6c5140 1 -- start start 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407e6c5140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f39ef0 0x560784fde380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407e6c5140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51a90 0x560784f4a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407e6c5140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f51e60 0x560784fe0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407e6c5140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560784e9d180 con 0x560784f51e60 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407e6c5140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x560784e30240 con 0x560784f51a90 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407e6c5140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x560785069570 con 0x560784f39ef0 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407c9fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f51e60 0x560784fe0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407c1fa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f39ef0 0x560784fde380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407c9fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f51e60 0x560784fe0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51410/0 (socket says 172.21.15.81:51410) 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407c9fb700 1 -- 172.21.15.81:0/1799917242 learned_addr learned my addr 172.21.15.81:0/1799917242 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.180+0000 7f407b9f9700 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51a90 0x560784f4a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407c9fb700 1 -- 172.21.15.81:0/1799917242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f39ef0 msgr2=0x560784fde380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407c9fb700 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f39ef0 0x560784fde380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407c9fb700 1 -- 172.21.15.81:0/1799917242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51a90 msgr2=0x560784f4a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407c9fb700 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51a90 0x560784f4a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407c9fb700 1 -- 172.21.15.81:0/1799917242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4074005d20 con 0x560784f51e60 2023-11-29T11:14:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407b9f9700 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51a90 0x560784f4a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407c9fb700 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f51e60 0x560784fe0a60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f406c006eb0 tx=0x7f406c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60af7c21bf7a22e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407a9f7700 1 -- 172.21.15.81:0/1799917242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c012600 con 0x560784f51e60 2023-11-29T11:14:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407a9f7700 1 -- 172.21.15.81:0/1799917242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c012780 con 0x560784f51e60 2023-11-29T11:14:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407a9f7700 1 -- 172.21.15.81:0/1799917242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c012b30 con 0x560784f51e60 2023-11-29T11:14:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 -- 172.21.15.81:0/1799917242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f51e60 msgr2=0x560784fe0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f51e60 0x560784fe0a60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f406c006eb0 tx=0x7f406c001930 comp rx=0 tx=0).stop 2023-11-29T11:14:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 -- 172.21.15.81:0/1799917242 shutdown_connections 2023-11-29T11:14:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f51e60 0x560784fe0a60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51a90 0x560784f4a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 --2- 172.21.15.81:0/1799917242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f39ef0 0x560784fde380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 -- 172.21.15.81:0/1799917242 >> 172.21.15.81:0/1799917242 conn(0x560784f37dc0 msgr2=0x560784f0cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 -- 172.21.15.81:0/1799917242 shutdown_connections 2023-11-29T11:14:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 -- 172.21.15.81:0/1799917242 wait complete. 2023-11-29T11:14:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 Processor -- start 2023-11-29T11:14:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.184+0000 7f407e6c5140 1 -- start start 2023-11-29T11:14:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407e6c5140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f39ef0 0x560784f0ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407e6c5140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f51a90 0x560784fdd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407e6c5140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51e60 0x560785067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407e6c5140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560784f4c350 con 0x560784f39ef0 2023-11-29T11:14:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407e6c5140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x560784f4c5f0 con 0x560784f51e60 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407e6c5140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x560784f4c890 con 0x560784f51a90 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f39ef0 0x560784f0ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f39ef0 0x560784f0ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51414/0 (socket says 172.21.15.81:51414) 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 -- 172.21.15.81:0/2789558982 learned_addr learned my addr 172.21.15.81:0/2789558982 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c9fb700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51e60 0x560785067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407b9f9700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f51a90 0x560784fdd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 -- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f51a90 msgr2=0x560784fdd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560784f51a90 0x560784fdd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 -- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51e60 msgr2=0x560785067c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51e60 0x560785067c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 -- 172.21.15.81:0/2789558982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068001e10 con 0x560784f39ef0 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c9fb700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560784f51e60 0x560785067c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407c1fa700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f39ef0 0x560784f0ce60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f407400a440 tx=0x7f4074002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f40799f5700 1 -- 172.21.15.81:0/2789558982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074012820 con 0x560784f39ef0 2023-11-29T11:14:53.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560784e3b520 con 0x560784f39ef0 2023-11-29T11:14:53.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f40799f5700 1 -- 172.21.15.81:0/2789558982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4074012980 con 0x560784f39ef0 2023-11-29T11:14:53.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f40799f5700 1 -- 172.21.15.81:0/2789558982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074012cf0 con 0x560784f39ef0 2023-11-29T11:14:53.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.188+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560784e3b8b0 con 0x560784f39ef0 2023-11-29T11:14:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f40799f5700 1 -- 172.21.15.81:0/2789558982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f40740303f0 con 0x560784f39ef0 2023-11-29T11:14:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f40799f5700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f405c063810 0x7f405c065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f40799f5700 1 -- 172.21.15.81:0/2789558982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f407400ae40 con 0x560784f39ef0 2023-11-29T11:14:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f407b9f9700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f405c063810 0x7f405c065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f407e6c5140 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x560784fdd540 0x560784f4da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:1 7.19 7:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) v8 -- 0x560784f4df60 con 0x560784fdd540 2023-11-29T11:14:53.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f407c9fb700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x560784fdd540 0x560784f4da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f407b9f9700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f405c063810 0x7f405c065cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4064000c00 tx=0x7f4064001670 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f407c9fb700 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x560784fdd540 0x560784f4da20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.192+0000 7f407c9fb700 1 -- 172.21.15.81:0/2789558982 <== osd.6 v2:172.21.15.176:6816/36813 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f406c012400 con 0x560784fdd540 2023-11-29T11:14:53.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x560784fdd540 msgr2=0x560784f4da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x560784fdd540 0x560784f4da20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f405c063810 msgr2=0x7f405c065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f405c063810 0x7f405c065cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4064000c00 tx=0x7f4064001670 comp rx=0 tx=0).stop 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f39ef0 msgr2=0x560784f0ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 --2- 172.21.15.81:0/2789558982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560784f39ef0 0x560784f0ce60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f407400a440 tx=0x7f4074002fb0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407c9fb700 1 -- 172.21.15.81:0/2789558982 reap_dead start 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 shutdown_connections 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 >> 172.21.15.81:0/2789558982 conn(0x560784f37dc0 msgr2=0x560784fe1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 shutdown_connections 2023-11-29T11:14:53.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.196+0000 7f407e6c5140 1 -- 172.21.15.81:0/2789558982 wait complete. 2023-11-29T11:14:53.205 INFO:teuthology.orchestra.run.smithi081.stdout:mytag 2023-11-29T11:14:53.205 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-11-29T11:14:53.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 Processor -- start 2023-11-29T11:14:53.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- start start 2023-11-29T11:14:53.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 0x557b82609650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610a90 0x557b825c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610e60 0x557b825c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b824ef240 con 0x557b82610a90 2023-11-29T11:14:53.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b825c8dd0 con 0x557b82610e60 2023-11-29T11:14:53.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b826837b0 con 0x557b825f8ef0 2023-11-29T11:14:53.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610a90 0x557b825c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e35aa4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 0x557b82609650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610a90 0x557b825c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51424/0 (socket says 172.21.15.81:51424) 2023-11-29T11:14:53.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 -- 172.21.15.81:0/1355199088 learned_addr learned my addr 172.21.15.81:0/1355199088 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e362a5700 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610e60 0x557b825c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 -- 172.21.15.81:0/1355199088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 msgr2=0x557b82609650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 0x557b82609650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 -- 172.21.15.81:0/1355199088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610e60 msgr2=0x557b825c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610e60 0x557b825c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 -- 172.21.15.81:0/1355199088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30005de0 con 0x557b82610a90 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e35aa4700 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 0x557b82609650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e352a3700 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610a90 0x557b825c73b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5e20001460 tx=0x7f5e20001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fed346dfc82be1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e2ffff700 1 -- 172.21.15.81:0/1355199088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20002030 con 0x557b82610a90 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e2ffff700 1 -- 172.21.15.81:0/1355199088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e20006320 con 0x557b82610a90 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e2ffff700 1 -- 172.21.15.81:0/1355199088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20013660 con 0x557b82610a90 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- 172.21.15.81:0/1355199088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610a90 msgr2=0x557b825c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610a90 0x557b825c73b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5e20001460 tx=0x7f5e20001770 comp rx=0 tx=0).stop 2023-11-29T11:14:53.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- 172.21.15.81:0/1355199088 shutdown_connections 2023-11-29T11:14:53.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610e60 0x557b825c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610a90 0x557b825c73b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 --2- 172.21.15.81:0/1355199088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 0x557b82609650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- 172.21.15.81:0/1355199088 >> 172.21.15.81:0/1355199088 conn(0x557b825f6dc0 msgr2=0x557b825cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- 172.21.15.81:0/1355199088 shutdown_connections 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.240+0000 7f5e37f6f140 1 -- 172.21.15.81:0/1355199088 wait complete. 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 Processor -- start 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 -- start start 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 0x557b825eba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610a90 0x557b82682a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610e60 0x557b82682fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b82683510 con 0x557b82610e60 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b82737c30 con 0x557b82610a90 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b82737ed0 con 0x557b825f8ef0 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610e60 0x557b82682fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610e60 0x557b82682fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51434/0 (socket says 172.21.15.81:51434) 2023-11-29T11:14:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 -- 172.21.15.81:0/3803300640 learned_addr learned my addr 172.21.15.81:0/3803300640 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e352a3700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610a90 0x557b82682a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e35aa4700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 0x557b825eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 -- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 msgr2=0x557b825eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557b825f8ef0 0x557b825eba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 -- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610a90 msgr2=0x557b82682a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557b82610a90 0x557b82682a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 -- 172.21.15.81:0/3803300640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28009450 con 0x557b82610e60 2023-11-29T11:14:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e362a5700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610e60 0x557b82682fd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5e30011000 tx=0x7f5e30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e2effd700 1 -- 172.21.15.81:0/3803300640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30008690 con 0x557b82610e60 2023-11-29T11:14:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b824fa520 con 0x557b82610e60 2023-11-29T11:14:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b82507390 con 0x557b82610e60 2023-11-29T11:14:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e2effd700 1 -- 172.21.15.81:0/3803300640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30012840 con 0x557b82610e60 2023-11-29T11:14:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.244+0000 7f5e2effd700 1 -- 172.21.15.81:0/3803300640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30012bf0 con 0x557b82610e60 2023-11-29T11:14:53.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.248+0000 7f5e2effd700 1 -- 172.21.15.81:0/3803300640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5e30012d50 con 0x557b82610e60 2023-11-29T11:14:53.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.248+0000 7f5e2effd700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5e18063840 0x7f5e18065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.248+0000 7f5e2effd700 1 -- 172.21.15.81:0/3803300640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5e30082830 con 0x557b82610e60 2023-11-29T11:14:53.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.248+0000 7f5e35aa4700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5e18063840 0x7f5e18065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.248+0000 7f5e37f6f140 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x557b825ebfc0 0x557b8260c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.248+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:1 7.12 7:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) v8 -- 0x557b8260cba0 con 0x557b825ebfc0 2023-11-29T11:14:53.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e352a3700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x557b825ebfc0 0x557b8260c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e35aa4700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5e18063840 0x7f5e18065cf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5e28005400 tx=0x7f5e2800c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e352a3700 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x557b825ebfc0 0x557b8260c660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e352a3700 1 -- 172.21.15.81:0/3803300640 <== osd.6 v2:172.21.15.176:6816/36813 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5e20001f30 con 0x557b825ebfc0 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x557b825ebfc0 msgr2=0x557b8260c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x557b825ebfc0 0x557b8260c660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5e18063840 msgr2=0x7f5e18065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5e18063840 0x7f5e18065cf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5e28005400 tx=0x7f5e2800c040 comp rx=0 tx=0).stop 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610e60 msgr2=0x557b82682fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 --2- 172.21.15.81:0/3803300640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b82610e60 0x557b82682fd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5e30011000 tx=0x7f5e30002fb0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e362a5700 1 -- 172.21.15.81:0/3803300640 reap_dead start 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 shutdown_connections 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 >> 172.21.15.81:0/3803300640 conn(0x557b825f6dc0 msgr2=0x557b825cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 shutdown_connections 2023-11-29T11:14:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.252+0000 7f5e37f6f140 1 -- 172.21.15.81:0/3803300640 wait complete. 2023-11-29T11:14:53.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:14:53.263 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:14:53.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:14:53.281 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:14:53.302 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:14:53.305 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:14:53.305 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:14:53.312 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:14:53.312 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:14:53.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:53.313 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:14:53.359 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-29T11:14:53.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:14:53.360 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:14:53.360 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:14:53.367 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:14:53.367 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:14:53.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:53.367 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-29T11:14:53.374 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-29T11:14:53.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:14:53.375 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:14:53.375 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:14:53.382 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:14:53.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:14:53.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:53.383 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-29T11:14:53.390 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-29T11:14:53.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:14:53.391 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:14:53.391 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:14:53.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:14:53.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:14:53.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:14:53.399 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-29T11:14:53.448 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-29T11:14:53.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:14:53.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:53.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfdffff700 1 Processor -- start 2023-11-29T11:14:53.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfdffff700 1 -- start start 2023-11-29T11:14:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfdffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe01606b0 0x7fbfe00c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfdffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbfe00ceef0 0x7fbfe00c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfdffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe00cae70 con 0x7fbfe00ad610 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfdffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00cbc10 con 0x7fbfe00ceef0 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfdffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00cb130 con 0x7fbfe01606b0 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfde7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbfe00ceef0 0x7fbfe00c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfde7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbfe00ceef0 0x7fbfe00c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51444/0 (socket says 172.21.15.81:51444) 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfde7fc700 1 -- 172.21.15.81:0/3615234725 learned_addr learned my addr 172.21.15.81:0/3615234725 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfdeffd700 1 --2- 172.21.15.81:0/3615234725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe01606b0 0x7fbfe00c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfde7fc700 1 -- 172.21.15.81:0/3615234725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe01606b0 msgr2=0x7fbfe00c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfde7fc700 1 --2- 172.21.15.81:0/3615234725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe01606b0 0x7fbfe00c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfde7fc700 1 -- 172.21.15.81:0/3615234725 >> v1:172.21.15.176:6789/0 conn(0x7fbfe00ad610 legacy=0x7fbfe0164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfde7fc700 1 -- 172.21.15.81:0/3615234725 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00cb410 con 0x7fbfe00ceef0 2023-11-29T11:14:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfde7fc700 1 --2- 172.21.15.81:0/3615234725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe00ceef0 0x7fbfe00c18f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009e50 tx=0x7fbfd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1617cf9d121fb2b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfddffb700 1 -- 172.21.15.81:0/3615234725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800e070 con 0x7fbfe00ceef0 2023-11-29T11:14:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfddffb700 1 -- 172.21.15.81:0/3615234725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800b9c0 con 0x7fbfe00ceef0 2023-11-29T11:14:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.568+0000 7fbfddffb700 1 -- 172.21.15.81:0/3615234725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800bd70 con 0x7fbfe00ceef0 2023-11-29T11:14:53.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- 172.21.15.81:0/3615234725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe00ceef0 msgr2=0x7fbfe00c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 --2- 172.21.15.81:0/3615234725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe00ceef0 0x7fbfe00c18f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009e50 tx=0x7fbfd800b330 comp rx=0 tx=0).stop 2023-11-29T11:14:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- 172.21.15.81:0/3615234725 shutdown_connections 2023-11-29T11:14:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 --2- 172.21.15.81:0/3615234725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe00ceef0 0x7fbfe00c18f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 --2- 172.21.15.81:0/3615234725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe01606b0 0x7fbfe00c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- 172.21.15.81:0/3615234725 >> 172.21.15.81:0/3615234725 conn(0x7fbfe00ce3e0 msgr2=0x7fbfe00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- 172.21.15.81:0/3615234725 shutdown_connections 2023-11-29T11:14:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- 172.21.15.81:0/3615234725 wait complete. 2023-11-29T11:14:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 Processor -- start 2023-11-29T11:14:53.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- start start 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe00ad610 0x7fbfe0158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe00ceef0 0x7fbfe015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe01606b0 0x7fbfe015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00af100 con 0x7fbfe01606b0 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe01594c0 con 0x7fbfe00ceef0 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00c4490 con 0x7fbfe00ad610 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe01606b0 0x7fbfe015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdeffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe00ad610 0x7fbfe0158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe01606b0 0x7fbfe015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51452/0 (socket says 172.21.15.81:51452) 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdeffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe00ad610 0x7fbfe0158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:51646/0 (socket says 172.21.15.81:51646) 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 -- 172.21.15.81:0/224652977 learned_addr learned my addr 172.21.15.81:0/224652977 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfde7fc700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe00ceef0 0x7fbfe015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 -- 172.21.15.81:0/224652977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe00ad610 msgr2=0x7fbfe0158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe00ad610 0x7fbfe0158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 -- 172.21.15.81:0/224652977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe00ceef0 msgr2=0x7fbfe015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe00ceef0 0x7fbfe015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 -- 172.21.15.81:0/224652977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009b30 con 0x7fbfe01606b0 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.572+0000 7fbfdf7fe700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe01606b0 0x7fbfe015efa0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000c430 tx=0x7fbfd000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfd77fe700 1 -- 172.21.15.81:0/224652977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00052d0 con 0x7fbfe01606b0 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe006ac50 con 0x7fbfe01606b0 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfd77fe700 1 -- 172.21.15.81:0/224652977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0005430 con 0x7fbfe01606b0 2023-11-29T11:14:53.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe00cb6f0 con 0x7fbfe01606b0 2023-11-29T11:14:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfd77fe700 1 -- 172.21.15.81:0/224652977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00055a0 con 0x7fbfe01606b0 2023-11-29T11:14:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe00b36c0 con 0x7fbfe01606b0 2023-11-29T11:14:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfd77fe700 1 -- 172.21.15.81:0/224652977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbfd0019030 con 0x7fbfe01606b0 2023-11-29T11:14:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfd77fe700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfc0064f10 0x7fbfc00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfd77fe700 1 -- 172.21.15.81:0/224652977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fbfd0081070 con 0x7fbfe01606b0 2023-11-29T11:14:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfdeffd700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfc0064f10 0x7fbfc00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.576+0000 7fbfdeffd700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfc0064f10 0x7fbfc00673c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00b7c70 tx=0x7fbfc8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.584+0000 7fbfd77fe700 1 -- 172.21.15.81:0/224652977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbfd004a400 con 0x7fbfe01606b0 2023-11-29T11:14:53.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfe00af240 con 0x7fbfe01606b0 2023-11-29T11:14:53.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfd77fe700 1 -- 172.21.15.81:0/224652977 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fbfe00af240 con 0x7fbfe01606b0 2023-11-29T11:14:53.790 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:53.790 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:14:16.825795+0000","modified":"2023-11-29T11:14:19.853366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1909362607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1909362607},{"type":"v1","addr":"172.21.15.176:6833","nonce":1909362607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfc0064f10 msgr2=0x7fbfc00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfc0064f10 0x7fbfc00673c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00b7c70 tx=0x7fbfc8008040 comp rx=0 tx=0).stop 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe01606b0 msgr2=0x7fbfe015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe01606b0 0x7fbfe015efa0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000c430 tx=0x7fbfd000c740 comp rx=0 tx=0).stop 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 shutdown_connections 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfc0064f10 0x7fbfc00673c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfe01606b0 0x7fbfe015efa0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfe00ceef0 0x7fbfe015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 --2- 172.21.15.81:0/224652977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfe00ad610 0x7fbfe0158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 >> 172.21.15.81:0/224652977 conn(0x7fbfe00ce3e0 msgr2=0x7fbfe0070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.784+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 shutdown_connections 2023-11-29T11:14:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.788+0000 7fbfdffff700 1 -- 172.21.15.81:0/224652977 wait complete. 2023-11-29T11:14:53.794 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-11-29T11:14:53.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a62a3700 1 Processor -- start 2023-11-29T11:14:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a62a3700 1 -- start start 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a62a3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f67a00ca310 0x7f67a006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a62a3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67a006cd80 0x7f67a015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a62a3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a00cca10 con 0x7f67a0069eb0 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a62a3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a00cdeb0 con 0x7f67a006cd80 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a62a3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a006a670 con 0x7f67a00ca310 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a5aa2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67a006cd80 0x7f67a015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a5aa2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67a006cd80 0x7f67a015b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51464/0 (socket says 172.21.15.81:51464) 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a5aa2700 1 -- 172.21.15.81:0/705170270 learned_addr learned my addr 172.21.15.81:0/705170270 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a52a1700 1 --2- 172.21.15.81:0/705170270 >> v2:172.21.15.176:3300/0 conn(0x7f67a00ca310 0x7f67a006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a5aa2700 1 -- 172.21.15.81:0/705170270 >> v2:172.21.15.176:3300/0 conn(0x7f67a00ca310 msgr2=0x7f67a006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a5aa2700 1 --2- 172.21.15.81:0/705170270 >> v2:172.21.15.176:3300/0 conn(0x7f67a00ca310 0x7f67a006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a5aa2700 1 -- 172.21.15.81:0/705170270 >> v1:172.21.15.176:6789/0 conn(0x7f67a0069eb0 legacy=0x7f67a006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a5aa2700 1 -- 172.21.15.81:0/705170270 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a006a950 con 0x7f67a006cd80 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.912+0000 7f67a5aa2700 1 --2- 172.21.15.81:0/705170270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a015b9f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f67a006d2f0 tx=0x7f6798009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7129bd2e91e13743 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f6797fff700 1 -- 172.21.15.81:0/705170270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798011830 con 0x7f67a006cd80 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f6797fff700 1 -- 172.21.15.81:0/705170270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6798011990 con 0x7f67a006cd80 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f6797fff700 1 -- 172.21.15.81:0/705170270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798011d20 con 0x7f67a006cd80 2023-11-29T11:14:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 -- 172.21.15.81:0/705170270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 msgr2=0x7f67a015b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 --2- 172.21.15.81:0/705170270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a015b9f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f67a006d2f0 tx=0x7f6798009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 -- 172.21.15.81:0/705170270 shutdown_connections 2023-11-29T11:14:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 --2- 172.21.15.81:0/705170270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a015b9f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 --2- 172.21.15.81:0/705170270 >> v2:172.21.15.176:3300/0 conn(0x7f67a00ca310 0x7f67a006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 -- 172.21.15.81:0/705170270 >> 172.21.15.81:0/705170270 conn(0x7f67a00ce3e0 msgr2=0x7f67a00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 -- 172.21.15.81:0/705170270 shutdown_connections 2023-11-29T11:14:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 -- 172.21.15.81:0/705170270 wait complete. 2023-11-29T11:14:53.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.916+0000 7f67a62a3700 1 Processor -- start 2023-11-29T11:14:53.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 -- start start 2023-11-29T11:14:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67a0069eb0 0x7f67a0097800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a00c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67a00ca310 0x7f67a00c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a00afa30 con 0x7f67a006cd80 2023-11-29T11:14:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a00c6bc0 con 0x7f67a0069eb0 2023-11-29T11:14:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a00af160 con 0x7f67a00ca310 2023-11-29T11:14:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a00c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a00c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51478/0 (socket says 172.21.15.81:51478) 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 -- 172.21.15.81:0/3193810831 learned_addr learned my addr 172.21.15.81:0/3193810831 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a5aa2700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67a00ca310 0x7f67a00c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a52a1700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67a0069eb0 0x7f67a0097800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 -- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67a00ca310 msgr2=0x7f67a00c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67a00ca310 0x7f67a00c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 -- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67a0069eb0 msgr2=0x7f67a0097800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67a0069eb0 0x7f67a0097800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 -- 172.21.15.81:0/3193810831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6798009570 con 0x7f67a006cd80 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a52a1700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67a0069eb0 0x7f67a0097800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a4aa0700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a00c5f30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f679c00cc20 tx=0x7f679c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f6795ffb700 1 -- 172.21.15.81:0/3193810831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c003c20 con 0x7f67a006cd80 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f6795ffb700 1 -- 172.21.15.81:0/3193810831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c003da0 con 0x7f67a006cd80 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f6795ffb700 1 -- 172.21.15.81:0/3193810831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c00ac60 con 0x7f67a006cd80 2023-11-29T11:14:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a00c8a30 con 0x7f67a006cd80 2023-11-29T11:14:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a006ac30 con 0x7f67a006cd80 2023-11-29T11:14:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.920+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a006af10 con 0x7f67a006cd80 2023-11-29T11:14:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.924+0000 7f6795ffb700 1 -- 172.21.15.81:0/3193810831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f679c010050 con 0x7f67a006cd80 2023-11-29T11:14:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.924+0000 7f6795ffb700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6784064ee0 0x7f6784067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.924+0000 7f6795ffb700 1 -- 172.21.15.81:0/3193810831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f679c082180 con 0x7f67a006cd80 2023-11-29T11:14:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.924+0000 7f67a52a1700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6784064ee0 0x7f6784067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.924+0000 7f67a52a1700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6784064ee0 0x7f6784067390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6790009ad0 tx=0x7f6790008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:53.928+0000 7f6795ffb700 1 -- 172.21.15.81:0/3193810831 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f679c050020 con 0x7f67a006cd80 2023-11-29T11:14:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.092+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67a00cd0c0 con 0x7f67a006cd80 2023-11-29T11:14:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.096+0000 7f6795ffb700 1 -- 172.21.15.81:0/3193810831 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18126 (secure 0 0 0) 0x7f679c053640 con 0x7f67a006cd80 2023-11-29T11:14:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:54.104 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:42.074222+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:14:14.596602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-29T11:14:15.817550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6784064ee0 msgr2=0x7f6784067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6784064ee0 0x7f6784067390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6790009ad0 tx=0x7f6790008040 comp rx=0 tx=0).stop 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 msgr2=0x7f67a00c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a00c5f30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f679c00cc20 tx=0x7f679c00a060 comp rx=0 tx=0).stop 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 shutdown_connections 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6784064ee0 0x7f6784067390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67a00ca310 0x7f67a00c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67a006cd80 0x7f67a00c5f30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 --2- 172.21.15.81:0/3193810831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67a0069eb0 0x7f67a0097800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 >> 172.21.15.81:0/3193810831 conn(0x7f67a00ce3e0 msgr2=0x7f67a00706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 shutdown_connections 2023-11-29T11:14:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.100+0000 7f67a62a3700 1 -- 172.21.15.81:0/3193810831 wait complete. 2023-11-29T11:14:54.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:14:14.596602+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:14:15.817550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:14:54.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:14:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.236+0000 7fc62a281700 1 Processor -- start 2023-11-29T11:14:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.236+0000 7fc62a281700 1 -- start start 2023-11-29T11:14:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc62406a6e0 0x7fc62406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62415a3a0 con 0x7fc6240cbaf0 2023-11-29T11:14:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62406aff0 con 0x7fc6240cb5a0 2023-11-29T11:14:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240ca430 con 0x7fc62406a6e0 2023-11-29T11:14:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc628a7e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc6240cbaf0 0x7fc62406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32814/0 (socket says 172.21.15.81:32814) 2023-11-29T11:14:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc628a7e700 1 -- 172.21.15.81:0/3863866819 learned_addr learned my addr 172.21.15.81:0/3863866819 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62927f700 1 --2- 172.21.15.81:0/3863866819 >> v2:172.21.15.176:3300/0 conn(0x7fc62406a6e0 0x7fc62406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc61bfff700 1 -- 172.21.15.81:0/3863866819 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160332278 0 0) 0x7fc614001290 con 0x7fc6240cbaf0 2023-11-29T11:14:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc61bfff700 1 -- 172.21.15.81:0/3863866819 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6100035d0 con 0x7fc6240cbaf0 2023-11-29T11:14:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62927f700 1 -- 172.21.15.81:0/3863866819 >> v1:172.21.15.176:6789/0 conn(0x7fc6240cb5a0 legacy=0x7fc62406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62927f700 1 -- 172.21.15.81:0/3863866819 >> v1:172.21.15.81:6789/0 conn(0x7fc6240cbaf0 legacy=0x7fc62406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62927f700 1 -- 172.21.15.81:0/3863866819 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240ca710 con 0x7fc62406a6e0 2023-11-29T11:14:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62927f700 1 --2- 172.21.15.81:0/3863866819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 0x7fc62406aab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc620009850 tx=0x7fc620009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e47a5816a674b680 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc61bfff700 1 -- 172.21.15.81:0/3863866819 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620011830 con 0x7fc62406a6e0 2023-11-29T11:14:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc61bfff700 1 -- 172.21.15.81:0/3863866819 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620011990 con 0x7fc62406a6e0 2023-11-29T11:14:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc61bfff700 1 -- 172.21.15.81:0/3863866819 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620011d00 con 0x7fc62406a6e0 2023-11-29T11:14:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 -- 172.21.15.81:0/3863866819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 msgr2=0x7fc62406aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 --2- 172.21.15.81:0/3863866819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 0x7fc62406aab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc620009850 tx=0x7fc620009b60 comp rx=0 tx=0).stop 2023-11-29T11:14:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 -- 172.21.15.81:0/3863866819 shutdown_connections 2023-11-29T11:14:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 --2- 172.21.15.81:0/3863866819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 0x7fc62406aab0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 -- 172.21.15.81:0/3863866819 >> 172.21.15.81:0/3863866819 conn(0x7fc6240d0240 msgr2=0x7fc6240cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 -- 172.21.15.81:0/3863866819 shutdown_connections 2023-11-29T11:14:54.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.240+0000 7fc62a281700 1 -- 172.21.15.81:0/3863866819 wait complete. 2023-11-29T11:14:54.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc62a281700 1 Processor -- start 2023-11-29T11:14:54.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc62a281700 1 -- start start 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc62a281700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 0x7fc6240c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc62a281700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6240cb5a0 0x7fc6240b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc62a281700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6240cbaf0 0x7fc6240c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc62a281700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c41d0 con 0x7fc6240cbaf0 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc62a281700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c5c40 con 0x7fc62406a6e0 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc62a281700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c4470 con 0x7fc6240cb5a0 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc629a80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6240cbaf0 0x7fc6240c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc629a80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6240cbaf0 0x7fc6240c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51482/0 (socket says 172.21.15.81:51482) 2023-11-29T11:14:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.244+0000 7fc629a80700 1 -- 172.21.15.81:0/1335582935 learned_addr learned my addr 172.21.15.81:0/1335582935 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc62927f700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 0x7fc6240c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc628a7e700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6240cb5a0 0x7fc6240b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc629a80700 1 -- 172.21.15.81:0/1335582935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6240cb5a0 msgr2=0x7fc6240b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc629a80700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6240cb5a0 0x7fc6240b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc629a80700 1 -- 172.21.15.81:0/1335582935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 msgr2=0x7fc6240c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc629a80700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 0x7fc6240c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc629a80700 1 -- 172.21.15.81:0/1335582935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200094b0 con 0x7fc6240cbaf0 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc629a80700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6240cbaf0 0x7fc6240c51f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00cb50 tx=0x7fc61c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc619ffb700 1 -- 172.21.15.81:0/1335582935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c003c20 con 0x7fc6240cbaf0 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc619ffb700 1 -- 172.21.15.81:0/1335582935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c003d80 con 0x7fc6240cbaf0 2023-11-29T11:14:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6240cacd0 con 0x7fc6240cbaf0 2023-11-29T11:14:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc619ffb700 1 -- 172.21.15.81:0/1335582935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00aa20 con 0x7fc6240cbaf0 2023-11-29T11:14:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6240ca9f0 con 0x7fc6240cbaf0 2023-11-29T11:14:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc619ffb700 1 -- 172.21.15.81:0/1335582935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc61c010050 con 0x7fc6240cbaf0 2023-11-29T11:14:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.248+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6240cafb0 con 0x7fc6240cbaf0 2023-11-29T11:14:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.252+0000 7fc619ffb700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc608064ee0 0x7fc608067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.252+0000 7fc619ffb700 1 -- 172.21.15.81:0/1335582935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc61c081ed0 con 0x7fc6240cbaf0 2023-11-29T11:14:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.252+0000 7fc62927f700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc608064ee0 0x7fc608067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.252+0000 7fc62927f700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc608064ee0 0x7fc608067390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc6200090b0 tx=0x7fc620008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.256+0000 7fc619ffb700 1 -- 172.21.15.81:0/1335582935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc61c04fe70 con 0x7fc6240cbaf0 2023-11-29T11:14:54.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6240c4930 con 0x7fc6240cbaf0 2023-11-29T11:14:54.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc619ffb700 1 -- 172.21.15.81:0/1335582935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc61c053490 con 0x7fc6240cbaf0 2023-11-29T11:14:54.426 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:14:54.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc608064ee0 msgr2=0x7fc608067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc608064ee0 0x7fc608067390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc6200090b0 tx=0x7fc620008030 comp rx=0 tx=0).stop 2023-11-29T11:14:54.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6240cbaf0 msgr2=0x7fc6240c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6240cbaf0 0x7fc6240c51f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00cb50 tx=0x7fc61c00ce60 comp rx=0 tx=0).stop 2023-11-29T11:14:54.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 shutdown_connections 2023-11-29T11:14:54.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc608064ee0 0x7fc608067390 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6240cbaf0 0x7fc6240c51f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6240cb5a0 0x7fc6240b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 --2- 172.21.15.81:0/1335582935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc62406a6e0 0x7fc6240c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 >> 172.21.15.81:0/1335582935 conn(0x7fc6240d0240 msgr2=0x7fc6240cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:54.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 shutdown_connections 2023-11-29T11:14:54.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.420+0000 7fc62a281700 1 -- 172.21.15.81:0/1335582935 wait complete. 2023-11-29T11:14:54.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:14:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.548+0000 7f1207fff700 1 Processor -- start 2023-11-29T11:14:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.548+0000 7f1207fff700 1 -- start start 2023-11-29T11:14:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f120815c520 0x7f1208069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12080b0910 con 0x7f12080ac1f0 2023-11-29T11:14:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120806a470 con 0x7f12080cca00 2023-11-29T11:14:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120806a750 con 0x7f120815c520 2023-11-29T11:14:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1206ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f120815c520 0x7f1208069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f12067fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f12080ac1f0 0x7f12080cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32826/0 (socket says 172.21.15.81:32826) 2023-11-29T11:14:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f12067fc700 1 -- 172.21.15.81:0/3804545360 learned_addr learned my addr 172.21.15.81:0/3804545360 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1205ffb700 1 -- 172.21.15.81:0/3804545360 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882885474 0 0) 0x7f12080b0910 con 0x7f12080ac1f0 2023-11-29T11:14:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1205ffb700 1 -- 172.21.15.81:0/3804545360 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f40035d0 con 0x7f12080ac1f0 2023-11-29T11:14:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1205ffb700 1 -- 172.21.15.81:0/3804545360 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727336241 0 0) 0x7f120806a470 con 0x7f12080cca00 2023-11-29T11:14:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1205ffb700 1 -- 172.21.15.81:0/3804545360 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12080b0910 con 0x7f12080cca00 2023-11-29T11:14:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1206ffd700 1 -- 172.21.15.81:0/3804545360 >> v1:172.21.15.176:6789/0 conn(0x7f12080cca00 legacy=0x7f12080b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1206ffd700 1 -- 172.21.15.81:0/3804545360 >> v1:172.21.15.81:6789/0 conn(0x7f12080ac1f0 legacy=0x7f12080cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1205ffb700 1 -- 172.21.15.81:0/3804545360 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2407503318 0 0) 0x7f11f40035d0 con 0x7f12080ac1f0 2023-11-29T11:14:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1206ffd700 1 -- 172.21.15.81:0/3804545360 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120806aa30 con 0x7f120815c520 2023-11-29T11:14:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1206ffd700 1 --2- 172.21.15.81:0/3804545360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f120815c520 0x7f1208069c40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009880 tx=0x7f11f8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7e4409e55177c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1205ffb700 1 -- 172.21.15.81:0/3804545360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0001670 con 0x7f120815c520 2023-11-29T11:14:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1205ffb700 1 -- 172.21.15.81:0/3804545360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8004030 con 0x7f120815c520 2023-11-29T11:14:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1205ffb700 1 -- 172.21.15.81:0/3804545360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80043a0 con 0x7f120815c520 2023-11-29T11:14:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 -- 172.21.15.81:0/3804545360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f120815c520 msgr2=0x7f1208069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 --2- 172.21.15.81:0/3804545360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f120815c520 0x7f1208069c40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009880 tx=0x7f11f8009b90 comp rx=0 tx=0).stop 2023-11-29T11:14:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 -- 172.21.15.81:0/3804545360 shutdown_connections 2023-11-29T11:14:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 --2- 172.21.15.81:0/3804545360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f120815c520 0x7f1208069c40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 -- 172.21.15.81:0/3804545360 >> 172.21.15.81:0/3804545360 conn(0x7f12080cae70 msgr2=0x7f12080cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 -- 172.21.15.81:0/3804545360 shutdown_connections 2023-11-29T11:14:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.552+0000 7f1207fff700 1 -- 172.21.15.81:0/3804545360 wait complete. 2023-11-29T11:14:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1207fff700 1 Processor -- start 2023-11-29T11:14:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1207fff700 1 -- start start 2023-11-29T11:14:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1207fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080ac1f0 0x7f120809ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1207fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12080cca00 0x7f12081f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1207fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f120815c520 0x7f12080711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1207fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1208099920 con 0x7f12080ac1f0 2023-11-29T11:14:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1207fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120809b070 con 0x7f120815c520 2023-11-29T11:14:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1207fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12081f1460 con 0x7f12080cca00 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080ac1f0 0x7f120809ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080ac1f0 0x7f120809ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51490/0 (socket says 172.21.15.81:51490) 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 -- 172.21.15.81:0/2752220883 learned_addr learned my addr 172.21.15.81:0/2752220883 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f12077fe700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f120815c520 0x7f12080711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f12067fc700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12080cca00 0x7f12081f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 -- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12080cca00 msgr2=0x7f12081f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12080cca00 0x7f12081f4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 -- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f120815c520 msgr2=0x7f12080711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f120815c520 0x7f12080711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 -- 172.21.15.81:0/2752220883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80094b0 con 0x7f12080ac1f0 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f12067fc700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12080cca00 0x7f12081f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.556+0000 7f1206ffd700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080ac1f0 0x7f120809ab30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1208066190 tx=0x7f11f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.560+0000 7f11fffff700 1 -- 172.21.15.81:0/2752220883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8003e60 con 0x7f12080ac1f0 2023-11-29T11:14:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.560+0000 7f11fffff700 1 -- 172.21.15.81:0/2752220883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8011630 con 0x7f12080ac1f0 2023-11-29T11:14:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.560+0000 7f11fffff700 1 -- 172.21.15.81:0/2752220883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80119c0 con 0x7f12080ac1f0 2023-11-29T11:14:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.560+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120806aff0 con 0x7f12080ac1f0 2023-11-29T11:14:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.560+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120806ad10 con 0x7f12080ac1f0 2023-11-29T11:14:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.560+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120806a180 con 0x7f12080ac1f0 2023-11-29T11:14:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.560+0000 7f11fffff700 1 -- 172.21.15.81:0/2752220883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f11f802b070 con 0x7f12080ac1f0 2023-11-29T11:14:54.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.564+0000 7f11fffff700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11e8064ee0 0x7f11e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.564+0000 7f12067fc700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11e8064ee0 0x7f11e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.564+0000 7f11fffff700 1 -- 172.21.15.81:0/2752220883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f11f8082f90 con 0x7f12080ac1f0 2023-11-29T11:14:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.564+0000 7f12067fc700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11e8064ee0 0x7f11e8067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f11f00017a0 tx=0x7f11f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.568+0000 7f11fffff700 1 -- 172.21.15.81:0/2752220883 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f11f8050f40 con 0x7f12080ac1f0 2023-11-29T11:14:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.724+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f120806d960 con 0x7f12080ac1f0 2023-11-29T11:14:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.724+0000 7f11fffff700 1 -- 172.21.15.81:0/2752220883 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11f8006ce0 con 0x7f12080ac1f0 2023-11-29T11:14:54.733 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:14:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11e8064ee0 msgr2=0x7f11e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11e8064ee0 0x7f11e8067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f11f00017a0 tx=0x7f11f0009040 comp rx=0 tx=0).stop 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080ac1f0 msgr2=0x7f120809ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080ac1f0 0x7f120809ab30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1208066190 tx=0x7f11f8004770 comp rx=0 tx=0).stop 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 shutdown_connections 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f11e8064ee0 0x7f11e8067390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f120815c520 0x7f12080711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12080cca00 0x7f12081f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 --2- 172.21.15.81:0/2752220883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080ac1f0 0x7f120809ab30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 >> 172.21.15.81:0/2752220883 conn(0x7f12080cae70 msgr2=0x7f12080b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 shutdown_connections 2023-11-29T11:14:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.728+0000 7f1207fff700 1 -- 172.21.15.81:0/2752220883 wait complete. 2023-11-29T11:14:54.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:14:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.856+0000 7f77113c3700 1 Processor -- start 2023-11-29T11:14:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.856+0000 7f77113c3700 1 -- start start 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f770c0b00e0 0x7f770c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f770c0cbb30 0x7f770c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0b2db0 con 0x7f770c09bdb0 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0b3240 con 0x7f770c0cbb30 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c06d840 con 0x7f770c0b00e0 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f7710bc2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f770c0cbb30 0x7f770c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f770b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f770c09bdb0 0x7f770c15d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32830/0 (socket says 172.21.15.81:32830) 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f770b7fe700 1 -- 172.21.15.81:0/3185109745 learned_addr learned my addr 172.21.15.81:0/3185109745 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f770bfff700 1 --2- 172.21.15.81:0/3185109745 >> v2:172.21.15.176:3300/0 conn(0x7f770c0b00e0 0x7f770c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f7710bc2700 1 -- 172.21.15.81:0/3185109745 >> v2:172.21.15.176:3300/0 conn(0x7f770c0b00e0 msgr2=0x7f770c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f7710bc2700 1 --2- 172.21.15.81:0/3185109745 >> v2:172.21.15.176:3300/0 conn(0x7f770c0b00e0 0x7f770c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f7710bc2700 1 -- 172.21.15.81:0/3185109745 >> v1:172.21.15.81:6789/0 conn(0x7f770c09bdb0 legacy=0x7f770c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f770affd700 1 -- 172.21.15.81:0/3185109745 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958251381 0 0) 0x7f770c0b2db0 con 0x7f770c09bdb0 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f7710bc2700 1 -- 172.21.15.81:0/3185109745 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c06d560 con 0x7f770c0cbb30 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f7710bc2700 1 --2- 172.21.15.81:0/3185109745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0cbb30 0x7f770c06bbd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f770c06fbf0 tx=0x7f770400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3966f4b24835fc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f770affd700 1 -- 172.21.15.81:0/3185109745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400e070 con 0x7f770c0cbb30 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f770affd700 1 -- 172.21.15.81:0/3185109745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770400bbd0 con 0x7f770c0cbb30 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f770affd700 1 -- 172.21.15.81:0/3185109745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704012430 con 0x7f770c0cbb30 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- 172.21.15.81:0/3185109745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0cbb30 msgr2=0x7f770c06bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 --2- 172.21.15.81:0/3185109745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0cbb30 0x7f770c06bbd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f770c06fbf0 tx=0x7f770400b330 comp rx=0 tx=0).stop 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- 172.21.15.81:0/3185109745 shutdown_connections 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 --2- 172.21.15.81:0/3185109745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0cbb30 0x7f770c06bbd0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 --2- 172.21.15.81:0/3185109745 >> v2:172.21.15.176:3300/0 conn(0x7f770c0b00e0 0x7f770c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- 172.21.15.81:0/3185109745 >> 172.21.15.81:0/3185109745 conn(0x7f770c0cae70 msgr2=0x7f770c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- 172.21.15.81:0/3185109745 shutdown_connections 2023-11-29T11:14:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- 172.21.15.81:0/3185109745 wait complete. 2023-11-29T11:14:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 Processor -- start 2023-11-29T11:14:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.860+0000 7f77113c3700 1 -- start start 2023-11-29T11:14:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770c09bdb0 0x7f770c15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0b00e0 0x7f770c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f770c0cbb30 0x7f770c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1f22d0 con 0x7f770c0b00e0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1f12a0 con 0x7f770c0cbb30 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0c47b0 con 0x7f770c09bdb0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0b00e0 0x7f770c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0b00e0 0x7f770c0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51506/0 (socket says 172.21.15.81:51506) 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 -- 172.21.15.81:0/214591721 learned_addr learned my addr 172.21.15.81:0/214591721 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f7710bc2700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f770c0cbb30 0x7f770c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770bfff700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770c09bdb0 0x7f770c15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 -- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770c09bdb0 msgr2=0x7f770c15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770c09bdb0 0x7f770c15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 -- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f770c0cbb30 msgr2=0x7f770c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f770c0cbb30 0x7f770c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 -- 172.21.15.81:0/214591721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7704009a70 con 0x7f770c0b00e0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770bfff700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770c09bdb0 0x7f770c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f770b7fe700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0b00e0 0x7f770c0c9a70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c4e0 tx=0x7f76fc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f7708ff9700 1 -- 172.21.15.81:0/214591721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc004ca0 con 0x7f770c0b00e0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f7708ff9700 1 -- 172.21.15.81:0/214591721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc004e00 con 0x7f770c0b00e0 2023-11-29T11:14:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c0ac3d0 con 0x7f770c0b00e0 2023-11-29T11:14:54.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f7708ff9700 1 -- 172.21.15.81:0/214591721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0072d0 con 0x7f770c0b00e0 2023-11-29T11:14:54.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c0ac0f0 con 0x7f770c0b00e0 2023-11-29T11:14:54.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0cc9f0 con 0x7f770c0b00e0 2023-11-29T11:14:54.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.864+0000 7f7708ff9700 1 -- 172.21.15.81:0/214591721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f76fc01a020 con 0x7f770c0b00e0 2023-11-29T11:14:54.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.868+0000 7f7708ff9700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f76ec064ee0 0x7f76ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:54.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.868+0000 7f7708ff9700 1 -- 172.21.15.81:0/214591721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f76fc081b90 con 0x7f770c0b00e0 2023-11-29T11:14:54.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.868+0000 7f770bfff700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f76ec064ee0 0x7f76ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:54.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.868+0000 7f770bfff700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f76ec064ee0 0x7f76ec067390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009a20 tx=0x7f76f4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:54.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:54.872+0000 7f7708ff9700 1 -- 172.21.15.81:0/214591721 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f76fc04fbb0 con 0x7f770c0b00e0 2023-11-29T11:14:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.032+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f770c072500 con 0x7f770c0b00e0 2023-11-29T11:14:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.032+0000 7f7708ff9700 1 -- 172.21.15.81:0/214591721 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f76fc0531d0 con 0x7f770c0b00e0 2023-11-29T11:14:55.040 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f76ec064ee0 msgr2=0x7f76ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f76ec064ee0 0x7f76ec067390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009a20 tx=0x7f76f4008040 comp rx=0 tx=0).stop 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0b00e0 msgr2=0x7f770c0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0b00e0 0x7f770c0c9a70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c4e0 tx=0x7f76fc00c8a0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 shutdown_connections 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f76ec064ee0 0x7f76ec067390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f770c0cbb30 0x7f770c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c0b00e0 0x7f770c0c9a70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 --2- 172.21.15.81:0/214591721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770c09bdb0 0x7f770c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 >> 172.21.15.81:0/214591721 conn(0x7f770c0cae70 msgr2=0x7f770c06a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 shutdown_connections 2023-11-29T11:14:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.036+0000 7f77113c3700 1 -- 172.21.15.81:0/214591721 wait complete. 2023-11-29T11:14:55.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:14:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.164+0000 7f619f555700 1 Processor -- start 2023-11-29T11:14:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.164+0000 7f619f555700 1 -- start start 2023-11-29T11:14:55.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.164+0000 7f619f555700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f619806ce60 0x7f61980d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.164+0000 7f619f555700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cce60 0x7f619806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.164+0000 7f619f555700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61980cd2d0 con 0x7f61980cf470 2023-11-29T11:14:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.164+0000 7f619f555700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619815c8b0 con 0x7f619806ce60 2023-11-29T11:14:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.164+0000 7f619f555700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619806d770 con 0x7f61980cce60 2023-11-29T11:14:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619e553700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f619806ce60 0x7f61980d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619e553700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f619806ce60 0x7f61980d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51518/0 (socket says 172.21.15.81:51518) 2023-11-29T11:14:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619e553700 1 -- 172.21.15.81:0/686599320 learned_addr learned my addr 172.21.15.81:0/686599320 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:55.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619dd52700 1 --2- 172.21.15.81:0/686599320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cce60 0x7f619806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619e553700 1 -- 172.21.15.81:0/686599320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cce60 msgr2=0x7f619806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619e553700 1 --2- 172.21.15.81:0/686599320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cce60 0x7f619806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619d551700 1 -- 172.21.15.81:0/686599320 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702104821 0 0) 0x7f61980cd2d0 con 0x7f61980cf470 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619e553700 1 -- 172.21.15.81:0/686599320 >> v1:172.21.15.176:6789/0 conn(0x7f61980cf470 legacy=0x7f61980cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619e553700 1 -- 172.21.15.81:0/686599320 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619806a7f0 con 0x7f619806ce60 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619e553700 1 --2- 172.21.15.81:0/686599320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980d31b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6188009910 tx=0x7f6188009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb324d255a1c51c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619d551700 1 -- 172.21.15.81:0/686599320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188011830 con 0x7f619806ce60 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619d551700 1 -- 172.21.15.81:0/686599320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188011990 con 0x7f619806ce60 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619d551700 1 -- 172.21.15.81:0/686599320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188011d40 con 0x7f619806ce60 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619f555700 1 -- 172.21.15.81:0/686599320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 msgr2=0x7f61980d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619f555700 1 --2- 172.21.15.81:0/686599320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980d31b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6188009910 tx=0x7f6188009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619f555700 1 -- 172.21.15.81:0/686599320 shutdown_connections 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619f555700 1 --2- 172.21.15.81:0/686599320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cce60 0x7f619806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619f555700 1 --2- 172.21.15.81:0/686599320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980d31b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619f555700 1 -- 172.21.15.81:0/686599320 >> 172.21.15.81:0/686599320 conn(0x7f61980b5760 msgr2=0x7f61980b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619f555700 1 -- 172.21.15.81:0/686599320 shutdown_connections 2023-11-29T11:14:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.168+0000 7f619f555700 1 -- 172.21.15.81:0/686599320 wait complete. 2023-11-29T11:14:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 Processor -- start 2023-11-29T11:14:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 -- start start 2023-11-29T11:14:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cce60 0x7f6198151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cf470 0x7f619815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980c6d10 con 0x7f619806ce60 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980c7f80 con 0x7f61980cce60 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980c9000 con 0x7f61980cf470 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51532/0 (socket says 172.21.15.81:51532) 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 -- 172.21.15.81:0/2353281683 learned_addr learned my addr 172.21.15.81:0/2353281683 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619dd52700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cce60 0x7f6198151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619ed54700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cf470 0x7f619815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 -- 172.21.15.81:0/2353281683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cf470 msgr2=0x7f619815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cf470 0x7f619815c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 -- 172.21.15.81:0/2353281683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cce60 msgr2=0x7f6198151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cce60 0x7f6198151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 -- 172.21.15.81:0/2353281683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188009570 con 0x7f619806ce60 2023-11-29T11:14:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619e553700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980c7a40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6188014040 tx=0x7f6188004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f618effd700 1 -- 172.21.15.81:0/2353281683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618801a830 con 0x7f619806ce60 2023-11-29T11:14:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f618effd700 1 -- 172.21.15.81:0/2353281683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618801e070 con 0x7f619806ce60 2023-11-29T11:14:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619806adb0 con 0x7f619806ce60 2023-11-29T11:14:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f618effd700 1 -- 172.21.15.81:0/2353281683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618801abd0 con 0x7f619806ce60 2023-11-29T11:14:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.172+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619806aad0 con 0x7f619806ce60 2023-11-29T11:14:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.176+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619806b090 con 0x7f619806ce60 2023-11-29T11:14:55.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.176+0000 7f618effd700 1 -- 172.21.15.81:0/2353281683 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f618800f050 con 0x7f619806ce60 2023-11-29T11:14:55.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.176+0000 7f618effd700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f617c064ee0 0x7f617c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.176+0000 7f619dd52700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f617c064ee0 0x7f617c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.176+0000 7f618effd700 1 -- 172.21.15.81:0/2353281683 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6188082f30 con 0x7f619806ce60 2023-11-29T11:14:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.176+0000 7f619dd52700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f617c064ee0 0x7f617c067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f61981f4ae0 tx=0x7f6194009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.184+0000 7f618effd700 1 -- 172.21.15.81:0/2353281683 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6188050e60 con 0x7f619806ce60 2023-11-29T11:14:55.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6198072c20 con 0x7f619806ce60 2023-11-29T11:14:55.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f618effd700 1 -- 172.21.15.81:0/2353281683 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6188015020 con 0x7f619806ce60 2023-11-29T11:14:55.351 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:14:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f617c064ee0 msgr2=0x7f617c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f619f555700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f617c064ee0 0x7f617c067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f61981f4ae0 tx=0x7f6194009240 comp rx=0 tx=0).stop 2023-11-29T11:14:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 msgr2=0x7f61980c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f619f555700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980c7a40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6188014040 tx=0x7f6188004770 comp rx=0 tx=0).stop 2023-11-29T11:14:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 shutdown_connections 2023-11-29T11:14:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f619f555700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f617c064ee0 0x7f617c067390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.344+0000 7f619f555700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61980cf470 0x7f619815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.348+0000 7f619f555700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61980cce60 0x7f6198151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.348+0000 7f619f555700 1 --2- 172.21.15.81:0/2353281683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f619806ce60 0x7f61980c7a40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.348+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 >> 172.21.15.81:0/2353281683 conn(0x7f61980b5760 msgr2=0x7f61980cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.348+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 shutdown_connections 2023-11-29T11:14:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.348+0000 7f619f555700 1 -- 172.21.15.81:0/2353281683 wait complete. 2023-11-29T11:14:55.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:55.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 Processor -- start 2023-11-29T11:14:55.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 -- start start 2023-11-29T11:14:55.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08d40b45f0 0x7f08d40d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cd1c0 0x7f08d40b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d40d0740 con 0x7f08d4160ac0 2023-11-29T11:14:55.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d40d1c90 con 0x7f08d40b45f0 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40d0990 con 0x7f08d40cd1c0 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d8b99700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08d4160ac0 0x7f08d40b49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32840/0 (socket says 172.21.15.81:32840) 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d8b99700 1 -- 172.21.15.81:0/4252656926 learned_addr learned my addr 172.21.15.81:0/4252656926 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cd1c0 0x7f08d40b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d939a700 1 --2- 172.21.15.81:0/4252656926 >> v2:172.21.15.176:3300/0 conn(0x7f08d40b45f0 0x7f08d40d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248331575 0 0) 0x7f08d40d0740 con 0x7f08d4160ac0 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08bc0035d0 con 0x7f08d4160ac0 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3754588986 0 0) 0x7f08bc0035d0 con 0x7f08d4160ac0 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cd1c0 msgr2=0x7f08d40b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cd1c0 0x7f08d40b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 >> v2:172.21.15.176:3300/0 conn(0x7f08d40b45f0 msgr2=0x7f08d40d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 --2- 172.21.15.81:0/4252656926 >> v2:172.21.15.176:3300/0 conn(0x7f08d40b45f0 0x7f08d40d1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40d0c70 con 0x7f08d4160ac0 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f08d00019f0 con 0x7f08d4160ac0 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 >> v1:172.21.15.81:6789/0 conn(0x7f08d4160ac0 legacy=0x7f08d40b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08bc003a20 0x7f08bc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cd1c0 0x7f08bc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08bc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40d1c90 con 0x7f08bc004db0 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40d0990 con 0x7f08bc003a20 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc00ba30 con 0x7f08d40cd1c0 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08bc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d8b99700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cd1c0 0x7f08bc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d939a700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08bc003a20 0x7f08bc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 -- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cd1c0 msgr2=0x7f08bc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cd1c0 0x7f08bc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 -- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08bc003a20 msgr2=0x7f08bc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08bc003a20 0x7f08bc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 -- 172.21.15.81:0/4252656926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0035d0 con 0x7f08bc004db0 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08bc005220 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009b70 tx=0x7f08bc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84be76dfd60e99e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00e6c0 con 0x7f08bc004db0 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc00e820 con 0x7f08bc004db0 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08cbfff700 1 -- 172.21.15.81:0/4252656926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00eb90 con 0x7f08bc004db0 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 -- 172.21.15.81:0/4252656926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 msgr2=0x7f08bc005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 --2- 172.21.15.81:0/4252656926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08bc005220 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009b70 tx=0x7f08bc0058a0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08d9b9b700 1 -- 172.21.15.81:0/4252656926 reap_dead start 2023-11-29T11:14:55.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 -- 172.21.15.81:0/4252656926 shutdown_connections 2023-11-29T11:14:55.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.472+0000 7f08db5fe700 1 -- 172.21.15.81:0/4252656926 >> 172.21.15.81:0/4252656926 conn(0x7f08d406cb40 msgr2=0x7f08d40cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:55.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 -- 172.21.15.81:0/4252656926 shutdown_connections 2023-11-29T11:14:55.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 -- 172.21.15.81:0/4252656926 wait complete. 2023-11-29T11:14:55.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 Processor -- start 2023-11-29T11:14:55.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 -- start start 2023-11-29T11:14:55.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08d40c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cf860 0x7f08d41eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d40cfcd0 0x7f08d41ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40c6d90 con 0x7f08bc004db0 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41f2de0 con 0x7f08d40cfcd0 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41f2b00 con 0x7f08d40cf860 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08d40c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08d40c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51544/0 (socket says 172.21.15.81:51544) 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 -- 172.21.15.81:0/2138203949 learned_addr learned my addr 172.21.15.81:0/2138203949 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d8b99700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cf860 0x7f08d41eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d9b9b700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d40cfcd0 0x7f08d41ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 -- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cf860 msgr2=0x7f08d41eef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cf860 0x7f08d41eef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 -- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d40cfcd0 msgr2=0x7f08d41ef480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d40cfcd0 0x7f08d41ef480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 -- 172.21.15.81:0/2138203949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40d1230 con 0x7f08bc004db0 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d8b99700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cf860 0x7f08d41eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08d939a700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08d40c7220 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f08c4011aa0 tx=0x7f08c4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08c9ffb700 1 -- 172.21.15.81:0/2138203949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400f9e0 con 0x7f08bc004db0 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08c9ffb700 1 -- 172.21.15.81:0/2138203949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400fb40 con 0x7f08bc004db0 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d40d0f50 con 0x7f08bc004db0 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.476+0000 7f08c9ffb700 1 -- 172.21.15.81:0/2138203949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4014440 con 0x7f08bc004db0 2023-11-29T11:14:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.480+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d415c660 con 0x7f08bc004db0 2023-11-29T11:14:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.480+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d4072c20 con 0x7f08bc004db0 2023-11-29T11:14:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.480+0000 7f08c9ffb700 1 -- 172.21.15.81:0/2138203949 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f08c40145a0 con 0x7f08bc004db0 2023-11-29T11:14:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.480+0000 7f08c9ffb700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f08c0064ee0 0x7f08c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.480+0000 7f08c9ffb700 1 -- 172.21.15.81:0/2138203949 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f08c4082a50 con 0x7f08bc004db0 2023-11-29T11:14:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.480+0000 7f08d8b99700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f08c0064ee0 0x7f08c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.480+0000 7f08d8b99700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f08c0064ee0 0x7f08c0067390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f08d0007260 tx=0x7f08d0006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.488+0000 7f08c9ffb700 1 -- 172.21.15.81:0/2138203949 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f08c4050a10 con 0x7f08bc004db0 2023-11-29T11:14:55.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.692+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08d40d28a0 con 0x7f08bc004db0 2023-11-29T11:14:55.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.692+0000 7f08c9ffb700 1 -- 172.21.15.81:0/2138203949 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f08c4054030 con 0x7f08bc004db0 2023-11-29T11:14:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:55.699 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:14:16.825795+0000","modified":"2023-11-29T11:14:19.853366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1909362607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1909362607},{"type":"v1","addr":"172.21.15.176:6833","nonce":1909362607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f08c0064ee0 msgr2=0x7f08c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f08c0064ee0 0x7f08c0067390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f08d0007260 tx=0x7f08d0006040 comp rx=0 tx=0).stop 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 msgr2=0x7f08d40c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08d40c7220 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f08c4011aa0 tx=0x7f08c4011e60 comp rx=0 tx=0).stop 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 shutdown_connections 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f08c0064ee0 0x7f08c0067390 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d40cfcd0 0x7f08d41ef480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08d40cf860 0x7f08d41eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 --2- 172.21.15.81:0/2138203949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08bc004db0 0x7f08d40c7220 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 >> 172.21.15.81:0/2138203949 conn(0x7f08d406cb40 msgr2=0x7f08d41562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 shutdown_connections 2023-11-29T11:14:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.696+0000 7f08db5fe700 1 -- 172.21.15.81:0/2138203949 wait complete. 2023-11-29T11:14:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-11-29T11:14:55.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.820+0000 7ff6e2b60700 1 Processor -- start 2023-11-29T11:14:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- start start 2023-11-29T11:14:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6dc0cc730 0x7ff6dc0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff6dc1594f0 0x7ff6dc159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6dc0cd720 con 0x7ff6dc15d650 2023-11-29T11:14:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc0cd990 con 0x7ff6dc0cc730 2023-11-29T11:14:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc0cdc70 con 0x7ff6dc1594f0 2023-11-29T11:14:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e135d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6dc0cc730 0x7ff6dc0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e135d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6dc0cc730 0x7ff6dc0ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51550/0 (socket says 172.21.15.81:51550) 2023-11-29T11:14:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e135d700 1 -- 172.21.15.81:0/1372255684 learned_addr learned my addr 172.21.15.81:0/1372255684 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e235f700 1 --2- 172.21.15.81:0/1372255684 >> v2:172.21.15.176:3300/0 conn(0x7ff6dc1594f0 0x7ff6dc159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e135d700 1 -- 172.21.15.81:0/1372255684 >> v2:172.21.15.176:3300/0 conn(0x7ff6dc1594f0 msgr2=0x7ff6dc159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e135d700 1 --2- 172.21.15.81:0/1372255684 >> v2:172.21.15.176:3300/0 conn(0x7ff6dc1594f0 0x7ff6dc159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e135d700 1 -- 172.21.15.81:0/1372255684 >> v1:172.21.15.176:6789/0 conn(0x7ff6dc15d650 legacy=0x7ff6dc0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e135d700 1 -- 172.21.15.81:0/1372255684 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc0cdf50 con 0x7ff6dc0cc730 2023-11-29T11:14:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e135d700 1 --2- 172.21.15.81:0/1372255684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc0cc730 0x7ff6dc0ce470 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc070ee0 tx=0x7ff6cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906b510ca98132cb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e0b5c700 1 -- 172.21.15.81:0/1372255684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc011830 con 0x7ff6dc0cc730 2023-11-29T11:14:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e0b5c700 1 -- 172.21.15.81:0/1372255684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc011990 con 0x7ff6dc0cc730 2023-11-29T11:14:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e0b5c700 1 -- 172.21.15.81:0/1372255684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc011d20 con 0x7ff6dc0cc730 2023-11-29T11:14:55.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- 172.21.15.81:0/1372255684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc0cc730 msgr2=0x7ff6dc0ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/1372255684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc0cc730 0x7ff6dc0ce470 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc070ee0 tx=0x7ff6cc009bf0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- 172.21.15.81:0/1372255684 shutdown_connections 2023-11-29T11:14:55.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/1372255684 >> v2:172.21.15.176:3300/0 conn(0x7ff6dc1594f0 0x7ff6dc159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/1372255684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc0cc730 0x7ff6dc0ce470 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- 172.21.15.81:0/1372255684 >> 172.21.15.81:0/1372255684 conn(0x7ff6dc06ec40 msgr2=0x7ff6dc0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:55.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- 172.21.15.81:0/1372255684 shutdown_connections 2023-11-29T11:14:55.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.824+0000 7ff6e2b60700 1 -- 172.21.15.81:0/1372255684 wait complete. 2023-11-29T11:14:55.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 Processor -- start 2023-11-29T11:14:55.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 -- start start 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6dc0cc730 0x7ff6dc0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6dc1594f0 0x7ff6dc0c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc15d650 0x7ff6dc0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0b53e0 con 0x7ff6dc15d650 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0c5f60 con 0x7ff6dc0cc730 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0c3120 con 0x7ff6dc1594f0 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc15d650 0x7ff6dc0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc15d650 0x7ff6dc0c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51556/0 (socket says 172.21.15.81:51556) 2023-11-29T11:14:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 -- 172.21.15.81:0/2273016965 learned_addr learned my addr 172.21.15.81:0/2273016965 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e1b5e700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6dc0cc730 0x7ff6dc0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e135d700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6dc1594f0 0x7ff6dc0c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 -- 172.21.15.81:0/2273016965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6dc1594f0 msgr2=0x7ff6dc0c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6dc1594f0 0x7ff6dc0c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 -- 172.21.15.81:0/2273016965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6dc0cc730 msgr2=0x7ff6dc0b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6dc0cc730 0x7ff6dc0b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 -- 172.21.15.81:0/2273016965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc009570 con 0x7ff6dc15d650 2023-11-29T11:14:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e235f700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc15d650 0x7ff6dc0c55d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400efc0 tx=0x7ff6d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6d27fc700 1 -- 172.21.15.81:0/2273016965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4009ea0 con 0x7ff6dc15d650 2023-11-29T11:14:55.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6d27fc700 1 -- 172.21.15.81:0/2273016965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d400f040 con 0x7ff6dc15d650 2023-11-29T11:14:55.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc159e50 con 0x7ff6dc15d650 2023-11-29T11:14:55.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6d27fc700 1 -- 172.21.15.81:0/2273016965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400ced0 con 0x7ff6dc15d650 2023-11-29T11:14:55.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.828+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc15a250 con 0x7ff6dc15d650 2023-11-29T11:14:55.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.832+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6dc159fe0 con 0x7ff6dc15d650 2023-11-29T11:14:55.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.832+0000 7ff6d27fc700 1 -- 172.21.15.81:0/2273016965 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff6d4014480 con 0x7ff6dc15d650 2023-11-29T11:14:55.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.832+0000 7ff6d27fc700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6c0064ee0 0x7ff6c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:55.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.832+0000 7ff6e1b5e700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6c0064ee0 0x7ff6c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:55.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.832+0000 7ff6d27fc700 1 -- 172.21.15.81:0/2273016965 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff6d4082ae0 con 0x7ff6dc15d650 2023-11-29T11:14:55.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.832+0000 7ff6e1b5e700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6c0064ee0 0x7ff6c0067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8000f60 tx=0x7ff6d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:55.840+0000 7ff6d27fc700 1 -- 172.21.15.81:0/2273016965 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff6d4050930 con 0x7ff6dc15d650 2023-11-29T11:14:55.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:14:55.977 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:14:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.004+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6dc0c60d0 con 0x7ff6dc15d650 2023-11-29T11:14:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.008+0000 7ff6d27fc700 1 -- 172.21.15.81:0/2273016965 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18126 (secure 0 0 0) 0x7ff6d4053f50 con 0x7ff6dc15d650 2023-11-29T11:14:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:56.016 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:42.074222+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:14:14.596602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-29T11:14:15.817550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6c0064ee0 msgr2=0x7ff6c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6c0064ee0 0x7ff6c0067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8000f60 tx=0x7ff6d8009040 comp rx=0 tx=0).stop 2023-11-29T11:14:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc15d650 msgr2=0x7ff6dc0c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc15d650 0x7ff6dc0c55d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400efc0 tx=0x7ff6d400c3a0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 shutdown_connections 2023-11-29T11:14:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6c0064ee0 0x7ff6c0067390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6dc15d650 0x7ff6dc0c55d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6dc1594f0 0x7ff6dc0c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 --2- 172.21.15.81:0/2273016965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6dc0cc730 0x7ff6dc0b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 >> 172.21.15.81:0/2273016965 conn(0x7ff6dc06ec40 msgr2=0x7ff6dc06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 shutdown_connections 2023-11-29T11:14:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.012+0000 7ff6e2b60700 1 -- 172.21.15.81:0/2273016965 wait complete. 2023-11-29T11:14:56.036 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T11:14:56.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:56.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.140+0000 7f62aa3b8700 1 Processor -- start 2023-11-29T11:14:56.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.140+0000 7f62aa3b8700 1 -- start start 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62a40ca310 0x7f62a406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a4069eb0 0x7f62a406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a406d000 con 0x7f62a406cbb0 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a40cdeb0 con 0x7f62a40ca310 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40cca10 con 0x7f62a4069eb0 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a93b6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62a40ca310 0x7f62a406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a93b6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62a40ca310 0x7f62a406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51566/0 (socket says 172.21.15.81:51566) 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a93b6700 1 -- 172.21.15.81:0/2164646866 learned_addr learned my addr 172.21.15.81:0/2164646866 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a8bb5700 1 --2- 172.21.15.81:0/2164646866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a4069eb0 0x7f62a406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a93b6700 1 -- 172.21.15.81:0/2164646866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a4069eb0 msgr2=0x7f62a406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a93b6700 1 --2- 172.21.15.81:0/2164646866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a4069eb0 0x7f62a406c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a93b6700 1 -- 172.21.15.81:0/2164646866 >> v1:172.21.15.176:6789/0 conn(0x7f62a406cbb0 legacy=0x7f62a415b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a93b6700 1 -- 172.21.15.81:0/2164646866 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a406a670 con 0x7f62a40ca310 2023-11-29T11:14:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62a93b6700 1 --2- 172.21.15.81:0/2164646866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a40ca310 0x7f62a406c0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6294009910 tx=0x7f6294009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d944c2ccfd92a59c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f629bfff700 1 -- 172.21.15.81:0/2164646866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294011830 con 0x7f62a40ca310 2023-11-29T11:14:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f629bfff700 1 -- 172.21.15.81:0/2164646866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6294011990 con 0x7f62a40ca310 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f629bfff700 1 -- 172.21.15.81:0/2164646866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294011d40 con 0x7f62a40ca310 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 -- 172.21.15.81:0/2164646866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a40ca310 msgr2=0x7f62a406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/2164646866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a40ca310 0x7f62a406c0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6294009910 tx=0x7f6294009c20 comp rx=0 tx=0).stop 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 -- 172.21.15.81:0/2164646866 shutdown_connections 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/2164646866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a4069eb0 0x7f62a406c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/2164646866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a40ca310 0x7f62a406c0a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 -- 172.21.15.81:0/2164646866 >> 172.21.15.81:0/2164646866 conn(0x7f62a40ce3e0 msgr2=0x7f62a40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 -- 172.21.15.81:0/2164646866 shutdown_connections 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.144+0000 7f62aa3b8700 1 -- 172.21.15.81:0/2164646866 wait complete. 2023-11-29T11:14:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 Processor -- start 2023-11-29T11:14:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 -- start start 2023-11-29T11:14:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a4069eb0 0x7f62a415be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a406cbb0 0x7f62a4157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40ca310 0x7f62a40c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a409c290 con 0x7f62a406cbb0 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4159190 con 0x7f62a4069eb0 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4159470 con 0x7f62a40ca310 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a406cbb0 0x7f62a4157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a406cbb0 0x7f62a4157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51572/0 (socket says 172.21.15.81:51572) 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 -- 172.21.15.81:0/142476306 learned_addr learned my addr 172.21.15.81:0/142476306 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a93b6700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a4069eb0 0x7f62a415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a9bb7700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40ca310 0x7f62a40c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 -- 172.21.15.81:0/142476306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40ca310 msgr2=0x7f62a40c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40ca310 0x7f62a40c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 -- 172.21.15.81:0/142476306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a4069eb0 msgr2=0x7f62a415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a4069eb0 0x7f62a415be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 -- 172.21.15.81:0/142476306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294009570 con 0x7f62a406cbb0 2023-11-29T11:14:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62a8bb5700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a406cbb0 0x7f62a4157f90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f62a000efc0 tx=0x7f62a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f6299ffb700 1 -- 172.21.15.81:0/142476306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a000cdc0 con 0x7f62a406cbb0 2023-11-29T11:14:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f6299ffb700 1 -- 172.21.15.81:0/142476306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a000f040 con 0x7f62a406cbb0 2023-11-29T11:14:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f6299ffb700 1 -- 172.21.15.81:0/142476306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a00146a0 con 0x7f62a406cbb0 2023-11-29T11:14:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a406ac30 con 0x7f62a406cbb0 2023-11-29T11:14:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.148+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a406a950 con 0x7f62a406cbb0 2023-11-29T11:14:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.152+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a40c8a30 con 0x7f62a406cbb0 2023-11-29T11:14:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.152+0000 7f6299ffb700 1 -- 172.21.15.81:0/142476306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f62a0014800 con 0x7f62a406cbb0 2023-11-29T11:14:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.152+0000 7f6299ffb700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6288064ee0 0x7f6288067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.152+0000 7f6299ffb700 1 -- 172.21.15.81:0/142476306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f62a0082b40 con 0x7f62a406cbb0 2023-11-29T11:14:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.152+0000 7f62a93b6700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6288064ee0 0x7f6288067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.152+0000 7f62a93b6700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6288064ee0 0x7f6288067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6294014040 tx=0x7f6294008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.156+0000 7f6299ffb700 1 -- 172.21.15.81:0/142476306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f62a0050ae0 con 0x7f62a406cbb0 2023-11-29T11:14:56.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.352+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62a4072500 con 0x7f62a406cbb0 2023-11-29T11:14:56.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.352+0000 7f6299ffb700 1 -- 172.21.15.81:0/142476306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f62a0054100 con 0x7f62a406cbb0 2023-11-29T11:14:56.359 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:56.360 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:14:16.825795+0000","modified":"2023-11-29T11:14:19.853366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1909362607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1909362607},{"type":"v1","addr":"172.21.15.176:6833","nonce":1909362607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T11:14:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6288064ee0 msgr2=0x7f6288067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6288064ee0 0x7f6288067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6294014040 tx=0x7f6294008030 comp rx=0 tx=0).stop 2023-11-29T11:14:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a406cbb0 msgr2=0x7f62a4157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a406cbb0 0x7f62a4157f90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f62a000efc0 tx=0x7f62a000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 shutdown_connections 2023-11-29T11:14:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6288064ee0 0x7f6288067390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62a40ca310 0x7f62a40c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62a406cbb0 0x7f62a4157f90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 --2- 172.21.15.81:0/142476306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62a4069eb0 0x7f62a415be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 >> 172.21.15.81:0/142476306 conn(0x7f62a40ce3e0 msgr2=0x7f62a40ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 shutdown_connections 2023-11-29T11:14:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.356+0000 7f62aa3b8700 1 -- 172.21.15.81:0/142476306 wait complete. 2023-11-29T11:14:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-11-29T11:14:56.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:14:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.480+0000 7fa1b4b99700 1 Processor -- start 2023-11-29T11:14:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.480+0000 7fa1b4b99700 1 -- start start 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1a8051ae0 0x7fa1a80df480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a80e03b0 con 0x7fa1a8007280 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a80dfdf0 con 0x7fa1a8037000 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a80e00d0 con 0x7fa1a8051ae0 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1affff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa1a8007280 0x7fa1a8053360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32844/0 (socket says 172.21.15.81:32844) 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1affff700 1 -- 172.21.15.81:0/730585672 learned_addr learned my addr 172.21.15.81:0/730585672 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1aeffd700 1 --2- 172.21.15.81:0/730585672 >> v2:172.21.15.176:3300/0 conn(0x7fa1a8051ae0 0x7fa1a80df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558045269 0 0) 0x7fa1a80e03b0 con 0x7fa1a8007280 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a00035d0 con 0x7fa1a8007280 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3973827823 0 0) 0x7fa1a00035d0 con 0x7fa1a8007280 2023-11-29T11:14:56.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 >> v2:172.21.15.176:3300/0 conn(0x7fa1a8051ae0 msgr2=0x7fa1a80df480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 --2- 172.21.15.81:0/730585672 >> v2:172.21.15.176:3300/0 conn(0x7fa1a8051ae0 0x7fa1a80df480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 >> v1:172.21.15.176:6789/0 conn(0x7fa1a8037000 legacy=0x7fa1a80373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a8006a80 con 0x7fa1a8007280 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fa1b00008d0 con 0x7fa1a8007280 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 >> v1:172.21.15.81:6789/0 conn(0x7fa1a8007280 legacy=0x7fa1a8053360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a0003a20 0x7fa1a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00043b0 0x7fa1a0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a0005110 0x7fa1a000ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80e00d0 con 0x7fa1a00043b0 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a000c040 con 0x7fa1a0005110 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a000c200 con 0x7fa1a0003a20 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1aeffd700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00043b0 0x7fa1a0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1affff700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a0005110 0x7fa1a000ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1af7fe700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a0003a20 0x7fa1a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1aeffd700 1 -- 172.21.15.81:0/730585672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a0003a20 msgr2=0x7fa1a0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1aeffd700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a0003a20 0x7fa1a0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1aeffd700 1 -- 172.21.15.81:0/730585672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a0005110 msgr2=0x7fa1a000ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1aeffd700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a0005110 0x7fa1a000ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1affff700 1 -- 172.21.15.81:0/730585672 reap_dead start 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1aeffd700 1 -- 172.21.15.81:0/730585672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00035d0 con 0x7fa1a00043b0 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1aeffd700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00043b0 0x7fa1a0004870 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00aaf0 tx=0x7fa1a00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529558124b4013c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00e960 con 0x7fa1a00043b0 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c00eac0 con 0x7fa1a00043b0 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1ae7fc700 1 -- 172.21.15.81:0/730585672 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00ee50 con 0x7fa1a00043b0 2023-11-29T11:14:56.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 -- 172.21.15.81:0/730585672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00043b0 msgr2=0x7fa1a0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00043b0 0x7fa1a0004870 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00aaf0 tx=0x7fa1a00058a0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 -- 172.21.15.81:0/730585672 shutdown_connections 2023-11-29T11:14:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 --2- 172.21.15.81:0/730585672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a00043b0 0x7fa1a0004870 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 -- 172.21.15.81:0/730585672 >> 172.21.15.81:0/730585672 conn(0x7fa1a8052000 msgr2=0x7fa1a8052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 -- 172.21.15.81:0/730585672 shutdown_connections 2023-11-29T11:14:56.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.484+0000 7fa1b4b99700 1 -- 172.21.15.81:0/730585672 wait complete. 2023-11-29T11:14:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 Processor -- start 2023-11-29T11:14:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 -- start start 2023-11-29T11:14:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a00043b0 0x7fa1a8039210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a803a410 0x7fa1a80ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a80de2b0 0x7fa1a804e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8039750 con 0x7fa1a803a410 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80de720 con 0x7fa1a00043b0 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8038d80 con 0x7fa1a80de2b0 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a803a410 0x7fa1a80ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a803a410 0x7fa1a80ddd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51584/0 (socket says 172.21.15.81:51584) 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 -- 172.21.15.81:0/1130825474 learned_addr learned my addr 172.21.15.81:0/1130825474 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1af7fe700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a00043b0 0x7fa1a8039210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1affff700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a80de2b0 0x7fa1a804e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 -- 172.21.15.81:0/1130825474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a80de2b0 msgr2=0x7fa1a804e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a80de2b0 0x7fa1a804e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 -- 172.21.15.81:0/1130825474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a00043b0 msgr2=0x7fa1a8039210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a00043b0 0x7fa1a8039210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 -- 172.21.15.81:0/1130825474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80dcc90 con 0x7fa1a803a410 2023-11-29T11:14:56.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1aeffd700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a803a410 0x7fa1a80ddd70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e550 tx=0x7fa19c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa19bfff700 1 -- 172.21.15.81:0/1130825474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c021070 con 0x7fa1a803a410 2023-11-29T11:14:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa19bfff700 1 -- 172.21.15.81:0/1130825474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c004250 con 0x7fa1a803a410 2023-11-29T11:14:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a8006d60 con 0x7fa1a803a410 2023-11-29T11:14:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa19bfff700 1 -- 172.21.15.81:0/1130825474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c004600 con 0x7fa1a803a410 2023-11-29T11:14:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.488+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a80dce20 con 0x7fa1a803a410 2023-11-29T11:14:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.492+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a8052e70 con 0x7fa1a803a410 2023-11-29T11:14:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.492+0000 7fa19bfff700 1 -- 172.21.15.81:0/1130825474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa19c018030 con 0x7fa1a803a410 2023-11-29T11:14:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.492+0000 7fa19bfff700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa194064ee0 0x7fa194067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.492+0000 7fa1af7fe700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa194064ee0 0x7fa194067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.492+0000 7fa19bfff700 1 -- 172.21.15.81:0/1130825474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa19c082930 con 0x7fa1a803a410 2023-11-29T11:14:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.492+0000 7fa1af7fe700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa194064ee0 0x7fa194067390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4007fd0 tx=0x7fa1a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.496+0000 7fa19bfff700 1 -- 172.21.15.81:0/1130825474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa19c0508f0 con 0x7fa1a803a410 2023-11-29T11:14:56.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.692+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1a8005e40 con 0x7fa1a803a410 2023-11-29T11:14:56.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa19bfff700 1 -- 172.21.15.81:0/1130825474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fa19c053f10 con 0x7fa1a803a410 2023-11-29T11:14:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:56.702 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:14:16.825795+0000","modified":"2023-11-29T11:14:19.853366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5580},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5580":{"gid":5580,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1909362607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1909362607},{"type":"v1","addr":"172.21.15.176:6833","nonce":1909362607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T11:14:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa194064ee0 msgr2=0x7fa194067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa194064ee0 0x7fa194067390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4007fd0 tx=0x7fa1a4009040 comp rx=0 tx=0).stop 2023-11-29T11:14:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a803a410 msgr2=0x7fa1a80ddd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a803a410 0x7fa1a80ddd70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e550 tx=0x7fa19c0047e0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 shutdown_connections 2023-11-29T11:14:56.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa194064ee0 0x7fa194067390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1a80de2b0 0x7fa1a804e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1a803a410 0x7fa1a80ddd70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 --2- 172.21.15.81:0/1130825474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1a00043b0 0x7fa1a8039210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 >> 172.21.15.81:0/1130825474 conn(0x7fa1a8052000 msgr2=0x7fa1a80df260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 shutdown_connections 2023-11-29T11:14:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.696+0000 7fa1b4b99700 1 -- 172.21.15.81:0/1130825474 wait complete. 2023-11-29T11:14:56.705 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2023-11-29T11:14:56.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:14:56.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd025325700 1 Processor -- start 2023-11-29T11:14:56.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd025325700 1 -- start start 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd025325700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 0x7fd0200c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd025325700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0200cd8f0 con 0x7fd0200ad490 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd025325700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02006dc60 con 0x7fd0200cb460 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd025325700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200add00 con 0x7fd020158e60 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd0200ad490 0x7fd0200cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32856/0 (socket says 172.21.15.81:32856) 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01f7fe700 1 -- 172.21.15.81:0/3663903748 learned_addr learned my addr 172.21.15.81:0/3663903748 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01ffff700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 0x7fd0200c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124107939 0 0) 0x7fd0200cd8f0 con 0x7fd0200ad490 2023-11-29T11:14:56.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0080035d0 con 0x7fd0200ad490 2023-11-29T11:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116532437 0 0) 0x7fd02006dc60 con 0x7fd0200cb460 2023-11-29T11:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0200cd8f0 con 0x7fd0200cb460 2023-11-29T11:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772339101 0 0) 0x7fd0080035d0 con 0x7fd0200ad490 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 msgr2=0x7fd0200c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 0x7fd0200c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 >> v1:172.21.15.176:6789/0 conn(0x7fd0200cb460 legacy=0x7fd02006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200cde90 con 0x7fd0200ad490 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fd0180019f0 con 0x7fd0200ad490 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 >> v1:172.21.15.81:6789/0 conn(0x7fd0200ad490 legacy=0x7fd0200cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 0x7fd008003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd008004190 0x7fd008004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd008004db0 0x7fd008005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200add00 con 0x7fd008004db0 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00800ddd0 con 0x7fd008004190 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00800df90 con 0x7fd020158e60 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd024b24700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd008004db0 0x7fd008005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.820+0000 7fd01ffff700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 0x7fd008003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd01f7fe700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd008004190 0x7fd008004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd024b24700 1 -- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 msgr2=0x7fd008003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd024b24700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 0x7fd008003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd024b24700 1 -- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd008004190 msgr2=0x7fd008004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd024b24700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd008004190 0x7fd008004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd024b24700 1 -- 172.21.15.81:0/3663903748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080035d0 con 0x7fd008004db0 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd01ffff700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd020158e60 0x7fd008003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd024b24700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd008004db0 0x7fd008005220 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd010001960 tx=0x7fd0080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b087804eddd6461a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010001450 con 0x7fd008004db0 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0100052f0 con 0x7fd008004db0 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd01effd700 1 -- 172.21.15.81:0/3663903748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100036a0 con 0x7fd008004db0 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd025325700 1 -- 172.21.15.81:0/3663903748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd008004db0 msgr2=0x7fd008005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd025325700 1 --2- 172.21.15.81:0/3663903748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd008004db0 0x7fd008005220 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd010001960 tx=0x7fd0080058a0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd024b24700 1 -- 172.21.15.81:0/3663903748 reap_dead start 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd025325700 1 -- 172.21.15.81:0/3663903748 shutdown_connections 2023-11-29T11:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd025325700 1 -- 172.21.15.81:0/3663903748 >> 172.21.15.81:0/3663903748 conn(0x7fd0200ce3e0 msgr2=0x7fd0200ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd025325700 1 -- 172.21.15.81:0/3663903748 shutdown_connections 2023-11-29T11:14:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd025325700 1 -- 172.21.15.81:0/3663903748 wait complete. 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd025325700 1 Processor -- start 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.824+0000 7fd025325700 1 -- start start 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd008004db0 0x7fd0200ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0200c7180 0x7fd02015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0201489c0 0x7fd020148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c8530 con 0x7fd0200c7180 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02015c1a0 con 0x7fd0201489c0 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c7920 con 0x7fd008004db0 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0200c7180 0x7fd02015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0200c7180 0x7fd02015bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51596/0 (socket says 172.21.15.81:51596) 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 -- 172.21.15.81:0/3518394817 learned_addr learned my addr 172.21.15.81:0/3518394817 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01ffff700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd008004db0 0x7fd0200ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd024b24700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0201489c0 0x7fd020148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 -- 172.21.15.81:0/3518394817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd008004db0 msgr2=0x7fd0200ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd008004db0 0x7fd0200ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 -- 172.21.15.81:0/3518394817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0201489c0 msgr2=0x7fd020148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0201489c0 0x7fd020148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 -- 172.21.15.81:0/3518394817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02006d6a0 con 0x7fd0200c7180 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01f7fe700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0200c7180 0x7fd02015bc60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd01800e240 tx=0x7fd018007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01cff9700 1 -- 172.21.15.81:0/3518394817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01800ea90 con 0x7fd0200c7180 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01cff9700 1 -- 172.21.15.81:0/3518394817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01800ec10 con 0x7fd0200c7180 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd020159230 con 0x7fd0200c7180 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd01cff9700 1 -- 172.21.15.81:0/3518394817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018013420 con 0x7fd0200c7180 2023-11-29T11:14:56.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02006d980 con 0x7fd0200c7180 2023-11-29T11:14:56.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.828+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0200c4fa0 con 0x7fd0200c7180 2023-11-29T11:14:56.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.832+0000 7fd01cff9700 1 -- 172.21.15.81:0/3518394817 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd018013580 con 0x7fd0200c7180 2023-11-29T11:14:56.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.832+0000 7fd01cff9700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd00c064ee0 0x7fd00c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:56.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.832+0000 7fd01cff9700 1 -- 172.21.15.81:0/3518394817 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fd018083060 con 0x7fd0200c7180 2023-11-29T11:14:56.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.832+0000 7fd01ffff700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd00c064ee0 0x7fd00c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:56.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.832+0000 7fd01ffff700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd00c064ee0 0x7fd00c067390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd014009bf0 tx=0x7fd014008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:56.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:56.836+0000 7fd01cff9700 1 -- 172.21.15.81:0/3518394817 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd0180510c0 con 0x7fd0200c7180 2023-11-29T11:14:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.000+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd020072500 con 0x7fd0200c7180 2023-11-29T11:14:57.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.004+0000 7fd01cff9700 1 -- 172.21.15.81:0/3518394817 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18126 (secure 0 0 0) 0x7fd0180546e0 con 0x7fd0200c7180 2023-11-29T11:14:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:14:57.011 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:14:42.074222+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:14:14.596602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-29T11:14:15.817550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:14:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.004+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd00c064ee0 msgr2=0x7fd00c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.004+0000 7fd025325700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd00c064ee0 0x7fd00c067390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd014009bf0 tx=0x7fd014008040 comp rx=0 tx=0).stop 2023-11-29T11:14:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0200c7180 msgr2=0x7fd02015bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0200c7180 0x7fd02015bc60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd01800e240 tx=0x7fd018007cb0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 shutdown_connections 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd00c064ee0 0x7fd00c067390 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0201489c0 0x7fd020148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0200c7180 0x7fd02015bc60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 --2- 172.21.15.81:0/3518394817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd008004db0 0x7fd0200ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 >> 172.21.15.81:0/3518394817 conn(0x7fd0200ce3e0 msgr2=0x7fd0200ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 shutdown_connections 2023-11-29T11:14:57.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.008+0000 7fd025325700 1 -- 172.21.15.81:0/3518394817 wait complete. 2023-11-29T11:14:57.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:14:57.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.128+0000 7fd627fff700 1 Processor -- start 2023-11-29T11:14:57.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.128+0000 7fd627fff700 1 -- start start 2023-11-29T11:14:57.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd62813d130 0x7fd62815da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:57.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd62815dfd0 0x7fd62806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:57.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62815a4a0 con 0x7fd62813cd60 2023-11-29T11:14:57.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62815e550 con 0x7fd62815dfd0 2023-11-29T11:14:57.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62815e830 con 0x7fd62813d130 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd626ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd62813cd60 0x7fd62815af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32858/0 (socket says 172.21.15.81:32858) 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd626ffd700 1 -- 172.21.15.81:0/3830217240 learned_addr learned my addr 172.21.15.81:0/3830217240 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6277fe700 1 --2- 172.21.15.81:0/3830217240 >> v2:172.21.15.81:3300/0 conn(0x7fd62815dfd0 0x7fd62806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd61ffff700 1 --2- 172.21.15.81:0/3830217240 >> v2:172.21.15.176:3300/0 conn(0x7fd62813d130 0x7fd62815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6277fe700 1 -- 172.21.15.81:0/3830217240 >> v2:172.21.15.176:3300/0 conn(0x7fd62813d130 msgr2=0x7fd62815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6277fe700 1 --2- 172.21.15.81:0/3830217240 >> v2:172.21.15.176:3300/0 conn(0x7fd62813d130 0x7fd62815da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6277fe700 1 -- 172.21.15.81:0/3830217240 >> v1:172.21.15.81:6789/0 conn(0x7fd62813cd60 legacy=0x7fd62815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6277fe700 1 -- 172.21.15.81:0/3830217240 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62815a720 con 0x7fd62815dfd0 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd61ffff700 1 --2- 172.21.15.81:0/3830217240 >> v2:172.21.15.176:3300/0 conn(0x7fd62813d130 0x7fd62815da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6277fe700 1 --2- 172.21.15.81:0/3830217240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62815dfd0 0x7fd62806c640 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd620009d90 tx=0x7fd62000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cdf5b97e4946dd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6267fc700 1 -- 172.21.15.81:0/3830217240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62000e070 con 0x7fd62815dfd0 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6267fc700 1 -- 172.21.15.81:0/3830217240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62000bb90 con 0x7fd62815dfd0 2023-11-29T11:14:57.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd6267fc700 1 -- 172.21.15.81:0/3830217240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620012430 con 0x7fd62815dfd0 2023-11-29T11:14:57.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 -- 172.21.15.81:0/3830217240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62815dfd0 msgr2=0x7fd62806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:57.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 --2- 172.21.15.81:0/3830217240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62815dfd0 0x7fd62806c640 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd620009d90 tx=0x7fd62000b330 comp rx=0 tx=0).stop 2023-11-29T11:14:57.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 -- 172.21.15.81:0/3830217240 shutdown_connections 2023-11-29T11:14:57.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 --2- 172.21.15.81:0/3830217240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62815dfd0 0x7fd62806c640 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 --2- 172.21.15.81:0/3830217240 >> v2:172.21.15.176:3300/0 conn(0x7fd62813d130 0x7fd62815da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 -- 172.21.15.81:0/3830217240 >> 172.21.15.81:0/3830217240 conn(0x7fd62806e000 msgr2=0x7fd6280b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:57.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 -- 172.21.15.81:0/3830217240 shutdown_connections 2023-11-29T11:14:57.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.132+0000 7fd627fff700 1 -- 172.21.15.81:0/3830217240 wait complete. 2023-11-29T11:14:57.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 Processor -- start 2023-11-29T11:14:57.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 -- start start 2023-11-29T11:14:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62813cd60 0x7fd62813dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62815dfd0 0x7fd62812e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62815be70 0x7fd62815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62815c830 con 0x7fd62813cd60 2023-11-29T11:14:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd628141420 con 0x7fd62815dfd0 2023-11-29T11:14:57.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd628140810 con 0x7fd62815be70 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62813cd60 0x7fd62813dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62813cd60 0x7fd62813dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51608/0 (socket says 172.21.15.81:51608) 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 -- 172.21.15.81:0/3569822915 learned_addr learned my addr 172.21.15.81:0/3569822915 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd61ffff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62815dfd0 0x7fd62812e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd6277fe700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62815be70 0x7fd62815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 -- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62815be70 msgr2=0x7fd62815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62815be70 0x7fd62815c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 -- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62815dfd0 msgr2=0x7fd62812e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62815dfd0 0x7fd62812e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 -- 172.21.15.81:0/3569822915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620009a70 con 0x7fd62813cd60 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd61ffff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62815dfd0 0x7fd62812e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd626ffd700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62813cd60 0x7fd62813dd70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c700 tx=0x7fd61800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd624ff9700 1 -- 172.21.15.81:0/3569822915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618005d90 con 0x7fd62813cd60 2023-11-29T11:14:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd624ff9700 1 -- 172.21.15.81:0/3569822915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6180070d0 con 0x7fd62813cd60 2023-11-29T11:14:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd624ff9700 1 -- 172.21.15.81:0/3569822915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618007440 con 0x7fd62813cd60 2023-11-29T11:14:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd628143830 con 0x7fd62813cd60 2023-11-29T11:14:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.136+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62815aa00 con 0x7fd62813cd60 2023-11-29T11:14:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.140+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62806cb80 con 0x7fd62813cd60 2023-11-29T11:14:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.140+0000 7fd624ff9700 1 -- 172.21.15.81:0/3569822915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd618019030 con 0x7fd62813cd60 2023-11-29T11:14:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.140+0000 7fd624ff9700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd608064ee0 0x7fd608067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.140+0000 7fd624ff9700 1 -- 172.21.15.81:0/3569822915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fd6180813b0 con 0x7fd62813cd60 2023-11-29T11:14:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.140+0000 7fd61ffff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd608064ee0 0x7fd608067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.140+0000 7fd61ffff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd608064ee0 0x7fd608067390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd6280aea20 tx=0x7fd610008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:57.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.144+0000 7fd624ff9700 1 -- 172.21.15.81:0/3569822915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd61804f400 con 0x7fd62813cd60 2023-11-29T11:14:57.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:57.344+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd628072c20 con 0x7fd62813cd60 2023-11-29T11:14:58.020 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:14:58.012+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:14:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.024+0000 7fd624ff9700 1 -- 172.21.15.81:0/3569822915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd618052a20 con 0x7fd62813cd60 2023-11-29T11:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd608064ee0 msgr2=0x7fd608067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd608064ee0 0x7fd608067390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd6280aea20 tx=0x7fd610008040 comp rx=0 tx=0).stop 2023-11-29T11:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62813cd60 msgr2=0x7fd62813dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62813cd60 0x7fd62813dd70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c700 tx=0x7fd61800cac0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 shutdown_connections 2023-11-29T11:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd608064ee0 0x7fd608067390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62815be70 0x7fd62815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62815dfd0 0x7fd62812e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 --2- 172.21.15.81:0/3569822915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd62813cd60 0x7fd62813dd70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 >> 172.21.15.81:0/3569822915 conn(0x7fd62806e000 msgr2=0x7fd6280cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 shutdown_connections 2023-11-29T11:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.032+0000 7fd627fff700 1 -- 172.21.15.81:0/3569822915 wait complete. 2023-11-29T11:14:58.039 INFO:tasks.ceph.mds.d.smithi176.stderr: -5849> 2023-11-29T11:14:20.256+0000 7f4a048f6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:14:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:14:58.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T11:14:58.074 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:14:58.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.168+0000 7f0c609b3700 1 Processor -- start 2023-11-29T11:14:58.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.168+0000 7f0c609b3700 1 -- start start 2023-11-29T11:14:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.168+0000 7f0c609b3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0c5c0b6950 0x7f0c5c166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.168+0000 7f0c609b3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c0d28e0 con 0x7f0c5c0b4570 2023-11-29T11:14:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.168+0000 7f0c609b3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c0d1730 con 0x7f0c5c06ad00 2023-11-29T11:14:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.168+0000 7f0c609b3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c0cd5c0 con 0x7f0c5c0b6950 2023-11-29T11:14:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.168+0000 7f0c5a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0c5c0b4570 0x7f0c5c0b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32860/0 (socket says 172.21.15.81:32860) 2023-11-29T11:14:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.168+0000 7f0c5a59c700 1 -- 172.21.15.81:0/2222558143 learned_addr learned my addr 172.21.15.81:0/2222558143 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:58.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5ad9d700 1 --2- 172.21.15.81:0/2222558143 >> v2:172.21.15.176:3300/0 conn(0x7f0c5c0b6950 0x7f0c5c166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468384312 0 0) 0x7f0c44001110 con 0x7f0c5c0b4570 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c480035d0 con 0x7f0c5c0b4570 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265456689 0 0) 0x7f0c5c0d1730 con 0x7f0c5c06ad00 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c44001110 con 0x7f0c5c06ad00 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3105375901 0 0) 0x7f0c480035d0 con 0x7f0c5c0b4570 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 >> v2:172.21.15.176:3300/0 conn(0x7f0c5c0b6950 msgr2=0x7f0c5c166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 --2- 172.21.15.81:0/2222558143 >> v2:172.21.15.176:3300/0 conn(0x7f0c5c0b6950 0x7f0c5c166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 >> v1:172.21.15.176:6789/0 conn(0x7f0c5c06ad00 legacy=0x7f0c5c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c0d1170 con 0x7f0c5c0b4570 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f0c44001800 con 0x7f0c5c0b4570 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 >> v1:172.21.15.81:6789/0 conn(0x7f0c5c0b4570 legacy=0x7f0c5c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c48003bb0 0x7f0c48003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c48004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c48005220 0x7f0c4800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0cd5c0 con 0x7f0c48004870 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4800c080 con 0x7f0c48003bb0 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4800c240 con 0x7f0c48005220 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c59d9b700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c48004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5a59c700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c48003bb0 0x7f0c48003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5ad9d700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c48005220 0x7f0c4800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c59d9b700 1 -- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c48005220 msgr2=0x7f0c4800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c59d9b700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c48005220 0x7f0c4800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c59d9b700 1 -- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c48003bb0 msgr2=0x7f0c48003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c59d9b700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c48003bb0 0x7f0c48003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c59d9b700 1 -- 172.21.15.81:0/2222558143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480035d0 con 0x7f0c48004870 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5ad9d700 1 -- 172.21.15.81:0/2222558143 reap_dead start 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5a59c700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c48003bb0 0x7f0c48003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c59d9b700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c48004ce0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c001960 tx=0x7f0c480058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1af38c386b53676 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c001450 con 0x7f0c48004870 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c006aa0 con 0x7f0c48004870 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c5959a700 1 -- 172.21.15.81:0/2222558143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c006e50 con 0x7f0c48004870 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c609b3700 1 -- 172.21.15.81:0/2222558143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 msgr2=0x7f0c48004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c609b3700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c48004ce0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c001960 tx=0x7f0c480058a0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c609b3700 1 -- 172.21.15.81:0/2222558143 shutdown_connections 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c609b3700 1 --2- 172.21.15.81:0/2222558143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c48004ce0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c609b3700 1 -- 172.21.15.81:0/2222558143 >> 172.21.15.81:0/2222558143 conn(0x7f0c5c06cac0 msgr2=0x7f0c5c0cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c609b3700 1 -- 172.21.15.81:0/2222558143 shutdown_connections 2023-11-29T11:14:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.172+0000 7f0c609b3700 1 -- 172.21.15.81:0/2222558143 wait complete. 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 Processor -- start 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 -- start start 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c5c1f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c5c0cac10 0x7f0c5c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c5c0cb5c0 0x7f0c5c156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0cc5a0 con 0x7f0c48004870 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0cba40 con 0x7f0c5c0cb5c0 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c15c210 con 0x7f0c5c0cac10 2023-11-29T11:14:58.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c5c1f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c5c1f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51620/0 (socket says 172.21.15.81:51620) 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 -- 172.21.15.81:0/488550574 learned_addr learned my addr 172.21.15.81:0/488550574 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c59d9b700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c5c0cac10 0x7f0c5c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5ad9d700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c5c0cb5c0 0x7f0c5c156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 -- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c5c0cac10 msgr2=0x7f0c5c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c5c0cac10 0x7f0c5c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 -- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c5c0cb5c0 msgr2=0x7f0c5c156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c5c0cb5c0 0x7f0c5c156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 -- 172.21.15.81:0/488550574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c0cd1e0 con 0x7f0c48004870 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5ad9d700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c5c0cb5c0 0x7f0c5c156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c5a59c700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c5c1f0f90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400eaf0 tx=0x7f0c4400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c52ffd700 1 -- 172.21.15.81:0/488550574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400c7e0 con 0x7f0c48004870 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c52ffd700 1 -- 172.21.15.81:0/488550574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4400c940 con 0x7f0c48004870 2023-11-29T11:14:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c52ffd700 1 -- 172.21.15.81:0/488550574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400ccf0 con 0x7f0c48004870 2023-11-29T11:14:58.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c0d1450 con 0x7f0c48004870 2023-11-29T11:14:58.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.176+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c0b1f90 con 0x7f0c48004870 2023-11-29T11:14:58.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.180+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c1560a0 con 0x7f0c48004870 2023-11-29T11:14:58.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.180+0000 7f0c52ffd700 1 -- 172.21.15.81:0/488550574 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0c4401d460 con 0x7f0c48004870 2023-11-29T11:14:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.180+0000 7f0c52ffd700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c3c064ee0 0x7f0c3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.180+0000 7f0c52ffd700 1 -- 172.21.15.81:0/488550574 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f0c44081ff0 con 0x7f0c48004870 2023-11-29T11:14:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.180+0000 7f0c59d9b700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c3c064ee0 0x7f0c3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.180+0000 7f0c59d9b700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c3c064ee0 0x7f0c3c067390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000c00 tx=0x7f0c4c005040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:58.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.188+0000 7f0c52ffd700 1 -- 172.21.15.81:0/488550574 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0c5c1560a0 con 0x7f0c48004870 2023-11-29T11:14:58.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:58.388+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c5c0d28e0 con 0x7f0c48004870 2023-11-29T11:14:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.032+0000 7f0c52ffd700 1 -- 172.21.15.81:0/488550574 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c5c0d28e0 con 0x7f0c48004870 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c3c064ee0 msgr2=0x7f0c3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c3c064ee0 0x7f0c3c067390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000c00 tx=0x7f0c4c005040 comp rx=0 tx=0).stop 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 msgr2=0x7f0c5c1f0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c5c1f0f90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400eaf0 tx=0x7f0c4400ee00 comp rx=0 tx=0).stop 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 shutdown_connections 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c3c064ee0 0x7f0c3c067390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c5c0cb5c0 0x7f0c5c156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c5c0cac10 0x7f0c5c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 --2- 172.21.15.81:0/488550574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c48004870 0x7f0c5c1f0f90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 >> 172.21.15.81:0/488550574 conn(0x7f0c5c06cac0 msgr2=0x7f0c5c0b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 shutdown_connections 2023-11-29T11:14:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.036+0000 7f0c609b3700 1 -- 172.21.15.81:0/488550574 wait complete. 2023-11-29T11:14:59.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T11:14:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda32567700 1 Processor -- start 2023-11-29T11:14:59.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda32567700 1 -- start start 2023-11-29T11:14:59.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda32567700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c0cb520 0x7fda2c163b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda32567700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0ce040 con 0x7fda2c158f10 2023-11-29T11:14:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda32567700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0c9460 con 0x7fda2c06b250 2023-11-29T11:14:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda32567700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0c9fe0 con 0x7fda2c0cb520 2023-11-29T11:14:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda31565700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fda2c158f10 0x7fda2c0cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32862/0 (socket says 172.21.15.81:32862) 2023-11-29T11:14:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda31565700 1 -- 172.21.15.81:0/2266086262 learned_addr learned my addr 172.21.15.81:0/2266086262 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:14:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.176+0000 7fda31d66700 1 --2- 172.21.15.81:0/2266086262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c0cb520 0x7fda2c163b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda23fff700 1 -- 172.21.15.81:0/2266086262 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915263842 0 0) 0x7fda28001110 con 0x7fda2c158f10 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda23fff700 1 -- 172.21.15.81:0/2266086262 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda180057e0 con 0x7fda2c158f10 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda31d66700 1 -- 172.21.15.81:0/2266086262 >> v1:172.21.15.176:6789/0 conn(0x7fda2c06b250 legacy=0x7fda2c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda23fff700 1 -- 172.21.15.81:0/2266086262 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490566936 0 0) 0x7fda2c0c9460 con 0x7fda2c06b250 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda31d66700 1 -- 172.21.15.81:0/2266086262 >> v1:172.21.15.81:6789/0 conn(0x7fda2c158f10 legacy=0x7fda2c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda31d66700 1 -- 172.21.15.81:0/2266086262 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c06dc90 con 0x7fda2c0cb520 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda31d66700 1 --2- 172.21.15.81:0/2266086262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c0cb520 0x7fda2c163b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda24009dc0 tx=0x7fda2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeef67569317e322 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda23fff700 1 -- 172.21.15.81:0/2266086262 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400e070 con 0x7fda2c0cb520 2023-11-29T11:14:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda23fff700 1 -- 172.21.15.81:0/2266086262 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400bb20 con 0x7fda2c0cb520 2023-11-29T11:14:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda23fff700 1 -- 172.21.15.81:0/2266086262 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400bed0 con 0x7fda2c0cb520 2023-11-29T11:14:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 -- 172.21.15.81:0/2266086262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c0cb520 msgr2=0x7fda2c163b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 --2- 172.21.15.81:0/2266086262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c0cb520 0x7fda2c163b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda24009dc0 tx=0x7fda2400b330 comp rx=0 tx=0).stop 2023-11-29T11:14:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 -- 172.21.15.81:0/2266086262 shutdown_connections 2023-11-29T11:14:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 --2- 172.21.15.81:0/2266086262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c0cb520 0x7fda2c163b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 -- 172.21.15.81:0/2266086262 >> 172.21.15.81:0/2266086262 conn(0x7fda2c0ce400 msgr2=0x7fda2c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:14:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 -- 172.21.15.81:0/2266086262 shutdown_connections 2023-11-29T11:14:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 -- 172.21.15.81:0/2266086262 wait complete. 2023-11-29T11:14:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 Processor -- start 2023-11-29T11:14:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.180+0000 7fda32567700 1 -- start start 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda32567700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2c06b250 0x7fda2c1f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda32567700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda2c0cb520 0x7fda2c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda32567700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c158f10 0x7fda2c0c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda32567700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c1559c0 con 0x7fda2c06b250 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda32567700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0c3ee0 con 0x7fda2c0cb520 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda32567700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c1556e0 con 0x7fda2c158f10 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2c06b250 0x7fda2c1f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2c06b250 0x7fda2c1f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51630/0 (socket says 172.21.15.81:51630) 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 -- 172.21.15.81:0/3455382452 learned_addr learned my addr 172.21.15.81:0/3455382452 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31d66700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c158f10 0x7fda2c0c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda30d64700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda2c0cb520 0x7fda2c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 -- 172.21.15.81:0/3455382452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c158f10 msgr2=0x7fda2c0c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c158f10 0x7fda2c0c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 -- 172.21.15.81:0/3455382452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda2c0cb520 msgr2=0x7fda2c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:14:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda2c0cb520 0x7fda2c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:14:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 -- 172.21.15.81:0/3455382452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24009a70 con 0x7fda2c06b250 2023-11-29T11:14:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda31565700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2c06b250 0x7fda2c1f1660 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c4d0 tx=0x7fda2800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda21ffb700 1 -- 172.21.15.81:0/3455382452 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28005d90 con 0x7fda2c06b250 2023-11-29T11:14:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda21ffb700 1 -- 172.21.15.81:0/3455382452 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2800ce80 con 0x7fda2c06b250 2023-11-29T11:14:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c0c9990 con 0x7fda2c06b250 2023-11-29T11:14:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda21ffb700 1 -- 172.21.15.81:0/3455382452 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28007310 con 0x7fda2c06b250 2023-11-29T11:14:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.184+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c0c96b0 con 0x7fda2c06b250 2023-11-29T11:14:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.188+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c0c9c70 con 0x7fda2c06b250 2023-11-29T11:14:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.188+0000 7fda21ffb700 1 -- 172.21.15.81:0/3455382452 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fda28019030 con 0x7fda2c06b250 2023-11-29T11:14:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.188+0000 7fda21ffb700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda10064ee0 0x7fda10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:14:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.188+0000 7fda21ffb700 1 -- 172.21.15.81:0/3455382452 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fda280811a0 con 0x7fda2c06b250 2023-11-29T11:14:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.188+0000 7fda30d64700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda10064ee0 0x7fda10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:14:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.188+0000 7fda30d64700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda10064ee0 0x7fda10067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fda2c156290 tx=0x7fda1c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:14:59.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.192+0000 7fda21ffb700 1 -- 172.21.15.81:0/3455382452 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fda2804f0f0 con 0x7fda2c06b250 2023-11-29T11:14:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:14:59.356+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fda2c0cefb0 con 0x7fda2c06b250 2023-11-29T11:15:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.108+0000 7fda21ffb700 1 -- 172.21.15.81:0/3455382452 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7fda28052710 con 0x7fda2c06b250 2023-11-29T11:15:00.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda10064ee0 msgr2=0x7fda10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda10064ee0 0x7fda10067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fda2c156290 tx=0x7fda1c009040 comp rx=0 tx=0).stop 2023-11-29T11:15:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2c06b250 msgr2=0x7fda2c1f1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2c06b250 0x7fda2c1f1660 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c4d0 tx=0x7fda2800c7e0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 shutdown_connections 2023-11-29T11:15:00.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda10064ee0 0x7fda10067390 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda2c158f10 0x7fda2c0c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda2c0cb520 0x7fda2c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 --2- 172.21.15.81:0/3455382452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2c06b250 0x7fda2c1f1660 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 >> 172.21.15.81:0/3455382452 conn(0x7fda2c0ce400 msgr2=0x7fda2c0c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 shutdown_connections 2023-11-29T11:15:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.116+0000 7fda32567700 1 -- 172.21.15.81:0/3455382452 wait complete. 2023-11-29T11:15:00.125 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-11-29T11:15:00.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T11:15:00.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.252+0000 7fdc5607b700 1 Processor -- start 2023-11-29T11:15:00.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.252+0000 7fdc5607b700 1 -- start start 2023-11-29T11:15:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc5015f710 0x7fdc50160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc500cac00 con 0x7fdc500c9c30 2023-11-29T11:15:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5006e000 con 0x7fdc5015f710 2023-11-29T11:15:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5015fae0 con 0x7fdc50070fc0 2023-11-29T11:15:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5587a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc55079700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc5015f710 0x7fdc50160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5587a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:46234/0 (socket says 172.21.15.81:46234) 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5587a700 1 -- 172.21.15.81:0/913606751 learned_addr learned my addr 172.21.15.81:0/913606751 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc55079700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc5015f710 0x7fdc50160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59964/0 (socket says 172.21.15.81:59964) 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5587a700 1 -- 172.21.15.81:0/913606751 >> v2:172.21.15.176:3300/0 conn(0x7fdc5015f710 msgr2=0x7fdc50160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5587a700 1 --2- 172.21.15.81:0/913606751 >> v2:172.21.15.176:3300/0 conn(0x7fdc5015f710 0x7fdc50160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5587a700 1 -- 172.21.15.81:0/913606751 >> v1:172.21.15.176:6789/0 conn(0x7fdc500c9c30 legacy=0x7fdc5006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5587a700 1 -- 172.21.15.81:0/913606751 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500718f0 con 0x7fdc50070fc0 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc55079700 1 --2- 172.21.15.81:0/913606751 >> v2:172.21.15.176:3300/0 conn(0x7fdc5015f710 0x7fdc50160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5587a700 1 --2- 172.21.15.81:0/913606751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500713b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009e50 tx=0x7fdc4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=706b0528c2953469 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc47fff700 1 -- 172.21.15.81:0/913606751 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800e070 con 0x7fdc50070fc0 2023-11-29T11:15:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc47fff700 1 -- 172.21.15.81:0/913606751 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4800b910 con 0x7fdc50070fc0 2023-11-29T11:15:00.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc47fff700 1 -- 172.21.15.81:0/913606751 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800bcc0 con 0x7fdc50070fc0 2023-11-29T11:15:00.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 -- 172.21.15.81:0/913606751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 msgr2=0x7fdc500713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:00.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 --2- 172.21.15.81:0/913606751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500713b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009e50 tx=0x7fdc4800b330 comp rx=0 tx=0).stop 2023-11-29T11:15:00.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 -- 172.21.15.81:0/913606751 shutdown_connections 2023-11-29T11:15:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 --2- 172.21.15.81:0/913606751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500713b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 --2- 172.21.15.81:0/913606751 >> v2:172.21.15.176:3300/0 conn(0x7fdc5015f710 0x7fdc50160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 -- 172.21.15.81:0/913606751 >> 172.21.15.81:0/913606751 conn(0x7fdc500cf5e0 msgr2=0x7fdc500cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 -- 172.21.15.81:0/913606751 shutdown_connections 2023-11-29T11:15:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.256+0000 7fdc5607b700 1 -- 172.21.15.81:0/913606751 wait complete. 2023-11-29T11:15:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 Processor -- start 2023-11-29T11:15:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 -- start start 2023-11-29T11:15:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc500c9c30 0x7fdc50153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5015f710 0x7fdc500c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc501544a0 con 0x7fdc5015f710 2023-11-29T11:15:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5006bbf0 con 0x7fdc500c9c30 2023-11-29T11:15:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500c6db0 con 0x7fdc50070fc0 2023-11-29T11:15:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5015f710 0x7fdc500c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5015f710 0x7fdc500c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44664/0 (socket says 172.21.15.81:44664) 2023-11-29T11:15:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 -- 172.21.15.81:0/1344417773 learned_addr learned my addr 172.21.15.81:0/1344417773 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc54878700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc500c9c30 0x7fdc50153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc55079700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 -- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 msgr2=0x7fdc500c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 -- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc500c9c30 msgr2=0x7fdc50153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc500c9c30 0x7fdc50153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 -- 172.21.15.81:0/1344417773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc400094b0 con 0x7fdc5015f710 2023-11-29T11:15:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc54878700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc500c9c30 0x7fdc50153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5587a700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5015f710 0x7fdc500c7fd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdc5015fc20 tx=0x7fdc48004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc45ffb700 1 -- 172.21.15.81:0/1344417773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48004800 con 0x7fdc5015f710 2023-11-29T11:15:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc45ffb700 1 -- 172.21.15.81:0/1344417773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc480092e0 con 0x7fdc5015f710 2023-11-29T11:15:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc48009b30 con 0x7fdc5015f710 2023-11-29T11:15:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc45ffb700 1 -- 172.21.15.81:0/1344417773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4801b650 con 0x7fdc5015f710 2023-11-29T11:15:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.260+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc500ca360 con 0x7fdc5015f710 2023-11-29T11:15:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.264+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc500ca090 con 0x7fdc5015f710 2023-11-29T11:15:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.264+0000 7fdc45ffb700 1 -- 172.21.15.81:0/1344417773 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc4802b070 con 0x7fdc5015f710 2023-11-29T11:15:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.264+0000 7fdc45ffb700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc34064f10 0x7fdc340673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.264+0000 7fdc55079700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc34064f10 0x7fdc340673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.264+0000 7fdc45ffb700 1 -- 172.21.15.81:0/1344417773 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6088+0+0 (secure 0 0 0) 0x7fdc48083540 con 0x7fdc5015f710 2023-11-29T11:15:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.264+0000 7fdc55079700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc34064f10 0x7fdc340673c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009d80 tx=0x7fdc40009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.272+0000 7fdc45ffb700 1 -- 172.21.15.81:0/1344417773 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdc480516c0 con 0x7fdc5015f710 2023-11-29T11:15:00.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:00.436+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc500676e0 con 0x7fdc5015f710 2023-11-29T11:15:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.124+0000 7fdc45ffb700 1 -- 172.21.15.81:0/1344417773 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdc48054ce0 con 0x7fdc5015f710 2023-11-29T11:15:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc34064f10 msgr2=0x7fdc340673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc34064f10 0x7fdc340673c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009d80 tx=0x7fdc40009240 comp rx=0 tx=0).stop 2023-11-29T11:15:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5015f710 msgr2=0x7fdc500c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5015f710 0x7fdc500c7fd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdc5015fc20 tx=0x7fdc48004af0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 shutdown_connections 2023-11-29T11:15:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc34064f10 0x7fdc340673c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5015f710 0x7fdc500c7fd0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc500c9c30 0x7fdc50153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 --2- 172.21.15.81:0/1344417773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc50070fc0 0x7fdc500c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 >> 172.21.15.81:0/1344417773 conn(0x7fdc500cf5e0 msgr2=0x7fdc500cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 shutdown_connections 2023-11-29T11:15:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.132+0000 7fdc5607b700 1 -- 172.21.15.81:0/1344417773 wait complete. 2023-11-29T11:15:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-11-29T11:15:01.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-29T11:15:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.256+0000 7f25b5695700 1 Processor -- start 2023-11-29T11:15:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.256+0000 7f25b5695700 1 -- start start 2023-11-29T11:15:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.256+0000 7f25b5695700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25b0159ec0 0x7f25b00ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.256+0000 7f25b5695700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25b0069c40 0x7f25b00cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.256+0000 7f25b5695700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b006b8d0 con 0x7f25b00ca930 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.256+0000 7f25b5695700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00cb600 con 0x7f25b0069c40 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.256+0000 7f25b5695700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b006a1d0 con 0x7f25b0159ec0 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b4e94700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25b0069c40 0x7f25b00cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b4e94700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25b0069c40 0x7f25b00cf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44680/0 (socket says 172.21.15.81:44680) 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b4e94700 1 -- 172.21.15.81:0/1328673111 learned_addr learned my addr 172.21.15.81:0/1328673111 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25affff700 1 --2- 172.21.15.81:0/1328673111 >> v2:172.21.15.176:3300/0 conn(0x7f25b0159ec0 0x7f25b00ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b4e94700 1 -- 172.21.15.81:0/1328673111 >> v2:172.21.15.176:3300/0 conn(0x7f25b0159ec0 msgr2=0x7f25b00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b4e94700 1 --2- 172.21.15.81:0/1328673111 >> v2:172.21.15.176:3300/0 conn(0x7f25b0159ec0 0x7f25b00ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b4e94700 1 -- 172.21.15.81:0/1328673111 >> v1:172.21.15.176:6789/0 conn(0x7f25b00ca930 legacy=0x7f25b00c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b4e94700 1 -- 172.21.15.81:0/1328673111 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b006b5a0 con 0x7f25b0069c40 2023-11-29T11:15:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b4e94700 1 --2- 172.21.15.81:0/1328673111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b0069c40 0x7f25b00cf270 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f25b0071b80 tx=0x7f25a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52bc23cc30f2a41 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25aeffd700 1 -- 172.21.15.81:0/1328673111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800e070 con 0x7f25b0069c40 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25aeffd700 1 -- 172.21.15.81:0/1328673111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a800b9c0 con 0x7f25b0069c40 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25aeffd700 1 -- 172.21.15.81:0/1328673111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800bd70 con 0x7f25b0069c40 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 -- 172.21.15.81:0/1328673111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b0069c40 msgr2=0x7f25b00cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 --2- 172.21.15.81:0/1328673111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b0069c40 0x7f25b00cf270 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f25b0071b80 tx=0x7f25a800b330 comp rx=0 tx=0).stop 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 -- 172.21.15.81:0/1328673111 shutdown_connections 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 --2- 172.21.15.81:0/1328673111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b0069c40 0x7f25b00cf270 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 --2- 172.21.15.81:0/1328673111 >> v2:172.21.15.176:3300/0 conn(0x7f25b0159ec0 0x7f25b00ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 -- 172.21.15.81:0/1328673111 >> 172.21.15.81:0/1328673111 conn(0x7f25b006c660 msgr2=0x7f25b006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 -- 172.21.15.81:0/1328673111 shutdown_connections 2023-11-29T11:15:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 -- 172.21.15.81:0/1328673111 wait complete. 2023-11-29T11:15:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.260+0000 7f25b5695700 1 Processor -- start 2023-11-29T11:15:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 -- start start 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25b0069c40 0x7f25b0149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b00ca930 0x7f25b00b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25b0159ec0 0x7f25b00b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c6b40 con 0x7f25b00ca930 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c5f30 con 0x7f25b0159ec0 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c6210 con 0x7f25b0069c40 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b00ca930 0x7f25b00b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b00ca930 0x7f25b00b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44688/0 (socket says 172.21.15.81:44688) 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 -- 172.21.15.81:0/1851595150 learned_addr learned my addr 172.21.15.81:0/1851595150 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25affff700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25b0069c40 0x7f25b0149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b4e94700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25b0159ec0 0x7f25b00b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 -- 172.21.15.81:0/1851595150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25b0069c40 msgr2=0x7f25b0149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25b0069c40 0x7f25b0149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 -- 172.21.15.81:0/1851595150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25b0159ec0 msgr2=0x7f25b00b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25b0159ec0 0x7f25b00b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 -- 172.21.15.81:0/1851595150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8009b30 con 0x7f25b00ca930 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25af7fe700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b00ca930 0x7f25b00b40b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c4d0 tx=0x7f25a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25acff9700 1 -- 172.21.15.81:0/1851595150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40052d0 con 0x7f25b00ca930 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25acff9700 1 -- 172.21.15.81:0/1851595150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4005430 con 0x7f25b00ca930 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b00cb040 con 0x7f25b00ca930 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25acff9700 1 -- 172.21.15.81:0/1851595150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40055a0 con 0x7f25b00ca930 2023-11-29T11:15:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.264+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b00cc630 con 0x7f25b00ca930 2023-11-29T11:15:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.268+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b00cb320 con 0x7f25b00ca930 2023-11-29T11:15:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.268+0000 7f25acff9700 1 -- 172.21.15.81:0/1851595150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f25a4019030 con 0x7f25b00ca930 2023-11-29T11:15:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.268+0000 7f25acff9700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f259c064ee0 0x7f259c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.268+0000 7f25acff9700 1 -- 172.21.15.81:0/1851595150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f25a4081080 con 0x7f25b00ca930 2023-11-29T11:15:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.268+0000 7f25affff700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f259c064ee0 0x7f259c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.268+0000 7f25affff700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f259c064ee0 0x7f259c067390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f25b00ce6d0 tx=0x7f25a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.276+0000 7f25acff9700 1 -- 172.21.15.81:0/1851595150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f25a404f3e0 con 0x7f25b00ca930 2023-11-29T11:15:01.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.444+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f25b0072c20 con 0x7f25b00ca930 2023-11-29T11:15:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.456+0000 7f25acff9700 1 -- 172.21.15.81:0/1851595150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f25a4052a00 con 0x7f25b00ca930 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f259c064ee0 msgr2=0x7f259c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f259c064ee0 0x7f259c067390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f25b00ce6d0 tx=0x7f25a0008040 comp rx=0 tx=0).stop 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b00ca930 msgr2=0x7f25b00b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b00ca930 0x7f25b00b40b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c4d0 tx=0x7f25a400c890 comp rx=0 tx=0).stop 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 shutdown_connections 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f259c064ee0 0x7f259c067390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25b0159ec0 0x7f25b00b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b00ca930 0x7f25b00b40b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 --2- 172.21.15.81:0/1851595150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25b0069c40 0x7f25b0149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 >> 172.21.15.81:0/1851595150 conn(0x7f25b006c660 msgr2=0x7f25b00b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 shutdown_connections 2023-11-29T11:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.460+0000 7f25b5695700 1 -- 172.21.15.81:0/1851595150 wait complete. 2023-11-29T11:15:01.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-29T11:15:01.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.576+0000 7f1e7359e700 1 Processor -- start 2023-11-29T11:15:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.576+0000 7f1e7359e700 1 -- start start 2023-11-29T11:15:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e7415d460 0x7f1e740706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e740b1cb0 con 0x7f1e74159e30 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e740b2830 con 0x7f1e7413c600 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7415a270 con 0x7f1e7415d460 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e7415d460 0x7f1e740706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e72d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1e74159e30 0x7f1e740b2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42386/0 (socket says 172.21.15.81:42386) 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e72d9d700 1 -- 172.21.15.81:0/2987251972 learned_addr learned my addr 172.21.15.81:0/2987251972 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7259c700 1 -- 172.21.15.81:0/2987251972 >> v1:172.21.15.176:6789/0 conn(0x7f1e7413c600 legacy=0x7f1e74159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7259c700 1 -- 172.21.15.81:0/2987251972 >> v1:172.21.15.81:6789/0 conn(0x7f1e74159e30 legacy=0x7f1e740b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7259c700 1 -- 172.21.15.81:0/2987251972 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740b1f00 con 0x7f1e7415d460 2023-11-29T11:15:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7259c700 1 --2- 172.21.15.81:0/2987251972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7415d460 0x7f1e740706f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009850 tx=0x7f1e64009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad98b103d0baf66a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e71d9b700 1 -- 172.21.15.81:0/2987251972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64004230 con 0x7f1e7415d460 2023-11-29T11:15:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e71d9b700 1 -- 172.21.15.81:0/2987251972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64004390 con 0x7f1e7415d460 2023-11-29T11:15:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e71d9b700 1 -- 172.21.15.81:0/2987251972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640036c0 con 0x7f1e7415d460 2023-11-29T11:15:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 -- 172.21.15.81:0/2987251972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7415d460 msgr2=0x7f1e740706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 --2- 172.21.15.81:0/2987251972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7415d460 0x7f1e740706f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009850 tx=0x7f1e64009b60 comp rx=0 tx=0).stop 2023-11-29T11:15:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 -- 172.21.15.81:0/2987251972 shutdown_connections 2023-11-29T11:15:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 --2- 172.21.15.81:0/2987251972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7415d460 0x7f1e740706f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 -- 172.21.15.81:0/2987251972 >> 172.21.15.81:0/2987251972 conn(0x7f1e7406e000 msgr2=0x7f1e740b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 -- 172.21.15.81:0/2987251972 shutdown_connections 2023-11-29T11:15:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.580+0000 7f1e7359e700 1 -- 172.21.15.81:0/2987251972 wait complete. 2023-11-29T11:15:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 Processor -- start 2023-11-29T11:15:01.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 -- start start 2023-11-29T11:15:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e7413c600 0x7f1e740ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e74159e30 0x7f1e7406af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e7415d460 0x7f1e740ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741f51d0 con 0x7f1e74159e30 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741f54b0 con 0x7f1e7415d460 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741f5790 con 0x7f1e7413c600 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e74159e30 0x7f1e7406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e74159e30 0x7f1e7406af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44702/0 (socket says 172.21.15.81:44702) 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 -- 172.21.15.81:0/530807376 learned_addr learned my addr 172.21.15.81:0/530807376 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7259c700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e7413c600 0x7f1e740ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e72d9d700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e7415d460 0x7f1e740ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 -- 172.21.15.81:0/530807376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e7413c600 msgr2=0x7f1e740ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e7413c600 0x7f1e740ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 -- 172.21.15.81:0/530807376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e7415d460 msgr2=0x7f1e740ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e7415d460 0x7f1e740ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 -- 172.21.15.81:0/530807376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640094b0 con 0x7f1e74159e30 2023-11-29T11:15:01.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e69d9b700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e74159e30 0x7f1e7406af00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00b4a0 tx=0x7f1e5c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:01.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e6b7fe700 1 -- 172.21.15.81:0/530807376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c011830 con 0x7f1e74159e30 2023-11-29T11:15:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e6b7fe700 1 -- 172.21.15.81:0/530807376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c0119b0 con 0x7f1e74159e30 2023-11-29T11:15:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e740b24c0 con 0x7f1e74159e30 2023-11-29T11:15:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e6b7fe700 1 -- 172.21.15.81:0/530807376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c011d60 con 0x7f1e74159e30 2023-11-29T11:15:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.584+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e740b21e0 con 0x7f1e74159e30 2023-11-29T11:15:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.588+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7415d830 con 0x7f1e74159e30 2023-11-29T11:15:01.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.588+0000 7f1e6b7fe700 1 -- 172.21.15.81:0/530807376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1e5c021070 con 0x7f1e74159e30 2023-11-29T11:15:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.588+0000 7f1e6b7fe700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1e54064ee0 0x7f1e54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.588+0000 7f1e6b7fe700 1 -- 172.21.15.81:0/530807376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1e5c081ab0 con 0x7f1e74159e30 2023-11-29T11:15:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.588+0000 7f1e7259c700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1e54064ee0 0x7f1e54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.588+0000 7f1e7259c700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1e54064ee0 0x7f1e54067390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009850 tx=0x7f1e64008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.596+0000 7f1e6b7fe700 1 -- 172.21.15.81:0/530807376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1e5c04fe10 con 0x7f1e74159e30 2023-11-29T11:15:01.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:01.820+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f1e74072c20 con 0x7f1e74159e30 2023-11-29T11:15:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.124+0000 7f1e6b7fe700 1 -- 172.21.15.81:0/530807376 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v126) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1e5c0150d0 con 0x7f1e74159e30 2023-11-29T11:15:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1e54064ee0 msgr2=0x7f1e54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1e54064ee0 0x7f1e54067390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009850 tx=0x7f1e64008030 comp rx=0 tx=0).stop 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e74159e30 msgr2=0x7f1e7406af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e74159e30 0x7f1e7406af00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00b4a0 tx=0x7f1e5c00b7b0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 shutdown_connections 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1e54064ee0 0x7f1e54067390 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e7415d460 0x7f1e740ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e74159e30 0x7f1e7406af00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 --2- 172.21.15.81:0/530807376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e7413c600 0x7f1e740ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 >> 172.21.15.81:0/530807376 conn(0x7f1e7406e000 msgr2=0x7f1e7415a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 shutdown_connections 2023-11-29T11:15:02.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.128+0000 7f1e7359e700 1 -- 172.21.15.81:0/530807376 wait complete. 2023-11-29T11:15:02.153 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-11-29T11:15:02.153 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-11-29T11:15:02.153 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:15:02.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-29T11:15:02.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 Processor -- start 2023-11-29T11:15:02.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- start start 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ff40c1ac0 0x7f6ff4069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40ceef0 0x7f6ff406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40cae70 con 0x7f6ff41606b0 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff40cbc10 con 0x7f6ff40c1ac0 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40cb130 con 0x7f6ff40ceef0 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff2ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ff40c1ac0 0x7f6ff4069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff2ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ff40c1ac0 0x7f6ff4069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44716/0 (socket says 172.21.15.81:44716) 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff2ffd700 1 -- 172.21.15.81:0/3352090767 learned_addr learned my addr 172.21.15.81:0/3352090767 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff3fff700 1 --2- 172.21.15.81:0/3352090767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40ceef0 0x7f6ff406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff2ffd700 1 -- 172.21.15.81:0/3352090767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40ceef0 msgr2=0x7f6ff406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff2ffd700 1 --2- 172.21.15.81:0/3352090767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40ceef0 0x7f6ff406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff2ffd700 1 -- 172.21.15.81:0/3352090767 >> v1:172.21.15.176:6789/0 conn(0x7f6ff41606b0 legacy=0x7f6ff40c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff2ffd700 1 -- 172.21.15.81:0/3352090767 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40cb410 con 0x7f6ff40c1ac0 2023-11-29T11:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff2ffd700 1 --2- 172.21.15.81:0/3352090767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40c1ac0 0x7f6ff4069c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009e50 tx=0x7f6fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ad1ced31db0b12 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff27fc700 1 -- 172.21.15.81:0/3352090767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00e070 con 0x7f6ff40c1ac0 2023-11-29T11:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff27fc700 1 -- 172.21.15.81:0/3352090767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00b9c0 con 0x7f6ff40c1ac0 2023-11-29T11:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff27fc700 1 -- 172.21.15.81:0/3352090767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00bd70 con 0x7f6ff40c1ac0 2023-11-29T11:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- 172.21.15.81:0/3352090767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40c1ac0 msgr2=0x7f6ff4069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 --2- 172.21.15.81:0/3352090767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40c1ac0 0x7f6ff4069c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009e50 tx=0x7f6fec00b330 comp rx=0 tx=0).stop 2023-11-29T11:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- 172.21.15.81:0/3352090767 shutdown_connections 2023-11-29T11:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 --2- 172.21.15.81:0/3352090767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff40ceef0 0x7f6ff406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 --2- 172.21.15.81:0/3352090767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40c1ac0 0x7f6ff4069c40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- 172.21.15.81:0/3352090767 >> 172.21.15.81:0/3352090767 conn(0x7f6ff40ce3e0 msgr2=0x7f6ff40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- 172.21.15.81:0/3352090767 shutdown_connections 2023-11-29T11:15:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.268+0000 7f6ff891e700 1 -- 172.21.15.81:0/3352090767 wait complete. 2023-11-29T11:15:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 Processor -- start 2023-11-29T11:15:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 -- start start 2023-11-29T11:15:02.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40c1ac0 0x7f6ff4163380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:02.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40ceef0 0x7f6ff40c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:02.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff41606b0 0x7f6ff41f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4163960 con 0x7f6ff40ceef0 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4163120 con 0x7f6ff40c1ac0 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4161c50 con 0x7f6ff41606b0 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40ceef0 0x7f6ff40c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40ceef0 0x7f6ff40c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44724/0 (socket says 172.21.15.81:44724) 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 -- 172.21.15.81:0/2917056896 learned_addr learned my addr 172.21.15.81:0/2917056896 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff3fff700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff41606b0 0x7f6ff41f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff37fe700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40c1ac0 0x7f6ff4163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 -- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff41606b0 msgr2=0x7f6ff41f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff41606b0 0x7f6ff41f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 -- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40c1ac0 msgr2=0x7f6ff4163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40c1ac0 0x7f6ff4163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 -- 172.21.15.81:0/2917056896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec009b30 con 0x7f6ff40ceef0 2023-11-29T11:15:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff3fff700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff41606b0 0x7f6ff41f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff2ffd700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40ceef0 0x7f6ff40c1ee0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00b370 tx=0x7f6fec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6febfff700 1 -- 172.21.15.81:0/2917056896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0048b0 con 0x7f6ff40ceef0 2023-11-29T11:15:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6febfff700 1 -- 172.21.15.81:0/2917056896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec0092e0 con 0x7f6ff40ceef0 2023-11-29T11:15:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff40b36c0 con 0x7f6ff40ceef0 2023-11-29T11:15:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6febfff700 1 -- 172.21.15.81:0/2917056896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec01c680 con 0x7f6ff40ceef0 2023-11-29T11:15:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.272+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff40cb6f0 con 0x7f6ff40ceef0 2023-11-29T11:15:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.276+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff40ad610 con 0x7f6ff40ceef0 2023-11-29T11:15:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.276+0000 7f6febfff700 1 -- 172.21.15.81:0/2917056896 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6fec022030 con 0x7f6ff40ceef0 2023-11-29T11:15:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.276+0000 7f6febfff700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fd4064f10 0x7f6fd40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.276+0000 7f6febfff700 1 -- 172.21.15.81:0/2917056896 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f6fec083990 con 0x7f6ff40ceef0 2023-11-29T11:15:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.276+0000 7f6ff37fe700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fd4064f10 0x7f6fd40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.276+0000 7f6ff37fe700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fd4064f10 0x7f6fd40673c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4000f60 tx=0x7f6fe4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.284+0000 7f6febfff700 1 -- 172.21.15.81:0/2917056896 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6fec051ca0 con 0x7f6ff40ceef0 2023-11-29T11:15:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:02.504+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f6ff4072500 con 0x7f6ff40ceef0 2023-11-29T11:15:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.132+0000 7f6febfff700 1 -- 172.21.15.81:0/2917056896 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v127) v1 ==== 152+0+0 (secure 0 0 0) 0x7f6fec0552c0 con 0x7f6ff40ceef0 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fd4064f10 msgr2=0x7f6fd40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fd4064f10 0x7f6fd40673c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4000f60 tx=0x7f6fe4009040 comp rx=0 tx=0).stop 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40ceef0 msgr2=0x7f6ff40c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40ceef0 0x7f6ff40c1ee0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00b370 tx=0x7f6fec004af0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 shutdown_connections 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fd4064f10 0x7f6fd40673c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ff41606b0 0x7f6ff41f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff40ceef0 0x7f6ff40c1ee0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 --2- 172.21.15.81:0/2917056896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ff40c1ac0 0x7f6ff4163380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 >> 172.21.15.81:0/2917056896 conn(0x7f6ff40ce3e0 msgr2=0x7f6ff40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 shutdown_connections 2023-11-29T11:15:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.136+0000 7f6ff891e700 1 -- 172.21.15.81:0/2917056896 wait complete. 2023-11-29T11:15:03.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-29T11:15:03.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 Processor -- start 2023-11-29T11:15:03.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- start start 2023-11-29T11:15:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74c80b00e0 0x7f74c815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f74c809bdb0 0x7f74c815d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 0x7f74c815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c80b2db0 con 0x7f74c80b00e0 2023-11-29T11:15:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c80b3240 con 0x7f74c809bdb0 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c806d840 con 0x7f74c80cbb30 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74c80b00e0 0x7f74c815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74c80b00e0 0x7f74c815d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44728/0 (socket says 172.21.15.81:44728) 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 -- 172.21.15.81:0/494738160 learned_addr learned my addr 172.21.15.81:0/494738160 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c7fff700 1 --2- 172.21.15.81:0/494738160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 0x7f74c815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c6ffd700 1 --2- 172.21.15.81:0/494738160 >> v2:172.21.15.176:3300/0 conn(0x7f74c809bdb0 0x7f74c815d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 -- 172.21.15.81:0/494738160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 msgr2=0x7f74c815dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 --2- 172.21.15.81:0/494738160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 0x7f74c815dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 -- 172.21.15.81:0/494738160 >> v2:172.21.15.176:3300/0 conn(0x7f74c809bdb0 msgr2=0x7f74c815d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 --2- 172.21.15.81:0/494738160 >> v2:172.21.15.176:3300/0 conn(0x7f74c809bdb0 0x7f74c815d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 -- 172.21.15.81:0/494738160 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c806d560 con 0x7f74c80b00e0 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c6ffd700 1 --2- 172.21.15.81:0/494738160 >> v2:172.21.15.176:3300/0 conn(0x7f74c809bdb0 0x7f74c815d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c77fe700 1 --2- 172.21.15.81:0/494738160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c80b00e0 0x7f74c815d2e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f74c80aca50 tx=0x7f74b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f630685bf2d75c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c67fc700 1 -- 172.21.15.81:0/494738160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800b8a0 con 0x7f74c80b00e0 2023-11-29T11:15:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c67fc700 1 -- 172.21.15.81:0/494738160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b800ba00 con 0x7f74c80b00e0 2023-11-29T11:15:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74c67fc700 1 -- 172.21.15.81:0/494738160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800bd90 con 0x7f74c80b00e0 2023-11-29T11:15:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- 172.21.15.81:0/494738160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c80b00e0 msgr2=0x7f74c815d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/494738160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c80b00e0 0x7f74c815d2e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f74c80aca50 tx=0x7f74b8009bf0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- 172.21.15.81:0/494738160 shutdown_connections 2023-11-29T11:15:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/494738160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 0x7f74c815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/494738160 >> v2:172.21.15.176:3300/0 conn(0x7f74c809bdb0 0x7f74c815d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/494738160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c80b00e0 0x7f74c815d2e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- 172.21.15.81:0/494738160 >> 172.21.15.81:0/494738160 conn(0x7f74c80cae70 msgr2=0x7f74c80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- 172.21.15.81:0/494738160 shutdown_connections 2023-11-29T11:15:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.284+0000 7f74ccb9c700 1 -- 172.21.15.81:0/494738160 wait complete. 2023-11-29T11:15:03.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74ccb9c700 1 Processor -- start 2023-11-29T11:15:03.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74ccb9c700 1 -- start start 2023-11-29T11:15:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74ccb9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c809bdb0 0x7f74c80c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74ccb9c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c80b00e0 0x7f74c8070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74ccb9c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 0x7f74c80710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74ccb9c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80c1f20 con 0x7f74c809bdb0 2023-11-29T11:15:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74ccb9c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c806ff70 con 0x7f74c80b00e0 2023-11-29T11:15:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74ccb9c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80c2170 con 0x7f74c80cbb30 2023-11-29T11:15:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c809bdb0 0x7f74c80c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c809bdb0 0x7f74c80c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44736/0 (socket says 172.21.15.81:44736) 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74c77fe700 1 -- 172.21.15.81:0/2074702674 learned_addr learned my addr 172.21.15.81:0/2074702674 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74c7fff700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 0x7f74c80710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.288+0000 7f74c6ffd700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c80b00e0 0x7f74c8070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74c77fe700 1 -- 172.21.15.81:0/2074702674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 msgr2=0x7f74c80710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74c77fe700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 0x7f74c80710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74c77fe700 1 -- 172.21.15.81:0/2074702674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c80b00e0 msgr2=0x7f74c8070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74c77fe700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c80b00e0 0x7f74c8070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74c77fe700 1 -- 172.21.15.81:0/2074702674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009570 con 0x7f74c809bdb0 2023-11-29T11:15:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74c77fe700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c809bdb0 0x7f74c80c5730 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f74b800b0e0 tx=0x7f74b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74affff700 1 -- 172.21.15.81:0/2074702674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80036c0 con 0x7f74c809bdb0 2023-11-29T11:15:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74affff700 1 -- 172.21.15.81:0/2074702674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b801f070 con 0x7f74c809bdb0 2023-11-29T11:15:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c80ac3d0 con 0x7f74c809bdb0 2023-11-29T11:15:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74affff700 1 -- 172.21.15.81:0/2074702674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8003a20 con 0x7f74c809bdb0 2023-11-29T11:15:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c80ac0f0 con 0x7f74c809bdb0 2023-11-29T11:15:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c80cc9f0 con 0x7f74c809bdb0 2023-11-29T11:15:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74affff700 1 -- 172.21.15.81:0/2074702674 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f74b802a020 con 0x7f74c809bdb0 2023-11-29T11:15:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74affff700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74affff700 1 -- 172.21.15.81:0/2074702674 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f74b8083460 con 0x7f74c809bdb0 2023-11-29T11:15:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.292+0000 7f74c6ffd700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.296+0000 7f74c6ffd700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f74c815ef20 tx=0x7f74bc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:03.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.300+0000 7f74affff700 1 -- 172.21.15.81:0/2074702674 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f74b80517c0 con 0x7f74c809bdb0 2023-11-29T11:15:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.464+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f74c8072500 con 0x7f74c809bdb0 2023-11-29T11:15:03.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74affff700 1 -- 172.21.15.81:0/2074702674 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74b8054de0 con 0x7f74c809bdb0 2023-11-29T11:15:03.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 msgr2=0x7f74b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f74c815ef20 tx=0x7f74bc008040 comp rx=0 tx=0).stop 2023-11-29T11:15:03.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c809bdb0 msgr2=0x7f74c80c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c809bdb0 0x7f74c80c5730 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f74b800b0e0 tx=0x7f74b8004770 comp rx=0 tx=0).stop 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 shutdown_connections 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74c80cbb30 0x7f74c80710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c80b00e0 0x7f74c8070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.472+0000 7f74ccb9c700 1 --2- 172.21.15.81:0/2074702674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c809bdb0 0x7f74c80c5730 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.476+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 >> 172.21.15.81:0/2074702674 conn(0x7f74c80cae70 msgr2=0x7f74c80aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.476+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 shutdown_connections 2023-11-29T11:15:03.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.476+0000 7f74ccb9c700 1 -- 172.21.15.81:0/2074702674 wait complete. 2023-11-29T11:15:03.495 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:15:03.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:15:03.514 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:15:03.536 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:15:03.536 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:15:03.536 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:15:03.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:15:03.543 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:15:03.544 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:15:03.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:15:03.550 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:15:03.550 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:15:03.591 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:15:03.592 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:15:03.592 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:15:03.599 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:15:03.599 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-29T11:15:03.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:03.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.708+0000 7f3295160700 1 Processor -- start 2023-11-29T11:15:03.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.708+0000 7f3295160700 1 -- start start 2023-11-29T11:15:03.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32901606b0 0x7f32900c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3290164e60 con 0x7f32900ceef0 2023-11-29T11:15:03.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32900cae70 con 0x7f32900ad610 2023-11-29T11:15:03.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900cbc10 con 0x7f32901606b0 2023-11-29T11:15:03.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f32900ceef0 0x7f3290164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42400/0 (socket says 172.21.15.81:42400) 2023-11-29T11:15:03.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328f7fe700 1 -- 172.21.15.81:0/1914902764 learned_addr learned my addr 172.21.15.81:0/1914902764 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:03.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328ffff700 1 --2- 172.21.15.81:0/1914902764 >> v2:172.21.15.81:3300/0 conn(0x7f32901606b0 0x7f32900c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328effd700 1 -- 172.21.15.81:0/1914902764 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719537672 0 0) 0x7f3290164e60 con 0x7f32900ceef0 2023-11-29T11:15:03.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328effd700 1 -- 172.21.15.81:0/1914902764 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32780035d0 con 0x7f32900ceef0 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328effd700 1 -- 172.21.15.81:0/1914902764 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888243797 0 0) 0x7f32900cae70 con 0x7f32900ad610 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328effd700 1 -- 172.21.15.81:0/1914902764 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3290164e60 con 0x7f32900ad610 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328ffff700 1 -- 172.21.15.81:0/1914902764 >> v1:172.21.15.176:6789/0 conn(0x7f32900ad610 legacy=0x7f3290164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328ffff700 1 -- 172.21.15.81:0/1914902764 >> v1:172.21.15.81:6789/0 conn(0x7f32900ceef0 legacy=0x7f3290164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328ffff700 1 -- 172.21.15.81:0/1914902764 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32900cb130 con 0x7f32901606b0 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328ffff700 1 --2- 172.21.15.81:0/1914902764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32901606b0 0x7f32900c13b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3284009850 tx=0x7f3284009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d8bcde2f4e33eb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328effd700 1 -- 172.21.15.81:0/1914902764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284011830 con 0x7f32901606b0 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328effd700 1 -- 172.21.15.81:0/1914902764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284011990 con 0x7f32901606b0 2023-11-29T11:15:03.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f328effd700 1 -- 172.21.15.81:0/1914902764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284011d40 con 0x7f32901606b0 2023-11-29T11:15:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 -- 172.21.15.81:0/1914902764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32901606b0 msgr2=0x7f32900c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 --2- 172.21.15.81:0/1914902764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32901606b0 0x7f32900c13b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3284009850 tx=0x7f3284009b60 comp rx=0 tx=0).stop 2023-11-29T11:15:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 -- 172.21.15.81:0/1914902764 shutdown_connections 2023-11-29T11:15:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 --2- 172.21.15.81:0/1914902764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32901606b0 0x7f32900c13b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 -- 172.21.15.81:0/1914902764 >> 172.21.15.81:0/1914902764 conn(0x7f32900ce3e0 msgr2=0x7f32900ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 -- 172.21.15.81:0/1914902764 shutdown_connections 2023-11-29T11:15:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.712+0000 7f3295160700 1 -- 172.21.15.81:0/1914902764 wait complete. 2023-11-29T11:15:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f3295160700 1 Processor -- start 2023-11-29T11:15:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f3295160700 1 -- start start 2023-11-29T11:15:03.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f3295160700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32900ad610 0x7f32901f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f3295160700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32900ceef0 0x7f3290162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f3295160700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32901606b0 0x7f32901f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f3295160700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32901614c0 con 0x7f32900ceef0 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f3295160700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3290163420 con 0x7f32901606b0 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f3295160700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32901f6100 con 0x7f32900ad610 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32900ceef0 0x7f3290162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32900ceef0 0x7f3290162ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44754/0 (socket says 172.21.15.81:44754) 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 -- 172.21.15.81:0/1401707955 learned_addr learned my addr 172.21.15.81:0/1401707955 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328ffff700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32900ad610 0x7f32901f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f329495f700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32901606b0 0x7f32901f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 -- 172.21.15.81:0/1401707955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32900ad610 msgr2=0x7f32901f9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32900ad610 0x7f32901f9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 -- 172.21.15.81:0/1401707955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32901606b0 msgr2=0x7f32901f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32901606b0 0x7f32901f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 -- 172.21.15.81:0/1401707955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840094b0 con 0x7f32900ceef0 2023-11-29T11:15:03.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328f7fe700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32900ceef0 0x7f3290162ee0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f328000c4d0 tx=0x7f328000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:03.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328cff9700 1 -- 172.21.15.81:0/1401707955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280005d90 con 0x7f32900ceef0 2023-11-29T11:15:03.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.716+0000 7f328cff9700 1 -- 172.21.15.81:0/1401707955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800070d0 con 0x7f32900ceef0 2023-11-29T11:15:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32900cb6f0 con 0x7f32900ceef0 2023-11-29T11:15:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f328cff9700 1 -- 172.21.15.81:0/1401707955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280007460 con 0x7f32900ceef0 2023-11-29T11:15:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32900cb410 con 0x7f32900ceef0 2023-11-29T11:15:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329006ac50 con 0x7f32900ceef0 2023-11-29T11:15:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f328cff9700 1 -- 172.21.15.81:0/1401707955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3280019030 con 0x7f32900ceef0 2023-11-29T11:15:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f328cff9700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f327c064ee0 0x7f327c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f328ffff700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f327c064ee0 0x7f327c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f328cff9700 1 -- 172.21.15.81:0/1401707955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3280080fe0 con 0x7f32900ceef0 2023-11-29T11:15:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.720+0000 7f328ffff700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f327c064ee0 0x7f327c067390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f32840090b0 tx=0x7f3284008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:03.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.728+0000 7f328cff9700 1 -- 172.21.15.81:0/1401707955 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f328004f2b0 con 0x7f32900ceef0 2023-11-29T11:15:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.928+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3290072500 con 0x7f32900ceef0 2023-11-29T11:15:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f328cff9700 1 -- 172.21.15.81:0/1401707955 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3280017de0 con 0x7f32900ceef0 2023-11-29T11:15:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:03.938 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1224885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1224885675},{"type":"v1","addr":"172.21.15.81:6835","nonce":1224885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3537361909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3537361909},{"type":"v1","addr":"172.21.15.176:6835","nonce":3537361909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/1626530030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1626530030},{"type":"v1","addr":"172.21.15.176:6833","nonce":1626530030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5524,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2781858795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2781858795},{"type":"v1","addr":"172.21.15.81:6837","nonce":2781858795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[]} 2023-11-29T11:15:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f327c064ee0 msgr2=0x7f327c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f327c064ee0 0x7f327c067390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f32840090b0 tx=0x7f3284008030 comp rx=0 tx=0).stop 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32900ceef0 msgr2=0x7f3290162ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32900ceef0 0x7f3290162ee0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f328000c4d0 tx=0x7f328000c7e0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 shutdown_connections 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f327c064ee0 0x7f327c067390 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32901606b0 0x7f32901f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32900ceef0 0x7f3290162ee0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 --2- 172.21.15.81:0/1401707955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32900ad610 0x7f32901f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 >> 172.21.15.81:0/1401707955 conn(0x7f32900ce3e0 msgr2=0x7f32900cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 shutdown_connections 2023-11-29T11:15:03.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:03.932+0000 7f3295160700 1 -- 172.21.15.81:0/1401707955 wait complete. 2023-11-29T11:15:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 19 2023-11-29T11:15:03.953 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-29T11:15:03.953 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-29T11:15:03.953 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T11:15:03.953 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:15:03.954 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-29T11:15:03.954 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-29T11:15:03.954 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T11:15:03.954 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:15:03.954 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-29T11:15:03.954 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-29T11:15:03.954 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T11:15:03.954 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:15:03.955 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-29T11:15:03.955 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-29T11:15:03.955 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T11:15:03.955 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:15:03.965 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T11:15:03.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-29T11:15:03.969 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T11:15:03.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-29T11:15:03.971 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T11:15:03.971 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-29T11:15:03.972 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T11:15:03.973 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-29T11:15:03.973 INFO:tasks.ceph.mds.d:Started 2023-11-29T11:15:03.974 DEBUG:teuthology.parallel:result is None 2023-11-29T11:15:03.975 INFO:tasks.ceph.mds.b:Started 2023-11-29T11:15:03.975 DEBUG:teuthology.parallel:result is None 2023-11-29T11:15:04.014 INFO:tasks.ceph.mds.c:Started 2023-11-29T11:15:04.014 DEBUG:teuthology.parallel:result is None 2023-11-29T11:15:04.015 INFO:tasks.ceph.mds.a:Started 2023-11-29T11:15:04.016 DEBUG:teuthology.parallel:result is None 2023-11-29T11:15:04.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-29T11:15:04.049 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:15:04.052 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-29T11:15:04.094 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:15:04.098 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:15:04.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c10881700 1 Processor -- start 2023-11-29T11:15:04.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c10881700 1 -- start start 2023-11-29T11:15:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c10881700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c0c06a330 0x7f5c0c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c10881700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5c0c0d2780 0x7f5c0c0d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c10881700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0c0cf070 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c10881700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0c0d3160 con 0x7f5c0c06a330 2023-11-29T11:15:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c10881700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0c0b2070 con 0x7f5c0c0d2780 2023-11-29T11:15:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c0c06a330 0x7f5c0c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c0c06a330 0x7f5c0c0b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44780/0 (socket says 172.21.15.81:44780) 2023-11-29T11:15:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0a59c700 1 -- 172.21.15.81:0/3898576307 learned_addr learned my addr 172.21.15.81:0/3898576307 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0b59e700 1 --2- 172.21.15.81:0/3898576307 >> v2:172.21.15.176:3300/0 conn(0x7f5c0c0d2780 0x7f5c0c0d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0a59c700 1 -- 172.21.15.81:0/3898576307 >> v2:172.21.15.176:3300/0 conn(0x7f5c0c0d2780 msgr2=0x7f5c0c0d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0a59c700 1 --2- 172.21.15.81:0/3898576307 >> v2:172.21.15.176:3300/0 conn(0x7f5c0c0d2780 0x7f5c0c0d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0a59c700 1 -- 172.21.15.81:0/3898576307 >> v1:172.21.15.176:6789/0 conn(0x7f5c0c0b1ca0 legacy=0x7f5c0c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0a59c700 1 -- 172.21.15.81:0/3898576307 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c06a8a0 con 0x7f5c0c06a330 2023-11-29T11:15:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.140+0000 7f5c0a59c700 1 --2- 172.21.15.81:0/3898576307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c06a330 0x7f5c0c0b6250 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c08bc90 tx=0x7f5bfc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea10d4d84605839 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c09d9b700 1 -- 172.21.15.81:0/3898576307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc011830 con 0x7f5c0c06a330 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c09d9b700 1 -- 172.21.15.81:0/3898576307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc011990 con 0x7f5c0c06a330 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c09d9b700 1 -- 172.21.15.81:0/3898576307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc011d20 con 0x7f5c0c06a330 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 -- 172.21.15.81:0/3898576307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c06a330 msgr2=0x7f5c0c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 --2- 172.21.15.81:0/3898576307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c06a330 0x7f5c0c0b6250 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c08bc90 tx=0x7f5bfc009bf0 comp rx=0 tx=0).stop 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 -- 172.21.15.81:0/3898576307 shutdown_connections 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 --2- 172.21.15.81:0/3898576307 >> v2:172.21.15.176:3300/0 conn(0x7f5c0c0d2780 0x7f5c0c0d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 --2- 172.21.15.81:0/3898576307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c06a330 0x7f5c0c0b6250 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 -- 172.21.15.81:0/3898576307 >> 172.21.15.81:0/3898576307 conn(0x7f5c0c0b5740 msgr2=0x7f5c0c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 -- 172.21.15.81:0/3898576307 shutdown_connections 2023-11-29T11:15:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 -- 172.21.15.81:0/3898576307 wait complete. 2023-11-29T11:15:04.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 Processor -- start 2023-11-29T11:15:04.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.144+0000 7f5c10881700 1 -- start start 2023-11-29T11:15:04.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c10881700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0c06a330 0x7f5c0c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:04.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c10881700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c0c0b1ca0 0x7f5c0c0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:04.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c10881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c0d2780 0x7f5c0c15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c10881700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c0b48b0 con 0x7f5c0c0d2780 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c10881700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c1f27f0 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c10881700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c0c5b20 con 0x7f5c0c06a330 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c0d2780 0x7f5c0c15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0a59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c0c0b1ca0 0x7f5c0c0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c0d2780 0x7f5c0c15e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44788/0 (socket says 172.21.15.81:44788) 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0ad9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0c06a330 0x7f5c0c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0b59e700 1 -- 172.21.15.81:0/2157297211 learned_addr learned my addr 172.21.15.81:0/2157297211 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0a59c700 1 -- 172.21.15.81:0/2157297211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0c06a330 msgr2=0x7f5c0c0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0a59c700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0c06a330 0x7f5c0c0b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0a59c700 1 -- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c0d2780 msgr2=0x7f5c0c15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0a59c700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c0d2780 0x7f5c0c15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0a59c700 1 -- 172.21.15.81:0/2157297211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc009570 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0b59e700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c0d2780 0x7f5c0c15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c0a59c700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c0c0b1ca0 0x7f5c0c0c55e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc016000 tx=0x7f5bfc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5bf37fe700 1 -- 172.21.15.81:0/2157297211 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc004510 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5bf37fe700 1 -- 172.21.15.81:0/2157297211 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc01e070 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5bf37fe700 1 -- 172.21.15.81:0/2157297211 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc0038e0 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c06ae60 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.148+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c06ab80 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.152+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c06b140 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.152+0000 7f5bf37fe700 1 -- 172.21.15.81:0/2157297211 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5bfc00f050 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.152+0000 7f5bf37fe700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5bf8064ee0 0x7f5bf8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.152+0000 7f5c0ad9d700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5bf8064ee0 0x7f5bf8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.152+0000 7f5bf37fe700 1 -- 172.21.15.81:0/2157297211 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f5bfc020070 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.152+0000 7f5c0ad9d700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5bf8064ee0 0x7f5bf8067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0b3b20 tx=0x7f5c00009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:04.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.164+0000 7f5bf37fe700 1 -- 172.21.15.81:0/2157297211 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5bfc087070 con 0x7f5c0c0b1ca0 2023-11-29T11:15:04.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-29T11:15:04.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-29T11:15:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:04.340+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5c0c0b49f0 con 0x7f5c0c0b1ca0 2023-11-29T11:15:05.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.156+0000 7f5bf37fe700 1 -- 172.21.15.81:0/2157297211 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5c0c0b49f0 con 0x7f5c0c0b1ca0 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5bf8064ee0 msgr2=0x7f5bf8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5bf8064ee0 0x7f5bf8067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0b3b20 tx=0x7f5c00009040 comp rx=0 tx=0).stop 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c0c0b1ca0 msgr2=0x7f5c0c0c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c0c0b1ca0 0x7f5c0c0c55e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc016000 tx=0x7f5bfc004770 comp rx=0 tx=0).stop 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 shutdown_connections 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5bf8064ee0 0x7f5bf8067390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c0c0d2780 0x7f5c0c15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c0c0b1ca0 0x7f5c0c0c55e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 --2- 172.21.15.81:0/2157297211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c0c06a330 0x7f5c0c0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 >> 172.21.15.81:0/2157297211 conn(0x7f5c0c0b5740 msgr2=0x7f5c0c0d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 shutdown_connections 2023-11-29T11:15:05.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.160+0000 7f5c10881700 1 -- 172.21.15.81:0/2157297211 wait complete. 2023-11-29T11:15:05.168 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-11-29T11:15:05.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-29T11:15:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.292+0000 7f8a93fff700 1 Processor -- start 2023-11-29T11:15:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.292+0000 7f8a93fff700 1 -- start start 2023-11-29T11:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.292+0000 7f8a93fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8a9415c150 0x7f8a941607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.292+0000 7f8a93fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a940cc600 0x7f8a940ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.292+0000 7f8a93fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9415c520 con 0x7f8a940c9e70 2023-11-29T11:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.292+0000 7f8a93fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a940ca680 con 0x7f8a940cc600 2023-11-29T11:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.292+0000 7f8a93fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a940ca960 con 0x7f8a9415c150 2023-11-29T11:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a937fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a940cc600 0x7f8a940ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a937fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a940cc600 0x7f8a940ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44804/0 (socket says 172.21.15.81:44804) 2023-11-29T11:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a937fe700 1 -- 172.21.15.81:0/2270183716 learned_addr learned my addr 172.21.15.81:0/2270183716 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/2270183716 >> v2:172.21.15.176:3300/0 conn(0x7f8a9415c150 0x7f8a941607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a937fe700 1 -- 172.21.15.81:0/2270183716 >> v2:172.21.15.176:3300/0 conn(0x7f8a9415c150 msgr2=0x7f8a941607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a937fe700 1 --2- 172.21.15.81:0/2270183716 >> v2:172.21.15.176:3300/0 conn(0x7f8a9415c150 0x7f8a941607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a937fe700 1 -- 172.21.15.81:0/2270183716 >> v1:172.21.15.176:6789/0 conn(0x7f8a940c9e70 legacy=0x7f8a940cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a937fe700 1 -- 172.21.15.81:0/2270183716 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a940cd840 con 0x7f8a940cc600 2023-11-29T11:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a937fe700 1 --2- 172.21.15.81:0/2270183716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a940ce320 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8a94070b20 tx=0x7f8a8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85bf0acb6be913f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a927fc700 1 -- 172.21.15.81:0/2270183716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00e070 con 0x7f8a940cc600 2023-11-29T11:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a927fc700 1 -- 172.21.15.81:0/2270183716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c00b910 con 0x7f8a940cc600 2023-11-29T11:15:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a927fc700 1 -- 172.21.15.81:0/2270183716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00bcc0 con 0x7f8a940cc600 2023-11-29T11:15:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a93fff700 1 -- 172.21.15.81:0/2270183716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 msgr2=0x7f8a940ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2270183716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a940ce320 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8a94070b20 tx=0x7f8a8c00b330 comp rx=0 tx=0).stop 2023-11-29T11:15:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a93fff700 1 -- 172.21.15.81:0/2270183716 shutdown_connections 2023-11-29T11:15:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2270183716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a940ce320 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2270183716 >> v2:172.21.15.176:3300/0 conn(0x7f8a9415c150 0x7f8a941607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a93fff700 1 -- 172.21.15.81:0/2270183716 >> 172.21.15.81:0/2270183716 conn(0x7f8a9406ec40 msgr2=0x7f8a940b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a93fff700 1 -- 172.21.15.81:0/2270183716 shutdown_connections 2023-11-29T11:15:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.296+0000 7f8a93fff700 1 -- 172.21.15.81:0/2270183716 wait complete. 2023-11-29T11:15:05.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a93fff700 1 Processor -- start 2023-11-29T11:15:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a93fff700 1 -- start start 2023-11-29T11:15:05.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940c9e70 0x7f8a940b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a9406b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a9415c150 0x7f8a9406ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a93fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940b55b0 con 0x7f8a940cc600 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a93fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9415c7e0 con 0x7f8a940c9e70 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a93fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9415cac0 con 0x7f8a9415c150 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a8bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a9406b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a8bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a9406b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44810/0 (socket says 172.21.15.81:44810) 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a8bfff700 1 -- 172.21.15.81:0/1414949415 learned_addr learned my addr 172.21.15.81:0/1414949415 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940c9e70 0x7f8a940b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a937fe700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a9415c150 0x7f8a9406ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a937fe700 1 -- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940c9e70 msgr2=0x7f8a940b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a937fe700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940c9e70 0x7f8a940b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a937fe700 1 -- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 msgr2=0x7f8a9406b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a937fe700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a9406b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a937fe700 1 -- 172.21.15.81:0/1414949415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c009b30 con 0x7f8a9415c150 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.300+0000 7f8a8bfff700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a9406b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.304+0000 7f8a937fe700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a9415c150 0x7f8a9406ba60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c015000 tx=0x7f8a8c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.304+0000 7f8a8b7fe700 1 -- 172.21.15.81:0/1414949415 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c004880 con 0x7f8a9415c150 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.304+0000 7f8a8b7fe700 1 -- 172.21.15.81:0/1414949415 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c0099b0 con 0x7f8a9415c150 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.304+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a940cde00 con 0x7f8a9415c150 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.304+0000 7f8a8b7fe700 1 -- 172.21.15.81:0/1414949415 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c01c680 con 0x7f8a9415c150 2023-11-29T11:15:05.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.304+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a940cdb20 con 0x7f8a9415c150 2023-11-29T11:15:05.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.304+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a940ca2f0 con 0x7f8a9415c150 2023-11-29T11:15:05.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.304+0000 7f8a8b7fe700 1 -- 172.21.15.81:0/1414949415 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8a8c022030 con 0x7f8a9415c150 2023-11-29T11:15:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.308+0000 7f8a8b7fe700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a74064f10 0x7f8a740673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.308+0000 7f8a8b7fe700 1 -- 172.21.15.81:0/1414949415 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8a8c083530 con 0x7f8a9415c150 2023-11-29T11:15:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.308+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a74064f10 0x7f8a740673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.308+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a74064f10 0x7f8a740673c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009b50 tx=0x7f8a84009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:05.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.316+0000 7f8a8b7fe700 1 -- 172.21.15.81:0/1414949415 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8a8c051a30 con 0x7f8a9415c150 2023-11-29T11:15:05.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.536+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8a9415c920 con 0x7f8a9415c150 2023-11-29T11:15:05.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.536+0000 7f8a8b7fe700 1 -- 172.21.15.81:0/1414949415 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f8a9415c920 con 0x7f8a9415c150 2023-11-29T11:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-11-29T11:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlSOayNhAAtezph/rP5i/F81/canwMdA==", 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdl8qMjBRAAuvMDj+jPn1OjXUEcUl34jg==", 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlIykpOhAAL31egdG19jdsaMglEpIC5w==", 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlKA1GCxAAOzBuOUs7pjJJOOFwZq8npA==", 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-11-29T11:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/HGdl92Q/OhAAXGWXiUvswEMnfzScuUn0cw==", 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDHGdl8TbZExAA2IBrIVdDMSaeGFjE0oBYFw==", 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCGHGdlUk9QJhAA3rf+afNjbbsQotcH4YjVQg==", 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJHGdlUPFnLRAAk4y/WOW2lDfYd22+GF2QlA==", 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCPHGdlLLatFRAAz4dG1oXNEITKomtPGnDBmw==", 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-11-29T11:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCSHGdl34DRKxAAt8kHY0+FALSWN612SIOnsQ==", 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCVHGdl4zPUMBAAsF8NTRCGqXpRuVduNnWO1A==", 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCYHGdlQv/DNRAAFMTV+dTJZ0UZK2eCJiFDuw==", 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-11-29T11:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgxnnDhAAfROm0RfwzNurvq62gqmGBQ==", 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgjcpFRAAtcxPbxV34mCHxFVoGYmqmg==", 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlvfbxERAA6d5eRkOBOKhyToZKDKlvYQ==", 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-11-29T11:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlDrDHGhAAfy4RAK8qFAj2Sf6GuRGhBw==", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlW+ELKBAAoMzxY7NGqIJ1SNfaQ/4qVQ==", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlqaiZMhAAPiboTL+csIYuoxSk+ZwfJA==", 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlcf6LLxAAqtoEWzgd41N9uT9tC7bZ/Q==", 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-11-29T11:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:15:05.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.536+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a74064f10 msgr2=0x7f8a740673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.536+0000 7f8a93fff700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a74064f10 0x7f8a740673c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009b50 tx=0x7f8a84009240 comp rx=0 tx=0).stop 2023-11-29T11:15:05.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.536+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a9415c150 msgr2=0x7f8a9406ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.536+0000 7f8a93fff700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a9415c150 0x7f8a9406ba60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c015000 tx=0x7f8a8c004af0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.540+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 shutdown_connections 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.540+0000 7f8a93fff700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a74064f10 0x7f8a740673c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.540+0000 7f8a93fff700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a9415c150 0x7f8a9406ba60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.540+0000 7f8a93fff700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940cc600 0x7f8a9406b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.540+0000 7f8a93fff700 1 --2- 172.21.15.81:0/1414949415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940c9e70 0x7f8a940b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.540+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 >> 172.21.15.81:0/1414949415 conn(0x7f8a9406ec40 msgr2=0x7f8a94070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.540+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 shutdown_connections 2023-11-29T11:15:05.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.540+0000 7f8a93fff700 1 -- 172.21.15.81:0/1414949415 wait complete. 2023-11-29T11:15:05.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:15:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.660+0000 7fda1359e700 1 Processor -- start 2023-11-29T11:15:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.660+0000 7fda1359e700 1 -- start start 2023-11-29T11:15:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda1406d7d0 0x7fda1406a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda140b4c10 0x7fda140cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1406dc70 con 0x7fda140cf050 2023-11-29T11:15:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1406aa70 con 0x7fda1406d7d0 2023-11-29T11:15:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1415c6d0 con 0x7fda140b4c10 2023-11-29T11:15:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda11d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda1406d7d0 0x7fda1406a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda11d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda1406d7d0 0x7fda1406a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44826/0 (socket says 172.21.15.81:44826) 2023-11-29T11:15:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda11d9b700 1 -- 172.21.15.81:0/1939932983 learned_addr learned my addr 172.21.15.81:0/1939932983 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda12d9d700 1 --2- 172.21.15.81:0/1939932983 >> v2:172.21.15.176:3300/0 conn(0x7fda140b4c10 0x7fda140cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda11d9b700 1 -- 172.21.15.81:0/1939932983 >> v2:172.21.15.176:3300/0 conn(0x7fda140b4c10 msgr2=0x7fda140cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda11d9b700 1 --2- 172.21.15.81:0/1939932983 >> v2:172.21.15.176:3300/0 conn(0x7fda140b4c10 0x7fda140cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda11d9b700 1 -- 172.21.15.81:0/1939932983 >> v1:172.21.15.176:6789/0 conn(0x7fda140cf050 legacy=0x7fda140cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda11d9b700 1 -- 172.21.15.81:0/1939932983 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1406ac60 con 0x7fda1406d7d0 2023-11-29T11:15:05.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda11d9b700 1 --2- 172.21.15.81:0/1939932983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1406d7d0 0x7fda1406a530 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fda1408c660 tx=0x7fda04009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee81ab24cc132e7b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1159a700 1 -- 172.21.15.81:0/1939932983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04011830 con 0x7fda1406d7d0 2023-11-29T11:15:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1159a700 1 -- 172.21.15.81:0/1939932983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda04011990 con 0x7fda1406d7d0 2023-11-29T11:15:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1159a700 1 -- 172.21.15.81:0/1939932983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04011d20 con 0x7fda1406d7d0 2023-11-29T11:15:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 -- 172.21.15.81:0/1939932983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1406d7d0 msgr2=0x7fda1406a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 --2- 172.21.15.81:0/1939932983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1406d7d0 0x7fda1406a530 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fda1408c660 tx=0x7fda04009bf0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 -- 172.21.15.81:0/1939932983 shutdown_connections 2023-11-29T11:15:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 --2- 172.21.15.81:0/1939932983 >> v2:172.21.15.176:3300/0 conn(0x7fda140b4c10 0x7fda140cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 --2- 172.21.15.81:0/1939932983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1406d7d0 0x7fda1406a530 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 -- 172.21.15.81:0/1939932983 >> 172.21.15.81:0/1939932983 conn(0x7fda1409bb30 msgr2=0x7fda140b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 -- 172.21.15.81:0/1939932983 shutdown_connections 2023-11-29T11:15:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.664+0000 7fda1359e700 1 -- 172.21.15.81:0/1939932983 wait complete. 2023-11-29T11:15:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 Processor -- start 2023-11-29T11:15:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 -- start start 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1406d7d0 0x7fda1414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda140b4c10 0x7fda140c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda140cf050 0x7fda140c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1414e380 con 0x7fda140b4c10 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda141501b0 con 0x7fda1406d7d0 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1414f5a0 con 0x7fda140cf050 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda140b4c10 0x7fda140c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda140b4c10 0x7fda140c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44836/0 (socket says 172.21.15.81:44836) 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 -- 172.21.15.81:0/2872787499 learned_addr learned my addr 172.21.15.81:0/2872787499 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1259c700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1406d7d0 0x7fda1414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda12d9d700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda140cf050 0x7fda140c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 -- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda140cf050 msgr2=0x7fda140c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda140cf050 0x7fda140c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 -- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1406d7d0 msgr2=0x7fda1414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1406d7d0 0x7fda1414de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 -- 172.21.15.81:0/2872787499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04009570 con 0x7fda140b4c10 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1259c700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1406d7d0 0x7fda1414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda11d9b700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda140b4c10 0x7fda140c84d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fda1408c6b0 tx=0x7fda04004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda02ffd700 1 -- 172.21.15.81:0/2872787499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04004550 con 0x7fda140b4c10 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda02ffd700 1 -- 172.21.15.81:0/2872787499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0401f070 con 0x7fda140b4c10 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda140b4410 con 0x7fda140b4c10 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda02ffd700 1 -- 172.21.15.81:0/2872787499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04003900 con 0x7fda140b4c10 2023-11-29T11:15:05.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.668+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1406af40 con 0x7fda140b4c10 2023-11-29T11:15:05.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.672+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda140b46f0 con 0x7fda140b4c10 2023-11-29T11:15:05.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.672+0000 7fda02ffd700 1 -- 172.21.15.81:0/2872787499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fda0400f050 con 0x7fda140b4c10 2023-11-29T11:15:05.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.672+0000 7fda02ffd700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd9f4064ee0 0x7fd9f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.672+0000 7fda02ffd700 1 -- 172.21.15.81:0/2872787499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fda04021070 con 0x7fda140b4c10 2023-11-29T11:15:05.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.672+0000 7fda1259c700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd9f4064ee0 0x7fd9f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.672+0000 7fda1259c700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd9f4064ee0 0x7fd9f4067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda08000f60 tx=0x7fda08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:05.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.680+0000 7fda02ffd700 1 -- 172.21.15.81:0/2872787499 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fda04051510 con 0x7fda140b4c10 2023-11-29T11:15:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.848+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda14072500 con 0x7fda140b4c10 2023-11-29T11:15:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.848+0000 7fda02ffd700 1 -- 172.21.15.81:0/2872787499 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+14318 (secure 0 0 0) 0x7fda04015090 con 0x7fda140b4c10 2023-11-29T11:15:05.856 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:05.856 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":51,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:15:05.138094+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:15:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd9f4064ee0 msgr2=0x7fd9f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd9f4064ee0 0x7fd9f4067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda08000f60 tx=0x7fda08009040 comp rx=0 tx=0).stop 2023-11-29T11:15:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda140b4c10 msgr2=0x7fda140c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda140b4c10 0x7fda140c84d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fda1408c6b0 tx=0x7fda04004770 comp rx=0 tx=0).stop 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 shutdown_connections 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd9f4064ee0 0x7fd9f4067390 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda140cf050 0x7fda140c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda140b4c10 0x7fda140c84d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 --2- 172.21.15.81:0/2872787499 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1406d7d0 0x7fda1414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 >> 172.21.15.81:0/2872787499 conn(0x7fda1409bb30 msgr2=0x7fda140afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 shutdown_connections 2023-11-29T11:15:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.852+0000 7fda1359e700 1 -- 172.21.15.81:0/2872787499 wait complete. 2023-11-29T11:15:05.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:15:05.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:15:05.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882d82700 1 Processor -- start 2023-11-29T11:15:05.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882d82700 1 -- start start 2023-11-29T11:15:05.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882d82700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 0x7fa87c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882d82700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa87c0cf0e0 0x7fa87c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:05.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882d82700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c0cfa80 con 0x7fa87c06a4c0 2023-11-29T11:15:05.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882d82700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0d0ab0 con 0x7fa87c0cf0e0 2023-11-29T11:15:05.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882d82700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c06a9c0 con 0x7fa87c0b1ae0 2023-11-29T11:15:05.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882581700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa87c0cf0e0 0x7fa87c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa88157f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa87c06a4c0 0x7fa87c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42420/0 (socket says 172.21.15.81:42420) 2023-11-29T11:15:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa88157f700 1 -- 172.21.15.81:0/1958682212 learned_addr learned my addr 172.21.15.81:0/1958682212 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa881d80700 1 --2- 172.21.15.81:0/1958682212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 0x7fa87c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882581700 1 -- 172.21.15.81:0/1958682212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 msgr2=0x7fa87c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882581700 1 --2- 172.21.15.81:0/1958682212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 0x7fa87c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882581700 1 -- 172.21.15.81:0/1958682212 >> v1:172.21.15.81:6789/0 conn(0x7fa87c06a4c0 legacy=0x7fa87c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882581700 1 -- 172.21.15.81:0/1958682212 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c06aca0 con 0x7fa87c0cf0e0 2023-11-29T11:15:05.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa882581700 1 --2- 172.21.15.81:0/1958682212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c0cf0e0 0x7fa87c0cf540 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa874009d90 tx=0x7fa87400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31961360a14cb18e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa880d7e700 1 -- 172.21.15.81:0/1958682212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400e070 con 0x7fa87c0cf0e0 2023-11-29T11:15:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa880d7e700 1 -- 172.21.15.81:0/1958682212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87400bbd0 con 0x7fa87c0cf0e0 2023-11-29T11:15:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.984+0000 7fa880d7e700 1 -- 172.21.15.81:0/1958682212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874012430 con 0x7fa87c0cf0e0 2023-11-29T11:15:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.988+0000 7fa882d82700 1 -- 172.21.15.81:0/1958682212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c0cf0e0 msgr2=0x7fa87c0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.988+0000 7fa882d82700 1 --2- 172.21.15.81:0/1958682212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c0cf0e0 0x7fa87c0cf540 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa874009d90 tx=0x7fa87400b330 comp rx=0 tx=0).stop 2023-11-29T11:15:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.988+0000 7fa882d82700 1 -- 172.21.15.81:0/1958682212 shutdown_connections 2023-11-29T11:15:05.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.988+0000 7fa882d82700 1 --2- 172.21.15.81:0/1958682212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c0cf0e0 0x7fa87c0cf540 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.988+0000 7fa882d82700 1 --2- 172.21.15.81:0/1958682212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 0x7fa87c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:05.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.988+0000 7fa882d82700 1 -- 172.21.15.81:0/1958682212 >> 172.21.15.81:0/1958682212 conn(0x7fa87c09bbd0 msgr2=0x7fa87c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:05.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.988+0000 7fa882d82700 1 -- 172.21.15.81:0/1958682212 shutdown_connections 2023-11-29T11:15:05.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.988+0000 7fa882d82700 1 -- 172.21.15.81:0/1958682212 wait complete. 2023-11-29T11:15:05.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 Processor -- start 2023-11-29T11:15:05.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 -- start start 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c06a4c0 0x7fa87c0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 0x7fa87c1f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c0cf0e0 0x7fa87c1f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c15dc90 con 0x7fa87c06a4c0 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c15df70 con 0x7fa87c0cf0e0 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c15e250 con 0x7fa87c0b1ae0 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c06a4c0 0x7fa87c0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c06a4c0 0x7fa87c0c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44856/0 (socket says 172.21.15.81:44856) 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 -- 172.21.15.81:0/1563205727 learned_addr learned my addr 172.21.15.81:0/1563205727 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa88157f700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 0x7fa87c1f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882581700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c0cf0e0 0x7fa87c1f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 -- 172.21.15.81:0/1563205727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 msgr2=0x7fa87c1f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 0x7fa87c1f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 -- 172.21.15.81:0/1563205727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c0cf0e0 msgr2=0x7fa87c1f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c0cf0e0 0x7fa87c1f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 -- 172.21.15.81:0/1563205727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009a70 con 0x7fa87c06a4c0 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa881d80700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c06a4c0 0x7fa87c0c81e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00d800 tx=0x7fa86c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa8727fc700 1 -- 172.21.15.81:0/1563205727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0125f0 con 0x7fa87c06a4c0 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa8727fc700 1 -- 172.21.15.81:0/1563205727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c012750 con 0x7fa87c06a4c0 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c0b4380 con 0x7fa87c06a4c0 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa8727fc700 1 -- 172.21.15.81:0/1563205727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c012ac0 con 0x7fa87c06a4c0 2023-11-29T11:15:06.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.992+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c06af80 con 0x7fa87c06a4c0 2023-11-29T11:15:06.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.996+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c0b1eb0 con 0x7fa87c06a4c0 2023-11-29T11:15:06.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.996+0000 7fa8727fc700 1 -- 172.21.15.81:0/1563205727 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa86c012c20 con 0x7fa87c06a4c0 2023-11-29T11:15:06.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.996+0000 7fa8727fc700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa860064ee0 0x7fa860067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.996+0000 7fa8727fc700 1 -- 172.21.15.81:0/1563205727 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa86c082260 con 0x7fa87c06a4c0 2023-11-29T11:15:06.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.996+0000 7fa88157f700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa860064ee0 0x7fa860067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:05.996+0000 7fa88157f700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa860064ee0 0x7fa860067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0b53d0 tx=0x7fa878009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.008+0000 7fa8727fc700 1 -- 172.21.15.81:0/1563205727 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa86c050520 con 0x7fa87c06a4c0 2023-11-29T11:15:06.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.168+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa87c072500 con 0x7fa87c06a4c0 2023-11-29T11:15:06.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.168+0000 7fa8727fc700 1 -- 172.21.15.81:0/1563205727 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa86c053b40 con 0x7fa87c06a4c0 2023-11-29T11:15:06.176 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:15:06.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa860064ee0 msgr2=0x7fa860067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa860064ee0 0x7fa860067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0b53d0 tx=0x7fa878009040 comp rx=0 tx=0).stop 2023-11-29T11:15:06.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c06a4c0 msgr2=0x7fa87c0c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c06a4c0 0x7fa87c0c81e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00d800 tx=0x7fa86c00dbc0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 shutdown_connections 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa860064ee0 0x7fa860067390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c0cf0e0 0x7fa87c1f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c0b1ae0 0x7fa87c1f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 --2- 172.21.15.81:0/1563205727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87c06a4c0 0x7fa87c0c81e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 >> 172.21.15.81:0/1563205727 conn(0x7fa87c09bbd0 msgr2=0x7fa87c0b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 shutdown_connections 2023-11-29T11:15:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.172+0000 7fa882d82700 1 -- 172.21.15.81:0/1563205727 wait complete. 2023-11-29T11:15:06.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:15:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc9374700 1 Processor -- start 2023-11-29T11:15:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc9374700 1 -- start start 2023-11-29T11:15:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc9374700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1cc40b2d30 0x7f1cc40ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc9374700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc409c0e0 con 0x7f1cc415a3e0 2023-11-29T11:15:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc9374700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc40b13e0 con 0x7f1cc40cc2f0 2023-11-29T11:15:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc9374700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40b16c0 con 0x7f1cc40b2d30 2023-11-29T11:15:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1cc415a3e0 0x7f1cc4069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42426/0 (socket says 172.21.15.81:42426) 2023-11-29T11:15:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc37fe700 1 -- 172.21.15.81:0/2114649133 learned_addr learned my addr 172.21.15.81:0/2114649133 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/2114649133 >> v2:172.21.15.176:3300/0 conn(0x7f1cc40b2d30 0x7f1cc40ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660625482 0 0) 0x7f1cc409c0e0 con 0x7f1cc415a3e0 2023-11-29T11:15:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cac0035d0 con 0x7f1cc415a3e0 2023-11-29T11:15:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 728841129 0 0) 0x7f1cac0035d0 con 0x7f1cc415a3e0 2023-11-29T11:15:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 >> v2:172.21.15.176:3300/0 conn(0x7f1cc40b2d30 msgr2=0x7f1cc40ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 --2- 172.21.15.81:0/2114649133 >> v2:172.21.15.176:3300/0 conn(0x7f1cc40b2d30 0x7f1cc40ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 >> v1:172.21.15.176:6789/0 conn(0x7f1cc40cc2f0 legacy=0x7f1cc40cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40b19a0 con 0x7f1cc415a3e0 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f1cb40019f0 con 0x7f1cc415a3e0 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/2114649133 >> v2:172.21.15.176:3300/0 conn(0x7f1cc40b2d30 0x7f1cc40ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 >> v1:172.21.15.81:6789/0 conn(0x7f1cc415a3e0 legacy=0x7f1cc4069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac003a20 0x7f1cac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac004870 0x7f1cac004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cac005220 0x7f1cac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40b16c0 con 0x7f1cac005220 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac00c0a0 con 0x7f1cac003a20 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac00c260 con 0x7f1cac004870 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cac005220 0x7f1cac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc3fff700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac003a20 0x7f1cac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc37fe700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac004870 0x7f1cac004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc8b73700 1 -- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac004870 msgr2=0x7f1cac004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.295+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac004870 0x7f1cac004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc8b73700 1 -- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac003a20 msgr2=0x7f1cac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac003a20 0x7f1cac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc8b73700 1 -- 172.21.15.81:0/2114649133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0035d0 con 0x7f1cac005220 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc3fff700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac003a20 0x7f1cac003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc8b73700 1 -- 172.21.15.81:0/2114649133 reap_dead start 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cac005220 0x7f1cac00ba30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009d40 tx=0x7f1cac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7681f47641ab0f8f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc009e90 con 0x7f1cac005220 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00e9a0 con 0x7f1cac005220 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc2ffd700 1 -- 172.21.15.81:0/2114649133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00ed50 con 0x7f1cac005220 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 -- 172.21.15.81:0/2114649133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cac005220 msgr2=0x7f1cac00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cac005220 0x7f1cac00ba30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009d40 tx=0x7f1cac0058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 -- 172.21.15.81:0/2114649133 shutdown_connections 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 --2- 172.21.15.81:0/2114649133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cac005220 0x7f1cac00ba30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 -- 172.21.15.81:0/2114649133 >> 172.21.15.81:0/2114649133 conn(0x7f1cc40cae70 msgr2=0x7f1cc40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 -- 172.21.15.81:0/2114649133 shutdown_connections 2023-11-29T11:15:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 -- 172.21.15.81:0/2114649133 wait complete. 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 Processor -- start 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.299+0000 7f1cc9374700 1 -- start start 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac005220 0x7f1cc4152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cc415d380 0x7f1cc4152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4153050 0x7f1cc41534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc41efa50 con 0x7f1cc4153050 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40ae820 con 0x7f1cac005220 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40aea30 con 0x7f1cc415d380 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4153050 0x7f1cc41534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4153050 0x7f1cc41534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44860/0 (socket says 172.21.15.81:44860) 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 -- 172.21.15.81:0/339848155 learned_addr learned my addr 172.21.15.81:0/339848155 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc37fe700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cc415d380 0x7f1cc4152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc3fff700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac005220 0x7f1cc4152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 -- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cc415d380 msgr2=0x7f1cc4152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cc415d380 0x7f1cc4152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 -- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac005220 msgr2=0x7f1cc4152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac005220 0x7f1cc4152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 -- 172.21.15.81:0/339848155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40ac280 con 0x7f1cc4153050 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc37fe700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cc415d380 0x7f1cc4152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc8b73700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4153050 0x7f1cc41534c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40ce3c0 tx=0x7f1cbc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc0ff9700 1 -- 172.21.15.81:0/339848155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc013ea0 con 0x7f1cc4153050 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc40b1c80 con 0x7f1cc4153050 2023-11-29T11:15:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc0ff9700 1 -- 172.21.15.81:0/339848155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc027650 con 0x7f1cc4153050 2023-11-29T11:15:06.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc0ff9700 1 -- 172.21.15.81:0/339848155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc027a00 con 0x7f1cc4153050 2023-11-29T11:15:06.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc40ac410 con 0x7f1cc4153050 2023-11-29T11:15:06.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.303+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc4072120 con 0x7f1cc4153050 2023-11-29T11:15:06.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.307+0000 7f1cc0ff9700 1 -- 172.21.15.81:0/339848155 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1cbc024070 con 0x7f1cc4153050 2023-11-29T11:15:06.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.307+0000 7f1cc0ff9700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1cb0064ee0 0x7f1cb0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.307+0000 7f1cc0ff9700 1 -- 172.21.15.81:0/339848155 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1cbc0834e0 con 0x7f1cc4153050 2023-11-29T11:15:06.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.307+0000 7f1cc3fff700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1cb0064ee0 0x7f1cb0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.307+0000 7f1cc3fff700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1cb0064ee0 0x7f1cb0067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8000c00 tx=0x7f1cb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.311+0000 7f1cc0ff9700 1 -- 172.21.15.81:0/339848155 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1cbc051720 con 0x7f1cc4153050 2023-11-29T11:15:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.471+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cc4072500 con 0x7f1cc4153050 2023-11-29T11:15:06.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.471+0000 7f1cc0ff9700 1 -- 172.21.15.81:0/339848155 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1cbc017020 con 0x7f1cc4153050 2023-11-29T11:15:06.481 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:15:06.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1cb0064ee0 msgr2=0x7f1cb0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1cb0064ee0 0x7f1cb0067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8000c00 tx=0x7f1cb8009040 comp rx=0 tx=0).stop 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4153050 msgr2=0x7f1cc41534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4153050 0x7f1cc41534c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40ce3c0 tx=0x7f1cbc0047e0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 shutdown_connections 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1cb0064ee0 0x7f1cb0067390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc4153050 0x7f1cc41534c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cc415d380 0x7f1cc4152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 --2- 172.21.15.81:0/339848155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac005220 0x7f1cc4152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 >> 172.21.15.81:0/339848155 conn(0x7f1cc40cae70 msgr2=0x7f1cc41566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 shutdown_connections 2023-11-29T11:15:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.475+0000 7f1cc9374700 1 -- 172.21.15.81:0/339848155 wait complete. 2023-11-29T11:15:06.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-29T11:15:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.599+0000 7f74d9061700 1 Processor -- start 2023-11-29T11:15:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.599+0000 7f74d9061700 1 -- start start 2023-11-29T11:15:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.599+0000 7f74d9061700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f74d4159e70 0x7f74d406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.599+0000 7f74d9061700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74d40c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.599+0000 7f74d9061700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d406ace0 con 0x7f74d4069c40 2023-11-29T11:15:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.599+0000 7f74d9061700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d406a0d0 con 0x7f74d4159e70 2023-11-29T11:15:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.599+0000 7f74d9061700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d406a3b0 con 0x7f74d40cb470 2023-11-29T11:15:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74cbfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f74d4069c40 0x7f74d40cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42432/0 (socket says 172.21.15.81:42432) 2023-11-29T11:15:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74cbfff700 1 -- 172.21.15.81:0/3622851323 learned_addr learned my addr 172.21.15.81:0/3622851323 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 --2- 172.21.15.81:0/3622851323 >> v2:172.21.15.176:3300/0 conn(0x7f74d4159e70 0x7f74d406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d8860700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74d40c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018598256 0 0) 0x7f74d406ace0 con 0x7f74d4069c40 2023-11-29T11:15:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c00035d0 con 0x7f74d4069c40 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2673336341 0 0) 0x7f74c00035d0 con 0x7f74d4069c40 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 msgr2=0x7f74d40c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74d40c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 >> v2:172.21.15.176:3300/0 conn(0x7f74d4159e70 msgr2=0x7f74d406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 --2- 172.21.15.81:0/3622851323 >> v2:172.21.15.176:3300/0 conn(0x7f74d4159e70 0x7f74d406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d406a690 con 0x7f74d4069c40 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f74c4001670 con 0x7f74d4069c40 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 --2- 172.21.15.81:0/3622851323 >> v2:172.21.15.176:3300/0 conn(0x7f74d4159e70 0x7f74d406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 >> v1:172.21.15.81:6789/0 conn(0x7f74d4069c40 legacy=0x7f74d40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74c0003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c0003fa0 0x7f74c0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c0004db0 0x7f74c0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d406a0d0 con 0x7f74c0004db0 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d406a3b0 con 0x7f74c0003fa0 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c000ba60 con 0x7f74d40cb470 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74c0003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d8860700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c0004db0 0x7f74c0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74cbfff700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c0003fa0 0x7f74c0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 -- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c0003fa0 msgr2=0x7f74c0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74c0003fa0 0x7f74c0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 -- 172.21.15.81:0/3622851323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c0004db0 msgr2=0x7f74c0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c0004db0 0x7f74c0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 -- 172.21.15.81:0/3622851323 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c00035d0 con 0x7f74d40cb470 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d8860700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74c0004db0 0x7f74c0005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:06.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d3fff700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74c0003a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009d40 tx=0x7f74c00058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a833030ab950bf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc009e90 con 0x7f74d40cb470 2023-11-29T11:15:06.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc00e9a0 con 0x7f74d40cb470 2023-11-29T11:15:06.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d37fe700 1 -- 172.21.15.81:0/3622851323 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00ed10 con 0x7f74d40cb470 2023-11-29T11:15:06.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d9061700 1 -- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 msgr2=0x7f74c0003a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d9061700 1 --2- 172.21.15.81:0/3622851323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74c0003a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009d40 tx=0x7f74c00058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d8860700 1 -- 172.21.15.81:0/3622851323 reap_dead start 2023-11-29T11:15:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d9061700 1 -- 172.21.15.81:0/3622851323 shutdown_connections 2023-11-29T11:15:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d9061700 1 -- 172.21.15.81:0/3622851323 >> 172.21.15.81:0/3622851323 conn(0x7f74d40ce3e0 msgr2=0x7f74d40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d9061700 1 -- 172.21.15.81:0/3622851323 shutdown_connections 2023-11-29T11:15:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.603+0000 7f74d9061700 1 -- 172.21.15.81:0/3622851323 wait complete. 2023-11-29T11:15:06.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.607+0000 7f74d9061700 1 Processor -- start 2023-11-29T11:15:06.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.607+0000 7f74d9061700 1 -- start start 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74d415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74d4097570 0x7f74d4096cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74d40ae680 0x7f74d40aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d40af060 con 0x7f74d40ae680 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d415a760 con 0x7f74d4097570 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d41e43e0 con 0x7f74d40cb470 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d8860700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74d40ae680 0x7f74d40aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74d415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74d415cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:46434/0 (socket says 172.21.15.81:46434) 2023-11-29T11:15:06.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d3fff700 1 -- 172.21.15.81:0/1913150534 learned_addr learned my addr 172.21.15.81:0/1913150534 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:06.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74cbfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74d4097570 0x7f74d4096cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d8860700 1 -- 172.21.15.81:0/1913150534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 msgr2=0x7f74d415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d8860700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74d415cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d8860700 1 -- 172.21.15.81:0/1913150534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74d4097570 msgr2=0x7f74d4096cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d8860700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74d4097570 0x7f74d4096cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d8860700 1 -- 172.21.15.81:0/1913150534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d415a240 con 0x7f74d40ae680 2023-11-29T11:15:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d8860700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74d40ae680 0x7f74d40aeb20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f74d40ce2d0 tx=0x7f74cc00f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d17fa700 1 -- 172.21.15.81:0/1913150534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00e040 con 0x7f74d40ae680 2023-11-29T11:15:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d17fa700 1 -- 172.21.15.81:0/1913150534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc00f040 con 0x7f74d40ae680 2023-11-29T11:15:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d406a970 con 0x7f74d40ae680 2023-11-29T11:15:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d17fa700 1 -- 172.21.15.81:0/1913150534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00fbb0 con 0x7f74d40ae680 2023-11-29T11:15:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d406cee0 con 0x7f74d40ae680 2023-11-29T11:15:06.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.611+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d40c1f10 con 0x7f74d40ae680 2023-11-29T11:15:06.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.615+0000 7f74d17fa700 1 -- 172.21.15.81:0/1913150534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f74cc025070 con 0x7f74d40ae680 2023-11-29T11:15:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.615+0000 7f74d17fa700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.615+0000 7f74d17fa700 1 -- 172.21.15.81:0/1913150534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f74cc082200 con 0x7f74d40ae680 2023-11-29T11:15:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.615+0000 7f74d3fff700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.615+0000 7f74d3fff700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00a010 tx=0x7f74bc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.623+0000 7f74d17fa700 1 -- 172.21.15.81:0/1913150534 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f74d40c1f10 con 0x7f74d40ae680 2023-11-29T11:15:06.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f74d40c1ee0 con 0x7f74d40ae680 2023-11-29T11:15:06.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d17fa700 1 -- 172.21.15.81:0/1913150534 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+126 (secure 0 0 0) 0x7f74cc0504c0 con 0x7f74d40ae680 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:06.795 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:15:06.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 msgr2=0x7f74b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00a010 tx=0x7f74bc008030 comp rx=0 tx=0).stop 2023-11-29T11:15:06.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74d40ae680 msgr2=0x7f74d40aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74d40ae680 0x7f74d40aeb20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f74d40ce2d0 tx=0x7f74cc00f490 comp rx=0 tx=0).stop 2023-11-29T11:15:06.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 shutdown_connections 2023-11-29T11:15:06.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74b4064ee0 0x7f74b4067390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74d40ae680 0x7f74d40aeb20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74d4097570 0x7f74d4096cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 --2- 172.21.15.81:0/1913150534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74d40cb470 0x7f74d415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.787+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 >> 172.21.15.81:0/1913150534 conn(0x7f74d40ce3e0 msgr2=0x7f74d4070340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:06.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.791+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 shutdown_connections 2023-11-29T11:15:06.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.791+0000 7f74d9061700 1 -- 172.21.15.81:0/1913150534 wait complete. 2023-11-29T11:15:06.809 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-29T11:15:06.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-29T11:15:06.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2d96700 1 Processor -- start 2023-11-29T11:15:06.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2d96700 1 -- start start 2023-11-29T11:15:06.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2d96700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2d96700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f569c0cf0e0 0x7f569c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2d96700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c0cfa80 con 0x7f569c06a4c0 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2d96700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c0d0ab0 con 0x7f569c0cf0e0 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2d96700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c06a9c0 con 0x7f569c0b1ae0 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a1593700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f569c06a4c0 0x7f569c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42446/0 (socket says 172.21.15.81:42446) 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a1593700 1 -- 172.21.15.81:0/1846194259 learned_addr learned my addr 172.21.15.81:0/1846194259 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2595700 1 --2- 172.21.15.81:0/1846194259 >> v2:172.21.15.176:3300/0 conn(0x7f569c0cf0e0 0x7f569c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a1d94700 1 --2- 172.21.15.81:0/1846194259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a0d92700 1 -- 172.21.15.81:0/1846194259 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043701267 0 0) 0x7f569c0cfa80 con 0x7f569c06a4c0 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a0d92700 1 -- 172.21.15.81:0/1846194259 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56880035d0 con 0x7f569c06a4c0 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2595700 1 -- 172.21.15.81:0/1846194259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 msgr2=0x7f569c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2595700 1 --2- 172.21.15.81:0/1846194259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2595700 1 -- 172.21.15.81:0/1846194259 >> v1:172.21.15.81:6789/0 conn(0x7f569c06a4c0 legacy=0x7f569c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2595700 1 -- 172.21.15.81:0/1846194259 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c06aca0 con 0x7f569c0cf0e0 2023-11-29T11:15:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.919+0000 7f56a2595700 1 --2- 172.21.15.81:0/1846194259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 0x7f569c0cf540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5694009d90 tx=0x7f569400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95d8148462f8210c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a0d92700 1 -- 172.21.15.81:0/1846194259 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400e070 con 0x7f569c0cf0e0 2023-11-29T11:15:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a0d92700 1 -- 172.21.15.81:0/1846194259 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400bb20 con 0x7f569c0cf0e0 2023-11-29T11:15:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a0d92700 1 -- 172.21.15.81:0/1846194259 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694012430 con 0x7f569c0cf0e0 2023-11-29T11:15:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 -- 172.21.15.81:0/1846194259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 msgr2=0x7f569c0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 --2- 172.21.15.81:0/1846194259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 0x7f569c0cf540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5694009d90 tx=0x7f569400b330 comp rx=0 tx=0).stop 2023-11-29T11:15:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 -- 172.21.15.81:0/1846194259 shutdown_connections 2023-11-29T11:15:06.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 --2- 172.21.15.81:0/1846194259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 0x7f569c0cf540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 --2- 172.21.15.81:0/1846194259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 -- 172.21.15.81:0/1846194259 >> 172.21.15.81:0/1846194259 conn(0x7f569c09bbd0 msgr2=0x7f569c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:06.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 -- 172.21.15.81:0/1846194259 shutdown_connections 2023-11-29T11:15:06.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 -- 172.21.15.81:0/1846194259 wait complete. 2023-11-29T11:15:06.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 Processor -- start 2023-11-29T11:15:06.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 -- start start 2023-11-29T11:15:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c06a4c0 0x7f569c14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.923+0000 7f56a2d96700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a2d96700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 0x7f569c15e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a2d96700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c15b600 con 0x7f569c06a4c0 2023-11-29T11:15:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a2d96700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c14c240 con 0x7f569c0cf0e0 2023-11-29T11:15:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a2d96700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0c6ee0 con 0x7f569c0b1ae0 2023-11-29T11:15:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c06a4c0 0x7f569c14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c06a4c0 0x7f569c14bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44882/0 (socket says 172.21.15.81:44882) 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 -- 172.21.15.81:0/3424500010 learned_addr learned my addr 172.21.15.81:0/3424500010 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a2595700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 0x7f569c15e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1593700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 -- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 msgr2=0x7f569c14c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c14c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 -- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 msgr2=0x7f569c15e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 0x7f569c15e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 -- 172.21.15.81:0/3424500010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009a70 con 0x7f569c06a4c0 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1593700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c14c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:06.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a1d94700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c06a4c0 0x7f569c14bd00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f569800ea00 tx=0x7f569800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56927fc700 1 -- 172.21.15.81:0/3424500010 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698009720 con 0x7f569c06a4c0 2023-11-29T11:15:06.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56927fc700 1 -- 172.21.15.81:0/3424500010 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800c850 con 0x7f569c06a4c0 2023-11-29T11:15:06.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56927fc700 1 -- 172.21.15.81:0/3424500010 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800cbc0 con 0x7f569c06a4c0 2023-11-29T11:15:06.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c0b4380 con 0x7f569c06a4c0 2023-11-29T11:15:06.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c06af80 con 0x7f569c06a4c0 2023-11-29T11:15:06.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c0b1eb0 con 0x7f569c06a4c0 2023-11-29T11:15:06.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.927+0000 7f56927fc700 1 -- 172.21.15.81:0/3424500010 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5698019030 con 0x7f569c06a4c0 2023-11-29T11:15:06.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.931+0000 7f56927fc700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5680064f10 0x7f56800673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:06.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.931+0000 7f56927fc700 1 -- 172.21.15.81:0/3424500010 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5698081c20 con 0x7f569c06a4c0 2023-11-29T11:15:06.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.931+0000 7f56a1593700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5680064f10 0x7f56800673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:06.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.931+0000 7f56a1593700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5680064f10 0x7f56800673c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f569c0afc80 tx=0x7f568c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:06.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:06.935+0000 7f56927fc700 1 -- 172.21.15.81:0/3424500010 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f569804ff50 con 0x7f569c06a4c0 2023-11-29T11:15:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.099+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f569c072500 con 0x7f569c06a4c0 2023-11-29T11:15:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.167+0000 7f56927fc700 1 -- 172.21.15.81:0/3424500010 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5698053570 con 0x7f569c06a4c0 2023-11-29T11:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5680064f10 msgr2=0x7f56800673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5680064f10 0x7f56800673c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f569c0afc80 tx=0x7f568c009040 comp rx=0 tx=0).stop 2023-11-29T11:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c06a4c0 msgr2=0x7f569c14bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c06a4c0 0x7f569c14bd00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f569800ea00 tx=0x7f569800ed10 comp rx=0 tx=0).stop 2023-11-29T11:15:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 shutdown_connections 2023-11-29T11:15:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5680064f10 0x7f56800673c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f569c0cf0e0 0x7f569c15e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f569c0b1ae0 0x7f569c14c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 --2- 172.21.15.81:0/3424500010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c06a4c0 0x7f569c14bd00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.171+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 >> 172.21.15.81:0/3424500010 conn(0x7f569c09bbd0 msgr2=0x7f569c0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.175+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 shutdown_connections 2023-11-29T11:15:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.175+0000 7f56a2d96700 1 -- 172.21.15.81:0/3424500010 wait complete. 2023-11-29T11:15:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-11-29T11:15:07.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-29T11:15:07.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9bc866700 1 Processor -- start 2023-11-29T11:15:07.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9bc866700 1 -- start start 2023-11-29T11:15:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9bc866700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b80b1ae0 0x7fd9b806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9bc866700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd9b80cf0e0 0x7fd9b80cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9bc866700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b80cfa80 con 0x7fd9b806a4c0 2023-11-29T11:15:07.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9bc866700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b80d0ab0 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9bc866700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b806a9c0 con 0x7fd9b80b1ae0 2023-11-29T11:15:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9b759e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd9b80cf0e0 0x7fd9b80cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9b6d9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b80b1ae0 0x7fd9b806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9b759e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd9b80cf0e0 0x7fd9b80cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:60186/0 (socket says 172.21.15.81:60186) 2023-11-29T11:15:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.307+0000 7fd9b759e700 1 -- 172.21.15.81:0/1635762741 learned_addr learned my addr 172.21.15.81:0/1635762741 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9b759e700 1 -- 172.21.15.81:0/1635762741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b80b1ae0 msgr2=0x7fd9b806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9b759e700 1 --2- 172.21.15.81:0/1635762741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b80b1ae0 0x7fd9b806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9b759e700 1 -- 172.21.15.81:0/1635762741 >> v1:172.21.15.176:6789/0 conn(0x7fd9b806a4c0 legacy=0x7fd9b80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9b759e700 1 -- 172.21.15.81:0/1635762741 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b806aca0 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9b759e700 1 --2- 172.21.15.81:0/1635762741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 0x7fd9b80cf540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009e50 tx=0x7fd9b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381869a7351ffdc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9b5d9b700 1 -- 172.21.15.81:0/1635762741 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000e070 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9b5d9b700 1 -- 172.21.15.81:0/1635762741 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b000b910 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9b5d9b700 1 -- 172.21.15.81:0/1635762741 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000bcc0 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9bc866700 1 -- 172.21.15.81:0/1635762741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 msgr2=0x7fd9b80cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9bc866700 1 --2- 172.21.15.81:0/1635762741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 0x7fd9b80cf540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009e50 tx=0x7fd9b000b330 comp rx=0 tx=0).stop 2023-11-29T11:15:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9bc866700 1 -- 172.21.15.81:0/1635762741 shutdown_connections 2023-11-29T11:15:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9bc866700 1 --2- 172.21.15.81:0/1635762741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 0x7fd9b80cf540 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9bc866700 1 --2- 172.21.15.81:0/1635762741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b80b1ae0 0x7fd9b806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9bc866700 1 -- 172.21.15.81:0/1635762741 >> 172.21.15.81:0/1635762741 conn(0x7fd9b809bbd0 msgr2=0x7fd9b80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9bc866700 1 -- 172.21.15.81:0/1635762741 shutdown_connections 2023-11-29T11:15:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.311+0000 7fd9bc866700 1 -- 172.21.15.81:0/1635762741 wait complete. 2023-11-29T11:15:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 Processor -- start 2023-11-29T11:15:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 -- start start 2023-11-29T11:15:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b806a4c0 0x7fd9b81f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b80b1ae0 0x7fd9b814cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 0x7fd9b814d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b814d980 con 0x7fd9b80b1ae0 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b809dbc0 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b815f060 con 0x7fd9b806a4c0 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b80b1ae0 0x7fd9b814cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b80b1ae0 0x7fd9b814cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44886/0 (socket says 172.21.15.81:44886) 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b659c700 1 -- 172.21.15.81:0/2416061924 learned_addr learned my addr 172.21.15.81:0/2416061924 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b759e700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 0x7fd9b814d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b6d9d700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b806a4c0 0x7fd9b81f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b759e700 1 -- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b806a4c0 msgr2=0x7fd9b81f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b759e700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b806a4c0 0x7fd9b81f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b759e700 1 -- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b80b1ae0 msgr2=0x7fd9b814cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b759e700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b80b1ae0 0x7fd9b814cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b759e700 1 -- 172.21.15.81:0/2416061924 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0009b30 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b659c700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b80b1ae0 0x7fd9b814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9b759e700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 0x7fd9b814d000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0015000 tx=0x7fd9b0004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9af7fe700 1 -- 172.21.15.81:0/2416061924 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0004800 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9af7fe700 1 -- 172.21.15.81:0/2416061924 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b00092e0 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b80b4380 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.315+0000 7fd9af7fe700 1 -- 172.21.15.81:0/2416061924 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b001c660 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.319+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b806af80 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.319+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b80b1eb0 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.319+0000 7fd9af7fe700 1 -- 172.21.15.81:0/2416061924 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd9b0022030 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.319+0000 7fd9af7fe700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd998064ee0 0x7fd998067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:07.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.319+0000 7fd9b6d9d700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd998064ee0 0x7fd998067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:07.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.319+0000 7fd9af7fe700 1 -- 172.21.15.81:0/2416061924 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fd9b0083620 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.323+0000 7fd9b6d9d700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd998064ee0 0x7fd998067390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009bf0 tx=0x7fd9a0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:07.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.331+0000 7fd9af7fe700 1 -- 172.21.15.81:0/2416061924 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd9b0051770 con 0x7fd9b80cf0e0 2023-11-29T11:15:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:07.491+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd9b8072500 con 0x7fd9b80cf0e0 2023-11-29T11:15:08.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.183+0000 7fd9af7fe700 1 -- 172.21.15.81:0/2416061924 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd9b0054d90 con 0x7fd9b80cf0e0 2023-11-29T11:15:08.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd998064ee0 msgr2=0x7fd998067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd998064ee0 0x7fd998067390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009bf0 tx=0x7fd9a0009240 comp rx=0 tx=0).stop 2023-11-29T11:15:08.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 msgr2=0x7fd9b814d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 0x7fd9b814d000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0015000 tx=0x7fd9b0004af0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 shutdown_connections 2023-11-29T11:15:08.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd998064ee0 0x7fd998067390 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b80cf0e0 0x7fd9b814d000 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b80b1ae0 0x7fd9b814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 --2- 172.21.15.81:0/2416061924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b806a4c0 0x7fd9b81f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 >> 172.21.15.81:0/2416061924 conn(0x7fd9b809bbd0 msgr2=0x7fd9b815bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:08.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 shutdown_connections 2023-11-29T11:15:08.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.199+0000 7fd9bc866700 1 -- 172.21.15.81:0/2416061924 wait complete. 2023-11-29T11:15:08.208 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-11-29T11:15:08.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-29T11:15:08.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.323+0000 7f626ffff700 1 Processor -- start 2023-11-29T11:15:08.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.323+0000 7f626ffff700 1 -- start start 2023-11-29T11:15:08.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62700cc2f0 0x7f62700ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f62700b2d30 0x7f6270069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627009c0e0 con 0x7f627015a3e0 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700b13e0 con 0x7f62700cc2f0 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700b16c0 con 0x7f62700b2d30 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f62667fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f627015a3e0 0x7f62700cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42458/0 (socket says 172.21.15.81:42458) 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f62667fc700 1 -- 172.21.15.81:0/463078897 learned_addr learned my addr 172.21.15.81:0/463078897 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626effd700 1 --2- 172.21.15.81:0/463078897 >> v2:172.21.15.81:3300/0 conn(0x7f62700cc2f0 0x7f62700ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626f7fe700 1 --2- 172.21.15.81:0/463078897 >> v2:172.21.15.176:3300/0 conn(0x7f62700b2d30 0x7f6270069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626e7fc700 1 -- 172.21.15.81:0/463078897 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990272438 0 0) 0x7f627009c0e0 con 0x7f627015a3e0 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626e7fc700 1 -- 172.21.15.81:0/463078897 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f625c0035d0 con 0x7f627015a3e0 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626effd700 1 -- 172.21.15.81:0/463078897 >> v2:172.21.15.176:3300/0 conn(0x7f62700b2d30 msgr2=0x7f6270069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626effd700 1 --2- 172.21.15.81:0/463078897 >> v2:172.21.15.176:3300/0 conn(0x7f62700b2d30 0x7f6270069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626effd700 1 -- 172.21.15.81:0/463078897 >> v1:172.21.15.81:6789/0 conn(0x7f627015a3e0 legacy=0x7f62700cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626effd700 1 -- 172.21.15.81:0/463078897 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700b19a0 con 0x7f62700cc2f0 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626f7fe700 1 --2- 172.21.15.81:0/463078897 >> v2:172.21.15.176:3300/0 conn(0x7f62700b2d30 0x7f6270069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626effd700 1 --2- 172.21.15.81:0/463078897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f62700ac280 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f62700adde0 tx=0x7f6260009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91156c2fe6c3c1a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:08.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626e7fc700 1 -- 172.21.15.81:0/463078897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260011830 con 0x7f62700cc2f0 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626e7fc700 1 -- 172.21.15.81:0/463078897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260011990 con 0x7f62700cc2f0 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626e7fc700 1 -- 172.21.15.81:0/463078897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260011d20 con 0x7f62700cc2f0 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 -- 172.21.15.81:0/463078897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 msgr2=0x7f62700ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 --2- 172.21.15.81:0/463078897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f62700ac280 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f62700adde0 tx=0x7f6260009b30 comp rx=0 tx=0).stop 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 -- 172.21.15.81:0/463078897 shutdown_connections 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 --2- 172.21.15.81:0/463078897 >> v2:172.21.15.176:3300/0 conn(0x7f62700b2d30 0x7f6270069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 --2- 172.21.15.81:0/463078897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f62700ac280 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 -- 172.21.15.81:0/463078897 >> 172.21.15.81:0/463078897 conn(0x7f62700cae70 msgr2=0x7f62700cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 -- 172.21.15.81:0/463078897 shutdown_connections 2023-11-29T11:15:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.327+0000 7f626ffff700 1 -- 172.21.15.81:0/463078897 wait complete. 2023-11-29T11:15:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626ffff700 1 Processor -- start 2023-11-29T11:15:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626ffff700 1 -- start start 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62700b2d30 0x7f6270153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f627015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f627015a3e0 0x7f6270155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701537a0 con 0x7f62700cc2f0 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701597d0 con 0x7f62700b2d30 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627015acf0 con 0x7f627015a3e0 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f627015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f627015a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44890/0 (socket says 172.21.15.81:44890) 2023-11-29T11:15:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 -- 172.21.15.81:0/3560946574 learned_addr learned my addr 172.21.15.81:0/3560946574 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626effd700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62700b2d30 0x7f6270153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f626f7fe700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f627015a3e0 0x7f6270155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 -- 172.21.15.81:0/3560946574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f627015a3e0 msgr2=0x7f6270155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f627015a3e0 0x7f6270155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 -- 172.21.15.81:0/3560946574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62700b2d30 msgr2=0x7f6270153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62700b2d30 0x7f6270153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 -- 172.21.15.81:0/3560946574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600094b0 con 0x7f62700cc2f0 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.331+0000 7f62667fc700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f627015a7b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6258005930 tx=0x7f625800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.335+0000 7f626cff9700 1 -- 172.21.15.81:0/3560946574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258005d90 con 0x7f62700cc2f0 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.335+0000 7f626cff9700 1 -- 172.21.15.81:0/3560946574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580070d0 con 0x7f62700cc2f0 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.335+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627006a180 con 0x7f62700cc2f0 2023-11-29T11:15:08.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.335+0000 7f626cff9700 1 -- 172.21.15.81:0/3560946574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258007480 con 0x7f62700cc2f0 2023-11-29T11:15:08.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.335+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62700b1c80 con 0x7f62700cc2f0 2023-11-29T11:15:08.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.335+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627006a310 con 0x7f62700cc2f0 2023-11-29T11:15:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.335+0000 7f626cff9700 1 -- 172.21.15.81:0/3560946574 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6258019030 con 0x7f62700cc2f0 2023-11-29T11:15:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.339+0000 7f626cff9700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6250064f10 0x7f62500673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.339+0000 7f626cff9700 1 -- 172.21.15.81:0/3560946574 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f6258081280 con 0x7f62700cc2f0 2023-11-29T11:15:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.339+0000 7f626effd700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6250064f10 0x7f62500673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.339+0000 7f626effd700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6250064f10 0x7f62500673c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f62600090b0 tx=0x7f6260008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:08.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.343+0000 7f626cff9700 1 -- 172.21.15.81:0/3560946574 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f625804f250 con 0x7f62700cc2f0 2023-11-29T11:15:08.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.539+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6270072500 con 0x7f62700cc2f0 2023-11-29T11:15:08.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.551+0000 7f626cff9700 1 -- 172.21.15.81:0/3560946574 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6258052870 con 0x7f62700cc2f0 2023-11-29T11:15:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6250064f10 msgr2=0x7f62500673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6250064f10 0x7f62500673c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f62600090b0 tx=0x7f6260008030 comp rx=0 tx=0).stop 2023-11-29T11:15:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 msgr2=0x7f627015a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f627015a7b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6258005930 tx=0x7f625800c7b0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 shutdown_connections 2023-11-29T11:15:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6250064f10 0x7f62500673c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f627015a3e0 0x7f6270155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62700cc2f0 0x7f627015a7b0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 --2- 172.21.15.81:0/3560946574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62700b2d30 0x7f6270153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.563+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 >> 172.21.15.81:0/3560946574 conn(0x7f62700cae70 msgr2=0x7f62700ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.567+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 shutdown_connections 2023-11-29T11:15:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.567+0000 7f626ffff700 1 -- 172.21.15.81:0/3560946574 wait complete. 2023-11-29T11:15:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 8 and data pool 9 2023-11-29T11:15:08.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:15:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.683+0000 7f2a73fff700 1 Processor -- start 2023-11-29T11:15:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.683+0000 7f2a73fff700 1 -- start start 2023-11-29T11:15:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 0x7f2a7406a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a740b4c10 0x7f2a740cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7406dc40 con 0x7f2a740cf050 2023-11-29T11:15:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7406aa70 con 0x7f2a740b4c10 2023-11-29T11:15:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7415c6d0 con 0x7f2a7406d7d0 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a737fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a740b4c10 0x7f2a740cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a737fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a740b4c10 0x7f2a740cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44906/0 (socket says 172.21.15.81:44906) 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a737fe700 1 -- 172.21.15.81:0/2994588572 learned_addr learned my addr 172.21.15.81:0/2994588572 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a727fc700 1 --2- 172.21.15.81:0/2994588572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 0x7f2a7406a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a737fe700 1 -- 172.21.15.81:0/2994588572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 msgr2=0x7f2a7406a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a737fe700 1 --2- 172.21.15.81:0/2994588572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 0x7f2a7406a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a737fe700 1 -- 172.21.15.81:0/2994588572 >> v1:172.21.15.176:6789/0 conn(0x7f2a740cf050 legacy=0x7f2a740cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a737fe700 1 -- 172.21.15.81:0/2994588572 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7406ac60 con 0x7f2a740b4c10 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a737fe700 1 --2- 172.21.15.81:0/2994588572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a740cce20 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009910 tx=0x7f2a6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3d84522e7f3977 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a71ffb700 1 -- 172.21.15.81:0/2994588572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c00ba60 con 0x7f2a740b4c10 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a71ffb700 1 -- 172.21.15.81:0/2994588572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c00bbc0 con 0x7f2a740b4c10 2023-11-29T11:15:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a71ffb700 1 -- 172.21.15.81:0/2994588572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c009e60 con 0x7f2a740b4c10 2023-11-29T11:15:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 -- 172.21.15.81:0/2994588572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 msgr2=0x7f2a740cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 --2- 172.21.15.81:0/2994588572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a740cce20 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009910 tx=0x7f2a6c009c20 comp rx=0 tx=0).stop 2023-11-29T11:15:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 -- 172.21.15.81:0/2994588572 shutdown_connections 2023-11-29T11:15:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 --2- 172.21.15.81:0/2994588572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a740cce20 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 --2- 172.21.15.81:0/2994588572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 0x7f2a7406a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 -- 172.21.15.81:0/2994588572 >> 172.21.15.81:0/2994588572 conn(0x7f2a7409bb30 msgr2=0x7f2a740b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 -- 172.21.15.81:0/2994588572 shutdown_connections 2023-11-29T11:15:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.687+0000 7f2a73fff700 1 -- 172.21.15.81:0/2994588572 wait complete. 2023-11-29T11:15:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 Processor -- start 2023-11-29T11:15:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 -- start start 2023-11-29T11:15:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 0x7f2a7409f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a74150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a740cf050 0x7f2a740b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a741f2610 con 0x7f2a740b4c10 2023-11-29T11:15:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7409f7c0 con 0x7f2a740cf050 2023-11-29T11:15:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a741f1990 con 0x7f2a7406d7d0 2023-11-29T11:15:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a74150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a74150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44914/0 (socket says 172.21.15.81:44914) 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 -- 172.21.15.81:0/973979673 learned_addr learned my addr 172.21.15.81:0/973979673 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a72ffd700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 0x7f2a7409f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a737fe700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a740cf050 0x7f2a740b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 -- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 msgr2=0x7f2a7409f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 0x7f2a7409f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 -- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a740cf050 msgr2=0x7f2a740b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a740cf050 0x7f2a740b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 -- 172.21.15.81:0/973979673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c009570 con 0x7f2a740b4c10 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a737fe700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a740cf050 0x7f2a740b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a727fc700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a74150c70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00e810 tx=0x7f2a5c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a6b7fe700 1 -- 172.21.15.81:0/973979673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c013610 con 0x7f2a740b4c10 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a6b7fe700 1 -- 172.21.15.81:0/973979673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c013770 con 0x7f2a740b4c10 2023-11-29T11:15:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a740b4410 con 0x7f2a740b4c10 2023-11-29T11:15:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a6b7fe700 1 -- 172.21.15.81:0/973979673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c013b20 con 0x7f2a740b4c10 2023-11-29T11:15:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.691+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7406af40 con 0x7f2a740b4c10 2023-11-29T11:15:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.695+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a740b46f0 con 0x7f2a740b4c10 2023-11-29T11:15:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.695+0000 7f2a6b7fe700 1 -- 172.21.15.81:0/973979673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2a5c023070 con 0x7f2a740b4c10 2023-11-29T11:15:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.695+0000 7f2a6b7fe700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a54064ee0 0x7f2a54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.695+0000 7f2a72ffd700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a54064ee0 0x7f2a54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.695+0000 7f2a6b7fe700 1 -- 172.21.15.81:0/973979673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2a5c0821a0 con 0x7f2a740b4c10 2023-11-29T11:15:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.699+0000 7f2a72ffd700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a54064ee0 0x7f2a54067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2a640012e0 tx=0x7f2a64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.703+0000 7f2a6b7fe700 1 -- 172.21.15.81:0/973979673 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2a5c050200 con 0x7f2a740b4c10 2023-11-29T11:15:08.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.863+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a74072500 con 0x7f2a740b4c10 2023-11-29T11:15:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a6b7fe700 1 -- 172.21.15.81:0/973979673 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18039 (secure 0 0 0) 0x7f2a5c053820 con 0x7f2a740b4c10 2023-11-29T11:15:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:08.875 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:15:08.544769+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:15:07.147241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-29T11:15:07.541685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:15:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a54064ee0 msgr2=0x7f2a54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a54064ee0 0x7f2a54067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2a640012e0 tx=0x7f2a64009040 comp rx=0 tx=0).stop 2023-11-29T11:15:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 msgr2=0x7f2a74150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a74150c70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00e810 tx=0x7f2a5c00ebd0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 shutdown_connections 2023-11-29T11:15:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a54064ee0 0x7f2a54067390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a740cf050 0x7f2a740b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a740b4c10 0x7f2a74150c70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 --2- 172.21.15.81:0/973979673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a7406d7d0 0x7f2a7409f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 >> 172.21.15.81:0/973979673 conn(0x7f2a7409bb30 msgr2=0x7f2a740cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 shutdown_connections 2023-11-29T11:15:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.867+0000 7f2a73fff700 1 -- 172.21.15.81:0/973979673 wait complete. 2023-11-29T11:15:08.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:15:09.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9958ce9700 1 Processor -- start 2023-11-29T11:15:09.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9958ce9700 1 -- start start 2023-11-29T11:15:09.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9958ce9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9958ce9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f995406a530 0x7f99540cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9958ce9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995415c6d0 con 0x7f99540b4c10 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9958ce9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995406a9a0 con 0x7f995406a530 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9958ce9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540cf960 con 0x7f99540cf050 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9953fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f99540b4c10 0x7f99540cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42472/0 (socket says 172.21.15.81:42472) 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9953fff700 1 -- 172.21.15.81:0/567664240 learned_addr learned my addr 172.21.15.81:0/567664240 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f9952ffd700 1 --2- 172.21.15.81:0/567664240 >> v2:172.21.15.176:3300/0 conn(0x7f995406a530 0x7f99540cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:08.999+0000 7f99537fe700 1 --2- 172.21.15.81:0/567664240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f99527fc700 1 -- 172.21.15.81:0/567664240 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071944578 0 0) 0x7f995415c6d0 con 0x7f99540b4c10 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f99527fc700 1 -- 172.21.15.81:0/567664240 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f993c0035d0 con 0x7f99540b4c10 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9952ffd700 1 -- 172.21.15.81:0/567664240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 msgr2=0x7f995406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9952ffd700 1 --2- 172.21.15.81:0/567664240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995406d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9952ffd700 1 -- 172.21.15.81:0/567664240 >> v1:172.21.15.81:6789/0 conn(0x7f99540b4c10 legacy=0x7f99540cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9952ffd700 1 -- 172.21.15.81:0/567664240 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995406ac60 con 0x7f995406a530 2023-11-29T11:15:09.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9952ffd700 1 --2- 172.21.15.81:0/567664240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f995406a530 0x7f99540cf420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9944009850 tx=0x7f9944009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b31080433486569 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f99527fc700 1 -- 172.21.15.81:0/567664240 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944011830 con 0x7f995406a530 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f99527fc700 1 -- 172.21.15.81:0/567664240 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944011990 con 0x7f995406a530 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f99527fc700 1 -- 172.21.15.81:0/567664240 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944011d40 con 0x7f995406a530 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 -- 172.21.15.81:0/567664240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f995406a530 msgr2=0x7f99540cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 --2- 172.21.15.81:0/567664240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f995406a530 0x7f99540cf420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9944009850 tx=0x7f9944009b60 comp rx=0 tx=0).stop 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 -- 172.21.15.81:0/567664240 shutdown_connections 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 --2- 172.21.15.81:0/567664240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f995406a530 0x7f99540cf420 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 --2- 172.21.15.81:0/567664240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995406d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 -- 172.21.15.81:0/567664240 >> 172.21.15.81:0/567664240 conn(0x7f995409bb30 msgr2=0x7f99540b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 -- 172.21.15.81:0/567664240 shutdown_connections 2023-11-29T11:15:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 -- 172.21.15.81:0/567664240 wait complete. 2023-11-29T11:15:09.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 Processor -- start 2023-11-29T11:15:09.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.003+0000 7f9958ce9700 1 -- start start 2023-11-29T11:15:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f995406a530 0x7f995415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99540b4c10 0x7f995414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995415f1e0 con 0x7f995406a530 2023-11-29T11:15:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995415f4c0 con 0x7f99540b4c10 2023-11-29T11:15:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995415f7a0 con 0x7f99540cf050 2023-11-29T11:15:09.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f99537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f995406a530 0x7f995415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9952ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99540b4c10 0x7f995414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f99537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f995406a530 0x7f995415c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44928/0 (socket says 172.21.15.81:44928) 2023-11-29T11:15:09.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f99537fe700 1 -- 172.21.15.81:0/2546426110 learned_addr learned my addr 172.21.15.81:0/2546426110 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:09.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9953fff700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9953fff700 1 -- 172.21.15.81:0/2546426110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99540b4c10 msgr2=0x7f995414d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9953fff700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99540b4c10 0x7f995414d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9953fff700 1 -- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f995406a530 msgr2=0x7f995415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9953fff700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f995406a530 0x7f995415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9953fff700 1 -- 172.21.15.81:0/2546426110 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440094b0 con 0x7f99540cf050 2023-11-29T11:15:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f99537fe700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f995406a530 0x7f995415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9953fff700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995415e2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f994c00ca80 tx=0x7f994c00cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f993bfff700 1 -- 172.21.15.81:0/2546426110 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c007480 con 0x7f99540cf050 2023-11-29T11:15:09.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f993bfff700 1 -- 172.21.15.81:0/2546426110 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c0075e0 con 0x7f99540cf050 2023-11-29T11:15:09.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540b4410 con 0x7f99540cf050 2023-11-29T11:15:09.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f993bfff700 1 -- 172.21.15.81:0/2546426110 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c007950 con 0x7f99540cf050 2023-11-29T11:15:09.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995406af40 con 0x7f99540cf050 2023-11-29T11:15:09.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.007+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99540b46f0 con 0x7f99540cf050 2023-11-29T11:15:09.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.011+0000 7f993bfff700 1 -- 172.21.15.81:0/2546426110 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f994c019030 con 0x7f99540cf050 2023-11-29T11:15:09.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.011+0000 7f993bfff700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9940064f10 0x7f99400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.011+0000 7f993bfff700 1 -- 172.21.15.81:0/2546426110 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f994c081b90 con 0x7f99540cf050 2023-11-29T11:15:09.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.011+0000 7f99537fe700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9940064f10 0x7f99400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.011+0000 7f99537fe700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9940064f10 0x7f99400673c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99480112c0 tx=0x7f9948009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:09.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.019+0000 7f993bfff700 1 -- 172.21.15.81:0/2546426110 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f994c04fc30 con 0x7f99540cf050 2023-11-29T11:15:09.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.187+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9954072500 con 0x7f99540cf050 2023-11-29T11:15:09.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.195+0000 7f993bfff700 1 -- 172.21.15.81:0/2546426110 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18039 (secure 0 0 0) 0x7f994c053250 con 0x7f99540cf050 2023-11-29T11:15:09.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:09.204 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:15:08.544769+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:15:07.147241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-29T11:15:07.541685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9940064f10 msgr2=0x7f99400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9940064f10 0x7f99400673c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99480112c0 tx=0x7f9948009240 comp rx=0 tx=0).stop 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 msgr2=0x7f995415e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995415e2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f994c00ca80 tx=0x7f994c00cab0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 shutdown_connections 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9940064f10 0x7f99400673c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99540cf050 0x7f995415e2d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99540b4c10 0x7f995414d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 --2- 172.21.15.81:0/2546426110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f995406a530 0x7f995415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 >> 172.21.15.81:0/2546426110 conn(0x7f995409bb30 msgr2=0x7f995415bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 shutdown_connections 2023-11-29T11:15:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.199+0000 7f9958ce9700 1 -- 172.21.15.81:0/2546426110 wait complete. 2023-11-29T11:15:09.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-29T11:15:09.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caff30700 1 Processor -- start 2023-11-29T11:15:09.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caff30700 1 -- start start 2023-11-29T11:15:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caff30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ca80b1890 0x7f0ca80b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caff30700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80ced70 con 0x7f0ca80b45a0 2023-11-29T11:15:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caff30700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80b2190 con 0x7f0ca806ae20 2023-11-29T11:15:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caff30700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80d1100 con 0x7f0ca80b1890 2023-11-29T11:15:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0cae4cd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ca80b1890 0x7f0ca80b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0cae4cd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ca80b1890 0x7f0ca80b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44936/0 (socket says 172.21.15.81:44936) 2023-11-29T11:15:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0cae4cd700 1 -- 172.21.15.81:0/178380235 learned_addr learned my addr 172.21.15.81:0/178380235 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0cadccc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0ca80b45a0 0x7f0ca80b4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42474/0 (socket says 172.21.15.81:42474) 2023-11-29T11:15:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0cae4cd700 1 -- 172.21.15.81:0/178380235 >> v1:172.21.15.176:6789/0 conn(0x7f0ca806ae20 legacy=0x7f0ca80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0cae4cd700 1 -- 172.21.15.81:0/178380235 >> v1:172.21.15.81:6789/0 conn(0x7f0ca80b45a0 legacy=0x7f0ca80b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0cae4cd700 1 -- 172.21.15.81:0/178380235 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80cefa0 con 0x7f0ca80b1890 2023-11-29T11:15:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0cae4cd700 1 --2- 172.21.15.81:0/178380235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca80b5970 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009e50 tx=0x7f0ca000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2802fcd11c1a8f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caccca700 1 -- 172.21.15.81:0/178380235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000e070 con 0x7f0ca80b1890 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caccca700 1 -- 172.21.15.81:0/178380235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000b9c0 con 0x7f0ca80b1890 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.339+0000 7f0caccca700 1 -- 172.21.15.81:0/178380235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000bd70 con 0x7f0ca80b1890 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 -- 172.21.15.81:0/178380235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 msgr2=0x7f0ca80b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 --2- 172.21.15.81:0/178380235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca80b5970 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009e50 tx=0x7f0ca000b330 comp rx=0 tx=0).stop 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 -- 172.21.15.81:0/178380235 shutdown_connections 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 --2- 172.21.15.81:0/178380235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca80b5970 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 -- 172.21.15.81:0/178380235 >> 172.21.15.81:0/178380235 conn(0x7f0ca80cf5a0 msgr2=0x7f0ca80cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 -- 172.21.15.81:0/178380235 shutdown_connections 2023-11-29T11:15:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 -- 172.21.15.81:0/178380235 wait complete. 2023-11-29T11:15:09.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 Processor -- start 2023-11-29T11:15:09.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.343+0000 7f0caff30700 1 -- start start 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0caff30700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ca806ae20 0x7f0ca81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0caff30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0caff30700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ca80b45a0 0x7f0ca80c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0caff30700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8157d90 con 0x7f0ca80b1890 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0caff30700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80c9740 con 0x7f0ca80b45a0 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0caff30700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca814fe50 con 0x7f0ca806ae20 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca814f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44950/0 (socket says 172.21.15.81:44950) 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 -- 172.21.15.81:0/873529377 learned_addr learned my addr 172.21.15.81:0/873529377 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cae4cd700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ca80b45a0 0x7f0ca80c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cadccc700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ca806ae20 0x7f0ca81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 -- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ca806ae20 msgr2=0x7f0ca81581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ca806ae20 0x7f0ca81581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 -- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ca80b45a0 msgr2=0x7f0ca80c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ca80b45a0 0x7f0ca80c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 -- 172.21.15.81:0/873529377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009b30 con 0x7f0ca80b1890 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cadccc700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ca806ae20 0x7f0ca81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0cad4cb700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca814f910 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c430 tx=0x7f0c9800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0c9e7fc700 1 -- 172.21.15.81:0/873529377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980052d0 con 0x7f0ca80b1890 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0c9e7fc700 1 -- 172.21.15.81:0/873529377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98005450 con 0x7f0ca80b1890 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca80d13a0 con 0x7f0ca80b1890 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0c9e7fc700 1 -- 172.21.15.81:0/873529377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98003930 con 0x7f0ca80b1890 2023-11-29T11:15:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca80cf280 con 0x7f0ca80b1890 2023-11-29T11:15:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.347+0000 7f0c9e7fc700 1 -- 172.21.15.81:0/873529377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0c98019030 con 0x7f0ca80b1890 2023-11-29T11:15:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.351+0000 7f0c9e7fc700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c8c064f10 0x7f0c8c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.351+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca80cd880 con 0x7f0ca80b1890 2023-11-29T11:15:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.351+0000 7f0c9e7fc700 1 -- 172.21.15.81:0/873529377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0c980811c0 con 0x7f0ca80b1890 2023-11-29T11:15:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.351+0000 7f0cadccc700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c8c064f10 0x7f0c8c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.351+0000 7f0cadccc700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c8c064f10 0x7f0c8c0673c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4000f60 tx=0x7f0ca4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:09.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.355+0000 7f0c9e7fc700 1 -- 172.21.15.81:0/873529377 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0c9804f220 con 0x7f0ca80b1890 2023-11-29T11:15:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:09.555+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0ca81f1ff0 con 0x7f0ca80b1890 2023-11-29T11:15:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.563+0000 7f0c9e7fc700 1 -- 172.21.15.81:0/873529377 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0c98017020 con 0x7f0ca80b1890 2023-11-29T11:15:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c8c064f10 msgr2=0x7f0c8c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c8c064f10 0x7f0c8c0673c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4000f60 tx=0x7f0ca4009040 comp rx=0 tx=0).stop 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 msgr2=0x7f0ca814f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca814f910 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c430 tx=0x7f0c9800c740 comp rx=0 tx=0).stop 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 shutdown_connections 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c8c064f10 0x7f0c8c0673c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ca80b45a0 0x7f0ca80c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1890 0x7f0ca814f910 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 --2- 172.21.15.81:0/873529377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ca806ae20 0x7f0ca81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 >> 172.21.15.81:0/873529377 conn(0x7f0ca80cf5a0 msgr2=0x7f0ca8156230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 shutdown_connections 2023-11-29T11:15:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.567+0000 7f0caff30700 1 -- 172.21.15.81:0/873529377 wait complete. 2023-11-29T11:15:10.592 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-29T11:15:10.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-29T11:15:10.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f7030d8a700 1 Processor -- start 2023-11-29T11:15:10.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f7030d8a700 1 -- start start 2023-11-29T11:15:10.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f7030d8a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f702c0cfdd0 0x7f702c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:10.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f7030d8a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f702c0b2570 0x7f702c0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:10.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f7030d8a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c0cac70 con 0x7f702c0cc590 2023-11-29T11:15:10.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f7030d8a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c06c8e0 con 0x7f702c0cfdd0 2023-11-29T11:15:10.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f7030d8a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c0b29f0 con 0x7f702c0b2570 2023-11-29T11:15:10.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f702affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f702c0cfdd0 0x7f702c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:10.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f702affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f702c0cfdd0 0x7f702c0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42330/0 (socket says 172.21.15.81:42330) 2023-11-29T11:15:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f702affd700 1 -- 172.21.15.81:0/1083502826 learned_addr learned my addr 172.21.15.81:0/1083502826 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.715+0000 7f702bfff700 1 --2- 172.21.15.81:0/1083502826 >> v2:172.21.15.176:3300/0 conn(0x7f702c0b2570 0x7f702c0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f702affd700 1 -- 172.21.15.81:0/1083502826 >> v2:172.21.15.176:3300/0 conn(0x7f702c0b2570 msgr2=0x7f702c0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f702affd700 1 --2- 172.21.15.81:0/1083502826 >> v2:172.21.15.176:3300/0 conn(0x7f702c0b2570 0x7f702c0cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f702affd700 1 -- 172.21.15.81:0/1083502826 >> v1:172.21.15.176:6789/0 conn(0x7f702c0cc590 legacy=0x7f702c0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f702affd700 1 -- 172.21.15.81:0/1083502826 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0d0340 con 0x7f702c0cfdd0 2023-11-29T11:15:10.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f702affd700 1 --2- 172.21.15.81:0/1083502826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c0b2030 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f701c009910 tx=0x7f701c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dcbd8a94ce658c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f702a7fc700 1 -- 172.21.15.81:0/1083502826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c004230 con 0x7f702c0cfdd0 2023-11-29T11:15:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f702a7fc700 1 -- 172.21.15.81:0/1083502826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c004390 con 0x7f702c0cfdd0 2023-11-29T11:15:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f702a7fc700 1 -- 172.21.15.81:0/1083502826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c009e60 con 0x7f702c0cfdd0 2023-11-29T11:15:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f7030d8a700 1 -- 172.21.15.81:0/1083502826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 msgr2=0x7f702c0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f7030d8a700 1 --2- 172.21.15.81:0/1083502826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c0b2030 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f701c009910 tx=0x7f701c009c20 comp rx=0 tx=0).stop 2023-11-29T11:15:10.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f7030d8a700 1 -- 172.21.15.81:0/1083502826 shutdown_connections 2023-11-29T11:15:10.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f7030d8a700 1 --2- 172.21.15.81:0/1083502826 >> v2:172.21.15.176:3300/0 conn(0x7f702c0b2570 0x7f702c0cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f7030d8a700 1 --2- 172.21.15.81:0/1083502826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c0b2030 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f7030d8a700 1 -- 172.21.15.81:0/1083502826 >> 172.21.15.81:0/1083502826 conn(0x7f702c0cd0a0 msgr2=0x7f702c0cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:10.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f7030d8a700 1 -- 172.21.15.81:0/1083502826 shutdown_connections 2023-11-29T11:15:10.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.719+0000 7f7030d8a700 1 -- 172.21.15.81:0/1083502826 wait complete. 2023-11-29T11:15:10.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 Processor -- start 2023-11-29T11:15:10.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 -- start start 2023-11-29T11:15:10.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f702c0b2570 0x7f702c15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702c15e710 0x7f702c0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c15d780 con 0x7f702c0cfdd0 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c15dd40 con 0x7f702c15e710 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0b5f30 con 0x7f702c0b2570 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c15e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42346/0 (socket says 172.21.15.81:42346) 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 -- 172.21.15.81:0/822283960 learned_addr learned my addr 172.21.15.81:0/822283960 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702b7fe700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f702c0b2570 0x7f702c15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702bfff700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702c15e710 0x7f702c0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 -- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f702c0b2570 msgr2=0x7f702c15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f702c0b2570 0x7f702c15aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 -- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702c15e710 msgr2=0x7f702c0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702c15e710 0x7f702c0b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:10.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 -- 172.21.15.81:0/822283960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c009570 con 0x7f702c0cfdd0 2023-11-29T11:15:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702bfff700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702c15e710 0x7f702c0b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f702affd700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c15e1d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f701c004000 tx=0x7f701c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7013fff700 1 -- 172.21.15.81:0/822283960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c00bcc0 con 0x7f702c0cfdd0 2023-11-29T11:15:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7013fff700 1 -- 172.21.15.81:0/822283960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c01f070 con 0x7f702c0cfdd0 2023-11-29T11:15:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7013fff700 1 -- 172.21.15.81:0/822283960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c0036c0 con 0x7f702c0cfdd0 2023-11-29T11:15:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c06d4b0 con 0x7f702c0cfdd0 2023-11-29T11:15:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.723+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c06d1d0 con 0x7f702c0cfdd0 2023-11-29T11:15:10.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.727+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c0ce520 con 0x7f702c0cfdd0 2023-11-29T11:15:10.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.727+0000 7f7013fff700 1 -- 172.21.15.81:0/822283960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f701c02a020 con 0x7f702c0cfdd0 2023-11-29T11:15:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.727+0000 7f7013fff700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7018064f10 0x7f70180673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.727+0000 7f702b7fe700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7018064f10 0x7f70180673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:10.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.727+0000 7f7013fff700 1 -- 172.21.15.81:0/822283960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f701c083930 con 0x7f702c0cfdd0 2023-11-29T11:15:10.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.727+0000 7f702b7fe700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7018064f10 0x7f70180673c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f702c15c2a0 tx=0x7f70200090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:10.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.739+0000 7f7013fff700 1 -- 172.21.15.81:0/822283960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f701c0518a0 con 0x7f702c0cfdd0 2023-11-29T11:15:10.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-29T11:15:10.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-29T11:15:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:10.931+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f702c0ce520 con 0x7f702c0cfdd0 2023-11-29T11:15:11.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.563+0000 7f7013fff700 1 -- 172.21.15.81:0/822283960 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f701c054ec0 con 0x7f702c0cfdd0 2023-11-29T11:15:11.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.567+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7018064f10 msgr2=0x7f70180673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:11.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.567+0000 7f7030d8a700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7018064f10 0x7f70180673c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f702c15c2a0 tx=0x7f70200090e0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.567+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 msgr2=0x7f702c15e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:11.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.567+0000 7f7030d8a700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c15e1d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f701c004000 tx=0x7f701c004770 comp rx=0 tx=0).stop 2023-11-29T11:15:11.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.567+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 shutdown_connections 2023-11-29T11:15:11.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.567+0000 7f7030d8a700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7018064f10 0x7f70180673c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.567+0000 7f7030d8a700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f702c15e710 0x7f702c0b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.571+0000 7f7030d8a700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702c0cfdd0 0x7f702c15e1d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.571+0000 7f7030d8a700 1 --2- 172.21.15.81:0/822283960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f702c0b2570 0x7f702c15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.571+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 >> 172.21.15.81:0/822283960 conn(0x7f702c0cd0a0 msgr2=0x7f702c0cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:11.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.571+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 shutdown_connections 2023-11-29T11:15:11.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.571+0000 7f7030d8a700 1 -- 172.21.15.81:0/822283960 wait complete. 2023-11-29T11:15:11.594 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-29T11:15:11.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.699+0000 7f8a3ea74700 1 Processor -- start 2023-11-29T11:15:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.699+0000 7f8a3ea74700 1 -- start start 2023-11-29T11:15:11.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8a380cc360 0x7f8a380cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:11.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a381607b0 0x7f8a380ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:11.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a380cc730 con 0x7f8a380cd000 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a380d04c0 con 0x7f8a381607b0 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3815d460 con 0x7f8a380cc360 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3d271700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a381607b0 0x7f8a380ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3e273700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8a380cd000 0x7f8a380cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42556/0 (socket says 172.21.15.81:42556) 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3e273700 1 -- 172.21.15.81:0/186160279 learned_addr learned my addr 172.21.15.81:0/186160279 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3da72700 1 --2- 172.21.15.81:0/186160279 >> v2:172.21.15.176:3300/0 conn(0x7f8a380cc360 0x7f8a380cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3d271700 1 -- 172.21.15.81:0/186160279 >> v2:172.21.15.176:3300/0 conn(0x7f8a380cc360 msgr2=0x7f8a380cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3d271700 1 --2- 172.21.15.81:0/186160279 >> v2:172.21.15.176:3300/0 conn(0x7f8a380cc360 0x7f8a380cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3d271700 1 -- 172.21.15.81:0/186160279 >> v1:172.21.15.81:6789/0 conn(0x7f8a380cd000 legacy=0x7f8a380cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3d271700 1 -- 172.21.15.81:0/186160279 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380b1f30 con 0x7f8a381607b0 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ca70700 1 -- 172.21.15.81:0/186160279 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622548280 0 0) 0x7f8a380cc730 con 0x7f8a380cd000 2023-11-29T11:15:11.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3d271700 1 --2- 172.21.15.81:0/186160279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380ce200 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8a380b3220 tx=0x7f8a34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec9e27af5412c42 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:11.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ca70700 1 -- 172.21.15.81:0/186160279 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34005e50 con 0x7f8a381607b0 2023-11-29T11:15:11.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ca70700 1 -- 172.21.15.81:0/186160279 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a34006030 con 0x7f8a381607b0 2023-11-29T11:15:11.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ca70700 1 -- 172.21.15.81:0/186160279 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a340063c0 con 0x7f8a381607b0 2023-11-29T11:15:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 -- 172.21.15.81:0/186160279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 msgr2=0x7f8a380ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/186160279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380ce200 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8a380b3220 tx=0x7f8a34009b50 comp rx=0 tx=0).stop 2023-11-29T11:15:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 -- 172.21.15.81:0/186160279 shutdown_connections 2023-11-29T11:15:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/186160279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380ce200 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/186160279 >> v2:172.21.15.176:3300/0 conn(0x7f8a380cc360 0x7f8a380cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 -- 172.21.15.81:0/186160279 >> 172.21.15.81:0/186160279 conn(0x7f8a380b2140 msgr2=0x7f8a380b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 -- 172.21.15.81:0/186160279 shutdown_connections 2023-11-29T11:15:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.703+0000 7f8a3ea74700 1 -- 172.21.15.81:0/186160279 wait complete. 2023-11-29T11:15:11.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3ea74700 1 Processor -- start 2023-11-29T11:15:11.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3ea74700 1 -- start start 2023-11-29T11:15:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3ea74700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a380cc360 0x7f8a380b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3ea74700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a380cd000 0x7f8a380c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3ea74700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3ea74700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380b09f0 con 0x7f8a381607b0 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3ea74700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380b3460 con 0x7f8a380cc360 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3ea74700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380b3a20 con 0x7f8a380cd000 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42358/0 (socket says 172.21.15.81:42358) 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 -- 172.21.15.81:0/214678226 learned_addr learned my addr 172.21.15.81:0/214678226 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3da72700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a380cc360 0x7f8a380b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3d271700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a380cd000 0x7f8a380c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 -- 172.21.15.81:0/214678226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a380cd000 msgr2=0x7f8a380c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a380cd000 0x7f8a380c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 -- 172.21.15.81:0/214678226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a380cc360 msgr2=0x7f8a380b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a380cc360 0x7f8a380b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 -- 172.21.15.81:0/214678226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a34009450 con 0x7f8a381607b0 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.707+0000 7f8a3e273700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380c6850 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8a30002230 tx=0x7f8a3000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.711+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/214678226 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000aac0 con 0x7f8a381607b0 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.711+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/214678226 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000ac40 con 0x7f8a381607b0 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.711+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a380d01e0 con 0x7f8a381607b0 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.711+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/214678226 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300070d0 con 0x7f8a381607b0 2023-11-29T11:15:11.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.711+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a380ce740 con 0x7f8a381607b0 2023-11-29T11:15:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.711+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3815fcd0 con 0x7f8a381607b0 2023-11-29T11:15:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.711+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/214678226 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8a3001a030 con 0x7f8a381607b0 2023-11-29T11:15:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.715+0000 7f8a2a7fc700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a1c064ee0 0x7f8a1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.715+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/214678226 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8a30081c30 con 0x7f8a381607b0 2023-11-29T11:15:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.715+0000 7f8a3da72700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a1c064ee0 0x7f8a1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.715+0000 7f8a3da72700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a1c064ee0 0x7f8a1c067390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c006b40 tx=0x7f8a2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.719+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/214678226 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8a3004fc90 con 0x7f8a381607b0 2023-11-29T11:15:11.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.919+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a380b3b90 con 0x7f8a381607b0 2023-11-29T11:15:11.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.919+0000 7f8a2a7fc700 1 -- 172.21.15.81:0/214678226 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f8a30018090 con 0x7f8a381607b0 2023-11-29T11:15:11.929 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:11.930 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:15:08.545106+0000","modified":"2023-11-29T11:15:11.563216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/63586216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":63586216},{"type":"v1","addr":"172.21.15.81:6837","nonce":63586216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-29T11:15:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a1c064ee0 msgr2=0x7f8a1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a1c064ee0 0x7f8a1c067390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c006b40 tx=0x7f8a2c008040 comp rx=0 tx=0).stop 2023-11-29T11:15:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 msgr2=0x7f8a380c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380c6850 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8a30002230 tx=0x7f8a3000cf50 comp rx=0 tx=0).stop 2023-11-29T11:15:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 shutdown_connections 2023-11-29T11:15:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a1c064ee0 0x7f8a1c067390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a381607b0 0x7f8a380c6850 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a380cd000 0x7f8a380c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 --2- 172.21.15.81:0/214678226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a380cc360 0x7f8a380b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 >> 172.21.15.81:0/214678226 conn(0x7f8a380b2140 msgr2=0x7f8a3806ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 shutdown_connections 2023-11-29T11:15:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:11.923+0000 7f8a3ea74700 1 -- 172.21.15.81:0/214678226 wait complete. 2023-11-29T11:15:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-11-29T11:15:11.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:15:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce62a9700 1 Processor -- start 2023-11-29T11:15:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce62a9700 1 -- start start 2023-11-29T11:15:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce62a9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ce006bb40 0x7f5ce015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce62a9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce0071940 con 0x7f5ce006b660 2023-11-29T11:15:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce62a9700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce006a8a0 con 0x7f5ce00706b0 2023-11-29T11:15:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce62a9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce015d7d0 con 0x7f5ce006bb40 2023-11-29T11:15:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce5aa8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ce006bb40 0x7f5ce015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce52a7700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f5ce00706b0 0x7f5ce0070a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:54988/0 (socket says 172.21.15.81:54988) 2023-11-29T11:15:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce52a7700 1 -- 172.21.15.81:0/3285083298 learned_addr learned my addr 172.21.15.81:0/3285083298 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce4aa6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ce006b660 0x7f5ce00cc970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42566/0 (socket says 172.21.15.81:42566) 2023-11-29T11:15:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce5aa8700 1 -- 172.21.15.81:0/3285083298 >> v1:172.21.15.176:6789/0 conn(0x7f5ce00706b0 legacy=0x7f5ce0070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce5aa8700 1 -- 172.21.15.81:0/3285083298 >> v1:172.21.15.81:6789/0 conn(0x7f5ce006b660 legacy=0x7f5ce00cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce5aa8700 1 -- 172.21.15.81:0/3285083298 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce006ab80 con 0x7f5ce006bb40 2023-11-29T11:15:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5ce5aa8700 1 --2- 172.21.15.81:0/3285083298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006bb40 0x7f5ce015d290 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009d90 tx=0x7f5cd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ceb59e80b0a76d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5cd7fff700 1 -- 172.21.15.81:0/3285083298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800e070 con 0x7f5ce006bb40 2023-11-29T11:15:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5cd7fff700 1 -- 172.21.15.81:0/3285083298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd800bbd0 con 0x7f5ce006bb40 2023-11-29T11:15:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.055+0000 7f5cd7fff700 1 -- 172.21.15.81:0/3285083298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8012430 con 0x7f5ce006bb40 2023-11-29T11:15:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3285083298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006bb40 msgr2=0x7f5ce015d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 --2- 172.21.15.81:0/3285083298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006bb40 0x7f5ce015d290 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009d90 tx=0x7f5cd800b330 comp rx=0 tx=0).stop 2023-11-29T11:15:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3285083298 shutdown_connections 2023-11-29T11:15:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 --2- 172.21.15.81:0/3285083298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006bb40 0x7f5ce015d290 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3285083298 >> 172.21.15.81:0/3285083298 conn(0x7f5ce00b1720 msgr2=0x7f5ce00ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3285083298 shutdown_connections 2023-11-29T11:15:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3285083298 wait complete. 2023-11-29T11:15:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 Processor -- start 2023-11-29T11:15:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.059+0000 7f5ce62a9700 1 -- start start 2023-11-29T11:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006b660 0x7f5ce015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ce006bb40 0x7f5ce01f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ce00706b0 0x7f5ce0140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce01f5e80 con 0x7f5ce006b660 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce01f1960 con 0x7f5ce00706b0 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce015bdd0 con 0x7f5ce006bb40 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006b660 0x7f5ce015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006b660 0x7f5ce015c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42376/0 (socket says 172.21.15.81:42376) 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 -- 172.21.15.81:0/3818161030 learned_addr learned my addr 172.21.15.81:0/3818161030 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce5aa8700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ce00706b0 0x7f5ce0140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce4aa6700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ce006bb40 0x7f5ce01f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 -- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ce006bb40 msgr2=0x7f5ce01f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ce006bb40 0x7f5ce01f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 -- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ce00706b0 msgr2=0x7f5ce0140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ce00706b0 0x7f5ce0140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 -- 172.21.15.81:0/3818161030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009a70 con 0x7f5ce006b660 2023-11-29T11:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce5aa8700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ce00706b0 0x7f5ce0140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce52a7700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006b660 0x7f5ce015c2b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c700 tx=0x7f5cdc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5cd5ffb700 1 -- 172.21.15.81:0/3818161030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc005d90 con 0x7f5ce006b660 2023-11-29T11:15:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5cd5ffb700 1 -- 172.21.15.81:0/3818161030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0070d0 con 0x7f5ce006b660 2023-11-29T11:15:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce006b140 con 0x7f5ce006b660 2023-11-29T11:15:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5cd5ffb700 1 -- 172.21.15.81:0/3818161030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc007440 con 0x7f5ce006b660 2023-11-29T11:15:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce006ae60 con 0x7f5ce006b660 2023-11-29T11:15:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.063+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce006a4e0 con 0x7f5ce006b660 2023-11-29T11:15:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.067+0000 7f5cd5ffb700 1 -- 172.21.15.81:0/3818161030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5cdc019030 con 0x7f5ce006b660 2023-11-29T11:15:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.067+0000 7f5cd5ffb700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5cc4064ee0 0x7f5cc4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.067+0000 7f5cd5ffb700 1 -- 172.21.15.81:0/3818161030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5cdc081460 con 0x7f5ce006b660 2023-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.067+0000 7f5ce4aa6700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5cc4064ee0 0x7f5cc4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.067+0000 7f5ce4aa6700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5cc4064ee0 0x7f5cc4067390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5ce015b550 tx=0x7f5cd0007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.071+0000 7f5cd5ffb700 1 -- 172.21.15.81:0/3818161030 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5cdc04f400 con 0x7f5ce006b660 2023-11-29T11:15:12.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.235+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ce00008d0 con 0x7f5ce006b660 2023-11-29T11:15:12.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5cd5ffb700 1 -- 172.21.15.81:0/3818161030 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18026 (secure 0 0 0) 0x7f5cdc052a20 con 0x7f5ce006b660 2023-11-29T11:15:12.246 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:12.246 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:15:09.548834+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:15:07.147241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-29T11:15:07.541685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:15:12.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5cc4064ee0 msgr2=0x7f5cc4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5cc4064ee0 0x7f5cc4067390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5ce015b550 tx=0x7f5cd0007d30 comp rx=0 tx=0).stop 2023-11-29T11:15:12.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006b660 msgr2=0x7f5ce015c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006b660 0x7f5ce015c2b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c700 tx=0x7f5cdc00cac0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 shutdown_connections 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5cc4064ee0 0x7f5cc4067390 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ce00706b0 0x7f5ce0140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ce006bb40 0x7f5ce01f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 --2- 172.21.15.81:0/3818161030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce006b660 0x7f5ce015c2b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 >> 172.21.15.81:0/3818161030 conn(0x7f5ce00b1720 msgr2=0x7f5ce015c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 shutdown_connections 2023-11-29T11:15:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.239+0000 7f5ce62a9700 1 -- 172.21.15.81:0/3818161030 wait complete. 2023-11-29T11:15:12.261 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-29T11:15:12.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:15:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36e214700 1 Processor -- start 2023-11-29T11:15:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36e214700 1 -- start start 2023-11-29T11:15:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36e214700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3681606b0 0x7fe3680c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36e214700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe3680ceef0 0x7fe3680c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36e214700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680cae70 con 0x7fe3680ad610 2023-11-29T11:15:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36e214700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3680cbc10 con 0x7fe3680ceef0 2023-11-29T11:15:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36e214700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680cb130 con 0x7fe3681606b0 2023-11-29T11:15:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe3680ad610 0x7fe368164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42572/0 (socket says 172.21.15.81:42572) 2023-11-29T11:15:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 -- 172.21.15.81:0/1143115390 learned_addr learned my addr 172.21.15.81:0/1143115390 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36ca11700 1 --2- 172.21.15.81:0/1143115390 >> v2:172.21.15.176:3300/0 conn(0x7fe3680ceef0 0x7fe3680c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36d212700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3681606b0 0x7fe3680c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367404881 0 0) 0x7fe3680cae70 con 0x7fe3680ad610 2023-11-29T11:15:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3540035d0 con 0x7fe3680ad610 2023-11-29T11:15:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4199559017 0 0) 0x7fe3540035d0 con 0x7fe3680ad610 2023-11-29T11:15:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3681606b0 msgr2=0x7fe3680c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3681606b0 0x7fe3680c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 >> v2:172.21.15.176:3300/0 conn(0x7fe3680ceef0 msgr2=0x7fe3680c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 --2- 172.21.15.81:0/1143115390 >> v2:172.21.15.176:3300/0 conn(0x7fe3680ceef0 0x7fe3680c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680cb410 con 0x7fe3680ad610 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fe360001670 con 0x7fe3680ad610 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 >> v1:172.21.15.81:6789/0 conn(0x7fe3680ad610 legacy=0x7fe368164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe354003a20 0x7fe354003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3681606b0 0x7fe354004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe354004db0 0x7fe354005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680cbc10 con 0x7fe354004db0 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680cb130 con 0x7fe354003a20 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35400ba30 con 0x7fe3681606b0 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe354004db0 0x7fe354005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36d212700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe354003a20 0x7fe354003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36ca11700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3681606b0 0x7fe354004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 -- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3681606b0 msgr2=0x7fe354004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3681606b0 0x7fe354004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 -- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe354003a20 msgr2=0x7fe354003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe354003a20 0x7fe354003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 -- 172.21.15.81:0/1143115390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540035d0 con 0x7fe354004db0 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe36da13700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe354004db0 0x7fe354005220 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe36000c2f0 tx=0x7fe3540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791a8d1c97e42434 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360007c80 con 0x7fe354004db0 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36000ce90 con 0x7fe354004db0 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.367+0000 7fe35ffff700 1 -- 172.21.15.81:0/1143115390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360005bc0 con 0x7fe354004db0 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- 172.21.15.81:0/1143115390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe354004db0 msgr2=0x7fe354005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 --2- 172.21.15.81:0/1143115390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe354004db0 0x7fe354005220 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe36000c2f0 tx=0x7fe3540058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36da13700 1 -- 172.21.15.81:0/1143115390 reap_dead start 2023-11-29T11:15:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- 172.21.15.81:0/1143115390 shutdown_connections 2023-11-29T11:15:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- 172.21.15.81:0/1143115390 >> 172.21.15.81:0/1143115390 conn(0x7fe3680ce3e0 msgr2=0x7fe3680ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- 172.21.15.81:0/1143115390 shutdown_connections 2023-11-29T11:15:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- 172.21.15.81:0/1143115390 wait complete. 2023-11-29T11:15:12.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 Processor -- start 2023-11-29T11:15:12.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- start start 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3680cc050 0x7fe36815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3680cc420 0x7fe36815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe36815b0d0 0x7fe36815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680b5240 con 0x7fe3680cc420 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36815ccf0 con 0x7fe36815b0d0 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36e214700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36815cf70 con 0x7fe3680cc050 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36ca11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3680cc420 0x7fe36815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36ca11700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3680cc420 0x7fe36815c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42382/0 (socket says 172.21.15.81:42382) 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36ca11700 1 -- 172.21.15.81:0/2968092660 learned_addr learned my addr 172.21.15.81:0/2968092660 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36d212700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3680cc050 0x7fe36815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.371+0000 7fe36da13700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe36815b0d0 0x7fe36815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36ca11700 1 -- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3680cc050 msgr2=0x7fe36815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36ca11700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3680cc050 0x7fe36815ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36ca11700 1 -- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe36815b0d0 msgr2=0x7fe36815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36ca11700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe36815b0d0 0x7fe36815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36ca11700 1 -- 172.21.15.81:0/2968092660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36806ac50 con 0x7fe3680cc420 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36d212700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3680cc050 0x7fe36815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36ca11700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3680cc420 0x7fe36815c7b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe364007f60 tx=0x7fe364007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe35dffb700 1 -- 172.21.15.81:0/2968092660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400e030 con 0x7fe3680cc420 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe35dffb700 1 -- 172.21.15.81:0/2968092660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364011e30 con 0x7fe3680cc420 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe35dffb700 1 -- 172.21.15.81:0/2968092660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640166b0 con 0x7fe3680cc420 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3680cb6f0 con 0x7fe3680cc420 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3680b36c0 con 0x7fe3680cc420 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe368072500 con 0x7fe3680cc420 2023-11-29T11:15:12.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe35dffb700 1 -- 172.21.15.81:0/2968092660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe364016810 con 0x7fe3680cc420 2023-11-29T11:15:12.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe35dffb700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe34c064ee0 0x7fe34c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe35dffb700 1 -- 172.21.15.81:0/2968092660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe36400f070 con 0x7fe3680cc420 2023-11-29T11:15:12.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.375+0000 7fe36d212700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe34c064ee0 0x7fe34c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.379+0000 7fe36d212700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe34c064ee0 0x7fe34c067390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe358009c70 tx=0x7fe358008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.387+0000 7fe35dffb700 1 -- 172.21.15.81:0/2968092660 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe364086030 con 0x7fe3680cc420 2023-11-29T11:15:12.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.539+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe36815ba80 con 0x7fe34c064ee0 2023-11-29T11:15:12.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.555+0000 7fe35dffb700 1 -- 172.21.15.81:0/2968092660 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310276 (secure 0 0 0) 0x7fe36815ba80 con 0x7fe34c064ee0 2023-11-29T11:15:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe34c064ee0 msgr2=0x7fe34c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe34c064ee0 0x7fe34c067390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe358009c70 tx=0x7fe358008040 comp rx=0 tx=0).stop 2023-11-29T11:15:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3680cc420 msgr2=0x7fe36815c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3680cc420 0x7fe36815c7b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe364007f60 tx=0x7fe364007f90 comp rx=0 tx=0).stop 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 shutdown_connections 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe34c064ee0 0x7fe34c067390 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe36815b0d0 0x7fe36815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3680cc420 0x7fe36815c7b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 --2- 172.21.15.81:0/2968092660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3680cc050 0x7fe36815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 >> 172.21.15.81:0/2968092660 conn(0x7fe3680ce3e0 msgr2=0x7fe3680ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 shutdown_connections 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.567+0000 7fe36e214700 1 -- 172.21.15.81:0/2968092660 wait complete. 2023-11-29T11:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:15:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-11-29T11:15:12.471426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76096,"kb_used_data":6272,"kb_used_omap":0,"kb_used_meta":69760,"kb_avail":754898624,"statfs":{"total":773094113280,"available":773016190976,"internally_reserved":0,"allocated":6422528,"data_stored":3580379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71434240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.301646"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288831+0000","last_change":"2023-11-29T11:15:08.578841+0000","last_active":"2023-11-29T11:15:10.288831+0000","last_peered":"2023-11-29T11:15:10.288831+0000","last_clean":"2023-11-29T11:15:10.288831+0000","last_became_active":"2023-11-29T11:15:08.578583+0000","last_became_peered":"2023-11-29T11:15:08.578583+0000","last_unstale":"2023-11-29T11:15:10.288831+0000","last_undegraded":"2023-11-29T11:15:10.288831+0000","last_fullsized":"2023-11-29T11:15:10.288831+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:18:38.310642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287792+0000","last_change":"2023-11-29T11:15:08.584740+0000","last_active":"2023-11-29T11:15:10.287792+0000","last_peered":"2023-11-29T11:15:10.287792+0000","last_clean":"2023-11-29T11:15:10.287792+0000","last_became_active":"2023-11-29T11:15:08.583974+0000","last_became_peered":"2023-11-29T11:15:08.583974+0000","last_unstale":"2023-11-29T11:15:10.287792+0000","last_undegraded":"2023-11-29T11:15:10.287792+0000","last_fullsized":"2023-11-29T11:15:10.287792+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:10:42.029997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568484+0000","last_change":"2023-11-29T11:15:08.580380+0000","last_active":"2023-11-29T11:15:09.568484+0000","last_peered":"2023-11-29T11:15:09.568484+0000","last_clean":"2023-11-29T11:15:09.568484+0000","last_became_active":"2023-11-29T11:15:08.579169+0000","last_became_peered":"2023-11-29T11:15:08.579169+0000","last_unstale":"2023-11-29T11:15:09.568484+0000","last_undegraded":"2023-11-29T11:15:09.568484+0000","last_fullsized":"2023-11-29T11:15:09.568484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:12:14.883693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569606+0000","last_change":"2023-11-29T11:15:08.569669+0000","last_active":"2023-11-29T11:15:09.569606+0000","last_peered":"2023-11-29T11:15:09.569606+0000","last_clean":"2023-11-29T11:15:09.569606+0000","last_became_active":"2023-11-29T11:15:08.569368+0000","last_became_peered":"2023-11-29T11:15:08.569368+0000","last_unstale":"2023-11-29T11:15:09.569606+0000","last_undegraded":"2023-11-29T11:15:09.569606+0000","last_fullsized":"2023-11-29T11:15:09.569606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:39:37.945277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288504+0000","last_change":"2023-11-29T11:15:08.572961+0000","last_active":"2023-11-29T11:15:10.288504+0000","last_peered":"2023-11-29T11:15:10.288504+0000","last_clean":"2023-11-29T11:15:10.288504+0000","last_became_active":"2023-11-29T11:15:08.572679+0000","last_became_peered":"2023-11-29T11:15:08.572679+0000","last_unstale":"2023-11-29T11:15:10.288504+0000","last_undegraded":"2023-11-29T11:15:10.288504+0000","last_fullsized":"2023-11-29T11:15:10.288504+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:36:58.685175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890540+0000","last_change":"2023-11-29T11:15:08.569286+0000","last_active":"2023-11-29T11:15:09.890540+0000","last_peered":"2023-11-29T11:15:09.890540+0000","last_clean":"2023-11-29T11:15:09.890540+0000","last_became_active":"2023-11-29T11:15:08.569031+0000","last_became_peered":"2023-11-29T11:15:08.569031+0000","last_unstale":"2023-11-29T11:15:09.890540+0000","last_undegraded":"2023-11-29T11:15:09.890540+0000","last_fullsized":"2023-11-29T11:15:09.890540+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:23:25.843218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.285846+0000","last_change":"2023-11-29T11:15:08.578149+0000","last_active":"2023-11-29T11:15:10.285846+0000","last_peered":"2023-11-29T11:15:10.285846+0000","last_clean":"2023-11-29T11:15:10.285846+0000","last_became_active":"2023-11-29T11:15:08.577828+0000","last_became_peered":"2023-11-29T11:15:08.577828+0000","last_unstale":"2023-11-29T11:15:10.285846+0000","last_undegraded":"2023-11-29T11:15:10.285846+0000","last_fullsized":"2023-11-29T11:15:10.285846+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:10:42.029997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286510+0000","last_change":"2023-11-29T11:15:08.581019+0000","last_active":"2023-11-29T11:15:10.286510+0000","last_peered":"2023-11-29T11:15:10.286510+0000","last_clean":"2023-11-29T11:15:10.286510+0000","last_became_active":"2023-11-29T11:15:08.580760+0000","last_became_peered":"2023-11-29T11:15:08.580760+0000","last_unstale":"2023-11-29T11:15:10.286510+0000","last_undegraded":"2023-11-29T11:15:10.286510+0000","last_fullsized":"2023-11-29T11:15:10.286510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:23:25.843218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286541+0000","last_change":"2023-11-29T11:15:08.578404+0000","last_active":"2023-11-29T11:15:10.286541+0000","last_peered":"2023-11-29T11:15:10.286541+0000","last_clean":"2023-11-29T11:15:10.286541+0000","last_became_active":"2023-11-29T11:15:08.578067+0000","last_became_peered":"2023-11-29T11:15:08.578067+0000","last_unstale":"2023-11-29T11:15:10.286541+0000","last_undegraded":"2023-11-29T11:15:10.286541+0000","last_fullsized":"2023-11-29T11:15:10.286541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:35:04.785257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564634+0000","last_change":"2023-11-29T11:15:08.569215+0000","last_active":"2023-11-29T11:15:09.564634+0000","last_peered":"2023-11-29T11:15:09.564634+0000","last_clean":"2023-11-29T11:15:09.564634+0000","last_became_active":"2023-11-29T11:15:08.568960+0000","last_became_peered":"2023-11-29T11:15:08.568960+0000","last_unstale":"2023-11-29T11:15:09.564634+0000","last_undegraded":"2023-11-29T11:15:09.564634+0000","last_fullsized":"2023-11-29T11:15:09.564634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:20:06.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564547+0000","last_change":"2023-11-29T11:15:08.580136+0000","last_active":"2023-11-29T11:15:09.564547+0000","last_peered":"2023-11-29T11:15:09.564547+0000","last_clean":"2023-11-29T11:15:09.564547+0000","last_became_active":"2023-11-29T11:15:08.577966+0000","last_became_peered":"2023-11-29T11:15:08.577966+0000","last_unstale":"2023-11-29T11:15:09.564547+0000","last_undegraded":"2023-11-29T11:15:09.564547+0000","last_fullsized":"2023-11-29T11:15:09.564547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:48:01.079643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569603+0000","last_change":"2023-11-29T11:15:08.569798+0000","last_active":"2023-11-29T11:15:09.569603+0000","last_peered":"2023-11-29T11:15:09.569603+0000","last_clean":"2023-11-29T11:15:09.569603+0000","last_became_active":"2023-11-29T11:15:08.569494+0000","last_became_peered":"2023-11-29T11:15:08.569494+0000","last_unstale":"2023-11-29T11:15:09.569603+0000","last_undegraded":"2023-11-29T11:15:09.569603+0000","last_fullsized":"2023-11-29T11:15:09.569603+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:30:01.683255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287643+0000","last_change":"2023-11-29T11:15:08.572758+0000","last_active":"2023-11-29T11:15:10.287643+0000","last_peered":"2023-11-29T11:15:10.287643+0000","last_clean":"2023-11-29T11:15:10.287643+0000","last_became_active":"2023-11-29T11:15:08.572291+0000","last_became_peered":"2023-11-29T11:15:08.572291+0000","last_unstale":"2023-11-29T11:15:10.287643+0000","last_undegraded":"2023-11-29T11:15:10.287643+0000","last_fullsized":"2023-11-29T11:15:10.287643+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:14:20.079125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286367+0000","last_change":"2023-11-29T11:15:08.578309+0000","last_active":"2023-11-29T11:15:10.286367+0000","last_peered":"2023-11-29T11:15:10.286367+0000","last_clean":"2023-11-29T11:15:10.286367+0000","last_became_active":"2023-11-29T11:15:08.577885+0000","last_became_peered":"2023-11-29T11:15:08.577885+0000","last_unstale":"2023-11-29T11:15:10.286367+0000","last_undegraded":"2023-11-29T11:15:10.286367+0000","last_fullsized":"2023-11-29T11:15:10.286367+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:23:25.843218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286403+0000","last_change":"2023-11-29T11:15:08.588428+0000","last_active":"2023-11-29T11:15:10.286403+0000","last_peered":"2023-11-29T11:15:10.286403+0000","last_clean":"2023-11-29T11:15:10.286403+0000","last_became_active":"2023-11-29T11:15:08.588114+0000","last_became_peered":"2023-11-29T11:15:08.588114+0000","last_unstale":"2023-11-29T11:15:10.286403+0000","last_undegraded":"2023-11-29T11:15:10.286403+0000","last_fullsized":"2023-11-29T11:15:10.286403+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:27.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890182+0000","last_change":"2023-11-29T11:15:08.572512+0000","last_active":"2023-11-29T11:15:09.890182+0000","last_peered":"2023-11-29T11:15:09.890182+0000","last_clean":"2023-11-29T11:15:09.890182+0000","last_became_active":"2023-11-29T11:15:08.572255+0000","last_became_peered":"2023-11-29T11:15:08.572255+0000","last_unstale":"2023-11-29T11:15:09.890182+0000","last_undegraded":"2023-11-29T11:15:09.890182+0000","last_fullsized":"2023-11-29T11:15:09.890182+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:27.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287715+0000","last_change":"2023-11-29T11:15:08.577753+0000","last_active":"2023-11-29T11:15:10.287715+0000","last_peered":"2023-11-29T11:15:10.287715+0000","last_clean":"2023-11-29T11:15:10.287715+0000","last_became_active":"2023-11-29T11:15:08.577520+0000","last_became_peered":"2023-11-29T11:15:08.577520+0000","last_unstale":"2023-11-29T11:15:10.287715+0000","last_undegraded":"2023-11-29T11:15:10.287715+0000","last_fullsized":"2023-11-29T11:15:10.287715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:27.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568897+0000","last_change":"2023-11-29T11:15:08.578152+0000","last_active":"2023-11-29T11:15:09.568897+0000","last_peered":"2023-11-29T11:15:09.568897+0000","last_clean":"2023-11-29T11:15:09.568897+0000","last_became_active":"2023-11-29T11:15:08.577900+0000","last_became_peered":"2023-11-29T11:15:08.577900+0000","last_unstale":"2023-11-29T11:15:09.568897+0000","last_undegraded":"2023-11-29T11:15:09.568897+0000","last_fullsized":"2023-11-29T11:15:09.568897+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:05:19.825175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288575+0000","last_change":"2023-11-29T11:15:08.582131+0000","last_active":"2023-11-29T11:15:10.288575+0000","last_peered":"2023-11-29T11:15:10.288575+0000","last_clean":"2023-11-29T11:15:10.288575+0000","last_became_active":"2023-11-29T11:15:08.581857+0000","last_became_peered":"2023-11-29T11:15:08.581857+0000","last_unstale":"2023-11-29T11:15:10.288575+0000","last_undegraded":"2023-11-29T11:15:10.288575+0000","last_fullsized":"2023-11-29T11:15:10.288575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:59:19.787296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287367+0000","last_change":"2023-11-29T11:15:08.581568+0000","last_active":"2023-11-29T11:15:10.287367+0000","last_peered":"2023-11-29T11:15:10.287367+0000","last_clean":"2023-11-29T11:15:10.287367+0000","last_became_active":"2023-11-29T11:15:08.581318+0000","last_became_peered":"2023-11-29T11:15:08.581318+0000","last_unstale":"2023-11-29T11:15:10.287367+0000","last_undegraded":"2023-11-29T11:15:10.287367+0000","last_fullsized":"2023-11-29T11:15:10.287367+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:15.130261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567992+0000","last_change":"2023-11-29T11:15:08.572140+0000","last_active":"2023-11-29T11:15:09.567992+0000","last_peered":"2023-11-29T11:15:09.567992+0000","last_clean":"2023-11-29T11:15:09.567992+0000","last_became_active":"2023-11-29T11:15:08.571843+0000","last_became_peered":"2023-11-29T11:15:08.571843+0000","last_unstale":"2023-11-29T11:15:09.567992+0000","last_undegraded":"2023-11-29T11:15:09.567992+0000","last_fullsized":"2023-11-29T11:15:09.567992+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:37.737844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286664+0000","last_change":"2023-11-29T11:15:08.585408+0000","last_active":"2023-11-29T11:15:10.286664+0000","last_peered":"2023-11-29T11:15:10.286664+0000","last_clean":"2023-11-29T11:15:10.286664+0000","last_became_active":"2023-11-29T11:15:08.585053+0000","last_became_peered":"2023-11-29T11:15:08.585053+0000","last_unstale":"2023-11-29T11:15:10.286664+0000","last_undegraded":"2023-11-29T11:15:10.286664+0000","last_fullsized":"2023-11-29T11:15:10.286664+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:54:15.014685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567685+0000","last_change":"2023-11-29T11:15:08.582904+0000","last_active":"2023-11-29T11:15:09.567685+0000","last_peered":"2023-11-29T11:15:09.567685+0000","last_clean":"2023-11-29T11:15:09.567685+0000","last_became_active":"2023-11-29T11:15:08.581420+0000","last_became_peered":"2023-11-29T11:15:08.581420+0000","last_unstale":"2023-11-29T11:15:09.567685+0000","last_undegraded":"2023-11-29T11:15:09.567685+0000","last_fullsized":"2023-11-29T11:15:09.567685+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:38:48.839284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286882+0000","last_change":"2023-11-29T11:15:08.573862+0000","last_active":"2023-11-29T11:15:10.286882+0000","last_peered":"2023-11-29T11:15:10.286882+0000","last_clean":"2023-11-29T11:15:10.286882+0000","last_became_active":"2023-11-29T11:15:08.573142+0000","last_became_peered":"2023-11-29T11:15:08.573142+0000","last_unstale":"2023-11-29T11:15:10.286882+0000","last_undegraded":"2023-11-29T11:15:10.286882+0000","last_fullsized":"2023-11-29T11:15:10.286882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:24:57.508560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.289053+0000","last_change":"2023-11-29T11:15:08.588772+0000","last_active":"2023-11-29T11:15:10.289053+0000","last_peered":"2023-11-29T11:15:10.289053+0000","last_clean":"2023-11-29T11:15:10.289053+0000","last_became_active":"2023-11-29T11:15:08.588492+0000","last_became_peered":"2023-11-29T11:15:08.588492+0000","last_unstale":"2023-11-29T11:15:10.289053+0000","last_undegraded":"2023-11-29T11:15:10.289053+0000","last_fullsized":"2023-11-29T11:15:10.289053+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:41:06.783897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569854+0000","last_change":"2023-11-29T11:15:08.579244+0000","last_active":"2023-11-29T11:15:09.569854+0000","last_peered":"2023-11-29T11:15:09.569854+0000","last_clean":"2023-11-29T11:15:09.569854+0000","last_became_active":"2023-11-29T11:15:08.578967+0000","last_became_peered":"2023-11-29T11:15:08.578967+0000","last_unstale":"2023-11-29T11:15:09.569854+0000","last_undegraded":"2023-11-29T11:15:09.569854+0000","last_fullsized":"2023-11-29T11:15:09.569854+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:38:09.602618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890966+0000","last_change":"2023-11-29T11:15:08.572805+0000","last_active":"2023-11-29T11:15:09.890966+0000","last_peered":"2023-11-29T11:15:09.890966+0000","last_clean":"2023-11-29T11:15:09.890966+0000","last_became_active":"2023-11-29T11:15:08.572535+0000","last_became_peered":"2023-11-29T11:15:08.572535+0000","last_unstale":"2023-11-29T11:15:09.890966+0000","last_undegraded":"2023-11-29T11:15:09.890966+0000","last_fullsized":"2023-11-29T11:15:09.890966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:04:09.208142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288561+0000","last_change":"2023-11-29T11:15:08.573080+0000","last_active":"2023-11-29T11:15:10.288561+0000","last_peered":"2023-11-29T11:15:10.288561+0000","last_clean":"2023-11-29T11:15:10.288561+0000","last_became_active":"2023-11-29T11:15:08.572808+0000","last_became_peered":"2023-11-29T11:15:08.572808+0000","last_unstale":"2023-11-29T11:15:10.288561+0000","last_undegraded":"2023-11-29T11:15:10.288561+0000","last_fullsized":"2023-11-29T11:15:10.288561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:28:39.244025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287643+0000","last_change":"2023-11-29T11:15:08.574771+0000","last_active":"2023-11-29T11:15:10.287643+0000","last_peered":"2023-11-29T11:15:10.287643+0000","last_clean":"2023-11-29T11:15:10.287643+0000","last_became_active":"2023-11-29T11:15:08.574502+0000","last_became_peered":"2023-11-29T11:15:08.574502+0000","last_unstale":"2023-11-29T11:15:10.287643+0000","last_undegraded":"2023-11-29T11:15:10.287643+0000","last_fullsized":"2023-11-29T11:15:10.287643+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:12:17.966864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567767+0000","last_change":"2023-11-29T11:15:08.580976+0000","last_active":"2023-11-29T11:15:09.567767+0000","last_peered":"2023-11-29T11:15:09.567767+0000","last_clean":"2023-11-29T11:15:09.567767+0000","last_became_active":"2023-11-29T11:15:08.580432+0000","last_became_peered":"2023-11-29T11:15:08.580432+0000","last_unstale":"2023-11-29T11:15:09.567767+0000","last_undegraded":"2023-11-29T11:15:09.567767+0000","last_fullsized":"2023-11-29T11:15:09.567767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:45.068666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286715+0000","last_change":"2023-11-29T11:15:08.588702+0000","last_active":"2023-11-29T11:15:10.286715+0000","last_peered":"2023-11-29T11:15:10.286715+0000","last_clean":"2023-11-29T11:15:10.286715+0000","last_became_active":"2023-11-29T11:15:08.588410+0000","last_became_peered":"2023-11-29T11:15:08.588410+0000","last_unstale":"2023-11-29T11:15:10.286715+0000","last_undegraded":"2023-11-29T11:15:10.286715+0000","last_fullsized":"2023-11-29T11:15:10.286715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:36:04.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890203+0000","last_change":"2023-11-29T11:15:08.586269+0000","last_active":"2023-11-29T11:15:09.890203+0000","last_peered":"2023-11-29T11:15:09.890203+0000","last_clean":"2023-11-29T11:15:09.890203+0000","last_became_active":"2023-11-29T11:15:08.585989+0000","last_became_peered":"2023-11-29T11:15:08.585989+0000","last_unstale":"2023-11-29T11:15:09.890203+0000","last_undegraded":"2023-11-29T11:15:09.890203+0000","last_fullsized":"2023-11-29T11:15:09.890203+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:10:42.029997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891586+0000","last_change":"2023-11-29T11:15:08.582424+0000","last_active":"2023-11-29T11:15:09.891586+0000","last_peered":"2023-11-29T11:15:09.891586+0000","last_clean":"2023-11-29T11:15:09.891586+0000","last_became_active":"2023-11-29T11:15:08.582171+0000","last_became_peered":"2023-11-29T11:15:08.582171+0000","last_unstale":"2023-11-29T11:15:09.891586+0000","last_undegraded":"2023-11-29T11:15:09.891586+0000","last_fullsized":"2023-11-29T11:15:09.891586+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:49:40.731455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891860+0000","last_change":"2023-11-29T11:15:08.206183+0000","last_active":"2023-11-29T11:15:09.891860+0000","last_peered":"2023-11-29T11:15:09.891860+0000","last_clean":"2023-11-29T11:15:09.891860+0000","last_became_active":"2023-11-29T11:15:08.205893+0000","last_became_peered":"2023-11-29T11:15:08.205893+0000","last_unstale":"2023-11-29T11:15:09.891860+0000","last_undegraded":"2023-11-29T11:15:09.891860+0000","last_fullsized":"2023-11-29T11:15:09.891860+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:11:26.113956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564563+0000","last_change":"2023-11-29T11:15:08.576821+0000","last_active":"2023-11-29T11:15:09.564563+0000","last_peered":"2023-11-29T11:15:09.564563+0000","last_clean":"2023-11-29T11:15:09.564563+0000","last_became_active":"2023-11-29T11:15:08.576540+0000","last_became_peered":"2023-11-29T11:15:08.576540+0000","last_unstale":"2023-11-29T11:15:09.564563+0000","last_undegraded":"2023-11-29T11:15:09.564563+0000","last_fullsized":"2023-11-29T11:15:09.564563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:16:53.354545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287940+0000","last_change":"2023-11-29T11:15:08.208357+0000","last_active":"2023-11-29T11:15:10.287940+0000","last_peered":"2023-11-29T11:15:10.287940+0000","last_clean":"2023-11-29T11:15:10.287940+0000","last_became_active":"2023-11-29T11:15:08.208074+0000","last_became_peered":"2023-11-29T11:15:08.208074+0000","last_unstale":"2023-11-29T11:15:10.287940+0000","last_undegraded":"2023-11-29T11:15:10.287940+0000","last_fullsized":"2023-11-29T11:15:10.287940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:11:26.113956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890950+0000","last_change":"2023-11-29T11:15:08.570400+0000","last_active":"2023-11-29T11:15:09.890950+0000","last_peered":"2023-11-29T11:15:09.890950+0000","last_clean":"2023-11-29T11:15:09.890950+0000","last_became_active":"2023-11-29T11:15:08.570134+0000","last_became_peered":"2023-11-29T11:15:08.570134+0000","last_unstale":"2023-11-29T11:15:09.890950+0000","last_undegraded":"2023-11-29T11:15:09.890950+0000","last_fullsized":"2023-11-29T11:15:09.890950+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:49.990573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891420+0000","last_change":"2023-11-29T11:15:08.210200+0000","last_active":"2023-11-29T11:15:09.891420+0000","last_peered":"2023-11-29T11:15:09.891420+0000","last_clean":"2023-11-29T11:15:09.891420+0000","last_became_active":"2023-11-29T11:15:08.210021+0000","last_became_peered":"2023-11-29T11:15:08.210021+0000","last_unstale":"2023-11-29T11:15:09.891420+0000","last_undegraded":"2023-11-29T11:15:09.891420+0000","last_fullsized":"2023-11-29T11:15:09.891420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:36.725124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890971+0000","last_change":"2023-11-29T11:15:08.575005+0000","last_active":"2023-11-29T11:15:09.890971+0000","last_peered":"2023-11-29T11:15:09.890971+0000","last_clean":"2023-11-29T11:15:09.890971+0000","last_became_active":"2023-11-29T11:15:08.574715+0000","last_became_peered":"2023-11-29T11:15:08.574715+0000","last_unstale":"2023-11-29T11:15:09.890971+0000","last_undegraded":"2023-11-29T11:15:09.890971+0000","last_fullsized":"2023-11-29T11:15:09.890971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:35:04.785257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569799+0000","last_change":"2023-11-29T11:15:08.201244+0000","last_active":"2023-11-29T11:15:09.569799+0000","last_peered":"2023-11-29T11:15:09.569799+0000","last_clean":"2023-11-29T11:15:09.569799+0000","last_became_active":"2023-11-29T11:15:08.201042+0000","last_became_peered":"2023-11-29T11:15:08.201042+0000","last_unstale":"2023-11-29T11:15:09.569799+0000","last_undegraded":"2023-11-29T11:15:09.569799+0000","last_fullsized":"2023-11-29T11:15:09.569799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:20:09.258129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286799+0000","last_change":"2023-11-29T11:15:08.581930+0000","last_active":"2023-11-29T11:15:10.286799+0000","last_peered":"2023-11-29T11:15:10.286799+0000","last_clean":"2023-11-29T11:15:10.286799+0000","last_became_active":"2023-11-29T11:15:08.581674+0000","last_became_peered":"2023-11-29T11:15:08.581674+0000","last_unstale":"2023-11-29T11:15:10.286799+0000","last_undegraded":"2023-11-29T11:15:10.286799+0000","last_fullsized":"2023-11-29T11:15:10.286799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:35:04.785257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286220+0000","last_change":"2023-11-29T11:15:08.214897+0000","last_active":"2023-11-29T11:15:10.286220+0000","last_peered":"2023-11-29T11:15:10.286220+0000","last_clean":"2023-11-29T11:15:10.286220+0000","last_became_active":"2023-11-29T11:15:08.214630+0000","last_became_peered":"2023-11-29T11:15:08.214630+0000","last_unstale":"2023-11-29T11:15:10.286220+0000","last_undegraded":"2023-11-29T11:15:10.286220+0000","last_fullsized":"2023-11-29T11:15:10.286220+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:55:26.720056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287286+0000","last_change":"2023-11-29T11:15:08.577672+0000","last_active":"2023-11-29T11:15:10.287286+0000","last_peered":"2023-11-29T11:15:10.287286+0000","last_clean":"2023-11-29T11:15:10.287286+0000","last_became_active":"2023-11-29T11:15:08.572147+0000","last_became_peered":"2023-11-29T11:15:08.572147+0000","last_unstale":"2023-11-29T11:15:10.287286+0000","last_undegraded":"2023-11-29T11:15:10.287286+0000","last_fullsized":"2023-11-29T11:15:10.287286+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:16:45.989075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890609+0000","last_change":"2023-11-29T11:15:08.208974+0000","last_active":"2023-11-29T11:15:09.890609+0000","last_peered":"2023-11-29T11:15:09.890609+0000","last_clean":"2023-11-29T11:15:09.890609+0000","last_became_active":"2023-11-29T11:15:08.208717+0000","last_became_peered":"2023-11-29T11:15:08.208717+0000","last_unstale":"2023-11-29T11:15:09.890609+0000","last_undegraded":"2023-11-29T11:15:09.890609+0000","last_fullsized":"2023-11-29T11:15:09.890609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:44.055946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287019+0000","last_change":"2023-11-29T11:15:08.579648+0000","last_active":"2023-11-29T11:15:10.287019+0000","last_peered":"2023-11-29T11:15:10.287019+0000","last_clean":"2023-11-29T11:15:10.287019+0000","last_became_active":"2023-11-29T11:15:08.579369+0000","last_became_peered":"2023-11-29T11:15:08.579369+0000","last_unstale":"2023-11-29T11:15:10.287019+0000","last_undegraded":"2023-11-29T11:15:10.287019+0000","last_fullsized":"2023-11-29T11:15:10.287019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:47:57.555191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569067+0000","last_change":"2023-11-29T11:15:08.205695+0000","last_active":"2023-11-29T11:15:09.569067+0000","last_peered":"2023-11-29T11:15:09.569067+0000","last_clean":"2023-11-29T11:15:09.569067+0000","last_became_active":"2023-11-29T11:15:08.205203+0000","last_became_peered":"2023-11-29T11:15:08.205203+0000","last_unstale":"2023-11-29T11:15:09.569067+0000","last_undegraded":"2023-11-29T11:15:09.569067+0000","last_fullsized":"2023-11-29T11:15:09.569067+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:54:45.331356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286995+0000","last_change":"2023-11-29T11:15:08.572755+0000","last_active":"2023-11-29T11:15:10.286995+0000","last_peered":"2023-11-29T11:15:10.286995+0000","last_clean":"2023-11-29T11:15:10.286995+0000","last_became_active":"2023-11-29T11:15:08.572427+0000","last_became_peered":"2023-11-29T11:15:08.572427+0000","last_unstale":"2023-11-29T11:15:10.286995+0000","last_undegraded":"2023-11-29T11:15:10.286995+0000","last_fullsized":"2023-11-29T11:15:10.286995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:09:39.332245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.285891+0000","last_change":"2023-11-29T11:15:08.210931+0000","last_active":"2023-11-29T11:15:10.285891+0000","last_peered":"2023-11-29T11:15:10.285891+0000","last_clean":"2023-11-29T11:15:10.285891+0000","last_became_active":"2023-11-29T11:15:08.210637+0000","last_became_peered":"2023-11-29T11:15:08.210637+0000","last_unstale":"2023-11-29T11:15:10.285891+0000","last_undegraded":"2023-11-29T11:15:10.285891+0000","last_fullsized":"2023-11-29T11:15:10.285891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:46:06.931313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286882+0000","last_change":"2023-11-29T11:15:08.588432+0000","last_active":"2023-11-29T11:15:10.286882+0000","last_peered":"2023-11-29T11:15:10.286882+0000","last_clean":"2023-11-29T11:15:10.286882+0000","last_became_active":"2023-11-29T11:15:08.588136+0000","last_became_peered":"2023-11-29T11:15:08.588136+0000","last_unstale":"2023-11-29T11:15:10.286882+0000","last_undegraded":"2023-11-29T11:15:10.286882+0000","last_fullsized":"2023-11-29T11:15:10.286882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:09:39.332245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569581+0000","last_change":"2023-11-29T11:15:08.211238+0000","last_active":"2023-11-29T11:15:09.569581+0000","last_peered":"2023-11-29T11:15:09.569581+0000","last_clean":"2023-11-29T11:15:09.569581+0000","last_became_active":"2023-11-29T11:15:08.210991+0000","last_became_peered":"2023-11-29T11:15:08.210991+0000","last_unstale":"2023-11-29T11:15:09.569581+0000","last_undegraded":"2023-11-29T11:15:09.569581+0000","last_fullsized":"2023-11-29T11:15:09.569581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:16:52.341825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569474+0000","last_change":"2023-11-29T11:15:08.587739+0000","last_active":"2023-11-29T11:15:09.569474+0000","last_peered":"2023-11-29T11:15:09.569474+0000","last_clean":"2023-11-29T11:15:09.569474+0000","last_became_active":"2023-11-29T11:15:08.587448+0000","last_became_peered":"2023-11-29T11:15:08.587448+0000","last_unstale":"2023-11-29T11:15:09.569474+0000","last_undegraded":"2023-11-29T11:15:09.569474+0000","last_fullsized":"2023-11-29T11:15:09.569474+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:56:22.003735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288053+0000","last_change":"2023-11-29T11:15:08.215350+0000","last_active":"2023-11-29T11:15:10.288053+0000","last_peered":"2023-11-29T11:15:10.288053+0000","last_clean":"2023-11-29T11:15:10.288053+0000","last_became_active":"2023-11-29T11:15:08.214981+0000","last_became_peered":"2023-11-29T11:15:08.214981+0000","last_unstale":"2023-11-29T11:15:10.288053+0000","last_undegraded":"2023-11-29T11:15:10.288053+0000","last_fullsized":"2023-11-29T11:15:10.288053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:40:38.015084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564363+0000","last_change":"2023-11-29T11:15:08.580476+0000","last_active":"2023-11-29T11:15:09.564363+0000","last_peered":"2023-11-29T11:15:09.564363+0000","last_clean":"2023-11-29T11:15:09.564363+0000","last_became_active":"2023-11-29T11:15:08.580188+0000","last_became_peered":"2023-11-29T11:15:08.580188+0000","last_unstale":"2023-11-29T11:15:09.564363+0000","last_undegraded":"2023-11-29T11:15:09.564363+0000","last_fullsized":"2023-11-29T11:15:09.564363+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:49:34.651943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568814+0000","last_change":"2023-11-29T11:15:08.209120+0000","last_active":"2023-11-29T11:15:09.568814+0000","last_peered":"2023-11-29T11:15:09.568814+0000","last_clean":"2023-11-29T11:15:09.568814+0000","last_became_active":"2023-11-29T11:15:08.208718+0000","last_became_peered":"2023-11-29T11:15:08.208718+0000","last_unstale":"2023-11-29T11:15:09.568814+0000","last_undegraded":"2023-11-29T11:15:09.568814+0000","last_fullsized":"2023-11-29T11:15:09.568814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:18:33.381289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568590+0000","last_change":"2023-11-29T11:15:08.584510+0000","last_active":"2023-11-29T11:15:09.568590+0000","last_peered":"2023-11-29T11:15:09.568590+0000","last_clean":"2023-11-29T11:15:09.568590+0000","last_became_active":"2023-11-29T11:15:08.584172+0000","last_became_peered":"2023-11-29T11:15:08.584172+0000","last_unstale":"2023-11-29T11:15:09.568590+0000","last_undegraded":"2023-11-29T11:15:09.568590+0000","last_fullsized":"2023-11-29T11:15:09.568590+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:13:15.033400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286716+0000","last_change":"2023-11-29T11:15:08.211926+0000","last_active":"2023-11-29T11:15:10.286716+0000","last_peered":"2023-11-29T11:15:10.286716+0000","last_clean":"2023-11-29T11:15:10.286716+0000","last_became_active":"2023-11-29T11:15:08.211662+0000","last_became_peered":"2023-11-29T11:15:08.211662+0000","last_unstale":"2023-11-29T11:15:10.286716+0000","last_undegraded":"2023-11-29T11:15:10.286716+0000","last_fullsized":"2023-11-29T11:15:10.286716+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:33.156333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569336+0000","last_change":"2023-11-29T11:15:08.568986+0000","last_active":"2023-11-29T11:15:09.569336+0000","last_peered":"2023-11-29T11:15:09.569336+0000","last_clean":"2023-11-29T11:15:09.569336+0000","last_became_active":"2023-11-29T11:15:08.568297+0000","last_became_peered":"2023-11-29T11:15:08.568297+0000","last_unstale":"2023-11-29T11:15:09.569336+0000","last_undegraded":"2023-11-29T11:15:09.569336+0000","last_fullsized":"2023-11-29T11:15:09.569336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:27:51.216003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287506+0000","last_change":"2023-11-29T11:15:08.215792+0000","last_active":"2023-11-29T11:15:10.287506+0000","last_peered":"2023-11-29T11:15:10.287506+0000","last_clean":"2023-11-29T11:15:10.287506+0000","last_became_active":"2023-11-29T11:15:08.215520+0000","last_became_peered":"2023-11-29T11:15:08.215520+0000","last_unstale":"2023-11-29T11:15:10.287506+0000","last_undegraded":"2023-11-29T11:15:10.287506+0000","last_fullsized":"2023-11-29T11:15:10.287506+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:12:13.870972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568094+0000","last_change":"2023-11-29T11:15:08.570030+0000","last_active":"2023-11-29T11:15:09.568094+0000","last_peered":"2023-11-29T11:15:09.568094+0000","last_clean":"2023-11-29T11:15:09.568094+0000","last_became_active":"2023-11-29T11:15:08.569759+0000","last_became_peered":"2023-11-29T11:15:08.569759+0000","last_unstale":"2023-11-29T11:15:09.568094+0000","last_undegraded":"2023-11-29T11:15:09.568094+0000","last_fullsized":"2023-11-29T11:15:09.568094+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:33:11.121188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287332+0000","last_change":"2023-11-29T11:15:08.203971+0000","last_active":"2023-11-29T11:15:10.287332+0000","last_peered":"2023-11-29T11:15:10.287332+0000","last_clean":"2023-11-29T11:15:10.287332+0000","last_became_active":"2023-11-29T11:15:08.203693+0000","last_became_peered":"2023-11-29T11:15:08.203693+0000","last_unstale":"2023-11-29T11:15:10.287332+0000","last_undegraded":"2023-11-29T11:15:10.287332+0000","last_fullsized":"2023-11-29T11:15:10.287332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:12:56.689018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.285751+0000","last_change":"2023-11-29T11:15:08.580505+0000","last_active":"2023-11-29T11:15:10.285751+0000","last_peered":"2023-11-29T11:15:10.285751+0000","last_clean":"2023-11-29T11:15:10.285751+0000","last_became_active":"2023-11-29T11:15:08.580192+0000","last_became_peered":"2023-11-29T11:15:08.580192+0000","last_unstale":"2023-11-29T11:15:10.285751+0000","last_undegraded":"2023-11-29T11:15:10.285751+0000","last_fullsized":"2023-11-29T11:15:10.285751+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:49:40.731455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569199+0000","last_change":"2023-11-29T11:15:08.201996+0000","last_active":"2023-11-29T11:15:09.569199+0000","last_peered":"2023-11-29T11:15:09.569199+0000","last_clean":"2023-11-29T11:15:09.569199+0000","last_became_active":"2023-11-29T11:15:08.201681+0000","last_became_peered":"2023-11-29T11:15:08.201681+0000","last_unstale":"2023-11-29T11:15:09.569199+0000","last_undegraded":"2023-11-29T11:15:09.569199+0000","last_fullsized":"2023-11-29T11:15:09.569199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:40:52.937195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567736+0000","last_change":"2023-11-29T11:15:08.582658+0000","last_active":"2023-11-29T11:15:09.567736+0000","last_peered":"2023-11-29T11:15:09.567736+0000","last_clean":"2023-11-29T11:15:09.567736+0000","last_became_active":"2023-11-29T11:15:08.582249+0000","last_became_peered":"2023-11-29T11:15:08.582249+0000","last_unstale":"2023-11-29T11:15:09.567736+0000","last_undegraded":"2023-11-29T11:15:09.567736+0000","last_fullsized":"2023-11-29T11:15:09.567736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:55:41.269273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567794+0000","last_change":"2023-11-29T11:15:08.205489+0000","last_active":"2023-11-29T11:15:09.567794+0000","last_peered":"2023-11-29T11:15:09.567794+0000","last_clean":"2023-11-29T11:15:09.567794+0000","last_became_active":"2023-11-29T11:15:08.205150+0000","last_became_peered":"2023-11-29T11:15:08.205150+0000","last_unstale":"2023-11-29T11:15:09.567794+0000","last_undegraded":"2023-11-29T11:15:09.567794+0000","last_fullsized":"2023-11-29T11:15:09.567794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:20:30.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569787+0000","last_change":"2023-11-29T11:15:08.575414+0000","last_active":"2023-11-29T11:15:09.569787+0000","last_peered":"2023-11-29T11:15:09.569787+0000","last_clean":"2023-11-29T11:15:09.569787+0000","last_became_active":"2023-11-29T11:15:08.575115+0000","last_became_peered":"2023-11-29T11:15:08.575115+0000","last_unstale":"2023-11-29T11:15:09.569787+0000","last_undegraded":"2023-11-29T11:15:09.569787+0000","last_fullsized":"2023-11-29T11:15:09.569787+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:41:56.996540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564577+0000","last_change":"2023-11-29T11:15:08.203997+0000","last_active":"2023-11-29T11:15:09.564577+0000","last_peered":"2023-11-29T11:15:09.564577+0000","last_clean":"2023-11-29T11:15:09.564577+0000","last_became_active":"2023-11-29T11:15:08.203672+0000","last_became_peered":"2023-11-29T11:15:08.203672+0000","last_unstale":"2023-11-29T11:15:09.564577+0000","last_undegraded":"2023-11-29T11:15:09.564577+0000","last_fullsized":"2023-11-29T11:15:09.564577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:00:04.914821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.570070+0000","last_change":"2023-11-29T11:15:08.571551+0000","last_active":"2023-11-29T11:15:09.570070+0000","last_peered":"2023-11-29T11:15:09.570070+0000","last_clean":"2023-11-29T11:15:09.570070+0000","last_became_active":"2023-11-29T11:15:08.571282+0000","last_became_peered":"2023-11-29T11:15:08.571282+0000","last_unstale":"2023-11-29T11:15:09.570070+0000","last_undegraded":"2023-11-29T11:15:09.570070+0000","last_fullsized":"2023-11-29T11:15:09.570070+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:28:17.269618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891721+0000","last_change":"2023-11-29T11:15:08.206187+0000","last_active":"2023-11-29T11:15:09.891721+0000","last_peered":"2023-11-29T11:15:09.891721+0000","last_clean":"2023-11-29T11:15:09.891721+0000","last_became_active":"2023-11-29T11:15:08.205713+0000","last_became_peered":"2023-11-29T11:15:08.205713+0000","last_unstale":"2023-11-29T11:15:09.891721+0000","last_undegraded":"2023-11-29T11:15:09.891721+0000","last_fullsized":"2023-11-29T11:15:09.891721+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:05:18.812454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564276+0000","last_change":"2023-11-29T11:15:08.579931+0000","last_active":"2023-11-29T11:15:09.564276+0000","last_peered":"2023-11-29T11:15:09.564276+0000","last_clean":"2023-11-29T11:15:09.564276+0000","last_became_active":"2023-11-29T11:15:08.579654+0000","last_became_peered":"2023-11-29T11:15:08.579654+0000","last_unstale":"2023-11-29T11:15:09.564276+0000","last_undegraded":"2023-11-29T11:15:09.564276+0000","last_fullsized":"2023-11-29T11:15:09.564276+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:18:34.394010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287515+0000","last_change":"2023-11-29T11:15:08.205519+0000","last_active":"2023-11-29T11:15:10.287515+0000","last_peered":"2023-11-29T11:15:10.287515+0000","last_clean":"2023-11-29T11:15:10.287515+0000","last_became_active":"2023-11-29T11:15:08.205266+0000","last_became_peered":"2023-11-29T11:15:08.205266+0000","last_unstale":"2023-11-29T11:15:10.287515+0000","last_undegraded":"2023-11-29T11:15:10.287515+0000","last_fullsized":"2023-11-29T11:15:10.287515+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:15:57.059410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891230+0000","last_change":"2023-11-29T11:15:08.574143+0000","last_active":"2023-11-29T11:15:09.891230+0000","last_peered":"2023-11-29T11:15:09.891230+0000","last_clean":"2023-11-29T11:15:09.891230+0000","last_became_active":"2023-11-29T11:15:08.573844+0000","last_became_peered":"2023-11-29T11:15:08.573844+0000","last_unstale":"2023-11-29T11:15:09.891230+0000","last_undegraded":"2023-11-29T11:15:09.891230+0000","last_fullsized":"2023-11-29T11:15:09.891230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:08.200866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.570024+0000","last_change":"2023-11-29T11:15:08.206881+0000","last_active":"2023-11-29T11:15:09.570024+0000","last_peered":"2023-11-29T11:15:09.570024+0000","last_clean":"2023-11-29T11:15:09.570024+0000","last_became_active":"2023-11-29T11:15:08.206640+0000","last_became_peered":"2023-11-29T11:15:08.206640+0000","last_unstale":"2023-11-29T11:15:09.570024+0000","last_undegraded":"2023-11-29T11:15:09.570024+0000","last_fullsized":"2023-11-29T11:15:09.570024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:38:33.656872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286881+0000","last_change":"2023-11-29T11:15:08.587961+0000","last_active":"2023-11-29T11:15:10.286881+0000","last_peered":"2023-11-29T11:15:10.286881+0000","last_clean":"2023-11-29T11:15:10.286881+0000","last_became_active":"2023-11-29T11:15:08.587673+0000","last_became_peered":"2023-11-29T11:15:08.587673+0000","last_unstale":"2023-11-29T11:15:10.286881+0000","last_undegraded":"2023-11-29T11:15:10.286881+0000","last_fullsized":"2023-11-29T11:15:10.286881+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:04:09.208142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564156+0000","last_change":"2023-11-29T11:15:08.203424+0000","last_active":"2023-11-29T11:15:09.564156+0000","last_peered":"2023-11-29T11:15:09.564156+0000","last_clean":"2023-11-29T11:15:09.564156+0000","last_became_active":"2023-11-29T11:15:08.202905+0000","last_became_peered":"2023-11-29T11:15:08.202905+0000","last_unstale":"2023-11-29T11:15:09.564156+0000","last_undegraded":"2023-11-29T11:15:09.564156+0000","last_fullsized":"2023-11-29T11:15:09.564156+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:06:22.134360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568288+0000","last_change":"2023-11-29T11:15:08.579382+0000","last_active":"2023-11-29T11:15:09.568288+0000","last_peered":"2023-11-29T11:15:09.568288+0000","last_clean":"2023-11-29T11:15:09.568288+0000","last_became_active":"2023-11-29T11:15:08.579031+0000","last_became_peered":"2023-11-29T11:15:08.579031+0000","last_unstale":"2023-11-29T11:15:09.568288+0000","last_undegraded":"2023-11-29T11:15:09.568288+0000","last_fullsized":"2023-11-29T11:15:09.568288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:40:39.027805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286131+0000","last_change":"2023-11-29T11:15:08.212934+0000","last_active":"2023-11-29T11:15:10.286131+0000","last_peered":"2023-11-29T11:15:10.286131+0000","last_clean":"2023-11-29T11:15:10.286131+0000","last_became_active":"2023-11-29T11:15:08.212681+0000","last_became_peered":"2023-11-29T11:15:08.212681+0000","last_unstale":"2023-11-29T11:15:10.286131+0000","last_undegraded":"2023-11-29T11:15:10.286131+0000","last_fullsized":"2023-11-29T11:15:10.286131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:10:01.314637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.563964+0000","last_change":"2023-11-29T11:15:08.569273+0000","last_active":"2023-11-29T11:15:09.563964+0000","last_peered":"2023-11-29T11:15:09.563964+0000","last_clean":"2023-11-29T11:15:09.563964+0000","last_became_active":"2023-11-29T11:15:08.569003+0000","last_became_peered":"2023-11-29T11:15:08.569003+0000","last_unstale":"2023-11-29T11:15:09.563964+0000","last_undegraded":"2023-11-29T11:15:09.563964+0000","last_fullsized":"2023-11-29T11:15:09.563964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:20:31.043990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564037+0000","last_change":"2023-11-29T11:15:08.210110+0000","last_active":"2023-11-29T11:15:09.564037+0000","last_peered":"2023-11-29T11:15:09.564037+0000","last_clean":"2023-11-29T11:15:09.564037+0000","last_became_active":"2023-11-29T11:15:08.209861+0000","last_became_peered":"2023-11-29T11:15:08.209861+0000","last_unstale":"2023-11-29T11:15:09.564037+0000","last_undegraded":"2023-11-29T11:15:09.564037+0000","last_fullsized":"2023-11-29T11:15:09.564037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:47:45.443662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286947+0000","last_change":"2023-11-29T11:15:08.572431+0000","last_active":"2023-11-29T11:15:10.286947+0000","last_peered":"2023-11-29T11:15:10.286947+0000","last_clean":"2023-11-29T11:15:10.286947+0000","last_became_active":"2023-11-29T11:15:08.572086+0000","last_became_peered":"2023-11-29T11:15:08.572086+0000","last_unstale":"2023-11-29T11:15:10.286947+0000","last_undegraded":"2023-11-29T11:15:10.286947+0000","last_fullsized":"2023-11-29T11:15:10.286947+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:44:28.810311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287102+0000","last_change":"2023-11-29T11:15:08.207887+0000","last_active":"2023-11-29T11:15:10.287102+0000","last_peered":"2023-11-29T11:15:10.287102+0000","last_clean":"2023-11-29T11:15:10.287102+0000","last_became_active":"2023-11-29T11:15:08.207601+0000","last_became_peered":"2023-11-29T11:15:08.207601+0000","last_unstale":"2023-11-29T11:15:10.287102+0000","last_undegraded":"2023-11-29T11:15:10.287102+0000","last_fullsized":"2023-11-29T11:15:10.287102+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:36.725124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.570060+0000","last_change":"2023-11-29T11:15:08.570338+0000","last_active":"2023-11-29T11:15:09.570060+0000","last_peered":"2023-11-29T11:15:09.570060+0000","last_clean":"2023-11-29T11:15:09.570060+0000","last_became_active":"2023-11-29T11:15:08.570097+0000","last_became_peered":"2023-11-29T11:15:08.570097+0000","last_unstale":"2023-11-29T11:15:09.570060+0000","last_undegraded":"2023-11-29T11:15:09.570060+0000","last_fullsized":"2023-11-29T11:15:09.570060+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:44:50.827297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891577+0000","last_change":"2023-11-29T11:15:08.215249+0000","last_active":"2023-11-29T11:15:09.891577+0000","last_peered":"2023-11-29T11:15:09.891577+0000","last_clean":"2023-11-29T11:15:09.891577+0000","last_became_active":"2023-11-29T11:15:08.214796+0000","last_became_peered":"2023-11-29T11:15:08.214796+0000","last_unstale":"2023-11-29T11:15:09.891577+0000","last_undegraded":"2023-11-29T11:15:09.891577+0000","last_fullsized":"2023-11-29T11:15:09.891577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:12:13.870972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.560344+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:15:08.560344+0000","last_peered":"2023-11-29T11:15:08.560344+0000","last_clean":"2023-11-29T11:15:08.560344+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:15:08.560344+0000","last_undegraded":"2023-11-29T11:15:08.560344+0000","last_fullsized":"2023-11-29T11:15:08.560344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568981+0000","last_change":"2023-11-29T11:15:08.579424+0000","last_active":"2023-11-29T11:15:09.568981+0000","last_peered":"2023-11-29T11:15:09.568981+0000","last_clean":"2023-11-29T11:15:09.568981+0000","last_became_active":"2023-11-29T11:15:08.579062+0000","last_became_peered":"2023-11-29T11:15:08.579062+0000","last_unstale":"2023-11-29T11:15:09.568981+0000","last_undegraded":"2023-11-29T11:15:09.568981+0000","last_fullsized":"2023-11-29T11:15:09.568981+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:50:29.313780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288044+0000","last_change":"2023-11-29T11:15:08.215429+0000","last_active":"2023-11-29T11:15:10.288044+0000","last_peered":"2023-11-29T11:15:10.288044+0000","last_clean":"2023-11-29T11:15:10.288044+0000","last_became_active":"2023-11-29T11:15:08.215039+0000","last_became_peered":"2023-11-29T11:15:08.215039+0000","last_unstale":"2023-11-29T11:15:10.288044+0000","last_undegraded":"2023-11-29T11:15:10.288044+0000","last_fullsized":"2023-11-29T11:15:10.288044+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:33:10.108468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.561023+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:15:08.561023+0000","last_peered":"2023-11-29T11:15:08.561023+0000","last_clean":"2023-11-29T11:15:08.561023+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:15:08.561023+0000","last_undegraded":"2023-11-29T11:15:08.561023+0000","last_fullsized":"2023-11-29T11:15:08.561023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568652+0000","last_change":"2023-11-29T11:15:08.587766+0000","last_active":"2023-11-29T11:15:09.568652+0000","last_peered":"2023-11-29T11:15:09.568652+0000","last_clean":"2023-11-29T11:15:09.568652+0000","last_became_active":"2023-11-29T11:15:08.587477+0000","last_became_peered":"2023-11-29T11:15:08.587477+0000","last_unstale":"2023-11-29T11:15:09.568652+0000","last_undegraded":"2023-11-29T11:15:09.568652+0000","last_fullsized":"2023-11-29T11:15:09.568652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:11:27.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890971+0000","last_change":"2023-11-29T11:15:08.211167+0000","last_active":"2023-11-29T11:15:09.890971+0000","last_peered":"2023-11-29T11:15:09.890971+0000","last_clean":"2023-11-29T11:15:09.890971+0000","last_became_active":"2023-11-29T11:15:08.210912+0000","last_became_peered":"2023-11-29T11:15:08.210912+0000","last_unstale":"2023-11-29T11:15:09.890971+0000","last_undegraded":"2023-11-29T11:15:09.890971+0000","last_fullsized":"2023-11-29T11:15:09.890971+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:40:38.015084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.565311+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:15:08.565311+0000","last_peered":"2023-11-29T11:15:08.565311+0000","last_clean":"2023-11-29T11:15:08.565311+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:15:08.565311+0000","last_undegraded":"2023-11-29T11:15:08.565311+0000","last_fullsized":"2023-11-29T11:15:08.565311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287539+0000","last_change":"2023-11-29T11:15:08.582498+0000","last_active":"2023-11-29T11:15:10.287539+0000","last_peered":"2023-11-29T11:15:10.287539+0000","last_clean":"2023-11-29T11:15:10.287539+0000","last_became_active":"2023-11-29T11:15:08.582233+0000","last_became_peered":"2023-11-29T11:15:08.582233+0000","last_unstale":"2023-11-29T11:15:10.287539+0000","last_undegraded":"2023-11-29T11:15:10.287539+0000","last_fullsized":"2023-11-29T11:15:10.287539+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:49.990573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569993+0000","last_change":"2023-11-29T11:15:08.200550+0000","last_active":"2023-11-29T11:15:09.569993+0000","last_peered":"2023-11-29T11:15:09.569993+0000","last_clean":"2023-11-29T11:15:09.569993+0000","last_became_active":"2023-11-29T11:15:08.200283+0000","last_became_peered":"2023-11-29T11:15:08.200283+0000","last_unstale":"2023-11-29T11:15:09.569993+0000","last_undegraded":"2023-11-29T11:15:09.569993+0000","last_fullsized":"2023-11-29T11:15:09.569993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:27:31.009339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.572338+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:15:08.572338+0000","last_peered":"2023-11-29T11:15:08.572338+0000","last_clean":"2023-11-29T11:15:08.572338+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:15:08.572338+0000","last_undegraded":"2023-11-29T11:15:08.572338+0000","last_fullsized":"2023-11-29T11:15:08.572338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890870+0000","last_change":"2023-11-29T11:15:08.572976+0000","last_active":"2023-11-29T11:15:09.890870+0000","last_peered":"2023-11-29T11:15:09.890870+0000","last_clean":"2023-11-29T11:15:09.890870+0000","last_became_active":"2023-11-29T11:15:08.572146+0000","last_became_peered":"2023-11-29T11:15:08.572146+0000","last_unstale":"2023-11-29T11:15:09.890870+0000","last_undegraded":"2023-11-29T11:15:09.890870+0000","last_fullsized":"2023-11-29T11:15:09.890870+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:09:39.332245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564482+0000","last_change":"2023-11-29T11:15:08.202969+0000","last_active":"2023-11-29T11:15:09.564482+0000","last_peered":"2023-11-29T11:15:09.564482+0000","last_clean":"2023-11-29T11:15:09.564482+0000","last_became_active":"2023-11-29T11:15:08.202663+0000","last_became_peered":"2023-11-29T11:15:08.202663+0000","last_unstale":"2023-11-29T11:15:09.564482+0000","last_undegraded":"2023-11-29T11:15:09.564482+0000","last_fullsized":"2023-11-29T11:15:09.564482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:13:22.373531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.559558+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:15:08.559558+0000","last_peered":"2023-11-29T11:15:08.559558+0000","last_clean":"2023-11-29T11:15:08.559558+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:15:08.559558+0000","last_undegraded":"2023-11-29T11:15:08.559558+0000","last_fullsized":"2023-11-29T11:15:08.559558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.554611+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:15:08.554611+0000","last_peered":"2023-11-29T11:15:08.554611+0000","last_clean":"2023-11-29T11:15:08.554611+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:15:08.554611+0000","last_undegraded":"2023-11-29T11:15:08.554611+0000","last_fullsized":"2023-11-29T11:15:08.554611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569362+0000","last_change":"2023-11-29T11:15:08.568763+0000","last_active":"2023-11-29T11:15:09.569362+0000","last_peered":"2023-11-29T11:15:09.569362+0000","last_clean":"2023-11-29T11:15:09.569362+0000","last_became_active":"2023-11-29T11:15:08.568301+0000","last_became_peered":"2023-11-29T11:15:08.568301+0000","last_unstale":"2023-11-29T11:15:09.569362+0000","last_undegraded":"2023-11-29T11:15:09.569362+0000","last_fullsized":"2023-11-29T11:15:09.569362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:08:08.767479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287761+0000","last_change":"2023-11-29T11:15:08.209475+0000","last_active":"2023-11-29T11:15:10.287761+0000","last_peered":"2023-11-29T11:15:10.287761+0000","last_clean":"2023-11-29T11:15:10.287761+0000","last_became_active":"2023-11-29T11:15:08.209128+0000","last_became_peered":"2023-11-29T11:15:08.209128+0000","last_unstale":"2023-11-29T11:15:10.287761+0000","last_undegraded":"2023-11-29T11:15:10.287761+0000","last_fullsized":"2023-11-29T11:15:10.287761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:05:18.812454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.559869+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:15:08.559869+0000","last_peered":"2023-11-29T11:15:08.559869+0000","last_clean":"2023-11-29T11:15:08.559869+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:15:08.559869+0000","last_undegraded":"2023-11-29T11:15:08.559869+0000","last_fullsized":"2023-11-29T11:15:08.559869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890389+0000","last_change":"2023-11-29T11:15:08.580224+0000","last_active":"2023-11-29T11:15:09.890389+0000","last_peered":"2023-11-29T11:15:09.890389+0000","last_clean":"2023-11-29T11:15:09.890389+0000","last_became_active":"2023-11-29T11:15:08.579888+0000","last_became_peered":"2023-11-29T11:15:08.579888+0000","last_unstale":"2023-11-29T11:15:09.890389+0000","last_undegraded":"2023-11-29T11:15:09.890389+0000","last_fullsized":"2023-11-29T11:15:09.890389+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:28:25.497519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568827+0000","last_change":"2023-11-29T11:15:08.207859+0000","last_active":"2023-11-29T11:15:09.568827+0000","last_peered":"2023-11-29T11:15:09.568827+0000","last_clean":"2023-11-29T11:15:09.568827+0000","last_became_active":"2023-11-29T11:15:08.207530+0000","last_became_peered":"2023-11-29T11:15:08.207530+0000","last_unstale":"2023-11-29T11:15:09.568827+0000","last_undegraded":"2023-11-29T11:15:09.568827+0000","last_fullsized":"2023-11-29T11:15:09.568827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:42:48.600854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.556305+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:15:08.556305+0000","last_peered":"2023-11-29T11:15:08.556305+0000","last_clean":"2023-11-29T11:15:08.556305+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:15:08.556305+0000","last_undegraded":"2023-11-29T11:15:08.556305+0000","last_fullsized":"2023-11-29T11:15:08.556305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286519+0000","last_change":"2023-11-29T11:15:08.573477+0000","last_active":"2023-11-29T11:15:10.286519+0000","last_peered":"2023-11-29T11:15:10.286519+0000","last_clean":"2023-11-29T11:15:10.286519+0000","last_became_active":"2023-11-29T11:15:08.573195+0000","last_became_peered":"2023-11-29T11:15:08.573195+0000","last_unstale":"2023-11-29T11:15:10.286519+0000","last_undegraded":"2023-11-29T11:15:10.286519+0000","last_fullsized":"2023-11-29T11:15:10.286519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:58:45.455571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287204+0000","last_change":"2023-11-29T11:15:08.204739+0000","last_active":"2023-11-29T11:15:10.287204+0000","last_peered":"2023-11-29T11:15:10.287204+0000","last_clean":"2023-11-29T11:15:10.287204+0000","last_became_active":"2023-11-29T11:15:08.204457+0000","last_became_peered":"2023-11-29T11:15:08.204457+0000","last_unstale":"2023-11-29T11:15:10.287204+0000","last_undegraded":"2023-11-29T11:15:10.287204+0000","last_fullsized":"2023-11-29T11:15:10.287204+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:08:25.931610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.559626+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:15:08.559626+0000","last_peered":"2023-11-29T11:15:08.559626+0000","last_clean":"2023-11-29T11:15:08.559626+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:15:08.559626+0000","last_undegraded":"2023-11-29T11:15:08.559626+0000","last_fullsized":"2023-11-29T11:15:08.559626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542175,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10320,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361520,"statfs":{"total":96636764160,"available":96626196480,"internally_reserved":0,"allocated":1253376,"data_stored":892639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.90100000000000002,"15min":0.91100000000000003},"min":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1910000000000001,"5min":1.371,"15min":1.371},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1479999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.93799999999999994}]},{"osd":1,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.64000000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.337,"15min":1.337},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.89500000000000002,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.99299999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.69099999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.0109999999999999,"15min":1.024},"min":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.127,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1519999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.97299999999999998,"15min":0.98099999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4650000000000001,"5min":1.641,"15min":1.641},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97299999999999998,"15min":0.98299999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.1659999999999999,"5min":1.214,"15min":1.214},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97499999999999998,"15min":0.997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0649999999999999,"5min":1.319,"15min":1.319},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0920000000000001,"15min":1.0960000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.877}]},{"osd":5,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.1160000000000001,"15min":1.1399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2050000000000001,"5min":1.909,"15min":1.909},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1339999999999999,"15min":1.1519999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4239999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.004}]},{"osd":6,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.179,"15min":1.1970000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.2509999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.202,"15min":1.2110000000000001},"min":{"1min":0.95799999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.623,"5min":1.77,"15min":1.77},"last":0.97099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9144,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362696,"statfs":{"total":96636764160,"available":96627400704,"internally_reserved":0,"allocated":638976,"data_stored":295138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.56399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1180000000000001,"5min":1.2,"15min":1.2},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.71599999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.93100000000000005,"15min":0.92700000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.495},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93899999999999995,"15min":0.93300000000000005},"min":{"1min":0.64700000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.052,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90300000000000002,"15min":0.89700000000000002},"min":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.75}]},{"osd":3,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90900000000000003,"15min":0.90800000000000003},"min":{"1min":0.65000000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93200000000000005,"15min":0.93100000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.878}]},{"osd":4,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.61899999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.97899999999999998,"15min":0.97499999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.90100000000000002}]},{"osd":5,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90200000000000002,"15min":0.90000000000000002},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0700000000000001,"15min":1.0669999999999999},"min":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.087}]},{"osd":7,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0820000000000001,"15min":1.0880000000000001},"min":{"1min":0.81599999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.081,"15min":1.085},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.98499999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9228,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362612,"statfs":{"total":96636764160,"available":96627314688,"internally_reserved":0,"allocated":659456,"data_stored":302747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.76900000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95399999999999996,"15min":0.95999999999999996},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.875},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.89700000000000002,"15min":0.88700000000000001},"min":{"1min":0.59699999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.95199999999999996,"15min":0.95699999999999996},"min":{"1min":0.60099999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1080000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.335},{"interface":"front","average":{"1min":1.266,"5min":1.0600000000000001,"15min":1.026},"min":{"1min":0.78600000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":6.6040000000000001,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.2609999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0720000000000001,"15min":1.0820000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.054}]},{"osd":6,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.389},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.044,"15min":1.054},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4870000000000001,"5min":1.575,"15min":1.575},"last":1.1879999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1140000000000001,"15min":1.101},"min":{"1min":0.84699999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6379999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.151},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2050000000000001,"15min":1.2090000000000001},"min":{"1min":0.84999999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6779999999999999,"5min":1.889,"15min":1.889},"last":1.468}]}]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9348,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362492,"statfs":{"total":96636764160,"available":96627191808,"internally_reserved":0,"allocated":651264,"data_stored":296686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.92100000000000004,"15min":0.93899999999999995},"min":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0620000000000001,"5min":1.431,"15min":1.431},"last":1.099},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.92500000000000004}]},{"osd":1,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88600000000000001,"15min":0.88900000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.88200000000000001,"15min":0.878},"min":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1000000000000001,"5min":1.401,"15min":1.401},"last":0.95299999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.64500000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":0.98899999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.254,"5min":1.3,"15min":1.3},"last":1.0149999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.0249999999999999,"15min":1.034},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.536,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.88400000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.66900000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1759999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.02,"15min":1.0229999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.585,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1830000000000001,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0600000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.321,"5min":1.333,"15min":1.333},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.1759999999999999,"15min":1.181},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.625,"5min":1.905,"15min":1.905},"last":1.0329999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":647168,"data_stored":295194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":2.742},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.28499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.72899999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.63700000000000001,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.774,"5min":3.774,"15min":3.774},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72799999999999998,"15min":0.72499999999999998},"min":{"1min":0.46700000000000003,"5min":0.31,"15min":0.31},"max":{"1min":1.153,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.97599999999999998,"15min":0.98799999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.345,"5min":1.708,"15min":1.708},"last":2.8959999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.96199999999999997,"15min":0.97099999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.167,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.876}]},{"osd":5,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.94499999999999995,"15min":0.94299999999999995},"min":{"1min":0.68300000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.206,"5min":1.506,"15min":1.506},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4419999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":2.8639999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.006,"15min":1.002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":2.806},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.0980000000000001,"15min":1.0600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.3410000000000002,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.96899999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.133,"15min":1.145},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.546,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":3.0390000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.04,"15min":1.0289999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":2.6920000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542175,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9164,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362676,"statfs":{"total":96636764160,"available":96627380224,"internally_reserved":0,"allocated":659456,"data_stored":302167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97999999999999998,"5min":1.107,"15min":1.107},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88300000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82499999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97399999999999998,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.96699999999999997,"15min":0.97999999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.151,"5min":1.371,"15min":1.371},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.96999999999999997,"15min":0.98199999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.385,"5min":1.532,"15min":1.532},"last":0.88400000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98199999999999998,"15min":0.98899999999999999},"min":{"1min":0.749,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.196,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.99199999999999999,"15min":1.004},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2549999999999999,"5min":1.327,"15min":1.327},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0429999999999999,"15min":1.0609999999999999},"min":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.2789999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0469999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4730000000000001,"5min":1.76,"15min":1.76},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0609999999999999,"15min":1.075},"min":{"1min":0.75900000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.2949999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0049999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10252,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361588,"statfs":{"total":96636764160,"available":96626266112,"internally_reserved":0,"allocated":1249280,"data_stored":892569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.93600000000000005,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.028,"5min":1.089,"15min":1.089},"last":0.69399999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98199999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.625},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.081,"5min":1.393,"15min":1.393},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":1.744,"15min":1.744},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.302,"5min":1.609,"15min":1.609},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.999,"15min":1.0049999999999999},"min":{"1min":0.71299999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.1799999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.83599999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.254,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.087,"15min":1.1020000000000001},"min":{"1min":0.70699999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":0.999},"min":{"1min":0.73299999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.282,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.66700000000000004}]},{"osd":7,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.069,"15min":1.081},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.339,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.115,"15min":1.127},"min":{"1min":0.81499999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2829999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.78600000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9360,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362480,"statfs":{"total":96636764160,"available":96627179520,"internally_reserved":0,"allocated":663552,"data_stored":303239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98899999999999999,"5min":1.155,"15min":1.155},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.88800000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.877,"15min":0.875},"min":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1359999999999999,"5min":1.423,"15min":1.423},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.0009999999999999,"15min":1.0149999999999999},"min":{"1min":0.73399999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2370000000000001,"5min":1.399,"15min":1.399},"last":0.999}]},{"osd":5,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0209999999999999,"15min":1.026},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.28,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.0049999999999999,"15min":1.004},"min":{"1min":0.78300000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.226,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0900000000000001,"15min":1.101},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.123,"15min":1.139},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.3939999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.96999999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.139,"15min":1.155},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.345,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0820000000000001,"15min":1.089},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.325,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2729999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:15:12.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:15:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 Processor -- start 2023-11-29T11:15:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- start start 2023-11-29T11:15:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fed840cace0 0x7fed840cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 0x7fed840c4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed840cddb0 con 0x7fed840c6bd0 2023-11-29T11:15:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed840b2b10 con 0x7fed840cace0 2023-11-29T11:15:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed840ccc00 con 0x7fed840cd960 2023-11-29T11:15:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fed840cace0 0x7fed840cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fed840cace0 0x7fed840cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:60698/0 (socket says 172.21.15.81:60698) 2023-11-29T11:15:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 -- 172.21.15.81:0/1073046127 learned_addr learned my addr 172.21.15.81:0/1073046127 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8999e700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fed840c6bd0 0x7fed840cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:54992/0 (socket says 172.21.15.81:54992) 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a19f700 1 --2- 172.21.15.81:0/1073046127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 0x7fed840c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 -- 172.21.15.81:0/1073046127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 msgr2=0x7fed840c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 --2- 172.21.15.81:0/1073046127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 0x7fed840c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 -- 172.21.15.81:0/1073046127 >> v1:172.21.15.176:6789/0 conn(0x7fed840c6bd0 legacy=0x7fed840cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 -- 172.21.15.81:0/1073046127 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed840c6fa0 con 0x7fed840cace0 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 --2- 172.21.15.81:0/1073046127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840cd420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009940 tx=0x7fed6c009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4caeb2200fa73281 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8899c700 1 -- 172.21.15.81:0/1073046127 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c011830 con 0x7fed840cace0 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8899c700 1 -- 172.21.15.81:0/1073046127 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c011990 con 0x7fed840cace0 2023-11-29T11:15:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8899c700 1 -- 172.21.15.81:0/1073046127 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c011d20 con 0x7fed840cace0 2023-11-29T11:15:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- 172.21.15.81:0/1073046127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 msgr2=0x7fed840cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/1073046127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840cd420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009940 tx=0x7fed6c009c50 comp rx=0 tx=0).stop 2023-11-29T11:15:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- 172.21.15.81:0/1073046127 shutdown_connections 2023-11-29T11:15:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/1073046127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 0x7fed840c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/1073046127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840cd420 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- 172.21.15.81:0/1073046127 >> 172.21.15.81:0/1073046127 conn(0x7fed84069c40 msgr2=0x7fed8406a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- 172.21.15.81:0/1073046127 shutdown_connections 2023-11-29T11:15:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- 172.21.15.81:0/1073046127 wait complete. 2023-11-29T11:15:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 Processor -- start 2023-11-29T11:15:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- start start 2023-11-29T11:15:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed840c6bd0 0x7fed841542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 0x7fed840cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed840b5300 con 0x7fed840c6bd0 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed841f22a0 con 0x7fed840cace0 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a9a0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed840b4540 con 0x7fed840cd960 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8999e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed840c6bd0 0x7fed841542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8a19f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 0x7fed840cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:60712/0 (socket says 172.21.15.81:60712) 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.703+0000 7fed8919d700 1 -- 172.21.15.81:0/2550969447 learned_addr learned my addr 172.21.15.81:0/2550969447 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8919d700 1 -- 172.21.15.81:0/2550969447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 msgr2=0x7fed840cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8919d700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 0x7fed840cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8919d700 1 -- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed840c6bd0 msgr2=0x7fed841542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8919d700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed840c6bd0 0x7fed841542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8919d700 1 -- 172.21.15.81:0/2550969447 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c009570 con 0x7fed840cace0 2023-11-29T11:15:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8919d700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840ce520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed8406b200 tx=0x7fed6c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed827fc700 1 -- 172.21.15.81:0/2550969447 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c004380 con 0x7fed840cace0 2023-11-29T11:15:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed827fc700 1 -- 172.21.15.81:0/2550969447 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c01f070 con 0x7fed840cace0 2023-11-29T11:15:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed840b2f30 con 0x7fed840cace0 2023-11-29T11:15:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed827fc700 1 -- 172.21.15.81:0/2550969447 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0036c0 con 0x7fed840cace0 2023-11-29T11:15:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed840b21b0 con 0x7fed840cace0 2023-11-29T11:15:12.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed840b2430 con 0x7fed840cace0 2023-11-29T11:15:12.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.707+0000 7fed827fc700 1 -- 172.21.15.81:0/2550969447 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fed6c02a020 con 0x7fed840cace0 2023-11-29T11:15:12.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.711+0000 7fed827fc700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed64064ee0 0x7fed64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:12.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.711+0000 7fed827fc700 1 -- 172.21.15.81:0/2550969447 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fed6c083650 con 0x7fed840cace0 2023-11-29T11:15:12.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.711+0000 7fed8999e700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed64064ee0 0x7fed64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:12.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.711+0000 7fed8999e700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed64064ee0 0x7fed64067390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed74000f60 tx=0x7fed74007eb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:12.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.723+0000 7fed827fc700 1 -- 172.21.15.81:0/2550969447 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fed6c0516b0 con 0x7fed840cace0 2023-11-29T11:15:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.875+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed84072c20 con 0x7fed64064ee0 2023-11-29T11:15:12.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.891+0000 7fed827fc700 1 -- 172.21.15.81:0/2550969447 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310276 (secure 0 0 0) 0x7fed84072c20 con 0x7fed64064ee0 2023-11-29T11:15:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed64064ee0 msgr2=0x7fed64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed64064ee0 0x7fed64067390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed74000f60 tx=0x7fed74007eb0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 msgr2=0x7fed840ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840ce520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed8406b200 tx=0x7fed6c004770 comp rx=0 tx=0).stop 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 shutdown_connections 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed64064ee0 0x7fed64067390 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed840cd960 0x7fed840cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed840cace0 0x7fed840ce520 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 --2- 172.21.15.81:0/2550969447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed840c6bd0 0x7fed841542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:12.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 >> 172.21.15.81:0/2550969447 conn(0x7fed84069c40 msgr2=0x7fed8406f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:12.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 shutdown_connections 2023-11-29T11:15:12.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:12.899+0000 7fed8a9a0700 1 -- 172.21.15.81:0/2550969447 wait complete. 2023-11-29T11:15:12.908 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:15:12.920 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-11-29T11:15:12.471426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76096,"kb_used_data":6272,"kb_used_omap":0,"kb_used_meta":69760,"kb_avail":754898624,"statfs":{"total":773094113280,"available":773016190976,"internally_reserved":0,"allocated":6422528,"data_stored":3580379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71434240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.301646"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288831+0000","last_change":"2023-11-29T11:15:08.578841+0000","last_active":"2023-11-29T11:15:10.288831+0000","last_peered":"2023-11-29T11:15:10.288831+0000","last_clean":"2023-11-29T11:15:10.288831+0000","last_became_active":"2023-11-29T11:15:08.578583+0000","last_became_peered":"2023-11-29T11:15:08.578583+0000","last_unstale":"2023-11-29T11:15:10.288831+0000","last_undegraded":"2023-11-29T11:15:10.288831+0000","last_fullsized":"2023-11-29T11:15:10.288831+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:18:38.310642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287792+0000","last_change":"2023-11-29T11:15:08.584740+0000","last_active":"2023-11-29T11:15:10.287792+0000","last_peered":"2023-11-29T11:15:10.287792+0000","last_clean":"2023-11-29T11:15:10.287792+0000","last_became_active":"2023-11-29T11:15:08.583974+0000","last_became_peered":"2023-11-29T11:15:08.583974+0000","last_unstale":"2023-11-29T11:15:10.287792+0000","last_undegraded":"2023-11-29T11:15:10.287792+0000","last_fullsized":"2023-11-29T11:15:10.287792+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:10:42.029997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568484+0000","last_change":"2023-11-29T11:15:08.580380+0000","last_active":"2023-11-29T11:15:09.568484+0000","last_peered":"2023-11-29T11:15:09.568484+0000","last_clean":"2023-11-29T11:15:09.568484+0000","last_became_active":"2023-11-29T11:15:08.579169+0000","last_became_peered":"2023-11-29T11:15:08.579169+0000","last_unstale":"2023-11-29T11:15:09.568484+0000","last_undegraded":"2023-11-29T11:15:09.568484+0000","last_fullsized":"2023-11-29T11:15:09.568484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:12:14.883693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569606+0000","last_change":"2023-11-29T11:15:08.569669+0000","last_active":"2023-11-29T11:15:09.569606+0000","last_peered":"2023-11-29T11:15:09.569606+0000","last_clean":"2023-11-29T11:15:09.569606+0000","last_became_active":"2023-11-29T11:15:08.569368+0000","last_became_peered":"2023-11-29T11:15:08.569368+0000","last_unstale":"2023-11-29T11:15:09.569606+0000","last_undegraded":"2023-11-29T11:15:09.569606+0000","last_fullsized":"2023-11-29T11:15:09.569606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:39:37.945277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288504+0000","last_change":"2023-11-29T11:15:08.572961+0000","last_active":"2023-11-29T11:15:10.288504+0000","last_peered":"2023-11-29T11:15:10.288504+0000","last_clean":"2023-11-29T11:15:10.288504+0000","last_became_active":"2023-11-29T11:15:08.572679+0000","last_became_peered":"2023-11-29T11:15:08.572679+0000","last_unstale":"2023-11-29T11:15:10.288504+0000","last_undegraded":"2023-11-29T11:15:10.288504+0000","last_fullsized":"2023-11-29T11:15:10.288504+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:36:58.685175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890540+0000","last_change":"2023-11-29T11:15:08.569286+0000","last_active":"2023-11-29T11:15:09.890540+0000","last_peered":"2023-11-29T11:15:09.890540+0000","last_clean":"2023-11-29T11:15:09.890540+0000","last_became_active":"2023-11-29T11:15:08.569031+0000","last_became_peered":"2023-11-29T11:15:08.569031+0000","last_unstale":"2023-11-29T11:15:09.890540+0000","last_undegraded":"2023-11-29T11:15:09.890540+0000","last_fullsized":"2023-11-29T11:15:09.890540+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:23:25.843218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.285846+0000","last_change":"2023-11-29T11:15:08.578149+0000","last_active":"2023-11-29T11:15:10.285846+0000","last_peered":"2023-11-29T11:15:10.285846+0000","last_clean":"2023-11-29T11:15:10.285846+0000","last_became_active":"2023-11-29T11:15:08.577828+0000","last_became_peered":"2023-11-29T11:15:08.577828+0000","last_unstale":"2023-11-29T11:15:10.285846+0000","last_undegraded":"2023-11-29T11:15:10.285846+0000","last_fullsized":"2023-11-29T11:15:10.285846+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:10:42.029997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286510+0000","last_change":"2023-11-29T11:15:08.581019+0000","last_active":"2023-11-29T11:15:10.286510+0000","last_peered":"2023-11-29T11:15:10.286510+0000","last_clean":"2023-11-29T11:15:10.286510+0000","last_became_active":"2023-11-29T11:15:08.580760+0000","last_became_peered":"2023-11-29T11:15:08.580760+0000","last_unstale":"2023-11-29T11:15:10.286510+0000","last_undegraded":"2023-11-29T11:15:10.286510+0000","last_fullsized":"2023-11-29T11:15:10.286510+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:23:25.843218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286541+0000","last_change":"2023-11-29T11:15:08.578404+0000","last_active":"2023-11-29T11:15:10.286541+0000","last_peered":"2023-11-29T11:15:10.286541+0000","last_clean":"2023-11-29T11:15:10.286541+0000","last_became_active":"2023-11-29T11:15:08.578067+0000","last_became_peered":"2023-11-29T11:15:08.578067+0000","last_unstale":"2023-11-29T11:15:10.286541+0000","last_undegraded":"2023-11-29T11:15:10.286541+0000","last_fullsized":"2023-11-29T11:15:10.286541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:35:04.785257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564634+0000","last_change":"2023-11-29T11:15:08.569215+0000","last_active":"2023-11-29T11:15:09.564634+0000","last_peered":"2023-11-29T11:15:09.564634+0000","last_clean":"2023-11-29T11:15:09.564634+0000","last_became_active":"2023-11-29T11:15:08.568960+0000","last_became_peered":"2023-11-29T11:15:08.568960+0000","last_unstale":"2023-11-29T11:15:09.564634+0000","last_undegraded":"2023-11-29T11:15:09.564634+0000","last_fullsized":"2023-11-29T11:15:09.564634+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:20:06.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564547+0000","last_change":"2023-11-29T11:15:08.580136+0000","last_active":"2023-11-29T11:15:09.564547+0000","last_peered":"2023-11-29T11:15:09.564547+0000","last_clean":"2023-11-29T11:15:09.564547+0000","last_became_active":"2023-11-29T11:15:08.577966+0000","last_became_peered":"2023-11-29T11:15:08.577966+0000","last_unstale":"2023-11-29T11:15:09.564547+0000","last_undegraded":"2023-11-29T11:15:09.564547+0000","last_fullsized":"2023-11-29T11:15:09.564547+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:48:01.079643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569603+0000","last_change":"2023-11-29T11:15:08.569798+0000","last_active":"2023-11-29T11:15:09.569603+0000","last_peered":"2023-11-29T11:15:09.569603+0000","last_clean":"2023-11-29T11:15:09.569603+0000","last_became_active":"2023-11-29T11:15:08.569494+0000","last_became_peered":"2023-11-29T11:15:08.569494+0000","last_unstale":"2023-11-29T11:15:09.569603+0000","last_undegraded":"2023-11-29T11:15:09.569603+0000","last_fullsized":"2023-11-29T11:15:09.569603+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:30:01.683255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287643+0000","last_change":"2023-11-29T11:15:08.572758+0000","last_active":"2023-11-29T11:15:10.287643+0000","last_peered":"2023-11-29T11:15:10.287643+0000","last_clean":"2023-11-29T11:15:10.287643+0000","last_became_active":"2023-11-29T11:15:08.572291+0000","last_became_peered":"2023-11-29T11:15:08.572291+0000","last_unstale":"2023-11-29T11:15:10.287643+0000","last_undegraded":"2023-11-29T11:15:10.287643+0000","last_fullsized":"2023-11-29T11:15:10.287643+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:14:20.079125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286367+0000","last_change":"2023-11-29T11:15:08.578309+0000","last_active":"2023-11-29T11:15:10.286367+0000","last_peered":"2023-11-29T11:15:10.286367+0000","last_clean":"2023-11-29T11:15:10.286367+0000","last_became_active":"2023-11-29T11:15:08.577885+0000","last_became_peered":"2023-11-29T11:15:08.577885+0000","last_unstale":"2023-11-29T11:15:10.286367+0000","last_undegraded":"2023-11-29T11:15:10.286367+0000","last_fullsized":"2023-11-29T11:15:10.286367+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:23:25.843218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286403+0000","last_change":"2023-11-29T11:15:08.588428+0000","last_active":"2023-11-29T11:15:10.286403+0000","last_peered":"2023-11-29T11:15:10.286403+0000","last_clean":"2023-11-29T11:15:10.286403+0000","last_became_active":"2023-11-29T11:15:08.588114+0000","last_became_peered":"2023-11-29T11:15:08.588114+0000","last_unstale":"2023-11-29T11:15:10.286403+0000","last_undegraded":"2023-11-29T11:15:10.286403+0000","last_fullsized":"2023-11-29T11:15:10.286403+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:27.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890182+0000","last_change":"2023-11-29T11:15:08.572512+0000","last_active":"2023-11-29T11:15:09.890182+0000","last_peered":"2023-11-29T11:15:09.890182+0000","last_clean":"2023-11-29T11:15:09.890182+0000","last_became_active":"2023-11-29T11:15:08.572255+0000","last_became_peered":"2023-11-29T11:15:08.572255+0000","last_unstale":"2023-11-29T11:15:09.890182+0000","last_undegraded":"2023-11-29T11:15:09.890182+0000","last_fullsized":"2023-11-29T11:15:09.890182+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:27.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287715+0000","last_change":"2023-11-29T11:15:08.577753+0000","last_active":"2023-11-29T11:15:10.287715+0000","last_peered":"2023-11-29T11:15:10.287715+0000","last_clean":"2023-11-29T11:15:10.287715+0000","last_became_active":"2023-11-29T11:15:08.577520+0000","last_became_peered":"2023-11-29T11:15:08.577520+0000","last_unstale":"2023-11-29T11:15:10.287715+0000","last_undegraded":"2023-11-29T11:15:10.287715+0000","last_fullsized":"2023-11-29T11:15:10.287715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:27:27.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568897+0000","last_change":"2023-11-29T11:15:08.578152+0000","last_active":"2023-11-29T11:15:09.568897+0000","last_peered":"2023-11-29T11:15:09.568897+0000","last_clean":"2023-11-29T11:15:09.568897+0000","last_became_active":"2023-11-29T11:15:08.577900+0000","last_became_peered":"2023-11-29T11:15:08.577900+0000","last_unstale":"2023-11-29T11:15:09.568897+0000","last_undegraded":"2023-11-29T11:15:09.568897+0000","last_fullsized":"2023-11-29T11:15:09.568897+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:05:19.825175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288575+0000","last_change":"2023-11-29T11:15:08.582131+0000","last_active":"2023-11-29T11:15:10.288575+0000","last_peered":"2023-11-29T11:15:10.288575+0000","last_clean":"2023-11-29T11:15:10.288575+0000","last_became_active":"2023-11-29T11:15:08.581857+0000","last_became_peered":"2023-11-29T11:15:08.581857+0000","last_unstale":"2023-11-29T11:15:10.288575+0000","last_undegraded":"2023-11-29T11:15:10.288575+0000","last_fullsized":"2023-11-29T11:15:10.288575+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:59:19.787296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287367+0000","last_change":"2023-11-29T11:15:08.581568+0000","last_active":"2023-11-29T11:15:10.287367+0000","last_peered":"2023-11-29T11:15:10.287367+0000","last_clean":"2023-11-29T11:15:10.287367+0000","last_became_active":"2023-11-29T11:15:08.581318+0000","last_became_peered":"2023-11-29T11:15:08.581318+0000","last_unstale":"2023-11-29T11:15:10.287367+0000","last_undegraded":"2023-11-29T11:15:10.287367+0000","last_fullsized":"2023-11-29T11:15:10.287367+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:15.130261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567992+0000","last_change":"2023-11-29T11:15:08.572140+0000","last_active":"2023-11-29T11:15:09.567992+0000","last_peered":"2023-11-29T11:15:09.567992+0000","last_clean":"2023-11-29T11:15:09.567992+0000","last_became_active":"2023-11-29T11:15:08.571843+0000","last_became_peered":"2023-11-29T11:15:08.571843+0000","last_unstale":"2023-11-29T11:15:09.567992+0000","last_undegraded":"2023-11-29T11:15:09.567992+0000","last_fullsized":"2023-11-29T11:15:09.567992+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:37.737844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286664+0000","last_change":"2023-11-29T11:15:08.585408+0000","last_active":"2023-11-29T11:15:10.286664+0000","last_peered":"2023-11-29T11:15:10.286664+0000","last_clean":"2023-11-29T11:15:10.286664+0000","last_became_active":"2023-11-29T11:15:08.585053+0000","last_became_peered":"2023-11-29T11:15:08.585053+0000","last_unstale":"2023-11-29T11:15:10.286664+0000","last_undegraded":"2023-11-29T11:15:10.286664+0000","last_fullsized":"2023-11-29T11:15:10.286664+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:54:15.014685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567685+0000","last_change":"2023-11-29T11:15:08.582904+0000","last_active":"2023-11-29T11:15:09.567685+0000","last_peered":"2023-11-29T11:15:09.567685+0000","last_clean":"2023-11-29T11:15:09.567685+0000","last_became_active":"2023-11-29T11:15:08.581420+0000","last_became_peered":"2023-11-29T11:15:08.581420+0000","last_unstale":"2023-11-29T11:15:09.567685+0000","last_undegraded":"2023-11-29T11:15:09.567685+0000","last_fullsized":"2023-11-29T11:15:09.567685+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:38:48.839284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286882+0000","last_change":"2023-11-29T11:15:08.573862+0000","last_active":"2023-11-29T11:15:10.286882+0000","last_peered":"2023-11-29T11:15:10.286882+0000","last_clean":"2023-11-29T11:15:10.286882+0000","last_became_active":"2023-11-29T11:15:08.573142+0000","last_became_peered":"2023-11-29T11:15:08.573142+0000","last_unstale":"2023-11-29T11:15:10.286882+0000","last_undegraded":"2023-11-29T11:15:10.286882+0000","last_fullsized":"2023-11-29T11:15:10.286882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:24:57.508560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.289053+0000","last_change":"2023-11-29T11:15:08.588772+0000","last_active":"2023-11-29T11:15:10.289053+0000","last_peered":"2023-11-29T11:15:10.289053+0000","last_clean":"2023-11-29T11:15:10.289053+0000","last_became_active":"2023-11-29T11:15:08.588492+0000","last_became_peered":"2023-11-29T11:15:08.588492+0000","last_unstale":"2023-11-29T11:15:10.289053+0000","last_undegraded":"2023-11-29T11:15:10.289053+0000","last_fullsized":"2023-11-29T11:15:10.289053+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:41:06.783897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569854+0000","last_change":"2023-11-29T11:15:08.579244+0000","last_active":"2023-11-29T11:15:09.569854+0000","last_peered":"2023-11-29T11:15:09.569854+0000","last_clean":"2023-11-29T11:15:09.569854+0000","last_became_active":"2023-11-29T11:15:08.578967+0000","last_became_peered":"2023-11-29T11:15:08.578967+0000","last_unstale":"2023-11-29T11:15:09.569854+0000","last_undegraded":"2023-11-29T11:15:09.569854+0000","last_fullsized":"2023-11-29T11:15:09.569854+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:38:09.602618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890966+0000","last_change":"2023-11-29T11:15:08.572805+0000","last_active":"2023-11-29T11:15:09.890966+0000","last_peered":"2023-11-29T11:15:09.890966+0000","last_clean":"2023-11-29T11:15:09.890966+0000","last_became_active":"2023-11-29T11:15:08.572535+0000","last_became_peered":"2023-11-29T11:15:08.572535+0000","last_unstale":"2023-11-29T11:15:09.890966+0000","last_undegraded":"2023-11-29T11:15:09.890966+0000","last_fullsized":"2023-11-29T11:15:09.890966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:04:09.208142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288561+0000","last_change":"2023-11-29T11:15:08.573080+0000","last_active":"2023-11-29T11:15:10.288561+0000","last_peered":"2023-11-29T11:15:10.288561+0000","last_clean":"2023-11-29T11:15:10.288561+0000","last_became_active":"2023-11-29T11:15:08.572808+0000","last_became_peered":"2023-11-29T11:15:08.572808+0000","last_unstale":"2023-11-29T11:15:10.288561+0000","last_undegraded":"2023-11-29T11:15:10.288561+0000","last_fullsized":"2023-11-29T11:15:10.288561+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:28:39.244025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287643+0000","last_change":"2023-11-29T11:15:08.574771+0000","last_active":"2023-11-29T11:15:10.287643+0000","last_peered":"2023-11-29T11:15:10.287643+0000","last_clean":"2023-11-29T11:15:10.287643+0000","last_became_active":"2023-11-29T11:15:08.574502+0000","last_became_peered":"2023-11-29T11:15:08.574502+0000","last_unstale":"2023-11-29T11:15:10.287643+0000","last_undegraded":"2023-11-29T11:15:10.287643+0000","last_fullsized":"2023-11-29T11:15:10.287643+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:12:17.966864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567767+0000","last_change":"2023-11-29T11:15:08.580976+0000","last_active":"2023-11-29T11:15:09.567767+0000","last_peered":"2023-11-29T11:15:09.567767+0000","last_clean":"2023-11-29T11:15:09.567767+0000","last_became_active":"2023-11-29T11:15:08.580432+0000","last_became_peered":"2023-11-29T11:15:08.580432+0000","last_unstale":"2023-11-29T11:15:09.567767+0000","last_undegraded":"2023-11-29T11:15:09.567767+0000","last_fullsized":"2023-11-29T11:15:09.567767+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:45.068666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286715+0000","last_change":"2023-11-29T11:15:08.588702+0000","last_active":"2023-11-29T11:15:10.286715+0000","last_peered":"2023-11-29T11:15:10.286715+0000","last_clean":"2023-11-29T11:15:10.286715+0000","last_became_active":"2023-11-29T11:15:08.588410+0000","last_became_peered":"2023-11-29T11:15:08.588410+0000","last_unstale":"2023-11-29T11:15:10.286715+0000","last_undegraded":"2023-11-29T11:15:10.286715+0000","last_fullsized":"2023-11-29T11:15:10.286715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:36:04.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890203+0000","last_change":"2023-11-29T11:15:08.586269+0000","last_active":"2023-11-29T11:15:09.890203+0000","last_peered":"2023-11-29T11:15:09.890203+0000","last_clean":"2023-11-29T11:15:09.890203+0000","last_became_active":"2023-11-29T11:15:08.585989+0000","last_became_peered":"2023-11-29T11:15:08.585989+0000","last_unstale":"2023-11-29T11:15:09.890203+0000","last_undegraded":"2023-11-29T11:15:09.890203+0000","last_fullsized":"2023-11-29T11:15:09.890203+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:10:42.029997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891586+0000","last_change":"2023-11-29T11:15:08.582424+0000","last_active":"2023-11-29T11:15:09.891586+0000","last_peered":"2023-11-29T11:15:09.891586+0000","last_clean":"2023-11-29T11:15:09.891586+0000","last_became_active":"2023-11-29T11:15:08.582171+0000","last_became_peered":"2023-11-29T11:15:08.582171+0000","last_unstale":"2023-11-29T11:15:09.891586+0000","last_undegraded":"2023-11-29T11:15:09.891586+0000","last_fullsized":"2023-11-29T11:15:09.891586+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:49:40.731455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"54'4","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891860+0000","last_change":"2023-11-29T11:15:08.206183+0000","last_active":"2023-11-29T11:15:09.891860+0000","last_peered":"2023-11-29T11:15:09.891860+0000","last_clean":"2023-11-29T11:15:09.891860+0000","last_became_active":"2023-11-29T11:15:08.205893+0000","last_became_peered":"2023-11-29T11:15:08.205893+0000","last_unstale":"2023-11-29T11:15:09.891860+0000","last_undegraded":"2023-11-29T11:15:09.891860+0000","last_fullsized":"2023-11-29T11:15:09.891860+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:11:26.113956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564563+0000","last_change":"2023-11-29T11:15:08.576821+0000","last_active":"2023-11-29T11:15:09.564563+0000","last_peered":"2023-11-29T11:15:09.564563+0000","last_clean":"2023-11-29T11:15:09.564563+0000","last_became_active":"2023-11-29T11:15:08.576540+0000","last_became_peered":"2023-11-29T11:15:08.576540+0000","last_unstale":"2023-11-29T11:15:09.564563+0000","last_undegraded":"2023-11-29T11:15:09.564563+0000","last_fullsized":"2023-11-29T11:15:09.564563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:16:53.354545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287940+0000","last_change":"2023-11-29T11:15:08.208357+0000","last_active":"2023-11-29T11:15:10.287940+0000","last_peered":"2023-11-29T11:15:10.287940+0000","last_clean":"2023-11-29T11:15:10.287940+0000","last_became_active":"2023-11-29T11:15:08.208074+0000","last_became_peered":"2023-11-29T11:15:08.208074+0000","last_unstale":"2023-11-29T11:15:10.287940+0000","last_undegraded":"2023-11-29T11:15:10.287940+0000","last_fullsized":"2023-11-29T11:15:10.287940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:11:26.113956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890950+0000","last_change":"2023-11-29T11:15:08.570400+0000","last_active":"2023-11-29T11:15:09.890950+0000","last_peered":"2023-11-29T11:15:09.890950+0000","last_clean":"2023-11-29T11:15:09.890950+0000","last_became_active":"2023-11-29T11:15:08.570134+0000","last_became_peered":"2023-11-29T11:15:08.570134+0000","last_unstale":"2023-11-29T11:15:09.890950+0000","last_undegraded":"2023-11-29T11:15:09.890950+0000","last_fullsized":"2023-11-29T11:15:09.890950+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:49.990573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891420+0000","last_change":"2023-11-29T11:15:08.210200+0000","last_active":"2023-11-29T11:15:09.891420+0000","last_peered":"2023-11-29T11:15:09.891420+0000","last_clean":"2023-11-29T11:15:09.891420+0000","last_became_active":"2023-11-29T11:15:08.210021+0000","last_became_peered":"2023-11-29T11:15:08.210021+0000","last_unstale":"2023-11-29T11:15:09.891420+0000","last_undegraded":"2023-11-29T11:15:09.891420+0000","last_fullsized":"2023-11-29T11:15:09.891420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:36.725124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890971+0000","last_change":"2023-11-29T11:15:08.575005+0000","last_active":"2023-11-29T11:15:09.890971+0000","last_peered":"2023-11-29T11:15:09.890971+0000","last_clean":"2023-11-29T11:15:09.890971+0000","last_became_active":"2023-11-29T11:15:08.574715+0000","last_became_peered":"2023-11-29T11:15:08.574715+0000","last_unstale":"2023-11-29T11:15:09.890971+0000","last_undegraded":"2023-11-29T11:15:09.890971+0000","last_fullsized":"2023-11-29T11:15:09.890971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:35:04.785257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569799+0000","last_change":"2023-11-29T11:15:08.201244+0000","last_active":"2023-11-29T11:15:09.569799+0000","last_peered":"2023-11-29T11:15:09.569799+0000","last_clean":"2023-11-29T11:15:09.569799+0000","last_became_active":"2023-11-29T11:15:08.201042+0000","last_became_peered":"2023-11-29T11:15:08.201042+0000","last_unstale":"2023-11-29T11:15:09.569799+0000","last_undegraded":"2023-11-29T11:15:09.569799+0000","last_fullsized":"2023-11-29T11:15:09.569799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:20:09.258129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286799+0000","last_change":"2023-11-29T11:15:08.581930+0000","last_active":"2023-11-29T11:15:10.286799+0000","last_peered":"2023-11-29T11:15:10.286799+0000","last_clean":"2023-11-29T11:15:10.286799+0000","last_became_active":"2023-11-29T11:15:08.581674+0000","last_became_peered":"2023-11-29T11:15:08.581674+0000","last_unstale":"2023-11-29T11:15:10.286799+0000","last_undegraded":"2023-11-29T11:15:10.286799+0000","last_fullsized":"2023-11-29T11:15:10.286799+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:35:04.785257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286220+0000","last_change":"2023-11-29T11:15:08.214897+0000","last_active":"2023-11-29T11:15:10.286220+0000","last_peered":"2023-11-29T11:15:10.286220+0000","last_clean":"2023-11-29T11:15:10.286220+0000","last_became_active":"2023-11-29T11:15:08.214630+0000","last_became_peered":"2023-11-29T11:15:08.214630+0000","last_unstale":"2023-11-29T11:15:10.286220+0000","last_undegraded":"2023-11-29T11:15:10.286220+0000","last_fullsized":"2023-11-29T11:15:10.286220+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:55:26.720056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287286+0000","last_change":"2023-11-29T11:15:08.577672+0000","last_active":"2023-11-29T11:15:10.287286+0000","last_peered":"2023-11-29T11:15:10.287286+0000","last_clean":"2023-11-29T11:15:10.287286+0000","last_became_active":"2023-11-29T11:15:08.572147+0000","last_became_peered":"2023-11-29T11:15:08.572147+0000","last_unstale":"2023-11-29T11:15:10.287286+0000","last_undegraded":"2023-11-29T11:15:10.287286+0000","last_fullsized":"2023-11-29T11:15:10.287286+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:16:45.989075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890609+0000","last_change":"2023-11-29T11:15:08.208974+0000","last_active":"2023-11-29T11:15:09.890609+0000","last_peered":"2023-11-29T11:15:09.890609+0000","last_clean":"2023-11-29T11:15:09.890609+0000","last_became_active":"2023-11-29T11:15:08.208717+0000","last_became_peered":"2023-11-29T11:15:08.208717+0000","last_unstale":"2023-11-29T11:15:09.890609+0000","last_undegraded":"2023-11-29T11:15:09.890609+0000","last_fullsized":"2023-11-29T11:15:09.890609+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:46:44.055946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287019+0000","last_change":"2023-11-29T11:15:08.579648+0000","last_active":"2023-11-29T11:15:10.287019+0000","last_peered":"2023-11-29T11:15:10.287019+0000","last_clean":"2023-11-29T11:15:10.287019+0000","last_became_active":"2023-11-29T11:15:08.579369+0000","last_became_peered":"2023-11-29T11:15:08.579369+0000","last_unstale":"2023-11-29T11:15:10.287019+0000","last_undegraded":"2023-11-29T11:15:10.287019+0000","last_fullsized":"2023-11-29T11:15:10.287019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:47:57.555191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569067+0000","last_change":"2023-11-29T11:15:08.205695+0000","last_active":"2023-11-29T11:15:09.569067+0000","last_peered":"2023-11-29T11:15:09.569067+0000","last_clean":"2023-11-29T11:15:09.569067+0000","last_became_active":"2023-11-29T11:15:08.205203+0000","last_became_peered":"2023-11-29T11:15:08.205203+0000","last_unstale":"2023-11-29T11:15:09.569067+0000","last_undegraded":"2023-11-29T11:15:09.569067+0000","last_fullsized":"2023-11-29T11:15:09.569067+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:54:45.331356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286995+0000","last_change":"2023-11-29T11:15:08.572755+0000","last_active":"2023-11-29T11:15:10.286995+0000","last_peered":"2023-11-29T11:15:10.286995+0000","last_clean":"2023-11-29T11:15:10.286995+0000","last_became_active":"2023-11-29T11:15:08.572427+0000","last_became_peered":"2023-11-29T11:15:08.572427+0000","last_unstale":"2023-11-29T11:15:10.286995+0000","last_undegraded":"2023-11-29T11:15:10.286995+0000","last_fullsized":"2023-11-29T11:15:10.286995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:09:39.332245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.285891+0000","last_change":"2023-11-29T11:15:08.210931+0000","last_active":"2023-11-29T11:15:10.285891+0000","last_peered":"2023-11-29T11:15:10.285891+0000","last_clean":"2023-11-29T11:15:10.285891+0000","last_became_active":"2023-11-29T11:15:08.210637+0000","last_became_peered":"2023-11-29T11:15:08.210637+0000","last_unstale":"2023-11-29T11:15:10.285891+0000","last_undegraded":"2023-11-29T11:15:10.285891+0000","last_fullsized":"2023-11-29T11:15:10.285891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:46:06.931313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286882+0000","last_change":"2023-11-29T11:15:08.588432+0000","last_active":"2023-11-29T11:15:10.286882+0000","last_peered":"2023-11-29T11:15:10.286882+0000","last_clean":"2023-11-29T11:15:10.286882+0000","last_became_active":"2023-11-29T11:15:08.588136+0000","last_became_peered":"2023-11-29T11:15:08.588136+0000","last_unstale":"2023-11-29T11:15:10.286882+0000","last_undegraded":"2023-11-29T11:15:10.286882+0000","last_fullsized":"2023-11-29T11:15:10.286882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:09:39.332245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569581+0000","last_change":"2023-11-29T11:15:08.211238+0000","last_active":"2023-11-29T11:15:09.569581+0000","last_peered":"2023-11-29T11:15:09.569581+0000","last_clean":"2023-11-29T11:15:09.569581+0000","last_became_active":"2023-11-29T11:15:08.210991+0000","last_became_peered":"2023-11-29T11:15:08.210991+0000","last_unstale":"2023-11-29T11:15:09.569581+0000","last_undegraded":"2023-11-29T11:15:09.569581+0000","last_fullsized":"2023-11-29T11:15:09.569581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:16:52.341825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569474+0000","last_change":"2023-11-29T11:15:08.587739+0000","last_active":"2023-11-29T11:15:09.569474+0000","last_peered":"2023-11-29T11:15:09.569474+0000","last_clean":"2023-11-29T11:15:09.569474+0000","last_became_active":"2023-11-29T11:15:08.587448+0000","last_became_peered":"2023-11-29T11:15:08.587448+0000","last_unstale":"2023-11-29T11:15:09.569474+0000","last_undegraded":"2023-11-29T11:15:09.569474+0000","last_fullsized":"2023-11-29T11:15:09.569474+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:56:22.003735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288053+0000","last_change":"2023-11-29T11:15:08.215350+0000","last_active":"2023-11-29T11:15:10.288053+0000","last_peered":"2023-11-29T11:15:10.288053+0000","last_clean":"2023-11-29T11:15:10.288053+0000","last_became_active":"2023-11-29T11:15:08.214981+0000","last_became_peered":"2023-11-29T11:15:08.214981+0000","last_unstale":"2023-11-29T11:15:10.288053+0000","last_undegraded":"2023-11-29T11:15:10.288053+0000","last_fullsized":"2023-11-29T11:15:10.288053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:40:38.015084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564363+0000","last_change":"2023-11-29T11:15:08.580476+0000","last_active":"2023-11-29T11:15:09.564363+0000","last_peered":"2023-11-29T11:15:09.564363+0000","last_clean":"2023-11-29T11:15:09.564363+0000","last_became_active":"2023-11-29T11:15:08.580188+0000","last_became_peered":"2023-11-29T11:15:08.580188+0000","last_unstale":"2023-11-29T11:15:09.564363+0000","last_undegraded":"2023-11-29T11:15:09.564363+0000","last_fullsized":"2023-11-29T11:15:09.564363+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:49:34.651943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"54'3","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568814+0000","last_change":"2023-11-29T11:15:08.209120+0000","last_active":"2023-11-29T11:15:09.568814+0000","last_peered":"2023-11-29T11:15:09.568814+0000","last_clean":"2023-11-29T11:15:09.568814+0000","last_became_active":"2023-11-29T11:15:08.208718+0000","last_became_peered":"2023-11-29T11:15:08.208718+0000","last_unstale":"2023-11-29T11:15:09.568814+0000","last_undegraded":"2023-11-29T11:15:09.568814+0000","last_fullsized":"2023-11-29T11:15:09.568814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:18:33.381289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568590+0000","last_change":"2023-11-29T11:15:08.584510+0000","last_active":"2023-11-29T11:15:09.568590+0000","last_peered":"2023-11-29T11:15:09.568590+0000","last_clean":"2023-11-29T11:15:09.568590+0000","last_became_active":"2023-11-29T11:15:08.584172+0000","last_became_peered":"2023-11-29T11:15:08.584172+0000","last_unstale":"2023-11-29T11:15:09.568590+0000","last_undegraded":"2023-11-29T11:15:09.568590+0000","last_fullsized":"2023-11-29T11:15:09.568590+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:13:15.033400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'6","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286716+0000","last_change":"2023-11-29T11:15:08.211926+0000","last_active":"2023-11-29T11:15:10.286716+0000","last_peered":"2023-11-29T11:15:10.286716+0000","last_clean":"2023-11-29T11:15:10.286716+0000","last_became_active":"2023-11-29T11:15:08.211662+0000","last_became_peered":"2023-11-29T11:15:08.211662+0000","last_unstale":"2023-11-29T11:15:10.286716+0000","last_undegraded":"2023-11-29T11:15:10.286716+0000","last_fullsized":"2023-11-29T11:15:10.286716+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:49:33.156333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569336+0000","last_change":"2023-11-29T11:15:08.568986+0000","last_active":"2023-11-29T11:15:09.569336+0000","last_peered":"2023-11-29T11:15:09.569336+0000","last_clean":"2023-11-29T11:15:09.569336+0000","last_became_active":"2023-11-29T11:15:08.568297+0000","last_became_peered":"2023-11-29T11:15:08.568297+0000","last_unstale":"2023-11-29T11:15:09.569336+0000","last_undegraded":"2023-11-29T11:15:09.569336+0000","last_fullsized":"2023-11-29T11:15:09.569336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:27:51.216003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287506+0000","last_change":"2023-11-29T11:15:08.215792+0000","last_active":"2023-11-29T11:15:10.287506+0000","last_peered":"2023-11-29T11:15:10.287506+0000","last_clean":"2023-11-29T11:15:10.287506+0000","last_became_active":"2023-11-29T11:15:08.215520+0000","last_became_peered":"2023-11-29T11:15:08.215520+0000","last_unstale":"2023-11-29T11:15:10.287506+0000","last_undegraded":"2023-11-29T11:15:10.287506+0000","last_fullsized":"2023-11-29T11:15:10.287506+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:12:13.870972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568094+0000","last_change":"2023-11-29T11:15:08.570030+0000","last_active":"2023-11-29T11:15:09.568094+0000","last_peered":"2023-11-29T11:15:09.568094+0000","last_clean":"2023-11-29T11:15:09.568094+0000","last_became_active":"2023-11-29T11:15:08.569759+0000","last_became_peered":"2023-11-29T11:15:08.569759+0000","last_unstale":"2023-11-29T11:15:09.568094+0000","last_undegraded":"2023-11-29T11:15:09.568094+0000","last_fullsized":"2023-11-29T11:15:09.568094+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:33:11.121188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287332+0000","last_change":"2023-11-29T11:15:08.203971+0000","last_active":"2023-11-29T11:15:10.287332+0000","last_peered":"2023-11-29T11:15:10.287332+0000","last_clean":"2023-11-29T11:15:10.287332+0000","last_became_active":"2023-11-29T11:15:08.203693+0000","last_became_peered":"2023-11-29T11:15:08.203693+0000","last_unstale":"2023-11-29T11:15:10.287332+0000","last_undegraded":"2023-11-29T11:15:10.287332+0000","last_fullsized":"2023-11-29T11:15:10.287332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:12:56.689018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.285751+0000","last_change":"2023-11-29T11:15:08.580505+0000","last_active":"2023-11-29T11:15:10.285751+0000","last_peered":"2023-11-29T11:15:10.285751+0000","last_clean":"2023-11-29T11:15:10.285751+0000","last_became_active":"2023-11-29T11:15:08.580192+0000","last_became_peered":"2023-11-29T11:15:08.580192+0000","last_unstale":"2023-11-29T11:15:10.285751+0000","last_undegraded":"2023-11-29T11:15:10.285751+0000","last_fullsized":"2023-11-29T11:15:10.285751+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:49:40.731455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569199+0000","last_change":"2023-11-29T11:15:08.201996+0000","last_active":"2023-11-29T11:15:09.569199+0000","last_peered":"2023-11-29T11:15:09.569199+0000","last_clean":"2023-11-29T11:15:09.569199+0000","last_became_active":"2023-11-29T11:15:08.201681+0000","last_became_peered":"2023-11-29T11:15:08.201681+0000","last_unstale":"2023-11-29T11:15:09.569199+0000","last_undegraded":"2023-11-29T11:15:09.569199+0000","last_fullsized":"2023-11-29T11:15:09.569199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:40:52.937195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567736+0000","last_change":"2023-11-29T11:15:08.582658+0000","last_active":"2023-11-29T11:15:09.567736+0000","last_peered":"2023-11-29T11:15:09.567736+0000","last_clean":"2023-11-29T11:15:09.567736+0000","last_became_active":"2023-11-29T11:15:08.582249+0000","last_became_peered":"2023-11-29T11:15:08.582249+0000","last_unstale":"2023-11-29T11:15:09.567736+0000","last_undegraded":"2023-11-29T11:15:09.567736+0000","last_fullsized":"2023-11-29T11:15:09.567736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:55:41.269273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"54'8","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.567794+0000","last_change":"2023-11-29T11:15:08.205489+0000","last_active":"2023-11-29T11:15:09.567794+0000","last_peered":"2023-11-29T11:15:09.567794+0000","last_clean":"2023-11-29T11:15:09.567794+0000","last_became_active":"2023-11-29T11:15:08.205150+0000","last_became_peered":"2023-11-29T11:15:08.205150+0000","last_unstale":"2023-11-29T11:15:09.567794+0000","last_undegraded":"2023-11-29T11:15:09.567794+0000","last_fullsized":"2023-11-29T11:15:09.567794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:20:30.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569787+0000","last_change":"2023-11-29T11:15:08.575414+0000","last_active":"2023-11-29T11:15:09.569787+0000","last_peered":"2023-11-29T11:15:09.569787+0000","last_clean":"2023-11-29T11:15:09.569787+0000","last_became_active":"2023-11-29T11:15:08.575115+0000","last_became_peered":"2023-11-29T11:15:08.575115+0000","last_unstale":"2023-11-29T11:15:09.569787+0000","last_undegraded":"2023-11-29T11:15:09.569787+0000","last_fullsized":"2023-11-29T11:15:09.569787+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:41:56.996540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564577+0000","last_change":"2023-11-29T11:15:08.203997+0000","last_active":"2023-11-29T11:15:09.564577+0000","last_peered":"2023-11-29T11:15:09.564577+0000","last_clean":"2023-11-29T11:15:09.564577+0000","last_became_active":"2023-11-29T11:15:08.203672+0000","last_became_peered":"2023-11-29T11:15:08.203672+0000","last_unstale":"2023-11-29T11:15:09.564577+0000","last_undegraded":"2023-11-29T11:15:09.564577+0000","last_fullsized":"2023-11-29T11:15:09.564577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:00:04.914821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.570070+0000","last_change":"2023-11-29T11:15:08.571551+0000","last_active":"2023-11-29T11:15:09.570070+0000","last_peered":"2023-11-29T11:15:09.570070+0000","last_clean":"2023-11-29T11:15:09.570070+0000","last_became_active":"2023-11-29T11:15:08.571282+0000","last_became_peered":"2023-11-29T11:15:08.571282+0000","last_unstale":"2023-11-29T11:15:09.570070+0000","last_undegraded":"2023-11-29T11:15:09.570070+0000","last_fullsized":"2023-11-29T11:15:09.570070+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:28:17.269618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891721+0000","last_change":"2023-11-29T11:15:08.206187+0000","last_active":"2023-11-29T11:15:09.891721+0000","last_peered":"2023-11-29T11:15:09.891721+0000","last_clean":"2023-11-29T11:15:09.891721+0000","last_became_active":"2023-11-29T11:15:08.205713+0000","last_became_peered":"2023-11-29T11:15:08.205713+0000","last_unstale":"2023-11-29T11:15:09.891721+0000","last_undegraded":"2023-11-29T11:15:09.891721+0000","last_fullsized":"2023-11-29T11:15:09.891721+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:05:18.812454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564276+0000","last_change":"2023-11-29T11:15:08.579931+0000","last_active":"2023-11-29T11:15:09.564276+0000","last_peered":"2023-11-29T11:15:09.564276+0000","last_clean":"2023-11-29T11:15:09.564276+0000","last_became_active":"2023-11-29T11:15:08.579654+0000","last_became_peered":"2023-11-29T11:15:08.579654+0000","last_unstale":"2023-11-29T11:15:09.564276+0000","last_undegraded":"2023-11-29T11:15:09.564276+0000","last_fullsized":"2023-11-29T11:15:09.564276+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:18:34.394010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287515+0000","last_change":"2023-11-29T11:15:08.205519+0000","last_active":"2023-11-29T11:15:10.287515+0000","last_peered":"2023-11-29T11:15:10.287515+0000","last_clean":"2023-11-29T11:15:10.287515+0000","last_became_active":"2023-11-29T11:15:08.205266+0000","last_became_peered":"2023-11-29T11:15:08.205266+0000","last_unstale":"2023-11-29T11:15:10.287515+0000","last_undegraded":"2023-11-29T11:15:10.287515+0000","last_fullsized":"2023-11-29T11:15:10.287515+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:15:57.059410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891230+0000","last_change":"2023-11-29T11:15:08.574143+0000","last_active":"2023-11-29T11:15:09.891230+0000","last_peered":"2023-11-29T11:15:09.891230+0000","last_clean":"2023-11-29T11:15:09.891230+0000","last_became_active":"2023-11-29T11:15:08.573844+0000","last_became_peered":"2023-11-29T11:15:08.573844+0000","last_unstale":"2023-11-29T11:15:09.891230+0000","last_undegraded":"2023-11-29T11:15:09.891230+0000","last_fullsized":"2023-11-29T11:15:09.891230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:08.200866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.570024+0000","last_change":"2023-11-29T11:15:08.206881+0000","last_active":"2023-11-29T11:15:09.570024+0000","last_peered":"2023-11-29T11:15:09.570024+0000","last_clean":"2023-11-29T11:15:09.570024+0000","last_became_active":"2023-11-29T11:15:08.206640+0000","last_became_peered":"2023-11-29T11:15:08.206640+0000","last_unstale":"2023-11-29T11:15:09.570024+0000","last_undegraded":"2023-11-29T11:15:09.570024+0000","last_fullsized":"2023-11-29T11:15:09.570024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:38:33.656872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286881+0000","last_change":"2023-11-29T11:15:08.587961+0000","last_active":"2023-11-29T11:15:10.286881+0000","last_peered":"2023-11-29T11:15:10.286881+0000","last_clean":"2023-11-29T11:15:10.286881+0000","last_became_active":"2023-11-29T11:15:08.587673+0000","last_became_peered":"2023-11-29T11:15:08.587673+0000","last_unstale":"2023-11-29T11:15:10.286881+0000","last_undegraded":"2023-11-29T11:15:10.286881+0000","last_fullsized":"2023-11-29T11:15:10.286881+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:04:09.208142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564156+0000","last_change":"2023-11-29T11:15:08.203424+0000","last_active":"2023-11-29T11:15:09.564156+0000","last_peered":"2023-11-29T11:15:09.564156+0000","last_clean":"2023-11-29T11:15:09.564156+0000","last_became_active":"2023-11-29T11:15:08.202905+0000","last_became_peered":"2023-11-29T11:15:08.202905+0000","last_unstale":"2023-11-29T11:15:09.564156+0000","last_undegraded":"2023-11-29T11:15:09.564156+0000","last_fullsized":"2023-11-29T11:15:09.564156+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:06:22.134360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568288+0000","last_change":"2023-11-29T11:15:08.579382+0000","last_active":"2023-11-29T11:15:09.568288+0000","last_peered":"2023-11-29T11:15:09.568288+0000","last_clean":"2023-11-29T11:15:09.568288+0000","last_became_active":"2023-11-29T11:15:08.579031+0000","last_became_peered":"2023-11-29T11:15:08.579031+0000","last_unstale":"2023-11-29T11:15:09.568288+0000","last_undegraded":"2023-11-29T11:15:09.568288+0000","last_fullsized":"2023-11-29T11:15:09.568288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:40:39.027805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286131+0000","last_change":"2023-11-29T11:15:08.212934+0000","last_active":"2023-11-29T11:15:10.286131+0000","last_peered":"2023-11-29T11:15:10.286131+0000","last_clean":"2023-11-29T11:15:10.286131+0000","last_became_active":"2023-11-29T11:15:08.212681+0000","last_became_peered":"2023-11-29T11:15:08.212681+0000","last_unstale":"2023-11-29T11:15:10.286131+0000","last_undegraded":"2023-11-29T11:15:10.286131+0000","last_fullsized":"2023-11-29T11:15:10.286131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:10:01.314637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.563964+0000","last_change":"2023-11-29T11:15:08.569273+0000","last_active":"2023-11-29T11:15:09.563964+0000","last_peered":"2023-11-29T11:15:09.563964+0000","last_clean":"2023-11-29T11:15:09.563964+0000","last_became_active":"2023-11-29T11:15:08.569003+0000","last_became_peered":"2023-11-29T11:15:08.569003+0000","last_unstale":"2023-11-29T11:15:09.563964+0000","last_undegraded":"2023-11-29T11:15:09.563964+0000","last_fullsized":"2023-11-29T11:15:09.563964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:20:31.043990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564037+0000","last_change":"2023-11-29T11:15:08.210110+0000","last_active":"2023-11-29T11:15:09.564037+0000","last_peered":"2023-11-29T11:15:09.564037+0000","last_clean":"2023-11-29T11:15:09.564037+0000","last_became_active":"2023-11-29T11:15:08.209861+0000","last_became_peered":"2023-11-29T11:15:08.209861+0000","last_unstale":"2023-11-29T11:15:09.564037+0000","last_undegraded":"2023-11-29T11:15:09.564037+0000","last_fullsized":"2023-11-29T11:15:09.564037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:47:45.443662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286947+0000","last_change":"2023-11-29T11:15:08.572431+0000","last_active":"2023-11-29T11:15:10.286947+0000","last_peered":"2023-11-29T11:15:10.286947+0000","last_clean":"2023-11-29T11:15:10.286947+0000","last_became_active":"2023-11-29T11:15:08.572086+0000","last_became_peered":"2023-11-29T11:15:08.572086+0000","last_unstale":"2023-11-29T11:15:10.286947+0000","last_undegraded":"2023-11-29T11:15:10.286947+0000","last_fullsized":"2023-11-29T11:15:10.286947+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:44:28.810311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287102+0000","last_change":"2023-11-29T11:15:08.207887+0000","last_active":"2023-11-29T11:15:10.287102+0000","last_peered":"2023-11-29T11:15:10.287102+0000","last_clean":"2023-11-29T11:15:10.287102+0000","last_became_active":"2023-11-29T11:15:08.207601+0000","last_became_peered":"2023-11-29T11:15:08.207601+0000","last_unstale":"2023-11-29T11:15:10.287102+0000","last_undegraded":"2023-11-29T11:15:10.287102+0000","last_fullsized":"2023-11-29T11:15:10.287102+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:36.725124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.570060+0000","last_change":"2023-11-29T11:15:08.570338+0000","last_active":"2023-11-29T11:15:09.570060+0000","last_peered":"2023-11-29T11:15:09.570060+0000","last_clean":"2023-11-29T11:15:09.570060+0000","last_became_active":"2023-11-29T11:15:08.570097+0000","last_became_peered":"2023-11-29T11:15:08.570097+0000","last_unstale":"2023-11-29T11:15:09.570060+0000","last_undegraded":"2023-11-29T11:15:09.570060+0000","last_fullsized":"2023-11-29T11:15:09.570060+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:44:50.827297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.891577+0000","last_change":"2023-11-29T11:15:08.215249+0000","last_active":"2023-11-29T11:15:09.891577+0000","last_peered":"2023-11-29T11:15:09.891577+0000","last_clean":"2023-11-29T11:15:09.891577+0000","last_became_active":"2023-11-29T11:15:08.214796+0000","last_became_peered":"2023-11-29T11:15:08.214796+0000","last_unstale":"2023-11-29T11:15:09.891577+0000","last_undegraded":"2023-11-29T11:15:09.891577+0000","last_fullsized":"2023-11-29T11:15:09.891577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:12:13.870972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.560344+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:15:08.560344+0000","last_peered":"2023-11-29T11:15:08.560344+0000","last_clean":"2023-11-29T11:15:08.560344+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:15:08.560344+0000","last_undegraded":"2023-11-29T11:15:08.560344+0000","last_fullsized":"2023-11-29T11:15:08.560344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568981+0000","last_change":"2023-11-29T11:15:08.579424+0000","last_active":"2023-11-29T11:15:09.568981+0000","last_peered":"2023-11-29T11:15:09.568981+0000","last_clean":"2023-11-29T11:15:09.568981+0000","last_became_active":"2023-11-29T11:15:08.579062+0000","last_became_peered":"2023-11-29T11:15:08.579062+0000","last_unstale":"2023-11-29T11:15:09.568981+0000","last_undegraded":"2023-11-29T11:15:09.568981+0000","last_fullsized":"2023-11-29T11:15:09.568981+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:50:29.313780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.288044+0000","last_change":"2023-11-29T11:15:08.215429+0000","last_active":"2023-11-29T11:15:10.288044+0000","last_peered":"2023-11-29T11:15:10.288044+0000","last_clean":"2023-11-29T11:15:10.288044+0000","last_became_active":"2023-11-29T11:15:08.215039+0000","last_became_peered":"2023-11-29T11:15:08.215039+0000","last_unstale":"2023-11-29T11:15:10.288044+0000","last_undegraded":"2023-11-29T11:15:10.288044+0000","last_fullsized":"2023-11-29T11:15:10.288044+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:33:10.108468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.561023+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:15:08.561023+0000","last_peered":"2023-11-29T11:15:08.561023+0000","last_clean":"2023-11-29T11:15:08.561023+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:15:08.561023+0000","last_undegraded":"2023-11-29T11:15:08.561023+0000","last_fullsized":"2023-11-29T11:15:08.561023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568652+0000","last_change":"2023-11-29T11:15:08.587766+0000","last_active":"2023-11-29T11:15:09.568652+0000","last_peered":"2023-11-29T11:15:09.568652+0000","last_clean":"2023-11-29T11:15:09.568652+0000","last_became_active":"2023-11-29T11:15:08.587477+0000","last_became_peered":"2023-11-29T11:15:08.587477+0000","last_unstale":"2023-11-29T11:15:09.568652+0000","last_undegraded":"2023-11-29T11:15:09.568652+0000","last_fullsized":"2023-11-29T11:15:09.568652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:11:27.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890971+0000","last_change":"2023-11-29T11:15:08.211167+0000","last_active":"2023-11-29T11:15:09.890971+0000","last_peered":"2023-11-29T11:15:09.890971+0000","last_clean":"2023-11-29T11:15:09.890971+0000","last_became_active":"2023-11-29T11:15:08.210912+0000","last_became_peered":"2023-11-29T11:15:08.210912+0000","last_unstale":"2023-11-29T11:15:09.890971+0000","last_undegraded":"2023-11-29T11:15:09.890971+0000","last_fullsized":"2023-11-29T11:15:09.890971+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:40:38.015084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.565311+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:15:08.565311+0000","last_peered":"2023-11-29T11:15:08.565311+0000","last_clean":"2023-11-29T11:15:08.565311+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:15:08.565311+0000","last_undegraded":"2023-11-29T11:15:08.565311+0000","last_fullsized":"2023-11-29T11:15:08.565311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287539+0000","last_change":"2023-11-29T11:15:08.582498+0000","last_active":"2023-11-29T11:15:10.287539+0000","last_peered":"2023-11-29T11:15:10.287539+0000","last_clean":"2023-11-29T11:15:10.287539+0000","last_became_active":"2023-11-29T11:15:08.582233+0000","last_became_peered":"2023-11-29T11:15:08.582233+0000","last_unstale":"2023-11-29T11:15:10.287539+0000","last_undegraded":"2023-11-29T11:15:10.287539+0000","last_fullsized":"2023-11-29T11:15:10.287539+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:49.990573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"54'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569993+0000","last_change":"2023-11-29T11:15:08.200550+0000","last_active":"2023-11-29T11:15:09.569993+0000","last_peered":"2023-11-29T11:15:09.569993+0000","last_clean":"2023-11-29T11:15:09.569993+0000","last_became_active":"2023-11-29T11:15:08.200283+0000","last_became_peered":"2023-11-29T11:15:08.200283+0000","last_unstale":"2023-11-29T11:15:09.569993+0000","last_undegraded":"2023-11-29T11:15:09.569993+0000","last_fullsized":"2023-11-29T11:15:09.569993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:27:31.009339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.572338+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:15:08.572338+0000","last_peered":"2023-11-29T11:15:08.572338+0000","last_clean":"2023-11-29T11:15:08.572338+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:15:08.572338+0000","last_undegraded":"2023-11-29T11:15:08.572338+0000","last_fullsized":"2023-11-29T11:15:08.572338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890870+0000","last_change":"2023-11-29T11:15:08.572976+0000","last_active":"2023-11-29T11:15:09.890870+0000","last_peered":"2023-11-29T11:15:09.890870+0000","last_clean":"2023-11-29T11:15:09.890870+0000","last_became_active":"2023-11-29T11:15:08.572146+0000","last_became_peered":"2023-11-29T11:15:08.572146+0000","last_unstale":"2023-11-29T11:15:09.890870+0000","last_undegraded":"2023-11-29T11:15:09.890870+0000","last_fullsized":"2023-11-29T11:15:09.890870+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:09:39.332245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.564482+0000","last_change":"2023-11-29T11:15:08.202969+0000","last_active":"2023-11-29T11:15:09.564482+0000","last_peered":"2023-11-29T11:15:09.564482+0000","last_clean":"2023-11-29T11:15:09.564482+0000","last_became_active":"2023-11-29T11:15:08.202663+0000","last_became_peered":"2023-11-29T11:15:08.202663+0000","last_unstale":"2023-11-29T11:15:09.564482+0000","last_undegraded":"2023-11-29T11:15:09.564482+0000","last_fullsized":"2023-11-29T11:15:09.564482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:13:22.373531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":194,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.559558+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:15:08.559558+0000","last_peered":"2023-11-29T11:15:08.559558+0000","last_clean":"2023-11-29T11:15:08.559558+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:15:08.559558+0000","last_undegraded":"2023-11-29T11:15:08.559558+0000","last_fullsized":"2023-11-29T11:15:08.559558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.554611+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:15:08.554611+0000","last_peered":"2023-11-29T11:15:08.554611+0000","last_clean":"2023-11-29T11:15:08.554611+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:15:08.554611+0000","last_undegraded":"2023-11-29T11:15:08.554611+0000","last_fullsized":"2023-11-29T11:15:08.554611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.569362+0000","last_change":"2023-11-29T11:15:08.568763+0000","last_active":"2023-11-29T11:15:09.569362+0000","last_peered":"2023-11-29T11:15:09.569362+0000","last_clean":"2023-11-29T11:15:09.569362+0000","last_became_active":"2023-11-29T11:15:08.568301+0000","last_became_peered":"2023-11-29T11:15:08.568301+0000","last_unstale":"2023-11-29T11:15:09.569362+0000","last_undegraded":"2023-11-29T11:15:09.569362+0000","last_fullsized":"2023-11-29T11:15:09.569362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:08:08.767479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"54'2","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287761+0000","last_change":"2023-11-29T11:15:08.209475+0000","last_active":"2023-11-29T11:15:10.287761+0000","last_peered":"2023-11-29T11:15:10.287761+0000","last_clean":"2023-11-29T11:15:10.287761+0000","last_became_active":"2023-11-29T11:15:08.209128+0000","last_became_peered":"2023-11-29T11:15:08.209128+0000","last_unstale":"2023-11-29T11:15:10.287761+0000","last_undegraded":"2023-11-29T11:15:10.287761+0000","last_fullsized":"2023-11-29T11:15:10.287761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:05:18.812454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.559869+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:15:08.559869+0000","last_peered":"2023-11-29T11:15:08.559869+0000","last_clean":"2023-11-29T11:15:08.559869+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:15:08.559869+0000","last_undegraded":"2023-11-29T11:15:08.559869+0000","last_fullsized":"2023-11-29T11:15:08.559869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.890389+0000","last_change":"2023-11-29T11:15:08.580224+0000","last_active":"2023-11-29T11:15:09.890389+0000","last_peered":"2023-11-29T11:15:09.890389+0000","last_clean":"2023-11-29T11:15:09.890389+0000","last_became_active":"2023-11-29T11:15:08.579888+0000","last_became_peered":"2023-11-29T11:15:08.579888+0000","last_unstale":"2023-11-29T11:15:09.890389+0000","last_undegraded":"2023-11-29T11:15:09.890389+0000","last_fullsized":"2023-11-29T11:15:09.890389+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:28:25.497519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:09.568827+0000","last_change":"2023-11-29T11:15:08.207859+0000","last_active":"2023-11-29T11:15:09.568827+0000","last_peered":"2023-11-29T11:15:09.568827+0000","last_clean":"2023-11-29T11:15:09.568827+0000","last_became_active":"2023-11-29T11:15:08.207530+0000","last_became_peered":"2023-11-29T11:15:08.207530+0000","last_unstale":"2023-11-29T11:15:09.568827+0000","last_undegraded":"2023-11-29T11:15:09.568827+0000","last_fullsized":"2023-11-29T11:15:09.568827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:42:48.600854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.556305+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:15:08.556305+0000","last_peered":"2023-11-29T11:15:08.556305+0000","last_clean":"2023-11-29T11:15:08.556305+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:15:08.556305+0000","last_undegraded":"2023-11-29T11:15:08.556305+0000","last_fullsized":"2023-11-29T11:15:08.556305+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.286519+0000","last_change":"2023-11-29T11:15:08.573477+0000","last_active":"2023-11-29T11:15:10.286519+0000","last_peered":"2023-11-29T11:15:10.286519+0000","last_clean":"2023-11-29T11:15:10.286519+0000","last_became_active":"2023-11-29T11:15:08.573195+0000","last_became_peered":"2023-11-29T11:15:08.573195+0000","last_unstale":"2023-11-29T11:15:10.286519+0000","last_undegraded":"2023-11-29T11:15:10.286519+0000","last_fullsized":"2023-11-29T11:15:10.286519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:08.168990+0000","last_clean_scrub_stamp":"2023-11-29T11:15:08.168990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:58:45.455571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-11-29T11:15:10.287204+0000","last_change":"2023-11-29T11:15:08.204739+0000","last_active":"2023-11-29T11:15:10.287204+0000","last_peered":"2023-11-29T11:15:10.287204+0000","last_clean":"2023-11-29T11:15:10.287204+0000","last_became_active":"2023-11-29T11:15:08.204457+0000","last_became_peered":"2023-11-29T11:15:08.204457+0000","last_unstale":"2023-11-29T11:15:10.287204+0000","last_undegraded":"2023-11-29T11:15:10.287204+0000","last_fullsized":"2023-11-29T11:15:10.287204+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:15:07.156269+0000","last_clean_scrub_stamp":"2023-11-29T11:15:07.156269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:08:25.931610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-29T11:15:08.559626+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:15:08.559626+0000","last_peered":"2023-11-29T11:15:08.559626+0000","last_clean":"2023-11-29T11:15:08.559626+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:15:08.559626+0000","last_undegraded":"2023-11-29T11:15:08.559626+0000","last_fullsized":"2023-11-29T11:15:08.559626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542175,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10320,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361520,"statfs":{"total":96636764160,"available":96626196480,"internally_reserved":0,"allocated":1253376,"data_stored":892639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.90100000000000002,"15min":0.91100000000000003},"min":{"1min":0.60099999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1910000000000001,"5min":1.371,"15min":1.371},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1479999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.93799999999999994}]},{"osd":1,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.64000000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.337,"15min":1.337},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.89500000000000002,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.99299999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.69099999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":1.0109999999999999,"15min":1.024},"min":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.127,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1519999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.97299999999999998,"15min":0.98099999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4650000000000001,"5min":1.641,"15min":1.641},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97299999999999998,"15min":0.98299999999999998},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.1659999999999999,"5min":1.214,"15min":1.214},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.97499999999999998,"15min":0.997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0649999999999999,"5min":1.319,"15min":1.319},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0920000000000001,"15min":1.0960000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.877}]},{"osd":5,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.1160000000000001,"15min":1.1399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2050000000000001,"5min":1.909,"15min":1.909},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.1339999999999999,"15min":1.1519999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4239999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.004}]},{"osd":6,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.179,"15min":1.1970000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.2509999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.202,"15min":1.2110000000000001},"min":{"1min":0.95799999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.623,"5min":1.77,"15min":1.77},"last":0.97099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9144,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362696,"statfs":{"total":96636764160,"available":96627400704,"internally_reserved":0,"allocated":638976,"data_stored":295138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.56399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1180000000000001,"5min":1.2,"15min":1.2},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.71599999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.93100000000000005,"15min":0.92700000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.495},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93899999999999995,"15min":0.93300000000000005},"min":{"1min":0.64700000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.052,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90300000000000002,"15min":0.89700000000000002},"min":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.75}]},{"osd":3,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90900000000000003,"15min":0.90800000000000003},"min":{"1min":0.65000000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93200000000000005,"15min":0.93100000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.878}]},{"osd":4,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.61899999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.97899999999999998,"15min":0.97499999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.90100000000000002}]},{"osd":5,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90200000000000002,"15min":0.90000000000000002},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0700000000000001,"15min":1.0669999999999999},"min":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.087}]},{"osd":7,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0820000000000001,"15min":1.0880000000000001},"min":{"1min":0.81599999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.081,"15min":1.085},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.98499999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9228,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362612,"statfs":{"total":96636764160,"available":96627314688,"internally_reserved":0,"allocated":659456,"data_stored":302747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.81999999999999995,"15min":0.82599999999999996},"min":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.76900000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95399999999999996,"15min":0.95999999999999996},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.875},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.89700000000000002,"15min":0.88700000000000001},"min":{"1min":0.59699999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.95199999999999996,"15min":0.95699999999999996},"min":{"1min":0.60099999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1080000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.335},{"interface":"front","average":{"1min":1.266,"5min":1.0600000000000001,"15min":1.026},"min":{"1min":0.78600000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":6.6040000000000001,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.2609999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0720000000000001,"15min":1.0820000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.054}]},{"osd":6,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.389},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.044,"15min":1.054},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4870000000000001,"5min":1.575,"15min":1.575},"last":1.1879999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:14:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1140000000000001,"15min":1.101},"min":{"1min":0.84699999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6379999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.151},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2050000000000001,"15min":1.2090000000000001},"min":{"1min":0.84999999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6779999999999999,"5min":1.889,"15min":1.889},"last":1.468}]}]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9348,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362492,"statfs":{"total":96636764160,"available":96627191808,"internally_reserved":0,"allocated":651264,"data_stored":296686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.92100000000000004,"15min":0.93899999999999995},"min":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0620000000000001,"5min":1.431,"15min":1.431},"last":1.099},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.92500000000000004}]},{"osd":1,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88600000000000001,"15min":0.88900000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.88200000000000001,"15min":0.878},"min":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1000000000000001,"5min":1.401,"15min":1.401},"last":0.95299999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.64500000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":0.98899999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.254,"5min":1.3,"15min":1.3},"last":1.0149999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.0249999999999999,"15min":1.034},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.536,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.88400000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.66900000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1759999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.02,"15min":1.0229999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.585,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1830000000000001,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0600000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.321,"5min":1.333,"15min":1.333},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.1759999999999999,"15min":1.181},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.625,"5min":1.905,"15min":1.905},"last":1.0329999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":647168,"data_stored":295194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":2.742},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.28499999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.72899999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.63700000000000001,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.774,"5min":3.774,"15min":3.774},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72799999999999998,"15min":0.72499999999999998},"min":{"1min":0.46700000000000003,"5min":0.31,"15min":0.31},"max":{"1min":1.153,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.97599999999999998,"15min":0.98799999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.345,"5min":1.708,"15min":1.708},"last":2.8959999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.96199999999999997,"15min":0.97099999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.167,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.876}]},{"osd":5,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.94499999999999995,"15min":0.94299999999999995},"min":{"1min":0.68300000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.206,"5min":1.506,"15min":1.506},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.083,"15min":1.087},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.4419999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":2.8639999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.006,"15min":1.002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":2.806},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.0980000000000001,"15min":1.0600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":7.3410000000000002,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.96899999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:14:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.133,"15min":1.145},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.546,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":3.0390000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.04,"15min":1.0289999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":2.6920000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542175,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9164,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362676,"statfs":{"total":96636764160,"available":96627380224,"internally_reserved":0,"allocated":659456,"data_stored":302167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97999999999999998,"5min":1.107,"15min":1.107},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88300000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.40999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82499999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97399999999999998,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.96699999999999997,"15min":0.97999999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.151,"5min":1.371,"15min":1.371},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.96999999999999997,"15min":0.98199999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.385,"5min":1.532,"15min":1.532},"last":0.88400000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98199999999999998,"15min":0.98899999999999999},"min":{"1min":0.749,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.196,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.99199999999999999,"15min":1.004},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2549999999999999,"5min":1.327,"15min":1.327},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0429999999999999,"15min":1.0609999999999999},"min":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.2789999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0469999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:14:50 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4730000000000001,"5min":1.76,"15min":1.76},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0609999999999999,"15min":1.075},"min":{"1min":0.75900000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.2949999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0049999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10252,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361588,"statfs":{"total":96636764160,"available":96626266112,"internally_reserved":0,"allocated":1249280,"data_stored":892569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.93600000000000005,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.028,"5min":1.089,"15min":1.089},"last":0.69399999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.496,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98199999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.625},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.081,"5min":1.393,"15min":1.393},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1870000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":1.744,"15min":1.744},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.69299999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.302,"5min":1.609,"15min":1.609},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.999,"15min":1.0049999999999999},"min":{"1min":0.71299999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.1799999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.83599999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.254,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.087,"15min":1.1020000000000001},"min":{"1min":0.70699999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":0.999},"min":{"1min":0.73299999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.282,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.66700000000000004}]},{"osd":7,"last update":"Wed Nov 29 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.069,"15min":1.081},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.339,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.115,"15min":1.127},"min":{"1min":0.81499999999999995,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2829999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.78600000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9360,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362480,"statfs":{"total":96636764160,"available":96627179520,"internally_reserved":0,"allocated":663552,"data_stored":303239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98899999999999999,"5min":1.155,"15min":1.155},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.88800000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.877,"15min":0.875},"min":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.1359999999999999,"5min":1.423,"15min":1.423},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.0009999999999999,"15min":1.0149999999999999},"min":{"1min":0.73399999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2370000000000001,"5min":1.399,"15min":1.399},"last":0.999}]},{"osd":5,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0209999999999999,"15min":1.026},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.28,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.0049999999999999,"15min":1.004},"min":{"1min":0.78300000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.226,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0900000000000001,"15min":1.101},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.123,"15min":1.139},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.3939999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.96999999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:14:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.139,"15min":1.155},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.345,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0820000000000001,"15min":1.089},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.325,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2729999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:15:12.925 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-29T11:15:12.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-29T11:15:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.039+0000 7efe4215b700 1 Processor -- start 2023-11-29T11:15:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.039+0000 7efe4215b700 1 -- start start 2023-11-29T11:15:13.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4215b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efe3c0cf7f0 0x7efe3c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4215b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c06a9c0 con 0x7efe3c06a4c0 2023-11-29T11:15:13.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4215b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c06aca0 con 0x7efe3c0b1ae0 2023-11-29T11:15:13.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4215b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0d0ab0 con 0x7efe3c0cf7f0 2023-11-29T11:15:13.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe40958700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe3c06a4c0 0x7efe3c0cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42576/0 (socket says 172.21.15.81:42576) 2023-11-29T11:15:13.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe40958700 1 -- 172.21.15.81:0/2302936927 learned_addr learned my addr 172.21.15.81:0/2302936927 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 --2- 172.21.15.81:0/2302936927 >> v2:172.21.15.176:3300/0 conn(0x7efe3c0cf7f0 0x7efe3c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933364662 0 0) 0x7efe3c06a9c0 con 0x7efe3c06a4c0 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe280035d0 con 0x7efe3c06a4c0 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700510234 0 0) 0x7efe280035d0 con 0x7efe3c06a4c0 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 >> v2:172.21.15.176:3300/0 conn(0x7efe3c0cf7f0 msgr2=0x7efe3c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 --2- 172.21.15.81:0/2302936927 >> v2:172.21.15.176:3300/0 conn(0x7efe3c0cf7f0 0x7efe3c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 >> v1:172.21.15.176:6789/0 conn(0x7efe3c0b1ae0 legacy=0x7efe3c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c06af80 con 0x7efe3c06a4c0 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7efe38001670 con 0x7efe3c06a4c0 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 >> v1:172.21.15.81:6789/0 conn(0x7efe3c06a4c0 legacy=0x7efe3c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28003a20 0x7efe28003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe28004870 0x7efe28004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe28005220 0x7efe2800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0d0ab0 con 0x7efe28005220 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2800c0a0 con 0x7efe28003a20 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2800c260 con 0x7efe28004870 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 --2- 172.21.15.81:0/2302936927 >> v2:172.21.15.176:3300/0 conn(0x7efe3c0cf7f0 0x7efe3c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe41159700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28003a20 0x7efe28003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe28005220 0x7efe2800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe40958700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe28004870 0x7efe28004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 -- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe28004870 msgr2=0x7efe28004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe28004870 0x7efe28004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 -- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28003a20 msgr2=0x7efe28003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28003a20 0x7efe28003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 -- 172.21.15.81:0/2302936927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe280035d0 con 0x7efe28005220 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe41159700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28003a20 0x7efe28003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe40958700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe28004870 0x7efe28004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 -- 172.21.15.81:0/2302936927 reap_dead start 2023-11-29T11:15:13.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe4195a700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe28005220 0x7efe2800ba30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7efe3400e350 tx=0x7efe280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6952375f041b52bd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:13.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400ee10 con 0x7efe28005220 2023-11-29T11:15:13.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400f040 con 0x7efe28005220 2023-11-29T11:15:13.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.043+0000 7efe33fff700 1 -- 172.21.15.81:0/2302936927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34003c60 con 0x7efe28005220 2023-11-29T11:15:13.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 -- 172.21.15.81:0/2302936927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe28005220 msgr2=0x7efe2800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe28005220 0x7efe2800ba30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7efe3400e350 tx=0x7efe280058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 -- 172.21.15.81:0/2302936927 shutdown_connections 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 --2- 172.21.15.81:0/2302936927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe28005220 0x7efe2800ba30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 -- 172.21.15.81:0/2302936927 >> 172.21.15.81:0/2302936927 conn(0x7efe3c09bbd0 msgr2=0x7efe3c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 -- 172.21.15.81:0/2302936927 shutdown_connections 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 -- 172.21.15.81:0/2302936927 wait complete. 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 Processor -- start 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.047+0000 7efe4215b700 1 -- start start 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28005220 0x7efe3c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3c0b2040 0x7efe3c09fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c09ce10 0x7efe3c159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0a0080 con 0x7efe3c09ce10 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0b2600 con 0x7efe28005220 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0b28e0 con 0x7efe3c0b2040 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c09ce10 0x7efe3c159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c09ce10 0x7efe3c159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42394/0 (socket says 172.21.15.81:42394) 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 -- 172.21.15.81:0/401671328 learned_addr learned my addr 172.21.15.81:0/401671328 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe41159700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28005220 0x7efe3c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe40958700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3c0b2040 0x7efe3c09fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 -- 172.21.15.81:0/401671328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3c0b2040 msgr2=0x7efe3c09fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3c0b2040 0x7efe3c09fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 -- 172.21.15.81:0/401671328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28005220 msgr2=0x7efe3c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28005220 0x7efe3c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 -- 172.21.15.81:0/401671328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c0b1eb0 con 0x7efe3c09ce10 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4195a700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c09ce10 0x7efe3c159be0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7efe3c08cd20 tx=0x7efe34009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe31ffb700 1 -- 172.21.15.81:0/401671328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34004450 con 0x7efe3c09ce10 2023-11-29T11:15:13.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe31ffb700 1 -- 172.21.15.81:0/401671328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe340045d0 con 0x7efe3c09ce10 2023-11-29T11:15:13.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c0b4380 con 0x7efe3c09ce10 2023-11-29T11:15:13.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe31ffb700 1 -- 172.21.15.81:0/401671328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34004980 con 0x7efe3c09ce10 2023-11-29T11:15:13.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c0b60e0 con 0x7efe3c09ce10 2023-11-29T11:15:13.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.051+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c0b65b0 con 0x7efe3c09ce10 2023-11-29T11:15:13.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.055+0000 7efe31ffb700 1 -- 172.21.15.81:0/401671328 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efe3401a070 con 0x7efe3c09ce10 2023-11-29T11:15:13.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.055+0000 7efe31ffb700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe20064ee0 0x7efe20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.055+0000 7efe31ffb700 1 -- 172.21.15.81:0/401671328 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efe34083100 con 0x7efe3c09ce10 2023-11-29T11:15:13.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.055+0000 7efe41159700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe20064ee0 0x7efe20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.055+0000 7efe41159700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe20064ee0 0x7efe20067390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe2c000c00 tx=0x7efe2c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:13.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.059+0000 7efe31ffb700 1 -- 172.21.15.81:0/401671328 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efe34051070 con 0x7efe3c09ce10 2023-11-29T11:15:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.283+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7efe3c072500 con 0x7efe3c09ce10 2023-11-29T11:15:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.287+0000 7efe31ffb700 1 -- 172.21.15.81:0/401671328 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7efe340180e0 con 0x7efe3c09ce10 2023-11-29T11:15:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe20064ee0 msgr2=0x7efe20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe20064ee0 0x7efe20067390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe2c000c00 tx=0x7efe2c009040 comp rx=0 tx=0).stop 2023-11-29T11:15:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c09ce10 msgr2=0x7efe3c159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c09ce10 0x7efe3c159be0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7efe3c08cd20 tx=0x7efe34009750 comp rx=0 tx=0).stop 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 shutdown_connections 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe20064ee0 0x7efe20067390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe3c09ce10 0x7efe3c159be0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3c0b2040 0x7efe3c09fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 --2- 172.21.15.81:0/401671328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe28005220 0x7efe3c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 >> 172.21.15.81:0/401671328 conn(0x7efe3c09bbd0 msgr2=0x7efe3c0d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 shutdown_connections 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.291+0000 7efe4215b700 1 -- 172.21.15.81:0/401671328 wait complete. 2023-11-29T11:15:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-11-29T11:15:13.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:13.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5e14b700 1 Processor -- start 2023-11-29T11:15:13.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5e14b700 1 -- start start 2023-11-29T11:15:13.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5e14b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac5806b540 0x7fac580cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5e14b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fac580c1330 0x7fac580c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5e14b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac580b38c0 con 0x7fac5806d420 2023-11-29T11:15:13.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5e14b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac580cbca0 con 0x7fac5806b540 2023-11-29T11:15:13.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5e14b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac580cb2d0 con 0x7fac580c1330 2023-11-29T11:15:13.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5c948700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fac5806d420 0x7fac580ad660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42586/0 (socket says 172.21.15.81:42586) 2023-11-29T11:15:13.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5c948700 1 -- 172.21.15.81:0/3229812012 learned_addr learned my addr 172.21.15.81:0/3229812012 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:13.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5d149700 1 --2- 172.21.15.81:0/3229812012 >> v2:172.21.15.81:3300/0 conn(0x7fac5806b540 0x7fac580cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5d94a700 1 --2- 172.21.15.81:0/3229812012 >> v2:172.21.15.176:3300/0 conn(0x7fac580c1330 0x7fac580c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac4ffff700 1 -- 172.21.15.81:0/3229812012 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168090890 0 0) 0x7fac580b38c0 con 0x7fac5806d420 2023-11-29T11:15:13.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac4ffff700 1 -- 172.21.15.81:0/3229812012 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac400035d0 con 0x7fac5806d420 2023-11-29T11:15:13.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5d149700 1 -- 172.21.15.81:0/3229812012 >> v2:172.21.15.176:3300/0 conn(0x7fac580c1330 msgr2=0x7fac580c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5d149700 1 --2- 172.21.15.81:0/3229812012 >> v2:172.21.15.176:3300/0 conn(0x7fac580c1330 0x7fac580c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac4ffff700 1 -- 172.21.15.81:0/3229812012 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459525561 0 0) 0x7fac400035d0 con 0x7fac5806d420 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5d149700 1 -- 172.21.15.81:0/3229812012 >> v1:172.21.15.81:6789/0 conn(0x7fac5806d420 legacy=0x7fac580ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.419+0000 7fac5d149700 1 -- 172.21.15.81:0/3229812012 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac580c1cb0 con 0x7fac5806b540 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5d149700 1 --2- 172.21.15.81:0/3229812012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806b540 0x7fac580cb760 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fac580b1240 tx=0x7fac50009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a992cdb723b9679 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac4ffff700 1 -- 172.21.15.81:0/3229812012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540019f0 con 0x7fac5806b540 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac4ffff700 1 -- 172.21.15.81:0/3229812012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50004030 con 0x7fac5806b540 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac4ffff700 1 -- 172.21.15.81:0/3229812012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac500043c0 con 0x7fac5806b540 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 -- 172.21.15.81:0/3229812012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806b540 msgr2=0x7fac580cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3229812012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806b540 0x7fac580cb760 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fac580b1240 tx=0x7fac50009b20 comp rx=0 tx=0).stop 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 -- 172.21.15.81:0/3229812012 shutdown_connections 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3229812012 >> v2:172.21.15.176:3300/0 conn(0x7fac580c1330 0x7fac580c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3229812012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806b540 0x7fac580cb760 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 -- 172.21.15.81:0/3229812012 >> 172.21.15.81:0/3229812012 conn(0x7fac580ce360 msgr2=0x7fac580ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:13.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 -- 172.21.15.81:0/3229812012 shutdown_connections 2023-11-29T11:15:13.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 -- 172.21.15.81:0/3229812012 wait complete. 2023-11-29T11:15:13.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 Processor -- start 2023-11-29T11:15:13.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.423+0000 7fac5e14b700 1 -- start start 2023-11-29T11:15:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5806b540 0x7fac581f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806d420 0x7fac5815ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac580c1330 0x7fac5815f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5814c100 con 0x7fac5806d420 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5814bb20 con 0x7fac580c1330 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5815b1a0 con 0x7fac5806b540 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806d420 0x7fac5815ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806d420 0x7fac5815ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42412/0 (socket says 172.21.15.81:42412) 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 -- 172.21.15.81:0/3580738447 learned_addr learned my addr 172.21.15.81:0/3580738447 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5d149700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5806b540 0x7fac581f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5d94a700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac580c1330 0x7fac5815f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 -- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5806b540 msgr2=0x7fac581f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5806b540 0x7fac581f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 -- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac580c1330 msgr2=0x7fac5815f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac580c1330 0x7fac5815f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 -- 172.21.15.81:0/3580738447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50009450 con 0x7fac5806d420 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5d149700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5806b540 0x7fac581f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:13.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5d94a700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac580c1330 0x7fac5815f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5c948700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806d420 0x7fac5815ecd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fac540019e0 tx=0x7fac5400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac4dffb700 1 -- 172.21.15.81:0/3580738447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400ae00 con 0x7fac5806d420 2023-11-29T11:15:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac4dffb700 1 -- 172.21.15.81:0/3580738447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540070d0 con 0x7fac5806d420 2023-11-29T11:15:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac580b3b10 con 0x7fac5806d420 2023-11-29T11:15:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac4dffb700 1 -- 172.21.15.81:0/3580738447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54007480 con 0x7fac5806d420 2023-11-29T11:15:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac58160b50 con 0x7fac5806d420 2023-11-29T11:15:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.427+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac580b3df0 con 0x7fac5806d420 2023-11-29T11:15:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.431+0000 7fac4dffb700 1 -- 172.21.15.81:0/3580738447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fac5401a030 con 0x7fac5806d420 2023-11-29T11:15:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.431+0000 7fac4dffb700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac44064ee0 0x7fac44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:13.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.431+0000 7fac5d149700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac44064ee0 0x7fac44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.431+0000 7fac4dffb700 1 -- 172.21.15.81:0/3580738447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fac54081fe0 con 0x7fac5806d420 2023-11-29T11:15:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.431+0000 7fac5d149700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac44064ee0 0x7fac44067390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fac50014040 tx=0x7fac50008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.435+0000 7fac4dffb700 1 -- 172.21.15.81:0/3580738447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fac5404ff50 con 0x7fac5806d420 2023-11-29T11:15:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.635+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac580008d0 con 0x7fac5806d420 2023-11-29T11:15:13.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.635+0000 7fac4dffb700 1 -- 172.21.15.81:0/3580738447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fac54018090 con 0x7fac5806d420 2023-11-29T11:15:13.639 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:13.639 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:15:08.545106+0000","modified":"2023-11-29T11:15:11.563216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/63586216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":63586216},{"type":"v1","addr":"172.21.15.81:6837","nonce":63586216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac44064ee0 msgr2=0x7fac44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac44064ee0 0x7fac44067390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fac50014040 tx=0x7fac50008030 comp rx=0 tx=0).stop 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806d420 msgr2=0x7fac5815ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806d420 0x7fac5815ecd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fac540019e0 tx=0x7fac5400a340 comp rx=0 tx=0).stop 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 shutdown_connections 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac44064ee0 0x7fac44067390 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac580c1330 0x7fac5815f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5806d420 0x7fac5815ecd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 --2- 172.21.15.81:0/3580738447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5806b540 0x7fac581f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 >> 172.21.15.81:0/3580738447 conn(0x7fac580ce360 msgr2=0x7fac580cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:13.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 shutdown_connections 2023-11-29T11:15:13.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:13.639+0000 7fac5e14b700 1 -- 172.21.15.81:0/3580738447 wait complete. 2023-11-29T11:15:13.643 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-11-29T11:15:14.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:15:08.545106+0000', 'modified': '2023-11-29T11:15:11.563216+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6117}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6117': {'gid': 6117, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/63586216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 63586216}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 63586216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:15:14.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:15:14.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-29T11:15:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72c93700 1 Processor -- start 2023-11-29T11:15:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72c93700 1 -- start start 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72c93700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd6c0ceef0 0x7fdd6c06a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72c93700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c0cae70 con 0x7fdd6c1606b0 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72c93700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c0cbc10 con 0x7fdd6c0c1ac0 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72c93700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6c0cb130 con 0x7fdd6c0ceef0 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd71c91700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd6c1606b0 0x7fdd6c0c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42600/0 (socket says 172.21.15.81:42600) 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd71c91700 1 -- 172.21.15.81:0/2771841460 learned_addr learned my addr 172.21.15.81:0/2771841460 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 --2- 172.21.15.81:0/2771841460 >> v2:172.21.15.81:3300/0 conn(0x7fdd6c0ceef0 0x7fdd6c06a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727843813 0 0) 0x7fdd6c0cae70 con 0x7fdd6c1606b0 2023-11-29T11:15:14.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd580035d0 con 0x7fdd6c1606b0 2023-11-29T11:15:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533685707 0 0) 0x7fdd6c0cbc10 con 0x7fdd6c0c1ac0 2023-11-29T11:15:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd6c0cae70 con 0x7fdd6c0c1ac0 2023-11-29T11:15:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660818696 0 0) 0x7fdd580035d0 con 0x7fdd6c1606b0 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 >> v2:172.21.15.81:3300/0 conn(0x7fdd6c0ceef0 msgr2=0x7fdd6c06a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 --2- 172.21.15.81:0/2771841460 >> v2:172.21.15.81:3300/0 conn(0x7fdd6c0ceef0 0x7fdd6c06a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 >> v1:172.21.15.176:6789/0 conn(0x7fdd6c0c1ac0 legacy=0x7fdd6c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0cb410 con 0x7fdd6c1606b0 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fdd680015f0 con 0x7fdd6c1606b0 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 >> v1:172.21.15.81:6789/0 conn(0x7fdd6c1606b0 legacy=0x7fdd6c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58003c00 0x7fdd58003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58004870 0x7fdd58004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd58005220 0x7fdd5800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0cb130 con 0x7fdd58005220 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5800c100 con 0x7fdd58003c00 2023-11-29T11:15:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5800c290 con 0x7fdd58004870 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd58005220 0x7fdd5800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd71490700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58004870 0x7fdd58004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd71c91700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58003c00 0x7fdd58003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 -- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58004870 msgr2=0x7fdd58004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58004870 0x7fdd58004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 -- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58003c00 msgr2=0x7fdd58003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58003c00 0x7fdd58003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 -- 172.21.15.81:0/2771841460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd580035d0 con 0x7fdd58005220 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd71c91700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58003c00 0x7fdd58003ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd71490700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58004870 0x7fdd58004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 -- 172.21.15.81:0/2771841460 reap_dead start 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd72492700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd58005220 0x7fdd5800ba30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009f90 tx=0x7fdd580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ef6b8d4f4094bc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64003a40 con 0x7fdd58005220 2023-11-29T11:15:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6400f040 con 0x7fdd58005220 2023-11-29T11:15:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.183+0000 7fdd70c8f700 1 -- 172.21.15.81:0/2771841460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64003de0 con 0x7fdd58005220 2023-11-29T11:15:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.187+0000 7fdd72c93700 1 -- 172.21.15.81:0/2771841460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd58005220 msgr2=0x7fdd5800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.187+0000 7fdd72c93700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd58005220 0x7fdd5800ba30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009f90 tx=0x7fdd580058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.187+0000 7fdd72c93700 1 -- 172.21.15.81:0/2771841460 shutdown_connections 2023-11-29T11:15:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.187+0000 7fdd72c93700 1 --2- 172.21.15.81:0/2771841460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd58005220 0x7fdd5800ba30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.187+0000 7fdd72c93700 1 -- 172.21.15.81:0/2771841460 >> 172.21.15.81:0/2771841460 conn(0x7fdd6c0ce3e0 msgr2=0x7fdd6c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.187+0000 7fdd72c93700 1 -- 172.21.15.81:0/2771841460 shutdown_connections 2023-11-29T11:15:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.187+0000 7fdd72c93700 1 -- 172.21.15.81:0/2771841460 wait complete. 2023-11-29T11:15:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72c93700 1 Processor -- start 2023-11-29T11:15:14.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72c93700 1 -- start start 2023-11-29T11:15:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72c93700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58005220 0x7fdd6c163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72c93700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6c0c2410 0x7fdd6c0abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72c93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0c2c50 0x7fdd6c0c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72c93700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0c3630 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72c93700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0ac460 con 0x7fdd6c0c2410 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72c93700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0ac740 con 0x7fdd58005220 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0c2c50 0x7fdd6c0c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0c2c50 0x7fdd6c0c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42446/0 (socket says 172.21.15.81:42446) 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 -- 172.21.15.81:0/359948436 learned_addr learned my addr 172.21.15.81:0/359948436 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd71c91700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58005220 0x7fdd6c163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd71490700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6c0c2410 0x7fdd6c0abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 -- 172.21.15.81:0/359948436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58005220 msgr2=0x7fdd6c163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58005220 0x7fdd6c163270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 -- 172.21.15.81:0/359948436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6c0c2410 msgr2=0x7fdd6c0abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6c0c2410 0x7fdd6c0abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 -- 172.21.15.81:0/359948436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0b36c0 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd72492700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0c2c50 0x7fdd6c0c30f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c06f410 tx=0x7fdd64004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.191+0000 7fdd627fc700 1 -- 172.21.15.81:0/359948436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64003e30 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd627fc700 1 -- 172.21.15.81:0/359948436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd64004230 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd627fc700 1 -- 172.21.15.81:0/359948436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd640045e0 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd72c93700 1 -- 172.21.15.81:0/359948436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c0cb6f0 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd72c93700 1 -- 172.21.15.81:0/359948436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c0ad610 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd627fc700 1 -- 172.21.15.81:0/359948436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd64004740 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd627fc700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd50064f10 0x7fdd500673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd627fc700 1 -- 172.21.15.81:0/359948436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdd640833b0 con 0x7fdd6c0c2c50 2023-11-29T11:15:14.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd71c91700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd50064f10 0x7fdd500673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.195+0000 7fdd71c91700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd50064f10 0x7fdd500673c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd68001980 tx=0x7fdd68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.199+0000 7fdd77175740 1 Processor -- start 2023-11-29T11:15:14.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.199+0000 7fdd77175740 1 -- start start 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bbae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bbb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1bbb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a79ae0 con 0x190aae0 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ae9bd0 con 0x190a710 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ae2ed0 con 0x1955790 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bbae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bbae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42462/0 (socket says 172.21.15.81:42462) 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 -- 172.21.15.81:0/316466226 learned_addr learned my addr 172.21.15.81:0/316466226 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71490700 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bbb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd72492700 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1bbb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 -- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 msgr2=0x1bbb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1bbb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 -- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 msgr2=0x1bbb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bbb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 -- 172.21.15.81:0/316466226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b08cc0 con 0x190aae0 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71490700 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bbb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd71c91700 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bbae00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdd68010a30 tx=0x7fdd68013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2c92a411ed5527 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd4f7fe700 1 -- 172.21.15.81:0/316466226 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68014870 con 0x190aae0 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd4f7fe700 1 -- 172.21.15.81:0/316466226 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800d050 con 0x190aae0 2023-11-29T11:15:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd4f7fe700 1 -- 172.21.15.81:0/316466226 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68014bd0 con 0x190aae0 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- 172.21.15.81:0/316466226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 msgr2=0x1bbae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bbae00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdd68010a30 tx=0x7fdd68013000 comp rx=0 tx=0).stop 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- 172.21.15.81:0/316466226 shutdown_connections 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1bbb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bbb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- 172.21.15.81:0/316466226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bbae00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- 172.21.15.81:0/316466226 >> 172.21.15.81:0/316466226 conn(0x190aeb0 msgr2=0x1ba3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- 172.21.15.81:0/316466226 shutdown_connections 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- 172.21.15.81:0/316466226 wait complete. 2023-11-29T11:15:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- start start 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 Processor -- start 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190a710 0x1bbcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 0x1b91790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1955790 0x1b92200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x198fb20 con 0x190a710 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba21f0 con 0x1955790 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba4d60 con 0x190aae0 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.203+0000 7fdd77175740 10 client.0 _ll_register_callbacks cb 0x1b3f0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190a710 0x1bbcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190a710 0x1bbcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42464/0 (socket says 172.21.15.81:42464) 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 -- 172.21.15.81:0/320760092 learned_addr learned my addr 172.21.15.81:0/320760092 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71490700 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 0x1b91790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd72492700 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1955790 0x1b92200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 -- 172.21.15.81:0/320760092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 msgr2=0x1b91790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 0x1b91790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 -- 172.21.15.81:0/320760092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1955790 msgr2=0x1b92200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1955790 0x1b92200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 -- 172.21.15.81:0/320760092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c0cb410 con 0x190a710 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71c91700 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190a710 0x1bbcaf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdd68010df0 tx=0x7fdd680018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a769a26c72a931c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 1 -- 172.21.15.81:0/320760092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68021830 con 0x190a710 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 1 -- 172.21.15.81:0/320760092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdd6801c050 con 0x190a710 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 1 -- 172.21.15.81:0/320760092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1adbf50 con 0x190a710 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 1 -- 172.21.15.81:0/320760092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd68014e20 con 0x190a710 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 10 client.6258 fetch_fsmap learned FSMap version 25 2023-11-29T11:15:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 1 -- 172.21.15.81:0/320760092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x19569e0 con 0x190a710 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 1 -- 172.21.15.81:0/320760092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1adbf50 con 0x190a710 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 1 -- 172.21.15.81:0/320760092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdd68021990 con 0x190a710 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 10 client.6258 fetch_fsmap finished waiting for FSMap version 25 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 10 client.6258 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 20 client.6258 populate_metadata read hostname 'smithi081' 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1b90080 0x1b90450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 4 client.6258 mds_command: new command op to 6117 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 1 -- 172.21.15.81:0/320760092 --> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1adbc70 con 0x1b90080 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71490700 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1b90080 0x1b90450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 10 client.6258 ms_handle_connect on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd71490700 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1b90080 0x1b90450 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c325b448b59f2b server_cookie=7117495c1b4704d7 in_seq=0 out_seq=0 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 1 -- 172.21.15.81:0/320760092 <== mds.0 v2:172.21.15.81:6836/63586216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1adbc70 con 0x1b90080 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd4cff9700 10 client.6258 handle_command_reply: tid=0 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.207+0000 7fdd77175740 1 client.6258 shutdown 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 -- 172.21.15.81:0/320760092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190a710 msgr2=0x1bbcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190a710 0x1bbcaf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdd68010df0 tx=0x7fdd680018b0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 -- 172.21.15.81:0/320760092 shutdown_connections 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1b90080 0x1b90450 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1955790 0x1b92200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd4cff9700 0 client.6258 ms_handle_reset on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 0x1b91790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 --2- 172.21.15.81:0/320760092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190a710 0x1bbcaf0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 -- 172.21.15.81:0/320760092 >> 172.21.15.81:0/320760092 conn(0x190aeb0 msgr2=0x1ba3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 -- 172.21.15.81:0/320760092 shutdown_connections 2023-11-29T11:15:14.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 1 -- 172.21.15.81:0/320760092 wait complete. 2023-11-29T11:15:14.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.211+0000 7fdd77175740 20 client.6258 trim_cache size 0 max 16384 2023-11-29T11:15:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 Processor -- start 2023-11-29T11:15:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- start start 2023-11-29T11:15:14.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bc9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bc9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1ba1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aeae60 con 0x190aae0 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ab3ec0 con 0x190a710 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a89750 con 0x1955790 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bc9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bc9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42478/0 (socket says 172.21.15.81:42478) 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 -- 172.21.15.81:0/3337503136 learned_addr learned my addr 172.21.15.81:0/3337503136 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71c91700 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bc9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd72492700 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1ba1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 -- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 msgr2=0x1ba1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1ba1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 -- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 msgr2=0x1bc9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bc9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 -- 172.21.15.81:0/3337503136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c15e760 con 0x190aae0 2023-11-29T11:15:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd72492700 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1ba1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:14.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd71490700 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bc9eb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c000f60 tx=0x7fdd5c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f8fe6b322c9bc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd4ffff700 1 -- 172.21.15.81:0/3337503136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c004a70 con 0x190aae0 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd4ffff700 1 -- 172.21.15.81:0/3337503136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00d040 con 0x190aae0 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd4ffff700 1 -- 172.21.15.81:0/3337503136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c004dd0 con 0x190aae0 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- 172.21.15.81:0/3337503136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 msgr2=0x1bc9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bc9eb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c000f60 tx=0x7fdd5c000ed0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- 172.21.15.81:0/3337503136 shutdown_connections 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1955790 0x1ba1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x190aae0 0x1bc9eb0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 --2- 172.21.15.81:0/3337503136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1bc9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- 172.21.15.81:0/3337503136 >> 172.21.15.81:0/3337503136 conn(0x190aeb0 msgr2=0x1b91670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- 172.21.15.81:0/3337503136 shutdown_connections 2023-11-29T11:15:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.231+0000 7fdd77175740 1 -- 172.21.15.81:0/3337503136 wait complete. 2023-11-29T11:15:14.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 1 -- start start 2023-11-29T11:15:14.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 1 Processor -- start 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1c213e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 0x1bceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1955790 0x1ba1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd0a20 con 0x1955790 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bb94a0 con 0x190a710 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba5130 con 0x190aae0 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd77175740 10 client.0 _ll_register_callbacks cb 0x1a8f2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd72492700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1955790 0x1ba1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd71c91700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1c213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd72492700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1955790 0x1ba1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42488/0 (socket says 172.21.15.81:42488) 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd72492700 1 -- 172.21.15.81:0/771743832 learned_addr learned my addr 172.21.15.81:0/771743832 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.235+0000 7fdd71490700 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 0x1bceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd72492700 1 -- 172.21.15.81:0/771743832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 msgr2=0x1bceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd72492700 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 0x1bceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd72492700 1 -- 172.21.15.81:0/771743832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 msgr2=0x1c213e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd72492700 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1c213e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd72492700 1 -- 172.21.15.81:0/771743832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c0cae70 con 0x1955790 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd71c91700 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1c213e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd72492700 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1955790 0x1ba1490 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdd64007130 tx=0x7fdd64054730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbaa3052d6058e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 1 -- 172.21.15.81:0/771743832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6405cff0 con 0x1955790 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 1 -- 172.21.15.81:0/771743832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdd6406c120 con 0x1955790 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 -- 172.21.15.81:0/771743832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd6800d050 con 0x1955790 2023-11-29T11:15:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 1 -- 172.21.15.81:0/771743832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd64071200 con 0x1955790 2023-11-29T11:15:14.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 10 client.6264 fetch_fsmap learned FSMap version 25 2023-11-29T11:15:14.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 -- 172.21.15.81:0/771743832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1a8fa20 con 0x1955790 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 1 -- 172.21.15.81:0/771743832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800d050 con 0x1955790 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 1 -- 172.21.15.81:0/771743832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdd6407bba0 con 0x1955790 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 10 client.6264 fetch_fsmap finished waiting for FSMap version 25 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 10 client.6264 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 20 client.6264 populate_metadata read hostname 'smithi081' 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1ba1da0 0x1bcdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 4 client.6264 mds_command: new command op to 6117 tid=0[{"prefix": "status"}] 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 -- 172.21.15.81:0/771743832 --> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1987260 con 0x1ba1da0 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd71c91700 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1ba1da0 0x1bcdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd71c91700 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1ba1da0 0x1bcdcc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2fab46be6cdddf0 server_cookie=3a09ee225bbb3c4e in_seq=0 out_seq=0 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 10 client.6264 ms_handle_connect on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 1 -- 172.21.15.81:0/771743832 <== mds.0 v2:172.21.15.81:6836/63586216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x1987260 con 0x1ba1da0 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 10 client.6264 handle_command_reply: tid=0 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 client.6264 shutdown 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 -- 172.21.15.81:0/771743832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1955790 msgr2=0x1ba1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1955790 0x1ba1490 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdd64007130 tx=0x7fdd64054730 comp rx=0 tx=0).stop 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 -- 172.21.15.81:0/771743832 shutdown_connections 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1ba1da0 0x1bcdcc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1955790 0x1ba1490 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd4cff9700 0 client.6264 ms_handle_reset on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x190aae0 0x1bceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 --2- 172.21.15.81:0/771743832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x190a710 0x1c213e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 -- 172.21.15.81:0/771743832 >> 172.21.15.81:0/771743832 conn(0x190aeb0 msgr2=0x1bbc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 -- 172.21.15.81:0/771743832 shutdown_connections 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 1 -- 172.21.15.81:0/771743832 wait complete. 2023-11-29T11:15:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.239+0000 7fdd77175740 20 client.6264 trim_cache size 0 max 16384 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6117, 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.6938877249999997, 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 25, 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 55, 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 55, 2023-11-29T11:15:14.248 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 10.142816928 2023-11-29T11:15:14.249 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:15:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 -- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd50064f10 msgr2=0x7fdd500673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd50064f10 0x7fdd500673c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd68001980 tx=0x7fdd68009040 comp rx=0 tx=0).stop 2023-11-29T11:15:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 -- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0c2c50 msgr2=0x7fdd6c0c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0c2c50 0x7fdd6c0c30f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c06f410 tx=0x7fdd64004b60 comp rx=0 tx=0).stop 2023-11-29T11:15:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 -- 172.21.15.81:0/359948436 shutdown_connections 2023-11-29T11:15:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd50064f10 0x7fdd500673c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0c2c50 0x7fdd6c0c30f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6c0c2410 0x7fdd6c0abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 --2- 172.21.15.81:0/359948436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd58005220 0x7fdd6c163270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 -- 172.21.15.81:0/359948436 >> 172.21.15.81:0/359948436 conn(0x7fdd6c0ce3e0 msgr2=0x7fdd6c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 -- 172.21.15.81:0/359948436 shutdown_connections 2023-11-29T11:15:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.243+0000 7fdd72c93700 1 -- 172.21.15.81:0/359948436 wait complete. 2023-11-29T11:15:14.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:15:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d359e700 1 Processor -- start 2023-11-29T11:15:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d359e700 1 -- start start 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 0x7f04d40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d359e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04d40cb460 0x7f04d40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d359e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d40cd8f0 con 0x7f04d40ad490 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d359e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d40add00 con 0x7f04d40cb460 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40cc4f0 con 0x7f04d4158e60 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d2d9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04d40cb460 0x7f04d40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d1d9b700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f04d40ad490 0x7f04d40cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:55012/0 (socket says 172.21.15.81:55012) 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.379+0000 7f04d1d9b700 1 -- 172.21.15.81:0/562063093 learned_addr learned my addr 172.21.15.81:0/562063093 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:14.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d259c700 1 --2- 172.21.15.81:0/562063093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 0x7f04d40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d2d9d700 1 -- 172.21.15.81:0/562063093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 msgr2=0x7f04d40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d2d9d700 1 --2- 172.21.15.81:0/562063093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 0x7f04d40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d2d9d700 1 -- 172.21.15.81:0/562063093 >> v1:172.21.15.176:6789/0 conn(0x7f04d40ad490 legacy=0x7f04d40cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d159a700 1 -- 172.21.15.81:0/562063093 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810690211 0 0) 0x7f04d40cd8f0 con 0x7f04d40ad490 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d2d9d700 1 -- 172.21.15.81:0/562063093 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d406dc60 con 0x7f04d40cb460 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d2d9d700 1 --2- 172.21.15.81:0/562063093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40cb460 0x7f04d40cbfb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009dc0 tx=0x7f04cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27d6afec6053595 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d159a700 1 -- 172.21.15.81:0/562063093 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00e070 con 0x7f04d40cb460 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d159a700 1 -- 172.21.15.81:0/562063093 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc00bae0 con 0x7f04d40cb460 2023-11-29T11:15:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d159a700 1 -- 172.21.15.81:0/562063093 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00be90 con 0x7f04d40cb460 2023-11-29T11:15:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d359e700 1 -- 172.21.15.81:0/562063093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40cb460 msgr2=0x7f04d40cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d359e700 1 --2- 172.21.15.81:0/562063093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40cb460 0x7f04d40cbfb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009dc0 tx=0x7f04cc00b330 comp rx=0 tx=0).stop 2023-11-29T11:15:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d359e700 1 -- 172.21.15.81:0/562063093 shutdown_connections 2023-11-29T11:15:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d359e700 1 --2- 172.21.15.81:0/562063093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40cb460 0x7f04d40cbfb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d359e700 1 --2- 172.21.15.81:0/562063093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 0x7f04d40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d359e700 1 -- 172.21.15.81:0/562063093 >> 172.21.15.81:0/562063093 conn(0x7f04d40ce3e0 msgr2=0x7f04d40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d359e700 1 -- 172.21.15.81:0/562063093 shutdown_connections 2023-11-29T11:15:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.383+0000 7f04d359e700 1 -- 172.21.15.81:0/562063093 wait complete. 2023-11-29T11:15:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 Processor -- start 2023-11-29T11:15:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 -- start start 2023-11-29T11:15:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40ad490 0x7f04d4157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d40cb460 0x7f04d406a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 0x7f04d406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40c78f0 con 0x7f04d40cb460 2023-11-29T11:15:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40c7bd0 con 0x7f04d40ad490 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40c7eb0 con 0x7f04d4158e60 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d40cb460 0x7f04d406a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d40cb460 0x7f04d406a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42502/0 (socket says 172.21.15.81:42502) 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 -- 172.21.15.81:0/241260605 learned_addr learned my addr 172.21.15.81:0/241260605 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d259c700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40ad490 0x7f04d4157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d2d9d700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 0x7f04d406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 -- 172.21.15.81:0/241260605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 msgr2=0x7f04d406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 0x7f04d406aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 -- 172.21.15.81:0/241260605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40ad490 msgr2=0x7f04d4157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40ad490 0x7f04d4157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 -- 172.21.15.81:0/241260605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc009a70 con 0x7f04d40cb460 2023-11-29T11:15:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d1d9b700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d40cb460 0x7f04d406a560 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c580 tx=0x7f04c400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04caffd700 1 -- 172.21.15.81:0/241260605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4004ca0 con 0x7f04d40cb460 2023-11-29T11:15:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04caffd700 1 -- 172.21.15.81:0/241260605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4004e20 con 0x7f04d40cb460 2023-11-29T11:15:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d4159230 con 0x7f04d40cb460 2023-11-29T11:15:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04caffd700 1 -- 172.21.15.81:0/241260605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4007310 con 0x7f04d40cb460 2023-11-29T11:15:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.387+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d40cde90 con 0x7f04d40cb460 2023-11-29T11:15:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.391+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d406d6a0 con 0x7f04d40cb460 2023-11-29T11:15:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.391+0000 7f04caffd700 1 -- 172.21.15.81:0/241260605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f04c401a020 con 0x7f04d40cb460 2023-11-29T11:15:14.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.391+0000 7f04caffd700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04b4064ee0 0x7f04b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:14.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.391+0000 7f04caffd700 1 -- 172.21.15.81:0/241260605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f04c4081c50 con 0x7f04d40cb460 2023-11-29T11:15:14.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.391+0000 7f04d259c700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04b4064ee0 0x7f04b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:14.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.391+0000 7f04d259c700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04b4064ee0 0x7f04b4067390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009b50 tx=0x7f04bc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:14.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.399+0000 7f04caffd700 1 -- 172.21.15.81:0/241260605 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f04c404fb60 con 0x7f04d40cb460 2023-11-29T11:15:14.488 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-11-29T11:15:14.483+0000 7ffa9460e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:15:14.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.599+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f04d4072500 con 0x7f04d40cb460 2023-11-29T11:15:14.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.603+0000 7f04caffd700 1 -- 172.21.15.81:0/241260605 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f04c4053180 con 0x7f04d40cb460 2023-11-29T11:15:14.607 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04b4064ee0 msgr2=0x7f04b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04b4064ee0 0x7f04b4067390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009b50 tx=0x7f04bc009240 comp rx=0 tx=0).stop 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d40cb460 msgr2=0x7f04d406a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d40cb460 0x7f04d406a560 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f04c400c580 tx=0x7f04c400c890 comp rx=0 tx=0).stop 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 shutdown_connections 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f04b4064ee0 0x7f04b4067390 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04d4158e60 0x7f04d406aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d40cb460 0x7f04d406a560 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 --2- 172.21.15.81:0/241260605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04d40ad490 0x7f04d4157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 >> 172.21.15.81:0/241260605 conn(0x7f04d40ce3e0 msgr2=0x7f04d40af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 shutdown_connections 2023-11-29T11:15:14.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:14.607+0000 7f04d359e700 1 -- 172.21.15.81:0/241260605 wait complete. 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:15:14.625 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:15:14.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:14.626 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:15:14.632 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:15:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:15:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:15:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42452sec preferred_lft 42452sec 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:15:14.633 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:15:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:15:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:15:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:15:14.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:14.635 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:15:14.647 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:15:14.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:14.649 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:15:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:15:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:15:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:15:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:15:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:15:14.657 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:15:14.657 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:15:14.657 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:15:14.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:14.657 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:15:14.657 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:15:14.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:15:14.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:15:14.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:15:14.657 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:15:14.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:14.738 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:15:14.744 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:15:14.745 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:15:14.745 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:15:14.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:14.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:15:14.762 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:15:14.762 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:15:14.762 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:15:14.769 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:15:14.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:15:14.769 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:15:14.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:15:14.833 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:15:14.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:15:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:15:14.847 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:15:14.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:14.848 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:15:14.853 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:15:14.854 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:15:14.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:15:14.871 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:15:14.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:15:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:15:14.883 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:15:14.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:14.883 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:15:14.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:15:14.943+0000 7f6520022640 -1 init, newargv = 0x55b58023e0a0 newargc=15 2023-11-29T11:15:14.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[50739]: starting ceph client 2023-11-29T11:15:14.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[50739]: starting fuse 2023-11-29T11:15:16.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:15:16.052 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:15:16.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:15:16.068 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:15:16.069 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:15:16.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:16.069 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:15:16.076 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:15:16.077 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:15:16.077 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:15:16.078 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:15:16.160 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.50739.asok 2023-11-29T11:15:16.344 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50739.asok 2023-11-29T11:15:16.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:16.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50739.asok status 2023-11-29T11:15:16.489 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "50739", 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6273, 2023-11-29T11:15:16.490 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6273 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1692233755 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1692233755 2023-11-29T11:15:16.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.6273 192.168.0.1:0/1692233755", 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/1692233755", 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 25, 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 55, 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:15:16.492 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:15:16.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:16.500 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:15:16.500 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:15:16.507 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:15:16.507 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:15:16.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:16.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:15:16.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:16.524 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-11-29T11:15:16.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:16.585 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-11-29T11:15:16.594 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:15:16.594 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:15:16.594 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:15:16.594 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:15:16.594 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-11-29T11:15:16.594 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:15:16.660 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627777 2023-11-29T11:15:16.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.963+0000 7f806c913700 1 Processor -- start 2023-11-29T11:15:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.963+0000 7f806c913700 1 -- start start 2023-11-29T11:15:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80680cf050 0x7f806806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f80680b4c10 0x7f80680cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806815c6d0 con 0x7f806806a530 2023-11-29T11:15:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806806a9a0 con 0x7f80680b4c10 2023-11-29T11:15:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806806ac60 con 0x7f80680cf050 2023-11-29T11:15:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f80677fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80680cf050 0x7f806806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f8067fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f80680b4c10 0x7f80680cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f8066ffd700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f806806a530 0x7f80680cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:55020/0 (socket says 172.21.15.81:55020) 2023-11-29T11:15:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f8066ffd700 1 -- 172.21.15.81:0/1628633745 learned_addr learned my addr 172.21.15.81:0/1628633745 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f80677fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80680cf050 0x7f806806d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:51718/0 (socket says 172.21.15.81:51718) 2023-11-29T11:15:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f8067fff700 1 -- 172.21.15.81:0/1628633745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80680cf050 msgr2=0x7f806806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f8067fff700 1 --2- 172.21.15.81:0/1628633745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80680cf050 0x7f806806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f8067fff700 1 -- 172.21.15.81:0/1628633745 >> v1:172.21.15.176:6789/0 conn(0x7f806806a530 legacy=0x7f80680cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f8067fff700 1 -- 172.21.15.81:0/1628633745 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806806af40 con 0x7f80680b4c10 2023-11-29T11:15:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f8067fff700 1 --2- 172.21.15.81:0/1628633745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680b4c10 0x7f80680cce20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8060009d90 tx=0x7f806000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=304f94472fe1e660 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f80667fc700 1 -- 172.21.15.81:0/1628633745 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000e070 con 0x7f80680b4c10 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f80667fc700 1 -- 172.21.15.81:0/1628633745 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806000bb20 con 0x7f80680b4c10 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f80667fc700 1 -- 172.21.15.81:0/1628633745 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060012430 con 0x7f80680b4c10 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 -- 172.21.15.81:0/1628633745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680b4c10 msgr2=0x7f80680cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 --2- 172.21.15.81:0/1628633745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680b4c10 0x7f80680cce20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8060009d90 tx=0x7f806000b330 comp rx=0 tx=0).stop 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 -- 172.21.15.81:0/1628633745 shutdown_connections 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 --2- 172.21.15.81:0/1628633745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680b4c10 0x7f80680cce20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 --2- 172.21.15.81:0/1628633745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80680cf050 0x7f806806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 -- 172.21.15.81:0/1628633745 >> 172.21.15.81:0/1628633745 conn(0x7f806809bb30 msgr2=0x7f80680b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 -- 172.21.15.81:0/1628633745 shutdown_connections 2023-11-29T11:15:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.967+0000 7f806c913700 1 -- 172.21.15.81:0/1628633745 wait complete. 2023-11-29T11:15:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 Processor -- start 2023-11-29T11:15:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 -- start start 2023-11-29T11:15:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f806806a530 0x7f806815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80680b4c10 0x7f80680c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680cf050 0x7f80680c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80680a0300 con 0x7f80680b4c10 2023-11-29T11:15:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80680c6f10 con 0x7f80680cf050 2023-11-29T11:15:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80680c71f0 con 0x7f806806a530 2023-11-29T11:15:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80680b4c10 0x7f80680c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80680b4c10 0x7f80680c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42512/0 (socket says 172.21.15.81:42512) 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 -- 172.21.15.81:0/189787530 learned_addr learned my addr 172.21.15.81:0/189787530 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8067fff700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680cf050 0x7f80680c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f80677fe700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f806806a530 0x7f806815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 -- 172.21.15.81:0/189787530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f806806a530 msgr2=0x7f806815e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f806806a530 0x7f806815e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 -- 172.21.15.81:0/189787530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680cf050 msgr2=0x7f80680c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680cf050 0x7f80680c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 -- 172.21.15.81:0/189787530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060009a70 con 0x7f80680b4c10 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f8066ffd700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80680b4c10 0x7f80680c6300 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f805800c410 tx=0x7f805800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f804ffff700 1 -- 172.21.15.81:0/189787530 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058005d90 con 0x7f80680b4c10 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f804ffff700 1 -- 172.21.15.81:0/189787530 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805800ce20 con 0x7f80680b4c10 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.971+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80680b46f0 con 0x7f80680b4c10 2023-11-29T11:15:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.975+0000 7f804ffff700 1 -- 172.21.15.81:0/189787530 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580072f0 con 0x7f80680b4c10 2023-11-29T11:15:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.975+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80680b4410 con 0x7f80680b4c10 2023-11-29T11:15:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.975+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806806b220 con 0x7f80680b4c10 2023-11-29T11:15:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.975+0000 7f804ffff700 1 -- 172.21.15.81:0/189787530 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8058019030 con 0x7f80680b4c10 2023-11-29T11:15:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.975+0000 7f804ffff700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8054064ee0 0x7f8054067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.975+0000 7f804ffff700 1 -- 172.21.15.81:0/189787530 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f80580816c0 con 0x7f80680b4c10 2023-11-29T11:15:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.975+0000 7f80677fe700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8054064ee0 0x7f8054067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.975+0000 7f80677fe700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8054064ee0 0x7f8054067390 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f805c009bf0 tx=0x7f805c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:16.983+0000 7f804ffff700 1 -- 172.21.15.81:0/189787530 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f805804f6b0 con 0x7f80680b4c10 2023-11-29T11:15:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.183+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8068072500 con 0x7f80680b4c10 2023-11-29T11:15:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.183+0000 7f804ffff700 1 -- 172.21.15.81:0/189787530 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f8058017090 con 0x7f80680b4c10 2023-11-29T11:15:17.188 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:17.188 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:15:08.545106+0000","modified":"2023-11-29T11:15:11.563216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/63586216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":63586216},{"type":"v1","addr":"172.21.15.81:6837","nonce":63586216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8054064ee0 msgr2=0x7f8054067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8054064ee0 0x7f8054067390 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f805c009bf0 tx=0x7f805c009240 comp rx=0 tx=0).stop 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80680b4c10 msgr2=0x7f80680c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80680b4c10 0x7f80680c6300 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f805800c410 tx=0x7f805800c720 comp rx=0 tx=0).stop 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 shutdown_connections 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8054064ee0 0x7f8054067390 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80680cf050 0x7f80680c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80680b4c10 0x7f80680c6300 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 --2- 172.21.15.81:0/189787530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f806806a530 0x7f806815e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 >> 172.21.15.81:0/189787530 conn(0x7f806809bb30 msgr2=0x7f80680b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 shutdown_connections 2023-11-29T11:15:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.187+0000 7f806c913700 1 -- 172.21.15.81:0/189787530 wait complete. 2023-11-29T11:15:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-11-29T11:15:17.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-29T11:15:17.338 INFO:teuthology.orchestra.run.smithi081.stdout:{"message":"","return_code":0} 2023-11-29T11:15:17.338 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:15:17.338 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-29T11:15:17.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.371+0000 7f2a2e1b3140 1 Processor -- start 2023-11-29T11:15:17.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.371+0000 7f2a2e1b3140 1 -- start start 2023-11-29T11:15:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a37eac50 0x55d5a37e9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 0x55d5a37e7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a38c5f50 0x55d5a38282e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a370e240 con 0x55d5a38c5f50 2023-11-29T11:15:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a38135b0 con 0x55d5a37eac50 2023-11-29T11:15:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a3830260 con 0x55d5a3817700 2023-11-29T11:15:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a38c5f50 0x55d5a38282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a38c5f50 0x55d5a38282e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42534/0 (socket says 172.21.15.81:42534) 2023-11-29T11:15:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 -- 172.21.15.81:0/961125468 learned_addr learned my addr 172.21.15.81:0/961125468 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2bce8700 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a37eac50 0x55d5a37e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2b4e7700 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 0x55d5a37e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 -- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 msgr2=0x55d5a37e7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 0x55d5a37e7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 -- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a37eac50 msgr2=0x55d5a37e9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a37eac50 0x55d5a37e9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 -- 172.21.15.81:0/961125468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2400a100 con 0x55d5a38c5f50 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2bce8700 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a37eac50 0x55d5a37e9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2c4e9700 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a38c5f50 0x55d5a38282e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c005c20 tx=0x7f2a1c00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1497731375033d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2a4e5700 1 -- 172.21.15.81:0/961125468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c008a00 con 0x55d5a38c5f50 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2a4e5700 1 -- 172.21.15.81:0/961125468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c008b60 con 0x55d5a38c5f50 2023-11-29T11:15:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2a4e5700 1 -- 172.21.15.81:0/961125468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c01e450 con 0x55d5a38c5f50 2023-11-29T11:15:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/961125468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a38c5f50 msgr2=0x55d5a38282e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a38c5f50 0x55d5a38282e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c005c20 tx=0x7f2a1c00d000 comp rx=0 tx=0).stop 2023-11-29T11:15:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/961125468 shutdown_connections 2023-11-29T11:15:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a38c5f50 0x55d5a38282e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 0x55d5a37e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 --2- 172.21.15.81:0/961125468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a37eac50 0x55d5a37e9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/961125468 >> 172.21.15.81:0/961125468 conn(0x55d5a37e5b30 msgr2=0x55d5a37ea3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/961125468 shutdown_connections 2023-11-29T11:15:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.375+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/961125468 wait complete. 2023-11-29T11:15:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 Processor -- start 2023-11-29T11:15:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 -- start start 2023-11-29T11:15:17.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a37eac50 0x55d5a3832860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 0x55d5a38b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a38c5f50 0x55d5a3813770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a382a2c0 con 0x55d5a37eac50 2023-11-29T11:15:17.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5a382a560 con 0x55d5a38c5f50 2023-11-29T11:15:17.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5a382a800 con 0x55d5a3817700 2023-11-29T11:15:17.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a37eac50 0x55d5a3832860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a37eac50 0x55d5a3832860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42548/0 (socket says 172.21.15.81:42548) 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 -- 172.21.15.81:0/2972890818 learned_addr learned my addr 172.21.15.81:0/2972890818 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2c4e9700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a38c5f50 0x55d5a3813770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2b4e7700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 0x55d5a38b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 -- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 msgr2=0x55d5a38b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d5a3817700 0x55d5a38b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 -- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a38c5f50 msgr2=0x55d5a3813770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d5a38c5f50 0x55d5a3813770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 -- 172.21.15.81:0/2972890818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2400a440 con 0x55d5a37eac50 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2bce8700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a37eac50 0x55d5a3832860 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2a24010930 tx=0x7f2a24010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a294e3700 1 -- 172.21.15.81:0/2972890818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24010e80 con 0x55d5a37eac50 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a294e3700 1 -- 172.21.15.81:0/2972890818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a24002980 con 0x55d5a37eac50 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5a3740760 con 0x55d5a37eac50 2023-11-29T11:15:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a294e3700 1 -- 172.21.15.81:0/2972890818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24002b30 con 0x55d5a37eac50 2023-11-29T11:15:17.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.379+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5a37198b0 con 0x55d5a37eac50 2023-11-29T11:15:17.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a294e3700 1 -- 172.21.15.81:0/2972890818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2a24023070 con 0x55d5a37eac50 2023-11-29T11:15:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a294e3700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a18063810 0x7f2a18065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a294e3700 1 -- 172.21.15.81:0/2972890818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2a240811d0 con 0x55d5a37eac50 2023-11-29T11:15:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a2b4e7700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a18063810 0x7f2a18065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a2e1b3140 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55d5a38b5600 0x55d5a382b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55) v8 -- 0x55d5a3829d40 con 0x55d5a38b5600 2023-11-29T11:15:17.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a2c4e9700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55d5a38b5600 0x55d5a382b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a2b4e7700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a18063810 0x7f2a18065cc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2a20001ed0 tx=0x7f2a20001710 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.383+0000 7f2a2c4e9700 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55d5a38b5600 0x55d5a382b6f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2c4e9700 1 -- 172.21.15.81:0/2972890818 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f2a1c025040 con 0x55d5a38b5600 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55d5a38b5600 msgr2=0x55d5a382b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55d5a38b5600 0x55d5a382b6f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a18063810 msgr2=0x7f2a18065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a18063810 0x7f2a18065cc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2a20001ed0 tx=0x7f2a20001710 comp rx=0 tx=0).stop 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a37eac50 msgr2=0x55d5a3832860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 --2- 172.21.15.81:0/2972890818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d5a37eac50 0x55d5a3832860 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2a24010930 tx=0x7f2a24010c40 comp rx=0 tx=0).stop 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2c4e9700 1 -- 172.21.15.81:0/2972890818 reap_dead start 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 shutdown_connections 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 >> 172.21.15.81:0/2972890818 conn(0x55d5a37e5b30 msgr2=0x55d5a3816cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 shutdown_connections 2023-11-29T11:15:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.387+0000 7f2a2e1b3140 1 -- 172.21.15.81:0/2972890818 wait complete. 2023-11-29T11:15:17.393 INFO:teuthology.orchestra.run.smithi081.stdout:Yalphaparent_a 2023-11-29T11:15:17.393 DEBUG:teuthology.orchestra.run.smithi081:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-29T11:15:17.448 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627777, 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "ancestors": [ 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "dirino": 1099511627776, 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "dname": "alpha", 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 2 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "dirino": 1, 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "dname": "parent_a", 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 4 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-11-29T11:15:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 9, 2023-11-29T11:15:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: "old_pools": [] 2023-11-29T11:15:17.450 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:15:17.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:17.451 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-11-29T11:15:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36ab5d9140 1 Processor -- start 2023-11-29T11:15:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36ab5d9140 1 -- start start 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36ab5d9140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea861880 0x5560ea85d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36ab5d9140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea8d4980 0x5560ea8d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36ab5d9140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 0x5560ea8eee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36ab5d9140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ea7ab180 con 0x5560ea861880 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36ab5d9140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ea73e240 con 0x5560ea8d4980 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36ab5d9140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560ea8d38d0 con 0x5560ea8d4d50 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a910e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea861880 0x5560ea85d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a910e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea861880 0x5560ea85d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42552/0 (socket says 172.21.15.81:42552) 2023-11-29T11:15:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a910e700 1 -- 172.21.15.81:0/469556636 learned_addr learned my addr 172.21.15.81:0/469556636 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a890d700 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea8d4980 0x5560ea8d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a990f700 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 0x5560ea8eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a910e700 1 -- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 msgr2=0x5560ea8eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a910e700 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 0x5560ea8eee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a910e700 1 -- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea8d4980 msgr2=0x5560ea8d3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a910e700 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea8d4980 0x5560ea8d3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.487+0000 7f36a910e700 1 -- 172.21.15.81:0/469556636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c005d20 con 0x5560ea861880 2023-11-29T11:15:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36a990f700 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 0x5560ea8eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36a910e700 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea861880 0x5560ea85d990 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5560ea806150 tx=0x7f369c00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb44ed9b07bdc4e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36a37fe700 1 -- 172.21.15.81:0/469556636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c00a300 con 0x5560ea861880 2023-11-29T11:15:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36a37fe700 1 -- 172.21.15.81:0/469556636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c008800 con 0x5560ea861880 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36a37fe700 1 -- 172.21.15.81:0/469556636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c008bb0 con 0x5560ea861880 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 -- 172.21.15.81:0/469556636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea861880 msgr2=0x5560ea85d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea861880 0x5560ea85d990 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5560ea806150 tx=0x7f369c00d000 comp rx=0 tx=0).stop 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 -- 172.21.15.81:0/469556636 shutdown_connections 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 0x5560ea8eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea8d4980 0x5560ea8d3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 --2- 172.21.15.81:0/469556636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea861880 0x5560ea85d990 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 -- 172.21.15.81:0/469556636 >> 172.21.15.81:0/469556636 conn(0x5560ea841fc0 msgr2=0x5560ea81a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 -- 172.21.15.81:0/469556636 shutdown_connections 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 -- 172.21.15.81:0/469556636 wait complete. 2023-11-29T11:15:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 Processor -- start 2023-11-29T11:15:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.491+0000 7f36ab5d9140 1 -- start start 2023-11-29T11:15:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36ab5d9140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea861880 0x5560ea977020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36ab5d9140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea8d4980 0x5560ea8195a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36ab5d9140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 0x5560ea979c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36ab5d9140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ea979600 con 0x5560ea8d4980 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36ab5d9140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ea81a0b0 con 0x5560ea861880 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36ab5d9140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560ea81a350 con 0x5560ea8d4d50 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea8d4980 0x5560ea8195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea8d4980 0x5560ea8195a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42556/0 (socket says 172.21.15.81:42556) 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 -- 172.21.15.81:0/3602495565 learned_addr learned my addr 172.21.15.81:0/3602495565 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a910e700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea861880 0x5560ea977020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 -- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 msgr2=0x5560ea979c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a990f700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 0x5560ea979c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5560ea8d4d50 0x5560ea979c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 -- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea861880 msgr2=0x5560ea977020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea861880 0x5560ea977020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 -- 172.21.15.81:0/3602495565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560ea756390 con 0x5560ea8d4980 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a910e700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5560ea861880 0x5560ea977020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a890d700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea8d4980 0x5560ea8195a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3694001ed0 tx=0x7f369400c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a27fc700 1 -- 172.21.15.81:0/3602495565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400f650 con 0x5560ea8d4980 2023-11-29T11:15:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a27fc700 1 -- 172.21.15.81:0/3602495565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694005030 con 0x5560ea8d4980 2023-11-29T11:15:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36a27fc700 1 -- 172.21.15.81:0/3602495565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400f9f0 con 0x5560ea8d4980 2023-11-29T11:15:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560ea7498b0 con 0x5560ea8d4980 2023-11-29T11:15:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.495+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560ea7565d0 con 0x5560ea8d4980 2023-11-29T11:15:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36a27fc700 1 -- 172.21.15.81:0/3602495565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f369401f070 con 0x5560ea8d4980 2023-11-29T11:15:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36a27fc700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f368c063840 0x7f368c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36a27fc700 1 -- 172.21.15.81:0/3602495565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3694081110 con 0x5560ea8d4980 2023-11-29T11:15:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36a910e700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f368c063840 0x7f368c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36ab5d9140 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5560ea977560 0x5560ea990220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) v8 -- 0x5560ea984f80 con 0x5560ea977560 2023-11-29T11:15:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36a990f700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5560ea977560 0x5560ea990220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36a910e700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f368c063840 0x7f368c065cf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f369c020000 tx=0x7f369c014040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.499+0000 7f36a990f700 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5560ea977560 0x5560ea990220 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36a990f700 1 -- 172.21.15.81:0/3602495565 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v55'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f36a400e1d0 con 0x5560ea977560 2023-11-29T11:15:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5560ea977560 msgr2=0x5560ea990220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5560ea977560 0x5560ea990220 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f368c063840 msgr2=0x7f368c065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f368c063840 0x7f368c065cf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f369c020000 tx=0x7f369c014040 comp rx=0 tx=0).stop 2023-11-29T11:15:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea8d4980 msgr2=0x5560ea8195a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 --2- 172.21.15.81:0/3602495565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560ea8d4980 0x5560ea8195a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3694001ed0 tx=0x7f369400c640 comp rx=0 tx=0).stop 2023-11-29T11:15:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36a990f700 1 -- 172.21.15.81:0/3602495565 reap_dead start 2023-11-29T11:15:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 shutdown_connections 2023-11-29T11:15:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 >> 172.21.15.81:0/3602495565 conn(0x5560ea841fc0 msgr2=0x5560ea85e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 shutdown_connections 2023-11-29T11:15:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.503+0000 7f36ab5d9140 1 -- 172.21.15.81:0/3602495565 wait complete. 2023-11-29T11:15:17.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo daemon-helper kill ceph --cluster ceph -w 2023-11-29T11:15:17.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-11-29T11:15:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d9c849700 1 Processor -- start 2023-11-29T11:15:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d9c849700 1 -- start start 2023-11-29T11:15:17.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d9c849700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1d980d2a30 0x7f1d9806a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d9c849700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2e00 0x7f1d980b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d9c849700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d980b7900 con 0x7f1d980b5e90 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d9c849700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9806b2b0 con 0x7f1d980d2a30 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d9c849700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9806aa10 con 0x7f1d980d2e00 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d96ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1d980b5e90 0x7f1d980cf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42618/0 (socket says 172.21.15.81:42618) 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d96ffd700 1 -- 172.21.15.81:0/1691914637 learned_addr learned my addr 172.21.15.81:0/1691914637 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d977fe700 1 --2- 172.21.15.81:0/1691914637 >> v2:172.21.15.176:3300/0 conn(0x7f1d980d2a30 0x7f1d9806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d97fff700 1 --2- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2e00 0x7f1d980b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d967fc700 1 -- 172.21.15.81:0/1691914637 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335651992 0 0) 0x7f1d980b7900 con 0x7f1d980b5e90 2023-11-29T11:15:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d967fc700 1 -- 172.21.15.81:0/1691914637 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d840035d0 con 0x7f1d980b5e90 2023-11-29T11:15:17.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d977fe700 1 -- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2e00 msgr2=0x7f1d980b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d977fe700 1 --2- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2e00 0x7f1d980b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d967fc700 1 -- 172.21.15.81:0/1691914637 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3405656927 0 0) 0x7f1d840035d0 con 0x7f1d980b5e90 2023-11-29T11:15:17.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d977fe700 1 -- 172.21.15.81:0/1691914637 >> v1:172.21.15.81:6789/0 conn(0x7f1d980b5e90 legacy=0x7f1d980cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d977fe700 1 -- 172.21.15.81:0/1691914637 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9806acf0 con 0x7f1d980d2a30 2023-11-29T11:15:17.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d97fff700 1 --2- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2e00 0x7f1d980b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:17.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d977fe700 1 --2- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980d2a30 0x7f1d9806a430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009850 tx=0x7f1d90009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcaf608f491e26b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d967fc700 1 -- 172.21.15.81:0/1691914637 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800019f0 con 0x7f1d980d2a30 2023-11-29T11:15:17.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d967fc700 1 -- 172.21.15.81:0/1691914637 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90004030 con 0x7f1d980d2a30 2023-11-29T11:15:17.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.635+0000 7f1d967fc700 1 -- 172.21.15.81:0/1691914637 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900043e0 con 0x7f1d980d2a30 2023-11-29T11:15:17.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980d2a30 msgr2=0x7f1d9806a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 --2- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980d2a30 0x7f1d9806a430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009850 tx=0x7f1d90009b60 comp rx=0 tx=0).stop 2023-11-29T11:15:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- 172.21.15.81:0/1691914637 shutdown_connections 2023-11-29T11:15:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 --2- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2e00 0x7f1d980b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 --2- 172.21.15.81:0/1691914637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980d2a30 0x7f1d9806a430 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- 172.21.15.81:0/1691914637 >> 172.21.15.81:0/1691914637 conn(0x7f1d9809bbb0 msgr2=0x7f1d980b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- 172.21.15.81:0/1691914637 shutdown_connections 2023-11-29T11:15:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- 172.21.15.81:0/1691914637 wait complete. 2023-11-29T11:15:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 Processor -- start 2023-11-29T11:15:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- start start 2023-11-29T11:15:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980b5e90 0x7f1d980c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2a30 0x7f1d980b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d980d2e00 0x7f1d9815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d980b3d50 con 0x7f1d980d2e00 2023-11-29T11:15:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d980c6940 con 0x7f1d980b5e90 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.639+0000 7f1d9c849700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d980c8a50 con 0x7f1d980d2a30 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d980d2e00 0x7f1d9815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d980d2e00 0x7f1d9815a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42572/0 (socket says 172.21.15.81:42572) 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 -- 172.21.15.81:0/3947940763 learned_addr learned my addr 172.21.15.81:0/3947940763 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d977fe700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980b5e90 0x7f1d980c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2a30 0x7f1d980b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 -- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2a30 msgr2=0x7f1d980b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2a30 0x7f1d980b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 -- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980b5e90 msgr2=0x7f1d980c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980b5e90 0x7f1d980c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 -- 172.21.15.81:0/3947940763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880094b0 con 0x7f1d980d2e00 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d977fe700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980b5e90 0x7f1d980c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d97fff700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d980d2e00 0x7f1d9815a690 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800eb60 tx=0x7f1d8800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d8ffff700 1 -- 172.21.15.81:0/3947940763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88004020 con 0x7f1d980d2e00 2023-11-29T11:15:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d8ffff700 1 -- 172.21.15.81:0/3947940763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88004180 con 0x7f1d980d2e00 2023-11-29T11:15:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d9c849700 1 -- 172.21.15.81:0/3947940763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d900094b0 con 0x7f1d980d2e00 2023-11-29T11:15:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d8ffff700 1 -- 172.21.15.81:0/3947940763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88004530 con 0x7f1d980d2e00 2023-11-29T11:15:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d9c849700 1 -- 172.21.15.81:0/3947940763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d980cf7c0 con 0x7f1d980d2e00 2023-11-29T11:15:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d8ffff700 1 -- 172.21.15.81:0/3947940763 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1d8800c850 con 0x7f1d980d2e00 2023-11-29T11:15:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d8ffff700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1d78064ee0 0x7f1d78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d8ffff700 1 -- 172.21.15.81:0/3947940763 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1d88081f60 con 0x7f1d980d2e00 2023-11-29T11:15:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.643+0000 7f1d977fe700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1d78064ee0 0x7f1d78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1d78064ee0 0x7f1d78067390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1d90000c00 tx=0x7f1d90008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1da0d2b740 1 Processor -- start 2023-11-29T11:15:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1da0d2b740 1 -- start start 2023-11-29T11:15:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2abbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280d9b0 0x2ac4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2858a30 0x2ac5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x297cc80 con 0x280dd80 2023-11-29T11:15:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x29ecd60 con 0x280d9b0 2023-11-29T11:15:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x29e6060 con 0x2858a30 2023-11-29T11:15:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2abbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2abbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42578/0 (socket says 172.21.15.81:42578) 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 -- 172.21.15.81:0/3097057661 learned_addr learned my addr 172.21.15.81:0/3097057661 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280d9b0 0x2ac4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d97fff700 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2858a30 0x2ac5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 -- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2858a30 msgr2=0x2ac5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2858a30 0x2ac5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 -- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280d9b0 msgr2=0x2ac4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280d9b0 0x2ac4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 -- 172.21.15.81:0/3097057661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a0b4e0 con 0x280dd80 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d97fff700 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2858a30 0x2ac5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d977fe700 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2abbd70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1d900090b0 tx=0x7f1d90010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916ff735d5e07856 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d8d7fa700 1 -- 172.21.15.81:0/3097057661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90006ea0 con 0x280dd80 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d8d7fa700 1 -- 172.21.15.81:0/3097057661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9002a070 con 0x280dd80 2023-11-29T11:15:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.647+0000 7f1d8d7fa700 1 -- 172.21.15.81:0/3097057661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90011830 con 0x280dd80 2023-11-29T11:15:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3097057661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 msgr2=0x2abbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2abbd70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1d900090b0 tx=0x7f1d90010000 comp rx=0 tx=0).stop 2023-11-29T11:15:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3097057661 shutdown_connections 2023-11-29T11:15:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2858a30 0x2ac5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280d9b0 0x2ac4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/3097057661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2abbd70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3097057661 >> 172.21.15.81:0/3097057661 conn(0x280e150 msgr2=0x2aa6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3097057661 shutdown_connections 2023-11-29T11:15:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3097057661 wait complete. 2023-11-29T11:15:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- start start 2023-11-29T11:15:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 Processor -- start 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2aca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a7e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2892dc0 con 0x280dd80 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2abba90 con 0x2858a30 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aca880 con 0x280d9b0 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 10 client.0 _ll_register_callbacks cb 0x2a41b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42588/0 (socket says 172.21.15.81:42588) 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 -- 172.21.15.81:0/468208314 learned_addr learned my addr 172.21.15.81:0/468208314 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d977fe700 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2aca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d97fff700 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a7e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 -- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 msgr2=0x2aca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2aca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 -- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 msgr2=0x2a7e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a7e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 -- 172.21.15.81:0/468208314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d90021050 con 0x280dd80 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d97fff700 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a7e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7ec40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1d80007820 tx=0x7f1d8000f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a46efa12521a843 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d767fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d767fc700 1 -- 172.21.15.81:0/468208314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000fa50 con 0x280dd80 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1d767fc700 1 -- 172.21.15.81:0/468208314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1d8000fbb0 con 0x280dd80 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.651+0000 7f1da0d2b740 1 -- 172.21.15.81:0/468208314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29df0e0 con 0x280dd80 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d767fc700 1 -- 172.21.15.81:0/468208314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d8000fd70 con 0x280dd80 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 10 client.6309 fetch_fsmap learned FSMap version 25 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 -- 172.21.15.81:0/468208314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x2859c80 con 0x280dd80 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d767fc700 1 -- 172.21.15.81:0/468208314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29df0e0 con 0x280dd80 2023-11-29T11:15:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d767fc700 1 -- 172.21.15.81:0/468208314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1d80012070 con 0x280dd80 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 10 client.6309 fetch_fsmap finished waiting for FSMap version 25 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 10 client.6309 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 20 client.6309 populate_metadata read hostname 'smithi081' 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x2abcb90 0x2abe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 4 client.6309 mds_command: new command op to 6117 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 -- 172.21.15.81:0/468208314 --> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x29dee00 con 0x2abcb90 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d977fe700 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x2abcb90 0x2abe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d767fc700 10 client.6309 ms_handle_connect on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d977fe700 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x2abcb90 0x2abe030 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba025d9c7a98f0ba server_cookie=bf374fea13e4ea9e in_seq=0 out_seq=0 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f77a4a76700 1 Processor -- start 2023-11-29T11:15:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f77a4a76700 1 -- start start 2023-11-29T11:15:17.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d767fc700 1 -- 172.21.15.81:0/468208314 <== mds.0 v2:172.21.15.81:6836/63586216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x29dee00 con 0x2abcb90 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d767fc700 10 client.6309 handle_command_reply: tid=0 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 client.6309 shutdown 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 -- 172.21.15.81:0/468208314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 msgr2=0x2a7ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7ec40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1d80007820 tx=0x7f1d8000f1d0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 -- 172.21.15.81:0/468208314 shutdown_connections 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x2abcb90 0x2abe030 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a7e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7ec40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/468208314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2aca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 -- 172.21.15.81:0/468208314 >> 172.21.15.81:0/468208314 conn(0x280e150 msgr2=0x2aa5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1d767fc700 0 client.6309 ms_handle_reset on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 -- 172.21.15.81:0/468208314 shutdown_connections 2023-11-29T11:15:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 1 -- 172.21.15.81:0/468208314 wait complete. 2023-11-29T11:15:17.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f77a4a76700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f77a0159bd0 0x7f77a006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f77a4a76700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77a006e540 0x7f77a00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f1da0d2b740 20 client.6309 trim_cache size 0 max 16384 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f77a4a76700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a015d230 con 0x7f77a00ae1a0 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f77a4a76700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a0160cf0 con 0x7f77a006e540 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f77a4a76700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a015c6f0 con 0x7f77a0159bd0 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f779ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f77a00ae1a0 0x7f77a00708e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42620/0 (socket says 172.21.15.81:42620) 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f779ffff700 1 -- 172.21.15.81:0/3348817578 learned_addr learned my addr 172.21.15.81:0/3348817578 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f7797fff700 1 --2- 172.21.15.81:0/3348817578 >> v2:172.21.15.81:3300/0 conn(0x7f77a006e540 0x7f77a00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f779f7fe700 1 --2- 172.21.15.81:0/3348817578 >> v2:172.21.15.176:3300/0 conn(0x7f77a0159bd0 0x7f77a006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f779effd700 1 -- 172.21.15.81:0/3348817578 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139427744 0 0) 0x7f77a015d230 con 0x7f77a00ae1a0 2023-11-29T11:15:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f779effd700 1 -- 172.21.15.81:0/3348817578 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f778c0035d0 con 0x7f77a00ae1a0 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f7797fff700 1 -- 172.21.15.81:0/3348817578 >> v2:172.21.15.176:3300/0 conn(0x7f77a0159bd0 msgr2=0x7f77a006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f7797fff700 1 --2- 172.21.15.81:0/3348817578 >> v2:172.21.15.176:3300/0 conn(0x7f77a0159bd0 0x7f77a006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f7797fff700 1 -- 172.21.15.81:0/3348817578 >> v1:172.21.15.81:6789/0 conn(0x7f77a00ae1a0 legacy=0x7f77a00708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f7797fff700 1 -- 172.21.15.81:0/3348817578 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0069c40 con 0x7f77a006e540 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f7797fff700 1 --2- 172.21.15.81:0/3348817578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a006e540 0x7f77a00adc60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f77a006d830 tx=0x7f7788009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1992f0e1979227 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f779effd700 1 -- 172.21.15.81:0/3348817578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788011830 con 0x7f77a006e540 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f779effd700 1 -- 172.21.15.81:0/3348817578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788011990 con 0x7f77a006e540 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.655+0000 7f779effd700 1 -- 172.21.15.81:0/3348817578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788011d20 con 0x7f77a006e540 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- 172.21.15.81:0/3348817578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a006e540 msgr2=0x7f77a00adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 --2- 172.21.15.81:0/3348817578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a006e540 0x7f77a00adc60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f77a006d830 tx=0x7f7788009b30 comp rx=0 tx=0).stop 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- 172.21.15.81:0/3348817578 shutdown_connections 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 --2- 172.21.15.81:0/3348817578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a006e540 0x7f77a00adc60 secure :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f77a006d830 tx=0x7f7788009b30 comp rx=0 tx=0).stop 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 --2- 172.21.15.81:0/3348817578 >> v2:172.21.15.176:3300/0 conn(0x7f77a0159bd0 0x7f77a006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- 172.21.15.81:0/3348817578 >> 172.21.15.81:0/3348817578 conn(0x7f77a00ceee0 msgr2=0x7f77a00cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- 172.21.15.81:0/3348817578 shutdown_connections 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- 172.21.15.81:0/3348817578 wait complete. 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 Processor -- start 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- start start 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a00ae1a0 0x7f77a00ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77a0159bd0 0x7f77a01f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a01516c0 0x7f77a015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00ad2c0 con 0x7f77a00ae1a0 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00ac7a0 con 0x7f77a01516c0 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00aca20 con 0x7f77a0159bd0 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a00ae1a0 0x7f77a00ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a00ae1a0 0x7f77a00ac260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42606/0 (socket says 172.21.15.81:42606) 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 -- 172.21.15.81:0/3515136440 learned_addr learned my addr 172.21.15.81:0/3515136440 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779ffff700 1 --2- 172.21.15.81:0/3515136440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a01516c0 0x7f77a015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f7797fff700 1 --2- 172.21.15.81:0/3515136440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77a0159bd0 0x7f77a01f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 -- 172.21.15.81:0/3515136440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77a0159bd0 msgr2=0x7f77a01f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 --2- 172.21.15.81:0/3515136440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77a0159bd0 0x7f77a01f1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 -- 172.21.15.81:0/3515136440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a01516c0 msgr2=0x7f77a015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 --2- 172.21.15.81:0/3515136440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a01516c0 0x7f77a015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 -- 172.21.15.81:0/3515136440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77880094b0 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779f7fe700 1 --2- 172.21.15.81:0/3515136440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a00ae1a0 0x7f77a00ac260 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f779000e840 tx=0x7f779000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779cff9700 1 -- 172.21.15.81:0/3515136440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900095a0 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779cff9700 1 -- 172.21.15.81:0/3515136440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790013680 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- 172.21.15.81:0/3515136440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a015cbe0 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f779cff9700 1 -- 172.21.15.81:0/3515136440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900139f0 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.659+0000 7f77a4a76700 1 -- 172.21.15.81:0/3515136440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a015c900 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.663+0000 7f77a4a76700 1 -- 172.21.15.81:0/3515136440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f77a015cec0 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.663+0000 7f779cff9700 1 -- 172.21.15.81:0/3515136440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7790019030 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.663+0000 7f779cff9700 1 --2- 172.21.15.81:0/3515136440 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f778c065340 0x7f778c0677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.663+0000 7f779cff9700 1 -- 172.21.15.81:0/3515136440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7790081d50 con 0x7f77a00ae1a0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.663+0000 7f7797fff700 1 --2- 172.21.15.81:0/3515136440 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f778c065340 0x7f778c0677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.663+0000 7f779cff9700 1 -- 172.21.15.81:0/3515136440 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+502 (secure 0 0 0) 0x7f779004fd50 con 0x7f77a00ae1a0 2023-11-29T11:15:17.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.663+0000 7f77a4a76700 1 -- 172.21.15.81:0/3515136440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f77a0067230 con 0x7f77a00ae1a0 2023-11-29T11:15:17.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.663+0000 7f7797fff700 1 --2- 172.21.15.81:0/3515136440 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f778c065340 0x7f778c0677f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f77a006e910 tx=0x7f7788008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1da0d2b740 1 Processor -- start 2023-11-29T11:15:17.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1da0d2b740 1 -- start start 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2a7c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29e4d10 con 0x280dd80 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x29943e0 con 0x2858a30 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x29ae0e0 con 0x280d9b0 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42618/0 (socket says 172.21.15.81:42618) 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 -- 172.21.15.81:0/3002848011 learned_addr learned my addr 172.21.15.81:0/3002848011 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d97fff700 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d977fe700 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2a7c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 -- 172.21.15.81:0/3002848011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 msgr2=0x2a7c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2a7c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 -- 172.21.15.81:0/3002848011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 msgr2=0x2a798d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a798d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 -- 172.21.15.81:0/3002848011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980c93d0 con 0x280dd80 2023-11-29T11:15:17.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7cd70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1d80007710 tx=0x7f1d80013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbaea30c9df33ac server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d8dffb700 1 -- 172.21.15.81:0/3002848011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000f5d0 con 0x280dd80 2023-11-29T11:15:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d8dffb700 1 -- 172.21.15.81:0/3002848011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8000d050 con 0x280dd80 2023-11-29T11:15:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.675+0000 7f1d8dffb700 1 -- 172.21.15.81:0/3002848011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8001b3a0 con 0x280dd80 2023-11-29T11:15:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3002848011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 msgr2=0x2a7cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7cd70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1d80007710 tx=0x7f1d80013000 comp rx=0 tx=0).stop 2023-11-29T11:15:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3002848011 shutdown_connections 2023-11-29T11:15:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2858a30 0x2a798d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x280dd80 0x2a7cd70 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/3002848011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2a7c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3002848011 >> 172.21.15.81:0/3002848011 conn(0x280e150 msgr2=0x2ad40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3002848011 shutdown_connections 2023-11-29T11:15:17.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- 172.21.15.81:0/3002848011 wait complete. 2023-11-29T11:15:17.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- start start 2023-11-29T11:15:17.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 Processor -- start 2023-11-29T11:15:17.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2b20360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280dd80 0x2a79be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2858a30 0x2a7a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2abbbd0 con 0x2858a30 2023-11-29T11:15:17.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b208a0 con 0x280dd80 2023-11-29T11:15:17.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2adcb40 con 0x280d9b0 2023-11-29T11:15:17.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1da0d2b740 10 client.0 _ll_register_callbacks cb 0x2a0c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:15:17.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2858a30 0x2a7a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2858a30 0x2a7a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42634/0 (socket says 172.21.15.81:42634) 2023-11-29T11:15:17.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 -- 172.21.15.81:0/592480367 learned_addr learned my addr 172.21.15.81:0/592480367 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d96ffd700 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280dd80 0x2a79be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d977fe700 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2b20360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 -- 172.21.15.81:0/592480367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 msgr2=0x2b20360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2b20360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 -- 172.21.15.81:0/592480367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280dd80 msgr2=0x2a79be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280dd80 0x2a79be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 -- 172.21.15.81:0/592480367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2859c80 con 0x2858a30 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d97fff700 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2858a30 0x2a7a120 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1d88053930 tx=0x7f1d88057e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d44c2950573d3ed server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.679+0000 7f1d767fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 1 -- 172.21.15.81:0/592480367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8805bb50 con 0x2858a30 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 1 -- 172.21.15.81:0/592480367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1d8804fa70 con 0x2858a30 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 -- 172.21.15.81:0/592480367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d9002a070 con 0x2858a30 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 1 -- 172.21.15.81:0/592480367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d8804fc50 con 0x2858a30 2023-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 10 client.6324 fetch_fsmap learned FSMap version 25 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 -- 172.21.15.81:0/592480367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x2992bb0 con 0x2858a30 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 1 -- 172.21.15.81:0/592480367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9002a070 con 0x2858a30 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 1 -- 172.21.15.81:0/592480367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1d8800cae0 con 0x2858a30 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 10 client.6324 fetch_fsmap finished waiting for FSMap version 25 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 10 client.6324 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 20 client.6324 populate_metadata read hostname 'smithi081' 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x2abd1f0 0x2a788c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 4 client.6324 mds_command: new command op to 6117 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 -- 172.21.15.81:0/592480367 --> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x288a500 con 0x2abd1f0 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d977fe700 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x2abd1f0 0x2a788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d977fe700 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x2abd1f0 0x2a788c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e114ce6cb5c3955 server_cookie=a3905e64280b29df in_seq=0 out_seq=0 2023-11-29T11:15:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 10 client.6324 ms_handle_connect on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 1 -- 172.21.15.81:0/592480367 <== mds.0 v2:172.21.15.81:6836/63586216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x288a500 con 0x2abd1f0 2023-11-29T11:15:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 10 client.6324 handle_command_reply: tid=0 2023-11-29T11:15:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 client.6324 shutdown 2023-11-29T11:15:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 -- 172.21.15.81:0/592480367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2858a30 msgr2=0x2a7a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2858a30 0x2a7a120 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1d88053930 tx=0x7f1d88057e10 comp rx=0 tx=0).stop 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 -- 172.21.15.81:0/592480367 shutdown_connections 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x2abd1f0 0x2a788c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2858a30 0x2a7a120 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x280dd80 0x2a79be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 --2- 172.21.15.81:0/592480367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x280d9b0 0x2b20360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 -- 172.21.15.81:0/592480367 >> 172.21.15.81:0/592480367 conn(0x280e150 msgr2=0x2ad40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d767fc700 0 client.6324 ms_handle_reset on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 -- 172.21.15.81:0/592480367 shutdown_connections 2023-11-29T11:15:17.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 1 -- 172.21.15.81:0/592480367 wait complete. 2023-11-29T11:15:17.690 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-11-29T11:15:17.683+0000 7ffa90e07700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6273=0-4194304@1} caps={6273=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6273 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x558a354ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-29T11:15:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1da0d2b740 20 client.6324 trim_cache size 0 max 16384 2023-11-29T11:15:17.691 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:15:17.691 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:15:17.691 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "708af060-adac-41f9-a1da-3ba7958fd847", 2023-11-29T11:15:17.691 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:15:17.691 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:15:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d9c849700 1 -- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1d78064ee0 msgr2=0x7f1d78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d9c849700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1d78064ee0 0x7f1d78067390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1d90000c00 tx=0x7f1d90008030 comp rx=0 tx=0).stop 2023-11-29T11:15:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d9c849700 1 -- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d980d2e00 msgr2=0x7f1d9815a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.683+0000 7f1d9c849700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d980d2e00 0x7f1d9815a690 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800eb60 tx=0x7f1d8800ef20 comp rx=0 tx=0).stop 2023-11-29T11:15:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.687+0000 7f1d9c849700 1 -- 172.21.15.81:0/3947940763 shutdown_connections 2023-11-29T11:15:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.687+0000 7f1d9c849700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1d78064ee0 0x7f1d78067390 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.687+0000 7f1d9c849700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d980d2e00 0x7f1d9815a690 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.687+0000 7f1d9c849700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d980d2a30 0x7f1d980b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.687+0000 7f1d9c849700 1 --2- 172.21.15.81:0/3947940763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d980b5e90 0x7f1d980c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.687+0000 7f1d9c849700 1 -- 172.21.15.81:0/3947940763 >> 172.21.15.81:0/3947940763 conn(0x7f1d9809bbb0 msgr2=0x7f1d9815cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.687+0000 7f1d9c849700 1 -- 172.21.15.81:0/3947940763 shutdown_connections 2023-11-29T11:15:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.687+0000 7f1d9c849700 1 -- 172.21.15.81:0/3947940763 wait complete. 2023-11-29T11:15:17.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-29T11:15:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.815+0000 7f7c14f63700 1 Processor -- start 2023-11-29T11:15:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.815+0000 7f7c14f63700 1 -- start start 2023-11-29T11:15:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.815+0000 7f7c14f63700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c100cf980 0x7f7c100cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.815+0000 7f7c14f63700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1006dc40 con 0x7f7c1006af20 2023-11-29T11:15:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.815+0000 7f7c14f63700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1006d0c0 con 0x7f7c1006cc50 2023-11-29T11:15:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.815+0000 7f7c14f63700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1006b2f0 con 0x7f7c100cf980 2023-11-29T11:15:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7c1006af20 0x7f7c100cf270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42634/0 (socket says 172.21.15.81:42634) 2023-11-29T11:15:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/1819146601 learned_addr learned my addr 172.21.15.81:0/1819146601 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/1819146601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c100cf980 0x7f7c100cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0e7fc700 1 -- 172.21.15.81:0/1819146601 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187880627 0 0) 0x7f7c1006dc40 con 0x7f7c1006af20 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0e7fc700 1 -- 172.21.15.81:0/1819146601 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bfc0035d0 con 0x7f7c1006af20 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0e7fc700 1 -- 172.21.15.81:0/1819146601 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870960500 0 0) 0x7f7c1006d0c0 con 0x7f7c1006cc50 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0e7fc700 1 -- 172.21.15.81:0/1819146601 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c1006dc40 con 0x7f7c1006cc50 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0ffff700 1 -- 172.21.15.81:0/1819146601 >> v1:172.21.15.176:6789/0 conn(0x7f7c1006cc50 legacy=0x7f7c100b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0ffff700 1 -- 172.21.15.81:0/1819146601 >> v1:172.21.15.81:6789/0 conn(0x7f7c1006af20 legacy=0x7f7c100cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0ffff700 1 -- 172.21.15.81:0/1819146601 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1006d3a0 con 0x7f7c100cf980 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/1819146601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c100cf980 0x7f7c100cce20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009880 tx=0x7f7c08009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c543d2c0ba76c7fa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0e7fc700 1 -- 172.21.15.81:0/1819146601 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08011830 con 0x7f7c100cf980 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0e7fc700 1 -- 172.21.15.81:0/1819146601 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08011990 con 0x7f7c100cf980 2023-11-29T11:15:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c0e7fc700 1 -- 172.21.15.81:0/1819146601 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08011d20 con 0x7f7c100cf980 2023-11-29T11:15:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c14f63700 1 -- 172.21.15.81:0/1819146601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c100cf980 msgr2=0x7f7c100cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c14f63700 1 --2- 172.21.15.81:0/1819146601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c100cf980 0x7f7c100cce20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009880 tx=0x7f7c08009b90 comp rx=0 tx=0).stop 2023-11-29T11:15:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c14f63700 1 -- 172.21.15.81:0/1819146601 shutdown_connections 2023-11-29T11:15:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c14f63700 1 --2- 172.21.15.81:0/1819146601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c100cf980 0x7f7c100cce20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c14f63700 1 -- 172.21.15.81:0/1819146601 >> 172.21.15.81:0/1819146601 conn(0x7f7c1009bb30 msgr2=0x7f7c100b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c14f63700 1 -- 172.21.15.81:0/1819146601 shutdown_connections 2023-11-29T11:15:17.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.819+0000 7f7c14f63700 1 -- 172.21.15.81:0/1819146601 wait complete. 2023-11-29T11:15:17.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 Processor -- start 2023-11-29T11:15:17.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 -- start start 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c1006af20 0x7f7c100cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c1006cc50 0x7f7c100d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100cf980 0x7f7c101f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100d3100 con 0x7f7c100cf980 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100d0e50 con 0x7f7c1006af20 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100d10f0 con 0x7f7c1006cc50 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100cf980 0x7f7c101f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100cf980 0x7f7c101f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42642/0 (socket says 172.21.15.81:42642) 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c1006af20 0x7f7c100cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 -- 172.21.15.81:0/26953791 learned_addr learned my addr 172.21.15.81:0/26953791 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0effd700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c1006cc50 0x7f7c100d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 -- 172.21.15.81:0/26953791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c1006cc50 msgr2=0x7f7c100d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c1006cc50 0x7f7c100d2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 -- 172.21.15.81:0/26953791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c1006af20 msgr2=0x7f7c100cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c1006af20 0x7f7c100cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 -- 172.21.15.81:0/26953791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080094b0 con 0x7f7c100cf980 2023-11-29T11:15:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100cf980 0x7f7c101f1a80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7c080097d0 tx=0x7f7c08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c07fff700 1 -- 172.21.15.81:0/26953791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801a8c0 con 0x7f7c100cf980 2023-11-29T11:15:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c07fff700 1 -- 172.21.15.81:0/26953791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0801e070 con 0x7f7c100cf980 2023-11-29T11:15:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 -- 172.21.15.81:0/26953791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1006d960 con 0x7f7c100cf980 2023-11-29T11:15:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c07fff700 1 -- 172.21.15.81:0/26953791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0801ac80 con 0x7f7c100cf980 2023-11-29T11:15:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.823+0000 7f7c14f63700 1 -- 172.21.15.81:0/26953791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1006d680 con 0x7f7c100cf980 2023-11-29T11:15:17.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.827+0000 7f7c07fff700 1 -- 172.21.15.81:0/26953791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7c0800f050 con 0x7f7c100cf980 2023-11-29T11:15:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.831+0000 7f7c07fff700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7bf0064ee0 0x7f7bf0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.831+0000 7f7c07fff700 1 -- 172.21.15.81:0/26953791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7c08082b00 con 0x7f7c100cf980 2023-11-29T11:15:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.831+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7bf0064ee0 0x7f7bf0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.831+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7bf0064ee0 0x7f7bf0067390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c000012e0 tx=0x7f7c00001ad0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.831+0000 7f7c19445740 1 Processor -- start 2023-11-29T11:15:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.831+0000 7f7c19445740 1 -- start start 2023-11-29T11:15:17.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1bb77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937840 0x1bb7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 0x1bb8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aa6d20 con 0x1937c10 2023-11-29T11:15:17.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b16d60 con 0x1937840 2023-11-29T11:15:17.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b10060 con 0x19828c0 2023-11-29T11:15:17.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1bb77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1bb77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42650/0 (socket says 172.21.15.81:42650) 2023-11-29T11:15:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/3479657389 learned_addr learned my addr 172.21.15.81:0/3479657389 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0effd700 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937840 0x1bb7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 0x1bb8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/3479657389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 msgr2=0x1bb8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 0x1bb8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/3479657389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937840 msgr2=0x1bb7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937840 0x1bb7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/3479657389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b360a0 con 0x1937c10 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1bb77d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7c00007a90 tx=0x7f7c00012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427d9b29feb6a2f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c057fa700 1 -- 172.21.15.81:0/3479657389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00002080 con 0x1937c10 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c057fa700 1 -- 172.21.15.81:0/3479657389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c000148e0 con 0x1937c10 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c057fa700 1 -- 172.21.15.81:0/3479657389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00014c50 con 0x1937c10 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 -- 172.21.15.81:0/3479657389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 msgr2=0x1bb77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1bb77d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7c00007a90 tx=0x7f7c00012000 comp rx=0 tx=0).stop 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 -- 172.21.15.81:0/3479657389 shutdown_connections 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 0x1bb8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937840 0x1bb7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 --2- 172.21.15.81:0/3479657389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1bb77d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 -- 172.21.15.81:0/3479657389 >> 172.21.15.81:0/3479657389 conn(0x1937fe0 msgr2=0x1bd0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 -- 172.21.15.81:0/3479657389 shutdown_connections 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.835+0000 7f7c19445740 1 -- 172.21.15.81:0/3479657389 wait complete. 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 1 -- start start 2023-11-29T11:15:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 1 Processor -- start 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 0x1bf6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1ba4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19828c0 0x1ba5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x19bcc50 con 0x1937c10 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf73e0 con 0x19828c0 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bf7680 con 0x1937840 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c19445740 10 client.0 _ll_register_callbacks cb 0x1b099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c0effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1ba4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c0effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1ba4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42652/0 (socket says 172.21.15.81:42652) 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c0effd700 1 -- 172.21.15.81:0/2645731050 learned_addr learned my addr 172.21.15.81:0/2645731050 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 0x1bf6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.839+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19828c0 0x1ba5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c0effd700 1 -- 172.21.15.81:0/2645731050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 msgr2=0x1bf6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c0effd700 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 0x1bf6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c0effd700 1 -- 172.21.15.81:0/2645731050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19828c0 msgr2=0x1ba5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c0effd700 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19828c0 0x1ba5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c0effd700 1 -- 172.21.15.81:0/2645731050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc0035d0 con 0x1937c10 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c0effd700 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1ba4e20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8012520 tx=0x7f7bf8012830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76a6cef5a858998 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 1 -- 172.21.15.81:0/2645731050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf801a030 con 0x1937c10 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 1 -- 172.21.15.81:0/2645731050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7bf801b070 con 0x1937c10 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 1 -- 172.21.15.81:0/2645731050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b090e0 con 0x1937c10 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 1 -- 172.21.15.81:0/2645731050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bf8012e50 con 0x1937c10 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 10 client.6336 fetch_fsmap learned FSMap version 25 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 1 -- 172.21.15.81:0/2645731050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1983b10 con 0x1937c10 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 1 -- 172.21.15.81:0/2645731050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf8025020 con 0x1937c10 2023-11-29T11:15:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 1 -- 172.21.15.81:0/2645731050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7bf8005320 con 0x1937c10 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 10 client.6336 fetch_fsmap finished waiting for FSMap version 25 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 10 client.6336 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 20 client.6336 populate_metadata read hostname 'smithi081' 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1ba5d90 0x1c00dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 4 client.6336 mds_command: new command op to 6117 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 1 -- 172.21.15.81:0/2645731050 --> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b08e00 con 0x1ba5d90 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1ba5d90 0x1c00dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 10 client.6336 ms_handle_connect on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1ba5d90 0x1c00dc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69dbbbd78aa5479f server_cookie=dcbce236765eba2a in_seq=0 out_seq=0 2023-11-29T11:15:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 1 -- 172.21.15.81:0/2645731050 <== mds.0 v2:172.21.15.81:6836/63586216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1b08e00 con 0x1ba5d90 2023-11-29T11:15:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7bee7fc700 10 client.6336 handle_command_reply: tid=0 2023-11-29T11:15:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 1 client.6336 shutdown 2023-11-29T11:15:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 1 -- 172.21.15.81:0/2645731050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 msgr2=0x1ba4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.843+0000 7f7c19445740 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1ba4e20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8012520 tx=0x7f7bf8012830 comp rx=0 tx=0).stop 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 1 -- 172.21.15.81:0/2645731050 shutdown_connections 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1ba5d90 0x1c00dc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19828c0 0x1ba5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7bee7fc700 0 client.6336 ms_handle_reset on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937c10 0x1ba4e20 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 1 --2- 172.21.15.81:0/2645731050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 0x1bf6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 1 -- 172.21.15.81:0/2645731050 >> 172.21.15.81:0/2645731050 conn(0x1937fe0 msgr2=0x1ba97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 1 -- 172.21.15.81:0/2645731050 shutdown_connections 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 1 -- 172.21.15.81:0/2645731050 wait complete. 2023-11-29T11:15:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.847+0000 7f7c19445740 20 client.6336 trim_cache size 0 max 16384 2023-11-29T11:15:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c19445740 1 Processor -- start 2023-11-29T11:15:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c19445740 1 -- start start 2023-11-29T11:15:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c19445740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937840 0x1ba3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c19445740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 0x1ba3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c19445740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 0x1c46560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c19445740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aa6200 con 0x1937840 2023-11-29T11:15:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c19445740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ab9f10 con 0x1937c10 2023-11-29T11:15:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c19445740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b17ff0 con 0x19828c0 2023-11-29T11:15:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937840 0x1ba3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937840 0x1ba3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42668/0 (socket says 172.21.15.81:42668) 2023-11-29T11:15:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/2549957118 learned_addr learned my addr 172.21.15.81:0/2549957118 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0effd700 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 0x1ba3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 0x1c46560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/2549957118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 msgr2=0x1c46560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 0x1c46560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/2549957118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 msgr2=0x1ba3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 0x1ba3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 -- 172.21.15.81:0/2549957118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100af710 con 0x1937840 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937840 0x1ba3510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x1ab2250 tx=0x7f7c00014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ec229d5ffc1869 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c05ffb700 1 -- 172.21.15.81:0/2549957118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00001790 con 0x1937840 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c05ffb700 1 -- 172.21.15.81:0/2549957118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00002020 con 0x1937840 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.867+0000 7f7c05ffb700 1 -- 172.21.15.81:0/2549957118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00037450 con 0x1937840 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- 172.21.15.81:0/2549957118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937840 msgr2=0x1ba3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937840 0x1ba3510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x1ab2250 tx=0x7f7c00014000 comp rx=0 tx=0).stop 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- 172.21.15.81:0/2549957118 shutdown_connections 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19828c0 0x1c46560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 0x1ba3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 --2- 172.21.15.81:0/2549957118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1937840 0x1ba3510 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- 172.21.15.81:0/2549957118 >> 172.21.15.81:0/2549957118 conn(0x1937fe0 msgr2=0x1bf60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- 172.21.15.81:0/2549957118 shutdown_connections 2023-11-29T11:15:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- 172.21.15.81:0/2549957118 wait complete. 2023-11-29T11:15:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- start start 2023-11-29T11:15:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 Processor -- start 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 0x1c4e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 0x1bcc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19828c0 0x1bcce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aaf510 con 0x19828c0 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ae5f70 con 0x1937c10 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.871+0000 7f7c19445740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ad5440 con 0x1937840 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19828c0 0x1bcce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 10 client.0 _ll_register_callbacks cb 0x7f7c00017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19828c0 0x1bcce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42678/0 (socket says 172.21.15.81:42678) 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 -- 172.21.15.81:0/3045668302 learned_addr learned my addr 172.21.15.81:0/3045668302 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0effd700 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 0x1bcc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 0x1c4e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 -- 172.21.15.81:0/3045668302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 msgr2=0x1c4e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 0x1c4e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 -- 172.21.15.81:0/3045668302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 msgr2=0x1bcc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 0x1bcc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 -- 172.21.15.81:0/3045668302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1b360a0 con 0x19828c0 2023-11-29T11:15:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0ffff700 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19828c0 0x1bcce20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7c0802b4a0 tx=0x7f7c0805c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3417ffb8d6cc4f36 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 1 -- 172.21.15.81:0/3045668302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08053e20 con 0x19828c0 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 1 -- 172.21.15.81:0/3045668302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7c0805a2c0 con 0x19828c0 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 -- 172.21.15.81:0/3045668302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c000148e0 con 0x19828c0 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 1 -- 172.21.15.81:0/3045668302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c0805c330 con 0x19828c0 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 10 client.6342 fetch_fsmap learned FSMap version 25 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 -- 172.21.15.81:0/3045668302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1abcaf0 con 0x19828c0 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 1 -- 172.21.15.81:0/3045668302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c000148e0 con 0x19828c0 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 1 -- 172.21.15.81:0/3045668302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7c08050520 con 0x19828c0 2023-11-29T11:15:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 10 client.6342 fetch_fsmap finished waiting for FSMap version 25 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 10 client.6342 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 20 client.6342 populate_metadata read hostname 'smithi081' 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1bf8810 0x1bf8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 4 client.6342 mds_command: new command op to 6117 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 -- 172.21.15.81:0/3045668302 --> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x19b4390 con 0x1bf8810 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1bf8810 0x1bf8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 10 client.6342 ms_handle_connect on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c0f7fe700 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1bf8810 0x1bf8c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e9082ffa8cff38a server_cookie=336ea83b7e13cbc1 in_seq=0 out_seq=0 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 1 -- 172.21.15.81:0/3045668302 <== mds.0 v2:172.21.15.81:6836/63586216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x19b4390 con 0x1bf8810 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 10 client.6342 handle_command_reply: tid=0 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 client.6342 shutdown 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 -- 172.21.15.81:0/3045668302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19828c0 msgr2=0x1bcce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19828c0 0x1bcce20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7c0802b4a0 tx=0x7f7c0805c7c0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 -- 172.21.15.81:0/3045668302 shutdown_connections 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1bf8810 0x1bf8c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19828c0 0x1bcce20 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1937c10 0x1bcc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7bee7fc700 0 client.6342 ms_handle_reset on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 --2- 172.21.15.81:0/3045668302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1937840 0x1c4e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 -- 172.21.15.81:0/3045668302 >> 172.21.15.81:0/3045668302 conn(0x1937fe0 msgr2=0x1bd0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 -- 172.21.15.81:0/3045668302 shutdown_connections 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 1 -- 172.21.15.81:0/3045668302 wait complete. 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.875+0000 7f7c19445740 20 client.6342 trim_cache size 0 max 16384 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:15:17.883 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:15:17.884 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:15:17.884 INFO:teuthology.orchestra.run.smithi081.stdout: "708af060-adac-41f9-a1da-3ba7958fd847": { 2023-11-29T11:15:17.884 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2023-11-29T11:15:17.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "708af060-adac-41f9-a1da-3ba7958fd847", 2023-11-29T11:15:17.884 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,repair" 2023-11-29T11:15:17.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:17.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:17.884 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 -- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7bf0064ee0 msgr2=0x7f7bf0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7bf0064ee0 0x7f7bf0067390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c000012e0 tx=0x7f7c00001ad0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 -- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100cf980 msgr2=0x7f7c101f1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100cf980 0x7f7c101f1a80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7c080097d0 tx=0x7f7c08004770 comp rx=0 tx=0).stop 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 -- 172.21.15.81:0/26953791 shutdown_connections 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7bf0064ee0 0x7f7bf0067390 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100cf980 0x7f7c101f1a80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c1006cc50 0x7f7c100d2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 --2- 172.21.15.81:0/26953791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c1006af20 0x7f7c100cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 -- 172.21.15.81:0/26953791 >> 172.21.15.81:0/26953791 conn(0x7f7c1009bb30 msgr2=0x7f7c100b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 -- 172.21.15.81:0/26953791 shutdown_connections 2023-11-29T11:15:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:17.879+0000 7f7c14f63700 1 -- 172.21.15.81:0/26953791 wait complete. 2023-11-29T11:15:17.895 INFO:tasks.cephfs.filesystem:scrub status for tag:708af060-adac-41f9-a1da-3ba7958fd847 - {'path': '/', 'tag': '708af060-adac-41f9-a1da-3ba7958fd847', 'options': 'recursive,repair'} 2023-11-29T11:15:18.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:18.611+0000 7f779cff9700 1 -- 172.21.15.81:0/3515136440 <== mon.0 v2:172.21.15.81:3300/0 7 ==== log(6 entries from seq 1 at 2023-11-29T11:15:17.685768+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f779005bb00 con 0x7f77a00ae1a0 2023-11-29T11:15:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: cluster: 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: id: 8e4db050-5755-42f7-ba76-f62443203ed8 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: health: HEALTH_OK 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: services: 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: mgr: y(active, since 2m), standbys: x 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: mds: 1/1 daemons up, 3 standby 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: data: 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: volumes: 1/1 healthy 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: pools: 4 pools, 105 pgs 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: objects: 24 objects, 579 KiB 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: usage: 74 MiB used, 720 GiB / 720 GiB avail 2023-11-29T11:15:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: pgs: 105 active+clean 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: io: 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: client: 1.9 KiB/s wr, 0 op/s rd, 5 op/s wr 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:15:17.685768+0000 mds.c [INF] scrub queued for path: / 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:15:17.685772+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:15:17.685776+0000 mds.c [INF] scrub summary: active paths [/] 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:15:17.687086+0000 mds.c [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:15:17.687096+0000 mds.c [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-11-29T11:15:18.617 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:15:17.687578+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-11-29T11:15:21.009 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:15:19.104094+0000 mds.c [INF] scrub summary: idle 2023-11-29T11:15:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:21.003+0000 7f779cff9700 1 -- 172.21.15.81:0/3515136440 <== mon.0 v2:172.21.15.81:3300/0 8 ==== log(1 entries from seq 7 at 2023-11-29T11:15:19.104094+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7790051db0 con 0x7f77a00ae1a0 2023-11-29T11:15:26.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:15:26.044 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:15:47.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-29T11:15:48.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc2901a1700 1 Processor -- start 2023-11-29T11:15:48.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc2901a1700 1 -- start start 2023-11-29T11:15:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc2901a1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc2880b4570 0x7fc2880b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc2901a1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc28806ad00 0x7fc2880ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc2901a1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc288069c40 0x7fc28806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc2901a1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880cd5c0 con 0x7fc288069c40 2023-11-29T11:15:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc2901a1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880d28e0 con 0x7fc2880b4570 2023-11-29T11:15:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc2901a1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880d1730 con 0x7fc28806ad00 2023-11-29T11:15:48.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc28e73e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc288069c40 0x7fc28806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc28e73e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc288069c40 0x7fc28806a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41316/0 (socket says 172.21.15.81:41316) 2023-11-29T11:15:48.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.019+0000 7fc28e73e700 1 -- 172.21.15.81:0/3169871638 learned_addr learned my addr 172.21.15.81:0/3169871638 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28d73c700 1 --2- 172.21.15.81:0/3169871638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc28806ad00 0x7fc2880ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28df3d700 1 --2- 172.21.15.81:0/3169871638 >> v2:172.21.15.176:3300/0 conn(0x7fc2880b4570 0x7fc2880b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28e73e700 1 -- 172.21.15.81:0/3169871638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc28806ad00 msgr2=0x7fc2880ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28e73e700 1 --2- 172.21.15.81:0/3169871638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc28806ad00 0x7fc2880ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28e73e700 1 -- 172.21.15.81:0/3169871638 >> v2:172.21.15.176:3300/0 conn(0x7fc2880b4570 msgr2=0x7fc2880b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28e73e700 1 --2- 172.21.15.81:0/3169871638 >> v2:172.21.15.176:3300/0 conn(0x7fc2880b4570 0x7fc2880b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28e73e700 1 -- 172.21.15.81:0/3169871638 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880b4e80 con 0x7fc288069c40 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28e73e700 1 --2- 172.21.15.81:0/3169871638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288069c40 0x7fc28806a0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc28808bd40 tx=0x7fc28000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2898e265f84437d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28cf3b700 1 -- 172.21.15.81:0/3169871638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28000e070 con 0x7fc288069c40 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28cf3b700 1 -- 172.21.15.81:0/3169871638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28000b910 con 0x7fc288069c40 2023-11-29T11:15:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc28cf3b700 1 -- 172.21.15.81:0/3169871638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28000bcc0 con 0x7fc288069c40 2023-11-29T11:15:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 -- 172.21.15.81:0/3169871638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288069c40 msgr2=0x7fc28806a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3169871638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288069c40 0x7fc28806a0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc28808bd40 tx=0x7fc28000b330 comp rx=0 tx=0).stop 2023-11-29T11:15:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 -- 172.21.15.81:0/3169871638 shutdown_connections 2023-11-29T11:15:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3169871638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc28806ad00 0x7fc2880ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3169871638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288069c40 0x7fc28806a0c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3169871638 >> v2:172.21.15.176:3300/0 conn(0x7fc2880b4570 0x7fc2880b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 -- 172.21.15.81:0/3169871638 >> 172.21.15.81:0/3169871638 conn(0x7fc28806cac0 msgr2=0x7fc2880cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 -- 172.21.15.81:0/3169871638 shutdown_connections 2023-11-29T11:15:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.023+0000 7fc2901a1700 1 -- 172.21.15.81:0/3169871638 wait complete. 2023-11-29T11:15:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 Processor -- start 2023-11-29T11:15:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 -- start start 2023-11-29T11:15:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc288069c40 0x7fc288155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc28806ad00 0x7fc2881596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2880b4570 0x7fc2880b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288156d10 con 0x7fc28806ad00 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288159be0 con 0x7fc2880b4570 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881f1620 con 0x7fc288069c40 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc28806ad00 0x7fc2881596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28e73e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2880b4570 0x7fc2880b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28df3d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc288069c40 0x7fc288155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc28806ad00 0x7fc2881596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41322/0 (socket says 172.21.15.81:41322) 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 -- 172.21.15.81:0/3582020169 learned_addr learned my addr 172.21.15.81:0/3582020169 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28e73e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2880b4570 0x7fc2880b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:41074/0 (socket says 172.21.15.81:41074) 2023-11-29T11:15:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 -- 172.21.15.81:0/3582020169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc288069c40 msgr2=0x7fc288155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc288069c40 0x7fc288155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 -- 172.21.15.81:0/3582020169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2880b4570 msgr2=0x7fc2880b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2880b4570 0x7fc2880b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 -- 172.21.15.81:0/3582020169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280009b30 con 0x7fc28806ad00 2023-11-29T11:15:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc28d73c700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc28806ad00 0x7fc2881596a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc28400e7f0 tx=0x7fc28400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc27e7fc700 1 -- 172.21.15.81:0/3582020169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284013680 con 0x7fc28806ad00 2023-11-29T11:15:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc27e7fc700 1 -- 172.21.15.81:0/3582020169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2840137e0 con 0x7fc28806ad00 2023-11-29T11:15:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 -- 172.21.15.81:0/3582020169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2880d1450 con 0x7fc28806ad00 2023-11-29T11:15:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc27e7fc700 1 -- 172.21.15.81:0/3582020169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284013b90 con 0x7fc28806ad00 2023-11-29T11:15:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.027+0000 7fc2901a1700 1 -- 172.21.15.81:0/3582020169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2880d1170 con 0x7fc28806ad00 2023-11-29T11:15:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.031+0000 7fc27e7fc700 1 -- 172.21.15.81:0/3582020169 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc284019030 con 0x7fc28806ad00 2023-11-29T11:15:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.031+0000 7fc27e7fc700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc26c064f10 0x7fc26c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.031+0000 7fc293421740 1 Processor -- start 2023-11-29T11:15:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.031+0000 7fc28df3d700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc26c064f10 0x7fc26c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.031+0000 7fc27e7fc700 1 -- 172.21.15.81:0/3582020169 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc284081d30 con 0x7fc28806ad00 2023-11-29T11:15:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.031+0000 7fc293421740 1 -- start start 2023-11-29T11:15:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.031+0000 7fc28df3d700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc26c064f10 0x7fc26c0673c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc278009bf0 tx=0x7fc278009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88c10 0x113fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xed38c0 0x113c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xff7d20 con 0xe88840 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1067d60 con 0xe88c10 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1061060 con 0xed38c0 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28df3d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88c10 0x113fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41332/0 (socket says 172.21.15.81:41332) 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 -- 172.21.15.81:0/1186357248 learned_addr learned my addr 172.21.15.81:0/1186357248 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28e73e700 1 --2- 172.21.15.81:0/1186357248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xed38c0 0x113c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 -- 172.21.15.81:0/1186357248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xed38c0 msgr2=0x113c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 --2- 172.21.15.81:0/1186357248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xed38c0 0x113c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 -- 172.21.15.81:0/1186357248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88c10 msgr2=0x113fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 --2- 172.21.15.81:0/1186357248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88c10 0x113fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 -- 172.21.15.81:0/1186357248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10870a0 con 0xe88840 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc28d73c700 1 --2- 172.21.15.81:0/1186357248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11400a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc28405b4c0 tx=0x7fc28405ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23928b5045dcb72 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc26b7fe700 1 -- 172.21.15.81:0/1186357248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284053050 con 0xe88840 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc26b7fe700 1 -- 172.21.15.81:0/1186357248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284069020 con 0xe88840 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc26b7fe700 1 -- 172.21.15.81:0/1186357248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28405b760 con 0xe88840 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- 172.21.15.81:0/1186357248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 msgr2=0x11400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 --2- 172.21.15.81:0/1186357248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11400a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc28405b4c0 tx=0x7fc28405ba70 comp rx=0 tx=0).stop 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- 172.21.15.81:0/1186357248 shutdown_connections 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 --2- 172.21.15.81:0/1186357248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xed38c0 0x113c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 --2- 172.21.15.81:0/1186357248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11400a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 --2- 172.21.15.81:0/1186357248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88c10 0x113fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- 172.21.15.81:0/1186357248 >> 172.21.15.81:0/1186357248 conn(0xe88fe0 msgr2=0x1121b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- 172.21.15.81:0/1186357248 shutdown_connections 2023-11-29T11:15:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- 172.21.15.81:0/1186357248 wait complete. 2023-11-29T11:15:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 -- start start 2023-11-29T11:15:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.035+0000 7fc293421740 1 Processor -- start 2023-11-29T11:15:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88840 0x10fb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88c10 0x1106860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xed38c0 0x11083c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf0dc50 con 0xe88c10 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x111b5e0 con 0xed38c0 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1106da0 con 0xe88840 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 10 client.0 _ll_register_callbacks cb 0x105a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88c10 0x1106860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88c10 0x1106860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41338/0 (socket says 172.21.15.81:41338) 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 -- 172.21.15.81:0/4198304291 learned_addr learned my addr 172.21.15.81:0/4198304291 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28e73e700 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xed38c0 0x11083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28df3d700 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88840 0x10fb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 -- 172.21.15.81:0/4198304291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88840 msgr2=0x10fb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88840 0x10fb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 -- 172.21.15.81:0/4198304291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xed38c0 msgr2=0x11083c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xed38c0 0x11083c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 -- 172.21.15.81:0/4198304291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2880d1170 con 0xe88c10 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28d73c700 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88c10 0x1106860 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fc28404fe60 tx=0x7fc2840095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b9f8377dc6ce7d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc268ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc268ff9700 1 -- 172.21.15.81:0/4198304291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284051dc0 con 0xe88c10 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc268ff9700 1 -- 172.21.15.81:0/4198304291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc28406a030 con 0xe88c10 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 -- 172.21.15.81:0/4198304291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x105a0e0 con 0xe88c10 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc268ff9700 1 -- 172.21.15.81:0/4198304291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc28405b770 con 0xe88c10 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 10 client.6354 fetch_fsmap learned FSMap version 25 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 -- 172.21.15.81:0/4198304291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0xed4b10 con 0xe88c10 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc268ff9700 1 -- 172.21.15.81:0/4198304291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x105a0e0 con 0xe88c10 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc268ff9700 1 -- 172.21.15.81:0/4198304291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc284063030 con 0xe88c10 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 10 client.6354 fetch_fsmap finished waiting for FSMap version 25 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 10 client.6354 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 20 client.6354 populate_metadata read hostname 'smithi081' 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1109150 0x1151d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 4 client.6354 mds_command: new command op to 6117 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:15:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc293421740 1 -- 172.21.15.81:0/4198304291 --> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1059e00 con 0x1109150 2023-11-29T11:15:48.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28df3d700 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1109150 0x1151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc268ff9700 10 client.6354 ms_handle_connect on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.039+0000 7fc28df3d700 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1109150 0x1151d20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=395c90c3f2d6e2cb server_cookie=cbf18d180f09729f in_seq=0 out_seq=0 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc268ff9700 1 -- 172.21.15.81:0/4198304291 <== mds.0 v2:172.21.15.81:6836/63586216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1059e00 con 0x1109150 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc268ff9700 10 client.6354 handle_command_reply: tid=0 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 client.6354 shutdown 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 -- 172.21.15.81:0/4198304291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88c10 msgr2=0x1106860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88c10 0x1106860 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fc28404fe60 tx=0x7fc2840095e0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 -- 172.21.15.81:0/4198304291 shutdown_connections 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0x1109150 0x1151d20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xed38c0 0x11083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88c10 0x1106860 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 --2- 172.21.15.81:0/4198304291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88840 0x10fb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc268ff9700 0 client.6354 ms_handle_reset on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:48.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 -- 172.21.15.81:0/4198304291 >> 172.21.15.81:0/4198304291 conn(0xe88fe0 msgr2=0x111d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 -- 172.21.15.81:0/4198304291 shutdown_connections 2023-11-29T11:15:48.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 1 -- 172.21.15.81:0/4198304291 wait complete. 2023-11-29T11:15:48.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.043+0000 7fc293421740 20 client.6354 trim_cache size 0 max 16384 2023-11-29T11:15:48.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc293421740 1 Processor -- start 2023-11-29T11:15:48.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc293421740 1 -- start start 2023-11-29T11:15:48.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc293421740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 0x1142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc293421740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc293421740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x1143930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc293421740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x100af10 con 0xe88840 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc293421740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1026440 con 0xe88fe0 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc293421740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1036f70 con 0xe88c10 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc28d73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc28d73c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41348/0 (socket says 172.21.15.81:41348) 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc28d73c700 1 -- 172.21.15.81:0/873127501 learned_addr learned my addr 172.21.15.81:0/873127501 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc28e73e700 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x1143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.059+0000 7fc28df3d700 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 0x1142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc28d73c700 1 -- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 msgr2=0x1143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc28d73c700 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x1143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc28d73c700 1 -- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 msgr2=0x1142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc28d73c700 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 0x1142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc28d73c700 1 -- 172.21.15.81:0/873127501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880c7720 con 0xe88840 2023-11-29T11:15:48.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc28e73e700 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x1143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:48.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc28d73c700 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11433f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc28405b4c0 tx=0x7fc28405c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcfa1323d84920d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc26bfff700 1 -- 172.21.15.81:0/873127501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840534a0 con 0xe88840 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc26bfff700 1 -- 172.21.15.81:0/873127501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284051dc0 con 0xe88840 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc26bfff700 1 -- 172.21.15.81:0/873127501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840529e0 con 0xe88840 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- 172.21.15.81:0/873127501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 msgr2=0x11433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11433f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc28405b4c0 tx=0x7fc28405c000 comp rx=0 tx=0).stop 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- 172.21.15.81:0/873127501 shutdown_connections 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x1143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x11433f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 --2- 172.21.15.81:0/873127501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 0x1142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- 172.21.15.81:0/873127501 >> 172.21.15.81:0/873127501 conn(0x11069d0 msgr2=0x111de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- 172.21.15.81:0/873127501 shutdown_connections 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- 172.21.15.81:0/873127501 wait complete. 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- start start 2023-11-29T11:15:48.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 Processor -- start 2023-11-29T11:15:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x114a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x114a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 0x119bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1063bc0 con 0xe88840 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1030ba0 con 0xe88fe0 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1023140 con 0xe88c10 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc293421740 10 client.0 _ll_register_callbacks cb 0x7fc28404fd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.063+0000 7fc28df3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x114a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28df3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x114a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41360/0 (socket says 172.21.15.81:41360) 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28df3d700 1 -- 172.21.15.81:0/1906063566 learned_addr learned my addr 172.21.15.81:0/1906063566 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28e73e700 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 0x119bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28d73c700 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x114a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28df3d700 1 -- 172.21.15.81:0/1906063566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 msgr2=0x114a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28df3d700 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x114a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28df3d700 1 -- 172.21.15.81:0/1906063566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 msgr2=0x119bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28df3d700 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 0x119bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28df3d700 1 -- 172.21.15.81:0/1906063566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xed4b10 con 0xe88840 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28df3d700 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x114a170 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc27802a3e0 tx=0x7fc2780047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a08632f112e7769 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 1 -- 172.21.15.81:0/1906063566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278029070 con 0xe88840 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 1 -- 172.21.15.81:0/1906063566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc27802a410 con 0xe88840 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 -- 172.21.15.81:0/1906063566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc284069020 con 0xe88840 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 1 -- 172.21.15.81:0/1906063566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc27801c040 con 0xe88840 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 10 client.6360 fetch_fsmap learned FSMap version 25 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 -- 172.21.15.81:0/1906063566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x100daf0 con 0xe88840 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 1 -- 172.21.15.81:0/1906063566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284069020 con 0xe88840 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 1 -- 172.21.15.81:0/1906063566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc27802a870 con 0xe88840 2023-11-29T11:15:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 10 client.6360 fetch_fsmap finished waiting for FSMap version 25 2023-11-29T11:15:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 10 client.6360 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-29T11:15:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 20 client.6360 populate_metadata read hostname 'smithi081' 2023-11-29T11:15:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0xed38c0 0x119c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 4 client.6360 mds_command: new command op to 6117 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:15:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 -- 172.21.15.81:0/1906063566 --> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xf05390 con 0xed38c0 2023-11-29T11:15:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28d73c700 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0xed38c0 0x119c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 10 client.6360 ms_handle_connect on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc28d73c700 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0xed38c0 0x119c1d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d939bc5157808b server_cookie=4464ea27e8ff32ab in_seq=0 out_seq=0 2023-11-29T11:15:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 1 -- 172.21.15.81:0/1906063566 <== mds.0 v2:172.21.15.81:6836/63586216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xf05390 con 0xed38c0 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc268ff9700 10 client.6360 handle_command_reply: tid=0 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 client.6360 shutdown 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 -- 172.21.15.81:0/1906063566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 msgr2=0x114a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x114a170 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc27802a3e0 tx=0x7fc2780047e0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 -- 172.21.15.81:0/1906063566 shutdown_connections 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.067+0000 7fc293421740 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.81:6836/63586216,v1:172.21.15.81:6837/63586216] conn(0xed38c0 0x119c1d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc293421740 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe88fe0 0x119bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc268ff9700 0 client.6360 ms_handle_reset on v2:172.21.15.81:6836/63586216 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc293421740 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe88c10 0x114a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc293421740 1 --2- 172.21.15.81:0/1906063566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe88840 0x114a170 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc293421740 1 -- 172.21.15.81:0/1906063566 >> 172.21.15.81:0/1906063566 conn(0x11069d0 msgr2=0x10f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc293421740 1 -- 172.21.15.81:0/1906063566 shutdown_connections 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc293421740 1 -- 172.21.15.81:0/1906063566 wait complete. 2023-11-29T11:15:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc293421740 20 client.6360 trim_cache size 0 max 16384 2023-11-29T11:15:48.076 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:15:48.076 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:15:48.076 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:15:48.076 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 -- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc26c064f10 msgr2=0x7fc26c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc26c064f10 0x7fc26c0673c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc278009bf0 tx=0x7fc278009240 comp rx=0 tx=0).stop 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 -- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc28806ad00 msgr2=0x7fc2881596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc28806ad00 0x7fc2881596a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc28400e7f0 tx=0x7fc28400eb00 comp rx=0 tx=0).stop 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 -- 172.21.15.81:0/3582020169 shutdown_connections 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc26c064f10 0x7fc26c0673c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2880b4570 0x7fc2880b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc28806ad00 0x7fc2881596a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 --2- 172.21.15.81:0/3582020169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc288069c40 0x7fc288155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 -- 172.21.15.81:0/3582020169 >> 172.21.15.81:0/3582020169 conn(0x7fc28806cac0 msgr2=0x7fc2880d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 -- 172.21.15.81:0/3582020169 shutdown_connections 2023-11-29T11:15:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.071+0000 7fc2901a1700 1 -- 172.21.15.81:0/3582020169 wait complete. 2023-11-29T11:15:48.091 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:15:48.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:48.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4aca540700 1 Processor -- start 2023-11-29T11:15:48.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4aca540700 1 -- start start 2023-11-29T11:15:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4aca540700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac4160ac0 0x7f4ac40b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4aca540700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4ac40cd1c0 0x7f4ac40b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4aca540700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40d0740 con 0x7f4ac40b45f0 2023-11-29T11:15:48.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4aca540700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac40b4f00 con 0x7f4ac40cd1c0 2023-11-29T11:15:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4aca540700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40d0990 con 0x7f4ac4160ac0 2023-11-29T11:15:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ac40b45f0 0x7f4ac40d1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58624/0 (socket says 172.21.15.81:58624) 2023-11-29T11:15:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac3fff700 1 -- 172.21.15.81:0/3208592945 learned_addr learned my addr 172.21.15.81:0/3208592945 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:48.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac8add700 1 --2- 172.21.15.81:0/3208592945 >> v2:172.21.15.176:3300/0 conn(0x7f4ac40cd1c0 0x7f4ac40b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac37fe700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac4160ac0 0x7f4ac40b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168353850 0 0) 0x7f4ac40d0740 con 0x7f4ac40b45f0 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa40035d0 con 0x7f4ac40b45f0 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1681934189 0 0) 0x7f4aa40035d0 con 0x7f4ac40b45f0 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac4160ac0 msgr2=0x7f4ac40b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac4160ac0 0x7f4ac40b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 >> v2:172.21.15.176:3300/0 conn(0x7f4ac40cd1c0 msgr2=0x7f4ac40b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 --2- 172.21.15.81:0/3208592945 >> v2:172.21.15.176:3300/0 conn(0x7f4ac40cd1c0 0x7f4ac40b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40d0c70 con 0x7f4ac40b45f0 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f4ab40019f0 con 0x7f4ac40b45f0 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 >> v1:172.21.15.81:6789/0 conn(0x7f4ac40b45f0 legacy=0x7f4ac40d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4003a20 0x7f4aa4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa4004450 0x7f4aa4004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac4160ac0 0x7f4aa4004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40b4f00 con 0x7f4aa4003a20 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40d0990 con 0x7f4aa4004450 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa400ba30 con 0x7f4ac4160ac0 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac3fff700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4003a20 0x7f4aa4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac37fe700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa4004450 0x7f4aa4004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac8add700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac4160ac0 0x7f4aa4004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac3fff700 1 -- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac4160ac0 msgr2=0x7f4aa4004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac3fff700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac4160ac0 0x7f4aa4004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac3fff700 1 -- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa4004450 msgr2=0x7f4aa4004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac3fff700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa4004450 0x7f4aa4004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.307+0000 7f4ac3fff700 1 -- 172.21.15.81:0/3208592945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40035d0 con 0x7f4aa4003a20 2023-11-29T11:15:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4ac3fff700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4003a20 0x7f4aa4003e30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400a850 tx=0x7f4aa40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d383a39d80d3473 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40072d0 con 0x7f4aa4003a20 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4007430 con 0x7f4aa4003a20 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4ac2ffd700 1 -- 172.21.15.81:0/3208592945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40077c0 con 0x7f4aa4003a20 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4aca540700 1 -- 172.21.15.81:0/3208592945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4003a20 msgr2=0x7f4aa4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4aca540700 1 --2- 172.21.15.81:0/3208592945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4003a20 0x7f4aa4003e30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400a850 tx=0x7f4aa40058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4ac8add700 1 -- 172.21.15.81:0/3208592945 reap_dead start 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4aca540700 1 -- 172.21.15.81:0/3208592945 shutdown_connections 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4aca540700 1 -- 172.21.15.81:0/3208592945 >> 172.21.15.81:0/3208592945 conn(0x7f4ac406cb40 msgr2=0x7f4ac40cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4aca540700 1 -- 172.21.15.81:0/3208592945 shutdown_connections 2023-11-29T11:15:48.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4aca540700 1 -- 172.21.15.81:0/3208592945 wait complete. 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4aca540700 1 Processor -- start 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.311+0000 7f4aca540700 1 -- start start 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4aca540700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa4003a20 0x7f4ac40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4aca540700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac40ca9e0 0x7f4ac40b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4aca540700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac415d530 0x7f4ac414de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4aca540700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40b59a0 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4aca540700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40b64e0 con 0x7f4ac415d530 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4aca540700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40b5bb0 con 0x7f4aa4003a20 2023-11-29T11:15:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac40ca9e0 0x7f4ac40b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac40ca9e0 0x7f4ac40b7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41382/0 (socket says 172.21.15.81:41382) 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 -- 172.21.15.81:0/3628226256 learned_addr learned my addr 172.21.15.81:0/3628226256 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac3fff700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa4003a20 0x7f4ac40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac8add700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac415d530 0x7f4ac414de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 -- 172.21.15.81:0/3628226256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa4003a20 msgr2=0x7f4ac40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa4003a20 0x7f4ac40cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 -- 172.21.15.81:0/3628226256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac415d530 msgr2=0x7f4ac414de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac415d530 0x7f4ac414de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 -- 172.21.15.81:0/3628226256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40d1230 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac37fe700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac40ca9e0 0x7f4ac40b7cb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0108f0 tx=0x7f4aac010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac0ff9700 1 -- 172.21.15.81:0/3628226256 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac016670 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac0ff9700 1 -- 172.21.15.81:0/3628226256 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac0167d0 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4ac0ff9700 1 -- 172.21.15.81:0/3628226256 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac016b60 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac40d0f50 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.315+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac415c660 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.319+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac4072c20 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.319+0000 7f4ac0ff9700 1 -- 172.21.15.81:0/3628226256 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4aac01c030 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.319+0000 7f4ac0ff9700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4aa8064ee0 0x7f4aa8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.319+0000 7f4ac0ff9700 1 -- 172.21.15.81:0/3628226256 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4aac0820f0 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.319+0000 7f4ac3fff700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4aa8064ee0 0x7f4aa8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.319+0000 7f4ac3fff700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4aa8064ee0 0x7f4aa8067390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000f80 tx=0x7f4ab4009070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.327+0000 7f4ac0ff9700 1 -- 172.21.15.81:0/3628226256 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4aac0500d0 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.527+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ac40b6620 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4ac0ff9700 1 -- 172.21.15.81:0/3628226256 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f4aac0536f0 con 0x7f4ac40ca9e0 2023-11-29T11:15:48.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:48.534 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:15:08.545106+0000","modified":"2023-11-29T11:15:11.563216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/63586216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":63586216},{"type":"v1","addr":"172.21.15.81:6837","nonce":63586216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-29T11:15:48.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4aa8064ee0 msgr2=0x7f4aa8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4aa8064ee0 0x7f4aa8067390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000f80 tx=0x7f4ab4009070 comp rx=0 tx=0).stop 2023-11-29T11:15:48.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac40ca9e0 msgr2=0x7f4ac40b7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac40ca9e0 0x7f4ac40b7cb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0108f0 tx=0x7f4aac010c00 comp rx=0 tx=0).stop 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 shutdown_connections 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4aa8064ee0 0x7f4aa8067390 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac415d530 0x7f4ac414de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac40ca9e0 0x7f4ac40b7cb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 --2- 172.21.15.81:0/3628226256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa4003a20 0x7f4ac40cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 >> 172.21.15.81:0/3628226256 conn(0x7f4ac406cb40 msgr2=0x7f4ac40b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 shutdown_connections 2023-11-29T11:15:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.531+0000 7f4aca540700 1 -- 172.21.15.81:0/3628226256 wait complete. 2023-11-29T11:15:48.538 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-11-29T11:15:48.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-29T11:15:48.677 INFO:teuthology.orchestra.run.smithi081.stdout:{"message":"","return_code":0} 2023-11-29T11:15:48.677 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:15:48.677 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-29T11:15:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff9672ff140 1 Processor -- start 2023-11-29T11:15:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff9672ff140 1 -- start start 2023-11-29T11:15:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff9672ff140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddafc610 0x55e0ddb3a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff9672ff140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40a90 0x55e0ddbb6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff9672ff140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddb40e60 0x55e0ddb39650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff9672ff140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0dda1f240 con 0x55e0ddb40a90 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff9672ff140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ddb3b0e0 con 0x55e0ddafc610 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff9672ff140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0ddbd0ce0 con 0x55e0ddb40e60 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40a90 0x55e0ddbb6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40a90 0x55e0ddbb6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41412/0 (socket says 172.21.15.81:41412) 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 -- 172.21.15.81:0/1570438434 learned_addr learned my addr 172.21.15.81:0/1570438434 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff965635700 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddb40e60 0x55e0ddb39650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964e34700 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddafc610 0x55e0ddb3a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 -- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddb40e60 msgr2=0x55e0ddb39650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddb40e60 0x55e0ddb39650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 -- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddafc610 msgr2=0x55e0ddb3a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddafc610 0x55e0ddb3a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 -- 172.21.15.81:0/1570438434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c00a1c0 con 0x55e0ddb40a90 2023-11-29T11:15:48.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964e34700 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddafc610 0x55e0ddb3a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:48.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.711+0000 7ff964633700 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40a90 0x55e0ddbb6850 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00a7a0 tx=0x7ff94c00aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6fdd2e0a851bd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff963631700 1 -- 172.21.15.81:0/1570438434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00f070 con 0x55e0ddb40a90 2023-11-29T11:15:48.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff963631700 1 -- 172.21.15.81:0/1570438434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c0084c0 con 0x55e0ddb40a90 2023-11-29T11:15:48.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff963631700 1 -- 172.21.15.81:0/1570438434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c008850 con 0x55e0ddb40a90 2023-11-29T11:15:48.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 -- 172.21.15.81:0/1570438434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40a90 msgr2=0x55e0ddbb6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40a90 0x55e0ddbb6850 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00a7a0 tx=0x7ff94c00aab0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 -- 172.21.15.81:0/1570438434 shutdown_connections 2023-11-29T11:15:48.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddb40e60 0x55e0ddb39650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40a90 0x55e0ddbb6850 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 --2- 172.21.15.81:0/1570438434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddafc610 0x55e0ddb3a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 -- 172.21.15.81:0/1570438434 >> 172.21.15.81:0/1570438434 conn(0x55e0ddb26dc0 msgr2=0x55e0ddb281c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 -- 172.21.15.81:0/1570438434 shutdown_connections 2023-11-29T11:15:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 -- 172.21.15.81:0/1570438434 wait complete. 2023-11-29T11:15:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 Processor -- start 2023-11-29T11:15:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.715+0000 7ff9672ff140 1 -- start start 2023-11-29T11:15:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff9672ff140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddafc610 0x55e0ddb39650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff9672ff140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddb40a90 0x55e0ddb39b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff9672ff140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40e60 0x55e0ddc61cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff9672ff140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ddba6b60 con 0x55e0ddb40e60 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff9672ff140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ddba4e60 con 0x55e0ddb40a90 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff9672ff140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0ddba5100 con 0x55e0ddafc610 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40e60 0x55e0ddc61cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40e60 0x55e0ddc61cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41426/0 (socket says 172.21.15.81:41426) 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 -- 172.21.15.81:0/2745992889 learned_addr learned my addr 172.21.15.81:0/2745992889 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff964e34700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddafc610 0x55e0ddb39650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff964633700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddb40a90 0x55e0ddb39b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 -- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddafc610 msgr2=0x55e0ddb39650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddafc610 0x55e0ddb39650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 -- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddb40a90 msgr2=0x55e0ddb39b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddb40a90 0x55e0ddb39b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 -- 172.21.15.81:0/2745992889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c00a420 con 0x55e0ddb40e60 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff964e34700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0ddafc610 0x55e0ddb39650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:48.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff964633700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0ddb40a90 0x55e0ddb39b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff965635700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40e60 0x55e0ddc61cb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff95c003000 tx=0x7ff95c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff96262f700 1 -- 172.21.15.81:0/2745992889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c010d60 con 0x55e0ddb40e60 2023-11-29T11:15:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0dda37390 con 0x55e0ddb40e60 2023-11-29T11:15:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff96262f700 1 -- 172.21.15.81:0/2745992889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c009030 con 0x55e0ddb40e60 2023-11-29T11:15:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff96262f700 1 -- 172.21.15.81:0/2745992889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c024640 con 0x55e0ddb40e60 2023-11-29T11:15:48.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0dda2a8b0 con 0x55e0ddb40e60 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.719+0000 7ff96262f700 1 -- 172.21.15.81:0/2745992889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff95c00e070 con 0x55e0ddb40e60 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff96262f700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff944063810 0x7ff944065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff96262f700 1 -- 172.21.15.81:0/2745992889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff95c082ba0 con 0x55e0ddb40e60 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff964e34700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff944063810 0x7ff944065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e0ddb25940 0x55e0ddba3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55) v8 -- 0x55e0ddb25d40 con 0x55e0ddb25940 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff964e34700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff944063810 0x7ff944065cc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff954000f60 tx=0x7ff954001740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff964633700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e0ddb25940 0x55e0ddba3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff964633700 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e0ddb25940 0x55e0ddba3f70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff964633700 1 -- 172.21.15.81:0/2745992889 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7ff94c008a30 con 0x55e0ddb25940 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e0ddb25940 msgr2=0x55e0ddba3f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e0ddb25940 0x55e0ddba3f70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff944063810 msgr2=0x7ff944065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff944063810 0x7ff944065cc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff954000f60 tx=0x7ff954001740 comp rx=0 tx=0).stop 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40e60 msgr2=0x55e0ddc61cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 --2- 172.21.15.81:0/2745992889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0ddb40e60 0x55e0ddc61cb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff95c003000 tx=0x7ff95c003330 comp rx=0 tx=0).stop 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff965635700 1 -- 172.21.15.81:0/2745992889 reap_dead start 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 shutdown_connections 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 >> 172.21.15.81:0/2745992889 conn(0x55e0ddb26dc0 msgr2=0x55e0ddafb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 shutdown_connections 2023-11-29T11:15:48.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.723+0000 7ff9672ff140 1 -- 172.21.15.81:0/2745992889 wait complete. 2023-11-29T11:15:48.731 INFO:teuthology.orchestra.run.smithi081.stdout:Yalphaparent_a 2023-11-29T11:15:48.732 DEBUG:teuthology.orchestra.run.smithi081:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-29T11:15:48.789 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:15:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627777, 2023-11-29T11:15:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ancestors": [ 2023-11-29T11:15:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: "dirino": 1099511627776, 2023-11-29T11:15:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: "dname": "alpha", 2023-11-29T11:15:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 4 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: "dirino": 1, 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: "dname": "parent_a", 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 7 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 9, 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: "old_pools": [] 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:15:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:48.792 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:15:48.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:15:48.805 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:15:48.826 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:15:48.827 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:15:48.827 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:15:48.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:15:48.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a7068700 1 Processor -- start 2023-11-29T11:15:48.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a7068700 1 -- start start 2023-11-29T11:15:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a7068700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe3a006ad60 0x7fe3a00b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a7068700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3a0160790 0x7fe3a00b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a7068700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00b81f0 con 0x7fe3a00ceb50 2023-11-29T11:15:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a7068700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00cce70 con 0x7fe3a0160790 2023-11-29T11:15:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a7068700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00b6580 con 0x7fe3a006ad60 2023-11-29T11:15:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a6066700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe3a00ceb50 0x7fe3a006a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58638/0 (socket says 172.21.15.81:58638) 2023-11-29T11:15:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a6066700 1 -- 172.21.15.81:0/4044154546 learned_addr learned my addr 172.21.15.81:0/4044154546 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a5865700 1 --2- 172.21.15.81:0/4044154546 >> v2:172.21.15.176:3300/0 conn(0x7fe3a006ad60 0x7fe3a00b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a6867700 1 --2- 172.21.15.81:0/4044154546 >> v2:172.21.15.81:3300/0 conn(0x7fe3a0160790 0x7fe3a00b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a5064700 1 -- 172.21.15.81:0/4044154546 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182397827 0 0) 0x7fe3a00b81f0 con 0x7fe3a00ceb50 2023-11-29T11:15:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a5064700 1 -- 172.21.15.81:0/4044154546 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe38c0035d0 con 0x7fe3a00ceb50 2023-11-29T11:15:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a6867700 1 -- 172.21.15.81:0/4044154546 >> v2:172.21.15.176:3300/0 conn(0x7fe3a006ad60 msgr2=0x7fe3a00b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a6867700 1 --2- 172.21.15.81:0/4044154546 >> v2:172.21.15.176:3300/0 conn(0x7fe3a006ad60 0x7fe3a00b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a6867700 1 -- 172.21.15.81:0/4044154546 >> v1:172.21.15.81:6789/0 conn(0x7fe3a00ceb50 legacy=0x7fe3a006a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a6867700 1 -- 172.21.15.81:0/4044154546 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00b7900 con 0x7fe3a0160790 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.986+0000 7fe3a6867700 1 --2- 172.21.15.81:0/4044154546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a0160790 0x7fe3a00b30e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00d3680 tx=0x7fe39800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301a0a3abac3990c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a5064700 1 -- 172.21.15.81:0/4044154546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39800e070 con 0x7fe3a0160790 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a5064700 1 -- 172.21.15.81:0/4044154546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39800bb20 con 0x7fe3a0160790 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a5064700 1 -- 172.21.15.81:0/4044154546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398012430 con 0x7fe3a0160790 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- 172.21.15.81:0/4044154546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a0160790 msgr2=0x7fe3a00b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 --2- 172.21.15.81:0/4044154546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a0160790 0x7fe3a00b30e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00d3680 tx=0x7fe39800b330 comp rx=0 tx=0).stop 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- 172.21.15.81:0/4044154546 shutdown_connections 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 --2- 172.21.15.81:0/4044154546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a0160790 0x7fe3a00b30e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 --2- 172.21.15.81:0/4044154546 >> v2:172.21.15.176:3300/0 conn(0x7fe3a006ad60 0x7fe3a00b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- 172.21.15.81:0/4044154546 >> 172.21.15.81:0/4044154546 conn(0x7fe3a0089f70 msgr2=0x7fe3a00b5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- 172.21.15.81:0/4044154546 shutdown_connections 2023-11-29T11:15:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- 172.21.15.81:0/4044154546 wait complete. 2023-11-29T11:15:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 Processor -- start 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- start start 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a006ad60 0x7fe3a00c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a00ceb50 0x7fe3a00c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a0160790 0x7fe3a01f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a015cbb0 con 0x7fe3a006ad60 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01f1910 con 0x7fe3a00ceb50 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a7068700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01f1bf0 con 0x7fe3a0160790 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a006ad60 0x7fe3a00c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a006ad60 0x7fe3a00c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41432/0 (socket says 172.21.15.81:41432) 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 -- 172.21.15.81:0/1389750861 learned_addr learned my addr 172.21.15.81:0/1389750861 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 -- 172.21.15.81:0/1389750861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a0160790 msgr2=0x7fe3a01f0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a0160790 0x7fe3a01f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 -- 172.21.15.81:0/1389750861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a00ceb50 msgr2=0x7fe3a00c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a5865700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a00ceb50 0x7fe3a00c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a00ceb50 0x7fe3a00c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 -- 172.21.15.81:0/1389750861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe398009a70 con 0x7fe3a006ad60 2023-11-29T11:15:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a5865700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a00ceb50 0x7fe3a00c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.990+0000 7fe3a6066700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a006ad60 0x7fe3a00c81e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe39000c700 tx=0x7fe39000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe396ffd700 1 -- 172.21.15.81:0/1389750861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390005d90 con 0x7fe3a006ad60 2023-11-29T11:15:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe396ffd700 1 -- 172.21.15.81:0/1389750861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3900070d0 con 0x7fe3a006ad60 2023-11-29T11:15:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a0160bf0 con 0x7fe3a006ad60 2023-11-29T11:15:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe396ffd700 1 -- 172.21.15.81:0/1389750861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390007480 con 0x7fe3a006ad60 2023-11-29T11:15:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a015c600 con 0x7fe3a006ad60 2023-11-29T11:15:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a00b8680 con 0x7fe3a006ad60 2023-11-29T11:15:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe396ffd700 1 -- 172.21.15.81:0/1389750861 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe390019030 con 0x7fe3a006ad60 2023-11-29T11:15:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe396ffd700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe384064f10 0x7fe3840673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe396ffd700 1 -- 172.21.15.81:0/1389750861 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe390081510 con 0x7fe3a006ad60 2023-11-29T11:15:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe3a5865700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe384064f10 0x7fe3840673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:48.994+0000 7fe3a5865700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe384064f10 0x7fe3840673c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe3a015b1c0 tx=0x7fe39c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.002+0000 7fe396ffd700 1 -- 172.21.15.81:0/1389750861 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe39004f4f0 con 0x7fe3a006ad60 2023-11-29T11:15:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.170+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3a01f4c40 con 0x7fe3a006ad60 2023-11-29T11:15:49.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe396ffd700 1 -- 172.21.15.81:0/1389750861 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18026 (secure 0 0 0) 0x7fe3a01f4c40 con 0x7fe3a006ad60 2023-11-29T11:15:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:49.179 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:15:09.548834+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:15:07.147241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-29T11:15:07.541685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:15:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe384064f10 msgr2=0x7fe3840673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe384064f10 0x7fe3840673c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe3a015b1c0 tx=0x7fe39c008040 comp rx=0 tx=0).stop 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a006ad60 msgr2=0x7fe3a00c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a006ad60 0x7fe3a00c81e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe39000c700 tx=0x7fe39000cac0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 shutdown_connections 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe384064f10 0x7fe3840673c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3a0160790 0x7fe3a01f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3a00ceb50 0x7fe3a00c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 --2- 172.21.15.81:0/1389750861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a006ad60 0x7fe3a00c81e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 >> 172.21.15.81:0/1389750861 conn(0x7fe3a0089f70 msgr2=0x7fe3a006d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 shutdown_connections 2023-11-29T11:15:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.174+0000 7fe3a7068700 1 -- 172.21.15.81:0/1389750861 wait complete. 2023-11-29T11:15:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:15:07.147241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:15:07.541685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:15:49.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:15:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.314+0000 7f48808e8700 1 Processor -- start 2023-11-29T11:15:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.314+0000 7f48808e8700 1 -- start start 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.314+0000 7f48808e8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f487c160880 0x7f487c06aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.314+0000 7f48808e8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f487c0c1ad0 0x7f487c1642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.314+0000 7f48808e8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c160c50 con 0x7f487c06b000 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.314+0000 7f48808e8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0b3050 con 0x7f487c160880 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.314+0000 7f48808e8700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c06b630 con 0x7f487c0c1ad0 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f487c160880 0x7f487c06aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f487c160880 0x7f487c06aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41442/0 (socket says 172.21.15.81:41442) 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487ad9d700 1 -- 172.21.15.81:0/2390335827 learned_addr learned my addr 172.21.15.81:0/2390335827 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487a59c700 1 --1- 172.21.15.81:0/2390335827 >> v1:172.21.15.81:6789/0 conn(0x7f487c06b000 0x7f487c0c13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58650/0 (socket says 172.21.15.81:58650) 2023-11-29T11:15:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487b59e700 1 --2- 172.21.15.81:0/2390335827 >> v2:172.21.15.176:3300/0 conn(0x7f487c0c1ad0 0x7f487c1642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487ad9d700 1 -- 172.21.15.81:0/2390335827 >> v2:172.21.15.176:3300/0 conn(0x7f487c0c1ad0 msgr2=0x7f487c1642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487ad9d700 1 --2- 172.21.15.81:0/2390335827 >> v2:172.21.15.176:3300/0 conn(0x7f487c0c1ad0 0x7f487c1642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487ad9d700 1 -- 172.21.15.81:0/2390335827 >> v1:172.21.15.81:6789/0 conn(0x7f487c06b000 legacy=0x7f487c0c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487ad9d700 1 -- 172.21.15.81:0/2390335827 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c069ce0 con 0x7f487c160880 2023-11-29T11:15:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f487ad9d700 1 --2- 172.21.15.81:0/2390335827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c160880 0x7f487c06aac0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f487c0aafd0 tx=0x7f4864009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de1c047e8a72f96 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f4879d9b700 1 -- 172.21.15.81:0/2390335827 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864011830 con 0x7f487c160880 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f4879d9b700 1 -- 172.21.15.81:0/2390335827 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4864011990 con 0x7f487c160880 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f4879d9b700 1 -- 172.21.15.81:0/2390335827 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864011d20 con 0x7f487c160880 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f48808e8700 1 -- 172.21.15.81:0/2390335827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c160880 msgr2=0x7f487c06aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f48808e8700 1 --2- 172.21.15.81:0/2390335827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c160880 0x7f487c06aac0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f487c0aafd0 tx=0x7f4864009bf0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f48808e8700 1 -- 172.21.15.81:0/2390335827 shutdown_connections 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f48808e8700 1 --2- 172.21.15.81:0/2390335827 >> v2:172.21.15.176:3300/0 conn(0x7f487c0c1ad0 0x7f487c1642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f48808e8700 1 --2- 172.21.15.81:0/2390335827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c160880 0x7f487c06aac0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f48808e8700 1 -- 172.21.15.81:0/2390335827 >> 172.21.15.81:0/2390335827 conn(0x7f487c0cae70 msgr2=0x7f487c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f48808e8700 1 -- 172.21.15.81:0/2390335827 shutdown_connections 2023-11-29T11:15:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.318+0000 7f48808e8700 1 -- 172.21.15.81:0/2390335827 wait complete. 2023-11-29T11:15:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 Processor -- start 2023-11-29T11:15:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 -- start start 2023-11-29T11:15:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f487c06b000 0x7f487c1fa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c0c1ad0 0x7f487c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f487c160880 0x7f487c1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0c38d0 con 0x7f487c0c1ad0 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1fa910 con 0x7f487c06b000 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0aded0 con 0x7f487c160880 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c0c1ad0 0x7f487c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c0c1ad0 0x7f487c070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41446/0 (socket says 172.21.15.81:41446) 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 -- 172.21.15.81:0/865452366 learned_addr learned my addr 172.21.15.81:0/865452366 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487b59e700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f487c160880 0x7f487c1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487ad9d700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f487c06b000 0x7f487c1fa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 -- 172.21.15.81:0/865452366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f487c160880 msgr2=0x7f487c1578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f487c160880 0x7f487c1578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 -- 172.21.15.81:0/865452366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f487c06b000 msgr2=0x7f487c1fa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f487c06b000 0x7f487c1fa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 -- 172.21.15.81:0/865452366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864009570 con 0x7f487c0c1ad0 2023-11-29T11:15:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f487a59c700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c0c1ad0 0x7f487c070f00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f487400c500 tx=0x7f487400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48737fe700 1 -- 172.21.15.81:0/865452366 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874005cd0 con 0x7f487c0c1ad0 2023-11-29T11:15:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48737fe700 1 -- 172.21.15.81:0/865452366 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487400ce90 con 0x7f487c0c1ad0 2023-11-29T11:15:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c06a2a0 con 0x7f487c0c1ad0 2023-11-29T11:15:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48737fe700 1 -- 172.21.15.81:0/865452366 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740072d0 con 0x7f487c0c1ad0 2023-11-29T11:15:49.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.322+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c069fc0 con 0x7f487c0c1ad0 2023-11-29T11:15:49.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.326+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c06a580 con 0x7f487c0c1ad0 2023-11-29T11:15:49.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.326+0000 7f48737fe700 1 -- 172.21.15.81:0/865452366 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4874019030 con 0x7f487c0c1ad0 2023-11-29T11:15:49.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.326+0000 7f48737fe700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f485c064f10 0x7f485c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.326+0000 7f487ad9d700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f485c064f10 0x7f485c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.326+0000 7f48737fe700 1 -- 172.21.15.81:0/865452366 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4874081030 con 0x7f487c0c1ad0 2023-11-29T11:15:49.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.326+0000 7f487ad9d700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f485c064f10 0x7f485c0673c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4864009860 tx=0x7f4864008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.334+0000 7f48737fe700 1 -- 172.21.15.81:0/865452366 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f487404a400 con 0x7f487c0c1ad0 2023-11-29T11:15:49.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.494+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f487c0afaf0 con 0x7f487c0c1ad0 2023-11-29T11:15:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.494+0000 7f48737fe700 1 -- 172.21.15.81:0/865452366 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48740170a0 con 0x7f487c0c1ad0 2023-11-29T11:15:49.499 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.494+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f485c064f10 msgr2=0x7f485c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.494+0000 7f48808e8700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f485c064f10 0x7f485c0673c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4864009860 tx=0x7f4864008030 comp rx=0 tx=0).stop 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c0c1ad0 msgr2=0x7f487c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c0c1ad0 0x7f487c070f00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f487400c500 tx=0x7f487400c810 comp rx=0 tx=0).stop 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 shutdown_connections 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f485c064f10 0x7f485c0673c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f487c160880 0x7f487c1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f487c0c1ad0 0x7f487c070f00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 --2- 172.21.15.81:0/865452366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f487c06b000 0x7f487c1fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 >> 172.21.15.81:0/865452366 conn(0x7f487c0cae70 msgr2=0x7f487c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 shutdown_connections 2023-11-29T11:15:49.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.498+0000 7f48808e8700 1 -- 172.21.15.81:0/865452366 wait complete. 2023-11-29T11:15:49.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d9178e700 1 Processor -- start 2023-11-29T11:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d9178e700 1 -- start start 2023-11-29T11:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d9178e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6d8c06ce60 0x7f6d8c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d9178e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d8c0cce60 0x7f6d8c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d9178e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf470 0x7f6d8c0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d9178e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c15c8b0 con 0x7f6d8c0cce60 2023-11-29T11:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d9178e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c0cd300 con 0x7f6d8c06ce60 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d9178e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c06d770 con 0x7f6d8c0cf470 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d8c0cce60 0x7f6d8c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d8c0cce60 0x7f6d8c06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41454/0 (socket says 172.21.15.81:41454) 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 -- 172.21.15.81:0/107598863 learned_addr learned my addr 172.21.15.81:0/107598863 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8bfff700 1 --2- 172.21.15.81:0/107598863 >> v2:172.21.15.176:3300/0 conn(0x7f6d8c06ce60 0x7f6d8c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d90f8d700 1 --2- 172.21.15.81:0/107598863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf470 0x7f6d8c0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 -- 172.21.15.81:0/107598863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf470 msgr2=0x7f6d8c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 --2- 172.21.15.81:0/107598863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf470 0x7f6d8c0cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 -- 172.21.15.81:0/107598863 >> v2:172.21.15.176:3300/0 conn(0x7f6d8c06ce60 msgr2=0x7f6d8c0d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 --2- 172.21.15.81:0/107598863 >> v2:172.21.15.176:3300/0 conn(0x7f6d8c06ce60 0x7f6d8c0d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 -- 172.21.15.81:0/107598863 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c06a7f0 con 0x7f6d8c0cce60 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.626+0000 7f6d8b7fe700 1 --2- 172.21.15.81:0/107598863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cce60 0x7f6d8c06d230 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009910 tx=0x7f6d7c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7e785c7229e809 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d8affd700 1 -- 172.21.15.81:0/107598863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c011830 con 0x7f6d8c0cce60 2023-11-29T11:15:49.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d8affd700 1 -- 172.21.15.81:0/107598863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c011990 con 0x7f6d8c0cce60 2023-11-29T11:15:49.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d8affd700 1 -- 172.21.15.81:0/107598863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c011d40 con 0x7f6d8c0cce60 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- 172.21.15.81:0/107598863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cce60 msgr2=0x7f6d8c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 --2- 172.21.15.81:0/107598863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cce60 0x7f6d8c06d230 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009910 tx=0x7f6d7c009c20 comp rx=0 tx=0).stop 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- 172.21.15.81:0/107598863 shutdown_connections 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 --2- 172.21.15.81:0/107598863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf470 0x7f6d8c0cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 --2- 172.21.15.81:0/107598863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cce60 0x7f6d8c06d230 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 --2- 172.21.15.81:0/107598863 >> v2:172.21.15.176:3300/0 conn(0x7f6d8c06ce60 0x7f6d8c0d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- 172.21.15.81:0/107598863 >> 172.21.15.81:0/107598863 conn(0x7f6d8c0b5760 msgr2=0x7f6d8c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- 172.21.15.81:0/107598863 shutdown_connections 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- 172.21.15.81:0/107598863 wait complete. 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 Processor -- start 2023-11-29T11:15:49.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- start start 2023-11-29T11:15:49.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c06ce60 0x7f6d8c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cce60 0x7f6d8c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cf470 0x7f6d8c0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0b36e0 con 0x7f6d8c0cf470 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c1594e0 con 0x7f6d8c06ce60 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d9178e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c15f520 con 0x7f6d8c0cce60 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d90f8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cf470 0x7f6d8c0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d90f8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cf470 0x7f6d8c0cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41458/0 (socket says 172.21.15.81:41458) 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d90f8d700 1 -- 172.21.15.81:0/2283261287 learned_addr learned my addr 172.21.15.81:0/2283261287 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d8bfff700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c06ce60 0x7f6d8c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d8b7fe700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cce60 0x7f6d8c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d90f8d700 1 -- 172.21.15.81:0/2283261287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cce60 msgr2=0x7f6d8c0cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d90f8d700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cce60 0x7f6d8c0cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d90f8d700 1 -- 172.21.15.81:0/2283261287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c06ce60 msgr2=0x7f6d8c158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.630+0000 7f6d90f8d700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c06ce60 0x7f6d8c158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d90f8d700 1 -- 172.21.15.81:0/2283261287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c009570 con 0x7f6d8c0cf470 2023-11-29T11:15:49.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d90f8d700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cf470 0x7f6d8c0cd9e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400efc0 tx=0x7f6d8400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d88ff9700 1 -- 172.21.15.81:0/2283261287 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400cad0 con 0x7f6d8c0cf470 2023-11-29T11:15:49.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d88ff9700 1 -- 172.21.15.81:0/2283261287 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400f040 con 0x7f6d8c0cf470 2023-11-29T11:15:49.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8c06adb0 con 0x7f6d8c0cf470 2023-11-29T11:15:49.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d88ff9700 1 -- 172.21.15.81:0/2283261287 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400ce70 con 0x7f6d8c0cf470 2023-11-29T11:15:49.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c06aad0 con 0x7f6d8c0cf470 2023-11-29T11:15:49.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c06b090 con 0x7f6d8c0cf470 2023-11-29T11:15:49.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.634+0000 7f6d88ff9700 1 -- 172.21.15.81:0/2283261287 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6d84014480 con 0x7f6d8c0cf470 2023-11-29T11:15:49.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.638+0000 7f6d88ff9700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d78064ee0 0x7f6d78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.638+0000 7f6d88ff9700 1 -- 172.21.15.81:0/2283261287 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6d840827a0 con 0x7f6d8c0cf470 2023-11-29T11:15:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.638+0000 7f6d8bfff700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d78064ee0 0x7f6d78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.638+0000 7f6d8bfff700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d78064ee0 0x7f6d78067390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c15b560 tx=0x7f6d80009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.642+0000 7f6d88ff9700 1 -- 172.21.15.81:0/2283261287 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6d840507a0 con 0x7f6d8c0cf470 2023-11-29T11:15:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.802+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d8c072c20 con 0x7f6d8c0cf470 2023-11-29T11:15:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.802+0000 7f6d88ff9700 1 -- 172.21.15.81:0/2283261287 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d84053dc0 con 0x7f6d8c0cf470 2023-11-29T11:15:49.808 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d78064ee0 msgr2=0x7f6d78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d78064ee0 0x7f6d78067390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c15b560 tx=0x7f6d80009240 comp rx=0 tx=0).stop 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cf470 msgr2=0x7f6d8c0cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cf470 0x7f6d8c0cd9e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400efc0 tx=0x7f6d8400c0c0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 shutdown_connections 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6d78064ee0 0x7f6d78067390 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d8c0cf470 0x7f6d8c0cd9e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cce60 0x7f6d8c0cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 --2- 172.21.15.81:0/2283261287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c06ce60 0x7f6d8c158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 >> 172.21.15.81:0/2283261287 conn(0x7f6d8c0b5760 msgr2=0x7f6d8c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 shutdown_connections 2023-11-29T11:15:49.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.806+0000 7f6d9178e700 1 -- 172.21.15.81:0/2283261287 wait complete. 2023-11-29T11:15:49.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:15:49.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.938+0000 7f9bbaf8a700 1 Processor -- start 2023-11-29T11:15:49.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.938+0000 7f9bbaf8a700 1 -- start start 2023-11-29T11:15:49.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bb4158ee0 0x7f9bb40ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9bb40cd5d0 0x7f9bb40cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40ce060 0x7f9bb415c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb406e000 con 0x7f9bb4158ee0 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb406d1c0 con 0x7f9bb40cd5d0 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40ce480 con 0x7f9bb40ce060 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bb4158ee0 0x7f9bb40ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bb4158ee0 0x7f9bb40ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59506/0 (socket says 172.21.15.81:59506) 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bba789700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40ce060 0x7f9bb415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9787700 1 --2- 172.21.15.81:0/1214959287 >> v2:172.21.15.176:3300/0 conn(0x7f9bb40cd5d0 0x7f9bb40cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 -- 172.21.15.81:0/1214959287 learned_addr learned my addr 172.21.15.81:0/1214959287 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 -- 172.21.15.81:0/1214959287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40ce060 msgr2=0x7f9bb415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 --2- 172.21.15.81:0/1214959287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40ce060 0x7f9bb415c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 -- 172.21.15.81:0/1214959287 >> v2:172.21.15.176:3300/0 conn(0x7f9bb40cd5d0 msgr2=0x7f9bb40cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 --2- 172.21.15.81:0/1214959287 >> v2:172.21.15.176:3300/0 conn(0x7f9bb40cd5d0 0x7f9bb40cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 -- 172.21.15.81:0/1214959287 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40ca3a0 con 0x7f9bb4158ee0 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb9f88700 1 --2- 172.21.15.81:0/1214959287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40ae760 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9bb415d8f0 tx=0x7f9bb000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfdaff348609061 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb8f86700 1 -- 172.21.15.81:0/1214959287 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000dd30 con 0x7f9bb4158ee0 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb8f86700 1 -- 172.21.15.81:0/1214959287 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000de90 con 0x7f9bb4158ee0 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bb8f86700 1 -- 172.21.15.81:0/1214959287 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0010690 con 0x7f9bb4158ee0 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/1214959287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 msgr2=0x7f9bb40ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/1214959287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40ae760 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9bb415d8f0 tx=0x7f9bb000be90 comp rx=0 tx=0).stop 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/1214959287 shutdown_connections 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/1214959287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40ce060 0x7f9bb415c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/1214959287 >> v2:172.21.15.176:3300/0 conn(0x7f9bb40cd5d0 0x7f9bb40cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/1214959287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40ae760 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/1214959287 >> 172.21.15.81:0/1214959287 conn(0x7f9bb40d0240 msgr2=0x7f9bb40cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:49.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/1214959287 shutdown_connections 2023-11-29T11:15:49.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.942+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/1214959287 wait complete. 2023-11-29T11:15:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bbaf8a700 1 Processor -- start 2023-11-29T11:15:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bbaf8a700 1 -- start start 2023-11-29T11:15:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bbaf8a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40cd5d0 0x7f9bb4151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bbaf8a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb40ce060 0x7f9bb40c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bbaf8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bbaf8a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40c7be0 con 0x7f9bb4158ee0 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bbaf8a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40c7e30 con 0x7f9bb40ce060 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bbaf8a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40c8110 con 0x7f9bb40cd5d0 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bba789700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bba789700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59510/0 (socket says 172.21.15.81:59510) 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bba789700 1 -- 172.21.15.81:0/4190663213 learned_addr learned my addr 172.21.15.81:0/4190663213 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bb9787700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb40ce060 0x7f9bb40c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.946+0000 7f9bb9f88700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40cd5d0 0x7f9bb4151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bba789700 1 -- 172.21.15.81:0/4190663213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40cd5d0 msgr2=0x7f9bb4151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bba789700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40cd5d0 0x7f9bb4151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bba789700 1 -- 172.21.15.81:0/4190663213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb40ce060 msgr2=0x7f9bb40c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bba789700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb40ce060 0x7f9bb40c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bba789700 1 -- 172.21.15.81:0/4190663213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb000b810 con 0x7f9bb4158ee0 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bba789700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40c7090 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00efc0 tx=0x7f9bac00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9ba67fc700 1 -- 172.21.15.81:0/4190663213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00cad0 con 0x7f9bb4158ee0 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9ba67fc700 1 -- 172.21.15.81:0/4190663213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f040 con 0x7f9bb4158ee0 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb406cc00 con 0x7f9bb4158ee0 2023-11-29T11:15:49.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9ba67fc700 1 -- 172.21.15.81:0/4190663213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00ce70 con 0x7f9bb4158ee0 2023-11-29T11:15:49.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb406c920 con 0x7f9bb4158ee0 2023-11-29T11:15:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb406cee0 con 0x7f9bb4158ee0 2023-11-29T11:15:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.950+0000 7f9ba67fc700 1 -- 172.21.15.81:0/4190663213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9bac014480 con 0x7f9bb4158ee0 2023-11-29T11:15:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.954+0000 7f9ba67fc700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b98064ee0 0x7f9b98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.954+0000 7f9ba67fc700 1 -- 172.21.15.81:0/4190663213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9bac082960 con 0x7f9bb4158ee0 2023-11-29T11:15:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.954+0000 7f9bb9f88700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b98064ee0 0x7f9b98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:49.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.954+0000 7f9bb9f88700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b98064ee0 0x7f9b98067390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb0013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:49.958+0000 7f9ba67fc700 1 -- 172.21.15.81:0/4190663213 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9bac050870 con 0x7f9bb4158ee0 2023-11-29T11:15:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.122+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9bb4072c20 con 0x7f9bb4158ee0 2023-11-29T11:15:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.122+0000 7f9ba67fc700 1 -- 172.21.15.81:0/4190663213 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9bac053e90 con 0x7f9bb4158ee0 2023-11-29T11:15:50.128 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:15:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b98064ee0 msgr2=0x7f9b98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b98064ee0 0x7f9b98067390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb0013000 comp rx=0 tx=0).stop 2023-11-29T11:15:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 msgr2=0x7f9bb40c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40c7090 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00efc0 tx=0x7f9bac00c0c0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 shutdown_connections 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b98064ee0 0x7f9b98067390 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb4158ee0 0x7f9bb40c7090 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bb40ce060 0x7f9bb40c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 --2- 172.21.15.81:0/4190663213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bb40cd5d0 0x7f9bb4151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 >> 172.21.15.81:0/4190663213 conn(0x7f9bb40d0240 msgr2=0x7f9bb40cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 shutdown_connections 2023-11-29T11:15:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.126+0000 7f9bbaf8a700 1 -- 172.21.15.81:0/4190663213 wait complete. 2023-11-29T11:15:50.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:15:50.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.250+0000 7f750bfff700 1 Processor -- start 2023-11-29T11:15:50.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.250+0000 7f750bfff700 1 -- start start 2023-11-29T11:15:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f750c0cd5d0 0x7f750c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c06d1c0 con 0x7f750c158ee0 2023-11-29T11:15:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f750c158ee0 0x7f750c0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33818/0 (socket says 172.21.15.81:33818) 2023-11-29T11:15:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750affd700 1 -- 172.21.15.81:0/3782128433 learned_addr learned my addr 172.21.15.81:0/3782128433 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750b7fe700 1 --2- 172.21.15.81:0/3782128433 >> v2:172.21.15.81:3300/0 conn(0x7f750c0cd5d0 0x7f750c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 -- 172.21.15.81:0/3782128433 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c0ca3a0 con 0x7f750c0ce230 2023-11-29T11:15:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 -- 172.21.15.81:0/3782128433 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c06e000 con 0x7f750c0cd5d0 2023-11-29T11:15:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750a7fc700 1 -- 172.21.15.81:0/3782128433 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998779488 0 0) 0x7f74fc001110 con 0x7f750c158ee0 2023-11-29T11:15:50.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750a7fc700 1 -- 172.21.15.81:0/3782128433 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f80035d0 con 0x7f750c158ee0 2023-11-29T11:15:50.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750b7fe700 1 -- 172.21.15.81:0/3782128433 >> v1:172.21.15.176:6789/0 conn(0x7f750c0ce230 legacy=0x7f750c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750b7fe700 1 -- 172.21.15.81:0/3782128433 >> v1:172.21.15.81:6789/0 conn(0x7f750c158ee0 legacy=0x7f750c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750b7fe700 1 -- 172.21.15.81:0/3782128433 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c06c920 con 0x7f750c0cd5d0 2023-11-29T11:15:50.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750b7fe700 1 --2- 172.21.15.81:0/3782128433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c0cd5d0 0x7f750c0ae760 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7504009d90 tx=0x7f750400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6757e543d9e3837 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:50.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750a7fc700 1 -- 172.21.15.81:0/3782128433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750400e070 con 0x7f750c0cd5d0 2023-11-29T11:15:50.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750a7fc700 1 -- 172.21.15.81:0/3782128433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750400bb20 con 0x7f750c0cd5d0 2023-11-29T11:15:50.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750a7fc700 1 -- 172.21.15.81:0/3782128433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504012430 con 0x7f750c0cd5d0 2023-11-29T11:15:50.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 -- 172.21.15.81:0/3782128433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c0cd5d0 msgr2=0x7f750c0ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 --2- 172.21.15.81:0/3782128433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c0cd5d0 0x7f750c0ae760 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7504009d90 tx=0x7f750400b330 comp rx=0 tx=0).stop 2023-11-29T11:15:50.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 -- 172.21.15.81:0/3782128433 shutdown_connections 2023-11-29T11:15:50.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 --2- 172.21.15.81:0/3782128433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c0cd5d0 0x7f750c0ae760 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 -- 172.21.15.81:0/3782128433 >> 172.21.15.81:0/3782128433 conn(0x7f750c0d0240 msgr2=0x7f750c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:50.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 -- 172.21.15.81:0/3782128433 shutdown_connections 2023-11-29T11:15:50.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.254+0000 7f750bfff700 1 -- 172.21.15.81:0/3782128433 wait complete. 2023-11-29T11:15:50.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 Processor -- start 2023-11-29T11:15:50.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 -- start start 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750c0cd5d0 0x7f750c1eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750c0ce230 0x7f750c0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c158ee0 0x7f750c1f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c146260 con 0x7f750c158ee0 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c1f3810 con 0x7f750c0cd5d0 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0b51a0 con 0x7f750c0ce230 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c158ee0 0x7f750c1f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c158ee0 0x7f750c1f32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59530/0 (socket says 172.21.15.81:59530) 2023-11-29T11:15:50.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 -- 172.21.15.81:0/1907615305 learned_addr learned my addr 172.21.15.81:0/1907615305 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750affd700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750c0cd5d0 0x7f750c1eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f7503fff700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750c0ce230 0x7f750c0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 -- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750c0ce230 msgr2=0x7f750c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750c0ce230 0x7f750c0b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 -- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750c0cd5d0 msgr2=0x7f750c1eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750c0cd5d0 0x7f750c1eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 -- 172.21.15.81:0/1907615305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504009a70 con 0x7f750c158ee0 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750affd700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750c0cd5d0 0x7f750c1eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750b7fe700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c158ee0 0x7f750c1f32d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f750c070b90 tx=0x7f7504004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f75037fe700 1 -- 172.21.15.81:0/1907615305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504012430 con 0x7f750c158ee0 2023-11-29T11:15:50.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f75037fe700 1 -- 172.21.15.81:0/1907615305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504020070 con 0x7f750c158ee0 2023-11-29T11:15:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c06cee0 con 0x7f750c158ee0 2023-11-29T11:15:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f75037fe700 1 -- 172.21.15.81:0/1907615305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504004280 con 0x7f750c158ee0 2023-11-29T11:15:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.258+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c06cc00 con 0x7f750c158ee0 2023-11-29T11:15:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.262+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c0ca640 con 0x7f750c158ee0 2023-11-29T11:15:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.262+0000 7f75037fe700 1 -- 172.21.15.81:0/1907615305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f75040043e0 con 0x7f750c158ee0 2023-11-29T11:15:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.262+0000 7f75037fe700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74ec064ee0 0x7f74ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.262+0000 7f75037fe700 1 -- 172.21.15.81:0/1907615305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7504022070 con 0x7f750c158ee0 2023-11-29T11:15:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.262+0000 7f750affd700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74ec064ee0 0x7f74ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.262+0000 7f750affd700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74ec064ee0 0x7f74ec067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f74fc001270 tx=0x7f74fc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.270+0000 7f75037fe700 1 -- 172.21.15.81:0/1907615305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7504052650 con 0x7f750c158ee0 2023-11-29T11:15:50.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.426+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f750c072c20 con 0x7f750c158ee0 2023-11-29T11:15:50.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f75037fe700 1 -- 172.21.15.81:0/1907615305 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75040263e0 con 0x7f750c158ee0 2023-11-29T11:15:50.434 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:15:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74ec064ee0 msgr2=0x7f74ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74ec064ee0 0x7f74ec067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f74fc001270 tx=0x7f74fc009040 comp rx=0 tx=0).stop 2023-11-29T11:15:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c158ee0 msgr2=0x7f750c1f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c158ee0 0x7f750c1f32d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f750c070b90 tx=0x7f7504004af0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 shutdown_connections 2023-11-29T11:15:50.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74ec064ee0 0x7f74ec067390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c158ee0 0x7f750c1f32d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750c0ce230 0x7f750c0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 --2- 172.21.15.81:0/1907615305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750c0cd5d0 0x7f750c1eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 >> 172.21.15.81:0/1907615305 conn(0x7f750c0d0240 msgr2=0x7f750c0aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 shutdown_connections 2023-11-29T11:15:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.430+0000 7f750bfff700 1 -- 172.21.15.81:0/1907615305 wait complete. 2023-11-29T11:15:50.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:15:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.550+0000 7f91689fb700 1 Processor -- start 2023-11-29T11:15:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.550+0000 7f91689fb700 1 -- start start 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91689fb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91640cc730 0x7f91640ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91689fb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916415a020 con 0x7f91641594f0 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91689fb700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91640cd720 con 0x7f916415d650 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91689fb700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640cd990 con 0x7f91640cc730 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9163fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f91641594f0 0x7f9164159910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33824/0 (socket says 172.21.15.81:33824) 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9163fff700 1 -- 172.21.15.81:0/4204189222 learned_addr learned my addr 172.21.15.81:0/4204189222 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f915affd700 1 --2- 172.21.15.81:0/4204189222 >> v2:172.21.15.176:3300/0 conn(0x7f91640cc730 0x7f91640ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458633678 0 0) 0x7f916415a020 con 0x7f91641594f0 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91500035d0 con 0x7f91641594f0 2023-11-29T11:15:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882709321 0 0) 0x7f91500035d0 con 0x7f91641594f0 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 >> v2:172.21.15.176:3300/0 conn(0x7f91640cc730 msgr2=0x7f91640ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 --2- 172.21.15.81:0/4204189222 >> v2:172.21.15.176:3300/0 conn(0x7f91640cc730 0x7f91640ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 >> v1:172.21.15.176:6789/0 conn(0x7f916415d650 legacy=0x7f91640cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640cdc70 con 0x7f91641594f0 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f915c0019f0 con 0x7f91641594f0 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 >> v1:172.21.15.81:6789/0 conn(0x7f91641594f0 legacy=0x7f9164159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9150003a20 0x7f9150003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150004870 0x7f9150004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9150005220 0x7f915000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640cd990 con 0x7f9150003a20 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915000c0a0 con 0x7f9150004870 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915000c260 con 0x7f9150005220 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91637fe700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9150003a20 0x7f9150003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f915affd700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150004870 0x7f9150004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9163fff700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9150005220 0x7f915000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91637fe700 1 -- 172.21.15.81:0/4204189222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9150005220 msgr2=0x7f915000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91637fe700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9150005220 0x7f915000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91637fe700 1 -- 172.21.15.81:0/4204189222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150004870 msgr2=0x7f9150004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91637fe700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150004870 0x7f9150004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f9163fff700 1 -- 172.21.15.81:0/4204189222 reap_dead start 2023-11-29T11:15:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.554+0000 7f91637fe700 1 -- 172.21.15.81:0/4204189222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91500035d0 con 0x7f9150003a20 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91637fe700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9150003a20 0x7f9150003e30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f91540017e0 tx=0x7f91500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4765c696380b7931 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91540052d0 con 0x7f9150003a20 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154005430 con 0x7f9150003a20 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f9162ffd700 1 -- 172.21.15.81:0/4204189222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91540055a0 con 0x7f9150003a20 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 -- 172.21.15.81:0/4204189222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9150003a20 msgr2=0x7f9150003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9150003a20 0x7f9150003e30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f91540017e0 tx=0x7f91500058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 -- 172.21.15.81:0/4204189222 shutdown_connections 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 --2- 172.21.15.81:0/4204189222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9150003a20 0x7f9150003e30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 -- 172.21.15.81:0/4204189222 >> 172.21.15.81:0/4204189222 conn(0x7f916406ec40 msgr2=0x7f91640b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:50.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 -- 172.21.15.81:0/4204189222 shutdown_connections 2023-11-29T11:15:50.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 -- 172.21.15.81:0/4204189222 wait complete. 2023-11-29T11:15:50.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 Processor -- start 2023-11-29T11:15:50.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.558+0000 7f91689fb700 1 -- start start 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150003a20 0x7f91641f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91640b2500 0x7f91640c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91641559e0 0x7f916406c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640b49a0 con 0x7f91641559e0 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640b4c80 con 0x7f9150003a20 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91640b4f60 con 0x7f91640b2500 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91641559e0 0x7f916406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91641559e0 0x7f916406c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59546/0 (socket says 172.21.15.81:59546) 2023-11-29T11:15:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 -- 172.21.15.81:0/3368351562 learned_addr learned my addr 172.21.15.81:0/3368351562 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f915affd700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91640b2500 0x7f91640c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91637fe700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150003a20 0x7f91641f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 -- 172.21.15.81:0/3368351562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91640b2500 msgr2=0x7f91640c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91640b2500 0x7f91640c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 -- 172.21.15.81:0/3368351562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150003a20 msgr2=0x7f91641f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150003a20 0x7f91641f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 -- 172.21.15.81:0/3368351562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916415a250 con 0x7f91641559e0 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9163fff700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91641559e0 0x7f916406c530 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f915c000f80 tx=0x7f915c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9160ff9700 1 -- 172.21.15.81:0/3368351562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c00ab30 con 0x7f91641559e0 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9160ff9700 1 -- 172.21.15.81:0/3368351562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c00acb0 con 0x7f91641559e0 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91640cdf50 con 0x7f91641559e0 2023-11-29T11:15:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f9160ff9700 1 -- 172.21.15.81:0/3368351562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c013630 con 0x7f91641559e0 2023-11-29T11:15:50.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91640ce470 con 0x7f91641559e0 2023-11-29T11:15:50.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.562+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91640b5120 con 0x7f91641559e0 2023-11-29T11:15:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.566+0000 7f9160ff9700 1 -- 172.21.15.81:0/3368351562 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f915c023070 con 0x7f91641559e0 2023-11-29T11:15:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.566+0000 7f9160ff9700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9144064f10 0x7f91440673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.566+0000 7f9160ff9700 1 -- 172.21.15.81:0/3368351562 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f915c0828e0 con 0x7f91641559e0 2023-11-29T11:15:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.566+0000 7f91637fe700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9144064f10 0x7f91440673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.566+0000 7f91637fe700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9144064f10 0x7f91440673c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9154005040 tx=0x7f9154009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:50.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.570+0000 7f9160ff9700 1 -- 172.21.15.81:0/3368351562 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f915c0507f0 con 0x7f91641559e0 2023-11-29T11:15:50.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f91640b4ae0 con 0x7f91641559e0 2023-11-29T11:15:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f9160ff9700 1 -- 172.21.15.81:0/3368351562 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f91640b4ae0 con 0x7f91641559e0 2023-11-29T11:15:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9144064f10 msgr2=0x7f91440673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9144064f10 0x7f91440673c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9154005040 tx=0x7f9154009030 comp rx=0 tx=0).stop 2023-11-29T11:15:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91641559e0 msgr2=0x7f916406c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91641559e0 0x7f916406c530 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f915c000f80 tx=0x7f915c007ca0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 shutdown_connections 2023-11-29T11:15:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9144064f10 0x7f91440673c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91641559e0 0x7f916406c530 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91640b2500 0x7f91640c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 --2- 172.21.15.81:0/3368351562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9150003a20 0x7f91641f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 >> 172.21.15.81:0/3368351562 conn(0x7f916406ec40 msgr2=0x7f91640b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 shutdown_connections 2023-11-29T11:15:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:50.742+0000 7f91689fb700 1 -- 172.21.15.81:0/3368351562 wait complete. 2023-11-29T11:15:50.751 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:15:50.761 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:15:50.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:50.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:15:50.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[50739]: fuse finished with error 0 and tester_r 0 2023-11-29T11:15:50.834 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:15:50.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:50.835 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:15:50.961 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:15:50.961 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:15:50.969 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:15:50.969 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:15:50.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:50.969 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-29T11:15:51.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:15:51.018 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-29T11:15:51.018 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:15:51.018 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:15:51.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:15:51.027 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:15:51.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:51.027 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-29T11:15:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-29T11:15:51.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:15:51.076 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:15:51.077 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:15:51.084 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:15:51.084 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:15:51.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:15:51.085 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-29T11:15:51.137 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-29T11:15:51.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:15:51.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.254+0000 7f3331dc3700 1 Processor -- start 2023-11-29T11:15:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.254+0000 7f3331dc3700 1 -- start start 2023-11-29T11:15:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.254+0000 7f3331dc3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f332c0cd000 0x7f332c0cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.254+0000 7f3331dc3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd3d0 0x7f332c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.254+0000 7f3331dc3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0ce3a0 con 0x7f332c0cf120 2023-11-29T11:15:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.254+0000 7f3331dc3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0d02c0 con 0x7f332c0cd000 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.254+0000 7f3331dc3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0d04b0 con 0x7f332c0cd3d0 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd3d0 0x7f332c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3330dc1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f332c0cd000 0x7f332c0cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd3d0 0x7f332c0b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:43714/0 (socket says 172.21.15.81:43714) 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332bfff700 1 -- 172.21.15.81:0/3338939803 learned_addr learned my addr 172.21.15.81:0/3338939803 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f33315c2700 1 --1- 172.21.15.81:0/3338939803 >> v1:172.21.15.176:6789/0 conn(0x7f332c0cf120 0x7f332c0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:38928/0 (socket says 172.21.15.81:38928) 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332bfff700 1 -- 172.21.15.81:0/3338939803 >> v2:172.21.15.176:3300/0 conn(0x7f332c0cd000 msgr2=0x7f332c0cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332bfff700 1 --2- 172.21.15.81:0/3338939803 >> v2:172.21.15.176:3300/0 conn(0x7f332c0cd000 0x7f332c0cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332bfff700 1 -- 172.21.15.81:0/3338939803 >> v1:172.21.15.176:6789/0 conn(0x7f332c0cf120 legacy=0x7f332c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332bfff700 1 -- 172.21.15.81:0/3338939803 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c0ce640 con 0x7f332c0cd3d0 2023-11-29T11:15:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332bfff700 1 --2- 172.21.15.81:0/3338939803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd3d0 0x7f332c0b3480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3314009910 tx=0x7f3314009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffe15f72cb0148d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332b7fe700 1 -- 172.21.15.81:0/3338939803 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314005e50 con 0x7f332c0cd3d0 2023-11-29T11:15:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332b7fe700 1 -- 172.21.15.81:0/3338939803 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3314006030 con 0x7f332c0cd3d0 2023-11-29T11:15:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f332b7fe700 1 -- 172.21.15.81:0/3338939803 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33140063e0 con 0x7f332c0cd3d0 2023-11-29T11:15:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3331dc3700 1 -- 172.21.15.81:0/3338939803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd3d0 msgr2=0x7f332c0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3331dc3700 1 --2- 172.21.15.81:0/3338939803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd3d0 0x7f332c0b3480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3314009910 tx=0x7f3314009c20 comp rx=0 tx=0).stop 2023-11-29T11:15:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3331dc3700 1 -- 172.21.15.81:0/3338939803 shutdown_connections 2023-11-29T11:15:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3331dc3700 1 --2- 172.21.15.81:0/3338939803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd3d0 0x7f332c0b3480 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3331dc3700 1 --2- 172.21.15.81:0/3338939803 >> v2:172.21.15.176:3300/0 conn(0x7f332c0cd000 0x7f332c0cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3331dc3700 1 -- 172.21.15.81:0/3338939803 >> 172.21.15.81:0/3338939803 conn(0x7f332c0b2140 msgr2=0x7f332c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3331dc3700 1 -- 172.21.15.81:0/3338939803 shutdown_connections 2023-11-29T11:15:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.258+0000 7f3331dc3700 1 -- 172.21.15.81:0/3338939803 wait complete. 2023-11-29T11:15:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.262+0000 7f3331dc3700 1 Processor -- start 2023-11-29T11:15:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.262+0000 7f3331dc3700 1 -- start start 2023-11-29T11:15:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.262+0000 7f3331dc3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd000 0x7f332c155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f3331dc3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f332c0cd3d0 0x7f332c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f3331dc3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f332c0cf120 0x7f332c154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f3331dc3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0ca640 con 0x7f332c0cf120 2023-11-29T11:15:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f3331dc3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c159680 con 0x7f332c0cd3d0 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f3331dc3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0c7830 con 0x7f332c0cd000 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33315c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f332c0cf120 0x7f332c154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f332bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f332c0cd3d0 0x7f332c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f332bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f332c0cd3d0 0x7f332c0ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:35964/0 (socket says 172.21.15.81:35964) 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f332bfff700 1 -- 172.21.15.81:0/2318385872 learned_addr learned my addr 172.21.15.81:0/2318385872 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33315c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f332c0cf120 0x7f332c154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59558/0 (socket says 172.21.15.81:59558) 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f3330dc1700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd000 0x7f332c155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33315c2700 1 -- 172.21.15.81:0/2318385872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd000 msgr2=0x7f332c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33315c2700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd000 0x7f332c155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33315c2700 1 -- 172.21.15.81:0/2318385872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f332c0cd3d0 msgr2=0x7f332c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33315c2700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f332c0cd3d0 0x7f332c0ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33315c2700 1 -- 172.21.15.81:0/2318385872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3314009520 con 0x7f332c0cf120 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33315c2700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f332c0cf120 0x7f332c154220 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f332400cb10 tx=0x7f332400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33297fa700 1 -- 172.21.15.81:0/2318385872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400a9e0 con 0x7f332c0cf120 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33297fa700 1 -- 172.21.15.81:0/2318385872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400ab40 con 0x7f332c0cf120 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c0cec00 con 0x7f332c0cf120 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f33297fa700 1 -- 172.21.15.81:0/2318385872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324007070 con 0x7f332c0cf120 2023-11-29T11:15:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.266+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c0ce920 con 0x7f332c0cf120 2023-11-29T11:15:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.270+0000 7f33297fa700 1 -- 172.21.15.81:0/2318385872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3324019030 con 0x7f332c0cf120 2023-11-29T11:15:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.270+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c15d6a0 con 0x7f332c0cf120 2023-11-29T11:15:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.270+0000 7f33297fa700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3310064ee0 0x7f3310067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.270+0000 7f33297fa700 1 -- 172.21.15.81:0/2318385872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3324081a70 con 0x7f332c0cf120 2023-11-29T11:15:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.270+0000 7f3330dc1700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3310064ee0 0x7f3310067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.270+0000 7f3330dc1700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3310064ee0 0x7f3310067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f331c009b50 tx=0x7f331c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.274+0000 7f33297fa700 1 -- 172.21.15.81:0/2318385872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f332404a400 con 0x7f332c0cf120 2023-11-29T11:15:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.470+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f332c072500 con 0x7f332c0cf120 2023-11-29T11:15:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.470+0000 7f33297fa700 1 -- 172.21.15.81:0/2318385872 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f3324081e60 con 0x7f332c0cf120 2023-11-29T11:15:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:51.477 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:15:08.545106+0000","modified":"2023-11-29T11:15:11.563216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/63586216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":63586216},{"type":"v1","addr":"172.21.15.81:6837","nonce":63586216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-29T11:15:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3310064ee0 msgr2=0x7f3310067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3310064ee0 0x7f3310067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f331c009b50 tx=0x7f331c009240 comp rx=0 tx=0).stop 2023-11-29T11:15:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f332c0cf120 msgr2=0x7f332c154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f332c0cf120 0x7f332c154220 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f332400cb10 tx=0x7f332400ce20 comp rx=0 tx=0).stop 2023-11-29T11:15:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 shutdown_connections 2023-11-29T11:15:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3310064ee0 0x7f3310067390 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f332c0cf120 0x7f332c154220 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f332c0cd3d0 0x7f332c0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 --2- 172.21.15.81:0/2318385872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f332c0cd000 0x7f332c155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 >> 172.21.15.81:0/2318385872 conn(0x7f332c0b2140 msgr2=0x7f332c06e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 shutdown_connections 2023-11-29T11:15:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.474+0000 7f3331dc3700 1 -- 172.21.15.81:0/2318385872 wait complete. 2023-11-29T11:15:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-11-29T11:15:51.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:15:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f392a900700 1 Processor -- start 2023-11-29T11:15:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f392a900700 1 -- start start 2023-11-29T11:15:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f392a900700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 0x7f39240c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f392a900700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39240ad490 0x7f39240cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f392a900700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39240cd8f0 con 0x7f39240cad50 2023-11-29T11:15:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f392a900700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39240add00 con 0x7f39240ad490 2023-11-29T11:15:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f392a900700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240cc4f0 con 0x7f3924158e60 2023-11-29T11:15:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f39290fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39240ad490 0x7f39240cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f39290fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39240ad490 0x7f39240cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59564/0 (socket says 172.21.15.81:59564) 2023-11-29T11:15:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f39290fd700 1 -- 172.21.15.81:0/179398611 learned_addr learned my addr 172.21.15.81:0/179398611 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.594+0000 7f39298fe700 1 --2- 172.21.15.81:0/179398611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 0x7f39240c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f39290fd700 1 -- 172.21.15.81:0/179398611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 msgr2=0x7f39240c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f39290fd700 1 --2- 172.21.15.81:0/179398611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 0x7f39240c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f39290fd700 1 -- 172.21.15.81:0/179398611 >> v1:172.21.15.176:6789/0 conn(0x7f39240cad50 legacy=0x7f392406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f39290fd700 1 -- 172.21.15.81:0/179398611 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392406dc60 con 0x7f39240ad490 2023-11-29T11:15:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f39290fd700 1 --2- 172.21.15.81:0/179398611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240ad490 0x7f39240cbfb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3914009970 tx=0x7f3914009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ba747db1848b8d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f39288fc700 1 -- 172.21.15.81:0/179398611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400b9e0 con 0x7f39240ad490 2023-11-29T11:15:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f39288fc700 1 -- 172.21.15.81:0/179398611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391400bb40 con 0x7f39240ad490 2023-11-29T11:15:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f39288fc700 1 -- 172.21.15.81:0/179398611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914011420 con 0x7f39240ad490 2023-11-29T11:15:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 -- 172.21.15.81:0/179398611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240ad490 msgr2=0x7f39240cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 --2- 172.21.15.81:0/179398611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240ad490 0x7f39240cbfb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3914009970 tx=0x7f3914009c80 comp rx=0 tx=0).stop 2023-11-29T11:15:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 -- 172.21.15.81:0/179398611 shutdown_connections 2023-11-29T11:15:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 --2- 172.21.15.81:0/179398611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240ad490 0x7f39240cbfb0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 --2- 172.21.15.81:0/179398611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 0x7f39240c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 -- 172.21.15.81:0/179398611 >> 172.21.15.81:0/179398611 conn(0x7f39240ce3e0 msgr2=0x7f39240ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 -- 172.21.15.81:0/179398611 shutdown_connections 2023-11-29T11:15:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 -- 172.21.15.81:0/179398611 wait complete. 2023-11-29T11:15:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 Processor -- start 2023-11-29T11:15:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.598+0000 7f392a900700 1 -- start start 2023-11-29T11:15:51.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39240ad490 0x7f392415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240cad50 0x7f3924159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 0x7f3924159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392415af50 con 0x7f39240cad50 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392415b230 con 0x7f39240ad490 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392415b510 con 0x7f3924158e60 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240cad50 0x7f3924159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240cad50 0x7f3924159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59576/0 (socket says 172.21.15.81:59576) 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 -- 172.21.15.81:0/1572740796 learned_addr learned my addr 172.21.15.81:0/1572740796 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39298fe700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39240ad490 0x7f392415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a0ff700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 0x7f3924159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 -- 172.21.15.81:0/1572740796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 msgr2=0x7f3924159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 0x7f3924159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 -- 172.21.15.81:0/1572740796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39240ad490 msgr2=0x7f392415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39240ad490 0x7f392415a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 -- 172.21.15.81:0/1572740796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914009570 con 0x7f39240cad50 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f39290fd700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240cad50 0x7f3924159690 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f392406f7e0 tx=0x7f3914004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f391a7fc700 1 -- 172.21.15.81:0/1572740796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914004450 con 0x7f39240cad50 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f391a7fc700 1 -- 172.21.15.81:0/1572740796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39140045b0 con 0x7f39240cad50 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3924159230 con 0x7f39240cad50 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f391a7fc700 1 -- 172.21.15.81:0/1572740796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914003900 con 0x7f39240cad50 2023-11-29T11:15:51.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39240cde90 con 0x7f39240cad50 2023-11-29T11:15:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.602+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392406d6a0 con 0x7f39240cad50 2023-11-29T11:15:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.606+0000 7f391a7fc700 1 -- 172.21.15.81:0/1572740796 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f391400f050 con 0x7f39240cad50 2023-11-29T11:15:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.606+0000 7f391a7fc700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3908064ee0 0x7f3908067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.606+0000 7f391a7fc700 1 -- 172.21.15.81:0/1572740796 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f39140837a0 con 0x7f39240cad50 2023-11-29T11:15:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.606+0000 7f39298fe700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3908064ee0 0x7f3908067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.606+0000 7f39298fe700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3908064ee0 0x7f3908067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3920007a60 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.610+0000 7f391a7fc700 1 -- 172.21.15.81:0/1572740796 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3914051800 con 0x7f39240cad50 2023-11-29T11:15:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.774+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f392415adb0 con 0x7f39240cad50 2023-11-29T11:15:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f391a7fc700 1 -- 172.21.15.81:0/1572740796 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18026 (secure 0 0 0) 0x7f392415adb0 con 0x7f39240cad50 2023-11-29T11:15:51.783 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:51.783 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:15:09.548834+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:15:07.147241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-29T11:15:07.541685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:15:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3908064ee0 msgr2=0x7f3908067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3908064ee0 0x7f3908067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3920007a60 tx=0x7f3920008040 comp rx=0 tx=0).stop 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240cad50 msgr2=0x7f3924159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240cad50 0x7f3924159690 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f392406f7e0 tx=0x7f3914004770 comp rx=0 tx=0).stop 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 shutdown_connections 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3908064ee0 0x7f3908067390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3924158e60 0x7f3924159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39240cad50 0x7f3924159690 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 --2- 172.21.15.81:0/1572740796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39240ad490 0x7f392415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 >> 172.21.15.81:0/1572740796 conn(0x7f39240ce3e0 msgr2=0x7f3924069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 shutdown_connections 2023-11-29T11:15:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.778+0000 7f392a900700 1 -- 172.21.15.81:0/1572740796 wait complete. 2023-11-29T11:15:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:15:07.147241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:15:07.541685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:15:51.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:15:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6fcd2d700 1 Processor -- start 2023-11-29T11:15:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6fcd2d700 1 -- start start 2023-11-29T11:15:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6fcd2d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc6f80cd370 0x7fc6f80cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6fcd2d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6f80ce220 0x7fc6f80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6fcd2d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80d0130 con 0x7fc6f815c1d0 2023-11-29T11:15:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6fcd2d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80cb750 con 0x7fc6f80ce220 2023-11-29T11:15:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6fcd2d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80cba30 con 0x7fc6f80cd370 2023-11-29T11:15:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6f80ce220 0x7fc6f80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6f80ce220 0x7fc6f80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59592/0 (socket says 172.21.15.81:59592) 2023-11-29T11:15:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f7fff700 1 -- 172.21.15.81:0/1869117655 learned_addr learned my addr 172.21.15.81:0/1869117655 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f6ffd700 1 --2- 172.21.15.81:0/1869117655 >> v2:172.21.15.176:3300/0 conn(0x7fc6f80cd370 0x7fc6f80cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f7fff700 1 -- 172.21.15.81:0/1869117655 >> v2:172.21.15.176:3300/0 conn(0x7fc6f80cd370 msgr2=0x7fc6f80cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f7fff700 1 --2- 172.21.15.81:0/1869117655 >> v2:172.21.15.176:3300/0 conn(0x7fc6f80cd370 0x7fc6f80cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f7fff700 1 -- 172.21.15.81:0/1869117655 >> v1:172.21.15.176:6789/0 conn(0x7fc6f815c1d0 legacy=0x7fc6f80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f7fff700 1 -- 172.21.15.81:0/1869117655 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80cbd10 con 0x7fc6f80ce220 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f6ffd700 1 --2- 172.21.15.81:0/1869117655 >> v2:172.21.15.176:3300/0 conn(0x7fc6f80cd370 0x7fc6f80cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f7fff700 1 --2- 172.21.15.81:0/1869117655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f80cfbf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc6f806d7a0 tx=0x7fc6f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4671476c581bb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f67fc700 1 -- 172.21.15.81:0/1869117655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f000e070 con 0x7fc6f80ce220 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f67fc700 1 -- 172.21.15.81:0/1869117655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f0003a40 con 0x7fc6f80ce220 2023-11-29T11:15:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.906+0000 7fc6f67fc700 1 -- 172.21.15.81:0/1869117655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0003df0 con 0x7fc6f80ce220 2023-11-29T11:15:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.910+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/1869117655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 msgr2=0x7fc6f80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.910+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/1869117655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f80cfbf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc6f806d7a0 tx=0x7fc6f000b330 comp rx=0 tx=0).stop 2023-11-29T11:15:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.910+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/1869117655 shutdown_connections 2023-11-29T11:15:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.910+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/1869117655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f80cfbf0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.910+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/1869117655 >> v2:172.21.15.176:3300/0 conn(0x7fc6f80cd370 0x7fc6f80cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.910+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/1869117655 >> 172.21.15.81:0/1869117655 conn(0x7fc6f80b2180 msgr2=0x7fc6f80b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.910+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/1869117655 shutdown_connections 2023-11-29T11:15:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.910+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/1869117655 wait complete. 2023-11-29T11:15:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 Processor -- start 2023-11-29T11:15:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 -- start start 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f80cd370 0x7fc6f815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f8152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6f815c1d0 0x7fc6f80b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f81531e0 con 0x7fc6f80ce220 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b6330 con 0x7fc6f80cd370 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b3480 con 0x7fc6f815c1d0 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f8152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f8152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59598/0 (socket says 172.21.15.81:59598) 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 -- 172.21.15.81:0/795957818 learned_addr learned my addr 172.21.15.81:0/795957818 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f77fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f80cd370 0x7fc6f815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f7fff700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6f815c1d0 0x7fc6f80b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 -- 172.21.15.81:0/795957818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6f815c1d0 msgr2=0x7fc6f80b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6f815c1d0 0x7fc6f80b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 -- 172.21.15.81:0/795957818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f80cd370 msgr2=0x7fc6f815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f80cd370 0x7fc6f815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 -- 172.21.15.81:0/795957818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009b30 con 0x7fc6f80ce220 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6f6ffd700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f8152ca0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c820 tx=0x7fc6e800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6dffff700 1 -- 172.21.15.81:0/795957818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8011800 con 0x7fc6f80ce220 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6dffff700 1 -- 172.21.15.81:0/795957818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8011960 con 0x7fc6f80ce220 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f80ce5f0 con 0x7fc6f80ce220 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6dffff700 1 -- 172.21.15.81:0/795957818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8011cf0 con 0x7fc6f80ce220 2023-11-29T11:15:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.914+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f80cbff0 con 0x7fc6f80ce220 2023-11-29T11:15:51.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.918+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f80d0360 con 0x7fc6f80ce220 2023-11-29T11:15:51.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.918+0000 7fc6dffff700 1 -- 172.21.15.81:0/795957818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc6e8021070 con 0x7fc6f80ce220 2023-11-29T11:15:51.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.918+0000 7fc6dffff700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc6e4064ee0 0x7fc6e4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:51.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.918+0000 7fc6dffff700 1 -- 172.21.15.81:0/795957818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc6e8081e30 con 0x7fc6f80ce220 2023-11-29T11:15:51.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.918+0000 7fc6f77fe700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc6e4064ee0 0x7fc6e4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:51.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.918+0000 7fc6f77fe700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc6e4064ee0 0x7fc6e4067390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009980 tx=0x7fc6ec0090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:51.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:51.926+0000 7fc6dffff700 1 -- 172.21.15.81:0/795957818 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc6e804fe10 con 0x7fc6f80ce220 2023-11-29T11:15:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.090+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6f8072500 con 0x7fc6f80ce220 2023-11-29T11:15:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.090+0000 7fc6dffff700 1 -- 172.21.15.81:0/795957818 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6e80150a0 con 0x7fc6f80ce220 2023-11-29T11:15:52.095 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:15:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc6e4064ee0 msgr2=0x7fc6e4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc6e4064ee0 0x7fc6e4067390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009980 tx=0x7fc6ec0090e0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 msgr2=0x7fc6f8152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f8152ca0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c820 tx=0x7fc6e800cb30 comp rx=0 tx=0).stop 2023-11-29T11:15:52.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 shutdown_connections 2023-11-29T11:15:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc6e4064ee0 0x7fc6e4067390 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6f815c1d0 0x7fc6f80b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6f80ce220 0x7fc6f8152ca0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 --2- 172.21.15.81:0/795957818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f80cd370 0x7fc6f815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 >> 172.21.15.81:0/795957818 conn(0x7fc6f80b2180 msgr2=0x7fc6f806e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 shutdown_connections 2023-11-29T11:15:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.094+0000 7fc6fcd2d700 1 -- 172.21.15.81:0/795957818 wait complete. 2023-11-29T11:15:52.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:15:52.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.222+0000 7feea5be5700 1 Processor -- start 2023-11-29T11:15:52.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.222+0000 7feea5be5700 1 -- start start 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.222+0000 7feea5be5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feea00cf7f0 0x7feea006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.222+0000 7feea5be5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea006a9c0 con 0x7feea006a4c0 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.222+0000 7feea5be5700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea006aca0 con 0x7feea00b1ae0 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea5be5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea00d0ab0 con 0x7feea00cf7f0 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feea006a4c0 0x7feea00cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33834/0 (socket says 172.21.15.81:33834) 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9ffff700 1 -- 172.21.15.81:0/76444060 learned_addr learned my addr 172.21.15.81:0/76444060 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 --2- 172.21.15.81:0/76444060 >> v2:172.21.15.176:3300/0 conn(0x7feea00cf7f0 0x7feea006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017938854 0 0) 0x7feea006a9c0 con 0x7feea006a4c0 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee8c0035d0 con 0x7feea006a4c0 2023-11-29T11:15:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2999635171 0 0) 0x7fee8c0035d0 con 0x7feea006a4c0 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 >> v2:172.21.15.176:3300/0 conn(0x7feea00cf7f0 msgr2=0x7feea006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 --2- 172.21.15.81:0/76444060 >> v2:172.21.15.176:3300/0 conn(0x7feea00cf7f0 0x7feea006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 >> v1:172.21.15.176:6789/0 conn(0x7feea00b1ae0 legacy=0x7feea00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea006af80 con 0x7feea006a4c0 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fee90001670 con 0x7feea006a4c0 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 >> v1:172.21.15.81:6789/0 conn(0x7feea006a4c0 legacy=0x7feea00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c003a20 0x7fee8c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee8c004870 0x7fee8c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c005220 0x7fee8c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea00d0ab0 con 0x7fee8c005220 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c00c0a0 con 0x7fee8c004870 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c00c260 con 0x7fee8c003a20 2023-11-29T11:15:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c005220 0x7fee8c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9ffff700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee8c004870 0x7fee8c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 -- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c003a20 msgr2=0x7fee8c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea4be3700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c003a20 0x7fee8c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c003a20 0x7fee8c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 -- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee8c004870 msgr2=0x7fee8c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee8c004870 0x7fee8c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 -- 172.21.15.81:0/76444060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c0035d0 con 0x7fee8c005220 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9ffff700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee8c004870 0x7fee8c004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea4be3700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c003a20 0x7fee8c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 -- 172.21.15.81:0/76444060 reap_dead start 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea53e4700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c005220 0x7fee8c00ba30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fee98009fc0 tx=0x7fee8c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5f61c7f69df965 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98003a40 con 0x7fee8c005220 2023-11-29T11:15:52.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9800f040 con 0x7fee8c005220 2023-11-29T11:15:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7fee9f7fe700 1 -- 172.21.15.81:0/76444060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98003dc0 con 0x7fee8c005220 2023-11-29T11:15:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea5be5700 1 -- 172.21.15.81:0/76444060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c005220 msgr2=0x7fee8c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea5be5700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c005220 0x7fee8c00ba30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fee98009fc0 tx=0x7fee8c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea5be5700 1 -- 172.21.15.81:0/76444060 shutdown_connections 2023-11-29T11:15:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea5be5700 1 --2- 172.21.15.81:0/76444060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c005220 0x7fee8c00ba30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea5be5700 1 -- 172.21.15.81:0/76444060 >> 172.21.15.81:0/76444060 conn(0x7feea009bbd0 msgr2=0x7feea00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea5be5700 1 -- 172.21.15.81:0/76444060 shutdown_connections 2023-11-29T11:15:52.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.226+0000 7feea5be5700 1 -- 172.21.15.81:0/76444060 wait complete. 2023-11-29T11:15:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.230+0000 7feea5be5700 1 Processor -- start 2023-11-29T11:15:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.230+0000 7feea5be5700 1 -- start start 2023-11-29T11:15:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c005220 0x7feea00a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feea00b2040 0x7feea009c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feea015a2e0 0x7feea009ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea01555f0 con 0x7feea00b2040 2023-11-29T11:15:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea015a0a0 con 0x7feea015a2e0 2023-11-29T11:15:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea015d6f0 con 0x7fee8c005220 2023-11-29T11:15:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feea00b2040 0x7feea009c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feea00b2040 0x7feea009c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59618/0 (socket says 172.21.15.81:59618) 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 -- 172.21.15.81:0/1783680878 learned_addr learned my addr 172.21.15.81:0/1783680878 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea53e4700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feea015a2e0 0x7feea009ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea4be3700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c005220 0x7feea00a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 -- 172.21.15.81:0/1783680878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c005220 msgr2=0x7feea00a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c005220 0x7feea00a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 -- 172.21.15.81:0/1783680878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feea015a2e0 msgr2=0x7feea009ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feea015a2e0 0x7feea009ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 -- 172.21.15.81:0/1783680878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00b1eb0 con 0x7feea00b2040 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9ffff700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feea00b2040 0x7feea009c540 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fee9000db10 tx=0x7fee9000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9d7fa700 1 -- 172.21.15.81:0/1783680878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90004ca0 con 0x7feea00b2040 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9d7fa700 1 -- 172.21.15.81:0/1783680878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9000de90 con 0x7feea00b2040 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea00b4380 con 0x7feea00b2040 2023-11-29T11:15:52.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7fee9d7fa700 1 -- 172.21.15.81:0/1783680878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90007e20 con 0x7feea00b2040 2023-11-29T11:15:52.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea00b60e0 con 0x7feea00b2040 2023-11-29T11:15:52.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.234+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea015d860 con 0x7feea00b2040 2023-11-29T11:15:52.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.238+0000 7fee9d7fa700 1 -- 172.21.15.81:0/1783680878 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fee9001b030 con 0x7feea00b2040 2023-11-29T11:15:52.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.238+0000 7fee9d7fa700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee80064f10 0x7fee800673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.238+0000 7feea4be3700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee80064f10 0x7fee800673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.238+0000 7fee9d7fa700 1 -- 172.21.15.81:0/1783680878 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fee90081840 con 0x7feea00b2040 2023-11-29T11:15:52.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.238+0000 7feea4be3700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee80064f10 0x7fee800673c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fee88000f60 tx=0x7fee88009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.242+0000 7fee9d7fa700 1 -- 172.21.15.81:0/1783680878 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fee9004f8a0 con 0x7feea00b2040 2023-11-29T11:15:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feea0072500 con 0x7feea00b2040 2023-11-29T11:15:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7fee9d7fa700 1 -- 172.21.15.81:0/1783680878 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee90019020 con 0x7feea00b2040 2023-11-29T11:15:52.411 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:15:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee80064f10 msgr2=0x7fee800673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee80064f10 0x7fee800673c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fee88000f60 tx=0x7fee88009040 comp rx=0 tx=0).stop 2023-11-29T11:15:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feea00b2040 msgr2=0x7feea009c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feea00b2040 0x7feea009c540 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fee9000db10 tx=0x7fee9000de20 comp rx=0 tx=0).stop 2023-11-29T11:15:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 shutdown_connections 2023-11-29T11:15:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee80064f10 0x7fee800673c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feea015a2e0 0x7feea009ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feea00b2040 0x7feea009c540 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 --2- 172.21.15.81:0/1783680878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee8c005220 0x7feea00a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 >> 172.21.15.81:0/1783680878 conn(0x7feea009bbd0 msgr2=0x7feea015bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 shutdown_connections 2023-11-29T11:15:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.406+0000 7feea5be5700 1 -- 172.21.15.81:0/1783680878 wait complete. 2023-11-29T11:15:52.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:15:52.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ce5ea700 1 Processor -- start 2023-11-29T11:15:52.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ce5ea700 1 -- start start 2023-11-29T11:15:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ce5ea700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f86c806a4c0 0x7f86c806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ce5ea700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c806a9c0 con 0x7f86c80cf0e0 2023-11-29T11:15:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ce5ea700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c806aca0 con 0x7f86c80b1ae0 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ce5ea700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80d0ab0 con 0x7f86c806a4c0 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86cdde9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f86c80cf0e0 0x7f86c80cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33844/0 (socket says 172.21.15.81:33844) 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86cdde9700 1 -- 172.21.15.81:0/3905616114 learned_addr learned my addr 172.21.15.81:0/3905616114 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ccde7700 1 --2- 172.21.15.81:0/3905616114 >> v2:172.21.15.176:3300/0 conn(0x7f86c806a4c0 0x7f86c806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86bffff700 1 -- 172.21.15.81:0/3905616114 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73359044 0 0) 0x7f86c806a9c0 con 0x7f86c80cf0e0 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86bffff700 1 -- 172.21.15.81:0/3905616114 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b40035d0 con 0x7f86c80cf0e0 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ccde7700 1 -- 172.21.15.81:0/3905616114 >> v1:172.21.15.176:6789/0 conn(0x7f86c80b1ae0 legacy=0x7f86c80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ccde7700 1 -- 172.21.15.81:0/3905616114 >> v1:172.21.15.81:6789/0 conn(0x7f86c80cf0e0 legacy=0x7f86c80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.538+0000 7f86ccde7700 1 -- 172.21.15.81:0/3905616114 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c806af80 con 0x7f86c806a4c0 2023-11-29T11:15:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86ccde7700 1 --2- 172.21.15.81:0/3905616114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c806a4c0 0x7f86c806d8e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009850 tx=0x7f86c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebe3d368450d1829 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86bffff700 1 -- 172.21.15.81:0/3905616114 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4011830 con 0x7f86c806a4c0 2023-11-29T11:15:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86bffff700 1 -- 172.21.15.81:0/3905616114 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c4011990 con 0x7f86c806a4c0 2023-11-29T11:15:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86bffff700 1 -- 172.21.15.81:0/3905616114 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4011d00 con 0x7f86c806a4c0 2023-11-29T11:15:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3905616114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c806a4c0 msgr2=0x7f86c806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86ce5ea700 1 --2- 172.21.15.81:0/3905616114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c806a4c0 0x7f86c806d8e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009850 tx=0x7f86c4009b60 comp rx=0 tx=0).stop 2023-11-29T11:15:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3905616114 shutdown_connections 2023-11-29T11:15:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86ce5ea700 1 --2- 172.21.15.81:0/3905616114 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c806a4c0 0x7f86c806d8e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3905616114 >> 172.21.15.81:0/3905616114 conn(0x7f86c809bbd0 msgr2=0x7f86c80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3905616114 shutdown_connections 2023-11-29T11:15:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.542+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3905616114 wait complete. 2023-11-29T11:15:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 Processor -- start 2023-11-29T11:15:52.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 -- start start 2023-11-29T11:15:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86c806a4c0 0x7f86c80b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b1ae0 0x7f86c815e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80cf0e0 0x7f86c80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c815dc30 con 0x7f86c806a4c0 2023-11-29T11:15:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c71d0 con 0x7f86c80b1ae0 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80c6c10 con 0x7f86c80cf0e0 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86c806a4c0 0x7f86c80b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86c806a4c0 0x7f86c80b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59632/0 (socket says 172.21.15.81:59632) 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 -- 172.21.15.81:0/3603204794 learned_addr learned my addr 172.21.15.81:0/3603204794 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ccde7700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b1ae0 0x7f86c815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cdde9700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80cf0e0 0x7f86c80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 -- 172.21.15.81:0/3603204794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80cf0e0 msgr2=0x7f86c80c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80cf0e0 0x7f86c80c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 -- 172.21.15.81:0/3603204794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b1ae0 msgr2=0x7f86c815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b1ae0 0x7f86c815e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 -- 172.21.15.81:0/3603204794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40094b0 con 0x7f86c806a4c0 2023-11-29T11:15:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86cd5e8700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86c806a4c0 0x7f86c80b07f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f86b800c410 tx=0x7f86b800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86bdffb700 1 -- 172.21.15.81:0/3603204794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80052d0 con 0x7f86c806a4c0 2023-11-29T11:15:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86bdffb700 1 -- 172.21.15.81:0/3603204794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8005430 con 0x7f86c806a4c0 2023-11-29T11:15:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80b1eb0 con 0x7f86c806a4c0 2023-11-29T11:15:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86bdffb700 1 -- 172.21.15.81:0/3603204794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80055a0 con 0x7f86c806a4c0 2023-11-29T11:15:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.546+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c80b4380 con 0x7f86c806a4c0 2023-11-29T11:15:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.550+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c80b60e0 con 0x7f86c806a4c0 2023-11-29T11:15:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.550+0000 7f86bdffb700 1 -- 172.21.15.81:0/3603204794 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f86b8010050 con 0x7f86c806a4c0 2023-11-29T11:15:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.550+0000 7f86bdffb700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86ac064ee0 0x7f86ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.550+0000 7f86ccde7700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86ac064ee0 0x7f86ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.550+0000 7f86bdffb700 1 -- 172.21.15.81:0/3603204794 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f86b80812a0 con 0x7f86c806a4c0 2023-11-29T11:15:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.554+0000 7f86ccde7700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86ac064ee0 0x7f86ac067390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f86c40090b0 tx=0x7f86c401c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.558+0000 7f86bdffb700 1 -- 172.21.15.81:0/3603204794 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f86b8049400 con 0x7f86c806a4c0 2023-11-29T11:15:52.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.718+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86c815dea0 con 0x7f86c806a4c0 2023-11-29T11:15:52.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86bdffb700 1 -- 172.21.15.81:0/3603204794 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86b804f130 con 0x7f86c806a4c0 2023-11-29T11:15:52.725 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86ac064ee0 msgr2=0x7f86ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86ac064ee0 0x7f86ac067390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f86c40090b0 tx=0x7f86c401c040 comp rx=0 tx=0).stop 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86c806a4c0 msgr2=0x7f86c80b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86c806a4c0 0x7f86c80b07f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f86b800c410 tx=0x7f86b800c7d0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 shutdown_connections 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86ac064ee0 0x7f86ac067390 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86c80cf0e0 0x7f86c80c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86c80b1ae0 0x7f86c815e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 --2- 172.21.15.81:0/3603204794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86c806a4c0 0x7f86c80b07f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 >> 172.21.15.81:0/3603204794 conn(0x7f86c809bbd0 msgr2=0x7f86c815bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 shutdown_connections 2023-11-29T11:15:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.722+0000 7f86ce5ea700 1 -- 172.21.15.81:0/3603204794 wait complete. 2023-11-29T11:15:52.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:15:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.854+0000 7ff763fff700 1 Processor -- start 2023-11-29T11:15:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.854+0000 7ff763fff700 1 -- start start 2023-11-29T11:15:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.854+0000 7ff763fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff76415a060 0x7ff764069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a430 0x7ff7640cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640b2250 con 0x7ff7640ac230 2023-11-29T11:15:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76406a490 con 0x7ff76415a060 2023-11-29T11:15:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76406a770 con 0x7ff76415a430 2023-11-29T11:15:52.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff7637fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7640ac230 0x7ff7640aaf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33856/0 (socket says 172.21.15.81:33856) 2023-11-29T11:15:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff7637fe700 1 -- 172.21.15.81:0/3737520925 learned_addr learned my addr 172.21.15.81:0/3737520925 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff762ffd700 1 --2- 172.21.15.81:0/3737520925 >> v2:172.21.15.176:3300/0 conn(0x7ff76415a060 0x7ff764069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff7627fc700 1 --2- 172.21.15.81:0/3737520925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a430 0x7ff7640cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff761ffb700 1 -- 172.21.15.81:0/3737520925 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042627506 0 0) 0x7ff7640b2250 con 0x7ff7640ac230 2023-11-29T11:15:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff761ffb700 1 -- 172.21.15.81:0/3737520925 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7500035d0 con 0x7ff7640ac230 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff761ffb700 1 -- 172.21.15.81:0/3737520925 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4137667557 0 0) 0x7ff7500035d0 con 0x7ff7640ac230 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff7627fc700 1 -- 172.21.15.81:0/3737520925 >> v2:172.21.15.176:3300/0 conn(0x7ff76415a060 msgr2=0x7ff764069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff7627fc700 1 --2- 172.21.15.81:0/3737520925 >> v2:172.21.15.176:3300/0 conn(0x7ff76415a060 0x7ff764069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff7627fc700 1 -- 172.21.15.81:0/3737520925 >> v1:172.21.15.81:6789/0 conn(0x7ff7640ac230 legacy=0x7ff7640aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff7627fc700 1 -- 172.21.15.81:0/3737520925 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76406aa50 con 0x7ff76415a430 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff7627fc700 1 --2- 172.21.15.81:0/3737520925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a430 0x7ff7640cc2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff754009d90 tx=0x7ff75400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebeca12bc8e39d35 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff761ffb700 1 -- 172.21.15.81:0/3737520925 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c001670 con 0x7ff76415a430 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff761ffb700 1 -- 172.21.15.81:0/3737520925 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff754003a40 con 0x7ff76415a430 2023-11-29T11:15:52.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff761ffb700 1 -- 172.21.15.81:0/3737520925 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754003df0 con 0x7ff76415a430 2023-11-29T11:15:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 -- 172.21.15.81:0/3737520925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a430 msgr2=0x7ff7640cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 --2- 172.21.15.81:0/3737520925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a430 0x7ff7640cc2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff754009d90 tx=0x7ff75400b330 comp rx=0 tx=0).stop 2023-11-29T11:15:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 -- 172.21.15.81:0/3737520925 shutdown_connections 2023-11-29T11:15:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 --2- 172.21.15.81:0/3737520925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a430 0x7ff7640cc2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 --2- 172.21.15.81:0/3737520925 >> v2:172.21.15.176:3300/0 conn(0x7ff76415a060 0x7ff764069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 -- 172.21.15.81:0/3737520925 >> 172.21.15.81:0/3737520925 conn(0x7ff7640cae70 msgr2=0x7ff7640cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 -- 172.21.15.81:0/3737520925 shutdown_connections 2023-11-29T11:15:52.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.858+0000 7ff763fff700 1 -- 172.21.15.81:0/3737520925 wait complete. 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 Processor -- start 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 -- start start 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640ac230 0x7ff76409b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a060 0x7ff764070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76415a430 0x7ff764071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76409ac00 con 0x7ff7640ac230 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764099ff0 con 0x7ff76415a430 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76409a2d0 con 0x7ff76415a060 2023-11-29T11:15:52.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640ac230 0x7ff76409b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640ac230 0x7ff76409b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59648/0 (socket says 172.21.15.81:59648) 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 -- 172.21.15.81:0/261962305 learned_addr learned my addr 172.21.15.81:0/261962305 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff7627fc700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a060 0x7ff764070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff7637fe700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76415a430 0x7ff764071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 -- 172.21.15.81:0/261962305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a060 msgr2=0x7ff764070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a060 0x7ff764070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 -- 172.21.15.81:0/261962305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76415a430 msgr2=0x7ff764071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76415a430 0x7ff764071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 -- 172.21.15.81:0/261962305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754009a70 con 0x7ff7640ac230 2023-11-29T11:15:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff762ffd700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640ac230 0x7ff76409b090 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e840 tx=0x7ff75c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff75b7fe700 1 -- 172.21.15.81:0/261962305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0095a0 con 0x7ff7640ac230 2023-11-29T11:15:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff75b7fe700 1 -- 172.21.15.81:0/261962305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c00c690 con 0x7ff7640ac230 2023-11-29T11:15:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76406b010 con 0x7ff7640ac230 2023-11-29T11:15:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff75b7fe700 1 -- 172.21.15.81:0/261962305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00ca00 con 0x7ff7640ac230 2023-11-29T11:15:52.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.862+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76406ad30 con 0x7ff7640ac230 2023-11-29T11:15:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.866+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76406a180 con 0x7ff7640ac230 2023-11-29T11:15:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.866+0000 7ff75b7fe700 1 -- 172.21.15.81:0/261962305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff75c019030 con 0x7ff7640ac230 2023-11-29T11:15:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.866+0000 7ff75b7fe700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff744064ee0 0x7ff744067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.866+0000 7ff75b7fe700 1 -- 172.21.15.81:0/261962305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff75c081e90 con 0x7ff7640ac230 2023-11-29T11:15:52.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.866+0000 7ff7627fc700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff744064ee0 0x7ff744067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:52.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.866+0000 7ff7627fc700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff744064ee0 0x7ff744067390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff76415a880 tx=0x7ff754014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:52.874+0000 7ff75b7fe700 1 -- 172.21.15.81:0/261962305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff75c04fe90 con 0x7ff7640ac230 2023-11-29T11:15:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.030+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff764072500 con 0x7ff7640ac230 2023-11-29T11:15:53.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.030+0000 7ff75b7fe700 1 -- 172.21.15.81:0/261962305 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff75c0534b0 con 0x7ff7640ac230 2023-11-29T11:15:53.036 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:15:53.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff744064ee0 msgr2=0x7ff744067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff744064ee0 0x7ff744067390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff76415a880 tx=0x7ff754014000 comp rx=0 tx=0).stop 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640ac230 msgr2=0x7ff76409b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640ac230 0x7ff76409b090 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e840 tx=0x7ff75c00ec00 comp rx=0 tx=0).stop 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 shutdown_connections 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff744064ee0 0x7ff744067390 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff76415a430 0x7ff764071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff76415a060 0x7ff764070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 --2- 172.21.15.81:0/261962305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7640ac230 0x7ff76409b090 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 >> 172.21.15.81:0/261962305 conn(0x7ff7640cae70 msgr2=0x7ff76406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:53.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 shutdown_connections 2023-11-29T11:15:53.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.034+0000 7ff763fff700 1 -- 172.21.15.81:0/261962305 wait complete. 2023-11-29T11:15:53.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:53.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 Processor -- start 2023-11-29T11:15:53.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- start start 2023-11-29T11:15:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab4c0ce260 0x7fab4c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c0ce6f0 con 0x7fab4c159fe0 2023-11-29T11:15:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c0ce9d0 con 0x7fab4c0ce260 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0cecb0 con 0x7fab4c0b2840 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab50fc8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fab4c159fe0 0x7fab4c0b2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33860/0 (socket says 172.21.15.81:33860) 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab4c0ce260 0x7fab4c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab50fc8700 1 -- 172.21.15.81:0/213305742 learned_addr learned my addr 172.21.15.81:0/213305742 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab517c9700 1 --2- 172.21.15.81:0/213305742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4b7fe700 1 -- 172.21.15.81:0/213305742 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114878540 0 0) 0x7fab4c0ce6f0 con 0x7fab4c159fe0 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4b7fe700 1 -- 172.21.15.81:0/213305742 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab340035d0 con 0x7fab4c159fe0 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4bfff700 1 -- 172.21.15.81:0/213305742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 msgr2=0x7fab4c0b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4bfff700 1 --2- 172.21.15.81:0/213305742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c0b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4bfff700 1 -- 172.21.15.81:0/213305742 >> v1:172.21.15.81:6789/0 conn(0x7fab4c159fe0 legacy=0x7fab4c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4bfff700 1 -- 172.21.15.81:0/213305742 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0cef90 con 0x7fab4c0ce260 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4bfff700 1 --2- 172.21.15.81:0/213305742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0ce260 0x7fab4c0b34e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fab44009d90 tx=0x7fab4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bac7b88834f0f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4b7fe700 1 -- 172.21.15.81:0/213305742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4400e070 con 0x7fab4c0ce260 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4b7fe700 1 -- 172.21.15.81:0/213305742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4400bb20 con 0x7fab4c0ce260 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab4b7fe700 1 -- 172.21.15.81:0/213305742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44012430 con 0x7fab4c0ce260 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- 172.21.15.81:0/213305742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0ce260 msgr2=0x7fab4c0b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 --2- 172.21.15.81:0/213305742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0ce260 0x7fab4c0b34e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fab44009d90 tx=0x7fab4400b330 comp rx=0 tx=0).stop 2023-11-29T11:15:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- 172.21.15.81:0/213305742 shutdown_connections 2023-11-29T11:15:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 --2- 172.21.15.81:0/213305742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c0b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 --2- 172.21.15.81:0/213305742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0ce260 0x7fab4c0b34e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- 172.21.15.81:0/213305742 >> 172.21.15.81:0/213305742 conn(0x7fab4c0cd110 msgr2=0x7fab4c0cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- 172.21.15.81:0/213305742 shutdown_connections 2023-11-29T11:15:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.158+0000 7fab51fca700 1 -- 172.21.15.81:0/213305742 wait complete. 2023-11-29T11:15:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 Processor -- start 2023-11-29T11:15:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 -- start start 2023-11-29T11:15:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c1f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4c0ce260 0x7fab4c0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c159fe0 0x7fab4c15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0c88c0 con 0x7fab4c159fe0 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0c8ba0 con 0x7fab4c0ce260 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0c8e80 con 0x7fab4c0b2840 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c159fe0 0x7fab4c15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c159fe0 0x7fab4c15a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59662/0 (socket says 172.21.15.81:59662) 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 -- 172.21.15.81:0/808159726 learned_addr learned my addr 172.21.15.81:0/808159726 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab4bfff700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4c0ce260 0x7fab4c0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab50fc8700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c1f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 -- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 msgr2=0x7fab4c1f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c1f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 -- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4c0ce260 msgr2=0x7fab4c0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4c0ce260 0x7fab4c0c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 -- 172.21.15.81:0/808159726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44009a70 con 0x7fab4c159fe0 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab4bfff700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4c0ce260 0x7fab4c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab50fc8700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c1f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab517c9700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c159fe0 0x7fab4c15a3b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fab4000e810 tx=0x7fab4000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab497fa700 1 -- 172.21.15.81:0/808159726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40013610 con 0x7fab4c159fe0 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab497fa700 1 -- 172.21.15.81:0/808159726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40013790 con 0x7fab4c159fe0 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab497fa700 1 -- 172.21.15.81:0/808159726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40013b40 con 0x7fab4c159fe0 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c0b0ee0 con 0x7fab4c159fe0 2023-11-29T11:15:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c0cf270 con 0x7fab4c159fe0 2023-11-29T11:15:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.162+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c0cf790 con 0x7fab4c159fe0 2023-11-29T11:15:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.166+0000 7fab497fa700 1 -- 172.21.15.81:0/808159726 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fab40023070 con 0x7fab4c159fe0 2023-11-29T11:15:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.166+0000 7fab497fa700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fab38064ee0 0x7fab38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.166+0000 7fab50fc8700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fab38064ee0 0x7fab38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.166+0000 7fab497fa700 1 -- 172.21.15.81:0/808159726 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fab40081d90 con 0x7fab4c159fe0 2023-11-29T11:15:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.166+0000 7fab50fc8700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fab38064ee0 0x7fab38067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0011e0 tx=0x7fab3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.170+0000 7fab497fa700 1 -- 172.21.15.81:0/808159726 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fab4004fc70 con 0x7fab4c159fe0 2023-11-29T11:15:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.366+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab4c0008d0 con 0x7fab4c159fe0 2023-11-29T11:15:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.366+0000 7fab497fa700 1 -- 172.21.15.81:0/808159726 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fab40021090 con 0x7fab4c159fe0 2023-11-29T11:15:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:15:08.545106+0000","modified":"2023-11-29T11:15:11.563216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/63586216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":63586216},{"type":"v1","addr":"172.21.15.81:6837","nonce":63586216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-29T11:15:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fab38064ee0 msgr2=0x7fab38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fab38064ee0 0x7fab38067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0011e0 tx=0x7fab3c009040 comp rx=0 tx=0).stop 2023-11-29T11:15:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c159fe0 msgr2=0x7fab4c15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c159fe0 0x7fab4c15a3b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fab4000e810 tx=0x7fab4000ebd0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 shutdown_connections 2023-11-29T11:15:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fab38064ee0 0x7fab38067390 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c159fe0 0x7fab4c15a3b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab4c0ce260 0x7fab4c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 --2- 172.21.15.81:0/808159726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab4c0b2840 0x7fab4c1f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 >> 172.21.15.81:0/808159726 conn(0x7fab4c0cd110 msgr2=0x7fab4c06f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 shutdown_connections 2023-11-29T11:15:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.370+0000 7fab51fca700 1 -- 172.21.15.81:0/808159726 wait complete. 2023-11-29T11:15:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-11-29T11:15:53.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:15:53.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.494+0000 7f3f48f80700 1 Processor -- start 2023-11-29T11:15:53.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.494+0000 7f3f48f80700 1 -- start start 2023-11-29T11:15:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f44164e60 con 0x7f3f440ad610 2023-11-29T11:15:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f440cae70 con 0x7f3f440ceef0 2023-11-29T11:15:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440cbc10 con 0x7f3f441606b0 2023-11-29T11:15:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f43fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3f440ad610 0x7f3f44164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33874/0 (socket says 172.21.15.81:33874) 2023-11-29T11:15:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f43fff700 1 -- 172.21.15.81:0/4062590053 learned_addr learned my addr 172.21.15.81:0/4062590053 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f437fe700 1 --2- 172.21.15.81:0/4062590053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f427fc700 1 -- 172.21.15.81:0/4062590053 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956802746 0 0) 0x7f3f44164e60 con 0x7f3f440ad610 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f427fc700 1 -- 172.21.15.81:0/4062590053 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f2c0035d0 con 0x7f3f440ad610 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f427fc700 1 -- 172.21.15.81:0/4062590053 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046710186 0 0) 0x7f3f440cae70 con 0x7f3f440ceef0 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f427fc700 1 -- 172.21.15.81:0/4062590053 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f44164e60 con 0x7f3f440ceef0 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f437fe700 1 -- 172.21.15.81:0/4062590053 >> v1:172.21.15.176:6789/0 conn(0x7f3f440ceef0 legacy=0x7f3f44164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f437fe700 1 -- 172.21.15.81:0/4062590053 >> v1:172.21.15.81:6789/0 conn(0x7f3f440ad610 legacy=0x7f3f44164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f437fe700 1 -- 172.21.15.81:0/4062590053 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440cb130 con 0x7f3f441606b0 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f437fe700 1 --2- 172.21.15.81:0/4062590053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440c13b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009880 tx=0x7f3f34009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1475b079a3538642 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f427fc700 1 -- 172.21.15.81:0/4062590053 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011830 con 0x7f3f441606b0 2023-11-29T11:15:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f427fc700 1 -- 172.21.15.81:0/4062590053 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34011990 con 0x7f3f441606b0 2023-11-29T11:15:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f427fc700 1 -- 172.21.15.81:0/4062590053 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011d20 con 0x7f3f441606b0 2023-11-29T11:15:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 -- 172.21.15.81:0/4062590053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 msgr2=0x7f3f440c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 --2- 172.21.15.81:0/4062590053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440c13b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009880 tx=0x7f3f34009b90 comp rx=0 tx=0).stop 2023-11-29T11:15:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 -- 172.21.15.81:0/4062590053 shutdown_connections 2023-11-29T11:15:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 --2- 172.21.15.81:0/4062590053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440c13b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 -- 172.21.15.81:0/4062590053 >> 172.21.15.81:0/4062590053 conn(0x7f3f440ce3e0 msgr2=0x7f3f440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 -- 172.21.15.81:0/4062590053 shutdown_connections 2023-11-29T11:15:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.498+0000 7f3f48f80700 1 -- 172.21.15.81:0/4062590053 wait complete. 2023-11-29T11:15:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f48f80700 1 Processor -- start 2023-11-29T11:15:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f48f80700 1 -- start start 2023-11-29T11:15:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f48f80700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f440ad610 0x7f3f44156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f48f80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f440ceef0 0x7f3f440c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f48f80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f48f80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440c3d60 con 0x7f3f440ceef0 2023-11-29T11:15:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f48f80700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440c4040 con 0x7f3f440ad610 2023-11-29T11:15:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f48f80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440c4320 con 0x7f3f441606b0 2023-11-29T11:15:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f42ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f440ceef0 0x7f3f440c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f42ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f440ceef0 0x7f3f440c3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59664/0 (socket says 172.21.15.81:59664) 2023-11-29T11:15:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f42ffd700 1 -- 172.21.15.81:0/1356658989 learned_addr learned my addr 172.21.15.81:0/1356658989 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f437fe700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f440ad610 0x7f3f44156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f43fff700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f42ffd700 1 -- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 msgr2=0x7f3f440ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f42ffd700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f42ffd700 1 -- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f440ad610 msgr2=0x7f3f44156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f42ffd700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f440ad610 0x7f3f44156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f42ffd700 1 -- 172.21.15.81:0/1356658989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340094b0 con 0x7f3f440ceef0 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.502+0000 7f3f437fe700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f440ad610 0x7f3f44156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.506+0000 7f3f42ffd700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f440ceef0 0x7f3f440c3460 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c490 tx=0x7f3f3800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.506+0000 7f3f2bfff700 1 -- 172.21.15.81:0/1356658989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380052d0 con 0x7f3f440ceef0 2023-11-29T11:15:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.506+0000 7f3f2bfff700 1 -- 172.21.15.81:0/1356658989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38005450 con 0x7f3f440ceef0 2023-11-29T11:15:53.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.506+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f440cb6f0 con 0x7f3f440ceef0 2023-11-29T11:15:53.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.506+0000 7f3f2bfff700 1 -- 172.21.15.81:0/1356658989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380038e0 con 0x7f3f440ceef0 2023-11-29T11:15:53.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.506+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f440cb410 con 0x7f3f440ceef0 2023-11-29T11:15:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.506+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4406ac50 con 0x7f3f440ceef0 2023-11-29T11:15:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.506+0000 7f3f2bfff700 1 -- 172.21.15.81:0/1356658989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3f38019030 con 0x7f3f440ceef0 2023-11-29T11:15:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.510+0000 7f3f2bfff700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f30064ee0 0x7f3f30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.510+0000 7f3f437fe700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f30064ee0 0x7f3f30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.510+0000 7f3f2bfff700 1 -- 172.21.15.81:0/1356658989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3f380813b0 con 0x7f3f440ceef0 2023-11-29T11:15:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.510+0000 7f3f437fe700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f30064ee0 0x7f3f30067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f340090b0 tx=0x7f3f3401c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.518+0000 7f3f2bfff700 1 -- 172.21.15.81:0/1356658989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3f3804f410 con 0x7f3f440ceef0 2023-11-29T11:15:53.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.682+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f44072500 con 0x7f3f440ceef0 2023-11-29T11:15:53.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.682+0000 7f3f2bfff700 1 -- 172.21.15.81:0/1356658989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18026 (secure 0 0 0) 0x7f3f38052a30 con 0x7f3f440ceef0 2023-11-29T11:15:53.688 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:53.688 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:15:09.548834+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:15:07.147241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-29T11:15:07.541685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:15:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f30064ee0 msgr2=0x7f3f30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f30064ee0 0x7f3f30067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f340090b0 tx=0x7f3f3401c040 comp rx=0 tx=0).stop 2023-11-29T11:15:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f440ceef0 msgr2=0x7f3f440c3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f440ceef0 0x7f3f440c3460 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c490 tx=0x7f3f3800c850 comp rx=0 tx=0).stop 2023-11-29T11:15:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 shutdown_connections 2023-11-29T11:15:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f30064ee0 0x7f3f30067390 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f441606b0 0x7f3f440ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f440ceef0 0x7f3f440c3460 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 --2- 172.21.15.81:0/1356658989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f440ad610 0x7f3f44156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 >> 172.21.15.81:0/1356658989 conn(0x7f3f440ce3e0 msgr2=0x7f3f4415aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 shutdown_connections 2023-11-29T11:15:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.686+0000 7f3f48f80700 1 -- 172.21.15.81:0/1356658989 wait complete. 2023-11-29T11:15:53.706 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T11:15:53.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.810+0000 7fde4759e700 1 Processor -- start 2023-11-29T11:15:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.810+0000 7fde4759e700 1 -- start start 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde48159e70 0x7fde4806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fde48069c40 0x7fde480cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde4806cee0 0x7fde480cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4806ace0 con 0x7fde4806cee0 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4806a0d0 con 0x7fde48069c40 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4806a3b0 con 0x7fde48159e70 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde4806cee0 0x7fde480cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde4806cee0 0x7fde480cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59672/0 (socket says 172.21.15.81:59672) 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 -- 172.21.15.81:0/3301498445 learned_addr learned my addr 172.21.15.81:0/3301498445 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde45d9b700 1 --2- 172.21.15.81:0/3301498445 >> v2:172.21.15.176:3300/0 conn(0x7fde48069c40 0x7fde480cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4659c700 1 --2- 172.21.15.81:0/3301498445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde48159e70 0x7fde4806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 -- 172.21.15.81:0/3301498445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde48159e70 msgr2=0x7fde4806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 --2- 172.21.15.81:0/3301498445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde48159e70 0x7fde4806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 -- 172.21.15.81:0/3301498445 >> v2:172.21.15.176:3300/0 conn(0x7fde48069c40 msgr2=0x7fde480cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 --2- 172.21.15.81:0/3301498445 >> v2:172.21.15.176:3300/0 conn(0x7fde48069c40 0x7fde480cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 -- 172.21.15.81:0/3301498445 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4806a690 con 0x7fde4806cee0 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4659c700 1 --2- 172.21.15.81:0/3301498445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde48159e70 0x7fde4806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde46d9d700 1 --2- 172.21.15.81:0/3301498445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4806cee0 0x7fde480cb2a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fde480ce2d0 tx=0x7fde40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c670c58711b08a10 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4559a700 1 -- 172.21.15.81:0/3301498445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40011830 con 0x7fde4806cee0 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4559a700 1 -- 172.21.15.81:0/3301498445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40011990 con 0x7fde4806cee0 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4559a700 1 -- 172.21.15.81:0/3301498445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40011d20 con 0x7fde4806cee0 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 -- 172.21.15.81:0/3301498445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4806cee0 msgr2=0x7fde480cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 --2- 172.21.15.81:0/3301498445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4806cee0 0x7fde480cb2a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fde480ce2d0 tx=0x7fde40009bf0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 -- 172.21.15.81:0/3301498445 shutdown_connections 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 --2- 172.21.15.81:0/3301498445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4806cee0 0x7fde480cb2a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 --2- 172.21.15.81:0/3301498445 >> v2:172.21.15.176:3300/0 conn(0x7fde48069c40 0x7fde480cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 --2- 172.21.15.81:0/3301498445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde48159e70 0x7fde4806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 -- 172.21.15.81:0/3301498445 >> 172.21.15.81:0/3301498445 conn(0x7fde480ce3e0 msgr2=0x7fde480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 -- 172.21.15.81:0/3301498445 shutdown_connections 2023-11-29T11:15:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.814+0000 7fde4759e700 1 -- 172.21.15.81:0/3301498445 wait complete. 2023-11-29T11:15:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.818+0000 7fde4759e700 1 Processor -- start 2023-11-29T11:15:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.818+0000 7fde4759e700 1 -- start start 2023-11-29T11:15:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.818+0000 7fde4759e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde48069c40 0x7fde481f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4806cee0 0x7fde480af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde48159e70 0x7fde480af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde480ccf70 con 0x7fde48159e70 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4759e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde480cd250 con 0x7fde48069c40 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde480cd530 con 0x7fde4806cee0 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde48159e70 0x7fde480af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde48159e70 0x7fde480af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59686/0 (socket says 172.21.15.81:59686) 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4659c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde48069c40 0x7fde481f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 -- 172.21.15.81:0/367093072 learned_addr learned my addr 172.21.15.81:0/367093072 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde45d9b700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4806cee0 0x7fde480af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 -- 172.21.15.81:0/367093072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4806cee0 msgr2=0x7fde480af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4806cee0 0x7fde480af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 -- 172.21.15.81:0/367093072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde48069c40 msgr2=0x7fde481f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde48069c40 0x7fde481f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 -- 172.21.15.81:0/367093072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40009570 con 0x7fde48159e70 2023-11-29T11:15:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde46d9d700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde48159e70 0x7fde480af750 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fde4806f4b0 tx=0x7fde40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde36ffd700 1 -- 172.21.15.81:0/367093072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40004450 con 0x7fde48159e70 2023-11-29T11:15:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde36ffd700 1 -- 172.21.15.81:0/367093072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde400045b0 con 0x7fde48159e70 2023-11-29T11:15:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4815a240 con 0x7fde48159e70 2023-11-29T11:15:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde36ffd700 1 -- 172.21.15.81:0/367093072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40003900 con 0x7fde48159e70 2023-11-29T11:15:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4806a970 con 0x7fde48159e70 2023-11-29T11:15:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde480b32e0 con 0x7fde48159e70 2023-11-29T11:15:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.822+0000 7fde36ffd700 1 -- 172.21.15.81:0/367093072 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fde4000f050 con 0x7fde48159e70 2023-11-29T11:15:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.826+0000 7fde36ffd700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde28064ee0 0x7fde28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.826+0000 7fde36ffd700 1 -- 172.21.15.81:0/367093072 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde40083680 con 0x7fde48159e70 2023-11-29T11:15:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.826+0000 7fde4659c700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde28064ee0 0x7fde28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.826+0000 7fde4659c700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde28064ee0 0x7fde28067390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fde3c004430 tx=0x7fde3c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:53.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:53.830+0000 7fde36ffd700 1 -- 172.21.15.81:0/367093072 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fde400516e0 con 0x7fde48159e70 2023-11-29T11:15:54.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.034+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde4806b6d0 con 0x7fde48159e70 2023-11-29T11:15:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.034+0000 7fde36ffd700 1 -- 172.21.15.81:0/367093072 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fde40015090 con 0x7fde48159e70 2023-11-29T11:15:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:54.042 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:15:08.545106+0000","modified":"2023-11-29T11:15:11.563216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/63586216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":63586216},{"type":"v1","addr":"172.21.15.81:6837","nonce":63586216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-29T11:15:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde28064ee0 msgr2=0x7fde28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde28064ee0 0x7fde28067390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fde3c004430 tx=0x7fde3c008040 comp rx=0 tx=0).stop 2023-11-29T11:15:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde48159e70 msgr2=0x7fde480af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde48159e70 0x7fde480af750 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fde4806f4b0 tx=0x7fde40004770 comp rx=0 tx=0).stop 2023-11-29T11:15:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 shutdown_connections 2023-11-29T11:15:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fde28064ee0 0x7fde28067390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde48159e70 0x7fde480af750 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde4806cee0 0x7fde480af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 --2- 172.21.15.81:0/367093072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde48069c40 0x7fde481f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 >> 172.21.15.81:0/367093072 conn(0x7fde480ce3e0 msgr2=0x7fde480712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 shutdown_connections 2023-11-29T11:15:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.038+0000 7fde4759e700 1 -- 172.21.15.81:0/367093072 wait complete. 2023-11-29T11:15:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-11-29T11:15:54.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115b59e700 1 Processor -- start 2023-11-29T11:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115b59e700 1 -- start start 2023-11-29T11:15:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f115c06d870 0x7f115c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c0d36c0 con 0x7f115c06a8a0 2023-11-29T11:15:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c0d2ab0 con 0x7f115c06ac70 2023-11-29T11:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115c0d2d90 con 0x7f115c06d870 2023-11-29T11:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f115c06a8a0 0x7f115c0b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33890/0 (socket says 172.21.15.81:33890) 2023-11-29T11:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115a59c700 1 -- 172.21.15.81:0/2268978831 learned_addr learned my addr 172.21.15.81:0/2268978831 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f1159d9b700 1 --2- 172.21.15.81:0/2268978831 >> v2:172.21.15.176:3300/0 conn(0x7f115c06d870 0x7f115c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004588050 0 0) 0x7f115c0d36c0 con 0x7f115c06a8a0 2023-11-29T11:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f113c0035d0 con 0x7f115c06a8a0 2023-11-29T11:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1660536442 0 0) 0x7f113c0035d0 con 0x7f115c06a8a0 2023-11-29T11:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 >> v2:172.21.15.176:3300/0 conn(0x7f115c06d870 msgr2=0x7f115c0b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 --2- 172.21.15.81:0/2268978831 >> v2:172.21.15.176:3300/0 conn(0x7f115c06d870 0x7f115c0b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 >> v1:172.21.15.176:6789/0 conn(0x7f115c06ac70 legacy=0x7f115c0cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0d3070 con 0x7f115c06a8a0 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f11440019f0 con 0x7f115c06a8a0 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 >> v1:172.21.15.81:6789/0 conn(0x7f115c06a8a0 legacy=0x7f115c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c003a20 0x7f113c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c004870 0x7f113c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f113c005220 0x7f113c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0d2d90 con 0x7f113c004870 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c00c0a0 con 0x7f113c005220 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c00c260 con 0x7f113c003a20 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f1159d9b700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c004870 0x7f113c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115ad9d700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f113c005220 0x7f113c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115a59c700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c003a20 0x7f113c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f1159d9b700 1 -- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c003a20 msgr2=0x7f113c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f1159d9b700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c003a20 0x7f113c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f1159d9b700 1 -- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f113c005220 msgr2=0x7f113c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f1159d9b700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f113c005220 0x7f113c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f1159d9b700 1 -- 172.21.15.81:0/2268978831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0035d0 con 0x7f113c004870 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115ad9d700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f113c005220 0x7f113c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f115ad9d700 1 -- 172.21.15.81:0/2268978831 reap_dead start 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.170+0000 7f1159d9b700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c004870 0x7f113c004ce0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1154009b70 tx=0x7f113c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40947d89272aad71 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115400e6c0 con 0x7f113c004870 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115400e820 con 0x7f113c004870 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115959a700 1 -- 172.21.15.81:0/2268978831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115400eb90 con 0x7f113c004870 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115b59e700 1 -- 172.21.15.81:0/2268978831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c004870 msgr2=0x7f113c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115b59e700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c004870 0x7f113c004ce0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1154009b70 tx=0x7f113c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115b59e700 1 -- 172.21.15.81:0/2268978831 shutdown_connections 2023-11-29T11:15:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115b59e700 1 --2- 172.21.15.81:0/2268978831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c004870 0x7f113c004ce0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115b59e700 1 -- 172.21.15.81:0/2268978831 >> 172.21.15.81:0/2268978831 conn(0x7f115c0b5740 msgr2=0x7f115c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115b59e700 1 -- 172.21.15.81:0/2268978831 shutdown_connections 2023-11-29T11:15:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.174+0000 7f115b59e700 1 -- 172.21.15.81:0/2268978831 wait complete. 2023-11-29T11:15:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 Processor -- start 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 -- start start 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c004870 0x7f115c1e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115c1e8660 0x7f115c1e7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f115c0c13b0 0x7f115c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0c1d90 con 0x7f115c0c13b0 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0c7d70 con 0x7f115c1e8660 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c1e9570 con 0x7f113c004870 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f115c0c13b0 0x7f115c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f115c0c13b0 0x7f115c0c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59702/0 (socket says 172.21.15.81:59702) 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 -- 172.21.15.81:0/2829062779 learned_addr learned my addr 172.21.15.81:0/2829062779 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115a59c700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c004870 0x7f115c1e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f1159d9b700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115c1e8660 0x7f115c1e7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 -- 172.21.15.81:0/2829062779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c004870 msgr2=0x7f115c1e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c004870 0x7f115c1e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 -- 172.21.15.81:0/2829062779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115c1e8660 msgr2=0x7f115c1e7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115c1e8660 0x7f115c1e7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 -- 172.21.15.81:0/2829062779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0d26d0 con 0x7f115c0c13b0 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115ad9d700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f115c0c13b0 0x7f115c0c1850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f115c08ad10 tx=0x7f114c00e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f1152ffd700 1 -- 172.21.15.81:0/2829062779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00eea0 con 0x7f115c0c13b0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f1152ffd700 1 -- 172.21.15.81:0/2829062779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c0050d0 con 0x7f115c0c13b0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f1152ffd700 1 -- 172.21.15.81:0/2829062779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c005460 con 0x7f115c0c13b0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115c0d3350 con 0x7f115c0c13b0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.178+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115c0d2860 con 0x7f115c0c13b0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.182+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115c1e96e0 con 0x7f115c0c13b0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.182+0000 7f1152ffd700 1 -- 172.21.15.81:0/2829062779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f114c0036a0 con 0x7f115c0c13b0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.182+0000 7f1152ffd700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1140064f10 0x7f11400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.182+0000 7f1152ffd700 1 -- 172.21.15.81:0/2829062779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f114c081240 con 0x7f115c0c13b0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.182+0000 7f115a59c700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1140064f10 0x7f11400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.182+0000 7f115a59c700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1140064f10 0x7f11400673c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1144002010 tx=0x7f1144009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.190+0000 7f1152ffd700 1 -- 172.21.15.81:0/2829062779 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f114c04f1b0 con 0x7f115c0c13b0 2023-11-29T11:15:54.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.386+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f115c072c20 con 0x7f115c0c13b0 2023-11-29T11:15:54.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.386+0000 7f1152ffd700 1 -- 172.21.15.81:0/2829062779 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f114c0527d0 con 0x7f115c0c13b0 2023-11-29T11:15:54.393 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:54.394 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:15:08.545106+0000","modified":"2023-11-29T11:15:11.563216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6117":{"gid":6117,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/63586216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":63586216},{"type":"v1","addr":"172.21.15.81:6837","nonce":63586216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-29T11:15:54.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1140064f10 msgr2=0x7f11400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1140064f10 0x7f11400673c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1144002010 tx=0x7f1144009040 comp rx=0 tx=0).stop 2023-11-29T11:15:54.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f115c0c13b0 msgr2=0x7f115c0c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f115c0c13b0 0x7f115c0c1850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f115c08ad10 tx=0x7f114c00e670 comp rx=0 tx=0).stop 2023-11-29T11:15:54.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 shutdown_connections 2023-11-29T11:15:54.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1140064f10 0x7f11400673c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f115c0c13b0 0x7f115c0c1850 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f115c1e8660 0x7f115c1e7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 --2- 172.21.15.81:0/2829062779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f113c004870 0x7f115c1e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 >> 172.21.15.81:0/2829062779 conn(0x7f115c0b5740 msgr2=0x7f115c0d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:54.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 shutdown_connections 2023-11-29T11:15:54.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.390+0000 7f115b59e700 1 -- 172.21.15.81:0/2829062779 wait complete. 2023-11-29T11:15:54.397 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2023-11-29T11:15:54.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:15:54.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda95bb700 1 Processor -- start 2023-11-29T11:15:54.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda95bb700 1 -- start start 2023-11-29T11:15:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda95bb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdda40c1ac0 0x7fdda4069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda95bb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda40ceef0 0x7fdda406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda95bb700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40cae70 con 0x7fdda41606b0 2023-11-29T11:15:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda95bb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda40cbc10 con 0x7fdda40c1ac0 2023-11-29T11:15:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda95bb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40cb130 con 0x7fdda40ceef0 2023-11-29T11:15:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdda40c1ac0 0x7fdda4069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdda40c1ac0 0x7fdda4069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59716/0 (socket says 172.21.15.81:59716) 2023-11-29T11:15:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda3fff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fdda41606b0 0x7fdda40c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:39000/0 (socket says 172.21.15.81:39000) 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda37fe700 1 -- 172.21.15.81:0/2917954812 learned_addr learned my addr 172.21.15.81:0/2917954812 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda8dba700 1 --2- 172.21.15.81:0/2917954812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda40ceef0 0x7fdda406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda37fe700 1 -- 172.21.15.81:0/2917954812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda40ceef0 msgr2=0x7fdda406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda37fe700 1 --2- 172.21.15.81:0/2917954812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda40ceef0 0x7fdda406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda37fe700 1 -- 172.21.15.81:0/2917954812 >> v1:172.21.15.176:6789/0 conn(0x7fdda41606b0 legacy=0x7fdda40c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda37fe700 1 -- 172.21.15.81:0/2917954812 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40cb410 con 0x7fdda40c1ac0 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda37fe700 1 --2- 172.21.15.81:0/2917954812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda4069c40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009910 tx=0x7fdd94009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28864d4d7061adc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda2ffd700 1 -- 172.21.15.81:0/2917954812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400ba60 con 0x7fdda40c1ac0 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda2ffd700 1 -- 172.21.15.81:0/2917954812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400bbc0 con 0x7fdda40c1ac0 2023-11-29T11:15:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.518+0000 7fdda2ffd700 1 -- 172.21.15.81:0/2917954812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94009e60 con 0x7fdda40c1ac0 2023-11-29T11:15:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- 172.21.15.81:0/2917954812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 msgr2=0x7fdda4069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 --2- 172.21.15.81:0/2917954812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda4069c40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009910 tx=0x7fdd94009c20 comp rx=0 tx=0).stop 2023-11-29T11:15:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- 172.21.15.81:0/2917954812 shutdown_connections 2023-11-29T11:15:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 --2- 172.21.15.81:0/2917954812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda40ceef0 0x7fdda406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 --2- 172.21.15.81:0/2917954812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda4069c40 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- 172.21.15.81:0/2917954812 >> 172.21.15.81:0/2917954812 conn(0x7fdda40ce3e0 msgr2=0x7fdda40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- 172.21.15.81:0/2917954812 shutdown_connections 2023-11-29T11:15:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- 172.21.15.81:0/2917954812 wait complete. 2023-11-29T11:15:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 Processor -- start 2023-11-29T11:15:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- start start 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda41f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdda40ceef0 0x7fdda4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda41606b0 0x7fdda4071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda4152350 con 0x7fdda40c1ac0 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda41639f0 con 0x7fdda40ceef0 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda95bb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda4163710 con 0x7fdda41606b0 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda41f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda41f6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59724/0 (socket says 172.21.15.81:59724) 2023-11-29T11:15:54.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.522+0000 7fdda3fff700 1 -- 172.21.15.81:0/3398543967 learned_addr learned my addr 172.21.15.81:0/3398543967 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda37fe700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdda40ceef0 0x7fdda4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda8dba700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda41606b0 0x7fdda4071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda3fff700 1 -- 172.21.15.81:0/3398543967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda41606b0 msgr2=0x7fdda4071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda3fff700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda41606b0 0x7fdda4071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda3fff700 1 -- 172.21.15.81:0/3398543967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdda40ceef0 msgr2=0x7fdda4070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda3fff700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdda40ceef0 0x7fdda4070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda3fff700 1 -- 172.21.15.81:0/3398543967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd94009570 con 0x7fdda40c1ac0 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda3fff700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda41f6830 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00cc50 tx=0x7fdd8c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda0ff9700 1 -- 172.21.15.81:0/3398543967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00aad0 con 0x7fdda40c1ac0 2023-11-29T11:15:54.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda0ff9700 1 -- 172.21.15.81:0/3398543967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00ac30 con 0x7fdda40c1ac0 2023-11-29T11:15:54.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda40b36c0 con 0x7fdda40c1ac0 2023-11-29T11:15:54.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda0ff9700 1 -- 172.21.15.81:0/3398543967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c007070 con 0x7fdda40c1ac0 2023-11-29T11:15:54.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda40cb6f0 con 0x7fdda40c1ac0 2023-11-29T11:15:54.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40ad610 con 0x7fdda40c1ac0 2023-11-29T11:15:54.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda0ff9700 1 -- 172.21.15.81:0/3398543967 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd8c019030 con 0x7fdda40c1ac0 2023-11-29T11:15:54.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda0ff9700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda0ff9700 1 -- 172.21.15.81:0/3398543967 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdd8c081b40 con 0x7fdda40c1ac0 2023-11-29T11:15:54.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.526+0000 7fdda37fe700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.530+0000 7fdda37fe700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdda40c1eb0 tx=0x7fdd94008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.534+0000 7fdda0ff9700 1 -- 172.21.15.81:0/3398543967 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd8c04a400 con 0x7fdda40c1ac0 2023-11-29T11:15:54.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.694+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdda40ac810 con 0x7fdda40c1ac0 2023-11-29T11:15:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.698+0000 7fdda0ff9700 1 -- 172.21.15.81:0/3398543967 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18026 (secure 0 0 0) 0x7fdd8c017020 con 0x7fdda40c1ac0 2023-11-29T11:15:54.705 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:15:54.705 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:15:09.548834+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:15:07.147241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-29T11:15:07.541685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:15:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 msgr2=0x7fdd88067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdda40c1eb0 tx=0x7fdd94008030 comp rx=0 tx=0).stop 2023-11-29T11:15:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 msgr2=0x7fdda41f6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda41f6830 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00cc50 tx=0x7fdd8c00cf60 comp rx=0 tx=0).stop 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 shutdown_connections 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdda41606b0 0x7fdda4071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdda40ceef0 0x7fdda4070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 --2- 172.21.15.81:0/3398543967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdda40c1ac0 0x7fdda41f6830 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 >> 172.21.15.81:0/3398543967 conn(0x7fdda40ce3e0 msgr2=0x7fdda406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 shutdown_connections 2023-11-29T11:15:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.702+0000 7fdda95bb700 1 -- 172.21.15.81:0/3398543967 wait complete. 2023-11-29T11:15:54.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:15:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91bfff700 1 Processor -- start 2023-11-29T11:15:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91bfff700 1 -- start start 2023-11-29T11:15:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc91c0cf050 0x7fc91c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91bfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc91c0b4c10 0x7fc91c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c15c6d0 con 0x7fc91c06a530 2023-11-29T11:15:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c06a9d0 con 0x7fc91c0cf050 2023-11-29T11:15:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91bfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c06ac60 con 0x7fc91c0b4c10 2023-11-29T11:15:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc91c0cf050 0x7fc91c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc91c0cf050 0x7fc91c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59736/0 (socket says 172.21.15.81:59736) 2023-11-29T11:15:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91affd700 1 -- 172.21.15.81:0/2446786398 learned_addr learned my addr 172.21.15.81:0/2446786398 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91b7fe700 1 --2- 172.21.15.81:0/2446786398 >> v2:172.21.15.176:3300/0 conn(0x7fc91c0b4c10 0x7fc91c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91affd700 1 -- 172.21.15.81:0/2446786398 >> v2:172.21.15.176:3300/0 conn(0x7fc91c0b4c10 msgr2=0x7fc91c0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91affd700 1 --2- 172.21.15.81:0/2446786398 >> v2:172.21.15.176:3300/0 conn(0x7fc91c0b4c10 0x7fc91c0cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91affd700 1 -- 172.21.15.81:0/2446786398 >> v1:172.21.15.176:6789/0 conn(0x7fc91c06a530 legacy=0x7fc91c0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91affd700 1 -- 172.21.15.81:0/2446786398 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c06af40 con 0x7fc91c0cf050 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc91affd700 1 --2- 172.21.15.81:0/2446786398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c0cf050 0x7fc91c06d7d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc91c08c660 tx=0x7fc904009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e823873b487c084e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc919ffb700 1 -- 172.21.15.81:0/2446786398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400b8a0 con 0x7fc91c0cf050 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc919ffb700 1 -- 172.21.15.81:0/2446786398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90400ba00 con 0x7fc91c0cf050 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.822+0000 7fc919ffb700 1 -- 172.21.15.81:0/2446786398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400bd90 con 0x7fc91c0cf050 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 -- 172.21.15.81:0/2446786398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c0cf050 msgr2=0x7fc91c06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2446786398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c0cf050 0x7fc91c06d7d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc91c08c660 tx=0x7fc904009bf0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 -- 172.21.15.81:0/2446786398 shutdown_connections 2023-11-29T11:15:54.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2446786398 >> v2:172.21.15.176:3300/0 conn(0x7fc91c0b4c10 0x7fc91c0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2446786398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c0cf050 0x7fc91c06d7d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 -- 172.21.15.81:0/2446786398 >> 172.21.15.81:0/2446786398 conn(0x7fc91c09bb30 msgr2=0x7fc91c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:54.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 -- 172.21.15.81:0/2446786398 shutdown_connections 2023-11-29T11:15:54.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 -- 172.21.15.81:0/2446786398 wait complete. 2023-11-29T11:15:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 Processor -- start 2023-11-29T11:15:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.826+0000 7fc91bfff700 1 -- start start 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c06a530 0x7fc91c1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91c0b4c10 0x7fc91c09fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91c0cf050 0x7fc91c15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0d1f90 con 0x7fc91c06a530 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0d2b10 con 0x7fc91c0b4c10 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0d21e0 con 0x7fc91c0cf050 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c06a530 0x7fc91c1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c06a530 0x7fc91c1558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59742/0 (socket says 172.21.15.81:59742) 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 -- 172.21.15.81:0/2773595954 learned_addr learned my addr 172.21.15.81:0/2773595954 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91a7fc700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91c0b4c10 0x7fc91c09fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91b7fe700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91c0cf050 0x7fc91c15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 -- 172.21.15.81:0/2773595954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91c0cf050 msgr2=0x7fc91c15e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91c0cf050 0x7fc91c15e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 -- 172.21.15.81:0/2773595954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91c0b4c10 msgr2=0x7fc91c09fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91c0b4c10 0x7fc91c09fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 -- 172.21.15.81:0/2773595954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc904009570 con 0x7fc91c06a530 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91affd700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c06a530 0x7fc91c1558e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc90400b0e0 tx=0x7fc904004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc913fff700 1 -- 172.21.15.81:0/2773595954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9040036c0 con 0x7fc91c06a530 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc913fff700 1 -- 172.21.15.81:0/2773595954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90401f070 con 0x7fc91c06a530 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c0b46f0 con 0x7fc91c06a530 2023-11-29T11:15:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc913fff700 1 -- 172.21.15.81:0/2773595954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904003a80 con 0x7fc91c06a530 2023-11-29T11:15:54.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c0b4410 con 0x7fc91c06a530 2023-11-29T11:15:54.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.830+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c06b220 con 0x7fc91c06a530 2023-11-29T11:15:54.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.834+0000 7fc913fff700 1 -- 172.21.15.81:0/2773595954 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc90402a020 con 0x7fc91c06a530 2023-11-29T11:15:54.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.834+0000 7fc913fff700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8fc064ee0 0x7fc8fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:54.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.834+0000 7fc91a7fc700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8fc064ee0 0x7fc8fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:54.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.834+0000 7fc913fff700 1 -- 172.21.15.81:0/2773595954 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc904083770 con 0x7fc91c06a530 2023-11-29T11:15:54.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.834+0000 7fc91a7fc700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8fc064ee0 0x7fc8fc067390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0b08a0 tx=0x7fc90c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:54.842+0000 7fc913fff700 1 -- 172.21.15.81:0/2773595954 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc904051800 con 0x7fc91c06a530 2023-11-29T11:15:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:55.038+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc91c072500 con 0x7fc91c06a530 2023-11-29T11:15:56.010 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:15:56.006+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:15:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.014+0000 7fc913fff700 1 -- 172.21.15.81:0/2773595954 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc904054e20 con 0x7fc91c06a530 2023-11-29T11:15:56.024 INFO:tasks.ceph.mds.c.smithi081.stderr: -4437> 2023-11-29T11:15:14.483+0000 7ffa9460e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:15:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8fc064ee0 msgr2=0x7fc8fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8fc064ee0 0x7fc8fc067390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0b08a0 tx=0x7fc90c009040 comp rx=0 tx=0).stop 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c06a530 msgr2=0x7fc91c1558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c06a530 0x7fc91c1558e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc90400b0e0 tx=0x7fc904004770 comp rx=0 tx=0).stop 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 shutdown_connections 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8fc064ee0 0x7fc8fc067390 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91c0cf050 0x7fc91c15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91c0b4c10 0x7fc91c09fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 --2- 172.21.15.81:0/2773595954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc91c06a530 0x7fc91c1558e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 >> 172.21.15.81:0/2773595954 conn(0x7fc91c09bb30 msgr2=0x7fc91c06cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 shutdown_connections 2023-11-29T11:15:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.018+0000 7fc91bfff700 1 -- 172.21.15.81:0/2773595954 wait complete. 2023-11-29T11:15:56.026 INFO:tasks.ceph.mds.c.smithi081.stderr: -2967> 2023-11-29T11:15:17.683+0000 7ffa90e07700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6273=0-4194304@1} caps={6273=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6273 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x558a354ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-29T11:15:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:15:56.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T11:15:56.058 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:15:56.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:15:56.084 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:15:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 Processor -- start 2023-11-29T11:15:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- start start 2023-11-29T11:15:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff1fc15a440 0x7ff1fc0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15de30 0x7ff1fc0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc0cd520 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc0b10b0 con 0x7ff1fc15a440 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0cd800 con 0x7ff1fc15de30 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff201630700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1fc0b0c30 0x7ff1fc0b1ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33896/0 (socket says 172.21.15.81:33896) 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff201630700 1 -- 172.21.15.81:0/4030585189 learned_addr learned my addr 172.21.15.81:0/4030585189 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff200e2f700 1 --2- 172.21.15.81:0/4030585189 >> v2:172.21.15.176:3300/0 conn(0x7ff1fc15a440 0x7ff1fc0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff1fbfff700 1 --2- 172.21.15.81:0/4030585189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15de30 0x7ff1fc0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff1fb7fe700 1 -- 172.21.15.81:0/4030585189 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859162241 0 0) 0x7ff1fc0cd520 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff1fb7fe700 1 -- 172.21.15.81:0/4030585189 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1ec0035d0 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff200e2f700 1 -- 172.21.15.81:0/4030585189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15de30 msgr2=0x7ff1fc0b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff200e2f700 1 --2- 172.21.15.81:0/4030585189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15de30 0x7ff1fc0b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff200e2f700 1 -- 172.21.15.81:0/4030585189 >> v1:172.21.15.81:6789/0 conn(0x7ff1fc0b0c30 legacy=0x7ff1fc0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff200e2f700 1 -- 172.21.15.81:0/4030585189 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0cdae0 con 0x7ff1fc15a440 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff200e2f700 1 --2- 172.21.15.81:0/4030585189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15a440 0x7ff1fc0b43a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009850 tx=0x7ff1f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8853476f05a2ca77 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff1fb7fe700 1 -- 172.21.15.81:0/4030585189 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0011830 con 0x7ff1fc15a440 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff1fb7fe700 1 -- 172.21.15.81:0/4030585189 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f0011990 con 0x7ff1fc15a440 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff1fb7fe700 1 -- 172.21.15.81:0/4030585189 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0011d00 con 0x7ff1fc15a440 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- 172.21.15.81:0/4030585189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15a440 msgr2=0x7ff1fc0b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 --2- 172.21.15.81:0/4030585189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15a440 0x7ff1fc0b43a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009850 tx=0x7ff1f0009b60 comp rx=0 tx=0).stop 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- 172.21.15.81:0/4030585189 shutdown_connections 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 --2- 172.21.15.81:0/4030585189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15de30 0x7ff1fc0b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 --2- 172.21.15.81:0/4030585189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15a440 0x7ff1fc0b43a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- 172.21.15.81:0/4030585189 >> 172.21.15.81:0/4030585189 conn(0x7ff1fc0cf4a0 msgr2=0x7ff1fc0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- 172.21.15.81:0/4030585189 shutdown_connections 2023-11-29T11:15:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.150+0000 7ff203093700 1 -- 172.21.15.81:0/4030585189 wait complete. 2023-11-29T11:15:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff203093700 1 Processor -- start 2023-11-29T11:15:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff203093700 1 -- start start 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff203093700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc0b0c30 0x7ff1fc0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff203093700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15a440 0x7ff1fc0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff203093700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15de30 0x7ff1fc15cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff203093700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc1f5310 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff203093700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0c8820 con 0x7ff1fc15de30 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff203093700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc1f5560 con 0x7ff1fc15a440 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc0b0c30 0x7ff1fc0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc0b0c30 0x7ff1fc0afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59762/0 (socket says 172.21.15.81:59762) 2023-11-29T11:15:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 -- 172.21.15.81:0/171018391 learned_addr learned my addr 172.21.15.81:0/171018391 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff201630700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15de30 0x7ff1fc15cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff1fbfff700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15a440 0x7ff1fc0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 -- 172.21.15.81:0/171018391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15a440 msgr2=0x7ff1fc0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15a440 0x7ff1fc0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 -- 172.21.15.81:0/171018391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15de30 msgr2=0x7ff1fc15cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15de30 0x7ff1fc15cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 -- 172.21.15.81:0/171018391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00094b0 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.154+0000 7ff200e2f700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc0b0c30 0x7ff1fc0afdd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00090b0 tx=0x7ff1f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff1f97fa700 1 -- 172.21.15.81:0/171018391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0004450 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff1f97fa700 1 -- 172.21.15.81:0/171018391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f001e070 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc0ce0a0 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff1f97fa700 1 -- 172.21.15.81:0/171018391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0003900 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc0cddc0 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc0cd1f0 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff1f97fa700 1 -- 172.21.15.81:0/171018391 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff1f000f050 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff1f97fa700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1e0064ee0 0x7ff1e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff1fbfff700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1e0064ee0 0x7ff1e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.158+0000 7ff1f97fa700 1 -- 172.21.15.81:0/171018391 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6468+0+0 (secure 0 0 0) 0x7ff1f0082fc0 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.162+0000 7ff1fbfff700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1e0064ee0 0x7ff1e0067390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc1556f0 tx=0x7ff1e8009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:56.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.170+0000 7ff1f97fa700 1 -- 172.21.15.81:0/171018391 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff1f0050f40 con 0x7ff1fc0b0c30 2023-11-29T11:15:56.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:56.366+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff1fc072500 con 0x7ff1fc0b0c30 2023-11-29T11:15:57.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.018+0000 7ff1f97fa700 1 -- 172.21.15.81:0/171018391 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff1f0054560 con 0x7ff1fc0b0c30 2023-11-29T11:15:57.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1e0064ee0 msgr2=0x7ff1e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:57.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1e0064ee0 0x7ff1e0067390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc1556f0 tx=0x7ff1e8009240 comp rx=0 tx=0).stop 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc0b0c30 msgr2=0x7ff1fc0afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc0b0c30 0x7ff1fc0afdd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00090b0 tx=0x7ff1f0004770 comp rx=0 tx=0).stop 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 shutdown_connections 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1e0064ee0 0x7ff1e0067390 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1fc15de30 0x7ff1fc15cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1fc15a440 0x7ff1fc0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 --2- 172.21.15.81:0/171018391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1fc0b0c30 0x7ff1fc0afdd0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 >> 172.21.15.81:0/171018391 conn(0x7ff1fc0cf4a0 msgr2=0x7ff1fc0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 shutdown_connections 2023-11-29T11:15:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.022+0000 7ff203093700 1 -- 172.21.15.81:0/171018391 wait complete. 2023-11-29T11:15:57.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T11:15:57.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ced373700 1 Processor -- start 2023-11-29T11:15:57.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ced373700 1 -- start start 2023-11-29T11:15:57.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ced373700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ce8158f10 0x7f0ce806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:57.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ced373700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ce80cb520 0x7f0ce8162b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ced373700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce80c9460 con 0x7f0ce80cd930 2023-11-29T11:15:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ced373700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce80c9fe0 con 0x7f0ce80cb520 2023-11-29T11:15:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ced373700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce806dc90 con 0x7f0ce8158f10 2023-11-29T11:15:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0cecb72700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ce80cb520 0x7f0ce8162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ce8158f10 0x7f0ce806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0cecb72700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ce80cb520 0x7f0ce8162b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59770/0 (socket says 172.21.15.81:59770) 2023-11-29T11:15:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0cecb72700 1 -- 172.21.15.81:0/1387869666 learned_addr learned my addr 172.21.15.81:0/1387869666 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce7fff700 1 -- 172.21.15.81:0/1387869666 >> v2:172.21.15.81:3300/0 conn(0x7f0ce80cb520 msgr2=0x7f0ce8162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce7fff700 1 --2- 172.21.15.81:0/1387869666 >> v2:172.21.15.81:3300/0 conn(0x7f0ce80cb520 0x7f0ce8162b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce7fff700 1 -- 172.21.15.81:0/1387869666 >> v1:172.21.15.176:6789/0 conn(0x7f0ce80cd930 legacy=0x7f0ce80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce6ffd700 1 -- 172.21.15.81:0/1387869666 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208800731 0 0) 0x7f0ce80c9460 con 0x7f0ce80cd930 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce7fff700 1 -- 172.21.15.81:0/1387869666 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80c96b0 con 0x7f0ce8158f10 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0cecb72700 1 --2- 172.21.15.81:0/1387869666 >> v2:172.21.15.81:3300/0 conn(0x7f0ce80cb520 0x7f0ce8162b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce7fff700 1 --2- 172.21.15.81:0/1387869666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 0x7f0ce806b250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ce806e420 tx=0x7f0cd0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5922125fb341d1c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce6ffd700 1 -- 172.21.15.81:0/1387869666 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011830 con 0x7f0ce8158f10 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce6ffd700 1 -- 172.21.15.81:0/1387869666 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0011990 con 0x7f0ce8158f10 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.162+0000 7f0ce6ffd700 1 -- 172.21.15.81:0/1387869666 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011d20 con 0x7f0ce8158f10 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- 172.21.15.81:0/1387869666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 msgr2=0x7f0ce806b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/1387869666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 0x7f0ce806b250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ce806e420 tx=0x7f0cd0009b30 comp rx=0 tx=0).stop 2023-11-29T11:15:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- 172.21.15.81:0/1387869666 shutdown_connections 2023-11-29T11:15:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/1387869666 >> v2:172.21.15.81:3300/0 conn(0x7f0ce80cb520 0x7f0ce8162b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/1387869666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 0x7f0ce806b250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- 172.21.15.81:0/1387869666 >> 172.21.15.81:0/1387869666 conn(0x7f0ce80ce400 msgr2=0x7f0ce80ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- 172.21.15.81:0/1387869666 shutdown_connections 2023-11-29T11:15:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- 172.21.15.81:0/1387869666 wait complete. 2023-11-29T11:15:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 Processor -- start 2023-11-29T11:15:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- start start 2023-11-29T11:15:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ce80cb520 0x7f0ce8071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80cd930 0x7f0ce80add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 0x7f0ce80ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8159620 con 0x7f0ce80cb520 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8070bf0 con 0x7f0ce8158f10 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ced373700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8070ed0 con 0x7f0ce80cd930 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ce7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ce80cb520 0x7f0ce8071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ce7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ce80cb520 0x7f0ce8071c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59774/0 (socket says 172.21.15.81:59774) 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ce7fff700 1 -- 172.21.15.81:0/4028308212 learned_addr learned my addr 172.21.15.81:0/4028308212 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0cecb72700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 0x7f0ce80ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.166+0000 7f0ce77fe700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80cd930 0x7f0ce80add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce7fff700 1 -- 172.21.15.81:0/4028308212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80cd930 msgr2=0x7f0ce80add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce7fff700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80cd930 0x7f0ce80add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce7fff700 1 -- 172.21.15.81:0/4028308212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 msgr2=0x7f0ce80ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce7fff700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 0x7f0ce80ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce7fff700 1 -- 172.21.15.81:0/4028308212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0009570 con 0x7f0ce80cb520 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce7fff700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ce80cb520 0x7f0ce8071c50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0014040 tx=0x7f0cd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce4ff9700 1 -- 172.21.15.81:0/4028308212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0004610 con 0x7f0ce80cb520 2023-11-29T11:15:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce4ff9700 1 -- 172.21.15.81:0/4028308212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd001e070 con 0x7f0ce80cb520 2023-11-29T11:15:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd00094b0 con 0x7f0ce80cb520 2023-11-29T11:15:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce4ff9700 1 -- 172.21.15.81:0/4028308212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00038e0 con 0x7f0ce80cb520 2023-11-29T11:15:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce80c9c70 con 0x7f0ce80cb520 2023-11-29T11:15:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce80c9990 con 0x7f0ce80cb520 2023-11-29T11:15:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce4ff9700 1 -- 172.21.15.81:0/4028308212 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0cd000f050 con 0x7f0ce80cb520 2023-11-29T11:15:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.170+0000 7f0ce4ff9700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cc8064ee0 0x7f0cc8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.174+0000 7f0ce77fe700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cc8064ee0 0x7f0cc8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.174+0000 7f0ce4ff9700 1 -- 172.21.15.81:0/4028308212 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f0cd0082e50 con 0x7f0ce80cb520 2023-11-29T11:15:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.174+0000 7f0ce77fe700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cc8064ee0 0x7f0cc8067390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ce81f4de0 tx=0x7f0cd8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.178+0000 7f0ce4ff9700 1 -- 172.21.15.81:0/4028308212 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0cd0050e50 con 0x7f0ce80cb520 2023-11-29T11:15:57.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:57.342+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ce81592e0 con 0x7f0ce80cb520 2023-11-29T11:15:58.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.158+0000 7f0ce4ff9700 1 -- 172.21.15.81:0/4028308212 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0cd00200d0 con 0x7f0ce80cb520 2023-11-29T11:15:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cc8064ee0 msgr2=0x7f0cc8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cc8064ee0 0x7f0cc8067390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ce81f4de0 tx=0x7f0cd8009040 comp rx=0 tx=0).stop 2023-11-29T11:15:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ce80cb520 msgr2=0x7f0ce8071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ce80cb520 0x7f0ce8071c50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0014040 tx=0x7f0cd0004770 comp rx=0 tx=0).stop 2023-11-29T11:15:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 shutdown_connections 2023-11-29T11:15:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cc8064ee0 0x7f0cc8067390 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ce8158f10 0x7f0ce80ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ce80cd930 0x7f0ce80add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 --2- 172.21.15.81:0/4028308212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ce80cb520 0x7f0ce8071c50 secure :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0014040 tx=0x7f0cd0004770 comp rx=0 tx=0).stop 2023-11-29T11:15:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 >> 172.21.15.81:0/4028308212 conn(0x7f0ce80ce400 msgr2=0x7f0ce80ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 shutdown_connections 2023-11-29T11:15:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.166+0000 7f0ced373700 1 -- 172.21.15.81:0/4028308212 wait complete. 2023-11-29T11:15:58.175 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-11-29T11:15:58.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T11:15:58.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35ffff700 1 Processor -- start 2023-11-29T11:15:58.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35ffff700 1 -- start start 2023-11-29T11:15:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb36015a110 0x7fb36015e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb360069c40 0x7fb3600cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb3600b1c90 0x7fb3600cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3600cb470 con 0x7fb36015a110 2023-11-29T11:15:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36015ebf0 con 0x7fb3600b1c90 2023-11-29T11:15:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36006bdf0 con 0x7fb360069c40 2023-11-29T11:15:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb36015a110 0x7fb36015e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:58.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb36015a110 0x7fb36015e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59778/0 (socket says 172.21.15.81:59778) 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 -- 172.21.15.81:0/2056700583 learned_addr learned my addr 172.21.15.81:0/2056700583 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35f7fe700 1 --2- 172.21.15.81:0/2056700583 >> v2:172.21.15.176:3300/0 conn(0x7fb3600b1c90 0x7fb3600cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35e7fc700 1 --2- 172.21.15.81:0/2056700583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb360069c40 0x7fb3600cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 -- 172.21.15.81:0/2056700583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb360069c40 msgr2=0x7fb3600cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 --2- 172.21.15.81:0/2056700583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb360069c40 0x7fb3600cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 -- 172.21.15.81:0/2056700583 >> v2:172.21.15.176:3300/0 conn(0x7fb3600b1c90 msgr2=0x7fb3600cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 --2- 172.21.15.81:0/2056700583 >> v2:172.21.15.176:3300/0 conn(0x7fb3600b1c90 0x7fb3600cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 -- 172.21.15.81:0/2056700583 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36015a4e0 con 0x7fb36015a110 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.298+0000 7fb35effd700 1 --2- 172.21.15.81:0/2056700583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36015a110 0x7fb36015e6b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb3600c28e0 tx=0x7fb350009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45deef7147334c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35dffb700 1 -- 172.21.15.81:0/2056700583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350011830 con 0x7fb36015a110 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35dffb700 1 -- 172.21.15.81:0/2056700583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb350011990 con 0x7fb36015a110 2023-11-29T11:15:58.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35dffb700 1 -- 172.21.15.81:0/2056700583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350011d20 con 0x7fb36015a110 2023-11-29T11:15:58.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 -- 172.21.15.81:0/2056700583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36015a110 msgr2=0x7fb36015e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:58.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 --2- 172.21.15.81:0/2056700583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36015a110 0x7fb36015e6b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb3600c28e0 tx=0x7fb350009bf0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 -- 172.21.15.81:0/2056700583 shutdown_connections 2023-11-29T11:15:58.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 --2- 172.21.15.81:0/2056700583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb360069c40 0x7fb3600cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 --2- 172.21.15.81:0/2056700583 >> v2:172.21.15.176:3300/0 conn(0x7fb3600b1c90 0x7fb3600cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 --2- 172.21.15.81:0/2056700583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb36015a110 0x7fb36015e6b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 -- 172.21.15.81:0/2056700583 >> 172.21.15.81:0/2056700583 conn(0x7fb36006c6b0 msgr2=0x7fb36006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:58.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 -- 172.21.15.81:0/2056700583 shutdown_connections 2023-11-29T11:15:58.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 -- 172.21.15.81:0/2056700583 wait complete. 2023-11-29T11:15:58.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 Processor -- start 2023-11-29T11:15:58.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.302+0000 7fb35ffff700 1 -- start start 2023-11-29T11:15:58.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb360069c40 0x7fb360149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:58.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3600b1c90 0x7fb3600a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:58.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36015a110 0x7fb360149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:58.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb360149a90 con 0x7fb360069c40 2023-11-29T11:15:58.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb360146b50 con 0x7fb3600b1c90 2023-11-29T11:15:58.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb360146e30 con 0x7fb36015a110 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb360069c40 0x7fb360149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb360069c40 0x7fb360149fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59792/0 (socket says 172.21.15.81:59792) 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 -- 172.21.15.81:0/3027118106 learned_addr learned my addr 172.21.15.81:0/3027118106 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35e7fc700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3600b1c90 0x7fb3600a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35f7fe700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36015a110 0x7fb360149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 -- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36015a110 msgr2=0x7fb360149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36015a110 0x7fb360149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 -- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3600b1c90 msgr2=0x7fb3600a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3600b1c90 0x7fb3600a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 -- 172.21.15.81:0/3027118106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350009570 con 0x7fb360069c40 2023-11-29T11:15:58.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35e7fc700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3600b1c90 0x7fb3600a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:58.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35effd700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb360069c40 0x7fb360149fa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb3600cc9e0 tx=0x7fb350004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:58.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb3477fe700 1 -- 172.21.15.81:0/3027118106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350004240 con 0x7fb360069c40 2023-11-29T11:15:58.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb3477fe700 1 -- 172.21.15.81:0/3027118106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35001f070 con 0x7fb360069c40 2023-11-29T11:15:58.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36006bb10 con 0x7fb360069c40 2023-11-29T11:15:58.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb3477fe700 1 -- 172.21.15.81:0/3027118106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350004600 con 0x7fb360069c40 2023-11-29T11:15:58.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.306+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36006a0d0 con 0x7fb360069c40 2023-11-29T11:15:58.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.310+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3600caee0 con 0x7fb360069c40 2023-11-29T11:15:58.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.310+0000 7fb3477fe700 1 -- 172.21.15.81:0/3027118106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb35000f050 con 0x7fb360069c40 2023-11-29T11:15:58.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.310+0000 7fb3477fe700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb34c064ee0 0x7fb34c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:58.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.310+0000 7fb3477fe700 1 -- 172.21.15.81:0/3027118106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6030+0+0 (secure 0 0 0) 0x7fb350082f50 con 0x7fb360069c40 2023-11-29T11:15:58.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.310+0000 7fb35e7fc700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb34c064ee0 0x7fb34c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:58.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.310+0000 7fb35e7fc700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb34c064ee0 0x7fb34c067390 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb3600a8b40 tx=0x7fb354009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:58.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.318+0000 7fb3477fe700 1 -- 172.21.15.81:0/3027118106 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb3500b3400 con 0x7fb360069c40 2023-11-29T11:15:58.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:58.482+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3600676e0 con 0x7fb360069c40 2023-11-29T11:15:59.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.178+0000 7fb3477fe700 1 -- 172.21.15.81:0/3027118106 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb3500150d0 con 0x7fb360069c40 2023-11-29T11:15:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb34c064ee0 msgr2=0x7fb34c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb34c064ee0 0x7fb34c067390 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb3600a8b40 tx=0x7fb354009240 comp rx=0 tx=0).stop 2023-11-29T11:15:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb360069c40 msgr2=0x7fb360149fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb360069c40 0x7fb360149fa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb3600cc9e0 tx=0x7fb350004770 comp rx=0 tx=0).stop 2023-11-29T11:15:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 shutdown_connections 2023-11-29T11:15:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb34c064ee0 0x7fb34c067390 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb36015a110 0x7fb360149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3600b1c90 0x7fb3600a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 --2- 172.21.15.81:0/3027118106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb360069c40 0x7fb360149fa0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 >> 172.21.15.81:0/3027118106 conn(0x7fb36006c6b0 msgr2=0x7fb3600c65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 shutdown_connections 2023-11-29T11:15:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.186+0000 7fb35ffff700 1 -- 172.21.15.81:0/3027118106 wait complete. 2023-11-29T11:15:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-11-29T11:15:59.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-29T11:15:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.314+0000 7f87f6a3f700 1 Processor -- start 2023-11-29T11:15:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.314+0000 7f87f6a3f700 1 -- start start 2023-11-29T11:15:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f006a4c0 0x7f87f006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87f00cf0e0 0x7f87f00cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f00cfa80 con 0x7f87f00b1ae0 2023-11-29T11:15:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f00d0ab0 con 0x7f87f00cf0e0 2023-11-29T11:15:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f006a9c0 con 0x7f87f006a4c0 2023-11-29T11:15:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f623e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87f00cf0e0 0x7f87f00cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f623e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87f00cf0e0 0x7f87f00cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59794/0 (socket says 172.21.15.81:59794) 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f623e700 1 -- 172.21.15.81:0/1256225703 learned_addr learned my addr 172.21.15.81:0/1256225703 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f523c700 1 --2- 172.21.15.81:0/1256225703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f006a4c0 0x7f87f006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f623e700 1 -- 172.21.15.81:0/1256225703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f006a4c0 msgr2=0x7f87f006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f623e700 1 --2- 172.21.15.81:0/1256225703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f006a4c0 0x7f87f006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f623e700 1 -- 172.21.15.81:0/1256225703 >> v1:172.21.15.81:6789/0 conn(0x7f87f00b1ae0 legacy=0x7f87f00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f623e700 1 -- 172.21.15.81:0/1256225703 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f006aca0 con 0x7f87f00cf0e0 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f623e700 1 --2- 172.21.15.81:0/1256225703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f00cf0e0 0x7f87f00cf540 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009e50 tx=0x7f87e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad7eaf17fa751bf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f4a3b700 1 -- 172.21.15.81:0/1256225703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800e070 con 0x7f87f00cf0e0 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f4a3b700 1 -- 172.21.15.81:0/1256225703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e800b9c0 con 0x7f87f00cf0e0 2023-11-29T11:15:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f4a3b700 1 -- 172.21.15.81:0/1256225703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800bd70 con 0x7f87f00cf0e0 2023-11-29T11:15:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 -- 172.21.15.81:0/1256225703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f00cf0e0 msgr2=0x7f87f00cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/1256225703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f00cf0e0 0x7f87f00cf540 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009e50 tx=0x7f87e800b330 comp rx=0 tx=0).stop 2023-11-29T11:15:59.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 -- 172.21.15.81:0/1256225703 shutdown_connections 2023-11-29T11:15:59.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/1256225703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f00cf0e0 0x7f87f00cf540 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/1256225703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f006a4c0 0x7f87f006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 -- 172.21.15.81:0/1256225703 >> 172.21.15.81:0/1256225703 conn(0x7f87f009bbd0 msgr2=0x7f87f00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:59.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 -- 172.21.15.81:0/1256225703 shutdown_connections 2023-11-29T11:15:59.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.318+0000 7f87f6a3f700 1 -- 172.21.15.81:0/1256225703 wait complete. 2023-11-29T11:15:59.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f6a3f700 1 Processor -- start 2023-11-29T11:15:59.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f6a3f700 1 -- start start 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f6a3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f006a4c0 0x7f87f00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f6a3f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f00b1ae0 0x7f87f0159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f6a3f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00cf0e0 0x7f87f00c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f6a3f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f015f660 con 0x7f87f006a4c0 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f6a3f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f01f25e0 con 0x7f87f00b1ae0 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f6a3f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00c7170 con 0x7f87f00cf0e0 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f006a4c0 0x7f87f00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f006a4c0 0x7f87f00c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59800/0 (socket says 172.21.15.81:59800) 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 -- 172.21.15.81:0/3288581705 learned_addr learned my addr 172.21.15.81:0/3288581705 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:59.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f623e700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00cf0e0 0x7f87f00c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f523c700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f00b1ae0 0x7f87f0159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 -- 172.21.15.81:0/3288581705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00cf0e0 msgr2=0x7f87f00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00cf0e0 0x7f87f00c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 -- 172.21.15.81:0/3288581705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f00b1ae0 msgr2=0x7f87f0159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f00b1ae0 0x7f87f0159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 -- 172.21.15.81:0/3288581705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8009b30 con 0x7f87f006a4c0 2023-11-29T11:15:59.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.322+0000 7f87f5a3d700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f006a4c0 0x7f87f00c6b40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00c500 tx=0x7f87ec00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:59.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87e67fc700 1 -- 172.21.15.81:0/3288581705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0052d0 con 0x7f87f006a4c0 2023-11-29T11:15:59.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87e67fc700 1 -- 172.21.15.81:0/3288581705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec005430 con 0x7f87f006a4c0 2023-11-29T11:15:59.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f00b4380 con 0x7f87f006a4c0 2023-11-29T11:15:59.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87e67fc700 1 -- 172.21.15.81:0/3288581705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0055a0 con 0x7f87f006a4c0 2023-11-29T11:15:59.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f006af80 con 0x7f87f006a4c0 2023-11-29T11:15:59.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87e67fc700 1 -- 172.21.15.81:0/3288581705 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f87ec019030 con 0x7f87f006a4c0 2023-11-29T11:15:59.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f00b1eb0 con 0x7f87f006a4c0 2023-11-29T11:15:59.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87e67fc700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87d4064ee0 0x7f87d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87e67fc700 1 -- 172.21.15.81:0/3288581705 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f87ec080e10 con 0x7f87f006a4c0 2023-11-29T11:15:59.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87f523c700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87d4064ee0 0x7f87d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.326+0000 7f87f523c700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87d4064ee0 0x7f87d4067390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87f00af690 tx=0x7f87e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:59.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.334+0000 7f87e67fc700 1 -- 172.21.15.81:0/3288581705 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f87ec04a400 con 0x7f87f006a4c0 2023-11-29T11:15:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.494+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f87f0072500 con 0x7f87f006a4c0 2023-11-29T11:15:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.502+0000 7f87e67fc700 1 -- 172.21.15.81:0/3288581705 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f87ec04f160 con 0x7f87f006a4c0 2023-11-29T11:15:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87d4064ee0 msgr2=0x7f87d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87d4064ee0 0x7f87d4067390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87f00af690 tx=0x7f87e0008040 comp rx=0 tx=0).stop 2023-11-29T11:15:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f006a4c0 msgr2=0x7f87f00c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f006a4c0 0x7f87f00c6b40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00c500 tx=0x7f87ec00c810 comp rx=0 tx=0).stop 2023-11-29T11:15:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 shutdown_connections 2023-11-29T11:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87d4064ee0 0x7f87d4067390 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00cf0e0 0x7f87f00c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f00b1ae0 0x7f87f0159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 --2- 172.21.15.81:0/3288581705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f006a4c0 0x7f87f00c6b40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 >> 172.21.15.81:0/3288581705 conn(0x7f87f009bbd0 msgr2=0x7f87f00d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 shutdown_connections 2023-11-29T11:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.506+0000 7f87f6a3f700 1 -- 172.21.15.81:0/3288581705 wait complete. 2023-11-29T11:15:59.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-29T11:15:59.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 Processor -- start 2023-11-29T11:15:59.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- start start 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00b32e0 0x7f01a00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f01a00cae10 0x7f01a0163090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a00cbe00 con 0x7f01a01584c0 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a006dbd0 con 0x7f01a00cae10 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00b3c30 con 0x7f01a00b32e0 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f01a01584c0 0x7f01a00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33916/0 (socket says 172.21.15.81:33916) 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019effd700 1 -- 172.21.15.81:0/2534212946 learned_addr learned my addr 172.21.15.81:0/2534212946 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019f7fe700 1 --2- 172.21.15.81:0/2534212946 >> v2:172.21.15.176:3300/0 conn(0x7f01a00cae10 0x7f01a0163090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f0197fff700 1 --2- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00b32e0 0x7f01a00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019e7fc700 1 -- 172.21.15.81:0/2534212946 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421227969 0 0) 0x7f01a00cbe00 con 0x7f01a01584c0 2023-11-29T11:15:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019e7fc700 1 -- 172.21.15.81:0/2534212946 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f018c0035d0 con 0x7f01a01584c0 2023-11-29T11:15:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019f7fe700 1 -- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00b32e0 msgr2=0x7f01a00b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:15:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019f7fe700 1 --2- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00b32e0 0x7f01a00b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019f7fe700 1 -- 172.21.15.81:0/2534212946 >> v1:172.21.15.81:6789/0 conn(0x7f01a01584c0 legacy=0x7f01a00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019f7fe700 1 -- 172.21.15.81:0/2534212946 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a00cd0f0 con 0x7f01a00cae10 2023-11-29T11:15:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f0197fff700 1 --2- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00b32e0 0x7f01a00b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:15:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019f7fe700 1 --2- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cae10 0x7f01a0163090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0198009d90 tx=0x7f019800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c227855e58c8206 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019e7fc700 1 -- 172.21.15.81:0/2534212946 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800e070 con 0x7f01a00cae10 2023-11-29T11:15:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019e7fc700 1 -- 172.21.15.81:0/2534212946 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800bb20 con 0x7f01a00cae10 2023-11-29T11:15:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019e7fc700 1 -- 172.21.15.81:0/2534212946 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800be90 con 0x7f01a00cae10 2023-11-29T11:15:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cae10 msgr2=0x7f01a0163090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 --2- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cae10 0x7f01a0163090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0198009d90 tx=0x7f019800b330 comp rx=0 tx=0).stop 2023-11-29T11:15:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- 172.21.15.81:0/2534212946 shutdown_connections 2023-11-29T11:15:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 --2- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cae10 0x7f01a0163090 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 --2- 172.21.15.81:0/2534212946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00b32e0 0x7f01a00b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- 172.21.15.81:0/2534212946 >> 172.21.15.81:0/2534212946 conn(0x7f01a00ce3e0 msgr2=0x7f01a00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:15:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- 172.21.15.81:0/2534212946 shutdown_connections 2023-11-29T11:15:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.634+0000 7f019ffff700 1 -- 172.21.15.81:0/2534212946 wait complete. 2023-11-29T11:15:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 Processor -- start 2023-11-29T11:15:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 -- start start 2023-11-29T11:15:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a00b32e0 0x7f01a0153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00cae10 0x7f01a01f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a01584c0 0x7f01a00c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c1a90 con 0x7f01a00b32e0 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c1d70 con 0x7f01a01584c0 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c2050 con 0x7f01a00cae10 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a00b32e0 0x7f01a0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f0197fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00cae10 0x7f01a01f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019f7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a01584c0 0x7f01a00c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a00b32e0 0x7f01a0153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59808/0 (socket says 172.21.15.81:59808) 2023-11-29T11:15:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 -- 172.21.15.81:0/4283542332 learned_addr learned my addr 172.21.15.81:0/4283542332 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:15:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 -- 172.21.15.81:0/4283542332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00cae10 msgr2=0x7f01a01f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00cae10 0x7f01a01f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 -- 172.21.15.81:0/4283542332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a01584c0 msgr2=0x7f01a00c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:15:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a01584c0 0x7f01a00c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:15:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 -- 172.21.15.81:0/4283542332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880094b0 con 0x7f01a00b32e0 2023-11-29T11:15:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019effd700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a00b32e0 0x7f01a0153860 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f019000c4d0 tx=0x7f019000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019cff9700 1 -- 172.21.15.81:0/4283542332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190005d90 con 0x7f01a00b32e0 2023-11-29T11:15:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019cff9700 1 -- 172.21.15.81:0/4283542332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000ce80 con 0x7f01a00b32e0 2023-11-29T11:15:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0198009a70 con 0x7f01a00b32e0 2023-11-29T11:15:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019cff9700 1 -- 172.21.15.81:0/4283542332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900072d0 con 0x7f01a00b32e0 2023-11-29T11:15:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.638+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a00cd6b0 con 0x7f01a00b32e0 2023-11-29T11:15:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.642+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a00cd3d0 con 0x7f01a00b32e0 2023-11-29T11:15:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.642+0000 7f019cff9700 1 -- 172.21.15.81:0/4283542332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0190019030 con 0x7f01a00b32e0 2023-11-29T11:15:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.642+0000 7f019cff9700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0180064ee0 0x7f0180067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:15:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.642+0000 7f019cff9700 1 -- 172.21.15.81:0/4283542332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0190080f30 con 0x7f01a00b32e0 2023-11-29T11:15:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.642+0000 7f0197fff700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0180064ee0 0x7f0180067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:15:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.646+0000 7f0197fff700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0180064ee0 0x7f0180067390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f01a01546f0 tx=0x7f0188009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:15:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.650+0000 7f019cff9700 1 -- 172.21.15.81:0/4283542332 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f019004a400 con 0x7f01a00b32e0 2023-11-29T11:15:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:15:59.866+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f01a00cd990 con 0x7f01a00b32e0 2023-11-29T11:16:00.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.170+0000 7f019cff9700 1 -- 172.21.15.81:0/4283542332 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v169) v1 ==== 149+0+0 (secure 0 0 0) 0x7f01900170d0 con 0x7f01a00b32e0 2023-11-29T11:16:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0180064ee0 msgr2=0x7f0180067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0180064ee0 0x7f0180067390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f01a01546f0 tx=0x7f0188009240 comp rx=0 tx=0).stop 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a00b32e0 msgr2=0x7f01a0153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a00b32e0 0x7f01a0153860 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f019000c4d0 tx=0x7f019000c7e0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 shutdown_connections 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0180064ee0 0x7f0180067390 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a01584c0 0x7f01a00c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a00cae10 0x7f01a01f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 --2- 172.21.15.81:0/4283542332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a00b32e0 0x7f01a0153860 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.174+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 >> 172.21.15.81:0/4283542332 conn(0x7f01a00ce3e0 msgr2=0x7f01a00c8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.178+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 shutdown_connections 2023-11-29T11:16:00.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.178+0000 7f019ffff700 1 -- 172.21.15.81:0/4283542332 wait complete. 2023-11-29T11:16:00.198 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-11-29T11:16:00.199 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-29T11:16:00.199 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:16:00.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-29T11:16:00.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c24800700 1 Processor -- start 2023-11-29T11:16:00.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c24800700 1 -- start start 2023-11-29T11:16:00.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c24800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c200cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:00.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c24800700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4c200cb2a0 0x7f4c200c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:00.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c24800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2006ace0 con 0x7f4c20159e70 2023-11-29T11:16:00.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c24800700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c200cb720 con 0x7f4c200cb2a0 2023-11-29T11:16:00.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c24800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2006a0d0 con 0x7f4c20069c40 2023-11-29T11:16:00.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c1f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4c20159e70 0x7f4c2006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37034/0 (socket says 172.21.15.81:37034) 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c1f7fe700 1 -- 172.21.15.81:0/1372393155 learned_addr learned my addr 172.21.15.81:0/1372393155 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c1ffff700 1 --2- 172.21.15.81:0/1372393155 >> v2:172.21.15.176:3300/0 conn(0x7f4c200cb2a0 0x7f4c200c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.314+0000 7f4c1effd700 1 --2- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c200cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1ffff700 1 -- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 msgr2=0x7f4c200cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1ffff700 1 --2- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c200cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1ffff700 1 -- 172.21.15.81:0/1372393155 >> v1:172.21.15.81:6789/0 conn(0x7f4c20159e70 legacy=0x7f4c2006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1ffff700 1 -- 172.21.15.81:0/1372393155 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2006a3b0 con 0x7f4c200cb2a0 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1effd700 1 --2- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c200cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:00.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1ffff700 1 --2- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c200cb2a0 0x7f4c200c91d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009d90 tx=0x7f4c1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e3105d5b050834 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1e7fc700 1 -- 172.21.15.81:0/1372393155 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800e070 con 0x7f4c200cb2a0 2023-11-29T11:16:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1e7fc700 1 -- 172.21.15.81:0/1372393155 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1800bb20 con 0x7f4c200cb2a0 2023-11-29T11:16:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c1e7fc700 1 -- 172.21.15.81:0/1372393155 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18012430 con 0x7f4c200cb2a0 2023-11-29T11:16:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c24800700 1 -- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c200cb2a0 msgr2=0x7f4c200c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c24800700 1 --2- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c200cb2a0 0x7f4c200c91d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009d90 tx=0x7f4c1800b330 comp rx=0 tx=0).stop 2023-11-29T11:16:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c24800700 1 -- 172.21.15.81:0/1372393155 shutdown_connections 2023-11-29T11:16:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c24800700 1 --2- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c200cb2a0 0x7f4c200c91d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c24800700 1 --2- 172.21.15.81:0/1372393155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c200cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c24800700 1 -- 172.21.15.81:0/1372393155 >> 172.21.15.81:0/1372393155 conn(0x7f4c200ce3e0 msgr2=0x7f4c200ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c24800700 1 -- 172.21.15.81:0/1372393155 shutdown_connections 2023-11-29T11:16:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.318+0000 7f4c24800700 1 -- 172.21.15.81:0/1372393155 wait complete. 2023-11-29T11:16:00.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c24800700 1 Processor -- start 2023-11-29T11:16:00.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c24800700 1 -- start start 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c24800700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c20097620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c24800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c200cb2a0 0x7f4c20070380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c24800700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c20159e70 0x7f4c200acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c24800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200720d0 con 0x7f4c200cb2a0 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c24800700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c20159350 con 0x7f4c20159e70 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c24800700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c20159630 con 0x7f4c20069c40 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c200cb2a0 0x7f4c20070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c200cb2a0 0x7f4c20070380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55026/0 (socket says 172.21.15.81:55026) 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1effd700 1 -- 172.21.15.81:0/3758900902 learned_addr learned my addr 172.21.15.81:0/3758900902 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1f7fe700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c20097620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:00.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1ffff700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c20159e70 0x7f4c200acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1effd700 1 -- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 msgr2=0x7f4c20097620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1effd700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c20097620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1effd700 1 -- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c20159e70 msgr2=0x7f4c200acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.322+0000 7f4c1effd700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c20159e70 0x7f4c200acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c1effd700 1 -- 172.21.15.81:0/3758900902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100094b0 con 0x7f4c200cb2a0 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c1ffff700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c20159e70 0x7f4c200acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c1effd700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c200cb2a0 0x7f4c20070380 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000ebe0 tx=0x7f4c1000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c17fff700 1 -- 172.21.15.81:0/3758900902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000c890 con 0x7f4c200cb2a0 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c18009a70 con 0x7f4c200cb2a0 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c17fff700 1 -- 172.21.15.81:0/3758900902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000c9f0 con 0x7f4c200cb2a0 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2006a970 con 0x7f4c200cb2a0 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c17fff700 1 -- 172.21.15.81:0/3758900902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000cd60 con 0x7f4c200cb2a0 2023-11-29T11:16:00.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2006a690 con 0x7f4c200cb2a0 2023-11-29T11:16:00.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.326+0000 7f4c17fff700 1 -- 172.21.15.81:0/3758900902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4c10019030 con 0x7f4c200cb2a0 2023-11-29T11:16:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.330+0000 7f4c17fff700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c00064ee0 0x7f4c00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.330+0000 7f4c17fff700 1 -- 172.21.15.81:0/3758900902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4c10081d60 con 0x7f4c200cb2a0 2023-11-29T11:16:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.330+0000 7f4c1f7fe700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c00064ee0 0x7f4c00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:00.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.330+0000 7f4c1f7fe700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c00064ee0 0x7f4c00067390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c08005930 tx=0x7f4c08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:00.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.334+0000 7f4c17fff700 1 -- 172.21.15.81:0/3758900902 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4c1004ffe0 con 0x7f4c200cb2a0 2023-11-29T11:16:00.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:00.558+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f4c2006b6d0 con 0x7f4c200cb2a0 2023-11-29T11:16:01.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.182+0000 7f4c17fff700 1 -- 172.21.15.81:0/3758900902 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v170) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4c10053600 con 0x7f4c200cb2a0 2023-11-29T11:16:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c00064ee0 msgr2=0x7f4c00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c00064ee0 0x7f4c00067390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c08005930 tx=0x7f4c08009040 comp rx=0 tx=0).stop 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c200cb2a0 msgr2=0x7f4c20070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c200cb2a0 0x7f4c20070380 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000ebe0 tx=0x7f4c1000eef0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 shutdown_connections 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c00064ee0 0x7f4c00067390 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c20159e70 0x7f4c200acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c200cb2a0 0x7f4c20070380 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 --2- 172.21.15.81:0/3758900902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c20069c40 0x7f4c20097620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 >> 172.21.15.81:0/3758900902 conn(0x7f4c200ce3e0 msgr2=0x7f4c20151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 shutdown_connections 2023-11-29T11:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.186+0000 7f4c24800700 1 -- 172.21.15.81:0/3758900902 wait complete. 2023-11-29T11:16:01.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-29T11:16:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a380e700 1 Processor -- start 2023-11-29T11:16:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a380e700 1 -- start start 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a380e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a380e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c0cd520 con 0x7f139c0b0e00 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a380e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c0cd800 con 0x7f139c15de30 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a380e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0cdae0 con 0x7f139c15a440 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a1dab700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f139c0b0e00 0x7f139c069f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37050/0 (socket says 172.21.15.81:37050) 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a1dab700 1 -- 172.21.15.81:0/3523622292 learned_addr learned my addr 172.21.15.81:0/3523622292 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a15aa700 1 --2- 172.21.15.81:0/3523622292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f138ffff700 1 -- 172.21.15.81:0/3523622292 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186711192 0 0) 0x7f139c0cd520 con 0x7f139c0b0e00 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f138ffff700 1 -- 172.21.15.81:0/3523622292 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13880035d0 con 0x7f139c0b0e00 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f138ffff700 1 -- 172.21.15.81:0/3523622292 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927895388 0 0) 0x7f139c0cd800 con 0x7f139c15de30 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f138ffff700 1 -- 172.21.15.81:0/3523622292 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f139c0cd520 con 0x7f139c15de30 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a15aa700 1 -- 172.21.15.81:0/3523622292 >> v1:172.21.15.176:6789/0 conn(0x7f139c15de30 legacy=0x7f139c0b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a15aa700 1 -- 172.21.15.81:0/3523622292 >> v1:172.21.15.81:6789/0 conn(0x7f139c0b0e00 legacy=0x7f139c069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a15aa700 1 -- 172.21.15.81:0/3523622292 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c0cddc0 con 0x7f139c15a440 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.326+0000 7f13a15aa700 1 --2- 172.21.15.81:0/3523622292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c0b43a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1390009880 tx=0x7f1390009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4587517557cdb8bc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f138ffff700 1 -- 172.21.15.81:0/3523622292 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390011830 con 0x7f139c15a440 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f138ffff700 1 -- 172.21.15.81:0/3523622292 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1390011990 con 0x7f139c15a440 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f138ffff700 1 -- 172.21.15.81:0/3523622292 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390011d00 con 0x7f139c15a440 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 -- 172.21.15.81:0/3523622292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 msgr2=0x7f139c0b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 --2- 172.21.15.81:0/3523622292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c0b43a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1390009880 tx=0x7f1390009b90 comp rx=0 tx=0).stop 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 -- 172.21.15.81:0/3523622292 shutdown_connections 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 --2- 172.21.15.81:0/3523622292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c0b43a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 -- 172.21.15.81:0/3523622292 >> 172.21.15.81:0/3523622292 conn(0x7f139c0cf4a0 msgr2=0x7f139c0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 -- 172.21.15.81:0/3523622292 shutdown_connections 2023-11-29T11:16:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 -- 172.21.15.81:0/3523622292 wait complete. 2023-11-29T11:16:01.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 Processor -- start 2023-11-29T11:16:01.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.330+0000 7f13a380e700 1 -- start start 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139c0b0e00 0x7f139c153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f139c15de30 0x7f139c0c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c15cb60 con 0x7f139c0b0e00 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c93a0 con 0x7f139c15de30 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0ca1c0 con 0x7f139c15a440 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139c0b0e00 0x7f139c153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139c0b0e00 0x7f139c153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55040/0 (socket says 172.21.15.81:55040) 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 -- 172.21.15.81:0/2090458269 learned_addr learned my addr 172.21.15.81:0/2090458269 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a1dab700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f139c15de30 0x7f139c0c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a0da9700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 -- 172.21.15.81:0/2090458269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 msgr2=0x7f139c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 -- 172.21.15.81:0/2090458269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f139c15de30 msgr2=0x7f139c0c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f139c15de30 0x7f139c0c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 -- 172.21.15.81:0/2090458269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13900094b0 con 0x7f139c0b0e00 2023-11-29T11:16:01.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a15aa700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139c0b0e00 0x7f139c153110 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1390013040 tx=0x7f1390004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:01.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f138dffb700 1 -- 172.21.15.81:0/2090458269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390004510 con 0x7f139c0b0e00 2023-11-29T11:16:01.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f138dffb700 1 -- 172.21.15.81:0/2090458269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13900036c0 con 0x7f139c0b0e00 2023-11-29T11:16:01.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f138dffb700 1 -- 172.21.15.81:0/2090458269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390003a70 con 0x7f139c0b0e00 2023-11-29T11:16:01.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c0cd1f0 con 0x7f139c0b0e00 2023-11-29T11:16:01.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c0ce0a0 con 0x7f139c0b0e00 2023-11-29T11:16:01.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.334+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c06a630 con 0x7f139c0b0e00 2023-11-29T11:16:01.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.338+0000 7f138dffb700 1 -- 172.21.15.81:0/2090458269 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f139000f050 con 0x7f139c0b0e00 2023-11-29T11:16:01.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.338+0000 7f138dffb700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1380064ee0 0x7f1380067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.338+0000 7f138dffb700 1 -- 172.21.15.81:0/2090458269 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1390083550 con 0x7f139c0b0e00 2023-11-29T11:16:01.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.338+0000 7f13a0da9700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1380064ee0 0x7f1380067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.338+0000 7f13a0da9700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1380064ee0 0x7f1380067390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f139c15c500 tx=0x7f1398009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:01.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.346+0000 7f138dffb700 1 -- 172.21.15.81:0/2090458269 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f13900518b0 con 0x7f139c0b0e00 2023-11-29T11:16:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.510+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f139c072500 con 0x7f139c0b0e00 2023-11-29T11:16:01.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.518+0000 7f138dffb700 1 -- 172.21.15.81:0/2090458269 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1390054ed0 con 0x7f139c0b0e00 2023-11-29T11:16:01.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1380064ee0 msgr2=0x7f1380067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1380064ee0 0x7f1380067390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f139c15c500 tx=0x7f1398009040 comp rx=0 tx=0).stop 2023-11-29T11:16:01.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139c0b0e00 msgr2=0x7f139c153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139c0b0e00 0x7f139c153110 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1390013040 tx=0x7f1390004770 comp rx=0 tx=0).stop 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 shutdown_connections 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1380064ee0 0x7f1380067390 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f139c15de30 0x7f139c0c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f139c15a440 0x7f139c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 --2- 172.21.15.81:0/2090458269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139c0b0e00 0x7f139c153110 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 >> 172.21.15.81:0/2090458269 conn(0x7f139c0cf4a0 msgr2=0x7f139c071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 shutdown_connections 2023-11-29T11:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.522+0000 7f13a380e700 1 -- 172.21.15.81:0/2090458269 wait complete. 2023-11-29T11:16:01.540 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:16:01.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:16:01.555 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:16:01.576 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:16:01.576 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:16:01.576 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:16:01.583 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:16:01.583 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:16:01.583 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:16:01.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:16:01.626 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:16:01.626 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:16:01.633 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:16:01.633 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:16:01.633 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:16:01.639 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:16:01.639 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-29T11:16:01.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:16:01.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f9372dad700 1 Processor -- start 2023-11-29T11:16:01.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f9372dad700 1 -- start start 2023-11-29T11:16:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f9372dad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 0x7f936c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f9372dad700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f936c069c40 0x7f936c0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f9372dad700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c06ace0 con 0x7f936c06cee0 2023-11-29T11:16:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f9372dad700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c06a0d0 con 0x7f936c069c40 2023-11-29T11:16:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f9372dad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c06a3b0 con 0x7f936c159e70 2023-11-29T11:16:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f9371dab700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 0x7f936c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f93715aa700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f936c069c40 0x7f936c0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f93715aa700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f936c069c40 0x7f936c0cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:57600/0 (socket says 172.21.15.81:57600) 2023-11-29T11:16:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.754+0000 7f93715aa700 1 -- 172.21.15.81:0/2724144717 learned_addr learned my addr 172.21.15.81:0/2724144717 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f93715aa700 1 -- 172.21.15.81:0/2724144717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 msgr2=0x7f936c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f93715aa700 1 --2- 172.21.15.81:0/2724144717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 0x7f936c06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f93715aa700 1 -- 172.21.15.81:0/2724144717 >> v1:172.21.15.176:6789/0 conn(0x7f936c06cee0 legacy=0x7f936c0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f93715aa700 1 -- 172.21.15.81:0/2724144717 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c06a690 con 0x7f936c069c40 2023-11-29T11:16:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f93715aa700 1 --2- 172.21.15.81:0/2724144717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c069c40 0x7f936c0cad60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9368009e50 tx=0x7f936800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3adb6b474b886e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9370da9700 1 -- 172.21.15.81:0/2724144717 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800e070 con 0x7f936c069c40 2023-11-29T11:16:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9370da9700 1 -- 172.21.15.81:0/2724144717 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800b910 con 0x7f936c069c40 2023-11-29T11:16:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9370da9700 1 -- 172.21.15.81:0/2724144717 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936800bcc0 con 0x7f936c069c40 2023-11-29T11:16:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 -- 172.21.15.81:0/2724144717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c069c40 msgr2=0x7f936c0cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 --2- 172.21.15.81:0/2724144717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c069c40 0x7f936c0cad60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9368009e50 tx=0x7f936800b330 comp rx=0 tx=0).stop 2023-11-29T11:16:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 -- 172.21.15.81:0/2724144717 shutdown_connections 2023-11-29T11:16:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 --2- 172.21.15.81:0/2724144717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c069c40 0x7f936c0cad60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 --2- 172.21.15.81:0/2724144717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 0x7f936c06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 -- 172.21.15.81:0/2724144717 >> 172.21.15.81:0/2724144717 conn(0x7f936c0ce3e0 msgr2=0x7f936c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 -- 172.21.15.81:0/2724144717 shutdown_connections 2023-11-29T11:16:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 -- 172.21.15.81:0/2724144717 wait complete. 2023-11-29T11:16:01.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 Processor -- start 2023-11-29T11:16:01.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.758+0000 7f9372dad700 1 -- start start 2023-11-29T11:16:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f936c069c40 0x7f936c0c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c06cee0 0x7f936c0acc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 0x7f936c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1f0aa0 con 0x7f936c069c40 2023-11-29T11:16:01.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0c4d70 con 0x7f936c06cee0 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1f0cf0 con 0x7f936c159e70 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9371dab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f936c069c40 0x7f936c0c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c06cee0 0x7f936c0acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c06cee0 0x7f936c0acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:57604/0 (socket says 172.21.15.81:57604) 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 -- 172.21.15.81:0/2755273202 learned_addr learned my addr 172.21.15.81:0/2755273202 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93725ac700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 0x7f936c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 -- 172.21.15.81:0/2755273202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 msgr2=0x7f936c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 0x7f936c0ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 -- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f936c069c40 msgr2=0x7f936c0c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f936c069c40 0x7f936c0c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 -- 172.21.15.81:0/2755273202 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9368009b30 con 0x7f936c06cee0 2023-11-29T11:16:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93715aa700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c06cee0 0x7f936c0acc60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f936800b370 tx=0x7f9368004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93627fc700 1 -- 172.21.15.81:0/2755273202 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680048c0 con 0x7f936c06cee0 2023-11-29T11:16:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936c15a240 con 0x7f936c06cee0 2023-11-29T11:16:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93627fc700 1 -- 172.21.15.81:0/2755273202 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93680099b0 con 0x7f936c06cee0 2023-11-29T11:16:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f93627fc700 1 -- 172.21.15.81:0/2755273202 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936801c680 con 0x7f936c06cee0 2023-11-29T11:16:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c06a970 con 0x7f936c06cee0 2023-11-29T11:16:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.762+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c0ca1e0 con 0x7f936c06cee0 2023-11-29T11:16:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.766+0000 7f93627fc700 1 -- 172.21.15.81:0/2755273202 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9368022030 con 0x7f936c06cee0 2023-11-29T11:16:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.766+0000 7f93627fc700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9350064f10 0x7f93500673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.766+0000 7f93627fc700 1 -- 172.21.15.81:0/2755273202 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9368083820 con 0x7f936c06cee0 2023-11-29T11:16:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.766+0000 7f9371dab700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9350064f10 0x7f93500673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.766+0000 7f9371dab700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9350064f10 0x7f93500673c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f935c015230 tx=0x7f935c00f040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:01.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.774+0000 7f93627fc700 1 -- 172.21.15.81:0/2755273202 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9368051b80 con 0x7f936c06cee0 2023-11-29T11:16:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.974+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f936c06fda0 con 0x7f936c06cee0 2023-11-29T11:16:01.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.974+0000 7f93627fc700 1 -- 172.21.15.81:0/2755273202 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f936c06fda0 con 0x7f936c06cee0 2023-11-29T11:16:01.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:01.980 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2023041882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2023041882},{"type":"v1","addr":"172.21.15.176:6833","nonce":2023041882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/825150211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":825150211},{"type":"v1","addr":"172.21.15.176:6835","nonce":825150211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/773233140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":773233140},{"type":"v1","addr":"172.21.15.81:6835","nonce":773233140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3979505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3979505948},{"type":"v1","addr":"172.21.15.81:6837","nonce":3979505948}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9350064f10 msgr2=0x7f93500673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9350064f10 0x7f93500673c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f935c015230 tx=0x7f935c00f040 comp rx=0 tx=0).stop 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c06cee0 msgr2=0x7f936c0acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c06cee0 0x7f936c0acc60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f936800b370 tx=0x7f9368004af0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 shutdown_connections 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9350064f10 0x7f93500673c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f936c159e70 0x7f936c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f936c06cee0 0x7f936c0acc60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 --2- 172.21.15.81:0/2755273202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f936c069c40 0x7f936c0c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 >> 172.21.15.81:0/2755273202 conn(0x7f936c0ce3e0 msgr2=0x7f936c0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 shutdown_connections 2023-11-29T11:16:01.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:01.978+0000 7f9372dad700 1 -- 172.21.15.81:0/2755273202 wait complete. 2023-11-29T11:16:01.985 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2023-11-29T11:16:01.995 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-29T11:16:01.995 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-29T11:16:01.995 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T11:16:01.995 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:16:01.996 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-29T11:16:01.996 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-29T11:16:01.996 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T11:16:01.996 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:16:01.996 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-29T11:16:01.996 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-29T11:16:01.996 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T11:16:01.996 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:16:01.996 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-29T11:16:01.997 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-29T11:16:01.997 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T11:16:01.997 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:16:02.006 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T11:16:02.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-29T11:16:02.008 INFO:tasks.ceph.mds.a:Started 2023-11-29T11:16:02.008 DEBUG:teuthology.parallel:result is None 2023-11-29T11:16:02.010 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T11:16:02.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-29T11:16:02.012 INFO:tasks.ceph.mds.c:Started 2023-11-29T11:16:02.012 DEBUG:teuthology.parallel:result is None 2023-11-29T11:16:02.014 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T11:16:02.014 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-29T11:16:02.015 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T11:16:02.015 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-29T11:16:02.056 INFO:tasks.ceph.mds.b:Started 2023-11-29T11:16:02.057 DEBUG:teuthology.parallel:result is None 2023-11-29T11:16:02.057 INFO:tasks.ceph.mds.d:Started 2023-11-29T11:16:02.057 DEBUG:teuthology.parallel:result is None 2023-11-29T11:16:02.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-29T11:16:02.083 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:16:02.087 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:16:02.141 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-29T11:16:02.145 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:16:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6caee9700 1 Processor -- start 2023-11-29T11:16:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6caee9700 1 -- start start 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6caee9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c415c300 0x7fe6c40adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6caee9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe6c406c640 0x7fe6c406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6caee9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c406b830 con 0x7fe6c40ae290 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6caee9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c406ad00 con 0x7fe6c406c640 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6caee9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c406d000 con 0x7fe6c415c300 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6c96e6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe6c40ae290 0x7fe6c406b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37074/0 (socket says 172.21.15.81:37074) 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6c96e6700 1 -- 172.21.15.81:0/790068127 learned_addr learned my addr 172.21.15.81:0/790068127 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6ca6e8700 1 --2- 172.21.15.81:0/790068127 >> v2:172.21.15.176:3300/0 conn(0x7fe6c406c640 0x7fe6c406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6c9ee7700 1 --2- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c415c300 0x7fe6c40adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.154+0000 7fe6c8ee5700 1 -- 172.21.15.81:0/790068127 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199200994 0 0) 0x7fe6c406b830 con 0x7fe6c40ae290 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6c8ee5700 1 -- 172.21.15.81:0/790068127 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b00035d0 con 0x7fe6c40ae290 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6ca6e8700 1 -- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c415c300 msgr2=0x7fe6c40adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6ca6e8700 1 --2- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c415c300 0x7fe6c40adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6ca6e8700 1 -- 172.21.15.81:0/790068127 >> v1:172.21.15.81:6789/0 conn(0x7fe6c40ae290 legacy=0x7fe6c406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6ca6e8700 1 -- 172.21.15.81:0/790068127 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c406a080 con 0x7fe6c406c640 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6c9ee7700 1 --2- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c415c300 0x7fe6c40adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6ca6e8700 1 --2- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 0x7fe6c406cac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009d90 tx=0x7fe6bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7f9c6221e9a0971 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6c8ee5700 1 -- 172.21.15.81:0/790068127 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00e070 con 0x7fe6c406c640 2023-11-29T11:16:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6c8ee5700 1 -- 172.21.15.81:0/790068127 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc00bb20 con 0x7fe6c406c640 2023-11-29T11:16:02.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6c8ee5700 1 -- 172.21.15.81:0/790068127 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc012430 con 0x7fe6c406c640 2023-11-29T11:16:02.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 -- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 msgr2=0x7fe6c406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:02.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 --2- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 0x7fe6c406cac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009d90 tx=0x7fe6bc00b330 comp rx=0 tx=0).stop 2023-11-29T11:16:02.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 -- 172.21.15.81:0/790068127 shutdown_connections 2023-11-29T11:16:02.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 --2- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 0x7fe6c406cac0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:02.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 --2- 172.21.15.81:0/790068127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c415c300 0x7fe6c40adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:02.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 -- 172.21.15.81:0/790068127 >> 172.21.15.81:0/790068127 conn(0x7fe6c406e000 msgr2=0x7fe6c40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:02.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 -- 172.21.15.81:0/790068127 shutdown_connections 2023-11-29T11:16:02.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 -- 172.21.15.81:0/790068127 wait complete. 2023-11-29T11:16:02.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 Processor -- start 2023-11-29T11:16:02.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.158+0000 7fe6caee9700 1 -- start start 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 0x7fe6c414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c40ae290 0x7fe6c40ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c415c300 0x7fe6c40aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c41fa200 con 0x7fe6c415c300 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c41f9630 con 0x7fe6c406c640 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c41f98d0 con 0x7fe6c40ae290 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c415c300 0x7fe6c40aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c415c300 0x7fe6c40aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55074/0 (socket says 172.21.15.81:55074) 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6c9ee7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 0x7fe6c414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 -- 172.21.15.81:0/1416965987 learned_addr learned my addr 172.21.15.81:0/1416965987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6c96e6700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c40ae290 0x7fe6c40ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 -- 172.21.15.81:0/1416965987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c40ae290 msgr2=0x7fe6c40ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c40ae290 0x7fe6c40ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 -- 172.21.15.81:0/1416965987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 msgr2=0x7fe6c414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 0x7fe6c414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 -- 172.21.15.81:0/1416965987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00094b0 con 0x7fe6c415c300 2023-11-29T11:16:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6c96e6700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c40ae290 0x7fe6c40ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ca6e8700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c415c300 0x7fe6c40aecb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc014040 tx=0x7fe6bc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ba7fc700 1 -- 172.21.15.81:0/1416965987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc012430 con 0x7fe6c415c300 2023-11-29T11:16:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ba7fc700 1 -- 172.21.15.81:0/1416965987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc020070 con 0x7fe6c415c300 2023-11-29T11:16:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6ba7fc700 1 -- 172.21.15.81:0/1416965987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc004280 con 0x7fe6c415c300 2023-11-29T11:16:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc009a70 con 0x7fe6c415c300 2023-11-29T11:16:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c406a640 con 0x7fe6c415c300 2023-11-29T11:16:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.162+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c406a360 con 0x7fe6c415c300 2023-11-29T11:16:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.166+0000 7fe6ba7fc700 1 -- 172.21.15.81:0/1416965987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe6bc02e070 con 0x7fe6c415c300 2023-11-29T11:16:02.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.166+0000 7fe6ba7fc700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6a8064f10 0x7fe6a80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:02.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.166+0000 7fe6ba7fc700 1 -- 172.21.15.81:0/1416965987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe6bc022070 con 0x7fe6c415c300 2023-11-29T11:16:02.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.166+0000 7fe6c9ee7700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6a8064f10 0x7fe6a80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:02.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.166+0000 7fe6c9ee7700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6a8064f10 0x7fe6a80673c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009d80 tx=0x7fe6c0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:02.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.170+0000 7fe6ba7fc700 1 -- 172.21.15.81:0/1416965987 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe6bc051be0 con 0x7fe6c415c300 2023-11-29T11:16:02.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:02.350+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe6c406a920 con 0x7fe6c415c300 2023-11-29T11:16:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.206+0000 7fe6ba7fc700 1 -- 172.21.15.81:0/1416965987 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe6bc02c080 con 0x7fe6c415c300 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6a8064f10 msgr2=0x7fe6a80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6a8064f10 0x7fe6a80673c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009d80 tx=0x7fe6c0009240 comp rx=0 tx=0).stop 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c415c300 msgr2=0x7fe6c40aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c415c300 0x7fe6c40aecb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc014040 tx=0x7fe6bc004af0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 shutdown_connections 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6a8064f10 0x7fe6a80673c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6c415c300 0x7fe6c40aecb0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c40ae290 0x7fe6c40ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 --2- 172.21.15.81:0/1416965987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6c406c640 0x7fe6c414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 >> 172.21.15.81:0/1416965987 conn(0x7fe6c406e000 msgr2=0x7fe6c4151090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 shutdown_connections 2023-11-29T11:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.210+0000 7fe6caee9700 1 -- 172.21.15.81:0/1416965987 wait complete. 2023-11-29T11:16:03.218 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-11-29T11:16:03.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-29T11:16:03.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.386+0000 7fa1c2240700 1 Processor -- start 2023-11-29T11:16:03.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.386+0000 7fa1c2240700 1 -- start start 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1bc0c1ac0 0x7fa1bc069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1bc0ceef0 0x7fa1bc06a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc0cae70 con 0x7fa1bc1606b0 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc0cbc10 con 0x7fa1bc0c1ac0 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc0cb130 con 0x7fa1bc0ceef0 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c0a3d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1bc0c1ac0 0x7fa1bc069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c0a3d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1bc0c1ac0 0x7fa1bc069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55086/0 (socket says 172.21.15.81:55086) 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c0a3d700 1 -- 172.21.15.81:0/1303579997 learned_addr learned my addr 172.21.15.81:0/1303579997 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c1a3f700 1 --2- 172.21.15.81:0/1303579997 >> v2:172.21.15.176:3300/0 conn(0x7fa1bc0ceef0 0x7fa1bc06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c0a3d700 1 -- 172.21.15.81:0/1303579997 >> v2:172.21.15.176:3300/0 conn(0x7fa1bc0ceef0 msgr2=0x7fa1bc06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c0a3d700 1 --2- 172.21.15.81:0/1303579997 >> v2:172.21.15.176:3300/0 conn(0x7fa1bc0ceef0 0x7fa1bc06a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c0a3d700 1 -- 172.21.15.81:0/1303579997 >> v1:172.21.15.176:6789/0 conn(0x7fa1bc1606b0 legacy=0x7fa1bc0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c0a3d700 1 -- 172.21.15.81:0/1303579997 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc0cb410 con 0x7fa1bc0c1ac0 2023-11-29T11:16:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c0a3d700 1 --2- 172.21.15.81:0/1303579997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc0c1ac0 0x7fa1bc069c40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc072100 tx=0x7fa1b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6028e24b379f758f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1b3fff700 1 -- 172.21.15.81:0/1303579997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800e070 con 0x7fa1bc0c1ac0 2023-11-29T11:16:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1b3fff700 1 -- 172.21.15.81:0/1303579997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b800b910 con 0x7fa1bc0c1ac0 2023-11-29T11:16:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1b3fff700 1 -- 172.21.15.81:0/1303579997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800bcc0 con 0x7fa1bc0c1ac0 2023-11-29T11:16:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 -- 172.21.15.81:0/1303579997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc0c1ac0 msgr2=0x7fa1bc069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 --2- 172.21.15.81:0/1303579997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc0c1ac0 0x7fa1bc069c40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc072100 tx=0x7fa1b800b330 comp rx=0 tx=0).stop 2023-11-29T11:16:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 -- 172.21.15.81:0/1303579997 shutdown_connections 2023-11-29T11:16:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 --2- 172.21.15.81:0/1303579997 >> v2:172.21.15.176:3300/0 conn(0x7fa1bc0ceef0 0x7fa1bc06a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 --2- 172.21.15.81:0/1303579997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc0c1ac0 0x7fa1bc069c40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 -- 172.21.15.81:0/1303579997 >> 172.21.15.81:0/1303579997 conn(0x7fa1bc0ce3e0 msgr2=0x7fa1bc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 -- 172.21.15.81:0/1303579997 shutdown_connections 2023-11-29T11:16:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.390+0000 7fa1c2240700 1 -- 172.21.15.81:0/1303579997 wait complete. 2023-11-29T11:16:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 Processor -- start 2023-11-29T11:16:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 -- start start 2023-11-29T11:16:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1bc0c1ac0 0x7fa1bc0abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1bc0ceef0 0x7fa1bc157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc1606b0 0x7fa1bc0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc15e3e0 con 0x7fa1bc1606b0 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc15e680 con 0x7fa1bc0c1ac0 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0ac0a0 con 0x7fa1bc0ceef0 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc1606b0 0x7fa1bc0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc1606b0 0x7fa1bc0c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55090/0 (socket says 172.21.15.81:55090) 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 -- 172.21.15.81:0/705506159 learned_addr learned my addr 172.21.15.81:0/705506159 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c123e700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1bc0c1ac0 0x7fa1bc0abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c0a3d700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1bc0ceef0 0x7fa1bc157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 -- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1bc0ceef0 msgr2=0x7fa1bc157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1bc0ceef0 0x7fa1bc157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 -- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1bc0c1ac0 msgr2=0x7fa1bc0abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1bc0c1ac0 0x7fa1bc0abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 -- 172.21.15.81:0/705506159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8009b30 con 0x7fa1bc1606b0 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c123e700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1bc0c1ac0 0x7fa1bc0abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c1a3f700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc1606b0 0x7fa1bc0c27d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400eb60 tx=0x7fa1b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1b1ffb700 1 -- 172.21.15.81:0/705506159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4009740 con 0x7fa1bc1606b0 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1b1ffb700 1 -- 172.21.15.81:0/705506159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4009e00 con 0x7fa1bc1606b0 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1b1ffb700 1 -- 172.21.15.81:0/705506159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400ca70 con 0x7fa1bc1606b0 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc0b36c0 con 0x7fa1bc1606b0 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.394+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc0cb6f0 con 0x7fa1bc1606b0 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.398+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc0ad610 con 0x7fa1bc1606b0 2023-11-29T11:16:03.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.398+0000 7fa1b1ffb700 1 -- 172.21.15.81:0/705506159 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa1b4019030 con 0x7fa1bc1606b0 2023-11-29T11:16:03.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.398+0000 7fa1b1ffb700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa1a0064ee0 0x7fa1a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.398+0000 7fa1c123e700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa1a0064ee0 0x7fa1a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.398+0000 7fa1b1ffb700 1 -- 172.21.15.81:0/705506159 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa1b40822c0 con 0x7fa1bc1606b0 2023-11-29T11:16:03.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.398+0000 7fa1c123e700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa1a0064ee0 0x7fa1a0067390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac000f60 tx=0x7fa1ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:03.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.406+0000 7fa1b1ffb700 1 -- 172.21.15.81:0/705506159 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa1b4050690 con 0x7fa1bc1606b0 2023-11-29T11:16:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.622+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa1bc15e7f0 con 0x7fa1bc1606b0 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1b1ffb700 1 -- 172.21.15.81:0/705506159 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fa1b4053cb0 con 0x7fa1bc1606b0 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlSOayNhAAtezph/rP5i/F81/canwMdA==", 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.630 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdl8qMjBRAAuvMDj+jPn1OjXUEcUl34jg==", 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.631 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlIykpOhAAL31egdG19jdsaMglEpIC5w==", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlKA1GCxAAOzBuOUs7pjJJOOFwZq8npA==", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:16:03.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/HGdl92Q/OhAAXGWXiUvswEMnfzScuUn0cw==", 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDHGdl8TbZExAA2IBrIVdDMSaeGFjE0oBYFw==", 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.633 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCGHGdlUk9QJhAA3rf+afNjbbsQotcH4YjVQg==", 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.634 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJHGdlUPFnLRAAk4y/WOW2lDfYd22+GF2QlA==", 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCPHGdlLLatFRAAz4dG1oXNEITKomtPGnDBmw==", 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCSHGdl34DRKxAAt8kHY0+FALSWN612SIOnsQ==", 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCVHGdl4zPUMBAAsF8NTRCGqXpRuVduNnWO1A==", 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCYHGdlQv/DNRAAFMTV+dTJZ0UZK2eCJiFDuw==", 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgxnnDhAAfROm0RfwzNurvq62gqmGBQ==", 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:16:03.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgjcpFRAAtcxPbxV34mCHxFVoGYmqmg==", 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.638 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlvfbxERAA6d5eRkOBOKhyToZKDKlvYQ==", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlDrDHGhAAfy4RAK8qFAj2Sf6GuRGhBw==", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:16:03.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlW+ELKBAAoMzxY7NGqIJ1SNfaQ/4qVQ==", 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlqaiZMhAAPiboTL+csIYuoxSk+ZwfJA==", 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlcf6LLxAAqtoEWzgd41N9uT9tC7bZ/Q==", 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-11-29T11:16:03.641 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa1a0064ee0 msgr2=0x7fa1a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa1a0064ee0 0x7fa1a0067390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac000f60 tx=0x7fa1ac009040 comp rx=0 tx=0).stop 2023-11-29T11:16:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc1606b0 msgr2=0x7fa1bc0c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc1606b0 0x7fa1bc0c27d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400eb60 tx=0x7fa1b400ee70 comp rx=0 tx=0).stop 2023-11-29T11:16:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 shutdown_connections 2023-11-29T11:16:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa1a0064ee0 0x7fa1a0067390 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1bc1606b0 0x7fa1bc0c27d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1bc0ceef0 0x7fa1bc157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 --2- 172.21.15.81:0/705506159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1bc0c1ac0 0x7fa1bc0abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 >> 172.21.15.81:0/705506159 conn(0x7fa1bc0ce3e0 msgr2=0x7fa1bc06ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 shutdown_connections 2023-11-29T11:16:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.626+0000 7fa1c2240700 1 -- 172.21.15.81:0/705506159 wait complete. 2023-11-29T11:16:03.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:16:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.746+0000 7f4d853d7700 1 Processor -- start 2023-11-29T11:16:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.746+0000 7f4d853d7700 1 -- start start 2023-11-29T11:16:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d80159e70 0x7f4d8006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 0x7f4d800cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4d8006cee0 0x7f4d800cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8006ace0 con 0x7f4d80159e70 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8006a0d0 con 0x7f4d8006cee0 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8006a3b0 con 0x7f4d80069c40 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d80159e70 0x7f4d8006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d80159e70 0x7f4d8006c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55100/0 (socket says 172.21.15.81:55100) 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 -- 172.21.15.81:0/3628197948 learned_addr learned my addr 172.21.15.81:0/3628197948 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d77fff700 1 --2- 172.21.15.81:0/3628197948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 0x7f4d800cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d84bd6700 1 --2- 172.21.15.81:0/3628197948 >> v2:172.21.15.176:3300/0 conn(0x7f4d8006cee0 0x7f4d800cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 -- 172.21.15.81:0/3628197948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 msgr2=0x7f4d800cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 --2- 172.21.15.81:0/3628197948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 0x7f4d800cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 -- 172.21.15.81:0/3628197948 >> v2:172.21.15.176:3300/0 conn(0x7f4d8006cee0 msgr2=0x7f4d800cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 --2- 172.21.15.81:0/3628197948 >> v2:172.21.15.176:3300/0 conn(0x7f4d8006cee0 0x7f4d800cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 -- 172.21.15.81:0/3628197948 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8006a690 con 0x7f4d80159e70 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d84bd6700 1 --2- 172.21.15.81:0/3628197948 >> v2:172.21.15.176:3300/0 conn(0x7f4d8006cee0 0x7f4d800cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7ffff700 1 --2- 172.21.15.81:0/3628197948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80159e70 0x7f4d8006c9a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4d800b12c0 tx=0x7f4d70009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488f07e6aa648d27 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7f7fe700 1 -- 172.21.15.81:0/3628197948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000b8a0 con 0x7f4d80159e70 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7f7fe700 1 -- 172.21.15.81:0/3628197948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7000ba00 con 0x7f4d80159e70 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d7f7fe700 1 -- 172.21.15.81:0/3628197948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000bd90 con 0x7f4d80159e70 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 -- 172.21.15.81:0/3628197948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80159e70 msgr2=0x7f4d8006c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 --2- 172.21.15.81:0/3628197948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80159e70 0x7f4d8006c9a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f4d800b12c0 tx=0x7f4d70009bf0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 -- 172.21.15.81:0/3628197948 shutdown_connections 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 --2- 172.21.15.81:0/3628197948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 0x7f4d800cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 --2- 172.21.15.81:0/3628197948 >> v2:172.21.15.176:3300/0 conn(0x7f4d8006cee0 0x7f4d800cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 --2- 172.21.15.81:0/3628197948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80159e70 0x7f4d8006c9a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 -- 172.21.15.81:0/3628197948 >> 172.21.15.81:0/3628197948 conn(0x7f4d800ce3e0 msgr2=0x7f4d800ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 -- 172.21.15.81:0/3628197948 shutdown_connections 2023-11-29T11:16:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.750+0000 7f4d853d7700 1 -- 172.21.15.81:0/3628197948 wait complete. 2023-11-29T11:16:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d853d7700 1 Processor -- start 2023-11-29T11:16:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d853d7700 1 -- start start 2023-11-29T11:16:03.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d853d7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 0x7f4d801eed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d853d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8006cee0 0x7f4d800c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d853d7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d80159e70 0x7f4d800ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d853d7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c2740 con 0x7f4d8006cee0 2023-11-29T11:16:03.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d853d7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c2a20 con 0x7f4d80159e70 2023-11-29T11:16:03.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d853d7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c5630 con 0x7f4d80069c40 2023-11-29T11:16:03.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8006cee0 0x7f4d800c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8006cee0 0x7f4d800c1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55114/0 (socket says 172.21.15.81:55114) 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d77fff700 1 -- 172.21.15.81:0/947160198 learned_addr learned my addr 172.21.15.81:0/947160198 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d7ffff700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 0x7f4d801eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d84bd6700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d80159e70 0x7f4d800ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d77fff700 1 -- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 msgr2=0x7f4d801eed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d77fff700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 0x7f4d801eed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d77fff700 1 -- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d80159e70 msgr2=0x7f4d800ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d77fff700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d80159e70 0x7f4d800ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.754+0000 7f4d77fff700 1 -- 172.21.15.81:0/947160198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70009570 con 0x7f4d8006cee0 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d84bd6700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d80159e70 0x7f4d800ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d77fff700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8006cee0 0x7f4d800c1ef0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c7f0 tx=0x7f4d6800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d7d7fa700 1 -- 172.21.15.81:0/947160198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68011800 con 0x7f4d8006cee0 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d7d7fa700 1 -- 172.21.15.81:0/947160198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d68011960 con 0x7f4d8006cee0 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8015a240 con 0x7f4d8006cee0 2023-11-29T11:16:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d7d7fa700 1 -- 172.21.15.81:0/947160198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68011d10 con 0x7f4d8006cee0 2023-11-29T11:16:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8006a970 con 0x7f4d8006cee0 2023-11-29T11:16:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d800b32e0 con 0x7f4d8006cee0 2023-11-29T11:16:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d7d7fa700 1 -- 172.21.15.81:0/947160198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4d68021070 con 0x7f4d8006cee0 2023-11-29T11:16:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d7d7fa700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4d60064ee0 0x7f4d60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:03.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d7d7fa700 1 -- 172.21.15.81:0/947160198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4d68081c30 con 0x7f4d8006cee0 2023-11-29T11:16:03.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d7ffff700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4d60064ee0 0x7f4d60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:03.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.758+0000 7f4d7ffff700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4d60064ee0 0x7f4d60067390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4d70000c00 tx=0x7f4d70008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:03.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.762+0000 7f4d7d7fa700 1 -- 172.21.15.81:0/947160198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4d6804ff60 con 0x7f4d8006cee0 2023-11-29T11:16:03.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.930+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d800c5490 con 0x7f4d8006cee0 2023-11-29T11:16:03.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.930+0000 7f4d7d7fa700 1 -- 172.21.15.81:0/947160198 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+14318 (secure 0 0 0) 0x7f4d800c5490 con 0x7f4d8006cee0 2023-11-29T11:16:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:03.937 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:16:03.192865+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4d60064ee0 msgr2=0x7f4d60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4d60064ee0 0x7f4d60067390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4d70000c00 tx=0x7f4d70008030 comp rx=0 tx=0).stop 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8006cee0 msgr2=0x7f4d800c1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8006cee0 0x7f4d800c1ef0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c7f0 tx=0x7f4d6800cbb0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 shutdown_connections 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4d60064ee0 0x7f4d60067390 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d80159e70 0x7f4d800ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d8006cee0 0x7f4d800c1ef0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 --2- 172.21.15.81:0/947160198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d80069c40 0x7f4d801eed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 >> 172.21.15.81:0/947160198 conn(0x7f4d800ce3e0 msgr2=0x7f4d800ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 shutdown_connections 2023-11-29T11:16:03.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:03.934+0000 7f4d853d7700 1 -- 172.21.15.81:0/947160198 wait complete. 2023-11-29T11:16:03.952 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:16:03.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:16:04.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc92506c700 1 Processor -- start 2023-11-29T11:16:04.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc92506c700 1 -- start start 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc92506c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9200cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc92506c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc92006ad50 0x7fc92006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc92506c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9200b16e0 con 0x7fc92015c6f0 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc92506c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92006b710 con 0x7fc92006ad50 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc92506c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92015cac0 con 0x7fc9200b0bf0 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc92006ad50 0x7fc92006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc92015c6f0 0x7fc9200b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37086/0 (socket says 172.21.15.81:37086) 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91ed9d700 1 -- 172.21.15.81:0/1029058526 learned_addr learned my addr 172.21.15.81:0/1029058526 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91e59c700 1 --2- 172.21.15.81:0/1029058526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9200cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91f59e700 1 -- 172.21.15.81:0/1029058526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 msgr2=0x7fc9200cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91f59e700 1 --2- 172.21.15.81:0/1029058526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9200cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91f59e700 1 -- 172.21.15.81:0/1029058526 >> v1:172.21.15.81:6789/0 conn(0x7fc92015c6f0 legacy=0x7fc9200b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91f59e700 1 -- 172.21.15.81:0/1029058526 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92015daa0 con 0x7fc92006ad50 2023-11-29T11:16:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91f59e700 1 --2- 172.21.15.81:0/1029058526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92006ad50 0x7fc92006b1d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc918009d90 tx=0x7fc91800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3371a93808af4c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.062+0000 7fc91dd9b700 1 -- 172.21.15.81:0/1029058526 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800e070 con 0x7fc92006ad50 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc91dd9b700 1 -- 172.21.15.81:0/1029058526 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91800bbd0 con 0x7fc92006ad50 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc91dd9b700 1 -- 172.21.15.81:0/1029058526 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918012430 con 0x7fc92006ad50 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 -- 172.21.15.81:0/1029058526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92006ad50 msgr2=0x7fc92006b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 --2- 172.21.15.81:0/1029058526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92006ad50 0x7fc92006b1d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc918009d90 tx=0x7fc91800b330 comp rx=0 tx=0).stop 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 -- 172.21.15.81:0/1029058526 shutdown_connections 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 --2- 172.21.15.81:0/1029058526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92006ad50 0x7fc92006b1d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 --2- 172.21.15.81:0/1029058526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9200cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 -- 172.21.15.81:0/1029058526 >> 172.21.15.81:0/1029058526 conn(0x7fc9200cf4a0 msgr2=0x7fc9200cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 -- 172.21.15.81:0/1029058526 shutdown_connections 2023-11-29T11:16:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 -- 172.21.15.81:0/1029058526 wait complete. 2023-11-29T11:16:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 Processor -- start 2023-11-29T11:16:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.066+0000 7fc92506c700 1 -- start start 2023-11-29T11:16:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc92506c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc92006ad50 0x7fc92015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc92506c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9201f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc92506c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92015c6f0 0x7fc92013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc92506c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200c1e60 con 0x7fc92015c6f0 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc92506c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9201544f0 con 0x7fc92006ad50 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc92506c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9201f2b70 con 0x7fc9200b0bf0 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92015c6f0 0x7fc92013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91e59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9201f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92015c6f0 0x7fc92013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55136/0 (socket says 172.21.15.81:55136) 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91e59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9201f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:52356/0 (socket says 172.21.15.81:52356) 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 -- 172.21.15.81:0/3354678795 learned_addr learned my addr 172.21.15.81:0/3354678795 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91ed9d700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc92006ad50 0x7fc92015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 -- 172.21.15.81:0/3354678795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 msgr2=0x7fc9201f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9201f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 -- 172.21.15.81:0/3354678795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc92006ad50 msgr2=0x7fc92015bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc92006ad50 0x7fc92015bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 -- 172.21.15.81:0/3354678795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc918009a70 con 0x7fc92015c6f0 2023-11-29T11:16:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc91f59e700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92015c6f0 0x7fc92013f620 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc92006daa0 tx=0x7fc918004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc9077fe700 1 -- 172.21.15.81:0/3354678795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918012430 con 0x7fc92015c6f0 2023-11-29T11:16:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc9077fe700 1 -- 172.21.15.81:0/3354678795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918020070 con 0x7fc92015c6f0 2023-11-29T11:16:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9200b1c10 con 0x7fc92015c6f0 2023-11-29T11:16:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc9077fe700 1 -- 172.21.15.81:0/3354678795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9180098f0 con 0x7fc92015c6f0 2023-11-29T11:16:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.070+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9200b1930 con 0x7fc92015c6f0 2023-11-29T11:16:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.074+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9200c8e60 con 0x7fc92015c6f0 2023-11-29T11:16:04.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.074+0000 7fc9077fe700 1 -- 172.21.15.81:0/3354678795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc91802e070 con 0x7fc92015c6f0 2023-11-29T11:16:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.074+0000 7fc9077fe700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc90c064f10 0x7fc90c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.074+0000 7fc9077fe700 1 -- 172.21.15.81:0/3354678795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc918022070 con 0x7fc92015c6f0 2023-11-29T11:16:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.074+0000 7fc91ed9d700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc90c064f10 0x7fc90c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.074+0000 7fc91ed9d700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc90c064f10 0x7fc90c0673c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc914005930 tx=0x7fc914009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.082+0000 7fc9077fe700 1 -- 172.21.15.81:0/3354678795 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc918051cb0 con 0x7fc92015c6f0 2023-11-29T11:16:04.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.246+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc920072500 con 0x7fc92015c6f0 2023-11-29T11:16:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.246+0000 7fc9077fe700 1 -- 172.21.15.81:0/3354678795 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc91802c020 con 0x7fc92015c6f0 2023-11-29T11:16:04.252 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:16:04.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc90c064f10 msgr2=0x7fc90c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc90c064f10 0x7fc90c0673c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc914005930 tx=0x7fc914009040 comp rx=0 tx=0).stop 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92015c6f0 msgr2=0x7fc92013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92015c6f0 0x7fc92013f620 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc92006daa0 tx=0x7fc918004af0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 shutdown_connections 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc90c064f10 0x7fc90c0673c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92015c6f0 0x7fc92013f620 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9200b0bf0 0x7fc9201f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 --2- 172.21.15.81:0/3354678795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc92006ad50 0x7fc92015bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 >> 172.21.15.81:0/3354678795 conn(0x7fc9200cf4a0 msgr2=0x7fc920070120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 shutdown_connections 2023-11-29T11:16:04.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.250+0000 7fc92506c700 1 -- 172.21.15.81:0/3354678795 wait complete. 2023-11-29T11:16:04.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:16:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.370+0000 7f6c16b23700 1 Processor -- start 2023-11-29T11:16:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c16b23700 1 -- start start 2023-11-29T11:16:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c16b23700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100ce230 0x7f6c100ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c16b23700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6c100cd5d0 0x7f6c100cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c16b23700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1006d1c0 con 0x7f6c10158ee0 2023-11-29T11:16:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c16b23700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1006e000 con 0x7f6c100cd5d0 2023-11-29T11:16:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c16b23700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100ca3a0 con 0x7f6c100ce230 2023-11-29T11:16:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c15320700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100ce230 0x7f6c100ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c16322700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6c100cd5d0 0x7f6c100cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c15b21700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6c10158ee0 0x7f6c100cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:37900/0 (socket says 172.21.15.81:37900) 2023-11-29T11:16:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c15b21700 1 -- 172.21.15.81:0/2773499103 learned_addr learned my addr 172.21.15.81:0/2773499103 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c15320700 1 -- 172.21.15.81:0/2773499103 >> v2:172.21.15.176:3300/0 conn(0x7f6c100cd5d0 msgr2=0x7f6c100cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c15320700 1 --2- 172.21.15.81:0/2773499103 >> v2:172.21.15.176:3300/0 conn(0x7f6c100cd5d0 0x7f6c100cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c15320700 1 -- 172.21.15.81:0/2773499103 >> v1:172.21.15.176:6789/0 conn(0x7f6c10158ee0 legacy=0x7f6c100cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c15320700 1 -- 172.21.15.81:0/2773499103 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1006c920 con 0x7f6c100ce230 2023-11-29T11:16:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.374+0000 7f6c15320700 1 --2- 172.21.15.81:0/2773499103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100ce230 0x7f6c100ae760 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009840 tx=0x7f6c00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af9a4474b3a2287d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c14b1f700 1 -- 172.21.15.81:0/2773499103 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00005e50 con 0x7f6c100ce230 2023-11-29T11:16:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c14b1f700 1 -- 172.21.15.81:0/2773499103 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00006030 con 0x7f6c100ce230 2023-11-29T11:16:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c14b1f700 1 -- 172.21.15.81:0/2773499103 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000063c0 con 0x7f6c100ce230 2023-11-29T11:16:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 -- 172.21.15.81:0/2773499103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100ce230 msgr2=0x7f6c100ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2773499103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100ce230 0x7f6c100ae760 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009840 tx=0x7f6c00009b50 comp rx=0 tx=0).stop 2023-11-29T11:16:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 -- 172.21.15.81:0/2773499103 shutdown_connections 2023-11-29T11:16:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2773499103 >> v2:172.21.15.176:3300/0 conn(0x7f6c100cd5d0 0x7f6c100cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2773499103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100ce230 0x7f6c100ae760 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 -- 172.21.15.81:0/2773499103 >> 172.21.15.81:0/2773499103 conn(0x7f6c100d0240 msgr2=0x7f6c100cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 -- 172.21.15.81:0/2773499103 shutdown_connections 2023-11-29T11:16:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 -- 172.21.15.81:0/2773499103 wait complete. 2023-11-29T11:16:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 Processor -- start 2023-11-29T11:16:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.378+0000 7f6c16b23700 1 -- start start 2023-11-29T11:16:04.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100cd5d0 0x7f6c10150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c100ce230 0x7f6c100c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c10158ee0 0x7f6c10157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c10156110 con 0x7f6c10158ee0 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101563f0 con 0x7f6c100ce230 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101566d0 con 0x7f6c100cd5d0 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c10158ee0 0x7f6c10157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c15b21700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100cd5d0 0x7f6c10150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c10158ee0 0x7f6c10157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55138/0 (socket says 172.21.15.81:55138) 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 -- 172.21.15.81:0/2283064347 learned_addr learned my addr 172.21.15.81:0/2283064347 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c15320700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c100ce230 0x7f6c100c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 -- 172.21.15.81:0/2283064347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100cd5d0 msgr2=0x7f6c10150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100cd5d0 0x7f6c10150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 -- 172.21.15.81:0/2283064347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c100ce230 msgr2=0x7f6c100c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c100ce230 0x7f6c100c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 -- 172.21.15.81:0/2283064347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009450 con 0x7f6c10158ee0 2023-11-29T11:16:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16322700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c10158ee0 0x7f6c10157490 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6c08010fc0 tx=0x7f6c0800e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c067fc700 1 -- 172.21.15.81:0/2283064347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800e940 con 0x7f6c10158ee0 2023-11-29T11:16:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c067fc700 1 -- 172.21.15.81:0/2283064347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08011040 con 0x7f6c10158ee0 2023-11-29T11:16:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1006cee0 con 0x7f6c10158ee0 2023-11-29T11:16:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c067fc700 1 -- 172.21.15.81:0/2283064347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800ece0 con 0x7f6c10158ee0 2023-11-29T11:16:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1006cc00 con 0x7f6c10158ee0 2023-11-29T11:16:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c067fc700 1 -- 172.21.15.81:0/2283064347 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c08009540 con 0x7f6c10158ee0 2023-11-29T11:16:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.382+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c100ca640 con 0x7f6c10158ee0 2023-11-29T11:16:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.386+0000 7f6c067fc700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bf4064ee0 0x7f6bf4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.386+0000 7f6c067fc700 1 -- 172.21.15.81:0/2283064347 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6c08084360 con 0x7f6c10158ee0 2023-11-29T11:16:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.386+0000 7f6c15b21700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bf4064ee0 0x7f6bf4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.386+0000 7f6c15b21700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bf4064ee0 0x7f6bf4067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c005930 tx=0x7f6c0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.394+0000 7f6c067fc700 1 -- 172.21.15.81:0/2283064347 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6c080526b0 con 0x7f6c10158ee0 2023-11-29T11:16:04.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.558+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c10072c20 con 0x7f6c10158ee0 2023-11-29T11:16:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.558+0000 7f6c067fc700 1 -- 172.21.15.81:0/2283064347 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c08055cd0 con 0x7f6c10158ee0 2023-11-29T11:16:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:16:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bf4064ee0 msgr2=0x7f6bf4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bf4064ee0 0x7f6bf4067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c005930 tx=0x7f6c0c009040 comp rx=0 tx=0).stop 2023-11-29T11:16:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c10158ee0 msgr2=0x7f6c10157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c10158ee0 0x7f6c10157490 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6c08010fc0 tx=0x7f6c0800e3a0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 shutdown_connections 2023-11-29T11:16:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bf4064ee0 0x7f6bf4067390 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c10158ee0 0x7f6c10157490 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c100ce230 0x7f6c100c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 --2- 172.21.15.81:0/2283064347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c100cd5d0 0x7f6c10150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 >> 172.21.15.81:0/2283064347 conn(0x7f6c100d0240 msgr2=0x7f6c100cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 shutdown_connections 2023-11-29T11:16:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.562+0000 7f6c16b23700 1 -- 172.21.15.81:0/2283064347 wait complete. 2023-11-29T11:16:04.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-29T11:16:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15bbfff700 1 Processor -- start 2023-11-29T11:16:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15bbfff700 1 -- start start 2023-11-29T11:16:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15bbfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f15bc0cdcb0 0x7f15bc0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc0cd4f0 0x7f15bc06ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15bbfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc0c9a40 con 0x7f15bc15bfd0 2023-11-29T11:16:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15bbfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc0ccb90 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15bbfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0cd990 con 0x7f15bc0cd4f0 2023-11-29T11:16:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15baffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f15bc15bfd0 0x7f15bc0caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37088/0 (socket says 172.21.15.81:37088) 2023-11-29T11:16:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.686+0000 7f15baffd700 1 -- 172.21.15.81:0/3713365436 learned_addr learned my addr 172.21.15.81:0/3713365436 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bb7fe700 1 --2- 172.21.15.81:0/3713365436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc0cd4f0 0x7f15bc06ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15b3fff700 1 --2- 172.21.15.81:0/3713365436 >> v2:172.21.15.176:3300/0 conn(0x7f15bc0cdcb0 0x7f15bc0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15ba7fc700 1 -- 172.21.15.81:0/3713365436 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036884081 0 0) 0x7f15bc0c9a40 con 0x7f15bc15bfd0 2023-11-29T11:16:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15ba7fc700 1 -- 172.21.15.81:0/3713365436 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a80035d0 con 0x7f15bc15bfd0 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bb7fe700 1 -- 172.21.15.81:0/3713365436 >> v2:172.21.15.176:3300/0 conn(0x7f15bc0cdcb0 msgr2=0x7f15bc0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bb7fe700 1 --2- 172.21.15.81:0/3713365436 >> v2:172.21.15.176:3300/0 conn(0x7f15bc0cdcb0 0x7f15bc0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bb7fe700 1 -- 172.21.15.81:0/3713365436 >> v1:172.21.15.81:6789/0 conn(0x7f15bc15bfd0 legacy=0x7f15bc0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15ba7fc700 1 -- 172.21.15.81:0/3713365436 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 263460506 0 0) 0x7f15a80035d0 con 0x7f15bc15bfd0 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bb7fe700 1 -- 172.21.15.81:0/3713365436 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0c9480 con 0x7f15bc0cd4f0 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15b3fff700 1 --2- 172.21.15.81:0/3713365436 >> v2:172.21.15.176:3300/0 conn(0x7f15bc0cdcb0 0x7f15bc0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bb7fe700 1 --2- 172.21.15.81:0/3713365436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc0cd4f0 0x7f15bc06ac50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009d90 tx=0x7f15b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aab600a47b03414 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15ba7fc700 1 -- 172.21.15.81:0/3713365436 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400e070 con 0x7f15bc0cd4f0 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15ba7fc700 1 -- 172.21.15.81:0/3713365436 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4003a40 con 0x7f15bc0cd4f0 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15ba7fc700 1 -- 172.21.15.81:0/3713365436 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac001670 con 0x7f15bc0cd4f0 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bbfff700 1 -- 172.21.15.81:0/3713365436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc0cd4f0 msgr2=0x7f15bc06ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bbfff700 1 --2- 172.21.15.81:0/3713365436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc0cd4f0 0x7f15bc06ac50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009d90 tx=0x7f15b400b330 comp rx=0 tx=0).stop 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bbfff700 1 -- 172.21.15.81:0/3713365436 shutdown_connections 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bbfff700 1 --2- 172.21.15.81:0/3713365436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc0cd4f0 0x7f15bc06ac50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bbfff700 1 --2- 172.21.15.81:0/3713365436 >> v2:172.21.15.176:3300/0 conn(0x7f15bc0cdcb0 0x7f15bc0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bbfff700 1 -- 172.21.15.81:0/3713365436 >> 172.21.15.81:0/3713365436 conn(0x7f15bc06c640 msgr2=0x7f15bc06ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bbfff700 1 -- 172.21.15.81:0/3713365436 shutdown_connections 2023-11-29T11:16:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.690+0000 7f15bbfff700 1 -- 172.21.15.81:0/3713365436 wait complete. 2023-11-29T11:16:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 Processor -- start 2023-11-29T11:16:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 -- start start 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15bc0cd4f0 0x7f15bc158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc0cdcb0 0x7f15bc0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc15bfd0 0x7f15bc15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1f29e0 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b3be0 con 0x7f15bc0cd4f0 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b32b0 con 0x7f15bc15bfd0 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc0cdcb0 0x7f15bc0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc0cdcb0 0x7f15bc0ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55140/0 (socket says 172.21.15.81:55140) 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 -- 172.21.15.81:0/778678009 learned_addr learned my addr 172.21.15.81:0/778678009 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bb7fe700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc15bfd0 0x7f15bc15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15baffd700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15bc0cd4f0 0x7f15bc158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 -- 172.21.15.81:0/778678009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc15bfd0 msgr2=0x7f15bc15a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc15bfd0 0x7f15bc15a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 -- 172.21.15.81:0/778678009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15bc0cd4f0 msgr2=0x7f15bc158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15bc0cd4f0 0x7f15bc158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 -- 172.21.15.81:0/778678009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40094b0 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b3fff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc0cdcb0 0x7f15bc0ae7f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f15a400ebe0 tx=0x7f15a400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b37fe700 1 -- 172.21.15.81:0/778678009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400c850 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b37fe700 1 -- 172.21.15.81:0/778678009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400c9b0 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b4009a70 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15b37fe700 1 -- 172.21.15.81:0/778678009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400cd40 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.694+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc0ceaa0 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.698+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc0c9760 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.698+0000 7f15b37fe700 1 -- 172.21.15.81:0/778678009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f15a4019030 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.698+0000 7f15b37fe700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f159c064ee0 0x7f159c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.698+0000 7f15b37fe700 1 -- 172.21.15.81:0/778678009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f15a4081c40 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.698+0000 7f15baffd700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f159c064ee0 0x7f159c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.698+0000 7f15baffd700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f159c064ee0 0x7f159c067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0011e0 tx=0x7f15ac001bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.706+0000 7f15b37fe700 1 -- 172.21.15.81:0/778678009 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f15a404fff0 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.870+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f15bc0cb650 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.870+0000 7f15b37fe700 1 -- 172.21.15.81:0/778678009 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+126 (secure 0 0 0) 0x7f15a4017090 con 0x7f15bc0cdcb0 2023-11-29T11:16:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:04.876 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:16:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f159c064ee0 msgr2=0x7f159c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f159c064ee0 0x7f159c067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0011e0 tx=0x7f15ac001bc0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc0cdcb0 msgr2=0x7f15bc0ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc0cdcb0 0x7f15bc0ae7f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f15a400ebe0 tx=0x7f15a400eef0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 shutdown_connections 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f159c064ee0 0x7f159c067390 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15bc15bfd0 0x7f15bc15a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15bc0cdcb0 0x7f15bc0ae7f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 --2- 172.21.15.81:0/778678009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15bc0cd4f0 0x7f15bc158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 >> 172.21.15.81:0/778678009 conn(0x7f15bc06c640 msgr2=0x7f15bc06b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 shutdown_connections 2023-11-29T11:16:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:04.874+0000 7f15bbfff700 1 -- 172.21.15.81:0/778678009 wait complete. 2023-11-29T11:16:04.890 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-29T11:16:04.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-29T11:16:05.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb1966700 1 Processor -- start 2023-11-29T11:16:05.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb1966700 1 -- start start 2023-11-29T11:16:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb1966700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9fac0b1ae0 0x7f9fac06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb1966700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac06a9c0 con 0x7f9fac0cf0e0 2023-11-29T11:16:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb1966700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac06aca0 con 0x7f9fac06a4c0 2023-11-29T11:16:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb1966700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0d0ab0 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb1165700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9fac0cf0e0 0x7f9fac0cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37102/0 (socket says 172.21.15.81:37102) 2023-11-29T11:16:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb1165700 1 -- 172.21.15.81:0/1789015292 learned_addr learned my addr 172.21.15.81:0/1789015292 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb0964700 1 --2- 172.21.15.81:0/1789015292 >> v2:172.21.15.176:3300/0 conn(0x7f9fac0b1ae0 0x7f9fac06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb0964700 1 -- 172.21.15.81:0/1789015292 >> v1:172.21.15.176:6789/0 conn(0x7f9fac06a4c0 legacy=0x7f9fac0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb0964700 1 -- 172.21.15.81:0/1789015292 >> v1:172.21.15.81:6789/0 conn(0x7f9fac0cf0e0 legacy=0x7f9fac0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb0964700 1 -- 172.21.15.81:0/1789015292 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac06af80 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fb0964700 1 --2- 172.21.15.81:0/1789015292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac06d8e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009850 tx=0x7f9fa0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e52429bfbdd4cd08 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fab7fe700 1 -- 172.21.15.81:0/1789015292 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0011830 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fab7fe700 1 -- 172.21.15.81:0/1789015292 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0011990 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.006+0000 7f9fab7fe700 1 -- 172.21.15.81:0/1789015292 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0011d20 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- 172.21.15.81:0/1789015292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac0b1ae0 msgr2=0x7f9fac06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:05.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 --2- 172.21.15.81:0/1789015292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac06d8e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009850 tx=0x7f9fa0009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:05.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- 172.21.15.81:0/1789015292 shutdown_connections 2023-11-29T11:16:05.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 --2- 172.21.15.81:0/1789015292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac06d8e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:05.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- 172.21.15.81:0/1789015292 >> 172.21.15.81:0/1789015292 conn(0x7f9fac09bbd0 msgr2=0x7f9fac0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:05.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- 172.21.15.81:0/1789015292 shutdown_connections 2023-11-29T11:16:05.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- 172.21.15.81:0/1789015292 wait complete. 2023-11-29T11:16:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 Processor -- start 2023-11-29T11:16:05.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- start start 2023-11-29T11:16:05.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac06a4c0 0x7f9fac1f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:05.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac09c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:05.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fac0cf0e0 0x7f9fac09ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:05.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac09e410 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0c91d0 con 0x7f9fac06a4c0 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fb1966700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0c8ef0 con 0x7f9fac0cf0e0 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac09c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55144/0 (socket says 172.21.15.81:55144) 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.010+0000 7f9fabfff700 1 -- 172.21.15.81:0/3842753663 learned_addr learned my addr 172.21.15.81:0/3842753663 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fb1165700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fac0cf0e0 0x7f9fac09ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fb0964700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac06a4c0 0x7f9fac1f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fabfff700 1 -- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fac0cf0e0 msgr2=0x7f9fac09ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fabfff700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fac0cf0e0 0x7f9fac09ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fabfff700 1 -- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac06a4c0 msgr2=0x7f9fac1f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fabfff700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac06a4c0 0x7f9fac1f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fabfff700 1 -- 172.21.15.81:0/3842753663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00094b0 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fb0964700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac06a4c0 0x7f9fac1f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fabfff700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac09c540 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800c440 tx=0x7f9f9800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:05.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fa97fa700 1 -- 172.21.15.81:0/3842753663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980052d0 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fa97fa700 1 -- 172.21.15.81:0/3842753663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f98005430 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac0b1eb0 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fa97fa700 1 -- 172.21.15.81:0/3842753663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980055a0 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac0b4380 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac0b60e0 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.014+0000 7f9fa97fa700 1 -- 172.21.15.81:0/3842753663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9f98010050 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.018+0000 7f9fa97fa700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f90064ee0 0x7f9f90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.018+0000 7f9fa97fa700 1 -- 172.21.15.81:0/3842753663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9f98080d40 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.018+0000 7f9fb0964700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f90064ee0 0x7f9f90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:05.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.018+0000 7f9fb0964700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f90064ee0 0x7f9f90067390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0014040 tx=0x7f9fa0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:05.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.022+0000 7f9fa97fa700 1 -- 172.21.15.81:0/3842753663 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9f98049400 con 0x7f9fac0b1ae0 2023-11-29T11:16:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:05.178+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9fac0b1610 con 0x7f9fac0b1ae0 2023-11-29T11:16:06.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.018+0000 7f9fa97fa700 1 -- 172.21.15.81:0/3842753663 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9f9804f090 con 0x7f9fac0b1ae0 2023-11-29T11:16:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f90064ee0 msgr2=0x7f9f90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f90064ee0 0x7f9f90067390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0014040 tx=0x7f9fa0008030 comp rx=0 tx=0).stop 2023-11-29T11:16:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0b1ae0 msgr2=0x7f9fac09c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac09c540 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800c440 tx=0x7f9f9800c750 comp rx=0 tx=0).stop 2023-11-29T11:16:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 shutdown_connections 2023-11-29T11:16:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f90064ee0 0x7f9f90067390 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9fac0cf0e0 0x7f9fac09ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0b1ae0 0x7f9fac09c540 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 --2- 172.21.15.81:0/3842753663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9fac06a4c0 0x7f9fac1f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 >> 172.21.15.81:0/3842753663 conn(0x7f9fac09bbd0 msgr2=0x7f9fac0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 shutdown_connections 2023-11-29T11:16:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.026+0000 7f9fb1966700 1 -- 172.21.15.81:0/3842753663 wait complete. 2023-11-29T11:16:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-11-29T11:16:06.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-29T11:16:06.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.162+0000 7f1b37fff700 1 Processor -- start 2023-11-29T11:16:06.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b37fff700 1 -- start start 2023-11-29T11:16:06.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b37fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b3806a4c0 0x7f1b3806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:06.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b37fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1b380cf0e0 0x7f1b380cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b37fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b380cfa40 con 0x7f1b380b1ae0 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b37fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b380d0ab0 con 0x7f1b3806a4c0 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b37fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3806a9c0 con 0x7f1b380cf0e0 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b367fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b3806a4c0 0x7f1b3806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b367fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b3806a4c0 0x7f1b3806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55156/0 (socket says 172.21.15.81:55156) 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b367fc700 1 -- 172.21.15.81:0/93411186 learned_addr learned my addr 172.21.15.81:0/93411186 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b377fe700 1 --2- 172.21.15.81:0/93411186 >> v2:172.21.15.176:3300/0 conn(0x7f1b380cf0e0 0x7f1b380cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b367fc700 1 -- 172.21.15.81:0/93411186 >> v2:172.21.15.176:3300/0 conn(0x7f1b380cf0e0 msgr2=0x7f1b380cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b367fc700 1 --2- 172.21.15.81:0/93411186 >> v2:172.21.15.176:3300/0 conn(0x7f1b380cf0e0 0x7f1b380cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b367fc700 1 -- 172.21.15.81:0/93411186 >> v1:172.21.15.176:6789/0 conn(0x7f1b380b1ae0 legacy=0x7f1b380d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b367fc700 1 -- 172.21.15.81:0/93411186 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3806aca0 con 0x7f1b3806a4c0 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b367fc700 1 --2- 172.21.15.81:0/93411186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b3806d8e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1b380b6440 tx=0x7f1b20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cce2ba5141bf08 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b35ffb700 1 -- 172.21.15.81:0/93411186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20011830 con 0x7f1b3806a4c0 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b35ffb700 1 -- 172.21.15.81:0/93411186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20011990 con 0x7f1b3806a4c0 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.166+0000 7f1b35ffb700 1 -- 172.21.15.81:0/93411186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20011d20 con 0x7f1b3806a4c0 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 -- 172.21.15.81:0/93411186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 msgr2=0x7f1b3806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 --2- 172.21.15.81:0/93411186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b3806d8e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1b380b6440 tx=0x7f1b20009bf0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 -- 172.21.15.81:0/93411186 shutdown_connections 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 --2- 172.21.15.81:0/93411186 >> v2:172.21.15.176:3300/0 conn(0x7f1b380cf0e0 0x7f1b380cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 --2- 172.21.15.81:0/93411186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b3806d8e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 -- 172.21.15.81:0/93411186 >> 172.21.15.81:0/93411186 conn(0x7f1b3809bbd0 msgr2=0x7f1b380b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 -- 172.21.15.81:0/93411186 shutdown_connections 2023-11-29T11:16:06.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 -- 172.21.15.81:0/93411186 wait complete. 2023-11-29T11:16:06.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 Processor -- start 2023-11-29T11:16:06.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 -- start start 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b380c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b380b1ae0 0x7f1b3809dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.170+0000 7f1b37fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b380cf0e0 0x7f1b3814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b37fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3809e190 con 0x7f1b3806a4c0 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b37fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3809e3f0 con 0x7f1b380cf0e0 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b37fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3809e6d0 con 0x7f1b380b1ae0 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b380c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b380c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55166/0 (socket says 172.21.15.81:55166) 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 -- 172.21.15.81:0/1585051151 learned_addr learned my addr 172.21.15.81:0/1585051151 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b367fc700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b380b1ae0 0x7f1b3809dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b377fe700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b380cf0e0 0x7f1b3814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:06.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 -- 172.21.15.81:0/1585051151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b380b1ae0 msgr2=0x7f1b3809dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b380b1ae0 0x7f1b3809dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 -- 172.21.15.81:0/1585051151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b380cf0e0 msgr2=0x7f1b3814fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b380cf0e0 0x7f1b3814fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 -- 172.21.15.81:0/1585051151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20009570 con 0x7f1b3806a4c0 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b36ffd700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b380c8cd0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c500 tx=0x7f1b2800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b2ffff700 1 -- 172.21.15.81:0/1585051151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b280052d0 con 0x7f1b3806a4c0 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b2ffff700 1 -- 172.21.15.81:0/1585051151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28005430 con 0x7f1b3806a4c0 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b380b4380 con 0x7f1b3806a4c0 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b2ffff700 1 -- 172.21.15.81:0/1585051151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b280055a0 con 0x7f1b3806a4c0 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3806af80 con 0x7f1b3806a4c0 2023-11-29T11:16:06.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.174+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b380b1eb0 con 0x7f1b3806a4c0 2023-11-29T11:16:06.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.178+0000 7f1b2ffff700 1 -- 172.21.15.81:0/1585051151 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1b28019030 con 0x7f1b3806a4c0 2023-11-29T11:16:06.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.178+0000 7f1b2ffff700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b18064ee0 0x7f1b18067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:06.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.178+0000 7f1b2ffff700 1 -- 172.21.15.81:0/1585051151 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f1b28081120 con 0x7f1b3806a4c0 2023-11-29T11:16:06.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.178+0000 7f1b367fc700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b18064ee0 0x7f1b18067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:06.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.178+0000 7f1b367fc700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b18064ee0 0x7f1b18067390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1b20000c00 tx=0x7f1b20008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.186+0000 7f1b2ffff700 1 -- 172.21.15.81:0/1585051151 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1b2804f2d0 con 0x7f1b3806a4c0 2023-11-29T11:16:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:06.338+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1b38072500 con 0x7f1b3806a4c0 2023-11-29T11:16:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.026+0000 7f1b2ffff700 1 -- 172.21.15.81:0/1585051151 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1b280170d0 con 0x7f1b3806a4c0 2023-11-29T11:16:07.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.046+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b18064ee0 msgr2=0x7f1b18067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.046+0000 7f1b37fff700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b18064ee0 0x7f1b18067390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1b20000c00 tx=0x7f1b20008030 comp rx=0 tx=0).stop 2023-11-29T11:16:07.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.046+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 msgr2=0x7f1b380c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.046+0000 7f1b37fff700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b380c8cd0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c500 tx=0x7f1b2800c810 comp rx=0 tx=0).stop 2023-11-29T11:16:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.046+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 shutdown_connections 2023-11-29T11:16:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.050+0000 7f1b37fff700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b18064ee0 0x7f1b18067390 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.050+0000 7f1b37fff700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b380cf0e0 0x7f1b3814fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.050+0000 7f1b37fff700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b380b1ae0 0x7f1b3809dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.050+0000 7f1b37fff700 1 --2- 172.21.15.81:0/1585051151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b3806a4c0 0x7f1b380c8cd0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.050+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 >> 172.21.15.81:0/1585051151 conn(0x7f1b3809bbd0 msgr2=0x7f1b380b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.050+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 shutdown_connections 2023-11-29T11:16:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.050+0000 7f1b37fff700 1 -- 172.21.15.81:0/1585051151 wait complete. 2023-11-29T11:16:07.055 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-11-29T11:16:07.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-29T11:16:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed6d67700 1 Processor -- start 2023-11-29T11:16:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed6d67700 1 -- start start 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed6d67700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ed00b1ae0 0x7f1ed006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed6d67700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1ed006a4c0 0x7f1ed00d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed6d67700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed006a9c0 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed6d67700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed006aca0 con 0x7f1ed00b1ae0 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed6d67700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed006af80 con 0x7f1ed006a4c0 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5d65700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ed00b1ae0 0x7f1ed006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5d65700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ed00b1ae0 0x7f1ed006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55178/0 (socket says 172.21.15.81:55178) 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5d65700 1 -- 172.21.15.81:0/359159512 learned_addr learned my addr 172.21.15.81:0/359159512 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5564700 1 --2- 172.21.15.81:0/359159512 >> v2:172.21.15.176:3300/0 conn(0x7f1ed006a4c0 0x7f1ed00d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5d65700 1 -- 172.21.15.81:0/359159512 >> v2:172.21.15.176:3300/0 conn(0x7f1ed006a4c0 msgr2=0x7f1ed00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5d65700 1 --2- 172.21.15.81:0/359159512 >> v2:172.21.15.176:3300/0 conn(0x7f1ed006a4c0 0x7f1ed00d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5d65700 1 -- 172.21.15.81:0/359159512 >> v1:172.21.15.176:6789/0 conn(0x7f1ed00cf0e0 legacy=0x7f1ed00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5d65700 1 -- 172.21.15.81:0/359159512 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00b4380 con 0x7f1ed00b1ae0 2023-11-29T11:16:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed5d65700 1 --2- 172.21.15.81:0/359159512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00b1ae0 0x7f1ed006d8e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00b88d0 tx=0x7f1ecc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbd72618a4eaa45 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.174+0000 7f1ed4d63700 1 -- 172.21.15.81:0/359159512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc004230 con 0x7f1ed00b1ae0 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed4d63700 1 -- 172.21.15.81:0/359159512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc004390 con 0x7f1ed00b1ae0 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed4d63700 1 -- 172.21.15.81:0/359159512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0036c0 con 0x7f1ed00b1ae0 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 -- 172.21.15.81:0/359159512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00b1ae0 msgr2=0x7f1ed006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/359159512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00b1ae0 0x7f1ed006d8e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00b88d0 tx=0x7f1ecc009bf0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 -- 172.21.15.81:0/359159512 shutdown_connections 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/359159512 >> v2:172.21.15.176:3300/0 conn(0x7f1ed006a4c0 0x7f1ed00d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/359159512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00b1ae0 0x7f1ed006d8e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 -- 172.21.15.81:0/359159512 >> 172.21.15.81:0/359159512 conn(0x7f1ed009bbd0 msgr2=0x7f1ed00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 -- 172.21.15.81:0/359159512 shutdown_connections 2023-11-29T11:16:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 -- 172.21.15.81:0/359159512 wait complete. 2023-11-29T11:16:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 Processor -- start 2023-11-29T11:16:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.178+0000 7f1ed6d67700 1 -- start start 2023-11-29T11:16:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed006a4c0 0x7f1ed0158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ed00b1ae0 0x7f1ed01f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00cf0e0 0x7f1ed00c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0158f70 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed015c6d0 con 0x7f1ed006a4c0 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed015c920 con 0x7f1ed00b1ae0 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00cf0e0 0x7f1ed00c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00cf0e0 0x7f1ed00c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55188/0 (socket says 172.21.15.81:55188) 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 -- 172.21.15.81:0/538028341 learned_addr learned my addr 172.21.15.81:0/538028341 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed5d65700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed006a4c0 0x7f1ed0158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed5564700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ed00b1ae0 0x7f1ed01f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 -- 172.21.15.81:0/538028341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ed00b1ae0 msgr2=0x7f1ed01f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ed00b1ae0 0x7f1ed01f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 -- 172.21.15.81:0/538028341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed006a4c0 msgr2=0x7f1ed0158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed006a4c0 0x7f1ed0158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 -- 172.21.15.81:0/538028341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc009570 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6566700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00cf0e0 0x7f1ed00c6b60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800cc10 tx=0x7f1ec800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ec67fc700 1 -- 172.21.15.81:0/538028341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800ab10 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ec67fc700 1 -- 172.21.15.81:0/538028341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec800ac70 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed00b60e0 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ec67fc700 1 -- 172.21.15.81:0/538028341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8012420 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed00b1eb0 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.182+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed00d08e0 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.186+0000 7f1ec67fc700 1 -- 172.21.15.81:0/538028341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1ec8010050 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.186+0000 7f1ec67fc700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1eb4064ee0 0x7f1eb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.186+0000 7f1ec67fc700 1 -- 172.21.15.81:0/538028341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f1ec8082de0 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.186+0000 7f1ed5d65700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1eb4064ee0 0x7f1eb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.190+0000 7f1ed5d65700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1eb4064ee0 0x7f1eb4067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00b88d0 tx=0x7f1ecc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.194+0000 7f1ec67fc700 1 -- 172.21.15.81:0/538028341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1ec8050e30 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.394+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1ed0072500 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.406+0000 7f1ec67fc700 1 -- 172.21.15.81:0/538028341 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1ec8054450 con 0x7f1ed00cf0e0 2023-11-29T11:16:07.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1eb4064ee0 msgr2=0x7f1eb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1eb4064ee0 0x7f1eb4067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00b88d0 tx=0x7f1ecc008030 comp rx=0 tx=0).stop 2023-11-29T11:16:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00cf0e0 msgr2=0x7f1ed00c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00cf0e0 0x7f1ed00c6b60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800cc10 tx=0x7f1ec800cf20 comp rx=0 tx=0).stop 2023-11-29T11:16:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 shutdown_connections 2023-11-29T11:16:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1eb4064ee0 0x7f1eb4067390 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed00cf0e0 0x7f1ed00c6b60 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ed00b1ae0 0x7f1ed01f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 --2- 172.21.15.81:0/538028341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ed006a4c0 0x7f1ed0158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 >> 172.21.15.81:0/538028341 conn(0x7f1ed009bbd0 msgr2=0x7f1ed00d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 shutdown_connections 2023-11-29T11:16:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.414+0000 7f1ed6d67700 1 -- 172.21.15.81:0/538028341 wait complete. 2023-11-29T11:16:07.429 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 10 and data pool 11 2023-11-29T11:16:07.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:16:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db249d700 1 Processor -- start 2023-11-29T11:16:07.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db249d700 1 -- start start 2023-11-29T11:16:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db249d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac158ef0 0x7f0dac0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db249d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0dac0ad490 0x7f0dac0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db249d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0dac0cad50 0x7f0dac0cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db249d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac0ce290 con 0x7f0dac0ad490 2023-11-29T11:16:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db249d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac0cb710 con 0x7f0dac0cad50 2023-11-29T11:16:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db249d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0adcc0 con 0x7f0dac158ef0 2023-11-29T11:16:07.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db0c9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0dac0ad490 0x7f0dac0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db0c9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0dac0ad490 0x7f0dac0cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55194/0 (socket says 172.21.15.81:55194) 2023-11-29T11:16:07.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db149b700 1 --2- 172.21.15.81:0/1268900039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac158ef0 0x7f0dac0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db0c9a700 1 -- 172.21.15.81:0/1268900039 learned_addr learned my addr 172.21.15.81:0/1268900039 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:07.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db1c9c700 1 --2- 172.21.15.81:0/1268900039 >> v2:172.21.15.176:3300/0 conn(0x7f0dac0cad50 0x7f0dac0cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db149b700 1 -- 172.21.15.81:0/1268900039 >> v2:172.21.15.176:3300/0 conn(0x7f0dac0cad50 msgr2=0x7f0dac0cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:07.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db149b700 1 --2- 172.21.15.81:0/1268900039 >> v2:172.21.15.176:3300/0 conn(0x7f0dac0cad50 0x7f0dac0cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db149b700 1 -- 172.21.15.81:0/1268900039 >> v2:172.21.15.81:3300/0 conn(0x7f0dac0ad490 msgr2=0x7f0dac0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db149b700 1 --2- 172.21.15.81:0/1268900039 >> v2:172.21.15.81:3300/0 conn(0x7f0dac0ad490 0x7f0dac0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db149b700 1 -- 172.21.15.81:0/1268900039 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0cde00 con 0x7f0dac158ef0 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.542+0000 7f0db149b700 1 --2- 172.21.15.81:0/1268900039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac158ef0 0x7f0dac0c8a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009850 tx=0x7f0da8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664923e37e837b6d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0da3fff700 1 -- 172.21.15.81:0/1268900039 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8011830 con 0x7f0dac158ef0 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0da3fff700 1 -- 172.21.15.81:0/1268900039 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8011990 con 0x7f0dac158ef0 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0da3fff700 1 -- 172.21.15.81:0/1268900039 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8011d20 con 0x7f0dac158ef0 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- 172.21.15.81:0/1268900039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac158ef0 msgr2=0x7f0dac0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 --2- 172.21.15.81:0/1268900039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac158ef0 0x7f0dac0c8a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009850 tx=0x7f0da8009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- 172.21.15.81:0/1268900039 shutdown_connections 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 --2- 172.21.15.81:0/1268900039 >> v2:172.21.15.176:3300/0 conn(0x7f0dac0cad50 0x7f0dac0cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 --2- 172.21.15.81:0/1268900039 >> v2:172.21.15.81:3300/0 conn(0x7f0dac0ad490 0x7f0dac0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 --2- 172.21.15.81:0/1268900039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac158ef0 0x7f0dac0c8a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- 172.21.15.81:0/1268900039 >> 172.21.15.81:0/1268900039 conn(0x7f0dac0ce3e0 msgr2=0x7f0dac0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:07.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- 172.21.15.81:0/1268900039 shutdown_connections 2023-11-29T11:16:07.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- 172.21.15.81:0/1268900039 wait complete. 2023-11-29T11:16:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 Processor -- start 2023-11-29T11:16:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- start start 2023-11-29T11:16:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dac0ad490 0x7f0dac0ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac0cad50 0x7f0dac0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dac158ef0 0x7f0dac154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0afab0 con 0x7f0dac0ad490 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0b0d80 con 0x7f0dac158ef0 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db249d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac1548a0 con 0x7f0dac0cad50 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db149b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dac0ad490 0x7f0dac0ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db149b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dac0ad490 0x7f0dac0ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55198/0 (socket says 172.21.15.81:55198) 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db149b700 1 -- 172.21.15.81:0/51236002 learned_addr learned my addr 172.21.15.81:0/51236002 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db0c9a700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac0cad50 0x7f0dac0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db1c9c700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dac158ef0 0x7f0dac154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db0c9a700 1 -- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dac158ef0 msgr2=0x7f0dac154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db0c9a700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dac158ef0 0x7f0dac154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db0c9a700 1 -- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dac0ad490 msgr2=0x7f0dac0ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db0c9a700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dac0ad490 0x7f0dac0ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db0c9a700 1 -- 172.21.15.81:0/51236002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da80094b0 con 0x7f0dac0cad50 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.546+0000 7f0db149b700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dac0ad490 0x7f0dac0ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0db0c9a700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac0cad50 0x7f0dac0b0840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00e820 tx=0x7f0d9c00eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0da1ffb700 1 -- 172.21.15.81:0/51236002 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c013680 con 0x7f0dac0cad50 2023-11-29T11:16:07.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0da1ffb700 1 -- 172.21.15.81:0/51236002 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0137e0 con 0x7f0dac0cad50 2023-11-29T11:16:07.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac06d910 con 0x7f0dac0cad50 2023-11-29T11:16:07.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0da1ffb700 1 -- 172.21.15.81:0/51236002 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c013b90 con 0x7f0dac0cad50 2023-11-29T11:16:07.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac06d630 con 0x7f0dac0cad50 2023-11-29T11:16:07.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac06dbf0 con 0x7f0dac0cad50 2023-11-29T11:16:07.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0da1ffb700 1 -- 172.21.15.81:0/51236002 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0d9c019030 con 0x7f0dac0cad50 2023-11-29T11:16:07.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0da1ffb700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d90064ee0 0x7f0d90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0da1ffb700 1 -- 172.21.15.81:0/51236002 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0d9c082450 con 0x7f0dac0cad50 2023-11-29T11:16:07.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.550+0000 7f0db149b700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d90064ee0 0x7f0d90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.554+0000 7f0db149b700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d90064ee0 0x7f0d90067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0da8000c00 tx=0x7f0da8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.562+0000 7f0da1ffb700 1 -- 172.21.15.81:0/51236002 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0d9c050550 con 0x7f0dac0cad50 2023-11-29T11:16:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.726+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dac072500 con 0x7f0dac0cad50 2023-11-29T11:16:07.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0da1ffb700 1 -- 172.21.15.81:0/51236002 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18042 (secure 0 0 0) 0x7f0d9c059090 con 0x7f0dac0cad50 2023-11-29T11:16:07.734 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:16:07.397266+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:16:05.224956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-29T11:16:06.381228+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:16:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d90064ee0 msgr2=0x7f0d90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d90064ee0 0x7f0d90067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0da8000c00 tx=0x7f0da8008030 comp rx=0 tx=0).stop 2023-11-29T11:16:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac0cad50 msgr2=0x7f0dac0b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac0cad50 0x7f0dac0b0840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00e820 tx=0x7f0d9c00eb30 comp rx=0 tx=0).stop 2023-11-29T11:16:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 shutdown_connections 2023-11-29T11:16:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0d90064ee0 0x7f0d90067390 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dac158ef0 0x7f0dac154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dac0cad50 0x7f0dac0b0840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 --2- 172.21.15.81:0/51236002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dac0ad490 0x7f0dac0ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 >> 172.21.15.81:0/51236002 conn(0x7f0dac0ce3e0 msgr2=0x7f0dac1575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:07.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 shutdown_connections 2023-11-29T11:16:07.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.730+0000 7f0db249d700 1 -- 172.21.15.81:0/51236002 wait complete. 2023-11-29T11:16:07.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:16:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.854+0000 7f22974fc700 1 Processor -- start 2023-11-29T11:16:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- start start 2023-11-29T11:16:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2290158e60 0x7f22900c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f22900ad490 0x7f22900cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900cd8f0 con 0x7f22900cad50 2023-11-29T11:16:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22900add00 con 0x7f2290158e60 2023-11-29T11:16:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22900cc4f0 con 0x7f22900ad490 2023-11-29T11:16:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22964fa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2290158e60 0x7f22900c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f2296cfb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f22900cad50 0x7f229006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37112/0 (socket says 172.21.15.81:37112) 2023-11-29T11:16:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f2296cfb700 1 -- 172.21.15.81:0/3736122271 learned_addr learned my addr 172.21.15.81:0/3736122271 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f2295cf9700 1 --2- 172.21.15.81:0/3736122271 >> v2:172.21.15.176:3300/0 conn(0x7f22900ad490 0x7f22900cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22964fa700 1 -- 172.21.15.81:0/3736122271 >> v2:172.21.15.176:3300/0 conn(0x7f22900ad490 msgr2=0x7f22900cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:07.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22954f8700 1 -- 172.21.15.81:0/3736122271 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792498158 0 0) 0x7f22900cd8f0 con 0x7f22900cad50 2023-11-29T11:16:07.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22964fa700 1 --2- 172.21.15.81:0/3736122271 >> v2:172.21.15.176:3300/0 conn(0x7f22900ad490 0x7f22900cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22964fa700 1 -- 172.21.15.81:0/3736122271 >> v1:172.21.15.81:6789/0 conn(0x7f22900cad50 legacy=0x7f229006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22964fa700 1 -- 172.21.15.81:0/3736122271 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229006dc60 con 0x7f2290158e60 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22964fa700 1 --2- 172.21.15.81:0/3736122271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2290158e60 0x7f22900c8a30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f229006f8b0 tx=0x7f2280009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c914e283d00c72b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22954f8700 1 -- 172.21.15.81:0/3736122271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280011830 con 0x7f2290158e60 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22954f8700 1 -- 172.21.15.81:0/3736122271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280011990 con 0x7f2290158e60 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22954f8700 1 -- 172.21.15.81:0/3736122271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280011d20 con 0x7f2290158e60 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- 172.21.15.81:0/3736122271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2290158e60 msgr2=0x7f22900c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 --2- 172.21.15.81:0/3736122271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2290158e60 0x7f22900c8a30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f229006f8b0 tx=0x7f2280009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- 172.21.15.81:0/3736122271 shutdown_connections 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 --2- 172.21.15.81:0/3736122271 >> v2:172.21.15.176:3300/0 conn(0x7f22900ad490 0x7f22900cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 --2- 172.21.15.81:0/3736122271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2290158e60 0x7f22900c8a30 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- 172.21.15.81:0/3736122271 >> 172.21.15.81:0/3736122271 conn(0x7f22900ce3e0 msgr2=0x7f22900ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- 172.21.15.81:0/3736122271 shutdown_connections 2023-11-29T11:16:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.858+0000 7f22974fc700 1 -- 172.21.15.81:0/3736122271 wait complete. 2023-11-29T11:16:07.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 Processor -- start 2023-11-29T11:16:07.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 -- start start 2023-11-29T11:16:07.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22900ad490 0x7f22901503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22900cad50 0x7f229006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2290158e60 0x7f2290155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22901508f0 con 0x7f22900ad490 2023-11-29T11:16:07.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22900b8f10 con 0x7f22900cad50 2023-11-29T11:16:07.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22900706f0 con 0x7f2290158e60 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22900ad490 0x7f22901503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22900ad490 0x7f22901503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55226/0 (socket says 172.21.15.81:55226) 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 -- 172.21.15.81:0/591631956 learned_addr learned my addr 172.21.15.81:0/591631956 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f2296cfb700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2290158e60 0x7f2290155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f2295cf9700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22900cad50 0x7f229006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 -- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2290158e60 msgr2=0x7f2290155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2290158e60 0x7f2290155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 -- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22900cad50 msgr2=0x7f229006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22900cad50 0x7f229006fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 -- 172.21.15.81:0/591631956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800094b0 con 0x7f22900ad490 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f2295cf9700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22900cad50 0x7f229006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:07.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22964fa700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22900ad490 0x7f22901503b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2280009ba0 tx=0x7f2280004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f2286ffd700 1 -- 172.21.15.81:0/591631956 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22800045d0 con 0x7f22900ad490 2023-11-29T11:16:07.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f2286ffd700 1 -- 172.21.15.81:0/591631956 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228001e070 con 0x7f22900ad490 2023-11-29T11:16:07.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2290159230 con 0x7f22900ad490 2023-11-29T11:16:07.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f2286ffd700 1 -- 172.21.15.81:0/591631956 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22800038c0 con 0x7f22900ad490 2023-11-29T11:16:07.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.862+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22900cde90 con 0x7f22900ad490 2023-11-29T11:16:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.866+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229006d6a0 con 0x7f22900ad490 2023-11-29T11:16:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.866+0000 7f2286ffd700 1 -- 172.21.15.81:0/591631956 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f228000f050 con 0x7f22900ad490 2023-11-29T11:16:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.866+0000 7f2286ffd700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2274064ee0 0x7f2274067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.866+0000 7f2286ffd700 1 -- 172.21.15.81:0/591631956 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2280082e50 con 0x7f22900ad490 2023-11-29T11:16:07.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.866+0000 7f2295cf9700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2274064ee0 0x7f2274067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:07.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.866+0000 7f2295cf9700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2274064ee0 0x7f2274067390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f22900c5100 tx=0x7f228c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:07.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:07.874+0000 7f2286ffd700 1 -- 172.21.15.81:0/591631956 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2280050eb0 con 0x7f22900ad490 2023-11-29T11:16:08.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.034+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2290072500 con 0x7f22900ad490 2023-11-29T11:16:08.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f2286ffd700 1 -- 172.21.15.81:0/591631956 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18042 (secure 0 0 0) 0x7f2280020090 con 0x7f22900ad490 2023-11-29T11:16:08.043 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:08.043 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:16:07.397266+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:16:05.224956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-29T11:16:06.381228+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:16:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2274064ee0 msgr2=0x7f2274067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2274064ee0 0x7f2274067390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f22900c5100 tx=0x7f228c008040 comp rx=0 tx=0).stop 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22900ad490 msgr2=0x7f22901503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22900ad490 0x7f22901503b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2280009ba0 tx=0x7f2280004770 comp rx=0 tx=0).stop 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 shutdown_connections 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2274064ee0 0x7f2274067390 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2290158e60 0x7f2290155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22900cad50 0x7f229006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.038+0000 7f22974fc700 1 --2- 172.21.15.81:0/591631956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22900ad490 0x7f22901503b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.042+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 >> 172.21.15.81:0/591631956 conn(0x7f22900ce3e0 msgr2=0x7f229006a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.042+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 shutdown_connections 2023-11-29T11:16:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.042+0000 7f22974fc700 1 -- 172.21.15.81:0/591631956 wait complete. 2023-11-29T11:16:08.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-29T11:16:08.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.174+0000 7fbeaf19e700 1 Processor -- start 2023-11-29T11:16:08.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.174+0000 7fbeaf19e700 1 -- start start 2023-11-29T11:16:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.174+0000 7fbeaf19e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbea80b1ae0 0x7fbea806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.174+0000 7fbeaf19e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea806a4c0 0x7fbea80d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.174+0000 7fbeaf19e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea806a9c0 con 0x7fbea80cf0e0 2023-11-29T11:16:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.174+0000 7fbeaf19e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea806aca0 con 0x7fbea80b1ae0 2023-11-29T11:16:08.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.174+0000 7fbeaf19e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea806af80 con 0x7fbea806a4c0 2023-11-29T11:16:08.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeae19c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbea80b1ae0 0x7fbea806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeae99d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbea80cf0e0 0x7fbea80b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37126/0 (socket says 172.21.15.81:37126) 2023-11-29T11:16:08.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeae99d700 1 -- 172.21.15.81:0/4038246195 learned_addr learned my addr 172.21.15.81:0/4038246195 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbead99b700 1 --2- 172.21.15.81:0/4038246195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea806a4c0 0x7fbea80d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbead19a700 1 -- 172.21.15.81:0/4038246195 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287907840 0 0) 0x7fbea806a9c0 con 0x7fbea80cf0e0 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbead19a700 1 -- 172.21.15.81:0/4038246195 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe940035d0 con 0x7fbea80cf0e0 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeae19c700 1 -- 172.21.15.81:0/4038246195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea806a4c0 msgr2=0x7fbea80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeae19c700 1 --2- 172.21.15.81:0/4038246195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea806a4c0 0x7fbea80d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeae19c700 1 -- 172.21.15.81:0/4038246195 >> v1:172.21.15.81:6789/0 conn(0x7fbea80cf0e0 legacy=0x7fbea80b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeae19c700 1 -- 172.21.15.81:0/4038246195 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80b4380 con 0x7fbea80b1ae0 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbead99b700 1 --2- 172.21.15.81:0/4038246195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea806a4c0 0x7fbea80d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:08.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeae19c700 1 --2- 172.21.15.81:0/4038246195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea80b1ae0 0x7fbea806d8e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009850 tx=0x7fbe98009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445e60ac0ec14272 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:08.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbead19a700 1 -- 172.21.15.81:0/4038246195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98011830 con 0x7fbea80b1ae0 2023-11-29T11:16:08.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbead19a700 1 -- 172.21.15.81:0/4038246195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe98011990 con 0x7fbea80b1ae0 2023-11-29T11:16:08.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbead19a700 1 -- 172.21.15.81:0/4038246195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98011d00 con 0x7fbea80b1ae0 2023-11-29T11:16:08.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeaf19e700 1 -- 172.21.15.81:0/4038246195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea80b1ae0 msgr2=0x7fbea806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/4038246195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea80b1ae0 0x7fbea806d8e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009850 tx=0x7fbe98009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeaf19e700 1 -- 172.21.15.81:0/4038246195 shutdown_connections 2023-11-29T11:16:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/4038246195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea806a4c0 0x7fbea80d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/4038246195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea80b1ae0 0x7fbea806d8e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeaf19e700 1 -- 172.21.15.81:0/4038246195 >> 172.21.15.81:0/4038246195 conn(0x7fbea809bbd0 msgr2=0x7fbea80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeaf19e700 1 -- 172.21.15.81:0/4038246195 shutdown_connections 2023-11-29T11:16:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.178+0000 7fbeaf19e700 1 -- 172.21.15.81:0/4038246195 wait complete. 2023-11-29T11:16:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 Processor -- start 2023-11-29T11:16:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 -- start start 2023-11-29T11:16:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea806a4c0 0x7fbea81f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbea80b1ae0 0x7fbea81f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea80cf0e0 0x7fbea80d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea81f28c0 con 0x7fbea806a4c0 2023-11-29T11:16:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea815f910 con 0x7fbea80b1ae0 2023-11-29T11:16:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea815c770 con 0x7fbea80cf0e0 2023-11-29T11:16:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea806a4c0 0x7fbea81f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea806a4c0 0x7fbea81f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55242/0 (socket says 172.21.15.81:55242) 2023-11-29T11:16:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 -- 172.21.15.81:0/399768742 learned_addr learned my addr 172.21.15.81:0/399768742 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae99d700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea80cf0e0 0x7fbea80d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbead99b700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbea80b1ae0 0x7fbea81f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 -- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea80cf0e0 msgr2=0x7fbea80d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea80cf0e0 0x7fbea80d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 -- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbea80b1ae0 msgr2=0x7fbea81f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbea80b1ae0 0x7fbea81f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 -- 172.21.15.81:0/399768742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe980094b0 con 0x7fbea806a4c0 2023-11-29T11:16:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbead99b700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbea80b1ae0 0x7fbea81f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeae19c700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea806a4c0 0x7fbea81f2380 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbe980090b0 tx=0x7fbe98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbe9effd700 1 -- 172.21.15.81:0/399768742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980036c0 con 0x7fbea806a4c0 2023-11-29T11:16:08.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea80b60e0 con 0x7fbea806a4c0 2023-11-29T11:16:08.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbe9effd700 1 -- 172.21.15.81:0/399768742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9801f070 con 0x7fbea806a4c0 2023-11-29T11:16:08.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbe9effd700 1 -- 172.21.15.81:0/399768742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98003aa0 con 0x7fbea806a4c0 2023-11-29T11:16:08.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.182+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea80b1eb0 con 0x7fbea806a4c0 2023-11-29T11:16:08.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.186+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea80d08e0 con 0x7fbea806a4c0 2023-11-29T11:16:08.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.186+0000 7fbe9effd700 1 -- 172.21.15.81:0/399768742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe9800f050 con 0x7fbea806a4c0 2023-11-29T11:16:08.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.186+0000 7fbe9effd700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe8c064ee0 0x7fbe8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.186+0000 7fbe9effd700 1 -- 172.21.15.81:0/399768742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbe98021070 con 0x7fbea806a4c0 2023-11-29T11:16:08.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.186+0000 7fbead99b700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe8c064ee0 0x7fbe8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.186+0000 7fbead99b700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe8c064ee0 0x7fbe8c067390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbea809c560 tx=0x7fbea4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:08.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.194+0000 7fbe9effd700 1 -- 172.21.15.81:0/399768742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbe980517c0 con 0x7fbea806a4c0 2023-11-29T11:16:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.398+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbea8072500 con 0x7fbea806a4c0 2023-11-29T11:16:08.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.406+0000 7fbe9effd700 1 -- 172.21.15.81:0/399768742 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbe980150b0 con 0x7fbea806a4c0 2023-11-29T11:16:08.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe8c064ee0 msgr2=0x7fbe8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe8c064ee0 0x7fbe8c067390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbea809c560 tx=0x7fbea4008040 comp rx=0 tx=0).stop 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea806a4c0 msgr2=0x7fbea81f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea806a4c0 0x7fbea81f2380 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbe980090b0 tx=0x7fbe98004770 comp rx=0 tx=0).stop 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 shutdown_connections 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe8c064ee0 0x7fbe8c067390 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbea80cf0e0 0x7fbea80d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbea80b1ae0 0x7fbea81f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 --2- 172.21.15.81:0/399768742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea806a4c0 0x7fbea81f2380 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 >> 172.21.15.81:0/399768742 conn(0x7fbea809bbd0 msgr2=0x7fbea815bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 shutdown_connections 2023-11-29T11:16:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.410+0000 7fbeaf19e700 1 -- 172.21.15.81:0/399768742 wait complete. 2023-11-29T11:16:08.431 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-29T11:16:08.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-29T11:16:08.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.542+0000 7fdad928b700 1 Processor -- start 2023-11-29T11:16:08.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad928b700 1 -- start start 2023-11-29T11:16:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad928b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40b2d30 0x7fdad40ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad928b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad409c0e0 con 0x7fdad40cc2f0 2023-11-29T11:16:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad928b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40b13e0 con 0x7fdad415a3e0 2023-11-29T11:16:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad928b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40b16c0 con 0x7fdad40b2d30 2023-11-29T11:16:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdad40cc2f0 0x7fdad40cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37130/0 (socket says 172.21.15.81:37130) 2023-11-29T11:16:08.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad3fff700 1 -- 172.21.15.81:0/1411050508 learned_addr learned my addr 172.21.15.81:0/1411050508 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:08.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad8a8a700 1 --2- 172.21.15.81:0/1411050508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40b2d30 0x7fdad40ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad37fe700 1 -- 172.21.15.81:0/1411050508 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656393684 0 0) 0x7fdad409c0e0 con 0x7fdad40cc2f0 2023-11-29T11:16:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad37fe700 1 -- 172.21.15.81:0/1411050508 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac00035d0 con 0x7fdad40cc2f0 2023-11-29T11:16:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad37fe700 1 -- 172.21.15.81:0/1411050508 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694294224 0 0) 0x7fdad40b13e0 con 0x7fdad415a3e0 2023-11-29T11:16:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad37fe700 1 -- 172.21.15.81:0/1411050508 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad409c0e0 con 0x7fdad415a3e0 2023-11-29T11:16:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad8a8a700 1 -- 172.21.15.81:0/1411050508 >> v1:172.21.15.176:6789/0 conn(0x7fdad415a3e0 legacy=0x7fdad4069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad37fe700 1 -- 172.21.15.81:0/1411050508 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3522445643 0 0) 0x7fdac00035d0 con 0x7fdad40cc2f0 2023-11-29T11:16:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad8a8a700 1 -- 172.21.15.81:0/1411050508 >> v1:172.21.15.81:6789/0 conn(0x7fdad40cc2f0 legacy=0x7fdad40cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad8a8a700 1 -- 172.21.15.81:0/1411050508 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40b19a0 con 0x7fdad40b2d30 2023-11-29T11:16:08.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad8a8a700 1 --2- 172.21.15.81:0/1411050508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40b2d30 0x7fdad40ac280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009dc0 tx=0x7fdacc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f33d0f208e6df42 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:08.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad37fe700 1 -- 172.21.15.81:0/1411050508 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00e070 con 0x7fdad40b2d30 2023-11-29T11:16:08.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad37fe700 1 -- 172.21.15.81:0/1411050508 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc003a40 con 0x7fdad40b2d30 2023-11-29T11:16:08.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.546+0000 7fdad37fe700 1 -- 172.21.15.81:0/1411050508 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4001670 con 0x7fdad40b2d30 2023-11-29T11:16:08.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 -- 172.21.15.81:0/1411050508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40b2d30 msgr2=0x7fdad40ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 --2- 172.21.15.81:0/1411050508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40b2d30 0x7fdad40ac280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009dc0 tx=0x7fdacc00b330 comp rx=0 tx=0).stop 2023-11-29T11:16:08.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 -- 172.21.15.81:0/1411050508 shutdown_connections 2023-11-29T11:16:08.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 --2- 172.21.15.81:0/1411050508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40b2d30 0x7fdad40ac280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 -- 172.21.15.81:0/1411050508 >> 172.21.15.81:0/1411050508 conn(0x7fdad40cae70 msgr2=0x7fdad40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:08.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 -- 172.21.15.81:0/1411050508 shutdown_connections 2023-11-29T11:16:08.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 -- 172.21.15.81:0/1411050508 wait complete. 2023-11-29T11:16:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 Processor -- start 2023-11-29T11:16:08.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.550+0000 7fdad928b700 1 -- start start 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdad40b2d30 0x7fdad415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40cc2f0 0x7fdad406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdad415a3e0 0x7fdad406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415cd30 con 0x7fdad40b2d30 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad406dba0 con 0x7fdad415a3e0 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad41f2380 con 0x7fdad40cc2f0 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdad40b2d30 0x7fdad415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdad40b2d30 0x7fdad415c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55252/0 (socket says 172.21.15.81:55252) 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 -- 172.21.15.81:0/854475739 learned_addr learned my addr 172.21.15.81:0/854475739 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:08.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdacb7fe700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40cc2f0 0x7fdad406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad8a8a700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdad415a3e0 0x7fdad406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 -- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40cc2f0 msgr2=0x7fdad406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40cc2f0 0x7fdad406d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 -- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdad415a3e0 msgr2=0x7fdad406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdad415a3e0 0x7fdad406bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 -- 172.21.15.81:0/854475739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc009a70 con 0x7fdad40b2d30 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad8a8a700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdad415a3e0 0x7fdad406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad3fff700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdad40b2d30 0x7fdad415c7f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c780 tx=0x7fdac400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad17fa700 1 -- 172.21.15.81:0/854475739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4004ca0 con 0x7fdad40b2d30 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad17fa700 1 -- 172.21.15.81:0/854475739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4004e20 con 0x7fdad40b2d30 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad406a350 con 0x7fdad40b2d30 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad17fa700 1 -- 172.21.15.81:0/854475739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4007310 con 0x7fdad40b2d30 2023-11-29T11:16:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40b1c80 con 0x7fdad40b2d30 2023-11-29T11:16:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.554+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad40b21a0 con 0x7fdad40b2d30 2023-11-29T11:16:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.558+0000 7fdad17fa700 1 -- 172.21.15.81:0/854475739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdac401a020 con 0x7fdad40b2d30 2023-11-29T11:16:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.558+0000 7fdad17fa700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdab4064ee0 0x7fdab4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.558+0000 7fdad17fa700 1 -- 172.21.15.81:0/854475739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdac4081cd0 con 0x7fdad40b2d30 2023-11-29T11:16:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.558+0000 7fdacb7fe700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdab4064ee0 0x7fdab4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.558+0000 7fdacb7fe700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdab4064ee0 0x7fdab4067390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdad40c84c0 tx=0x7fdabc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:08.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.566+0000 7fdad17fa700 1 -- 172.21.15.81:0/854475739 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdac404fcb0 con 0x7fdad40b2d30 2023-11-29T11:16:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:08.758+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdad40b13e0 con 0x7fdad40b2d30 2023-11-29T11:16:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.426+0000 7fdad17fa700 1 -- 172.21.15.81:0/854475739 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdac40532d0 con 0x7fdad40b2d30 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdab4064ee0 msgr2=0x7fdab4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdab4064ee0 0x7fdab4067390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdad40c84c0 tx=0x7fdabc009040 comp rx=0 tx=0).stop 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdad40b2d30 msgr2=0x7fdad415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdad40b2d30 0x7fdad415c7f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c780 tx=0x7fdac400ca90 comp rx=0 tx=0).stop 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 shutdown_connections 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdab4064ee0 0x7fdab4067390 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdad415a3e0 0x7fdad406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdad40cc2f0 0x7fdad406d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 --2- 172.21.15.81:0/854475739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdad40b2d30 0x7fdad415c7f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 >> 172.21.15.81:0/854475739 conn(0x7fdad40cae70 msgr2=0x7fdad40ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 shutdown_connections 2023-11-29T11:16:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.430+0000 7fdad928b700 1 -- 172.21.15.81:0/854475739 wait complete. 2023-11-29T11:16:09.453 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-29T11:16:09.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:16:09.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.570+0000 7fc3e97de700 1 Processor -- start 2023-11-29T11:16:09.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.570+0000 7fc3e97de700 1 -- start start 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.570+0000 7fc3e97de700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3e40b1ca0 0x7fc3e40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.570+0000 7fc3e97de700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc3e40d2780 0x7fc3e40d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.570+0000 7fc3e97de700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e40cf070 con 0x7fc3e406a330 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.570+0000 7fc3e97de700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40d3140 con 0x7fc3e40b1ca0 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.570+0000 7fc3e97de700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40b2070 con 0x7fc3e40d2780 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e37fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3e406a330 0x7fc3e40cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37142/0 (socket says 172.21.15.81:37142) 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e37fe700 1 -- 172.21.15.81:0/1688000560 learned_addr learned my addr 172.21.15.81:0/1688000560 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e3fff700 1 --2- 172.21.15.81:0/1688000560 >> v2:172.21.15.81:3300/0 conn(0x7fc3e40b1ca0 0x7fc3e40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e8fdd700 1 --2- 172.21.15.81:0/1688000560 >> v2:172.21.15.176:3300/0 conn(0x7fc3e40d2780 0x7fc3e40d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e2ffd700 1 -- 172.21.15.81:0/1688000560 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234703709 0 0) 0x7fc3e40cf070 con 0x7fc3e406a330 2023-11-29T11:16:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e2ffd700 1 -- 172.21.15.81:0/1688000560 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3cc0035d0 con 0x7fc3e406a330 2023-11-29T11:16:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e3fff700 1 -- 172.21.15.81:0/1688000560 >> v2:172.21.15.176:3300/0 conn(0x7fc3e40d2780 msgr2=0x7fc3e40d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e3fff700 1 --2- 172.21.15.81:0/1688000560 >> v2:172.21.15.176:3300/0 conn(0x7fc3e40d2780 0x7fc3e40d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e3fff700 1 -- 172.21.15.81:0/1688000560 >> v1:172.21.15.81:6789/0 conn(0x7fc3e406a330 legacy=0x7fc3e40cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e3fff700 1 -- 172.21.15.81:0/1688000560 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e406a8a0 con 0x7fc3e40b1ca0 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e3fff700 1 --2- 172.21.15.81:0/1688000560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e40b1ca0 0x7fc3e40b6250 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40b56f0 tx=0x7fc3d4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42d22928dc0707 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e2ffd700 1 -- 172.21.15.81:0/1688000560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011830 con 0x7fc3e40b1ca0 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e2ffd700 1 -- 172.21.15.81:0/1688000560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d4011990 con 0x7fc3e40b1ca0 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e2ffd700 1 -- 172.21.15.81:0/1688000560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011d00 con 0x7fc3e40b1ca0 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 -- 172.21.15.81:0/1688000560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e40b1ca0 msgr2=0x7fc3e40b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 --2- 172.21.15.81:0/1688000560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e40b1ca0 0x7fc3e40b6250 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40b56f0 tx=0x7fc3d4009b30 comp rx=0 tx=0).stop 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 -- 172.21.15.81:0/1688000560 shutdown_connections 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 --2- 172.21.15.81:0/1688000560 >> v2:172.21.15.176:3300/0 conn(0x7fc3e40d2780 0x7fc3e40d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 --2- 172.21.15.81:0/1688000560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e40b1ca0 0x7fc3e40b6250 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 -- 172.21.15.81:0/1688000560 >> 172.21.15.81:0/1688000560 conn(0x7fc3e40b5740 msgr2=0x7fc3e40b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:09.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 -- 172.21.15.81:0/1688000560 shutdown_connections 2023-11-29T11:16:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 -- 172.21.15.81:0/1688000560 wait complete. 2023-11-29T11:16:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.574+0000 7fc3e97de700 1 Processor -- start 2023-11-29T11:16:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 -- start start 2023-11-29T11:16:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e406a330 0x7fc3e4155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3e40b1ca0 0x7fc3e40c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3e40d2780 0x7fc3e40cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40c9e00 con 0x7fc3e406a330 2023-11-29T11:16:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40c8bf0 con 0x7fc3e40d2780 2023-11-29T11:16:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40c9190 con 0x7fc3e40b1ca0 2023-11-29T11:16:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e406a330 0x7fc3e4155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e406a330 0x7fc3e4155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55282/0 (socket says 172.21.15.81:55282) 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 -- 172.21.15.81:0/3061714704 learned_addr learned my addr 172.21.15.81:0/3061714704 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e8fdd700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3e40d2780 0x7fc3e40cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e37fe700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3e40b1ca0 0x7fc3e40c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 -- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3e40b1ca0 msgr2=0x7fc3e40c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3e40b1ca0 0x7fc3e40c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 -- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3e40d2780 msgr2=0x7fc3e40cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3e40d2780 0x7fc3e40cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 -- 172.21.15.81:0/3061714704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d40094b0 con 0x7fc3e406a330 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e37fe700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3e40b1ca0 0x7fc3e40c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e3fff700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e406a330 0x7fc3e4155300 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009b70 tx=0x7fc3d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e0ff9700 1 -- 172.21.15.81:0/3061714704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40045d0 con 0x7fc3e406a330 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e0ff9700 1 -- 172.21.15.81:0/3061714704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d401e070 con 0x7fc3e406a330 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e406ae60 con 0x7fc3e406a330 2023-11-29T11:16:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e0ff9700 1 -- 172.21.15.81:0/3061714704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40038c0 con 0x7fc3e406a330 2023-11-29T11:16:09.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.578+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e406ab80 con 0x7fc3e406a330 2023-11-29T11:16:09.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.582+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e406b140 con 0x7fc3e406a330 2023-11-29T11:16:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.582+0000 7fc3e0ff9700 1 -- 172.21.15.81:0/3061714704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc3d400f050 con 0x7fc3e406a330 2023-11-29T11:16:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.582+0000 7fc3e0ff9700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3d0064f10 0x7fc3d00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.582+0000 7fc3e0ff9700 1 -- 172.21.15.81:0/3061714704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc3d4082ff0 con 0x7fc3e406a330 2023-11-29T11:16:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.582+0000 7fc3e37fe700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3d0064f10 0x7fc3d00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.582+0000 7fc3e37fe700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3d0064f10 0x7fc3d00673c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40c8420 tx=0x7fc3d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.590+0000 7fc3e0ff9700 1 -- 172.21.15.81:0/3061714704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc3d40b3400 con 0x7fc3e406a330 2023-11-29T11:16:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.794+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3e4072c20 con 0x7fc3e406a330 2023-11-29T11:16:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.794+0000 7fc3e0ff9700 1 -- 172.21.15.81:0/3061714704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4650 (secure 0 0 0) 0x7fc3d4050ee0 con 0x7fc3e406a330 2023-11-29T11:16:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:09.800 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:09.416362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3d0064f10 msgr2=0x7fc3d00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3d0064f10 0x7fc3d00673c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40c8420 tx=0x7fc3d8009040 comp rx=0 tx=0).stop 2023-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e406a330 msgr2=0x7fc3e4155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e406a330 0x7fc3e4155300 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009b70 tx=0x7fc3d4004770 comp rx=0 tx=0).stop 2023-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 shutdown_connections 2023-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3d0064f10 0x7fc3d00673c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3e40d2780 0x7fc3e40cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3e40b1ca0 0x7fc3e40c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 --2- 172.21.15.81:0/3061714704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3e406a330 0x7fc3e4155300 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 >> 172.21.15.81:0/3061714704 conn(0x7fc3e40b5740 msgr2=0x7fc3e40cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 shutdown_connections 2023-11-29T11:16:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.798+0000 7fc3e97de700 1 -- 172.21.15.81:0/3061714704 wait complete. 2023-11-29T11:16:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 31 2023-11-29T11:16:09.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:16:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7efff490f700 1 Processor -- start 2023-11-29T11:16:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7efff490f700 1 -- start start 2023-11-29T11:16:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7efff490f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efff015beb0 0x7efff00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7efff490f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff015c280 0x7efff00cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7efff490f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff00ccc40 con 0x7efff00ce6c0 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7efff490f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff00cc960 con 0x7efff015beb0 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7efff490f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00c9580 con 0x7efff015c280 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7effef59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efff00ce6c0 0x7efff006ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60106/0 (socket says 172.21.15.81:60106) 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7effef59e700 1 -- 172.21.15.81:0/1453721073 learned_addr learned my addr 172.21.15.81:0/1453721073 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7effeed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efff015beb0 0x7efff00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7effee59c700 1 --2- 172.21.15.81:0/1453721073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff015c280 0x7efff00cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7effedd9b700 1 -- 172.21.15.81:0/1453721073 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136301336 0 0) 0x7efff00ccc40 con 0x7efff00ce6c0 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.918+0000 7effedd9b700 1 -- 172.21.15.81:0/1453721073 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd80035d0 con 0x7efff00ce6c0 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effeed9d700 1 -- 172.21.15.81:0/1453721073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff015c280 msgr2=0x7efff00cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effeed9d700 1 --2- 172.21.15.81:0/1453721073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff015c280 0x7efff00cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effeed9d700 1 -- 172.21.15.81:0/1453721073 >> v1:172.21.15.81:6789/0 conn(0x7efff00ce6c0 legacy=0x7efff006ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effeed9d700 1 -- 172.21.15.81:0/1453721073 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00c9860 con 0x7efff015beb0 2023-11-29T11:16:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effeed9d700 1 --2- 172.21.15.81:0/1453721073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015beb0 0x7efff00caf40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7effe8009d90 tx=0x7effe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c87de6ac641379 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effedd9b700 1 -- 172.21.15.81:0/1453721073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe800e070 con 0x7efff015beb0 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effedd9b700 1 -- 172.21.15.81:0/1453721073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe800bb20 con 0x7efff015beb0 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effedd9b700 1 -- 172.21.15.81:0/1453721073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8012430 con 0x7efff015beb0 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- 172.21.15.81:0/1453721073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015beb0 msgr2=0x7efff00caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 --2- 172.21.15.81:0/1453721073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015beb0 0x7efff00caf40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7effe8009d90 tx=0x7effe800b330 comp rx=0 tx=0).stop 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- 172.21.15.81:0/1453721073 shutdown_connections 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 --2- 172.21.15.81:0/1453721073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff015c280 0x7efff00cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 --2- 172.21.15.81:0/1453721073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015beb0 0x7efff00caf40 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- 172.21.15.81:0/1453721073 >> 172.21.15.81:0/1453721073 conn(0x7efff006c640 msgr2=0x7efff006ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- 172.21.15.81:0/1453721073 shutdown_connections 2023-11-29T11:16:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- 172.21.15.81:0/1453721073 wait complete. 2023-11-29T11:16:09.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 Processor -- start 2023-11-29T11:16:09.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- start start 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00ce6c0 0x7efff014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015beb0 0x7efff006ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015c280 0x7efff006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff01f59b0 con 0x7efff015c280 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff01f4da0 con 0x7efff015beb0 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7efff490f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff01f5080 con 0x7efff00ce6c0 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effef59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015c280 0x7efff006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effef59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015c280 0x7efff006b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57860/0 (socket says 172.21.15.81:57860) 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effef59e700 1 -- 172.21.15.81:0/2506972217 learned_addr learned my addr 172.21.15.81:0/2506972217 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effee59c700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015beb0 0x7efff006ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effeed9d700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00ce6c0 0x7efff014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effef59e700 1 -- 172.21.15.81:0/2506972217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00ce6c0 msgr2=0x7efff014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effef59e700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00ce6c0 0x7efff014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effef59e700 1 -- 172.21.15.81:0/2506972217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015beb0 msgr2=0x7efff006ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effef59e700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015beb0 0x7efff006ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.922+0000 7effef59e700 1 -- 172.21.15.81:0/2506972217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe8009a70 con 0x7efff015c280 2023-11-29T11:16:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7effef59e700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015c280 0x7efff006b1d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7effe000c4f0 tx=0x7effe000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7effd77fe700 1 -- 172.21.15.81:0/2506972217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0005d90 con 0x7efff015c280 2023-11-29T11:16:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7effd77fe700 1 -- 172.21.15.81:0/2506972217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe00070d0 con 0x7efff015c280 2023-11-29T11:16:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff00ce4c0 con 0x7efff015c280 2023-11-29T11:16:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7effd77fe700 1 -- 172.21.15.81:0/2506972217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0007460 con 0x7efff015c280 2023-11-29T11:16:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff00ce330 con 0x7efff015c280 2023-11-29T11:16:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff00cb480 con 0x7efff015c280 2023-11-29T11:16:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7effd77fe700 1 -- 172.21.15.81:0/2506972217 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7effe0019030 con 0x7efff015c280 2023-11-29T11:16:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7effd77fe700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effdc064ee0 0x7effdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7effd77fe700 1 -- 172.21.15.81:0/2506972217 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7effe0081310 con 0x7efff015c280 2023-11-29T11:16:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.926+0000 7effeed9d700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effdc064ee0 0x7effdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.930+0000 7effeed9d700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effdc064ee0 0x7effdc067390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7effe8014040 tx=0x7effe8011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:09.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:09.934+0000 7effd77fe700 1 -- 172.21.15.81:0/2506972217 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7effe004f2f0 con 0x7efff015c280 2023-11-29T11:16:10.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.098+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efff0070ae0 con 0x7efff015c280 2023-11-29T11:16:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.098+0000 7effd77fe700 1 -- 172.21.15.81:0/2506972217 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18029 (secure 0 0 0) 0x7effe0052910 con 0x7efff015c280 2023-11-29T11:16:10.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:10.105 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:16:08.402649+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:16:05.224956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-29T11:16:06.381228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:16:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effdc064ee0 msgr2=0x7effdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effdc064ee0 0x7effdc067390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7effe8014040 tx=0x7effe8011000 comp rx=0 tx=0).stop 2023-11-29T11:16:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015c280 msgr2=0x7efff006b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015c280 0x7efff006b1d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7effe000c4f0 tx=0x7effe000c800 comp rx=0 tx=0).stop 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 shutdown_connections 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7effdc064ee0 0x7effdc067390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015c280 0x7efff006b1d0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015beb0 0x7efff006ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 --2- 172.21.15.81:0/2506972217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00ce6c0 0x7efff014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 >> 172.21.15.81:0/2506972217 conn(0x7efff006c640 msgr2=0x7efff00abb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 shutdown_connections 2023-11-29T11:16:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.102+0000 7efff490f700 1 -- 172.21.15.81:0/2506972217 wait complete. 2023-11-29T11:16:10.120 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-29T11:16:10.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:16:10.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f686893a700 1 Processor -- start 2023-11-29T11:16:10.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f686893a700 1 -- start start 2023-11-29T11:16:10.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f686893a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 0x7f6864069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f686893a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68640ceef0 0x7f686406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f686893a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68640cae70 con 0x7f68641606b0 2023-11-29T11:16:10.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f686893a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68640cbc10 con 0x7f68640ceef0 2023-11-29T11:16:10.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f686893a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68640cb130 con 0x7f68640c1ac0 2023-11-29T11:16:10.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f6863fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68640ceef0 0x7f686406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f68637fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f68641606b0 0x7f68640c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60122/0 (socket says 172.21.15.81:60122) 2023-11-29T11:16:10.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f68637fe700 1 -- 172.21.15.81:0/175566660 learned_addr learned my addr 172.21.15.81:0/175566660 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:10.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f6862ffd700 1 --2- 172.21.15.81:0/175566660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 0x7f6864069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f6863fff700 1 -- 172.21.15.81:0/175566660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 msgr2=0x7f6864069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:10.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f6863fff700 1 --2- 172.21.15.81:0/175566660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 0x7f6864069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f6863fff700 1 -- 172.21.15.81:0/175566660 >> v1:172.21.15.81:6789/0 conn(0x7f68641606b0 legacy=0x7f68640c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f6863fff700 1 -- 172.21.15.81:0/175566660 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68640cb410 con 0x7f68640ceef0 2023-11-29T11:16:10.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f6863fff700 1 --2- 172.21.15.81:0/175566660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68640ceef0 0x7f686406a180 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f685c009d90 tx=0x7f685c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29096649ac0fdb23 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f68627fc700 1 -- 172.21.15.81:0/175566660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00e070 con 0x7f68640ceef0 2023-11-29T11:16:10.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f68627fc700 1 -- 172.21.15.81:0/175566660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c00bb20 con 0x7f68640ceef0 2023-11-29T11:16:10.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f68627fc700 1 -- 172.21.15.81:0/175566660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c012430 con 0x7f68640ceef0 2023-11-29T11:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.230+0000 7f686893a700 1 -- 172.21.15.81:0/175566660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68640ceef0 msgr2=0x7f686406a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 --2- 172.21.15.81:0/175566660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68640ceef0 0x7f686406a180 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f685c009d90 tx=0x7f685c00b330 comp rx=0 tx=0).stop 2023-11-29T11:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 -- 172.21.15.81:0/175566660 shutdown_connections 2023-11-29T11:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 --2- 172.21.15.81:0/175566660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68640ceef0 0x7f686406a180 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 --2- 172.21.15.81:0/175566660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 0x7f6864069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 -- 172.21.15.81:0/175566660 >> 172.21.15.81:0/175566660 conn(0x7f68640ce3e0 msgr2=0x7f68640ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 -- 172.21.15.81:0/175566660 shutdown_connections 2023-11-29T11:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 -- 172.21.15.81:0/175566660 wait complete. 2023-11-29T11:16:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 Processor -- start 2023-11-29T11:16:10.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 -- start start 2023-11-29T11:16:10.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 0x7f6864158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68640ceef0 0x7f68640c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68641606b0 0x7f68640c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68641f6cf0 con 0x7f68641606b0 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6864158da0 con 0x7f68640ceef0 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f686893a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68641f6070 con 0x7f68640c1ac0 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6863fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68641606b0 0x7f68640c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6863fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68641606b0 0x7f68640c2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57876/0 (socket says 172.21.15.81:57876) 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f68637fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 0x7f6864158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6863fff700 1 -- 172.21.15.81:0/3069161912 learned_addr learned my addr 172.21.15.81:0/3069161912 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:10.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6862ffd700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68640ceef0 0x7f68640c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6863fff700 1 -- 172.21.15.81:0/3069161912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 msgr2=0x7f6864158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6863fff700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 0x7f6864158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6863fff700 1 -- 172.21.15.81:0/3069161912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68640ceef0 msgr2=0x7f68640c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6863fff700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68640ceef0 0x7f68640c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.234+0000 7f6863fff700 1 -- 172.21.15.81:0/3069161912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c009a70 con 0x7f68641606b0 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.238+0000 7f6863fff700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68641606b0 0x7f68640c2420 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f685c014040 tx=0x7f685c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.238+0000 7f684bfff700 1 -- 172.21.15.81:0/3069161912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c012430 con 0x7f68641606b0 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.238+0000 7f684bfff700 1 -- 172.21.15.81:0/3069161912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c020070 con 0x7f68641606b0 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.238+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68640b36c0 con 0x7f68641606b0 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.238+0000 7f684bfff700 1 -- 172.21.15.81:0/3069161912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0098f0 con 0x7f68641606b0 2023-11-29T11:16:10.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.238+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68640cb6f0 con 0x7f68641606b0 2023-11-29T11:16:10.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.238+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68640ad610 con 0x7f68641606b0 2023-11-29T11:16:10.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.238+0000 7f684bfff700 1 -- 172.21.15.81:0/3069161912 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f685c004040 con 0x7f68641606b0 2023-11-29T11:16:10.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.242+0000 7f684bfff700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6850064ee0 0x7f6850067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.242+0000 7f684bfff700 1 -- 172.21.15.81:0/3069161912 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f685c022070 con 0x7f68641606b0 2023-11-29T11:16:10.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.242+0000 7f68637fe700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6850064ee0 0x7f6850067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.242+0000 7f68637fe700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6850064ee0 0x7f6850067390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6858005930 tx=0x7f6858009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.246+0000 7f684bfff700 1 -- 172.21.15.81:0/3069161912 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f685c052020 con 0x7f68641606b0 2023-11-29T11:16:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.402+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68641f6e30 con 0x7f6850064ee0 2023-11-29T11:16:10.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.418+0000 7f684bfff700 1 -- 172.21.15.81:0/3069161912 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295286 (secure 0 0 0) 0x7f68641f6e30 con 0x7f6850064ee0 2023-11-29T11:16:10.429 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6850064ee0 msgr2=0x7f6850067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6850064ee0 0x7f6850067390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6858005930 tx=0x7f6858009040 comp rx=0 tx=0).stop 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68641606b0 msgr2=0x7f68640c2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68641606b0 0x7f68640c2420 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f685c014040 tx=0x7f685c004af0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 shutdown_connections 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6850064ee0 0x7f6850067390 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68641606b0 0x7f68640c2420 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68640ceef0 0x7f68640c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 --2- 172.21.15.81:0/3069161912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68640c1ac0 0x7f6864158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 >> 172.21.15.81:0/3069161912 conn(0x7f68640ce3e0 msgr2=0x7f6864069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 shutdown_connections 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.422+0000 7f686893a700 1 -- 172.21.15.81:0/3069161912 wait complete. 2023-11-29T11:16:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:16:10.443 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-11-29T11:16:08.491318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78692,"kb_used_data":7076,"kb_used_omap":0,"kb_used_meta":71552,"kb_avail":754896028,"statfs":{"total":773094113280,"available":773013532672,"internally_reserved":0,"allocated":7245824,"data_stored":3986494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73269248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001048"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300725+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:16:02.300725+0000","last_peered":"2023-11-29T11:16:02.300725+0000","last_clean":"2023-11-29T11:16:02.300725+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:16:02.300725+0000","last_undegraded":"2023-11-29T11:16:02.300725+0000","last_fullsized":"2023-11-29T11:16:02.300725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300722+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:16:02.300722+0000","last_peered":"2023-11-29T11:16:02.300722+0000","last_clean":"2023-11-29T11:16:02.300722+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:16:02.300722+0000","last_undegraded":"2023-11-29T11:16:02.300722+0000","last_fullsized":"2023-11-29T11:16:02.300722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.157157+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:16:02.157157+0000","last_peered":"2023-11-29T11:16:02.157157+0000","last_clean":"2023-11-29T11:16:02.157157+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:16:02.157157+0000","last_undegraded":"2023-11-29T11:16:02.157157+0000","last_fullsized":"2023-11-29T11:16:02.157157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.176182+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:16:02.176182+0000","last_peered":"2023-11-29T11:16:02.176182+0000","last_clean":"2023-11-29T11:16:02.176182+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:16:02.176182+0000","last_undegraded":"2023-11-29T11:16:02.176182+0000","last_fullsized":"2023-11-29T11:16:02.176182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190404+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:16:02.190404+0000","last_peered":"2023-11-29T11:16:02.190404+0000","last_clean":"2023-11-29T11:16:02.190404+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:16:02.190404+0000","last_undegraded":"2023-11-29T11:16:02.190404+0000","last_fullsized":"2023-11-29T11:16:02.190404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300721+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:16:02.300721+0000","last_peered":"2023-11-29T11:16:02.300721+0000","last_clean":"2023-11-29T11:16:02.300721+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:16:02.300721+0000","last_undegraded":"2023-11-29T11:16:02.300721+0000","last_fullsized":"2023-11-29T11:16:02.300721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190377+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:16:02.190377+0000","last_peered":"2023-11-29T11:16:02.190377+0000","last_clean":"2023-11-29T11:16:02.190377+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:16:02.190377+0000","last_undegraded":"2023-11-29T11:16:02.190377+0000","last_fullsized":"2023-11-29T11:16:02.190377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.180861+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:16:02.180861+0000","last_peered":"2023-11-29T11:16:02.180861+0000","last_clean":"2023-11-29T11:16:02.180861+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:16:02.180861+0000","last_undegraded":"2023-11-29T11:16:02.180861+0000","last_fullsized":"2023-11-29T11:16:02.180861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190345+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:16:02.190345+0000","last_peered":"2023-11-29T11:16:02.190345+0000","last_clean":"2023-11-29T11:16:02.190345+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:16:02.190345+0000","last_undegraded":"2023-11-29T11:16:02.190345+0000","last_fullsized":"2023-11-29T11:16:02.190345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10672,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361168,"statfs":{"total":96636764160,"available":96625836032,"internally_reserved":0,"allocated":1351680,"data_stored":941211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.204,"5min":1.371,"15min":1.371},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.081}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.224},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90100000000000002,"15min":0.91100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.0449999999999999,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0189999999999999},"min":{"1min":0.65600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2090000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.65200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1899999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.82899999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.169,"5min":1.641,"15min":1.641},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96499999999999997,"15min":0.98099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.94499999999999995,"15min":0.98699999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.248,"5min":1.319,"15min":1.319},"last":1.446},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.0880000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.349,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.393}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.087,"15min":1.131},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.1000000000000001,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.234,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.4159999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1419999999999999,"15min":1.1839999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.196,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1819999999999999,"15min":1.204},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.472,"5min":1.77,"15min":1.77},"last":1.302}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9452,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362388,"statfs":{"total":96636764160,"available":96627085312,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.80600000000000005,"15min":0.80200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.462,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3260000000000001,"5min":1.625,"15min":1.625},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.93000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.254,"5min":1.714,"15min":1.714},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.995,"5min":0.98299999999999998,"15min":0.97599999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.456,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.095}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.085,"5min":1.073,"15min":1.0680000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5660000000000001,"5min":1.593,"15min":1.593},"last":1.0169999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0740000000000001,"15min":1.0860000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5580000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9516,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362324,"statfs":{"total":96636764160,"available":96627019776,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.224,"5min":1.242,"15min":1.242},"last":0.752},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.079,"5min":1.512,"15min":1.512},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.165}]},{"osd":2,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1299999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.093}]},{"osd":3,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90600000000000003,"15min":0.90000000000000002},"min":{"1min":0.65100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.627},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.76800000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5649999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.2070000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1539999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.58599999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.607,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.3520000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0409999999999999,"15min":1.0609999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.389,"5min":1.585,"15min":1.585},"last":1.276},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.038,"15min":1.052},"min":{"1min":0.621,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2869999999999999,"5min":1.575,"15min":1.575},"last":1.381}]},{"osd":7,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.111,"15min":1.1000000000000001},"min":{"1min":0.77900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3360000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.236},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6399999999999999,"5min":1.889,"15min":1.889},"last":1.413}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9708,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362132,"statfs":{"total":96636764160,"available":96626823168,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1519999999999999,"5min":1.431,"15min":1.431},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.65100000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1579999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.87}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.88800000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.276,"5min":1.458,"15min":1.458},"last":1.077},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88400000000000001,"15min":0.879},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1870000000000001,"5min":1.401,"15min":1.401},"last":0.73999999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1080000000000001,"5min":1.206,"15min":1.206},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.95699999999999996,"15min":0.98299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.05}]},{"osd":3,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.232,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92800000000000005,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.127},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96599999999999997,"15min":0.96499999999999997},"min":{"1min":0.70699999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3620000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0089999999999999,"15min":1.0189999999999999},"min":{"1min":0.755,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4550000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.097,"15min":1.107},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.101},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.159,"15min":1.175},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5649999999999999,"5min":1.905,"15min":1.905},"last":1.024}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9644,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362196,"statfs":{"total":96636764160,"available":96626888704,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.438},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.98099999999999998,"5min":1.282,"15min":1.282},"last":0.46600000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61299999999999999},"min":{"1min":0.497,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.139,"5min":3.774,"15min":3.774},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.0109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.45,"5min":1.494,"15min":1.494},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.022,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98299999999999998,"15min":0.98999999999999999},"min":{"1min":0.65900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.94599999999999995,"15min":0.96599999999999997},"min":{"1min":0.622,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3340000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95299999999999996,"15min":0.94499999999999995},"min":{"1min":0.70999999999999996,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.0860000000000001},"min":{"1min":0.73699999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0229999999999999,"15min":1.008},"min":{"1min":0.70799999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.0960000000000001,"15min":1.0600000000000001},"min":{"1min":0.85699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2709999999999999,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.81599999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.145},"min":{"1min":0.82099999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0720000000000001,"15min":1.04},"min":{"1min":0.91600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.63900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0229999999999999,"5min":1.107,"15min":1.107},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95899999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1220000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.91000000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95199999999999996,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2769999999999999,"5min":1.371,"15min":1.371},"last":1.077},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.746,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.157,"5min":1.532,"15min":1.532},"last":0.95999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97599999999999998,"15min":0.98699999999999999},"min":{"1min":0.68999999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.155,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1559999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.97499999999999998,"15min":0.999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.056},"min":{"1min":0.77700000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.302,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.181}]},{"osd":7,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0349999999999999,"15min":1.0509999999999999},"min":{"1min":0.76500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1990000000000001,"5min":1.76,"15min":1.76},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.071},"min":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3100000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0409999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10544,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361296,"statfs":{"total":96636764160,"available":96625967104,"internally_reserved":0,"allocated":1351680,"data_stored":941211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.40500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.94999999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.56000000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":1.393,"15min":1.393},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0209999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91500000000000004,"5min":1.744,"15min":1.744},"last":0.51500000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2430000000000001,"5min":1.609,"15min":1.609},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0189999999999999,"15min":1.036},"min":{"1min":0.74199999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.22,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.98699999999999999,"15min":1.0009999999999999},"min":{"1min":0.78500000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4770000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.77500000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2629999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0680000000000001,"15min":1.0960000000000001},"min":{"1min":0.749,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2669999999999999,"5min":1.575,"15min":1.575},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.99399999999999999,"15min":0.999},"min":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4099999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.81999999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0509999999999999,"15min":1.075},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3260000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1020000000000001,"15min":1.1220000000000001},"min":{"1min":0.78600000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2929999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0309999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9768,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362072,"statfs":{"total":96636764160,"available":96626761728,"internally_reserved":0,"allocated":753664,"data_stored":349857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95399999999999996,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82999999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0149999999999999,"5min":1.155,"15min":1.155},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.46899999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.755},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.149,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.75,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98999999999999999,"15min":1.012},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2490000000000001,"5min":1.399,"15min":1.399},"last":1.2270000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.022,"15min":1.026},"min":{"1min":0.78600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.179,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.165},{"interface":"front","average":{"1min":1.006,"5min":1.0049999999999999,"15min":1.004},"min":{"1min":0.82299999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3680000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.073}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0680000000000001,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.2789999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.105,"15min":1.133},"min":{"1min":0.80300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.264,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3080000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.86899999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.361},{"interface":"front","average":{"1min":1.038,"5min":1.071,"15min":1.085},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4159999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:16:10.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:16:10.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.554+0000 7fabfe3de700 1 Processor -- start 2023-11-29T11:16:10.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.554+0000 7fabfe3de700 1 -- start start 2023-11-29T11:16:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabf80b32e0 0x7fabf80b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf80cbe00 con 0x7fabf81584c0 2023-11-29T11:16:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf80b3c60 con 0x7fabf8069cd0 2023-11-29T11:16:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf806dbd0 con 0x7fabf80b32e0 2023-11-29T11:16:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfcbdb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabf80b32e0 0x7fabf80b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfd3dc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fabf81584c0 0x7fabf80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60132/0 (socket says 172.21.15.81:60132) 2023-11-29T11:16:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfcbdb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabf80b32e0 0x7fabf80b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57882/0 (socket says 172.21.15.81:57882) 2023-11-29T11:16:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfd3dc700 1 -- 172.21.15.81:0/2663979330 learned_addr learned my addr 172.21.15.81:0/2663979330 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:10.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfcbdb700 1 -- 172.21.15.81:0/2663979330 >> v1:172.21.15.176:6789/0 conn(0x7fabf8069cd0 legacy=0x7fabf806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabebfff700 1 -- 172.21.15.81:0/2663979330 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464445867 0 0) 0x7fabf80b3c60 con 0x7fabf8069cd0 2023-11-29T11:16:10.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfcbdb700 1 -- 172.21.15.81:0/2663979330 >> v1:172.21.15.81:6789/0 conn(0x7fabf81584c0 legacy=0x7fabf80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfcbdb700 1 -- 172.21.15.81:0/2663979330 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80cd0f0 con 0x7fabf80b32e0 2023-11-29T11:16:10.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfcbdb700 1 --2- 172.21.15.81:0/2663979330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf80b3720 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009850 tx=0x7fabf4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64682d3255681bd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabebfff700 1 -- 172.21.15.81:0/2663979330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400b830 con 0x7fabf80b32e0 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabebfff700 1 -- 172.21.15.81:0/2663979330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400b990 con 0x7fabf80b32e0 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabebfff700 1 -- 172.21.15.81:0/2663979330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400bd20 con 0x7fabf80b32e0 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 -- 172.21.15.81:0/2663979330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 msgr2=0x7fabf80b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 --2- 172.21.15.81:0/2663979330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf80b3720 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009850 tx=0x7fabf4009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 -- 172.21.15.81:0/2663979330 shutdown_connections 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 --2- 172.21.15.81:0/2663979330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf80b3720 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 -- 172.21.15.81:0/2663979330 >> 172.21.15.81:0/2663979330 conn(0x7fabf80ce3e0 msgr2=0x7fabf80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 -- 172.21.15.81:0/2663979330 shutdown_connections 2023-11-29T11:16:10.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.558+0000 7fabfe3de700 1 -- 172.21.15.81:0/2663979330 wait complete. 2023-11-29T11:16:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.562+0000 7fabfe3de700 1 Processor -- start 2023-11-29T11:16:10.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.562+0000 7fabfe3de700 1 -- start start 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfe3de700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabf8069cd0 0x7fabf80c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfe3de700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf81ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfe3de700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf81584c0 0x7fabf80afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfe3de700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf81ed780 con 0x7fabf80b32e0 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfe3de700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80ade40 con 0x7fabf81584c0 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfe3de700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80aff70 con 0x7fabf8069cd0 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf81ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf81ed240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57896/0 (socket says 172.21.15.81:57896) 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 -- 172.21.15.81:0/3026890066 learned_addr learned my addr 172.21.15.81:0/3026890066 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfd3dc700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabf8069cd0 0x7fabf80c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfdbdd700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf81584c0 0x7fabf80afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 -- 172.21.15.81:0/3026890066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabf8069cd0 msgr2=0x7fabf80c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabf8069cd0 0x7fabf80c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 -- 172.21.15.81:0/3026890066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf81584c0 msgr2=0x7fabf80afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf81584c0 0x7fabf80afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 -- 172.21.15.81:0/3026890066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf40094b0 con 0x7fabf80b32e0 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfcbdb700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf81ed240 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fabf40090b0 tx=0x7fabf4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabe9ffb700 1 -- 172.21.15.81:0/3026890066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf401d070 con 0x7fabf80b32e0 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabe9ffb700 1 -- 172.21.15.81:0/3026890066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf40187f0 con 0x7fabf80b32e0 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf80cd6b0 con 0x7fabf80b32e0 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabe9ffb700 1 -- 172.21.15.81:0/3026890066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4018ba0 con 0x7fabf80b32e0 2023-11-29T11:16:10.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.566+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf80cd3d0 con 0x7fabf80b32e0 2023-11-29T11:16:10.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.570+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf80cd990 con 0x7fabf80b32e0 2023-11-29T11:16:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.570+0000 7fabe9ffb700 1 -- 172.21.15.81:0/3026890066 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fabf400e040 con 0x7fabf80b32e0 2023-11-29T11:16:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.570+0000 7fabe9ffb700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabdc064ee0 0x7fabdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.570+0000 7fabe9ffb700 1 -- 172.21.15.81:0/3026890066 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fabf4083ff0 con 0x7fabf80b32e0 2023-11-29T11:16:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.570+0000 7fabfd3dc700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabdc064ee0 0x7fabdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.570+0000 7fabfd3dc700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabdc064ee0 0x7fabdc067390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fabec005930 tx=0x7fabec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.578+0000 7fabe9ffb700 1 -- 172.21.15.81:0/3026890066 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fabf4052050 con 0x7fabf80b32e0 2023-11-29T11:16:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.734+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabf8072500 con 0x7fabdc064ee0 2023-11-29T11:16:10.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.742+0000 7fabe9ffb700 1 -- 172.21.15.81:0/3026890066 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295286 (secure 0 0 0) 0x7fabf8072500 con 0x7fabdc064ee0 2023-11-29T11:16:10.753 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabdc064ee0 msgr2=0x7fabdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabdc064ee0 0x7fabdc067390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fabec005930 tx=0x7fabec009040 comp rx=0 tx=0).stop 2023-11-29T11:16:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 msgr2=0x7fabf81ed240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf81ed240 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fabf40090b0 tx=0x7fabf4004770 comp rx=0 tx=0).stop 2023-11-29T11:16:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 shutdown_connections 2023-11-29T11:16:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fabdc064ee0 0x7fabdc067390 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fabf81584c0 0x7fabf80afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabf80b32e0 0x7fabf81ed240 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 --2- 172.21.15.81:0/3026890066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fabf8069cd0 0x7fabf80c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 >> 172.21.15.81:0/3026890066 conn(0x7fabf80ce3e0 msgr2=0x7fabf80c8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 shutdown_connections 2023-11-29T11:16:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.750+0000 7fabfe3de700 1 -- 172.21.15.81:0/3026890066 wait complete. 2023-11-29T11:16:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:16:10.769 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-29T11:16:10.491830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78692,"kb_used_data":7076,"kb_used_omap":0,"kb_used_meta":71552,"kb_avail":754896028,"statfs":{"total":773094113280,"available":773013532672,"internally_reserved":0,"allocated":7245824,"data_stored":3986494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73269248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.471962"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300725+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:16:02.300725+0000","last_peered":"2023-11-29T11:16:02.300725+0000","last_clean":"2023-11-29T11:16:02.300725+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:16:02.300725+0000","last_undegraded":"2023-11-29T11:16:02.300725+0000","last_fullsized":"2023-11-29T11:16:02.300725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300722+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:16:02.300722+0000","last_peered":"2023-11-29T11:16:02.300722+0000","last_clean":"2023-11-29T11:16:02.300722+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:16:02.300722+0000","last_undegraded":"2023-11-29T11:16:02.300722+0000","last_fullsized":"2023-11-29T11:16:02.300722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.157157+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:16:02.157157+0000","last_peered":"2023-11-29T11:16:02.157157+0000","last_clean":"2023-11-29T11:16:02.157157+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:16:02.157157+0000","last_undegraded":"2023-11-29T11:16:02.157157+0000","last_fullsized":"2023-11-29T11:16:02.157157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.176182+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:16:02.176182+0000","last_peered":"2023-11-29T11:16:02.176182+0000","last_clean":"2023-11-29T11:16:02.176182+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:16:02.176182+0000","last_undegraded":"2023-11-29T11:16:02.176182+0000","last_fullsized":"2023-11-29T11:16:02.176182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190404+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:16:02.190404+0000","last_peered":"2023-11-29T11:16:02.190404+0000","last_clean":"2023-11-29T11:16:02.190404+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:16:02.190404+0000","last_undegraded":"2023-11-29T11:16:02.190404+0000","last_fullsized":"2023-11-29T11:16:02.190404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300721+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:16:02.300721+0000","last_peered":"2023-11-29T11:16:02.300721+0000","last_clean":"2023-11-29T11:16:02.300721+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:16:02.300721+0000","last_undegraded":"2023-11-29T11:16:02.300721+0000","last_fullsized":"2023-11-29T11:16:02.300721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190377+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:16:02.190377+0000","last_peered":"2023-11-29T11:16:02.190377+0000","last_clean":"2023-11-29T11:16:02.190377+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:16:02.190377+0000","last_undegraded":"2023-11-29T11:16:02.190377+0000","last_fullsized":"2023-11-29T11:16:02.190377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.180861+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:16:02.180861+0000","last_peered":"2023-11-29T11:16:02.180861+0000","last_clean":"2023-11-29T11:16:02.180861+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:16:02.180861+0000","last_undegraded":"2023-11-29T11:16:02.180861+0000","last_fullsized":"2023-11-29T11:16:02.180861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190345+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:16:02.190345+0000","last_peered":"2023-11-29T11:16:02.190345+0000","last_clean":"2023-11-29T11:16:02.190345+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:16:02.190345+0000","last_undegraded":"2023-11-29T11:16:02.190345+0000","last_fullsized":"2023-11-29T11:16:02.190345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10672,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361168,"statfs":{"total":96636764160,"available":96625836032,"internally_reserved":0,"allocated":1351680,"data_stored":941211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.204,"5min":1.371,"15min":1.371},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.081}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.224},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90100000000000002,"15min":0.91100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.0449999999999999,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0189999999999999},"min":{"1min":0.65600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2090000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.65200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1899999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.82899999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.169,"5min":1.641,"15min":1.641},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96499999999999997,"15min":0.98099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.94499999999999995,"15min":0.98699999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.248,"5min":1.319,"15min":1.319},"last":1.446},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.0880000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.349,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.393}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.087,"15min":1.131},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.1000000000000001,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.234,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.4159999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1419999999999999,"15min":1.1839999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.196,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1819999999999999,"15min":1.204},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.472,"5min":1.77,"15min":1.77},"last":1.302}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9452,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362388,"statfs":{"total":96636764160,"available":96627085312,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.80600000000000005,"15min":0.80200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.462,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3260000000000001,"5min":1.625,"15min":1.625},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.93000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.254,"5min":1.714,"15min":1.714},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.995,"5min":0.98299999999999998,"15min":0.97599999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.456,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.095}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.085,"5min":1.073,"15min":1.0680000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5660000000000001,"5min":1.593,"15min":1.593},"last":1.0169999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0740000000000001,"15min":1.0860000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5580000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9516,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362324,"statfs":{"total":96636764160,"available":96627019776,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.224,"5min":1.242,"15min":1.242},"last":0.752},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.079,"5min":1.512,"15min":1.512},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.165}]},{"osd":2,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1299999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.093}]},{"osd":3,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90600000000000003,"15min":0.90000000000000002},"min":{"1min":0.65100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.627},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.76800000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5649999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.2070000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1539999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.58599999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.607,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.3520000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0409999999999999,"15min":1.0609999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.389,"5min":1.585,"15min":1.585},"last":1.276},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.038,"15min":1.052},"min":{"1min":0.621,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2869999999999999,"5min":1.575,"15min":1.575},"last":1.381}]},{"osd":7,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.111,"15min":1.1000000000000001},"min":{"1min":0.77900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3360000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.236},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6399999999999999,"5min":1.889,"15min":1.889},"last":1.413}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9708,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362132,"statfs":{"total":96636764160,"available":96626823168,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1519999999999999,"5min":1.431,"15min":1.431},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.65100000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1579999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.87}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.88800000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.276,"5min":1.458,"15min":1.458},"last":1.077},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88400000000000001,"15min":0.879},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1870000000000001,"5min":1.401,"15min":1.401},"last":0.73999999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1080000000000001,"5min":1.206,"15min":1.206},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.95699999999999996,"15min":0.98299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.05}]},{"osd":3,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.232,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92800000000000005,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.127},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96599999999999997,"15min":0.96499999999999997},"min":{"1min":0.70699999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3620000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0089999999999999,"15min":1.0189999999999999},"min":{"1min":0.755,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4550000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.097,"15min":1.107},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.101},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.159,"15min":1.175},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5649999999999999,"5min":1.905,"15min":1.905},"last":1.024}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9644,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362196,"statfs":{"total":96636764160,"available":96626888704,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.438},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.98099999999999998,"5min":1.282,"15min":1.282},"last":0.46600000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61299999999999999},"min":{"1min":0.497,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.139,"5min":3.774,"15min":3.774},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.0109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.45,"5min":1.494,"15min":1.494},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.022,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98299999999999998,"15min":0.98999999999999999},"min":{"1min":0.65900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.94599999999999995,"15min":0.96599999999999997},"min":{"1min":0.622,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3340000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95299999999999996,"15min":0.94499999999999995},"min":{"1min":0.70999999999999996,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.0860000000000001},"min":{"1min":0.73699999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0229999999999999,"15min":1.008},"min":{"1min":0.70799999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.0960000000000001,"15min":1.0600000000000001},"min":{"1min":0.85699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2709999999999999,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.81599999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.145},"min":{"1min":0.82099999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0720000000000001,"15min":1.04},"min":{"1min":0.91600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.63900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0229999999999999,"5min":1.107,"15min":1.107},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95899999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1220000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.91000000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95199999999999996,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2769999999999999,"5min":1.371,"15min":1.371},"last":1.077},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.746,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.157,"5min":1.532,"15min":1.532},"last":0.95999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97599999999999998,"15min":0.98699999999999999},"min":{"1min":0.68999999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.155,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1559999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.97499999999999998,"15min":0.999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.056},"min":{"1min":0.77700000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.302,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.181}]},{"osd":7,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0349999999999999,"15min":1.0509999999999999},"min":{"1min":0.76500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1990000000000001,"5min":1.76,"15min":1.76},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.071},"min":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3100000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0409999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10544,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361296,"statfs":{"total":96636764160,"available":96625967104,"internally_reserved":0,"allocated":1351680,"data_stored":941211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.40500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.94999999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.56000000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":1.393,"15min":1.393},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0209999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91500000000000004,"5min":1.744,"15min":1.744},"last":0.51500000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2430000000000001,"5min":1.609,"15min":1.609},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0189999999999999,"15min":1.036},"min":{"1min":0.74199999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.22,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.98699999999999999,"15min":1.0009999999999999},"min":{"1min":0.78500000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4770000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.77500000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2629999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0680000000000001,"15min":1.0960000000000001},"min":{"1min":0.749,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2669999999999999,"5min":1.575,"15min":1.575},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.99399999999999999,"15min":0.999},"min":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4099999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.81999999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0509999999999999,"15min":1.075},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3260000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1020000000000001,"15min":1.1220000000000001},"min":{"1min":0.78600000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2929999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0309999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9768,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362072,"statfs":{"total":96636764160,"available":96626761728,"internally_reserved":0,"allocated":753664,"data_stored":349857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95399999999999996,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82999999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0149999999999999,"5min":1.155,"15min":1.155},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.46899999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.755},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.149,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.75,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98999999999999999,"15min":1.012},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2490000000000001,"5min":1.399,"15min":1.399},"last":1.2270000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.022,"15min":1.026},"min":{"1min":0.78600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.179,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.165},{"interface":"front","average":{"1min":1.006,"5min":1.0049999999999999,"15min":1.004},"min":{"1min":0.82299999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3680000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.073}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0680000000000001,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.2789999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.105,"15min":1.133},"min":{"1min":0.80300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.264,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3080000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.86899999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.361},{"interface":"front","average":{"1min":1.038,"5min":1.071,"15min":1.085},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4159999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:16:10.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:16:10.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.882+0000 7f8002d39700 1 Processor -- start 2023-11-29T11:16:10.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- start start 2023-11-29T11:16:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b3720 0x7f7ffc06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc0cbe00 con 0x7f7ffc0b32e0 2023-11-29T11:16:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc0cd0f0 con 0x7f7ffc1584c0 2023-11-29T11:16:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc06dbd0 con 0x7f7ffc0b3720 2023-11-29T11:16:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8001536700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ffc0b32e0 0x7f7ffc069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60138/0 (socket says 172.21.15.81:60138) 2023-11-29T11:16:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8001536700 1 -- 172.21.15.81:0/1127140852 learned_addr learned my addr 172.21.15.81:0/1127140852 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002538700 1 --2- 172.21.15.81:0/1127140852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b3720 0x7f7ffc06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8000d35700 1 -- 172.21.15.81:0/1127140852 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642674242 0 0) 0x7f7ffc0cbe00 con 0x7f7ffc0b32e0 2023-11-29T11:16:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8000d35700 1 -- 172.21.15.81:0/1127140852 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fe80035d0 con 0x7f7ffc0b32e0 2023-11-29T11:16:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002538700 1 -- 172.21.15.81:0/1127140852 >> v1:172.21.15.176:6789/0 conn(0x7f7ffc1584c0 legacy=0x7f7ffc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002538700 1 -- 172.21.15.81:0/1127140852 >> v1:172.21.15.81:6789/0 conn(0x7f7ffc0b32e0 legacy=0x7f7ffc069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002538700 1 -- 172.21.15.81:0/1127140852 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0cd3d0 con 0x7f7ffc0b3720 2023-11-29T11:16:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002538700 1 --2- 172.21.15.81:0/1127140852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b3720 0x7f7ffc06a3e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400aed0 tx=0x7f7ff400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1dbe74a90ef5260 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8000d35700 1 -- 172.21.15.81:0/1127140852 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400cb10 con 0x7f7ffc0b3720 2023-11-29T11:16:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8000d35700 1 -- 172.21.15.81:0/1127140852 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400cc70 con 0x7f7ffc0b3720 2023-11-29T11:16:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8000d35700 1 -- 172.21.15.81:0/1127140852 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400a2e0 con 0x7f7ffc0b3720 2023-11-29T11:16:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- 172.21.15.81:0/1127140852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b3720 msgr2=0x7f7ffc06a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 --2- 172.21.15.81:0/1127140852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b3720 0x7f7ffc06a3e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400aed0 tx=0x7f7ff400c330 comp rx=0 tx=0).stop 2023-11-29T11:16:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- 172.21.15.81:0/1127140852 shutdown_connections 2023-11-29T11:16:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 --2- 172.21.15.81:0/1127140852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b3720 0x7f7ffc06a3e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- 172.21.15.81:0/1127140852 >> 172.21.15.81:0/1127140852 conn(0x7f7ffc0ce3e0 msgr2=0x7f7ffc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- 172.21.15.81:0/1127140852 shutdown_connections 2023-11-29T11:16:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.886+0000 7f8002d39700 1 -- 172.21.15.81:0/1127140852 wait complete. 2023-11-29T11:16:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 Processor -- start 2023-11-29T11:16:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 -- start start 2023-11-29T11:16:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b32e0 0x7f7ffc151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ffc0b3720 0x7f7ffc0c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc1584c0 0x7f7ffc0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc153a10 con 0x7f7ffc1584c0 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc06b0d0 con 0x7f7ffc0b3720 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc151d50 con 0x7f7ffc0b32e0 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc1584c0 0x7f7ffc0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc1584c0 0x7f7ffc0b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57900/0 (socket says 172.21.15.81:57900) 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 -- 172.21.15.81:0/635949332 learned_addr learned my addr 172.21.15.81:0/635949332 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8001d37700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b32e0 0x7f7ffc151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8001536700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ffc0b3720 0x7f7ffc0c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 -- 172.21.15.81:0/635949332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b32e0 msgr2=0x7f7ffc151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b32e0 0x7f7ffc151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 -- 172.21.15.81:0/635949332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ffc0b3720 msgr2=0x7f7ffc0c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ffc0b3720 0x7f7ffc0c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 -- 172.21.15.81:0/635949332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff400ab80 con 0x7f7ffc1584c0 2023-11-29T11:16:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002538700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc1584c0 0x7f7ffc0b0350 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400c370 tx=0x7f7ff4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f7ff27fc700 1 -- 172.21.15.81:0/635949332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4020070 con 0x7f7ffc1584c0 2023-11-29T11:16:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f7ff27fc700 1 -- 172.21.15.81:0/635949332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400a2e0 con 0x7f7ffc1584c0 2023-11-29T11:16:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc0cd990 con 0x7f7ffc1584c0 2023-11-29T11:16:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f7ff27fc700 1 -- 172.21.15.81:0/635949332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4007000 con 0x7f7ffc1584c0 2023-11-29T11:16:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.890+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc0cd6b0 con 0x7f7ffc1584c0 2023-11-29T11:16:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.894+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc0cdc70 con 0x7f7ffc1584c0 2023-11-29T11:16:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.894+0000 7f7ff27fc700 1 -- 172.21.15.81:0/635949332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7ff402b030 con 0x7f7ffc1584c0 2023-11-29T11:16:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.894+0000 7f7ff27fc700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7fe0064ee0 0x7f7fe0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.894+0000 7f7ff27fc700 1 -- 172.21.15.81:0/635949332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7ff40852f0 con 0x7f7ffc1584c0 2023-11-29T11:16:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.894+0000 7f8001d37700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7fe0064ee0 0x7f7fe0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.894+0000 7f8001d37700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7fe0064ee0 0x7f7fe0067390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8001800 tx=0x7f7ff8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:10.898+0000 7f7ff27fc700 1 -- 172.21.15.81:0/635949332 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7ff4053350 con 0x7f7ffc1584c0 2023-11-29T11:16:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.058+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ffc0b3e40 con 0x7f7fe0064ee0 2023-11-29T11:16:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.066+0000 7f7ff27fc700 1 -- 172.21.15.81:0/635949332 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295286 (secure 0 0 0) 0x7f7ffc0b3e40 con 0x7f7fe0064ee0 2023-11-29T11:16:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7fe0064ee0 msgr2=0x7f7fe0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7fe0064ee0 0x7f7fe0067390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8001800 tx=0x7f7ff8009040 comp rx=0 tx=0).stop 2023-11-29T11:16:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc1584c0 msgr2=0x7f7ffc0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc1584c0 0x7f7ffc0b0350 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400c370 tx=0x7f7ff4004af0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 shutdown_connections 2023-11-29T11:16:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7fe0064ee0 0x7f7fe0067390 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc1584c0 0x7f7ffc0b0350 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ffc0b3720 0x7f7ffc0c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 --2- 172.21.15.81:0/635949332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ffc0b32e0 0x7f7ffc151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 >> 172.21.15.81:0/635949332 conn(0x7f7ffc0ce3e0 msgr2=0x7f7ffc071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 shutdown_connections 2023-11-29T11:16:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.074+0000 7f8002d39700 1 -- 172.21.15.81:0/635949332 wait complete. 2023-11-29T11:16:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:16:11.091 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-29T11:16:10.491830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78692,"kb_used_data":7076,"kb_used_omap":0,"kb_used_meta":71552,"kb_avail":754896028,"statfs":{"total":773094113280,"available":773013532672,"internally_reserved":0,"allocated":7245824,"data_stored":3986494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73269248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.471962"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300725+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:16:02.300725+0000","last_peered":"2023-11-29T11:16:02.300725+0000","last_clean":"2023-11-29T11:16:02.300725+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:16:02.300725+0000","last_undegraded":"2023-11-29T11:16:02.300725+0000","last_fullsized":"2023-11-29T11:16:02.300725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300722+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:16:02.300722+0000","last_peered":"2023-11-29T11:16:02.300722+0000","last_clean":"2023-11-29T11:16:02.300722+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:16:02.300722+0000","last_undegraded":"2023-11-29T11:16:02.300722+0000","last_fullsized":"2023-11-29T11:16:02.300722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.157157+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:16:02.157157+0000","last_peered":"2023-11-29T11:16:02.157157+0000","last_clean":"2023-11-29T11:16:02.157157+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:16:02.157157+0000","last_undegraded":"2023-11-29T11:16:02.157157+0000","last_fullsized":"2023-11-29T11:16:02.157157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.176182+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:16:02.176182+0000","last_peered":"2023-11-29T11:16:02.176182+0000","last_clean":"2023-11-29T11:16:02.176182+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:16:02.176182+0000","last_undegraded":"2023-11-29T11:16:02.176182+0000","last_fullsized":"2023-11-29T11:16:02.176182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190404+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:16:02.190404+0000","last_peered":"2023-11-29T11:16:02.190404+0000","last_clean":"2023-11-29T11:16:02.190404+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:16:02.190404+0000","last_undegraded":"2023-11-29T11:16:02.190404+0000","last_fullsized":"2023-11-29T11:16:02.190404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300721+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:16:02.300721+0000","last_peered":"2023-11-29T11:16:02.300721+0000","last_clean":"2023-11-29T11:16:02.300721+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:16:02.300721+0000","last_undegraded":"2023-11-29T11:16:02.300721+0000","last_fullsized":"2023-11-29T11:16:02.300721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190377+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:16:02.190377+0000","last_peered":"2023-11-29T11:16:02.190377+0000","last_clean":"2023-11-29T11:16:02.190377+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:16:02.190377+0000","last_undegraded":"2023-11-29T11:16:02.190377+0000","last_fullsized":"2023-11-29T11:16:02.190377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.180861+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:16:02.180861+0000","last_peered":"2023-11-29T11:16:02.180861+0000","last_clean":"2023-11-29T11:16:02.180861+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:16:02.180861+0000","last_undegraded":"2023-11-29T11:16:02.180861+0000","last_fullsized":"2023-11-29T11:16:02.180861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190345+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:16:02.190345+0000","last_peered":"2023-11-29T11:16:02.190345+0000","last_clean":"2023-11-29T11:16:02.190345+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:16:02.190345+0000","last_undegraded":"2023-11-29T11:16:02.190345+0000","last_fullsized":"2023-11-29T11:16:02.190345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10672,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361168,"statfs":{"total":96636764160,"available":96625836032,"internally_reserved":0,"allocated":1351680,"data_stored":941211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.204,"5min":1.371,"15min":1.371},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.081}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.224},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90100000000000002,"15min":0.91100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.0449999999999999,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0189999999999999},"min":{"1min":0.65600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2090000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.65200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1899999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.82899999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.169,"5min":1.641,"15min":1.641},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96499999999999997,"15min":0.98099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.94499999999999995,"15min":0.98699999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.248,"5min":1.319,"15min":1.319},"last":1.446},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.0880000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.349,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.393}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.087,"15min":1.131},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.1000000000000001,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.234,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.4159999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1419999999999999,"15min":1.1839999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.196,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1819999999999999,"15min":1.204},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.472,"5min":1.77,"15min":1.77},"last":1.302}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9452,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362388,"statfs":{"total":96636764160,"available":96627085312,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.80600000000000005,"15min":0.80200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.462,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3260000000000001,"5min":1.625,"15min":1.625},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.93000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.254,"5min":1.714,"15min":1.714},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.995,"5min":0.98299999999999998,"15min":0.97599999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.456,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.095}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.085,"5min":1.073,"15min":1.0680000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5660000000000001,"5min":1.593,"15min":1.593},"last":1.0169999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0740000000000001,"15min":1.0860000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5580000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9516,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362324,"statfs":{"total":96636764160,"available":96627019776,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.224,"5min":1.242,"15min":1.242},"last":0.752},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.079,"5min":1.512,"15min":1.512},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.165}]},{"osd":2,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1299999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.093}]},{"osd":3,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90600000000000003,"15min":0.90000000000000002},"min":{"1min":0.65100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.627},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.76800000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5649999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.2070000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1539999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.58599999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.607,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.3520000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0409999999999999,"15min":1.0609999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.389,"5min":1.585,"15min":1.585},"last":1.276},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.038,"15min":1.052},"min":{"1min":0.621,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2869999999999999,"5min":1.575,"15min":1.575},"last":1.381}]},{"osd":7,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.111,"15min":1.1000000000000001},"min":{"1min":0.77900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3360000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.236},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6399999999999999,"5min":1.889,"15min":1.889},"last":1.413}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9708,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362132,"statfs":{"total":96636764160,"available":96626823168,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1519999999999999,"5min":1.431,"15min":1.431},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.65100000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1579999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.87}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.88800000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.276,"5min":1.458,"15min":1.458},"last":1.077},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88400000000000001,"15min":0.879},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1870000000000001,"5min":1.401,"15min":1.401},"last":0.73999999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1080000000000001,"5min":1.206,"15min":1.206},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.95699999999999996,"15min":0.98299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.05}]},{"osd":3,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.232,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92800000000000005,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.127},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96599999999999997,"15min":0.96499999999999997},"min":{"1min":0.70699999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3620000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0089999999999999,"15min":1.0189999999999999},"min":{"1min":0.755,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4550000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.097,"15min":1.107},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.101},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.159,"15min":1.175},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5649999999999999,"5min":1.905,"15min":1.905},"last":1.024}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9644,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362196,"statfs":{"total":96636764160,"available":96626888704,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.438},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.98099999999999998,"5min":1.282,"15min":1.282},"last":0.46600000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61299999999999999},"min":{"1min":0.497,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.139,"5min":3.774,"15min":3.774},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.0109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.45,"5min":1.494,"15min":1.494},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.022,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98299999999999998,"15min":0.98999999999999999},"min":{"1min":0.65900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.94599999999999995,"15min":0.96599999999999997},"min":{"1min":0.622,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3340000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95299999999999996,"15min":0.94499999999999995},"min":{"1min":0.70999999999999996,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.0860000000000001},"min":{"1min":0.73699999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0229999999999999,"15min":1.008},"min":{"1min":0.70799999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.0960000000000001,"15min":1.0600000000000001},"min":{"1min":0.85699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2709999999999999,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.81599999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.145},"min":{"1min":0.82099999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0720000000000001,"15min":1.04},"min":{"1min":0.91600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.63900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0229999999999999,"5min":1.107,"15min":1.107},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95899999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1220000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.91000000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95199999999999996,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2769999999999999,"5min":1.371,"15min":1.371},"last":1.077},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.746,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.157,"5min":1.532,"15min":1.532},"last":0.95999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97599999999999998,"15min":0.98699999999999999},"min":{"1min":0.68999999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.155,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1559999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.97499999999999998,"15min":0.999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.056},"min":{"1min":0.77700000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.302,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.181}]},{"osd":7,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0349999999999999,"15min":1.0509999999999999},"min":{"1min":0.76500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1990000000000001,"5min":1.76,"15min":1.76},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.071},"min":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3100000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0409999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10544,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361296,"statfs":{"total":96636764160,"available":96625967104,"internally_reserved":0,"allocated":1351680,"data_stored":941211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.40500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.94999999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.56000000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":1.393,"15min":1.393},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0209999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91500000000000004,"5min":1.744,"15min":1.744},"last":0.51500000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2430000000000001,"5min":1.609,"15min":1.609},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0189999999999999,"15min":1.036},"min":{"1min":0.74199999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.22,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.98699999999999999,"15min":1.0009999999999999},"min":{"1min":0.78500000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4770000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.77500000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2629999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0680000000000001,"15min":1.0960000000000001},"min":{"1min":0.749,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2669999999999999,"5min":1.575,"15min":1.575},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.99399999999999999,"15min":0.999},"min":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4099999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.81999999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0509999999999999,"15min":1.075},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3260000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1020000000000001,"15min":1.1220000000000001},"min":{"1min":0.78600000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2929999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0309999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9768,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362072,"statfs":{"total":96636764160,"available":96626761728,"internally_reserved":0,"allocated":753664,"data_stored":349857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95399999999999996,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82999999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0149999999999999,"5min":1.155,"15min":1.155},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.46899999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.755},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.149,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.75,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98999999999999999,"15min":1.012},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2490000000000001,"5min":1.399,"15min":1.399},"last":1.2270000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.022,"15min":1.026},"min":{"1min":0.78600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.179,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.165},{"interface":"front","average":{"1min":1.006,"5min":1.0049999999999999,"15min":1.004},"min":{"1min":0.82299999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3680000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.073}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0680000000000001,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.2789999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.105,"15min":1.133},"min":{"1min":0.80300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.264,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3080000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.86899999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.361},{"interface":"front","average":{"1min":1.038,"5min":1.071,"15min":1.085},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4159999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-29T11:16:11.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-29T11:16:11.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-11-29T11:16:11.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-11-29T11:16:11.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-29T11:16:11.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-11-29T11:16:11.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-11-29T11:16:11.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-11-29T11:16:11.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-11-29T11:16:11.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-11-29T11:16:11.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-11-29T11:16:11.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-11-29T11:16:11.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:07.015901+0000', 'last_change': '2023-11-29T11:16:07.015901+0000', 'last_active': '2023-11-29T11:16:07.015901+0000', 'last_peered': '2023-11-29T11:16:07.015901+0000', 'last_clean': '2023-11-29T11:16:07.015901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:07.015901+0000', 'last_undegraded': '2023-11-29T11:16:07.015901+0000', 'last_fullsized': '2023-11-29T11:16:07.015901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:07.015901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-11-29T11:16:11.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-29T11:16:06.011987+0000', 'last_change': '2023-11-29T11:16:06.011987+0000', 'last_active': '2023-11-29T11:16:06.011987+0000', 'last_peered': '2023-11-29T11:16:06.011987+0000', 'last_clean': '2023-11-29T11:16:06.011987+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-29T11:16:06.011987+0000', 'last_undegraded': '2023-11-29T11:16:06.011987+0000', 'last_fullsized': '2023-11-29T11:16:06.011987+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'last_clean_scrub_stamp': '2023-11-29T11:16:06.011987+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-29T11:16:11.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-29T11:16:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.218+0000 7f83d5ff3700 1 Processor -- start 2023-11-29T11:16:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.218+0000 7f83d5ff3700 1 -- start start 2023-11-29T11:16:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f83d00cf050 0x7f83d006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83d00b4c10 0x7f83d00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d015c6d0 con 0x7f83d00b4c10 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d006a9a0 con 0x7f83d00cf050 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00cf960 con 0x7f83d006a530 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83d00b4c10 0x7f83d00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83d00b4c10 0x7f83d00cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57914/0 (socket says 172.21.15.81:57914) 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 -- 172.21.15.81:0/2677975971 learned_addr learned my addr 172.21.15.81:0/2677975971 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83cffff700 1 --2- 172.21.15.81:0/2677975971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d4ff1700 1 --2- 172.21.15.81:0/2677975971 >> v2:172.21.15.176:3300/0 conn(0x7f83d00cf050 0x7f83d006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 -- 172.21.15.81:0/2677975971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 msgr2=0x7f83d00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 --2- 172.21.15.81:0/2677975971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 -- 172.21.15.81:0/2677975971 >> v2:172.21.15.176:3300/0 conn(0x7f83d00cf050 msgr2=0x7f83d006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 --2- 172.21.15.81:0/2677975971 >> v2:172.21.15.176:3300/0 conn(0x7f83d00cf050 0x7f83d006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 -- 172.21.15.81:0/2677975971 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d006ac60 con 0x7f83d00b4c10 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d4ff1700 1 --2- 172.21.15.81:0/2677975971 >> v2:172.21.15.176:3300/0 conn(0x7f83d00cf050 0x7f83d006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d57f2700 1 --2- 172.21.15.81:0/2677975971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00b4c10 0x7f83d00cce20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f83d008b9c0 tx=0x7f83c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5673f0f851d4309c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:11.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83cf7fe700 1 -- 172.21.15.81:0/2677975971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800e070 con 0x7f83d00b4c10 2023-11-29T11:16:11.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83cf7fe700 1 -- 172.21.15.81:0/2677975971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800b910 con 0x7f83d00b4c10 2023-11-29T11:16:11.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83cf7fe700 1 -- 172.21.15.81:0/2677975971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800bcc0 con 0x7f83d00b4c10 2023-11-29T11:16:11.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 -- 172.21.15.81:0/2677975971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00b4c10 msgr2=0x7f83d00cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/2677975971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00b4c10 0x7f83d00cce20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f83d008b9c0 tx=0x7f83c800b330 comp rx=0 tx=0).stop 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 -- 172.21.15.81:0/2677975971 shutdown_connections 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/2677975971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/2677975971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00b4c10 0x7f83d00cce20 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/2677975971 >> v2:172.21.15.176:3300/0 conn(0x7f83d00cf050 0x7f83d006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 -- 172.21.15.81:0/2677975971 >> 172.21.15.81:0/2677975971 conn(0x7f83d009bb30 msgr2=0x7f83d00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 -- 172.21.15.81:0/2677975971 shutdown_connections 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.222+0000 7f83d5ff3700 1 -- 172.21.15.81:0/2677975971 wait complete. 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 Processor -- start 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 -- start start 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83d00b4c10 0x7f83d009cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00cf050 0x7f83d01f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d015d8c0 con 0x7f83d00cf050 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d009d9b0 con 0x7f83d00b4c10 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d015db10 con 0x7f83d006a530 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d57f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00cf050 0x7f83d01f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d4ff1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d57f2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00cf050 0x7f83d01f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57918/0 (socket says 172.21.15.81:57918) 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d57f2700 1 -- 172.21.15.81:0/758425472 learned_addr learned my addr 172.21.15.81:0/758425472 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83cffff700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83d00b4c10 0x7f83d009cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d4ff1700 1 -- 172.21.15.81:0/758425472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83d00b4c10 msgr2=0x7f83d009cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d4ff1700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83d00b4c10 0x7f83d009cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d4ff1700 1 -- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00cf050 msgr2=0x7f83d01f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d4ff1700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00cf050 0x7f83d01f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d4ff1700 1 -- 172.21.15.81:0/758425472 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009b30 con 0x7f83d006a530 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d57f2700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00cf050 0x7f83d01f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d4ff1700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00b2c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f83c000e810 tx=0x7f83c000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83cd7fa700 1 -- 172.21.15.81:0/758425472 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c000c070 con 0x7f83d006a530 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83cd7fa700 1 -- 172.21.15.81:0/758425472 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0013610 con 0x7f83d006a530 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83cd7fa700 1 -- 172.21.15.81:0/758425472 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c00139c0 con 0x7f83d006a530 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d00b4410 con 0x7f83d006a530 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d006af40 con 0x7f83d006a530 2023-11-29T11:16:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.226+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d00b46f0 con 0x7f83d006a530 2023-11-29T11:16:11.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.230+0000 7f83cd7fa700 1 -- 172.21.15.81:0/758425472 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f83c0023070 con 0x7f83d006a530 2023-11-29T11:16:11.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.230+0000 7f83cd7fa700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83b0064ee0 0x7f83b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.230+0000 7f83cd7fa700 1 -- 172.21.15.81:0/758425472 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f83c00822a0 con 0x7f83d006a530 2023-11-29T11:16:11.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.230+0000 7f83cffff700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83b0064ee0 0x7f83b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.230+0000 7f83cffff700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83b0064ee0 0x7f83b0067390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f83d00b3560 tx=0x7f83b8009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:11.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.238+0000 7f83cd7fa700 1 -- 172.21.15.81:0/758425472 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f83c0050200 con 0x7f83d006a530 2023-11-29T11:16:11.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.462+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f83d0072500 con 0x7f83d006a530 2023-11-29T11:16:11.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.462+0000 7f83cd7fa700 1 -- 172.21.15.81:0/758425472 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1441 (secure 0 0 0) 0x7f83c0053820 con 0x7f83d006a530 2023-11-29T11:16:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:11.469 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":216,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1701256365,"num_in_osds":8,"osd_in_since":1701256357,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":80580608,"bytes_avail":773013532672,"bytes_total":773094113280,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":31,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6564}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-11-29T11:15:56.488307+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-29T11:16:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83b0064ee0 msgr2=0x7f83b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83b0064ee0 0x7f83b0067390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f83d00b3560 tx=0x7f83b8009240 comp rx=0 tx=0).stop 2023-11-29T11:16:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 msgr2=0x7f83d00b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00b2c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f83c000e810 tx=0x7f83c000eb20 comp rx=0 tx=0).stop 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 shutdown_connections 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83b0064ee0 0x7f83b0067390 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83d00cf050 0x7f83d01f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83d00b4c10 0x7f83d009cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 --2- 172.21.15.81:0/758425472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83d006a530 0x7f83d00b2c10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 >> 172.21.15.81:0/758425472 conn(0x7f83d009bb30 msgr2=0x7f83d015bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 shutdown_connections 2023-11-29T11:16:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.466+0000 7f83d5ff3700 1 -- 172.21.15.81:0/758425472 wait complete. 2023-11-29T11:16:11.483 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-29T11:16:11.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:16:11.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.582+0000 7fe340e52700 1 Processor -- start 2023-11-29T11:16:11.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.582+0000 7fe340e52700 1 -- start start 2023-11-29T11:16:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.582+0000 7fe340e52700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe33c06cdd0 0x7fe33c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.582+0000 7fe340e52700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe33c06aef0 0x7fe33c0b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.582+0000 7fe340e52700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0d0140 con 0x7fe33c06b320 2023-11-29T11:16:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.582+0000 7fe340e52700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c06d6e0 con 0x7fe33c06cdd0 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.582+0000 7fe340e52700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c15c670 con 0x7fe33c06aef0 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe33c06cdd0 0x7fe33c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe33c06cdd0 0x7fe33c06d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57930/0 (socket says 172.21.15.81:57930) 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33b7fe700 1 -- 172.21.15.81:0/1884955045 learned_addr learned my addr 172.21.15.81:0/1884955045 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33affd700 1 --2- 172.21.15.81:0/1884955045 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06aef0 0x7fe33c0b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33b7fe700 1 -- 172.21.15.81:0/1884955045 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06aef0 msgr2=0x7fe33c0b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33b7fe700 1 --2- 172.21.15.81:0/1884955045 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06aef0 0x7fe33c0b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33b7fe700 1 -- 172.21.15.81:0/1884955045 >> v1:172.21.15.176:6789/0 conn(0x7fe33c06b320 legacy=0x7fe33c0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33b7fe700 1 -- 172.21.15.81:0/1884955045 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0cf530 con 0x7fe33c06cdd0 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33affd700 1 --2- 172.21.15.81:0/1884955045 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06aef0 0x7fe33c0b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33b7fe700 1 --2- 172.21.15.81:0/1884955045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c06d1a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe33c067150 tx=0x7fe32400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb14b8be2e9e339 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33a7fc700 1 -- 172.21.15.81:0/1884955045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400e070 con 0x7fe33c06cdd0 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33a7fc700 1 -- 172.21.15.81:0/1884955045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3240090d0 con 0x7fe33c06cdd0 2023-11-29T11:16:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe33a7fc700 1 -- 172.21.15.81:0/1884955045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324003c80 con 0x7fe33c06cdd0 2023-11-29T11:16:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 -- 172.21.15.81:0/1884955045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 msgr2=0x7fe33c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 --2- 172.21.15.81:0/1884955045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c06d1a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe33c067150 tx=0x7fe32400b330 comp rx=0 tx=0).stop 2023-11-29T11:16:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 -- 172.21.15.81:0/1884955045 shutdown_connections 2023-11-29T11:16:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 --2- 172.21.15.81:0/1884955045 >> v2:172.21.15.176:3300/0 conn(0x7fe33c06aef0 0x7fe33c0b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 --2- 172.21.15.81:0/1884955045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c06d1a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 -- 172.21.15.81:0/1884955045 >> 172.21.15.81:0/1884955045 conn(0x7fe33c09bb10 msgr2=0x7fe33c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 -- 172.21.15.81:0/1884955045 shutdown_connections 2023-11-29T11:16:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 -- 172.21.15.81:0/1884955045 wait complete. 2023-11-29T11:16:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 Processor -- start 2023-11-29T11:16:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.586+0000 7fe340e52700 1 -- start start 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c06aef0 0x7fe33c150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06b320 0x7fe33c0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0ce9e0 con 0x7fe33c06cdd0 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0cde60 con 0x7fe33c06aef0 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0ce140 con 0x7fe33c06b320 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c0cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57936/0 (socket says 172.21.15.81:57936) 2023-11-29T11:16:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 -- 172.21.15.81:0/518425009 learned_addr learned my addr 172.21.15.81:0/518425009 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33b7fe700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c06aef0 0x7fe33c150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33affd700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06b320 0x7fe33c0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 -- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06b320 msgr2=0x7fe33c0ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06b320 0x7fe33c0ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 -- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c06aef0 msgr2=0x7fe33c150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c06aef0 0x7fe33c150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 -- 172.21.15.81:0/518425009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009b30 con 0x7fe33c06cdd0 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33affd700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06b320 0x7fe33c0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe33bfff700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c0cbdd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c430 tx=0x7fe33400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe333fff700 1 -- 172.21.15.81:0/518425009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334011790 con 0x7fe33c06cdd0 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe333fff700 1 -- 172.21.15.81:0/518425009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3340118f0 con 0x7fe33c06cdd0 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c0cfaf0 con 0x7fe33c06cdd0 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe333fff700 1 -- 172.21.15.81:0/518425009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334011ca0 con 0x7fe33c06cdd0 2023-11-29T11:16:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c0cf810 con 0x7fe33c06cdd0 2023-11-29T11:16:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c0cfdd0 con 0x7fe33c06cdd0 2023-11-29T11:16:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.590+0000 7fe333fff700 1 -- 172.21.15.81:0/518425009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe334010050 con 0x7fe33c06cdd0 2023-11-29T11:16:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.594+0000 7fe333fff700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe31c064ee0 0x7fe31c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.594+0000 7fe333fff700 1 -- 172.21.15.81:0/518425009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe334081c60 con 0x7fe33c06cdd0 2023-11-29T11:16:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.594+0000 7fe33b7fe700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe31c064ee0 0x7fe31c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.594+0000 7fe33b7fe700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe31c064ee0 0x7fe31c067390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe324015040 tx=0x7fe324009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.598+0000 7fe333fff700 1 -- 172.21.15.81:0/518425009 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe33404fc40 con 0x7fe33c06cdd0 2023-11-29T11:16:11.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.754+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe33c0ce2b0 con 0x7fe31c064ee0 2023-11-29T11:16:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.770+0000 7fe333fff700 1 -- 172.21.15.81:0/518425009 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295286 (secure 0 0 0) 0x7fe33c0ce2b0 con 0x7fe31c064ee0 2023-11-29T11:16:11.779 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe31c064ee0 msgr2=0x7fe31c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe31c064ee0 0x7fe31c067390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe324015040 tx=0x7fe324009000 comp rx=0 tx=0).stop 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 msgr2=0x7fe33c0cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c0cbdd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c430 tx=0x7fe33400c7f0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 shutdown_connections 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe31c064ee0 0x7fe31c067390 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe33c06cdd0 0x7fe33c0cbdd0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33c06b320 0x7fe33c0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 --2- 172.21.15.81:0/518425009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe33c06aef0 0x7fe33c150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 >> 172.21.15.81:0/518425009 conn(0x7fe33c09bb10 msgr2=0x7fe33c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 shutdown_connections 2023-11-29T11:16:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:11.774+0000 7fe340e52700 1 -- 172.21.15.81:0/518425009 wait complete. 2023-11-29T11:16:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:16:11.796 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-29T11:16:10.491830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78692,"kb_used_data":7076,"kb_used_omap":0,"kb_used_meta":71552,"kb_avail":754896028,"statfs":{"total":773094113280,"available":773013532672,"internally_reserved":0,"allocated":7245824,"data_stored":3986494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73269248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.471962"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300725+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:16:02.300725+0000","last_peered":"2023-11-29T11:16:02.300725+0000","last_clean":"2023-11-29T11:16:02.300725+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:16:02.300725+0000","last_undegraded":"2023-11-29T11:16:02.300725+0000","last_fullsized":"2023-11-29T11:16:02.300725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300722+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:16:02.300722+0000","last_peered":"2023-11-29T11:16:02.300722+0000","last_clean":"2023-11-29T11:16:02.300722+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:16:02.300722+0000","last_undegraded":"2023-11-29T11:16:02.300722+0000","last_fullsized":"2023-11-29T11:16:02.300722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.157157+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:16:02.157157+0000","last_peered":"2023-11-29T11:16:02.157157+0000","last_clean":"2023-11-29T11:16:02.157157+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:16:02.157157+0000","last_undegraded":"2023-11-29T11:16:02.157157+0000","last_fullsized":"2023-11-29T11:16:02.157157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.176182+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:16:02.176182+0000","last_peered":"2023-11-29T11:16:02.176182+0000","last_clean":"2023-11-29T11:16:02.176182+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:16:02.176182+0000","last_undegraded":"2023-11-29T11:16:02.176182+0000","last_fullsized":"2023-11-29T11:16:02.176182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":201,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190404+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:16:02.190404+0000","last_peered":"2023-11-29T11:16:02.190404+0000","last_clean":"2023-11-29T11:16:02.190404+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:16:02.190404+0000","last_undegraded":"2023-11-29T11:16:02.190404+0000","last_fullsized":"2023-11-29T11:16:02.190404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.300721+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:16:02.300721+0000","last_peered":"2023-11-29T11:16:02.300721+0000","last_clean":"2023-11-29T11:16:02.300721+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:16:02.300721+0000","last_undegraded":"2023-11-29T11:16:02.300721+0000","last_fullsized":"2023-11-29T11:16:02.300721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190377+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:16:02.190377+0000","last_peered":"2023-11-29T11:16:02.190377+0000","last_clean":"2023-11-29T11:16:02.190377+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:16:02.190377+0000","last_undegraded":"2023-11-29T11:16:02.190377+0000","last_fullsized":"2023-11-29T11:16:02.190377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.180861+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:16:02.180861+0000","last_peered":"2023-11-29T11:16:02.180861+0000","last_clean":"2023-11-29T11:16:02.180861+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:16:02.180861+0000","last_undegraded":"2023-11-29T11:16:02.180861+0000","last_fullsized":"2023-11-29T11:16:02.180861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:07.015901+0000","last_change":"2023-11-29T11:16:07.015901+0000","last_active":"2023-11-29T11:16:07.015901+0000","last_peered":"2023-11-29T11:16:07.015901+0000","last_clean":"2023-11-29T11:16:07.015901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:07.015901+0000","last_undegraded":"2023-11-29T11:16:07.015901+0000","last_fullsized":"2023-11-29T11:16:07.015901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:16:06.011987+0000","last_change":"2023-11-29T11:16:06.011987+0000","last_active":"2023-11-29T11:16:06.011987+0000","last_peered":"2023-11-29T11:16:06.011987+0000","last_clean":"2023-11-29T11:16:06.011987+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:16:06.011987+0000","last_undegraded":"2023-11-29T11:16:06.011987+0000","last_fullsized":"2023-11-29T11:16:06.011987+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-29T11:16:02.190345+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:16:02.190345+0000","last_peered":"2023-11-29T11:16:02.190345+0000","last_clean":"2023-11-29T11:16:02.190345+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:16:02.190345+0000","last_undegraded":"2023-11-29T11:16:02.190345+0000","last_fullsized":"2023-11-29T11:16:02.190345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10672,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361168,"statfs":{"total":96636764160,"available":96625836032,"internally_reserved":0,"allocated":1351680,"data_stored":941211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.204,"5min":1.371,"15min":1.371},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.081}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.224},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90100000000000002,"15min":0.91100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.0449999999999999,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0189999999999999},"min":{"1min":0.65600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2090000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.65200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1899999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.82899999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.169,"5min":1.641,"15min":1.641},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96499999999999997,"15min":0.98099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.94499999999999995,"15min":0.98699999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.248,"5min":1.319,"15min":1.319},"last":1.446},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.0880000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.349,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.393}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.087,"15min":1.131},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.1000000000000001,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.234,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.4159999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1419999999999999,"15min":1.1839999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.196,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1819999999999999,"15min":1.204},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.472,"5min":1.77,"15min":1.77},"last":1.302}]}]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9452,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362388,"statfs":{"total":96636764160,"available":96627085312,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.80600000000000005,"15min":0.80200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.462,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3260000000000001,"5min":1.625,"15min":1.625},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.93000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.254,"5min":1.714,"15min":1.714},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.995,"5min":0.98299999999999998,"15min":0.97599999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.456,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.095}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.085,"5min":1.073,"15min":1.0680000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5660000000000001,"5min":1.593,"15min":1.593},"last":1.0169999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0740000000000001,"15min":1.0860000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5580000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9516,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362324,"statfs":{"total":96636764160,"available":96627019776,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.224,"5min":1.242,"15min":1.242},"last":0.752},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.079,"5min":1.512,"15min":1.512},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.165}]},{"osd":2,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1299999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.093}]},{"osd":3,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90600000000000003,"15min":0.90000000000000002},"min":{"1min":0.65100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.627},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.76800000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5649999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.2070000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1539999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.58599999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.607,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.3520000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0409999999999999,"15min":1.0609999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.389,"5min":1.585,"15min":1.585},"last":1.276},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.038,"15min":1.052},"min":{"1min":0.621,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2869999999999999,"5min":1.575,"15min":1.575},"last":1.381}]},{"osd":7,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.111,"15min":1.1000000000000001},"min":{"1min":0.77900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3360000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.236},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6399999999999999,"5min":1.889,"15min":1.889},"last":1.413}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9708,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362132,"statfs":{"total":96636764160,"available":96626823168,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1519999999999999,"5min":1.431,"15min":1.431},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.65100000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1579999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.87}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.88800000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.276,"5min":1.458,"15min":1.458},"last":1.077},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88400000000000001,"15min":0.879},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1870000000000001,"5min":1.401,"15min":1.401},"last":0.73999999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1080000000000001,"5min":1.206,"15min":1.206},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.95699999999999996,"15min":0.98299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.05}]},{"osd":3,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.232,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92800000000000005,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.127},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96599999999999997,"15min":0.96499999999999997},"min":{"1min":0.70699999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3620000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0089999999999999,"15min":1.0189999999999999},"min":{"1min":0.755,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4550000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.097,"15min":1.107},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.101},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.159,"15min":1.175},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5649999999999999,"5min":1.905,"15min":1.905},"last":1.024}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9644,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362196,"statfs":{"total":96636764160,"available":96626888704,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.438},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.98099999999999998,"5min":1.282,"15min":1.282},"last":0.46600000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61299999999999999},"min":{"1min":0.497,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.139,"5min":3.774,"15min":3.774},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.0109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.45,"5min":1.494,"15min":1.494},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.022,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98299999999999998,"15min":0.98999999999999999},"min":{"1min":0.65900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.94599999999999995,"15min":0.96599999999999997},"min":{"1min":0.622,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3340000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95299999999999996,"15min":0.94499999999999995},"min":{"1min":0.70999999999999996,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.0860000000000001},"min":{"1min":0.73699999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0229999999999999,"15min":1.008},"min":{"1min":0.70799999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.0960000000000001,"15min":1.0600000000000001},"min":{"1min":0.85699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2709999999999999,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.81599999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.145},"min":{"1min":0.82099999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0720000000000001,"15min":1.04},"min":{"1min":0.91600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.63900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":757760,"data_stored":350843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0229999999999999,"5min":1.107,"15min":1.107},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95899999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1220000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.91000000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95199999999999996,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2769999999999999,"5min":1.371,"15min":1.371},"last":1.077},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.746,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.157,"5min":1.532,"15min":1.532},"last":0.95999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97599999999999998,"15min":0.98699999999999999},"min":{"1min":0.68999999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.155,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1559999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.97499999999999998,"15min":0.999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.056},"min":{"1min":0.77700000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.302,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.181}]},{"osd":7,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0349999999999999,"15min":1.0509999999999999},"min":{"1min":0.76500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1990000000000001,"5min":1.76,"15min":1.76},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.071},"min":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3100000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0409999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10544,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361296,"statfs":{"total":96636764160,"available":96625967104,"internally_reserved":0,"allocated":1351680,"data_stored":941211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.40500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.94999999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.56000000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":1.393,"15min":1.393},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0209999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91500000000000004,"5min":1.744,"15min":1.744},"last":0.51500000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2430000000000001,"5min":1.609,"15min":1.609},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0189999999999999,"15min":1.036},"min":{"1min":0.74199999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.22,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.98699999999999999,"15min":1.0009999999999999},"min":{"1min":0.78500000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4770000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.77500000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2629999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0680000000000001,"15min":1.0960000000000001},"min":{"1min":0.749,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2669999999999999,"5min":1.575,"15min":1.575},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.99399999999999999,"15min":0.999},"min":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4099999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.81999999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0509999999999999,"15min":1.075},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3260000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1020000000000001,"15min":1.1220000000000001},"min":{"1min":0.78600000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2929999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0309999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9768,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362072,"statfs":{"total":96636764160,"available":96626761728,"internally_reserved":0,"allocated":753664,"data_stored":349857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95399999999999996,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82999999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0149999999999999,"5min":1.155,"15min":1.155},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.46899999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.755},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.149,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.75,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98999999999999999,"15min":1.012},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2490000000000001,"5min":1.399,"15min":1.399},"last":1.2270000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.022,"15min":1.026},"min":{"1min":0.78600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.179,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.165},{"interface":"front","average":{"1min":1.006,"5min":1.0049999999999999,"15min":1.004},"min":{"1min":0.82299999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3680000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.073}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0680000000000001,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.2789999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.105,"15min":1.133},"min":{"1min":0.80300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.264,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3080000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.86899999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.361},{"interface":"front","average":{"1min":1.038,"5min":1.071,"15min":1.085},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4159999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:16:12.537 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:16:12.534+0000 7f9bc34a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:16:14.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:16:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909116e700 1 Processor -- start 2023-11-29T11:16:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909116e700 1 -- start start 2023-11-29T11:16:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909116e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f908c158e60 0x7f908c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909116e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f908c0ad490 0x7f908c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909116e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908c0cd8f0 con 0x7f908c0cad50 2023-11-29T11:16:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909116e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908c0add00 con 0x7f908c0ad490 2023-11-29T11:16:14.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909116e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908c0cc4f0 con 0x7f908c158e60 2023-11-29T11:16:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f908b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f908c0ad490 0x7f908c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909096d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f908c0cad50 0x7f908c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60152/0 (socket says 172.21.15.81:60152) 2023-11-29T11:16:14.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f909096d700 1 -- 172.21.15.81:0/344873800 learned_addr learned my addr 172.21.15.81:0/344873800 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f908bfff700 1 --2- 172.21.15.81:0/344873800 >> v2:172.21.15.176:3300/0 conn(0x7f908c158e60 0x7f908c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f908b7fe700 1 -- 172.21.15.81:0/344873800 >> v2:172.21.15.176:3300/0 conn(0x7f908c158e60 msgr2=0x7f908c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f908b7fe700 1 --2- 172.21.15.81:0/344873800 >> v2:172.21.15.176:3300/0 conn(0x7f908c158e60 0x7f908c0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f908b7fe700 1 -- 172.21.15.81:0/344873800 >> v1:172.21.15.81:6789/0 conn(0x7f908c0cad50 legacy=0x7f908c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f908b7fe700 1 -- 172.21.15.81:0/344873800 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c06dc60 con 0x7f908c0ad490 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f908affd700 1 -- 172.21.15.81:0/344873800 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579184148 0 0) 0x7f908c0cd8f0 con 0x7f908c0cad50 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.922+0000 7f908b7fe700 1 --2- 172.21.15.81:0/344873800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0ad490 0x7f908c0cbfb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f908c06f4e0 tx=0x7f907c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bca7ac5e55c9675 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f908affd700 1 -- 172.21.15.81:0/344873800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00e070 con 0x7f908c0ad490 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f908affd700 1 -- 172.21.15.81:0/344873800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c00bae0 con 0x7f908c0ad490 2023-11-29T11:16:14.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f908affd700 1 -- 172.21.15.81:0/344873800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00be90 con 0x7f908c0ad490 2023-11-29T11:16:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 -- 172.21.15.81:0/344873800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0ad490 msgr2=0x7f908c0cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 --2- 172.21.15.81:0/344873800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0ad490 0x7f908c0cbfb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f908c06f4e0 tx=0x7f907c00b330 comp rx=0 tx=0).stop 2023-11-29T11:16:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 -- 172.21.15.81:0/344873800 shutdown_connections 2023-11-29T11:16:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 --2- 172.21.15.81:0/344873800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0ad490 0x7f908c0cbfb0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 --2- 172.21.15.81:0/344873800 >> v2:172.21.15.176:3300/0 conn(0x7f908c158e60 0x7f908c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 -- 172.21.15.81:0/344873800 >> 172.21.15.81:0/344873800 conn(0x7f908c0ce3e0 msgr2=0x7f908c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 -- 172.21.15.81:0/344873800 shutdown_connections 2023-11-29T11:16:14.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 -- 172.21.15.81:0/344873800 wait complete. 2023-11-29T11:16:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 Processor -- start 2023-11-29T11:16:14.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.926+0000 7f909116e700 1 -- start start 2023-11-29T11:16:14.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f908c0ad490 0x7f908c0935a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0cad50 0x7f908c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f908c158e60 0x7f908c06a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c153a80 con 0x7f908c0cad50 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c153d60 con 0x7f908c158e60 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c150000 con 0x7f908c0ad490 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0cad50 0x7f908c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0cad50 0x7f908c06fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57946/0 (socket says 172.21.15.81:57946) 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 -- 172.21.15.81:0/546351650 learned_addr learned my addr 172.21.15.81:0/546351650 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908bfff700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f908c0ad490 0x7f908c0935a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909096d700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f908c158e60 0x7f908c06a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 -- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f908c0ad490 msgr2=0x7f908c0935a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f908c0ad490 0x7f908c0935a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 -- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f908c158e60 msgr2=0x7f908c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:14.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f908c158e60 0x7f908c06a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 -- 172.21.15.81:0/546351650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c009a70 con 0x7f908c0cad50 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909096d700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f908c158e60 0x7f908c06a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f908b7fe700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0cad50 0x7f908c06fda0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f907c000f80 tx=0x7f907c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f9088ff9700 1 -- 172.21.15.81:0/546351650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c027480 con 0x7f908c0cad50 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f9088ff9700 1 -- 172.21.15.81:0/546351650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c020070 con 0x7f908c0cad50 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908c159230 con 0x7f908c0cad50 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f9088ff9700 1 -- 172.21.15.81:0/546351650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c027820 con 0x7f908c0cad50 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c0cde90 con 0x7f908c0cad50 2023-11-29T11:16:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.930+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c06d6a0 con 0x7f908c0cad50 2023-11-29T11:16:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.934+0000 7f9088ff9700 1 -- 172.21.15.81:0/546351650 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f907c027980 con 0x7f908c0cad50 2023-11-29T11:16:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.934+0000 7f9088ff9700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9078064ee0 0x7f9078067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.934+0000 7f9088ff9700 1 -- 172.21.15.81:0/546351650 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f907c022070 con 0x7f908c0cad50 2023-11-29T11:16:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.934+0000 7f908bfff700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9078064ee0 0x7f9078067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.934+0000 7f908bfff700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9078064ee0 0x7f9078067390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9080009ae0 tx=0x7f9080008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:14.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:14.938+0000 7f9088ff9700 1 -- 172.21.15.81:0/546351650 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f907c052810 con 0x7f908c0cad50 2023-11-29T11:16:15.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.098+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f908c14fe80 con 0x7f9078064ee0 2023-11-29T11:16:15.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.114+0000 7f9088ff9700 1 -- 172.21.15.81:0/546351650 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310059 (secure 0 0 0) 0x7f9080011750 con 0x7f9078064ee0 2023-11-29T11:16:15.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:15.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9078064ee0 msgr2=0x7f9078067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9078064ee0 0x7f9078067390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9080009ae0 tx=0x7f9080008040 comp rx=0 tx=0).stop 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0cad50 msgr2=0x7f908c06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0cad50 0x7f908c06fda0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f907c000f80 tx=0x7f907c004af0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 shutdown_connections 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9078064ee0 0x7f9078067390 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f908c158e60 0x7f908c06a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f908c0cad50 0x7f908c06fda0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 --2- 172.21.15.81:0/546351650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f908c0ad490 0x7f908c0935a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 >> 172.21.15.81:0/546351650 conn(0x7f908c0ce3e0 msgr2=0x7f908c0c97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 shutdown_connections 2023-11-29T11:16:15.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.122+0000 7f909116e700 1 -- 172.21.15.81:0/546351650 wait complete. 2023-11-29T11:16:15.129 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:16:15.141 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-11-29T11:16:14.493266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":84312,"kb_used_data":7512,"kb_used_omap":0,"kb_used_meta":76736,"kb_avail":754890408,"statfs":{"total":773094113280,"available":773007777792,"internally_reserved":0,"allocated":7692288,"data_stored":4207053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":78577664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.468413"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590885+0000","last_change":"2023-11-29T11:16:07.434411+0000","last_active":"2023-11-29T11:16:08.590885+0000","last_peered":"2023-11-29T11:16:08.590885+0000","last_clean":"2023-11-29T11:16:08.590885+0000","last_became_active":"2023-11-29T11:16:07.433603+0000","last_became_peered":"2023-11-29T11:16:07.433603+0000","last_unstale":"2023-11-29T11:16:08.590885+0000","last_undegraded":"2023-11-29T11:16:08.590885+0000","last_fullsized":"2023-11-29T11:16:08.590885+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:22:06.092125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903762+0000","last_change":"2023-11-29T11:16:07.433243+0000","last_active":"2023-11-29T11:16:09.903762+0000","last_peered":"2023-11-29T11:16:09.903762+0000","last_clean":"2023-11-29T11:16:09.903762+0000","last_became_active":"2023-11-29T11:16:07.432895+0000","last_became_peered":"2023-11-29T11:16:07.432895+0000","last_unstale":"2023-11-29T11:16:09.903762+0000","last_undegraded":"2023-11-29T11:16:09.903762+0000","last_fullsized":"2023-11-29T11:16:09.903762+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:17:14.369443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903339+0000","last_change":"2023-11-29T11:16:07.428536+0000","last_active":"2023-11-29T11:16:09.903339+0000","last_peered":"2023-11-29T11:16:09.903339+0000","last_clean":"2023-11-29T11:16:09.903339+0000","last_became_active":"2023-11-29T11:16:07.428237+0000","last_became_peered":"2023-11-29T11:16:07.428237+0000","last_unstale":"2023-11-29T11:16:09.903339+0000","last_undegraded":"2023-11-29T11:16:09.903339+0000","last_fullsized":"2023-11-29T11:16:09.903339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:04:21.578171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.628344+0000","last_change":"2023-11-29T11:16:07.441877+0000","last_active":"2023-11-29T11:16:09.628344+0000","last_peered":"2023-11-29T11:16:09.628344+0000","last_clean":"2023-11-29T11:16:09.628344+0000","last_became_active":"2023-11-29T11:16:07.441623+0000","last_became_peered":"2023-11-29T11:16:07.441623+0000","last_unstale":"2023-11-29T11:16:09.628344+0000","last_undegraded":"2023-11-29T11:16:09.628344+0000","last_fullsized":"2023-11-29T11:16:09.628344+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:54:54.517277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902856+0000","last_change":"2023-11-29T11:16:07.433061+0000","last_active":"2023-11-29T11:16:09.902856+0000","last_peered":"2023-11-29T11:16:09.902856+0000","last_clean":"2023-11-29T11:16:09.902856+0000","last_became_active":"2023-11-29T11:16:07.432789+0000","last_became_peered":"2023-11-29T11:16:07.432789+0000","last_unstale":"2023-11-29T11:16:09.902856+0000","last_undegraded":"2023-11-29T11:16:09.902856+0000","last_fullsized":"2023-11-29T11:16:09.902856+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:00:08.937638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902643+0000","last_change":"2023-11-29T11:16:07.432878+0000","last_active":"2023-11-29T11:16:09.902643+0000","last_peered":"2023-11-29T11:16:09.902643+0000","last_clean":"2023-11-29T11:16:09.902643+0000","last_became_active":"2023-11-29T11:16:07.429777+0000","last_became_peered":"2023-11-29T11:16:07.429777+0000","last_unstale":"2023-11-29T11:16:09.902643+0000","last_undegraded":"2023-11-29T11:16:09.902643+0000","last_fullsized":"2023-11-29T11:16:09.902643+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:27:16.006345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.420411+0000","last_change":"2023-11-29T11:16:07.424505+0000","last_active":"2023-11-29T11:16:08.420411+0000","last_peered":"2023-11-29T11:16:08.420411+0000","last_clean":"2023-11-29T11:16:08.420411+0000","last_became_active":"2023-11-29T11:16:07.424217+0000","last_became_peered":"2023-11-29T11:16:07.424217+0000","last_unstale":"2023-11-29T11:16:08.420411+0000","last_undegraded":"2023-11-29T11:16:08.420411+0000","last_fullsized":"2023-11-29T11:16:08.420411+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:17:14.369443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902729+0000","last_change":"2023-11-29T11:16:07.438296+0000","last_active":"2023-11-29T11:16:09.902729+0000","last_peered":"2023-11-29T11:16:09.902729+0000","last_clean":"2023-11-29T11:16:09.902729+0000","last_became_active":"2023-11-29T11:16:07.433730+0000","last_became_peered":"2023-11-29T11:16:07.433730+0000","last_unstale":"2023-11-29T11:16:09.902729+0000","last_undegraded":"2023-11-29T11:16:09.902729+0000","last_fullsized":"2023-11-29T11:16:09.902729+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:47.367658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903363+0000","last_change":"2023-11-29T11:16:07.435401+0000","last_active":"2023-11-29T11:16:09.903363+0000","last_peered":"2023-11-29T11:16:09.903363+0000","last_clean":"2023-11-29T11:16:09.903363+0000","last_became_active":"2023-11-29T11:16:07.434699+0000","last_became_peered":"2023-11-29T11:16:07.434699+0000","last_unstale":"2023-11-29T11:16:09.903363+0000","last_undegraded":"2023-11-29T11:16:09.903363+0000","last_fullsized":"2023-11-29T11:16:09.903363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:13.082298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.423645+0000","last_change":"2023-11-29T11:16:07.429099+0000","last_active":"2023-11-29T11:16:08.423645+0000","last_peered":"2023-11-29T11:16:08.423645+0000","last_clean":"2023-11-29T11:16:08.423645+0000","last_became_active":"2023-11-29T11:16:07.427895+0000","last_became_peered":"2023-11-29T11:16:07.427895+0000","last_unstale":"2023-11-29T11:16:08.423645+0000","last_undegraded":"2023-11-29T11:16:08.423645+0000","last_fullsized":"2023-11-29T11:16:08.423645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:38:19.027643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590520+0000","last_change":"2023-11-29T11:16:07.434900+0000","last_active":"2023-11-29T11:16:08.590520+0000","last_peered":"2023-11-29T11:16:08.590520+0000","last_clean":"2023-11-29T11:16:08.590520+0000","last_became_active":"2023-11-29T11:16:07.434337+0000","last_became_peered":"2023-11-29T11:16:07.434337+0000","last_unstale":"2023-11-29T11:16:08.590520+0000","last_undegraded":"2023-11-29T11:16:08.590520+0000","last_fullsized":"2023-11-29T11:16:08.590520+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:13:00.098548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.628311+0000","last_change":"2023-11-29T11:16:07.430269+0000","last_active":"2023-11-29T11:16:09.628311+0000","last_peered":"2023-11-29T11:16:09.628311+0000","last_clean":"2023-11-29T11:16:09.628311+0000","last_became_active":"2023-11-29T11:16:07.430017+0000","last_became_peered":"2023-11-29T11:16:07.430017+0000","last_unstale":"2023-11-29T11:16:09.628311+0000","last_undegraded":"2023-11-29T11:16:09.628311+0000","last_fullsized":"2023-11-29T11:16:09.628311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:25:19.548033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421303+0000","last_change":"2023-11-29T11:16:07.442013+0000","last_active":"2023-11-29T11:16:08.421303+0000","last_peered":"2023-11-29T11:16:08.421303+0000","last_clean":"2023-11-29T11:16:08.421303+0000","last_became_active":"2023-11-29T11:16:07.441711+0000","last_became_peered":"2023-11-29T11:16:07.441711+0000","last_unstale":"2023-11-29T11:16:08.421303+0000","last_undegraded":"2023-11-29T11:16:08.421303+0000","last_fullsized":"2023-11-29T11:16:08.421303+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:27:19.830840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903490+0000","last_change":"2023-11-29T11:16:07.431353+0000","last_active":"2023-11-29T11:16:09.903490+0000","last_peered":"2023-11-29T11:16:09.903490+0000","last_clean":"2023-11-29T11:16:09.903490+0000","last_became_active":"2023-11-29T11:16:07.431120+0000","last_became_peered":"2023-11-29T11:16:07.431120+0000","last_unstale":"2023-11-29T11:16:09.903490+0000","last_undegraded":"2023-11-29T11:16:09.903490+0000","last_fullsized":"2023-11-29T11:16:09.903490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:40:05.181865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421111+0000","last_change":"2023-11-29T11:16:07.426444+0000","last_active":"2023-11-29T11:16:08.421111+0000","last_peered":"2023-11-29T11:16:08.421111+0000","last_clean":"2023-11-29T11:16:08.421111+0000","last_became_active":"2023-11-29T11:16:07.426168+0000","last_became_peered":"2023-11-29T11:16:07.426168+0000","last_unstale":"2023-11-29T11:16:08.421111+0000","last_undegraded":"2023-11-29T11:16:08.421111+0000","last_fullsized":"2023-11-29T11:16:08.421111+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:21:42.819764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.422419+0000","last_change":"2023-11-29T11:16:07.442295+0000","last_active":"2023-11-29T11:16:08.422419+0000","last_peered":"2023-11-29T11:16:08.422419+0000","last_clean":"2023-11-29T11:16:08.422419+0000","last_became_active":"2023-11-29T11:16:07.442009+0000","last_became_peered":"2023-11-29T11:16:07.442009+0000","last_unstale":"2023-11-29T11:16:08.422419+0000","last_undegraded":"2023-11-29T11:16:08.422419+0000","last_fullsized":"2023-11-29T11:16:08.422419+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:46.564588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903485+0000","last_change":"2023-11-29T11:16:07.435244+0000","last_active":"2023-11-29T11:16:09.903485+0000","last_peered":"2023-11-29T11:16:09.903485+0000","last_clean":"2023-11-29T11:16:09.903485+0000","last_became_active":"2023-11-29T11:16:07.434365+0000","last_became_peered":"2023-11-29T11:16:07.434365+0000","last_unstale":"2023-11-29T11:16:09.903485+0000","last_undegraded":"2023-11-29T11:16:09.903485+0000","last_fullsized":"2023-11-29T11:16:09.903485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:27:54.609078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.628555+0000","last_change":"2023-11-29T11:16:07.442004+0000","last_active":"2023-11-29T11:16:09.628555+0000","last_peered":"2023-11-29T11:16:09.628555+0000","last_clean":"2023-11-29T11:16:09.628555+0000","last_became_active":"2023-11-29T11:16:07.441604+0000","last_became_peered":"2023-11-29T11:16:07.441604+0000","last_unstale":"2023-11-29T11:16:09.628555+0000","last_undegraded":"2023-11-29T11:16:09.628555+0000","last_fullsized":"2023-11-29T11:16:09.628555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:19:55.419921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903370+0000","last_change":"2023-11-29T11:16:07.437648+0000","last_active":"2023-11-29T11:16:09.903370+0000","last_peered":"2023-11-29T11:16:09.903370+0000","last_clean":"2023-11-29T11:16:09.903370+0000","last_became_active":"2023-11-29T11:16:07.437371+0000","last_became_peered":"2023-11-29T11:16:07.437371+0000","last_unstale":"2023-11-29T11:16:09.903370+0000","last_undegraded":"2023-11-29T11:16:09.903370+0000","last_fullsized":"2023-11-29T11:16:09.903370+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:25:28.566448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421355+0000","last_change":"2023-11-29T11:16:07.417415+0000","last_active":"2023-11-29T11:16:08.421355+0000","last_peered":"2023-11-29T11:16:08.421355+0000","last_clean":"2023-11-29T11:16:08.421355+0000","last_became_active":"2023-11-29T11:16:07.417123+0000","last_became_peered":"2023-11-29T11:16:07.417123+0000","last_unstale":"2023-11-29T11:16:08.421355+0000","last_undegraded":"2023-11-29T11:16:08.421355+0000","last_fullsized":"2023-11-29T11:16:08.421355+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:38:34.085206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.422779+0000","last_change":"2023-11-29T11:16:07.435693+0000","last_active":"2023-11-29T11:16:08.422779+0000","last_peered":"2023-11-29T11:16:08.422779+0000","last_clean":"2023-11-29T11:16:08.422779+0000","last_became_active":"2023-11-29T11:16:07.435207+0000","last_became_peered":"2023-11-29T11:16:07.435207+0000","last_unstale":"2023-11-29T11:16:08.422779+0000","last_undegraded":"2023-11-29T11:16:08.422779+0000","last_fullsized":"2023-11-29T11:16:08.422779+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:30:35.862469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.422711+0000","last_change":"2023-11-29T11:16:07.428213+0000","last_active":"2023-11-29T11:16:08.422711+0000","last_peered":"2023-11-29T11:16:08.422711+0000","last_clean":"2023-11-29T11:16:08.422711+0000","last_became_active":"2023-11-29T11:16:07.427914+0000","last_became_peered":"2023-11-29T11:16:07.427914+0000","last_unstale":"2023-11-29T11:16:08.422711+0000","last_undegraded":"2023-11-29T11:16:08.422711+0000","last_fullsized":"2023-11-29T11:16:08.422711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:26:52.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590003+0000","last_change":"2023-11-29T11:16:07.432309+0000","last_active":"2023-11-29T11:16:08.590003+0000","last_peered":"2023-11-29T11:16:08.590003+0000","last_clean":"2023-11-29T11:16:08.590003+0000","last_became_active":"2023-11-29T11:16:07.431945+0000","last_became_peered":"2023-11-29T11:16:07.431945+0000","last_unstale":"2023-11-29T11:16:08.590003+0000","last_undegraded":"2023-11-29T11:16:08.590003+0000","last_fullsized":"2023-11-29T11:16:08.590003+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:15:04.195189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590016+0000","last_change":"2023-11-29T11:16:07.446153+0000","last_active":"2023-11-29T11:16:08.590016+0000","last_peered":"2023-11-29T11:16:08.590016+0000","last_clean":"2023-11-29T11:16:08.590016+0000","last_became_active":"2023-11-29T11:16:07.445892+0000","last_became_peered":"2023-11-29T11:16:07.445892+0000","last_unstale":"2023-11-29T11:16:08.590016+0000","last_undegraded":"2023-11-29T11:16:08.590016+0000","last_fullsized":"2023-11-29T11:16:08.590016+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:46.086795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.423607+0000","last_change":"2023-11-29T11:16:07.435540+0000","last_active":"2023-11-29T11:16:08.423607+0000","last_peered":"2023-11-29T11:16:08.423607+0000","last_clean":"2023-11-29T11:16:08.423607+0000","last_became_active":"2023-11-29T11:16:07.435238+0000","last_became_peered":"2023-11-29T11:16:07.435238+0000","last_unstale":"2023-11-29T11:16:08.423607+0000","last_undegraded":"2023-11-29T11:16:08.423607+0000","last_fullsized":"2023-11-29T11:16:08.423607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:11:26.002795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421683+0000","last_change":"2023-11-29T11:16:07.442322+0000","last_active":"2023-11-29T11:16:08.421683+0000","last_peered":"2023-11-29T11:16:08.421683+0000","last_clean":"2023-11-29T11:16:08.421683+0000","last_became_active":"2023-11-29T11:16:07.442018+0000","last_became_peered":"2023-11-29T11:16:07.442018+0000","last_unstale":"2023-11-29T11:16:08.421683+0000","last_undegraded":"2023-11-29T11:16:08.421683+0000","last_fullsized":"2023-11-29T11:16:08.421683+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:45:35.974251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903556+0000","last_change":"2023-11-29T11:16:07.434618+0000","last_active":"2023-11-29T11:16:09.903556+0000","last_peered":"2023-11-29T11:16:09.903556+0000","last_clean":"2023-11-29T11:16:09.903556+0000","last_became_active":"2023-11-29T11:16:07.434245+0000","last_became_peered":"2023-11-29T11:16:07.434245+0000","last_unstale":"2023-11-29T11:16:09.903556+0000","last_undegraded":"2023-11-29T11:16:09.903556+0000","last_fullsized":"2023-11-29T11:16:09.903556+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:38:56.958224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.423359+0000","last_change":"2023-11-29T11:16:07.428824+0000","last_active":"2023-11-29T11:16:08.423359+0000","last_peered":"2023-11-29T11:16:08.423359+0000","last_clean":"2023-11-29T11:16:08.423359+0000","last_became_active":"2023-11-29T11:16:07.428527+0000","last_became_peered":"2023-11-29T11:16:07.428527+0000","last_unstale":"2023-11-29T11:16:08.423359+0000","last_undegraded":"2023-11-29T11:16:08.423359+0000","last_fullsized":"2023-11-29T11:16:08.423359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:41:52.900776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903181+0000","last_change":"2023-11-29T11:16:07.434084+0000","last_active":"2023-11-29T11:16:09.903181+0000","last_peered":"2023-11-29T11:16:09.903181+0000","last_clean":"2023-11-29T11:16:09.903181+0000","last_became_active":"2023-11-29T11:16:07.433739+0000","last_became_peered":"2023-11-29T11:16:07.433739+0000","last_unstale":"2023-11-29T11:16:09.903181+0000","last_undegraded":"2023-11-29T11:16:09.903181+0000","last_fullsized":"2023-11-29T11:16:09.903181+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:11:26.002795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.420972+0000","last_change":"2023-11-29T11:16:07.445205+0000","last_active":"2023-11-29T11:16:08.420972+0000","last_peered":"2023-11-29T11:16:08.420972+0000","last_clean":"2023-11-29T11:16:08.420972+0000","last_became_active":"2023-11-29T11:16:07.444848+0000","last_became_peered":"2023-11-29T11:16:07.444848+0000","last_unstale":"2023-11-29T11:16:08.420972+0000","last_undegraded":"2023-11-29T11:16:08.420972+0000","last_fullsized":"2023-11-29T11:16:08.420972+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:38:36.636518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.420818+0000","last_change":"2023-11-29T11:16:07.427117+0000","last_active":"2023-11-29T11:16:08.420818+0000","last_peered":"2023-11-29T11:16:08.420818+0000","last_clean":"2023-11-29T11:16:08.420818+0000","last_became_active":"2023-11-29T11:16:07.426826+0000","last_became_peered":"2023-11-29T11:16:07.426826+0000","last_unstale":"2023-11-29T11:16:08.420818+0000","last_undegraded":"2023-11-29T11:16:08.420818+0000","last_fullsized":"2023-11-29T11:16:08.420818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:52:07.942634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902841+0000","last_change":"2023-11-29T11:16:07.440620+0000","last_active":"2023-11-29T11:16:09.902841+0000","last_peered":"2023-11-29T11:16:09.902841+0000","last_clean":"2023-11-29T11:16:09.902841+0000","last_became_active":"2023-11-29T11:16:07.437873+0000","last_became_peered":"2023-11-29T11:16:07.437873+0000","last_unstale":"2023-11-29T11:16:09.902841+0000","last_undegraded":"2023-11-29T11:16:09.902841+0000","last_fullsized":"2023-11-29T11:16:09.902841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:59:18.672454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590847+0000","last_change":"2023-11-29T11:16:07.445142+0000","last_active":"2023-11-29T11:16:08.590847+0000","last_peered":"2023-11-29T11:16:08.590847+0000","last_clean":"2023-11-29T11:16:08.590847+0000","last_became_active":"2023-11-29T11:16:07.444867+0000","last_became_peered":"2023-11-29T11:16:07.444867+0000","last_unstale":"2023-11-29T11:16:08.590847+0000","last_undegraded":"2023-11-29T11:16:08.590847+0000","last_fullsized":"2023-11-29T11:16:08.590847+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:22:12.630660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"66'4","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.591051+0000","last_change":"2023-11-29T11:16:07.051303+0000","last_active":"2023-11-29T11:16:08.591051+0000","last_peered":"2023-11-29T11:16:08.591051+0000","last_clean":"2023-11-29T11:16:08.591051+0000","last_became_active":"2023-11-29T11:16:07.051045+0000","last_became_peered":"2023-11-29T11:16:07.051045+0000","last_unstale":"2023-11-29T11:16:08.591051+0000","last_undegraded":"2023-11-29T11:16:08.591051+0000","last_fullsized":"2023-11-29T11:16:08.591051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:24:34.845101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903555+0000","last_change":"2023-11-29T11:16:07.435541+0000","last_active":"2023-11-29T11:16:09.903555+0000","last_peered":"2023-11-29T11:16:09.903555+0000","last_clean":"2023-11-29T11:16:09.903555+0000","last_became_active":"2023-11-29T11:16:07.435008+0000","last_became_peered":"2023-11-29T11:16:07.435008+0000","last_unstale":"2023-11-29T11:16:09.903555+0000","last_undegraded":"2023-11-29T11:16:09.903555+0000","last_fullsized":"2023-11-29T11:16:09.903555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:50:58.533123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"66'1","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421593+0000","last_change":"2023-11-29T11:16:07.047565+0000","last_active":"2023-11-29T11:16:08.421593+0000","last_peered":"2023-11-29T11:16:08.421593+0000","last_clean":"2023-11-29T11:16:08.421593+0000","last_became_active":"2023-11-29T11:16:07.047286+0000","last_became_peered":"2023-11-29T11:16:07.047286+0000","last_unstale":"2023-11-29T11:16:08.421593+0000","last_undegraded":"2023-11-29T11:16:08.421593+0000","last_fullsized":"2023-11-29T11:16:08.421593+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:12:59.094635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902971+0000","last_change":"2023-11-29T11:16:07.438143+0000","last_active":"2023-11-29T11:16:09.902971+0000","last_peered":"2023-11-29T11:16:09.902971+0000","last_clean":"2023-11-29T11:16:09.902971+0000","last_became_active":"2023-11-29T11:16:07.437466+0000","last_became_peered":"2023-11-29T11:16:07.437466+0000","last_unstale":"2023-11-29T11:16:09.902971+0000","last_undegraded":"2023-11-29T11:16:09.902971+0000","last_fullsized":"2023-11-29T11:16:09.902971+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:08:31.123084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"66'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.423496+0000","last_change":"2023-11-29T11:16:07.051540+0000","last_active":"2023-11-29T11:16:08.423496+0000","last_peered":"2023-11-29T11:16:08.423496+0000","last_clean":"2023-11-29T11:16:08.423496+0000","last_became_active":"2023-11-29T11:16:07.051206+0000","last_became_peered":"2023-11-29T11:16:07.051206+0000","last_unstale":"2023-11-29T11:16:08.423496+0000","last_undegraded":"2023-11-29T11:16:08.423496+0000","last_fullsized":"2023-11-29T11:16:08.423496+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:54:45.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590690+0000","last_change":"2023-11-29T11:16:07.433293+0000","last_active":"2023-11-29T11:16:08.590690+0000","last_peered":"2023-11-29T11:16:08.590690+0000","last_clean":"2023-11-29T11:16:08.590690+0000","last_became_active":"2023-11-29T11:16:07.433020+0000","last_became_peered":"2023-11-29T11:16:07.433020+0000","last_unstale":"2023-11-29T11:16:08.590690+0000","last_undegraded":"2023-11-29T11:16:08.590690+0000","last_fullsized":"2023-11-29T11:16:08.590690+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:08:49.013264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"66'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903314+0000","last_change":"2023-11-29T11:16:07.053101+0000","last_active":"2023-11-29T11:16:09.903314+0000","last_peered":"2023-11-29T11:16:09.903314+0000","last_clean":"2023-11-29T11:16:09.903314+0000","last_became_active":"2023-11-29T11:16:07.052831+0000","last_became_peered":"2023-11-29T11:16:07.052831+0000","last_unstale":"2023-11-29T11:16:09.903314+0000","last_undegraded":"2023-11-29T11:16:09.903314+0000","last_fullsized":"2023-11-29T11:16:09.903314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:17:50.355859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421041+0000","last_change":"2023-11-29T11:16:07.420294+0000","last_active":"2023-11-29T11:16:08.421041+0000","last_peered":"2023-11-29T11:16:08.421041+0000","last_clean":"2023-11-29T11:16:08.421041+0000","last_became_active":"2023-11-29T11:16:07.420032+0000","last_became_peered":"2023-11-29T11:16:07.420032+0000","last_unstale":"2023-11-29T11:16:08.421041+0000","last_undegraded":"2023-11-29T11:16:08.421041+0000","last_fullsized":"2023-11-29T11:16:08.421041+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:04.135314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"66'1","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903591+0000","last_change":"2023-11-29T11:16:07.043117+0000","last_active":"2023-11-29T11:16:09.903591+0000","last_peered":"2023-11-29T11:16:09.903591+0000","last_clean":"2023-11-29T11:16:09.903591+0000","last_became_active":"2023-11-29T11:16:07.042839+0000","last_became_peered":"2023-11-29T11:16:07.042839+0000","last_unstale":"2023-11-29T11:16:09.903591+0000","last_undegraded":"2023-11-29T11:16:09.903591+0000","last_fullsized":"2023-11-29T11:16:09.903591+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:45.082881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.422780+0000","last_change":"2023-11-29T11:16:07.428945+0000","last_active":"2023-11-29T11:16:08.422780+0000","last_peered":"2023-11-29T11:16:08.422780+0000","last_clean":"2023-11-29T11:16:08.422780+0000","last_became_active":"2023-11-29T11:16:07.428407+0000","last_became_peered":"2023-11-29T11:16:07.428407+0000","last_unstale":"2023-11-29T11:16:08.422780+0000","last_undegraded":"2023-11-29T11:16:08.422780+0000","last_fullsized":"2023-11-29T11:16:08.422780+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:16:58.763672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"66'1","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902895+0000","last_change":"2023-11-29T11:16:07.050606+0000","last_active":"2023-11-29T11:16:09.902895+0000","last_peered":"2023-11-29T11:16:09.902895+0000","last_clean":"2023-11-29T11:16:09.902895+0000","last_became_active":"2023-11-29T11:16:07.050131+0000","last_became_peered":"2023-11-29T11:16:07.050131+0000","last_unstale":"2023-11-29T11:16:09.902895+0000","last_undegraded":"2023-11-29T11:16:09.902895+0000","last_fullsized":"2023-11-29T11:16:09.902895+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:48:34.521271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902244+0000","last_change":"2023-11-29T11:16:07.429146+0000","last_active":"2023-11-29T11:16:09.902244+0000","last_peered":"2023-11-29T11:16:09.902244+0000","last_clean":"2023-11-29T11:16:09.902244+0000","last_became_active":"2023-11-29T11:16:07.428792+0000","last_became_peered":"2023-11-29T11:16:07.428792+0000","last_unstale":"2023-11-29T11:16:09.902244+0000","last_undegraded":"2023-11-29T11:16:09.902244+0000","last_fullsized":"2023-11-29T11:16:09.902244+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:59:32.222693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.627962+0000","last_change":"2023-11-29T11:16:07.042546+0000","last_active":"2023-11-29T11:16:09.627962+0000","last_peered":"2023-11-29T11:16:09.627962+0000","last_clean":"2023-11-29T11:16:09.627962+0000","last_became_active":"2023-11-29T11:16:07.042228+0000","last_became_peered":"2023-11-29T11:16:07.042228+0000","last_unstale":"2023-11-29T11:16:09.627962+0000","last_undegraded":"2023-11-29T11:16:09.627962+0000","last_fullsized":"2023-11-29T11:16:09.627962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:40:04.177952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421370+0000","last_change":"2023-11-29T11:16:07.428077+0000","last_active":"2023-11-29T11:16:08.421370+0000","last_peered":"2023-11-29T11:16:08.421370+0000","last_clean":"2023-11-29T11:16:08.421370+0000","last_became_active":"2023-11-29T11:16:07.427807+0000","last_became_peered":"2023-11-29T11:16:07.427807+0000","last_unstale":"2023-11-29T11:16:08.421370+0000","last_undegraded":"2023-11-29T11:16:08.421370+0000","last_fullsized":"2023-11-29T11:16:08.421370+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:57:00.641306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902608+0000","last_change":"2023-11-29T11:16:07.047058+0000","last_active":"2023-11-29T11:16:09.902608+0000","last_peered":"2023-11-29T11:16:09.902608+0000","last_clean":"2023-11-29T11:16:09.902608+0000","last_became_active":"2023-11-29T11:16:07.046773+0000","last_became_peered":"2023-11-29T11:16:07.046773+0000","last_unstale":"2023-11-29T11:16:09.902608+0000","last_undegraded":"2023-11-29T11:16:09.902608+0000","last_fullsized":"2023-11-29T11:16:09.902608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:43:59.370279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421863+0000","last_change":"2023-11-29T11:16:07.428280+0000","last_active":"2023-11-29T11:16:08.421863+0000","last_peered":"2023-11-29T11:16:08.421863+0000","last_clean":"2023-11-29T11:16:08.421863+0000","last_became_active":"2023-11-29T11:16:07.428007+0000","last_became_peered":"2023-11-29T11:16:07.428007+0000","last_unstale":"2023-11-29T11:16:08.421863+0000","last_undegraded":"2023-11-29T11:16:08.421863+0000","last_fullsized":"2023-11-29T11:16:08.421863+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:29:17.738222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.423738+0000","last_change":"2023-11-29T11:16:07.042980+0000","last_active":"2023-11-29T11:16:08.423738+0000","last_peered":"2023-11-29T11:16:08.423738+0000","last_clean":"2023-11-29T11:16:08.423738+0000","last_became_active":"2023-11-29T11:16:07.042701+0000","last_became_peered":"2023-11-29T11:16:07.042701+0000","last_unstale":"2023-11-29T11:16:08.423738+0000","last_undegraded":"2023-11-29T11:16:08.423738+0000","last_fullsized":"2023-11-29T11:16:08.423738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:25:53.492252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590930+0000","last_change":"2023-11-29T11:16:07.446157+0000","last_active":"2023-11-29T11:16:08.590930+0000","last_peered":"2023-11-29T11:16:08.590930+0000","last_clean":"2023-11-29T11:16:08.590930+0000","last_became_active":"2023-11-29T11:16:07.445869+0000","last_became_peered":"2023-11-29T11:16:07.445869+0000","last_unstale":"2023-11-29T11:16:08.590930+0000","last_undegraded":"2023-11-29T11:16:08.590930+0000","last_fullsized":"2023-11-29T11:16:08.590930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:06:50.611187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903987+0000","last_change":"2023-11-29T11:16:07.050266+0000","last_active":"2023-11-29T11:16:09.903987+0000","last_peered":"2023-11-29T11:16:09.903987+0000","last_clean":"2023-11-29T11:16:09.903987+0000","last_became_active":"2023-11-29T11:16:07.049940+0000","last_became_peered":"2023-11-29T11:16:07.049940+0000","last_unstale":"2023-11-29T11:16:09.903987+0000","last_undegraded":"2023-11-29T11:16:09.903987+0000","last_fullsized":"2023-11-29T11:16:09.903987+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:36:36.382551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903181+0000","last_change":"2023-11-29T11:16:07.438110+0000","last_active":"2023-11-29T11:16:09.903181+0000","last_peered":"2023-11-29T11:16:09.903181+0000","last_clean":"2023-11-29T11:16:09.903181+0000","last_became_active":"2023-11-29T11:16:07.437073+0000","last_became_peered":"2023-11-29T11:16:07.437073+0000","last_unstale":"2023-11-29T11:16:09.903181+0000","last_undegraded":"2023-11-29T11:16:09.903181+0000","last_fullsized":"2023-11-29T11:16:09.903181+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:09:20.903314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"66'3","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903764+0000","last_change":"2023-11-29T11:16:07.040545+0000","last_active":"2023-11-29T11:16:09.903764+0000","last_peered":"2023-11-29T11:16:09.903764+0000","last_clean":"2023-11-29T11:16:09.903764+0000","last_became_active":"2023-11-29T11:16:07.040231+0000","last_became_peered":"2023-11-29T11:16:07.040231+0000","last_unstale":"2023-11-29T11:16:09.903764+0000","last_undegraded":"2023-11-29T11:16:09.903764+0000","last_fullsized":"2023-11-29T11:16:09.903764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:25:53.492252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903341+0000","last_change":"2023-11-29T11:16:07.425876+0000","last_active":"2023-11-29T11:16:09.903341+0000","last_peered":"2023-11-29T11:16:09.903341+0000","last_clean":"2023-11-29T11:16:09.903341+0000","last_became_active":"2023-11-29T11:16:07.425421+0000","last_became_peered":"2023-11-29T11:16:07.425421+0000","last_unstale":"2023-11-29T11:16:09.903341+0000","last_undegraded":"2023-11-29T11:16:09.903341+0000","last_fullsized":"2023-11-29T11:16:09.903341+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:16:31.651077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"66'6","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.628537+0000","last_change":"2023-11-29T11:16:07.047309+0000","last_active":"2023-11-29T11:16:09.628537+0000","last_peered":"2023-11-29T11:16:09.628537+0000","last_clean":"2023-11-29T11:16:09.628537+0000","last_became_active":"2023-11-29T11:16:07.047065+0000","last_became_peered":"2023-11-29T11:16:07.047065+0000","last_unstale":"2023-11-29T11:16:09.628537+0000","last_undegraded":"2023-11-29T11:16:09.628537+0000","last_fullsized":"2023-11-29T11:16:09.628537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:10:12.078384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590114+0000","last_change":"2023-11-29T11:16:07.432550+0000","last_active":"2023-11-29T11:16:08.590114+0000","last_peered":"2023-11-29T11:16:08.590114+0000","last_clean":"2023-11-29T11:16:08.590114+0000","last_became_active":"2023-11-29T11:16:07.432147+0000","last_became_peered":"2023-11-29T11:16:07.432147+0000","last_unstale":"2023-11-29T11:16:08.590114+0000","last_undegraded":"2023-11-29T11:16:08.590114+0000","last_fullsized":"2023-11-29T11:16:08.590114+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:12:58.585439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"66'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.628250+0000","last_change":"2023-11-29T11:16:07.050308+0000","last_active":"2023-11-29T11:16:09.628250+0000","last_peered":"2023-11-29T11:16:09.628250+0000","last_clean":"2023-11-29T11:16:09.628250+0000","last_became_active":"2023-11-29T11:16:07.049992+0000","last_became_peered":"2023-11-29T11:16:07.049992+0000","last_unstale":"2023-11-29T11:16:09.628250+0000","last_undegraded":"2023-11-29T11:16:09.628250+0000","last_fullsized":"2023-11-29T11:16:09.628250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:16:50.941443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421186+0000","last_change":"2023-11-29T11:16:07.422399+0000","last_active":"2023-11-29T11:16:08.421186+0000","last_peered":"2023-11-29T11:16:08.421186+0000","last_clean":"2023-11-29T11:16:08.421186+0000","last_became_active":"2023-11-29T11:16:07.422102+0000","last_became_peered":"2023-11-29T11:16:07.422102+0000","last_unstale":"2023-11-29T11:16:08.421186+0000","last_undegraded":"2023-11-29T11:16:08.421186+0000","last_fullsized":"2023-11-29T11:16:08.421186+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:14.916615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903096+0000","last_change":"2023-11-29T11:16:07.052724+0000","last_active":"2023-11-29T11:16:09.903096+0000","last_peered":"2023-11-29T11:16:09.903096+0000","last_clean":"2023-11-29T11:16:09.903096+0000","last_became_active":"2023-11-29T11:16:07.052373+0000","last_became_peered":"2023-11-29T11:16:07.052373+0000","last_unstale":"2023-11-29T11:16:09.903096+0000","last_undegraded":"2023-11-29T11:16:09.903096+0000","last_fullsized":"2023-11-29T11:16:09.903096+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:58:09.819308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.420841+0000","last_change":"2023-11-29T11:16:07.446204+0000","last_active":"2023-11-29T11:16:08.420841+0000","last_peered":"2023-11-29T11:16:08.420841+0000","last_clean":"2023-11-29T11:16:08.420841+0000","last_became_active":"2023-11-29T11:16:07.445994+0000","last_became_peered":"2023-11-29T11:16:07.445994+0000","last_unstale":"2023-11-29T11:16:08.420841+0000","last_undegraded":"2023-11-29T11:16:08.420841+0000","last_fullsized":"2023-11-29T11:16:08.420841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:28:09.917683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.420682+0000","last_change":"2023-11-29T11:16:07.048775+0000","last_active":"2023-11-29T11:16:08.420682+0000","last_peered":"2023-11-29T11:16:08.420682+0000","last_clean":"2023-11-29T11:16:08.420682+0000","last_became_active":"2023-11-29T11:16:07.048436+0000","last_became_peered":"2023-11-29T11:16:07.048436+0000","last_unstale":"2023-11-29T11:16:08.420682+0000","last_undegraded":"2023-11-29T11:16:08.420682+0000","last_fullsized":"2023-11-29T11:16:08.420682+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:51:15.812965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902613+0000","last_change":"2023-11-29T11:16:07.434566+0000","last_active":"2023-11-29T11:16:09.902613+0000","last_peered":"2023-11-29T11:16:09.902613+0000","last_clean":"2023-11-29T11:16:09.902613+0000","last_became_active":"2023-11-29T11:16:07.434293+0000","last_became_peered":"2023-11-29T11:16:07.434293+0000","last_unstale":"2023-11-29T11:16:09.902613+0000","last_undegraded":"2023-11-29T11:16:09.902613+0000","last_fullsized":"2023-11-29T11:16:09.902613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:56:42.020566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"66'8","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.422418+0000","last_change":"2023-11-29T11:16:07.049660+0000","last_active":"2023-11-29T11:16:08.422418+0000","last_peered":"2023-11-29T11:16:08.422418+0000","last_clean":"2023-11-29T11:16:08.422418+0000","last_became_active":"2023-11-29T11:16:07.049373+0000","last_became_peered":"2023-11-29T11:16:07.049373+0000","last_unstale":"2023-11-29T11:16:08.422418+0000","last_undegraded":"2023-11-29T11:16:08.422418+0000","last_fullsized":"2023-11-29T11:16:08.422418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:51:45.082881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421522+0000","last_change":"2023-11-29T11:16:07.426305+0000","last_active":"2023-11-29T11:16:08.421522+0000","last_peered":"2023-11-29T11:16:08.421522+0000","last_clean":"2023-11-29T11:16:08.421522+0000","last_became_active":"2023-11-29T11:16:07.425979+0000","last_became_peered":"2023-11-29T11:16:07.425979+0000","last_unstale":"2023-11-29T11:16:08.421522+0000","last_undegraded":"2023-11-29T11:16:08.421522+0000","last_fullsized":"2023-11-29T11:16:08.421522+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:47:02.918319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"66'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903757+0000","last_change":"2023-11-29T11:16:07.049108+0000","last_active":"2023-11-29T11:16:09.903757+0000","last_peered":"2023-11-29T11:16:09.903757+0000","last_clean":"2023-11-29T11:16:09.903757+0000","last_became_active":"2023-11-29T11:16:07.047725+0000","last_became_peered":"2023-11-29T11:16:07.047725+0000","last_unstale":"2023-11-29T11:16:09.903757+0000","last_undegraded":"2023-11-29T11:16:09.903757+0000","last_fullsized":"2023-11-29T11:16:09.903757+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:28:27.731890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421509+0000","last_change":"2023-11-29T11:16:07.425394+0000","last_active":"2023-11-29T11:16:08.421509+0000","last_peered":"2023-11-29T11:16:08.421509+0000","last_clean":"2023-11-29T11:16:08.421509+0000","last_became_active":"2023-11-29T11:16:07.423886+0000","last_became_peered":"2023-11-29T11:16:07.423886+0000","last_unstale":"2023-11-29T11:16:08.421509+0000","last_undegraded":"2023-11-29T11:16:08.421509+0000","last_fullsized":"2023-11-29T11:16:08.421509+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:47.367658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.422034+0000","last_change":"2023-11-29T11:16:07.048301+0000","last_active":"2023-11-29T11:16:08.422034+0000","last_peered":"2023-11-29T11:16:08.422034+0000","last_clean":"2023-11-29T11:16:08.422034+0000","last_became_active":"2023-11-29T11:16:07.047997+0000","last_became_peered":"2023-11-29T11:16:07.047997+0000","last_unstale":"2023-11-29T11:16:08.422034+0000","last_undegraded":"2023-11-29T11:16:08.422034+0000","last_fullsized":"2023-11-29T11:16:08.422034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:16:08.130078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590401+0000","last_change":"2023-11-29T11:16:07.442396+0000","last_active":"2023-11-29T11:16:08.590401+0000","last_peered":"2023-11-29T11:16:08.590401+0000","last_clean":"2023-11-29T11:16:08.590401+0000","last_became_active":"2023-11-29T11:16:07.442117+0000","last_became_peered":"2023-11-29T11:16:07.442117+0000","last_unstale":"2023-11-29T11:16:08.590401+0000","last_undegraded":"2023-11-29T11:16:08.590401+0000","last_fullsized":"2023-11-29T11:16:08.590401+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:25:54.496165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903219+0000","last_change":"2023-11-29T11:16:07.048792+0000","last_active":"2023-11-29T11:16:09.903219+0000","last_peered":"2023-11-29T11:16:09.903219+0000","last_clean":"2023-11-29T11:16:09.903219+0000","last_became_active":"2023-11-29T11:16:07.048485+0000","last_became_peered":"2023-11-29T11:16:07.048485+0000","last_unstale":"2023-11-29T11:16:09.903219+0000","last_undegraded":"2023-11-29T11:16:09.903219+0000","last_fullsized":"2023-11-29T11:16:09.903219+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:24:46.040425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590922+0000","last_change":"2023-11-29T11:16:07.432801+0000","last_active":"2023-11-29T11:16:08.590922+0000","last_peered":"2023-11-29T11:16:08.590922+0000","last_clean":"2023-11-29T11:16:08.590922+0000","last_became_active":"2023-11-29T11:16:07.432495+0000","last_became_peered":"2023-11-29T11:16:07.432495+0000","last_unstale":"2023-11-29T11:16:08.590922+0000","last_undegraded":"2023-11-29T11:16:08.590922+0000","last_fullsized":"2023-11-29T11:16:08.590922+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:23:25.292695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.421470+0000","last_change":"2023-11-29T11:16:07.043531+0000","last_active":"2023-11-29T11:16:08.421470+0000","last_peered":"2023-11-29T11:16:08.421470+0000","last_clean":"2023-11-29T11:16:08.421470+0000","last_became_active":"2023-11-29T11:16:07.043238+0000","last_became_peered":"2023-11-29T11:16:07.043238+0000","last_unstale":"2023-11-29T11:16:08.421470+0000","last_undegraded":"2023-11-29T11:16:08.421470+0000","last_fullsized":"2023-11-29T11:16:08.421470+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:06:49.607274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903693+0000","last_change":"2023-11-29T11:16:07.435109+0000","last_active":"2023-11-29T11:16:09.903693+0000","last_peered":"2023-11-29T11:16:09.903693+0000","last_clean":"2023-11-29T11:16:09.903693+0000","last_became_active":"2023-11-29T11:16:07.434861+0000","last_became_peered":"2023-11-29T11:16:07.434861+0000","last_unstale":"2023-11-29T11:16:09.903693+0000","last_undegraded":"2023-11-29T11:16:09.903693+0000","last_fullsized":"2023-11-29T11:16:09.903693+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:22:47.220138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902897+0000","last_change":"2023-11-29T11:16:07.046148+0000","last_active":"2023-11-29T11:16:09.902897+0000","last_peered":"2023-11-29T11:16:09.902897+0000","last_clean":"2023-11-29T11:16:09.902897+0000","last_became_active":"2023-11-29T11:16:07.045833+0000","last_became_peered":"2023-11-29T11:16:07.045833+0000","last_unstale":"2023-11-29T11:16:09.902897+0000","last_undegraded":"2023-11-29T11:16:09.902897+0000","last_fullsized":"2023-11-29T11:16:09.902897+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:55:45.507256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902610+0000","last_change":"2023-11-29T11:16:07.440754+0000","last_active":"2023-11-29T11:16:09.902610+0000","last_peered":"2023-11-29T11:16:09.902610+0000","last_clean":"2023-11-29T11:16:09.902610+0000","last_became_active":"2023-11-29T11:16:07.437078+0000","last_became_peered":"2023-11-29T11:16:07.437078+0000","last_unstale":"2023-11-29T11:16:09.902610+0000","last_undegraded":"2023-11-29T11:16:09.902610+0000","last_fullsized":"2023-11-29T11:16:09.902610+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:38:56.242522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.627948+0000","last_change":"2023-11-29T11:16:07.043058+0000","last_active":"2023-11-29T11:16:09.627948+0000","last_peered":"2023-11-29T11:16:09.627948+0000","last_clean":"2023-11-29T11:16:09.627948+0000","last_became_active":"2023-11-29T11:16:07.042248+0000","last_became_peered":"2023-11-29T11:16:07.042248+0000","last_unstale":"2023-11-29T11:16:09.627948+0000","last_undegraded":"2023-11-29T11:16:09.627948+0000","last_fullsized":"2023-11-29T11:16:09.627948+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:27:53.605164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.627948+0000","last_change":"2023-11-29T11:16:07.420388+0000","last_active":"2023-11-29T11:16:09.627948+0000","last_peered":"2023-11-29T11:16:09.627948+0000","last_clean":"2023-11-29T11:16:09.627948+0000","last_became_active":"2023-11-29T11:16:07.420144+0000","last_became_peered":"2023-11-29T11:16:07.420144+0000","last_unstale":"2023-11-29T11:16:09.627948+0000","last_undegraded":"2023-11-29T11:16:09.627948+0000","last_fullsized":"2023-11-29T11:16:09.627948+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:14:02.919239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.422598+0000","last_change":"2023-11-29T11:16:07.041824+0000","last_active":"2023-11-29T11:16:08.422598+0000","last_peered":"2023-11-29T11:16:08.422598+0000","last_clean":"2023-11-29T11:16:08.422598+0000","last_became_active":"2023-11-29T11:16:07.041497+0000","last_became_peered":"2023-11-29T11:16:07.041497+0000","last_unstale":"2023-11-29T11:16:08.422598+0000","last_undegraded":"2023-11-29T11:16:08.422598+0000","last_fullsized":"2023-11-29T11:16:08.422598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:22:11.626747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902471+0000","last_change":"2023-11-29T11:16:07.437150+0000","last_active":"2023-11-29T11:16:09.902471+0000","last_peered":"2023-11-29T11:16:09.902471+0000","last_clean":"2023-11-29T11:16:09.902471+0000","last_became_active":"2023-11-29T11:16:07.432731+0000","last_became_peered":"2023-11-29T11:16:07.432731+0000","last_unstale":"2023-11-29T11:16:09.902471+0000","last_undegraded":"2023-11-29T11:16:09.902471+0000","last_fullsized":"2023-11-29T11:16:09.902471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:27:43.805785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902928+0000","last_change":"2023-11-29T11:16:07.053424+0000","last_active":"2023-11-29T11:16:09.902928+0000","last_peered":"2023-11-29T11:16:09.902928+0000","last_clean":"2023-11-29T11:16:09.902928+0000","last_became_active":"2023-11-29T11:16:07.053098+0000","last_became_peered":"2023-11-29T11:16:07.053098+0000","last_unstale":"2023-11-29T11:16:09.902928+0000","last_undegraded":"2023-11-29T11:16:09.902928+0000","last_fullsized":"2023-11-29T11:16:09.902928+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:33:52.531460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903122+0000","last_change":"2023-11-29T11:16:07.429150+0000","last_active":"2023-11-29T11:16:09.903122+0000","last_peered":"2023-11-29T11:16:09.903122+0000","last_clean":"2023-11-29T11:16:09.903122+0000","last_became_active":"2023-11-29T11:16:07.428873+0000","last_became_peered":"2023-11-29T11:16:07.428873+0000","last_unstale":"2023-11-29T11:16:09.903122+0000","last_undegraded":"2023-11-29T11:16:09.903122+0000","last_fullsized":"2023-11-29T11:16:09.903122+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:16:51.945356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.590549+0000","last_change":"2023-11-29T11:16:07.051479+0000","last_active":"2023-11-29T11:16:08.590549+0000","last_peered":"2023-11-29T11:16:08.590549+0000","last_clean":"2023-11-29T11:16:08.590549+0000","last_became_active":"2023-11-29T11:16:07.050590+0000","last_became_peered":"2023-11-29T11:16:07.050590+0000","last_unstale":"2023-11-29T11:16:08.590549+0000","last_undegraded":"2023-11-29T11:16:08.590549+0000","last_fullsized":"2023-11-29T11:16:08.590549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:21:18.387927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":54,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.432805+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:16:07.432805+0000","last_peered":"2023-11-29T11:16:07.432805+0000","last_clean":"2023-11-29T11:16:07.432805+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:16:07.432805+0000","last_undegraded":"2023-11-29T11:16:07.432805+0000","last_fullsized":"2023-11-29T11:16:07.432805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.628434+0000","last_change":"2023-11-29T11:16:07.430089+0000","last_active":"2023-11-29T11:16:09.628434+0000","last_peered":"2023-11-29T11:16:09.628434+0000","last_clean":"2023-11-29T11:16:09.628434+0000","last_became_active":"2023-11-29T11:16:07.429680+0000","last_became_peered":"2023-11-29T11:16:07.429680+0000","last_unstale":"2023-11-29T11:16:09.628434+0000","last_undegraded":"2023-11-29T11:16:09.628434+0000","last_fullsized":"2023-11-29T11:16:09.628434+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:22:14.990152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"66'1","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903569+0000","last_change":"2023-11-29T11:16:07.052447+0000","last_active":"2023-11-29T11:16:09.903569+0000","last_peered":"2023-11-29T11:16:09.903569+0000","last_clean":"2023-11-29T11:16:09.903569+0000","last_became_active":"2023-11-29T11:16:07.050527+0000","last_became_peered":"2023-11-29T11:16:07.050527+0000","last_unstale":"2023-11-29T11:16:09.903569+0000","last_undegraded":"2023-11-29T11:16:09.903569+0000","last_fullsized":"2023-11-29T11:16:09.903569+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:32:24.248017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":55,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.429815+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:16:07.429815+0000","last_peered":"2023-11-29T11:16:07.429815+0000","last_clean":"2023-11-29T11:16:07.429815+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:16:07.429815+0000","last_undegraded":"2023-11-29T11:16:07.429815+0000","last_fullsized":"2023-11-29T11:16:07.429815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.591014+0000","last_change":"2023-11-29T11:16:07.435003+0000","last_active":"2023-11-29T11:16:08.591014+0000","last_peered":"2023-11-29T11:16:08.591014+0000","last_clean":"2023-11-29T11:16:08.591014+0000","last_became_active":"2023-11-29T11:16:07.434220+0000","last_became_peered":"2023-11-29T11:16:07.434220+0000","last_unstale":"2023-11-29T11:16:08.591014+0000","last_undegraded":"2023-11-29T11:16:08.591014+0000","last_fullsized":"2023-11-29T11:16:08.591014+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:40:22.132204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"66'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.423892+0000","last_change":"2023-11-29T11:16:07.051640+0000","last_active":"2023-11-29T11:16:08.423892+0000","last_peered":"2023-11-29T11:16:08.423892+0000","last_clean":"2023-11-29T11:16:08.423892+0000","last_became_active":"2023-11-29T11:16:07.051306+0000","last_became_peered":"2023-11-29T11:16:07.051306+0000","last_unstale":"2023-11-29T11:16:08.423892+0000","last_undegraded":"2023-11-29T11:16:08.423892+0000","last_fullsized":"2023-11-29T11:16:08.423892+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:34:22.609255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.414783+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:16:07.414783+0000","last_peered":"2023-11-29T11:16:07.414783+0000","last_clean":"2023-11-29T11:16:07.414783+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:16:07.414783+0000","last_undegraded":"2023-11-29T11:16:07.414783+0000","last_fullsized":"2023-11-29T11:16:07.414783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.423793+0000","last_change":"2023-11-29T11:16:07.422278+0000","last_active":"2023-11-29T11:16:08.423793+0000","last_peered":"2023-11-29T11:16:08.423793+0000","last_clean":"2023-11-29T11:16:08.423793+0000","last_became_active":"2023-11-29T11:16:07.421948+0000","last_became_peered":"2023-11-29T11:16:07.421948+0000","last_unstale":"2023-11-29T11:16:08.423793+0000","last_undegraded":"2023-11-29T11:16:08.423793+0000","last_fullsized":"2023-11-29T11:16:08.423793+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:47:13.442895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"66'1","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903701+0000","last_change":"2023-11-29T11:16:07.049120+0000","last_active":"2023-11-29T11:16:09.903701+0000","last_peered":"2023-11-29T11:16:09.903701+0000","last_clean":"2023-11-29T11:16:09.903701+0000","last_became_active":"2023-11-29T11:16:07.048839+0000","last_became_peered":"2023-11-29T11:16:07.048839+0000","last_unstale":"2023-11-29T11:16:09.903701+0000","last_undegraded":"2023-11-29T11:16:09.903701+0000","last_fullsized":"2023-11-29T11:16:09.903701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:32:09.101564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.414454+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:16:07.414454+0000","last_peered":"2023-11-29T11:16:07.414454+0000","last_clean":"2023-11-29T11:16:07.414454+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:16:07.414454+0000","last_undegraded":"2023-11-29T11:16:07.414454+0000","last_fullsized":"2023-11-29T11:16:07.414454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902657+0000","last_change":"2023-11-29T11:16:07.430621+0000","last_active":"2023-11-29T11:16:09.902657+0000","last_peered":"2023-11-29T11:16:09.902657+0000","last_clean":"2023-11-29T11:16:09.902657+0000","last_became_active":"2023-11-29T11:16:07.430256+0000","last_became_peered":"2023-11-29T11:16:07.430256+0000","last_unstale":"2023-11-29T11:16:09.902657+0000","last_undegraded":"2023-11-29T11:16:09.902657+0000","last_fullsized":"2023-11-29T11:16:09.902657+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:16:58.763672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.420848+0000","last_change":"2023-11-29T11:16:07.047488+0000","last_active":"2023-11-29T11:16:08.420848+0000","last_peered":"2023-11-29T11:16:08.420848+0000","last_clean":"2023-11-29T11:16:08.420848+0000","last_became_active":"2023-11-29T11:16:07.047179+0000","last_became_peered":"2023-11-29T11:16:07.047179+0000","last_unstale":"2023-11-29T11:16:08.420848+0000","last_undegraded":"2023-11-29T11:16:08.420848+0000","last_fullsized":"2023-11-29T11:16:08.420848+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:22:05.088212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":205,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.421022+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:16:07.421022+0000","last_peered":"2023-11-29T11:16:07.421022+0000","last_clean":"2023-11-29T11:16:07.421022+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:16:07.421022+0000","last_undegraded":"2023-11-29T11:16:07.421022+0000","last_fullsized":"2023-11-29T11:16:07.421022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":54,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.412971+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:16:07.412971+0000","last_peered":"2023-11-29T11:16:07.412971+0000","last_clean":"2023-11-29T11:16:07.412971+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:16:07.412971+0000","last_undegraded":"2023-11-29T11:16:07.412971+0000","last_fullsized":"2023-11-29T11:16:07.412971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902425+0000","last_change":"2023-11-29T11:16:07.441379+0000","last_active":"2023-11-29T11:16:09.902425+0000","last_peered":"2023-11-29T11:16:09.902425+0000","last_clean":"2023-11-29T11:16:09.902425+0000","last_became_active":"2023-11-29T11:16:07.441062+0000","last_became_peered":"2023-11-29T11:16:07.441062+0000","last_unstale":"2023-11-29T11:16:09.902425+0000","last_undegraded":"2023-11-29T11:16:09.902425+0000","last_fullsized":"2023-11-29T11:16:09.902425+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:47:13.442895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:08.420896+0000","last_change":"2023-11-29T11:16:07.046226+0000","last_active":"2023-11-29T11:16:08.420896+0000","last_peered":"2023-11-29T11:16:08.420896+0000","last_clean":"2023-11-29T11:16:08.420896+0000","last_became_active":"2023-11-29T11:16:07.045921+0000","last_became_peered":"2023-11-29T11:16:07.045921+0000","last_unstale":"2023-11-29T11:16:08.420896+0000","last_undegraded":"2023-11-29T11:16:08.420896+0000","last_fullsized":"2023-11-29T11:16:08.420896+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:52:31.943411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.418309+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:16:07.418309+0000","last_peered":"2023-11-29T11:16:07.418309+0000","last_clean":"2023-11-29T11:16:07.418309+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:16:07.418309+0000","last_undegraded":"2023-11-29T11:16:07.418309+0000","last_fullsized":"2023-11-29T11:16:07.418309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903397+0000","last_change":"2023-11-29T11:16:07.424236+0000","last_active":"2023-11-29T11:16:09.903397+0000","last_peered":"2023-11-29T11:16:09.903397+0000","last_clean":"2023-11-29T11:16:09.903397+0000","last_became_active":"2023-11-29T11:16:07.423946+0000","last_became_peered":"2023-11-29T11:16:07.423946+0000","last_unstale":"2023-11-29T11:16:09.903397+0000","last_undegraded":"2023-11-29T11:16:09.903397+0000","last_fullsized":"2023-11-29T11:16:09.903397+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:27:19.830840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.903147+0000","last_change":"2023-11-29T11:16:07.050417+0000","last_active":"2023-11-29T11:16:09.903147+0000","last_peered":"2023-11-29T11:16:09.903147+0000","last_clean":"2023-11-29T11:16:09.903147+0000","last_became_active":"2023-11-29T11:16:07.049693+0000","last_became_peered":"2023-11-29T11:16:07.049693+0000","last_unstale":"2023-11-29T11:16:09.903147+0000","last_undegraded":"2023-11-29T11:16:09.903147+0000","last_fullsized":"2023-11-29T11:16:09.903147+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:57:56.807959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":60,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.412967+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:16:07.412967+0000","last_peered":"2023-11-29T11:16:07.412967+0000","last_clean":"2023-11-29T11:16:07.412967+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:16:07.412967+0000","last_undegraded":"2023-11-29T11:16:07.412967+0000","last_fullsized":"2023-11-29T11:16:07.412967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.904144+0000","last_change":"2023-11-29T11:16:07.434468+0000","last_active":"2023-11-29T11:16:09.904144+0000","last_peered":"2023-11-29T11:16:09.904144+0000","last_clean":"2023-11-29T11:16:09.904144+0000","last_became_active":"2023-11-29T11:16:07.434194+0000","last_became_peered":"2023-11-29T11:16:07.434194+0000","last_unstale":"2023-11-29T11:16:09.904144+0000","last_undegraded":"2023-11-29T11:16:09.904144+0000","last_fullsized":"2023-11-29T11:16:09.904144+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:07.015901+0000","last_clean_scrub_stamp":"2023-11-29T11:16:07.015901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:30:35.862469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"66'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-11-29T11:16:09.902791+0000","last_change":"2023-11-29T11:16:07.047684+0000","last_active":"2023-11-29T11:16:09.902791+0000","last_peered":"2023-11-29T11:16:09.902791+0000","last_clean":"2023-11-29T11:16:09.902791+0000","last_became_active":"2023-11-29T11:16:07.047341+0000","last_became_peered":"2023-11-29T11:16:07.047341+0000","last_unstale":"2023-11-29T11:16:09.902791+0000","last_undegraded":"2023-11-29T11:16:09.902791+0000","last_fullsized":"2023-11-29T11:16:09.902791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:16:06.011987+0000","last_clean_scrub_stamp":"2023-11-29T11:16:06.011987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:13:35.498214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-29T11:16:07.420924+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:16:07.420924+0000","last_peered":"2023-11-29T11:16:07.420924+0000","last_clean":"2023-11-29T11:16:07.420924+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:16:07.420924+0000","last_undegraded":"2023-11-29T11:16:07.420924+0000","last_fullsized":"2023-11-29T11:16:07.420924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10856,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360984,"statfs":{"total":96636764160,"available":96625647616,"internally_reserved":0,"allocated":1409024,"data_stored":969670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.88900000000000001,"15min":0.90700000000000003},"min":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.204,"5min":1.371,"15min":1.371},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.101}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90100000000000002,"15min":0.91100000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.0449999999999999,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.995,"15min":1.0189999999999999},"min":{"1min":0.65600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2090000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.3979999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.65200000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1899999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.169,"5min":1.641,"15min":1.641},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96499999999999997,"15min":0.98099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.3140000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.94499999999999995,"15min":0.98699999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.248,"5min":1.319,"15min":1.319},"last":0.876},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0680000000000001,"15min":1.0880000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.349,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.91900000000000004}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.087,"15min":1.131},"min":{"1min":0.68899999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":1.45},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.1000000000000001,"15min":1.141},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.234,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.2010000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.1419999999999999,"15min":1.1839999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.196,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1819999999999999,"15min":1.204},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.472,"5min":1.77,"15min":1.77},"last":1.145}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9700,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362140,"statfs":{"total":96636764160,"available":96626831360,"internally_reserved":0,"allocated":815104,"data_stored":378794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.80600000000000005,"15min":0.80200000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.82999999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.462,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.01}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3260000000000001,"5min":1.625,"15min":1.625},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92800000000000005,"15min":0.93000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92500000000000004,"15min":0.92700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.254,"5min":1.714,"15min":1.714},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.98299999999999998,"15min":0.97599999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.456,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.032}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.073,"15min":1.0680000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5660000000000001,"5min":1.593,"15min":1.593},"last":1.0660000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0740000000000001,"15min":1.0860000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5580000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.071,"15min":1.081},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.143}]}]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13792,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":12992,"kb_avail":94358048,"statfs":{"total":96636764160,"available":96622641152,"internally_reserved":0,"allocated":811008,"data_stored":378792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13303808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.224,"5min":1.242,"15min":1.242},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.079,"5min":1.512,"15min":1.512},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.04}]},{"osd":2,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1299999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.999}]},{"osd":3,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90600000000000003,"15min":0.90000000000000002},"min":{"1min":0.65100000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0249999999999999},"min":{"1min":0.76800000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5649999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":0.88400000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.56599999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1539999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.58599999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.607,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.071}]},{"osd":6,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.0409999999999999,"15min":1.0609999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.389,"5min":1.585,"15min":1.585},"last":1.133},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.038,"15min":1.052},"min":{"1min":0.621,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2869999999999999,"5min":1.575,"15min":1.575},"last":1.1970000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:15:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.111,"15min":1.1000000000000001},"min":{"1min":0.77900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3360000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1879999999999999,"15min":1.204},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6399999999999999,"5min":1.889,"15min":1.889},"last":1.1719999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9888,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361952,"statfs":{"total":96636764160,"available":96626638848,"internally_reserved":0,"allocated":811008,"data_stored":378772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1519999999999999,"5min":1.431,"15min":1.431},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.65100000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1579999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.87}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.88800000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.276,"5min":1.458,"15min":1.458},"last":1.077},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88400000000000001,"15min":0.879},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1870000000000001,"5min":1.401,"15min":1.401},"last":0.73999999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85899999999999999,"15min":0.86699999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1080000000000001,"5min":1.206,"15min":1.206},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.95699999999999996,"15min":0.98299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.05}]},{"osd":3,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.232,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92800000000000005,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.127},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96599999999999997,"15min":0.96499999999999997},"min":{"1min":0.70699999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3620000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0089999999999999,"15min":1.0189999999999999},"min":{"1min":0.755,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4550000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84399999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.097,"15min":1.107},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.101},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.159,"15min":1.175},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5649999999999999,"5min":1.905,"15min":1.905},"last":1.024}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9816,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94362024,"statfs":{"total":96636764160,"available":96626712576,"internally_reserved":0,"allocated":802816,"data_stored":371841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.98099999999999998,"5min":1.282,"15min":1.282},"last":0.60099999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61299999999999999},"min":{"1min":0.497,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.139,"5min":3.774,"15min":3.774},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.0109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.47699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.45,"5min":1.494,"15min":1.494},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.022,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98299999999999998,"15min":0.98999999999999999},"min":{"1min":0.65900000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.94599999999999995,"15min":0.96599999999999997},"min":{"1min":0.622,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3340000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95299999999999996,"15min":0.94499999999999995},"min":{"1min":0.70999999999999996,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.0820000000000001,"15min":1.0860000000000001},"min":{"1min":0.73699999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":0.93500000000000005}]},{"osd":6,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0229999999999999,"15min":1.008},"min":{"1min":0.70799999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.87},{"interface":"front","average":{"1min":1.034,"5min":1.0960000000000001,"15min":1.0600000000000001},"min":{"1min":0.85699999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2709999999999999,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.71999999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:15:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.135,"15min":1.145},"min":{"1min":0.82099999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0720000000000001,"15min":1.04},"min":{"1min":0.91600000000000004,"5min":0.437,"15min":0.437},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.67200000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":819200,"data_stored":380250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63700000000000001,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.626},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0229999999999999,"5min":1.107,"15min":1.107},"last":0.72899999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95899999999999996,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1220000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.012}]},{"osd":4,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95199999999999996,"15min":0.97499999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2769999999999999,"5min":1.371,"15min":1.371},"last":1.28},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.95499999999999996,"15min":0.97699999999999998},"min":{"1min":0.746,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.157,"5min":1.532,"15min":1.532},"last":1.3100000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97599999999999998,"15min":0.98699999999999999},"min":{"1min":0.68999999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.155,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.23},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1559999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.97499999999999998,"15min":0.999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1850000000000001,"5min":1.327,"15min":1.327},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0269999999999999,"15min":1.056},"min":{"1min":0.77700000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.302,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.153}]},{"osd":7,"last update":"Wed Nov 29 11:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0349999999999999,"15min":1.0509999999999999},"min":{"1min":0.76500000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1990000000000001,"5min":1.76,"15min":1.76},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0509999999999999,"15min":1.071},"min":{"1min":0.72999999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3100000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.94599999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10804,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":9408,"kb_avail":94361036,"statfs":{"total":96636764160,"available":96625700864,"internally_reserved":0,"allocated":1421312,"data_stored":971218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9633792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.40500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.94999999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.56000000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":1.393,"15min":1.393},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0209999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.71099999999999997},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91500000000000004,"5min":1.744,"15min":1.744},"last":0.496}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2430000000000001,"5min":1.609,"15min":1.609},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1.0189999999999999,"15min":1.036},"min":{"1min":0.74199999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.22,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.0209999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.98699999999999999,"15min":1.0009999999999999},"min":{"1min":0.78500000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4770000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.0169999999999999},"min":{"1min":0.77500000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2629999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0680000000000001,"15min":1.0960000000000001},"min":{"1min":0.749,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2669999999999999,"5min":1.575,"15min":1.575},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.99399999999999999,"15min":0.999},"min":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4099999999999999,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.2070000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0509999999999999,"15min":1.075},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.3260000000000001,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.444},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.1020000000000001,"15min":1.1220000000000001},"min":{"1min":0.78600000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2929999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3720000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9880,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361960,"statfs":{"total":96636764160,"available":96626647040,"internally_reserved":0,"allocated":802816,"data_stored":377716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95399999999999996,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0149999999999999,"5min":1.155,"15min":1.155},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.46899999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.745}]},{"osd":3,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.149,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.69799999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.75,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.296,"5min":1.423,"15min":1.423},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98999999999999999,"15min":1.012},"min":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2490000000000001,"5min":1.399,"15min":1.399},"last":0.84899999999999998}]},{"osd":5,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.022,"15min":1.026},"min":{"1min":0.78600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.179,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.0049999999999999,"15min":1.004},"min":{"1min":0.82299999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3680000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1899999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0680000000000001,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.2789999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.052},{"interface":"front","average":{"1min":1.054,"5min":1.105,"15min":1.133},"min":{"1min":0.80300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.264,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3220000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1180000000000001,"15min":1.1479999999999999},"min":{"1min":0.86899999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3480000000000001,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.071,"15min":1.085},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4159999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3440000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:16:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-29T11:16:15.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-29T11:16:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.258+0000 7f8a673e0700 1 Processor -- start 2023-11-29T11:16:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.258+0000 7f8a673e0700 1 -- start start 2023-11-29T11:16:15.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a673e0700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8a600b6330 0x7f8a600cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a673e0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600b6700 con 0x7f8a6006fa70 2023-11-29T11:16:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a673e0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600cb070 con 0x7f8a600b2b10 2023-11-29T11:16:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a673e0700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600cb5c0 con 0x7f8a600b6330 2023-11-29T11:16:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8a6006fa70 0x7f8a600b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60168/0 (socket says 172.21.15.81:60168) 2023-11-29T11:16:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 -- 172.21.15.81:0/3004883966 learned_addr learned my addr 172.21.15.81:0/3004883966 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:15.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6517c700 1 --2- 172.21.15.81:0/3004883966 >> v2:172.21.15.176:3300/0 conn(0x7f8a600b6330 0x7f8a600cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432664302 0 0) 0x7f8a600b6700 con 0x7f8a6006fa70 2023-11-29T11:16:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a4c0035d0 con 0x7f8a6006fa70 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3129503949 0 0) 0x7f8a4c0035d0 con 0x7f8a6006fa70 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 >> v2:172.21.15.176:3300/0 conn(0x7f8a600b6330 msgr2=0x7f8a600cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 --2- 172.21.15.81:0/3004883966 >> v2:172.21.15.176:3300/0 conn(0x7f8a600b6330 0x7f8a600cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 >> v1:172.21.15.176:6789/0 conn(0x7f8a600b2b10 legacy=0x7f8a600b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600cb2e0 con 0x7f8a6006fa70 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f8a5c001670 con 0x7f8a6006fa70 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 >> v1:172.21.15.81:6789/0 conn(0x7f8a6006fa70 legacy=0x7f8a600b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a4c003a20 0x7f8a4c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a4c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a4c005220 0x7f8a4c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600cb5c0 con 0x7f8a4c004870 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c00c130 con 0x7f8a4c003a20 2023-11-29T11:16:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c00c2f0 con 0x7f8a4c005220 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6517c700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a4c003a20 0x7f8a4c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a4c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6597d700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a4c005220 0x7f8a4c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 -- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a4c005220 msgr2=0x7f8a4c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a4c005220 0x7f8a4c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 -- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a4c003a20 msgr2=0x7f8a4c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a4c003a20 0x7f8a4c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6597d700 1 -- 172.21.15.81:0/3004883966 reap_dead start 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 -- 172.21.15.81:0/3004883966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0035d0 con 0x7f8a4c004870 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6517c700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a4c003a20 0x7f8a4c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a6497b700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a4c004ce0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00c320 tx=0x7f8a4c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa1ad4b806d8243 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c007c30 con 0x7f8a4c004870 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c00ce20 con 0x7f8a4c004870 2023-11-29T11:16:15.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.262+0000 7f8a53fff700 1 -- 172.21.15.81:0/3004883966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c005bc0 con 0x7f8a4c004870 2023-11-29T11:16:15.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- 172.21.15.81:0/3004883966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 msgr2=0x7f8a4c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a4c004ce0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00c320 tx=0x7f8a4c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- 172.21.15.81:0/3004883966 shutdown_connections 2023-11-29T11:16:15.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 --2- 172.21.15.81:0/3004883966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a4c004ce0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- 172.21.15.81:0/3004883966 >> 172.21.15.81:0/3004883966 conn(0x7f8a600cd400 msgr2=0x7f8a600cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:15.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- 172.21.15.81:0/3004883966 shutdown_connections 2023-11-29T11:16:15.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- 172.21.15.81:0/3004883966 wait complete. 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 Processor -- start 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- start start 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a60150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a60150a70 0x7f8a6015cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a601f2c80 0x7f8a6015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a601f6550 con 0x7f8a4c004870 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a601f1f90 con 0x7f8a601f2c80 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a601f6270 con 0x7f8a60150a70 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a60150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a60150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57966/0 (socket says 172.21.15.81:57966) 2023-11-29T11:16:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 -- 172.21.15.81:0/2145082801 learned_addr learned my addr 172.21.15.81:0/2145082801 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6597d700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a601f2c80 0x7f8a6015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6497b700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a60150a70 0x7f8a6015cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 -- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a60150a70 msgr2=0x7f8a6015cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a60150a70 0x7f8a6015cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 -- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a601f2c80 msgr2=0x7f8a6015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a601f2c80 0x7f8a6015d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 -- 172.21.15.81:0/2145082801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600d0050 con 0x7f8a4c004870 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6597d700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a601f2c80 0x7f8a6015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6497b700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a60150a70 0x7f8a6015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a6517c700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a60150530 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8a54011bd0 tx=0x7f8a54011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a51ffb700 1 -- 172.21.15.81:0/2145082801 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400fa60 con 0x7f8a4c004870 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a51ffb700 1 -- 172.21.15.81:0/2145082801 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5400fbc0 con 0x7f8a4c004870 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a600cfd70 con 0x7f8a4c004870 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a51ffb700 1 -- 172.21.15.81:0/2145082801 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54004020 con 0x7f8a4c004870 2023-11-29T11:16:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.266+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6006fef0 con 0x7f8a4c004870 2023-11-29T11:16:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.270+0000 7f8a51ffb700 1 -- 172.21.15.81:0/2145082801 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8a54024070 con 0x7f8a4c004870 2023-11-29T11:16:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.270+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a60066670 con 0x7f8a4c004870 2023-11-29T11:16:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.270+0000 7f8a51ffb700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a44064ee0 0x7f8a44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.270+0000 7f8a6497b700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a44064ee0 0x7f8a44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.270+0000 7f8a51ffb700 1 -- 172.21.15.81:0/2145082801 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8a54082390 con 0x7f8a4c004870 2023-11-29T11:16:15.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.270+0000 7f8a6497b700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a44064ee0 0x7f8a44067390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c015040 tx=0x7f8a5c006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.278+0000 7f8a51ffb700 1 -- 172.21.15.81:0/2145082801 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8a54050300 con 0x7f8a4c004870 2023-11-29T11:16:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.502+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f8a60072500 con 0x7f8a4c004870 2023-11-29T11:16:15.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.510+0000 7f8a51ffb700 1 -- 172.21.15.81:0/2145082801 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8a54053920 con 0x7f8a4c004870 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a44064ee0 msgr2=0x7f8a44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a44064ee0 0x7f8a44067390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c015040 tx=0x7f8a5c006040 comp rx=0 tx=0).stop 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 msgr2=0x7f8a60150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a60150530 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8a54011bd0 tx=0x7f8a54011f90 comp rx=0 tx=0).stop 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 shutdown_connections 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a44064ee0 0x7f8a44067390 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a601f2c80 0x7f8a6015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a60150a70 0x7f8a6015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 --2- 172.21.15.81:0/2145082801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a4c004870 0x7f8a60150530 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 >> 172.21.15.81:0/2145082801 conn(0x7f8a600cd400 msgr2=0x7f8a60159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 shutdown_connections 2023-11-29T11:16:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.514+0000 7f8a673e0700 1 -- 172.21.15.81:0/2145082801 wait complete. 2023-11-29T11:16:15.521 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-11-29T11:16:15.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:16:15.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 Processor -- start 2023-11-29T11:16:15.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 -- start start 2023-11-29T11:16:15.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f31900cd000 0x7f31900cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f31900cd3d0 0x7f31900b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900ce3a0 con 0x7f31900cf120 2023-11-29T11:16:15.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31900d02c0 con 0x7f31900cd3d0 2023-11-29T11:16:15.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31900d04b0 con 0x7f31900cd000 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3194c56700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f31900cf120 0x7f31900cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60170/0 (socket says 172.21.15.81:60170) 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3194c56700 1 -- 172.21.15.81:0/1835795695 learned_addr learned my addr 172.21.15.81:0/1835795695 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318f7fe700 1 --2- 172.21.15.81:0/1835795695 >> v2:172.21.15.81:3300/0 conn(0x7f31900cd3d0 0x7f31900b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318ffff700 1 --2- 172.21.15.81:0/1835795695 >> v2:172.21.15.176:3300/0 conn(0x7f31900cd000 0x7f31900cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318effd700 1 -- 172.21.15.81:0/1835795695 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569154666 0 0) 0x7f31900ce3a0 con 0x7f31900cf120 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318effd700 1 -- 172.21.15.81:0/1835795695 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f317c0035d0 con 0x7f31900cf120 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318f7fe700 1 -- 172.21.15.81:0/1835795695 >> v2:172.21.15.176:3300/0 conn(0x7f31900cd000 msgr2=0x7f31900cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318f7fe700 1 --2- 172.21.15.81:0/1835795695 >> v2:172.21.15.176:3300/0 conn(0x7f31900cd000 0x7f31900cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318f7fe700 1 -- 172.21.15.81:0/1835795695 >> v1:172.21.15.81:6789/0 conn(0x7f31900cf120 legacy=0x7f31900cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318f7fe700 1 -- 172.21.15.81:0/1835795695 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900ce640 con 0x7f31900cd3d0 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318f7fe700 1 --2- 172.21.15.81:0/1835795695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd3d0 0x7f31900b3480 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f31900cdf80 tx=0x7f3180009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecd55927a272248 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318effd700 1 -- 172.21.15.81:0/1835795695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180005e50 con 0x7f31900cd3d0 2023-11-29T11:16:15.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318effd700 1 -- 172.21.15.81:0/1835795695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180006030 con 0x7f31900cd3d0 2023-11-29T11:16:15.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f318effd700 1 -- 172.21.15.81:0/1835795695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800063c0 con 0x7f31900cd3d0 2023-11-29T11:16:15.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 -- 172.21.15.81:0/1835795695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd3d0 msgr2=0x7f31900b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.642+0000 7f3195457700 1 --2- 172.21.15.81:0/1835795695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd3d0 0x7f31900b3480 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f31900cdf80 tx=0x7f3180009b20 comp rx=0 tx=0).stop 2023-11-29T11:16:15.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 -- 172.21.15.81:0/1835795695 shutdown_connections 2023-11-29T11:16:15.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 --2- 172.21.15.81:0/1835795695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd3d0 0x7f31900b3480 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 --2- 172.21.15.81:0/1835795695 >> v2:172.21.15.176:3300/0 conn(0x7f31900cd000 0x7f31900cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 -- 172.21.15.81:0/1835795695 >> 172.21.15.81:0/1835795695 conn(0x7f31900b2140 msgr2=0x7f31900b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:15.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 -- 172.21.15.81:0/1835795695 shutdown_connections 2023-11-29T11:16:15.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 -- 172.21.15.81:0/1835795695 wait complete. 2023-11-29T11:16:15.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 Processor -- start 2023-11-29T11:16:15.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 -- start start 2023-11-29T11:16:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd000 0x7f3190156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31900cd3d0 0x7f3190154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cf120 0x7f319006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190155680 con 0x7f31900cd000 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190155960 con 0x7f31900cf120 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f3195457700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3190155c40 con 0x7f31900cd3d0 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.646+0000 7f318ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd000 0x7f3190156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd000 0x7f3190156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57984/0 (socket says 172.21.15.81:57984) 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318ffff700 1 -- 172.21.15.81:0/38361764 learned_addr learned my addr 172.21.15.81:0/38361764 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318f7fe700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31900cd3d0 0x7f3190154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f3194c56700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cf120 0x7f319006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318ffff700 1 -- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31900cd3d0 msgr2=0x7f3190154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318ffff700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31900cd3d0 0x7f3190154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318ffff700 1 -- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cf120 msgr2=0x7f319006f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318ffff700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cf120 0x7f319006f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318ffff700 1 -- 172.21.15.81:0/38361764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3180009450 con 0x7f31900cd000 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f3194c56700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cf120 0x7f319006f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318ffff700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd000 0x7f3190156720 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f317800e840 tx=0x7f317800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318cff9700 1 -- 172.21.15.81:0/38361764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31780095a0 con 0x7f31900cd000 2023-11-29T11:16:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318cff9700 1 -- 172.21.15.81:0/38361764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317800c690 con 0x7f31900cd000 2023-11-29T11:16:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318cff9700 1 -- 172.21.15.81:0/38361764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800ca00 con 0x7f31900cd000 2023-11-29T11:16:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31900cec00 con 0x7f31900cd000 2023-11-29T11:16:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31900ce920 con 0x7f31900cd000 2023-11-29T11:16:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319015d6a0 con 0x7f31900cd000 2023-11-29T11:16:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.650+0000 7f318cff9700 1 -- 172.21.15.81:0/38361764 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3178019030 con 0x7f31900cd000 2023-11-29T11:16:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.654+0000 7f318cff9700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3170064ee0 0x7f3170067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.654+0000 7f318cff9700 1 -- 172.21.15.81:0/38361764 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3178081f40 con 0x7f31900cd000 2023-11-29T11:16:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.654+0000 7f318f7fe700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3170064ee0 0x7f3170067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.654+0000 7f318f7fe700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3170064ee0 0x7f3170067390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3180009b60 tx=0x7f3180008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.662+0000 7f318cff9700 1 -- 172.21.15.81:0/38361764 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f317804fe90 con 0x7f31900cd000 2023-11-29T11:16:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3190072500 con 0x7f31900cd000 2023-11-29T11:16:15.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f318cff9700 1 -- 172.21.15.81:0/38361764 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f3178017090 con 0x7f31900cd000 2023-11-29T11:16:15.863 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:15.863 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:09.416362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:16:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3170064ee0 msgr2=0x7f3170067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3170064ee0 0x7f3170067390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3180009b60 tx=0x7f3180008070 comp rx=0 tx=0).stop 2023-11-29T11:16:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd000 msgr2=0x7f3190156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd000 0x7f3190156720 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f317800e840 tx=0x7f317800ec00 comp rx=0 tx=0).stop 2023-11-29T11:16:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 shutdown_connections 2023-11-29T11:16:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3170064ee0 0x7f3170067390 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31900cf120 0x7f319006f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31900cd3d0 0x7f3190154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 --2- 172.21.15.81:0/38361764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31900cd000 0x7f3190156720 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:15.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 >> 172.21.15.81:0/38361764 conn(0x7f31900b2140 msgr2=0x7f31900b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:15.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 shutdown_connections 2023-11-29T11:16:15.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:15.858+0000 7f3195457700 1 -- 172.21.15.81:0/38361764 wait complete. 2023-11-29T11:16:15.866 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 31 2023-11-29T11:16:16.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:16:07.398184+0000', 'modified': '2023-11-29T11:16:09.416362+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6564}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6564': {'gid': 6564, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/458453409', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 458453409}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 458453409}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:16:16.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:16:16.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-29T11:16:16.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.394+0000 7f68a3a5c700 1 Processor -- start 2023-11-29T11:16:16.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.394+0000 7f68a3a5c700 1 -- start start 2023-11-29T11:16:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.394+0000 7f68a3a5c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f689c15bed0 0x7f689c06b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.394+0000 7f68a3a5c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c06b590 con 0x7f689c0cca90 2023-11-29T11:16:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.394+0000 7f68a3a5c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c069fb0 con 0x7f689c0707d0 2023-11-29T11:16:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.394+0000 7f68a3a5c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c06a290 con 0x7f689c15bed0 2023-11-29T11:16:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a17f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f689c15bed0 0x7f689c06b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a1ff9700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f689c0cca90 0x7f689c0c5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60180/0 (socket says 172.21.15.81:60180) 2023-11-29T11:16:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a1ff9700 1 -- 172.21.15.81:0/2789780144 learned_addr learned my addr 172.21.15.81:0/2789780144 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:16.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a17f8700 1 -- 172.21.15.81:0/2789780144 >> v1:172.21.15.176:6789/0 conn(0x7f689c0707d0 legacy=0x7f689c0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a17f8700 1 -- 172.21.15.81:0/2789780144 >> v1:172.21.15.81:6789/0 conn(0x7f689c0cca90 legacy=0x7f689c0c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a17f8700 1 -- 172.21.15.81:0/2789780144 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c06a570 con 0x7f689c15bed0 2023-11-29T11:16:16.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a17f8700 1 --2- 172.21.15.81:0/2789780144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c15bed0 0x7f689c06b050 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f688c009850 tx=0x7f688c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b002f3556361d8f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f6893fff700 1 -- 172.21.15.81:0/2789780144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c011830 con 0x7f689c15bed0 2023-11-29T11:16:16.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f6893fff700 1 -- 172.21.15.81:0/2789780144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c011990 con 0x7f689c15bed0 2023-11-29T11:16:16.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f6893fff700 1 -- 172.21.15.81:0/2789780144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c011d20 con 0x7f689c15bed0 2023-11-29T11:16:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a3a5c700 1 -- 172.21.15.81:0/2789780144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c15bed0 msgr2=0x7f689c06b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a3a5c700 1 --2- 172.21.15.81:0/2789780144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c15bed0 0x7f689c06b050 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f688c009850 tx=0x7f688c009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a3a5c700 1 -- 172.21.15.81:0/2789780144 shutdown_connections 2023-11-29T11:16:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a3a5c700 1 --2- 172.21.15.81:0/2789780144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c15bed0 0x7f689c06b050 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a3a5c700 1 -- 172.21.15.81:0/2789780144 >> 172.21.15.81:0/2789780144 conn(0x7f689c06caf0 msgr2=0x7f689c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a3a5c700 1 -- 172.21.15.81:0/2789780144 shutdown_connections 2023-11-29T11:16:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.398+0000 7f68a3a5c700 1 -- 172.21.15.81:0/2789780144 wait complete. 2023-11-29T11:16:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 Processor -- start 2023-11-29T11:16:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 -- start start 2023-11-29T11:16:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c0707d0 0x7f689c14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c0cca90 0x7f689c14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c14e1d0 0x7f689c145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c14f150 con 0x7f689c0707d0 2023-11-29T11:16:16.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c1522b0 con 0x7f689c0cca90 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c152570 con 0x7f689c14e1d0 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c0707d0 0x7f689c14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c0707d0 0x7f689c14e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58004/0 (socket says 172.21.15.81:58004) 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 -- 172.21.15.81:0/630523165 learned_addr learned my addr 172.21.15.81:0/630523165 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c14e1d0 0x7f689c145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c0cca90 0x7f689c14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 -- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c14e1d0 msgr2=0x7f689c145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c14e1d0 0x7f689c145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 -- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c0cca90 msgr2=0x7f689c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c0cca90 0x7f689c14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 -- 172.21.15.81:0/630523165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0094b0 con 0x7f689c0707d0 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c0cca90 0x7f689c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a17f8700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c0707d0 0x7f689c14e8e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f688c000c00 tx=0x7f688c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f6891ffb700 1 -- 172.21.15.81:0/630523165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c0044b0 con 0x7f689c0707d0 2023-11-29T11:16:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f6891ffb700 1 -- 172.21.15.81:0/630523165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c01f070 con 0x7f689c0707d0 2023-11-29T11:16:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.402+0000 7f68a3a5c700 1 -- 172.21.15.81:0/630523165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c06ab30 con 0x7f689c0707d0 2023-11-29T11:16:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.406+0000 7f6891ffb700 1 -- 172.21.15.81:0/630523165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c003900 con 0x7f689c0707d0 2023-11-29T11:16:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.406+0000 7f68a3a5c700 1 -- 172.21.15.81:0/630523165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c06a850 con 0x7f689c0707d0 2023-11-29T11:16:16.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.406+0000 7f6891ffb700 1 -- 172.21.15.81:0/630523165 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f688c00f050 con 0x7f689c0707d0 2023-11-29T11:16:16.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.406+0000 7f6891ffb700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6888064ee0 0x7f6888067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.406+0000 7f6891ffb700 1 -- 172.21.15.81:0/630523165 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f688c083510 con 0x7f689c0707d0 2023-11-29T11:16:16.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.406+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6888064ee0 0x7f6888067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6888064ee0 0x7f6888067390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f689c0cb3c0 tx=0x7f6898009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a6cdc740 1 Processor -- start 2023-11-29T11:16:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a6cdc740 1 -- start start 2023-11-29T11:16:16.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd62e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xd63340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd63880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xc21ae0 con 0xafd790 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xc91bd0 con 0xab2ae0 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0xc8aed0 con 0xab2710 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd63880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a0ff7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xd63340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd63880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58012/0 (socket says 172.21.15.81:58012) 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a17f8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd62e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 -- 172.21.15.81:0/1426513437 learned_addr learned my addr 172.21.15.81:0/1426513437 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 -- 172.21.15.81:0/1426513437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 msgr2=0xd63340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/1426513437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xd63340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 -- 172.21.15.81:0/1426513437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 msgr2=0xd62e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/1426513437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd62e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 -- 172.21.15.81:0/1426513437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xcb0cc0 con 0xafd790 2023-11-29T11:16:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/1426513437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd63880 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6894002110 tx=0x7f6894001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fac82b7cef238 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f6882ffd700 1 -- 172.21.15.81:0/1426513437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894001d90 con 0xafd790 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f6882ffd700 1 -- 172.21.15.81:0/1426513437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400f8d0 con 0xafd790 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.410+0000 7f6882ffd700 1 -- 172.21.15.81:0/1426513437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400fc40 con 0xafd790 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- 172.21.15.81:0/1426513437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 msgr2=0xd63880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/1426513437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd63880 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6894002110 tx=0x7f6894001950 comp rx=0 tx=0).stop 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- 172.21.15.81:0/1426513437 shutdown_connections 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/1426513437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd63880 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/1426513437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xd63340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/1426513437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd62e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- 172.21.15.81:0/1426513437 >> 172.21.15.81:0/1426513437 conn(0xab2eb0 msgr2=0xd4b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- 172.21.15.81:0/1426513437 shutdown_connections 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- 172.21.15.81:0/1426513437 wait complete. 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- start start 2023-11-29T11:16:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 Processor -- start 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xd6f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd49c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd20be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb37b20 con 0xafd790 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xd24800 con 0xab2ae0 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0xd4a140 con 0xab2710 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 10 client.0 _ll_register_callbacks cb 0xce70d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd20be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a17f8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xd6f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd20be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58016/0 (socket says 172.21.15.81:58016) 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 -- 172.21.15.81:0/2365214635 learned_addr learned my addr 172.21.15.81:0/2365214635 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd49c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 -- 172.21.15.81:0/2365214635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 msgr2=0xd6f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xd6f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 -- 172.21.15.81:0/2365214635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 msgr2=0xd49c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd49c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 -- 172.21.15.81:0/2365214635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c06b590 con 0xafd790 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd20be0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6894000f80 tx=0x7f6894001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea459b1f56b7851 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f687bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f687bfff700 1 -- 172.21.15.81:0/2365214635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689401c820 con 0xafd790 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f687bfff700 1 -- 172.21.15.81:0/2365214635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6894027d90 con 0xafd790 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- 172.21.15.81:0/2365214635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc83f50 con 0xafd790 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f687bfff700 1 -- 172.21.15.81:0/2365214635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f689401c980 con 0xafd790 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 10 client.6753 fetch_fsmap learned FSMap version 31 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.414+0000 7f68a6cdc740 1 -- 172.21.15.81:0/2365214635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0xafe9e0 con 0xafd790 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f687bfff700 1 -- 172.21.15.81:0/2365214635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc83f50 con 0xafd790 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f687bfff700 1 -- 172.21.15.81:0/2365214635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f6894012070 con 0xafd790 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 10 client.6753 fetch_fsmap finished waiting for FSMap version 31 2023-11-29T11:16:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 10 client.6753 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:16:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 20 client.6753 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0xd1e370 0xd1ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 4 client.6753 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:16:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 -- 172.21.15.81:0/2365214635 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc83c70 con 0xd1e370 2023-11-29T11:16:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a17f8700 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0xd1e370 0xd1ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f687bfff700 10 client.6753 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a17f8700 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0xd1e370 0xd1ffb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b80f46ff05c563d server_cookie=d8590a0619e16624 in_seq=0 out_seq=0 2023-11-29T11:16:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f687bfff700 1 -- 172.21.15.81:0/2365214635 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xc83c70 con 0xd1e370 2023-11-29T11:16:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f687bfff700 10 client.6753 handle_command_reply: tid=0 2023-11-29T11:16:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 client.6753 shutdown 2023-11-29T11:16:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 -- 172.21.15.81:0/2365214635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 msgr2=0xd20be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd20be0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6894000f80 tx=0x7f6894001250 comp rx=0 tx=0).stop 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 -- 172.21.15.81:0/2365214635 shutdown_connections 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0xd1e370 0xd1ffb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xafd790 0xd20be0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd49c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/2365214635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xd6f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 -- 172.21.15.81:0/2365214635 >> 172.21.15.81:0/2365214635 conn(0xab2eb0 msgr2=0xd4b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f687bfff700 0 client.6753 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 -- 172.21.15.81:0/2365214635 shutdown_connections 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 1 -- 172.21.15.81:0/2365214635 wait complete. 2023-11-29T11:16:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.418+0000 7f68a6cdc740 20 client.6753 trim_cache size 0 max 16384 2023-11-29T11:16:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.438+0000 7f68a6cdc740 1 Processor -- start 2023-11-29T11:16:16.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.438+0000 7f68a6cdc740 1 -- start start 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2eb0 0xd1ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2710 0xd204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd21710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xc8a6e0 con 0xab2710 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xc40a40 con 0xab2ae0 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0xc3b260 con 0xab2eb0 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2710 0xd204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2710 0xd204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58024/0 (socket says 172.21.15.81:58024) 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 -- 172.21.15.81:0/108116482 learned_addr learned my addr 172.21.15.81:0/108116482 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd21710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a17f8700 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2eb0 0xd1ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 -- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2eb0 msgr2=0xd1ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:16.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2eb0 0xd1ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 -- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 msgr2=0xd21710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:16.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd21710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 -- 172.21.15.81:0/108116482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc518a0 con 0xab2710 2023-11-29T11:16:16.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd21710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:16.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2710 0xd204c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f68980053a0 tx=0x7f6898011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3bf3d903205a8a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68837fe700 1 -- 172.21.15.81:0/108116482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898003d70 con 0xab2710 2023-11-29T11:16:16.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68837fe700 1 -- 172.21.15.81:0/108116482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689800e620 con 0xab2710 2023-11-29T11:16:16.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68837fe700 1 -- 172.21.15.81:0/108116482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800e790 con 0xab2710 2023-11-29T11:16:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 -- 172.21.15.81:0/108116482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2710 msgr2=0xd204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2710 0xd204c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f68980053a0 tx=0x7f6898011000 comp rx=0 tx=0).stop 2023-11-29T11:16:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 -- 172.21.15.81:0/108116482 shutdown_connections 2023-11-29T11:16:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd21710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2710 0xd204c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/108116482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2eb0 0xd1ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 -- 172.21.15.81:0/108116482 >> 172.21.15.81:0/108116482 conn(0xd49d70 msgr2=0xd4ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 -- 172.21.15.81:0/108116482 shutdown_connections 2023-11-29T11:16:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.442+0000 7f68a6cdc740 1 -- 172.21.15.81:0/108116482 wait complete. 2023-11-29T11:16:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 -- start start 2023-11-29T11:16:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 Processor -- start 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xdc56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd22020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2eb0 0xd22560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd7df70 con 0xab2eb0 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xd7d460 con 0xab2ae0 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0xd48ce0 con 0xab2710 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 10 client.0 _ll_register_callbacks cb 0xc372d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2eb0 0xd22560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2eb0 0xd22560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58030/0 (socket says 172.21.15.81:58030) 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 -- 172.21.15.81:0/940977733 learned_addr learned my addr 172.21.15.81:0/940977733 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a0ff7700 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd22020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a17f8700 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xdc56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 -- 172.21.15.81:0/940977733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 msgr2=0xdc56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xdc56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 -- 172.21.15.81:0/940977733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 msgr2=0xd22020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd22020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 -- 172.21.15.81:0/940977733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689800f040 con 0xab2eb0 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f687bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a1ff9700 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2eb0 0xd22560 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6894000f80 tx=0x7f6894009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d5ccd6e39ff39e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f687bfff700 1 -- 172.21.15.81:0/940977733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894034070 con 0xab2eb0 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f687bfff700 1 -- 172.21.15.81:0/940977733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f689401ce40 con 0xab2eb0 2023-11-29T11:16:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.446+0000 7f68a6cdc740 1 -- 172.21.15.81:0/940977733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f689400f8d0 con 0xab2eb0 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f687bfff700 1 -- 172.21.15.81:0/940977733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6894001670 con 0xab2eb0 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 10 client.6759 fetch_fsmap learned FSMap version 31 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 -- 172.21.15.81:0/940977733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0xc37380 con 0xab2eb0 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f687bfff700 1 -- 172.21.15.81:0/940977733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400f8d0 con 0xab2eb0 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f687bfff700 1 -- 172.21.15.81:0/940977733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f6894037020 con 0xab2eb0 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 10 client.6759 fetch_fsmap finished waiting for FSMap version 31 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 10 client.6759 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 20 client.6759 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0xafd790 0xd7c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 4 client.6759 mds_command: new command op to 6564 tid=0[{"prefix": "status"}] 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 -- 172.21.15.81:0/940977733 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "status"}) v1 -- 0xb2f260 con 0xafd790 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a17f8700 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0xafd790 0xd7c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f687bfff700 10 client.6759 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a17f8700 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0xafd790 0xd7c300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8d8d72ea4ceaf82 server_cookie=278f224e2dee806c in_seq=0 out_seq=0 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f687bfff700 1 -- 172.21.15.81:0/940977733 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xb2f260 con 0xafd790 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f687bfff700 10 client.6759 handle_command_reply: tid=0 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 client.6759 shutdown 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 -- 172.21.15.81:0/940977733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2eb0 msgr2=0xd22560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2eb0 0xd22560 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6894000f80 tx=0x7f6894009040 comp rx=0 tx=0).stop 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 -- 172.21.15.81:0/940977733 shutdown_connections 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0xafd790 0xd7c300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f687bfff700 0 client.6759 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xab2eb0 0xd22560 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xab2ae0 0xd22020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 --2- 172.21.15.81:0/940977733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xab2710 0xdc56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 -- 172.21.15.81:0/940977733 >> 172.21.15.81:0/940977733 conn(0xd49d70 msgr2=0xd20680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 -- 172.21.15.81:0/940977733 shutdown_connections 2023-11-29T11:16:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 1 -- 172.21.15.81:0/940977733 wait complete. 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a6cdc740 20 client.6759 trim_cache size 0 max 16384 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6564, 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 9.0509592720000001, 2023-11-29T11:16:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 31, 2023-11-29T11:16:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 67, 2023-11-29T11:16:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 67, 2023-11-29T11:16:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 14.366038616000001 2023-11-29T11:16:16.460 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:16.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 -- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6888064ee0 msgr2=0x7f6888067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6888064ee0 0x7f6888067390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f689c0cb3c0 tx=0x7f6898009040 comp rx=0 tx=0).stop 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 -- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c0707d0 msgr2=0x7f689c14e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c0707d0 0x7f689c14e8e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f688c000c00 tx=0x7f688c004770 comp rx=0 tx=0).stop 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 -- 172.21.15.81:0/630523165 shutdown_connections 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6888064ee0 0x7f6888067390 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f689c14e1d0 0x7f689c145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f689c0cca90 0x7f689c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 --2- 172.21.15.81:0/630523165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689c0707d0 0x7f689c14e8e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 -- 172.21.15.81:0/630523165 >> 172.21.15.81:0/630523165 conn(0x7f689c06caf0 msgr2=0x7f689c0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 -- 172.21.15.81:0/630523165 shutdown_connections 2023-11-29T11:16:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.450+0000 7f68a3a5c700 1 -- 172.21.15.81:0/630523165 wait complete. 2023-11-29T11:16:16.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:16:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f499c8ff700 1 Processor -- start 2023-11-29T11:16:16.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f499c8ff700 1 -- start start 2023-11-29T11:16:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f499c8ff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49981537f0 0x7f49980c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f499c8ff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49980cad30 con 0x7f499815cb50 2023-11-29T11:16:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f499c8ff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49980b0cd0 con 0x7f4998153420 2023-11-29T11:16:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f499c8ff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49980cdda0 con 0x7f49981537f0 2023-11-29T11:16:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f4996d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f499815cb50 0x7f499815cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60188/0 (socket says 172.21.15.81:60188) 2023-11-29T11:16:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f4995d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49981537f0 0x7f49980c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.582+0000 7f4996d9d700 1 -- 172.21.15.81:0/962664701 learned_addr learned my addr 172.21.15.81:0/962664701 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f4995d9b700 1 -- 172.21.15.81:0/962664701 >> v1:172.21.15.176:6789/0 conn(0x7f4998153420 legacy=0x7f49980ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f4995d9b700 1 -- 172.21.15.81:0/962664701 >> v1:172.21.15.81:6789/0 conn(0x7f499815cb50 legacy=0x7f499815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499559a700 1 -- 172.21.15.81:0/962664701 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243895382 0 0) 0x7f49980cad30 con 0x7f499815cb50 2023-11-29T11:16:16.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f4995d9b700 1 -- 172.21.15.81:0/962664701 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49980caa00 con 0x7f49981537f0 2023-11-29T11:16:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f4995d9b700 1 --2- 172.21.15.81:0/962664701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49980c8f50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4980009850 tx=0x7f4980009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ddb5103bc08efc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499559a700 1 -- 172.21.15.81:0/962664701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980011830 con 0x7f49981537f0 2023-11-29T11:16:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499559a700 1 -- 172.21.15.81:0/962664701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4980011990 con 0x7f49981537f0 2023-11-29T11:16:16.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499559a700 1 -- 172.21.15.81:0/962664701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980011d20 con 0x7f49981537f0 2023-11-29T11:16:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499c8ff700 1 -- 172.21.15.81:0/962664701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 msgr2=0x7f49980c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499c8ff700 1 --2- 172.21.15.81:0/962664701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49980c8f50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4980009850 tx=0x7f4980009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499c8ff700 1 -- 172.21.15.81:0/962664701 shutdown_connections 2023-11-29T11:16:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499c8ff700 1 --2- 172.21.15.81:0/962664701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49980c8f50 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499c8ff700 1 -- 172.21.15.81:0/962664701 >> 172.21.15.81:0/962664701 conn(0x7f499806caf0 msgr2=0x7f49980ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:16.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499c8ff700 1 -- 172.21.15.81:0/962664701 shutdown_connections 2023-11-29T11:16:16.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.586+0000 7f499c8ff700 1 -- 172.21.15.81:0/962664701 wait complete. 2023-11-29T11:16:16.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 Processor -- start 2023-11-29T11:16:16.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 -- start start 2023-11-29T11:16:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4998153420 0x7f49981431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49981f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f499815cb50 0x7f499815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49981f5f30 con 0x7f49981537f0 2023-11-29T11:16:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49981f5970 con 0x7f499815cb50 2023-11-29T11:16:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49981f5c50 con 0x7f4998153420 2023-11-29T11:16:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49981f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49981f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58054/0 (socket says 172.21.15.81:58054) 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 -- 172.21.15.81:0/3789111270 learned_addr learned my addr 172.21.15.81:0/3789111270 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4996d9d700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f499815cb50 0x7f499815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499659c700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4998153420 0x7f49981431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 -- 172.21.15.81:0/3789111270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4998153420 msgr2=0x7f49981431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4998153420 0x7f49981431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 -- 172.21.15.81:0/3789111270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f499815cb50 msgr2=0x7f499815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f499815cb50 0x7f499815ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 -- 172.21.15.81:0/3789111270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49800094b0 con 0x7f49981537f0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f4995d9b700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49981f5070 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f49800090b0 tx=0x7f4980004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f498effd700 1 -- 172.21.15.81:0/3789111270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000ba70 con 0x7f49981537f0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f498effd700 1 -- 172.21.15.81:0/3789111270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498001f070 con 0x7f49981537f0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49980b1250 con 0x7f49981537f0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f498effd700 1 -- 172.21.15.81:0/3789111270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000bdf0 con 0x7f49981537f0 2023-11-29T11:16:16.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.590+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49980b0f70 con 0x7f49981537f0 2023-11-29T11:16:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.594+0000 7f498effd700 1 -- 172.21.15.81:0/3789111270 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f498000f050 con 0x7f49981537f0 2023-11-29T11:16:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.594+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499806fff0 con 0x7f49981537f0 2023-11-29T11:16:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.594+0000 7f498effd700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4978064ee0 0x7f4978067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.594+0000 7f498effd700 1 -- 172.21.15.81:0/3789111270 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4980021070 con 0x7f49981537f0 2023-11-29T11:16:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.594+0000 7f499659c700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4978064ee0 0x7f4978067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.594+0000 7f499659c700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4978064ee0 0x7f4978067390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f49980cbcb0 tx=0x7f4988009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:16.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.602+0000 7f498effd700 1 -- 172.21.15.81:0/3789111270 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f49800516c0 con 0x7f49981537f0 2023-11-29T11:16:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.802+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4998072500 con 0x7f49981537f0 2023-11-29T11:16:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.802+0000 7f498effd700 1 -- 172.21.15.81:0/3789111270 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4980015070 con 0x7f49981537f0 2023-11-29T11:16:16.809 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4978064ee0 msgr2=0x7f4978067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4978064ee0 0x7f4978067390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f49980cbcb0 tx=0x7f4988009040 comp rx=0 tx=0).stop 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 msgr2=0x7f49981f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49981f5070 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f49800090b0 tx=0x7f4980004770 comp rx=0 tx=0).stop 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 shutdown_connections 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4978064ee0 0x7f4978067390 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f499815cb50 0x7f499815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49981537f0 0x7f49981f5070 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 --2- 172.21.15.81:0/3789111270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4998153420 0x7f49981431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 >> 172.21.15.81:0/3789111270 conn(0x7f499806caf0 msgr2=0x7f4998151210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 shutdown_connections 2023-11-29T11:16:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:16.806+0000 7f499c8ff700 1 -- 172.21.15.81:0/3789111270 wait complete. 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:16:16.824 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:16:16.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:16.824 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:16:16.832 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:16:16.832 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:16:16.833 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:16:16.834 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:16:16.835 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:16:16.835 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:16:16.835 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:16:16.835 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:16:16.835 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:16:16.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:16.835 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:16:16.847 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:16:16.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:16.849 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:16:16.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:16.899 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:16:16.899 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:16:16.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:16:16.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:16:16.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:16:16.899 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:16:16.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:16.937 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:16:16.945 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:16:16.945 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:16:16.945 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:16:16.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:16.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:16:16.960 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:16:16.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:16:16.960 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:16:17.008 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:16:17.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:16:17.008 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:16:17.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:16:17.032 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:16:17.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:16:17.089 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:16:17.090 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:16:17.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:17.090 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:16:17.097 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:16:17.098 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:16:17.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:16:17.114 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:16:17.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:16:17.123 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:16:17.124 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:16:17.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:17.125 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:16:17.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:16:17.182+0000 7f196c96b640 -1 init, newargv = 0x55d8154958e0 newargc=15 2023-11-29T11:16:17.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[52645]: starting ceph client 2023-11-29T11:16:17.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[52645]: starting fuse 2023-11-29T11:16:18.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:16:18.247 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:16:18.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:16:18.260 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:16:18.260 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:16:18.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:18.261 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:16:18.312 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:16:18.313 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:16:18.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:16:18.313 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:16:18.313 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:16:18.313 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:16:18.313 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:16:18.313 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:16:18.313 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:16:18.314 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:16:18.315 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:16:18.400 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.52645.asok 2023-11-29T11:16:18.582 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52645.asok 2023-11-29T11:16:18.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:18.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52645.asok status 2023-11-29T11:16:18.684 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:18.684 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:16:18.684 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:16:18.684 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:16:18.684 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "52645", 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6774, 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:16:18.685 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6774 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1609436373 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:16:18.686 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1609436373 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.6774 192.168.0.1:0/1609436373", 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/1609436373", 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 31, 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 67, 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:16:18.687 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:18.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:18.694 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:16:18.694 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:16:18.700 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:16:18.700 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:16:18.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:18.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:16:18.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:18.718 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2023-11-29T11:16:18.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:16:18.780 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2023-11-29T11:16:18.792 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:16:18.792 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:16:18.793 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:16:18.793 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:16:18.793 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2023-11-29T11:16:18.793 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:16:18.858 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627777 2023-11-29T11:16:19.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:16:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.206+0000 7fe7c0c31700 1 Processor -- start 2023-11-29T11:16:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.206+0000 7fe7c0c31700 1 -- start start 2023-11-29T11:16:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7c0c31700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe7bc0cf050 0x7fe7bc06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7c0c31700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc06a530 0x7fe7bc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7c0c31700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc15c6d0 con 0x7fe7bc0b4c10 2023-11-29T11:16:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7c0c31700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc06a9a0 con 0x7fe7bc0cf050 2023-11-29T11:16:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7c0c31700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0cf960 con 0x7fe7bc06a530 2023-11-29T11:16:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bbfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe7bc0b4c10 0x7fe7bc0cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60198/0 (socket says 172.21.15.81:60198) 2023-11-29T11:16:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bbfff700 1 -- 172.21.15.81:0/96637085 learned_addr learned my addr 172.21.15.81:0/96637085 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7b2ffd700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc06a530 0x7fe7bc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bb7fe700 1 --2- 172.21.15.81:0/96637085 >> v2:172.21.15.176:3300/0 conn(0x7fe7bc0cf050 0x7fe7bc06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166303827 0 0) 0x7fe7bc15c6d0 con 0x7fe7bc0b4c10 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a80035d0 con 0x7fe7bc0b4c10 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4061754407 0 0) 0x7fe7a80035d0 con 0x7fe7bc0b4c10 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc06a530 msgr2=0x7fe7bc0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc06a530 0x7fe7bc0cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 >> v2:172.21.15.176:3300/0 conn(0x7fe7bc0cf050 msgr2=0x7fe7bc06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 --2- 172.21.15.81:0/96637085 >> v2:172.21.15.176:3300/0 conn(0x7fe7bc0cf050 0x7fe7bc06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc06ac60 con 0x7fe7bc0b4c10 2023-11-29T11:16:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fe7b40019f0 con 0x7fe7bc0b4c10 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 >> v1:172.21.15.81:6789/0 conn(0x7fe7bc0b4c10 legacy=0x7fe7bc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7a8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc06a530 0x7fe7a8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7a8004db0 0x7fe7a8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc06a9a0 con 0x7fe7a8003a20 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0cf960 con 0x7fe7a8004db0 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a800ba30 con 0x7fe7bc06a530 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bb7fe700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7a8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7b2ffd700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc06a530 0x7fe7a8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bbfff700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7a8004db0 0x7fe7a8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bb7fe700 1 -- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc06a530 msgr2=0x7fe7a8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bb7fe700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc06a530 0x7fe7a8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bb7fe700 1 -- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7a8004db0 msgr2=0x7fe7a8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bb7fe700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7a8004db0 0x7fe7a8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bb7fe700 1 -- 172.21.15.81:0/96637085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80035d0 con 0x7fe7a8003a20 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bbfff700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7a8004db0 0x7fe7a8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7bb7fe700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7a8003e30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009b70 tx=0x7fe7a80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1dfbd7248cdee5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00e6c0 con 0x7fe7a8003a20 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00e820 con 0x7fe7a8003a20 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.210+0000 7fe7baffd700 1 -- 172.21.15.81:0/96637085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00eb90 con 0x7fe7a8003a20 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- 172.21.15.81:0/96637085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 msgr2=0x7fe7a8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 --2- 172.21.15.81:0/96637085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7a8003e30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009b70 tx=0x7fe7a80058a0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7bbfff700 1 -- 172.21.15.81:0/96637085 reap_dead start 2023-11-29T11:16:19.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- 172.21.15.81:0/96637085 shutdown_connections 2023-11-29T11:16:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- 172.21.15.81:0/96637085 >> 172.21.15.81:0/96637085 conn(0x7fe7bc09bb30 msgr2=0x7fe7bc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- 172.21.15.81:0/96637085 shutdown_connections 2023-11-29T11:16:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- 172.21.15.81:0/96637085 wait complete. 2023-11-29T11:16:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 Processor -- start 2023-11-29T11:16:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- start start 2023-11-29T11:16:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7bc1f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc155ec0 0x7fe7bc156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7bc157e60 0x7fe7bc1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc156330 con 0x7fe7a8003a20 2023-11-29T11:16:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc156dc0 con 0x7fe7bc157e60 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7c0c31700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc1570a0 con 0x7fe7bc155ec0 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7bc1f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7bb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7bc1f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58078/0 (socket says 172.21.15.81:58078) 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7bb7fe700 1 -- 172.21.15.81:0/2129892529 learned_addr learned my addr 172.21.15.81:0/2129892529 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7b2ffd700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc155ec0 0x7fe7bc156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7bbfff700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7bc157e60 0x7fe7bc1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.214+0000 7fe7bb7fe700 1 -- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc155ec0 msgr2=0x7fe7bc156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7bb7fe700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc155ec0 0x7fe7bc156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7bb7fe700 1 -- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7bc157e60 msgr2=0x7fe7bc1582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7bb7fe700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7bc157e60 0x7fe7bc1582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7bb7fe700 1 -- 172.21.15.81:0/2129892529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0b4410 con 0x7fe7a8003a20 2023-11-29T11:16:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7b2ffd700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc155ec0 0x7fe7bc156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7bbfff700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7bc157e60 0x7fe7bc1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7bb7fe700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7bc1f1c20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8004740 tx=0x7fe7ac0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7b8ff9700 1 -- 172.21.15.81:0/2129892529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00e6c0 con 0x7fe7a8003a20 2023-11-29T11:16:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7b8ff9700 1 -- 172.21.15.81:0/2129892529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac013e20 con 0x7fe7a8003a20 2023-11-29T11:16:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc06af40 con 0x7fe7a8003a20 2023-11-29T11:16:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7b8ff9700 1 -- 172.21.15.81:0/2129892529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac004270 con 0x7fe7a8003a20 2023-11-29T11:16:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc0b46f0 con 0x7fe7a8003a20 2023-11-29T11:16:19.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc0cf7d0 con 0x7fe7a8003a20 2023-11-29T11:16:19.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.218+0000 7fe7b8ff9700 1 -- 172.21.15.81:0/2129892529 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe7ac02d070 con 0x7fe7a8003a20 2023-11-29T11:16:19.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.222+0000 7fe7b8ff9700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe79c064ee0 0x7fe79c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.222+0000 7fe7b8ff9700 1 -- 172.21.15.81:0/2129892529 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe7ac083510 con 0x7fe7a8003a20 2023-11-29T11:16:19.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.222+0000 7fe7b2ffd700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe79c064ee0 0x7fe79c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.222+0000 7fe7b2ffd700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe79c064ee0 0x7fe79c067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0b0ee0 tx=0x7fe7a4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.226+0000 7fe7b8ff9700 1 -- 172.21.15.81:0/2129892529 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe7ac051610 con 0x7fe7a8003a20 2023-11-29T11:16:19.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.422+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7bc072500 con 0x7fe7a8003a20 2023-11-29T11:16:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.422+0000 7fe7b8ff9700 1 -- 172.21.15.81:0/2129892529 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4650 (secure 0 0 0) 0x7fe7ac054c30 con 0x7fe7a8003a20 2023-11-29T11:16:19.426 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:19.427 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:09.416362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:16:19.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe79c064ee0 msgr2=0x7fe79c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe79c064ee0 0x7fe79c067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0b0ee0 tx=0x7fe7a4009240 comp rx=0 tx=0).stop 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 msgr2=0x7fe7bc1f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7bc1f1c20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8004740 tx=0x7fe7ac0047e0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 shutdown_connections 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe79c064ee0 0x7fe79c067390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7bc157e60 0x7fe7bc1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7bc155ec0 0x7fe7bc156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 --2- 172.21.15.81:0/2129892529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7a8003a20 0x7fe7bc1f1c20 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 >> 172.21.15.81:0/2129892529 conn(0x7fe7bc09bb30 msgr2=0x7fe7bc15bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 shutdown_connections 2023-11-29T11:16:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.426+0000 7fe7c0c31700 1 -- 172.21.15.81:0/2129892529 wait complete. 2023-11-29T11:16:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 31 2023-11-29T11:16:19.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-29T11:16:19.576 INFO:teuthology.orchestra.run.smithi081.stdout:{"message":"","return_code":0} 2023-11-29T11:16:19.577 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:16:19.577 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-29T11:16:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc950fc5140 1 Processor -- start 2023-11-29T11:16:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc950fc5140 1 -- start start 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc950fc5140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 0x55e65d5ab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc950fc5140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d4d6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc950fc5140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 0x55e65d519db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc950fc5140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e65d3fd240 con 0x55e65d51ea90 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc950fc5140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e65d518960 con 0x55e65d5067e0 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc950fc5140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e65d518b50 con 0x55e65d51ee60 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d4d6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d4d6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58088/0 (socket says 172.21.15.81:58088) 2023-11-29T11:16:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 -- 172.21.15.81:0/4290131414 learned_addr learned my addr 172.21.15.81:0/4290131414 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94f2fb700 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 0x55e65d519db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94eafa700 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 0x55e65d5ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 -- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 msgr2=0x55e65d519db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 0x55e65d519db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 -- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 msgr2=0x55e65d5ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 0x55e65d5ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 -- 172.21.15.81:0/4290131414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948005d20 con 0x55e65d51ea90 2023-11-29T11:16:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94f2fb700 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 0x55e65d519db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:19.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.610+0000 7fc94e2f9700 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d4d6360 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc938009780 tx=0x7fc938005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4363230fb59a5cb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94d2f7700 1 -- 172.21.15.81:0/4290131414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800f040 con 0x55e65d51ea90 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94d2f7700 1 -- 172.21.15.81:0/4290131414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938008870 con 0x55e65d51ea90 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94d2f7700 1 -- 172.21.15.81:0/4290131414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938005e10 con 0x55e65d51ea90 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- 172.21.15.81:0/4290131414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 msgr2=0x55e65d4d6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d4d6360 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc938009780 tx=0x7fc938005a00 comp rx=0 tx=0).stop 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- 172.21.15.81:0/4290131414 shutdown_connections 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 0x55e65d519db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d4d6360 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 --2- 172.21.15.81:0/4290131414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 0x55e65d5ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- 172.21.15.81:0/4290131414 >> 172.21.15.81:0/4290131414 conn(0x55e65d504dc0 msgr2=0x55e65d4d9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- 172.21.15.81:0/4290131414 shutdown_connections 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- 172.21.15.81:0/4290131414 wait complete. 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 Processor -- start 2023-11-29T11:16:19.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- start start 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 0x55e65d591c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d6385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 0x55e65d4fb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e65d51d740 con 0x55e65d51ea90 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e65d51cac0 con 0x55e65d5067e0 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e65d51cd60 con 0x55e65d51ee60 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d6385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d6385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58092/0 (socket says 172.21.15.81:58092) 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 -- 172.21.15.81:0/49059134 learned_addr learned my addr 172.21.15.81:0/49059134 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94f2fb700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 0x55e65d4fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94eafa700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 0x55e65d591c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 -- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 msgr2=0x55e65d4fb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e65d51ee60 0x55e65d4fb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 -- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 msgr2=0x55e65d591c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e65d5067e0 0x55e65d591c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 -- 172.21.15.81:0/49059134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c001e10 con 0x55e65d51ea90 2023-11-29T11:16:19.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc94e2f9700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d6385a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc938005a40 tx=0x7fc938003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc947fff700 1 -- 172.21.15.81:0/49059134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800f030 con 0x55e65d51ea90 2023-11-29T11:16:19.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc947fff700 1 -- 172.21.15.81:0/49059134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938013630 con 0x55e65d51ea90 2023-11-29T11:16:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc938009410 con 0x55e65d51ea90 2023-11-29T11:16:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc947fff700 1 -- 172.21.15.81:0/49059134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938013a00 con 0x55e65d51ea90 2023-11-29T11:16:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.614+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e65d415390 con 0x55e65d51ea90 2023-11-29T11:16:19.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.618+0000 7fc947fff700 1 -- 172.21.15.81:0/49059134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc938013b60 con 0x55e65d51ea90 2023-11-29T11:16:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.618+0000 7fc947fff700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc930063810 0x7fc930065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.618+0000 7fc94eafa700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc930063810 0x7fc930065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.618+0000 7fc947fff700 1 -- 172.21.15.81:0/49059134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc9380833a0 con 0x55e65d51ea90 2023-11-29T11:16:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e65d638ae0 0x55e65d4fba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67) v8 -- 0x55e65d4fbfc0 con 0x55e65d638ae0 2023-11-29T11:16:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc94eafa700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc930063810 0x7fc930065cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc948000c00 tx=0x7fc94800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc94f2fb700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e65d638ae0 0x55e65d4fba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc94f2fb700 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e65d638ae0 0x55e65d4fba80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc94f2fb700 1 -- 172.21.15.81:0/49059134 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7fc940001990 con 0x55e65d638ae0 2023-11-29T11:16:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e65d638ae0 msgr2=0x55e65d4fba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x55e65d638ae0 0x55e65d4fba80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc930063810 msgr2=0x7fc930065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc930063810 0x7fc930065cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc948000c00 tx=0x7fc94800f000 comp rx=0 tx=0).stop 2023-11-29T11:16:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 msgr2=0x55e65d6385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 --2- 172.21.15.81:0/49059134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e65d51ea90 0x55e65d6385a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc938005a40 tx=0x7fc938003020 comp rx=0 tx=0).stop 2023-11-29T11:16:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc94f2fb700 1 -- 172.21.15.81:0/49059134 reap_dead start 2023-11-29T11:16:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 shutdown_connections 2023-11-29T11:16:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 >> 172.21.15.81:0/49059134 conn(0x55e65d504dc0 msgr2=0x55e65d4d53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 shutdown_connections 2023-11-29T11:16:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.622+0000 7fc950fc5140 1 -- 172.21.15.81:0/49059134 wait complete. 2023-11-29T11:16:19.633 INFO:teuthology.orchestra.run.smithi081.stdout:Xfiledir_test 2023-11-29T11:16:19.633 DEBUG:teuthology.orchestra.run.smithi081:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-29T11:16:19.690 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627777, 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "ancestors": [ 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "dirino": 1099511627776, 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "dname": "file", 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 2 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "dirino": 1, 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "dname": "dir_test", 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 4 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 11, 2023-11-29T11:16:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: "old_pools": [] 2023-11-29T11:16:19.692 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:19.692 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:19.693 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2023-11-29T11:16:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1924af140 1 Processor -- start 2023-11-29T11:16:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1924af140 1 -- start start 2023-11-29T11:16:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1924af140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 0x5605af5e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1924af140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af55bef0 0x5605af53c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1924af140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af5e5590 0x5605af53cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1924af140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605af435240 con 0x5605af55bef0 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1924af140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605af5e7630 con 0x5605af53dde0 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1924af140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605af5e6e50 con 0x5605af5e5590 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af55bef0 0x5605af53c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af55bef0 0x5605af53c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59140/0 (socket says 172.21.15.81:59140) 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 -- 172.21.15.81:0/3843708783 learned_addr learned my addr 172.21.15.81:0/3843708783 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18ffe4700 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 0x5605af5e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd1907e5700 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af5e5590 0x5605af53cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 -- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af5e5590 msgr2=0x5605af53cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af5e5590 0x5605af53cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 -- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 msgr2=0x5605af5e5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 0x5605af5e5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 -- 172.21.15.81:0/3843708783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180005d20 con 0x5605af55bef0 2023-11-29T11:16:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18ffe4700 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 0x5605af5e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.726+0000 7fd18f7e3700 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af55bef0 0x5605af53c690 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd1780017e0 tx=0x7fd178001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5e6f7d925d3551 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd18e7e1700 1 -- 172.21.15.81:0/3843708783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178003650 con 0x5605af55bef0 2023-11-29T11:16:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd18e7e1700 1 -- 172.21.15.81:0/3843708783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1780037b0 con 0x5605af55bef0 2023-11-29T11:16:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd18e7e1700 1 -- 172.21.15.81:0/3843708783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178003b40 con 0x5605af55bef0 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- 172.21.15.81:0/3843708783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af55bef0 msgr2=0x5605af53c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af55bef0 0x5605af53c690 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd1780017e0 tx=0x7fd178001af0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- 172.21.15.81:0/3843708783 shutdown_connections 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af5e5590 0x5605af53cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af55bef0 0x5605af53c690 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 --2- 172.21.15.81:0/3843708783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 0x5605af5e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- 172.21.15.81:0/3843708783 >> 172.21.15.81:0/3843708783 conn(0x5605af53c2c0 msgr2=0x5605af557e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- 172.21.15.81:0/3843708783 shutdown_connections 2023-11-29T11:16:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- 172.21.15.81:0/3843708783 wait complete. 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 Processor -- start 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- start start 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 0x5605af5e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af55bef0 0x5605af554900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af5e5590 0x5605af540230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605af554e40 con 0x5605af5e5590 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605af555080 con 0x5605af53dde0 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.730+0000 7fd1924af140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605af555320 con 0x5605af55bef0 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd1907e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af5e5590 0x5605af540230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af55bef0 0x5605af554900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18ffe4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 0x5605af5e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af55bef0 0x5605af554900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:48548/0 (socket says 172.21.15.81:48548) 2023-11-29T11:16:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd1907e5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af5e5590 0x5605af540230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59152/0 (socket says 172.21.15.81:59152) 2023-11-29T11:16:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 -- 172.21.15.81:0/768265460 learned_addr learned my addr 172.21.15.81:0/768265460 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 -- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 msgr2=0x5605af5e3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5605af53dde0 0x5605af5e3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 -- 172.21.15.81:0/768265460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af5e5590 msgr2=0x5605af540230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af5e5590 0x5605af540230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 -- 172.21.15.81:0/768265460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd178006d50 con 0x5605af55bef0 2023-11-29T11:16:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd1907e5700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605af5e5590 0x5605af540230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18f7e3700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af55bef0 0x5605af554900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd178000f80 tx=0x7fd178001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18d7df700 1 -- 172.21.15.81:0/768265460 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178013420 con 0x5605af55bef0 2023-11-29T11:16:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18d7df700 1 -- 172.21.15.81:0/768265460 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd178013580 con 0x5605af55bef0 2023-11-29T11:16:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605af44d390 con 0x5605af55bef0 2023-11-29T11:16:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd18d7df700 1 -- 172.21.15.81:0/768265460 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1780138f0 con 0x5605af55bef0 2023-11-29T11:16:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.734+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605af4408b0 con 0x5605af55bef0 2023-11-29T11:16:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd18d7df700 1 -- 172.21.15.81:0/768265460 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd17801b040 con 0x5605af55bef0 2023-11-29T11:16:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd18d7df700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd170063840 0x7fd170065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd18ffe4700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd170063840 0x7fd170065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd18d7df700 1 -- 172.21.15.81:0/768265460 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd1780816d0 con 0x5605af55bef0 2023-11-29T11:16:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd18ffe4700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd170063840 0x7fd170065cf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd180015040 tx=0x7fd18000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd1924af140 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605af540770 0x5605af53b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) v8 -- 0x5605af686f50 con 0x5605af540770 2023-11-29T11:16:19.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd1907e5700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605af540770 0x5605af53b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.738+0000 7fd1907e5700 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605af540770 0x5605af53b310 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1907e5700 1 -- 172.21.15.81:0/768265460 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v67'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd188009930 con 0x5605af540770 2023-11-29T11:16:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605af540770 msgr2=0x5605af53b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605af540770 0x5605af53b310 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd170063840 msgr2=0x7fd170065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd170063840 0x7fd170065cf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd180015040 tx=0x7fd18000f000 comp rx=0 tx=0).stop 2023-11-29T11:16:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af55bef0 msgr2=0x5605af554900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 --2- 172.21.15.81:0/768265460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5605af55bef0 0x5605af554900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd178000f80 tx=0x7fd178001250 comp rx=0 tx=0).stop 2023-11-29T11:16:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1907e5700 1 -- 172.21.15.81:0/768265460 reap_dead start 2023-11-29T11:16:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 shutdown_connections 2023-11-29T11:16:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 >> 172.21.15.81:0/768265460 conn(0x5605af53c2c0 msgr2=0x5605af50e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 shutdown_connections 2023-11-29T11:16:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.742+0000 7fd1924af140 1 -- 172.21.15.81:0/768265460 wait complete. 2023-11-29T11:16:19.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2023-11-29T11:16:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.870+0000 7f533ef64700 1 Processor -- start 2023-11-29T11:16:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.870+0000 7f533ef64700 1 -- start start 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53380b1ae0 0x7f533806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533806a4c0 0x7f53380d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533806a9c0 con 0x7f53380cf0e0 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533806aca0 con 0x7f53380b1ae0 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533806af80 con 0x7f533806a4c0 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533df62700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53380b1ae0 0x7f533806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533df62700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53380b1ae0 0x7f533806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59164/0 (socket says 172.21.15.81:59164) 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533df62700 1 -- 172.21.15.81:0/1954534591 learned_addr learned my addr 172.21.15.81:0/1954534591 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533d761700 1 --2- 172.21.15.81:0/1954534591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533806a4c0 0x7f53380d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533df62700 1 -- 172.21.15.81:0/1954534591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533806a4c0 msgr2=0x7f53380d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533df62700 1 --2- 172.21.15.81:0/1954534591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533806a4c0 0x7f53380d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533df62700 1 -- 172.21.15.81:0/1954534591 >> v1:172.21.15.176:6789/0 conn(0x7f53380cf0e0 legacy=0x7f53380b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533cf60700 1 -- 172.21.15.81:0/1954534591 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737631169 0 0) 0x7f533806a9c0 con 0x7f53380cf0e0 2023-11-29T11:16:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533df62700 1 -- 172.21.15.81:0/1954534591 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380b4380 con 0x7f53380b1ae0 2023-11-29T11:16:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533df62700 1 --2- 172.21.15.81:0/1954534591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380b1ae0 0x7f533806d8e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f5334009910 tx=0x7f5334009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8eb414dd671a94 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533cf60700 1 -- 172.21.15.81:0/1954534591 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334011830 con 0x7f53380b1ae0 2023-11-29T11:16:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533cf60700 1 -- 172.21.15.81:0/1954534591 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334011990 con 0x7f53380b1ae0 2023-11-29T11:16:19.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533cf60700 1 -- 172.21.15.81:0/1954534591 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334011d40 con 0x7f53380b1ae0 2023-11-29T11:16:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 -- 172.21.15.81:0/1954534591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380b1ae0 msgr2=0x7f533806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 --2- 172.21.15.81:0/1954534591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380b1ae0 0x7f533806d8e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f5334009910 tx=0x7f5334009c20 comp rx=0 tx=0).stop 2023-11-29T11:16:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 -- 172.21.15.81:0/1954534591 shutdown_connections 2023-11-29T11:16:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 --2- 172.21.15.81:0/1954534591 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533806a4c0 0x7f53380d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 --2- 172.21.15.81:0/1954534591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380b1ae0 0x7f533806d8e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 -- 172.21.15.81:0/1954534591 >> 172.21.15.81:0/1954534591 conn(0x7f533809bbd0 msgr2=0x7f53380b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 -- 172.21.15.81:0/1954534591 shutdown_connections 2023-11-29T11:16:19.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.874+0000 7f533ef64700 1 -- 172.21.15.81:0/1954534591 wait complete. 2023-11-29T11:16:19.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.878+0000 7f533ef64700 1 Processor -- start 2023-11-29T11:16:19.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.878+0000 7f533ef64700 1 -- start start 2023-11-29T11:16:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533ef64700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533806a4c0 0x7f533809cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533ef64700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53380b1ae0 0x7f533815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533ef64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380cf0e0 0x7f53380c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533ef64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533815f760 con 0x7f53380cf0e0 2023-11-29T11:16:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533ef64700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533815c770 con 0x7f533806a4c0 2023-11-29T11:16:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533ef64700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533815ca50 con 0x7f53380b1ae0 2023-11-29T11:16:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380cf0e0 0x7f53380c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380cf0e0 0x7f53380c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59176/0 (socket says 172.21.15.81:59176) 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 -- 172.21.15.81:0/1756296461 learned_addr learned my addr 172.21.15.81:0/1756296461 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533df62700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533806a4c0 0x7f533809cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533d761700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53380b1ae0 0x7f533815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 -- 172.21.15.81:0/1756296461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53380b1ae0 msgr2=0x7f533815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53380b1ae0 0x7f533815ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 -- 172.21.15.81:0/1756296461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533806a4c0 msgr2=0x7f533809cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533806a4c0 0x7f533809cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 -- 172.21.15.81:0/1756296461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334009570 con 0x7f53380cf0e0 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533e763700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380cf0e0 0x7f53380c7e60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f533000cc20 tx=0x7f533000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f532a7fc700 1 -- 172.21.15.81:0/1756296461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330003e50 con 0x7f53380cf0e0 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f532a7fc700 1 -- 172.21.15.81:0/1756296461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533000a690 con 0x7f53380cf0e0 2023-11-29T11:16:19.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533ef64700 1 -- 172.21.15.81:0/1756296461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53380b60e0 con 0x7f53380cf0e0 2023-11-29T11:16:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f532a7fc700 1 -- 172.21.15.81:0/1756296461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533000aa40 con 0x7f53380cf0e0 2023-11-29T11:16:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.882+0000 7f533ef64700 1 -- 172.21.15.81:0/1756296461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53380b1eb0 con 0x7f53380cf0e0 2023-11-29T11:16:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.886+0000 7f532a7fc700 1 -- 172.21.15.81:0/1756296461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5330010070 con 0x7f53380cf0e0 2023-11-29T11:16:19.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.886+0000 7f532a7fc700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f531c064ee0 0x7f531c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.886+0000 7f532a7fc700 1 -- 172.21.15.81:0/1756296461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5330081f60 con 0x7f53380cf0e0 2023-11-29T11:16:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.886+0000 7f533df62700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f531c064ee0 0x7f531c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.886+0000 7f533df62700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f531c064ee0 0x7f531c067390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5334009150 tx=0x7f533401c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.890+0000 7f5343446740 1 Processor -- start 2023-11-29T11:16:19.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.890+0000 7f5343446740 1 -- start start 2023-11-29T11:16:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.890+0000 7f5343446740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135ed10 0x15f4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.890+0000 7f5343446740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x160f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.890+0000 7f5343446740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x160f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.890+0000 7f5343446740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14cdc00 con 0x135e940 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.890+0000 7f5343446740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x153dcf0 con 0x135ed10 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.890+0000 7f5343446740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1536ff0 con 0x13a99c0 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533d761700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x160f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533d761700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x160f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59190/0 (socket says 172.21.15.81:59190) 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533d761700 1 -- 172.21.15.81:0/1835291042 learned_addr learned my addr 172.21.15.81:0/1835291042 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533df62700 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135ed10 0x15f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533e763700 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x160f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533df62700 1 -- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 msgr2=0x160f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533df62700 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x160f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533df62700 1 -- 172.21.15.81:0/1835291042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 msgr2=0x160f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533df62700 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x160f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533df62700 1 -- 172.21.15.81:0/1835291042 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x155cec0 con 0x135ed10 2023-11-29T11:16:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533d761700 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x160f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:19.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f533df62700 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135ed10 0x15f4700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5334016000 tx=0x7f5334010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aab6a4a0cf24d0d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f531b7fe700 1 -- 172.21.15.81:0/1835291042 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533402a070 con 0x135ed10 2023-11-29T11:16:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f531b7fe700 1 -- 172.21.15.81:0/1835291042 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334011c00 con 0x135ed10 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f531b7fe700 1 -- 172.21.15.81:0/1835291042 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340038e0 con 0x135ed10 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 -- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135ed10 msgr2=0x15f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135ed10 0x15f4700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5334016000 tx=0x7f5334010000 comp rx=0 tx=0).stop 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 -- 172.21.15.81:0/1835291042 shutdown_connections 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x160f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x160f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 --2- 172.21.15.81:0/1835291042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135ed10 0x15f4700 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 -- 172.21.15.81:0/1835291042 >> 172.21.15.81:0/1835291042 conn(0x135f0e0 msgr2=0x15f79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 -- 172.21.15.81:0/1835291042 shutdown_connections 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 -- 172.21.15.81:0/1835291042 wait complete. 2023-11-29T11:16:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 -- start start 2023-11-29T11:16:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.894+0000 7f5343446740 1 Processor -- start 2023-11-29T11:16:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x15f9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 0x15f9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x13a99c0 0x15f2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x13e3d50 con 0x135e940 2023-11-29T11:16:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x15d03c0 con 0x13a99c0 2023-11-29T11:16:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x15d0660 con 0x135ed10 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 10 client.0 _ll_register_callbacks cb 0x15938f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x15f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x15f9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59192/0 (socket says 172.21.15.81:59192) 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 -- 172.21.15.81:0/1718866779 learned_addr learned my addr 172.21.15.81:0/1718866779 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533d761700 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 0x15f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533e763700 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x13a99c0 0x15f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 -- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 msgr2=0x15f9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 0x15f9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 -- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x13a99c0 msgr2=0x15f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x13a99c0 0x15f2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 -- 172.21.15.81:0/1718866779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53380b4380 con 0x135e940 2023-11-29T11:16:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533e763700 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x13a99c0 0x15f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533df62700 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x15f9330 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f5334009910 tx=0x7f53340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e370b5c071d4e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5318ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5318ff9700 1 -- 172.21.15.81:0/1718866779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533402a040 con 0x135e940 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 -- 172.21.15.81:0/1718866779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1564e30 con 0x135e940 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5318ff9700 1 -- 172.21.15.81:0/1718866779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f533401f070 con 0x135e940 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5318ff9700 1 -- 172.21.15.81:0/1718866779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5334003ee0 con 0x135e940 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 10 client.6813 fetch_fsmap learned FSMap version 31 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 -- 172.21.15.81:0/1718866779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x13aac10 con 0x135e940 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5318ff9700 1 -- 172.21.15.81:0/1718866779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1564e30 con 0x135e940 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5318ff9700 1 -- 172.21.15.81:0/1718866779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5334036030 con 0x135e940 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 10 client.6813 fetch_fsmap finished waiting for FSMap version 31 2023-11-29T11:16:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 10 client.6813 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 20 client.6813 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x161bea0 0x161c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 4 client.6813 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:16:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f5343446740 1 -- 172.21.15.81:0/1718866779 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1530070 con 0x161bea0 2023-11-29T11:16:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.898+0000 7f533d761700 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x161bea0 0x161c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f533d761700 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x161bea0 0x161c2a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6055664b0c099dbd server_cookie=1cc3461dbd53fdd4 in_seq=0 out_seq=0 2023-11-29T11:16:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5318ff9700 10 client.6813 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5318ff9700 1 -- 172.21.15.81:0/1718866779 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1530070 con 0x161bea0 2023-11-29T11:16:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5318ff9700 10 client.6813 handle_command_reply: tid=0 2023-11-29T11:16:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 client.6813 shutdown 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 -- 172.21.15.81:0/1718866779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 msgr2=0x15f9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x15f9330 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f5334009910 tx=0x7f53340047e0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 -- 172.21.15.81:0/1718866779 shutdown_connections 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x161bea0 0x161c2a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x13a99c0 0x15f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 0x15f9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 --2- 172.21.15.81:0/1718866779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135e940 0x15f9330 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5318ff9700 0 client.6813 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 -- 172.21.15.81:0/1718866779 >> 172.21.15.81:0/1718866779 conn(0x135f0e0 msgr2=0x15f3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 -- 172.21.15.81:0/1718866779 shutdown_connections 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 1 -- 172.21.15.81:0/1718866779 wait complete. 2023-11-29T11:16:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.902+0000 7f5343446740 20 client.6813 trim_cache size 0 max 16384 2023-11-29T11:16:19.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.922+0000 7f5343446740 1 Processor -- start 2023-11-29T11:16:19.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.922+0000 7f5343446740 1 -- start start 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.922+0000 7f5343446740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 0x15cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.922+0000 7f5343446740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135ed10 0x15cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.922+0000 7f5343446740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x15cca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.922+0000 7f5343446740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1535e80 con 0x135ed10 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.922+0000 7f5343446740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x153ef80 con 0x135e940 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.922+0000 7f5343446740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1531390 con 0x13a99c0 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135ed10 0x15cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135ed10 0x15cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59202/0 (socket says 172.21.15.81:59202) 2023-11-29T11:16:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 -- 172.21.15.81:0/1767383437 learned_addr learned my addr 172.21.15.81:0/1767383437 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533e763700 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x15cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533df62700 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 0x15cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 -- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 msgr2=0x15cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x15cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 -- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 msgr2=0x15cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 0x15cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 -- 172.21.15.81:0/1767383437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14fd9f0 con 0x135ed10 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533e763700 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x15cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533d761700 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135ed10 0x15cc550 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f532c009c30 tx=0x7f532c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bec292b4b6f1bd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f531bfff700 1 -- 172.21.15.81:0/1767383437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c01a040 con 0x135ed10 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f531bfff700 1 -- 172.21.15.81:0/1767383437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c01c040 con 0x135ed10 2023-11-29T11:16:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f531bfff700 1 -- 172.21.15.81:0/1767383437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c021e80 con 0x135ed10 2023-11-29T11:16:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- 172.21.15.81:0/1767383437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135ed10 msgr2=0x15cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135ed10 0x15cc550 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f532c009c30 tx=0x7f532c009240 comp rx=0 tx=0).stop 2023-11-29T11:16:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- 172.21.15.81:0/1767383437 shutdown_connections 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x13a99c0 0x15cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x135ed10 0x15cc550 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 --2- 172.21.15.81:0/1767383437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 0x15cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- 172.21.15.81:0/1767383437 >> 172.21.15.81:0/1767383437 conn(0x135f0e0 msgr2=0x15f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- 172.21.15.81:0/1767383437 shutdown_connections 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- 172.21.15.81:0/1767383437 wait complete. 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- start start 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 Processor -- start 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 0x162cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 0x167a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13a99c0 0x162b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x153aff0 con 0x13a99c0 2023-11-29T11:16:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1532960 con 0x135e940 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x15cd5b0 con 0x135ed10 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f5343446740 10 client.0 _ll_register_callbacks cb 0x1501a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533e763700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13a99c0 0x162b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533e763700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13a99c0 0x162b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59214/0 (socket says 172.21.15.81:59214) 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.926+0000 7f533e763700 1 -- 172.21.15.81:0/48254768 learned_addr learned my addr 172.21.15.81:0/48254768 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533d761700 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 0x167a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533df62700 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 0x162cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533e763700 1 -- 172.21.15.81:0/48254768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 msgr2=0x167a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533e763700 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 0x167a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533e763700 1 -- 172.21.15.81:0/48254768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 msgr2=0x162cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533e763700 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 0x162cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533e763700 1 -- 172.21.15.81:0/48254768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53380b1eb0 con 0x13a99c0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533e763700 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13a99c0 0x162b410 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f53300538a0 tx=0x7f5330053430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cd0bbd7a491e5b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5318ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5318ff9700 1 -- 172.21.15.81:0/48254768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330057d60 con 0x13a99c0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5318ff9700 1 -- 172.21.15.81:0/48254768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f533004f990 con 0x13a99c0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 1 -- 172.21.15.81:0/48254768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x15f2c40 con 0x13a99c0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5318ff9700 1 -- 172.21.15.81:0/48254768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f533000ae70 con 0x13a99c0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 10 client.6819 fetch_fsmap learned FSMap version 31 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 1 -- 172.21.15.81:0/48254768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x7f532c009640 con 0x13a99c0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5318ff9700 1 -- 172.21.15.81:0/48254768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x15f2c40 con 0x13a99c0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5318ff9700 1 -- 172.21.15.81:0/48254768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f533004fb50 con 0x13a99c0 2023-11-29T11:16:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 10 client.6819 fetch_fsmap finished waiting for FSMap version 31 2023-11-29T11:16:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 10 client.6819 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 20 client.6819 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x162bf70 0x162c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 4 client.6819 mds_command: new command op to 6564 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2023-11-29T11:16:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5343446740 1 -- 172.21.15.81:0/48254768 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x7f5334011c00 con 0x162bf70 2023-11-29T11:16:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533df62700 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x162bf70 0x162c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f5318ff9700 10 client.6819 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.930+0000 7f533df62700 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x162bf70 0x162c370 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2712b988605ae4b0 server_cookie=ba2c287169789177 in_seq=0 out_seq=0 2023-11-29T11:16:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5318ff9700 1 -- 172.21.15.81:0/48254768 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f5334011c00 con 0x162bf70 2023-11-29T11:16:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5318ff9700 10 client.6819 handle_command_reply: tid=0 2023-11-29T11:16:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 client.6819 shutdown 2023-11-29T11:16:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 -- 172.21.15.81:0/48254768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13a99c0 msgr2=0x162b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13a99c0 0x162b410 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f53300538a0 tx=0x7f5330053430 comp rx=0 tx=0).stop 2023-11-29T11:16:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 -- 172.21.15.81:0/48254768 shutdown_connections 2023-11-29T11:16:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x162bf70 0x162c370 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13a99c0 0x162b410 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x135ed10 0x167a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 --2- 172.21.15.81:0/48254768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x135e940 0x162cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 -- 172.21.15.81:0/48254768 >> 172.21.15.81:0/48254768 conn(0x135f0e0 msgr2=0x15cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5318ff9700 0 client.6819 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:19.942 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f9bbfc99700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6774=0-4194304@1} caps={6774=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6774 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x556f558cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-29T11:16:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 -- 172.21.15.81:0/48254768 shutdown_connections 2023-11-29T11:16:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 1 -- 172.21.15.81:0/48254768 wait complete. 2023-11-29T11:16:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f5343446740 20 client.6819 trim_cache size 0 max 16384 2023-11-29T11:16:19.943 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:19.943 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:16:19.943 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "615a6153-3eb1-4f81-9d4f-094f5fb4e93c", 2023-11-29T11:16:19.943 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:16:19.943 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 -- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f531c064ee0 msgr2=0x7f531c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f531c064ee0 0x7f531c067390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5334009150 tx=0x7f533401c040 comp rx=0 tx=0).stop 2023-11-29T11:16:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 -- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380cf0e0 msgr2=0x7f53380c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380cf0e0 0x7f53380c7e60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f533000cc20 tx=0x7f533000cf30 comp rx=0 tx=0).stop 2023-11-29T11:16:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 -- 172.21.15.81:0/1756296461 shutdown_connections 2023-11-29T11:16:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f531c064ee0 0x7f531c067390 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53380cf0e0 0x7f53380c7e60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53380b1ae0 0x7f533815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 --2- 172.21.15.81:0/1756296461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533806a4c0 0x7f533809cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 -- 172.21.15.81:0/1756296461 >> 172.21.15.81:0/1756296461 conn(0x7f533809bbd0 msgr2=0x7f53380d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 -- 172.21.15.81:0/1756296461 shutdown_connections 2023-11-29T11:16:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:19.934+0000 7f533ef64700 1 -- 172.21.15.81:0/1756296461 wait complete. 2023-11-29T11:16:19.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-29T11:16:20.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1ab59e700 1 Processor -- start 2023-11-29T11:16:20.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1ab59e700 1 -- start start 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1ab59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1ac0c9c00 0x7fc1ac06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1ab59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc1ac06ea10 0x7fc1ac0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1ab59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac06f990 con 0x7fc1ac15c160 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1ab59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac06a4d0 con 0x7fc1ac0c9c00 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1ab59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac06ee90 con 0x7fc1ac06ea10 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aa59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1ac0c9c00 0x7fc1ac06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aa59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1ac0c9c00 0x7fc1ac06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59226/0 (socket says 172.21.15.81:59226) 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aa59c700 1 -- 172.21.15.81:0/2305255247 learned_addr learned my addr 172.21.15.81:0/2305255247 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aad9d700 1 --2- 172.21.15.81:0/2305255247 >> v2:172.21.15.176:3300/0 conn(0x7fc1ac06ea10 0x7fc1ac0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aa59c700 1 -- 172.21.15.81:0/2305255247 >> v2:172.21.15.176:3300/0 conn(0x7fc1ac06ea10 msgr2=0x7fc1ac0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/2305255247 >> v2:172.21.15.176:3300/0 conn(0x7fc1ac06ea10 0x7fc1ac0cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aa59c700 1 -- 172.21.15.81:0/2305255247 >> v1:172.21.15.81:6789/0 conn(0x7fc1ac15c160 legacy=0x7fc1ac0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aa59c700 1 -- 172.21.15.81:0/2305255247 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac06f0f0 con 0x7fc1ac0c9c00 2023-11-29T11:16:20.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1a959a700 1 -- 172.21.15.81:0/2305255247 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643573508 0 0) 0x7fc1ac06f990 con 0x7fc1ac15c160 2023-11-29T11:16:20.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/2305255247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac0c9c00 0x7fc1ac06cd30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac070f50 tx=0x7fc19c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498cf713652fb82e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:20.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.074+0000 7fc1a959a700 1 -- 172.21.15.81:0/2305255247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00b8a0 con 0x7fc1ac0c9c00 2023-11-29T11:16:20.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1a959a700 1 -- 172.21.15.81:0/2305255247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00ba00 con 0x7fc1ac0c9c00 2023-11-29T11:16:20.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1a959a700 1 -- 172.21.15.81:0/2305255247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00bd90 con 0x7fc1ac0c9c00 2023-11-29T11:16:20.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2305255247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac0c9c00 msgr2=0x7fc1ac06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2305255247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac0c9c00 0x7fc1ac06cd30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac070f50 tx=0x7fc19c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2305255247 shutdown_connections 2023-11-29T11:16:20.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2305255247 >> v2:172.21.15.176:3300/0 conn(0x7fc1ac06ea10 0x7fc1ac0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2305255247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac0c9c00 0x7fc1ac06cd30 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2305255247 >> 172.21.15.81:0/2305255247 conn(0x7fc1ac0d0240 msgr2=0x7fc1ac0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:20.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2305255247 shutdown_connections 2023-11-29T11:16:20.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2305255247 wait complete. 2023-11-29T11:16:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 Processor -- start 2023-11-29T11:16:20.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.078+0000 7fc1ab59e700 1 -- start start 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1ab59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1ac06ea10 0x7fc1ac0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1ab59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1ac0c9c00 0x7fc1ac15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1ab59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac15c160 0x7fc1ac1f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1ab59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac15e010 con 0x7fc1ac15c160 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1ab59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1580a0 con 0x7fc1ac06ea10 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1ab59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c3210 con 0x7fc1ac0c9c00 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac15c160 0x7fc1ac1f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aa59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1ac06ea10 0x7fc1ac0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac15c160 0x7fc1ac1f0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59242/0 (socket says 172.21.15.81:59242) 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 -- 172.21.15.81:0/2924848367 learned_addr learned my addr 172.21.15.81:0/2924848367 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1ac0c9c00 0x7fc1ac15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 -- 172.21.15.81:0/2924848367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1ac0c9c00 msgr2=0x7fc1ac15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1ac0c9c00 0x7fc1ac15dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 -- 172.21.15.81:0/2924848367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1ac06ea10 msgr2=0x7fc1ac0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1ac06ea10 0x7fc1ac0c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 -- 172.21.15.81:0/2924848367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c009570 con 0x7fc1ac15c160 2023-11-29T11:16:20.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1aad9d700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac15c160 0x7fc1ac1f0fe0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4007e60 tx=0x7fc1a400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:20.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc19affd700 1 -- 172.21.15.81:0/2924848367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400ed30 con 0x7fc1ac15c160 2023-11-29T11:16:20.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc19affd700 1 -- 172.21.15.81:0/2924848367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4014420 con 0x7fc1ac15c160 2023-11-29T11:16:20.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2924848367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac06f6b0 con 0x7fc1ac15c160 2023-11-29T11:16:20.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc19affd700 1 -- 172.21.15.81:0/2924848367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40147d0 con 0x7fc1ac15c160 2023-11-29T11:16:20.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.082+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2924848367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac06f3d0 con 0x7fc1ac15c160 2023-11-29T11:16:20.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.086+0000 7fc19affd700 1 -- 172.21.15.81:0/2924848367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc1a4012050 con 0x7fc1ac15c160 2023-11-29T11:16:20.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.086+0000 7fc19affd700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc18c064ee0 0x7fc18c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.086+0000 7fc19affd700 1 -- 172.21.15.81:0/2924848367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc1a4082460 con 0x7fc1ac15c160 2023-11-29T11:16:20.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.086+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc18c064ee0 0x7fc18c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.086+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc18c064ee0 0x7fc18c067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc19c014040 tx=0x7fc19c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1b3cb5740 1 Processor -- start 2023-11-29T11:16:20.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1b3cb5740 1 -- start start 2023-11-29T11:16:20.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x1291e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x1292340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 0x128e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1149d20 con 0xfdac10 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x11b9d60 con 0xfda840 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x11b3060 con 0x10258c0 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x1291e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x1291e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59254/0 (socket says 172.21.15.81:59254) 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 -- 172.21.15.81:0/978130527 learned_addr learned my addr 172.21.15.81:0/978130527 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x1292340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aad9d700 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 0x128e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 -- 172.21.15.81:0/978130527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 msgr2=0x128e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 0x128e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 -- 172.21.15.81:0/978130527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 msgr2=0x1292340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x1292340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 -- 172.21.15.81:0/978130527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11d90a0 con 0xfdac10 2023-11-29T11:16:20.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.090+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x1291e00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac070b90 tx=0x7fc19c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a08fe3ea0da8ee server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:20.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc18bfff700 1 -- 172.21.15.81:0/978130527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c01f070 con 0xfdac10 2023-11-29T11:16:20.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc18bfff700 1 -- 172.21.15.81:0/978130527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c0044d0 con 0xfdac10 2023-11-29T11:16:20.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc18bfff700 1 -- 172.21.15.81:0/978130527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c003d20 con 0xfdac10 2023-11-29T11:16:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/978130527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 msgr2=0x1291e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x1291e00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac070b90 tx=0x7fc19c010000 comp rx=0 tx=0).stop 2023-11-29T11:16:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/978130527 shutdown_connections 2023-11-29T11:16:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 0x128e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x1292340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/978130527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x1291e00 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/978130527 >> 172.21.15.81:0/978130527 conn(0xfdafe0 msgr2=0x1273d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/978130527 shutdown_connections 2023-11-29T11:16:20.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/978130527 wait complete. 2023-11-29T11:16:20.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- start start 2023-11-29T11:16:20.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 Processor -- start 2023-11-29T11:16:20.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfda840 0x1254fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfdac10 0x126f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 0x1255a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x105fc50 con 0xfda840 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1255f50 con 0x10258c0 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x126f820 con 0xfdac10 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1b3cb5740 10 client.0 _ll_register_callbacks cb 0x11ac9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.094+0000 7fc1aa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfda840 0x1254fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfda840 0x1254fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59266/0 (socket says 172.21.15.81:59266) 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aa59c700 1 -- 172.21.15.81:0/530487144 learned_addr learned my addr 172.21.15.81:0/530487144 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfdac10 0x126f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aad9d700 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 0x1255a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aa59c700 1 -- 172.21.15.81:0/530487144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfdac10 msgr2=0x126f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfdac10 0x126f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aa59c700 1 -- 172.21.15.81:0/530487144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 msgr2=0x1255a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 0x1255a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aa59c700 1 -- 172.21.15.81:0/530487144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac06f0f0 con 0xfda840 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfda840 0x1254fa0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc19c000c00 tx=0x7fc19c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22bb2975d07ea3e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1897fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1897fa700 1 -- 172.21.15.81:0/530487144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c035040 con 0xfda840 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1897fa700 1 -- 172.21.15.81:0/530487144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc19c03bd40 con 0xfda840 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/530487144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11ac0e0 con 0xfda840 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1897fa700 1 -- 172.21.15.81:0/530487144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc19c031480 con 0xfda840 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 10 client.6834 fetch_fsmap learned FSMap version 31 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/530487144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1026b10 con 0xfda840 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1897fa700 1 -- 172.21.15.81:0/530487144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11ac0e0 con 0xfda840 2023-11-29T11:16:20.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1897fa700 1 -- 172.21.15.81:0/530487144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc19c0315e0 con 0xfda840 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 10 client.6834 fetch_fsmap finished waiting for FSMap version 31 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 10 client.6834 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 20 client.6834 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1270800 0x1270c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 4 client.6834 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/530487144 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11abe00 con 0x1270800 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1270800 0x1270c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1270800 0x1270c00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f64c7bd1557bcdd6 server_cookie=348027b4c15ed92 in_seq=0 out_seq=0 2023-11-29T11:16:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.098+0000 7fc1897fa700 10 client.6834 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1897fa700 1 -- 172.21.15.81:0/530487144 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x11abe00 con 0x1270800 2023-11-29T11:16:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1897fa700 10 client.6834 handle_command_reply: tid=0 2023-11-29T11:16:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 client.6834 shutdown 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/530487144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfda840 msgr2=0x1254fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfda840 0x1254fa0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc19c000c00 tx=0x7fc19c0047e0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/530487144 shutdown_connections 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1270800 0x1270c00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 0x1255a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfdac10 0x126f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1897fa700 0 client.6834 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/530487144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfda840 0x1254fa0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/530487144 >> 172.21.15.81:0/530487144 conn(0xfdafe0 msgr2=0x126a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/530487144 shutdown_connections 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/530487144 wait complete. 2023-11-29T11:16:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.102+0000 7fc1b3cb5740 20 client.6834 trim_cache size 0 max 16384 2023-11-29T11:16:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1b3cb5740 1 Processor -- start 2023-11-29T11:16:20.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1b3cb5740 1 -- start start 2023-11-29T11:16:20.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfda840 0x12f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x12f2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 0x12f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x115cf10 con 0xfdac10 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x126fac0 con 0x10258c0 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1175140 con 0xfda840 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x12f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x12f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59274/0 (socket says 172.21.15.81:59274) 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 -- 172.21.15.81:0/2352841113 learned_addr learned my addr 172.21.15.81:0/2352841113 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1aad9d700 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 0x12f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfda840 0x12f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 -- 172.21.15.81:0/2352841113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfda840 msgr2=0x12f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfda840 0x12f1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 -- 172.21.15.81:0/2352841113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 msgr2=0x12f28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 0x12f28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 -- 172.21.15.81:0/2352841113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0c8410 con 0xfdac10 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x12f2360 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0000fd0 tx=0x7fc1a0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2dc19d434f07a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc198ff9700 1 -- 172.21.15.81:0/2352841113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0001320 con 0xfdac10 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc198ff9700 1 -- 172.21.15.81:0/2352841113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a0001480 con 0xfdac10 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.122+0000 7fc198ff9700 1 -- 172.21.15.81:0/2352841113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0001810 con 0xfdac10 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/2352841113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 msgr2=0x12f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x12f2360 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0000fd0 tx=0x7fc1a0007d30 comp rx=0 tx=0).stop 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/2352841113 shutdown_connections 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10258c0 0x12f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x12f2360 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/2352841113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xfda840 0x12f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/2352841113 >> 172.21.15.81:0/2352841113 conn(0xfdafe0 msgr2=0x1268790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:20.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/2352841113 shutdown_connections 2023-11-29T11:16:20.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/2352841113 wait complete. 2023-11-29T11:16:20.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- start start 2023-11-29T11:16:20.132 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 Processor -- start 2023-11-29T11:16:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x12f1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x126e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 0x126e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x12aa490 con 0xfdac10 2023-11-29T11:16:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x11b0870 con 0xfda840 2023-11-29T11:16:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1182ba0 con 0x10258c0 2023-11-29T11:16:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 10 client.0 _ll_register_callbacks cb 0x7fc19c00b6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x126e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x126e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59280/0 (socket says 172.21.15.81:59280) 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 -- 172.21.15.81:0/3759975299 learned_addr learned my addr 172.21.15.81:0/3759975299 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1aad9d700 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 0x126e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x12f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 -- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 msgr2=0x126e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 0x126e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 -- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 msgr2=0x12f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x12f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 -- 172.21.15.81:0/3759975299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a0005360 con 0xfdac10 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x12f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1a9d9b700 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x126e0f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0001850 tx=0x7fc1a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0737349156176e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1897fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1897fa700 1 -- 172.21.15.81:0/3759975299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0001320 con 0xfdac10 2023-11-29T11:16:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1897fa700 1 -- 172.21.15.81:0/3759975299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc1a0001cf0 con 0xfdac10 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/3759975299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc19c0044d0 con 0xfdac10 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1897fa700 1 -- 172.21.15.81:0/3759975299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1a002d640 con 0xfdac10 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 10 client.6840 fetch_fsmap learned FSMap version 31 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.126+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/3759975299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x115faf0 con 0xfdac10 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1897fa700 1 -- 172.21.15.81:0/3759975299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c0044d0 con 0xfdac10 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1897fa700 1 -- 172.21.15.81:0/3759975299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc1a002d7a0 con 0xfdac10 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 10 client.6840 fetch_fsmap finished waiting for FSMap version 31 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 10 client.6840 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 20 client.6840 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1255170 0x1289060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 4 client.6840 mds_command: new command op to 6564 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/3759975299 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1057390 con 0x1255170 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1255170 0x1289060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1897fa700 10 client.6840 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1aa59c700 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1255170 0x1289060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e09614c5b806ca18 server_cookie=c2784be7c5a0bf62 in_seq=0 out_seq=0 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1897fa700 1 -- 172.21.15.81:0/3759975299 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x1057390 con 0x1255170 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1897fa700 10 client.6840 handle_command_reply: tid=0 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 client.6840 shutdown 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/3759975299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 msgr2=0x126e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x126e0f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0001850 tx=0x7fc1a0000ed0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/3759975299 shutdown_connections 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1255170 0x1289060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10258c0 0x126e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfdac10 0x126e0f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1897fa700 0 client.6840 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 --2- 172.21.15.81:0/3759975299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xfda840 0x12f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/3759975299 >> 172.21.15.81:0/3759975299 conn(0xfdafe0 msgr2=0x1269020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/3759975299 shutdown_connections 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 1 -- 172.21.15.81:0/3759975299 wait complete. 2023-11-29T11:16:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1b3cb5740 20 client.6840 trim_cache size 0 max 16384 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout: "615a6153-3eb1-4f81-9d4f-094f5fb4e93c": { 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "615a6153-3eb1-4f81-9d4f-094f5fb4e93c", 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive" 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:20.140 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc18c064ee0 msgr2=0x7fc18c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc18c064ee0 0x7fc18c067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc19c014040 tx=0x7fc19c008030 comp rx=0 tx=0).stop 2023-11-29T11:16:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac15c160 msgr2=0x7fc1ac1f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac15c160 0x7fc1ac1f0fe0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4007e60 tx=0x7fc1a400e3c0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2924848367 shutdown_connections 2023-11-29T11:16:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc18c064ee0 0x7fc18c067390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1ac15c160 0x7fc1ac1f0fe0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1ac0c9c00 0x7fc1ac15dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 --2- 172.21.15.81:0/2924848367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1ac06ea10 0x7fc1ac0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2924848367 >> 172.21.15.81:0/2924848367 conn(0x7fc1ac0d0240 msgr2=0x7fc1ac071830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2924848367 shutdown_connections 2023-11-29T11:16:20.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:20.130+0000 7fc1ab59e700 1 -- 172.21.15.81:0/2924848367 wait complete. 2023-11-29T11:16:20.154 INFO:tasks.cephfs.filesystem:scrub status for tag:615a6153-3eb1-4f81-9d4f-094f5fb4e93c - {'path': '/', 'tag': '615a6153-3eb1-4f81-9d4f-094f5fb4e93c', 'options': 'recursive'} 2023-11-29T11:16:24.058 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:16:24.054+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-29T11:16:26.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:16:26.143 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:16:50.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-29T11:16:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e359e700 1 Processor -- start 2023-11-29T11:16:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e359e700 1 -- start start 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4e40b1ae0 0x7fb4e406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e40cf0e0 0x7fb4e40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40cfa80 con 0x7fb4e406a4c0 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e40d0ab0 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e406a9c0 con 0x7fb4e40cf0e0 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4dbfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb4e406a4c0 0x7fb4e40d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48754/0 (socket says 172.21.15.81:48754) 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4dbfff700 1 -- 172.21.15.81:0/2461570541 learned_addr learned my addr 172.21.15.81:0/2461570541 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e259c700 1 --2- 172.21.15.81:0/2461570541 >> v2:172.21.15.81:3300/0 conn(0x7fb4e40b1ae0 0x7fb4e406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/2461570541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e40cf0e0 0x7fb4e40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e1d9b700 1 -- 172.21.15.81:0/2461570541 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544917847 0 0) 0x7fb4e40cfa80 con 0x7fb4e406a4c0 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e1d9b700 1 -- 172.21.15.81:0/2461570541 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d00035d0 con 0x7fb4e406a4c0 2023-11-29T11:16:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e259c700 1 -- 172.21.15.81:0/2461570541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e40cf0e0 msgr2=0x7fb4e40cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e259c700 1 --2- 172.21.15.81:0/2461570541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e40cf0e0 0x7fb4e40cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e259c700 1 -- 172.21.15.81:0/2461570541 >> v1:172.21.15.81:6789/0 conn(0x7fb4e406a4c0 legacy=0x7fb4e40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e259c700 1 -- 172.21.15.81:0/2461570541 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e406aca0 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e259c700 1 --2- 172.21.15.81:0/2461570541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e406d8e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009850 tx=0x7fb4d4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bc4c0b9993d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e1d9b700 1 -- 172.21.15.81:0/2461570541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4011830 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e1d9b700 1 -- 172.21.15.81:0/2461570541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4011990 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.265+0000 7fb4e1d9b700 1 -- 172.21.15.81:0/2461570541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4011d40 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- 172.21.15.81:0/2461570541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 msgr2=0x7fb4e406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2461570541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e406d8e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009850 tx=0x7fb4d4009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- 172.21.15.81:0/2461570541 shutdown_connections 2023-11-29T11:16:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2461570541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e40cf0e0 0x7fb4e40cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2461570541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e406d8e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- 172.21.15.81:0/2461570541 >> 172.21.15.81:0/2461570541 conn(0x7fb4e409bbd0 msgr2=0x7fb4e40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- 172.21.15.81:0/2461570541 shutdown_connections 2023-11-29T11:16:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- 172.21.15.81:0/2461570541 wait complete. 2023-11-29T11:16:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 Processor -- start 2023-11-29T11:16:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- start start 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e406a4c0 0x7fb4e4159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e409db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e40cf0e0 0x7fb4e409e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e409e6b0 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e415b810 con 0x7fb4e40cf0e0 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e415e6b0 con 0x7fb4e406a4c0 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e409db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39180/0 (socket says 172.21.15.81:39180) 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 -- 172.21.15.81:0/2068690805 learned_addr learned my addr 172.21.15.81:0/2068690805 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e259c700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e406a4c0 0x7fb4e4159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e40cf0e0 0x7fb4e409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 -- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e406a4c0 msgr2=0x7fb4e4159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e406a4c0 0x7fb4e4159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 -- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e40cf0e0 msgr2=0x7fb4e409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e40cf0e0 0x7fb4e409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 -- 172.21.15.81:0/2068690805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40094b0 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e40cf0e0 0x7fb4e409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e409db40 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00c4d0 tx=0x7fb4cc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4daffd700 1 -- 172.21.15.81:0/2068690805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc005d90 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4daffd700 1 -- 172.21.15.81:0/2068690805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc0070d0 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4daffd700 1 -- 172.21.15.81:0/2068690805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc007480 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- 172.21.15.81:0/2068690805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e40b4380 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.269+0000 7fb4e359e700 1 -- 172.21.15.81:0/2068690805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e406af80 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.273+0000 7fb4daffd700 1 -- 172.21.15.81:0/2068690805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb4cc019030 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.273+0000 7fb4daffd700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb4c4064ee0 0x7fb4c4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.273+0000 7fb4daffd700 1 -- 172.21.15.81:0/2068690805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb4cc081390 con 0x7fb4e40b1ae0 2023-11-29T11:16:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.273+0000 7fb4e259c700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb4c4064ee0 0x7fb4c4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.273+0000 7fb4e259c700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb4c4064ee0 0x7fb4c4067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40090b0 tx=0x7fb4d4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4ebff5740 1 Processor -- start 2023-11-29T11:16:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4ebff5740 1 -- start start 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 0x257ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5840 0x257d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23108c0 0x25796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2434d20 con 0x23108c0 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x24a4d60 con 0x22c5c10 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x249e060 con 0x22c5840 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23108c0 0x25796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23108c0 0x25796a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39186/0 (socket says 172.21.15.81:39186) 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 -- 172.21.15.81:0/2551951898 learned_addr learned my addr 172.21.15.81:0/2551951898 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e259c700 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 0x257ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5840 0x257d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 -- 172.21.15.81:0/2551951898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5840 msgr2=0x257d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5840 0x257d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 -- 172.21.15.81:0/2551951898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 msgr2=0x257ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 0x257ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 -- 172.21.15.81:0/2551951898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24c40a0 con 0x23108c0 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23108c0 0x25796a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0074f0 tx=0x7fb4dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b85a608f89a5023 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4c3fff700 1 -- 172.21.15.81:0/2551951898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00e030 con 0x23108c0 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4c3fff700 1 -- 172.21.15.81:0/2551951898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0153f0 con 0x23108c0 2023-11-29T11:16:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.277+0000 7fb4c3fff700 1 -- 172.21.15.81:0/2551951898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc015760 con 0x23108c0 2023-11-29T11:16:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- 172.21.15.81:0/2551951898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23108c0 msgr2=0x25796a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23108c0 0x25796a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0074f0 tx=0x7fb4dc009750 comp rx=0 tx=0).stop 2023-11-29T11:16:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- 172.21.15.81:0/2551951898 shutdown_connections 2023-11-29T11:16:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23108c0 0x25796a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5840 0x257d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/2551951898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 0x257ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- 172.21.15.81:0/2551951898 >> 172.21.15.81:0/2551951898 conn(0x22c5fe0 msgr2=0x255ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- 172.21.15.81:0/2551951898 shutdown_connections 2023-11-29T11:16:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- 172.21.15.81:0/2551951898 wait complete. 2023-11-29T11:16:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- start start 2023-11-29T11:16:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 Processor -- start 2023-11-29T11:16:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5840 0x2540ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5c10 0x255a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 0x255b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x234ac50 con 0x22c5c10 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2540ff0 con 0x22c5840 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x255aab0 con 0x23108c0 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5c10 0x255a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5c10 0x255a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39202/0 (socket says 172.21.15.81:39202) 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4dbfff700 1 -- 172.21.15.81:0/1295589616 learned_addr learned my addr 172.21.15.81:0/1295589616 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4ebff5740 10 client.0 _ll_register_callbacks cb 0x24979a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5840 0x2540ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 0x255b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4dbfff700 1 -- 172.21.15.81:0/1295589616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 msgr2=0x255b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 0x255b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4dbfff700 1 -- 172.21.15.81:0/1295589616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5840 msgr2=0x2540ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5840 0x2540ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.281+0000 7fb4dbfff700 1 -- 172.21.15.81:0/1295589616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2311b10 con 0x22c5c10 2023-11-29T11:16:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5c10 0x255a250 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0070a0 tx=0x7fb4cc0075e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bcb8e8872d2513 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1295589616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc06a180 con 0x22c5c10 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1295589616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb4cc06a2e0 con 0x22c5c10 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1295589616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24970e0 con 0x22c5c10 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1295589616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4cc04ee60 con 0x22c5c10 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 10 client.6855 fetch_fsmap learned FSMap version 32 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1295589616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x2464970 con 0x22c5c10 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1295589616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x24970e0 con 0x22c5c10 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1295589616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fb4cc04efc0 con 0x22c5c10 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 10 client.6855 fetch_fsmap finished waiting for FSMap version 32 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 10 client.6855 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 20 client.6855 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x255c540 0x255c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 4 client.6855 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1295589616 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2496e00 con 0x255c540 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x255c540 0x255c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 10 client.6855 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x255c540 0x255c940 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec20a632767fa671 server_cookie=f3fc08fb7f77179a in_seq=0 out_seq=0 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1295589616 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2496e00 con 0x255c540 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 10 client.6855 handle_command_reply: tid=0 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 client.6855 shutdown 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1295589616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5c10 msgr2=0x255a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5c10 0x255a250 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0070a0 tx=0x7fb4cc0075e0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1295589616 shutdown_connections 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x255c540 0x255c940 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 0x255b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5c10 0x255a250 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1295589616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5840 0x2540ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4c17fa700 0 client.6855 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1295589616 >> 172.21.15.81:0/1295589616 conn(0x22c5fe0 msgr2=0x2555760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1295589616 shutdown_connections 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1295589616 wait complete. 2023-11-29T11:16:50.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.285+0000 7fb4ebff5740 20 client.6855 trim_cache size 0 max 16384 2023-11-29T11:16:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.305+0000 7fb4ebff5740 1 Processor -- start 2023-11-29T11:16:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.305+0000 7fb4ebff5740 1 -- start start 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x2559790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5c10 0x2559cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x23108c0 0x255a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2460140 con 0x22c5840 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x24999d0 con 0x23108c0 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x243d510 con 0x22c5c10 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x2559790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x2559790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39214/0 (socket says 172.21.15.81:39214) 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 -- 172.21.15.81:0/1495910155 learned_addr learned my addr 172.21.15.81:0/1495910155 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5c10 0x2559cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x23108c0 0x255a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 -- 172.21.15.81:0/1495910155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5c10 msgr2=0x2559cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5c10 0x2559cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 -- 172.21.15.81:0/1495910155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x23108c0 msgr2=0x255a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x23108c0 0x255a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 -- 172.21.15.81:0/1495910155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e415ef30 con 0x22c5840 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x2559790 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4013000 tx=0x7fb4d400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0115536e3a0dac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4d8ff9700 1 -- 172.21.15.81:0/1495910155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4020070 con 0x22c5840 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4d8ff9700 1 -- 172.21.15.81:0/1495910155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d402d070 con 0x22c5840 2023-11-29T11:16:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4d8ff9700 1 -- 172.21.15.81:0/1495910155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40043a0 con 0x22c5840 2023-11-29T11:16:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1495910155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 msgr2=0x2559790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x2559790 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4013000 tx=0x7fb4d400e000 comp rx=0 tx=0).stop 2023-11-29T11:16:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1495910155 shutdown_connections 2023-11-29T11:16:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x23108c0 0x255a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22c5c10 0x2559cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1495910155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x2559790 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1495910155 >> 172.21.15.81:0/1495910155 conn(0x22c5fe0 msgr2=0x253d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1495910155 shutdown_connections 2023-11-29T11:16:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1495910155 wait complete. 2023-11-29T11:16:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 -- start start 2023-11-29T11:16:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.309+0000 7fb4ebff5740 1 Processor -- start 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x25759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 0x2574460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 0x25578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x249b870 con 0x22c5840 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x24a5ff0 con 0x22c5c10 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2447f10 con 0x23108c0 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x25759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 10 client.0 _ll_register_callbacks cb 0x7fb4dc009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x25759b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39218/0 (socket says 172.21.15.81:39218) 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 -- 172.21.15.81:0/1762499768 learned_addr learned my addr 172.21.15.81:0/1762499768 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e2d9d700 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 0x25578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 0x2574460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 -- 172.21.15.81:0/1762499768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 msgr2=0x25578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 0x25578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 -- 172.21.15.81:0/1762499768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 msgr2=0x2574460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 0x2574460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 -- 172.21.15.81:0/1762499768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e406aca0 con 0x22c5840 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4e259c700 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x25759b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4066b70 tx=0x7fb4d40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb92553319e9cf93 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1762499768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4020040 con 0x22c5840 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1762499768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb4d4004420 con 0x22c5840 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1762499768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4dc0153f0 con 0x22c5840 2023-11-29T11:16:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1762499768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4d40045e0 con 0x22c5840 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 10 client.6861 fetch_fsmap learned FSMap version 32 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1762499768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x244a450 con 0x22c5840 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1762499768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0153f0 con 0x22c5840 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1762499768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fb4d4034850 con 0x22c5840 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 10 client.6861 fetch_fsmap finished waiting for FSMap version 32 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 10 client.6861 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 20 client.6861 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x253f990 0x2557e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 4 client.6861 mds_command: new command op to 6564 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1762499768 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2342390 con 0x253f990 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x253f990 0x2557e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 10 client.6861 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4dbfff700 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x253f990 0x2557e20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4be8d0f4147822a server_cookie=2ec2706703b9e609 in_seq=0 out_seq=0 2023-11-29T11:16:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 1 -- 172.21.15.81:0/1762499768 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x2342390 con 0x253f990 2023-11-29T11:16:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4c17fa700 10 client.6861 handle_command_reply: tid=0 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.313+0000 7fb4ebff5740 1 client.6861 shutdown 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1762499768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 msgr2=0x25759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x25759b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4066b70 tx=0x7fb4d40047e0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1762499768 shutdown_connections 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x253f990 0x2557e20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4c17fa700 0 client.6861 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x23108c0 0x25578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22c5c10 0x2574460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 --2- 172.21.15.81:0/1762499768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22c5840 0x25759b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1762499768 >> 172.21.15.81:0/1762499768 conn(0x22c5fe0 msgr2=0x253cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1762499768 shutdown_connections 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 1 -- 172.21.15.81:0/1762499768 wait complete. 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4ebff5740 20 client.6861 trim_cache size 0 max 16384 2023-11-29T11:16:50.325 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:16:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:16:50.326 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 -- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb4c4064ee0 msgr2=0x7fb4c4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb4c4064ee0 0x7fb4c4067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40090b0 tx=0x7fb4d4008030 comp rx=0 tx=0).stop 2023-11-29T11:16:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 -- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 msgr2=0x7fb4e409db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e409db40 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00c4d0 tx=0x7fb4cc00c7e0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 -- 172.21.15.81:0/2068690805 shutdown_connections 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb4c4064ee0 0x7fb4c4067390 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e40cf0e0 0x7fb4e409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4e40b1ae0 0x7fb4e409db40 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 --2- 172.21.15.81:0/2068690805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e406a4c0 0x7fb4e4159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 -- 172.21.15.81:0/2068690805 >> 172.21.15.81:0/2068690805 conn(0x7fb4e409bbd0 msgr2=0x7fb4e40cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 -- 172.21.15.81:0/2068690805 shutdown_connections 2023-11-29T11:16:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.317+0000 7fb4e359e700 1 -- 172.21.15.81:0/2068690805 wait complete. 2023-11-29T11:16:50.336 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:16:50.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:16:50.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b7fff700 1 Processor -- start 2023-11-29T11:16:50.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b7fff700 1 -- start start 2023-11-29T11:16:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b80b1ca0 0x7fa1b80b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1b806a330 0x7fa1b80cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1b80d2780 0x7fa1b80d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b7fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80d3140 con 0x7fa1b80d2780 2023-11-29T11:16:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b7fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80cf070 con 0x7fa1b806a330 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80b2070 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1b80d2780 0x7fa1b80d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1b80d2780 0x7fa1b80d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39224/0 (socket says 172.21.15.81:39224) 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 -- 172.21.15.81:0/1078394798 learned_addr learned my addr 172.21.15.81:0/1078394798 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1affff700 1 --2- 172.21.15.81:0/1078394798 >> v2:172.21.15.176:3300/0 conn(0x7fa1b806a330 0x7fa1b80cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b6ffd700 1 --2- 172.21.15.81:0/1078394798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b80b1ca0 0x7fa1b80b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 -- 172.21.15.81:0/1078394798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b80b1ca0 msgr2=0x7fa1b80b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 --2- 172.21.15.81:0/1078394798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b80b1ca0 0x7fa1b80b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 -- 172.21.15.81:0/1078394798 >> v2:172.21.15.176:3300/0 conn(0x7fa1b806a330 msgr2=0x7fa1b80cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 --2- 172.21.15.81:0/1078394798 >> v2:172.21.15.176:3300/0 conn(0x7fa1b806a330 0x7fa1b80cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 -- 172.21.15.81:0/1078394798 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b806a8a0 con 0x7fa1b80d2780 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1affff700 1 --2- 172.21.15.81:0/1078394798 >> v2:172.21.15.176:3300/0 conn(0x7fa1b806a330 0x7fa1b80cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b77fe700 1 --2- 172.21.15.81:0/1078394798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80d2780 0x7fa1b80d2c00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa1b808a7d0 tx=0x7fa1b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f080b254607892c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b67fc700 1 -- 172.21.15.81:0/1078394798 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000e070 con 0x7fa1b80d2780 2023-11-29T11:16:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b67fc700 1 -- 172.21.15.81:0/1078394798 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b000b910 con 0x7fa1b80d2780 2023-11-29T11:16:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.437+0000 7fa1b67fc700 1 -- 172.21.15.81:0/1078394798 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000bcc0 con 0x7fa1b80d2780 2023-11-29T11:16:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- 172.21.15.81:0/1078394798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80d2780 msgr2=0x7fa1b80d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/1078394798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80d2780 0x7fa1b80d2c00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa1b808a7d0 tx=0x7fa1b000b330 comp rx=0 tx=0).stop 2023-11-29T11:16:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- 172.21.15.81:0/1078394798 shutdown_connections 2023-11-29T11:16:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/1078394798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80d2780 0x7fa1b80d2c00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/1078394798 >> v2:172.21.15.176:3300/0 conn(0x7fa1b806a330 0x7fa1b80cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/1078394798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b80b1ca0 0x7fa1b80b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- 172.21.15.81:0/1078394798 >> 172.21.15.81:0/1078394798 conn(0x7fa1b80b5740 msgr2=0x7fa1b80b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- 172.21.15.81:0/1078394798 shutdown_connections 2023-11-29T11:16:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- 172.21.15.81:0/1078394798 wait complete. 2023-11-29T11:16:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 Processor -- start 2023-11-29T11:16:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- start start 2023-11-29T11:16:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b806a330 0x7fa1b8155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80b1ca0 0x7fa1b80cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1b80d2780 0x7fa1b80b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81f2390 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81f1a60 con 0x7fa1b80d2780 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1b7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81f1d40 con 0x7fa1b806a330 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.441+0000 7fa1affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80b1ca0 0x7fa1b80cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1b77fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1b80d2780 0x7fa1b80b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80b1ca0 0x7fa1b80cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39228/0 (socket says 172.21.15.81:39228) 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1affff700 1 -- 172.21.15.81:0/467643051 learned_addr learned my addr 172.21.15.81:0/467643051 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1b6ffd700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b806a330 0x7fa1b8155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1affff700 1 -- 172.21.15.81:0/467643051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b806a330 msgr2=0x7fa1b8155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1affff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b806a330 0x7fa1b8155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1affff700 1 -- 172.21.15.81:0/467643051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1b80d2780 msgr2=0x7fa1b80b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1affff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1b80d2780 0x7fa1b80b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1affff700 1 -- 172.21.15.81:0/467643051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0009b30 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1b77fe700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1b80d2780 0x7fa1b80b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1affff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80b1ca0 0x7fa1b80cdb90 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000d800 tx=0x7fa1a000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1af7fe700 1 -- 172.21.15.81:0/467643051 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0004030 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1af7fe700 1 -- 172.21.15.81:0/467643051 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0004190 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b806ae60 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1af7fe700 1 -- 172.21.15.81:0/467643051 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0004520 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b806ab80 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1af7fe700 1 -- 172.21.15.81:0/467643051 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa1a001b030 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b806b140 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1af7fe700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa198064ee0 0x7fa198067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1b6ffd700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa198064ee0 0x7fa198067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.445+0000 7fa1af7fe700 1 -- 172.21.15.81:0/467643051 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa1a00816a0 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.449+0000 7fa1b6ffd700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa198064ee0 0x7fa198067390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa1b815bf40 tx=0x7fa1a8009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.453+0000 7fa1af7fe700 1 -- 172.21.15.81:0/467643051 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa1a004c400 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.645+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1b8072c20 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1af7fe700 1 -- 172.21.15.81:0/467643051 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4650 (secure 0 0 0) 0x7fa1a004f770 con 0x7fa1b80b1ca0 2023-11-29T11:16:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:50.654 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:24.056344+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa198064ee0 msgr2=0x7fa198067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa198064ee0 0x7fa198067390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa1b815bf40 tx=0x7fa1a8009240 comp rx=0 tx=0).stop 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80b1ca0 msgr2=0x7fa1b80cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80b1ca0 0x7fa1b80cdb90 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000d800 tx=0x7fa1a000db10 comp rx=0 tx=0).stop 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 shutdown_connections 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa198064ee0 0x7fa198067390 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1b80d2780 0x7fa1b80b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b80b1ca0 0x7fa1b80cdb90 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 --2- 172.21.15.81:0/467643051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1b806a330 0x7fa1b8155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 >> 172.21.15.81:0/467643051 conn(0x7fa1b80b5740 msgr2=0x7fa1b80b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 shutdown_connections 2023-11-29T11:16:50.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.649+0000 7fa1b7fff700 1 -- 172.21.15.81:0/467643051 wait complete. 2023-11-29T11:16:50.658 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2023-11-29T11:16:50.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-11-29T11:16:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83fb59e700 1 Processor -- start 2023-11-29T11:16:50.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83fb59e700 1 -- start start 2023-11-29T11:16:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83fb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83f4039090 0x7f83f40e4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83fb59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f40e5260 con 0x7f83f40514c0 2023-11-29T11:16:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83fb59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f4053500 con 0x7f83f4036320 2023-11-29T11:16:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83fb59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f403a460 con 0x7f83f4039090 2023-11-29T11:16:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83f9d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f83f40514c0 0x7f83f4038980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48764/0 (socket says 172.21.15.81:48764) 2023-11-29T11:16:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83f9d9b700 1 -- 172.21.15.81:0/3084887318 learned_addr learned my addr 172.21.15.81:0/3084887318 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:50.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83fad9d700 1 --2- 172.21.15.81:0/3084887318 >> v2:172.21.15.81:3300/0 conn(0x7f83f4039090 0x7f83f40e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83f959a700 1 -- 172.21.15.81:0/3084887318 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246998267 0 0) 0x7f83e4001110 con 0x7f83f40514c0 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83f959a700 1 -- 172.21.15.81:0/3084887318 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e80035d0 con 0x7f83f40514c0 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83f959a700 1 -- 172.21.15.81:0/3084887318 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2109372574 0 0) 0x7f83e80035d0 con 0x7f83f40514c0 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.773+0000 7f83fad9d700 1 -- 172.21.15.81:0/3084887318 >> v1:172.21.15.176:6789/0 conn(0x7f83f4036320 legacy=0x7f83f4039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fad9d700 1 -- 172.21.15.81:0/3084887318 >> v1:172.21.15.81:6789/0 conn(0x7f83f40514c0 legacy=0x7f83f4038980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fad9d700 1 -- 172.21.15.81:0/3084887318 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4051950 con 0x7f83f4039090 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fad9d700 1 --2- 172.21.15.81:0/3084887318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f40e4d20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f83fc02cad0 tx=0x7f83fc04e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2d206a88a330f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83f959a700 1 -- 172.21.15.81:0/3084887318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4001800 con 0x7f83f4039090 2023-11-29T11:16:50.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83f959a700 1 -- 172.21.15.81:0/3084887318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc000950 con 0x7f83f4039090 2023-11-29T11:16:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83f959a700 1 -- 172.21.15.81:0/3084887318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0676a0 con 0x7f83f4039090 2023-11-29T11:16:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 -- 172.21.15.81:0/3084887318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 msgr2=0x7f83f40e4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 --2- 172.21.15.81:0/3084887318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f40e4d20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f83fc02cad0 tx=0x7f83fc04e8b0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 -- 172.21.15.81:0/3084887318 shutdown_connections 2023-11-29T11:16:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 --2- 172.21.15.81:0/3084887318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f40e4d20 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 -- 172.21.15.81:0/3084887318 >> 172.21.15.81:0/3084887318 conn(0x7f83f4057b90 msgr2=0x7f83f4053980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 -- 172.21.15.81:0/3084887318 shutdown_connections 2023-11-29T11:16:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 -- 172.21.15.81:0/3084887318 wait complete. 2023-11-29T11:16:50.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 Processor -- start 2023-11-29T11:16:50.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.777+0000 7f83fb59e700 1 -- start start 2023-11-29T11:16:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fb59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83f4036320 0x7f83f40e2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f4037b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fb59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83f40514c0 0x7f83f40db390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40e1a90 con 0x7f83f4039090 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fb59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40e3790 con 0x7f83f40514c0 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fb59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40e3a70 con 0x7f83f4036320 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f4037b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f4037b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39246/0 (socket says 172.21.15.81:39246) 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 -- 172.21.15.81:0/3786178543 learned_addr learned my addr 172.21.15.81:0/3786178543 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fad9d700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83f40514c0 0x7f83f40db390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fa59c700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83f4036320 0x7f83f40e2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 -- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83f4036320 msgr2=0x7f83f40e2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83f4036320 0x7f83f40e2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 -- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83f40514c0 msgr2=0x7f83f40db390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83f40514c0 0x7f83f40db390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 -- 172.21.15.81:0/3786178543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc04e720 con 0x7f83f4039090 2023-11-29T11:16:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fad9d700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83f40514c0 0x7f83f40db390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f4037b20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c550 tx=0x7f83e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f2ffd700 1 -- 172.21.15.81:0/3786178543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4004ca0 con 0x7f83f4039090 2023-11-29T11:16:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f2ffd700 1 -- 172.21.15.81:0/3786178543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4004e00 con 0x7f83f4039090 2023-11-29T11:16:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fb59e700 1 -- 172.21.15.81:0/3786178543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f4054e50 con 0x7f83f4039090 2023-11-29T11:16:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83f2ffd700 1 -- 172.21.15.81:0/3786178543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40072d0 con 0x7f83f4039090 2023-11-29T11:16:50.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.781+0000 7f83fb59e700 1 -- 172.21.15.81:0/3786178543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f4054b70 con 0x7f83f4039090 2023-11-29T11:16:50.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f8403e13740 1 Processor -- start 2023-11-29T11:16:50.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83f2ffd700 1 -- 172.21.15.81:0/3786178543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f83e401a020 con 0x7f83f4039090 2023-11-29T11:16:50.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f8403e13740 1 -- start start 2023-11-29T11:16:50.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83f2ffd700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83dc064ee0 0x7f83dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83f2ffd700 1 -- 172.21.15.81:0/3786178543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f83e4081b80 con 0x7f83f4039090 2023-11-29T11:16:50.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fad9d700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83dc064ee0 0x7f83dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f8403e13740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1e66420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f8403e13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1e68970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f8403e13740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e6aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f8403e13740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d1ddc0 con 0x1baed20 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f8403e13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d8de20 con 0x1bae950 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f8403e13740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d87120 con 0x1bf99d0 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1e66420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fad9d700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83dc064ee0 0x7f83dc067390 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f83f400fdd0 tx=0x7f83fc06d050 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1e66420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39248/0 (socket says 172.21.15.81:39248) 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 -- 172.21.15.81:0/2250576872 learned_addr learned my addr 172.21.15.81:0/2250576872 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1e68970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e6aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 -- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 msgr2=0x1e6aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e6aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 -- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 msgr2=0x1e68970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1e68970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 -- 172.21.15.81:0/2250576872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1dad9b0 con 0x1baed20 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:50.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1e66420 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f83ec001710 tx=0x7f83ec001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b8dc956051a23e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83dbfff700 1 -- 172.21.15.81:0/2250576872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0052e0 con 0x1baed20 2023-11-29T11:16:50.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83dbfff700 1 -- 172.21.15.81:0/2250576872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec005440 con 0x1baed20 2023-11-29T11:16:50.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.785+0000 7f83dbfff700 1 -- 172.21.15.81:0/2250576872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0038e0 con 0x1baed20 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- 172.21.15.81:0/2250576872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 msgr2=0x1e66420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1e66420 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f83ec001710 tx=0x7f83ec001a20 comp rx=0 tx=0).stop 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- 172.21.15.81:0/2250576872 shutdown_connections 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1e68970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 --2- 172.21.15.81:0/2250576872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1e66420 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- 172.21.15.81:0/2250576872 >> 172.21.15.81:0/2250576872 conn(0x1baf0f0 msgr2=0x1e47e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- 172.21.15.81:0/2250576872 shutdown_connections 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- 172.21.15.81:0/2250576872 wait complete. 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- start start 2023-11-29T11:16:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 Processor -- start 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1e21520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1baed20 0x1e37790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e37cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c33d60 con 0x1bf99d0 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e49070 con 0x1bae950 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e21a60 con 0x1baed20 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.789+0000 7f8403e13740 10 client.0 _ll_register_callbacks cb 0x1d80a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e37cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e37cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39260/0 (socket says 172.21.15.81:39260) 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 -- 172.21.15.81:0/2058616750 learned_addr learned my addr 172.21.15.81:0/2058616750 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1e21520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1baed20 0x1e37790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 -- 172.21.15.81:0/2058616750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1baed20 msgr2=0x1e37790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1baed20 0x1e37790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 -- 172.21.15.81:0/2058616750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 msgr2=0x1e21520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1e21520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 -- 172.21.15.81:0/2058616750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec00f040 con 0x1bf99d0 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e37cd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f83fc000b60 tx=0x7f83fc068770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55538873e8fa2ba7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 1 -- 172.21.15.81:0/2058616750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0a6070 con 0x1bf99d0 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 1 -- 172.21.15.81:0/2058616750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f83fc066b20 con 0x1bf99d0 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 -- 172.21.15.81:0/2058616750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1d801a0 con 0x1bf99d0 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 1 -- 172.21.15.81:0/2058616750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83fc099070 con 0x1bf99d0 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 10 client.6882 fetch_fsmap learned FSMap version 32 2023-11-29T11:16:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 -- 172.21.15.81:0/2058616750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x1bfac20 con 0x1bf99d0 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 1 -- 172.21.15.81:0/2058616750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1d801a0 con 0x1bf99d0 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 1 -- 172.21.15.81:0/2058616750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f83fc066ce0 con 0x1bf99d0 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 10 client.6882 fetch_fsmap finished waiting for FSMap version 32 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 10 client.6882 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 20 client.6882 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1e60d70 0x1e1f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 4 client.6882 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 -- 172.21.15.81:0/2058616750 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1d7fec0 con 0x1e60d70 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1e60d70 0x1e1f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 10 client.6882 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1e60d70 0x1e1f9a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ba6c5d9559f73a server_cookie=44041595403ac86f in_seq=0 out_seq=0 2023-11-29T11:16:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 1 -- 172.21.15.81:0/2058616750 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1d7fec0 con 0x1e60d70 2023-11-29T11:16:50.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 10 client.6882 handle_command_reply: tid=0 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 client.6882 shutdown 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 -- 172.21.15.81:0/2058616750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 msgr2=0x1e37cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e37cd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f83fc000b60 tx=0x7f83fc068770 comp rx=0 tx=0).stop 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 -- 172.21.15.81:0/2058616750 shutdown_connections 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1e60d70 0x1e1f9a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e37cd0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f83d97fa700 0 client.6882 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1baed20 0x1e37790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 --2- 172.21.15.81:0/2058616750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1e21520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.793+0000 7f8403e13740 1 -- 172.21.15.81:0/2058616750 >> 172.21.15.81:0/2058616750 conn(0x1baf0f0 msgr2=0x1e47030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.797+0000 7f8403e13740 1 -- 172.21.15.81:0/2058616750 shutdown_connections 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.797+0000 7f8403e13740 1 -- 172.21.15.81:0/2058616750 wait complete. 2023-11-29T11:16:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.797+0000 7f8403e13740 20 client.6882 trim_cache size 0 max 16384 2023-11-29T11:16:50.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f8403e13740 1 Processor -- start 2023-11-29T11:16:50.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f8403e13740 1 -- start start 2023-11-29T11:16:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f8403e13740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bae950 0x1e75260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f8403e13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1baed20 0x1e1da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f8403e13740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e1df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f8403e13740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d266b0 con 0x1bf99d0 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f8403e13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d85fb0 con 0x1baed20 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f8403e13740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d47bc0 con 0x1bae950 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e1df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e1df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39262/0 (socket says 172.21.15.81:39262) 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 -- 172.21.15.81:0/2895202289 learned_addr learned my addr 172.21.15.81:0/2895202289 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bae950 0x1e75260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1baed20 0x1e1da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 -- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bae950 msgr2=0x1e75260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bae950 0x1e75260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 -- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1baed20 msgr2=0x1e1da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1baed20 0x1e1da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 -- 172.21.15.81:0/2895202289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40dbc30 con 0x1bf99d0 2023-11-29T11:16:50.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1baed20 0x1e1da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:50.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e1df40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f83fc063910 tx=0x7f83fc0a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82858de8123d5d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.809+0000 7f83f0ff9700 1 -- 172.21.15.81:0/2895202289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc061430 con 0x1bf99d0 2023-11-29T11:16:50.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f0ff9700 1 -- 172.21.15.81:0/2895202289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc071040 con 0x1bf99d0 2023-11-29T11:16:50.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f0ff9700 1 -- 172.21.15.81:0/2895202289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc061590 con 0x1bf99d0 2023-11-29T11:16:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- 172.21.15.81:0/2895202289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 msgr2=0x1e1df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e1df40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f83fc063910 tx=0x7f83fc0a6000 comp rx=0 tx=0).stop 2023-11-29T11:16:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- 172.21.15.81:0/2895202289 shutdown_connections 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bf99d0 0x1e1df40 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1baed20 0x1e1da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 --2- 172.21.15.81:0/2895202289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bae950 0x1e75260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- 172.21.15.81:0/2895202289 >> 172.21.15.81:0/2895202289 conn(0x1baf0f0 msgr2=0x1e74b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- 172.21.15.81:0/2895202289 shutdown_connections 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- 172.21.15.81:0/2895202289 wait complete. 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- start start 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 Processor -- start 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1ec7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1ec6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e5f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d89c80 con 0x1baed20 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d8b120 con 0x1bae950 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d814c0 con 0x1bf99d0 2023-11-29T11:16:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 10 client.0 _ll_register_callbacks cb 0x7f83ec0011c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1ec6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1ec6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39264/0 (socket says 172.21.15.81:39264) 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 -- 172.21.15.81:0/2432726904 learned_addr learned my addr 172.21.15.81:0/2432726904 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83fad9d700 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e5f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1ec7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 -- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 msgr2=0x1e5f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e5f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 -- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 msgr2=0x1ec7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1ec7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 -- 172.21.15.81:0/2432726904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1bfac20 con 0x1baed20 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1ec7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83f9d9b700 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1ec6990 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f83e404fc70 tx=0x7f83e405b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a039a7ffd1ad765 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83d97fa700 1 -- 172.21.15.81:0/2432726904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40592c0 con 0x1baed20 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- 172.21.15.81:0/2432726904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83ec005440 con 0x1baed20 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83d97fa700 1 -- 172.21.15.81:0/2432726904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f83e4007430 con 0x1baed20 2023-11-29T11:16:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83d97fa700 1 -- 172.21.15.81:0/2432726904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83e40075f0 con 0x1baed20 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 10 client.6888 fetch_fsmap learned FSMap version 32 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f8403e13740 1 -- 172.21.15.81:0/2432726904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x1d33b90 con 0x1baed20 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.813+0000 7f83d97fa700 1 -- 172.21.15.81:0/2432726904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4062070 con 0x1baed20 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83d97fa700 1 -- 172.21.15.81:0/2432726904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f83e4054b00 con 0x1baed20 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 10 client.6888 fetch_fsmap finished waiting for FSMap version 32 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 10 client.6888 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 20 client.6888 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1e1cb80 0x1e1cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 4 client.6888 mds_command: new command op to 6564 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 -- 172.21.15.81:0/2432726904 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x1c2b4a0 con 0x1e1cb80 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1e1cb80 0x1e1cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fa59c700 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1e1cb80 0x1e1cf50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6e36d0cbe8df58c server_cookie=d7a57e33056e016e in_seq=0 out_seq=0 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83d97fa700 10 client.6888 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83d97fa700 1 -- 172.21.15.81:0/2432726904 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x1c2b4a0 con 0x1e1cb80 2023-11-29T11:16:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83d97fa700 10 client.6888 handle_command_reply: tid=0 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 client.6888 shutdown 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 -- 172.21.15.81:0/2432726904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 msgr2=0x1ec6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1ec6990 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f83e404fc70 tx=0x7f83e405b980 comp rx=0 tx=0).stop 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 -- 172.21.15.81:0/2432726904 shutdown_connections 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1e1cb80 0x1e1cf50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bf99d0 0x1e5f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1baed20 0x1ec6990 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83d97fa700 0 client.6888 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 --2- 172.21.15.81:0/2432726904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bae950 0x1ec7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 -- 172.21.15.81:0/2432726904 >> 172.21.15.81:0/2432726904 conn(0x1baf0f0 msgr2=0x1e75470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 -- 172.21.15.81:0/2432726904 shutdown_connections 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 1 -- 172.21.15.81:0/2432726904 wait complete. 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f8403e13740 20 client.6888 trim_cache size 0 max 16384 2023-11-29T11:16:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:50.828 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:16:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:16:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2023-11-29T11:16:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 1894183778, 2023-11-29T11:16:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627777, 2023-11-29T11:16:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/dir_test/file" 2023-11-29T11:16:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:50.828 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 -- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83dc064ee0 msgr2=0x7f83dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83dc064ee0 0x7f83dc067390 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f83f400fdd0 tx=0x7f83fc06d050 comp rx=0 tx=0).stop 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 -- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 msgr2=0x7f83f4037b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f4037b20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c550 tx=0x7f83e400c910 comp rx=0 tx=0).stop 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 -- 172.21.15.81:0/3786178543 shutdown_connections 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f83dc064ee0 0x7f83dc067390 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83f40514c0 0x7f83f40db390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f4039090 0x7f83f4037b20 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 --2- 172.21.15.81:0/3786178543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83f4036320 0x7f83f40e2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 -- 172.21.15.81:0/3786178543 >> 172.21.15.81:0/3786178543 conn(0x7f83f4057b90 msgr2=0x7f83f40538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 -- 172.21.15.81:0/3786178543 shutdown_connections 2023-11-29T11:16:50.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.817+0000 7f83fb59e700 1 -- 172.21.15.81:0/3786178543 wait complete. 2023-11-29T11:16:50.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-29T11:16:50.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.933+0000 7fbf7359e700 1 Processor -- start 2023-11-29T11:16:50.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.933+0000 7fbf7359e700 1 -- start start 2023-11-29T11:16:50.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbf7406d870 0x7fbf740b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbf7406ac70 0x7fbf740cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf740d36c0 con 0x7fbf7406a8a0 2023-11-29T11:16:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf740d2ab0 con 0x7fbf7406ac70 2023-11-29T11:16:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf740d2d90 con 0x7fbf7406d870 2023-11-29T11:16:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf72d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbf7406ac70 0x7fbf740cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbf7406a8a0 0x7fbf740b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48772/0 (socket says 172.21.15.81:48772) 2023-11-29T11:16:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7259c700 1 -- 172.21.15.81:0/3479203449 learned_addr learned my addr 172.21.15.81:0/3479203449 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf71d9b700 1 --2- 172.21.15.81:0/3479203449 >> v2:172.21.15.176:3300/0 conn(0x7fbf7406d870 0x7fbf740b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf72d9d700 1 -- 172.21.15.81:0/3479203449 >> v2:172.21.15.176:3300/0 conn(0x7fbf7406d870 msgr2=0x7fbf740b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf72d9d700 1 --2- 172.21.15.81:0/3479203449 >> v2:172.21.15.176:3300/0 conn(0x7fbf7406d870 0x7fbf740b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf72d9d700 1 -- 172.21.15.81:0/3479203449 >> v1:172.21.15.81:6789/0 conn(0x7fbf7406a8a0 legacy=0x7fbf740b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf72d9d700 1 -- 172.21.15.81:0/3479203449 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf740d3070 con 0x7fbf7406ac70 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7159a700 1 -- 172.21.15.81:0/3479203449 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731121577 0 0) 0x7fbf740d36c0 con 0x7fbf7406a8a0 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf72d9d700 1 --2- 172.21.15.81:0/3479203449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406ac70 0x7fbf740cce40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbf74072360 tx=0x7fbf6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1cced31c2c2055 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7159a700 1 -- 172.21.15.81:0/3479203449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00e070 con 0x7fbf7406ac70 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7159a700 1 -- 172.21.15.81:0/3479203449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c00bb20 con 0x7fbf7406ac70 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7159a700 1 -- 172.21.15.81:0/3479203449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c012430 con 0x7fbf7406ac70 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 -- 172.21.15.81:0/3479203449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406ac70 msgr2=0x7fbf740cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3479203449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406ac70 0x7fbf740cce40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbf74072360 tx=0x7fbf6c00b330 comp rx=0 tx=0).stop 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 -- 172.21.15.81:0/3479203449 shutdown_connections 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3479203449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406ac70 0x7fbf740cce40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3479203449 >> v2:172.21.15.176:3300/0 conn(0x7fbf7406d870 0x7fbf740b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 -- 172.21.15.81:0/3479203449 >> 172.21.15.81:0/3479203449 conn(0x7fbf740b5740 msgr2=0x7fbf740b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 -- 172.21.15.81:0/3479203449 shutdown_connections 2023-11-29T11:16:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.937+0000 7fbf7359e700 1 -- 172.21.15.81:0/3479203449 wait complete. 2023-11-29T11:16:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 Processor -- start 2023-11-29T11:16:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 -- start start 2023-11-29T11:16:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406a8a0 0x7fbf741e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf7406ac70 0x7fbf74071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf7406d870 0x7fbf741eb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf74071ec0 con 0x7fbf7406a8a0 2023-11-29T11:16:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf74071be0 con 0x7fbf7406d870 2023-11-29T11:16:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf740c7670 con 0x7fbf7406ac70 2023-11-29T11:16:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406a8a0 0x7fbf741e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406a8a0 0x7fbf741e8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39290/0 (socket says 172.21.15.81:39290) 2023-11-29T11:16:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 -- 172.21.15.81:0/3810663790 learned_addr learned my addr 172.21.15.81:0/3810663790 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf71d9b700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf7406ac70 0x7fbf74071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf72d9d700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf7406d870 0x7fbf741eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 -- 172.21.15.81:0/3810663790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf7406ac70 msgr2=0x7fbf74071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf7406ac70 0x7fbf74071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 -- 172.21.15.81:0/3810663790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf7406d870 msgr2=0x7fbf741eb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf7406d870 0x7fbf741eb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 -- 172.21.15.81:0/3810663790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c009a70 con 0x7fbf7406a8a0 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7259c700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406a8a0 0x7fbf741e8cb0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400c580 tx=0x7fbf6400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf62ffd700 1 -- 172.21.15.81:0/3810663790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64004ca0 con 0x7fbf7406a8a0 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf62ffd700 1 -- 172.21.15.81:0/3810663790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf64004e20 con 0x7fbf7406a8a0 2023-11-29T11:16:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf62ffd700 1 -- 172.21.15.81:0/3810663790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64007310 con 0x7fbf7406a8a0 2023-11-29T11:16:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf740d26d0 con 0x7fbf7406a8a0 2023-11-29T11:16:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.941+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf740d3350 con 0x7fbf7406a8a0 2023-11-29T11:16:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.945+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf740d2860 con 0x7fbf7406a8a0 2023-11-29T11:16:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.945+0000 7fbf62ffd700 1 -- 172.21.15.81:0/3810663790 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbf6401a020 con 0x7fbf7406a8a0 2023-11-29T11:16:50.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.945+0000 7fbf62ffd700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbf54064f10 0x7fbf540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:50.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.949+0000 7fbf71d9b700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbf54064f10 0x7fbf540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:50.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.949+0000 7fbf62ffd700 1 -- 172.21.15.81:0/3810663790 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fbf64081c80 con 0x7fbf7406a8a0 2023-11-29T11:16:50.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.949+0000 7fbf71d9b700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbf54064f10 0x7fbf540673c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbf740c55f0 tx=0x7fbf68009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:50.953+0000 7fbf62ffd700 1 -- 172.21.15.81:0/3810663790 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbf6404fb30 con 0x7fbf7406a8a0 2023-11-29T11:16:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.145+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbf74072c20 con 0x7fbf7406a8a0 2023-11-29T11:16:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.145+0000 7fbf62ffd700 1 -- 172.21.15.81:0/3810663790 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fbf64053150 con 0x7fbf7406a8a0 2023-11-29T11:16:51.153 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:16:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-29T11:16:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbf54064f10 msgr2=0x7fbf540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbf54064f10 0x7fbf540673c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbf740c55f0 tx=0x7fbf68009240 comp rx=0 tx=0).stop 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406a8a0 msgr2=0x7fbf741e8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406a8a0 0x7fbf741e8cb0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400c580 tx=0x7fbf6400c890 comp rx=0 tx=0).stop 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 shutdown_connections 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbf54064f10 0x7fbf540673c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf7406d870 0x7fbf741eb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf7406ac70 0x7fbf74071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 --2- 172.21.15.81:0/3810663790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7406a8a0 0x7fbf741e8cb0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 >> 172.21.15.81:0/3810663790 conn(0x7fbf740b5740 msgr2=0x7fbf740cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 shutdown_connections 2023-11-29T11:16:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.149+0000 7fbf7359e700 1 -- 172.21.15.81:0/3810663790 wait complete. 2023-11-29T11:16:51.166 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-29T11:16:51.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2023-11-29T11:16:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.269+0000 7fc4c9ce2700 1 Processor -- start 2023-11-29T11:16:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.269+0000 7fc4c9ce2700 1 -- start start 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.269+0000 7fc4c9ce2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4c406a1a0 0x7fc4c40cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.269+0000 7fc4c9ce2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406bc80 0x7fc4c40ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.269+0000 7fc4c9ce2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c406c240 con 0x7fc4c40cac80 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.269+0000 7fc4c9ce2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c406c520 con 0x7fc4c406a1a0 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.269+0000 7fc4c9ce2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c406c800 con 0x7fc4c406bc80 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c8ce0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc4c40cac80 0x7fc4c40cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48776/0 (socket says 172.21.15.81:48776) 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c8ce0700 1 -- 172.21.15.81:0/3376162816 learned_addr learned my addr 172.21.15.81:0/3376162816 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4c406a1a0 0x7fc4c40cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/3376162816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406bc80 0x7fc4c40ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c37fe700 1 -- 172.21.15.81:0/3376162816 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258956287 0 0) 0x7fc4c406c240 con 0x7fc4c40cac80 2023-11-29T11:16:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c37fe700 1 -- 172.21.15.81:0/3376162816 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b00035d0 con 0x7fc4c40cac80 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c3fff700 1 -- 172.21.15.81:0/3376162816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406bc80 msgr2=0x7fc4c40ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/3376162816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406bc80 0x7fc4c40ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c3fff700 1 -- 172.21.15.81:0/3376162816 >> v1:172.21.15.81:6789/0 conn(0x7fc4c40cac80 legacy=0x7fc4c40cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c3fff700 1 -- 172.21.15.81:0/3376162816 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c406cae0 con 0x7fc4c406a1a0 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/3376162816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c406a1a0 0x7fc4c40cc800 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009850 tx=0x7fc4ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1f8ca0b21879c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c37fe700 1 -- 172.21.15.81:0/3376162816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac011830 con 0x7fc4c406a1a0 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c37fe700 1 -- 172.21.15.81:0/3376162816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac011990 con 0x7fc4c406a1a0 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c37fe700 1 -- 172.21.15.81:0/3376162816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac011d40 con 0x7fc4c406a1a0 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/3376162816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c406a1a0 msgr2=0x7fc4c40cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/3376162816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c406a1a0 0x7fc4c40cc800 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009850 tx=0x7fc4ac009b60 comp rx=0 tx=0).stop 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/3376162816 shutdown_connections 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/3376162816 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406bc80 0x7fc4c40ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/3376162816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c406a1a0 0x7fc4c40cc800 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/3376162816 >> 172.21.15.81:0/3376162816 conn(0x7fc4c40ce400 msgr2=0x7fc4c40ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/3376162816 shutdown_connections 2023-11-29T11:16:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.273+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/3376162816 wait complete. 2023-11-29T11:16:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c9ce2700 1 Processor -- start 2023-11-29T11:16:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c9ce2700 1 -- start start 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c9ce2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406a1a0 0x7fc4c41f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c9ce2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4c406bc80 0x7fc4c40707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c9ce2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c40cac80 0x7fc4c4070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c9ce2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c4072010 con 0x7fc4c40cac80 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c9ce2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c4071400 con 0x7fc4c406bc80 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c9ce2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40716e0 con 0x7fc4c406a1a0 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c94e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c40cac80 0x7fc4c4070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c94e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c40cac80 0x7fc4c4070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39308/0 (socket says 172.21.15.81:39308) 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c94e1700 1 -- 172.21.15.81:0/1692423649 learned_addr learned my addr 172.21.15.81:0/1692423649 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406a1a0 0x7fc4c41f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.277+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4c406bc80 0x7fc4c40707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c94e1700 1 -- 172.21.15.81:0/1692423649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406a1a0 msgr2=0x7fc4c41f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406a1a0 0x7fc4c41f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c94e1700 1 -- 172.21.15.81:0/1692423649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4c406bc80 msgr2=0x7fc4c40707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4c406bc80 0x7fc4c40707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c94e1700 1 -- 172.21.15.81:0/1692423649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0094b0 con 0x7fc4c40cac80 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c40cac80 0x7fc4c4070cf0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400eb60 tx=0x7fc4b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c17fa700 1 -- 172.21.15.81:0/1692423649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4009740 con 0x7fc4c40cac80 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c17fa700 1 -- 172.21.15.81:0/1692423649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4009e00 con 0x7fc4c40cac80 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/1692423649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c415c490 con 0x7fc4c40cac80 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c17fa700 1 -- 172.21.15.81:0/1692423649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400ca70 con 0x7fc4c40cac80 2023-11-29T11:16:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/1692423649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c406cdc0 con 0x7fc4c40cac80 2023-11-29T11:16:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.281+0000 7fc4c17fa700 1 -- 172.21.15.81:0/1692423649 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc4b4019030 con 0x7fc4c40cac80 2023-11-29T11:16:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c17fa700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc4a4064f10 0x7fc4a40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c17fa700 1 -- 172.21.15.81:0/1692423649 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc4b4081eb0 con 0x7fc4c40cac80 2023-11-29T11:16:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc4a4064f10 0x7fc4a40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 Processor -- start 2023-11-29T11:16:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- start start 2023-11-29T11:16:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc4a4064f10 0x7fc4a40673c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc001560 tx=0x7fc4bc0019f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b07410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 0x2b07950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x289bb30 0x2abd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29bfd90 con 0x2850e80 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a2fe80 con 0x289bb30 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a29180 con 0x2850ab0 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b07410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b07410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39314/0 (socket says 172.21.15.81:39314) 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 -- 172.21.15.81:0/3257243815 learned_addr learned my addr 172.21.15.81:0/3257243815 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 0x2b07950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x289bb30 0x2abd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 -- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 msgr2=0x2b07950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 0x2b07950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 -- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x289bb30 msgr2=0x2abd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x289bb30 0x2abd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 -- 172.21.15.81:0/3257243815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a4eb10 con 0x2850e80 2023-11-29T11:16:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x289bb30 0x2abd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b07410 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0079a0 tx=0x7fc4bc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebd59a7e79d95ce server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ba7fc700 1 -- 172.21.15.81:0/3257243815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0148e0 con 0x2850e80 2023-11-29T11:16:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ba7fc700 1 -- 172.21.15.81:0/3257243815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc014a40 con 0x2850e80 2023-11-29T11:16:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ba7fc700 1 -- 172.21.15.81:0/3257243815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc014dd0 con 0x2850e80 2023-11-29T11:16:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3257243815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 msgr2=0x2b07410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b07410 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0079a0 tx=0x7fc4bc012000 comp rx=0 tx=0).stop 2023-11-29T11:16:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3257243815 shutdown_connections 2023-11-29T11:16:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x289bb30 0x2abd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 0x2b07950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/3257243815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b07410 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3257243815 >> 172.21.15.81:0/3257243815 conn(0x2851250 msgr2=0x2ae9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3257243815 shutdown_connections 2023-11-29T11:16:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.285+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3257243815 wait complete. 2023-11-29T11:16:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 -- start start 2023-11-29T11:16:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 Processor -- start 2023-11-29T11:16:51.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 0x2abd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850e80 0x2ae2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d5ec0 con 0x289bb30 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ae2510 con 0x2850e80 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ae3610 con 0x2850ab0 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 10 client.0 _ll_register_callbacks cb 0x2a79820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39318/0 (socket says 172.21.15.81:39318) 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 -- 172.21.15.81:0/2504082207 learned_addr learned my addr 172.21.15.81:0/2504082207 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 0x2abd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850e80 0x2ae2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 -- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 msgr2=0x2abd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 0x2abd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 -- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850e80 msgr2=0x2ae2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850e80 0x2ae2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 -- 172.21.15.81:0/2504082207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b00035d0 con 0x289bb30 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850e80 0x2ae2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae30d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4053810 tx=0x7fc4b4053130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66be196a79f689eb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4a37fe700 1 -- 172.21.15.81:0/2504082207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4054ea0 con 0x289bb30 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4a37fe700 1 -- 172.21.15.81:0/2504082207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc4b404fb00 con 0x289bb30 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/2504082207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a22200 con 0x289bb30 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4a37fe700 1 -- 172.21.15.81:0/2504082207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4b404fcc0 con 0x289bb30 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 10 client.6912 fetch_fsmap learned FSMap version 32 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/2504082207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x289cd80 con 0x289bb30 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.289+0000 7fc4a37fe700 1 -- 172.21.15.81:0/2504082207 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a22200 con 0x289bb30 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4a37fe700 1 -- 172.21.15.81:0/2504082207 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc4b4052a70 con 0x289bb30 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 10 client.6912 fetch_fsmap finished waiting for FSMap version 32 2023-11-29T11:16:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 10 client.6912 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 20 client.6912 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x2abdbd0 0x2b11180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 4 client.6912 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/2504082207 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a21f20 con 0x2abdbd0 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x2abdbd0 0x2b11180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4a37fe700 10 client.6912 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x2abdbd0 0x2b11180 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1dea14c56e88fd9 server_cookie=990f2ded02e5f60d in_seq=0 out_seq=0 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4a37fe700 1 -- 172.21.15.81:0/2504082207 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2a21f20 con 0x2abdbd0 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4a37fe700 10 client.6912 handle_command_reply: tid=0 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 client.6912 shutdown 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/2504082207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 msgr2=0x2ae30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae30d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4053810 tx=0x7fc4b4053130 comp rx=0 tx=0).stop 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/2504082207 shutdown_connections 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x2abdbd0 0x2b11180 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae30d0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4a37fe700 0 client.6912 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850e80 0x2ae2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/2504082207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850ab0 0x2abd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/2504082207 >> 172.21.15.81:0/2504082207 conn(0x2851250 msgr2=0x2ae7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/2504082207 shutdown_connections 2023-11-29T11:16:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/2504082207 wait complete. 2023-11-29T11:16:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.293+0000 7fc4ce1c4740 20 client.6912 trim_cache size 0 max 16384 2023-11-29T11:16:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4ce1c4740 1 Processor -- start 2023-11-29T11:16:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4ce1c4740 1 -- start start 2023-11-29T11:16:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2abc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850e80 0x2abc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a28010 con 0x289bb30 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x29ce870 con 0x2850ab0 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x29e0380 con 0x2850e80 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39330/0 (socket says 172.21.15.81:39330) 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 -- 172.21.15.81:0/3197614013 learned_addr learned my addr 172.21.15.81:0/3197614013 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850e80 0x2abc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2abc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 -- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850e80 msgr2=0x2abc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850e80 0x2abc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 -- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 msgr2=0x2abc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2abc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 -- 172.21.15.81:0/3197614013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40ac040 con 0x289bb30 2023-11-29T11:16:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850e80 0x2abc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2abc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae5760 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc4b405b670 tx=0x7fc4b4059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4137c53b640d7d8c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4baffd700 1 -- 172.21.15.81:0/3197614013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4054ea0 con 0x289bb30 2023-11-29T11:16:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4baffd700 1 -- 172.21.15.81:0/3197614013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4052df0 con 0x289bb30 2023-11-29T11:16:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.313+0000 7fc4baffd700 1 -- 172.21.15.81:0/3197614013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400e070 con 0x289bb30 2023-11-29T11:16:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3197614013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 msgr2=0x2ae5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae5760 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc4b405b670 tx=0x7fc4b4059000 comp rx=0 tx=0).stop 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3197614013 shutdown_connections 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x289bb30 0x2ae5760 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2850e80 0x2abc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/3197614013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2abc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3197614013 >> 172.21.15.81:0/3197614013 conn(0x2851250 msgr2=0x2ae2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3197614013 shutdown_connections 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/3197614013 wait complete. 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- start start 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 Processor -- start 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2b66210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b03600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x289bb30 0x2b03b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29f7c10 con 0x2850e80 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b02da0 con 0x2850ab0 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b66750 con 0x289bb30 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 10 client.0 _ll_register_callbacks cb 0x29f3ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b03600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b03600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39338/0 (socket says 172.21.15.81:39338) 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 -- 172.21.15.81:0/556157281 learned_addr learned my addr 172.21.15.81:0/556157281 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2b66210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c94e1700 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x289bb30 0x2b03b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 -- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x289bb30 msgr2=0x2b03b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x289bb30 0x2b03b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 -- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 msgr2=0x2b66210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2b66210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 -- 172.21.15.81:0/556157281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x289cd80 con 0x2850e80 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2b66210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4c3fff700 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b03600 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc4c406f5d0 tx=0x7fc4ac0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad1e459e889e36e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4a37fe700 1 -- 172.21.15.81:0/556157281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac004450 con 0x2850e80 2023-11-29T11:16:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/556157281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4bc014a40 con 0x2850e80 2023-11-29T11:16:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4a37fe700 1 -- 172.21.15.81:0/556157281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc4ac020040 con 0x2850e80 2023-11-29T11:16:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4a37fe700 1 -- 172.21.15.81:0/556157281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4ac0045b0 con 0x2850e80 2023-11-29T11:16:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 10 client.6918 fetch_fsmap learned FSMap version 32 2023-11-29T11:16:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/556157281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x29d5c30 con 0x2850e80 2023-11-29T11:16:51.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4a37fe700 1 -- 172.21.15.81:0/556157281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc014a40 con 0x2850e80 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4a37fe700 1 -- 172.21.15.81:0/556157281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc4ac030430 con 0x2850e80 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 10 client.6918 fetch_fsmap finished waiting for FSMap version 32 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 10 client.6918 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 20 client.6918 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x2ac1a30 0x2b01ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 4 client.6918 mds_command: new command op to 6564 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.317+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/556157281 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) v1 -- 0x28cd600 con 0x2ac1a30 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x2ac1a30 0x2b01ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4a37fe700 10 client.6918 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4c8ce0700 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x2ac1a30 0x2b01ac0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1edc14cf8a80124 server_cookie=2b4e0bb3f48d2dc0 in_seq=0 out_seq=0 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4a37fe700 1 -- 172.21.15.81:0/556157281 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x28cd600 con 0x2ac1a30 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4a37fe700 10 client.6918 handle_command_reply: tid=0 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 client.6918 shutdown 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/556157281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 msgr2=0x2b03600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b03600 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc4c406f5d0 tx=0x7fc4ac0047e0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/556157281 shutdown_connections 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x2ac1a30 0x2b01ac0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x289bb30 0x2b03b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2850e80 0x2b03600 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 --2- 172.21.15.81:0/556157281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2850ab0 0x2b66210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/556157281 >> 172.21.15.81:0/556157281 conn(0x2851250 msgr2=0x2ae28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4a37fe700 0 client.6918 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/556157281 shutdown_connections 2023-11-29T11:16:51.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 1 -- 172.21.15.81:0/556157281 wait complete. 2023-11-29T11:16:51.330 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:16:51.321+0000 7f9bbfc99700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2023-11-29T11:16:18.789800+0000 1=1+0) (iversion lock) caps={6774=pAsLsXsFs/-@2},l=6774(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x556f558cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-29T11:16:51.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.321+0000 7fc4ce1c4740 20 client.6918 trim_cache size 0 max 16384 2023-11-29T11:16:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:51.331 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:16:51.331 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "1ff67fdc-7375-4220-9490-a831c5c3246e", 2023-11-29T11:16:51.331 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:16:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc4a4064f10 msgr2=0x7fc4a40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc4a4064f10 0x7fc4a40673c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc001560 tx=0x7fc4bc0019f0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c40cac80 msgr2=0x7fc4c4070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c40cac80 0x7fc4c4070cf0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400eb60 tx=0x7fc4b400ee70 comp rx=0 tx=0).stop 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/1692423649 shutdown_connections 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc4a4064f10 0x7fc4a40673c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c40cac80 0x7fc4c4070cf0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4c406bc80 0x7fc4c40707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 --2- 172.21.15.81:0/1692423649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4c406a1a0 0x7fc4c41f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/1692423649 >> 172.21.15.81:0/1692423649 conn(0x7fc4c40ce400 msgr2=0x7fc4c40ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/1692423649 shutdown_connections 2023-11-29T11:16:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.325+0000 7fc4c9ce2700 1 -- 172.21.15.81:0/1692423649 wait complete. 2023-11-29T11:16:51.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-29T11:16:51.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.453+0000 7f01e6efb700 1 Processor -- start 2023-11-29T11:16:51.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.453+0000 7f01e6efb700 1 -- start start 2023-11-29T11:16:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e009bdb0 0x7f01e015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e00b2db0 con 0x7f01e00cbb30 2023-11-29T11:16:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e00b3240 con 0x7f01e00b00e0 2023-11-29T11:16:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e006d840 con 0x7f01e009bdb0 2023-11-29T11:16:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e66fa700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f01e00cbb30 0x7f01e006bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48780/0 (socket says 172.21.15.81:48780) 2023-11-29T11:16:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e66fa700 1 -- 172.21.15.81:0/283720884 learned_addr learned my addr 172.21.15.81:0/283720884 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:16:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e56f8700 1 --2- 172.21.15.81:0/283720884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e009bdb0 0x7f01e015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e4ef7700 1 -- 172.21.15.81:0/283720884 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453141851 0 0) 0x7f01e00b2db0 con 0x7f01e00cbb30 2023-11-29T11:16:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e4ef7700 1 -- 172.21.15.81:0/283720884 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01cc0035d0 con 0x7f01e00cbb30 2023-11-29T11:16:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e4ef7700 1 -- 172.21.15.81:0/283720884 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062774738 0 0) 0x7f01e00b3240 con 0x7f01e00b00e0 2023-11-29T11:16:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e4ef7700 1 -- 172.21.15.81:0/283720884 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e00b2db0 con 0x7f01e00b00e0 2023-11-29T11:16:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e56f8700 1 -- 172.21.15.81:0/283720884 >> v1:172.21.15.176:6789/0 conn(0x7f01e00b00e0 legacy=0x7f01e015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e56f8700 1 -- 172.21.15.81:0/283720884 >> v1:172.21.15.81:6789/0 conn(0x7f01e00cbb30 legacy=0x7f01e006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e56f8700 1 -- 172.21.15.81:0/283720884 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e006d560 con 0x7f01e009bdb0 2023-11-29T11:16:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e56f8700 1 --2- 172.21.15.81:0/283720884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e009bdb0 0x7f01e015d9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009880 tx=0x7f01d0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=273c3f7aabe6b474 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e4ef7700 1 -- 172.21.15.81:0/283720884 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0011830 con 0x7f01e009bdb0 2023-11-29T11:16:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e4ef7700 1 -- 172.21.15.81:0/283720884 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d0011990 con 0x7f01e009bdb0 2023-11-29T11:16:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e4ef7700 1 -- 172.21.15.81:0/283720884 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0011d00 con 0x7f01e009bdb0 2023-11-29T11:16:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 -- 172.21.15.81:0/283720884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e009bdb0 msgr2=0x7f01e015d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 --2- 172.21.15.81:0/283720884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e009bdb0 0x7f01e015d9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009880 tx=0x7f01d0009b90 comp rx=0 tx=0).stop 2023-11-29T11:16:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 -- 172.21.15.81:0/283720884 shutdown_connections 2023-11-29T11:16:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 --2- 172.21.15.81:0/283720884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e009bdb0 0x7f01e015d9f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 -- 172.21.15.81:0/283720884 >> 172.21.15.81:0/283720884 conn(0x7f01e00cae70 msgr2=0x7f01e00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 -- 172.21.15.81:0/283720884 shutdown_connections 2023-11-29T11:16:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.457+0000 7f01e6efb700 1 -- 172.21.15.81:0/283720884 wait complete. 2023-11-29T11:16:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 Processor -- start 2023-11-29T11:16:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 -- start start 2023-11-29T11:16:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e009bdb0 0x7f01e00c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e00b00e0 0x7f01e00c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e00cbb30 0x7f01e009adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00c5270 con 0x7f01e009bdb0 2023-11-29T11:16:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e0099190 con 0x7f01e00cbb30 2023-11-29T11:16:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e01481b0 con 0x7f01e00b00e0 2023-11-29T11:16:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e009bdb0 0x7f01e00c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e009bdb0 0x7f01e00c1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39348/0 (socket says 172.21.15.81:39348) 2023-11-29T11:16:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 -- 172.21.15.81:0/1072204336 learned_addr learned my addr 172.21.15.81:0/1072204336 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e66fa700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e00cbb30 0x7f01e009adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e56f8700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e00b00e0 0x7f01e00c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 -- 172.21.15.81:0/1072204336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e00b00e0 msgr2=0x7f01e00c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e00b00e0 0x7f01e00c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 -- 172.21.15.81:0/1072204336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e00cbb30 msgr2=0x7f01e009adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e00cbb30 0x7f01e009adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 -- 172.21.15.81:0/1072204336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d00094b0 con 0x7f01e009bdb0 2023-11-29T11:16:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e009bdb0 0x7f01e00c1f20 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c550 tx=0x7f01dc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01d67fc700 1 -- 172.21.15.81:0/1072204336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0052d0 con 0x7f01e009bdb0 2023-11-29T11:16:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01d67fc700 1 -- 172.21.15.81:0/1072204336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc005450 con 0x7f01e009bdb0 2023-11-29T11:16:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 -- 172.21.15.81:0/1072204336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e00ac3d0 con 0x7f01e009bdb0 2023-11-29T11:16:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01d67fc700 1 -- 172.21.15.81:0/1072204336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0038e0 con 0x7f01e009bdb0 2023-11-29T11:16:51.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.461+0000 7f01e6efb700 1 -- 172.21.15.81:0/1072204336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e00ac0f0 con 0x7f01e009bdb0 2023-11-29T11:16:51.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.465+0000 7f01d67fc700 1 -- 172.21.15.81:0/1072204336 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f01dc019030 con 0x7f01e009bdb0 2023-11-29T11:16:51.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.465+0000 7f01d67fc700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f01c4064f10 0x7f01c40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.465+0000 7f01d67fc700 1 -- 172.21.15.81:0/1072204336 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f01dc0813d0 con 0x7f01e009bdb0 2023-11-29T11:16:51.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.465+0000 7f01e56f8700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f01c4064f10 0x7f01c40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.465+0000 7f01e56f8700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f01c4064f10 0x7f01c40673c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f01e009c1a0 tx=0x7f01d0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 Processor -- start 2023-11-29T11:16:51.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- start start 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f773b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f78ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x1f79430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e74d20 con 0x1d05840 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ee4d60 con 0x1d508c0 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ede060 con 0x1d05c10 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f78ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f78ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39356/0 (socket says 172.21.15.81:39356) 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 -- 172.21.15.81:0/1437149538 learned_addr learned my addr 172.21.15.81:0/1437149538 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e66fa700 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x1f79430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 -- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 msgr2=0x1f773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f773b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 -- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 msgr2=0x1f79430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x1f79430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 -- 172.21.15.81:0/1437149538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f040a0 con 0x1d05840 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f773b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e66fa700 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x1f79430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01e56f8700 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f78ef0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009bd0 tx=0x7f01d0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4dcf4fb397620e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01c37fe700 1 -- 172.21.15.81:0/1437149538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0011830 con 0x1d05840 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01c37fe700 1 -- 172.21.15.81:0/1437149538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d002c070 con 0x1d05840 2023-11-29T11:16:51.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01c37fe700 1 -- 172.21.15.81:0/1437149538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0003ac0 con 0x1d05840 2023-11-29T11:16:51.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- 172.21.15.81:0/1437149538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 msgr2=0x1f78ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f78ef0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009bd0 tx=0x7f01d0009f90 comp rx=0 tx=0).stop 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- 172.21.15.81:0/1437149538 shutdown_connections 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x1f79430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f78ef0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/1437149538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f773b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- 172.21.15.81:0/1437149538 >> 172.21.15.81:0/1437149538 conn(0x1d05fe0 msgr2=0x1f9ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- 172.21.15.81:0/1437149538 shutdown_connections 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.469+0000 7f01eb3dd740 1 -- 172.21.15.81:0/1437149538 wait complete. 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 -- start start 2023-11-29T11:16:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 Processor -- start 2023-11-29T11:16:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1fa3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05c10 0x1fa3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d508c0 0x1f9ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d8ac50 con 0x1d05c10 2023-11-29T11:16:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa1af0 con 0x1d05840 2023-11-29T11:16:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fa1d90 con 0x1d508c0 2023-11-29T11:16:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 10 client.0 _ll_register_callbacks cb 0x1ed79a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05c10 0x1fa3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05c10 0x1fa3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39360/0 (socket says 172.21.15.81:39360) 2023-11-29T11:16:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 -- 172.21.15.81:0/2511055249 learned_addr learned my addr 172.21.15.81:0/2511055249 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e66fa700 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d508c0 0x1f9ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1fa3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 -- 172.21.15.81:0/2511055249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d508c0 msgr2=0x1f9ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d508c0 0x1f9ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 -- 172.21.15.81:0/2511055249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 msgr2=0x1fa3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1fa3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 -- 172.21.15.81:0/2511055249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0022070 con 0x1d05c10 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01e56f8700 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05c10 0x1fa3ca0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f01d00090b0 tx=0x7f01d00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544d6470f8c638bc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2511055249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0003950 con 0x1d05c10 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2511055249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f01d0003ab0 con 0x1d05c10 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2511055249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ed70e0 con 0x1d05c10 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2511055249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01d0003c70 con 0x1d05c10 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.473+0000 7f01eb3dd740 10 client.6930 fetch_fsmap learned FSMap version 32 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2511055249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x1d51b10 con 0x1d05c10 2023-11-29T11:16:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2511055249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ed70e0 con 0x1d05c10 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2511055249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f01d003a480 con 0x1d05c10 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 10 client.6930 fetch_fsmap finished waiting for FSMap version 32 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 10 client.6930 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 20 client.6930 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1fc0830 0x1fa09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 4 client.6930 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2511055249 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ed6e00 con 0x1fc0830 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1fc0830 0x1fa09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01c0ff9700 10 client.6930 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1fc0830 0x1fa09f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e19faa67ec70ec0 server_cookie=44213541afdb35ea in_seq=0 out_seq=0 2023-11-29T11:16:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2511055249 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1ed6e00 con 0x1fc0830 2023-11-29T11:16:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01c0ff9700 10 client.6930 handle_command_reply: tid=0 2023-11-29T11:16:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 client.6930 shutdown 2023-11-29T11:16:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2511055249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05c10 msgr2=0x1fa3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05c10 0x1fa3ca0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f01d00090b0 tx=0x7f01d00047e0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2511055249 shutdown_connections 2023-11-29T11:16:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1fc0830 0x1fa09f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d508c0 0x1f9ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05c10 0x1fa3ca0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01c0ff9700 0 client.6930 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2511055249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1fa3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2511055249 >> 172.21.15.81:0/2511055249 conn(0x1d05fe0 msgr2=0x1f9ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2511055249 shutdown_connections 2023-11-29T11:16:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2511055249 wait complete. 2023-11-29T11:16:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.477+0000 7f01eb3dd740 20 client.6930 trim_cache size 0 max 16384 2023-11-29T11:16:51.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01eb3dd740 1 Processor -- start 2023-11-29T11:16:51.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01eb3dd740 1 -- start start 2023-11-29T11:16:51.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1f9bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f9c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d508c0 0x1f98ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea3440 con 0x1d508c0 2023-11-29T11:16:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e7d510 con 0x1d05840 2023-11-29T11:16:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ee5ff0 con 0x1d05c10 2023-11-29T11:16:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01e66fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d508c0 0x1f98ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01e66fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d508c0 0x1f98ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39362/0 (socket says 172.21.15.81:39362) 2023-11-29T11:16:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.497+0000 7f01e66fa700 1 -- 172.21.15.81:0/2445161588 learned_addr learned my addr 172.21.15.81:0/2445161588 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e56f8700 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f9c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1f9bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e66fa700 1 -- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 msgr2=0x1f9c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e66fa700 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f9c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e66fa700 1 -- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 msgr2=0x1f9bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e66fa700 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1f9bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e66fa700 1 -- 172.21.15.81:0/2445161588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e00c4760 con 0x1d508c0 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e56f8700 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f9c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1f9bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01e66fa700 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d508c0 0x1f98ff0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f01d8007040 tx=0x7f01d8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51952cffeb275c48 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01c3fff700 1 -- 172.21.15.81:0/2445161588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80076b0 con 0x1d508c0 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01c3fff700 1 -- 172.21.15.81:0/2445161588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d8007810 con 0x1d508c0 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01c3fff700 1 -- 172.21.15.81:0/2445161588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8007bc0 con 0x1d508c0 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2445161588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d508c0 msgr2=0x1f98ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d508c0 0x1f98ff0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f01d8007040 tx=0x7f01d8001970 comp rx=0 tx=0).stop 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2445161588 shutdown_connections 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d508c0 0x1f98ff0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x1f9c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2445161588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d05840 0x1f9bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2445161588 >> 172.21.15.81:0/2445161588 conn(0x1d05fe0 msgr2=0x1f71510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2445161588 shutdown_connections 2023-11-29T11:16:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2445161588 wait complete. 2023-11-29T11:16:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 -- start start 2023-11-29T11:16:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.501+0000 7f01eb3dd740 1 Processor -- start 2023-11-29T11:16:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f9c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x201ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x201d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd9d00 con 0x1d05840 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd8870 con 0x1d508c0 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fd9520 con 0x1d05c10 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f9c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 10 client.0 _ll_register_callbacks cb 0x7f01d0011d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f9c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39372/0 (socket says 172.21.15.81:39372) 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 -- 172.21.15.81:0/2735044080 learned_addr learned my addr 172.21.15.81:0/2735044080 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e56f8700 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x201ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e66fa700 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x201d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 -- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 msgr2=0x201ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x201ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 -- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 msgr2=0x201d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x201d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 -- 172.21.15.81:0/2735044080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d800f040 con 0x1d05840 2023-11-29T11:16:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e66fa700 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x201d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:16:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e5ef9700 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f9c0b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f01dc052ef0 tx=0x7f01dc058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d0987be255fc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:16:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:16:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2735044080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc05adc0 con 0x1d05840 2023-11-29T11:16:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2735044080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f01dc04ed50 con 0x1d05840 2023-11-29T11:16:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2735044080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01d002c070 con 0x1d05840 2023-11-29T11:16:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2735044080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01dc06a2d0 con 0x1d05840 2023-11-29T11:16:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 10 client.6936 fetch_fsmap learned FSMap version 32 2023-11-29T11:16:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2735044080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x1e8aaf0 con 0x1d05840 2023-11-29T11:16:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2735044080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d002c070 con 0x1d05840 2023-11-29T11:16:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2735044080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f01dc04ef10 con 0x1d05840 2023-11-29T11:16:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 10 client.6936 fetch_fsmap finished waiting for FSMap version 32 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 10 client.6936 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 20 client.6936 populate_metadata read hostname 'smithi081' 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1fd7400 0x1fd7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 4 client.6936 mds_command: new command op to 6564 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2735044080 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1d82390 con 0x1fd7400 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.505+0000 7f01e56f8700 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1fd7400 0x1fd7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e56f8700 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1fd7400 0x1fd7800 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62ff6d4b52c4a678 server_cookie=e6aaab9d832af2c5 in_seq=0 out_seq=0 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01c0ff9700 10 client.6936 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01c0ff9700 1 -- 172.21.15.81:0/2735044080 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x1d82390 con 0x1fd7400 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01c0ff9700 10 client.6936 handle_command_reply: tid=0 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 client.6936 shutdown 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2735044080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 msgr2=0x1f9c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f9c0b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f01dc052ef0 tx=0x7f01dc058040 comp rx=0 tx=0).stop 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2735044080 shutdown_connections 2023-11-29T11:16:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1fd7400 0x1fd7800 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1d508c0 0x201d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01c0ff9700 0 client.6936 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1d05c10 0x201ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 --2- 172.21.15.81:0/2735044080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1d05840 0x1f9c0b0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2735044080 >> 172.21.15.81:0/2735044080 conn(0x1d05fe0 msgr2=0x1f771c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2735044080 shutdown_connections 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 1 -- 172.21.15.81:0/2735044080 wait complete. 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01eb3dd740 20 client.6936 trim_cache size 0 max 16384 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:16:51.517 INFO:teuthology.orchestra.run.smithi081.stdout: "1ff67fdc-7375-4220-9490-a831c5c3246e": { 2023-11-29T11:16:51.518 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2023-11-29T11:16:51.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "1ff67fdc-7375-4220-9490-a831c5c3246e", 2023-11-29T11:16:51.518 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,repair,force" 2023-11-29T11:16:51.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:51.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:16:51.518 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 -- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f01c4064f10 msgr2=0x7f01c40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f01c4064f10 0x7f01c40673c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f01e009c1a0 tx=0x7f01d0010000 comp rx=0 tx=0).stop 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 -- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e009bdb0 msgr2=0x7f01e00c1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e009bdb0 0x7f01e00c1f20 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c550 tx=0x7f01dc00c860 comp rx=0 tx=0).stop 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 -- 172.21.15.81:0/1072204336 shutdown_connections 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f01c4064f10 0x7f01c40673c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01e00cbb30 0x7f01e009adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01e00b00e0 0x7f01e00c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 --2- 172.21.15.81:0/1072204336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e009bdb0 0x7f01e00c1f20 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:16:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 -- 172.21.15.81:0/1072204336 >> 172.21.15.81:0/1072204336 conn(0x7f01e00cae70 msgr2=0x7f01e006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:16:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 -- 172.21.15.81:0/1072204336 shutdown_connections 2023-11-29T11:16:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:16:51.509+0000 7f01e6efb700 1 -- 172.21.15.81:0/1072204336 wait complete. 2023-11-29T11:16:51.530 INFO:tasks.cephfs.filesystem:scrub status for tag:1ff67fdc-7375-4220-9490-a831c5c3246e - {'path': '/', 'tag': '1ff67fdc-7375-4220-9490-a831c5c3246e', 'options': 'recursive,repair,force'} 2023-11-29T11:16:56.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:16:56.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:17:21.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-29T11:17:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.648+0000 7fb85d5f5700 1 Processor -- start 2023-11-29T11:17:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.648+0000 7fb85d5f5700 1 -- start start 2023-11-29T11:17:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb85d5f5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb85815c350 0x7fb8580b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb85d5f5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb8580b2a90 0x7fb8580cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb85d5f5700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8580cff00 con 0x7fb8580ce4f0 2023-11-29T11:17:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb85d5f5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580d06f0 con 0x7fb85815c350 2023-11-29T11:17:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb85d5f5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580d0130 con 0x7fb8580b2a90 2023-11-29T11:17:21.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb856ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb85815c350 0x7fb8580b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb856ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb85815c350 0x7fb8580b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51506/0 (socket says 172.21.15.81:51506) 2023-11-29T11:17:21.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb856ffd700 1 -- 172.21.15.81:0/4252656421 learned_addr learned my addr 172.21.15.81:0/4252656421 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:21.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb8577fe700 1 --2- 172.21.15.81:0/4252656421 >> v2:172.21.15.176:3300/0 conn(0x7fb8580b2a90 0x7fb8580cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb856ffd700 1 -- 172.21.15.81:0/4252656421 >> v2:172.21.15.176:3300/0 conn(0x7fb8580b2a90 msgr2=0x7fb8580cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb856ffd700 1 --2- 172.21.15.81:0/4252656421 >> v2:172.21.15.176:3300/0 conn(0x7fb8580b2a90 0x7fb8580cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb856ffd700 1 -- 172.21.15.81:0/4252656421 >> v1:172.21.15.176:6789/0 conn(0x7fb8580ce4f0 legacy=0x7fb8580b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb856ffd700 1 -- 172.21.15.81:0/4252656421 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580d0410 con 0x7fb85815c350 2023-11-29T11:17:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb856ffd700 1 --2- 172.21.15.81:0/4252656421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85815c350 0x7fb8580b0c20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb858071bf0 tx=0x7fb848009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b113d8e657c7694 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb8567fc700 1 -- 172.21.15.81:0/4252656421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011830 con 0x7fb85815c350 2023-11-29T11:17:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb8567fc700 1 -- 172.21.15.81:0/4252656421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848011990 con 0x7fb85815c350 2023-11-29T11:17:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.652+0000 7fb8567fc700 1 -- 172.21.15.81:0/4252656421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011d20 con 0x7fb85815c350 2023-11-29T11:17:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- 172.21.15.81:0/4252656421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85815c350 msgr2=0x7fb8580b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/4252656421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85815c350 0x7fb8580b0c20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb858071bf0 tx=0x7fb848009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- 172.21.15.81:0/4252656421 shutdown_connections 2023-11-29T11:17:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/4252656421 >> v2:172.21.15.176:3300/0 conn(0x7fb8580b2a90 0x7fb8580cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/4252656421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85815c350 0x7fb8580b0c20 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- 172.21.15.81:0/4252656421 >> 172.21.15.81:0/4252656421 conn(0x7fb8580cd330 msgr2=0x7fb8580cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- 172.21.15.81:0/4252656421 shutdown_connections 2023-11-29T11:17:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- 172.21.15.81:0/4252656421 wait complete. 2023-11-29T11:17:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 Processor -- start 2023-11-29T11:17:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- start start 2023-11-29T11:17:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8580b2a90 0x7fb8580b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580ce4f0 0x7fb85806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb85815c350 0x7fb8581519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580b3860 con 0x7fb8580ce4f0 2023-11-29T11:17:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580b3b40 con 0x7fb85815c350 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb85d5f5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580b3e20 con 0x7fb8580b2a90 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580ce4f0 0x7fb85806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580ce4f0 0x7fb85806c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51512/0 (socket says 172.21.15.81:51512) 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1473358489 learned_addr learned my addr 172.21.15.81:0/1473358489 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb856ffd700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8580b2a90 0x7fb8580b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb8577fe700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb85815c350 0x7fb8581519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1473358489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8580b2a90 msgr2=0x7fb8580b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8580b2a90 0x7fb8580b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1473358489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb85815c350 msgr2=0x7fb8581519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb85815c350 0x7fb8581519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1473358489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009570 con 0x7fb8580ce4f0 2023-11-29T11:17:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.656+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580ce4f0 0x7fb85806c8a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb84000c4d0 tx=0x7fb84000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.660+0000 7fb84ffff700 1 -- 172.21.15.81:0/1473358489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400052d0 con 0x7fb8580ce4f0 2023-11-29T11:17:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.660+0000 7fb84ffff700 1 -- 172.21.15.81:0/1473358489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840005430 con 0x7fb8580ce4f0 2023-11-29T11:17:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.660+0000 7fb85d5f5700 1 -- 172.21.15.81:0/1473358489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8580cb360 con 0x7fb8580ce4f0 2023-11-29T11:17:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.660+0000 7fb84ffff700 1 -- 172.21.15.81:0/1473358489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400055a0 con 0x7fb8580ce4f0 2023-11-29T11:17:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.660+0000 7fb85d5f5700 1 -- 172.21.15.81:0/1473358489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8580cb080 con 0x7fb8580ce4f0 2023-11-29T11:17:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.660+0000 7fb84ffff700 1 -- 172.21.15.81:0/1473358489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb840019030 con 0x7fb8580ce4f0 2023-11-29T11:17:21.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84ffff700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb838064f10 0x7fb8380673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb856ffd700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb838064f10 0x7fb8380673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84ffff700 1 -- 172.21.15.81:0/1473358489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb8400812e0 con 0x7fb8580ce4f0 2023-11-29T11:17:21.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb856ffd700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb838064f10 0x7fb8380673c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb848000c00 tx=0x7fb848008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb860875740 1 Processor -- start 2023-11-29T11:17:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb860875740 1 -- start start 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb860875740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 0x1544b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb860875740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb860875740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x15412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb860875740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x13fcd20 con 0x128d840 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb860875740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x146cd60 con 0x128dc10 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb860875740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1466060 con 0x12d88c0 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51524/0 (socket says 172.21.15.81:51524) 2023-11-29T11:17:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1616228338 learned_addr learned my addr 172.21.15.81:0/1616228338 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb856ffd700 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 0x1544b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb8577fe700 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x15412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 msgr2=0x15412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x15412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 msgr2=0x1544b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 0x1544b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1616228338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x148c0a0 con 0x128d840 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb8577fe700 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x15412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.664+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15450a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb840052970 tx=0x7fb8400529a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72f163a6c001baf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb84cff9700 1 -- 172.21.15.81:0/1616228338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840056ea0 con 0x128d840 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb84cff9700 1 -- 172.21.15.81:0/1616228338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400512e0 con 0x128d840 2023-11-29T11:17:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb84cff9700 1 -- 172.21.15.81:0/1616228338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84005ad60 con 0x128d840 2023-11-29T11:17:21.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- 172.21.15.81:0/1616228338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 msgr2=0x15450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15450a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb840052970 tx=0x7fb8400529a0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- 172.21.15.81:0/1616228338 shutdown_connections 2023-11-29T11:17:21.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x15412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15450a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 --2- 172.21.15.81:0/1616228338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 0x1544b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- 172.21.15.81:0/1616228338 >> 172.21.15.81:0/1616228338 conn(0x128dfe0 msgr2=0x1526b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- 172.21.15.81:0/1616228338 shutdown_connections 2023-11-29T11:17:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- 172.21.15.81:0/1616228338 wait complete. 2023-11-29T11:17:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- start start 2023-11-29T11:17:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 Processor -- start 2023-11-29T11:17:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1500000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1520160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x150acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1312c50 con 0x128dc10 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x150c2a0 con 0x128d840 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x150b210 con 0x12d88c0 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb860875740 10 client.0 _ll_register_callbacks cb 0x145f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb84e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1520160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb84e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1520160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51528/0 (socket says 172.21.15.81:51528) 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb84e7fc700 1 -- 172.21.15.81:0/1211228926 learned_addr learned my addr 172.21.15.81:0/1211228926 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb856ffd700 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1500000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.668+0000 7fb8577fe700 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x150acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb856ffd700 1 -- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 msgr2=0x150acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb856ffd700 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x150acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb856ffd700 1 -- 172.21.15.81:0/1211228926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 msgr2=0x1520160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb856ffd700 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1520160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb856ffd700 1 -- 172.21.15.81:0/1211228926 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8580cb080 con 0x128d840 2023-11-29T11:17:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1520160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb856ffd700 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1500000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb848016000 tx=0x7fb8480047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cf87b87470bd41a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb835ffb700 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb835ffb700 1 -- 172.21.15.81:0/1211228926 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84802d070 con 0x128d840 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 1 -- 172.21.15.81:0/1211228926 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x145f0e0 con 0x128d840 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb835ffb700 1 -- 172.21.15.81:0/1211228926 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb848033db0 con 0x128d840 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb835ffb700 1 -- 172.21.15.81:0/1211228926 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb84801f070 con 0x128d840 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 10 client.6760 fetch_fsmap learned FSMap version 33 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 1 -- 172.21.15.81:0/1211228926 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x12d9b10 con 0x128d840 2023-11-29T11:17:21.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb835ffb700 1 -- 172.21.15.81:0/1211228926 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x145f0e0 con 0x128d840 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb835ffb700 1 -- 172.21.15.81:0/1211228926 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fb8480038d0 con 0x128d840 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 10 client.6760 fetch_fsmap finished waiting for FSMap version 33 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 10 client.6760 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 20 client.6760 populate_metadata read hostname 'smithi081' 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x15093d0 0x15097d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 4 client.6760 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb860875740 1 -- 172.21.15.81:0/1211228926 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x145ee00 con 0x15093d0 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x15093d0 0x15097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb835ffb700 10 client.6760 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:17:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.672+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x15093d0 0x15097d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dda903798fac8e0 server_cookie=b1cd015eccf8c608 in_seq=0 out_seq=0 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb835ffb700 1 -- 172.21.15.81:0/1211228926 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x145ee00 con 0x15093d0 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb835ffb700 10 client.6760 handle_command_reply: tid=0 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 client.6760 shutdown 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 -- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 msgr2=0x1500000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1500000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb848016000 tx=0x7fb8480047e0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 -- 172.21.15.81:0/1211228926 shutdown_connections 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x15093d0 0x15097d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x150acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb835ffb700 0 client.6760 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1520160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 --2- 172.21.15.81:0/1211228926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1500000 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 -- 172.21.15.81:0/1211228926 >> 172.21.15.81:0/1211228926 conn(0x128dfe0 msgr2=0x15227d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 -- 172.21.15.81:0/1211228926 shutdown_connections 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 1 -- 172.21.15.81:0/1211228926 wait complete. 2023-11-29T11:17:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.676+0000 7fb860875740 20 client.6760 trim_cache size 0 max 16384 2023-11-29T11:17:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb860875740 1 Processor -- start 2023-11-29T11:17:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb860875740 1 -- start start 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb860875740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1522790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb860875740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1522cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb860875740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x151e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb860875740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14fe850 con 0x128dc10 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb860875740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1430560 con 0x128d840 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb860875740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x140dae0 con 0x12d88c0 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.692+0000 7fb84e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1522cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1522cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51534/0 (socket says 172.21.15.81:51534) 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84e7fc700 1 -- 172.21.15.81:0/796637871 learned_addr learned my addr 172.21.15.81:0/796637871 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb856ffd700 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1522790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb8577fe700 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x151e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84e7fc700 1 -- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 msgr2=0x151e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x151e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84e7fc700 1 -- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 msgr2=0x1522790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1522790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84e7fc700 1 -- 172.21.15.81:0/796637871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858152260 con 0x128dc10 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb8577fe700 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x151e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1522cd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb840052e20 tx=0x7fb840017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a987a0d168941df server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84d7fa700 1 -- 172.21.15.81:0/796637871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840056ea0 con 0x128dc10 2023-11-29T11:17:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84d7fa700 1 -- 172.21.15.81:0/796637871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400528a0 con 0x128dc10 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb84d7fa700 1 -- 172.21.15.81:0/796637871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84005ad40 con 0x128dc10 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 -- 172.21.15.81:0/796637871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 msgr2=0x1522cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1522cd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb840052e20 tx=0x7fb840017000 comp rx=0 tx=0).stop 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 -- 172.21.15.81:0/796637871 shutdown_connections 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x151e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128dc10 0x1522cd0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 --2- 172.21.15.81:0/796637871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128d840 0x1522790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 -- 172.21.15.81:0/796637871 >> 172.21.15.81:0/796637871 conn(0x128dfe0 msgr2=0x15234d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 -- 172.21.15.81:0/796637871 shutdown_connections 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 -- 172.21.15.81:0/796637871 wait complete. 2023-11-29T11:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 -- start start 2023-11-29T11:17:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.696+0000 7fb860875740 1 Processor -- start 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 0x1560740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x14fb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1526e80 con 0x128d840 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x150a320 con 0x128dc10 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x150a5c0 con 0x12d88c0 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51542/0 (socket says 172.21.15.81:51542) 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 -- 172.21.15.81:0/3480754487 learned_addr learned my addr 172.21.15.81:0/3480754487 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 10 client.0 _ll_register_callbacks cb 0x7fb84004f280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 -- 172.21.15.81:0/3480754487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 msgr2=0x14fb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x14fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 -- 172.21.15.81:0/3480754487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 msgr2=0x1560740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 0x1560740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 -- 172.21.15.81:0/3480754487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x148c0a0 con 0x128d840 2023-11-29T11:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb856ffd700 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15a45c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb848003b00 tx=0x7fb8480092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8990bf84d60bbf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb835ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb835ffb700 1 -- 172.21.15.81:0/3480754487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84803c680 con 0x128d840 2023-11-29T11:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb835ffb700 1 -- 172.21.15.81:0/3480754487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb84803c7e0 con 0x128d840 2023-11-29T11:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 -- 172.21.15.81:0/3480754487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8400512e0 con 0x128d840 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb835ffb700 1 -- 172.21.15.81:0/3480754487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb84803c9e0 con 0x128d840 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 10 client.6954 fetch_fsmap learned FSMap version 33 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 -- 172.21.15.81:0/3480754487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x142c970 con 0x128d840 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb835ffb700 1 -- 172.21.15.81:0/3480754487 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400512e0 con 0x128d840 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb835ffb700 1 -- 172.21.15.81:0/3480754487 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fb84803cb40 con 0x128d840 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 10 client.6954 fetch_fsmap finished waiting for FSMap version 33 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 10 client.6954 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 20 client.6954 populate_metadata read hostname 'smithi081' 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1560c80 0x14fb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 4 client.6954 mds_command: new command op to 6564 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb860875740 1 -- 172.21.15.81:0/3480754487 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x130a390 con 0x1560c80 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.700+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1560c80 0x14fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb84e7fc700 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1560c80 0x14fb550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=657f0fc55bce500 server_cookie=17d2952625322ab8 in_seq=0 out_seq=0 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb835ffb700 10 client.6954 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb835ffb700 1 -- 172.21.15.81:0/3480754487 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x130a390 con 0x1560c80 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb835ffb700 10 client.6954 handle_command_reply: tid=0 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 client.6954 shutdown 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 -- 172.21.15.81:0/3480754487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 msgr2=0x15a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15a45c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb848003b00 tx=0x7fb8480092e0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 -- 172.21.15.81:0/3480754487 shutdown_connections 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1560c80 0x14fb550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb835ffb700 0 client.6954 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12d88c0 0x14fb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x128dc10 0x1560740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 --2- 172.21.15.81:0/3480754487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x128d840 0x15a45c0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 -- 172.21.15.81:0/3480754487 >> 172.21.15.81:0/3480754487 conn(0x128dfe0 msgr2=0x15234d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 -- 172.21.15.81:0/3480754487 shutdown_connections 2023-11-29T11:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 1 -- 172.21.15.81:0/3480754487 wait complete. 2023-11-29T11:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb860875740 20 client.6954 trim_cache size 0 max 16384 2023-11-29T11:17:21.713 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:17:21.713 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:17:21.713 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:17:21.714 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 -- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb838064f10 msgr2=0x7fb8380673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb838064f10 0x7fb8380673c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb848000c00 tx=0x7fb848008030 comp rx=0 tx=0).stop 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 -- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580ce4f0 msgr2=0x7fb85806c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580ce4f0 0x7fb85806c8a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb84000c4d0 tx=0x7fb84000c7e0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 -- 172.21.15.81:0/1473358489 shutdown_connections 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb838064f10 0x7fb8380673c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb85815c350 0x7fb8581519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8580ce4f0 0x7fb85806c8a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 --2- 172.21.15.81:0/1473358489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8580b2a90 0x7fb8580b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 -- 172.21.15.81:0/1473358489 >> 172.21.15.81:0/1473358489 conn(0x7fb8580cd330 msgr2=0x7fb8580cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 -- 172.21.15.81:0/1473358489 shutdown_connections 2023-11-29T11:17:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.704+0000 7fb85d5f5700 1 -- 172.21.15.81:0/1473358489 wait complete. 2023-11-29T11:17:21.728 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:17:21.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.836+0000 7f3369629700 1 Processor -- start 2023-11-29T11:17:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.836+0000 7f3369629700 1 -- start start 2023-11-29T11:17:21.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3364153420 0x7f33640c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336415cb50 0x7f336415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336415d4f0 con 0x7f33641537f0 2023-11-29T11:17:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33640cdda0 con 0x7f3364153420 2023-11-29T11:17:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33640cad30 con 0x7f336415cb50 2023-11-29T11:17:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3362ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3364153420 0x7f33640c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3362ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3364153420 0x7f33640c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51552/0 (socket says 172.21.15.81:51552) 2023-11-29T11:17:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3362ffd700 1 -- 172.21.15.81:0/2871980404 learned_addr learned my addr 172.21.15.81:0/2871980404 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f33637fe700 1 --2- 172.21.15.81:0/2871980404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336415cb50 0x7f336415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3361ffb700 1 -- 172.21.15.81:0/2871980404 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520450828 0 0) 0x7f336415d4f0 con 0x7f33641537f0 2023-11-29T11:17:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3361ffb700 1 -- 172.21.15.81:0/2871980404 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f334c0035d0 con 0x7f33641537f0 2023-11-29T11:17:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f33637fe700 1 -- 172.21.15.81:0/2871980404 >> v2:172.21.15.81:3300/0 conn(0x7f3364153420 msgr2=0x7f33640c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f33637fe700 1 --2- 172.21.15.81:0/2871980404 >> v2:172.21.15.81:3300/0 conn(0x7f3364153420 0x7f33640c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f33637fe700 1 -- 172.21.15.81:0/2871980404 >> v1:172.21.15.176:6789/0 conn(0x7f33641537f0 legacy=0x7f33640ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f33637fe700 1 -- 172.21.15.81:0/2871980404 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33640b0cd0 con 0x7f336415cb50 2023-11-29T11:17:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f33637fe700 1 --2- 172.21.15.81:0/2871980404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336415cb50 0x7f336415cfb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f335c009d90 tx=0x7f335c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48c3da954178bf4e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3361ffb700 1 -- 172.21.15.81:0/2871980404 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00e070 con 0x7f336415cb50 2023-11-29T11:17:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3361ffb700 1 -- 172.21.15.81:0/2871980404 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c00bb20 con 0x7f336415cb50 2023-11-29T11:17:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3361ffb700 1 -- 172.21.15.81:0/2871980404 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00be90 con 0x7f336415cb50 2023-11-29T11:17:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 -- 172.21.15.81:0/2871980404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336415cb50 msgr2=0x7f336415cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 --2- 172.21.15.81:0/2871980404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336415cb50 0x7f336415cfb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f335c009d90 tx=0x7f335c00b330 comp rx=0 tx=0).stop 2023-11-29T11:17:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 -- 172.21.15.81:0/2871980404 shutdown_connections 2023-11-29T11:17:21.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 --2- 172.21.15.81:0/2871980404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336415cb50 0x7f336415cfb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 --2- 172.21.15.81:0/2871980404 >> v2:172.21.15.81:3300/0 conn(0x7f3364153420 0x7f33640c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 -- 172.21.15.81:0/2871980404 >> 172.21.15.81:0/2871980404 conn(0x7f336406caf0 msgr2=0x7f33640ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 -- 172.21.15.81:0/2871980404 shutdown_connections 2023-11-29T11:17:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.840+0000 7f3369629700 1 -- 172.21.15.81:0/2871980404 wait complete. 2023-11-29T11:17:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 Processor -- start 2023-11-29T11:17:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 -- start start 2023-11-29T11:17:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3364153420 0x7f336414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33641537f0 0x7f336415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336415cb50 0x7f33640c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3364151b20 con 0x7f3364153420 2023-11-29T11:17:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336414f080 con 0x7f336415cb50 2023-11-29T11:17:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33640b16e0 con 0x7f33641537f0 2023-11-29T11:17:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3362ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3364153420 0x7f336414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33637fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336415cb50 0x7f33640c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33627fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33641537f0 0x7f336415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3362ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3364153420 0x7f336414eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51564/0 (socket says 172.21.15.81:51564) 2023-11-29T11:17:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3362ffd700 1 -- 172.21.15.81:0/1983774923 learned_addr learned my addr 172.21.15.81:0/1983774923 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33627fc700 1 -- 172.21.15.81:0/1983774923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336415cb50 msgr2=0x7f33640c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33627fc700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336415cb50 0x7f33640c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33627fc700 1 -- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3364153420 msgr2=0x7f336414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33627fc700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3364153420 0x7f336414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33627fc700 1 -- 172.21.15.81:0/1983774923 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c009a70 con 0x7f33641537f0 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33637fe700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336415cb50 0x7f33640c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3362ffd700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3364153420 0x7f336414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f33627fc700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33641537f0 0x7f336415b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f335400c3e0 tx=0x7f335400c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f334b7fe700 1 -- 172.21.15.81:0/1983774923 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33540052d0 con 0x7f33641537f0 2023-11-29T11:17:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f334b7fe700 1 -- 172.21.15.81:0/1983774923 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3354005430 con 0x7f33641537f0 2023-11-29T11:17:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33640b0f70 con 0x7f33641537f0 2023-11-29T11:17:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.844+0000 7f334b7fe700 1 -- 172.21.15.81:0/1983774923 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33540055a0 con 0x7f33641537f0 2023-11-29T11:17:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.848+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33640caa00 con 0x7f33641537f0 2023-11-29T11:17:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.848+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33640b1250 con 0x7f33641537f0 2023-11-29T11:17:21.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.848+0000 7f334b7fe700 1 -- 172.21.15.81:0/1983774923 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3354019030 con 0x7f33641537f0 2023-11-29T11:17:21.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.848+0000 7f334b7fe700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3350064f10 0x7f33500673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.848+0000 7f334b7fe700 1 -- 172.21.15.81:0/1983774923 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3354081570 con 0x7f33641537f0 2023-11-29T11:17:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.848+0000 7f3362ffd700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3350064f10 0x7f33500673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.848+0000 7f3362ffd700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3350064f10 0x7f33500673c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f336406e960 tx=0x7f33580092e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:21.860+0000 7f334b7fe700 1 -- 172.21.15.81:0/1983774923 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f335404f5d0 con 0x7f33641537f0 2023-11-29T11:17:22.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.064+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33640c7870 con 0x7f33641537f0 2023-11-29T11:17:22.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.064+0000 7f334b7fe700 1 -- 172.21.15.81:0/1983774923 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f33640c7870 con 0x7f33641537f0 2023-11-29T11:17:22.072 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:22.072 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:56.032848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3350064f10 msgr2=0x7f33500673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3350064f10 0x7f33500673c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f336406e960 tx=0x7f33580092e0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33641537f0 msgr2=0x7f336415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33641537f0 0x7f336415b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f335400c3e0 tx=0x7f335400c6f0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 shutdown_connections 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3350064f10 0x7f33500673c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336415cb50 0x7f33640c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33641537f0 0x7f336415b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 --2- 172.21.15.81:0/1983774923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3364153420 0x7f336414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 >> 172.21.15.81:0/1983774923 conn(0x7f336406caf0 msgr2=0x7f33640c36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 shutdown_connections 2023-11-29T11:17:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.068+0000 7f3369629700 1 -- 172.21.15.81:0/1983774923 wait complete. 2023-11-29T11:17:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2023-11-29T11:17:22.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-11-29T11:17:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1306a68700 1 Processor -- start 2023-11-29T11:17:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1306a68700 1 -- start start 2023-11-29T11:17:22.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1306a68700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f13000c8e60 0x7f13000cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1306a68700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000cd6b0 con 0x7f1300160980 2023-11-29T11:17:22.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1306a68700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000ce4f0 con 0x7f13000ca1b0 2023-11-29T11:17:22.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1306a68700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000b1010 con 0x7f13000c8e60 2023-11-29T11:17:22.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1304804700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1300160980 0x7f13000c9aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50580/0 (socket says 172.21.15.81:50580) 2023-11-29T11:17:22.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1304804700 1 -- 172.21.15.81:0/2024449017 learned_addr learned my addr 172.21.15.81:0/2024449017 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:22.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1305005700 1 --2- 172.21.15.81:0/2024449017 >> v2:172.21.15.176:3300/0 conn(0x7f13000c8e60 0x7f13000cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559410588 0 0) 0x7f13000cd6b0 con 0x7f1300160980 2023-11-29T11:17:22.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec0035d0 con 0x7f1300160980 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3893056069 0 0) 0x7f12ec0035d0 con 0x7f1300160980 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 >> v2:172.21.15.176:3300/0 conn(0x7f13000c8e60 msgr2=0x7f13000cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 --2- 172.21.15.81:0/2024449017 >> v2:172.21.15.176:3300/0 conn(0x7f13000c8e60 0x7f13000cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 >> v1:172.21.15.176:6789/0 conn(0x7f13000ca1b0 legacy=0x7f1300069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300160d50 con 0x7f1300160980 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f12e8001670 con 0x7f1300160980 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 >> v1:172.21.15.81:6789/0 conn(0x7f1300160980 legacy=0x7f13000c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ec003a20 0x7f12ec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12ec004870 0x7f12ec004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec005220 0x7f12ec00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b1010 con 0x7f12ec003a20 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec00c0a0 con 0x7f12ec005220 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec00c260 con 0x7f12ec004870 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1305005700 1 --2- 172.21.15.81:0/2024449017 >> v2:172.21.15.176:3300/0 conn(0x7f13000c8e60 0x7f13000cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1304804700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ec003a20 0x7f12ec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f12fffff700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12ec004870 0x7f12ec004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.200+0000 7f1305005700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec005220 0x7f12ec00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1304804700 1 -- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12ec004870 msgr2=0x7f12ec004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1304804700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12ec004870 0x7f12ec004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1304804700 1 -- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec005220 msgr2=0x7f12ec00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1304804700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec005220 0x7f12ec00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1304804700 1 -- 172.21.15.81:0/2024449017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0035d0 con 0x7f12ec003a20 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1305005700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec005220 0x7f12ec00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f12fffff700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12ec004870 0x7f12ec004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1305005700 1 -- 172.21.15.81:0/2024449017 reap_dead start 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1304804700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ec003a20 0x7f12ec003e30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c320 tx=0x7f12ec0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6748eb2f2b6ebac6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8007c30 con 0x7f12ec003a20 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e800ce80 con 0x7f12ec003a20 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f12ff7fe700 1 -- 172.21.15.81:0/2024449017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8005bc0 con 0x7f12ec003a20 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1306a68700 1 -- 172.21.15.81:0/2024449017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ec003a20 msgr2=0x7f12ec003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1306a68700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ec003a20 0x7f12ec003e30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c320 tx=0x7f12ec0058a0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1306a68700 1 -- 172.21.15.81:0/2024449017 shutdown_connections 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1306a68700 1 --2- 172.21.15.81:0/2024449017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12ec003a20 0x7f12ec003e30 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1306a68700 1 -- 172.21.15.81:0/2024449017 >> 172.21.15.81:0/2024449017 conn(0x7f13000cf4a0 msgr2=0x7f13000cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1306a68700 1 -- 172.21.15.81:0/2024449017 shutdown_connections 2023-11-29T11:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.204+0000 7f1306a68700 1 -- 172.21.15.81:0/2024449017 wait complete. 2023-11-29T11:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1306a68700 1 Processor -- start 2023-11-29T11:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1306a68700 1 -- start start 2023-11-29T11:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1306a68700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec003a20 0x7f1300153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1306a68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300154540 0x7f13000c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1306a68700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13000c6fa0 0x7f130015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1306a68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c62f0 con 0x7f1300154540 2023-11-29T11:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1306a68700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130015a280 con 0x7f12ec003a20 2023-11-29T11:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1306a68700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c8360 con 0x7f13000c6fa0 2023-11-29T11:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300154540 0x7f13000c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300154540 0x7f13000c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51580/0 (socket says 172.21.15.81:51580) 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 -- 172.21.15.81:0/2580523896 learned_addr learned my addr 172.21.15.81:0/2580523896 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1305005700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13000c6fa0 0x7f130015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1304804700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec003a20 0x7f1300153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 -- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13000c6fa0 msgr2=0x7f130015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13000c6fa0 0x7f130015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 -- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec003a20 msgr2=0x7f1300153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec003a20 0x7f1300153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 -- 172.21.15.81:0/2580523896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000cdbc0 con 0x7f1300154540 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f1305005700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13000c6fa0 0x7f130015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.208+0000 7f12fffff700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300154540 0x7f13000c6a60 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f12f8000f80 tx=0x7f12f800c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.212+0000 7f12fd7fa700 1 -- 172.21.15.81:0/2580523896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8003c30 con 0x7f1300154540 2023-11-29T11:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.212+0000 7f12fd7fa700 1 -- 172.21.15.81:0/2580523896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8003d90 con 0x7f1300154540 2023-11-29T11:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.212+0000 7f1306a68700 1 -- 172.21.15.81:0/2580523896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000cd8e0 con 0x7f1300154540 2023-11-29T11:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.212+0000 7f12fd7fa700 1 -- 172.21.15.81:0/2580523896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800ca20 con 0x7f1300154540 2023-11-29T11:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.212+0000 7f1306a68700 1 -- 172.21.15.81:0/2580523896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13000cdea0 con 0x7f1300154540 2023-11-29T11:17:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.212+0000 7f12fd7fa700 1 -- 172.21.15.81:0/2580523896 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f12f800cb80 con 0x7f1300154540 2023-11-29T11:17:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.212+0000 7f12fd7fa700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f12e0064ee0 0x7f12e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f12fd7fa700 1 -- 172.21.15.81:0/2580523896 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f12f8082520 con 0x7f1300154540 2023-11-29T11:17:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f12e0064ee0 0x7f12e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f12e0064ee0 0x7f12e0067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000c00 tx=0x7f12e8007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1309ce8740 1 Processor -- start 2023-11-29T11:17:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1309ce8740 1 -- start start 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526d20 0x17dd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 0x17ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 0x1794280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1309ce8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1695dc0 con 0x1526d20 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1309ce8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1705e20 con 0x15719d0 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1309ce8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x16ff120 con 0x1526950 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526d20 0x17dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526d20 0x17dd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51590/0 (socket says 172.21.15.81:51590) 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 -- 172.21.15.81:0/1973413274 learned_addr learned my addr 172.21.15.81:0/1973413274 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 -- 172.21.15.81:0/1973413274 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 msgr2=0x17ddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 --2- 172.21.15.81:0/1973413274 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 0x17ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 -- 172.21.15.81:0/1973413274 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 msgr2=0x1794280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 --2- 172.21.15.81:0/1973413274 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 0x1794280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 -- 172.21.15.81:0/1973413274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17259b0 con 0x1526d20 2023-11-29T11:17:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f1304804700 1 --2- 172.21.15.81:0/1973413274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526d20 0x17dd570 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c910 tx=0x7f12e800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95036722d0c51d83 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f12f67fc700 1 -- 172.21.15.81:0/1973413274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8004a90 con 0x1526d20 2023-11-29T11:17:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f12f67fc700 1 -- 172.21.15.81:0/1973413274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8004c10 con 0x1526d20 2023-11-29T11:17:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.216+0000 7f12f67fc700 1 -- 172.21.15.81:0/1973413274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80070d0 con 0x1526d20 2023-11-29T11:17:22.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- 172.21.15.81:0/1973413274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526d20 msgr2=0x17dd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 --2- 172.21.15.81:0/1973413274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526d20 0x17dd570 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c910 tx=0x7f12e800a000 comp rx=0 tx=0).stop 2023-11-29T11:17:22.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- 172.21.15.81:0/1973413274 shutdown_connections 2023-11-29T11:17:22.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 --2- 172.21.15.81:0/1973413274 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 0x1794280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 --2- 172.21.15.81:0/1973413274 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 0x17ddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 --2- 172.21.15.81:0/1973413274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526d20 0x17dd570 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- 172.21.15.81:0/1973413274 >> 172.21.15.81:0/1973413274 conn(0x15270f0 msgr2=0x17bfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- 172.21.15.81:0/1973413274 shutdown_connections 2023-11-29T11:17:22.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- 172.21.15.81:0/1973413274 wait complete. 2023-11-29T11:17:22.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- start start 2023-11-29T11:17:22.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 Processor -- start 2023-11-29T11:17:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 0x1794b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x17950c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15719d0 0x17b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x15abd60 con 0x15719d0 2023-11-29T11:17:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x17c0ca0 con 0x1526d20 2023-11-29T11:17:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x17b95e0 con 0x1526950 2023-11-29T11:17:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1309ce8740 10 client.0 _ll_register_callbacks cb 0x16f8a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1305005700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15719d0 0x17b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1305005700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15719d0 0x17b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51606/0 (socket says 172.21.15.81:51606) 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1305005700 1 -- 172.21.15.81:0/983353006 learned_addr learned my addr 172.21.15.81:0/983353006 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f1304804700 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 0x1794b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.220+0000 7f12fffff700 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x17950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1305005700 1 -- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 msgr2=0x1794b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1305005700 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 0x1794b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1305005700 1 -- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 msgr2=0x17950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1305005700 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x17950c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1305005700 1 -- 172.21.15.81:0/983353006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec0035d0 con 0x15719d0 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12fffff700 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x17950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1305005700 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15719d0 0x17b5c10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f12f0004860 tx=0x7f12f00127f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162756eb88d9faf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:17:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 1 -- 172.21.15.81:0/983353006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0012e70 con 0x15719d0 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 -- 172.21.15.81:0/983353006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x16f81a0 con 0x15719d0 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 1 -- 172.21.15.81:0/983353006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f12f001e410 con 0x15719d0 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 1 -- 172.21.15.81:0/983353006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12f0005a40 con 0x15719d0 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 10 client.6972 fetch_fsmap learned FSMap version 33 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 -- 172.21.15.81:0/983353006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1572c20 con 0x15719d0 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 1 -- 172.21.15.81:0/983353006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x16f81a0 con 0x15719d0 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 1 -- 172.21.15.81:0/983353006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f12f0005ba0 con 0x15719d0 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 10 client.6972 fetch_fsmap finished waiting for FSMap version 33 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 10 client.6972 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 20 client.6972 populate_metadata read hostname 'smithi081' 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1797510 0x1796740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 4 client.6972 mds_command: new command op to 6564 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 -- 172.21.15.81:0/983353006 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x16f7ec0 con 0x1797510 2023-11-29T11:17:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1304804700 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1797510 0x1796740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 10 client.6972 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1304804700 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1797510 0x1796740 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9207187b5796a788 server_cookie=3e97c1273fb5cf6c in_seq=0 out_seq=0 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 1 -- 172.21.15.81:0/983353006 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x16f7ec0 con 0x1797510 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 10 client.6972 handle_command_reply: tid=0 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 client.6972 shutdown 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 -- 172.21.15.81:0/983353006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15719d0 msgr2=0x17b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15719d0 0x17b5c10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f12f0004860 tx=0x7f12f00127f0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 -- 172.21.15.81:0/983353006 shutdown_connections 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x1797510 0x1796740 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15719d0 0x17b5c10 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x17950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f12df7fe700 0 client.6972 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:17:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 --2- 172.21.15.81:0/983353006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526950 0x1794b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 -- 172.21.15.81:0/983353006 >> 172.21.15.81:0/983353006 conn(0x15270f0 msgr2=0x17ba160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 -- 172.21.15.81:0/983353006 shutdown_connections 2023-11-29T11:17:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 1 -- 172.21.15.81:0/983353006 wait complete. 2023-11-29T11:17:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.224+0000 7f1309ce8740 20 client.6972 trim_cache size 0 max 16384 2023-11-29T11:17:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 Processor -- start 2023-11-29T11:17:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- start start 2023-11-29T11:17:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526d20 0x17b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 0x17b7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x175de50 con 0x1526950 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x16cb640 con 0x15719d0 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1701c80 con 0x1526d20 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17b6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51620/0 (socket says 172.21.15.81:51620) 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 -- 172.21.15.81:0/2377726665 learned_addr learned my addr 172.21.15.81:0/2377726665 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1305005700 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 0x17b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f12fffff700 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526d20 0x17b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 -- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526d20 msgr2=0x17b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526d20 0x17b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 -- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 msgr2=0x17b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 0x17b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 -- 172.21.15.81:0/2377726665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130015b7a0 con 0x1526950 2023-11-29T11:17:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f12fffff700 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526d20 0x17b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1304804700 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17b6ac0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f12e8020040 tx=0x7f12e8006050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a3d58b3fa485f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f12f6ffd700 1 -- 172.21.15.81:0/2377726665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8001a70 con 0x1526950 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f12f6ffd700 1 -- 172.21.15.81:0/2377726665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e80340d0 con 0x1526950 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f12f6ffd700 1 -- 172.21.15.81:0/2377726665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8034440 con 0x1526950 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- 172.21.15.81:0/2377726665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 msgr2=0x17b6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17b6ac0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f12e8020040 tx=0x7f12e8006050 comp rx=0 tx=0).stop 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- 172.21.15.81:0/2377726665 shutdown_connections 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15719d0 0x17b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1526d20 0x17b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2377726665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17b6ac0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- 172.21.15.81:0/2377726665 >> 172.21.15.81:0/2377726665 conn(0x15270f0 msgr2=0x17bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- 172.21.15.81:0/2377726665 shutdown_connections 2023-11-29T11:17:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.240+0000 7f1309ce8740 1 -- 172.21.15.81:0/2377726665 wait complete. 2023-11-29T11:17:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 1 -- start start 2023-11-29T11:17:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 1 Processor -- start 2023-11-29T11:17:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x18394d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15719d0 0x183c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1703120 con 0x1526950 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x16f94c0 con 0x1526d20 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x16faa90 con 0x15719d0 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1309ce8740 10 client.0 _ll_register_callbacks cb 0x7f12e8021070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51634/0 (socket says 172.21.15.81:51634) 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 -- 172.21.15.81:0/2621159109 learned_addr learned my addr 172.21.15.81:0/2621159109 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1305005700 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15719d0 0x183c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f12fffff700 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x18394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 -- 172.21.15.81:0/2621159109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15719d0 msgr2=0x183c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15719d0 0x183c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 -- 172.21.15.81:0/2621159109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 msgr2=0x18394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x18394d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 -- 172.21.15.81:0/2621159109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x17259b0 con 0x1526950 2023-11-29T11:17:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f1304804700 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17f1f60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x16a5220 tx=0x7f12e800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d8aeb5d40afe30 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.244+0000 7f12df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:17:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 1 -- 172.21.15.81:0/2621159109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8034b10 con 0x1526950 2023-11-29T11:17:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 1 -- 172.21.15.81:0/2621159109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f12e8023050 con 0x1526950 2023-11-29T11:17:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 -- 172.21.15.81:0/2621159109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12e8004c10 con 0x1526950 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 1 -- 172.21.15.81:0/2621159109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12e8034450 con 0x1526950 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 10 client.6978 fetch_fsmap learned FSMap version 33 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 -- 172.21.15.81:0/2621159109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x16abb90 con 0x1526950 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 1 -- 172.21.15.81:0/2621159109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8004c10 con 0x1526950 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 1 -- 172.21.15.81:0/2621159109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f12e8034c70 con 0x1526950 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 10 client.6978 fetch_fsmap finished waiting for FSMap version 33 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 10 client.6978 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 20 client.6978 populate_metadata read hostname 'smithi081' 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x183cb30 0x183cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 4 client.6978 mds_command: new command op to 6564 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 -- 172.21.15.81:0/2621159109 --> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x15a34a0 con 0x183cb30 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12fffff700 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x183cb30 0x183cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 10 client.6978 ms_handle_connect on v2:172.21.15.81:6836/458453409 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12fffff700 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x183cb30 0x183cf00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69a24933946037fc server_cookie=77a913ac1bf276b4 in_seq=0 out_seq=0 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 1 -- 172.21.15.81:0/2621159109 <== mds.0 v2:172.21.15.81:6836/458453409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x15a34a0 con 0x183cb30 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 10 client.6978 handle_command_reply: tid=0 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 client.6978 shutdown 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 -- 172.21.15.81:0/2621159109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 msgr2=0x17f1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17f1f60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x16a5220 tx=0x7f12e800f000 comp rx=0 tx=0).stop 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 -- 172.21.15.81:0/2621159109 shutdown_connections 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.81:6836/458453409,v1:172.21.15.81:6837/458453409] conn(0x183cb30 0x183cf00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15719d0 0x183c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1526d20 0x18394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 --2- 172.21.15.81:0/2621159109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1526950 0x17f1f60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f12df7fe700 0 client.6978 ms_handle_reset on v2:172.21.15.81:6836/458453409 2023-11-29T11:17:22.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 -- 172.21.15.81:0/2621159109 >> 172.21.15.81:0/2621159109 conn(0x15270f0 msgr2=0x17b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 -- 172.21.15.81:0/2621159109 shutdown_connections 2023-11-29T11:17:22.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 1 -- 172.21.15.81:0/2621159109 wait complete. 2023-11-29T11:17:22.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1309ce8740 20 client.6978 trim_cache size 0 max 16384 2023-11-29T11:17:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:22.259 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 -- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f12e0064ee0 msgr2=0x7f12e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f12e0064ee0 0x7f12e0067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000c00 tx=0x7f12e8007000 comp rx=0 tx=0).stop 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 -- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300154540 msgr2=0x7f13000c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300154540 0x7f13000c6a60 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f12f8000f80 tx=0x7f12f800c0e0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 -- 172.21.15.81:0/2580523896 shutdown_connections 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f12e0064ee0 0x7f12e0067390 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13000c6fa0 0x7f130015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300154540 0x7f13000c6a60 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 --2- 172.21.15.81:0/2580523896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12ec003a20 0x7f1300153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 -- 172.21.15.81:0/2580523896 >> 172.21.15.81:0/2580523896 conn(0x7f13000cf4a0 msgr2=0x7f13000b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 -- 172.21.15.81:0/2580523896 shutdown_connections 2023-11-29T11:17:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.248+0000 7f1306a68700 1 -- 172.21.15.81:0/2580523896 wait complete. 2023-11-29T11:17:22.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-29T11:17:22.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.368+0000 7fcf41e5a700 1 Processor -- start 2023-11-29T11:17:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.368+0000 7fcf41e5a700 1 -- start start 2023-11-29T11:17:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41e5a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf3c0ceef0 0x7fcf3c06a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41e5a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c0cae70 con 0x7fcf3c0c1ac0 2023-11-29T11:17:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41e5a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c0cbc10 con 0x7fcf3c1606b0 2023-11-29T11:17:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41e5a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0cb130 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf3bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcf3c0c1ac0 0x7fcf3c069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50588/0 (socket says 172.21.15.81:50588) 2023-11-29T11:17:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf3bfff700 1 -- 172.21.15.81:0/2127304241 learned_addr learned my addr 172.21.15.81:0/2127304241 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41659700 1 --2- 172.21.15.81:0/2127304241 >> v2:172.21.15.176:3300/0 conn(0x7fcf3c0ceef0 0x7fcf3c06a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf3b7fe700 1 -- 172.21.15.81:0/2127304241 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174372368 0 0) 0x7fcf3c0cae70 con 0x7fcf3c0c1ac0 2023-11-29T11:17:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf3b7fe700 1 -- 172.21.15.81:0/2127304241 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf2c0035d0 con 0x7fcf3c0c1ac0 2023-11-29T11:17:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf3b7fe700 1 -- 172.21.15.81:0/2127304241 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2233450797 0 0) 0x7fcf2c0035d0 con 0x7fcf3c0c1ac0 2023-11-29T11:17:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41659700 1 -- 172.21.15.81:0/2127304241 >> v1:172.21.15.176:6789/0 conn(0x7fcf3c1606b0 legacy=0x7fcf3c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41659700 1 -- 172.21.15.81:0/2127304241 >> v1:172.21.15.81:6789/0 conn(0x7fcf3c0c1ac0 legacy=0x7fcf3c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41659700 1 -- 172.21.15.81:0/2127304241 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0cb410 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41659700 1 --2- 172.21.15.81:0/2127304241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c06a350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009d90 tx=0x7fcf3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84c3e7299fed6239 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf3b7fe700 1 -- 172.21.15.81:0/2127304241 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400e070 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf3b7fe700 1 -- 172.21.15.81:0/2127304241 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf34003a40 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf3b7fe700 1 -- 172.21.15.81:0/2127304241 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28001670 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41e5a700 1 -- 172.21.15.81:0/2127304241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c0ceef0 msgr2=0x7fcf3c06a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.372+0000 7fcf41e5a700 1 --2- 172.21.15.81:0/2127304241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c06a350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009d90 tx=0x7fcf3400b330 comp rx=0 tx=0).stop 2023-11-29T11:17:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.376+0000 7fcf41e5a700 1 -- 172.21.15.81:0/2127304241 shutdown_connections 2023-11-29T11:17:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.376+0000 7fcf41e5a700 1 --2- 172.21.15.81:0/2127304241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c06a350 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.376+0000 7fcf41e5a700 1 -- 172.21.15.81:0/2127304241 >> 172.21.15.81:0/2127304241 conn(0x7fcf3c0ce3e0 msgr2=0x7fcf3c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.376+0000 7fcf41e5a700 1 -- 172.21.15.81:0/2127304241 shutdown_connections 2023-11-29T11:17:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.376+0000 7fcf41e5a700 1 -- 172.21.15.81:0/2127304241 wait complete. 2023-11-29T11:17:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.376+0000 7fcf41e5a700 1 Processor -- start 2023-11-29T11:17:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.376+0000 7fcf41e5a700 1 -- start start 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41e5a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3c0c1ac0 0x7fcf3c071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41e5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41e5a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c1606b0 0x7fcf3c0c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41e5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c072290 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41e5a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c15ac20 con 0x7fcf3c1606b0 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41e5a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c070cb0 con 0x7fcf3c0c1ac0 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c15a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51648/0 (socket says 172.21.15.81:51648) 2023-11-29T11:17:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 -- 172.21.15.81:0/1919922719 learned_addr learned my addr 172.21.15.81:0/1919922719 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf40e58700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3c0c1ac0 0x7fcf3c071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41659700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c1606b0 0x7fcf3c0c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 -- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3c0c1ac0 msgr2=0x7fcf3c071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3c0c1ac0 0x7fcf3c071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 -- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c1606b0 msgr2=0x7fcf3c0c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c1606b0 0x7fcf3c0c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 -- 172.21.15.81:0/1919922719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009a70 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41659700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c1606b0 0x7fcf3c0c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf3bfff700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c15a6e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800c760 tx=0x7fcf2800ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf397fa700 1 -- 172.21.15.81:0/1919922719 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28004ca0 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf397fa700 1 -- 172.21.15.81:0/1919922719 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf28004e00 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c0b36c0 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf397fa700 1 -- 172.21.15.81:0/1919922719 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28007310 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.380+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c0cb6f0 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.384+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c0ad610 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.384+0000 7fcf397fa700 1 -- 172.21.15.81:0/1919922719 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcf2801a020 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.384+0000 7fcf397fa700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf20064ee0 0x7fcf20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.384+0000 7fcf40e58700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf20064ee0 0x7fcf20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.384+0000 7fcf397fa700 1 -- 172.21.15.81:0/1919922719 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fcf28081cc0 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.384+0000 7fcf40e58700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf20064ee0 0x7fcf20067390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcf30001800 tx=0x7fcf30009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.392+0000 7fcf397fa700 1 -- 172.21.15.81:0/1919922719 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcf2804fce0 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcf3c072500 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf397fa700 1 -- 172.21.15.81:0/1919922719 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcf28001360 con 0x7fcf3c0ceef0 2023-11-29T11:17:22.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:22.599 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf20064ee0 msgr2=0x7fcf20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf20064ee0 0x7fcf20067390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcf30001800 tx=0x7fcf30009040 comp rx=0 tx=0).stop 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf3c0ceef0 msgr2=0x7fcf3c15a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c15a6e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800c760 tx=0x7fcf2800ca70 comp rx=0 tx=0).stop 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 shutdown_connections 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf20064ee0 0x7fcf20067390 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf3c1606b0 0x7fcf3c0c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf3c0ceef0 0x7fcf3c15a6e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 --2- 172.21.15.81:0/1919922719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf3c0c1ac0 0x7fcf3c071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.592+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 >> 172.21.15.81:0/1919922719 conn(0x7fcf3c0ce3e0 msgr2=0x7fcf3c06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.596+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 shutdown_connections 2023-11-29T11:17:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.596+0000 7fcf41e5a700 1 -- 172.21.15.81:0/1919922719 wait complete. 2023-11-29T11:17:22.613 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-29T11:17:22.614 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:17:22.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:17:22.627 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:17:22.646 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:17:22.646 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:17:22.647 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:22.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.784+0000 7f164b4b4700 1 Processor -- start 2023-11-29T11:17:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.784+0000 7f164b4b4700 1 -- start start 2023-11-29T11:17:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16441584c0 0x7f16440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f16440b32e0 0x7f16440b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16440b3c30 con 0x7f164406bc80 2023-11-29T11:17:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164406dbd0 con 0x7f16440b32e0 2023-11-29T11:17:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16440cd0f0 con 0x7f16441584c0 2023-11-29T11:17:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164acb3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f164406bc80 0x7f164406c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50594/0 (socket says 172.21.15.81:50594) 2023-11-29T11:17:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164acb3700 1 -- 172.21.15.81:0/1936372481 learned_addr learned my addr 172.21.15.81:0/1936372481 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f1649cb1700 1 --2- 172.21.15.81:0/1936372481 >> v2:172.21.15.176:3300/0 conn(0x7f16440b32e0 0x7f16440b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164a4b2700 1 --2- 172.21.15.81:0/1936372481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16441584c0 0x7f16440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f16494b0700 1 -- 172.21.15.81:0/1936372481 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839516936 0 0) 0x7f16440b3c30 con 0x7f164406bc80 2023-11-29T11:17:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f16494b0700 1 -- 172.21.15.81:0/1936372481 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f162c0035d0 con 0x7f164406bc80 2023-11-29T11:17:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164a4b2700 1 -- 172.21.15.81:0/1936372481 >> v2:172.21.15.176:3300/0 conn(0x7f16440b32e0 msgr2=0x7f16440b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164a4b2700 1 --2- 172.21.15.81:0/1936372481 >> v2:172.21.15.176:3300/0 conn(0x7f16440b32e0 0x7f16440b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164a4b2700 1 -- 172.21.15.81:0/1936372481 >> v1:172.21.15.81:6789/0 conn(0x7f164406bc80 legacy=0x7f164406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164a4b2700 1 -- 172.21.15.81:0/1936372481 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16440cd3d0 con 0x7f16441584c0 2023-11-29T11:17:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f1649cb1700 1 --2- 172.21.15.81:0/1936372481 >> v2:172.21.15.176:3300/0 conn(0x7f16440b32e0 0x7f16440b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164a4b2700 1 --2- 172.21.15.81:0/1936372481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16441584c0 0x7f16440cb6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f163c009850 tx=0x7f163c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1452f7bdd4c22d6c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f16494b0700 1 -- 172.21.15.81:0/1936372481 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c011830 con 0x7f16441584c0 2023-11-29T11:17:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f16494b0700 1 -- 172.21.15.81:0/1936372481 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c011990 con 0x7f16441584c0 2023-11-29T11:17:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f16494b0700 1 -- 172.21.15.81:0/1936372481 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c011d00 con 0x7f16441584c0 2023-11-29T11:17:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 -- 172.21.15.81:0/1936372481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16441584c0 msgr2=0x7f16440cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 --2- 172.21.15.81:0/1936372481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16441584c0 0x7f16440cb6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f163c009850 tx=0x7f163c009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 -- 172.21.15.81:0/1936372481 shutdown_connections 2023-11-29T11:17:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 --2- 172.21.15.81:0/1936372481 >> v2:172.21.15.176:3300/0 conn(0x7f16440b32e0 0x7f16440b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 --2- 172.21.15.81:0/1936372481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16441584c0 0x7f16440cb6f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 -- 172.21.15.81:0/1936372481 >> 172.21.15.81:0/1936372481 conn(0x7f16440ce3e0 msgr2=0x7f16440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.788+0000 7f164b4b4700 1 -- 172.21.15.81:0/1936372481 shutdown_connections 2023-11-29T11:17:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 -- 172.21.15.81:0/1936372481 wait complete. 2023-11-29T11:17:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 Processor -- start 2023-11-29T11:17:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 -- start start 2023-11-29T11:17:22.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f164406bc80 0x7f16440c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16440b32e0 0x7f16440c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16441584c0 0x7f16441505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16440c7a50 con 0x7f16441584c0 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16440c7d30 con 0x7f16440b32e0 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16440c8010 con 0x7f164406bc80 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16441584c0 0x7f16441505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16441584c0 0x7f16441505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51664/0 (socket says 172.21.15.81:51664) 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 -- 172.21.15.81:0/2279599048 learned_addr learned my addr 172.21.15.81:0/2279599048 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164a4b2700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f164406bc80 0x7f16440c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f1649cb1700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16440b32e0 0x7f16440c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 -- 172.21.15.81:0/2279599048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f164406bc80 msgr2=0x7f16440c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f164406bc80 0x7f16440c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 -- 172.21.15.81:0/2279599048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16440b32e0 msgr2=0x7f16440c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16440b32e0 0x7f16440c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 -- 172.21.15.81:0/2279599048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380094b0 con 0x7f16441584c0 2023-11-29T11:17:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164acb3700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16441584c0 0x7f16441505b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f163400cb10 tx=0x7f163400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f1642ffd700 1 -- 172.21.15.81:0/2279599048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634007480 con 0x7f16441584c0 2023-11-29T11:17:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f1642ffd700 1 -- 172.21.15.81:0/2279599048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16340075e0 con 0x7f16441584c0 2023-11-29T11:17:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c0094b0 con 0x7f16441584c0 2023-11-29T11:17:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.792+0000 7f1642ffd700 1 -- 172.21.15.81:0/2279599048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634007970 con 0x7f16441584c0 2023-11-29T11:17:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.796+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16440cd990 con 0x7f16441584c0 2023-11-29T11:17:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.796+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16440cd6b0 con 0x7f16441584c0 2023-11-29T11:17:22.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.796+0000 7f1642ffd700 1 -- 172.21.15.81:0/2279599048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1634019030 con 0x7f16441584c0 2023-11-29T11:17:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.796+0000 7f1642ffd700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1630064f10 0x7f16300673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.796+0000 7f1642ffd700 1 -- 172.21.15.81:0/2279599048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f16340818e0 con 0x7f16441584c0 2023-11-29T11:17:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.796+0000 7f164a4b2700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1630064f10 0x7f16300673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:22.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.800+0000 7f164a4b2700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1630064f10 0x7f16300673c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f163c0090b0 tx=0x7f163c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:22.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.804+0000 7f1642ffd700 1 -- 172.21.15.81:0/2279599048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f163404f810 con 0x7f16441584c0 2023-11-29T11:17:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.968+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16440cdc70 con 0x7f16441584c0 2023-11-29T11:17:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f1642ffd700 1 -- 172.21.15.81:0/2279599048 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18127 (secure 0 0 0) 0x7f1634001b80 con 0x7f16441584c0 2023-11-29T11:17:22.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:22.980 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:16:44.055201+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:16:05.224956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-29T11:16:06.381228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1630064f10 msgr2=0x7f16300673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1630064f10 0x7f16300673c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f163c0090b0 tx=0x7f163c008030 comp rx=0 tx=0).stop 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16441584c0 msgr2=0x7f16441505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16441584c0 0x7f16441505b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f163400cb10 tx=0x7f163400cb40 comp rx=0 tx=0).stop 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 shutdown_connections 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1630064f10 0x7f16300673c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16441584c0 0x7f16441505b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16440b32e0 0x7f16440c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 --2- 172.21.15.81:0/2279599048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f164406bc80 0x7f16440c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.972+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 >> 172.21.15.81:0/2279599048 conn(0x7f16440ce3e0 msgr2=0x7f16440709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.976+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 shutdown_connections 2023-11-29T11:17:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:22.976+0000 7f164b4b4700 1 -- 172.21.15.81:0/2279599048 wait complete. 2023-11-29T11:17:22.995 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:16:05.224956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:16:06.381228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:17:22.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:17:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b9e83700 1 Processor -- start 2023-11-29T11:17:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b9e83700 1 -- start start 2023-11-29T11:17:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b9e83700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe1b40b1eb0 0x7fe1b40d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b9e83700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b40cf0b0 con 0x7fe1b406d8e0 2023-11-29T11:17:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b9e83700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b40cfc30 con 0x7fe1b40d2eb0 2023-11-29T11:17:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b9e83700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b415c6a0 con 0x7fe1b40b1eb0 2023-11-29T11:17:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1abfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe1b406d8e0 0x7fe1b40d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50604/0 (socket says 172.21.15.81:50604) 2023-11-29T11:17:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1abfff700 1 -- 172.21.15.81:0/3262271856 learned_addr learned my addr 172.21.15.81:0/3262271856 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b8e81700 1 --2- 172.21.15.81:0/3262271856 >> v2:172.21.15.176:3300/0 conn(0x7fe1b40b1eb0 0x7fe1b40d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1ab7fe700 1 -- 172.21.15.81:0/3262271856 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51155003 0 0) 0x7fe1b40cf0b0 con 0x7fe1b406d8e0 2023-11-29T11:17:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1ab7fe700 1 -- 172.21.15.81:0/3262271856 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19c0035d0 con 0x7fe1b406d8e0 2023-11-29T11:17:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1ab7fe700 1 -- 172.21.15.81:0/3262271856 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213072364 0 0) 0x7fe1b40cfc30 con 0x7fe1b40d2eb0 2023-11-29T11:17:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1ab7fe700 1 -- 172.21.15.81:0/3262271856 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b40cf0b0 con 0x7fe1b40d2eb0 2023-11-29T11:17:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1ab7fe700 1 -- 172.21.15.81:0/3262271856 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416677992 0 0) 0x7fe19c0035d0 con 0x7fe1b406d8e0 2023-11-29T11:17:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b8e81700 1 -- 172.21.15.81:0/3262271856 >> v1:172.21.15.176:6789/0 conn(0x7fe1b40d2eb0 legacy=0x7fe1b406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b8e81700 1 -- 172.21.15.81:0/3262271856 >> v1:172.21.15.81:6789/0 conn(0x7fe1b406d8e0 legacy=0x7fe1b40d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b8e81700 1 -- 172.21.15.81:0/3262271856 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40cf300 con 0x7fe1b40b1eb0 2023-11-29T11:17:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1b8e81700 1 --2- 172.21.15.81:0/3262271856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1eb0 0x7fe1b40d1c70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009850 tx=0x7fe1b0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7c5843e9201251 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1ab7fe700 1 -- 172.21.15.81:0/3262271856 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4001670 con 0x7fe1b40b1eb0 2023-11-29T11:17:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1ab7fe700 1 -- 172.21.15.81:0/3262271856 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0004030 con 0x7fe1b40b1eb0 2023-11-29T11:17:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.108+0000 7fe1ab7fe700 1 -- 172.21.15.81:0/3262271856 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00043c0 con 0x7fe1b40b1eb0 2023-11-29T11:17:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3262271856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1eb0 msgr2=0x7fe1b40d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 --2- 172.21.15.81:0/3262271856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1eb0 0x7fe1b40d1c70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009850 tx=0x7fe1b0009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3262271856 shutdown_connections 2023-11-29T11:17:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 --2- 172.21.15.81:0/3262271856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40b1eb0 0x7fe1b40d1c70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3262271856 >> 172.21.15.81:0/3262271856 conn(0x7fe1b409bbb0 msgr2=0x7fe1b40b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3262271856 shutdown_connections 2023-11-29T11:17:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3262271856 wait complete. 2023-11-29T11:17:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 Processor -- start 2023-11-29T11:17:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 -- start start 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b406d8e0 0x7fe1b40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40d2eb0 0x7fe1b4147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b415ac20 0x7fe1b40c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.112+0000 7fe1b9e83700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40c80d0 con 0x7fe1b415ac20 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9e83700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40c8300 con 0x7fe1b40d2eb0 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9e83700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40c85a0 con 0x7fe1b406d8e0 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b415ac20 0x7fe1b40c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b415ac20 0x7fe1b40c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51672/0 (socket says 172.21.15.81:51672) 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 -- 172.21.15.81:0/3808358614 learned_addr learned my addr 172.21.15.81:0/3808358614 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:23.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b8e81700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b406d8e0 0x7fe1b40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1abfff700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40d2eb0 0x7fe1b4147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 -- 172.21.15.81:0/3808358614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b406d8e0 msgr2=0x7fe1b40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b406d8e0 0x7fe1b40c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 -- 172.21.15.81:0/3808358614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40d2eb0 msgr2=0x7fe1b4147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40d2eb0 0x7fe1b4147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 -- 172.21.15.81:0/3808358614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00094b0 con 0x7fe1b415ac20 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9682700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b415ac20 0x7fe1b40c6200 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00cb50 tx=0x7fe1ac00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1a97fa700 1 -- 172.21.15.81:0/3808358614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac003c20 con 0x7fe1b415ac20 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1a97fa700 1 -- 172.21.15.81:0/3808358614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac003d80 con 0x7fe1b415ac20 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b40cf8c0 con 0x7fe1b415ac20 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1a97fa700 1 -- 172.21.15.81:0/3808358614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00aa20 con 0x7fe1b415ac20 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b40cf5e0 con 0x7fe1b415ac20 2023-11-29T11:17:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.116+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b4072c20 con 0x7fe1b415ac20 2023-11-29T11:17:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.120+0000 7fe1a97fa700 1 -- 172.21.15.81:0/3808358614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe1ac010050 con 0x7fe1b415ac20 2023-11-29T11:17:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.120+0000 7fe1a97fa700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1a0064f10 0x7fe1a00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.120+0000 7fe1a97fa700 1 -- 172.21.15.81:0/3808358614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe1ac081ff0 con 0x7fe1b415ac20 2023-11-29T11:17:23.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.120+0000 7fe1b8e81700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1a0064f10 0x7fe1a00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.120+0000 7fe1b8e81700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1a0064f10 0x7fe1a00673c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00090b0 tx=0x7fe1b0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.128+0000 7fe1a97fa700 1 -- 172.21.15.81:0/3808358614 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe1ac04fec0 con 0x7fe1b415ac20 2023-11-29T11:17:23.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.288+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1b40d2290 con 0x7fe1b415ac20 2023-11-29T11:17:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.288+0000 7fe1a97fa700 1 -- 172.21.15.81:0/3808358614 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe1ac0534e0 con 0x7fe1b415ac20 2023-11-29T11:17:23.296 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:17:23.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1a0064f10 msgr2=0x7fe1a00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1a0064f10 0x7fe1a00673c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00090b0 tx=0x7fe1b0008030 comp rx=0 tx=0).stop 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b415ac20 msgr2=0x7fe1b40c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b415ac20 0x7fe1b40c6200 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00cb50 tx=0x7fe1ac00ce60 comp rx=0 tx=0).stop 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 shutdown_connections 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe1a0064f10 0x7fe1a00673c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b415ac20 0x7fe1b40c6200 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b40d2eb0 0x7fe1b4147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 --2- 172.21.15.81:0/3808358614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b406d8e0 0x7fe1b40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 >> 172.21.15.81:0/3808358614 conn(0x7fe1b409bbb0 msgr2=0x7fe1b415be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 shutdown_connections 2023-11-29T11:17:23.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.292+0000 7fe1b9e83700 1 -- 172.21.15.81:0/3808358614 wait complete. 2023-11-29T11:17:23.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:17:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f0965d1f700 1 Processor -- start 2023-11-29T11:17:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f0965d1f700 1 -- start start 2023-11-29T11:17:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f0965d1f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f096006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f0965d1f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096006a9c0 con 0x7f096006a4c0 2023-11-29T11:17:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f0965d1f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096006aca0 con 0x7f09600b1ae0 2023-11-29T11:17:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f0965d1f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09600d0ab0 con 0x7f09600cf7f0 2023-11-29T11:17:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f095ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f096006a4c0 0x7f09600cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50620/0 (socket says 172.21.15.81:50620) 2023-11-29T11:17:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f095ffff700 1 -- 172.21.15.81:0/1490798301 learned_addr learned my addr 172.21.15.81:0/1490798301 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.424+0000 7f096551e700 1 --2- 172.21.15.81:0/1490798301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f096006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f095f7fe700 1 -- 172.21.15.81:0/1490798301 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725612290 0 0) 0x7f096006a9c0 con 0x7f096006a4c0 2023-11-29T11:17:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f095f7fe700 1 -- 172.21.15.81:0/1490798301 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f094c0035d0 con 0x7f096006a4c0 2023-11-29T11:17:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f095f7fe700 1 -- 172.21.15.81:0/1490798301 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895203941 0 0) 0x7f096006aca0 con 0x7f09600b1ae0 2023-11-29T11:17:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f096551e700 1 -- 172.21.15.81:0/1490798301 >> v1:172.21.15.176:6789/0 conn(0x7f09600b1ae0 legacy=0x7f09600d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f096551e700 1 -- 172.21.15.81:0/1490798301 >> v1:172.21.15.81:6789/0 conn(0x7f096006a4c0 legacy=0x7f09600cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f096551e700 1 -- 172.21.15.81:0/1490798301 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096006af80 con 0x7f09600cf7f0 2023-11-29T11:17:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f096551e700 1 --2- 172.21.15.81:0/1490798301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f096006d8e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0958009dc0 tx=0x7f095800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97c71952c1853239 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f095f7fe700 1 -- 172.21.15.81:0/1490798301 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800e070 con 0x7f09600cf7f0 2023-11-29T11:17:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f095f7fe700 1 -- 172.21.15.81:0/1490798301 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095800bb20 con 0x7f09600cf7f0 2023-11-29T11:17:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f095f7fe700 1 -- 172.21.15.81:0/1490798301 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800bed0 con 0x7f09600cf7f0 2023-11-29T11:17:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f0965d1f700 1 -- 172.21.15.81:0/1490798301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 msgr2=0x7f096006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f0965d1f700 1 --2- 172.21.15.81:0/1490798301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f096006d8e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0958009dc0 tx=0x7f095800b330 comp rx=0 tx=0).stop 2023-11-29T11:17:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f0965d1f700 1 -- 172.21.15.81:0/1490798301 shutdown_connections 2023-11-29T11:17:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f0965d1f700 1 --2- 172.21.15.81:0/1490798301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f096006d8e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f0965d1f700 1 -- 172.21.15.81:0/1490798301 >> 172.21.15.81:0/1490798301 conn(0x7f096009bbd0 msgr2=0x7f09600b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f0965d1f700 1 -- 172.21.15.81:0/1490798301 shutdown_connections 2023-11-29T11:17:23.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.428+0000 7f0965d1f700 1 -- 172.21.15.81:0/1490798301 wait complete. 2023-11-29T11:17:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f0965d1f700 1 Processor -- start 2023-11-29T11:17:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f0965d1f700 1 -- start start 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f0965d1f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096006a4c0 0x7f09600c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f0965d1f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09600b1ae0 0x7f096015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f0965d1f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f09600d2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f0965d1f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096009fea0 con 0x7f09600b1ae0 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f0965d1f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09600a0180 con 0x7f096006a4c0 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f0965d1f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09600c8780 con 0x7f09600cf7f0 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.432+0000 7f095ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09600b1ae0 0x7f096015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09600b1ae0 0x7f096015d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51676/0 (socket says 172.21.15.81:51676) 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095ffff700 1 -- 172.21.15.81:0/4088345412 learned_addr learned my addr 172.21.15.81:0/4088345412 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f0964d1d700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096006a4c0 0x7f09600c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f096551e700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f09600d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095ffff700 1 -- 172.21.15.81:0/4088345412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 msgr2=0x7f09600d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095ffff700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f09600d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095ffff700 1 -- 172.21.15.81:0/4088345412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096006a4c0 msgr2=0x7f09600c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095ffff700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096006a4c0 0x7f09600c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095ffff700 1 -- 172.21.15.81:0/4088345412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958009a70 con 0x7f09600b1ae0 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095ffff700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09600b1ae0 0x7f096015d180 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f095000c4f0 tx=0x7f095000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095d7fa700 1 -- 172.21.15.81:0/4088345412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950005d90 con 0x7f09600b1ae0 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095d7fa700 1 -- 172.21.15.81:0/4088345412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09500070d0 con 0x7f09600b1ae0 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f095d7fa700 1 -- 172.21.15.81:0/4088345412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950007440 con 0x7f09600b1ae0 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09600b1eb0 con 0x7f09600b1ae0 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09600b4380 con 0x7f09600b1ae0 2023-11-29T11:17:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.436+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09600b60e0 con 0x7f09600b1ae0 2023-11-29T11:17:23.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.440+0000 7f095d7fa700 1 -- 172.21.15.81:0/4088345412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0950019030 con 0x7f09600b1ae0 2023-11-29T11:17:23.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.440+0000 7f095d7fa700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0940064ee0 0x7f0940067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.440+0000 7f0964d1d700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0940064ee0 0x7f0940067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.440+0000 7f095d7fa700 1 -- 172.21.15.81:0/4088345412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f09500812b0 con 0x7f09600b1ae0 2023-11-29T11:17:23.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.440+0000 7f0964d1d700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0940064ee0 0x7f0940067390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0948007fd0 tx=0x7f0948009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.444+0000 7f095d7fa700 1 -- 172.21.15.81:0/4088345412 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f095004a400 con 0x7f09600b1ae0 2023-11-29T11:17:23.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.604+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09600c85e0 con 0x7f09600b1ae0 2023-11-29T11:17:23.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.604+0000 7f095d7fa700 1 -- 172.21.15.81:0/4088345412 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0950017020 con 0x7f09600b1ae0 2023-11-29T11:17:23.614 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0940064ee0 msgr2=0x7f0940067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0940064ee0 0x7f0940067390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0948007fd0 tx=0x7f0948009040 comp rx=0 tx=0).stop 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09600b1ae0 msgr2=0x7f096015d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09600b1ae0 0x7f096015d180 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f095000c4f0 tx=0x7f095000c800 comp rx=0 tx=0).stop 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 shutdown_connections 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0940064ee0 0x7f0940067390 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09600cf7f0 0x7f09600d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09600b1ae0 0x7f096015d180 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 --2- 172.21.15.81:0/4088345412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f096006a4c0 0x7f09600c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 >> 172.21.15.81:0/4088345412 conn(0x7f096009bbd0 msgr2=0x7f096015bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 shutdown_connections 2023-11-29T11:17:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.608+0000 7f0965d1f700 1 -- 172.21.15.81:0/4088345412 wait complete. 2023-11-29T11:17:23.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:17:23.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f95dd700 1 Processor -- start 2023-11-29T11:17:23.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f95dd700 1 -- start start 2023-11-29T11:17:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f95dd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24f40ac1f0 0x7f24f40cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f95dd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f40b0910 con 0x7f24f415c520 2023-11-29T11:17:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f95dd700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f40ccc70 con 0x7f24f40cc830 2023-11-29T11:17:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f95dd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f406a470 con 0x7f24f40ac1f0 2023-11-29T11:17:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24f40ac1f0 0x7f24f40cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f24f415c520 0x7f24f4069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50626/0 (socket says 172.21.15.81:50626) 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24f40ac1f0 0x7f24f40cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51684/0 (socket says 172.21.15.81:51684) 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f3fff700 1 -- 172.21.15.81:0/3134507296 learned_addr learned my addr 172.21.15.81:0/3134507296 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f2ffd700 1 -- 172.21.15.81:0/3134507296 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513775986 0 0) 0x7f24f40b0910 con 0x7f24f415c520 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f2ffd700 1 -- 172.21.15.81:0/3134507296 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24dc0035d0 con 0x7f24f415c520 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f37fe700 1 -- 172.21.15.81:0/3134507296 >> v1:172.21.15.176:6789/0 conn(0x7f24f40cc830 legacy=0x7f24f40b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f37fe700 1 -- 172.21.15.81:0/3134507296 >> v1:172.21.15.81:6789/0 conn(0x7f24f415c520 legacy=0x7f24f4069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f37fe700 1 -- 172.21.15.81:0/3134507296 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f406a750 con 0x7f24f40ac1f0 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f37fe700 1 --2- 172.21.15.81:0/3134507296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40ac1f0 0x7f24f40cc2f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009880 tx=0x7f24e8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39048039c8eb7c8d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f2ffd700 1 -- 172.21.15.81:0/3134507296 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8011830 con 0x7f24f40ac1f0 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f2ffd700 1 -- 172.21.15.81:0/3134507296 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e8011990 con 0x7f24f40ac1f0 2023-11-29T11:17:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.744+0000 7f24f2ffd700 1 -- 172.21.15.81:0/3134507296 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8011d20 con 0x7f24f40ac1f0 2023-11-29T11:17:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 -- 172.21.15.81:0/3134507296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40ac1f0 msgr2=0x7f24f40cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 --2- 172.21.15.81:0/3134507296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40ac1f0 0x7f24f40cc2f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009880 tx=0x7f24e8009b90 comp rx=0 tx=0).stop 2023-11-29T11:17:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 -- 172.21.15.81:0/3134507296 shutdown_connections 2023-11-29T11:17:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 --2- 172.21.15.81:0/3134507296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40ac1f0 0x7f24f40cc2f0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 -- 172.21.15.81:0/3134507296 >> 172.21.15.81:0/3134507296 conn(0x7f24f40cae70 msgr2=0x7f24f40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 -- 172.21.15.81:0/3134507296 shutdown_connections 2023-11-29T11:17:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 -- 172.21.15.81:0/3134507296 wait complete. 2023-11-29T11:17:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 Processor -- start 2023-11-29T11:17:23.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.748+0000 7f24f95dd700 1 -- start start 2023-11-29T11:17:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24f40ac1f0 0x7f24f415c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40cc830 0x7f24f409b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24f415c520 0x7f24f406c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f415f300 con 0x7f24f40cc830 2023-11-29T11:17:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f415f790 con 0x7f24f415c520 2023-11-29T11:17:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f415e6f0 con 0x7f24f40ac1f0 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40cc830 0x7f24f409b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24f40ac1f0 0x7f24f415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40cc830 0x7f24f409b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51690/0 (socket says 172.21.15.81:51690) 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 -- 172.21.15.81:0/2779576341 learned_addr learned my addr 172.21.15.81:0/2779576341 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f8ddc700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24f415c520 0x7f24f406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 -- 172.21.15.81:0/2779576341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24f40ac1f0 msgr2=0x7f24f415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24f40ac1f0 0x7f24f415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 -- 172.21.15.81:0/2779576341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24f415c520 msgr2=0x7f24f406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24f415c520 0x7f24f406c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 -- 172.21.15.81:0/2779576341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e80094b0 con 0x7f24f40cc830 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f8ddc700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24f415c520 0x7f24f406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f37fe700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40cc830 0x7f24f409b170 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f24e80097d0 tx=0x7f24e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f0ff9700 1 -- 172.21.15.81:0/2779576341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e80036c0 con 0x7f24f40cc830 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f0ff9700 1 -- 172.21.15.81:0/2779576341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e801e070 con 0x7f24f40cc830 2023-11-29T11:17:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f406ad10 con 0x7f24f40cc830 2023-11-29T11:17:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f0ff9700 1 -- 172.21.15.81:0/2779576341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8003a60 con 0x7f24f40cc830 2023-11-29T11:17:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f406aa30 con 0x7f24f40cc830 2023-11-29T11:17:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.752+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f406aff0 con 0x7f24f40cc830 2023-11-29T11:17:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.756+0000 7f24f0ff9700 1 -- 172.21.15.81:0/2779576341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f24e800f050 con 0x7f24f40cc830 2023-11-29T11:17:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.756+0000 7f24f0ff9700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24e0064ee0 0x7f24e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.756+0000 7f24f0ff9700 1 -- 172.21.15.81:0/2779576341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f24e8082ff0 con 0x7f24f40cc830 2023-11-29T11:17:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.756+0000 7f24f3fff700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24e0064ee0 0x7f24e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.756+0000 7f24f3fff700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24e0064ee0 0x7f24e0067390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f24e4007fd0 tx=0x7f24e4007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:23.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.764+0000 7f24f0ff9700 1 -- 172.21.15.81:0/2779576341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f24e80b3400 con 0x7f24f40cc830 2023-11-29T11:17:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.924+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24f4072500 con 0x7f24f40cc830 2023-11-29T11:17:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.924+0000 7f24f0ff9700 1 -- 172.21.15.81:0/2779576341 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24e8050ee0 con 0x7f24f40cc830 2023-11-29T11:17:23.933 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:17:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24e0064ee0 msgr2=0x7f24e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24e0064ee0 0x7f24e0067390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f24e4007fd0 tx=0x7f24e4007de0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40cc830 msgr2=0x7f24f409b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40cc830 0x7f24f409b170 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f24e80097d0 tx=0x7f24e8004770 comp rx=0 tx=0).stop 2023-11-29T11:17:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 shutdown_connections 2023-11-29T11:17:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24e0064ee0 0x7f24e0067390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24f415c520 0x7f24f406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40cc830 0x7f24f409b170 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 --2- 172.21.15.81:0/2779576341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24f40ac1f0 0x7f24f415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 >> 172.21.15.81:0/2779576341 conn(0x7f24f40cae70 msgr2=0x7f24f406d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 shutdown_connections 2023-11-29T11:17:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:23.928+0000 7f24f95dd700 1 -- 172.21.15.81:0/2779576341 wait complete. 2023-11-29T11:17:23.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:17:24.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.052+0000 7fc4108de700 1 Processor -- start 2023-11-29T11:17:24.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.052+0000 7fc4108de700 1 -- start start 2023-11-29T11:17:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc40c0b00e0 0x7fc40c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c09bdb0 0x7fc40c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc40c0cbb30 0x7fc40c15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0b2db0 con 0x7fc40c0cbb30 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0b3240 con 0x7fc40c0b00e0 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c06d840 con 0x7fc40c09bdb0 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc40c0cbb30 0x7fc40c15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc40c0cbb30 0x7fc40c15dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51702/0 (socket says 172.21.15.81:51702) 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 -- 172.21.15.81:0/545398747 learned_addr learned my addr 172.21.15.81:0/545398747 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40a59c700 1 --2- 172.21.15.81:0/545398747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c09bdb0 0x7fc40c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40ad9d700 1 --2- 172.21.15.81:0/545398747 >> v2:172.21.15.176:3300/0 conn(0x7fc40c0b00e0 0x7fc40c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 -- 172.21.15.81:0/545398747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c09bdb0 msgr2=0x7fc40c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 --2- 172.21.15.81:0/545398747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c09bdb0 0x7fc40c15d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 -- 172.21.15.81:0/545398747 >> v2:172.21.15.176:3300/0 conn(0x7fc40c0b00e0 msgr2=0x7fc40c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 --2- 172.21.15.81:0/545398747 >> v2:172.21.15.176:3300/0 conn(0x7fc40c0b00e0 0x7fc40c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 -- 172.21.15.81:0/545398747 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c06d560 con 0x7fc40c0cbb30 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40a59c700 1 --2- 172.21.15.81:0/545398747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c09bdb0 0x7fc40c15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc40b59e700 1 --2- 172.21.15.81:0/545398747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0cbb30 0x7fc40c15dd60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc40c06fbf0 tx=0x7fc3fc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508f4ca19da4246a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc409d9b700 1 -- 172.21.15.81:0/545398747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00b8a0 con 0x7fc40c0cbb30 2023-11-29T11:17:24.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc409d9b700 1 -- 172.21.15.81:0/545398747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc00ba00 con 0x7fc40c0cbb30 2023-11-29T11:17:24.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc409d9b700 1 -- 172.21.15.81:0/545398747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00bd90 con 0x7fc40c0cbb30 2023-11-29T11:17:24.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 -- 172.21.15.81:0/545398747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0cbb30 msgr2=0x7fc40c15dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 --2- 172.21.15.81:0/545398747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0cbb30 0x7fc40c15dd60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc40c06fbf0 tx=0x7fc3fc009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 -- 172.21.15.81:0/545398747 shutdown_connections 2023-11-29T11:17:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 --2- 172.21.15.81:0/545398747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c09bdb0 0x7fc40c15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 --2- 172.21.15.81:0/545398747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0cbb30 0x7fc40c15dd60 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 --2- 172.21.15.81:0/545398747 >> v2:172.21.15.176:3300/0 conn(0x7fc40c0b00e0 0x7fc40c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 -- 172.21.15.81:0/545398747 >> 172.21.15.81:0/545398747 conn(0x7fc40c0cae70 msgr2=0x7fc40c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 -- 172.21.15.81:0/545398747 shutdown_connections 2023-11-29T11:17:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.056+0000 7fc4108de700 1 -- 172.21.15.81:0/545398747 wait complete. 2023-11-29T11:17:24.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.060+0000 7fc4108de700 1 Processor -- start 2023-11-29T11:17:24.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.060+0000 7fc4108de700 1 -- start start 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.060+0000 7fc4108de700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc40c09bdb0 0x7fc40c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.060+0000 7fc4108de700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0b00e0 0x7fc40c0c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.060+0000 7fc4108de700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c0cbb30 0x7fc40c0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.060+0000 7fc4108de700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0c4960 con 0x7fc40c0b00e0 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.060+0000 7fc4108de700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0c4c30 con 0x7fc40c09bdb0 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.060+0000 7fc4108de700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0c1f20 con 0x7fc40c0cbb30 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0b00e0 0x7fc40c0c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0b00e0 0x7fc40c0c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51714/0 (socket says 172.21.15.81:51714) 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 -- 172.21.15.81:0/897799530 learned_addr learned my addr 172.21.15.81:0/897799530 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40b59e700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c0cbb30 0x7fc40c0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40ad9d700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc40c09bdb0 0x7fc40c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 -- 172.21.15.81:0/897799530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c0cbb30 msgr2=0x7fc40c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c0cbb30 0x7fc40c0c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 -- 172.21.15.81:0/897799530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc40c09bdb0 msgr2=0x7fc40c155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc40c09bdb0 0x7fc40c155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 -- 172.21.15.81:0/897799530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc009570 con 0x7fc40c0b00e0 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc40a59c700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0b00e0 0x7fc40c0c3ee0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc404007de0 tx=0x7fc40400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc3f37fe700 1 -- 172.21.15.81:0/897799530 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40400dd20 con 0x7fc40c0b00e0 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc3f37fe700 1 -- 172.21.15.81:0/897799530 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40400f040 con 0x7fc40c0b00e0 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c0ac3d0 con 0x7fc40c0b00e0 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc3f37fe700 1 -- 172.21.15.81:0/897799530 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404003c60 con 0x7fc40c0b00e0 2023-11-29T11:17:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c0ac0f0 con 0x7fc40c0b00e0 2023-11-29T11:17:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc3f37fe700 1 -- 172.21.15.81:0/897799530 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc40401c030 con 0x7fc40c0b00e0 2023-11-29T11:17:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.064+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c0cc9f0 con 0x7fc40c0b00e0 2023-11-29T11:17:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.068+0000 7fc3f37fe700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3f8064ee0 0x7fc3f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.068+0000 7fc3f37fe700 1 -- 172.21.15.81:0/897799530 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc404081e80 con 0x7fc40c0b00e0 2023-11-29T11:17:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.068+0000 7fc40ad9d700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3f8064ee0 0x7fc3f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.068+0000 7fc40ad9d700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3f8064ee0 0x7fc3f8067390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc40c15ce10 tx=0x7fc400008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.072+0000 7fc3f37fe700 1 -- 172.21.15.81:0/897799530 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc40404d400 con 0x7fc40c0b00e0 2023-11-29T11:17:24.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.232+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc40c072500 con 0x7fc40c0b00e0 2023-11-29T11:17:24.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.232+0000 7fc3f37fe700 1 -- 172.21.15.81:0/897799530 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc40401a020 con 0x7fc40c0b00e0 2023-11-29T11:17:24.240 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3f8064ee0 msgr2=0x7fc3f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3f8064ee0 0x7fc3f8067390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc40c15ce10 tx=0x7fc400008040 comp rx=0 tx=0).stop 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0b00e0 msgr2=0x7fc40c0c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0b00e0 0x7fc40c0c3ee0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc404007de0 tx=0x7fc40400d3b0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 shutdown_connections 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3f8064ee0 0x7fc3f8067390 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc40c0cbb30 0x7fc40c0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc40c0b00e0 0x7fc40c0c3ee0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 --2- 172.21.15.81:0/897799530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc40c09bdb0 0x7fc40c155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 >> 172.21.15.81:0/897799530 conn(0x7fc40c0cae70 msgr2=0x7fc40c06ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:24.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 shutdown_connections 2023-11-29T11:17:24.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.236+0000 7fc4108de700 1 -- 172.21.15.81:0/897799530 wait complete. 2023-11-29T11:17:24.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:17:24.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.356+0000 7f90f359e700 1 Processor -- start 2023-11-29T11:17:24.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.356+0000 7f90f359e700 1 -- start start 2023-11-29T11:17:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f40cb460 0x7f90f40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90f40ad490 0x7f90f40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f40cd8f0 con 0x7f90f4158e60 2023-11-29T11:17:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40add00 con 0x7f90f40ad490 2023-11-29T11:17:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40cc4f0 con 0x7f90f40cb460 2023-11-29T11:17:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90f40ad490 0x7f90f40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f2d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90f40ad490 0x7f90f40cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51716/0 (socket says 172.21.15.81:51716) 2023-11-29T11:17:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f2d9d700 1 -- 172.21.15.81:0/528287064 learned_addr learned my addr 172.21.15.81:0/528287064 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f1d9b700 1 --2- 172.21.15.81:0/528287064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f40cb460 0x7f90f40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f2d9d700 1 -- 172.21.15.81:0/528287064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f40cb460 msgr2=0x7f90f40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f2d9d700 1 --2- 172.21.15.81:0/528287064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f40cb460 0x7f90f40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f2d9d700 1 -- 172.21.15.81:0/528287064 >> v1:172.21.15.176:6789/0 conn(0x7f90f4158e60 legacy=0x7f90f40cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f2d9d700 1 -- 172.21.15.81:0/528287064 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f406dc60 con 0x7f90f40ad490 2023-11-29T11:17:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f2d9d700 1 --2- 172.21.15.81:0/528287064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40ad490 0x7f90f40cbfb0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009970 tx=0x7f90ec009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1b9e918222121b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f159a700 1 -- 172.21.15.81:0/528287064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec011830 con 0x7f90f40ad490 2023-11-29T11:17:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f159a700 1 -- 172.21.15.81:0/528287064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec011990 con 0x7f90f40ad490 2023-11-29T11:17:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f159a700 1 -- 172.21.15.81:0/528287064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec011d20 con 0x7f90f40ad490 2023-11-29T11:17:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 -- 172.21.15.81:0/528287064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40ad490 msgr2=0x7f90f40cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 --2- 172.21.15.81:0/528287064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40ad490 0x7f90f40cbfb0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009970 tx=0x7f90ec009c80 comp rx=0 tx=0).stop 2023-11-29T11:17:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 -- 172.21.15.81:0/528287064 shutdown_connections 2023-11-29T11:17:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 --2- 172.21.15.81:0/528287064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40ad490 0x7f90f40cbfb0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 --2- 172.21.15.81:0/528287064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f40cb460 0x7f90f40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 -- 172.21.15.81:0/528287064 >> 172.21.15.81:0/528287064 conn(0x7f90f40ce3e0 msgr2=0x7f90f40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 -- 172.21.15.81:0/528287064 shutdown_connections 2023-11-29T11:17:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.360+0000 7f90f359e700 1 -- 172.21.15.81:0/528287064 wait complete. 2023-11-29T11:17:24.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 Processor -- start 2023-11-29T11:17:24.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 -- start start 2023-11-29T11:17:24.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90f40ad490 0x7f90f41f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40cb460 0x7f90f40c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f4158e60 0x7f90f4155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40c6480 con 0x7f90f40cb460 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f41f2230 con 0x7f90f40ad490 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f41f2510 con 0x7f90f4158e60 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40cb460 0x7f90f40c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40cb460 0x7f90f40c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51718/0 (socket says 172.21.15.81:51718) 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 -- 172.21.15.81:0/1442155977 learned_addr learned my addr 172.21.15.81:0/1442155977 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f2d9d700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f4158e60 0x7f90f4155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f259c700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90f40ad490 0x7f90f41f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 -- 172.21.15.81:0/1442155977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f4158e60 msgr2=0x7f90f4155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f4158e60 0x7f90f4155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 -- 172.21.15.81:0/1442155977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90f40ad490 msgr2=0x7f90f41f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90f40ad490 0x7f90f41f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 -- 172.21.15.81:0/1442155977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009570 con 0x7f90f40cb460 2023-11-29T11:17:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f1d9b700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40cb460 0x7f90f40c4390 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e580 tx=0x7f90e400e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90e2ffd700 1 -- 172.21.15.81:0/1442155977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4012630 con 0x7f90f40cb460 2023-11-29T11:17:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90e2ffd700 1 -- 172.21.15.81:0/1442155977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e40127b0 con 0x7f90f40cb460 2023-11-29T11:17:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.364+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f4159230 con 0x7f90f40cb460 2023-11-29T11:17:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.368+0000 7f90e2ffd700 1 -- 172.21.15.81:0/1442155977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4012b60 con 0x7f90f40cb460 2023-11-29T11:17:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.368+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f40cde90 con 0x7f90f40cb460 2023-11-29T11:17:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.368+0000 7f90e2ffd700 1 -- 172.21.15.81:0/1442155977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f90e4012cc0 con 0x7f90f40cb460 2023-11-29T11:17:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.368+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f406d6a0 con 0x7f90f40cb460 2023-11-29T11:17:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.368+0000 7f90e2ffd700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90d4064ee0 0x7f90d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.368+0000 7f90f259c700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90d4064ee0 0x7f90d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.368+0000 7f90e2ffd700 1 -- 172.21.15.81:0/1442155977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f90e4016070 con 0x7f90f40cb460 2023-11-29T11:17:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.368+0000 7f90f259c700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90d4064ee0 0x7f90d4067390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000f60 tx=0x7f90e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.376+0000 7f90e2ffd700 1 -- 172.21.15.81:0/1442155977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f90e40532a0 con 0x7f90f40cb460 2023-11-29T11:17:24.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.552+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90f40c65c0 con 0x7f90f40cb460 2023-11-29T11:17:24.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90e2ffd700 1 -- 172.21.15.81:0/1442155977 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f90f40c65c0 con 0x7f90f40cb460 2023-11-29T11:17:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90d4064ee0 msgr2=0x7f90d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90d4064ee0 0x7f90d4067390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000f60 tx=0x7f90e8009040 comp rx=0 tx=0).stop 2023-11-29T11:17:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40cb460 msgr2=0x7f90f40c4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40cb460 0x7f90f40c4390 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e580 tx=0x7f90e400e890 comp rx=0 tx=0).stop 2023-11-29T11:17:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 shutdown_connections 2023-11-29T11:17:24.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90d4064ee0 0x7f90d4067390 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90f4158e60 0x7f90f4155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f40cb460 0x7f90f40c4390 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 --2- 172.21.15.81:0/1442155977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90f40ad490 0x7f90f41f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 >> 172.21.15.81:0/1442155977 conn(0x7f90f40ce3e0 msgr2=0x7f90f40ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 shutdown_connections 2023-11-29T11:17:24.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.556+0000 7f90f359e700 1 -- 172.21.15.81:0/1442155977 wait complete. 2023-11-29T11:17:24.566 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:17:24.576 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:17:24.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:24.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:17:24.590 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[52645]: fuse finished with error 0 and tester_r 0 2023-11-29T11:17:24.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:17:24.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:24.591 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:17:24.663 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:17:24.663 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:24.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:17:24.668 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:17:24.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:24.669 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-29T11:17:24.673 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-29T11:17:24.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:17:24.674 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:17:24.674 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:24.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:17:24.680 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:17:24.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:24.680 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-29T11:17:24.686 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-29T11:17:24.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:17:24.687 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:17:24.687 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:24.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:17:24.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:17:24.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:24.694 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-29T11:17:24.741 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-29T11:17:24.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:17:24.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:24.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2483fff700 1 Processor -- start 2023-11-29T11:17:24.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2483fff700 1 -- start start 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2483fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 0x7f24840cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2483fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24840cc430 0x7f24840ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2483fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248415c520 con 0x7f248415c150 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2483fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2484160c00 con 0x7f24840cc430 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2483fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840ca680 con 0x7f24841607b0 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f24837fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24840cc430 0x7f24840ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2482ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f248415c150 0x7f24840c9e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50642/0 (socket says 172.21.15.81:50642) 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f2482ffd700 1 -- 172.21.15.81:0/1555657440 learned_addr learned my addr 172.21.15.81:0/1555657440 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:24.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f24827fc700 1 --2- 172.21.15.81:0/1555657440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 0x7f24840cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f24837fe700 1 -- 172.21.15.81:0/1555657440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 msgr2=0x7f24840cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:24.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f24837fe700 1 --2- 172.21.15.81:0/1555657440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 0x7f24840cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f24837fe700 1 -- 172.21.15.81:0/1555657440 >> v1:172.21.15.81:6789/0 conn(0x7f248415c150 legacy=0x7f24840c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f24837fe700 1 -- 172.21.15.81:0/1555657440 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24840ca960 con 0x7f24840cc430 2023-11-29T11:17:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.852+0000 7f24837fe700 1 --2- 172.21.15.81:0/1555657440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840ce320 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f247c009850 tx=0x7f247c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921192bbb72cbe12 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2481ffb700 1 -- 172.21.15.81:0/1555657440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c011830 con 0x7f24840cc430 2023-11-29T11:17:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2481ffb700 1 -- 172.21.15.81:0/1555657440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c011990 con 0x7f24840cc430 2023-11-29T11:17:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2481ffb700 1 -- 172.21.15.81:0/1555657440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c011d40 con 0x7f24840cc430 2023-11-29T11:17:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 -- 172.21.15.81:0/1555657440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 msgr2=0x7f24840ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 --2- 172.21.15.81:0/1555657440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840ce320 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f247c009850 tx=0x7f247c009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 -- 172.21.15.81:0/1555657440 shutdown_connections 2023-11-29T11:17:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 --2- 172.21.15.81:0/1555657440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840ce320 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 --2- 172.21.15.81:0/1555657440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 0x7f24840cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 -- 172.21.15.81:0/1555657440 >> 172.21.15.81:0/1555657440 conn(0x7f248406ec40 msgr2=0x7f24840b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 -- 172.21.15.81:0/1555657440 shutdown_connections 2023-11-29T11:17:24.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 -- 172.21.15.81:0/1555657440 wait complete. 2023-11-29T11:17:24.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 Processor -- start 2023-11-29T11:17:24.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.856+0000 7f2483fff700 1 -- start start 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248415c150 0x7f24841f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 0x7f24841f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24841f2390 con 0x7f24840cc430 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c3140 con 0x7f248415c150 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c33e0 con 0x7f24841607b0 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51738/0 (socket says 172.21.15.81:51738) 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 -- 172.21.15.81:0/1808655268 learned_addr learned my addr 172.21.15.81:0/1808655268 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f24837fe700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 0x7f24841f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f24827fc700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248415c150 0x7f24841f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 -- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 msgr2=0x7f24841f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 0x7f24841f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 -- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248415c150 msgr2=0x7f24841f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:24.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248415c150 0x7f24841f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:24.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 -- 172.21.15.81:0/1808655268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0094b0 con 0x7f24840cc430 2023-11-29T11:17:24.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f24827fc700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248415c150 0x7f24841f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:24.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2482ffd700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840b4f30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f246c00c700 tx=0x7f246c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f247b7fe700 1 -- 172.21.15.81:0/1808655268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c005d90 con 0x7f24840cc430 2023-11-29T11:17:24.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f247b7fe700 1 -- 172.21.15.81:0/1808655268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c0070d0 con 0x7f24840cc430 2023-11-29T11:17:24.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24840cdb20 con 0x7f24840cc430 2023-11-29T11:17:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f247b7fe700 1 -- 172.21.15.81:0/1808655268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c007440 con 0x7f24840cc430 2023-11-29T11:17:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24840cd840 con 0x7f24840cc430 2023-11-29T11:17:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24840cde00 con 0x7f24840cc430 2023-11-29T11:17:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.860+0000 7f247b7fe700 1 -- 172.21.15.81:0/1808655268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f246c019030 con 0x7f24840cc430 2023-11-29T11:17:24.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.864+0000 7f247b7fe700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2468064ee0 0x7f2468067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:24.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.864+0000 7f24827fc700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2468064ee0 0x7f2468067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:24.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.864+0000 7f247b7fe700 1 -- 172.21.15.81:0/1808655268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f246c081310 con 0x7f24840cc430 2023-11-29T11:17:24.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.864+0000 7f24827fc700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2468064ee0 0x7f2468067390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f24840ceef0 tx=0x7f247400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:24.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:24.872+0000 7f247b7fe700 1 -- 172.21.15.81:0/1808655268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f246c04a400 con 0x7f24840cc430 2023-11-29T11:17:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.068+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2484072c20 con 0x7f24840cc430 2023-11-29T11:17:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.068+0000 7f247b7fe700 1 -- 172.21.15.81:0/1808655268 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f246c056e60 con 0x7f24840cc430 2023-11-29T11:17:25.076 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:25.076 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:56.032848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:17:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2468064ee0 msgr2=0x7f2468067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2468064ee0 0x7f2468067390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f24840ceef0 tx=0x7f247400b040 comp rx=0 tx=0).stop 2023-11-29T11:17:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 msgr2=0x7f24840b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840b4f30 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f246c00c700 tx=0x7f246c00ca10 comp rx=0 tx=0).stop 2023-11-29T11:17:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 shutdown_connections 2023-11-29T11:17:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2468064ee0 0x7f2468067390 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24841607b0 0x7f24841f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248415c150 0x7f24841f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 --2- 172.21.15.81:0/1808655268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24840cc430 0x7f24840b4f30 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 >> 172.21.15.81:0/1808655268 conn(0x7f248406ec40 msgr2=0x7f24840c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 shutdown_connections 2023-11-29T11:17:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.072+0000 7f2483fff700 1 -- 172.21.15.81:0/1808655268 wait complete. 2023-11-29T11:17:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2023-11-29T11:17:25.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4236aac700 1 Processor -- start 2023-11-29T11:17:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4236aac700 1 -- start start 2023-11-29T11:17:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4236aac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42301606b0 0x7f42300c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4236aac700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300ceef0 0x7f42300c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4236aac700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42300cae70 con 0x7f42300ad610 2023-11-29T11:17:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4236aac700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42300cbc10 con 0x7f42301606b0 2023-11-29T11:17:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4236aac700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300cb130 con 0x7f42300ceef0 2023-11-29T11:17:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4235aaa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42301606b0 0x7f42300c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4235aaa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42301606b0 0x7f42300c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51750/0 (socket says 172.21.15.81:51750) 2023-11-29T11:17:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4235aaa700 1 -- 172.21.15.81:0/3703350697 learned_addr learned my addr 172.21.15.81:0/3703350697 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f42352a9700 1 --2- 172.21.15.81:0/3703350697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300ceef0 0x7f42300c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4235aaa700 1 -- 172.21.15.81:0/3703350697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300ceef0 msgr2=0x7f42300c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4235aaa700 1 --2- 172.21.15.81:0/3703350697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300ceef0 0x7f42300c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4235aaa700 1 -- 172.21.15.81:0/3703350697 >> v1:172.21.15.176:6789/0 conn(0x7f42300ad610 legacy=0x7f4230164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4235aaa700 1 -- 172.21.15.81:0/3703350697 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300cb410 con 0x7f42301606b0 2023-11-29T11:17:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4235aaa700 1 --2- 172.21.15.81:0/3703350697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42301606b0 0x7f42300c13b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f422c009910 tx=0x7f422c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c647cdfe0f379ff server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4234aa8700 1 -- 172.21.15.81:0/3703350697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c011830 con 0x7f42301606b0 2023-11-29T11:17:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4234aa8700 1 -- 172.21.15.81:0/3703350697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c011990 con 0x7f42301606b0 2023-11-29T11:17:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.200+0000 7f4234aa8700 1 -- 172.21.15.81:0/3703350697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c011d40 con 0x7f42301606b0 2023-11-29T11:17:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 -- 172.21.15.81:0/3703350697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42301606b0 msgr2=0x7f42300c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 --2- 172.21.15.81:0/3703350697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42301606b0 0x7f42300c13b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f422c009910 tx=0x7f422c009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 -- 172.21.15.81:0/3703350697 shutdown_connections 2023-11-29T11:17:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 --2- 172.21.15.81:0/3703350697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42300ceef0 0x7f42300c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 --2- 172.21.15.81:0/3703350697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42301606b0 0x7f42300c13b0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 -- 172.21.15.81:0/3703350697 >> 172.21.15.81:0/3703350697 conn(0x7f42300ce3e0 msgr2=0x7f42300ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 -- 172.21.15.81:0/3703350697 shutdown_connections 2023-11-29T11:17:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 -- 172.21.15.81:0/3703350697 wait complete. 2023-11-29T11:17:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 Processor -- start 2023-11-29T11:17:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.204+0000 7f4236aac700 1 -- start start 2023-11-29T11:17:25.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300ad610 0x7f42300ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42300ceef0 0x7f42300af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42301606b0 0x7f423015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300afab0 con 0x7f42300ceef0 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300afd90 con 0x7f42300ad610 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300b0070 con 0x7f42301606b0 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42300ceef0 0x7f42300af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42300ceef0 0x7f42300af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51758/0 (socket says 172.21.15.81:51758) 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 -- 172.21.15.81:0/587994001 learned_addr learned my addr 172.21.15.81:0/587994001 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4235aaa700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300ad610 0x7f42300ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42362ab700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42301606b0 0x7f423015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 -- 172.21.15.81:0/587994001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42301606b0 msgr2=0x7f423015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42301606b0 0x7f423015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 -- 172.21.15.81:0/587994001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300ad610 msgr2=0x7f42300ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300ad610 0x7f42300ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 -- 172.21.15.81:0/587994001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009570 con 0x7f42300ceef0 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42352a9700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42300ceef0 0x7f42300af0f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f422000e840 tx=0x7f422000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42267fc700 1 -- 172.21.15.81:0/587994001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200095a0 con 0x7f42300ceef0 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42267fc700 1 -- 172.21.15.81:0/587994001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220013680 con 0x7f42300ceef0 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423006ac50 con 0x7f42300ceef0 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f42267fc700 1 -- 172.21.15.81:0/587994001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200139f0 con 0x7f42300ceef0 2023-11-29T11:17:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42300cb6f0 con 0x7f42300ceef0 2023-11-29T11:17:25.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.208+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42300b3680 con 0x7f42300ceef0 2023-11-29T11:17:25.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.212+0000 7f42267fc700 1 -- 172.21.15.81:0/587994001 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4220019030 con 0x7f42300ceef0 2023-11-29T11:17:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.212+0000 7f42267fc700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4214064ee0 0x7f4214067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.212+0000 7f4235aaa700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4214064ee0 0x7f4214067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.212+0000 7f42267fc700 1 -- 172.21.15.81:0/587994001 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4220082560 con 0x7f42300ceef0 2023-11-29T11:17:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.212+0000 7f4235aaa700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4214064ee0 0x7f4214067390 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f422c014040 tx=0x7f422c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.220+0000 7f42267fc700 1 -- 172.21.15.81:0/587994001 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4220050510 con 0x7f42300ceef0 2023-11-29T11:17:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.384+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4230072500 con 0x7f42300ceef0 2023-11-29T11:17:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.384+0000 7f42267fc700 1 -- 172.21.15.81:0/587994001 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18127 (secure 0 0 0) 0x7f4220053b30 con 0x7f42300ceef0 2023-11-29T11:17:25.394 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:25.394 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:16:44.055201+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:16:05.224956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-29T11:16:06.381228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4214064ee0 msgr2=0x7f4214067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4214064ee0 0x7f4214067390 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f422c014040 tx=0x7f422c008030 comp rx=0 tx=0).stop 2023-11-29T11:17:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42300ceef0 msgr2=0x7f42300af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42300ceef0 0x7f42300af0f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f422000e840 tx=0x7f422000eb50 comp rx=0 tx=0).stop 2023-11-29T11:17:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 shutdown_connections 2023-11-29T11:17:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4214064ee0 0x7f4214067390 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42301606b0 0x7f423015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42300ceef0 0x7f42300af0f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 --2- 172.21.15.81:0/587994001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42300ad610 0x7f42300ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 >> 172.21.15.81:0/587994001 conn(0x7f42300ce3e0 msgr2=0x7f4230070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 shutdown_connections 2023-11-29T11:17:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.388+0000 7f4236aac700 1 -- 172.21.15.81:0/587994001 wait complete. 2023-11-29T11:17:25.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:16:05.224956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:16:06.381228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:17:25.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:17:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e7fff700 1 Processor -- start 2023-11-29T11:17:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e7fff700 1 -- start start 2023-11-29T11:17:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49e80b1ae0 0x7f49e806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f49e806a4c0 0x7f49e80d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e7fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e806a9c0 con 0x7f49e80cf0e0 2023-11-29T11:17:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e7fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e806aca0 con 0x7f49e80b1ae0 2023-11-29T11:17:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e7fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e806af80 con 0x7f49e806a4c0 2023-11-29T11:17:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49e80b1ae0 0x7f49e806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49e80b1ae0 0x7f49e806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51772/0 (socket says 172.21.15.81:51772) 2023-11-29T11:17:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e6ffd700 1 -- 172.21.15.81:0/3585747402 learned_addr learned my addr 172.21.15.81:0/3585747402 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.524+0000 7f49e67fc700 1 --2- 172.21.15.81:0/3585747402 >> v2:172.21.15.176:3300/0 conn(0x7f49e806a4c0 0x7f49e80d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e6ffd700 1 -- 172.21.15.81:0/3585747402 >> v2:172.21.15.176:3300/0 conn(0x7f49e806a4c0 msgr2=0x7f49e80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e6ffd700 1 --2- 172.21.15.81:0/3585747402 >> v2:172.21.15.176:3300/0 conn(0x7f49e806a4c0 0x7f49e80d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e6ffd700 1 -- 172.21.15.81:0/3585747402 >> v1:172.21.15.176:6789/0 conn(0x7f49e80cf0e0 legacy=0x7f49e80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e6ffd700 1 -- 172.21.15.81:0/3585747402 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80b4380 con 0x7f49e80b1ae0 2023-11-29T11:17:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e6ffd700 1 --2- 172.21.15.81:0/3585747402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80b1ae0 0x7f49e806d8e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f49e80b88d0 tx=0x7f49dc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892dcb8a1666cc25 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e5ffb700 1 -- 172.21.15.81:0/3585747402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc011830 con 0x7f49e80b1ae0 2023-11-29T11:17:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e5ffb700 1 -- 172.21.15.81:0/3585747402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc011990 con 0x7f49e80b1ae0 2023-11-29T11:17:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e5ffb700 1 -- 172.21.15.81:0/3585747402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc011d20 con 0x7f49e80b1ae0 2023-11-29T11:17:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 -- 172.21.15.81:0/3585747402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80b1ae0 msgr2=0x7f49e806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3585747402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80b1ae0 0x7f49e806d8e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f49e80b88d0 tx=0x7f49dc009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 -- 172.21.15.81:0/3585747402 shutdown_connections 2023-11-29T11:17:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3585747402 >> v2:172.21.15.176:3300/0 conn(0x7f49e806a4c0 0x7f49e80d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3585747402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80b1ae0 0x7f49e806d8e0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 -- 172.21.15.81:0/3585747402 >> 172.21.15.81:0/3585747402 conn(0x7f49e809bbd0 msgr2=0x7f49e80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 -- 172.21.15.81:0/3585747402 shutdown_connections 2023-11-29T11:17:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 -- 172.21.15.81:0/3585747402 wait complete. 2023-11-29T11:17:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.528+0000 7f49e7fff700 1 Processor -- start 2023-11-29T11:17:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 -- start start 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e806a4c0 0x7f49e8156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e80b1ae0 0x7f49e80c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80cf0e0 0x7f49e81f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80c6dd0 con 0x7f49e80cf0e0 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8153870 con 0x7f49e80b1ae0 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e81f6060 con 0x7f49e806a4c0 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80cf0e0 0x7f49e81f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80cf0e0 0x7f49e81f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51788/0 (socket says 172.21.15.81:51788) 2023-11-29T11:17:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 -- 172.21.15.81:0/3669998189 learned_addr learned my addr 172.21.15.81:0/3669998189 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e67fc700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e80b1ae0 0x7f49e80c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e6ffd700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e806a4c0 0x7f49e8156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 -- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e806a4c0 msgr2=0x7f49e8156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e806a4c0 0x7f49e8156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 -- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e80b1ae0 msgr2=0x7f49e80c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e80b1ae0 0x7f49e80c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 -- 172.21.15.81:0/3669998189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc009570 con 0x7f49e80cf0e0 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e6ffd700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e806a4c0 0x7f49e8156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e77fe700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80cf0e0 0x7f49e81f5b20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f49e000cc80 tx=0x7f49e000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49cffff700 1 -- 172.21.15.81:0/3669998189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000ad40 con 0x7f49e80cf0e0 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49cffff700 1 -- 172.21.15.81:0/3669998189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e000ce80 con 0x7f49e80cf0e0 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e80b60e0 con 0x7f49e80cf0e0 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49cffff700 1 -- 172.21.15.81:0/3669998189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000aea0 con 0x7f49e80cf0e0 2023-11-29T11:17:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80b1eb0 con 0x7f49e80cf0e0 2023-11-29T11:17:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.532+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e80d08e0 con 0x7f49e80cf0e0 2023-11-29T11:17:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.536+0000 7f49cffff700 1 -- 172.21.15.81:0/3669998189 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f49e0010050 con 0x7f49e80cf0e0 2023-11-29T11:17:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.536+0000 7f49cffff700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49d4064ee0 0x7f49d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.536+0000 7f49e6ffd700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49d4064ee0 0x7f49d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.536+0000 7f49cffff700 1 -- 172.21.15.81:0/3669998189 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f49e0082030 con 0x7f49e80cf0e0 2023-11-29T11:17:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.536+0000 7f49e6ffd700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49d4064ee0 0x7f49d4067390 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f49dc000c00 tx=0x7f49dc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.544+0000 7f49cffff700 1 -- 172.21.15.81:0/3669998189 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f49e004ffd0 con 0x7f49e80cf0e0 2023-11-29T11:17:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.696+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49e80c6f10 con 0x7f49e80cf0e0 2023-11-29T11:17:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.696+0000 7f49cffff700 1 -- 172.21.15.81:0/3669998189 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7f49e80c6f10 con 0x7f49e80cf0e0 2023-11-29T11:17:25.704 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:17:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49d4064ee0 msgr2=0x7f49d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49d4064ee0 0x7f49d4067390 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f49dc000c00 tx=0x7f49dc008030 comp rx=0 tx=0).stop 2023-11-29T11:17:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80cf0e0 msgr2=0x7f49e81f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80cf0e0 0x7f49e81f5b20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f49e000cc80 tx=0x7f49e000a340 comp rx=0 tx=0).stop 2023-11-29T11:17:25.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 shutdown_connections 2023-11-29T11:17:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49d4064ee0 0x7f49d4067390 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49e80cf0e0 0x7f49e81f5b20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49e80b1ae0 0x7f49e80c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 --2- 172.21.15.81:0/3669998189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49e806a4c0 0x7f49e8156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 >> 172.21.15.81:0/3669998189 conn(0x7f49e809bbd0 msgr2=0x7f49e815bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 shutdown_connections 2023-11-29T11:17:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.700+0000 7f49e7fff700 1 -- 172.21.15.81:0/3669998189 wait complete. 2023-11-29T11:17:25.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:17:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f6574a44700 1 Processor -- start 2023-11-29T11:17:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f6574a44700 1 -- start start 2023-11-29T11:17:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f6574a44700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6570159fa0 0x7f65700b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f6574a44700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f65700b1300 0x7f65700cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f6574a44700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65700cd540 0x7f65700b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f6574a44700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700cd9c0 con 0x7f65700cd540 2023-11-29T11:17:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f6574a44700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657015a370 con 0x7f65700b1300 2023-11-29T11:17:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f6574a44700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700cff70 con 0x7f6570159fa0 2023-11-29T11:17:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65700cd540 0x7f65700b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65700cd540 0x7f65700b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51802/0 (socket says 172.21.15.81:51802) 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656ffff700 1 -- 172.21.15.81:0/2730277068 learned_addr learned my addr 172.21.15.81:0/2730277068 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656f7fe700 1 --2- 172.21.15.81:0/2730277068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6570159fa0 0x7f65700b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656effd700 1 --2- 172.21.15.81:0/2730277068 >> v2:172.21.15.176:3300/0 conn(0x7f65700b1300 0x7f65700cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656ffff700 1 -- 172.21.15.81:0/2730277068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6570159fa0 msgr2=0x7f65700b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656ffff700 1 --2- 172.21.15.81:0/2730277068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6570159fa0 0x7f65700b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656ffff700 1 -- 172.21.15.81:0/2730277068 >> v2:172.21.15.176:3300/0 conn(0x7f65700b1300 msgr2=0x7f65700cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656ffff700 1 --2- 172.21.15.81:0/2730277068 >> v2:172.21.15.176:3300/0 conn(0x7f65700b1300 0x7f65700cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.824+0000 7f656ffff700 1 -- 172.21.15.81:0/2730277068 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700d0250 con 0x7f65700cd540 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f656effd700 1 --2- 172.21.15.81:0/2730277068 >> v2:172.21.15.176:3300/0 conn(0x7f65700b1300 0x7f65700cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f656ffff700 1 --2- 172.21.15.81:0/2730277068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65700cd540 0x7f65700b0580 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f657006a9e0 tx=0x7f656800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a97fcca764c158f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f656e7fc700 1 -- 172.21.15.81:0/2730277068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800e070 con 0x7f65700cd540 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f656e7fc700 1 -- 172.21.15.81:0/2730277068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800b910 con 0x7f65700cd540 2023-11-29T11:17:25.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f656e7fc700 1 -- 172.21.15.81:0/2730277068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800bcc0 con 0x7f65700cd540 2023-11-29T11:17:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 -- 172.21.15.81:0/2730277068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65700cd540 msgr2=0x7f65700b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 --2- 172.21.15.81:0/2730277068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65700cd540 0x7f65700b0580 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f657006a9e0 tx=0x7f656800b330 comp rx=0 tx=0).stop 2023-11-29T11:17:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 -- 172.21.15.81:0/2730277068 shutdown_connections 2023-11-29T11:17:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 --2- 172.21.15.81:0/2730277068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65700cd540 0x7f65700b0580 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 --2- 172.21.15.81:0/2730277068 >> v2:172.21.15.176:3300/0 conn(0x7f65700b1300 0x7f65700cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 --2- 172.21.15.81:0/2730277068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6570159fa0 0x7f65700b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 -- 172.21.15.81:0/2730277068 >> 172.21.15.81:0/2730277068 conn(0x7f65700b2180 msgr2=0x7f65700b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:25.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 -- 172.21.15.81:0/2730277068 shutdown_connections 2023-11-29T11:17:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 -- 172.21.15.81:0/2730277068 wait complete. 2023-11-29T11:17:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 Processor -- start 2023-11-29T11:17:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.828+0000 7f6574a44700 1 -- start start 2023-11-29T11:17:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65700b1300 0x7f657014de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65700cd540 0x7f65700c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6570159fa0 0x7f657006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657015a540 con 0x7f6570159fa0 2023-11-29T11:17:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700c96c0 con 0x7f65700b1300 2023-11-29T11:17:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700c99a0 con 0x7f65700cd540 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6570159fa0 0x7f657006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6570159fa0 0x7f657006ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51812/0 (socket says 172.21.15.81:51812) 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 -- 172.21.15.81:0/3346134917 learned_addr learned my addr 172.21.15.81:0/3346134917 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656effd700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65700cd540 0x7f65700c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656f7fe700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65700b1300 0x7f657014de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 -- 172.21.15.81:0/3346134917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65700cd540 msgr2=0x7f65700c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65700cd540 0x7f65700c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 -- 172.21.15.81:0/3346134917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65700b1300 msgr2=0x7f657014de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65700b1300 0x7f657014de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 -- 172.21.15.81:0/3346134917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568009b30 con 0x7f6570159fa0 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f656ffff700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6570159fa0 0x7f657006ec10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f657006afc0 tx=0x7f6568004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6557fff700 1 -- 172.21.15.81:0/3346134917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680099b0 con 0x7f6570159fa0 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6557fff700 1 -- 172.21.15.81:0/3346134917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568004250 con 0x7f6570159fa0 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700afd80 con 0x7f6570159fa0 2023-11-29T11:17:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6557fff700 1 -- 172.21.15.81:0/3346134917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680045e0 con 0x7f6570159fa0 2023-11-29T11:17:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65700afaa0 con 0x7f6570159fa0 2023-11-29T11:17:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.832+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65700b0060 con 0x7f6570159fa0 2023-11-29T11:17:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.836+0000 7f6557fff700 1 -- 172.21.15.81:0/3346134917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f656802c070 con 0x7f6570159fa0 2023-11-29T11:17:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.836+0000 7f6557fff700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f655c064ee0 0x7f655c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:25.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.836+0000 7f6557fff700 1 -- 172.21.15.81:0/3346134917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f65680836d0 con 0x7f6570159fa0 2023-11-29T11:17:25.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.836+0000 7f656f7fe700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f655c064ee0 0x7f655c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:25.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.836+0000 7f656f7fe700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f655c064ee0 0x7f655c067390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f657006ebb0 tx=0x7f6564008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:25.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:25.844+0000 7f6557fff700 1 -- 172.21.15.81:0/3346134917 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6568051670 con 0x7f6570159fa0 2023-11-29T11:17:26.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.004+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f657006d910 con 0x7f6570159fa0 2023-11-29T11:17:26.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.004+0000 7f6557fff700 1 -- 172.21.15.81:0/3346134917 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65680200a0 con 0x7f6570159fa0 2023-11-29T11:17:26.012 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:17:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f655c064ee0 msgr2=0x7f655c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f655c064ee0 0x7f655c067390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f657006ebb0 tx=0x7f6564008040 comp rx=0 tx=0).stop 2023-11-29T11:17:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6570159fa0 msgr2=0x7f657006ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6570159fa0 0x7f657006ec10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f657006afc0 tx=0x7f6568004af0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 shutdown_connections 2023-11-29T11:17:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f655c064ee0 0x7f655c067390 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6570159fa0 0x7f657006ec10 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65700cd540 0x7f65700c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 --2- 172.21.15.81:0/3346134917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65700b1300 0x7f657014de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 >> 172.21.15.81:0/3346134917 conn(0x7f65700b2180 msgr2=0x7f65701569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 shutdown_connections 2023-11-29T11:17:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.008+0000 7f6574a44700 1 -- 172.21.15.81:0/3346134917 wait complete. 2023-11-29T11:17:26.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:17:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c3497c700 1 Processor -- start 2023-11-29T11:17:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c3497c700 1 -- start start 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c3497c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0c3006ce60 0x7f0c300d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c3497c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c300cce60 0x7f0c3006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c3497c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c300cd300 con 0x7f0c300cf470 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c3497c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3015c8b0 con 0x7f0c300cce60 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c3497c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3006d770 con 0x7f0c3006ce60 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2f59e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0c300cf470 0x7f0c300cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50648/0 (socket says 172.21.15.81:50648) 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2f59e700 1 -- 172.21.15.81:0/613712397 learned_addr learned my addr 172.21.15.81:0/613712397 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2e59c700 1 --2- 172.21.15.81:0/613712397 >> v2:172.21.15.81:3300/0 conn(0x7f0c300cce60 0x7f0c3006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2ed9d700 1 --2- 172.21.15.81:0/613712397 >> v2:172.21.15.176:3300/0 conn(0x7f0c3006ce60 0x7f0c300d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2dd9b700 1 -- 172.21.15.81:0/613712397 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303468281 0 0) 0x7f0c28001110 con 0x7f0c300cf470 2023-11-29T11:17:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2dd9b700 1 -- 172.21.15.81:0/613712397 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c180035d0 con 0x7f0c300cf470 2023-11-29T11:17:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2e59c700 1 -- 172.21.15.81:0/613712397 >> v2:172.21.15.176:3300/0 conn(0x7f0c3006ce60 msgr2=0x7f0c300d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2e59c700 1 --2- 172.21.15.81:0/613712397 >> v2:172.21.15.176:3300/0 conn(0x7f0c3006ce60 0x7f0c300d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2dd9b700 1 -- 172.21.15.81:0/613712397 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3241142229 0 0) 0x7f0c180035d0 con 0x7f0c300cf470 2023-11-29T11:17:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2e59c700 1 -- 172.21.15.81:0/613712397 >> v1:172.21.15.81:6789/0 conn(0x7f0c300cf470 legacy=0x7f0c300cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.136+0000 7f0c2e59c700 1 -- 172.21.15.81:0/613712397 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3006a7f0 con 0x7f0c300cce60 2023-11-29T11:17:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c2e59c700 1 --2- 172.21.15.81:0/613712397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c3006d230 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009850 tx=0x7f0c24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b4859dd29245ca server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c2dd9b700 1 -- 172.21.15.81:0/613712397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28001800 con 0x7f0c300cce60 2023-11-29T11:17:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c2dd9b700 1 -- 172.21.15.81:0/613712397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24004030 con 0x7f0c300cce60 2023-11-29T11:17:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c2dd9b700 1 -- 172.21.15.81:0/613712397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c240043c0 con 0x7f0c300cce60 2023-11-29T11:17:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 -- 172.21.15.81:0/613712397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 msgr2=0x7f0c3006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 --2- 172.21.15.81:0/613712397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c3006d230 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009850 tx=0x7f0c24009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 -- 172.21.15.81:0/613712397 shutdown_connections 2023-11-29T11:17:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 --2- 172.21.15.81:0/613712397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c3006d230 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 --2- 172.21.15.81:0/613712397 >> v2:172.21.15.176:3300/0 conn(0x7f0c3006ce60 0x7f0c300d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 -- 172.21.15.81:0/613712397 >> 172.21.15.81:0/613712397 conn(0x7f0c300b5760 msgr2=0x7f0c300b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 -- 172.21.15.81:0/613712397 shutdown_connections 2023-11-29T11:17:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 -- 172.21.15.81:0/613712397 wait complete. 2023-11-29T11:17:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 Processor -- start 2023-11-29T11:17:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.140+0000 7f0c3497c700 1 -- start start 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c3497c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3006ce60 0x7f0c301429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c3497c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c300cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c3497c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300cf470 0x7f0c300cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c3497c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c9010 con 0x7f0c300cce60 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c3497c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300b4d50 con 0x7f0c3006ce60 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c3497c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300b5030 con 0x7f0c300cf470 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c300cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c300cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51834/0 (socket says 172.21.15.81:51834) 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 -- 172.21.15.81:0/1117518955 learned_addr learned my addr 172.21.15.81:0/1117518955 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2f59e700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300cf470 0x7f0c300cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2ed9d700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3006ce60 0x7f0c301429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 -- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300cf470 msgr2=0x7f0c300cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300cf470 0x7f0c300cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 -- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3006ce60 msgr2=0x7f0c301429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3006ce60 0x7f0c301429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 -- 172.21.15.81:0/1117518955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240094b0 con 0x7f0c300cce60 2023-11-29T11:17:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2ed9d700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3006ce60 0x7f0c301429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c2e59c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c300cb6e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0c3008a7d0 tx=0x7f0c24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c177fe700 1 -- 172.21.15.81:0/1117518955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24006ea0 con 0x7f0c300cce60 2023-11-29T11:17:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c177fe700 1 -- 172.21.15.81:0/1117518955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24011630 con 0x7f0c300cce60 2023-11-29T11:17:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3006adb0 con 0x7f0c300cce60 2023-11-29T11:17:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c177fe700 1 -- 172.21.15.81:0/1117518955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c240119e0 con 0x7f0c300cce60 2023-11-29T11:17:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.144+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3006aad0 con 0x7f0c300cce60 2023-11-29T11:17:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.148+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3006b090 con 0x7f0c300cce60 2023-11-29T11:17:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.148+0000 7f0c177fe700 1 -- 172.21.15.81:0/1117518955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0c24017020 con 0x7f0c300cce60 2023-11-29T11:17:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.148+0000 7f0c177fe700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c1c064ee0 0x7f0c1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.148+0000 7f0c177fe700 1 -- 172.21.15.81:0/1117518955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f0c24083470 con 0x7f0c300cce60 2023-11-29T11:17:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.148+0000 7f0c2ed9d700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c1c064ee0 0x7f0c1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.148+0000 7f0c2ed9d700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c1c064ee0 0x7f0c1c067390 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009fd0 tx=0x7f0c2000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.156+0000 7f0c177fe700 1 -- 172.21.15.81:0/1117518955 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0c24051490 con 0x7f0c300cce60 2023-11-29T11:17:26.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:17:26.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:17:26.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.308+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c30072c20 con 0x7f0c300cce60 2023-11-29T11:17:26.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c177fe700 1 -- 172.21.15.81:0/1117518955 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c2401f020 con 0x7f0c300cce60 2023-11-29T11:17:26.318 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:17:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c1c064ee0 msgr2=0x7f0c1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c1c064ee0 0x7f0c1c067390 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009fd0 tx=0x7f0c2000b040 comp rx=0 tx=0).stop 2023-11-29T11:17:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 msgr2=0x7f0c300cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c300cb6e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0c3008a7d0 tx=0x7f0c24004770 comp rx=0 tx=0).stop 2023-11-29T11:17:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 shutdown_connections 2023-11-29T11:17:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c1c064ee0 0x7f0c1c067390 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c300cf470 0x7f0c300cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c300cce60 0x7f0c300cb6e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 --2- 172.21.15.81:0/1117518955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c3006ce60 0x7f0c301429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 >> 172.21.15.81:0/1117518955 conn(0x7f0c300b5760 msgr2=0x7f0c300d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 shutdown_connections 2023-11-29T11:17:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.312+0000 7f0c3497c700 1 -- 172.21.15.81:0/1117518955 wait complete. 2023-11-29T11:17:26.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:17:26.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bffff700 1 Processor -- start 2023-11-29T11:17:26.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bffff700 1 -- start start 2023-11-29T11:17:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f44c01585c0 0x7f44c00c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c00cd2d0 0x7f44c015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c006aa40 con 0x7f44c006a4d0 2023-11-29T11:17:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c015c2a0 con 0x7f44c01585c0 2023-11-29T11:17:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006ad20 con 0x7f44c00cd2d0 2023-11-29T11:17:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44be7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f44c006a4d0 0x7f44c00ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50652/0 (socket says 172.21.15.81:50652) 2023-11-29T11:17:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44be7fc700 1 -- 172.21.15.81:0/2291210920 learned_addr learned my addr 172.21.15.81:0/2291210920 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bf7fe700 1 --2- 172.21.15.81:0/2291210920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c00cd2d0 0x7f44c015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44beffd700 1 --2- 172.21.15.81:0/2291210920 >> v2:172.21.15.176:3300/0 conn(0x7f44c01585c0 0x7f44c00c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bdffb700 1 -- 172.21.15.81:0/2291210920 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515364706 0 0) 0x7f44c006aa40 con 0x7f44c006a4d0 2023-11-29T11:17:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bdffb700 1 -- 172.21.15.81:0/2291210920 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a80035d0 con 0x7f44c006a4d0 2023-11-29T11:17:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bf7fe700 1 -- 172.21.15.81:0/2291210920 >> v2:172.21.15.176:3300/0 conn(0x7f44c01585c0 msgr2=0x7f44c00c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bf7fe700 1 --2- 172.21.15.81:0/2291210920 >> v2:172.21.15.176:3300/0 conn(0x7f44c01585c0 0x7f44c00c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bf7fe700 1 -- 172.21.15.81:0/2291210920 >> v1:172.21.15.81:6789/0 conn(0x7f44c006a4d0 legacy=0x7f44c00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.436+0000 7f44bdffb700 1 -- 172.21.15.81:0/2291210920 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044624434 0 0) 0x7f44a80035d0 con 0x7f44c006a4d0 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bf7fe700 1 -- 172.21.15.81:0/2291210920 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c006b000 con 0x7f44c00cd2d0 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bf7fe700 1 --2- 172.21.15.81:0/2291210920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c00cd2d0 0x7f44c015c6f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009d90 tx=0x7f44b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb3d179942bfe0a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bdffb700 1 -- 172.21.15.81:0/2291210920 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800e070 con 0x7f44c00cd2d0 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bdffb700 1 -- 172.21.15.81:0/2291210920 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b8003a40 con 0x7f44c00cd2d0 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bdffb700 1 -- 172.21.15.81:0/2291210920 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0001670 con 0x7f44c00cd2d0 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 -- 172.21.15.81:0/2291210920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c00cd2d0 msgr2=0x7f44c015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 --2- 172.21.15.81:0/2291210920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c00cd2d0 0x7f44c015c6f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009d90 tx=0x7f44b800b330 comp rx=0 tx=0).stop 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 -- 172.21.15.81:0/2291210920 shutdown_connections 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 --2- 172.21.15.81:0/2291210920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c00cd2d0 0x7f44c015c6f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 --2- 172.21.15.81:0/2291210920 >> v2:172.21.15.176:3300/0 conn(0x7f44c01585c0 0x7f44c00c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 -- 172.21.15.81:0/2291210920 >> 172.21.15.81:0/2291210920 conn(0x7f44c00b0990 msgr2=0x7f44c00b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 -- 172.21.15.81:0/2291210920 shutdown_connections 2023-11-29T11:17:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 -- 172.21.15.81:0/2291210920 wait complete. 2023-11-29T11:17:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 Processor -- start 2023-11-29T11:17:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.440+0000 7f44bffff700 1 -- start start 2023-11-29T11:17:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c006a4d0 0x7f44c014b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c00cd2d0 0x7f44c00cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44c01585c0 0x7f44c0148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c015b880 con 0x7f44c01585c0 2023-11-29T11:17:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c014b7f0 con 0x7f44c00cd2d0 2023-11-29T11:17:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c015ac00 con 0x7f44c006a4d0 2023-11-29T11:17:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44c01585c0 0x7f44c0148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44c01585c0 0x7f44c0148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51840/0 (socket says 172.21.15.81:51840) 2023-11-29T11:17:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 -- 172.21.15.81:0/2435549787 learned_addr learned my addr 172.21.15.81:0/2435549787 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44beffd700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c006a4d0 0x7f44c014b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44be7fc700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c00cd2d0 0x7f44c00cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 -- 172.21.15.81:0/2435549787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c006a4d0 msgr2=0x7f44c014b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c006a4d0 0x7f44c014b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 -- 172.21.15.81:0/2435549787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c00cd2d0 msgr2=0x7f44c00cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c00cd2d0 0x7f44c00cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 -- 172.21.15.81:0/2435549787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b8009a70 con 0x7f44c01585c0 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bf7fe700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44c01585c0 0x7f44c0148480 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f44b800b370 tx=0x7f44b8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44a77fe700 1 -- 172.21.15.81:0/2435549787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8004540 con 0x7f44c01585c0 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44a77fe700 1 -- 172.21.15.81:0/2435549787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b80046a0 con 0x7f44c01585c0 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c0071570 con 0x7f44c01585c0 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44a77fe700 1 -- 172.21.15.81:0/2435549787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b801c440 con 0x7f44c01585c0 2023-11-29T11:17:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.444+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c006b2e0 con 0x7f44c01585c0 2023-11-29T11:17:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.448+0000 7f44a77fe700 1 -- 172.21.15.81:0/2435549787 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f44b8024030 con 0x7f44c01585c0 2023-11-29T11:17:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.448+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c0071700 con 0x7f44c01585c0 2023-11-29T11:17:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.448+0000 7f44a77fe700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f44ac064ee0 0x7f44ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.448+0000 7f44beffd700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f44ac064ee0 0x7f44ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.448+0000 7f44a77fe700 1 -- 172.21.15.81:0/2435549787 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f44b8083540 con 0x7f44c01585c0 2023-11-29T11:17:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.448+0000 7f44beffd700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f44ac064ee0 0x7f44ac067390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009b50 tx=0x7f44b4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.456+0000 7f44a77fe700 1 -- 172.21.15.81:0/2435549787 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f44b8051470 con 0x7f44c01585c0 2023-11-29T11:17:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.616+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44c015b9c0 con 0x7f44c01585c0 2023-11-29T11:17:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.616+0000 7f44a77fe700 1 -- 172.21.15.81:0/2435549787 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44c015b9c0 con 0x7f44c01585c0 2023-11-29T11:17:26.624 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f44ac064ee0 msgr2=0x7f44ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f44ac064ee0 0x7f44ac067390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009b50 tx=0x7f44b4009240 comp rx=0 tx=0).stop 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44c01585c0 msgr2=0x7f44c0148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44c01585c0 0x7f44c0148480 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f44b800b370 tx=0x7f44b8004af0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 shutdown_connections 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f44ac064ee0 0x7f44ac067390 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44c01585c0 0x7f44c0148480 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c00cd2d0 0x7f44c00cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 --2- 172.21.15.81:0/2435549787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c006a4d0 0x7f44c014b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 >> 172.21.15.81:0/2435549787 conn(0x7f44c00b0990 msgr2=0x7f44c00b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 shutdown_connections 2023-11-29T11:17:26.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.620+0000 7f44bffff700 1 -- 172.21.15.81:0/2435549787 wait complete. 2023-11-29T11:17:26.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.740+0000 7f0a68c1b700 1 Processor -- start 2023-11-29T11:17:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.740+0000 7f0a68c1b700 1 -- start start 2023-11-29T11:17:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 0x7f0a6406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0a6406a530 0x7f0a640cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a640b4c10 0x7f0a640cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6415c6d0 con 0x7f0a640b4c10 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6406a9a0 con 0x7f0a6406a530 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640cf960 con 0x7f0a640cf050 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a640b4c10 0x7f0a640cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a640b4c10 0x7f0a640cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51852/0 (socket says 172.21.15.81:51852) 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 -- 172.21.15.81:0/4088524262 learned_addr learned my addr 172.21.15.81:0/4088524262 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a637fe700 1 --2- 172.21.15.81:0/4088524262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 0x7f0a6406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a5affd700 1 --2- 172.21.15.81:0/4088524262 >> v2:172.21.15.176:3300/0 conn(0x7f0a6406a530 0x7f0a640cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 -- 172.21.15.81:0/4088524262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 msgr2=0x7f0a6406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 --2- 172.21.15.81:0/4088524262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 0x7f0a6406d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 -- 172.21.15.81:0/4088524262 >> v2:172.21.15.176:3300/0 conn(0x7f0a6406a530 msgr2=0x7f0a640cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 --2- 172.21.15.81:0/4088524262 >> v2:172.21.15.176:3300/0 conn(0x7f0a6406a530 0x7f0a640cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 -- 172.21.15.81:0/4088524262 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6406ac60 con 0x7f0a640b4c10 2023-11-29T11:17:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a63fff700 1 --2- 172.21.15.81:0/4088524262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a640cce20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f0a6408b6e0 tx=0x7f0a5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4d248c7403d61d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a62ffd700 1 -- 172.21.15.81:0/4088524262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00e070 con 0x7f0a640b4c10 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a62ffd700 1 -- 172.21.15.81:0/4088524262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c00b910 con 0x7f0a640b4c10 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a62ffd700 1 -- 172.21.15.81:0/4088524262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00bcc0 con 0x7f0a640b4c10 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 -- 172.21.15.81:0/4088524262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 msgr2=0x7f0a640cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/4088524262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a640cce20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f0a6408b6e0 tx=0x7f0a5c00b330 comp rx=0 tx=0).stop 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 -- 172.21.15.81:0/4088524262 shutdown_connections 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/4088524262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a640cce20 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/4088524262 >> v2:172.21.15.176:3300/0 conn(0x7f0a6406a530 0x7f0a640cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/4088524262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 0x7f0a6406d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 -- 172.21.15.81:0/4088524262 >> 172.21.15.81:0/4088524262 conn(0x7f0a6409bb30 msgr2=0x7f0a640b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 -- 172.21.15.81:0/4088524262 shutdown_connections 2023-11-29T11:17:26.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.744+0000 7f0a68c1b700 1 -- 172.21.15.81:0/4088524262 wait complete. 2023-11-29T11:17:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a68c1b700 1 Processor -- start 2023-11-29T11:17:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a68c1b700 1 -- start start 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a68c1b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6406a530 0x7f0a641566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a68c1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a6415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a68c1b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 0x7f0a64156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a68c1b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6415c870 con 0x7f0a640b4c10 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a68c1b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6415d3f0 con 0x7f0a6406a530 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a68c1b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64156c00 con 0x7f0a640cf050 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a5affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a6415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a5affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a6415f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51866/0 (socket says 172.21.15.81:51866) 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.748+0000 7f0a5affd700 1 -- 172.21.15.81:0/3185131 learned_addr learned my addr 172.21.15.81:0/3185131 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a637fe700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6406a530 0x7f0a641566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a63fff700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 0x7f0a64156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a5affd700 1 -- 172.21.15.81:0/3185131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 msgr2=0x7f0a64156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a5affd700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 0x7f0a64156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a5affd700 1 -- 172.21.15.81:0/3185131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6406a530 msgr2=0x7f0a641566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a5affd700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6406a530 0x7f0a641566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a5affd700 1 -- 172.21.15.81:0/3185131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c009b30 con 0x7f0a640b4c10 2023-11-29T11:17:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a5affd700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a6415f490 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00e9d0 tx=0x7f0a4c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a60ff9700 1 -- 172.21.15.81:0/3185131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c009720 con 0x7f0a640b4c10 2023-11-29T11:17:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a60ff9700 1 -- 172.21.15.81:0/3185131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c00ee70 con 0x7f0a640b4c10 2023-11-29T11:17:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a640b4410 con 0x7f0a640b4c10 2023-11-29T11:17:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a60ff9700 1 -- 172.21.15.81:0/3185131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00ca50 con 0x7f0a640b4c10 2023-11-29T11:17:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6406af40 con 0x7f0a640b4c10 2023-11-29T11:17:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a640b46f0 con 0x7f0a640b4c10 2023-11-29T11:17:26.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.752+0000 7f0a60ff9700 1 -- 172.21.15.81:0/3185131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0a4c019030 con 0x7f0a640b4c10 2023-11-29T11:17:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.756+0000 7f0a60ff9700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a44064ee0 0x7f0a44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.756+0000 7f0a60ff9700 1 -- 172.21.15.81:0/3185131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f0a4c081f20 con 0x7f0a640b4c10 2023-11-29T11:17:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.756+0000 7f0a637fe700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a44064ee0 0x7f0a44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.756+0000 7f0a637fe700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a44064ee0 0x7f0a44067390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009ad0 tx=0x7f0a54009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:26.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.760+0000 7f0a60ff9700 1 -- 172.21.15.81:0/3185131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0a4c04feb0 con 0x7f0a640b4c10 2023-11-29T11:17:26.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.960+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a64072500 con 0x7f0a640b4c10 2023-11-29T11:17:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.960+0000 7f0a60ff9700 1 -- 172.21.15.81:0/3185131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f0a4c017090 con 0x7f0a640b4c10 2023-11-29T11:17:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:26.968 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:56.032848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:17:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a44064ee0 msgr2=0x7f0a44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a44064ee0 0x7f0a44067390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009ad0 tx=0x7f0a54009240 comp rx=0 tx=0).stop 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 msgr2=0x7f0a6415f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a6415f490 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00e9d0 tx=0x7f0a4c00ece0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 shutdown_connections 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a44064ee0 0x7f0a44067390 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a640cf050 0x7f0a64156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a640b4c10 0x7f0a6415f490 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 --2- 172.21.15.81:0/3185131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6406a530 0x7f0a641566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 >> 172.21.15.81:0/3185131 conn(0x7f0a6409bb30 msgr2=0x7f0a6415bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 shutdown_connections 2023-11-29T11:17:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:26.964+0000 7f0a68c1b700 1 -- 172.21.15.81:0/3185131 wait complete. 2023-11-29T11:17:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2023-11-29T11:17:26.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:27.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.084+0000 7fe37e523700 1 Processor -- start 2023-11-29T11:17:27.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.084+0000 7fe37e523700 1 -- start start 2023-11-29T11:17:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3781606b0 0x7fe3780c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe3780ad610 0x7fe3780c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3780cae70 con 0x7fe3780ceef0 2023-11-29T11:17:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3780cbc10 con 0x7fe3781606b0 2023-11-29T11:17:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3780cb130 con 0x7fe3780ad610 2023-11-29T11:17:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37d521700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3781606b0 0x7fe3780c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37d521700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3781606b0 0x7fe3780c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51876/0 (socket says 172.21.15.81:51876) 2023-11-29T11:17:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37d521700 1 -- 172.21.15.81:0/3659984085 learned_addr learned my addr 172.21.15.81:0/3659984085 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37dd22700 1 --2- 172.21.15.81:0/3659984085 >> v2:172.21.15.176:3300/0 conn(0x7fe3780ad610 0x7fe3780c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37d521700 1 -- 172.21.15.81:0/3659984085 >> v2:172.21.15.176:3300/0 conn(0x7fe3780ad610 msgr2=0x7fe3780c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37d521700 1 --2- 172.21.15.81:0/3659984085 >> v2:172.21.15.176:3300/0 conn(0x7fe3780ad610 0x7fe3780c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37d521700 1 -- 172.21.15.81:0/3659984085 >> v1:172.21.15.176:6789/0 conn(0x7fe3780ceef0 legacy=0x7fe378164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37d521700 1 -- 172.21.15.81:0/3659984085 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780cb410 con 0x7fe3781606b0 2023-11-29T11:17:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37d521700 1 --2- 172.21.15.81:0/3659984085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780c13b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe378067140 tx=0x7fe36c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c838ce36f207958 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe377fff700 1 -- 172.21.15.81:0/3659984085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c011830 con 0x7fe3781606b0 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe377fff700 1 -- 172.21.15.81:0/3659984085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c011990 con 0x7fe3781606b0 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe377fff700 1 -- 172.21.15.81:0/3659984085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c011d20 con 0x7fe3781606b0 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 -- 172.21.15.81:0/3659984085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 msgr2=0x7fe3780c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 --2- 172.21.15.81:0/3659984085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780c13b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe378067140 tx=0x7fe36c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 -- 172.21.15.81:0/3659984085 shutdown_connections 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 --2- 172.21.15.81:0/3659984085 >> v2:172.21.15.176:3300/0 conn(0x7fe3780ad610 0x7fe3780c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 --2- 172.21.15.81:0/3659984085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780c13b0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 -- 172.21.15.81:0/3659984085 >> 172.21.15.81:0/3659984085 conn(0x7fe3780ce3e0 msgr2=0x7fe3780ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:27.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 -- 172.21.15.81:0/3659984085 shutdown_connections 2023-11-29T11:17:27.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.088+0000 7fe37e523700 1 -- 172.21.15.81:0/3659984085 wait complete. 2023-11-29T11:17:27.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37e523700 1 Processor -- start 2023-11-29T11:17:27.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37e523700 1 -- start start 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37e523700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3780ad610 0x7fe378160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37e523700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3780ceef0 0x7fe3781f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37e523700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37e523700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37815acd0 con 0x7fe3781606b0 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37e523700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780c2820 con 0x7fe3780ad610 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37e523700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780c30c0 con 0x7fe3780ceef0 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37dd22700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37dd22700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51888/0 (socket says 172.21.15.81:51888) 2023-11-29T11:17:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37dd22700 1 -- 172.21.15.81:0/947124150 learned_addr learned my addr 172.21.15.81:0/947124150 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.092+0000 7fe37d521700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3780ad610 0x7fe378160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37cd20700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3780ceef0 0x7fe3781f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37dd22700 1 -- 172.21.15.81:0/947124150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3780ceef0 msgr2=0x7fe3781f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37dd22700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3780ceef0 0x7fe3781f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37dd22700 1 -- 172.21.15.81:0/947124150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3780ad610 msgr2=0x7fe378160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37dd22700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3780ad610 0x7fe378160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37dd22700 1 -- 172.21.15.81:0/947124150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c009570 con 0x7fe3781606b0 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37dd22700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780ae3e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e820 tx=0x7fe37000eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe375ffb700 1 -- 172.21.15.81:0/947124150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3700095c0 con 0x7fe3781606b0 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe375ffb700 1 -- 172.21.15.81:0/947124150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe370013680 con 0x7fe3781606b0 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37806ac50 con 0x7fe3781606b0 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe375ffb700 1 -- 172.21.15.81:0/947124150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370013a10 con 0x7fe3781606b0 2023-11-29T11:17:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3780cb6f0 con 0x7fe3781606b0 2023-11-29T11:17:27.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3780b36c0 con 0x7fe3781606b0 2023-11-29T11:17:27.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe375ffb700 1 -- 172.21.15.81:0/947124150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe370019030 con 0x7fe3781606b0 2023-11-29T11:17:27.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe375ffb700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe364064ee0 0x7fe364067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe375ffb700 1 -- 172.21.15.81:0/947124150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe370081d20 con 0x7fe3781606b0 2023-11-29T11:17:27.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.096+0000 7fe37d521700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe364064ee0 0x7fe364067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.100+0000 7fe37d521700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe364064ee0 0x7fe364067390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe36c000c00 tx=0x7fe36c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.104+0000 7fe375ffb700 1 -- 172.21.15.81:0/947124150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe37004fd40 con 0x7fe3781606b0 2023-11-29T11:17:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.272+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe378072500 con 0x7fe3781606b0 2023-11-29T11:17:27.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.272+0000 7fe375ffb700 1 -- 172.21.15.81:0/947124150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18127 (secure 0 0 0) 0x7fe370053360 con 0x7fe3781606b0 2023-11-29T11:17:27.282 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:27.282 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:16:44.055201+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:16:05.224956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-29T11:16:06.381228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe364064ee0 msgr2=0x7fe364067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe364064ee0 0x7fe364067390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe36c000c00 tx=0x7fe36c008030 comp rx=0 tx=0).stop 2023-11-29T11:17:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 msgr2=0x7fe3780ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780ae3e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e820 tx=0x7fe37000eb30 comp rx=0 tx=0).stop 2023-11-29T11:17:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 shutdown_connections 2023-11-29T11:17:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe364064ee0 0x7fe364067390 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3781606b0 0x7fe3780ae3e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3780ceef0 0x7fe3781f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 --2- 172.21.15.81:0/947124150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3780ad610 0x7fe378160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 >> 172.21.15.81:0/947124150 conn(0x7fe3780ce3e0 msgr2=0x7fe3780cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 shutdown_connections 2023-11-29T11:17:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.280+0000 7fe37e523700 1 -- 172.21.15.81:0/947124150 wait complete. 2023-11-29T11:17:27.302 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T11:17:27.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c4cbfc700 1 Processor -- start 2023-11-29T11:17:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c4cbfc700 1 -- start start 2023-11-29T11:17:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c4cbfc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c48159e70 0x7f5c4806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c4cbfc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c48069c40 0x7f5c480cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c4cbfc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4806ace0 con 0x7f5c4806cee0 2023-11-29T11:17:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c4cbfc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4806a0d0 con 0x7f5c48069c40 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c4cbfc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4806a3b0 con 0x7f5c48159e70 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c46ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c48069c40 0x7f5c480cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c46ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c48069c40 0x7f5c480cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51896/0 (socket says 172.21.15.81:51896) 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c46ffd700 1 -- 172.21.15.81:0/2770580339 learned_addr learned my addr 172.21.15.81:0/2770580339 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c477fe700 1 --2- 172.21.15.81:0/2770580339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c48159e70 0x7f5c4806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c46ffd700 1 -- 172.21.15.81:0/2770580339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c48159e70 msgr2=0x7f5c4806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c46ffd700 1 --2- 172.21.15.81:0/2770580339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c48159e70 0x7f5c4806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.404+0000 7f5c46ffd700 1 -- 172.21.15.81:0/2770580339 >> v1:172.21.15.81:6789/0 conn(0x7f5c4806cee0 legacy=0x7f5c480b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c46ffd700 1 -- 172.21.15.81:0/2770580339 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4806a690 con 0x7f5c48069c40 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c477fe700 1 --2- 172.21.15.81:0/2770580339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c48159e70 0x7f5c4806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c46ffd700 1 --2- 172.21.15.81:0/2770580339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480cad60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009910 tx=0x7f5c38009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678ab06c66603751 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c467fc700 1 -- 172.21.15.81:0/2770580339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800ba60 con 0x7f5c48069c40 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c467fc700 1 -- 172.21.15.81:0/2770580339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800bbc0 con 0x7f5c48069c40 2023-11-29T11:17:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c467fc700 1 -- 172.21.15.81:0/2770580339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38009e60 con 0x7f5c48069c40 2023-11-29T11:17:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/2770580339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 msgr2=0x7f5c480cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/2770580339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480cad60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009910 tx=0x7f5c38009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/2770580339 shutdown_connections 2023-11-29T11:17:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/2770580339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480cad60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/2770580339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c48159e70 0x7f5c4806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/2770580339 >> 172.21.15.81:0/2770580339 conn(0x7f5c480ce3e0 msgr2=0x7f5c480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/2770580339 shutdown_connections 2023-11-29T11:17:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.408+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/2770580339 wait complete. 2023-11-29T11:17:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 Processor -- start 2023-11-29T11:17:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 -- start start 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c4806cee0 0x7f5c480c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c48159e70 0x7f5c4806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480c4db0 con 0x7f5c48069c40 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480abbb0 con 0x7f5c48159e70 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480ab280 con 0x7f5c4806cee0 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51904/0 (socket says 172.21.15.81:51904) 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 -- 172.21.15.81:0/823000676 learned_addr learned my addr 172.21.15.81:0/823000676 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c46ffd700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c4806cee0 0x7f5c480c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c47fff700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c48159e70 0x7f5c4806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 -- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c4806cee0 msgr2=0x7f5c480c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c4806cee0 0x7f5c480c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 -- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c48159e70 msgr2=0x7f5c4806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c48159e70 0x7f5c4806fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 -- 172.21.15.81:0/823000676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009570 con 0x7f5c48069c40 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c46ffd700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c4806cee0 0x7f5c480c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c47fff700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c48159e70 0x7f5c4806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c477fe700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480716f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c7f0 tx=0x7f5c3c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c2ffff700 1 -- 172.21.15.81:0/823000676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c011800 con 0x7f5c48069c40 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c2ffff700 1 -- 172.21.15.81:0/823000676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c011960 con 0x7f5c48069c40 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4815a240 con 0x7f5c48069c40 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c2ffff700 1 -- 172.21.15.81:0/823000676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c011d10 con 0x7f5c48069c40 2023-11-29T11:17:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.412+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4806a970 con 0x7f5c48069c40 2023-11-29T11:17:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.416+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c480ca1e0 con 0x7f5c48069c40 2023-11-29T11:17:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.416+0000 7f5c2ffff700 1 -- 172.21.15.81:0/823000676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5c3c020070 con 0x7f5c48069c40 2023-11-29T11:17:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.416+0000 7f5c2ffff700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5c34064f10 0x7f5c340673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.416+0000 7f5c46ffd700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5c34064f10 0x7f5c340673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.416+0000 7f5c2ffff700 1 -- 172.21.15.81:0/823000676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5c3c081ea0 con 0x7f5c48069c40 2023-11-29T11:17:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.416+0000 7f5c46ffd700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5c34064f10 0x7f5c340673c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5c480723e0 tx=0x7f5c38008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.424+0000 7f5c2ffff700 1 -- 172.21.15.81:0/823000676 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5c3c04fe40 con 0x7f5c48069c40 2023-11-29T11:17:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.620+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c4806b6d0 con 0x7f5c48069c40 2023-11-29T11:17:27.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c2ffff700 1 -- 172.21.15.81:0/823000676 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f5c3c01e090 con 0x7f5c48069c40 2023-11-29T11:17:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:27.630 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:56.032848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:17:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5c34064f10 msgr2=0x7f5c340673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5c34064f10 0x7f5c340673c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5c480723e0 tx=0x7f5c38008030 comp rx=0 tx=0).stop 2023-11-29T11:17:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 msgr2=0x7f5c480716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480716f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c7f0 tx=0x7f5c3c00cbb0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 shutdown_connections 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5c34064f10 0x7f5c340673c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c48159e70 0x7f5c4806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c4806cee0 0x7f5c480c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 --2- 172.21.15.81:0/823000676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c48069c40 0x7f5c480716f0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 >> 172.21.15.81:0/823000676 conn(0x7f5c480ce3e0 msgr2=0x7f5c480cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 shutdown_connections 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.624+0000 7f5c4cbfc700 1 -- 172.21.15.81:0/823000676 wait complete. 2023-11-29T11:17:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2023-11-29T11:17:27.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2ced2700 1 Processor -- start 2023-11-29T11:17:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2ced2700 1 -- start start 2023-11-29T11:17:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2ced2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a800 0x7f3e28069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2ced2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e2806a180 0x7f3e280d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2ced2700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2806a5e0 con 0x7f3e280b8250 2023-11-29T11:17:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2ced2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e280d0760 con 0x7f3e2806a180 2023-11-29T11:17:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2ced2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280cd270 con 0x7f3e2806a800 2023-11-29T11:17:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e26d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e2806a180 0x7f3e280d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e26d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e2806a180 0x7f3e280d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51920/0 (socket says 172.21.15.81:51920) 2023-11-29T11:17:27.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e26d9d700 1 -- 172.21.15.81:0/781341545 learned_addr learned my addr 172.21.15.81:0/781341545 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:27.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e25d9b700 1 --2- 172.21.15.81:0/781341545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a800 0x7f3e28069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2559a700 1 -- 172.21.15.81:0/781341545 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440851369 0 0) 0x7f3e2806a5e0 con 0x7f3e280b8250 2023-11-29T11:17:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e2559a700 1 -- 172.21.15.81:0/781341545 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e100035d0 con 0x7f3e280b8250 2023-11-29T11:17:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e26d9d700 1 -- 172.21.15.81:0/781341545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a800 msgr2=0x7f3e28069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e26d9d700 1 --2- 172.21.15.81:0/781341545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a800 0x7f3e28069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e26d9d700 1 -- 172.21.15.81:0/781341545 >> v1:172.21.15.176:6789/0 conn(0x7f3e280b8250 legacy=0x7f3e280cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e26d9d700 1 -- 172.21.15.81:0/781341545 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280cd550 con 0x7f3e2806a180 2023-11-29T11:17:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.744+0000 7f3e26d9d700 1 --2- 172.21.15.81:0/781341545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e2806a180 0x7f3e280d0f20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009910 tx=0x7f3e18009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6d489d8dc35bb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2559a700 1 -- 172.21.15.81:0/781341545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18011830 con 0x7f3e2806a180 2023-11-29T11:17:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2559a700 1 -- 172.21.15.81:0/781341545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18011990 con 0x7f3e2806a180 2023-11-29T11:17:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2559a700 1 -- 172.21.15.81:0/781341545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18011d00 con 0x7f3e2806a180 2023-11-29T11:17:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 -- 172.21.15.81:0/781341545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e2806a180 msgr2=0x7f3e280d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/781341545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e2806a180 0x7f3e280d0f20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009910 tx=0x7f3e18009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 -- 172.21.15.81:0/781341545 shutdown_connections 2023-11-29T11:17:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/781341545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e2806a180 0x7f3e280d0f20 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/781341545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a800 0x7f3e28069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 -- 172.21.15.81:0/781341545 >> 172.21.15.81:0/781341545 conn(0x7f3e2806beb0 msgr2=0x7f3e2806c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 -- 172.21.15.81:0/781341545 shutdown_connections 2023-11-29T11:17:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 -- 172.21.15.81:0/781341545 wait complete. 2023-11-29T11:17:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 Processor -- start 2023-11-29T11:17:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 -- start start 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.748+0000 7f3e2ced2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a180 0x7f3e281593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2ced2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e2806a800 0x7f3e280d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2ced2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e280b8250 0x7f3e2815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2ced2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280c87a0 con 0x7f3e280b8250 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2ced2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280c9670 con 0x7f3e2806a800 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2ced2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280c7b20 con 0x7f3e2806a180 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e280b8250 0x7f3e2815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e280b8250 0x7f3e2815fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51922/0 (socket says 172.21.15.81:51922) 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 -- 172.21.15.81:0/2883811576 learned_addr learned my addr 172.21.15.81:0/2883811576 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e25d9b700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e2806a800 0x7f3e280d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2659c700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a180 0x7f3e281593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 -- 172.21.15.81:0/2883811576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a180 msgr2=0x7f3e281593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a180 0x7f3e281593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 -- 172.21.15.81:0/2883811576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e2806a800 msgr2=0x7f3e280d20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e2806a800 0x7f3e280d20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 -- 172.21.15.81:0/2883811576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18009570 con 0x7f3e280b8250 2023-11-29T11:17:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e26d9d700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e280b8250 0x7f3e2815fc90 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3e2806d1e0 tx=0x7f3e18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e16ffd700 1 -- 172.21.15.81:0/2883811576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18004510 con 0x7f3e280b8250 2023-11-29T11:17:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e16ffd700 1 -- 172.21.15.81:0/2883811576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e180036c0 con 0x7f3e280b8250 2023-11-29T11:17:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e280b8620 con 0x7f3e280b8250 2023-11-29T11:17:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e16ffd700 1 -- 172.21.15.81:0/2883811576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18003a50 con 0x7f3e280b8250 2023-11-29T11:17:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e280d0a00 con 0x7f3e280b8250 2023-11-29T11:17:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e16ffd700 1 -- 172.21.15.81:0/2883811576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3e1802c070 con 0x7f3e280b8250 2023-11-29T11:17:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.752+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e280cd830 con 0x7f3e280b8250 2023-11-29T11:17:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.756+0000 7f3e16ffd700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e08064ee0 0x7f3e08067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.756+0000 7f3e2659c700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e08064ee0 0x7f3e08067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.756+0000 7f3e16ffd700 1 -- 172.21.15.81:0/2883811576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3e18020030 con 0x7f3e280b8250 2023-11-29T11:17:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.756+0000 7f3e2659c700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e08064ee0 0x7f3e08067390 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001560 tx=0x7f3e20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.764+0000 7f3e16ffd700 1 -- 172.21.15.81:0/2883811576 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3e18051210 con 0x7f3e280b8250 2023-11-29T11:17:27.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.960+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e280c88e0 con 0x7f3e280b8250 2023-11-29T11:17:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.960+0000 7f3e16ffd700 1 -- 172.21.15.81:0/2883811576 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f3e280c88e0 con 0x7f3e280b8250 2023-11-29T11:17:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:27.968 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:16:07.398184+0000","modified":"2023-11-29T11:16:56.032848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6564":{"gid":6564,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.81:6837/458453409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":458453409},{"type":"v1","addr":"172.21.15.81:6837","nonce":458453409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-29T11:17:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e08064ee0 msgr2=0x7f3e08067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e08064ee0 0x7f3e08067390 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001560 tx=0x7f3e20009040 comp rx=0 tx=0).stop 2023-11-29T11:17:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e280b8250 msgr2=0x7f3e2815fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e280b8250 0x7f3e2815fc90 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3e2806d1e0 tx=0x7f3e18004770 comp rx=0 tx=0).stop 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 shutdown_connections 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e08064ee0 0x7f3e08067390 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e280b8250 0x7f3e2815fc90 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e2806a800 0x7f3e280d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 --2- 172.21.15.81:0/2883811576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e2806a180 0x7f3e281593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 >> 172.21.15.81:0/2883811576 conn(0x7f3e2806beb0 msgr2=0x7f3e2806c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 shutdown_connections 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:27.964+0000 7f3e2ced2700 1 -- 172.21.15.81:0/2883811576 wait complete. 2023-11-29T11:17:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2023-11-29T11:17:27.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.088+0000 7f60faf07700 1 Processor -- start 2023-11-29T11:17:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.088+0000 7f60faf07700 1 -- start start 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f415aec0 0x7f60f406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60f406aa10 0x7f60f415b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f415e300 con 0x7f60f4154600 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f406ae50 con 0x7f60f406aa10 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415b310 con 0x7f60f415aec0 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9704700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f415aec0 0x7f60f406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60fa706700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f60f406aa10 0x7f60f415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9704700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f415aec0 0x7f60f406a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:57770/0 (socket says 172.21.15.81:57770) 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9704700 1 -- 172.21.15.81:0/1074020627 learned_addr learned my addr 172.21.15.81:0/1074020627 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9f05700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f60f4154600 0x7f60f406c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:46224/0 (socket says 172.21.15.81:46224) 2023-11-29T11:17:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9704700 1 -- 172.21.15.81:0/1074020627 >> v2:172.21.15.81:3300/0 conn(0x7f60f406aa10 msgr2=0x7f60f415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9704700 1 --2- 172.21.15.81:0/1074020627 >> v2:172.21.15.81:3300/0 conn(0x7f60f406aa10 0x7f60f415b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9704700 1 -- 172.21.15.81:0/1074020627 >> v1:172.21.15.176:6789/0 conn(0x7f60f4154600 legacy=0x7f60f406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9704700 1 -- 172.21.15.81:0/1074020627 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f406ced0 con 0x7f60f415aec0 2023-11-29T11:17:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f9704700 1 --2- 172.21.15.81:0/1074020627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f415aec0 0x7f60f406a4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009910 tx=0x7f60f0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=684701aa7a626dfe server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f8f03700 1 -- 172.21.15.81:0/1074020627 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0011830 con 0x7f60f415aec0 2023-11-29T11:17:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f8f03700 1 -- 172.21.15.81:0/1074020627 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0011990 con 0x7f60f415aec0 2023-11-29T11:17:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60f8f03700 1 -- 172.21.15.81:0/1074020627 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0011d40 con 0x7f60f415aec0 2023-11-29T11:17:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 -- 172.21.15.81:0/1074020627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f415aec0 msgr2=0x7f60f406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 --2- 172.21.15.81:0/1074020627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f415aec0 0x7f60f406a4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009910 tx=0x7f60f0009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 -- 172.21.15.81:0/1074020627 shutdown_connections 2023-11-29T11:17:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 --2- 172.21.15.81:0/1074020627 >> v2:172.21.15.81:3300/0 conn(0x7f60f406aa10 0x7f60f415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 --2- 172.21.15.81:0/1074020627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f415aec0 0x7f60f406a4d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 -- 172.21.15.81:0/1074020627 >> 172.21.15.81:0/1074020627 conn(0x7f60f406ec40 msgr2=0x7f60f40b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 -- 172.21.15.81:0/1074020627 shutdown_connections 2023-11-29T11:17:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.092+0000 7f60faf07700 1 -- 172.21.15.81:0/1074020627 wait complete. 2023-11-29T11:17:28.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.096+0000 7f60faf07700 1 Processor -- start 2023-11-29T11:17:28.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.096+0000 7f60faf07700 1 -- start start 2023-11-29T11:17:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60faf07700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f406aa10 0x7f60f414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60faf07700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60f415aec0 0x7f60f41efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60faf07700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f4150ea0 0x7f60f4151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60faf07700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b2f40 con 0x7f60f415aec0 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60faf07700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f414e1e0 con 0x7f60f406aa10 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60faf07700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4151980 con 0x7f60f4150ea0 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60f415aec0 0x7f60f41efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9f05700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f406aa10 0x7f60f414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60f415aec0 0x7f60f41efac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51930/0 (socket says 172.21.15.81:51930) 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 -- 172.21.15.81:0/2952392023 learned_addr learned my addr 172.21.15.81:0/2952392023 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60fa706700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f4150ea0 0x7f60f4151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 -- 172.21.15.81:0/2952392023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f4150ea0 msgr2=0x7f60f4151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f4150ea0 0x7f60f4151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 -- 172.21.15.81:0/2952392023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f406aa10 msgr2=0x7f60f414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f406aa10 0x7f60f414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 -- 172.21.15.81:0/2952392023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f0009570 con 0x7f60f415aec0 2023-11-29T11:17:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60f9704700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60f415aec0 0x7f60f41efac0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f60f40cd190 tx=0x7f60f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60e67fc700 1 -- 172.21.15.81:0/2952392023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0004300 con 0x7f60f415aec0 2023-11-29T11:17:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60e67fc700 1 -- 172.21.15.81:0/2952392023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f001f070 con 0x7f60f415aec0 2023-11-29T11:17:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f415dcb0 con 0x7f60f415aec0 2023-11-29T11:17:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60e67fc700 1 -- 172.21.15.81:0/2952392023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00036c0 con 0x7f60f415aec0 2023-11-29T11:17:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.100+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f415d9d0 con 0x7f60f415aec0 2023-11-29T11:17:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.104+0000 7f60e67fc700 1 -- 172.21.15.81:0/2952392023 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f60f002a020 con 0x7f60f415aec0 2023-11-29T11:17:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.104+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f415df90 con 0x7f60f415aec0 2023-11-29T11:17:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.104+0000 7f60e67fc700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f60d8064ee0 0x7f60d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.104+0000 7f60e67fc700 1 -- 172.21.15.81:0/2952392023 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f60f0083520 con 0x7f60f415aec0 2023-11-29T11:17:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.104+0000 7f60f9f05700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f60d8064ee0 0x7f60d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.104+0000 7f60f9f05700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f60d8064ee0 0x7f60d8067390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f60e8000f60 tx=0x7f60e8007f30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.112+0000 7f60e67fc700 1 -- 172.21.15.81:0/2952392023 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f60f00514c0 con 0x7f60f415aec0 2023-11-29T11:17:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.276+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60f40b3080 con 0x7f60f415aec0 2023-11-29T11:17:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60e67fc700 1 -- 172.21.15.81:0/2952392023 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18127 (secure 0 0 0) 0x7f60f40b3080 con 0x7f60f415aec0 2023-11-29T11:17:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:28.287 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:16:44.055201+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:16:05.224956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-29T11:16:06.381228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.30","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f60d8064ee0 msgr2=0x7f60d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f60d8064ee0 0x7f60d8067390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f60e8000f60 tx=0x7f60e8007f30 comp rx=0 tx=0).stop 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60f415aec0 msgr2=0x7f60f41efac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60f415aec0 0x7f60f41efac0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f60f40cd190 tx=0x7f60f0004770 comp rx=0 tx=0).stop 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 shutdown_connections 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f60d8064ee0 0x7f60d8067390 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60f4150ea0 0x7f60f4151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60f415aec0 0x7f60f41efac0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 --2- 172.21.15.81:0/2952392023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60f406aa10 0x7f60f414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 >> 172.21.15.81:0/2952392023 conn(0x7f60f406ec40 msgr2=0x7f60f40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 shutdown_connections 2023-11-29T11:17:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.280+0000 7f60faf07700 1 -- 172.21.15.81:0/2952392023 wait complete. 2023-11-29T11:17:28.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:17:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77f10d700 1 Processor -- start 2023-11-29T11:17:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77f10d700 1 -- start start 2023-11-29T11:17:28.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77f10d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 0x7ff77806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77f10d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77806ace0 con 0x7ff7780cb470 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77f10d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77806a0d0 con 0x7ff778069c40 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77f10d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77806a3b0 con 0x7ff778159e70 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77e90c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7780cb470 0x7ff7780c91d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50672/0 (socket says 172.21.15.81:50672) 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77e90c700 1 -- 172.21.15.81:0/409175103 learned_addr learned my addr 172.21.15.81:0/409175103 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.404+0000 7ff77e10b700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 0x7ff77806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651530598 0 0) 0x7ff77806ace0 con 0x7ff7780cb470 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7600035d0 con 0x7ff7780cb470 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979136635 0 0) 0x7ff77806a0d0 con 0x7ff778069c40 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff77806ace0 con 0x7ff778069c40 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944324686 0 0) 0x7ff7600035d0 con 0x7ff7780cb470 2023-11-29T11:17:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 msgr2=0x7ff77806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 0x7ff77806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 >> v1:172.21.15.176:6789/0 conn(0x7ff778069c40 legacy=0x7ff7780cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77806a690 con 0x7ff7780cb470 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7ff770001670 con 0x7ff7780cb470 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 >> v1:172.21.15.81:6789/0 conn(0x7ff7780cb470 legacy=0x7ff7780c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 0x7ff760003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff760004140 0x7ff760004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff760004db0 0x7ff760005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77806a3b0 con 0x7ff760004db0 2023-11-29T11:17:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76000bae0 con 0x7ff760004140 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76000bca0 con 0x7ff778159e70 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e90c700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff760004db0 0x7ff760005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d90a700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff760004140 0x7ff760004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e10b700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 0x7ff760003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e90c700 1 -- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 msgr2=0x7ff760003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e90c700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 0x7ff760003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e90c700 1 -- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff760004140 msgr2=0x7ff760004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e90c700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff760004140 0x7ff760004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e90c700 1 -- 172.21.15.81:0/409175103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600035d0 con 0x7ff760004db0 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e10b700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778159e70 0x7ff760003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e90c700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff760004db0 0x7ff760005220 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff770001eb0 tx=0x7ff7600058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708e6b566a1a0634 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000cd50 con 0x7ff760004db0 2023-11-29T11:17:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770005980 con 0x7ff760004db0 2023-11-29T11:17:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77d109700 1 -- 172.21.15.81:0/409175103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770005d10 con 0x7ff760004db0 2023-11-29T11:17:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77f10d700 1 -- 172.21.15.81:0/409175103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff760004db0 msgr2=0x7ff760005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77f10d700 1 --2- 172.21.15.81:0/409175103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff760004db0 0x7ff760005220 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff770001eb0 tx=0x7ff7600058a0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77e90c700 1 -- 172.21.15.81:0/409175103 reap_dead start 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77f10d700 1 -- 172.21.15.81:0/409175103 shutdown_connections 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77f10d700 1 -- 172.21.15.81:0/409175103 >> 172.21.15.81:0/409175103 conn(0x7ff7780ce3e0 msgr2=0x7ff7780ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77f10d700 1 -- 172.21.15.81:0/409175103 shutdown_connections 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.408+0000 7ff77f10d700 1 -- 172.21.15.81:0/409175103 wait complete. 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 Processor -- start 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 -- start start 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff778153230 0x7ff7780c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778153600 0x7ff7780cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff77806b100 0x7ff7780cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780c6fb0 con 0x7ff77806b100 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780c7290 con 0x7ff778153230 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780c7570 con 0x7ff778153600 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff77806b100 0x7ff7780cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff77806b100 0x7ff7780cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51936/0 (socket says 172.21.15.81:51936) 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 -- 172.21.15.81:0/1628811157 learned_addr learned my addr 172.21.15.81:0/1628811157 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77d90a700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778153600 0x7ff7780cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e10b700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff778153230 0x7ff7780c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 -- 172.21.15.81:0/1628811157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778153600 msgr2=0x7ff7780cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778153600 0x7ff7780cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 -- 172.21.15.81:0/1628811157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff778153230 msgr2=0x7ff7780c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff778153230 0x7ff7780c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 -- 172.21.15.81:0/1628811157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77815a240 con 0x7ff77806b100 2023-11-29T11:17:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77e90c700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff77806b100 0x7ff7780cc4f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff770007fd0 tx=0x7ff770001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff776ffd700 1 -- 172.21.15.81:0/1628811157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700070d0 con 0x7ff77806b100 2023-11-29T11:17:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff776ffd700 1 -- 172.21.15.81:0/1628811157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770007250 con 0x7ff77806b100 2023-11-29T11:17:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77806a970 con 0x7ff77806b100 2023-11-29T11:17:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff776ffd700 1 -- 172.21.15.81:0/1628811157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770007600 con 0x7ff77806b100 2023-11-29T11:17:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.412+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77806c9a0 con 0x7ff77806b100 2023-11-29T11:17:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.416+0000 7ff776ffd700 1 -- 172.21.15.81:0/1628811157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff77002c070 con 0x7ff77806b100 2023-11-29T11:17:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.416+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff778072500 con 0x7ff77806b100 2023-11-29T11:17:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.416+0000 7ff776ffd700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff764064ee0 0x7ff764067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.416+0000 7ff776ffd700 1 -- 172.21.15.81:0/1628811157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff770082920 con 0x7ff77806b100 2023-11-29T11:17:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.416+0000 7ff77e10b700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff764064ee0 0x7ff764067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.416+0000 7ff77e10b700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff764064ee0 0x7ff764067390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009c00 tx=0x7ff76c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.424+0000 7ff776ffd700 1 -- 172.21.15.81:0/1628811157 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff7700509f0 con 0x7ff77806b100 2023-11-29T11:17:28.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:28.620+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff7780c6fb0 con 0x7ff77806b100 2023-11-29T11:17:29.180 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:17:29.172+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:17:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.188+0000 7ff776ffd700 1 -- 172.21.15.81:0/1628811157 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff770054010 con 0x7ff77806b100 2023-11-29T11:17:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff764064ee0 msgr2=0x7ff764067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff764064ee0 0x7ff764067390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009c00 tx=0x7ff76c008040 comp rx=0 tx=0).stop 2023-11-29T11:17:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff77806b100 msgr2=0x7ff7780cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff77806b100 0x7ff7780cc4f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff770007fd0 tx=0x7ff770001980 comp rx=0 tx=0).stop 2023-11-29T11:17:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 shutdown_connections 2023-11-29T11:17:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff764064ee0 0x7ff764067390 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff77806b100 0x7ff7780cc4f0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff778153600 0x7ff7780cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 --2- 172.21.15.81:0/1628811157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff778153230 0x7ff7780c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 >> 172.21.15.81:0/1628811157 conn(0x7ff7780ce3e0 msgr2=0x7ff77806fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 shutdown_connections 2023-11-29T11:17:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.192+0000 7ff77f10d700 1 -- 172.21.15.81:0/1628811157 wait complete. 2023-11-29T11:17:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:17:29.203 INFO:tasks.ceph.mds.a.smithi081.stderr: -5987> 2023-11-29T11:16:12.534+0000 7f9bc34a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:17:29.205 INFO:tasks.ceph.mds.a.smithi081.stderr: -4407> 2023-11-29T11:16:19.934+0000 7f9bbfc99700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6774=0-4194304@1} caps={6774=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6774 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x556f558cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-29T11:17:29.206 INFO:tasks.ceph.mds.a.smithi081.stderr: -2671> 2023-11-29T11:16:51.321+0000 7f9bbfc99700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2023-11-29T11:16:18.789800+0000 1=1+0) (iversion lock) caps={6774=pAsLsXsFs/-@2},l=6774(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x556f558cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-29T11:17:29.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T11:17:29.241 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:17:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 Processor -- start 2023-11-29T11:17:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- start start 2023-11-29T11:17:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70200c5c20 0x7f702006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f702006aee0 0x7f70200d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70200b5090 con 0x7f70200b5ec0 2023-11-29T11:17:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70200c5ff0 con 0x7f70200c5c20 2023-11-29T11:17:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70200b4480 con 0x7f702006aee0 2023-11-29T11:17:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70200c5c20 0x7f702006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:29.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701dd9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70200b5ec0 0x7f702006a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50678/0 (socket says 172.21.15.81:50678) 2023-11-29T11:17:29.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701dd9b700 1 -- 172.21.15.81:0/3536340909 learned_addr learned my addr 172.21.15.81:0/3536340909 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701ed9d700 1 --2- 172.21.15.81:0/3536340909 >> v2:172.21.15.176:3300/0 conn(0x7f702006aee0 0x7f70200d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701d59a700 1 -- 172.21.15.81:0/3536340909 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954447669 0 0) 0x7f70200b5090 con 0x7f70200b5ec0 2023-11-29T11:17:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701d59a700 1 -- 172.21.15.81:0/3536340909 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70000035d0 con 0x7f70200b5ec0 2023-11-29T11:17:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701e59c700 1 -- 172.21.15.81:0/3536340909 >> v2:172.21.15.176:3300/0 conn(0x7f702006aee0 msgr2=0x7f70200d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701e59c700 1 --2- 172.21.15.81:0/3536340909 >> v2:172.21.15.176:3300/0 conn(0x7f702006aee0 0x7f70200d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701e59c700 1 -- 172.21.15.81:0/3536340909 >> v1:172.21.15.81:6789/0 conn(0x7f70200b5ec0 legacy=0x7f702006a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701e59c700 1 -- 172.21.15.81:0/3536340909 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200b4760 con 0x7f70200c5c20 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701e59c700 1 --2- 172.21.15.81:0/3536340909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70200c5c20 0x7f702006cdd0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f702008c840 tx=0x7f7008009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf649542eb77d397 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701d59a700 1 -- 172.21.15.81:0/3536340909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008011830 con 0x7f70200c5c20 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701d59a700 1 -- 172.21.15.81:0/3536340909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008011990 con 0x7f70200c5c20 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701d59a700 1 -- 172.21.15.81:0/3536340909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008011d20 con 0x7f70200c5c20 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- 172.21.15.81:0/3536340909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70200c5c20 msgr2=0x7f702006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 --2- 172.21.15.81:0/3536340909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70200c5c20 0x7f702006cdd0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f702008c840 tx=0x7f7008009b30 comp rx=0 tx=0).stop 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- 172.21.15.81:0/3536340909 shutdown_connections 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 --2- 172.21.15.81:0/3536340909 >> v2:172.21.15.176:3300/0 conn(0x7f702006aee0 0x7f70200d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 --2- 172.21.15.81:0/3536340909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70200c5c20 0x7f702006cdd0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- 172.21.15.81:0/3536340909 >> 172.21.15.81:0/3536340909 conn(0x7f702009bbd0 msgr2=0x7f70200b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- 172.21.15.81:0/3536340909 shutdown_connections 2023-11-29T11:17:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.320+0000 7f701f59e700 1 -- 172.21.15.81:0/3536340909 wait complete. 2023-11-29T11:17:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 Processor -- start 2023-11-29T11:17:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 -- start start 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702006aee0 0x7f70200b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70200b5ec0 0x7f70201e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70200c5c20 0x7f70201e1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200cf150 con 0x7f702006aee0 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200af370 con 0x7f70200c5c20 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200af650 con 0x7f70200b5ec0 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702006aee0 0x7f70200b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702006aee0 0x7f70200b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51970/0 (socket says 172.21.15.81:51970) 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 -- 172.21.15.81:0/1341668615 learned_addr learned my addr 172.21.15.81:0/1341668615 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701dd9b700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70200b5ec0 0x7f70201e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 -- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70200b5ec0 msgr2=0x7f70201e0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70200b5ec0 0x7f70201e0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 -- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70200c5c20 msgr2=0x7f70201e1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701ed9d700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70200c5c20 0x7f70201e1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70200c5c20 0x7f70201e1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 -- 172.21.15.81:0/1341668615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080094b0 con 0x7f702006aee0 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701dd9b700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70200b5ec0 0x7f70201e0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701ed9d700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70200c5c20 0x7f70201e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701e59c700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702006aee0 0x7f70200b09c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f70080090b0 tx=0x7f7008004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f7016ffd700 1 -- 172.21.15.81:0/1341668615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080038c0 con 0x7f702006aee0 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f7016ffd700 1 -- 172.21.15.81:0/1341668615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700801e070 con 0x7f702006aee0 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.324+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70200b4d20 con 0x7f702006aee0 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.328+0000 7f7016ffd700 1 -- 172.21.15.81:0/1341668615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008003c40 con 0x7f702006aee0 2023-11-29T11:17:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.328+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70200b4a40 con 0x7f702006aee0 2023-11-29T11:17:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.328+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70200d2450 con 0x7f702006aee0 2023-11-29T11:17:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.328+0000 7f7016ffd700 1 -- 172.21.15.81:0/1341668615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f700800f050 con 0x7f702006aee0 2023-11-29T11:17:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.328+0000 7f7016ffd700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7004064f10 0x7f70040673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.328+0000 7f7016ffd700 1 -- 172.21.15.81:0/1341668615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f70080830b0 con 0x7f702006aee0 2023-11-29T11:17:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.328+0000 7f701dd9b700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7004064f10 0x7f70040673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:29.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.332+0000 7f701dd9b700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7004064f10 0x7f70040673c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f70201e7510 tx=0x7f7010009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:29.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.340+0000 7f7016ffd700 1 -- 172.21.15.81:0/1341668615 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7008051000 con 0x7f702006aee0 2023-11-29T11:17:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:29.540+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7020072500 con 0x7f702006aee0 2023-11-29T11:17:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.200+0000 7f7016ffd700 1 -- 172.21.15.81:0/1341668615 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7008054620 con 0x7f702006aee0 2023-11-29T11:17:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7004064f10 msgr2=0x7f70040673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7004064f10 0x7f70040673c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f70201e7510 tx=0x7f7010009040 comp rx=0 tx=0).stop 2023-11-29T11:17:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702006aee0 msgr2=0x7f70200b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702006aee0 0x7f70200b09c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f70080090b0 tx=0x7f7008004770 comp rx=0 tx=0).stop 2023-11-29T11:17:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 shutdown_connections 2023-11-29T11:17:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7004064f10 0x7f70040673c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70200c5c20 0x7f70201e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70200b5ec0 0x7f70201e0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 --2- 172.21.15.81:0/1341668615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f702006aee0 0x7f70200b09c0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 >> 172.21.15.81:0/1341668615 conn(0x7f702009bbd0 msgr2=0x7f702006ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 shutdown_connections 2023-11-29T11:17:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.204+0000 7f701f59e700 1 -- 172.21.15.81:0/1341668615 wait complete. 2023-11-29T11:17:30.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T11:17:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 Processor -- start 2023-11-29T11:17:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 -- start start 2023-11-29T11:17:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd9c06c3b0 0x7fdd9c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0cec90 con 0x7fdd9c15a050 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c153bb0 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c06cd10 con 0x7fdd9c15cc20 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd9c06c3b0 0x7fdd9c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd9c06c3b0 0x7fdd9c06c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39096/0 (socket says 172.21.15.81:39096) 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9bfff700 1 -- 172.21.15.81:0/2801506534 learned_addr learned my addr 172.21.15.81:0/2801506534 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9affd700 1 --2- 172.21.15.81:0/2801506534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9bfff700 1 -- 172.21.15.81:0/2801506534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 msgr2=0x7fdd9c15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9bfff700 1 --2- 172.21.15.81:0/2801506534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9bfff700 1 -- 172.21.15.81:0/2801506534 >> v1:172.21.15.176:6789/0 conn(0x7fdd9c15a050 legacy=0x7fdd9c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9bfff700 1 -- 172.21.15.81:0/2801506534 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c1599a0 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9bfff700 1 --2- 172.21.15.81:0/2801506534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c06c7d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009e50 tx=0x7fdd9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4eef5ed1523399 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9a7fc700 1 -- 172.21.15.81:0/2801506534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400e070 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9a7fc700 1 -- 172.21.15.81:0/2801506534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400b910 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdd9a7fc700 1 -- 172.21.15.81:0/2801506534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400bcc0 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 -- 172.21.15.81:0/2801506534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c06c3b0 msgr2=0x7fdd9c06c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.388+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/2801506534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c06c7d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009e50 tx=0x7fdd9400b330 comp rx=0 tx=0).stop 2023-11-29T11:17:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 -- 172.21.15.81:0/2801506534 shutdown_connections 2023-11-29T11:17:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/2801506534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c06c7d0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/2801506534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 -- 172.21.15.81:0/2801506534 >> 172.21.15.81:0/2801506534 conn(0x7fdd9c0b0a90 msgr2=0x7fdd9c0b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 -- 172.21.15.81:0/2801506534 shutdown_connections 2023-11-29T11:17:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 -- 172.21.15.81:0/2801506534 wait complete. 2023-11-29T11:17:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 Processor -- start 2023-11-29T11:17:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 -- start start 2023-11-29T11:17:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c15a050 0x7fdd9c1f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c1ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0c6310 con 0x7fdd9c15a050 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c147f10 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdda1a9f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c1f3fc0 con 0x7fdd9c15cc20 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdd9affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c15a050 0x7fdd9c1f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdd9b7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdd9affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c15a050 0x7fdd9c1f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39110/0 (socket says 172.21.15.81:39110) 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdd9b7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c0afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:39252/0 (socket says 172.21.15.81:39252) 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdd9affd700 1 -- 172.21.15.81:0/4124201500 learned_addr learned my addr 172.21.15.81:0/4124201500 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.392+0000 7fdd9bfff700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c1ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd9b7fe700 1 -- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 msgr2=0x7fdd9c1ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd9b7fe700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c1ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd9b7fe700 1 -- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c15a050 msgr2=0x7fdd9c1f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd9b7fe700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c15a050 0x7fdd9c1f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd9b7fe700 1 -- 172.21.15.81:0/4124201500 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd94009b30 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd9bfff700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c1ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd9affd700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c15a050 0x7fdd9c1f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd9b7fe700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c0afd40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c4d0 tx=0x7fdd8c00c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd83fff700 1 -- 172.21.15.81:0/4124201500 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0052d0 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd83fff700 1 -- 172.21.15.81:0/4124201500 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c005430 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c15d790 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd83fff700 1 -- 172.21.15.81:0/4124201500 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0055a0 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c0cdae0 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c15da70 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.396+0000 7fdd83fff700 1 -- 172.21.15.81:0/4124201500 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd8c019030 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.400+0000 7fdd83fff700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.400+0000 7fdd83fff700 1 -- 172.21.15.81:0/4124201500 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fdd8c081160 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.400+0000 7fdd9affd700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.400+0000 7fdd9affd700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c145150 tx=0x7fdd90009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.408+0000 7fdd83fff700 1 -- 172.21.15.81:0/4124201500 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd8c04f170 con 0x7fdd9c06c3b0 2023-11-29T11:17:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:30.572+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd9c072c20 con 0x7fdd9c06c3b0 2023-11-29T11:17:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.204+0000 7fdd83fff700 1 -- 172.21.15.81:0/4124201500 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdd8c052790 con 0x7fdd9c06c3b0 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 msgr2=0x7fdd88067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c145150 tx=0x7fdd90009240 comp rx=0 tx=0).stop 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd9c06c3b0 msgr2=0x7fdd9c0afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c0afd40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c4d0 tx=0x7fdd8c00c7e0 comp rx=0 tx=0).stop 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 shutdown_connections 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd88064ee0 0x7fdd88067390 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd9c15cc20 0x7fdd9c1ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd9c15a050 0x7fdd9c1f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 --2- 172.21.15.81:0/4124201500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd9c06c3b0 0x7fdd9c0afd40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 >> 172.21.15.81:0/4124201500 conn(0x7fdd9c0b0a90 msgr2=0x7fdd9c0b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 shutdown_connections 2023-11-29T11:17:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.212+0000 7fdda1a9f700 1 -- 172.21.15.81:0/4124201500 wait complete. 2023-11-29T11:17:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-11-29T11:17:31.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T11:17:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.340+0000 7fecf560b700 1 Processor -- start 2023-11-29T11:17:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.340+0000 7fecf560b700 1 -- start start 2023-11-29T11:17:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.340+0000 7fecf560b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fecf00b1ae0 0x7fecf006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.340+0000 7fecf560b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf006a9c0 con 0x7fecf00cf0e0 2023-11-29T11:17:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.340+0000 7fecf560b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf006aca0 con 0x7fecf006a4c0 2023-11-29T11:17:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf560b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf00d0ab0 con 0x7fecf00b1ae0 2023-11-29T11:17:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf4e0a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fecf00cf0e0 0x7fecf00cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58096/0 (socket says 172.21.15.81:58096) 2023-11-29T11:17:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf4e0a700 1 -- 172.21.15.81:0/3905630291 learned_addr learned my addr 172.21.15.81:0/3905630291 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceffff700 1 --2- 172.21.15.81:0/3905630291 >> v2:172.21.15.81:3300/0 conn(0x7fecf00b1ae0 0x7fecf006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceffff700 1 -- 172.21.15.81:0/3905630291 >> v1:172.21.15.176:6789/0 conn(0x7fecf006a4c0 legacy=0x7fecf00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceffff700 1 -- 172.21.15.81:0/3905630291 >> v1:172.21.15.81:6789/0 conn(0x7fecf00cf0e0 legacy=0x7fecf00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceffff700 1 -- 172.21.15.81:0/3905630291 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf006af80 con 0x7fecf00b1ae0 2023-11-29T11:17:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceeffd700 1 -- 172.21.15.81:0/3905630291 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950838575 0 0) 0x7fecf006a9c0 con 0x7fecf00cf0e0 2023-11-29T11:17:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceffff700 1 --2- 172.21.15.81:0/3905630291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00b1ae0 0x7fecf006d8e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fece0009850 tx=0x7fece0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ed62b20e20eedb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceeffd700 1 -- 172.21.15.81:0/3905630291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0011830 con 0x7fecf00b1ae0 2023-11-29T11:17:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceeffd700 1 -- 172.21.15.81:0/3905630291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0011990 con 0x7fecf00b1ae0 2023-11-29T11:17:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7feceeffd700 1 -- 172.21.15.81:0/3905630291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0011d20 con 0x7fecf00b1ae0 2023-11-29T11:17:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf560b700 1 -- 172.21.15.81:0/3905630291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00b1ae0 msgr2=0x7fecf006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf560b700 1 --2- 172.21.15.81:0/3905630291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00b1ae0 0x7fecf006d8e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fece0009850 tx=0x7fece0009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf560b700 1 -- 172.21.15.81:0/3905630291 shutdown_connections 2023-11-29T11:17:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf560b700 1 --2- 172.21.15.81:0/3905630291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00b1ae0 0x7fecf006d8e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf560b700 1 -- 172.21.15.81:0/3905630291 >> 172.21.15.81:0/3905630291 conn(0x7fecf009bbd0 msgr2=0x7fecf00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf560b700 1 -- 172.21.15.81:0/3905630291 shutdown_connections 2023-11-29T11:17:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.344+0000 7fecf560b700 1 -- 172.21.15.81:0/3905630291 wait complete. 2023-11-29T11:17:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 Processor -- start 2023-11-29T11:17:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 -- start start 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecf006a4c0 0x7fecf0158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecf00b1ae0 0x7fecf015f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00cf0e0 0x7fecf014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0150180 con 0x7fecf00cf0e0 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015e7d0 con 0x7fecf006a4c0 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015eab0 con 0x7fecf00b1ae0 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00cf0e0 0x7fecf014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00cf0e0 0x7fecf014fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39126/0 (socket says 172.21.15.81:39126) 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 -- 172.21.15.81:0/678714846 learned_addr learned my addr 172.21.15.81:0/678714846 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7feceffff700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecf006a4c0 0x7fecf0158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecef7fe700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecf00b1ae0 0x7fecf015f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 -- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecf00b1ae0 msgr2=0x7fecf015f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecf00b1ae0 0x7fecf015f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 -- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecf006a4c0 msgr2=0x7fecf0158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecf006a4c0 0x7fecf0158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 -- 172.21.15.81:0/678714846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00094b0 con 0x7fecf00cf0e0 2023-11-29T11:17:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecef7fe700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecf00b1ae0 0x7fecf015f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf4e0a700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00cf0e0 0x7fecf014fc40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fece8002230 tx=0x7fece800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fececff9700 1 -- 172.21.15.81:0/678714846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece800ab70 con 0x7fecf00cf0e0 2023-11-29T11:17:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fececff9700 1 -- 172.21.15.81:0/678714846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece800acf0 con 0x7fecf00cf0e0 2023-11-29T11:17:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf00b1eb0 con 0x7fecf00cf0e0 2023-11-29T11:17:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fececff9700 1 -- 172.21.15.81:0/678714846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8007310 con 0x7fecf00cf0e0 2023-11-29T11:17:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.348+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf00b4380 con 0x7fecf00cf0e0 2023-11-29T11:17:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.352+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf00b60e0 con 0x7fecf00cf0e0 2023-11-29T11:17:31.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.352+0000 7fececff9700 1 -- 172.21.15.81:0/678714846 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fece801a030 con 0x7fecf00cf0e0 2023-11-29T11:17:31.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.352+0000 7fececff9700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fecdc064ee0 0x7fecdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.352+0000 7feceffff700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fecdc064ee0 0x7fecdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.352+0000 7fececff9700 1 -- 172.21.15.81:0/678714846 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6088+0+0 (secure 0 0 0) 0x7fece8081b90 con 0x7fecf00cf0e0 2023-11-29T11:17:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.352+0000 7feceffff700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fecdc064ee0 0x7fecdc067390 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fece00090b0 tx=0x7fece001c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.360+0000 7fececff9700 1 -- 172.21.15.81:0/678714846 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fece804fd10 con 0x7fecf00cf0e0 2023-11-29T11:17:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:31.524+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fecf0072500 con 0x7fecf00cf0e0 2023-11-29T11:17:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.220+0000 7fececff9700 1 -- 172.21.15.81:0/678714846 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7fece80180d0 con 0x7fecf00cf0e0 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fecdc064ee0 msgr2=0x7fecdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fecdc064ee0 0x7fecdc067390 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fece00090b0 tx=0x7fece001c040 comp rx=0 tx=0).stop 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00cf0e0 msgr2=0x7fecf014fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00cf0e0 0x7fecf014fc40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fece8002230 tx=0x7fece800cf50 comp rx=0 tx=0).stop 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 shutdown_connections 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fecdc064ee0 0x7fecdc067390 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf00cf0e0 0x7fecf014fc40 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fecf00b1ae0 0x7fecf015f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 --2- 172.21.15.81:0/678714846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fecf006a4c0 0x7fecf0158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 >> 172.21.15.81:0/678714846 conn(0x7fecf009bbd0 msgr2=0x7fecf00d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 shutdown_connections 2023-11-29T11:17:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.228+0000 7fecf560b700 1 -- 172.21.15.81:0/678714846 wait complete. 2023-11-29T11:17:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-11-29T11:17:32.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-29T11:17:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.352+0000 7fdb1acc7700 1 Processor -- start 2023-11-29T11:17:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.352+0000 7fdb1acc7700 1 -- start start 2023-11-29T11:17:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb1acc7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb14158ee0 0x7fdb140ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb1acc7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1406d1c0 con 0x7fdb140cd5d0 2023-11-29T11:17:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb1acc7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140ca3a0 con 0x7fdb140ce230 2023-11-29T11:17:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb1acc7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1406e000 con 0x7fdb14158ee0 2023-11-29T11:17:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb194c4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdb140cd5d0 0x7fdb140cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58104/0 (socket says 172.21.15.81:58104) 2023-11-29T11:17:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb194c4700 1 -- 172.21.15.81:0/1326255848 learned_addr learned my addr 172.21.15.81:0/1326255848 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb19cc5700 1 --2- 172.21.15.81:0/1326255848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb14158ee0 0x7fdb140ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb18cc3700 1 -- 172.21.15.81:0/1326255848 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75735411 0 0) 0x7fdb04001290 con 0x7fdb140cd5d0 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb18cc3700 1 -- 172.21.15.81:0/1326255848 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb000035d0 con 0x7fdb140cd5d0 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb18cc3700 1 -- 172.21.15.81:0/1326255848 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435128692 0 0) 0x7fdb140ca3a0 con 0x7fdb140ce230 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb18cc3700 1 -- 172.21.15.81:0/1326255848 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb04001290 con 0x7fdb140ce230 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb19cc5700 1 -- 172.21.15.81:0/1326255848 >> v1:172.21.15.176:6789/0 conn(0x7fdb140ce230 legacy=0x7fdb140cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb19cc5700 1 -- 172.21.15.81:0/1326255848 >> v1:172.21.15.81:6789/0 conn(0x7fdb140cd5d0 legacy=0x7fdb140cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb19cc5700 1 -- 172.21.15.81:0/1326255848 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1406c920 con 0x7fdb14158ee0 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb19cc5700 1 --2- 172.21.15.81:0/1326255848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb14158ee0 0x7fdb140ae760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009880 tx=0x7fdb10009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1a243f1e1cc37a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb18cc3700 1 -- 172.21.15.81:0/1326255848 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011830 con 0x7fdb14158ee0 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb18cc3700 1 -- 172.21.15.81:0/1326255848 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb10011990 con 0x7fdb14158ee0 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb18cc3700 1 -- 172.21.15.81:0/1326255848 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011d20 con 0x7fdb14158ee0 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1326255848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb14158ee0 msgr2=0x7fdb140ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.356+0000 7fdb1acc7700 1 --2- 172.21.15.81:0/1326255848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb14158ee0 0x7fdb140ae760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009880 tx=0x7fdb10009b90 comp rx=0 tx=0).stop 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1326255848 shutdown_connections 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 --2- 172.21.15.81:0/1326255848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb14158ee0 0x7fdb140ae760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1326255848 >> 172.21.15.81:0/1326255848 conn(0x7fdb140d0240 msgr2=0x7fdb140cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1326255848 shutdown_connections 2023-11-29T11:17:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1326255848 wait complete. 2023-11-29T11:17:32.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 Processor -- start 2023-11-29T11:17:32.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 -- start start 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb140cd5d0 0x7fdb14152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140ce230 0x7fdb14151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb14158ee0 0x7fdb141efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1415a870 con 0x7fdb14158ee0 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb141522b0 con 0x7fdb140cd5d0 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1acc7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14152630 con 0x7fdb140ce230 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb14158ee0 0x7fdb141efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb14158ee0 0x7fdb141efa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39136/0 (socket says 172.21.15.81:39136) 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 -- 172.21.15.81:0/1733996588 learned_addr learned my addr 172.21.15.81:0/1733996588 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb194c4700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140ce230 0x7fdb14151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb19cc5700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb140cd5d0 0x7fdb14152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 -- 172.21.15.81:0/1733996588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140ce230 msgr2=0x7fdb14151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140ce230 0x7fdb14151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 -- 172.21.15.81:0/1733996588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb140cd5d0 msgr2=0x7fdb14152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb140cd5d0 0x7fdb14152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 -- 172.21.15.81:0/1733996588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100094b0 con 0x7fdb14158ee0 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.360+0000 7fdb1a4c6700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb14158ee0 0x7fdb141efa30 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00cbc0 tx=0x7fdb0c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb0a7fc700 1 -- 172.21.15.81:0/1733996588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c003c20 con 0x7fdb14158ee0 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb0a7fc700 1 -- 172.21.15.81:0/1733996588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c003d80 con 0x7fdb14158ee0 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1406cee0 con 0x7fdb14158ee0 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb0a7fc700 1 -- 172.21.15.81:0/1733996588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00aaa0 con 0x7fdb14158ee0 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1406cc00 con 0x7fdb14158ee0 2023-11-29T11:17:32.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb140ca640 con 0x7fdb14158ee0 2023-11-29T11:17:32.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb0a7fc700 1 -- 172.21.15.81:0/1733996588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdb0c010050 con 0x7fdb14158ee0 2023-11-29T11:17:32.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb0a7fc700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdaf8064f10 0x7fdaf80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb0a7fc700 1 -- 172.21.15.81:0/1733996588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fdb0c081b60 con 0x7fdb14158ee0 2023-11-29T11:17:32.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.364+0000 7fdb19cc5700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdaf8064f10 0x7fdaf80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.368+0000 7fdb19cc5700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdaf8064f10 0x7fdaf80673c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdb100090b0 tx=0x7fdb1001c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.372+0000 7fdb0a7fc700 1 -- 172.21.15.81:0/1733996588 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdb0c04fe40 con 0x7fdb14158ee0 2023-11-29T11:17:32.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.548+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdb14072c20 con 0x7fdb14158ee0 2023-11-29T11:17:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.556+0000 7fdb0a7fc700 1 -- 172.21.15.81:0/1733996588 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb0c053460 con 0x7fdb14158ee0 2023-11-29T11:17:32.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdaf8064f10 msgr2=0x7fdaf80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdaf8064f10 0x7fdaf80673c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdb100090b0 tx=0x7fdb1001c040 comp rx=0 tx=0).stop 2023-11-29T11:17:32.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb14158ee0 msgr2=0x7fdb141efa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb14158ee0 0x7fdb141efa30 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00cbc0 tx=0x7fdb0c00ced0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 shutdown_connections 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdaf8064f10 0x7fdaf80673c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb14158ee0 0x7fdb141efa30 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140ce230 0x7fdb14151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 --2- 172.21.15.81:0/1733996588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb140cd5d0 0x7fdb14152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 >> 172.21.15.81:0/1733996588 conn(0x7fdb140d0240 msgr2=0x7fdb140b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 shutdown_connections 2023-11-29T11:17:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.560+0000 7fdb1acc7700 1 -- 172.21.15.81:0/1733996588 wait complete. 2023-11-29T11:17:32.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-29T11:17:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c42de5700 1 Processor -- start 2023-11-29T11:17:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c42de5700 1 -- start start 2023-11-29T11:17:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c42de5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7c3c1580b0 0x7f7c3c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c42de5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c15c510 con 0x7f7c3c158480 2023-11-29T11:17:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c42de5700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c15cd30 con 0x7f7c3c070c60 2023-11-29T11:17:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c42de5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c15c770 con 0x7f7c3c1580b0 2023-11-29T11:17:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c41382700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7c3c158480 0x7f7c3c0ca500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58110/0 (socket says 172.21.15.81:58110) 2023-11-29T11:17:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c41382700 1 -- 172.21.15.81:0/752886330 learned_addr learned my addr 172.21.15.81:0/752886330 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:32.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c40b81700 1 --2- 172.21.15.81:0/752886330 >> v2:172.21.15.176:3300/0 conn(0x7f7c3c1580b0 0x7f7c3c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925039130 0 0) 0x7f7c3c15c510 con 0x7f7c3c158480 2023-11-29T11:17:32.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c280035d0 con 0x7f7c3c158480 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440077955 0 0) 0x7f7c280035d0 con 0x7f7c3c158480 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 >> v2:172.21.15.176:3300/0 conn(0x7f7c3c1580b0 msgr2=0x7f7c3c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 --2- 172.21.15.81:0/752886330 >> v2:172.21.15.176:3300/0 conn(0x7f7c3c1580b0 0x7f7c3c069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 >> v1:172.21.15.176:6789/0 conn(0x7f7c3c070c60 legacy=0x7f7c3c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c15ca50 con 0x7f7c3c158480 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f7c34001690 con 0x7f7c3c158480 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 >> v1:172.21.15.81:6789/0 conn(0x7f7c3c158480 legacy=0x7f7c3c0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c28003a20 0x7f7c28003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c28004410 0x7f7c280048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c280050d0 0x7f7c2800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c15c770 con 0x7f7c28003a20 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.688+0000 7f7c40b81700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c28003a20 0x7f7c28003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2800c020 con 0x7f7c28004410 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2800c1e0 con 0x7f7c280050d0 2023-11-29T11:17:32.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c3bfff700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c28004410 0x7f7c280048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c41382700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c280050d0 0x7f7c2800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c40b81700 1 -- 172.21.15.81:0/752886330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c280050d0 msgr2=0x7f7c2800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c40b81700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c280050d0 0x7f7c2800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c40b81700 1 -- 172.21.15.81:0/752886330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c28004410 msgr2=0x7f7c280048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c40b81700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c28004410 0x7f7c280048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c41382700 1 -- 172.21.15.81:0/752886330 reap_dead start 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c40b81700 1 -- 172.21.15.81:0/752886330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280035d0 con 0x7f7c28003a20 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c40b81700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c28003a20 0x7f7c28003df0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009b70 tx=0x7f7c280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71395937133cab48 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00e6c0 con 0x7f7c28003a20 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00e820 con 0x7f7c28003a20 2023-11-29T11:17:32.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c3b7fe700 1 -- 172.21.15.81:0/752886330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00eb90 con 0x7f7c28003a20 2023-11-29T11:17:32.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c42de5700 1 -- 172.21.15.81:0/752886330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c28003a20 msgr2=0x7f7c28003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c42de5700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c28003a20 0x7f7c28003df0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009b70 tx=0x7f7c280058a0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c42de5700 1 -- 172.21.15.81:0/752886330 shutdown_connections 2023-11-29T11:17:32.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c42de5700 1 --2- 172.21.15.81:0/752886330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c28003a20 0x7f7c28003df0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c42de5700 1 -- 172.21.15.81:0/752886330 >> 172.21.15.81:0/752886330 conn(0x7f7c3c06caf0 msgr2=0x7f7c3c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:32.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c42de5700 1 -- 172.21.15.81:0/752886330 shutdown_connections 2023-11-29T11:17:32.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.692+0000 7f7c42de5700 1 -- 172.21.15.81:0/752886330 wait complete. 2023-11-29T11:17:32.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 Processor -- start 2023-11-29T11:17:32.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 -- start start 2023-11-29T11:17:32.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c28003a20 0x7f7c3c15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3c15b4c0 0x7f7c3c158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c3c0c6290 0x7f7c3c1641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c15abf0 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0c6aa0 con 0x7f7c3c0c6290 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c158dc0 con 0x7f7c28003a20 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3c15b4c0 0x7f7c3c158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3c15b4c0 0x7f7c3c158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39154/0 (socket says 172.21.15.81:39154) 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 -- 172.21.15.81:0/1335318826 learned_addr learned my addr 172.21.15.81:0/1335318826 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c40b81700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c28003a20 0x7f7c3c15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c41382700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c3c0c6290 0x7f7c3c1641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 -- 172.21.15.81:0/1335318826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c28003a20 msgr2=0x7f7c3c15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c28003a20 0x7f7c3c15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 -- 172.21.15.81:0/1335318826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c3c0c6290 msgr2=0x7f7c3c1641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c3c0c6290 0x7f7c3c1641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 -- 172.21.15.81:0/1335318826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0c9fe0 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c3bfff700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3c15b4c0 0x7f7c3c158880 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7c24001ff0 tx=0x7f7c2400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:32.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c397fa700 1 -- 172.21.15.81:0/1335318826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24003c30 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c397fa700 1 -- 172.21.15.81:0/1335318826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24003d90 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c0c9d00 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c397fa700 1 -- 172.21.15.81:0/1335318826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400dc80 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c06e0e0 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.696+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c072500 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.700+0000 7f7c397fa700 1 -- 172.21.15.81:0/1335318826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7c240050d0 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.700+0000 7f7c397fa700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c1c064f10 0x7f7c1c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.700+0000 7f7c40b81700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c1c064f10 0x7f7c1c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.700+0000 7f7c397fa700 1 -- 172.21.15.81:0/1335318826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7c240822f0 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.700+0000 7f7c40b81700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c1c064f10 0x7f7c1c0673c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0090b0 tx=0x7f7c2c01e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.704+0000 7f7c397fa700 1 -- 172.21.15.81:0/1335318826 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7c24050580 con 0x7f7c3c15b4c0 2023-11-29T11:17:32.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:32.920+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f7c3c070500 con 0x7f7c3c15b4c0 2023-11-29T11:17:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.232+0000 7f7c397fa700 1 -- 172.21.15.81:0/1335318826 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v235) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c24053ba0 con 0x7f7c3c15b4c0 2023-11-29T11:17:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.232+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c1c064f10 msgr2=0x7f7c1c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.232+0000 7f7c42de5700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c1c064f10 0x7f7c1c0673c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0090b0 tx=0x7f7c2c01e040 comp rx=0 tx=0).stop 2023-11-29T11:17:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.232+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3c15b4c0 msgr2=0x7f7c3c158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.232+0000 7f7c42de5700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3c15b4c0 0x7f7c3c158880 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7c24001ff0 tx=0x7f7c2400d430 comp rx=0 tx=0).stop 2023-11-29T11:17:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.236+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 shutdown_connections 2023-11-29T11:17:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.236+0000 7f7c42de5700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c1c064f10 0x7f7c1c0673c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.236+0000 7f7c42de5700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c3c0c6290 0x7f7c3c1641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.236+0000 7f7c42de5700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3c15b4c0 0x7f7c3c158880 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:33.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.236+0000 7f7c42de5700 1 --2- 172.21.15.81:0/1335318826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c28003a20 0x7f7c3c15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:33.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.236+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 >> 172.21.15.81:0/1335318826 conn(0x7f7c3c06caf0 msgr2=0x7f7c3c071060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:33.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.236+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 shutdown_connections 2023-11-29T11:17:33.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.236+0000 7f7c42de5700 1 -- 172.21.15.81:0/1335318826 wait complete. 2023-11-29T11:17:33.258 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2023-11-29T11:17:33.258 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-29T11:17:33.258 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:17:33.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2023-11-29T11:17:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c994e6700 1 Processor -- start 2023-11-29T11:17:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c994e6700 1 -- start start 2023-11-29T11:17:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c994e6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c9406a530 0x7f8c940cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c994e6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9406dc70 con 0x7f8c9406d7d0 2023-11-29T11:17:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c994e6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9415c6d0 con 0x7f8c940cf050 2023-11-29T11:17:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c994e6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940b5320 con 0x7f8c9406a530 2023-11-29T11:17:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c98ce5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c9406a530 0x7f8c940cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c937fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8c9406d7d0 0x7f8c940b4c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58124/0 (socket says 172.21.15.81:58124) 2023-11-29T11:17:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c937fe700 1 -- 172.21.15.81:0/3060742723 learned_addr learned my addr 172.21.15.81:0/3060742723 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c92ffd700 1 -- 172.21.15.81:0/3060742723 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384176396 0 0) 0x7f8c84001110 con 0x7f8c9406d7d0 2023-11-29T11:17:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c92ffd700 1 -- 172.21.15.81:0/3060742723 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c740035d0 con 0x7f8c9406d7d0 2023-11-29T11:17:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c92ffd700 1 -- 172.21.15.81:0/3060742723 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458738039 0 0) 0x7f8c9415c6d0 con 0x7f8c940cf050 2023-11-29T11:17:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c92ffd700 1 -- 172.21.15.81:0/3060742723 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c84001110 con 0x7f8c940cf050 2023-11-29T11:17:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c98ce5700 1 -- 172.21.15.81:0/3060742723 >> v1:172.21.15.176:6789/0 conn(0x7f8c940cf050 legacy=0x7f8c940cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c98ce5700 1 -- 172.21.15.81:0/3060742723 >> v1:172.21.15.81:6789/0 conn(0x7f8c9406d7d0 legacy=0x7f8c940b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c98ce5700 1 -- 172.21.15.81:0/3060742723 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9406a9b0 con 0x7f8c9406a530 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c98ce5700 1 --2- 172.21.15.81:0/3060742723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c9406a530 0x7f8c940cce20 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009d90 tx=0x7f8c8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422810381fe2a2a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c92ffd700 1 -- 172.21.15.81:0/3060742723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00e070 con 0x7f8c9406a530 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c92ffd700 1 -- 172.21.15.81:0/3060742723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00bb20 con 0x7f8c9406a530 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c92ffd700 1 -- 172.21.15.81:0/3060742723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00be90 con 0x7f8c9406a530 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c994e6700 1 -- 172.21.15.81:0/3060742723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c9406a530 msgr2=0x7f8c940cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.372+0000 7f8c994e6700 1 --2- 172.21.15.81:0/3060742723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c9406a530 0x7f8c940cce20 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009d90 tx=0x7f8c8c00b330 comp rx=0 tx=0).stop 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 -- 172.21.15.81:0/3060742723 shutdown_connections 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 --2- 172.21.15.81:0/3060742723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c9406a530 0x7f8c940cce20 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 -- 172.21.15.81:0/3060742723 >> 172.21.15.81:0/3060742723 conn(0x7f8c9409bb30 msgr2=0x7f8c940b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 -- 172.21.15.81:0/3060742723 shutdown_connections 2023-11-29T11:17:33.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 -- 172.21.15.81:0/3060742723 wait complete. 2023-11-29T11:17:33.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 Processor -- start 2023-11-29T11:17:33.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 -- start start 2023-11-29T11:17:33.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c9406a530 0x7f8c94156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c9406d7d0 0x7f8c940c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c940cf050 0x7f8c94158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940c63a0 con 0x7f8c940cf050 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94157380 con 0x7f8c9406a530 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c994e6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c941594e0 con 0x7f8c9406d7d0 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c98ce5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c940cf050 0x7f8c94158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c98ce5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c940cf050 0x7f8c94158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39172/0 (socket says 172.21.15.81:39172) 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c98ce5700 1 -- 172.21.15.81:0/2317738483 learned_addr learned my addr 172.21.15.81:0/2317738483 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c93fff700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c9406a530 0x7f8c94156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c937fe700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c9406d7d0 0x7f8c940c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c98ce5700 1 -- 172.21.15.81:0/2317738483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c9406d7d0 msgr2=0x7f8c940c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c98ce5700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c9406d7d0 0x7f8c940c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c98ce5700 1 -- 172.21.15.81:0/2317738483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c9406a530 msgr2=0x7f8c94156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:33.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.376+0000 7f8c98ce5700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c9406a530 0x7f8c94156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:33.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c98ce5700 1 -- 172.21.15.81:0/2317738483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009a70 con 0x7f8c940cf050 2023-11-29T11:17:33.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c98ce5700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c940cf050 0x7f8c94158a40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00b370 tx=0x7f8c8c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:33.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c90ff9700 1 -- 172.21.15.81:0/2317738483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0098f0 con 0x7f8c940cf050 2023-11-29T11:17:33.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c90ff9700 1 -- 172.21.15.81:0/2317738483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c01f070 con 0x7f8c940cf050 2023-11-29T11:17:33.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9406af40 con 0x7f8c940cf050 2023-11-29T11:17:33.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c90ff9700 1 -- 172.21.15.81:0/2317738483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c003c60 con 0x7f8c940cf050 2023-11-29T11:17:33.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9406ac60 con 0x7f8c940cf050 2023-11-29T11:17:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c940b4410 con 0x7f8c940cf050 2023-11-29T11:17:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c90ff9700 1 -- 172.21.15.81:0/2317738483 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8c8c004030 con 0x7f8c940cf050 2023-11-29T11:17:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c90ff9700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8c78064ee0 0x7f8c78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c90ff9700 1 -- 172.21.15.81:0/2317738483 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8c8c083740 con 0x7f8c940cf050 2023-11-29T11:17:33.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.380+0000 7f8c93fff700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8c78064ee0 0x7f8c78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:33.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.384+0000 7f8c93fff700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8c78064ee0 0x7f8c78067390 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0017b0 tx=0x7f8c7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.388+0000 7f8c90ff9700 1 -- 172.21.15.81:0/2317738483 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8c8c051a20 con 0x7f8c940cf050 2023-11-29T11:17:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:33.608+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f8c94072500 con 0x7f8c940cf050 2023-11-29T11:17:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.236+0000 7f8c90ff9700 1 -- 172.21.15.81:0/2317738483 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v236) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8c8c055040 con 0x7f8c940cf050 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8c78064ee0 msgr2=0x7f8c78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8c78064ee0 0x7f8c78067390 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0017b0 tx=0x7f8c7c009040 comp rx=0 tx=0).stop 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c940cf050 msgr2=0x7f8c94158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c940cf050 0x7f8c94158a40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00b370 tx=0x7f8c8c004af0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 shutdown_connections 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8c78064ee0 0x7f8c78067390 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c940cf050 0x7f8c94158a40 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c9406d7d0 0x7f8c940c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 --2- 172.21.15.81:0/2317738483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c9406a530 0x7f8c94156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 >> 172.21.15.81:0/2317738483 conn(0x7f8c9409bb30 msgr2=0x7f8c9406cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 shutdown_connections 2023-11-29T11:17:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.240+0000 7f8c994e6700 1 -- 172.21.15.81:0/2317738483 wait complete. 2023-11-29T11:17:34.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-29T11:17:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.380+0000 7f233359e700 1 Processor -- start 2023-11-29T11:17:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.380+0000 7f233359e700 1 -- start start 2023-11-29T11:17:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23340b00e0 0x7f233415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f233409bdb0 0x7f233415d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23340b2db0 con 0x7f23340cbb30 2023-11-29T11:17:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23340b3240 con 0x7f23340b00e0 2023-11-29T11:17:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233406d840 con 0x7f233409bdb0 2023-11-29T11:17:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23340b00e0 0x7f233415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233259c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23340b00e0 0x7f233415d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39184/0 (socket says 172.21.15.81:39184) 2023-11-29T11:17:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233259c700 1 -- 172.21.15.81:0/2070595084 learned_addr learned my addr 172.21.15.81:0/2070595084 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f2329d9b700 1 --2- 172.21.15.81:0/2070595084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f233409bdb0 0x7f233415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233259c700 1 -- 172.21.15.81:0/2070595084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f233409bdb0 msgr2=0x7f233415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233259c700 1 --2- 172.21.15.81:0/2070595084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f233409bdb0 0x7f233415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233259c700 1 -- 172.21.15.81:0/2070595084 >> v1:172.21.15.176:6789/0 conn(0x7f23340cbb30 legacy=0x7f23340ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233259c700 1 -- 172.21.15.81:0/2070595084 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233406d560 con 0x7f23340b00e0 2023-11-29T11:17:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233259c700 1 --2- 172.21.15.81:0/2070595084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415d2e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2324009910 tx=0x7f2324009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9d3c9ce77aa8fe server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f2331d9b700 1 -- 172.21.15.81:0/2070595084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324011830 con 0x7f23340b00e0 2023-11-29T11:17:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f2331d9b700 1 -- 172.21.15.81:0/2070595084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2324011990 con 0x7f23340b00e0 2023-11-29T11:17:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f2331d9b700 1 -- 172.21.15.81:0/2070595084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324011d40 con 0x7f23340b00e0 2023-11-29T11:17:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 -- 172.21.15.81:0/2070595084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 msgr2=0x7f233415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 --2- 172.21.15.81:0/2070595084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415d2e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2324009910 tx=0x7f2324009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 -- 172.21.15.81:0/2070595084 shutdown_connections 2023-11-29T11:17:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 --2- 172.21.15.81:0/2070595084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f233409bdb0 0x7f233415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 --2- 172.21.15.81:0/2070595084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415d2e0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 -- 172.21.15.81:0/2070595084 >> 172.21.15.81:0/2070595084 conn(0x7f23340cae70 msgr2=0x7f23340cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 -- 172.21.15.81:0/2070595084 shutdown_connections 2023-11-29T11:17:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.384+0000 7f233359e700 1 -- 172.21.15.81:0/2070595084 wait complete. 2023-11-29T11:17:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 Processor -- start 2023-11-29T11:17:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 -- start start 2023-11-29T11:17:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f233409bdb0 0x7f233415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23340cbb30 0x7f2334155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23340c96f0 con 0x7f23340b00e0 2023-11-29T11:17:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23341546a0 con 0x7f233409bdb0 2023-11-29T11:17:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2334153a90 con 0x7f23340cbb30 2023-11-29T11:17:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39198/0 (socket says 172.21.15.81:39198) 2023-11-29T11:17:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 -- 172.21.15.81:0/6007338 learned_addr learned my addr 172.21.15.81:0/6007338 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233259c700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f233409bdb0 0x7f233415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2332d9d700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23340cbb30 0x7f2334155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 -- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23340cbb30 msgr2=0x7f2334155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23340cbb30 0x7f2334155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 -- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f233409bdb0 msgr2=0x7f233415c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f233409bdb0 0x7f233415c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 -- 172.21.15.81:0/6007338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324009570 con 0x7f23340b00e0 2023-11-29T11:17:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233259c700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f233409bdb0 0x7f233415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2332d9d700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23340cbb30 0x7f2334155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f2329d9b700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415a1d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f231c00e9d0 tx=0x7f231c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f232b7fe700 1 -- 172.21.15.81:0/6007338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c009720 con 0x7f23340b00e0 2023-11-29T11:17:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f232b7fe700 1 -- 172.21.15.81:0/6007338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00c850 con 0x7f23340b00e0 2023-11-29T11:17:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23340ac3d0 con 0x7f23340b00e0 2023-11-29T11:17:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f232b7fe700 1 -- 172.21.15.81:0/6007338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00cc00 con 0x7f23340b00e0 2023-11-29T11:17:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23340ac0f0 con 0x7f23340b00e0 2023-11-29T11:17:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.388+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233406cbe0 con 0x7f23340b00e0 2023-11-29T11:17:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.392+0000 7f232b7fe700 1 -- 172.21.15.81:0/6007338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f231c019030 con 0x7f23340b00e0 2023-11-29T11:17:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.392+0000 7f232b7fe700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2314064ee0 0x7f2314067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.392+0000 7f232b7fe700 1 -- 172.21.15.81:0/6007338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f231c081d10 con 0x7f23340b00e0 2023-11-29T11:17:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.392+0000 7f233259c700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2314064ee0 0x7f2314067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.392+0000 7f233259c700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2314064ee0 0x7f2314067390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f233415c960 tx=0x7f2324008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:34.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.400+0000 7f232b7fe700 1 -- 172.21.15.81:0/6007338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f231c04fff0 con 0x7f23340b00e0 2023-11-29T11:17:34.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.564+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2334072500 con 0x7f23340b00e0 2023-11-29T11:17:34.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.572+0000 7f232b7fe700 1 -- 172.21.15.81:0/6007338 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f231c053610 con 0x7f23340b00e0 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2314064ee0 msgr2=0x7f2314067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2314064ee0 0x7f2314067390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f233415c960 tx=0x7f2324008030 comp rx=0 tx=0).stop 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 msgr2=0x7f233415a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415a1d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f231c00e9d0 tx=0x7f231c00ed90 comp rx=0 tx=0).stop 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 shutdown_connections 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2314064ee0 0x7f2314067390 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23340cbb30 0x7f2334155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23340b00e0 0x7f233415a1d0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 --2- 172.21.15.81:0/6007338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f233409bdb0 0x7f233415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 >> 172.21.15.81:0/6007338 conn(0x7f23340cae70 msgr2=0x7f23340aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 shutdown_connections 2023-11-29T11:17:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.576+0000 7f233359e700 1 -- 172.21.15.81:0/6007338 wait complete. 2023-11-29T11:17:34.601 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:17:34.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:17:34.618 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:17:34.639 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:17:34.639 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:17:34.639 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:34.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:17:34.669 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:17:34.669 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:34.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:17:34.690 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:17:34.690 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:34.698 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:17:34.698 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:17:34.698 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:34.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:17:34.705 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-29T11:17:34.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.852+0000 7efe54875700 1 Processor -- start 2023-11-29T11:17:34.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.852+0000 7efe54875700 1 -- start start 2023-11-29T11:17:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe48037b40 0x7efe480e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe480e4f50 0x7efe48036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe480e0af0 con 0x7efe480e12a0 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe480e45f0 con 0x7efe480e4f50 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe48050f00 con 0x7efe48037b40 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe480e4f50 0x7efe48036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe480e12a0 0x7efe480e1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58134/0 (socket says 172.21.15.81:58134) 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4ed9d700 1 -- 172.21.15.81:0/1691064706 learned_addr learned my addr 172.21.15.81:0/1691064706 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4e59c700 1 --2- 172.21.15.81:0/1691064706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe48037b40 0x7efe480e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4f59e700 1 -- 172.21.15.81:0/1691064706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe48037b40 msgr2=0x7efe480e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4f59e700 1 --2- 172.21.15.81:0/1691064706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe48037b40 0x7efe480e4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4f59e700 1 -- 172.21.15.81:0/1691064706 >> v1:172.21.15.81:6789/0 conn(0x7efe480e12a0 legacy=0x7efe480e1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4f59e700 1 -- 172.21.15.81:0/1691064706 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48051150 con 0x7efe480e4f50 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4f59e700 1 --2- 172.21.15.81:0/1691064706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe48036770 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7efe5002cad0 tx=0x7efe5004e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8fb3eee8a1285d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4dd9b700 1 -- 172.21.15.81:0/1691064706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500727d0 con 0x7efe480e4f50 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4dd9b700 1 -- 172.21.15.81:0/1691064706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50072970 con 0x7efe480e4f50 2023-11-29T11:17:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe4dd9b700 1 -- 172.21.15.81:0/1691064706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50066b20 con 0x7efe480e4f50 2023-11-29T11:17:34.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 -- 172.21.15.81:0/1691064706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 msgr2=0x7efe48036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 --2- 172.21.15.81:0/1691064706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe48036770 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7efe5002cad0 tx=0x7efe5004e8b0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 -- 172.21.15.81:0/1691064706 shutdown_connections 2023-11-29T11:17:34.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 --2- 172.21.15.81:0/1691064706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe48036770 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 --2- 172.21.15.81:0/1691064706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe48037b40 0x7efe480e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 -- 172.21.15.81:0/1691064706 >> 172.21.15.81:0/1691064706 conn(0x7efe48051770 msgr2=0x7efe48051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 -- 172.21.15.81:0/1691064706 shutdown_connections 2023-11-29T11:17:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.856+0000 7efe54875700 1 -- 172.21.15.81:0/1691064706 wait complete. 2023-11-29T11:17:34.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe54875700 1 Processor -- start 2023-11-29T11:17:34.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe54875700 1 -- start start 2023-11-29T11:17:34.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe54875700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe48037b40 0x7efe481777d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe54875700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe480e12a0 0x7efe480dec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe54875700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe480df150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe54875700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe480342f0 con 0x7efe480e4f50 2023-11-29T11:17:34.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe54875700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe48053970 con 0x7efe48037b40 2023-11-29T11:17:34.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe54875700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe48053c50 con 0x7efe480e12a0 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe480df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe480df150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39212/0 (socket says 172.21.15.81:39212) 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 -- 172.21.15.81:0/3230328067 learned_addr learned my addr 172.21.15.81:0/3230328067 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4e59c700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe480e12a0 0x7efe480dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4ed9d700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe48037b40 0x7efe481777d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 -- 172.21.15.81:0/3230328067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe480e12a0 msgr2=0x7efe480dec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe480e12a0 0x7efe480dec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 -- 172.21.15.81:0/3230328067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe48037b40 msgr2=0x7efe481777d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe48037b40 0x7efe481777d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 -- 172.21.15.81:0/3230328067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5004e720 con 0x7efe480e4f50 2023-11-29T11:17:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.860+0000 7efe4f59e700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe480df150 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7efe50069bb0 tx=0x7efe500699b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:34.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe477fe700 1 -- 172.21.15.81:0/3230328067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50097070 con 0x7efe480e4f50 2023-11-29T11:17:34.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe477fe700 1 -- 172.21.15.81:0/3230328067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50067520 con 0x7efe480e4f50 2023-11-29T11:17:34.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe480e4210 con 0x7efe480e4f50 2023-11-29T11:17:34.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe477fe700 1 -- 172.21.15.81:0/3230328067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50066d40 con 0x7efe480e4f50 2023-11-29T11:17:34.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe48051430 con 0x7efe480e4f50 2023-11-29T11:17:34.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe48037f90 con 0x7efe480e4f50 2023-11-29T11:17:34.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe477fe700 1 -- 172.21.15.81:0/3230328067 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efe50066ea0 con 0x7efe480e4f50 2023-11-29T11:17:34.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe477fe700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe30064ee0 0x7efe30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:34.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe477fe700 1 -- 172.21.15.81:0/3230328067 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5616+0+0 (secure 0 0 0) 0x7efe500fc0f0 con 0x7efe480e4f50 2023-11-29T11:17:34.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.864+0000 7efe4ed9d700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe30064ee0 0x7efe30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:34.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.868+0000 7efe4ed9d700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe30064ee0 0x7efe30067390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efe40005930 tx=0x7efe40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:34.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:34.872+0000 7efe477fe700 1 -- 172.21.15.81:0/3230328067 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efe500ca450 con 0x7efe480e4f50 2023-11-29T11:17:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.068+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe48005570 con 0x7efe480e4f50 2023-11-29T11:17:35.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.068+0000 7efe477fe700 1 -- 172.21.15.81:0/3230328067 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3532 (secure 0 0 0) 0x7efe500cda70 con 0x7efe480e4f50 2023-11-29T11:17:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:35.078 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6451,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/2735061196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2735061196},{"type":"v1","addr":"172.21.15.176:6833","nonce":2735061196}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/245708296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":245708296},{"type":"v1","addr":"172.21.15.176:6835","nonce":245708296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3011533362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3011533362},{"type":"v1","addr":"172.21.15.81:6835","nonce":3011533362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":7110,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1044941374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1044941374},{"type":"v1","addr":"172.21.15.81:6837","nonce":1044941374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-11-29T11:17:35.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe30064ee0 msgr2=0x7efe30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:35.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe30064ee0 0x7efe30067390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efe40005930 tx=0x7efe40009040 comp rx=0 tx=0).stop 2023-11-29T11:17:35.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 msgr2=0x7efe480df150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:35.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe480df150 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7efe50069bb0 tx=0x7efe500699b0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 shutdown_connections 2023-11-29T11:17:35.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe30064ee0 0x7efe30067390 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe480e4f50 0x7efe480df150 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe480e12a0 0x7efe480dec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 --2- 172.21.15.81:0/3230328067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe48037b40 0x7efe481777d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 >> 172.21.15.81:0/3230328067 conn(0x7efe48051770 msgr2=0x7efe48050010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 shutdown_connections 2023-11-29T11:17:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.072+0000 7efe54875700 1 -- 172.21.15.81:0/3230328067 wait complete. 2023-11-29T11:17:35.081 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 35 2023-11-29T11:17:35.092 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-29T11:17:35.092 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-29T11:17:35.092 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T11:17:35.092 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:17:35.092 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-29T11:17:35.092 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-29T11:17:35.093 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T11:17:35.093 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:17:35.093 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-29T11:17:35.093 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-29T11:17:35.093 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T11:17:35.093 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:17:35.093 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-29T11:17:35.093 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-29T11:17:35.094 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T11:17:35.094 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:17:35.104 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T11:17:35.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-29T11:17:35.105 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T11:17:35.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-29T11:17:35.106 INFO:tasks.ceph.mds.a:Started 2023-11-29T11:17:35.107 DEBUG:teuthology.parallel:result is None 2023-11-29T11:17:35.108 INFO:tasks.ceph.mds.c:Started 2023-11-29T11:17:35.108 DEBUG:teuthology.parallel:result is None 2023-11-29T11:17:35.109 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T11:17:35.109 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-29T11:17:35.111 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T11:17:35.111 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-29T11:17:35.152 INFO:tasks.ceph.mds.b:Started 2023-11-29T11:17:35.153 DEBUG:teuthology.parallel:result is None 2023-11-29T11:17:35.154 INFO:tasks.ceph.mds.d:Started 2023-11-29T11:17:35.154 DEBUG:teuthology.parallel:result is None 2023-11-29T11:17:35.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-29T11:17:35.179 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:17:35.185 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:17:35.234 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-29T11:17:35.234 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:17:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7affff700 1 Processor -- start 2023-11-29T11:17:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7affff700 1 -- start start 2023-11-29T11:17:35.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7affff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb7b01592c0 0x7fb7b0159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7affff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b006e000 0x7fb7b006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7affff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b015cda0 con 0x7fb7b00ca670 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7affff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b006e9e0 con 0x7fb7b01592c0 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7affff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b015a300 con 0x7fb7b006e000 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7aeffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb7b00ca670 0x7fb7b015d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58154/0 (socket says 172.21.15.81:58154) 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7aeffd700 1 -- 172.21.15.81:0/2865632605 learned_addr learned my addr 172.21.15.81:0/2865632605 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7ae7fc700 1 --2- 172.21.15.81:0/2865632605 >> v2:172.21.15.176:3300/0 conn(0x7fb7b01592c0 0x7fb7b0159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.252+0000 7fb7af7fe700 1 --2- 172.21.15.81:0/2865632605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b006e000 0x7fb7b006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7adffb700 1 -- 172.21.15.81:0/2865632605 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037727899 0 0) 0x7fb7b015cda0 con 0x7fb7b00ca670 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7adffb700 1 -- 172.21.15.81:0/2865632605 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7980035d0 con 0x7fb7b00ca670 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7ae7fc700 1 -- 172.21.15.81:0/2865632605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b006e000 msgr2=0x7fb7b006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7ae7fc700 1 --2- 172.21.15.81:0/2865632605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b006e000 0x7fb7b006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7ae7fc700 1 -- 172.21.15.81:0/2865632605 >> v1:172.21.15.81:6789/0 conn(0x7fb7b00ca670 legacy=0x7fb7b015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7ae7fc700 1 -- 172.21.15.81:0/2865632605 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b0159d40 con 0x7fb7b01592c0 2023-11-29T11:17:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7ae7fc700 1 --2- 172.21.15.81:0/2865632605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b01592c0 0x7fb7b0159740 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009850 tx=0x7fb7a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=531b8b109e21001d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7adffb700 1 -- 172.21.15.81:0/2865632605 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0011830 con 0x7fb7b01592c0 2023-11-29T11:17:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7adffb700 1 -- 172.21.15.81:0/2865632605 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0011990 con 0x7fb7b01592c0 2023-11-29T11:17:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7adffb700 1 -- 172.21.15.81:0/2865632605 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0011d40 con 0x7fb7b01592c0 2023-11-29T11:17:35.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7affff700 1 -- 172.21.15.81:0/2865632605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b01592c0 msgr2=0x7fb7b0159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:35.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7affff700 1 --2- 172.21.15.81:0/2865632605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b01592c0 0x7fb7b0159740 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009850 tx=0x7fb7a0009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:35.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7affff700 1 -- 172.21.15.81:0/2865632605 shutdown_connections 2023-11-29T11:17:35.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7affff700 1 --2- 172.21.15.81:0/2865632605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b006e000 0x7fb7b006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7affff700 1 --2- 172.21.15.81:0/2865632605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b01592c0 0x7fb7b0159740 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7affff700 1 -- 172.21.15.81:0/2865632605 >> 172.21.15.81:0/2865632605 conn(0x7fb7b00cecb0 msgr2=0x7fb7b00cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:35.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7affff700 1 -- 172.21.15.81:0/2865632605 shutdown_connections 2023-11-29T11:17:35.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.256+0000 7fb7affff700 1 -- 172.21.15.81:0/2865632605 wait complete. 2023-11-29T11:17:35.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 Processor -- start 2023-11-29T11:17:35.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 -- start start 2023-11-29T11:17:35.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b006e000 0x7fb7b00c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:35.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b00ca670 0x7fb7b01e1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:35.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7b01592c0 0x7fb7b00c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00c84b0 con 0x7fb7b01592c0 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00c8f90 con 0x7fb7b006e000 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00c7570 con 0x7fb7b00ca670 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7b01592c0 0x7fb7b00c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7b01592c0 0x7fb7b00c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39266/0 (socket says 172.21.15.81:39266) 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 -- 172.21.15.81:0/3803614655 learned_addr learned my addr 172.21.15.81:0/3803614655 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7aeffd700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b006e000 0x7fb7b00c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7ae7fc700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b00ca670 0x7fb7b01e1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 -- 172.21.15.81:0/3803614655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b00ca670 msgr2=0x7fb7b01e1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b00ca670 0x7fb7b01e1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 -- 172.21.15.81:0/3803614655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b006e000 msgr2=0x7fb7b00c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b006e000 0x7fb7b00c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 -- 172.21.15.81:0/3803614655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a00094b0 con 0x7fb7b01592c0 2023-11-29T11:17:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7af7fe700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7b01592c0 0x7fb7b00c7030 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800efc0 tx=0x7fb7a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7977fe700 1 -- 172.21.15.81:0/3803614655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8009ea0 con 0x7fb7b01592c0 2023-11-29T11:17:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7977fe700 1 -- 172.21.15.81:0/3803614655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800f040 con 0x7fb7b01592c0 2023-11-29T11:17:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b015ca30 con 0x7fb7b01592c0 2023-11-29T11:17:35.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7977fe700 1 -- 172.21.15.81:0/3803614655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800ced0 con 0x7fb7b01592c0 2023-11-29T11:17:35.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.260+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b015a020 con 0x7fb7b01592c0 2023-11-29T11:17:35.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.264+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b00c96d0 con 0x7fb7b01592c0 2023-11-29T11:17:35.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.264+0000 7fb7977fe700 1 -- 172.21.15.81:0/3803614655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7a8014480 con 0x7fb7b01592c0 2023-11-29T11:17:35.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.264+0000 7fb7977fe700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb79c064ee0 0x7fb79c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:35.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.264+0000 7fb7977fe700 1 -- 172.21.15.81:0/3803614655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb7a8082610 con 0x7fb7b01592c0 2023-11-29T11:17:35.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.264+0000 7fb7aeffd700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb79c064ee0 0x7fb79c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:35.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.264+0000 7fb7aeffd700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb79c064ee0 0x7fb79c067390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4007fd0 tx=0x7fb7a4007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:35.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.268+0000 7fb7977fe700 1 -- 172.21.15.81:0/3803614655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb7a8050910 con 0x7fb7b01592c0 2023-11-29T11:17:35.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:35.440+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb7b0072500 con 0x7fb7b01592c0 2023-11-29T11:17:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.280+0000 7fb7977fe700 1 -- 172.21.15.81:0/3803614655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb7a8053f30 con 0x7fb7b01592c0 2023-11-29T11:17:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb79c064ee0 msgr2=0x7fb79c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb79c064ee0 0x7fb79c067390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4007fd0 tx=0x7fb7a4007de0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7b01592c0 msgr2=0x7fb7b00c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7b01592c0 0x7fb7b00c7030 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800efc0 tx=0x7fb7a800c3a0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 shutdown_connections 2023-11-29T11:17:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb79c064ee0 0x7fb79c067390 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7b01592c0 0x7fb7b00c7030 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b00ca670 0x7fb7b01e1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 --2- 172.21.15.81:0/3803614655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b006e000 0x7fb7b00c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 >> 172.21.15.81:0/3803614655 conn(0x7fb7b00cecb0 msgr2=0x7fb7b00cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 shutdown_connections 2023-11-29T11:17:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.284+0000 7fb7affff700 1 -- 172.21.15.81:0/3803614655 wait complete. 2023-11-29T11:17:36.293 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-11-29T11:17:36.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-29T11:17:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.464+0000 7f7f4ddd1700 1 Processor -- start 2023-11-29T11:17:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.464+0000 7f7f4ddd1700 1 -- start start 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f4815c150 0x7f7f481607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7f480c9e70 0x7f7f480cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4815c520 con 0x7f7f480cc430 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480ca680 con 0x7f7f4815c150 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480ca960 con 0x7f7f480c9e70 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4d5d0700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7f480cc430 0x7f7f48070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58164/0 (socket says 172.21.15.81:58164) 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4d5d0700 1 -- 172.21.15.81:0/3344557561 learned_addr learned my addr 172.21.15.81:0/3344557561 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4cdcf700 1 --2- 172.21.15.81:0/3344557561 >> v2:172.21.15.81:3300/0 conn(0x7f7f4815c150 0x7f7f481607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f47fff700 1 --2- 172.21.15.81:0/3344557561 >> v2:172.21.15.176:3300/0 conn(0x7f7f480c9e70 0x7f7f480cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f477fe700 1 -- 172.21.15.81:0/3344557561 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942303679 0 0) 0x7f7f4815c520 con 0x7f7f480cc430 2023-11-29T11:17:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4cdcf700 1 -- 172.21.15.81:0/3344557561 >> v2:172.21.15.176:3300/0 conn(0x7f7f480c9e70 msgr2=0x7f7f480cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4cdcf700 1 --2- 172.21.15.81:0/3344557561 >> v2:172.21.15.176:3300/0 conn(0x7f7f480c9e70 0x7f7f480cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4cdcf700 1 -- 172.21.15.81:0/3344557561 >> v1:172.21.15.81:6789/0 conn(0x7f7f480cc430 legacy=0x7f7f48070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4cdcf700 1 -- 172.21.15.81:0/3344557561 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480cf330 con 0x7f7f4815c150 2023-11-29T11:17:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f47fff700 1 --2- 172.21.15.81:0/3344557561 >> v2:172.21.15.176:3300/0 conn(0x7f7f480c9e70 0x7f7f480cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4cdcf700 1 --2- 172.21.15.81:0/3344557561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f4815c150 0x7f7f481607b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7f480af140 tx=0x7f7f3c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc3ccefd879c429 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f477fe700 1 -- 172.21.15.81:0/3344557561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c011830 con 0x7f7f4815c150 2023-11-29T11:17:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f477fe700 1 -- 172.21.15.81:0/3344557561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c011990 con 0x7f7f4815c150 2023-11-29T11:17:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f477fe700 1 -- 172.21.15.81:0/3344557561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c011d40 con 0x7f7f4815c150 2023-11-29T11:17:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/3344557561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f4815c150 msgr2=0x7f7f481607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/3344557561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f4815c150 0x7f7f481607b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7f480af140 tx=0x7f7f3c009b30 comp rx=0 tx=0).stop 2023-11-29T11:17:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/3344557561 shutdown_connections 2023-11-29T11:17:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/3344557561 >> v2:172.21.15.176:3300/0 conn(0x7f7f480c9e70 0x7f7f480cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/3344557561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f4815c150 0x7f7f481607b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/3344557561 >> 172.21.15.81:0/3344557561 conn(0x7f7f4806ec40 msgr2=0x7f7f480b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/3344557561 shutdown_connections 2023-11-29T11:17:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.468+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/3344557561 wait complete. 2023-11-29T11:17:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4ddd1700 1 Processor -- start 2023-11-29T11:17:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4ddd1700 1 -- start start 2023-11-29T11:17:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4ddd1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f480c9e70 0x7f7f480c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4ddd1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f480cc430 0x7f7f481588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4ddd1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4815c150 0x7f7f4806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4ddd1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480c6800 con 0x7f7f480c9e70 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4ddd1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480c6a40 con 0x7f7f4815c150 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4ddd1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480c6d20 con 0x7f7f480cc430 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4cdcf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f480c9e70 0x7f7f480c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4cdcf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f480c9e70 0x7f7f480c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39278/0 (socket says 172.21.15.81:39278) 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4cdcf700 1 -- 172.21.15.81:0/318781242 learned_addr learned my addr 172.21.15.81:0/318781242 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f47fff700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f480cc430 0x7f7f481588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4d5d0700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4815c150 0x7f7f4806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4cdcf700 1 -- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f480cc430 msgr2=0x7f7f481588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4cdcf700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f480cc430 0x7f7f481588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4cdcf700 1 -- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4815c150 msgr2=0x7f7f4806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4cdcf700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4815c150 0x7f7f4806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4cdcf700 1 -- 172.21.15.81:0/318781242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0094b0 con 0x7f7f480c9e70 2023-11-29T11:17:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.472+0000 7f7f4d5d0700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4815c150 0x7f7f4806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f4cdcf700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f480c9e70 0x7f7f480c9140 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c014040 tx=0x7f7f3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f457fa700 1 -- 172.21.15.81:0/318781242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c019ab0 con 0x7f7f480c9e70 2023-11-29T11:17:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f457fa700 1 -- 172.21.15.81:0/318781242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c01e070 con 0x7f7f480c9e70 2023-11-29T11:17:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f480cdb20 con 0x7f7f480c9e70 2023-11-29T11:17:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f457fa700 1 -- 172.21.15.81:0/318781242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c019e70 con 0x7f7f480c9e70 2023-11-29T11:17:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f480cd840 con 0x7f7f480c9e70 2023-11-29T11:17:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f480cde00 con 0x7f7f480c9e70 2023-11-29T11:17:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f457fa700 1 -- 172.21.15.81:0/318781242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7f3c00f050 con 0x7f7f480c9e70 2023-11-29T11:17:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.476+0000 7f7f457fa700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7f2c064f10 0x7f7f2c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.480+0000 7f7f47fff700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7f2c064f10 0x7f7f2c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.480+0000 7f7f457fa700 1 -- 172.21.15.81:0/318781242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7f3c082de0 con 0x7f7f480c9e70 2023-11-29T11:17:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.480+0000 7f7f47fff700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7f2c064f10 0x7f7f2c0673c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7f481f4b40 tx=0x7f7f34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.484+0000 7f7f457fa700 1 -- 172.21.15.81:0/318781242 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7f3c0510a0 con 0x7f7f480c9e70 2023-11-29T11:17:36.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.704+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7f4806cf00 con 0x7f7f480c9e70 2023-11-29T11:17:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.704+0000 7f7f457fa700 1 -- 172.21.15.81:0/318781242 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f7f3c015090 con 0x7f7f480c9e70 2023-11-29T11:17:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlSOayNhAAtezph/rP5i/F81/canwMdA==", 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdl8qMjBRAAuvMDj+jPn1OjXUEcUl34jg==", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlIykpOhAAL31egdG19jdsaMglEpIC5w==", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:17:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlKA1GCxAAOzBuOUs7pjJJOOFwZq8npA==", 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/HGdl92Q/OhAAXGWXiUvswEMnfzScuUn0cw==", 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDHGdl8TbZExAA2IBrIVdDMSaeGFjE0oBYFw==", 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCGHGdlUk9QJhAA3rf+afNjbbsQotcH4YjVQg==", 2023-11-29T11:17:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJHGdlUPFnLRAAk4y/WOW2lDfYd22+GF2QlA==", 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCPHGdlLLatFRAAz4dG1oXNEITKomtPGnDBmw==", 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCSHGdl34DRKxAAt8kHY0+FALSWN612SIOnsQ==", 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCVHGdl4zPUMBAAsF8NTRCGqXpRuVduNnWO1A==", 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCYHGdlQv/DNRAAFMTV+dTJZ0UZK2eCJiFDuw==", 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:17:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgxnnDhAAfROm0RfwzNurvq62gqmGBQ==", 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgjcpFRAAtcxPbxV34mCHxFVoGYmqmg==", 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:17:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlvfbxERAA6d5eRkOBOKhyToZKDKlvYQ==", 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlDrDHGhAAfy4RAK8qFAj2Sf6GuRGhBw==", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlW+ELKBAAoMzxY7NGqIJ1SNfaQ/4qVQ==", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:17:36.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlqaiZMhAAPiboTL+csIYuoxSk+ZwfJA==", 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlcf6LLxAAqtoEWzgd41N9uT9tC7bZ/Q==", 2023-11-29T11:17:36.724 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:17:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:17:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:17:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:17:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:36.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-11-29T11:17:36.725 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7f2c064f10 msgr2=0x7f7f2c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7f2c064f10 0x7f7f2c0673c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7f481f4b40 tx=0x7f7f34008040 comp rx=0 tx=0).stop 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f480c9e70 msgr2=0x7f7f480c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f480c9e70 0x7f7f480c9140 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c014040 tx=0x7f7f3c004770 comp rx=0 tx=0).stop 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 shutdown_connections 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7f2c064f10 0x7f7f2c0673c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f4815c150 0x7f7f4806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f480cc430 0x7f7f481588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 --2- 172.21.15.81:0/318781242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f480c9e70 0x7f7f480c9140 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 >> 172.21.15.81:0/318781242 conn(0x7f7f4806ec40 msgr2=0x7f7f480b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 shutdown_connections 2023-11-29T11:17:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.708+0000 7f7f4ddd1700 1 -- 172.21.15.81:0/318781242 wait complete. 2023-11-29T11:17:36.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.828+0000 7fa22bfff700 1 Processor -- start 2023-11-29T11:17:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.828+0000 7fa22bfff700 1 -- start start 2023-11-29T11:17:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 0x7fa22c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa22c069cd0 0x7fa22c06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c0cbe00 con 0x7fa22c1584c0 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c06dbd0 con 0x7fa22c069cd0 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0b3c30 con 0x7fa22c0b32e0 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa22c069cd0 0x7fa22c06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa22c069cd0 0x7fa22c06a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39280/0 (socket says 172.21.15.81:39280) 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22b7fe700 1 -- 172.21.15.81:0/3181779970 learned_addr learned my addr 172.21.15.81:0/3181779970 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22a7fc700 1 --2- 172.21.15.81:0/3181779970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 0x7fa22c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22b7fe700 1 -- 172.21.15.81:0/3181779970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 msgr2=0x7fa22c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22b7fe700 1 --2- 172.21.15.81:0/3181779970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 0x7fa22c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22b7fe700 1 -- 172.21.15.81:0/3181779970 >> v1:172.21.15.176:6789/0 conn(0x7fa22c1584c0 legacy=0x7fa22c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22b7fe700 1 -- 172.21.15.81:0/3181779970 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0cd0f0 con 0x7fa22c069cd0 2023-11-29T11:17:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22b7fe700 1 --2- 172.21.15.81:0/3181779970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c06a0f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa224006fd0 tx=0x7fa22400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951fac84d07251f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa229ffb700 1 -- 172.21.15.81:0/3181779970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400dc40 con 0x7fa22c069cd0 2023-11-29T11:17:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa229ffb700 1 -- 172.21.15.81:0/3181779970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22400dda0 con 0x7fa22c069cd0 2023-11-29T11:17:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa229ffb700 1 -- 172.21.15.81:0/3181779970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224004250 con 0x7fa22c069cd0 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- 172.21.15.81:0/3181779970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 msgr2=0x7fa22c06a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 --2- 172.21.15.81:0/3181779970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c06a0f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa224006fd0 tx=0x7fa22400bea0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- 172.21.15.81:0/3181779970 shutdown_connections 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 --2- 172.21.15.81:0/3181779970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c06a0f0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 --2- 172.21.15.81:0/3181779970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 0x7fa22c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- 172.21.15.81:0/3181779970 >> 172.21.15.81:0/3181779970 conn(0x7fa22c0ce3e0 msgr2=0x7fa22c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- 172.21.15.81:0/3181779970 shutdown_connections 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- 172.21.15.81:0/3181779970 wait complete. 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 Processor -- start 2023-11-29T11:17:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.832+0000 7fa22bfff700 1 -- start start 2023-11-29T11:17:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c1e6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 0x7fa22c1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa22c1584c0 0x7fa22c0aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0af7c0 con 0x7fa22c069cd0 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0afaa0 con 0x7fa22c1584c0 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0afd80 con 0x7fa22c0b32e0 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c1e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c1e6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39292/0 (socket says 172.21.15.81:39292) 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 -- 172.21.15.81:0/2354320474 learned_addr learned my addr 172.21.15.81:0/2354320474 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22a7fc700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 0x7fa22c1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22b7fe700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa22c1584c0 0x7fa22c0aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 -- 172.21.15.81:0/2354320474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 msgr2=0x7fa22c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 0x7fa22c1561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 -- 172.21.15.81:0/2354320474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa22c1584c0 msgr2=0x7fa22c0aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa22c1584c0 0x7fa22c0aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 -- 172.21.15.81:0/2354320474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22400b820 con 0x7fa22c069cd0 2023-11-29T11:17:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22affd700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c1e6830 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fa22000c410 tx=0x7fa22000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa2137fe700 1 -- 172.21.15.81:0/2354320474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200052d0 con 0x7fa22c069cd0 2023-11-29T11:17:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa2137fe700 1 -- 172.21.15.81:0/2354320474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa220005430 con 0x7fa22c069cd0 2023-11-29T11:17:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c0cd6b0 con 0x7fa22c069cd0 2023-11-29T11:17:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa2137fe700 1 -- 172.21.15.81:0/2354320474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200055a0 con 0x7fa22c069cd0 2023-11-29T11:17:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c0cd3d0 con 0x7fa22c069cd0 2023-11-29T11:17:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.836+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c0cd990 con 0x7fa22c069cd0 2023-11-29T11:17:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.840+0000 7fa2137fe700 1 -- 172.21.15.81:0/2354320474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa220010050 con 0x7fa22c069cd0 2023-11-29T11:17:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.840+0000 7fa2137fe700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa218064f10 0x7fa2180673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.840+0000 7fa2137fe700 1 -- 172.21.15.81:0/2354320474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa220081590 con 0x7fa22c069cd0 2023-11-29T11:17:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.840+0000 7fa22a7fc700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa218064f10 0x7fa2180673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.840+0000 7fa22a7fc700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa218064f10 0x7fa2180673c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa21c003c30 tx=0x7fa21c0098d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:36.844+0000 7fa2137fe700 1 -- 172.21.15.81:0/2354320474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa22004f870 con 0x7fa22c069cd0 2023-11-29T11:17:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.000+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa22c072500 con 0x7fa22c069cd0 2023-11-29T11:17:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.004+0000 7fa2137fe700 1 -- 172.21.15.81:0/2354320474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+14319 (secure 0 0 0) 0x7fa220052e90 con 0x7fa22c069cd0 2023-11-29T11:17:37.011 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:37.011 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:36.273995+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa218064f10 msgr2=0x7fa2180673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa218064f10 0x7fa2180673c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa21c003c30 tx=0x7fa21c0098d0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 msgr2=0x7fa22c1e6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c1e6830 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fa22000c410 tx=0x7fa22000c720 comp rx=0 tx=0).stop 2023-11-29T11:17:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 shutdown_connections 2023-11-29T11:17:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa218064f10 0x7fa2180673c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa22c1584c0 0x7fa22c0aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa22c0b32e0 0x7fa22c1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 --2- 172.21.15.81:0/2354320474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c069cd0 0x7fa22c1e6830 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 >> 172.21.15.81:0/2354320474 conn(0x7fa22c0ce3e0 msgr2=0x7fa22c06bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 shutdown_connections 2023-11-29T11:17:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.008+0000 7fa22bfff700 1 -- 172.21.15.81:0/2354320474 wait complete. 2023-11-29T11:17:37.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:17:37.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:17:37.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.140+0000 7fd17ac93700 1 Processor -- start 2023-11-29T11:17:37.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.140+0000 7fd17ac93700 1 -- start start 2023-11-29T11:17:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd17406ce60 0x7fd1740b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd1740d1e30 0x7fd17406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1740d0460 con 0x7fd17406a3a0 2023-11-29T11:17:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1740d3390 con 0x7fd17406ce60 2023-11-29T11:17:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1740d2380 con 0x7fd1740d1e30 2023-11-29T11:17:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179c91700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd17406ce60 0x7fd1740b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179c91700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd17406ce60 0x7fd1740b8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39298/0 (socket says 172.21.15.81:39298) 2023-11-29T11:17:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179c91700 1 -- 172.21.15.81:0/2812733140 learned_addr learned my addr 172.21.15.81:0/2812733140 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179490700 1 --2- 172.21.15.81:0/2812733140 >> v2:172.21.15.176:3300/0 conn(0x7fd1740d1e30 0x7fd17406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179c91700 1 -- 172.21.15.81:0/2812733140 >> v2:172.21.15.176:3300/0 conn(0x7fd1740d1e30 msgr2=0x7fd17406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179c91700 1 --2- 172.21.15.81:0/2812733140 >> v2:172.21.15.176:3300/0 conn(0x7fd1740d1e30 0x7fd17406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179c91700 1 -- 172.21.15.81:0/2812733140 >> v1:172.21.15.176:6789/0 conn(0x7fd17406a3a0 legacy=0x7fd17406a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179c91700 1 -- 172.21.15.81:0/2812733140 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740d2f00 con 0x7fd17406ce60 2023-11-29T11:17:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd179c91700 1 --2- 172.21.15.81:0/2812733140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406ce60 0x7fd1740b8240 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd174066b40 tx=0x7fd164009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7048751888df1e00 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd178c8f700 1 -- 172.21.15.81:0/2812733140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164011830 con 0x7fd17406ce60 2023-11-29T11:17:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd178c8f700 1 -- 172.21.15.81:0/2812733140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164011990 con 0x7fd17406ce60 2023-11-29T11:17:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd178c8f700 1 -- 172.21.15.81:0/2812733140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164011d20 con 0x7fd17406ce60 2023-11-29T11:17:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 -- 172.21.15.81:0/2812733140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406ce60 msgr2=0x7fd1740b8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2812733140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406ce60 0x7fd1740b8240 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd174066b40 tx=0x7fd164009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 -- 172.21.15.81:0/2812733140 shutdown_connections 2023-11-29T11:17:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2812733140 >> v2:172.21.15.176:3300/0 conn(0x7fd1740d1e30 0x7fd17406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2812733140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406ce60 0x7fd1740b8240 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 -- 172.21.15.81:0/2812733140 >> 172.21.15.81:0/2812733140 conn(0x7fd17409bbd0 msgr2=0x7fd1740b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:37.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.144+0000 7fd17ac93700 1 -- 172.21.15.81:0/2812733140 shutdown_connections 2023-11-29T11:17:37.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 -- 172.21.15.81:0/2812733140 wait complete. 2023-11-29T11:17:37.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 Processor -- start 2023-11-29T11:17:37.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 -- start start 2023-11-29T11:17:37.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406a3a0 0x7fd17414c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17406ce60 0x7fd17409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1740d1e30 0x7fd17409c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17409db30 con 0x7fd17406a3a0 2023-11-29T11:17:37.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17409ceb0 con 0x7fd17406ce60 2023-11-29T11:17:37.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd17ac93700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17409d190 con 0x7fd1740d1e30 2023-11-29T11:17:37.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd179c91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406a3a0 0x7fd17414c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.148+0000 7fd179c91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406a3a0 0x7fd17414c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39312/0 (socket says 172.21.15.81:39312) 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd179c91700 1 -- 172.21.15.81:0/2679595384 learned_addr learned my addr 172.21.15.81:0/2679595384 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd17a492700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1740d1e30 0x7fd17409c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd179490700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17406ce60 0x7fd17409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd179c91700 1 -- 172.21.15.81:0/2679595384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1740d1e30 msgr2=0x7fd17409c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd179c91700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1740d1e30 0x7fd17409c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd179c91700 1 -- 172.21.15.81:0/2679595384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17406ce60 msgr2=0x7fd17409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd179c91700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17406ce60 0x7fd17409f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd179c91700 1 -- 172.21.15.81:0/2679595384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd164009570 con 0x7fd17406a3a0 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd179c91700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406a3a0 0x7fd17414c830 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd17408bb40 tx=0x7fd164004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd16a7fc700 1 -- 172.21.15.81:0/2679595384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164004450 con 0x7fd17406a3a0 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd16a7fc700 1 -- 172.21.15.81:0/2679595384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16401f070 con 0x7fd17406a3a0 2023-11-29T11:17:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17406d770 con 0x7fd17406a3a0 2023-11-29T11:17:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd16a7fc700 1 -- 172.21.15.81:0/2679595384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164003900 con 0x7fd17406a3a0 2023-11-29T11:17:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1740d0120 con 0x7fd17406a3a0 2023-11-29T11:17:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.152+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17409dc70 con 0x7fd17406a3a0 2023-11-29T11:17:37.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.156+0000 7fd16a7fc700 1 -- 172.21.15.81:0/2679595384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd16400f050 con 0x7fd17406a3a0 2023-11-29T11:17:37.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.156+0000 7fd16a7fc700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd158064ee0 0x7fd158067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.156+0000 7fd16a7fc700 1 -- 172.21.15.81:0/2679595384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd164021070 con 0x7fd17406a3a0 2023-11-29T11:17:37.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.156+0000 7fd179490700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd158064ee0 0x7fd158067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.156+0000 7fd179490700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd158064ee0 0x7fd158067390 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd17409ec40 tx=0x7fd170009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.160+0000 7fd16a7fc700 1 -- 172.21.15.81:0/2679595384 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd17409dc70 con 0x7fd17406a3a0 2023-11-29T11:17:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.316+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd17415c6e0 con 0x7fd17406a3a0 2023-11-29T11:17:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.316+0000 7fd16a7fc700 1 -- 172.21.15.81:0/2679595384 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd164015020 con 0x7fd17406a3a0 2023-11-29T11:17:37.325 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:17:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd158064ee0 msgr2=0x7fd158067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd158064ee0 0x7fd158067390 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd17409ec40 tx=0x7fd170009240 comp rx=0 tx=0).stop 2023-11-29T11:17:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406a3a0 msgr2=0x7fd17414c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406a3a0 0x7fd17414c830 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd17408bb40 tx=0x7fd164004770 comp rx=0 tx=0).stop 2023-11-29T11:17:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 shutdown_connections 2023-11-29T11:17:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd158064ee0 0x7fd158067390 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1740d1e30 0x7fd17409c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17406ce60 0x7fd17409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 --2- 172.21.15.81:0/2679595384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17406a3a0 0x7fd17414c830 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 >> 172.21.15.81:0/2679595384 conn(0x7fd17409bbd0 msgr2=0x7fd17406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 shutdown_connections 2023-11-29T11:17:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.320+0000 7fd17ac93700 1 -- 172.21.15.81:0/2679595384 wait complete. 2023-11-29T11:17:37.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:17:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcadc26700 1 Processor -- start 2023-11-29T11:17:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcadc26700 1 -- start start 2023-11-29T11:17:37.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcadc26700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efca815bb80 0x7efca80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcadc26700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcadc26700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efca806b370 0x7efca80b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcadc26700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80ccd00 con 0x7efca815bb80 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcadc26700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80b19b0 con 0x7efca806b370 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcadc26700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80cd510 con 0x7efca80aaf40 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.448+0000 7efcacc24700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efca815bb80 0x7efca80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcacc24700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efca815bb80 0x7efca80b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39326/0 (socket says 172.21.15.81:39326) 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcacc24700 1 -- 172.21.15.81:0/3270977196 learned_addr learned my addr 172.21.15.81:0/3270977196 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcad425700 1 --2- 172.21.15.81:0/3270977196 >> v2:172.21.15.176:3300/0 conn(0x7efca806b370 0x7efca80b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efca7fff700 1 --2- 172.21.15.81:0/3270977196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcacc24700 1 -- 172.21.15.81:0/3270977196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 msgr2=0x7efca80b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcacc24700 1 --2- 172.21.15.81:0/3270977196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcacc24700 1 -- 172.21.15.81:0/3270977196 >> v2:172.21.15.176:3300/0 conn(0x7efca806b370 msgr2=0x7efca80b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:37.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcacc24700 1 --2- 172.21.15.81:0/3270977196 >> v2:172.21.15.176:3300/0 conn(0x7efca806b370 0x7efca80b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcacc24700 1 -- 172.21.15.81:0/3270977196 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80ccf50 con 0x7efca815bb80 2023-11-29T11:17:37.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efca7fff700 1 --2- 172.21.15.81:0/3270977196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:37.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcacc24700 1 --2- 172.21.15.81:0/3270977196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca815bb80 0x7efca80b2450 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7efca8067110 tx=0x7efc9c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371564b4deb8771f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efca77fe700 1 -- 172.21.15.81:0/3270977196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c011830 con 0x7efca815bb80 2023-11-29T11:17:37.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efca77fe700 1 -- 172.21.15.81:0/3270977196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c011990 con 0x7efca815bb80 2023-11-29T11:17:37.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efca77fe700 1 -- 172.21.15.81:0/3270977196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c011d20 con 0x7efca815bb80 2023-11-29T11:17:37.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 -- 172.21.15.81:0/3270977196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca815bb80 msgr2=0x7efca80b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 --2- 172.21.15.81:0/3270977196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca815bb80 0x7efca80b2450 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7efca8067110 tx=0x7efc9c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 -- 172.21.15.81:0/3270977196 shutdown_connections 2023-11-29T11:17:37.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 --2- 172.21.15.81:0/3270977196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 --2- 172.21.15.81:0/3270977196 >> v2:172.21.15.176:3300/0 conn(0x7efca806b370 0x7efca80b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 --2- 172.21.15.81:0/3270977196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca815bb80 0x7efca80b2450 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 -- 172.21.15.81:0/3270977196 >> 172.21.15.81:0/3270977196 conn(0x7efca80cae70 msgr2=0x7efca80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:37.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 -- 172.21.15.81:0/3270977196 shutdown_connections 2023-11-29T11:17:37.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.452+0000 7efcadc26700 1 -- 172.21.15.81:0/3270977196 wait complete. 2023-11-29T11:17:37.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.456+0000 7efcadc26700 1 Processor -- start 2023-11-29T11:17:37.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.456+0000 7efcadc26700 1 -- start start 2023-11-29T11:17:37.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.456+0000 7efcadc26700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca806b370 0x7efca81496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.456+0000 7efcadc26700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.456+0000 7efcadc26700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca815bb80 0x7efca80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.456+0000 7efcadc26700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca809af30 con 0x7efca806b370 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcadc26700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca809b210 con 0x7efca815bb80 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcadc26700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca809b4f0 con 0x7efca80aaf40 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca806b370 0x7efca81496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca806b370 0x7efca81496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39332/0 (socket says 172.21.15.81:39332) 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 -- 172.21.15.81:0/2118495195 learned_addr learned my addr 172.21.15.81:0/2118495195 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efca7fff700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcad425700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca815bb80 0x7efca80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 -- 172.21.15.81:0/2118495195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 msgr2=0x7efca80c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 -- 172.21.15.81:0/2118495195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca815bb80 msgr2=0x7efca80c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca815bb80 0x7efca80c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 -- 172.21.15.81:0/2118495195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c009570 con 0x7efca806b370 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcacc24700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca806b370 0x7efca81496a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7efc9c000c00 tx=0x7efc9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efca57fa700 1 -- 172.21.15.81:0/2118495195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c004510 con 0x7efca806b370 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efca57fa700 1 -- 172.21.15.81:0/2118495195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c0036c0 con 0x7efca806b370 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efca57fa700 1 -- 172.21.15.81:0/2118495195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c003a50 con 0x7efca806b370 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca80b1c50 con 0x7efca806b370 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca80cd230 con 0x7efca806b370 2023-11-29T11:17:37.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.460+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca80b1f30 con 0x7efca806b370 2023-11-29T11:17:37.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.464+0000 7efca57fa700 1 -- 172.21.15.81:0/2118495195 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efc9c00f050 con 0x7efca806b370 2023-11-29T11:17:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.464+0000 7efca57fa700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc8c064ee0 0x7efc8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.464+0000 7efca7fff700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc8c064ee0 0x7efc8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.464+0000 7efca57fa700 1 -- 172.21.15.81:0/2118495195 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efc9c084d80 con 0x7efca806b370 2023-11-29T11:17:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.464+0000 7efca7fff700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc8c064ee0 0x7efc8c067390 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efca80cdf00 tx=0x7efc94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.468+0000 7efca57fa700 1 -- 172.21.15.81:0/2118495195 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efc9c053040 con 0x7efca806b370 2023-11-29T11:17:37.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.632+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efca8072500 con 0x7efca806b370 2023-11-29T11:17:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.632+0000 7efca57fa700 1 -- 172.21.15.81:0/2118495195 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc9c0150a0 con 0x7efca806b370 2023-11-29T11:17:37.641 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:17:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc8c064ee0 msgr2=0x7efc8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc8c064ee0 0x7efc8c067390 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efca80cdf00 tx=0x7efc94008040 comp rx=0 tx=0).stop 2023-11-29T11:17:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca806b370 msgr2=0x7efca81496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca806b370 0x7efca81496a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7efc9c000c00 tx=0x7efc9c004770 comp rx=0 tx=0).stop 2023-11-29T11:17:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 shutdown_connections 2023-11-29T11:17:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc8c064ee0 0x7efc8c067390 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca815bb80 0x7efca80c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca80aaf40 0x7efca80c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 --2- 172.21.15.81:0/2118495195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca806b370 0x7efca81496a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 >> 172.21.15.81:0/2118495195 conn(0x7efca80cae70 msgr2=0x7efca80ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 shutdown_connections 2023-11-29T11:17:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.636+0000 7efcadc26700 1 -- 172.21.15.81:0/2118495195 wait complete. 2023-11-29T11:17:37.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-29T11:17:37.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.760+0000 7f3aacd17700 1 Processor -- start 2023-11-29T11:17:37.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.760+0000 7f3aacd17700 1 -- start start 2023-11-29T11:17:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3aa81584c0 0x7f3aa80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b32e0 0x7f3aa80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa80b3c30 con 0x7f3aa80cae10 2023-11-29T11:17:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa806dbd0 con 0x7f3aa81584c0 2023-11-29T11:17:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80cd0f0 con 0x7f3aa80b32e0 2023-11-29T11:17:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa6ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b32e0 0x7f3aa80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa77fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3aa81584c0 0x7f3aa80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa6ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b32e0 0x7f3aa80b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:49750/0 (socket says 172.21.15.81:49750) 2023-11-29T11:17:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa6ffd700 1 -- 172.21.15.81:0/789079579 learned_addr learned my addr 172.21.15.81:0/789079579 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa6ffd700 1 -- 172.21.15.81:0/789079579 >> v2:172.21.15.176:3300/0 conn(0x7f3aa81584c0 msgr2=0x7f3aa80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa6ffd700 1 --2- 172.21.15.81:0/789079579 >> v2:172.21.15.176:3300/0 conn(0x7f3aa81584c0 0x7f3aa80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa6ffd700 1 -- 172.21.15.81:0/789079579 >> v1:172.21.15.176:6789/0 conn(0x7f3aa80cae10 legacy=0x7f3aa806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa6ffd700 1 -- 172.21.15.81:0/789079579 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa80cd3d0 con 0x7f3aa80b32e0 2023-11-29T11:17:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa6ffd700 1 --2- 172.21.15.81:0/789079579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b32e0 0x7f3aa80b36f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009e50 tx=0x7f3a9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b45b42a8d5a3e99 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa67fc700 1 -- 172.21.15.81:0/789079579 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800bb10 con 0x7f3aa80b32e0 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa67fc700 1 -- 172.21.15.81:0/789079579 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9800bc70 con 0x7f3aa80b32e0 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aa67fc700 1 -- 172.21.15.81:0/789079579 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98011460 con 0x7f3aa80b32e0 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 -- 172.21.15.81:0/789079579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b32e0 msgr2=0x7f3aa80b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 --2- 172.21.15.81:0/789079579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b32e0 0x7f3aa80b36f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009e50 tx=0x7f3a9800b330 comp rx=0 tx=0).stop 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 -- 172.21.15.81:0/789079579 shutdown_connections 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 --2- 172.21.15.81:0/789079579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b32e0 0x7f3aa80b36f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 --2- 172.21.15.81:0/789079579 >> v2:172.21.15.176:3300/0 conn(0x7f3aa81584c0 0x7f3aa80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 -- 172.21.15.81:0/789079579 >> 172.21.15.81:0/789079579 conn(0x7f3aa80ce3e0 msgr2=0x7f3aa80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 -- 172.21.15.81:0/789079579 shutdown_connections 2023-11-29T11:17:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.764+0000 7f3aacd17700 1 -- 172.21.15.81:0/789079579 wait complete. 2023-11-29T11:17:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aacd17700 1 Processor -- start 2023-11-29T11:17:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aacd17700 1 -- start start 2023-11-29T11:17:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aacd17700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa80b32e0 0x7f3aa80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aacd17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa80cae10 0x7f3aa81f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aacd17700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa81584c0 0x7f3aa80c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aacd17700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80c6b50 con 0x7f3aa80cae10 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aacd17700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80c6e30 con 0x7f3aa80b32e0 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aacd17700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80c7110 con 0x7f3aa81584c0 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa80cae10 0x7f3aa81f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa80cae10 0x7f3aa81f0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39340/0 (socket says 172.21.15.81:39340) 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 -- 172.21.15.81:0/160020102 learned_addr learned my addr 172.21.15.81:0/160020102 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa77fe700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa80b32e0 0x7f3aa80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa7fff700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa81584c0 0x7f3aa80c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 -- 172.21.15.81:0/160020102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa81584c0 msgr2=0x7f3aa80c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa81584c0 0x7f3aa80c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 -- 172.21.15.81:0/160020102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa80b32e0 msgr2=0x7f3aa80b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa80b32e0 0x7f3aa80b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 -- 172.21.15.81:0/160020102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009b30 con 0x7f3aa80cae10 2023-11-29T11:17:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.768+0000 7f3aa6ffd700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa80cae10 0x7f3aa81f0c10 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800b370 tx=0x7f3a98004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3a9ffff700 1 -- 172.21.15.81:0/160020102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98011a20 con 0x7f3aa80cae10 2023-11-29T11:17:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa80cd990 con 0x7f3aa80cae10 2023-11-29T11:17:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3a9ffff700 1 -- 172.21.15.81:0/160020102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a980092e0 con 0x7f3aa80cae10 2023-11-29T11:17:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3a9ffff700 1 -- 172.21.15.81:0/160020102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98011de0 con 0x7f3aa80cae10 2023-11-29T11:17:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa80cd6b0 con 0x7f3aa80cae10 2023-11-29T11:17:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa80cdc70 con 0x7f3aa80cae10 2023-11-29T11:17:37.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3a9ffff700 1 -- 172.21.15.81:0/160020102 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3a98029030 con 0x7f3aa80cae10 2023-11-29T11:17:37.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3a9ffff700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3a88064ee0 0x7f3a88067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:37.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3a9ffff700 1 -- 172.21.15.81:0/160020102 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3a98083230 con 0x7f3aa80cae10 2023-11-29T11:17:37.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.772+0000 7f3aa77fe700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3a88064ee0 0x7f3a88067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:37.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.776+0000 7f3aa77fe700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3a88064ee0 0x7f3a88067390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009b50 tx=0x7f3a90009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:37.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.780+0000 7f3a9ffff700 1 -- 172.21.15.81:0/160020102 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3a98051560 con 0x7f3aa80cae10 2023-11-29T11:17:37.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.940+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3aa8072500 con 0x7f3aa80cae10 2023-11-29T11:17:37.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.940+0000 7f3a9ffff700 1 -- 172.21.15.81:0/160020102 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3a98015090 con 0x7f3aa80cae10 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:37.948 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:17:37.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3a88064ee0 msgr2=0x7f3a88067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3a88064ee0 0x7f3a88067390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009b50 tx=0x7f3a90009240 comp rx=0 tx=0).stop 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa80cae10 msgr2=0x7f3aa81f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa80cae10 0x7f3aa81f0c10 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800b370 tx=0x7f3a98004af0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 shutdown_connections 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3a88064ee0 0x7f3a88067390 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa81584c0 0x7f3aa80c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa80cae10 0x7f3aa81f0c10 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 --2- 172.21.15.81:0/160020102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa80b32e0 0x7f3aa80b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 >> 172.21.15.81:0/160020102 conn(0x7f3aa80ce3e0 msgr2=0x7f3aa806fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 shutdown_connections 2023-11-29T11:17:37.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:37.944+0000 7f3aacd17700 1 -- 172.21.15.81:0/160020102 wait complete. 2023-11-29T11:17:37.970 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-29T11:17:37.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-29T11:17:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f796ac2d700 1 Processor -- start 2023-11-29T11:17:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f796ac2d700 1 -- start start 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f796ac2d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f796415a040 0x7f79640ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f796ac2d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79640b3a10 0x7f7964070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f796ac2d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7964070370 con 0x7f796415a410 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f796ac2d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7964070040 con 0x7f796415a040 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f796ac2d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796406d130 con 0x7f79640b3a10 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f7969c2b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f796415a040 0x7f79640ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f7969c2b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f796415a040 0x7f79640ad870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39350/0 (socket says 172.21.15.81:39350) 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f7969c2b700 1 -- 172.21.15.81:0/1973761668 learned_addr learned my addr 172.21.15.81:0/1973761668 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f796a42c700 1 --2- 172.21.15.81:0/1973761668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79640b3a10 0x7f7964070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f7969c2b700 1 -- 172.21.15.81:0/1973761668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79640b3a10 msgr2=0x7f7964070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f7969c2b700 1 --2- 172.21.15.81:0/1973761668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79640b3a10 0x7f7964070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f7969c2b700 1 -- 172.21.15.81:0/1973761668 >> v1:172.21.15.176:6789/0 conn(0x7f796415a410 legacy=0x7f79640b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f7969c2b700 1 -- 172.21.15.81:0/1973761668 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796406cb70 con 0x7f796415a040 2023-11-29T11:17:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.084+0000 7f7969c2b700 1 --2- 172.21.15.81:0/1973761668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796415a040 0x7f79640ad870 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f7960009910 tx=0x7f7960009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f268cb23b2464b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f7968c29700 1 -- 172.21.15.81:0/1973761668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796000ba60 con 0x7f796415a040 2023-11-29T11:17:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f7968c29700 1 -- 172.21.15.81:0/1973761668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796000bbc0 con 0x7f796415a040 2023-11-29T11:17:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f7968c29700 1 -- 172.21.15.81:0/1973761668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960009e60 con 0x7f796415a040 2023-11-29T11:17:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- 172.21.15.81:0/1973761668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796415a040 msgr2=0x7f79640ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 --2- 172.21.15.81:0/1973761668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796415a040 0x7f79640ad870 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f7960009910 tx=0x7f7960009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- 172.21.15.81:0/1973761668 shutdown_connections 2023-11-29T11:17:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 --2- 172.21.15.81:0/1973761668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79640b3a10 0x7f7964070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 --2- 172.21.15.81:0/1973761668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796415a040 0x7f79640ad870 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- 172.21.15.81:0/1973761668 >> 172.21.15.81:0/1973761668 conn(0x7f79640ce400 msgr2=0x7f79640ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- 172.21.15.81:0/1973761668 shutdown_connections 2023-11-29T11:17:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- 172.21.15.81:0/1973761668 wait complete. 2023-11-29T11:17:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 Processor -- start 2023-11-29T11:17:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- start start 2023-11-29T11:17:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79640b3a10 0x7f79640978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f796415a040 0x7f79641e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79640c26d0 0x7f79640ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79640c54d0 con 0x7f79640b3a10 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79641e39a0 con 0x7f79640c26d0 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.088+0000 7f796ac2d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79640c62f0 con 0x7f796415a040 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79640b3a10 0x7f79640978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79640b3a10 0x7f79640978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39364/0 (socket says 172.21.15.81:39364) 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 -- 172.21.15.81:0/3284131684 learned_addr learned my addr 172.21.15.81:0/3284131684 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f796a42c700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79640c26d0 0x7f79640ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f796942a700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f796415a040 0x7f79641e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 -- 172.21.15.81:0/3284131684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f796415a040 msgr2=0x7f79641e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f796415a040 0x7f79641e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 -- 172.21.15.81:0/3284131684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79640c26d0 msgr2=0x7f79640ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79640c26d0 0x7f79640ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 -- 172.21.15.81:0/3284131684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960009570 con 0x7f79640b3a10 2023-11-29T11:17:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f7969c2b700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79640b3a10 0x7f79640978a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f796000b3c0 tx=0x7f7960004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f795a7fc700 1 -- 172.21.15.81:0/3284131684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960004510 con 0x7f79640b3a10 2023-11-29T11:17:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79640b4050 con 0x7f79640b3a10 2023-11-29T11:17:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f795a7fc700 1 -- 172.21.15.81:0/3284131684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796001f070 con 0x7f79640b3a10 2023-11-29T11:17:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f795a7fc700 1 -- 172.21.15.81:0/3284131684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960003900 con 0x7f79640b3a10 2023-11-29T11:17:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796406ce50 con 0x7f79640b3a10 2023-11-29T11:17:38.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.092+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796406c690 con 0x7f79640b3a10 2023-11-29T11:17:38.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.096+0000 7f795a7fc700 1 -- 172.21.15.81:0/3284131684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f796000f050 con 0x7f79640b3a10 2023-11-29T11:17:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.096+0000 7f795a7fc700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7948064ee0 0x7f7948067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.096+0000 7f795a7fc700 1 -- 172.21.15.81:0/3284131684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7960021070 con 0x7f79640b3a10 2023-11-29T11:17:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.096+0000 7f796942a700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7948064ee0 0x7f7948067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.096+0000 7f796942a700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7948064ee0 0x7f7948067390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f79640af370 tx=0x7f7954009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.100+0000 7f795a7fc700 1 -- 172.21.15.81:0/3284131684 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7960051830 con 0x7f79640b3a10 2023-11-29T11:17:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.264+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7964072500 con 0x7f79640b3a10 2023-11-29T11:17:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.368+0000 7f795a7fc700 1 -- 172.21.15.81:0/3284131684 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7960054e50 con 0x7f79640b3a10 2023-11-29T11:17:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7948064ee0 msgr2=0x7f7948067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7948064ee0 0x7f7948067390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f79640af370 tx=0x7f7954009040 comp rx=0 tx=0).stop 2023-11-29T11:17:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79640b3a10 msgr2=0x7f79640978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79640b3a10 0x7f79640978a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f796000b3c0 tx=0x7f7960004770 comp rx=0 tx=0).stop 2023-11-29T11:17:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 shutdown_connections 2023-11-29T11:17:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7948064ee0 0x7f7948067390 secure :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f79640af370 tx=0x7f7954009040 comp rx=0 tx=0).stop 2023-11-29T11:17:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79640c26d0 0x7f79640ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f796415a040 0x7f79641e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 --2- 172.21.15.81:0/3284131684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79640b3a10 0x7f79640978a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.372+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 >> 172.21.15.81:0/3284131684 conn(0x7f79640ce400 msgr2=0x7f796406bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.376+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 shutdown_connections 2023-11-29T11:17:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.376+0000 7f796ac2d700 1 -- 172.21.15.81:0/3284131684 wait complete. 2023-11-29T11:17:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-11-29T11:17:38.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-29T11:17:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfdf75700 1 Processor -- start 2023-11-29T11:17:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfdf75700 1 -- start start 2023-11-29T11:17:38.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfdf75700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3cf815a040 0x7f3cf806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfdf75700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80caaf0 0x7f3cf80caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfdf75700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf8070a20 con 0x7f3cf80711e0 2023-11-29T11:17:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfdf75700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf806bc70 con 0x7f3cf815a040 2023-11-29T11:17:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfdf75700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf806b080 con 0x7f3cf80caaf0 2023-11-29T11:17:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cf7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3cf80711e0 0x7f3cf806c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58172/0 (socket says 172.21.15.81:58172) 2023-11-29T11:17:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cf7fff700 1 -- 172.21.15.81:0/3585723897 learned_addr learned my addr 172.21.15.81:0/3585723897 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfcf73700 1 --2- 172.21.15.81:0/3585723897 >> v2:172.21.15.176:3300/0 conn(0x7f3cf815a040 0x7f3cf806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfd774700 1 --2- 172.21.15.81:0/3585723897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80caaf0 0x7f3cf80caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cf77fe700 1 -- 172.21.15.81:0/3585723897 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478232639 0 0) 0x7f3cf8070a20 con 0x7f3cf80711e0 2023-11-29T11:17:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cf77fe700 1 -- 172.21.15.81:0/3585723897 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce40035d0 con 0x7f3cf80711e0 2023-11-29T11:17:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfcf73700 1 -- 172.21.15.81:0/3585723897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80caaf0 msgr2=0x7f3cf80caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfcf73700 1 --2- 172.21.15.81:0/3585723897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80caaf0 0x7f3cf80caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfcf73700 1 -- 172.21.15.81:0/3585723897 >> v1:172.21.15.81:6789/0 conn(0x7f3cf80711e0 legacy=0x7f3cf806c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.508+0000 7f3cfcf73700 1 -- 172.21.15.81:0/3585723897 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf806b360 con 0x7f3cf815a040 2023-11-29T11:17:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfcf73700 1 --2- 172.21.15.81:0/3585723897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 0x7f3cf806c3a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009d90 tx=0x7f3cf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dfe6760fa748d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cf77fe700 1 -- 172.21.15.81:0/3585723897 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000e070 con 0x7f3cf815a040 2023-11-29T11:17:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cf77fe700 1 -- 172.21.15.81:0/3585723897 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf000bb20 con 0x7f3cf815a040 2023-11-29T11:17:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cf77fe700 1 -- 172.21.15.81:0/3585723897 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000be90 con 0x7f3cf815a040 2023-11-29T11:17:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3585723897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 msgr2=0x7f3cf806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3585723897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 0x7f3cf806c3a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009d90 tx=0x7f3cf000b330 comp rx=0 tx=0).stop 2023-11-29T11:17:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3585723897 shutdown_connections 2023-11-29T11:17:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3585723897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80caaf0 0x7f3cf80caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3585723897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 0x7f3cf806c3a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3585723897 >> 172.21.15.81:0/3585723897 conn(0x7f3cf80b0880 msgr2=0x7f3cf80b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3585723897 shutdown_connections 2023-11-29T11:17:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.512+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3585723897 wait complete. 2023-11-29T11:17:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 Processor -- start 2023-11-29T11:17:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 -- start start 2023-11-29T11:17:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80711e0 0x7f3cf80a8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf80caaf0 0x7f3cf81efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 0x7f3cf80c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80a85c0 con 0x7f3cf80caaf0 2023-11-29T11:17:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80aaee0 con 0x7f3cf815a040 2023-11-29T11:17:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80ab130 con 0x7f3cf80711e0 2023-11-29T11:17:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf80caaf0 0x7f3cf81efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf80caaf0 0x7f3cf81efb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39366/0 (socket says 172.21.15.81:39366) 2023-11-29T11:17:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 -- 172.21.15.81:0/3018137907 learned_addr learned my addr 172.21.15.81:0/3018137907 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfd774700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 0x7f3cf80c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfcf73700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80711e0 0x7f3cf80a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 -- 172.21.15.81:0/3018137907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80711e0 msgr2=0x7f3cf80a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80711e0 0x7f3cf80a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 -- 172.21.15.81:0/3018137907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 msgr2=0x7f3cf80c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 0x7f3cf80c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 -- 172.21.15.81:0/3018137907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0009a70 con 0x7f3cf80caaf0 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf7fff700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf80caaf0 0x7f3cf81efb90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c4d0 tx=0x7f3ce000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf57fa700 1 -- 172.21.15.81:0/3018137907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0005d90 con 0x7f3cf80caaf0 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf57fa700 1 -- 172.21.15.81:0/3018137907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce00070d0 con 0x7f3cf80caaf0 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cf57fa700 1 -- 172.21.15.81:0/3018137907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0007480 con 0x7f3cf80caaf0 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf815a410 con 0x7f3cf80caaf0 2023-11-29T11:17:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.516+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf80706b0 con 0x7f3cf80caaf0 2023-11-29T11:17:38.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.520+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf806b900 con 0x7f3cf80caaf0 2023-11-29T11:17:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.520+0000 7f3cf57fa700 1 -- 172.21.15.81:0/3018137907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3ce0019030 con 0x7f3cf80caaf0 2023-11-29T11:17:38.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.520+0000 7f3cf57fa700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3cd8064ee0 0x7f3cd8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:38.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.520+0000 7f3cfcf73700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3cd8064ee0 0x7f3cd8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:38.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.520+0000 7f3cf57fa700 1 -- 172.21.15.81:0/3018137907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f3ce0081150 con 0x7f3cf80caaf0 2023-11-29T11:17:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.524+0000 7f3cfcf73700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3cd8064ee0 0x7f3cd8067390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0014040 tx=0x7f3cf0011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.532+0000 7f3cf57fa700 1 -- 172.21.15.81:0/3018137907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3ce004f310 con 0x7f3cf80caaf0 2023-11-29T11:17:38.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:38.696+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3cf8072500 con 0x7f3cf80caaf0 2023-11-29T11:17:39.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.380+0000 7f3cf57fa700 1 -- 172.21.15.81:0/3018137907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3ce0052930 con 0x7f3cf80caaf0 2023-11-29T11:17:39.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.388+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3cd8064ee0 msgr2=0x7f3cd8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.388+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3cd8064ee0 0x7f3cd8067390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0014040 tx=0x7f3cf0011000 comp rx=0 tx=0).stop 2023-11-29T11:17:39.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.388+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf80caaf0 msgr2=0x7f3cf81efb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.388+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf80caaf0 0x7f3cf81efb90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c4d0 tx=0x7f3ce000c7e0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.392+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 shutdown_connections 2023-11-29T11:17:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.392+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3cd8064ee0 0x7f3cd8067390 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.392+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cf815a040 0x7f3cf80c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.392+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cf80caaf0 0x7f3cf81efb90 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.392+0000 7f3cfdf75700 1 --2- 172.21.15.81:0/3018137907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cf80711e0 0x7f3cf80a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.392+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 >> 172.21.15.81:0/3018137907 conn(0x7f3cf80b0880 msgr2=0x7f3cf80cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.392+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 shutdown_connections 2023-11-29T11:17:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.392+0000 7f3cfdf75700 1 -- 172.21.15.81:0/3018137907 wait complete. 2023-11-29T11:17:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-11-29T11:17:39.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-29T11:17:39.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.520+0000 7fc486ffb700 1 Processor -- start 2023-11-29T11:17:39.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.520+0000 7fc486ffb700 1 -- start start 2023-11-29T11:17:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc486ffb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4800cbaf0 0x7fc480165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc486ffb700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48015a3a0 con 0x7fc48006f010 2023-11-29T11:17:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc486ffb700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800ca430 con 0x7fc48006a6e0 2023-11-29T11:17:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc486ffb700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800ca710 con 0x7fc4800cbaf0 2023-11-29T11:17:39.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc4867fa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4800cbaf0 0x7fc480165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc4857f8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc48006f010 0x7fc480161a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58174/0 (socket says 172.21.15.81:58174) 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc4857f8700 1 -- 172.21.15.81:0/615798277 learned_addr learned my addr 172.21.15.81:0/615798277 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc4867fa700 1 --2- 172.21.15.81:0/615798277 >> v2:172.21.15.81:3300/0 conn(0x7fc4800cbaf0 0x7fc480165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39374/0 (socket says 172.21.15.81:39374) 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc4867fa700 1 -- 172.21.15.81:0/615798277 >> v1:172.21.15.176:6789/0 conn(0x7fc48006a6e0 legacy=0x7fc48006aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc4867fa700 1 -- 172.21.15.81:0/615798277 >> v1:172.21.15.81:6789/0 conn(0x7fc48006f010 legacy=0x7fc480161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc4867fa700 1 -- 172.21.15.81:0/615798277 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800ca9f0 con 0x7fc4800cbaf0 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc4867fa700 1 --2- 172.21.15.81:0/615798277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4800cbaf0 0x7fc480165190 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc478009d90 tx=0x7fc47800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b30d6f8fa44671 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc484ff7700 1 -- 172.21.15.81:0/615798277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800e070 con 0x7fc4800cbaf0 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc484ff7700 1 -- 172.21.15.81:0/615798277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800bbd0 con 0x7fc4800cbaf0 2023-11-29T11:17:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.524+0000 7fc484ff7700 1 -- 172.21.15.81:0/615798277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478012430 con 0x7fc4800cbaf0 2023-11-29T11:17:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- 172.21.15.81:0/615798277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4800cbaf0 msgr2=0x7fc480165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 --2- 172.21.15.81:0/615798277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4800cbaf0 0x7fc480165190 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc478009d90 tx=0x7fc47800b330 comp rx=0 tx=0).stop 2023-11-29T11:17:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- 172.21.15.81:0/615798277 shutdown_connections 2023-11-29T11:17:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 --2- 172.21.15.81:0/615798277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4800cbaf0 0x7fc480165190 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- 172.21.15.81:0/615798277 >> 172.21.15.81:0/615798277 conn(0x7fc4800d0240 msgr2=0x7fc4800cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- 172.21.15.81:0/615798277 shutdown_connections 2023-11-29T11:17:39.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- 172.21.15.81:0/615798277 wait complete. 2023-11-29T11:17:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 Processor -- start 2023-11-29T11:17:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- start start 2023-11-29T11:17:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48006a6e0 0x7fc480152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc48006f010 0x7fc4800c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4800cbaf0 0x7fc48015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800c4660 con 0x7fc48006a6e0 2023-11-29T11:17:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800c3a50 con 0x7fc48006f010 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc486ffb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800c3d30 con 0x7fc4800cbaf0 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc485ff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48006a6e0 0x7fc480152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc485ff9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48006a6e0 0x7fc480152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39376/0 (socket says 172.21.15.81:39376) 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc485ff9700 1 -- 172.21.15.81:0/2074682639 learned_addr learned my addr 172.21.15.81:0/2074682639 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc4857f8700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc48006f010 0x7fc4800c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc4867fa700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4800cbaf0 0x7fc48015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc485ff9700 1 -- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4800cbaf0 msgr2=0x7fc48015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc485ff9700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4800cbaf0 0x7fc48015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc485ff9700 1 -- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc48006f010 msgr2=0x7fc4800c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.528+0000 7fc485ff9700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc48006f010 0x7fc4800c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc485ff9700 1 -- 172.21.15.81:0/2074682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478009a70 con 0x7fc48006a6e0 2023-11-29T11:17:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc4867fa700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4800cbaf0 0x7fc48015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc485ff9700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48006a6e0 0x7fc480152b10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00c500 tx=0x7fc47c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc4767fc700 1 -- 172.21.15.81:0/2074682639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0052d0 con 0x7fc48006a6e0 2023-11-29T11:17:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc4767fc700 1 -- 172.21.15.81:0/2074682639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c005430 con 0x7fc48006a6e0 2023-11-29T11:17:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4800cafb0 con 0x7fc48006a6e0 2023-11-29T11:17:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc4767fc700 1 -- 172.21.15.81:0/2074682639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0055a0 con 0x7fc48006a6e0 2023-11-29T11:17:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4800cacd0 con 0x7fc48006a6e0 2023-11-29T11:17:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4800ca070 con 0x7fc48006a6e0 2023-11-29T11:17:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc4767fc700 1 -- 172.21.15.81:0/2074682639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc47c019030 con 0x7fc48006a6e0 2023-11-29T11:17:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.532+0000 7fc4767fc700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc464064ee0 0x7fc464067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.536+0000 7fc4767fc700 1 -- 172.21.15.81:0/2074682639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fc47c081290 con 0x7fc48006a6e0 2023-11-29T11:17:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.536+0000 7fc4857f8700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc464064ee0 0x7fc464067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.536+0000 7fc4857f8700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc464064ee0 0x7fc464067390 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc4800ae690 tx=0x7fc470009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:39.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.540+0000 7fc4767fc700 1 -- 172.21.15.81:0/2074682639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc47c04f350 con 0x7fc48006a6e0 2023-11-29T11:17:39.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.736+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc480072c20 con 0x7fc48006a6e0 2023-11-29T11:17:39.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.744+0000 7fc4767fc700 1 -- 172.21.15.81:0/2074682639 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc47c052970 con 0x7fc48006a6e0 2023-11-29T11:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.752+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc464064ee0 msgr2=0x7fc464067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.752+0000 7fc486ffb700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc464064ee0 0x7fc464067390 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc4800ae690 tx=0x7fc470009040 comp rx=0 tx=0).stop 2023-11-29T11:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.752+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48006a6e0 msgr2=0x7fc480152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.752+0000 7fc486ffb700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48006a6e0 0x7fc480152b10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00c500 tx=0x7fc47c00c8c0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.756+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 shutdown_connections 2023-11-29T11:17:39.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.756+0000 7fc486ffb700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc464064ee0 0x7fc464067390 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.756+0000 7fc486ffb700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4800cbaf0 0x7fc48015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.756+0000 7fc486ffb700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc48006f010 0x7fc4800c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.756+0000 7fc486ffb700 1 --2- 172.21.15.81:0/2074682639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48006a6e0 0x7fc480152b10 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.756+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 >> 172.21.15.81:0/2074682639 conn(0x7fc4800d0240 msgr2=0x7fc4800cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.756+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 shutdown_connections 2023-11-29T11:17:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.756+0000 7fc486ffb700 1 -- 172.21.15.81:0/2074682639 wait complete. 2023-11-29T11:17:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 12 and data pool 13 2023-11-29T11:17:39.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c1cc74700 1 Processor -- start 2023-11-29T11:17:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c1cc74700 1 -- start start 2023-11-29T11:17:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c1cc74700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c181606b0 0x7f6c180c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c1cc74700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6c180ceef0 0x7f6c180c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c1cc74700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6c180ad610 0x7f6c18164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c1cc74700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180cae70 con 0x7f6c180ad610 2023-11-29T11:17:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c1cc74700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180cbc10 con 0x7f6c180ceef0 2023-11-29T11:17:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c1cc74700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180cb130 con 0x7f6c181606b0 2023-11-29T11:17:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c17fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6c180ad610 0x7f6c18164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c177fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c181606b0 0x7f6c180c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c17fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6c180ad610 0x7f6c18164040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48302/0 (socket says 172.21.15.81:48302) 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c16ffd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6c180ceef0 0x7f6c180c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c17fff700 1 -- 172.21.15.81:0/3753216777 learned_addr learned my addr 172.21.15.81:0/3753216777 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c17fff700 1 -- 172.21.15.81:0/3753216777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c181606b0 msgr2=0x7f6c180c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c17fff700 1 --2- 172.21.15.81:0/3753216777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c181606b0 0x7f6c180c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c17fff700 1 -- 172.21.15.81:0/3753216777 >> v2:172.21.15.176:3300/0 conn(0x7f6c180ceef0 msgr2=0x7f6c180c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c17fff700 1 --2- 172.21.15.81:0/3753216777 >> v2:172.21.15.176:3300/0 conn(0x7f6c180ceef0 0x7f6c180c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.876+0000 7f6c17fff700 1 -- 172.21.15.81:0/3753216777 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180cb410 con 0x7f6c180ad610 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c17fff700 1 --2- 172.21.15.81:0/3753216777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c18164040 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6c180cbf00 tx=0x7f6c08009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad835308db765ac6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c167fc700 1 -- 172.21.15.81:0/3753216777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08011830 con 0x7f6c180ad610 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c167fc700 1 -- 172.21.15.81:0/3753216777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08011990 con 0x7f6c180ad610 2023-11-29T11:17:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c167fc700 1 -- 172.21.15.81:0/3753216777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08011d20 con 0x7f6c180ad610 2023-11-29T11:17:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3753216777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 msgr2=0x7f6c18164040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3753216777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c18164040 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6c180cbf00 tx=0x7f6c08009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3753216777 shutdown_connections 2023-11-29T11:17:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3753216777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c18164040 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3753216777 >> v2:172.21.15.176:3300/0 conn(0x7f6c180ceef0 0x7f6c180c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3753216777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c181606b0 0x7f6c180c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3753216777 >> 172.21.15.81:0/3753216777 conn(0x7f6c180ce3e0 msgr2=0x7f6c180ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3753216777 shutdown_connections 2023-11-29T11:17:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3753216777 wait complete. 2023-11-29T11:17:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 Processor -- start 2023-11-29T11:17:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.880+0000 7f6c1cc74700 1 -- start start 2023-11-29T11:17:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c1815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c180ceef0 0x7f6c1815f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c181606b0 0x7f6c180c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1815f830 con 0x7f6c180ad610 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180c45e0 con 0x7f6c181606b0 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1815d120 con 0x7f6c180ceef0 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c1815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c1815ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48314/0 (socket says 172.21.15.81:48314) 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 -- 172.21.15.81:0/3214430744 learned_addr learned my addr 172.21.15.81:0/3214430744 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c16ffd700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c180ceef0 0x7f6c1815f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c17fff700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c181606b0 0x7f6c180c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 -- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c180ceef0 msgr2=0x7f6c1815f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c180ceef0 0x7f6c1815f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 -- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c181606b0 msgr2=0x7f6c180c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c181606b0 0x7f6c180c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 -- 172.21.15.81:0/3214430744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08009570 con 0x7f6c180ad610 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c17fff700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c181606b0 0x7f6c180c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c177fe700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c1815ca90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000efc0 tx=0x7f6c1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6bfffff700 1 -- 172.21.15.81:0/3214430744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10009b80 con 0x7f6c180ad610 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6bfffff700 1 -- 172.21.15.81:0/3214430744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000f040 con 0x7f6c180ad610 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c180b36c0 con 0x7f6c180ad610 2023-11-29T11:17:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6bfffff700 1 -- 172.21.15.81:0/3214430744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10014480 con 0x7f6c180ad610 2023-11-29T11:17:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c180cb6f0 con 0x7f6c180ad610 2023-11-29T11:17:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.884+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c18164580 con 0x7f6c180ad610 2023-11-29T11:17:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.888+0000 7f6bfffff700 1 -- 172.21.15.81:0/3214430744 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c100145e0 con 0x7f6c180ad610 2023-11-29T11:17:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.888+0000 7f6bfffff700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6c04064ee0 0x7f6c04067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.888+0000 7f6bfffff700 1 -- 172.21.15.81:0/3214430744 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6c100831b0 con 0x7f6c180ad610 2023-11-29T11:17:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.888+0000 7f6c16ffd700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6c04064ee0 0x7f6c04067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.888+0000 7f6c16ffd700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6c04064ee0 0x7f6c04067390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6c18070cb0 tx=0x7f6c0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:39.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:39.892+0000 7f6bfffff700 1 -- 172.21.15.81:0/3214430744 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6c10054ce0 con 0x7f6c180ad610 2023-11-29T11:17:40.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.056+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c18072500 con 0x7f6c180ad610 2023-11-29T11:17:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6bfffff700 1 -- 172.21.15.81:0/3214430744 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18034 (secure 0 0 0) 0x7f6c100548d0 con 0x7f6c180ad610 2023-11-29T11:17:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:40.068 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:39.743143+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6c04064ee0 msgr2=0x7f6c04067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6c04064ee0 0x7f6c04067390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6c18070cb0 tx=0x7f6c0c008040 comp rx=0 tx=0).stop 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 msgr2=0x7f6c1815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c1815ca90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000efc0 tx=0x7f6c1000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 shutdown_connections 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6c04064ee0 0x7f6c04067390 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c181606b0 0x7f6c180c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c180ceef0 0x7f6c1815f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 --2- 172.21.15.81:0/3214430744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c180ad610 0x7f6c1815ca90 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 >> 172.21.15.81:0/3214430744 conn(0x7f6c180ce3e0 msgr2=0x7f6c18070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:40.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 shutdown_connections 2023-11-29T11:17:40.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.060+0000 7f6c1cc74700 1 -- 172.21.15.81:0/3214430744 wait complete. 2023-11-29T11:17:40.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:40.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.188+0000 7fb0752b4700 1 Processor -- start 2023-11-29T11:17:40.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.188+0000 7fb0752b4700 1 -- start start 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb0700cf050 0x7fb07006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb07006a530 0x7fb0700cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07015c6d0 con 0x7fb0700b4c10 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07006a9d0 con 0x7fb07006a530 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0700cf960 con 0x7fb0700cf050 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb067fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb07006a530 0x7fb0700cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb067fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb07006a530 0x7fb0700cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48318/0 (socket says 172.21.15.81:48318) 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb067fff700 1 -- 172.21.15.81:0/1657978925 learned_addr learned my addr 172.21.15.81:0/1657978925 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb06ffff700 1 --2- 172.21.15.81:0/1657978925 >> v2:172.21.15.176:3300/0 conn(0x7fb0700cf050 0x7fb07006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb067fff700 1 -- 172.21.15.81:0/1657978925 >> v2:172.21.15.176:3300/0 conn(0x7fb0700cf050 msgr2=0x7fb07006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb067fff700 1 --2- 172.21.15.81:0/1657978925 >> v2:172.21.15.176:3300/0 conn(0x7fb0700cf050 0x7fb07006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb067fff700 1 -- 172.21.15.81:0/1657978925 >> v1:172.21.15.176:6789/0 conn(0x7fb0700b4c10 legacy=0x7fb0700cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb067fff700 1 -- 172.21.15.81:0/1657978925 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07006ac60 con 0x7fb07006a530 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb067fff700 1 --2- 172.21.15.81:0/1657978925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb07006a530 0x7fb0700cf420 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb07008b9c0 tx=0x7fb058009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1223cfd111b259ac server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb06f7fe700 1 -- 172.21.15.81:0/1657978925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058004230 con 0x7fb07006a530 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb06f7fe700 1 -- 172.21.15.81:0/1657978925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058004390 con 0x7fb07006a530 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb06f7fe700 1 -- 172.21.15.81:0/1657978925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580036c0 con 0x7fb07006a530 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 -- 172.21.15.81:0/1657978925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb07006a530 msgr2=0x7fb0700cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 --2- 172.21.15.81:0/1657978925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb07006a530 0x7fb0700cf420 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb07008b9c0 tx=0x7fb058009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 -- 172.21.15.81:0/1657978925 shutdown_connections 2023-11-29T11:17:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 --2- 172.21.15.81:0/1657978925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb07006a530 0x7fb0700cf420 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 --2- 172.21.15.81:0/1657978925 >> v2:172.21.15.176:3300/0 conn(0x7fb0700cf050 0x7fb07006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 -- 172.21.15.81:0/1657978925 >> 172.21.15.81:0/1657978925 conn(0x7fb07009bb30 msgr2=0x7fb0700b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:40.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 -- 172.21.15.81:0/1657978925 shutdown_connections 2023-11-29T11:17:40.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.192+0000 7fb0752b4700 1 -- 172.21.15.81:0/1657978925 wait complete. 2023-11-29T11:17:40.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.196+0000 7fb0752b4700 1 Processor -- start 2023-11-29T11:17:40.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.196+0000 7fb0752b4700 1 -- start start 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.196+0000 7fb0752b4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb07006a530 0x7fb070158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.196+0000 7fb0752b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0700b4c10 0x7fb07015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb0752b4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0700cf050 0x7fb0701e5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb0752b4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0701f5c30 con 0x7fb0700b4c10 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb0752b4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0701592a0 con 0x7fb0700cf050 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb0752b4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0701f4fb0 con 0x7fb07006a530 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0700b4c10 0x7fb07015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0700b4c10 0x7fb07015a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48328/0 (socket says 172.21.15.81:48328) 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb06ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb07006a530 0x7fb070158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 -- 172.21.15.81:0/3281274659 learned_addr learned my addr 172.21.15.81:0/3281274659 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb074ab3700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0700cf050 0x7fb0701e5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 -- 172.21.15.81:0/3281274659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb07006a530 msgr2=0x7fb070158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb07006a530 0x7fb070158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 -- 172.21.15.81:0/3281274659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0700cf050 msgr2=0x7fb0701e5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0700cf050 0x7fb0701e5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 -- 172.21.15.81:0/3281274659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058009570 con 0x7fb0700b4c10 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb067fff700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0700b4c10 0x7fb07015a860 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb07008c6b0 tx=0x7fb058004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb06d7fa700 1 -- 172.21.15.81:0/3281274659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058003d00 con 0x7fb0700b4c10 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb06d7fa700 1 -- 172.21.15.81:0/3281274659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05801f070 con 0x7fb0700b4c10 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb06d7fa700 1 -- 172.21.15.81:0/3281274659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800b8a0 con 0x7fb0700b4c10 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0700b4410 con 0x7fb0700b4c10 2023-11-29T11:17:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07006af40 con 0x7fb0700b4c10 2023-11-29T11:17:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.200+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0700b46f0 con 0x7fb0700b4c10 2023-11-29T11:17:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.204+0000 7fb06d7fa700 1 -- 172.21.15.81:0/3281274659 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb05802a020 con 0x7fb0700b4c10 2023-11-29T11:17:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.204+0000 7fb06d7fa700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb050064ee0 0x7fb050067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.204+0000 7fb06d7fa700 1 -- 172.21.15.81:0/3281274659 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb058083600 con 0x7fb0700b4c10 2023-11-29T11:17:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.204+0000 7fb06ffff700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb050064ee0 0x7fb050067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.204+0000 7fb06ffff700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb050064ee0 0x7fb050067390 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb060007a60 tx=0x7fb060008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:40.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.208+0000 7fb06d7fa700 1 -- 172.21.15.81:0/3281274659 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb058051660 con 0x7fb0700b4c10 2023-11-29T11:17:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.368+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0700b46f0 con 0x7fb0700b4c10 2023-11-29T11:17:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.372+0000 7fb06d7fa700 1 -- 172.21.15.81:0/3281274659 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18034 (secure 0 0 0) 0x7fb058054c80 con 0x7fb0700b4c10 2023-11-29T11:17:40.381 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:40.381 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:39.743143+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb050064ee0 msgr2=0x7fb050067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb050064ee0 0x7fb050067390 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb060007a60 tx=0x7fb060008040 comp rx=0 tx=0).stop 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0700b4c10 msgr2=0x7fb07015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0700b4c10 0x7fb07015a860 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb07008c6b0 tx=0x7fb058004770 comp rx=0 tx=0).stop 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 shutdown_connections 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb050064ee0 0x7fb050067390 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0700cf050 0x7fb0701e5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0700b4c10 0x7fb07015a860 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 --2- 172.21.15.81:0/3281274659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb07006a530 0x7fb070158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 >> 172.21.15.81:0/3281274659 conn(0x7fb07009bb30 msgr2=0x7fb07006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:40.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 shutdown_connections 2023-11-29T11:17:40.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.376+0000 7fb0752b4700 1 -- 172.21.15.81:0/3281274659 wait complete. 2023-11-29T11:17:40.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-29T11:17:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.516+0000 7fdb5a23a700 1 Processor -- start 2023-11-29T11:17:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.516+0000 7fdb5a23a700 1 -- start start 2023-11-29T11:17:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 0x7fdb54160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdb5415c4d0 0x7fdb540ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb54160d70 con 0x7fdb5415c100 2023-11-29T11:17:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb540c9410 con 0x7fdb5415c4d0 2023-11-29T11:17:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5406a350 con 0x7fdb540caf70 2023-11-29T11:17:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59a39700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdb5415c4d0 0x7fdb540ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb58a37700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 0x7fdb54160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59a39700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdb5415c4d0 0x7fdb540ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59160/0 (socket says 172.21.15.81:59160) 2023-11-29T11:17:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59a39700 1 -- 172.21.15.81:0/4123028263 learned_addr learned my addr 172.21.15.81:0/4123028263 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59238700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fdb5415c100 0x7fdb54069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:41930/0 (socket says 172.21.15.81:41930) 2023-11-29T11:17:40.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59a39700 1 -- 172.21.15.81:0/4123028263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 msgr2=0x7fdb54160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59a39700 1 --2- 172.21.15.81:0/4123028263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 0x7fdb54160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59a39700 1 -- 172.21.15.81:0/4123028263 >> v1:172.21.15.176:6789/0 conn(0x7fdb5415c100 legacy=0x7fdb54069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59a39700 1 -- 172.21.15.81:0/4123028263 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540cb430 con 0x7fdb5415c4d0 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb59a39700 1 --2- 172.21.15.81:0/4123028263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 0x7fdb540ced50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009e50 tx=0x7fdb4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b421dc096587588 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb4bfff700 1 -- 172.21.15.81:0/4123028263 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00e070 con 0x7fdb5415c4d0 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb4bfff700 1 -- 172.21.15.81:0/4123028263 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c00b910 con 0x7fdb5415c4d0 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb4bfff700 1 -- 172.21.15.81:0/4123028263 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00bcc0 con 0x7fdb5415c4d0 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4123028263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 msgr2=0x7fdb540ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4123028263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 0x7fdb540ced50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009e50 tx=0x7fdb4c00b330 comp rx=0 tx=0).stop 2023-11-29T11:17:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4123028263 shutdown_connections 2023-11-29T11:17:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4123028263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 0x7fdb540ced50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4123028263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 0x7fdb54160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4123028263 >> 172.21.15.81:0/4123028263 conn(0x7fdb5406c660 msgr2=0x7fdb5406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4123028263 shutdown_connections 2023-11-29T11:17:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.520+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4123028263 wait complete. 2023-11-29T11:17:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 Processor -- start 2023-11-29T11:17:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 -- start start 2023-11-29T11:17:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 0x7fdb5415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5415c100 0x7fdb54149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 0x7fdb5414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb541f4ba0 con 0x7fdb5415c100 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb541f4e80 con 0x7fdb5415c4d0 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb541f5160 con 0x7fdb540caf70 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5415c100 0x7fdb54149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5415c100 0x7fdb54149e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48332/0 (socket says 172.21.15.81:48332) 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 -- 172.21.15.81:0/4281348052 learned_addr learned my addr 172.21.15.81:0/4281348052 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb59a39700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 0x7fdb5414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb59238700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 0x7fdb5415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 -- 172.21.15.81:0/4281348052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 msgr2=0x7fdb5415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 0x7fdb5415fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 -- 172.21.15.81:0/4281348052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 msgr2=0x7fdb5414a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 0x7fdb5414a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 -- 172.21.15.81:0/4281348052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c009b30 con 0x7fdb5415c100 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb58a37700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5415c100 0x7fdb54149e00 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e9a0 tx=0x7fdb4400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb49ffb700 1 -- 172.21.15.81:0/4281348052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44009720 con 0x7fdb5415c100 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb49ffb700 1 -- 172.21.15.81:0/4281348052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4400c850 con 0x7fdb5415c100 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb49ffb700 1 -- 172.21.15.81:0/4281348052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400cc00 con 0x7fdb5415c100 2023-11-29T11:17:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb540c9940 con 0x7fdb5415c100 2023-11-29T11:17:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.524+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb540c9660 con 0x7fdb5415c100 2023-11-29T11:17:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.528+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb540cc990 con 0x7fdb5415c100 2023-11-29T11:17:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.528+0000 7fdb49ffb700 1 -- 172.21.15.81:0/4281348052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdb44019030 con 0x7fdb5415c100 2023-11-29T11:17:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.528+0000 7fdb49ffb700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdb38064ee0 0x7fdb38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.528+0000 7fdb49ffb700 1 -- 172.21.15.81:0/4281348052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdb440820c0 con 0x7fdb5415c100 2023-11-29T11:17:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.528+0000 7fdb59238700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdb38064ee0 0x7fdb38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.528+0000 7fdb59238700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdb38064ee0 0x7fdb38067390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdb50000fb0 tx=0x7fdb50007d00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.532+0000 7fdb49ffb700 1 -- 172.21.15.81:0/4281348052 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdb44050030 con 0x7fdb5415c100 2023-11-29T11:17:40.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:40.732+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdb54072c20 con 0x7fdb5415c100 2023-11-29T11:17:41.067 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-11-29T11:17:41.064+0000 7f1d77650700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:17:41.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.392+0000 7fdb49ffb700 1 -- 172.21.15.81:0/4281348052 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdb44053650 con 0x7fdb5415c100 2023-11-29T11:17:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdb38064ee0 msgr2=0x7fdb38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdb38064ee0 0x7fdb38067390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdb50000fb0 tx=0x7fdb50007d00 comp rx=0 tx=0).stop 2023-11-29T11:17:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5415c100 msgr2=0x7fdb54149e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5415c100 0x7fdb54149e00 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e9a0 tx=0x7fdb4400ed60 comp rx=0 tx=0).stop 2023-11-29T11:17:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 shutdown_connections 2023-11-29T11:17:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdb38064ee0 0x7fdb38067390 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb5415c4d0 0x7fdb5414a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5415c100 0x7fdb54149e00 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 --2- 172.21.15.81:0/4281348052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb540caf70 0x7fdb5415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 >> 172.21.15.81:0/4281348052 conn(0x7fdb5406c660 msgr2=0x7fdb5415b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:41.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 shutdown_connections 2023-11-29T11:17:41.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.396+0000 7fdb5a23a700 1 -- 172.21.15.81:0/4281348052 wait complete. 2023-11-29T11:17:41.422 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-29T11:17:41.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-29T11:17:41.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8d282700 1 Processor -- start 2023-11-29T11:17:41.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8d282700 1 -- start start 2023-11-29T11:17:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8d282700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c880d31b0 0x7f3c880cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8d282700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c880cf470 0x7f3c880cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8d282700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8806a7f0 con 0x7f3c8806ce60 2023-11-29T11:17:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8d282700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c880d3650 con 0x7f3c880cf470 2023-11-29T11:17:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8d282700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8815c8b0 con 0x7f3c880d31b0 2023-11-29T11:17:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8ca81700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c880cf470 0x7f3c880cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8ca81700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c880cf470 0x7f3c880cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48344/0 (socket says 172.21.15.81:48344) 2023-11-29T11:17:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8ca81700 1 -- 172.21.15.81:0/2086170752 learned_addr learned my addr 172.21.15.81:0/2086170752 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c877fe700 1 --2- 172.21.15.81:0/2086170752 >> v2:172.21.15.176:3300/0 conn(0x7f3c880d31b0 0x7f3c880cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8ca81700 1 -- 172.21.15.81:0/2086170752 >> v2:172.21.15.176:3300/0 conn(0x7f3c880d31b0 msgr2=0x7f3c880cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8ca81700 1 --2- 172.21.15.81:0/2086170752 >> v2:172.21.15.176:3300/0 conn(0x7f3c880d31b0 0x7f3c880cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8ca81700 1 -- 172.21.15.81:0/2086170752 >> v1:172.21.15.176:6789/0 conn(0x7f3c8806ce60 legacy=0x7f3c8806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8ca81700 1 -- 172.21.15.81:0/2086170752 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8806aad0 con 0x7f3c880cf470 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.536+0000 7f3c8ca81700 1 --2- 172.21.15.81:0/2086170752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880cf470 0x7f3c880cf8f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009e50 tx=0x7f3c8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38fcce67d70c5b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c86ffd700 1 -- 172.21.15.81:0/2086170752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000e070 con 0x7f3c880cf470 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c86ffd700 1 -- 172.21.15.81:0/2086170752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8000b980 con 0x7f3c880cf470 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c86ffd700 1 -- 172.21.15.81:0/2086170752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000bd30 con 0x7f3c880cf470 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- 172.21.15.81:0/2086170752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880cf470 msgr2=0x7f3c880cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2086170752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880cf470 0x7f3c880cf8f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009e50 tx=0x7f3c8000b330 comp rx=0 tx=0).stop 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- 172.21.15.81:0/2086170752 shutdown_connections 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2086170752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880cf470 0x7f3c880cf8f0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2086170752 >> v2:172.21.15.176:3300/0 conn(0x7f3c880d31b0 0x7f3c880cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- 172.21.15.81:0/2086170752 >> 172.21.15.81:0/2086170752 conn(0x7f3c880b5760 msgr2=0x7f3c880b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- 172.21.15.81:0/2086170752 shutdown_connections 2023-11-29T11:17:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- 172.21.15.81:0/2086170752 wait complete. 2023-11-29T11:17:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 Processor -- start 2023-11-29T11:17:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- start start 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c8806ce60 0x7f3c88159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c880cf470 0x7f3c880b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880d31b0 0x7f3c880b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c881e6c40 con 0x7f3c880d31b0 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880c75c0 con 0x7f3c8806ce60 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.540+0000 7f3c8d282700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880c7b80 con 0x7f3c880cf470 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c8806ce60 0x7f3c88159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8ca81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880d31b0 0x7f3c880b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c8806ce60 0x7f3c88159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59176/0 (socket says 172.21.15.81:59176) 2023-11-29T11:17:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c87fff700 1 -- 172.21.15.81:0/2044401844 learned_addr learned my addr 172.21.15.81:0/2044401844 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c877fe700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c880cf470 0x7f3c880b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8ca81700 1 -- 172.21.15.81:0/2044401844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c880cf470 msgr2=0x7f3c880b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8ca81700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c880cf470 0x7f3c880b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8ca81700 1 -- 172.21.15.81:0/2044401844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c8806ce60 msgr2=0x7f3c88159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8ca81700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c8806ce60 0x7f3c88159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8ca81700 1 -- 172.21.15.81:0/2044401844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80009b30 con 0x7f3c880d31b0 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8ca81700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880d31b0 0x7f3c880b47c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3c8808bae0 tx=0x7f3c80004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c84ff9700 1 -- 172.21.15.81:0/2044401844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80004880 con 0x7f3c880d31b0 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c84ff9700 1 -- 172.21.15.81:0/2044401844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800099b0 con 0x7f3c880d31b0 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8806b090 con 0x7f3c880d31b0 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c84ff9700 1 -- 172.21.15.81:0/2044401844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8001c680 con 0x7f3c880d31b0 2023-11-29T11:17:41.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8806adb0 con 0x7f3c880d31b0 2023-11-29T11:17:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c880b6470 con 0x7f3c880d31b0 2023-11-29T11:17:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.544+0000 7f3c84ff9700 1 -- 172.21.15.81:0/2044401844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3c80022030 con 0x7f3c880d31b0 2023-11-29T11:17:41.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.548+0000 7f3c84ff9700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c74064ee0 0x7f3c74067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:41.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.548+0000 7f3c87fff700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c74064ee0 0x7f3c74067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.548+0000 7f3c84ff9700 1 -- 172.21.15.81:0/2044401844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3c80083880 con 0x7f3c880d31b0 2023-11-29T11:17:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.548+0000 7f3c87fff700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c74064ee0 0x7f3c74067390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c001850 tx=0x7f3c7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.552+0000 7f3c84ff9700 1 -- 172.21.15.81:0/2044401844 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3c80051770 con 0x7f3c880d31b0 2023-11-29T11:17:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:41.748+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3c88072c20 con 0x7f3c880d31b0 2023-11-29T11:17:42.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.404+0000 7f3c84ff9700 1 -- 172.21.15.81:0/2044401844 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c80054d90 con 0x7f3c880d31b0 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c74064ee0 msgr2=0x7f3c74067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c74064ee0 0x7f3c74067390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c001850 tx=0x7f3c7c009040 comp rx=0 tx=0).stop 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880d31b0 msgr2=0x7f3c880b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880d31b0 0x7f3c880b47c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3c8808bae0 tx=0x7f3c80004af0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 shutdown_connections 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c74064ee0 0x7f3c74067390 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c880d31b0 0x7f3c880b47c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c880cf470 0x7f3c880b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 --2- 172.21.15.81:0/2044401844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c8806ce60 0x7f3c88159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 >> 172.21.15.81:0/2044401844 conn(0x7f3c880b5760 msgr2=0x7f3c880af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 shutdown_connections 2023-11-29T11:17:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.408+0000 7f3c8d282700 1 -- 172.21.15.81:0/2044401844 wait complete. 2023-11-29T11:17:42.429 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-29T11:17:42.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:42.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f535cba5700 1 Processor -- start 2023-11-29T11:17:42.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f535cba5700 1 -- start start 2023-11-29T11:17:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f535cba5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f535806cd50 0x7f535815b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f535cba5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f535815da90 0x7f535815df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f535cba5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535815e9f0 con 0x7f535813cef0 2023-11-29T11:17:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f535cba5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535815e450 con 0x7f535806cd50 2023-11-29T11:17:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f53577fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f535813cef0 0x7f535806c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53958/0 (socket says 172.21.15.81:53958) 2023-11-29T11:17:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f53577fe700 1 -- 172.21.15.81:0/1566388869 learned_addr learned my addr 172.21.15.81:0/1566388869 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f535cba5700 1 -- 172.21.15.81:0/1566388869 --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535815e710 con 0x7f535815da90 2023-11-29T11:17:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f5356ffd700 1 --2- 172.21.15.81:0/1566388869 >> v2:172.21.15.81:3300/0 conn(0x7f535806cd50 0x7f535815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.536+0000 7f53567fc700 1 -- 172.21.15.81:0/1566388869 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277509588 0 0) 0x7f535815e9f0 con 0x7f535813cef0 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f5357fff700 1 --2- 172.21.15.81:0/1566388869 >> v2:172.21.15.176:3300/0 conn(0x7f535815da90 0x7f535815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f53567fc700 1 -- 172.21.15.81:0/1566388869 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53400035d0 con 0x7f535813cef0 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f5356ffd700 1 -- 172.21.15.81:0/1566388869 >> v2:172.21.15.176:3300/0 conn(0x7f535815da90 msgr2=0x7f535815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f5356ffd700 1 --2- 172.21.15.81:0/1566388869 >> v2:172.21.15.176:3300/0 conn(0x7f535815da90 0x7f535815df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f5356ffd700 1 -- 172.21.15.81:0/1566388869 >> v1:172.21.15.81:6789/0 conn(0x7f535813cef0 legacy=0x7f535806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f5356ffd700 1 -- 172.21.15.81:0/1566388869 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535815a620 con 0x7f535806cd50 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f5357fff700 1 --2- 172.21.15.81:0/1566388869 >> v2:172.21.15.176:3300/0 conn(0x7f535815da90 0x7f535815df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f5356ffd700 1 --2- 172.21.15.81:0/1566388869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806cd50 0x7f535815b100 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5358158070 tx=0x7f534c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1ad82c48619ecb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f53567fc700 1 -- 172.21.15.81:0/1566388869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c011830 con 0x7f535806cd50 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f53567fc700 1 -- 172.21.15.81:0/1566388869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c011990 con 0x7f535806cd50 2023-11-29T11:17:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f53567fc700 1 -- 172.21.15.81:0/1566388869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c011d20 con 0x7f535806cd50 2023-11-29T11:17:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 -- 172.21.15.81:0/1566388869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806cd50 msgr2=0x7f535815b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 --2- 172.21.15.81:0/1566388869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806cd50 0x7f535815b100 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5358158070 tx=0x7f534c009b30 comp rx=0 tx=0).stop 2023-11-29T11:17:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 -- 172.21.15.81:0/1566388869 shutdown_connections 2023-11-29T11:17:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 --2- 172.21.15.81:0/1566388869 >> v2:172.21.15.176:3300/0 conn(0x7f535815da90 0x7f535815df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 --2- 172.21.15.81:0/1566388869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535806cd50 0x7f535815b100 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 -- 172.21.15.81:0/1566388869 >> 172.21.15.81:0/1566388869 conn(0x7f535806e000 msgr2=0x7f53580b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 -- 172.21.15.81:0/1566388869 shutdown_connections 2023-11-29T11:17:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 -- 172.21.15.81:0/1566388869 wait complete. 2023-11-29T11:17:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 Processor -- start 2023-11-29T11:17:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.540+0000 7f535cba5700 1 -- start start 2023-11-29T11:17:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535806cd50 0x7f5358130600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535813cef0 0x7f535813def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535815da90 0x7f53580cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535813e430 con 0x7f535815da90 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535812e5f0 con 0x7f535813cef0 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5358130ca0 con 0x7f535806cd50 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535815da90 0x7f53580cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535815da90 0x7f53580cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48380/0 (socket says 172.21.15.81:48380) 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 -- 172.21.15.81:0/3242328295 learned_addr learned my addr 172.21.15.81:0/3242328295 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f53577fe700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535806cd50 0x7f5358130600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5356ffd700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535813cef0 0x7f535813def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 -- 172.21.15.81:0/3242328295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535806cd50 msgr2=0x7f5358130600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535806cd50 0x7f5358130600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 -- 172.21.15.81:0/3242328295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535813cef0 msgr2=0x7f535813def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535813cef0 0x7f535813def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 -- 172.21.15.81:0/3242328295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0094b0 con 0x7f535815da90 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f5357fff700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535815da90 0x7f53580cd6f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5350007e70 tx=0x7f535000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f533ffff700 1 -- 172.21.15.81:0/3242328295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000dd20 con 0x7f535815da90 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f533ffff700 1 -- 172.21.15.81:0/3242328295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000f040 con 0x7f535815da90 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535815abe0 con 0x7f535815da90 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f533ffff700 1 -- 172.21.15.81:0/3242328295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000dea0 con 0x7f535815da90 2023-11-29T11:17:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535815a900 con 0x7f535815da90 2023-11-29T11:17:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.544+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535813d2c0 con 0x7f535815da90 2023-11-29T11:17:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.548+0000 7f533ffff700 1 -- 172.21.15.81:0/3242328295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f535001c030 con 0x7f535815da90 2023-11-29T11:17:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.548+0000 7f533ffff700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5344064ee0 0x7f5344067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.548+0000 7f533ffff700 1 -- 172.21.15.81:0/3242328295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f5350081fc0 con 0x7f535815da90 2023-11-29T11:17:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.548+0000 7f53577fe700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5344064ee0 0x7f5344067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.548+0000 7f53577fe700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5344064ee0 0x7f5344067390 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5348007fd0 tx=0x7f5348007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.552+0000 7f533ffff700 1 -- 172.21.15.81:0/3242328295 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f535004ff10 con 0x7f535815da90 2023-11-29T11:17:42.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f535812e7b0 con 0x7f535815da90 2023-11-29T11:17:42.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f533ffff700 1 -- 172.21.15.81:0/3242328295 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f5350053530 con 0x7f535815da90 2023-11-29T11:17:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:42.756 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:17:42.393858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3247003029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3247003029},{"type":"v1","addr":"172.21.15.81:6837","nonce":3247003029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:17:42.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5344064ee0 msgr2=0x7f5344067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5344064ee0 0x7f5344067390 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5348007fd0 tx=0x7f5348007de0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535815da90 msgr2=0x7f53580cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535815da90 0x7f53580cd6f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5350007e70 tx=0x7f535000d3b0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 shutdown_connections 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5344064ee0 0x7f5344067390 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f535815da90 0x7f53580cd6f0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535813cef0 0x7f535813def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 --2- 172.21.15.81:0/3242328295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535806cd50 0x7f5358130600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 >> 172.21.15.81:0/3242328295 conn(0x7f535806e000 msgr2=0x7f5358143370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 shutdown_connections 2023-11-29T11:17:42.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.748+0000 7f535cba5700 1 -- 172.21.15.81:0/3242328295 wait complete. 2023-11-29T11:17:42.759 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-11-29T11:17:42.770 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 Processor -- start 2023-11-29T11:17:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- start start 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c159e70 0x7f3b1c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b1c0cb470 0x7f3b1c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c06ace0 con 0x7f3b1c069c40 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1c06a0d0 con 0x7f3b1c0cb470 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c06a3b0 con 0x7f3b1c159e70 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b19d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3b1c069c40 0x7f3b1c0cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53970/0 (socket says 172.21.15.81:53970) 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b19d9b700 1 -- 172.21.15.81:0/3975464664 learned_addr learned my addr 172.21.15.81:0/3975464664 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1ad9d700 1 --2- 172.21.15.81:0/3975464664 >> v2:172.21.15.81:3300/0 conn(0x7f3b1c0cb470 0x7f3b1c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1a59c700 1 --2- 172.21.15.81:0/3975464664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c159e70 0x7f3b1c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1959a700 1 -- 172.21.15.81:0/3975464664 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394862857 0 0) 0x7f3b1c06ace0 con 0x7f3b1c069c40 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1959a700 1 -- 172.21.15.81:0/3975464664 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b040035d0 con 0x7f3b1c069c40 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1ad9d700 1 -- 172.21.15.81:0/3975464664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c159e70 msgr2=0x7f3b1c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1ad9d700 1 --2- 172.21.15.81:0/3975464664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c159e70 0x7f3b1c06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1ad9d700 1 -- 172.21.15.81:0/3975464664 >> v1:172.21.15.81:6789/0 conn(0x7f3b1c069c40 legacy=0x7f3b1c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1ad9d700 1 -- 172.21.15.81:0/3975464664 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c06a690 con 0x7f3b1c0cb470 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1a59c700 1 --2- 172.21.15.81:0/3975464664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c159e70 0x7f3b1c06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1ad9d700 1 --2- 172.21.15.81:0/3975464664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c0cb470 0x7f3b1c0c91d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009850 tx=0x7f3b14009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e04c4e4fe236fd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1959a700 1 -- 172.21.15.81:0/3975464664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14011830 con 0x7f3b1c0cb470 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1959a700 1 -- 172.21.15.81:0/3975464664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b14011990 con 0x7f3b1c0cb470 2023-11-29T11:17:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1959a700 1 -- 172.21.15.81:0/3975464664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14011d00 con 0x7f3b1c0cb470 2023-11-29T11:17:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- 172.21.15.81:0/3975464664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c0cb470 msgr2=0x7f3b1c0c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/3975464664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c0cb470 0x7f3b1c0c91d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009850 tx=0x7f3b14009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- 172.21.15.81:0/3975464664 shutdown_connections 2023-11-29T11:17:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/3975464664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c0cb470 0x7f3b1c0c91d0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/3975464664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c159e70 0x7f3b1c06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- 172.21.15.81:0/3975464664 >> 172.21.15.81:0/3975464664 conn(0x7f3b1c0ce3e0 msgr2=0x7f3b1c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- 172.21.15.81:0/3975464664 shutdown_connections 2023-11-29T11:17:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.880+0000 7f3b1b59e700 1 -- 172.21.15.81:0/3975464664 wait complete. 2023-11-29T11:17:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 Processor -- start 2023-11-29T11:17:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 -- start start 2023-11-29T11:17:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c069c40 0x7f3b1c147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b1c0cb470 0x7f3b1c1f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c159e70 0x7f3b1c071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c2c30 con 0x7f3b1c159e70 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c4d10 con 0x7f3b1c0cb470 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c4190 con 0x7f3b1c069c40 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c159e70 0x7f3b1c071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c159e70 0x7f3b1c071af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48398/0 (socket says 172.21.15.81:48398) 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 -- 172.21.15.81:0/2779419850 learned_addr learned my addr 172.21.15.81:0/2779419850 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1a59c700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c069c40 0x7f3b1c147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b19d9b700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b1c0cb470 0x7f3b1c1f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 -- 172.21.15.81:0/2779419850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c069c40 msgr2=0x7f3b1c147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c069c40 0x7f3b1c147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 -- 172.21.15.81:0/2779419850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b1c0cb470 msgr2=0x7f3b1c1f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b1c0cb470 0x7f3b1c1f0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 -- 172.21.15.81:0/2779419850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c009a70 con 0x7f3b1c159e70 2023-11-29T11:17:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1ad9d700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c159e70 0x7f3b1c071af0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3b14013000 tx=0x7f3b14004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b0affd700 1 -- 172.21.15.81:0/2779419850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14004610 con 0x7f3b1c159e70 2023-11-29T11:17:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b0affd700 1 -- 172.21.15.81:0/2779419850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1401f070 con 0x7f3b1c159e70 2023-11-29T11:17:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b140094b0 con 0x7f3b1c159e70 2023-11-29T11:17:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b0affd700 1 -- 172.21.15.81:0/2779419850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14003900 con 0x7f3b1c159e70 2023-11-29T11:17:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.884+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c15a240 con 0x7f3b1c159e70 2023-11-29T11:17:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.888+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c06a970 con 0x7f3b1c159e70 2023-11-29T11:17:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.888+0000 7f3b0affd700 1 -- 172.21.15.81:0/2779419850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3b1400f050 con 0x7f3b1c159e70 2023-11-29T11:17:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.888+0000 7f3b0affd700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3afc064f10 0x7f3afc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.888+0000 7f3b0affd700 1 -- 172.21.15.81:0/2779419850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f3b14021070 con 0x7f3b1c159e70 2023-11-29T11:17:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.888+0000 7f3b1a59c700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3afc064f10 0x7f3afc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.888+0000 7f3b1a59c700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3afc064f10 0x7f3afc0673c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c007580 tx=0x7f3b0c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:42.896+0000 7f3b0affd700 1 -- 172.21.15.81:0/2779419850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3b14051850 con 0x7f3b1c159e70 2023-11-29T11:17:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.056+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b1c06cee0 con 0x7f3b1c159e70 2023-11-29T11:17:43.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.056+0000 7f3b0affd700 1 -- 172.21.15.81:0/2779419850 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18071 (secure 0 0 0) 0x7f3b14015090 con 0x7f3b1c159e70 2023-11-29T11:17:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:43.065 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:42.392627+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3afc064f10 msgr2=0x7f3afc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3afc064f10 0x7f3afc0673c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c007580 tx=0x7f3b0c00b040 comp rx=0 tx=0).stop 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c159e70 msgr2=0x7f3b1c071af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c159e70 0x7f3b1c071af0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3b14013000 tx=0x7f3b14004770 comp rx=0 tx=0).stop 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 shutdown_connections 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3afc064f10 0x7f3afc0673c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b1c159e70 0x7f3b1c071af0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b1c0cb470 0x7f3b1c1f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 --2- 172.21.15.81:0/2779419850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1c069c40 0x7f3b1c147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 >> 172.21.15.81:0/2779419850 conn(0x7f3b1c0ce3e0 msgr2=0x7f3b1c1594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 shutdown_connections 2023-11-29T11:17:43.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.060+0000 7f3b1b59e700 1 -- 172.21.15.81:0/2779419850 wait complete. 2023-11-29T11:17:43.086 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-29T11:17:43.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:17:43.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.192+0000 7faefe000700 1 Processor -- start 2023-11-29T11:17:43.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.192+0000 7faefe000700 1 -- start start 2023-11-29T11:17:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef8158e60 0x7faef80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80ad490 0x7faef80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef80cd8f0 con 0x7faef80cad50 2023-11-29T11:17:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef80add00 con 0x7faef8158e60 2023-11-29T11:17:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef80cc4f0 con 0x7faef80ad490 2023-11-29T11:17:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefcffe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef8158e60 0x7faef80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefcffe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef8158e60 0x7faef80c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48408/0 (socket says 172.21.15.81:48408) 2023-11-29T11:17:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefd7ff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faef80cad50 0x7faef806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53984/0 (socket says 172.21.15.81:53984) 2023-11-29T11:17:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefcffe700 1 -- 172.21.15.81:0/2323505284 learned_addr learned my addr 172.21.15.81:0/2323505284 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faef7fff700 1 --2- 172.21.15.81:0/2323505284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80ad490 0x7faef80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefcffe700 1 -- 172.21.15.81:0/2323505284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80ad490 msgr2=0x7faef80cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefcffe700 1 --2- 172.21.15.81:0/2323505284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80ad490 0x7faef80cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefcffe700 1 -- 172.21.15.81:0/2323505284 >> v1:172.21.15.81:6789/0 conn(0x7faef80cad50 legacy=0x7faef806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefcffe700 1 -- 172.21.15.81:0/2323505284 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef806dc60 con 0x7faef8158e60 2023-11-29T11:17:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faef77fe700 1 -- 172.21.15.81:0/2323505284 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638794443 0 0) 0x7faef80cd8f0 con 0x7faef80cad50 2023-11-29T11:17:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefcffe700 1 --2- 172.21.15.81:0/2323505284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef8158e60 0x7faef80c8a30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7faeec009970 tx=0x7faeec009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575bcf213b896464 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faef77fe700 1 -- 172.21.15.81:0/2323505284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec011830 con 0x7faef8158e60 2023-11-29T11:17:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faef77fe700 1 -- 172.21.15.81:0/2323505284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec011990 con 0x7faef8158e60 2023-11-29T11:17:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faef77fe700 1 -- 172.21.15.81:0/2323505284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec011d20 con 0x7faef8158e60 2023-11-29T11:17:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 -- 172.21.15.81:0/2323505284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef8158e60 msgr2=0x7faef80c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 --2- 172.21.15.81:0/2323505284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef8158e60 0x7faef80c8a30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7faeec009970 tx=0x7faeec009c80 comp rx=0 tx=0).stop 2023-11-29T11:17:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 -- 172.21.15.81:0/2323505284 shutdown_connections 2023-11-29T11:17:43.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 --2- 172.21.15.81:0/2323505284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80ad490 0x7faef80cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 --2- 172.21.15.81:0/2323505284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef8158e60 0x7faef80c8a30 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 -- 172.21.15.81:0/2323505284 >> 172.21.15.81:0/2323505284 conn(0x7faef80ce3e0 msgr2=0x7faef80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:43.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 -- 172.21.15.81:0/2323505284 shutdown_connections 2023-11-29T11:17:43.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.196+0000 7faefe000700 1 -- 172.21.15.81:0/2323505284 wait complete. 2023-11-29T11:17:43.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 Processor -- start 2023-11-29T11:17:43.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 -- start start 2023-11-29T11:17:43.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef80ad490 0x7faef8097a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80cad50 0x7faef81f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8158e60 0x7faef8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef80c1d40 con 0x7faef80ad490 2023-11-29T11:17:43.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef8152500 con 0x7faef8158e60 2023-11-29T11:17:43.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef81f4100 con 0x7faef80cad50 2023-11-29T11:17:43.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef80ad490 0x7faef8097a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef80ad490 0x7faef8097a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48424/0 (socket says 172.21.15.81:48424) 2023-11-29T11:17:43.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 -- 172.21.15.81:0/440342070 learned_addr learned my addr 172.21.15.81:0/440342070 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:43.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faef7fff700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80cad50 0x7faef81f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefd7ff700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8158e60 0x7faef8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 -- 172.21.15.81:0/440342070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80cad50 msgr2=0x7faef81f36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80cad50 0x7faef81f36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 -- 172.21.15.81:0/440342070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8158e60 msgr2=0x7faef8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8158e60 0x7faef8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 -- 172.21.15.81:0/440342070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec009570 con 0x7faef80ad490 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefcffe700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef80ad490 0x7faef8097a30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7faeec009890 tx=0x7faeec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faef57fa700 1 -- 172.21.15.81:0/440342070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec004510 con 0x7faef80ad490 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faef57fa700 1 -- 172.21.15.81:0/440342070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec01e070 con 0x7faef80ad490 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef8159230 con 0x7faef80ad490 2023-11-29T11:17:43.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faef57fa700 1 -- 172.21.15.81:0/440342070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec003900 con 0x7faef80ad490 2023-11-29T11:17:43.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.200+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef80cde90 con 0x7faef80ad490 2023-11-29T11:17:43.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.204+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef806d6a0 con 0x7faef80ad490 2023-11-29T11:17:43.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.204+0000 7faef57fa700 1 -- 172.21.15.81:0/440342070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faeec00f050 con 0x7faef80ad490 2023-11-29T11:17:43.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.204+0000 7faef57fa700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faedc064ee0 0x7faedc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.204+0000 7faef57fa700 1 -- 172.21.15.81:0/440342070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6411+0+0 (secure 0 0 0) 0x7faeec082ca0 con 0x7faef80ad490 2023-11-29T11:17:43.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.204+0000 7faef7fff700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faedc064ee0 0x7faedc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.208+0000 7faef7fff700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faedc064ee0 0x7faedc067390 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faef806ae50 tx=0x7faee4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.212+0000 7faef57fa700 1 -- 172.21.15.81:0/440342070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faeec087070 con 0x7faef80ad490 2023-11-29T11:17:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.368+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faef8072500 con 0x7faedc064ee0 2023-11-29T11:17:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.388+0000 7faef57fa700 1 -- 172.21.15.81:0/440342070 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310118 (secure 0 0 0) 0x7faef8072500 con 0x7faedc064ee0 2023-11-29T11:17:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.388+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faedc064ee0 msgr2=0x7faedc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.388+0000 7faefe000700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faedc064ee0 0x7faedc067390 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faef806ae50 tx=0x7faee4009240 comp rx=0 tx=0).stop 2023-11-29T11:17:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.388+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef80ad490 msgr2=0x7faef8097a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.388+0000 7faefe000700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef80ad490 0x7faef8097a30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7faeec009890 tx=0x7faeec004770 comp rx=0 tx=0).stop 2023-11-29T11:17:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.392+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 shutdown_connections 2023-11-29T11:17:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.392+0000 7faefe000700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faedc064ee0 0x7faedc067390 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.392+0000 7faefe000700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faef8158e60 0x7faef8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.392+0000 7faefe000700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faef80cad50 0x7faef81f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.392+0000 7faefe000700 1 --2- 172.21.15.81:0/440342070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef80ad490 0x7faef8097a30 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.392+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 >> 172.21.15.81:0/440342070 conn(0x7faef80ce3e0 msgr2=0x7faef806a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.392+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 shutdown_connections 2023-11-29T11:17:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.392+0000 7faefe000700 1 -- 172.21.15.81:0/440342070 wait complete. 2023-11-29T11:17:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:17:43.412 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2023-11-29T11:17:42.524679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":96652,"kb_used_data":8780,"kb_used_omap":0,"kb_used_meta":87808,"kb_avail":754878068,"statfs":{"total":773094113280,"available":772995141632,"internally_reserved":0,"allocated":8990720,"data_stored":4855866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":89915392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000844"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781421+0000","last_change":"2023-11-29T11:17:39.776173+0000","last_active":"2023-11-29T11:17:39.781421+0000","last_peered":"2023-11-29T11:17:39.781421+0000","last_clean":"2023-11-29T11:17:39.781421+0000","last_became_active":"2023-11-29T11:17:39.775779+0000","last_became_peered":"2023-11-29T11:17:39.775779+0000","last_unstale":"2023-11-29T11:17:39.781421+0000","last_undegraded":"2023-11-29T11:17:39.781421+0000","last_fullsized":"2023-11-29T11:17:39.781421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:29:38.733531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786218+0000","last_change":"2023-11-29T11:17:39.777197+0000","last_active":"2023-11-29T11:17:39.786218+0000","last_peered":"2023-11-29T11:17:39.786218+0000","last_clean":"2023-11-29T11:17:39.786218+0000","last_became_active":"2023-11-29T11:17:39.776829+0000","last_became_peered":"2023-11-29T11:17:39.776829+0000","last_unstale":"2023-11-29T11:17:39.786218+0000","last_undegraded":"2023-11-29T11:17:39.786218+0000","last_fullsized":"2023-11-29T11:17:39.786218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:04:16.989996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785055+0000","last_change":"2023-11-29T11:17:39.778457+0000","last_active":"2023-11-29T11:17:39.785055+0000","last_peered":"2023-11-29T11:17:39.785055+0000","last_clean":"2023-11-29T11:17:39.785055+0000","last_became_active":"2023-11-29T11:17:39.778181+0000","last_became_peered":"2023-11-29T11:17:39.778181+0000","last_unstale":"2023-11-29T11:17:39.785055+0000","last_undegraded":"2023-11-29T11:17:39.785055+0000","last_fullsized":"2023-11-29T11:17:39.785055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:40:49.985751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.784332+0000","last_change":"2023-11-29T11:17:39.770428+0000","last_active":"2023-11-29T11:17:39.784332+0000","last_peered":"2023-11-29T11:17:39.784332+0000","last_clean":"2023-11-29T11:17:39.784332+0000","last_became_active":"2023-11-29T11:17:39.770106+0000","last_became_peered":"2023-11-29T11:17:39.770106+0000","last_unstale":"2023-11-29T11:17:39.784332+0000","last_undegraded":"2023-11-29T11:17:39.784332+0000","last_fullsized":"2023-11-29T11:17:39.784332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:21:40.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.783756+0000","last_change":"2023-11-29T11:17:39.777707+0000","last_active":"2023-11-29T11:17:39.783756+0000","last_peered":"2023-11-29T11:17:39.783756+0000","last_clean":"2023-11-29T11:17:39.783756+0000","last_became_active":"2023-11-29T11:17:39.777301+0000","last_became_peered":"2023-11-29T11:17:39.777301+0000","last_unstale":"2023-11-29T11:17:39.783756+0000","last_undegraded":"2023-11-29T11:17:39.783756+0000","last_fullsized":"2023-11-29T11:17:39.783756+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:34:26.033001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.778696+0000","last_change":"2023-11-29T11:17:39.770827+0000","last_active":"2023-11-29T11:17:39.778696+0000","last_peered":"2023-11-29T11:17:39.778696+0000","last_clean":"2023-11-29T11:17:39.778696+0000","last_became_active":"2023-11-29T11:17:39.770363+0000","last_became_peered":"2023-11-29T11:17:39.770363+0000","last_unstale":"2023-11-29T11:17:39.778696+0000","last_undegraded":"2023-11-29T11:17:39.778696+0000","last_fullsized":"2023-11-29T11:17:39.778696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:39:49.630097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.784793+0000","last_change":"2023-11-29T11:17:39.778221+0000","last_active":"2023-11-29T11:17:39.784793+0000","last_peered":"2023-11-29T11:17:39.784793+0000","last_clean":"2023-11-29T11:17:39.784793+0000","last_became_active":"2023-11-29T11:17:39.777960+0000","last_became_peered":"2023-11-29T11:17:39.777960+0000","last_unstale":"2023-11-29T11:17:39.784793+0000","last_undegraded":"2023-11-29T11:17:39.784793+0000","last_fullsized":"2023-11-29T11:17:39.784793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:17:32.927327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777683+0000","last_change":"2023-11-29T11:17:39.768573+0000","last_active":"2023-11-29T11:17:39.777683+0000","last_peered":"2023-11-29T11:17:39.777683+0000","last_clean":"2023-11-29T11:17:39.777683+0000","last_became_active":"2023-11-29T11:17:39.768292+0000","last_became_peered":"2023-11-29T11:17:39.768292+0000","last_unstale":"2023-11-29T11:17:39.777683+0000","last_undegraded":"2023-11-29T11:17:39.777683+0000","last_fullsized":"2023-11-29T11:17:39.777683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:54:48.120723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788855+0000","last_change":"2023-11-29T11:17:39.784712+0000","last_active":"2023-11-29T11:17:39.788855+0000","last_peered":"2023-11-29T11:17:39.788855+0000","last_clean":"2023-11-29T11:17:39.788855+0000","last_became_active":"2023-11-29T11:17:39.784090+0000","last_became_peered":"2023-11-29T11:17:39.784090+0000","last_unstale":"2023-11-29T11:17:39.788855+0000","last_undegraded":"2023-11-29T11:17:39.788855+0000","last_fullsized":"2023-11-29T11:17:39.788855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:49.324687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781178+0000","last_change":"2023-11-29T11:17:39.775687+0000","last_active":"2023-11-29T11:17:39.781178+0000","last_peered":"2023-11-29T11:17:39.781178+0000","last_clean":"2023-11-29T11:17:39.781178+0000","last_became_active":"2023-11-29T11:17:39.772616+0000","last_became_peered":"2023-11-29T11:17:39.772616+0000","last_unstale":"2023-11-29T11:17:39.781178+0000","last_undegraded":"2023-11-29T11:17:39.781178+0000","last_fullsized":"2023-11-29T11:17:39.781178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:20:07.940670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.773458+0000","last_change":"2023-11-29T11:17:39.767568+0000","last_active":"2023-11-29T11:17:39.773458+0000","last_peered":"2023-11-29T11:17:39.773458+0000","last_clean":"2023-11-29T11:17:39.773458+0000","last_became_active":"2023-11-29T11:17:39.767131+0000","last_became_peered":"2023-11-29T11:17:39.767131+0000","last_unstale":"2023-11-29T11:17:39.773458+0000","last_undegraded":"2023-11-29T11:17:39.773458+0000","last_fullsized":"2023-11-29T11:17:39.773458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:06:14.821438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781088+0000","last_change":"2023-11-29T11:17:39.775476+0000","last_active":"2023-11-29T11:17:39.781088+0000","last_peered":"2023-11-29T11:17:39.781088+0000","last_clean":"2023-11-29T11:17:39.781088+0000","last_became_active":"2023-11-29T11:17:39.775251+0000","last_became_peered":"2023-11-29T11:17:39.775251+0000","last_unstale":"2023-11-29T11:17:39.781088+0000","last_undegraded":"2023-11-29T11:17:39.781088+0000","last_fullsized":"2023-11-29T11:17:39.781088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:12:30.534499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785004+0000","last_change":"2023-11-29T11:17:39.777139+0000","last_active":"2023-11-29T11:17:39.785004+0000","last_peered":"2023-11-29T11:17:39.785004+0000","last_clean":"2023-11-29T11:17:39.785004+0000","last_became_active":"2023-11-29T11:17:39.776852+0000","last_became_peered":"2023-11-29T11:17:39.776852+0000","last_unstale":"2023-11-29T11:17:39.785004+0000","last_undegraded":"2023-11-29T11:17:39.785004+0000","last_fullsized":"2023-11-29T11:17:39.785004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:11:03.994013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.784428+0000","last_change":"2023-11-29T11:17:39.770213+0000","last_active":"2023-11-29T11:17:39.784428+0000","last_peered":"2023-11-29T11:17:39.784428+0000","last_clean":"2023-11-29T11:17:39.784428+0000","last_became_active":"2023-11-29T11:17:39.769793+0000","last_became_peered":"2023-11-29T11:17:39.769793+0000","last_unstale":"2023-11-29T11:17:39.784428+0000","last_undegraded":"2023-11-29T11:17:39.784428+0000","last_fullsized":"2023-11-29T11:17:39.784428+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:09:30.288533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.773469+0000","last_change":"2023-11-29T11:17:39.772538+0000","last_active":"2023-11-29T11:17:39.773469+0000","last_peered":"2023-11-29T11:17:39.773469+0000","last_clean":"2023-11-29T11:17:39.773469+0000","last_became_active":"2023-11-29T11:17:39.772292+0000","last_became_peered":"2023-11-29T11:17:39.772292+0000","last_unstale":"2023-11-29T11:17:39.773469+0000","last_undegraded":"2023-11-29T11:17:39.773469+0000","last_fullsized":"2023-11-29T11:17:39.773469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:55:18.812667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786908+0000","last_change":"2023-11-29T11:17:39.781420+0000","last_active":"2023-11-29T11:17:39.786908+0000","last_peered":"2023-11-29T11:17:39.786908+0000","last_clean":"2023-11-29T11:17:39.786908+0000","last_became_active":"2023-11-29T11:17:39.781144+0000","last_became_peered":"2023-11-29T11:17:39.781144+0000","last_unstale":"2023-11-29T11:17:39.786908+0000","last_undegraded":"2023-11-29T11:17:39.786908+0000","last_fullsized":"2023-11-29T11:17:39.786908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:33:46.629424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789000+0000","last_change":"2023-11-29T11:17:39.785396+0000","last_active":"2023-11-29T11:17:39.789000+0000","last_peered":"2023-11-29T11:17:39.789000+0000","last_clean":"2023-11-29T11:17:39.789000+0000","last_became_active":"2023-11-29T11:17:39.785097+0000","last_became_peered":"2023-11-29T11:17:39.785097+0000","last_unstale":"2023-11-29T11:17:39.789000+0000","last_undegraded":"2023-11-29T11:17:39.789000+0000","last_fullsized":"2023-11-29T11:17:39.789000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:08:56.588850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785064+0000","last_change":"2023-11-29T11:17:39.781579+0000","last_active":"2023-11-29T11:17:39.785064+0000","last_peered":"2023-11-29T11:17:39.785064+0000","last_clean":"2023-11-29T11:17:39.785064+0000","last_became_active":"2023-11-29T11:17:39.781310+0000","last_became_peered":"2023-11-29T11:17:39.781310+0000","last_unstale":"2023-11-29T11:17:39.785064+0000","last_undegraded":"2023-11-29T11:17:39.785064+0000","last_fullsized":"2023-11-29T11:17:39.785064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:47:03.010466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.790422+0000","last_change":"2023-11-29T11:17:39.784136+0000","last_active":"2023-11-29T11:17:39.790422+0000","last_peered":"2023-11-29T11:17:39.790422+0000","last_clean":"2023-11-29T11:17:39.790422+0000","last_became_active":"2023-11-29T11:17:39.783871+0000","last_became_peered":"2023-11-29T11:17:39.783871+0000","last_unstale":"2023-11-29T11:17:39.790422+0000","last_undegraded":"2023-11-29T11:17:39.790422+0000","last_fullsized":"2023-11-29T11:17:39.790422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:37:37.723095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785033+0000","last_change":"2023-11-29T11:17:39.781250+0000","last_active":"2023-11-29T11:17:39.785033+0000","last_peered":"2023-11-29T11:17:39.785033+0000","last_clean":"2023-11-29T11:17:39.785033+0000","last_became_active":"2023-11-29T11:17:39.780968+0000","last_became_peered":"2023-11-29T11:17:39.780968+0000","last_unstale":"2023-11-29T11:17:39.785033+0000","last_undegraded":"2023-11-29T11:17:39.785033+0000","last_fullsized":"2023-11-29T11:17:39.785033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:16:37.479571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.787520+0000","last_change":"2023-11-29T11:17:39.784932+0000","last_active":"2023-11-29T11:17:39.787520+0000","last_peered":"2023-11-29T11:17:39.787520+0000","last_clean":"2023-11-29T11:17:39.787520+0000","last_became_active":"2023-11-29T11:17:39.784487+0000","last_became_peered":"2023-11-29T11:17:39.784487+0000","last_unstale":"2023-11-29T11:17:39.787520+0000","last_undegraded":"2023-11-29T11:17:39.787520+0000","last_fullsized":"2023-11-29T11:17:39.787520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:26:26.681066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788105+0000","last_change":"2023-11-29T11:17:39.786218+0000","last_active":"2023-11-29T11:17:39.788105+0000","last_peered":"2023-11-29T11:17:39.788105+0000","last_clean":"2023-11-29T11:17:39.788105+0000","last_became_active":"2023-11-29T11:17:39.785899+0000","last_became_peered":"2023-11-29T11:17:39.785899+0000","last_unstale":"2023-11-29T11:17:39.788105+0000","last_undegraded":"2023-11-29T11:17:39.788105+0000","last_fullsized":"2023-11-29T11:17:39.788105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:08:06.644032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.783599+0000","last_change":"2023-11-29T11:17:39.777453+0000","last_active":"2023-11-29T11:17:39.783599+0000","last_peered":"2023-11-29T11:17:39.783599+0000","last_clean":"2023-11-29T11:17:39.783599+0000","last_became_active":"2023-11-29T11:17:39.777181+0000","last_became_peered":"2023-11-29T11:17:39.777181+0000","last_unstale":"2023-11-29T11:17:39.783599+0000","last_undegraded":"2023-11-29T11:17:39.783599+0000","last_fullsized":"2023-11-29T11:17:39.783599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:22:09.020854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.787558+0000","last_change":"2023-11-29T11:17:39.785104+0000","last_active":"2023-11-29T11:17:39.787558+0000","last_peered":"2023-11-29T11:17:39.787558+0000","last_clean":"2023-11-29T11:17:39.787558+0000","last_became_active":"2023-11-29T11:17:39.784502+0000","last_became_peered":"2023-11-29T11:17:39.784502+0000","last_unstale":"2023-11-29T11:17:39.787558+0000","last_undegraded":"2023-11-29T11:17:39.787558+0000","last_fullsized":"2023-11-29T11:17:39.787558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:53:27.167335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786132+0000","last_change":"2023-11-29T11:17:39.777350+0000","last_active":"2023-11-29T11:17:39.786132+0000","last_peered":"2023-11-29T11:17:39.786132+0000","last_clean":"2023-11-29T11:17:39.786132+0000","last_became_active":"2023-11-29T11:17:39.776757+0000","last_became_peered":"2023-11-29T11:17:39.776757+0000","last_unstale":"2023-11-29T11:17:39.786132+0000","last_undegraded":"2023-11-29T11:17:39.786132+0000","last_fullsized":"2023-11-29T11:17:39.786132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:20:23.772099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785527+0000","last_change":"2023-11-29T11:17:39.780822+0000","last_active":"2023-11-29T11:17:39.785527+0000","last_peered":"2023-11-29T11:17:39.785527+0000","last_clean":"2023-11-29T11:17:39.785527+0000","last_became_active":"2023-11-29T11:17:39.780568+0000","last_became_peered":"2023-11-29T11:17:39.780568+0000","last_unstale":"2023-11-29T11:17:39.785527+0000","last_undegraded":"2023-11-29T11:17:39.785527+0000","last_fullsized":"2023-11-29T11:17:39.785527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:12:54.398926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780839+0000","last_change":"2023-11-29T11:17:39.774152+0000","last_active":"2023-11-29T11:17:39.780839+0000","last_peered":"2023-11-29T11:17:39.780839+0000","last_clean":"2023-11-29T11:17:39.780839+0000","last_became_active":"2023-11-29T11:17:39.773869+0000","last_became_peered":"2023-11-29T11:17:39.773869+0000","last_unstale":"2023-11-29T11:17:39.780839+0000","last_undegraded":"2023-11-29T11:17:39.780839+0000","last_fullsized":"2023-11-29T11:17:39.780839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:27:50.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781139+0000","last_change":"2023-11-29T11:17:39.776187+0000","last_active":"2023-11-29T11:17:39.781139+0000","last_peered":"2023-11-29T11:17:39.781139+0000","last_clean":"2023-11-29T11:17:39.781139+0000","last_became_active":"2023-11-29T11:17:39.775745+0000","last_became_peered":"2023-11-29T11:17:39.775745+0000","last_unstale":"2023-11-29T11:17:39.781139+0000","last_undegraded":"2023-11-29T11:17:39.781139+0000","last_fullsized":"2023-11-29T11:17:39.781139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:56.934584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.773948+0000","last_change":"2023-11-29T11:17:39.766915+0000","last_active":"2023-11-29T11:17:39.773948+0000","last_peered":"2023-11-29T11:17:39.773948+0000","last_clean":"2023-11-29T11:17:39.773948+0000","last_became_active":"2023-11-29T11:17:39.766199+0000","last_became_peered":"2023-11-29T11:17:39.766199+0000","last_unstale":"2023-11-29T11:17:39.773948+0000","last_undegraded":"2023-11-29T11:17:39.773948+0000","last_fullsized":"2023-11-29T11:17:39.773948+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:30:09.152398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786307+0000","last_change":"2023-11-29T11:17:39.774539+0000","last_active":"2023-11-29T11:17:39.786307+0000","last_peered":"2023-11-29T11:17:39.786307+0000","last_clean":"2023-11-29T11:17:39.786307+0000","last_became_active":"2023-11-29T11:17:39.774284+0000","last_became_peered":"2023-11-29T11:17:39.774284+0000","last_unstale":"2023-11-29T11:17:39.786307+0000","last_undegraded":"2023-11-29T11:17:39.786307+0000","last_fullsized":"2023-11-29T11:17:39.786307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:26:47.887494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786817+0000","last_change":"2023-11-29T11:17:39.778618+0000","last_active":"2023-11-29T11:17:39.786817+0000","last_peered":"2023-11-29T11:17:39.786817+0000","last_clean":"2023-11-29T11:17:39.786817+0000","last_became_active":"2023-11-29T11:17:39.778332+0000","last_became_peered":"2023-11-29T11:17:39.778332+0000","last_unstale":"2023-11-29T11:17:39.786817+0000","last_undegraded":"2023-11-29T11:17:39.786817+0000","last_fullsized":"2023-11-29T11:17:39.786817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:08:15.004341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777581+0000","last_change":"2023-11-29T11:17:39.769597+0000","last_active":"2023-11-29T11:17:39.777581+0000","last_peered":"2023-11-29T11:17:39.777581+0000","last_clean":"2023-11-29T11:17:39.777581+0000","last_became_active":"2023-11-29T11:17:39.769288+0000","last_became_peered":"2023-11-29T11:17:39.769288+0000","last_unstale":"2023-11-29T11:17:39.777581+0000","last_undegraded":"2023-11-29T11:17:39.777581+0000","last_fullsized":"2023-11-29T11:17:39.777581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:49:14.951649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786925+0000","last_change":"2023-11-29T11:17:39.781551+0000","last_active":"2023-11-29T11:17:39.786925+0000","last_peered":"2023-11-29T11:17:39.786925+0000","last_clean":"2023-11-29T11:17:39.786925+0000","last_became_active":"2023-11-29T11:17:39.781240+0000","last_became_peered":"2023-11-29T11:17:39.781240+0000","last_unstale":"2023-11-29T11:17:39.786925+0000","last_undegraded":"2023-11-29T11:17:39.786925+0000","last_fullsized":"2023-11-29T11:17:39.786925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:44.558273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.784795+0000","last_change":"2023-11-29T11:17:39.404658+0000","last_active":"2023-11-29T11:17:39.784795+0000","last_peered":"2023-11-29T11:17:39.784795+0000","last_clean":"2023-11-29T11:17:39.784795+0000","last_became_active":"2023-11-29T11:17:39.403857+0000","last_became_peered":"2023-11-29T11:17:39.403857+0000","last_unstale":"2023-11-29T11:17:39.784795+0000","last_undegraded":"2023-11-29T11:17:39.784795+0000","last_fullsized":"2023-11-29T11:17:39.784795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:39:48.625724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.783724+0000","last_change":"2023-11-29T11:17:39.778561+0000","last_active":"2023-11-29T11:17:39.783724+0000","last_peered":"2023-11-29T11:17:39.783724+0000","last_clean":"2023-11-29T11:17:39.783724+0000","last_became_active":"2023-11-29T11:17:39.778279+0000","last_became_peered":"2023-11-29T11:17:39.778279+0000","last_unstale":"2023-11-29T11:17:39.783724+0000","last_undegraded":"2023-11-29T11:17:39.783724+0000","last_fullsized":"2023-11-29T11:17:39.783724+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:04:30.265504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.776976+0000","last_change":"2023-11-29T11:17:39.403387+0000","last_active":"2023-11-29T11:17:39.776976+0000","last_peered":"2023-11-29T11:17:39.776976+0000","last_clean":"2023-11-29T11:17:39.776976+0000","last_became_active":"2023-11-29T11:17:39.403086+0000","last_became_peered":"2023-11-29T11:17:39.403086+0000","last_unstale":"2023-11-29T11:17:39.776976+0000","last_undegraded":"2023-11-29T11:17:39.776976+0000","last_fullsized":"2023-11-29T11:17:39.776976+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:46:45.423643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781069+0000","last_change":"2023-11-29T11:17:39.775462+0000","last_active":"2023-11-29T11:17:39.781069+0000","last_peered":"2023-11-29T11:17:39.781069+0000","last_clean":"2023-11-29T11:17:39.781069+0000","last_became_active":"2023-11-29T11:17:39.775149+0000","last_became_peered":"2023-11-29T11:17:39.775149+0000","last_unstale":"2023-11-29T11:17:39.781069+0000","last_undegraded":"2023-11-29T11:17:39.781069+0000","last_fullsized":"2023-11-29T11:17:39.781069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:24:24.808653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786105+0000","last_change":"2023-11-29T11:17:39.404627+0000","last_active":"2023-11-29T11:17:39.786105+0000","last_peered":"2023-11-29T11:17:39.786105+0000","last_clean":"2023-11-29T11:17:39.786105+0000","last_became_active":"2023-11-29T11:17:39.404338+0000","last_became_peered":"2023-11-29T11:17:39.404338+0000","last_unstale":"2023-11-29T11:17:39.786105+0000","last_undegraded":"2023-11-29T11:17:39.786105+0000","last_fullsized":"2023-11-29T11:17:39.786105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:13:47.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.775891+0000","last_change":"2023-11-29T11:17:39.772303+0000","last_active":"2023-11-29T11:17:39.775891+0000","last_peered":"2023-11-29T11:17:39.775891+0000","last_clean":"2023-11-29T11:17:39.775891+0000","last_became_active":"2023-11-29T11:17:39.772035+0000","last_became_peered":"2023-11-29T11:17:39.772035+0000","last_unstale":"2023-11-29T11:17:39.775891+0000","last_undegraded":"2023-11-29T11:17:39.775891+0000","last_fullsized":"2023-11-29T11:17:39.775891+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:53:59.070248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786562+0000","last_change":"2023-11-29T11:17:39.404636+0000","last_active":"2023-11-29T11:17:39.786562+0000","last_peered":"2023-11-29T11:17:39.786562+0000","last_clean":"2023-11-29T11:17:39.786562+0000","last_became_active":"2023-11-29T11:17:39.404331+0000","last_became_peered":"2023-11-29T11:17:39.404331+0000","last_unstale":"2023-11-29T11:17:39.786562+0000","last_undegraded":"2023-11-29T11:17:39.786562+0000","last_fullsized":"2023-11-29T11:17:39.786562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:19.835250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780425+0000","last_change":"2023-11-29T11:17:39.771284+0000","last_active":"2023-11-29T11:17:39.780425+0000","last_peered":"2023-11-29T11:17:39.780425+0000","last_clean":"2023-11-29T11:17:39.780425+0000","last_became_active":"2023-11-29T11:17:39.771040+0000","last_became_peered":"2023-11-29T11:17:39.771040+0000","last_unstale":"2023-11-29T11:17:39.780425+0000","last_undegraded":"2023-11-29T11:17:39.780425+0000","last_fullsized":"2023-11-29T11:17:39.780425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:12:29.695323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786620+0000","last_change":"2023-11-29T11:17:39.411417+0000","last_active":"2023-11-29T11:17:39.786620+0000","last_peered":"2023-11-29T11:17:39.786620+0000","last_clean":"2023-11-29T11:17:39.786620+0000","last_became_active":"2023-11-29T11:17:39.411083+0000","last_became_peered":"2023-11-29T11:17:39.411083+0000","last_unstale":"2023-11-29T11:17:39.786620+0000","last_undegraded":"2023-11-29T11:17:39.786620+0000","last_fullsized":"2023-11-29T11:17:39.786620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:04:14.675981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.778253+0000","last_change":"2023-11-29T11:17:39.774043+0000","last_active":"2023-11-29T11:17:39.778253+0000","last_peered":"2023-11-29T11:17:39.778253+0000","last_clean":"2023-11-29T11:17:39.778253+0000","last_became_active":"2023-11-29T11:17:39.773771+0000","last_became_peered":"2023-11-29T11:17:39.773771+0000","last_unstale":"2023-11-29T11:17:39.778253+0000","last_undegraded":"2023-11-29T11:17:39.778253+0000","last_fullsized":"2023-11-29T11:17:39.778253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:39:25.040121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.773931+0000","last_change":"2023-11-29T11:17:39.405585+0000","last_active":"2023-11-29T11:17:39.773931+0000","last_peered":"2023-11-29T11:17:39.773931+0000","last_clean":"2023-11-29T11:17:39.773931+0000","last_became_active":"2023-11-29T11:17:39.405315+0000","last_became_peered":"2023-11-29T11:17:39.405315+0000","last_unstale":"2023-11-29T11:17:39.773931+0000","last_undegraded":"2023-11-29T11:17:39.773931+0000","last_fullsized":"2023-11-29T11:17:39.773931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:37:36.718722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785287+0000","last_change":"2023-11-29T11:17:39.779922+0000","last_active":"2023-11-29T11:17:39.785287+0000","last_peered":"2023-11-29T11:17:39.785287+0000","last_clean":"2023-11-29T11:17:39.785287+0000","last_became_active":"2023-11-29T11:17:39.779646+0000","last_became_peered":"2023-11-29T11:17:39.779646+0000","last_unstale":"2023-11-29T11:17:39.785287+0000","last_undegraded":"2023-11-29T11:17:39.785287+0000","last_fullsized":"2023-11-29T11:17:39.785287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:20.839623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.775572+0000","last_change":"2023-11-29T11:17:39.405717+0000","last_active":"2023-11-29T11:17:39.775572+0000","last_peered":"2023-11-29T11:17:39.775572+0000","last_clean":"2023-11-29T11:17:39.775572+0000","last_became_active":"2023-11-29T11:17:39.405461+0000","last_became_peered":"2023-11-29T11:17:39.405461+0000","last_unstale":"2023-11-29T11:17:39.775572+0000","last_undegraded":"2023-11-29T11:17:39.775572+0000","last_fullsized":"2023-11-29T11:17:39.775572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:40:48.981378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.767867+0000","last_change":"2023-11-29T11:17:39.766447+0000","last_active":"2023-11-29T11:17:39.767867+0000","last_peered":"2023-11-29T11:17:39.767867+0000","last_clean":"2023-11-29T11:17:39.767867+0000","last_became_active":"2023-11-29T11:17:39.766145+0000","last_became_peered":"2023-11-29T11:17:39.766145+0000","last_unstale":"2023-11-29T11:17:39.767867+0000","last_undegraded":"2023-11-29T11:17:39.767867+0000","last_fullsized":"2023-11-29T11:17:39.767867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:22:02.921524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.755456+0000","last_change":"2023-11-29T11:17:39.408650+0000","last_active":"2023-11-29T11:17:39.755456+0000","last_peered":"2023-11-29T11:17:39.755456+0000","last_clean":"2023-11-29T11:17:39.755456+0000","last_became_active":"2023-11-29T11:17:39.408390+0000","last_became_peered":"2023-11-29T11:17:39.408390+0000","last_unstale":"2023-11-29T11:17:39.755456+0000","last_undegraded":"2023-11-29T11:17:39.755456+0000","last_fullsized":"2023-11-29T11:17:39.755456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:26:25.676693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.767811+0000","last_change":"2023-11-29T11:17:39.765316+0000","last_active":"2023-11-29T11:17:39.767811+0000","last_peered":"2023-11-29T11:17:39.767811+0000","last_clean":"2023-11-29T11:17:39.767811+0000","last_became_active":"2023-11-29T11:17:39.765052+0000","last_became_peered":"2023-11-29T11:17:39.765052+0000","last_unstale":"2023-11-29T11:17:39.767811+0000","last_undegraded":"2023-11-29T11:17:39.767811+0000","last_fullsized":"2023-11-29T11:17:39.767811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:37:37.723095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.765917+0000","last_change":"2023-11-29T11:17:39.404665+0000","last_active":"2023-11-29T11:17:39.765917+0000","last_peered":"2023-11-29T11:17:39.765917+0000","last_clean":"2023-11-29T11:17:39.765917+0000","last_became_active":"2023-11-29T11:17:39.404121+0000","last_became_peered":"2023-11-29T11:17:39.404121+0000","last_unstale":"2023-11-29T11:17:39.765917+0000","last_undegraded":"2023-11-29T11:17:39.765917+0000","last_fullsized":"2023-11-29T11:17:39.765917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:48.320314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777636+0000","last_change":"2023-11-29T11:17:39.770274+0000","last_active":"2023-11-29T11:17:39.777636+0000","last_peered":"2023-11-29T11:17:39.777636+0000","last_clean":"2023-11-29T11:17:39.777636+0000","last_became_active":"2023-11-29T11:17:39.770047+0000","last_became_peered":"2023-11-29T11:17:39.770047+0000","last_unstale":"2023-11-29T11:17:39.777636+0000","last_undegraded":"2023-11-29T11:17:39.777636+0000","last_fullsized":"2023-11-29T11:17:39.777636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:07:24.665909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.760203+0000","last_change":"2023-11-29T11:17:39.409658+0000","last_active":"2023-11-29T11:17:39.760203+0000","last_peered":"2023-11-29T11:17:39.760203+0000","last_clean":"2023-11-29T11:17:39.760203+0000","last_became_active":"2023-11-29T11:17:39.409400+0000","last_became_peered":"2023-11-29T11:17:39.409400+0000","last_unstale":"2023-11-29T11:17:39.760203+0000","last_undegraded":"2023-11-29T11:17:39.760203+0000","last_fullsized":"2023-11-29T11:17:39.760203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:00:56.377568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.790396+0000","last_change":"2023-11-29T11:17:39.782830+0000","last_active":"2023-11-29T11:17:39.790396+0000","last_peered":"2023-11-29T11:17:39.790396+0000","last_clean":"2023-11-29T11:17:39.790396+0000","last_became_active":"2023-11-29T11:17:39.782268+0000","last_became_peered":"2023-11-29T11:17:39.782268+0000","last_unstale":"2023-11-29T11:17:39.790396+0000","last_undegraded":"2023-11-29T11:17:39.790396+0000","last_fullsized":"2023-11-29T11:17:39.790396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:38:58.240037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"80'3","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780771+0000","last_change":"2023-11-29T11:17:39.411373+0000","last_active":"2023-11-29T11:17:39.780771+0000","last_peered":"2023-11-29T11:17:39.780771+0000","last_clean":"2023-11-29T11:17:39.780771+0000","last_became_active":"2023-11-29T11:17:39.411032+0000","last_became_peered":"2023-11-29T11:17:39.411032+0000","last_unstale":"2023-11-29T11:17:39.780771+0000","last_undegraded":"2023-11-29T11:17:39.780771+0000","last_fullsized":"2023-11-29T11:17:39.780771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:54:47.116350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788966+0000","last_change":"2023-11-29T11:17:39.784490+0000","last_active":"2023-11-29T11:17:39.788966+0000","last_peered":"2023-11-29T11:17:39.788966+0000","last_clean":"2023-11-29T11:17:39.788966+0000","last_became_active":"2023-11-29T11:17:39.784226+0000","last_became_peered":"2023-11-29T11:17:39.784226+0000","last_unstale":"2023-11-29T11:17:39.788966+0000","last_undegraded":"2023-11-29T11:17:39.788966+0000","last_fullsized":"2023-11-29T11:17:39.788966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:48:53.020111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"80'6","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789211+0000","last_change":"2023-11-29T11:17:39.400090+0000","last_active":"2023-11-29T11:17:39.789211+0000","last_peered":"2023-11-29T11:17:39.789211+0000","last_clean":"2023-11-29T11:17:39.789211+0000","last_became_active":"2023-11-29T11:17:39.399727+0000","last_became_peered":"2023-11-29T11:17:39.399727+0000","last_unstale":"2023-11-29T11:17:39.789211+0000","last_undegraded":"2023-11-29T11:17:39.789211+0000","last_fullsized":"2023-11-29T11:17:39.789211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:33:56.174714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789209+0000","last_change":"2023-11-29T11:17:39.779517+0000","last_active":"2023-11-29T11:17:39.789209+0000","last_peered":"2023-11-29T11:17:39.789209+0000","last_clean":"2023-11-29T11:17:39.789209+0000","last_became_active":"2023-11-29T11:17:39.779175+0000","last_became_peered":"2023-11-29T11:17:39.779175+0000","last_unstale":"2023-11-29T11:17:39.789209+0000","last_undegraded":"2023-11-29T11:17:39.789209+0000","last_fullsized":"2023-11-29T11:17:39.789209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:55:18.812667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.766709+0000","last_change":"2023-11-29T11:17:39.409930+0000","last_active":"2023-11-29T11:17:39.766709+0000","last_peered":"2023-11-29T11:17:39.766709+0000","last_clean":"2023-11-29T11:17:39.766709+0000","last_became_active":"2023-11-29T11:17:39.409548+0000","last_became_peered":"2023-11-29T11:17:39.409548+0000","last_unstale":"2023-11-29T11:17:39.766709+0000","last_undegraded":"2023-11-29T11:17:39.766709+0000","last_fullsized":"2023-11-29T11:17:39.766709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:47:02.006094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785026+0000","last_change":"2023-11-29T11:17:39.778162+0000","last_active":"2023-11-29T11:17:39.785026+0000","last_peered":"2023-11-29T11:17:39.785026+0000","last_clean":"2023-11-29T11:17:39.785026+0000","last_became_active":"2023-11-29T11:17:39.777883+0000","last_became_peered":"2023-11-29T11:17:39.777883+0000","last_unstale":"2023-11-29T11:17:39.785026+0000","last_undegraded":"2023-11-29T11:17:39.785026+0000","last_fullsized":"2023-11-29T11:17:39.785026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:13:48.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.758707+0000","last_change":"2023-11-29T11:17:39.401188+0000","last_active":"2023-11-29T11:17:39.758707+0000","last_peered":"2023-11-29T11:17:39.758707+0000","last_clean":"2023-11-29T11:17:39.758707+0000","last_became_active":"2023-11-29T11:17:39.400899+0000","last_became_peered":"2023-11-29T11:17:39.400899+0000","last_unstale":"2023-11-29T11:17:39.758707+0000","last_undegraded":"2023-11-29T11:17:39.758707+0000","last_fullsized":"2023-11-29T11:17:39.758707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:48:48.396303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786245+0000","last_change":"2023-11-29T11:17:39.774693+0000","last_active":"2023-11-29T11:17:39.786245+0000","last_peered":"2023-11-29T11:17:39.786245+0000","last_clean":"2023-11-29T11:17:39.786245+0000","last_became_active":"2023-11-29T11:17:39.774238+0000","last_became_peered":"2023-11-29T11:17:39.774238+0000","last_unstale":"2023-11-29T11:17:39.786245+0000","last_undegraded":"2023-11-29T11:17:39.786245+0000","last_fullsized":"2023-11-29T11:17:39.786245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:23:18.142626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.755961+0000","last_change":"2023-11-29T11:17:39.407552+0000","last_active":"2023-11-29T11:17:39.755961+0000","last_peered":"2023-11-29T11:17:39.755961+0000","last_clean":"2023-11-29T11:17:39.755961+0000","last_became_active":"2023-11-29T11:17:39.407240+0000","last_became_peered":"2023-11-29T11:17:39.407240+0000","last_unstale":"2023-11-29T11:17:39.755961+0000","last_undegraded":"2023-11-29T11:17:39.755961+0000","last_fullsized":"2023-11-29T11:17:39.755961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:11:20.952474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788063+0000","last_change":"2023-11-29T11:17:39.781574+0000","last_active":"2023-11-29T11:17:39.788063+0000","last_peered":"2023-11-29T11:17:39.788063+0000","last_clean":"2023-11-29T11:17:39.788063+0000","last_became_active":"2023-11-29T11:17:39.781302+0000","last_became_peered":"2023-11-29T11:17:39.781302+0000","last_unstale":"2023-11-29T11:17:39.788063+0000","last_undegraded":"2023-11-29T11:17:39.788063+0000","last_fullsized":"2023-11-29T11:17:39.788063+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:03:06.152970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789339+0000","last_change":"2023-11-29T11:17:39.400483+0000","last_active":"2023-11-29T11:17:39.789339+0000","last_peered":"2023-11-29T11:17:39.789339+0000","last_clean":"2023-11-29T11:17:39.789339+0000","last_became_active":"2023-11-29T11:17:39.400223+0000","last_became_peered":"2023-11-29T11:17:39.400223+0000","last_unstale":"2023-11-29T11:17:39.789339+0000","last_undegraded":"2023-11-29T11:17:39.789339+0000","last_fullsized":"2023-11-29T11:17:39.789339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:48:48.396303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786737+0000","last_change":"2023-11-29T11:17:39.778316+0000","last_active":"2023-11-29T11:17:39.786737+0000","last_peered":"2023-11-29T11:17:39.786737+0000","last_clean":"2023-11-29T11:17:39.786737+0000","last_became_active":"2023-11-29T11:17:39.778041+0000","last_became_peered":"2023-11-29T11:17:39.778041+0000","last_unstale":"2023-11-29T11:17:39.786737+0000","last_undegraded":"2023-11-29T11:17:39.786737+0000","last_fullsized":"2023-11-29T11:17:39.786737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:17:04.990325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777136+0000","last_change":"2023-11-29T11:17:39.404659+0000","last_active":"2023-11-29T11:17:39.777136+0000","last_peered":"2023-11-29T11:17:39.777136+0000","last_clean":"2023-11-29T11:17:39.777136+0000","last_became_active":"2023-11-29T11:17:39.404409+0000","last_became_peered":"2023-11-29T11:17:39.404409+0000","last_unstale":"2023-11-29T11:17:39.777136+0000","last_undegraded":"2023-11-29T11:17:39.777136+0000","last_fullsized":"2023-11-29T11:17:39.777136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:53:26.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785167+0000","last_change":"2023-11-29T11:17:39.779509+0000","last_active":"2023-11-29T11:17:39.785167+0000","last_peered":"2023-11-29T11:17:39.785167+0000","last_clean":"2023-11-29T11:17:39.785167+0000","last_became_active":"2023-11-29T11:17:39.779207+0000","last_became_peered":"2023-11-29T11:17:39.779207+0000","last_unstale":"2023-11-29T11:17:39.785167+0000","last_undegraded":"2023-11-29T11:17:39.785167+0000","last_fullsized":"2023-11-29T11:17:39.785167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:48:49.400676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:40.190849+0000","last_change":"2023-11-29T11:17:39.409833+0000","last_active":"2023-11-29T11:17:40.190849+0000","last_peered":"2023-11-29T11:17:40.190849+0000","last_clean":"2023-11-29T11:17:40.190849+0000","last_became_active":"2023-11-29T11:17:39.409539+0000","last_became_peered":"2023-11-29T11:17:39.409539+0000","last_unstale":"2023-11-29T11:17:40.190849+0000","last_undegraded":"2023-11-29T11:17:40.190849+0000","last_fullsized":"2023-11-29T11:17:40.190849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:16:36.475198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781050+0000","last_change":"2023-11-29T11:17:39.775338+0000","last_active":"2023-11-29T11:17:39.781050+0000","last_peered":"2023-11-29T11:17:39.781050+0000","last_clean":"2023-11-29T11:17:39.781050+0000","last_became_active":"2023-11-29T11:17:39.775020+0000","last_became_peered":"2023-11-29T11:17:39.775020+0000","last_unstale":"2023-11-29T11:17:39.781050+0000","last_undegraded":"2023-11-29T11:17:39.781050+0000","last_fullsized":"2023-11-29T11:17:39.781050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:08:44.499564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.759605+0000","last_change":"2023-11-29T11:17:39.404102+0000","last_active":"2023-11-29T11:17:39.759605+0000","last_peered":"2023-11-29T11:17:39.759605+0000","last_clean":"2023-11-29T11:17:39.759605+0000","last_became_active":"2023-11-29T11:17:39.403789+0000","last_became_peered":"2023-11-29T11:17:39.403789+0000","last_unstale":"2023-11-29T11:17:39.759605+0000","last_undegraded":"2023-11-29T11:17:39.759605+0000","last_fullsized":"2023-11-29T11:17:39.759605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:35:17.115893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786816+0000","last_change":"2023-11-29T11:17:39.780851+0000","last_active":"2023-11-29T11:17:39.786816+0000","last_peered":"2023-11-29T11:17:39.786816+0000","last_clean":"2023-11-29T11:17:39.786816+0000","last_became_active":"2023-11-29T11:17:39.780600+0000","last_became_peered":"2023-11-29T11:17:39.780600+0000","last_unstale":"2023-11-29T11:17:39.786816+0000","last_undegraded":"2023-11-29T11:17:39.786816+0000","last_fullsized":"2023-11-29T11:17:39.786816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:31:55.298988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.765663+0000","last_change":"2023-11-29T11:17:39.401203+0000","last_active":"2023-11-29T11:17:39.765663+0000","last_peered":"2023-11-29T11:17:39.765663+0000","last_clean":"2023-11-29T11:17:39.765663+0000","last_became_active":"2023-11-29T11:17:39.400797+0000","last_became_peered":"2023-11-29T11:17:39.400797+0000","last_unstale":"2023-11-29T11:17:39.765663+0000","last_undegraded":"2023-11-29T11:17:39.765663+0000","last_fullsized":"2023-11-29T11:17:39.765663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:14:30.989137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.764242+0000","last_change":"2023-11-29T11:17:39.760911+0000","last_active":"2023-11-29T11:17:39.764242+0000","last_peered":"2023-11-29T11:17:39.764242+0000","last_clean":"2023-11-29T11:17:39.764242+0000","last_became_active":"2023-11-29T11:17:39.760526+0000","last_became_peered":"2023-11-29T11:17:39.760526+0000","last_unstale":"2023-11-29T11:17:39.764242+0000","last_undegraded":"2023-11-29T11:17:39.764242+0000","last_fullsized":"2023-11-29T11:17:39.764242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:14:31.993510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.776347+0000","last_change":"2023-11-29T11:17:39.399638+0000","last_active":"2023-11-29T11:17:39.776347+0000","last_peered":"2023-11-29T11:17:39.776347+0000","last_clean":"2023-11-29T11:17:39.776347+0000","last_became_active":"2023-11-29T11:17:39.399150+0000","last_became_peered":"2023-11-29T11:17:39.399150+0000","last_unstale":"2023-11-29T11:17:39.776347+0000","last_undegraded":"2023-11-29T11:17:39.776347+0000","last_fullsized":"2023-11-29T11:17:39.776347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:15.769433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789123+0000","last_change":"2023-11-29T11:17:39.779370+0000","last_active":"2023-11-29T11:17:39.789123+0000","last_peered":"2023-11-29T11:17:39.789123+0000","last_clean":"2023-11-29T11:17:39.789123+0000","last_became_active":"2023-11-29T11:17:39.779049+0000","last_became_peered":"2023-11-29T11:17:39.779049+0000","last_unstale":"2023-11-29T11:17:39.789123+0000","last_undegraded":"2023-11-29T11:17:39.789123+0000","last_fullsized":"2023-11-29T11:17:39.789123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:37:49.621769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.769178+0000","last_change":"2023-11-29T11:17:39.401904+0000","last_active":"2023-11-29T11:17:39.769178+0000","last_peered":"2023-11-29T11:17:39.769178+0000","last_clean":"2023-11-29T11:17:39.769178+0000","last_became_active":"2023-11-29T11:17:39.401648+0000","last_became_peered":"2023-11-29T11:17:39.401648+0000","last_unstale":"2023-11-29T11:17:39.769178+0000","last_undegraded":"2023-11-29T11:17:39.769178+0000","last_fullsized":"2023-11-29T11:17:39.769178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:55:17.808295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785308+0000","last_change":"2023-11-29T11:17:39.780763+0000","last_active":"2023-11-29T11:17:39.785308+0000","last_peered":"2023-11-29T11:17:39.785308+0000","last_clean":"2023-11-29T11:17:39.785308+0000","last_became_active":"2023-11-29T11:17:39.780501+0000","last_became_peered":"2023-11-29T11:17:39.780501+0000","last_unstale":"2023-11-29T11:17:39.785308+0000","last_undegraded":"2023-11-29T11:17:39.785308+0000","last_fullsized":"2023-11-29T11:17:39.785308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:05:23.613726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.765456+0000","last_change":"2023-11-29T11:17:39.404015+0000","last_active":"2023-11-29T11:17:39.765456+0000","last_peered":"2023-11-29T11:17:39.765456+0000","last_clean":"2023-11-29T11:17:39.765456+0000","last_became_active":"2023-11-29T11:17:39.402855+0000","last_became_peered":"2023-11-29T11:17:39.402855+0000","last_unstale":"2023-11-29T11:17:39.765456+0000","last_undegraded":"2023-11-29T11:17:39.765456+0000","last_fullsized":"2023-11-29T11:17:39.765456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:15:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780882+0000","last_change":"2023-11-29T11:17:39.774550+0000","last_active":"2023-11-29T11:17:39.780882+0000","last_peered":"2023-11-29T11:17:39.780882+0000","last_clean":"2023-11-29T11:17:39.780882+0000","last_became_active":"2023-11-29T11:17:39.772508+0000","last_became_peered":"2023-11-29T11:17:39.772508+0000","last_unstale":"2023-11-29T11:17:39.780882+0000","last_undegraded":"2023-11-29T11:17:39.780882+0000","last_fullsized":"2023-11-29T11:17:39.780882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:12.164959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.762025+0000","last_change":"2023-11-29T11:17:39.406129+0000","last_active":"2023-11-29T11:17:39.762025+0000","last_peered":"2023-11-29T11:17:39.762025+0000","last_clean":"2023-11-29T11:17:39.762025+0000","last_became_active":"2023-11-29T11:17:39.405608+0000","last_became_peered":"2023-11-29T11:17:39.405608+0000","last_unstale":"2023-11-29T11:17:39.762025+0000","last_undegraded":"2023-11-29T11:17:39.762025+0000","last_fullsized":"2023-11-29T11:17:39.762025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:22:01.917152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777668+0000","last_change":"2023-11-29T11:17:39.768703+0000","last_active":"2023-11-29T11:17:39.777668+0000","last_peered":"2023-11-29T11:17:39.777668+0000","last_clean":"2023-11-29T11:17:39.777668+0000","last_became_active":"2023-11-29T11:17:39.768359+0000","last_became_peered":"2023-11-29T11:17:39.768359+0000","last_unstale":"2023-11-29T11:17:39.777668+0000","last_undegraded":"2023-11-29T11:17:39.777668+0000","last_fullsized":"2023-11-29T11:17:39.777668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:15:01.876664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.766078+0000","last_change":"2023-11-29T11:17:39.408896+0000","last_active":"2023-11-29T11:17:39.766078+0000","last_peered":"2023-11-29T11:17:39.766078+0000","last_clean":"2023-11-29T11:17:39.766078+0000","last_became_active":"2023-11-29T11:17:39.408608+0000","last_became_peered":"2023-11-29T11:17:39.408608+0000","last_unstale":"2023-11-29T11:17:39.766078+0000","last_undegraded":"2023-11-29T11:17:39.766078+0000","last_fullsized":"2023-11-29T11:17:39.766078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:53:44.029562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":66,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.402143+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:17:39.402143+0000","last_peered":"2023-11-29T11:17:39.402143+0000","last_clean":"2023-11-29T11:17:39.402143+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:17:39.402143+0000","last_undegraded":"2023-11-29T11:17:39.402143+0000","last_fullsized":"2023-11-29T11:17:39.402143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781337+0000","last_change":"2023-11-29T11:17:39.769788+0000","last_active":"2023-11-29T11:17:39.781337+0000","last_peered":"2023-11-29T11:17:39.781337+0000","last_clean":"2023-11-29T11:17:39.781337+0000","last_became_active":"2023-11-29T11:17:39.769463+0000","last_became_peered":"2023-11-29T11:17:39.769463+0000","last_unstale":"2023-11-29T11:17:39.781337+0000","last_undegraded":"2023-11-29T11:17:39.781337+0000","last_fullsized":"2023-11-29T11:17:39.781337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:32:04.227379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.770852+0000","last_change":"2023-11-29T11:17:39.398302+0000","last_active":"2023-11-29T11:17:39.770852+0000","last_peered":"2023-11-29T11:17:39.770852+0000","last_clean":"2023-11-29T11:17:39.770852+0000","last_became_active":"2023-11-29T11:17:39.397956+0000","last_became_peered":"2023-11-29T11:17:39.397956+0000","last_unstale":"2023-11-29T11:17:39.770852+0000","last_undegraded":"2023-11-29T11:17:39.770852+0000","last_fullsized":"2023-11-29T11:17:39.770852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:13:47.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":67,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.402002+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:17:39.402002+0000","last_peered":"2023-11-29T11:17:39.402002+0000","last_clean":"2023-11-29T11:17:39.402002+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:17:39.402002+0000","last_undegraded":"2023-11-29T11:17:39.402002+0000","last_fullsized":"2023-11-29T11:17:39.402002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788847+0000","last_change":"2023-11-29T11:17:39.784706+0000","last_active":"2023-11-29T11:17:39.788847+0000","last_peered":"2023-11-29T11:17:39.788847+0000","last_clean":"2023-11-29T11:17:39.788847+0000","last_became_active":"2023-11-29T11:17:39.784383+0000","last_became_peered":"2023-11-29T11:17:39.784383+0000","last_unstale":"2023-11-29T11:17:39.788847+0000","last_undegraded":"2023-11-29T11:17:39.788847+0000","last_fullsized":"2023-11-29T11:17:39.788847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:33:39.501948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.757116+0000","last_change":"2023-11-29T11:17:39.400307+0000","last_active":"2023-11-29T11:17:39.757116+0000","last_peered":"2023-11-29T11:17:39.757116+0000","last_clean":"2023-11-29T11:17:39.757116+0000","last_became_active":"2023-11-29T11:17:39.400044+0000","last_became_peered":"2023-11-29T11:17:39.400044+0000","last_unstale":"2023-11-29T11:17:39.757116+0000","last_undegraded":"2023-11-29T11:17:39.757116+0000","last_fullsized":"2023-11-29T11:17:39.757116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:15.769433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.406003+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:17:39.406003+0000","last_peered":"2023-11-29T11:17:39.406003+0000","last_clean":"2023-11-29T11:17:39.406003+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:17:39.406003+0000","last_undegraded":"2023-11-29T11:17:39.406003+0000","last_fullsized":"2023-11-29T11:17:39.406003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785183+0000","last_change":"2023-11-29T11:17:39.770504+0000","last_active":"2023-11-29T11:17:39.785183+0000","last_peered":"2023-11-29T11:17:39.785183+0000","last_clean":"2023-11-29T11:17:39.785183+0000","last_became_active":"2023-11-29T11:17:39.770077+0000","last_became_peered":"2023-11-29T11:17:39.770077+0000","last_unstale":"2023-11-29T11:17:39.785183+0000","last_undegraded":"2023-11-29T11:17:39.785183+0000","last_fullsized":"2023-11-29T11:17:39.785183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:06:15.417237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.766126+0000","last_change":"2023-11-29T11:17:39.406593+0000","last_active":"2023-11-29T11:17:39.766126+0000","last_peered":"2023-11-29T11:17:39.766126+0000","last_clean":"2023-11-29T11:17:39.766126+0000","last_became_active":"2023-11-29T11:17:39.406277+0000","last_became_peered":"2023-11-29T11:17:39.406277+0000","last_unstale":"2023-11-29T11:17:39.766126+0000","last_undegraded":"2023-11-29T11:17:39.766126+0000","last_fullsized":"2023-11-29T11:17:39.766126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:58:10.280096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":66,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.382630+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:17:39.382630+0000","last_peered":"2023-11-29T11:17:39.382630+0000","last_clean":"2023-11-29T11:17:39.382630+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:17:39.382630+0000","last_undegraded":"2023-11-29T11:17:39.382630+0000","last_fullsized":"2023-11-29T11:17:39.382630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781401+0000","last_change":"2023-11-29T11:17:39.774588+0000","last_active":"2023-11-29T11:17:39.781401+0000","last_peered":"2023-11-29T11:17:39.781401+0000","last_clean":"2023-11-29T11:17:39.781401+0000","last_became_active":"2023-11-29T11:17:39.772482+0000","last_became_peered":"2023-11-29T11:17:39.772482+0000","last_unstale":"2023-11-29T11:17:39.781401+0000","last_undegraded":"2023-11-29T11:17:39.781401+0000","last_fullsized":"2023-11-29T11:17:39.781401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:56:12.720288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788995+0000","last_change":"2023-11-29T11:17:39.413919+0000","last_active":"2023-11-29T11:17:39.788995+0000","last_peered":"2023-11-29T11:17:39.788995+0000","last_clean":"2023-11-29T11:17:39.788995+0000","last_became_active":"2023-11-29T11:17:39.413651+0000","last_became_peered":"2023-11-29T11:17:39.413651+0000","last_unstale":"2023-11-29T11:17:39.788995+0000","last_undegraded":"2023-11-29T11:17:39.788995+0000","last_fullsized":"2023-11-29T11:17:39.788995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:53:58.065875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.391130+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:17:39.391130+0000","last_peered":"2023-11-29T11:17:39.391130+0000","last_clean":"2023-11-29T11:17:39.391130+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:17:39.391130+0000","last_undegraded":"2023-11-29T11:17:39.391130+0000","last_fullsized":"2023-11-29T11:17:39.391130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":67,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.403977+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:17:39.403977+0000","last_peered":"2023-11-29T11:17:39.403977+0000","last_clean":"2023-11-29T11:17:39.403977+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:17:39.403977+0000","last_undegraded":"2023-11-29T11:17:39.403977+0000","last_fullsized":"2023-11-29T11:17:39.403977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.775723+0000","last_change":"2023-11-29T11:17:39.772837+0000","last_active":"2023-11-29T11:17:39.775723+0000","last_peered":"2023-11-29T11:17:39.775723+0000","last_clean":"2023-11-29T11:17:39.775723+0000","last_became_active":"2023-11-29T11:17:39.772583+0000","last_became_peered":"2023-11-29T11:17:39.772583+0000","last_unstale":"2023-11-29T11:17:39.775723+0000","last_undegraded":"2023-11-29T11:17:39.775723+0000","last_fullsized":"2023-11-29T11:17:39.775723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:16.773805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.778967+0000","last_change":"2023-11-29T11:17:39.405327+0000","last_active":"2023-11-29T11:17:39.778967+0000","last_peered":"2023-11-29T11:17:39.778967+0000","last_clean":"2023-11-29T11:17:39.778967+0000","last_became_active":"2023-11-29T11:17:39.404943+0000","last_became_peered":"2023-11-29T11:17:39.404943+0000","last_unstale":"2023-11-29T11:17:39.778967+0000","last_undegraded":"2023-11-29T11:17:39.778967+0000","last_fullsized":"2023-11-29T11:17:39.778967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:07:23.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.391001+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:17:39.391001+0000","last_peered":"2023-11-29T11:17:39.391001+0000","last_clean":"2023-11-29T11:17:39.391001+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:17:39.391001+0000","last_undegraded":"2023-11-29T11:17:39.391001+0000","last_fullsized":"2023-11-29T11:17:39.391001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.783674+0000","last_change":"2023-11-29T11:17:39.776691+0000","last_active":"2023-11-29T11:17:39.783674+0000","last_peered":"2023-11-29T11:17:39.783674+0000","last_clean":"2023-11-29T11:17:39.783674+0000","last_became_active":"2023-11-29T11:17:39.776246+0000","last_became_peered":"2023-11-29T11:17:39.776246+0000","last_unstale":"2023-11-29T11:17:39.783674+0000","last_undegraded":"2023-11-29T11:17:39.783674+0000","last_fullsized":"2023-11-29T11:17:39.783674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:40:15.611181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.775652+0000","last_change":"2023-11-29T11:17:39.405705+0000","last_active":"2023-11-29T11:17:39.775652+0000","last_peered":"2023-11-29T11:17:39.775652+0000","last_clean":"2023-11-29T11:17:39.775652+0000","last_became_active":"2023-11-29T11:17:39.405439+0000","last_became_peered":"2023-11-29T11:17:39.405439+0000","last_unstale":"2023-11-29T11:17:39.775652+0000","last_undegraded":"2023-11-29T11:17:39.775652+0000","last_fullsized":"2023-11-29T11:17:39.775652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:11:02.989640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.394229+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:17:39.394229+0000","last_peered":"2023-11-29T11:17:39.394229+0000","last_clean":"2023-11-29T11:17:39.394229+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:17:39.394229+0000","last_undegraded":"2023-11-29T11:17:39.394229+0000","last_fullsized":"2023-11-29T11:17:39.394229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.769591+0000","last_change":"2023-11-29T11:17:39.764575+0000","last_active":"2023-11-29T11:17:39.769591+0000","last_peered":"2023-11-29T11:17:39.769591+0000","last_clean":"2023-11-29T11:17:39.769591+0000","last_became_active":"2023-11-29T11:17:39.764232+0000","last_became_peered":"2023-11-29T11:17:39.764232+0000","last_unstale":"2023-11-29T11:17:39.769591+0000","last_undegraded":"2023-11-29T11:17:39.769591+0000","last_fullsized":"2023-11-29T11:17:39.769591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:57:31.624870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780287+0000","last_change":"2023-11-29T11:17:39.411328+0000","last_active":"2023-11-29T11:17:39.780287+0000","last_peered":"2023-11-29T11:17:39.780287+0000","last_clean":"2023-11-29T11:17:39.780287+0000","last_became_active":"2023-11-29T11:17:39.410970+0000","last_became_peered":"2023-11-29T11:17:39.410970+0000","last_unstale":"2023-11-29T11:17:39.780287+0000","last_undegraded":"2023-11-29T11:17:39.780287+0000","last_fullsized":"2023-11-29T11:17:39.780287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:51:12.859985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.391010+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:17:39.391010+0000","last_peered":"2023-11-29T11:17:39.391010+0000","last_clean":"2023-11-29T11:17:39.391010+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:17:39.391010+0000","last_undegraded":"2023-11-29T11:17:39.391010+0000","last_fullsized":"2023-11-29T11:17:39.391010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542205,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11256,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":9728,"kb_avail":94360584,"statfs":{"total":96636764160,"available":96625238016,"internally_reserved":0,"allocated":1556480,"data_stored":1044918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9961472},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.88200000000000001,"15min":0.90400000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.206,"5min":1.371,"15min":1.371},"last":1.143},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.82099999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2170000000000001,"5min":1.327,"15min":1.327},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92000000000000004,"15min":0.91400000000000003},"min":{"1min":0.57299999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.224,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.88700000000000001,"15min":0.90600000000000003},"min":{"1min":0.63100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0700000000000001,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.99299999999999999,"15min":1.018},"min":{"1min":0.82599999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3979999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94099999999999995,"15min":0.97599999999999998},"min":{"1min":0.68200000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1319999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.93500000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.93000000000000005,"15min":0.96599999999999997},"min":{"1min":0.53500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2729999999999999,"5min":1.641,"15min":1.641},"last":1.206},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.65900000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3140000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.97799999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91500000000000004,"15min":0.97699999999999998},"min":{"1min":0.59399999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.004},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0369999999999999,"15min":1.0780000000000001},"min":{"1min":0.63500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.393,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.252}]},{"osd":5,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.044,"15min":1.1160000000000001},"min":{"1min":0.66100000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.45,"5min":2.403,"15min":2.403},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.006,"5min":1.069,"15min":1.131},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4159999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.1679999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.097,"15min":1.169},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.1439999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.157,"15min":1.196},"min":{"1min":0.84399999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.371,"5min":1.77,"15min":1.77},"last":1.2889999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542206,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14412,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":13440,"kb_avail":94357428,"statfs":{"total":96636764160,"available":96622006272,"internally_reserved":0,"allocated":987136,"data_stored":462676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13762560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80100000000000005,"15min":0.82399999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.81299999999999994,"15min":0.80400000000000005},"min":{"1min":0.54100000000000004,"5min":0.375,"15min":0.375},"max":{"1min":1.224,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.59699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1910000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.115},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.93799999999999994},"min":{"1min":0.64700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4099999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.747},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.91600000000000004,"15min":0.90100000000000002},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.21,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.63300000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.149,"5min":1.625,"15min":1.625},"last":0.872},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.93500000000000005,"15min":0.93200000000000005},"min":{"1min":0.68300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.321,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.96499999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.92000000000000004,"15min":0.92500000000000004},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.133,"5min":1.714,"15min":1.714},"last":1.038},{"interface":"front","average":{"1min":1.006,"5min":0.98999999999999999,"15min":0.97799999999999998},"min":{"1min":0.71999999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3200000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.70799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.075,"15min":1.069},"min":{"1min":0.91500000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.286,"5min":1.593,"15min":1.593},"last":0.94099999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0660000000000001,"15min":1.083},"min":{"1min":0.71299999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.071,"15min":1.081},"min":{"1min":0.878,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0149999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542205,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14288,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357552,"statfs":{"total":96636764160,"available":96622133248,"internally_reserved":0,"allocated":991232,"data_stored":463568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1359999999999999,"5min":1.242,"15min":1.242},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.879,"15min":0.88500000000000001},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1240000000000001,"5min":1.52,"15min":1.52},"last":0.66100000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.64800000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.117,"5min":1.512,"15min":1.512},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.86199999999999999,"15min":0.88700000000000001},"min":{"1min":0.56799999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.165,"5min":1.377,"15min":1.377},"last":0.97399999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.873,"15min":0.879},"min":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0449999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94399999999999995,"15min":0.95399999999999996},"min":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.093,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.083}]},{"osd":3,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.61299999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1359999999999999,"5min":1.335,"15min":1.335},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.038,"15min":1.018},"min":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2070000000000001,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.61899999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1060000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0289999999999999,"15min":1.0680000000000001},"min":{"1min":0.66300000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3520000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0369999999999999,"15min":1.0600000000000001},"min":{"1min":0.66600000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.276,"5min":1.585,"15min":1.585},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.0329999999999999,"15min":1.05},"min":{"1min":0.81899999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.381,"5min":1.575,"15min":1.575},"last":1.0680000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.101,"15min":1.097},"min":{"1min":0.78900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.236,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.119},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1739999999999999,"15min":1.1990000000000001},"min":{"1min":0.99299999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.413,"5min":1.889,"15min":1.889},"last":1.163}]}]},{"osd":4,"up_from":14,"seq":60129542205,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10432,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94361408,"statfs":{"total":96636764160,"available":96626081792,"internally_reserved":0,"allocated":974848,"data_stored":461998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.88300000000000001,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.095,"5min":1.431,"15min":1.431},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.61799999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.107,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.95999999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.88900000000000001,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.179,"5min":1.458,"15min":1.458},"last":1.004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.879,"15min":0.877},"min":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.123,"5min":1.401,"15min":1.401},"last":1.103}]},{"osd":2,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94899999999999995,"15min":0.97999999999999998},"min":{"1min":0.64300000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.264,"5min":1.343,"15min":1.343},"last":0.91400000000000003}]},{"osd":3,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.67400000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.0349999999999999,"5min":1.294,"15min":1.294},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98499999999999999,"15min":1.0209999999999999},"min":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.171,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.218}]},{"osd":5,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93500000000000005,"15min":0.92700000000000005},"min":{"1min":0.751,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2210000000000001,"5min":1.492,"15min":1.492},"last":1.246},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96799999999999997},"min":{"1min":0.70099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.266,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.296}]},{"osd":6,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.996,"15min":1.0149999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2969999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.155},{"interface":"front","average":{"1min":1.075,"5min":1.0920000000000001,"15min":1.109},"min":{"1min":0.81000000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.367,"5min":1.542,"15min":1.542},"last":1.333}]},{"osd":7,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.179},{"interface":"front","average":{"1min":1.119,"5min":1.1459999999999999,"15min":1.171},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4299999999999999,"5min":1.905,"15min":1.905},"last":1.2749999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361612,"statfs":{"total":96636764160,"available":96626290688,"internally_reserved":0,"allocated":962560,"data_stored":454550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.68100000000000005,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":6.3840000000000003,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.39200000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.93200000000000005,"5min":1.282,"15min":1.282},"last":0.90600000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":0.84299999999999997,"15min":0.67700000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":19.015999999999998,"5min":19.015999999999998,"15min":19.015999999999998},"last":1.111},{"interface":"front","average":{"1min":0.998,"5min":0.77900000000000003,"15min":0.74199999999999999},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":6.3540000000000001,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.3899999999999999,"5min":1.494,"15min":1.494},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.845,"5min":0.94499999999999995,"15min":0.77700000000000002},"min":{"1min":0.42999999999999999,"5min":0.374,"15min":0.374},"max":{"1min":23.466000000000001,"5min":23.466000000000001,"15min":23.466000000000001},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.115,"15min":1.034},"min":{"1min":0.67800000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":15.255000000000001,"5min":15.255000000000001,"15min":15.255000000000001},"last":1.04},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.1639999999999999,"15min":1.038},"min":{"1min":0.63600000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":23.792999999999999,"5min":23.792999999999999,"15min":23.792999999999999},"last":1.5209999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.1779999999999999,"15min":1.02},"min":{"1min":0.73699999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":23.751000000000001,"5min":23.751000000000001,"15min":23.751000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":7.0110000000000001,"5min":7.0110000000000001,"15min":7.0110000000000001},"last":1.0860000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":1.171,"15min":1.0569999999999999},"min":{"1min":0.72399999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":15.292999999999999,"5min":15.292999999999999,"15min":15.292999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":2.1549999999999998,"5min":1.319,"15min":1.1339999999999999},"min":{"1min":0.71999999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":23.428999999999998,"5min":23.428999999999998,"15min":23.428999999999998},"last":1.276}]},{"osd":7,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.167,"15min":1.1559999999999999},"min":{"1min":0.79400000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":6.4199999999999999,"5min":6.4199999999999999,"15min":6.4199999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.2230000000000001,"15min":1.0900000000000001},"min":{"1min":0.63900000000000001,"5min":0.437,"15min":0.437},"max":{"1min":15.428000000000001,"5min":15.428000000000001,"15min":15.428000000000001},"last":1.2410000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10100,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361740,"statfs":{"total":96636764160,"available":96626421760,"internally_reserved":0,"allocated":962560,"data_stored":454550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86699999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.39600000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.99399999999999999,"5min":1.107,"15min":1.107},"last":0.41699999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66100000000000003,"15min":0.66000000000000003},"min":{"1min":0.502,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.026,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.095},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.012,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.67300000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.93400000000000005,"15min":0.96899999999999997},"min":{"1min":0.70399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.28,"5min":1.371,"15min":1.371},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94399999999999995,"15min":0.97399999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3100000000000001,"5min":1.532,"15min":1.532},"last":0.876}]},{"osd":5,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.68100000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.23,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98299999999999998,"15min":1.0109999999999999},"min":{"1min":0.64600000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.1830000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97999999999999998,"15min":1},"min":{"1min":0.748,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.016,"15min":1.052},"min":{"1min":0.751,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1890000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.036}]},{"osd":7,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0489999999999999,"15min":1.056},"min":{"1min":0.89700000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.569,"5min":1.76,"15min":1.76},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.84099999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.24,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.91200000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15504,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":13952,"kb_avail":94356336,"statfs":{"total":96636764160,"available":96620888064,"internally_reserved":0,"allocated":1581056,"data_stored":1052560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14286848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.96899999999999997,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.47999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.70299999999999996},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98699999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.56299999999999994,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.393,"15min":1.393},"last":0.72499999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0089999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.496,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94699999999999995,"5min":1.744,"15min":1.744},"last":0.56999999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95899999999999996,"15min":0.96399999999999997},"min":{"1min":0.66900000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3879999999999999,"5min":1.609,"15min":1.609},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0149999999999999,"15min":1.0349999999999999},"min":{"1min":0.83599999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2889999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.85699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.2869999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.01,"15min":1.016},"min":{"1min":0.88600000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.339,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.056,"15min":1.0920000000000001},"min":{"1min":0.77100000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.355,"5min":1.575,"15min":1.575},"last":1.024},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98899999999999999,"15min":0.997},"min":{"1min":0.70099999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3560000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.92100000000000004}]},{"osd":7,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.044,"15min":1.073},"min":{"1min":0.79100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.444,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.0960000000000001,"15min":1.1200000000000001},"min":{"1min":0.86699999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3720000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.97699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10432,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94361408,"statfs":{"total":96636764160,"available":96626081792,"internally_reserved":0,"allocated":974848,"data_stored":461046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.997,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83099999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68500000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70299999999999996,"15min":0.73299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85399999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0389999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.877,"15min":0.875},"min":{"1min":0.73199999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.0640000000000001,"5min":1.423,"15min":1.423},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.97099999999999997,"15min":1.0049999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.254,"5min":1.399,"15min":1.399},"last":0.97999999999999998}]},{"osd":5,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0069999999999999,"15min":1.0209999999999999},"min":{"1min":0.78600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.006},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1899999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1419999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.052,"15min":1.0880000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4239999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.085,"15min":1.1259999999999999},"min":{"1min":0.63700000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.3779999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.099,"15min":1.1419999999999999},"min":{"1min":0.67600000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.361,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0609999999999999,"15min":1.0820000000000001},"min":{"1min":0.76100000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.349,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.0640000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:17:43.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:17:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.516+0000 7f0082517700 1 Processor -- start 2023-11-29T11:17:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.516+0000 7f0082517700 1 -- start start 2023-11-29T11:17:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f007c0b3720 0x7f007c06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007c0cbe00 con 0x7f007c1584c0 2023-11-29T11:17:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007c0cd0f0 con 0x7f007c0b32e0 2023-11-29T11:17:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c06dbd0 con 0x7f007c0b3720 2023-11-29T11:17:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0081d16700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f007c0b3720 0x7f007c06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0081515700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f007c1584c0 0x7f007c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53992/0 (socket says 172.21.15.81:53992) 2023-11-29T11:17:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0081515700 1 -- 172.21.15.81:0/4201301774 learned_addr learned my addr 172.21.15.81:0/4201301774 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0081d16700 1 -- 172.21.15.81:0/4201301774 >> v1:172.21.15.176:6789/0 conn(0x7f007c0b32e0 legacy=0x7f007c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0081d16700 1 -- 172.21.15.81:0/4201301774 >> v1:172.21.15.81:6789/0 conn(0x7f007c1584c0 legacy=0x7f007c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0073fff700 1 -- 172.21.15.81:0/4201301774 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067213462 0 0) 0x7f007c0cbe00 con 0x7f007c1584c0 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0081d16700 1 -- 172.21.15.81:0/4201301774 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c0cd3d0 con 0x7f007c0b3720 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0081d16700 1 --2- 172.21.15.81:0/4201301774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c06a3e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0074009d90 tx=0x7f007400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460e4d4791af3ba0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0073fff700 1 -- 172.21.15.81:0/4201301774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400e070 con 0x7f007c0b3720 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0073fff700 1 -- 172.21.15.81:0/4201301774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400bbd0 con 0x7f007c0b3720 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0073fff700 1 -- 172.21.15.81:0/4201301774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074012430 con 0x7f007c0b3720 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 -- 172.21.15.81:0/4201301774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 msgr2=0x7f007c06a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 --2- 172.21.15.81:0/4201301774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c06a3e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0074009d90 tx=0x7f007400b330 comp rx=0 tx=0).stop 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 -- 172.21.15.81:0/4201301774 shutdown_connections 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 --2- 172.21.15.81:0/4201301774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c06a3e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 -- 172.21.15.81:0/4201301774 >> 172.21.15.81:0/4201301774 conn(0x7f007c0ce3e0 msgr2=0x7f007c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 -- 172.21.15.81:0/4201301774 shutdown_connections 2023-11-29T11:17:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.520+0000 7f0082517700 1 -- 172.21.15.81:0/4201301774 wait complete. 2023-11-29T11:17:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 Processor -- start 2023-11-29T11:17:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 -- start start 2023-11-29T11:17:43.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f007c0b32e0 0x7f007c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c0c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007c1584c0 0x7f007c1eec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c156720 con 0x7f007c0b3720 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c1ef1b0 con 0x7f007c0b32e0 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0c2190 con 0x7f007c1584c0 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c0c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c0c1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48438/0 (socket says 172.21.15.81:48438) 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 -- 172.21.15.81:0/1105032396 learned_addr learned my addr 172.21.15.81:0/1105032396 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0081515700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f007c0b32e0 0x7f007c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0081d16700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007c1584c0 0x7f007c1eec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 -- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007c1584c0 msgr2=0x7f007c1eec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007c1584c0 0x7f007c1eec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 -- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f007c0b32e0 msgr2=0x7f007c0b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f007c0b32e0 0x7f007c0b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 -- 172.21.15.81:0/1105032396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074009a70 con 0x7f007c0b3720 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0081d16700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007c1584c0 0x7f007c1eec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0081515700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f007c0b32e0 0x7f007c0b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0080d14700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c0c1a90 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f007800c500 tx=0x7f007800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0071ffb700 1 -- 172.21.15.81:0/1105032396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780052d0 con 0x7f007c0b3720 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0071ffb700 1 -- 172.21.15.81:0/1105032396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078005430 con 0x7f007c0b3720 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c0cd990 con 0x7f007c0b3720 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0071ffb700 1 -- 172.21.15.81:0/1105032396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780055a0 con 0x7f007c0b3720 2023-11-29T11:17:43.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.524+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c0cd6b0 con 0x7f007c0b3720 2023-11-29T11:17:43.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.528+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c0cdc70 con 0x7f007c0b3720 2023-11-29T11:17:43.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.528+0000 7f0071ffb700 1 -- 172.21.15.81:0/1105032396 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0078019030 con 0x7f007c0b3720 2023-11-29T11:17:43.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.528+0000 7f0071ffb700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0060064ee0 0x7f0060067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.528+0000 7f0081515700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0060064ee0 0x7f0060067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.528+0000 7f0071ffb700 1 -- 172.21.15.81:0/1105032396 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f00780814a0 con 0x7f007c0b3720 2023-11-29T11:17:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.528+0000 7f0081515700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0060064ee0 0x7f0060067390 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f006c000f60 tx=0x7f006c007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.536+0000 7f0071ffb700 1 -- 172.21.15.81:0/1105032396 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f007804f3f0 con 0x7f007c0b3720 2023-11-29T11:17:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.692+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f007c072500 con 0x7f0060064ee0 2023-11-29T11:17:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.708+0000 7f0071ffb700 1 -- 172.21.15.81:0/1105032396 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310118 (secure 0 0 0) 0x7f007c072500 con 0x7f0060064ee0 2023-11-29T11:17:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0060064ee0 msgr2=0x7f0060067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0060064ee0 0x7f0060067390 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f006c000f60 tx=0x7f006c007e90 comp rx=0 tx=0).stop 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 msgr2=0x7f007c0c1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c0c1a90 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f007800c500 tx=0x7f007800c8c0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 shutdown_connections 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0060064ee0 0x7f0060067390 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007c1584c0 0x7f007c1eec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c0b3720 0x7f007c0c1a90 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 --2- 172.21.15.81:0/1105032396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f007c0b32e0 0x7f007c0b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 >> 172.21.15.81:0/1105032396 conn(0x7f007c0ce3e0 msgr2=0x7f007c069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:43.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 shutdown_connections 2023-11-29T11:17:43.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.712+0000 7f0082517700 1 -- 172.21.15.81:0/1105032396 wait complete. 2023-11-29T11:17:43.724 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:17:43.734 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2023-11-29T11:17:43.420147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":96652,"kb_used_data":8780,"kb_used_omap":0,"kb_used_meta":87808,"kb_avail":754878068,"statfs":{"total":773094113280,"available":772995141632,"internally_reserved":0,"allocated":8990720,"data_stored":4855866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":89915392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.036662"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781421+0000","last_change":"2023-11-29T11:17:39.776173+0000","last_active":"2023-11-29T11:17:39.781421+0000","last_peered":"2023-11-29T11:17:39.781421+0000","last_clean":"2023-11-29T11:17:39.781421+0000","last_became_active":"2023-11-29T11:17:39.775779+0000","last_became_peered":"2023-11-29T11:17:39.775779+0000","last_unstale":"2023-11-29T11:17:39.781421+0000","last_undegraded":"2023-11-29T11:17:39.781421+0000","last_fullsized":"2023-11-29T11:17:39.781421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:29:38.733531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786218+0000","last_change":"2023-11-29T11:17:39.777197+0000","last_active":"2023-11-29T11:17:39.786218+0000","last_peered":"2023-11-29T11:17:39.786218+0000","last_clean":"2023-11-29T11:17:39.786218+0000","last_became_active":"2023-11-29T11:17:39.776829+0000","last_became_peered":"2023-11-29T11:17:39.776829+0000","last_unstale":"2023-11-29T11:17:39.786218+0000","last_undegraded":"2023-11-29T11:17:39.786218+0000","last_fullsized":"2023-11-29T11:17:39.786218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:04:16.989996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785055+0000","last_change":"2023-11-29T11:17:39.778457+0000","last_active":"2023-11-29T11:17:39.785055+0000","last_peered":"2023-11-29T11:17:39.785055+0000","last_clean":"2023-11-29T11:17:39.785055+0000","last_became_active":"2023-11-29T11:17:39.778181+0000","last_became_peered":"2023-11-29T11:17:39.778181+0000","last_unstale":"2023-11-29T11:17:39.785055+0000","last_undegraded":"2023-11-29T11:17:39.785055+0000","last_fullsized":"2023-11-29T11:17:39.785055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:40:49.985751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.784332+0000","last_change":"2023-11-29T11:17:39.770428+0000","last_active":"2023-11-29T11:17:39.784332+0000","last_peered":"2023-11-29T11:17:39.784332+0000","last_clean":"2023-11-29T11:17:39.784332+0000","last_became_active":"2023-11-29T11:17:39.770106+0000","last_became_peered":"2023-11-29T11:17:39.770106+0000","last_unstale":"2023-11-29T11:17:39.784332+0000","last_undegraded":"2023-11-29T11:17:39.784332+0000","last_fullsized":"2023-11-29T11:17:39.784332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:21:40.157140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.783756+0000","last_change":"2023-11-29T11:17:39.777707+0000","last_active":"2023-11-29T11:17:39.783756+0000","last_peered":"2023-11-29T11:17:39.783756+0000","last_clean":"2023-11-29T11:17:39.783756+0000","last_became_active":"2023-11-29T11:17:39.777301+0000","last_became_peered":"2023-11-29T11:17:39.777301+0000","last_unstale":"2023-11-29T11:17:39.783756+0000","last_undegraded":"2023-11-29T11:17:39.783756+0000","last_fullsized":"2023-11-29T11:17:39.783756+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:34:26.033001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.778696+0000","last_change":"2023-11-29T11:17:39.770827+0000","last_active":"2023-11-29T11:17:39.778696+0000","last_peered":"2023-11-29T11:17:39.778696+0000","last_clean":"2023-11-29T11:17:39.778696+0000","last_became_active":"2023-11-29T11:17:39.770363+0000","last_became_peered":"2023-11-29T11:17:39.770363+0000","last_unstale":"2023-11-29T11:17:39.778696+0000","last_undegraded":"2023-11-29T11:17:39.778696+0000","last_fullsized":"2023-11-29T11:17:39.778696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:39:49.630097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.784793+0000","last_change":"2023-11-29T11:17:39.778221+0000","last_active":"2023-11-29T11:17:39.784793+0000","last_peered":"2023-11-29T11:17:39.784793+0000","last_clean":"2023-11-29T11:17:39.784793+0000","last_became_active":"2023-11-29T11:17:39.777960+0000","last_became_peered":"2023-11-29T11:17:39.777960+0000","last_unstale":"2023-11-29T11:17:39.784793+0000","last_undegraded":"2023-11-29T11:17:39.784793+0000","last_fullsized":"2023-11-29T11:17:39.784793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:17:32.927327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777683+0000","last_change":"2023-11-29T11:17:39.768573+0000","last_active":"2023-11-29T11:17:39.777683+0000","last_peered":"2023-11-29T11:17:39.777683+0000","last_clean":"2023-11-29T11:17:39.777683+0000","last_became_active":"2023-11-29T11:17:39.768292+0000","last_became_peered":"2023-11-29T11:17:39.768292+0000","last_unstale":"2023-11-29T11:17:39.777683+0000","last_undegraded":"2023-11-29T11:17:39.777683+0000","last_fullsized":"2023-11-29T11:17:39.777683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:54:48.120723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788855+0000","last_change":"2023-11-29T11:17:39.784712+0000","last_active":"2023-11-29T11:17:39.788855+0000","last_peered":"2023-11-29T11:17:39.788855+0000","last_clean":"2023-11-29T11:17:39.788855+0000","last_became_active":"2023-11-29T11:17:39.784090+0000","last_became_peered":"2023-11-29T11:17:39.784090+0000","last_unstale":"2023-11-29T11:17:39.788855+0000","last_undegraded":"2023-11-29T11:17:39.788855+0000","last_fullsized":"2023-11-29T11:17:39.788855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:49.324687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781178+0000","last_change":"2023-11-29T11:17:39.775687+0000","last_active":"2023-11-29T11:17:39.781178+0000","last_peered":"2023-11-29T11:17:39.781178+0000","last_clean":"2023-11-29T11:17:39.781178+0000","last_became_active":"2023-11-29T11:17:39.772616+0000","last_became_peered":"2023-11-29T11:17:39.772616+0000","last_unstale":"2023-11-29T11:17:39.781178+0000","last_undegraded":"2023-11-29T11:17:39.781178+0000","last_fullsized":"2023-11-29T11:17:39.781178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:20:07.940670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.773458+0000","last_change":"2023-11-29T11:17:39.767568+0000","last_active":"2023-11-29T11:17:39.773458+0000","last_peered":"2023-11-29T11:17:39.773458+0000","last_clean":"2023-11-29T11:17:39.773458+0000","last_became_active":"2023-11-29T11:17:39.767131+0000","last_became_peered":"2023-11-29T11:17:39.767131+0000","last_unstale":"2023-11-29T11:17:39.773458+0000","last_undegraded":"2023-11-29T11:17:39.773458+0000","last_fullsized":"2023-11-29T11:17:39.773458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:06:14.821438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781088+0000","last_change":"2023-11-29T11:17:39.775476+0000","last_active":"2023-11-29T11:17:39.781088+0000","last_peered":"2023-11-29T11:17:39.781088+0000","last_clean":"2023-11-29T11:17:39.781088+0000","last_became_active":"2023-11-29T11:17:39.775251+0000","last_became_peered":"2023-11-29T11:17:39.775251+0000","last_unstale":"2023-11-29T11:17:39.781088+0000","last_undegraded":"2023-11-29T11:17:39.781088+0000","last_fullsized":"2023-11-29T11:17:39.781088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:12:30.534499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785004+0000","last_change":"2023-11-29T11:17:39.777139+0000","last_active":"2023-11-29T11:17:39.785004+0000","last_peered":"2023-11-29T11:17:39.785004+0000","last_clean":"2023-11-29T11:17:39.785004+0000","last_became_active":"2023-11-29T11:17:39.776852+0000","last_became_peered":"2023-11-29T11:17:39.776852+0000","last_unstale":"2023-11-29T11:17:39.785004+0000","last_undegraded":"2023-11-29T11:17:39.785004+0000","last_fullsized":"2023-11-29T11:17:39.785004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:11:03.994013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.784428+0000","last_change":"2023-11-29T11:17:39.770213+0000","last_active":"2023-11-29T11:17:39.784428+0000","last_peered":"2023-11-29T11:17:39.784428+0000","last_clean":"2023-11-29T11:17:39.784428+0000","last_became_active":"2023-11-29T11:17:39.769793+0000","last_became_peered":"2023-11-29T11:17:39.769793+0000","last_unstale":"2023-11-29T11:17:39.784428+0000","last_undegraded":"2023-11-29T11:17:39.784428+0000","last_fullsized":"2023-11-29T11:17:39.784428+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:09:30.288533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.773469+0000","last_change":"2023-11-29T11:17:39.772538+0000","last_active":"2023-11-29T11:17:39.773469+0000","last_peered":"2023-11-29T11:17:39.773469+0000","last_clean":"2023-11-29T11:17:39.773469+0000","last_became_active":"2023-11-29T11:17:39.772292+0000","last_became_peered":"2023-11-29T11:17:39.772292+0000","last_unstale":"2023-11-29T11:17:39.773469+0000","last_undegraded":"2023-11-29T11:17:39.773469+0000","last_fullsized":"2023-11-29T11:17:39.773469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:55:18.812667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786908+0000","last_change":"2023-11-29T11:17:39.781420+0000","last_active":"2023-11-29T11:17:39.786908+0000","last_peered":"2023-11-29T11:17:39.786908+0000","last_clean":"2023-11-29T11:17:39.786908+0000","last_became_active":"2023-11-29T11:17:39.781144+0000","last_became_peered":"2023-11-29T11:17:39.781144+0000","last_unstale":"2023-11-29T11:17:39.786908+0000","last_undegraded":"2023-11-29T11:17:39.786908+0000","last_fullsized":"2023-11-29T11:17:39.786908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:33:46.629424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789000+0000","last_change":"2023-11-29T11:17:39.785396+0000","last_active":"2023-11-29T11:17:39.789000+0000","last_peered":"2023-11-29T11:17:39.789000+0000","last_clean":"2023-11-29T11:17:39.789000+0000","last_became_active":"2023-11-29T11:17:39.785097+0000","last_became_peered":"2023-11-29T11:17:39.785097+0000","last_unstale":"2023-11-29T11:17:39.789000+0000","last_undegraded":"2023-11-29T11:17:39.789000+0000","last_fullsized":"2023-11-29T11:17:39.789000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:08:56.588850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785064+0000","last_change":"2023-11-29T11:17:39.781579+0000","last_active":"2023-11-29T11:17:39.785064+0000","last_peered":"2023-11-29T11:17:39.785064+0000","last_clean":"2023-11-29T11:17:39.785064+0000","last_became_active":"2023-11-29T11:17:39.781310+0000","last_became_peered":"2023-11-29T11:17:39.781310+0000","last_unstale":"2023-11-29T11:17:39.785064+0000","last_undegraded":"2023-11-29T11:17:39.785064+0000","last_fullsized":"2023-11-29T11:17:39.785064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:47:03.010466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.790422+0000","last_change":"2023-11-29T11:17:39.784136+0000","last_active":"2023-11-29T11:17:39.790422+0000","last_peered":"2023-11-29T11:17:39.790422+0000","last_clean":"2023-11-29T11:17:39.790422+0000","last_became_active":"2023-11-29T11:17:39.783871+0000","last_became_peered":"2023-11-29T11:17:39.783871+0000","last_unstale":"2023-11-29T11:17:39.790422+0000","last_undegraded":"2023-11-29T11:17:39.790422+0000","last_fullsized":"2023-11-29T11:17:39.790422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:37:37.723095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785033+0000","last_change":"2023-11-29T11:17:39.781250+0000","last_active":"2023-11-29T11:17:39.785033+0000","last_peered":"2023-11-29T11:17:39.785033+0000","last_clean":"2023-11-29T11:17:39.785033+0000","last_became_active":"2023-11-29T11:17:39.780968+0000","last_became_peered":"2023-11-29T11:17:39.780968+0000","last_unstale":"2023-11-29T11:17:39.785033+0000","last_undegraded":"2023-11-29T11:17:39.785033+0000","last_fullsized":"2023-11-29T11:17:39.785033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:16:37.479571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.787520+0000","last_change":"2023-11-29T11:17:39.784932+0000","last_active":"2023-11-29T11:17:39.787520+0000","last_peered":"2023-11-29T11:17:39.787520+0000","last_clean":"2023-11-29T11:17:39.787520+0000","last_became_active":"2023-11-29T11:17:39.784487+0000","last_became_peered":"2023-11-29T11:17:39.784487+0000","last_unstale":"2023-11-29T11:17:39.787520+0000","last_undegraded":"2023-11-29T11:17:39.787520+0000","last_fullsized":"2023-11-29T11:17:39.787520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:26:26.681066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788105+0000","last_change":"2023-11-29T11:17:39.786218+0000","last_active":"2023-11-29T11:17:39.788105+0000","last_peered":"2023-11-29T11:17:39.788105+0000","last_clean":"2023-11-29T11:17:39.788105+0000","last_became_active":"2023-11-29T11:17:39.785899+0000","last_became_peered":"2023-11-29T11:17:39.785899+0000","last_unstale":"2023-11-29T11:17:39.788105+0000","last_undegraded":"2023-11-29T11:17:39.788105+0000","last_fullsized":"2023-11-29T11:17:39.788105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:08:06.644032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.783599+0000","last_change":"2023-11-29T11:17:39.777453+0000","last_active":"2023-11-29T11:17:39.783599+0000","last_peered":"2023-11-29T11:17:39.783599+0000","last_clean":"2023-11-29T11:17:39.783599+0000","last_became_active":"2023-11-29T11:17:39.777181+0000","last_became_peered":"2023-11-29T11:17:39.777181+0000","last_unstale":"2023-11-29T11:17:39.783599+0000","last_undegraded":"2023-11-29T11:17:39.783599+0000","last_fullsized":"2023-11-29T11:17:39.783599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:22:09.020854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.787558+0000","last_change":"2023-11-29T11:17:39.785104+0000","last_active":"2023-11-29T11:17:39.787558+0000","last_peered":"2023-11-29T11:17:39.787558+0000","last_clean":"2023-11-29T11:17:39.787558+0000","last_became_active":"2023-11-29T11:17:39.784502+0000","last_became_peered":"2023-11-29T11:17:39.784502+0000","last_unstale":"2023-11-29T11:17:39.787558+0000","last_undegraded":"2023-11-29T11:17:39.787558+0000","last_fullsized":"2023-11-29T11:17:39.787558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:53:27.167335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786132+0000","last_change":"2023-11-29T11:17:39.777350+0000","last_active":"2023-11-29T11:17:39.786132+0000","last_peered":"2023-11-29T11:17:39.786132+0000","last_clean":"2023-11-29T11:17:39.786132+0000","last_became_active":"2023-11-29T11:17:39.776757+0000","last_became_peered":"2023-11-29T11:17:39.776757+0000","last_unstale":"2023-11-29T11:17:39.786132+0000","last_undegraded":"2023-11-29T11:17:39.786132+0000","last_fullsized":"2023-11-29T11:17:39.786132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:20:23.772099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785527+0000","last_change":"2023-11-29T11:17:39.780822+0000","last_active":"2023-11-29T11:17:39.785527+0000","last_peered":"2023-11-29T11:17:39.785527+0000","last_clean":"2023-11-29T11:17:39.785527+0000","last_became_active":"2023-11-29T11:17:39.780568+0000","last_became_peered":"2023-11-29T11:17:39.780568+0000","last_unstale":"2023-11-29T11:17:39.785527+0000","last_undegraded":"2023-11-29T11:17:39.785527+0000","last_fullsized":"2023-11-29T11:17:39.785527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:12:54.398926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780839+0000","last_change":"2023-11-29T11:17:39.774152+0000","last_active":"2023-11-29T11:17:39.780839+0000","last_peered":"2023-11-29T11:17:39.780839+0000","last_clean":"2023-11-29T11:17:39.780839+0000","last_became_active":"2023-11-29T11:17:39.773869+0000","last_became_peered":"2023-11-29T11:17:39.773869+0000","last_unstale":"2023-11-29T11:17:39.780839+0000","last_undegraded":"2023-11-29T11:17:39.780839+0000","last_fullsized":"2023-11-29T11:17:39.780839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:27:50.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781139+0000","last_change":"2023-11-29T11:17:39.776187+0000","last_active":"2023-11-29T11:17:39.781139+0000","last_peered":"2023-11-29T11:17:39.781139+0000","last_clean":"2023-11-29T11:17:39.781139+0000","last_became_active":"2023-11-29T11:17:39.775745+0000","last_became_peered":"2023-11-29T11:17:39.775745+0000","last_unstale":"2023-11-29T11:17:39.781139+0000","last_undegraded":"2023-11-29T11:17:39.781139+0000","last_fullsized":"2023-11-29T11:17:39.781139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:05:56.934584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.773948+0000","last_change":"2023-11-29T11:17:39.766915+0000","last_active":"2023-11-29T11:17:39.773948+0000","last_peered":"2023-11-29T11:17:39.773948+0000","last_clean":"2023-11-29T11:17:39.773948+0000","last_became_active":"2023-11-29T11:17:39.766199+0000","last_became_peered":"2023-11-29T11:17:39.766199+0000","last_unstale":"2023-11-29T11:17:39.773948+0000","last_undegraded":"2023-11-29T11:17:39.773948+0000","last_fullsized":"2023-11-29T11:17:39.773948+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:30:09.152398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786307+0000","last_change":"2023-11-29T11:17:39.774539+0000","last_active":"2023-11-29T11:17:39.786307+0000","last_peered":"2023-11-29T11:17:39.786307+0000","last_clean":"2023-11-29T11:17:39.786307+0000","last_became_active":"2023-11-29T11:17:39.774284+0000","last_became_peered":"2023-11-29T11:17:39.774284+0000","last_unstale":"2023-11-29T11:17:39.786307+0000","last_undegraded":"2023-11-29T11:17:39.786307+0000","last_fullsized":"2023-11-29T11:17:39.786307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:26:47.887494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786817+0000","last_change":"2023-11-29T11:17:39.778618+0000","last_active":"2023-11-29T11:17:39.786817+0000","last_peered":"2023-11-29T11:17:39.786817+0000","last_clean":"2023-11-29T11:17:39.786817+0000","last_became_active":"2023-11-29T11:17:39.778332+0000","last_became_peered":"2023-11-29T11:17:39.778332+0000","last_unstale":"2023-11-29T11:17:39.786817+0000","last_undegraded":"2023-11-29T11:17:39.786817+0000","last_fullsized":"2023-11-29T11:17:39.786817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:08:15.004341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777581+0000","last_change":"2023-11-29T11:17:39.769597+0000","last_active":"2023-11-29T11:17:39.777581+0000","last_peered":"2023-11-29T11:17:39.777581+0000","last_clean":"2023-11-29T11:17:39.777581+0000","last_became_active":"2023-11-29T11:17:39.769288+0000","last_became_peered":"2023-11-29T11:17:39.769288+0000","last_unstale":"2023-11-29T11:17:39.777581+0000","last_undegraded":"2023-11-29T11:17:39.777581+0000","last_fullsized":"2023-11-29T11:17:39.777581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:49:14.951649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786925+0000","last_change":"2023-11-29T11:17:39.781551+0000","last_active":"2023-11-29T11:17:39.786925+0000","last_peered":"2023-11-29T11:17:39.786925+0000","last_clean":"2023-11-29T11:17:39.786925+0000","last_became_active":"2023-11-29T11:17:39.781240+0000","last_became_peered":"2023-11-29T11:17:39.781240+0000","last_unstale":"2023-11-29T11:17:39.786925+0000","last_undegraded":"2023-11-29T11:17:39.786925+0000","last_fullsized":"2023-11-29T11:17:39.786925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:40:44.558273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.784795+0000","last_change":"2023-11-29T11:17:39.404658+0000","last_active":"2023-11-29T11:17:39.784795+0000","last_peered":"2023-11-29T11:17:39.784795+0000","last_clean":"2023-11-29T11:17:39.784795+0000","last_became_active":"2023-11-29T11:17:39.403857+0000","last_became_peered":"2023-11-29T11:17:39.403857+0000","last_unstale":"2023-11-29T11:17:39.784795+0000","last_undegraded":"2023-11-29T11:17:39.784795+0000","last_fullsized":"2023-11-29T11:17:39.784795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:39:48.625724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.783724+0000","last_change":"2023-11-29T11:17:39.778561+0000","last_active":"2023-11-29T11:17:39.783724+0000","last_peered":"2023-11-29T11:17:39.783724+0000","last_clean":"2023-11-29T11:17:39.783724+0000","last_became_active":"2023-11-29T11:17:39.778279+0000","last_became_peered":"2023-11-29T11:17:39.778279+0000","last_unstale":"2023-11-29T11:17:39.783724+0000","last_undegraded":"2023-11-29T11:17:39.783724+0000","last_fullsized":"2023-11-29T11:17:39.783724+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:04:30.265504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.776976+0000","last_change":"2023-11-29T11:17:39.403387+0000","last_active":"2023-11-29T11:17:39.776976+0000","last_peered":"2023-11-29T11:17:39.776976+0000","last_clean":"2023-11-29T11:17:39.776976+0000","last_became_active":"2023-11-29T11:17:39.403086+0000","last_became_peered":"2023-11-29T11:17:39.403086+0000","last_unstale":"2023-11-29T11:17:39.776976+0000","last_undegraded":"2023-11-29T11:17:39.776976+0000","last_fullsized":"2023-11-29T11:17:39.776976+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:46:45.423643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781069+0000","last_change":"2023-11-29T11:17:39.775462+0000","last_active":"2023-11-29T11:17:39.781069+0000","last_peered":"2023-11-29T11:17:39.781069+0000","last_clean":"2023-11-29T11:17:39.781069+0000","last_became_active":"2023-11-29T11:17:39.775149+0000","last_became_peered":"2023-11-29T11:17:39.775149+0000","last_unstale":"2023-11-29T11:17:39.781069+0000","last_undegraded":"2023-11-29T11:17:39.781069+0000","last_fullsized":"2023-11-29T11:17:39.781069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:24:24.808653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786105+0000","last_change":"2023-11-29T11:17:39.404627+0000","last_active":"2023-11-29T11:17:39.786105+0000","last_peered":"2023-11-29T11:17:39.786105+0000","last_clean":"2023-11-29T11:17:39.786105+0000","last_became_active":"2023-11-29T11:17:39.404338+0000","last_became_peered":"2023-11-29T11:17:39.404338+0000","last_unstale":"2023-11-29T11:17:39.786105+0000","last_undegraded":"2023-11-29T11:17:39.786105+0000","last_fullsized":"2023-11-29T11:17:39.786105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:13:47.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.775891+0000","last_change":"2023-11-29T11:17:39.772303+0000","last_active":"2023-11-29T11:17:39.775891+0000","last_peered":"2023-11-29T11:17:39.775891+0000","last_clean":"2023-11-29T11:17:39.775891+0000","last_became_active":"2023-11-29T11:17:39.772035+0000","last_became_peered":"2023-11-29T11:17:39.772035+0000","last_unstale":"2023-11-29T11:17:39.775891+0000","last_undegraded":"2023-11-29T11:17:39.775891+0000","last_fullsized":"2023-11-29T11:17:39.775891+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:53:59.070248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786562+0000","last_change":"2023-11-29T11:17:39.404636+0000","last_active":"2023-11-29T11:17:39.786562+0000","last_peered":"2023-11-29T11:17:39.786562+0000","last_clean":"2023-11-29T11:17:39.786562+0000","last_became_active":"2023-11-29T11:17:39.404331+0000","last_became_peered":"2023-11-29T11:17:39.404331+0000","last_unstale":"2023-11-29T11:17:39.786562+0000","last_undegraded":"2023-11-29T11:17:39.786562+0000","last_fullsized":"2023-11-29T11:17:39.786562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:19.835250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780425+0000","last_change":"2023-11-29T11:17:39.771284+0000","last_active":"2023-11-29T11:17:39.780425+0000","last_peered":"2023-11-29T11:17:39.780425+0000","last_clean":"2023-11-29T11:17:39.780425+0000","last_became_active":"2023-11-29T11:17:39.771040+0000","last_became_peered":"2023-11-29T11:17:39.771040+0000","last_unstale":"2023-11-29T11:17:39.780425+0000","last_undegraded":"2023-11-29T11:17:39.780425+0000","last_fullsized":"2023-11-29T11:17:39.780425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:12:29.695323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786620+0000","last_change":"2023-11-29T11:17:39.411417+0000","last_active":"2023-11-29T11:17:39.786620+0000","last_peered":"2023-11-29T11:17:39.786620+0000","last_clean":"2023-11-29T11:17:39.786620+0000","last_became_active":"2023-11-29T11:17:39.411083+0000","last_became_peered":"2023-11-29T11:17:39.411083+0000","last_unstale":"2023-11-29T11:17:39.786620+0000","last_undegraded":"2023-11-29T11:17:39.786620+0000","last_fullsized":"2023-11-29T11:17:39.786620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:04:14.675981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.778253+0000","last_change":"2023-11-29T11:17:39.774043+0000","last_active":"2023-11-29T11:17:39.778253+0000","last_peered":"2023-11-29T11:17:39.778253+0000","last_clean":"2023-11-29T11:17:39.778253+0000","last_became_active":"2023-11-29T11:17:39.773771+0000","last_became_peered":"2023-11-29T11:17:39.773771+0000","last_unstale":"2023-11-29T11:17:39.778253+0000","last_undegraded":"2023-11-29T11:17:39.778253+0000","last_fullsized":"2023-11-29T11:17:39.778253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:39:25.040121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.773931+0000","last_change":"2023-11-29T11:17:39.405585+0000","last_active":"2023-11-29T11:17:39.773931+0000","last_peered":"2023-11-29T11:17:39.773931+0000","last_clean":"2023-11-29T11:17:39.773931+0000","last_became_active":"2023-11-29T11:17:39.405315+0000","last_became_peered":"2023-11-29T11:17:39.405315+0000","last_unstale":"2023-11-29T11:17:39.773931+0000","last_undegraded":"2023-11-29T11:17:39.773931+0000","last_fullsized":"2023-11-29T11:17:39.773931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:37:36.718722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785287+0000","last_change":"2023-11-29T11:17:39.779922+0000","last_active":"2023-11-29T11:17:39.785287+0000","last_peered":"2023-11-29T11:17:39.785287+0000","last_clean":"2023-11-29T11:17:39.785287+0000","last_became_active":"2023-11-29T11:17:39.779646+0000","last_became_peered":"2023-11-29T11:17:39.779646+0000","last_unstale":"2023-11-29T11:17:39.785287+0000","last_undegraded":"2023-11-29T11:17:39.785287+0000","last_fullsized":"2023-11-29T11:17:39.785287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:11:20.839623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.775572+0000","last_change":"2023-11-29T11:17:39.405717+0000","last_active":"2023-11-29T11:17:39.775572+0000","last_peered":"2023-11-29T11:17:39.775572+0000","last_clean":"2023-11-29T11:17:39.775572+0000","last_became_active":"2023-11-29T11:17:39.405461+0000","last_became_peered":"2023-11-29T11:17:39.405461+0000","last_unstale":"2023-11-29T11:17:39.775572+0000","last_undegraded":"2023-11-29T11:17:39.775572+0000","last_fullsized":"2023-11-29T11:17:39.775572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:40:48.981378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.767867+0000","last_change":"2023-11-29T11:17:39.766447+0000","last_active":"2023-11-29T11:17:39.767867+0000","last_peered":"2023-11-29T11:17:39.767867+0000","last_clean":"2023-11-29T11:17:39.767867+0000","last_became_active":"2023-11-29T11:17:39.766145+0000","last_became_peered":"2023-11-29T11:17:39.766145+0000","last_unstale":"2023-11-29T11:17:39.767867+0000","last_undegraded":"2023-11-29T11:17:39.767867+0000","last_fullsized":"2023-11-29T11:17:39.767867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:22:02.921524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.755456+0000","last_change":"2023-11-29T11:17:39.408650+0000","last_active":"2023-11-29T11:17:39.755456+0000","last_peered":"2023-11-29T11:17:39.755456+0000","last_clean":"2023-11-29T11:17:39.755456+0000","last_became_active":"2023-11-29T11:17:39.408390+0000","last_became_peered":"2023-11-29T11:17:39.408390+0000","last_unstale":"2023-11-29T11:17:39.755456+0000","last_undegraded":"2023-11-29T11:17:39.755456+0000","last_fullsized":"2023-11-29T11:17:39.755456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:26:25.676693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.767811+0000","last_change":"2023-11-29T11:17:39.765316+0000","last_active":"2023-11-29T11:17:39.767811+0000","last_peered":"2023-11-29T11:17:39.767811+0000","last_clean":"2023-11-29T11:17:39.767811+0000","last_became_active":"2023-11-29T11:17:39.765052+0000","last_became_peered":"2023-11-29T11:17:39.765052+0000","last_unstale":"2023-11-29T11:17:39.767811+0000","last_undegraded":"2023-11-29T11:17:39.767811+0000","last_fullsized":"2023-11-29T11:17:39.767811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:37:37.723095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.765917+0000","last_change":"2023-11-29T11:17:39.404665+0000","last_active":"2023-11-29T11:17:39.765917+0000","last_peered":"2023-11-29T11:17:39.765917+0000","last_clean":"2023-11-29T11:17:39.765917+0000","last_became_active":"2023-11-29T11:17:39.404121+0000","last_became_peered":"2023-11-29T11:17:39.404121+0000","last_unstale":"2023-11-29T11:17:39.765917+0000","last_undegraded":"2023-11-29T11:17:39.765917+0000","last_fullsized":"2023-11-29T11:17:39.765917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:51:48.320314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777636+0000","last_change":"2023-11-29T11:17:39.770274+0000","last_active":"2023-11-29T11:17:39.777636+0000","last_peered":"2023-11-29T11:17:39.777636+0000","last_clean":"2023-11-29T11:17:39.777636+0000","last_became_active":"2023-11-29T11:17:39.770047+0000","last_became_peered":"2023-11-29T11:17:39.770047+0000","last_unstale":"2023-11-29T11:17:39.777636+0000","last_undegraded":"2023-11-29T11:17:39.777636+0000","last_fullsized":"2023-11-29T11:17:39.777636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:07:24.665909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.760203+0000","last_change":"2023-11-29T11:17:39.409658+0000","last_active":"2023-11-29T11:17:39.760203+0000","last_peered":"2023-11-29T11:17:39.760203+0000","last_clean":"2023-11-29T11:17:39.760203+0000","last_became_active":"2023-11-29T11:17:39.409400+0000","last_became_peered":"2023-11-29T11:17:39.409400+0000","last_unstale":"2023-11-29T11:17:39.760203+0000","last_undegraded":"2023-11-29T11:17:39.760203+0000","last_fullsized":"2023-11-29T11:17:39.760203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:00:56.377568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.790396+0000","last_change":"2023-11-29T11:17:39.782830+0000","last_active":"2023-11-29T11:17:39.790396+0000","last_peered":"2023-11-29T11:17:39.790396+0000","last_clean":"2023-11-29T11:17:39.790396+0000","last_became_active":"2023-11-29T11:17:39.782268+0000","last_became_peered":"2023-11-29T11:17:39.782268+0000","last_unstale":"2023-11-29T11:17:39.790396+0000","last_undegraded":"2023-11-29T11:17:39.790396+0000","last_fullsized":"2023-11-29T11:17:39.790396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:38:58.240037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"80'3","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780771+0000","last_change":"2023-11-29T11:17:39.411373+0000","last_active":"2023-11-29T11:17:39.780771+0000","last_peered":"2023-11-29T11:17:39.780771+0000","last_clean":"2023-11-29T11:17:39.780771+0000","last_became_active":"2023-11-29T11:17:39.411032+0000","last_became_peered":"2023-11-29T11:17:39.411032+0000","last_unstale":"2023-11-29T11:17:39.780771+0000","last_undegraded":"2023-11-29T11:17:39.780771+0000","last_fullsized":"2023-11-29T11:17:39.780771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:54:47.116350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788966+0000","last_change":"2023-11-29T11:17:39.784490+0000","last_active":"2023-11-29T11:17:39.788966+0000","last_peered":"2023-11-29T11:17:39.788966+0000","last_clean":"2023-11-29T11:17:39.788966+0000","last_became_active":"2023-11-29T11:17:39.784226+0000","last_became_peered":"2023-11-29T11:17:39.784226+0000","last_unstale":"2023-11-29T11:17:39.788966+0000","last_undegraded":"2023-11-29T11:17:39.788966+0000","last_fullsized":"2023-11-29T11:17:39.788966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:48:53.020111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"80'6","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789211+0000","last_change":"2023-11-29T11:17:39.400090+0000","last_active":"2023-11-29T11:17:39.789211+0000","last_peered":"2023-11-29T11:17:39.789211+0000","last_clean":"2023-11-29T11:17:39.789211+0000","last_became_active":"2023-11-29T11:17:39.399727+0000","last_became_peered":"2023-11-29T11:17:39.399727+0000","last_unstale":"2023-11-29T11:17:39.789211+0000","last_undegraded":"2023-11-29T11:17:39.789211+0000","last_fullsized":"2023-11-29T11:17:39.789211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:33:56.174714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789209+0000","last_change":"2023-11-29T11:17:39.779517+0000","last_active":"2023-11-29T11:17:39.789209+0000","last_peered":"2023-11-29T11:17:39.789209+0000","last_clean":"2023-11-29T11:17:39.789209+0000","last_became_active":"2023-11-29T11:17:39.779175+0000","last_became_peered":"2023-11-29T11:17:39.779175+0000","last_unstale":"2023-11-29T11:17:39.789209+0000","last_undegraded":"2023-11-29T11:17:39.789209+0000","last_fullsized":"2023-11-29T11:17:39.789209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:55:18.812667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.766709+0000","last_change":"2023-11-29T11:17:39.409930+0000","last_active":"2023-11-29T11:17:39.766709+0000","last_peered":"2023-11-29T11:17:39.766709+0000","last_clean":"2023-11-29T11:17:39.766709+0000","last_became_active":"2023-11-29T11:17:39.409548+0000","last_became_peered":"2023-11-29T11:17:39.409548+0000","last_unstale":"2023-11-29T11:17:39.766709+0000","last_undegraded":"2023-11-29T11:17:39.766709+0000","last_fullsized":"2023-11-29T11:17:39.766709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:47:02.006094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785026+0000","last_change":"2023-11-29T11:17:39.778162+0000","last_active":"2023-11-29T11:17:39.785026+0000","last_peered":"2023-11-29T11:17:39.785026+0000","last_clean":"2023-11-29T11:17:39.785026+0000","last_became_active":"2023-11-29T11:17:39.777883+0000","last_became_peered":"2023-11-29T11:17:39.777883+0000","last_unstale":"2023-11-29T11:17:39.785026+0000","last_undegraded":"2023-11-29T11:17:39.785026+0000","last_fullsized":"2023-11-29T11:17:39.785026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:13:48.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.758707+0000","last_change":"2023-11-29T11:17:39.401188+0000","last_active":"2023-11-29T11:17:39.758707+0000","last_peered":"2023-11-29T11:17:39.758707+0000","last_clean":"2023-11-29T11:17:39.758707+0000","last_became_active":"2023-11-29T11:17:39.400899+0000","last_became_peered":"2023-11-29T11:17:39.400899+0000","last_unstale":"2023-11-29T11:17:39.758707+0000","last_undegraded":"2023-11-29T11:17:39.758707+0000","last_fullsized":"2023-11-29T11:17:39.758707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:48:48.396303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786245+0000","last_change":"2023-11-29T11:17:39.774693+0000","last_active":"2023-11-29T11:17:39.786245+0000","last_peered":"2023-11-29T11:17:39.786245+0000","last_clean":"2023-11-29T11:17:39.786245+0000","last_became_active":"2023-11-29T11:17:39.774238+0000","last_became_peered":"2023-11-29T11:17:39.774238+0000","last_unstale":"2023-11-29T11:17:39.786245+0000","last_undegraded":"2023-11-29T11:17:39.786245+0000","last_fullsized":"2023-11-29T11:17:39.786245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:23:18.142626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.755961+0000","last_change":"2023-11-29T11:17:39.407552+0000","last_active":"2023-11-29T11:17:39.755961+0000","last_peered":"2023-11-29T11:17:39.755961+0000","last_clean":"2023-11-29T11:17:39.755961+0000","last_became_active":"2023-11-29T11:17:39.407240+0000","last_became_peered":"2023-11-29T11:17:39.407240+0000","last_unstale":"2023-11-29T11:17:39.755961+0000","last_undegraded":"2023-11-29T11:17:39.755961+0000","last_fullsized":"2023-11-29T11:17:39.755961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:11:20.952474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788063+0000","last_change":"2023-11-29T11:17:39.781574+0000","last_active":"2023-11-29T11:17:39.788063+0000","last_peered":"2023-11-29T11:17:39.788063+0000","last_clean":"2023-11-29T11:17:39.788063+0000","last_became_active":"2023-11-29T11:17:39.781302+0000","last_became_peered":"2023-11-29T11:17:39.781302+0000","last_unstale":"2023-11-29T11:17:39.788063+0000","last_undegraded":"2023-11-29T11:17:39.788063+0000","last_fullsized":"2023-11-29T11:17:39.788063+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:03:06.152970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789339+0000","last_change":"2023-11-29T11:17:39.400483+0000","last_active":"2023-11-29T11:17:39.789339+0000","last_peered":"2023-11-29T11:17:39.789339+0000","last_clean":"2023-11-29T11:17:39.789339+0000","last_became_active":"2023-11-29T11:17:39.400223+0000","last_became_peered":"2023-11-29T11:17:39.400223+0000","last_unstale":"2023-11-29T11:17:39.789339+0000","last_undegraded":"2023-11-29T11:17:39.789339+0000","last_fullsized":"2023-11-29T11:17:39.789339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:48:48.396303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786737+0000","last_change":"2023-11-29T11:17:39.778316+0000","last_active":"2023-11-29T11:17:39.786737+0000","last_peered":"2023-11-29T11:17:39.786737+0000","last_clean":"2023-11-29T11:17:39.786737+0000","last_became_active":"2023-11-29T11:17:39.778041+0000","last_became_peered":"2023-11-29T11:17:39.778041+0000","last_unstale":"2023-11-29T11:17:39.786737+0000","last_undegraded":"2023-11-29T11:17:39.786737+0000","last_fullsized":"2023-11-29T11:17:39.786737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:17:04.990325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777136+0000","last_change":"2023-11-29T11:17:39.404659+0000","last_active":"2023-11-29T11:17:39.777136+0000","last_peered":"2023-11-29T11:17:39.777136+0000","last_clean":"2023-11-29T11:17:39.777136+0000","last_became_active":"2023-11-29T11:17:39.404409+0000","last_became_peered":"2023-11-29T11:17:39.404409+0000","last_unstale":"2023-11-29T11:17:39.777136+0000","last_undegraded":"2023-11-29T11:17:39.777136+0000","last_fullsized":"2023-11-29T11:17:39.777136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:53:26.162962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785167+0000","last_change":"2023-11-29T11:17:39.779509+0000","last_active":"2023-11-29T11:17:39.785167+0000","last_peered":"2023-11-29T11:17:39.785167+0000","last_clean":"2023-11-29T11:17:39.785167+0000","last_became_active":"2023-11-29T11:17:39.779207+0000","last_became_peered":"2023-11-29T11:17:39.779207+0000","last_unstale":"2023-11-29T11:17:39.785167+0000","last_undegraded":"2023-11-29T11:17:39.785167+0000","last_fullsized":"2023-11-29T11:17:39.785167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:48:49.400676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:40.190849+0000","last_change":"2023-11-29T11:17:39.409833+0000","last_active":"2023-11-29T11:17:40.190849+0000","last_peered":"2023-11-29T11:17:40.190849+0000","last_clean":"2023-11-29T11:17:40.190849+0000","last_became_active":"2023-11-29T11:17:39.409539+0000","last_became_peered":"2023-11-29T11:17:39.409539+0000","last_unstale":"2023-11-29T11:17:40.190849+0000","last_undegraded":"2023-11-29T11:17:40.190849+0000","last_fullsized":"2023-11-29T11:17:40.190849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:16:36.475198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781050+0000","last_change":"2023-11-29T11:17:39.775338+0000","last_active":"2023-11-29T11:17:39.781050+0000","last_peered":"2023-11-29T11:17:39.781050+0000","last_clean":"2023-11-29T11:17:39.781050+0000","last_became_active":"2023-11-29T11:17:39.775020+0000","last_became_peered":"2023-11-29T11:17:39.775020+0000","last_unstale":"2023-11-29T11:17:39.781050+0000","last_undegraded":"2023-11-29T11:17:39.781050+0000","last_fullsized":"2023-11-29T11:17:39.781050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:08:44.499564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.759605+0000","last_change":"2023-11-29T11:17:39.404102+0000","last_active":"2023-11-29T11:17:39.759605+0000","last_peered":"2023-11-29T11:17:39.759605+0000","last_clean":"2023-11-29T11:17:39.759605+0000","last_became_active":"2023-11-29T11:17:39.403789+0000","last_became_peered":"2023-11-29T11:17:39.403789+0000","last_unstale":"2023-11-29T11:17:39.759605+0000","last_undegraded":"2023-11-29T11:17:39.759605+0000","last_fullsized":"2023-11-29T11:17:39.759605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:35:17.115893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.786816+0000","last_change":"2023-11-29T11:17:39.780851+0000","last_active":"2023-11-29T11:17:39.786816+0000","last_peered":"2023-11-29T11:17:39.786816+0000","last_clean":"2023-11-29T11:17:39.786816+0000","last_became_active":"2023-11-29T11:17:39.780600+0000","last_became_peered":"2023-11-29T11:17:39.780600+0000","last_unstale":"2023-11-29T11:17:39.786816+0000","last_undegraded":"2023-11-29T11:17:39.786816+0000","last_fullsized":"2023-11-29T11:17:39.786816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:31:55.298988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.765663+0000","last_change":"2023-11-29T11:17:39.401203+0000","last_active":"2023-11-29T11:17:39.765663+0000","last_peered":"2023-11-29T11:17:39.765663+0000","last_clean":"2023-11-29T11:17:39.765663+0000","last_became_active":"2023-11-29T11:17:39.400797+0000","last_became_peered":"2023-11-29T11:17:39.400797+0000","last_unstale":"2023-11-29T11:17:39.765663+0000","last_undegraded":"2023-11-29T11:17:39.765663+0000","last_fullsized":"2023-11-29T11:17:39.765663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:14:30.989137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.764242+0000","last_change":"2023-11-29T11:17:39.760911+0000","last_active":"2023-11-29T11:17:39.764242+0000","last_peered":"2023-11-29T11:17:39.764242+0000","last_clean":"2023-11-29T11:17:39.764242+0000","last_became_active":"2023-11-29T11:17:39.760526+0000","last_became_peered":"2023-11-29T11:17:39.760526+0000","last_unstale":"2023-11-29T11:17:39.764242+0000","last_undegraded":"2023-11-29T11:17:39.764242+0000","last_fullsized":"2023-11-29T11:17:39.764242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:14:31.993510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.776347+0000","last_change":"2023-11-29T11:17:39.399638+0000","last_active":"2023-11-29T11:17:39.776347+0000","last_peered":"2023-11-29T11:17:39.776347+0000","last_clean":"2023-11-29T11:17:39.776347+0000","last_became_active":"2023-11-29T11:17:39.399150+0000","last_became_peered":"2023-11-29T11:17:39.399150+0000","last_unstale":"2023-11-29T11:17:39.776347+0000","last_undegraded":"2023-11-29T11:17:39.776347+0000","last_fullsized":"2023-11-29T11:17:39.776347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:15.769433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.789123+0000","last_change":"2023-11-29T11:17:39.779370+0000","last_active":"2023-11-29T11:17:39.789123+0000","last_peered":"2023-11-29T11:17:39.789123+0000","last_clean":"2023-11-29T11:17:39.789123+0000","last_became_active":"2023-11-29T11:17:39.779049+0000","last_became_peered":"2023-11-29T11:17:39.779049+0000","last_unstale":"2023-11-29T11:17:39.789123+0000","last_undegraded":"2023-11-29T11:17:39.789123+0000","last_fullsized":"2023-11-29T11:17:39.789123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:37:49.621769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.769178+0000","last_change":"2023-11-29T11:17:39.401904+0000","last_active":"2023-11-29T11:17:39.769178+0000","last_peered":"2023-11-29T11:17:39.769178+0000","last_clean":"2023-11-29T11:17:39.769178+0000","last_became_active":"2023-11-29T11:17:39.401648+0000","last_became_peered":"2023-11-29T11:17:39.401648+0000","last_unstale":"2023-11-29T11:17:39.769178+0000","last_undegraded":"2023-11-29T11:17:39.769178+0000","last_fullsized":"2023-11-29T11:17:39.769178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:55:17.808295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785308+0000","last_change":"2023-11-29T11:17:39.780763+0000","last_active":"2023-11-29T11:17:39.785308+0000","last_peered":"2023-11-29T11:17:39.785308+0000","last_clean":"2023-11-29T11:17:39.785308+0000","last_became_active":"2023-11-29T11:17:39.780501+0000","last_became_peered":"2023-11-29T11:17:39.780501+0000","last_unstale":"2023-11-29T11:17:39.785308+0000","last_undegraded":"2023-11-29T11:17:39.785308+0000","last_fullsized":"2023-11-29T11:17:39.785308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:05:23.613726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.765456+0000","last_change":"2023-11-29T11:17:39.404015+0000","last_active":"2023-11-29T11:17:39.765456+0000","last_peered":"2023-11-29T11:17:39.765456+0000","last_clean":"2023-11-29T11:17:39.765456+0000","last_became_active":"2023-11-29T11:17:39.402855+0000","last_became_peered":"2023-11-29T11:17:39.402855+0000","last_unstale":"2023-11-29T11:17:39.765456+0000","last_undegraded":"2023-11-29T11:17:39.765456+0000","last_fullsized":"2023-11-29T11:17:39.765456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:15:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780882+0000","last_change":"2023-11-29T11:17:39.774550+0000","last_active":"2023-11-29T11:17:39.780882+0000","last_peered":"2023-11-29T11:17:39.780882+0000","last_clean":"2023-11-29T11:17:39.780882+0000","last_became_active":"2023-11-29T11:17:39.772508+0000","last_became_peered":"2023-11-29T11:17:39.772508+0000","last_unstale":"2023-11-29T11:17:39.780882+0000","last_undegraded":"2023-11-29T11:17:39.780882+0000","last_fullsized":"2023-11-29T11:17:39.780882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:12.164959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.762025+0000","last_change":"2023-11-29T11:17:39.406129+0000","last_active":"2023-11-29T11:17:39.762025+0000","last_peered":"2023-11-29T11:17:39.762025+0000","last_clean":"2023-11-29T11:17:39.762025+0000","last_became_active":"2023-11-29T11:17:39.405608+0000","last_became_peered":"2023-11-29T11:17:39.405608+0000","last_unstale":"2023-11-29T11:17:39.762025+0000","last_undegraded":"2023-11-29T11:17:39.762025+0000","last_fullsized":"2023-11-29T11:17:39.762025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:22:01.917152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.777668+0000","last_change":"2023-11-29T11:17:39.768703+0000","last_active":"2023-11-29T11:17:39.777668+0000","last_peered":"2023-11-29T11:17:39.777668+0000","last_clean":"2023-11-29T11:17:39.777668+0000","last_became_active":"2023-11-29T11:17:39.768359+0000","last_became_peered":"2023-11-29T11:17:39.768359+0000","last_unstale":"2023-11-29T11:17:39.777668+0000","last_undegraded":"2023-11-29T11:17:39.777668+0000","last_fullsized":"2023-11-29T11:17:39.777668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:15:01.876664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.766078+0000","last_change":"2023-11-29T11:17:39.408896+0000","last_active":"2023-11-29T11:17:39.766078+0000","last_peered":"2023-11-29T11:17:39.766078+0000","last_clean":"2023-11-29T11:17:39.766078+0000","last_became_active":"2023-11-29T11:17:39.408608+0000","last_became_peered":"2023-11-29T11:17:39.408608+0000","last_unstale":"2023-11-29T11:17:39.766078+0000","last_undegraded":"2023-11-29T11:17:39.766078+0000","last_fullsized":"2023-11-29T11:17:39.766078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:53:44.029562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":66,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.402143+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:17:39.402143+0000","last_peered":"2023-11-29T11:17:39.402143+0000","last_clean":"2023-11-29T11:17:39.402143+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:17:39.402143+0000","last_undegraded":"2023-11-29T11:17:39.402143+0000","last_fullsized":"2023-11-29T11:17:39.402143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781337+0000","last_change":"2023-11-29T11:17:39.769788+0000","last_active":"2023-11-29T11:17:39.781337+0000","last_peered":"2023-11-29T11:17:39.781337+0000","last_clean":"2023-11-29T11:17:39.781337+0000","last_became_active":"2023-11-29T11:17:39.769463+0000","last_became_peered":"2023-11-29T11:17:39.769463+0000","last_unstale":"2023-11-29T11:17:39.781337+0000","last_undegraded":"2023-11-29T11:17:39.781337+0000","last_fullsized":"2023-11-29T11:17:39.781337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:32:04.227379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.770852+0000","last_change":"2023-11-29T11:17:39.398302+0000","last_active":"2023-11-29T11:17:39.770852+0000","last_peered":"2023-11-29T11:17:39.770852+0000","last_clean":"2023-11-29T11:17:39.770852+0000","last_became_active":"2023-11-29T11:17:39.397956+0000","last_became_peered":"2023-11-29T11:17:39.397956+0000","last_unstale":"2023-11-29T11:17:39.770852+0000","last_undegraded":"2023-11-29T11:17:39.770852+0000","last_fullsized":"2023-11-29T11:17:39.770852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:13:47.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":67,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.402002+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:17:39.402002+0000","last_peered":"2023-11-29T11:17:39.402002+0000","last_clean":"2023-11-29T11:17:39.402002+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:17:39.402002+0000","last_undegraded":"2023-11-29T11:17:39.402002+0000","last_fullsized":"2023-11-29T11:17:39.402002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788847+0000","last_change":"2023-11-29T11:17:39.784706+0000","last_active":"2023-11-29T11:17:39.788847+0000","last_peered":"2023-11-29T11:17:39.788847+0000","last_clean":"2023-11-29T11:17:39.788847+0000","last_became_active":"2023-11-29T11:17:39.784383+0000","last_became_peered":"2023-11-29T11:17:39.784383+0000","last_unstale":"2023-11-29T11:17:39.788847+0000","last_undegraded":"2023-11-29T11:17:39.788847+0000","last_fullsized":"2023-11-29T11:17:39.788847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:33:39.501948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.757116+0000","last_change":"2023-11-29T11:17:39.400307+0000","last_active":"2023-11-29T11:17:39.757116+0000","last_peered":"2023-11-29T11:17:39.757116+0000","last_clean":"2023-11-29T11:17:39.757116+0000","last_became_active":"2023-11-29T11:17:39.400044+0000","last_became_peered":"2023-11-29T11:17:39.400044+0000","last_unstale":"2023-11-29T11:17:39.757116+0000","last_undegraded":"2023-11-29T11:17:39.757116+0000","last_fullsized":"2023-11-29T11:17:39.757116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:15.769433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.406003+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:17:39.406003+0000","last_peered":"2023-11-29T11:17:39.406003+0000","last_clean":"2023-11-29T11:17:39.406003+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:17:39.406003+0000","last_undegraded":"2023-11-29T11:17:39.406003+0000","last_fullsized":"2023-11-29T11:17:39.406003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.785183+0000","last_change":"2023-11-29T11:17:39.770504+0000","last_active":"2023-11-29T11:17:39.785183+0000","last_peered":"2023-11-29T11:17:39.785183+0000","last_clean":"2023-11-29T11:17:39.785183+0000","last_became_active":"2023-11-29T11:17:39.770077+0000","last_became_peered":"2023-11-29T11:17:39.770077+0000","last_unstale":"2023-11-29T11:17:39.785183+0000","last_undegraded":"2023-11-29T11:17:39.785183+0000","last_fullsized":"2023-11-29T11:17:39.785183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:06:15.417237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.766126+0000","last_change":"2023-11-29T11:17:39.406593+0000","last_active":"2023-11-29T11:17:39.766126+0000","last_peered":"2023-11-29T11:17:39.766126+0000","last_clean":"2023-11-29T11:17:39.766126+0000","last_became_active":"2023-11-29T11:17:39.406277+0000","last_became_peered":"2023-11-29T11:17:39.406277+0000","last_unstale":"2023-11-29T11:17:39.766126+0000","last_undegraded":"2023-11-29T11:17:39.766126+0000","last_fullsized":"2023-11-29T11:17:39.766126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:58:10.280096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":66,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.382630+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:17:39.382630+0000","last_peered":"2023-11-29T11:17:39.382630+0000","last_clean":"2023-11-29T11:17:39.382630+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:17:39.382630+0000","last_undegraded":"2023-11-29T11:17:39.382630+0000","last_fullsized":"2023-11-29T11:17:39.382630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.781401+0000","last_change":"2023-11-29T11:17:39.774588+0000","last_active":"2023-11-29T11:17:39.781401+0000","last_peered":"2023-11-29T11:17:39.781401+0000","last_clean":"2023-11-29T11:17:39.781401+0000","last_became_active":"2023-11-29T11:17:39.772482+0000","last_became_peered":"2023-11-29T11:17:39.772482+0000","last_unstale":"2023-11-29T11:17:39.781401+0000","last_undegraded":"2023-11-29T11:17:39.781401+0000","last_fullsized":"2023-11-29T11:17:39.781401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:56:12.720288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.788995+0000","last_change":"2023-11-29T11:17:39.413919+0000","last_active":"2023-11-29T11:17:39.788995+0000","last_peered":"2023-11-29T11:17:39.788995+0000","last_clean":"2023-11-29T11:17:39.788995+0000","last_became_active":"2023-11-29T11:17:39.413651+0000","last_became_peered":"2023-11-29T11:17:39.413651+0000","last_unstale":"2023-11-29T11:17:39.788995+0000","last_undegraded":"2023-11-29T11:17:39.788995+0000","last_fullsized":"2023-11-29T11:17:39.788995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:53:58.065875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.391130+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:17:39.391130+0000","last_peered":"2023-11-29T11:17:39.391130+0000","last_clean":"2023-11-29T11:17:39.391130+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:17:39.391130+0000","last_undegraded":"2023-11-29T11:17:39.391130+0000","last_fullsized":"2023-11-29T11:17:39.391130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":67,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.403977+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:17:39.403977+0000","last_peered":"2023-11-29T11:17:39.403977+0000","last_clean":"2023-11-29T11:17:39.403977+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:17:39.403977+0000","last_undegraded":"2023-11-29T11:17:39.403977+0000","last_fullsized":"2023-11-29T11:17:39.403977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.775723+0000","last_change":"2023-11-29T11:17:39.772837+0000","last_active":"2023-11-29T11:17:39.775723+0000","last_peered":"2023-11-29T11:17:39.775723+0000","last_clean":"2023-11-29T11:17:39.775723+0000","last_became_active":"2023-11-29T11:17:39.772583+0000","last_became_peered":"2023-11-29T11:17:39.772583+0000","last_unstale":"2023-11-29T11:17:39.775723+0000","last_undegraded":"2023-11-29T11:17:39.775723+0000","last_fullsized":"2023-11-29T11:17:39.775723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:16.773805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.778967+0000","last_change":"2023-11-29T11:17:39.405327+0000","last_active":"2023-11-29T11:17:39.778967+0000","last_peered":"2023-11-29T11:17:39.778967+0000","last_clean":"2023-11-29T11:17:39.778967+0000","last_became_active":"2023-11-29T11:17:39.404943+0000","last_became_peered":"2023-11-29T11:17:39.404943+0000","last_unstale":"2023-11-29T11:17:39.778967+0000","last_undegraded":"2023-11-29T11:17:39.778967+0000","last_fullsized":"2023-11-29T11:17:39.778967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:07:23.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.391001+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:17:39.391001+0000","last_peered":"2023-11-29T11:17:39.391001+0000","last_clean":"2023-11-29T11:17:39.391001+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:17:39.391001+0000","last_undegraded":"2023-11-29T11:17:39.391001+0000","last_fullsized":"2023-11-29T11:17:39.391001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.783674+0000","last_change":"2023-11-29T11:17:39.776691+0000","last_active":"2023-11-29T11:17:39.783674+0000","last_peered":"2023-11-29T11:17:39.783674+0000","last_clean":"2023-11-29T11:17:39.783674+0000","last_became_active":"2023-11-29T11:17:39.776246+0000","last_became_peered":"2023-11-29T11:17:39.776246+0000","last_unstale":"2023-11-29T11:17:39.783674+0000","last_undegraded":"2023-11-29T11:17:39.783674+0000","last_fullsized":"2023-11-29T11:17:39.783674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:40:15.611181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.775652+0000","last_change":"2023-11-29T11:17:39.405705+0000","last_active":"2023-11-29T11:17:39.775652+0000","last_peered":"2023-11-29T11:17:39.775652+0000","last_clean":"2023-11-29T11:17:39.775652+0000","last_became_active":"2023-11-29T11:17:39.405439+0000","last_became_peered":"2023-11-29T11:17:39.405439+0000","last_unstale":"2023-11-29T11:17:39.775652+0000","last_undegraded":"2023-11-29T11:17:39.775652+0000","last_fullsized":"2023-11-29T11:17:39.775652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:11:02.989640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.394229+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:17:39.394229+0000","last_peered":"2023-11-29T11:17:39.394229+0000","last_clean":"2023-11-29T11:17:39.394229+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:17:39.394229+0000","last_undegraded":"2023-11-29T11:17:39.394229+0000","last_fullsized":"2023-11-29T11:17:39.394229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.769591+0000","last_change":"2023-11-29T11:17:39.764575+0000","last_active":"2023-11-29T11:17:39.769591+0000","last_peered":"2023-11-29T11:17:39.769591+0000","last_clean":"2023-11-29T11:17:39.769591+0000","last_became_active":"2023-11-29T11:17:39.764232+0000","last_became_peered":"2023-11-29T11:17:39.764232+0000","last_unstale":"2023-11-29T11:17:39.769591+0000","last_undegraded":"2023-11-29T11:17:39.769591+0000","last_fullsized":"2023-11-29T11:17:39.769591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:39.364895+0000","last_clean_scrub_stamp":"2023-11-29T11:17:39.364895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:57:31.624870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.780287+0000","last_change":"2023-11-29T11:17:39.411328+0000","last_active":"2023-11-29T11:17:39.780287+0000","last_peered":"2023-11-29T11:17:39.780287+0000","last_clean":"2023-11-29T11:17:39.780287+0000","last_became_active":"2023-11-29T11:17:39.410970+0000","last_became_peered":"2023-11-29T11:17:39.410970+0000","last_unstale":"2023-11-29T11:17:39.780287+0000","last_undegraded":"2023-11-29T11:17:39.780287+0000","last_fullsized":"2023-11-29T11:17:39.780287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:17:38.360523+0000","last_clean_scrub_stamp":"2023-11-29T11:17:38.360523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:51:12.859985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-29T11:17:39.391010+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:17:39.391010+0000","last_peered":"2023-11-29T11:17:39.391010+0000","last_clean":"2023-11-29T11:17:39.391010+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:17:39.391010+0000","last_undegraded":"2023-11-29T11:17:39.391010+0000","last_fullsized":"2023-11-29T11:17:39.391010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542205,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11256,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":9728,"kb_avail":94360584,"statfs":{"total":96636764160,"available":96625238016,"internally_reserved":0,"allocated":1556480,"data_stored":1044918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9961472},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.88200000000000001,"15min":0.90400000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.206,"5min":1.371,"15min":1.371},"last":1.143},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81899999999999995,"15min":0.82099999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2170000000000001,"5min":1.327,"15min":1.327},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92000000000000004,"15min":0.91400000000000003},"min":{"1min":0.57299999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.224,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.88700000000000001,"15min":0.90600000000000003},"min":{"1min":0.63100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0700000000000001,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.99299999999999999,"15min":1.018},"min":{"1min":0.82599999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3979999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94099999999999995,"15min":0.97599999999999998},"min":{"1min":0.68200000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1319999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.93500000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.93000000000000005,"15min":0.96599999999999997},"min":{"1min":0.53500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2729999999999999,"5min":1.641,"15min":1.641},"last":1.206},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.65900000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3140000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.97799999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91500000000000004,"15min":0.97699999999999998},"min":{"1min":0.59399999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.004},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0369999999999999,"15min":1.0780000000000001},"min":{"1min":0.63500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.393,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.252}]},{"osd":5,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.044,"15min":1.1160000000000001},"min":{"1min":0.66100000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.45,"5min":2.403,"15min":2.403},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.006,"5min":1.069,"15min":1.131},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.4159999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.1679999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.097,"15min":1.169},"min":{"1min":0.76100000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.1439999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.157,"15min":1.196},"min":{"1min":0.84399999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.371,"5min":1.77,"15min":1.77},"last":1.2889999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542206,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14412,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":13440,"kb_avail":94357428,"statfs":{"total":96636764160,"available":96622006272,"internally_reserved":0,"allocated":987136,"data_stored":462676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13762560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80100000000000005,"15min":0.82399999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.81299999999999994,"15min":0.80400000000000005},"min":{"1min":0.54100000000000004,"5min":0.375,"15min":0.375},"max":{"1min":1.224,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.59699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1910000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.115},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.93799999999999994},"min":{"1min":0.64700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4099999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.747},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.91600000000000004,"15min":0.90100000000000002},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.21,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.63300000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.149,"5min":1.625,"15min":1.625},"last":0.872},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.93500000000000005,"15min":0.93200000000000005},"min":{"1min":0.68300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.321,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.96499999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.92000000000000004,"15min":0.92500000000000004},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.133,"5min":1.714,"15min":1.714},"last":1.038},{"interface":"front","average":{"1min":1.006,"5min":0.98999999999999999,"15min":0.97799999999999998},"min":{"1min":0.71999999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3200000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.70799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.075,"15min":1.069},"min":{"1min":0.91500000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.286,"5min":1.593,"15min":1.593},"last":0.94099999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0660000000000001,"15min":1.083},"min":{"1min":0.71299999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.071,"15min":1.081},"min":{"1min":0.878,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0149999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542205,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14288,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357552,"statfs":{"total":96636764160,"available":96622133248,"internally_reserved":0,"allocated":991232,"data_stored":463568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1359999999999999,"5min":1.242,"15min":1.242},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.879,"15min":0.88500000000000001},"min":{"1min":0.55100000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1240000000000001,"5min":1.52,"15min":1.52},"last":0.66100000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.64800000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.117,"5min":1.512,"15min":1.512},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.86199999999999999,"15min":0.88700000000000001},"min":{"1min":0.56799999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.165,"5min":1.377,"15min":1.377},"last":0.97399999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.873,"15min":0.879},"min":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0449999999999999,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94399999999999995,"15min":0.95399999999999996},"min":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.093,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.083}]},{"osd":3,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.61299999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1359999999999999,"5min":1.335,"15min":1.335},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.038,"15min":1.018},"min":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2070000000000001,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.61899999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1060000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0289999999999999,"15min":1.0680000000000001},"min":{"1min":0.66300000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3520000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0369999999999999,"15min":1.0600000000000001},"min":{"1min":0.66600000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.276,"5min":1.585,"15min":1.585},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.0329999999999999,"15min":1.05},"min":{"1min":0.81899999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.381,"5min":1.575,"15min":1.575},"last":1.0680000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:16:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.101,"15min":1.097},"min":{"1min":0.78900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.236,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.119},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1739999999999999,"15min":1.1990000000000001},"min":{"1min":0.99299999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.413,"5min":1.889,"15min":1.889},"last":1.163}]}]},{"osd":4,"up_from":14,"seq":60129542205,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10432,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94361408,"statfs":{"total":96636764160,"available":96626081792,"internally_reserved":0,"allocated":974848,"data_stored":461998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.88300000000000001,"15min":0.92700000000000005},"min":{"1min":0.56499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.095,"5min":1.431,"15min":1.431},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.61799999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.107,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.95999999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.88900000000000001,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.179,"5min":1.458,"15min":1.458},"last":1.004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.879,"15min":0.877},"min":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.123,"5min":1.401,"15min":1.401},"last":1.103}]},{"osd":2,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94899999999999995,"15min":0.97999999999999998},"min":{"1min":0.64300000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.264,"5min":1.343,"15min":1.343},"last":0.91400000000000003}]},{"osd":3,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.67400000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.0349999999999999,"5min":1.294,"15min":1.294},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98499999999999999,"15min":1.0209999999999999},"min":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.171,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.218}]},{"osd":5,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93500000000000005,"15min":0.92700000000000005},"min":{"1min":0.751,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2210000000000001,"5min":1.492,"15min":1.492},"last":1.246},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96799999999999997},"min":{"1min":0.70099999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.266,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.296}]},{"osd":6,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.996,"15min":1.0149999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2969999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.155},{"interface":"front","average":{"1min":1.075,"5min":1.0920000000000001,"15min":1.109},"min":{"1min":0.81000000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.367,"5min":1.542,"15min":1.542},"last":1.333}]},{"osd":7,"last update":"Wed Nov 29 11:16:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.087,"15min":1.1040000000000001},"min":{"1min":0.80800000000000005,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.179},{"interface":"front","average":{"1min":1.119,"5min":1.1459999999999999,"15min":1.171},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4299999999999999,"5min":1.905,"15min":1.905},"last":1.2749999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361612,"statfs":{"total":96636764160,"available":96626290688,"internally_reserved":0,"allocated":962560,"data_stored":454550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.68100000000000005,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":6.3840000000000003,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.39200000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.93200000000000005,"5min":1.282,"15min":1.282},"last":0.90600000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":0.84299999999999997,"15min":0.67700000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":19.015999999999998,"5min":19.015999999999998,"15min":19.015999999999998},"last":1.111},{"interface":"front","average":{"1min":0.998,"5min":0.77900000000000003,"15min":0.74199999999999999},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":6.3540000000000001,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.3899999999999999,"5min":1.494,"15min":1.494},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.845,"5min":0.94499999999999995,"15min":0.77700000000000002},"min":{"1min":0.42999999999999999,"5min":0.374,"15min":0.374},"max":{"1min":23.466000000000001,"5min":23.466000000000001,"15min":23.466000000000001},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.653,"5min":1.115,"15min":1.034},"min":{"1min":0.67800000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":15.255000000000001,"5min":15.255000000000001,"15min":15.255000000000001},"last":1.04},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.1639999999999999,"15min":1.038},"min":{"1min":0.63600000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":23.792999999999999,"5min":23.792999999999999,"15min":23.792999999999999},"last":1.5209999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.1779999999999999,"15min":1.02},"min":{"1min":0.73699999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":23.751000000000001,"5min":23.751000000000001,"15min":23.751000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":7.0110000000000001,"5min":7.0110000000000001,"15min":7.0110000000000001},"last":1.0860000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":1.171,"15min":1.0569999999999999},"min":{"1min":0.72399999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":15.292999999999999,"5min":15.292999999999999,"15min":15.292999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":2.1549999999999998,"5min":1.319,"15min":1.1339999999999999},"min":{"1min":0.71999999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":23.428999999999998,"5min":23.428999999999998,"15min":23.428999999999998},"last":1.276}]},{"osd":7,"last update":"Wed Nov 29 11:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.167,"15min":1.1559999999999999},"min":{"1min":0.79400000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":6.4199999999999999,"5min":6.4199999999999999,"15min":6.4199999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.7789999999999999,"5min":1.2230000000000001,"15min":1.0900000000000001},"min":{"1min":0.63900000000000001,"5min":0.437,"15min":0.437},"max":{"1min":15.428000000000001,"5min":15.428000000000001,"15min":15.428000000000001},"last":1.2410000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10100,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361740,"statfs":{"total":96636764160,"available":96626421760,"internally_reserved":0,"allocated":962560,"data_stored":454550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86699999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.39600000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.99399999999999999,"5min":1.107,"15min":1.107},"last":0.41699999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66100000000000003,"15min":0.66000000000000003},"min":{"1min":0.502,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.026,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.095},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.012,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.67300000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.93400000000000005,"15min":0.96899999999999997},"min":{"1min":0.70399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.28,"5min":1.371,"15min":1.371},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94399999999999995,"15min":0.97399999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3100000000000001,"5min":1.532,"15min":1.532},"last":0.876}]},{"osd":5,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.68100000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.23,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.98299999999999998,"15min":1.0109999999999999},"min":{"1min":0.64600000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.1830000000000001,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97999999999999998,"15min":1},"min":{"1min":0.748,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.016,"15min":1.052},"min":{"1min":0.751,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1890000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.036}]},{"osd":7,"last update":"Wed Nov 29 11:16:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0489999999999999,"15min":1.056},"min":{"1min":0.89700000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.569,"5min":1.76,"15min":1.76},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.84099999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.24,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.91200000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15504,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":13952,"kb_avail":94356336,"statfs":{"total":96636764160,"available":96620888064,"internally_reserved":0,"allocated":1581056,"data_stored":1052560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14286848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.96899999999999997,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.47999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69999999999999996,"15min":0.70299999999999996},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98699999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68400000000000005,"15min":0.70199999999999996},"min":{"1min":0.56299999999999994,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.393,"15min":1.393},"last":0.72499999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.753,"15min":0.76200000000000001},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0089999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.496,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94699999999999995,"5min":1.744,"15min":1.744},"last":0.56999999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.95899999999999996,"15min":0.96399999999999997},"min":{"1min":0.66900000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3879999999999999,"5min":1.609,"15min":1.609},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0149999999999999,"15min":1.0349999999999999},"min":{"1min":0.83599999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2889999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.85699999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.2869999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.01,"15min":1.016},"min":{"1min":0.88600000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.339,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.056,"15min":1.0920000000000001},"min":{"1min":0.77100000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.355,"5min":1.575,"15min":1.575},"last":1.024},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98899999999999999,"15min":0.997},"min":{"1min":0.70099999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3560000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.92100000000000004}]},{"osd":7,"last update":"Wed Nov 29 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.044,"15min":1.073},"min":{"1min":0.79100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.444,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.0960000000000001,"15min":1.1200000000000001},"min":{"1min":0.86699999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3720000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.97699999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10432,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94361408,"statfs":{"total":96636764160,"available":96626081792,"internally_reserved":0,"allocated":974848,"data_stored":461046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.997,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65000000000000002,"15min":0.66300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83099999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68500000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70299999999999996,"15min":0.73299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85399999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0389999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.877,"15min":0.875},"min":{"1min":0.73199999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.0640000000000001,"5min":1.423,"15min":1.423},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.97099999999999997,"15min":1.0049999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.254,"5min":1.399,"15min":1.399},"last":0.97999999999999998}]},{"osd":5,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.0069999999999999,"15min":1.0209999999999999},"min":{"1min":0.78600000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.006},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1899999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1419999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.052,"15min":1.0880000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4239999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.085,"15min":1.1259999999999999},"min":{"1min":0.63700000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.3779999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Wed Nov 29 11:16:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.099,"15min":1.1419999999999999},"min":{"1min":0.67600000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.361,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0609999999999999,"15min":1.0820000000000001},"min":{"1min":0.76100000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.349,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.0640000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:17:43.738 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-29T11:17:43.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-29T11:17:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4c9c7700 1 Processor -- start 2023-11-29T11:17:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4c9c7700 1 -- start start 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4c9c7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b4815a140 0x7f5b4806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4c9c7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5b480b1970 0x7f5b480caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4c9c7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4806cce0 con 0x7f5b4815e5e0 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4c9c7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4815a510 con 0x7f5b4815a140 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4c9c7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4806cfc0 con 0x7f5b480b1970 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b4815a140 0x7f5b4806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b4815a140 0x7f5b4806aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48446/0 (socket says 172.21.15.81:48446) 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.856+0000 7f5b4659c700 1 -- 172.21.15.81:0/896529593 learned_addr learned my addr 172.21.15.81:0/896529593 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4659c700 1 -- 172.21.15.81:0/896529593 >> v2:172.21.15.176:3300/0 conn(0x7f5b480b1970 msgr2=0x7f5b480caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b46d9d700 1 --2- 172.21.15.81:0/896529593 >> v2:172.21.15.176:3300/0 conn(0x7f5b480b1970 0x7f5b480caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4659c700 1 --2- 172.21.15.81:0/896529593 >> v2:172.21.15.176:3300/0 conn(0x7f5b480b1970 0x7f5b480caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4659c700 1 -- 172.21.15.81:0/896529593 >> v1:172.21.15.176:6789/0 conn(0x7f5b4815e5e0 legacy=0x7f5b480b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:43.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4659c700 1 -- 172.21.15.81:0/896529593 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480ca560 con 0x7f5b4815a140 2023-11-29T11:17:43.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4659c700 1 --2- 172.21.15.81:0/896529593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b4806aee0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5b48066fb0 tx=0x7f5b4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7631c8ffa49ef9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4559a700 1 -- 172.21.15.81:0/896529593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4000e070 con 0x7f5b4815a140 2023-11-29T11:17:43.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4559a700 1 -- 172.21.15.81:0/896529593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b40003a40 con 0x7f5b4815a140 2023-11-29T11:17:43.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4559a700 1 -- 172.21.15.81:0/896529593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40003df0 con 0x7f5b4815a140 2023-11-29T11:17:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/896529593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 msgr2=0x7f5b4806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/896529593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b4806aee0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5b48066fb0 tx=0x7f5b4000b330 comp rx=0 tx=0).stop 2023-11-29T11:17:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/896529593 shutdown_connections 2023-11-29T11:17:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/896529593 >> v2:172.21.15.176:3300/0 conn(0x7f5b480b1970 0x7f5b480caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/896529593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b4806aee0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/896529593 >> 172.21.15.81:0/896529593 conn(0x7f5b480cc260 msgr2=0x7f5b480cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/896529593 shutdown_connections 2023-11-29T11:17:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.860+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/896529593 wait complete. 2023-11-29T11:17:43.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4c9c7700 1 Processor -- start 2023-11-29T11:17:43.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4c9c7700 1 -- start start 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4c9c7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b480b1970 0x7f5b4814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4c9c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b480afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4c9c7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4815e5e0 0x7f5b480b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4c9c7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4814b270 con 0x7f5b4815a140 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4c9c7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481f3240 con 0x7f5b4815e5e0 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4c9c7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481f34e0 con 0x7f5b480b1970 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b45d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b480afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b45d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b480afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48456/0 (socket says 172.21.15.81:48456) 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b45d9b700 1 -- 172.21.15.81:0/1981192691 learned_addr learned my addr 172.21.15.81:0/1981192691 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b4659c700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b480b1970 0x7f5b4814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.864+0000 7f5b46d9d700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4815e5e0 0x7f5b480b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b45d9b700 1 -- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b480b1970 msgr2=0x7f5b4814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b45d9b700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b480b1970 0x7f5b4814ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b45d9b700 1 -- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4815e5e0 msgr2=0x7f5b480b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b45d9b700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4815e5e0 0x7f5b480b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b45d9b700 1 -- 172.21.15.81:0/1981192691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40009b30 con 0x7f5b4815a140 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b46d9d700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4815e5e0 0x7f5b480b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b45d9b700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b480afc40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00b4a0 tx=0x7f5b3c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b36ffd700 1 -- 172.21.15.81:0/1981192691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c011830 con 0x7f5b4815a140 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b36ffd700 1 -- 172.21.15.81:0/1981192691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c011990 con 0x7f5b4815a140 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4815ea30 con 0x7f5b4815a140 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b36ffd700 1 -- 172.21.15.81:0/1981192691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c011d40 con 0x7f5b4815a140 2023-11-29T11:17:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4806c990 con 0x7f5b4815a140 2023-11-29T11:17:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b480cafc0 con 0x7f5b4815a140 2023-11-29T11:17:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b36ffd700 1 -- 172.21.15.81:0/1981192691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5b3c00f050 con 0x7f5b4815a140 2023-11-29T11:17:43.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.868+0000 7f5b36ffd700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b28064f10 0x7f5b280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:43.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.872+0000 7f5b4659c700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b28064f10 0x7f5b280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:43.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.872+0000 7f5b36ffd700 1 -- 172.21.15.81:0/1981192691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f5b3c081b40 con 0x7f5b4815a140 2023-11-29T11:17:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.872+0000 7f5b4659c700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b28064f10 0x7f5b280673c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5b40015040 tx=0x7f5b40009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:43.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:43.876+0000 7f5b36ffd700 1 -- 172.21.15.81:0/1981192691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5b3c04fb80 con 0x7f5b4815a140 2023-11-29T11:17:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.104+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f5b48072c20 con 0x7f5b4815a140 2023-11-29T11:17:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.112+0000 7f5b36ffd700 1 -- 172.21.15.81:0/1981192691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5b3c0531a0 con 0x7f5b4815a140 2023-11-29T11:17:44.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b28064f10 msgr2=0x7f5b280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:44.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b28064f10 0x7f5b280673c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5b40015040 tx=0x7f5b40009000 comp rx=0 tx=0).stop 2023-11-29T11:17:44.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 msgr2=0x7f5b480afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b480afc40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00b4a0 tx=0x7f5b3c00b7b0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 shutdown_connections 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5b28064f10 0x7f5b280673c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4815e5e0 0x7f5b480b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b4815a140 0x7f5b480afc40 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 --2- 172.21.15.81:0/1981192691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b480b1970 0x7f5b4814ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 >> 172.21.15.81:0/1981192691 conn(0x7f5b480cc260 msgr2=0x7f5b48159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 shutdown_connections 2023-11-29T11:17:44.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.116+0000 7f5b4c9c7700 1 -- 172.21.15.81:0/1981192691 wait complete. 2023-11-29T11:17:44.125 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-11-29T11:17:44.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03f457700 1 Processor -- start 2023-11-29T11:17:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03f457700 1 -- start start 2023-11-29T11:17:44.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03f457700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc03806c460 0x7fc038071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:44.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03f457700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc03806c880 0x7fc0380ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03f457700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03806b5e0 con 0x7fc038159220 2023-11-29T11:17:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03f457700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0380722c0 con 0x7fc03806c460 2023-11-29T11:17:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03f457700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380cdfb0 con 0x7fc03806c880 2023-11-29T11:17:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03dc54700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc03806c460 0x7fc038071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03e455700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc038159220 0x7fc03806bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54002/0 (socket says 172.21.15.81:54002) 2023-11-29T11:17:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03e455700 1 -- 172.21.15.81:0/1991048399 learned_addr learned my addr 172.21.15.81:0/1991048399 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:44.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03ec56700 1 --2- 172.21.15.81:0/1991048399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc03806c880 0x7fc0380ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03dc54700 1 -- 172.21.15.81:0/1991048399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc03806c880 msgr2=0x7fc0380ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03dc54700 1 --2- 172.21.15.81:0/1991048399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc03806c880 0x7fc0380ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03dc54700 1 -- 172.21.15.81:0/1991048399 >> v1:172.21.15.81:6789/0 conn(0x7fc038159220 legacy=0x7fc03806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03d453700 1 -- 172.21.15.81:0/1991048399 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112768311 0 0) 0x7fc03806b5e0 con 0x7fc038159220 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03dc54700 1 -- 172.21.15.81:0/1991048399 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380ce290 con 0x7fc03806c460 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03dc54700 1 --2- 172.21.15.81:0/1991048399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc038071d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fc034009d90 tx=0x7fc03400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524fe8282ee6ee97 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.248+0000 7fc03d453700 1 -- 172.21.15.81:0/1991048399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400e070 con 0x7fc03806c460 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03d453700 1 -- 172.21.15.81:0/1991048399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400bb20 con 0x7fc03806c460 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03d453700 1 -- 172.21.15.81:0/1991048399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034012430 con 0x7fc03806c460 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- 172.21.15.81:0/1991048399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 msgr2=0x7fc038071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 --2- 172.21.15.81:0/1991048399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc038071d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fc034009d90 tx=0x7fc03400b330 comp rx=0 tx=0).stop 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- 172.21.15.81:0/1991048399 shutdown_connections 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 --2- 172.21.15.81:0/1991048399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc03806c880 0x7fc0380ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 --2- 172.21.15.81:0/1991048399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc038071d80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- 172.21.15.81:0/1991048399 >> 172.21.15.81:0/1991048399 conn(0x7fc0380b1d40 msgr2=0x7fc0380cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:44.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- 172.21.15.81:0/1991048399 shutdown_connections 2023-11-29T11:17:44.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- 172.21.15.81:0/1991048399 wait complete. 2023-11-29T11:17:44.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 Processor -- start 2023-11-29T11:17:44.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- start start 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc0380c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03806c880 0x7fc038148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc038159220 0x7fc0380c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc038149850 con 0x7fc03806c460 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc038149b30 con 0x7fc03806c880 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03f457700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc038149e10 con 0x7fc038159220 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03e455700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc0380c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03e455700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc0380c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48476/0 (socket says 172.21.15.81:48476) 2023-11-29T11:17:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03e455700 1 -- 172.21.15.81:0/1595715262 learned_addr learned my addr 172.21.15.81:0/1595715262 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.252+0000 7fc03dc54700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03806c880 0x7fc038148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03ec56700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc038159220 0x7fc0380c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03e455700 1 -- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc038159220 msgr2=0x7fc0380c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03e455700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc038159220 0x7fc0380c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03e455700 1 -- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03806c880 msgr2=0x7fc038148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03e455700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03806c880 0x7fc038148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03e455700 1 -- 172.21.15.81:0/1595715262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034009a70 con 0x7fc03806c460 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03dc54700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03806c880 0x7fc038148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:44.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03e455700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc0380c8d40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c580 tx=0x7fc02c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc02affd700 1 -- 172.21.15.81:0/1595715262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c004ca0 con 0x7fc03806c460 2023-11-29T11:17:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc02affd700 1 -- 172.21.15.81:0/1595715262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c004e20 con 0x7fc03806c460 2023-11-29T11:17:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03806b830 con 0x7fc03806c460 2023-11-29T11:17:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc02affd700 1 -- 172.21.15.81:0/1595715262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c007310 con 0x7fc03806c460 2023-11-29T11:17:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0380ce570 con 0x7fc03806c460 2023-11-29T11:17:44.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0381595f0 con 0x7fc03806c460 2023-11-29T11:17:44.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc02affd700 1 -- 172.21.15.81:0/1595715262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc02c01a020 con 0x7fc03806c460 2023-11-29T11:17:44.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc02affd700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc01c064ee0 0x7fc01c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:44.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc02affd700 1 -- 172.21.15.81:0/1595715262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fc02c081c70 con 0x7fc03806c460 2023-11-29T11:17:44.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.256+0000 7fc03dc54700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc01c064ee0 0x7fc01c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:44.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.260+0000 7fc03dc54700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc01c064ee0 0x7fc01c067390 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc034009d90 tx=0x7fc034011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:44.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.264+0000 7fc02affd700 1 -- 172.21.15.81:0/1595715262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc02c04fcb0 con 0x7fc03806c460 2023-11-29T11:17:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc038072500 con 0x7fc03806c460 2023-11-29T11:17:44.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc02affd700 1 -- 172.21.15.81:0/1595715262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fc02c0532d0 con 0x7fc03806c460 2023-11-29T11:17:44.471 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:44.471 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:17:42.393858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3247003029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3247003029},{"type":"v1","addr":"172.21.15.81:6837","nonce":3247003029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:17:44.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc01c064ee0 msgr2=0x7fc01c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:44.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc01c064ee0 0x7fc01c067390 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc034009d90 tx=0x7fc034011000 comp rx=0 tx=0).stop 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 msgr2=0x7fc0380c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc0380c8d40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c580 tx=0x7fc02c00c940 comp rx=0 tx=0).stop 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 shutdown_connections 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc01c064ee0 0x7fc01c067390 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc038159220 0x7fc0380c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc03806c880 0x7fc038148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 --2- 172.21.15.81:0/1595715262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc03806c460 0x7fc0380c8d40 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 >> 172.21.15.81:0/1595715262 conn(0x7fc0380b1d40 msgr2=0x7fc0380657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 shutdown_connections 2023-11-29T11:17:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:44.464+0000 7fc03f457700 1 -- 172.21.15.81:0/1595715262 wait complete. 2023-11-29T11:17:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-11-29T11:17:44.888 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:17:39.743930+0000', 'modified': '2023-11-29T11:17:42.393858+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7185}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7185': {'gid': 7185, 'name': 'c', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3247003029', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3247003029}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3247003029}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:17:44.889 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:17:44.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-29T11:17:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.004+0000 7feb7f6d4700 1 Processor -- start 2023-11-29T11:17:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.004+0000 7feb7f6d4700 1 -- start start 2023-11-29T11:17:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 0x7feb78071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb780cd5e0 0x7feb780c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb780cc420 con 0x7feb78069c40 2023-11-29T11:17:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb780cc6c0 con 0x7feb780cd5e0 2023-11-29T11:17:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb780cc9a0 con 0x7feb78160680 2023-11-29T11:17:45.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7dc71700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb780cd5e0 0x7feb780c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7cc6f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb78069c40 0x7feb780cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54016/0 (socket says 172.21.15.81:54016) 2023-11-29T11:17:45.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7cc6f700 1 -- 172.21.15.81:0/4226716963 learned_addr learned my addr 172.21.15.81:0/4226716963 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:45.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7d470700 1 --2- 172.21.15.81:0/4226716963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 0x7feb78071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7dc71700 1 -- 172.21.15.81:0/4226716963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 msgr2=0x7feb78071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7dc71700 1 --2- 172.21.15.81:0/4226716963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 0x7feb78071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7dc71700 1 -- 172.21.15.81:0/4226716963 >> v1:172.21.15.81:6789/0 conn(0x7feb78069c40 legacy=0x7feb780cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7dc71700 1 -- 172.21.15.81:0/4226716963 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780705c0 con 0x7feb780cd5e0 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb6ffff700 1 -- 172.21.15.81:0/4226716963 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32719954 0 0) 0x7feb780cc420 con 0x7feb78069c40 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7dc71700 1 --2- 172.21.15.81:0/4226716963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780c9ce0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7feb70009850 tx=0x7feb70009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb6b92557938bb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb6ffff700 1 -- 172.21.15.81:0/4226716963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70011830 con 0x7feb780cd5e0 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb6ffff700 1 -- 172.21.15.81:0/4226716963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70011990 con 0x7feb780cd5e0 2023-11-29T11:17:45.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb6ffff700 1 -- 172.21.15.81:0/4226716963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70011d40 con 0x7feb780cd5e0 2023-11-29T11:17:45.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 -- 172.21.15.81:0/4226716963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 msgr2=0x7feb780c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/4226716963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780c9ce0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7feb70009850 tx=0x7feb70009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:45.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 -- 172.21.15.81:0/4226716963 shutdown_connections 2023-11-29T11:17:45.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/4226716963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780c9ce0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/4226716963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 0x7feb78071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 -- 172.21.15.81:0/4226716963 >> 172.21.15.81:0/4226716963 conn(0x7feb7806caf0 msgr2=0x7feb780ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:45.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 -- 172.21.15.81:0/4226716963 shutdown_connections 2023-11-29T11:17:45.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.008+0000 7feb7f6d4700 1 -- 172.21.15.81:0/4226716963 wait complete. 2023-11-29T11:17:45.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 Processor -- start 2023-11-29T11:17:45.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 -- start start 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb78069c40 0x7feb780c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 0x7feb780b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7815b210 con 0x7feb780cd5e0 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7815a870 con 0x7feb78069c40 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7815ab50 con 0x7feb78160680 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48496/0 (socket says 172.21.15.81:48496) 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 -- 172.21.15.81:0/736949382 learned_addr learned my addr 172.21.15.81:0/736949382 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7d470700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb78069c40 0x7feb780c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7dc71700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 0x7feb780b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 -- 172.21.15.81:0/736949382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 msgr2=0x7feb780b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 0x7feb780b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 -- 172.21.15.81:0/736949382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb78069c40 msgr2=0x7feb780c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb78069c40 0x7feb780c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 -- 172.21.15.81:0/736949382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700094b0 con 0x7feb780cd5e0 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780ca120 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7feb74001f80 tx=0x7feb7400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb6dffb700 1 -- 172.21.15.81:0/736949382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7400acd0 con 0x7feb780cd5e0 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb6dffb700 1 -- 172.21.15.81:0/736949382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7400ae50 con 0x7feb780cd5e0 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 -- 172.21.15.81:0/736949382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb780c9750 con 0x7feb780cd5e0 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb6dffb700 1 -- 172.21.15.81:0/736949382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74007310 con 0x7feb780cd5e0 2023-11-29T11:17:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.012+0000 7feb7f6d4700 1 -- 172.21.15.81:0/736949382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb78071940 con 0x7feb780cd5e0 2023-11-29T11:17:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.016+0000 7feb6dffb700 1 -- 172.21.15.81:0/736949382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb74010070 con 0x7feb780cd5e0 2023-11-29T11:17:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.016+0000 7feb6dffb700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb5c064ee0 0x7feb5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.016+0000 7feb6dffb700 1 -- 172.21.15.81:0/736949382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7feb74081990 con 0x7feb780cd5e0 2023-11-29T11:17:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.016+0000 7feb7d470700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb5c064ee0 0x7feb5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.016+0000 7feb7d470700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb5c064ee0 0x7feb5c067390 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feb781f8e50 tx=0x7feb68009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb82954740 1 Processor -- start 2023-11-29T11:17:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb82954740 1 -- start start 2023-11-29T11:17:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb82954740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1b09e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb82954740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1b0a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb82954740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18a4790 0x1b0a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb82954740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x19c8ae0 con 0x1859710 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb82954740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a38bd0 con 0x18a4790 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb82954740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a31ed0 con 0x1859ae0 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1b0a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7dc71700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18a4790 0x1b0a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1b0a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48502/0 (socket says 172.21.15.81:48502) 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 -- 172.21.15.81:0/2850667221 learned_addr learned my addr 172.21.15.81:0/2850667221 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7d470700 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1b09e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 -- 172.21.15.81:0/2850667221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 msgr2=0x1b09e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1b09e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 -- 172.21.15.81:0/2850667221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18a4790 msgr2=0x1b0a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18a4790 0x1b0a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 -- 172.21.15.81:0/2850667221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a57cc0 con 0x1859710 2023-11-29T11:17:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7d470700 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1b09e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1b0a340 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7feb74052fd0 tx=0x7feb74053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9057e7f1b51bffe9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb62ffd700 1 -- 172.21.15.81:0/2850667221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb740590d0 con 0x1859710 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb62ffd700 1 -- 172.21.15.81:0/2850667221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74057150 con 0x1859710 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.020+0000 7feb62ffd700 1 -- 172.21.15.81:0/2850667221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7405b210 con 0x1859710 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- 172.21.15.81:0/2850667221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 msgr2=0x1b0a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1b0a340 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7feb74052fd0 tx=0x7feb74053000 comp rx=0 tx=0).stop 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- 172.21.15.81:0/2850667221 shutdown_connections 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x18a4790 0x1b0a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1b0a340 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 --2- 172.21.15.81:0/2850667221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1b09e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- 172.21.15.81:0/2850667221 >> 172.21.15.81:0/2850667221 conn(0x1859eb0 msgr2=0x1af2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- 172.21.15.81:0/2850667221 shutdown_connections 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- 172.21.15.81:0/2850667221 wait complete. 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- start start 2023-11-29T11:17:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 Processor -- start 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1af0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b0baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x18a4790 0x1ac98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x18deb20 con 0x1859710 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1acab00 con 0x1859ae0 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ac9e00 con 0x18a4790 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 10 client.0 _ll_register_callbacks cb 0x1a8e0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1af0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1af0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48512/0 (socket says 172.21.15.81:48512) 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 -- 172.21.15.81:0/4138761753 learned_addr learned my addr 172.21.15.81:0/4138761753 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b0baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7dc71700 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x18a4790 0x1ac98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 -- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x18a4790 msgr2=0x1ac98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x18a4790 0x1ac98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 -- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 msgr2=0x1b0baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b0baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 -- 172.21.15.81:0/4138761753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb78071940 con 0x1859710 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7dc71700 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x18a4790 0x1ac98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb7d470700 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1af0da0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7feb68014740 tx=0x7feb680047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11f593a7dbc2168 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb57fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb57fff700 1 -- 172.21.15.81:0/4138761753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680226e0 con 0x1859710 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb57fff700 1 -- 172.21.15.81:0/4138761753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7feb6801c040 con 0x1859710 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 1 -- 172.21.15.81:0/4138761753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a2af50 con 0x1859710 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb57fff700 1 -- 172.21.15.81:0/4138761753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb68022840 con 0x1859710 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.024+0000 7feb82954740 10 client.7344 fetch_fsmap learned FSMap version 40 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 -- 172.21.15.81:0/4138761753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x18a59e0 con 0x1859710 2023-11-29T11:17:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb57fff700 1 -- 172.21.15.81:0/4138761753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a2af50 con 0x1859710 2023-11-29T11:17:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb57fff700 1 -- 172.21.15.81:0/4138761753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3106+0+0 (secure 0 0 0) 0x7feb680229a0 con 0x1859710 2023-11-29T11:17:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 10 client.7344 fetch_fsmap finished waiting for FSMap version 40 2023-11-29T11:17:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 10 client.7344 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:17:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 20 client.7344 populate_metadata read hostname 'smithi081' 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] conn(0x1ac7ee0 0x1b23fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 4 client.7344 mds_command: new command op to 7185 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 -- 172.21.15.81:0/4138761753 --> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a2ac70 con 0x1ac7ee0 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] conn(0x1ac7ee0 0x1b23fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] conn(0x1ac7ee0 0x1b23fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8ccef4449ec457 server_cookie=f4cbe7a31a7d2b5a in_seq=0 out_seq=0 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb57fff700 10 client.7344 ms_handle_connect on v2:172.21.15.81:6836/3247003029 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb57fff700 1 -- 172.21.15.81:0/4138761753 <== mds.0 v2:172.21.15.81:6836/3247003029 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1a2ac70 con 0x1ac7ee0 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb57fff700 10 client.7344 handle_command_reply: tid=0 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 client.7344 shutdown 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 -- 172.21.15.81:0/4138761753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 msgr2=0x1af0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1af0da0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7feb68014740 tx=0x7feb680047e0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 -- 172.21.15.81:0/4138761753 shutdown_connections 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] conn(0x1ac7ee0 0x1b23fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x18a4790 0x1ac98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b0baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 --2- 172.21.15.81:0/4138761753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1859710 0x1af0da0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb57fff700 0 client.7344 ms_handle_reset on v2:172.21.15.81:6836/3247003029 2023-11-29T11:17:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 -- 172.21.15.81:0/4138761753 >> 172.21.15.81:0/4138761753 conn(0x1859eb0 msgr2=0x1af27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 -- 172.21.15.81:0/4138761753 shutdown_connections 2023-11-29T11:17:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 1 -- 172.21.15.81:0/4138761753 wait complete. 2023-11-29T11:17:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.028+0000 7feb82954740 20 client.7344 trim_cache size 0 max 16384 2023-11-29T11:17:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.048+0000 7feb82954740 1 Processor -- start 2023-11-29T11:17:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.048+0000 7feb82954740 1 -- start start 2023-11-29T11:17:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859710 0x1aef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1aefee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1af0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a2f6e0 con 0x18a4790 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b0ad50 con 0x1859710 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a30d60 con 0x1859ae0 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1af0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1af0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48522/0 (socket says 172.21.15.81:48522) 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 -- 172.21.15.81:0/2026723160 learned_addr learned my addr 172.21.15.81:0/2026723160 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7d470700 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859710 0x1aef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1aefee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 -- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 msgr2=0x1aefee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1aefee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 -- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859710 msgr2=0x1aef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859710 0x1aef9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 -- 172.21.15.81:0/2026723160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780c39b0 con 0x18a4790 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7d470700 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859710 0x1aef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb7dc71700 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1af0420 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7feb70009ba0 tx=0x7feb70010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbae07550e120f65 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb637fe700 1 -- 172.21.15.81:0/2026723160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7002a070 con 0x18a4790 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb637fe700 1 -- 172.21.15.81:0/2026723160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70011b00 con 0x18a4790 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb637fe700 1 -- 172.21.15.81:0/2026723160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70020040 con 0x18a4790 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 -- 172.21.15.81:0/2026723160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 msgr2=0x1af0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1af0420 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7feb70009ba0 tx=0x7feb70010000 comp rx=0 tx=0).stop 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 -- 172.21.15.81:0/2026723160 shutdown_connections 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1af0420 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859ae0 0x1aefee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 --2- 172.21.15.81:0/2026723160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859710 0x1aef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 -- 172.21.15.81:0/2026723160 >> 172.21.15.81:0/2026723160 conn(0x1859eb0 msgr2=0x1b0b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 -- 172.21.15.81:0/2026723160 shutdown_connections 2023-11-29T11:17:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.052+0000 7feb82954740 1 -- 172.21.15.81:0/2026723160 wait complete. 2023-11-29T11:17:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 1 -- start start 2023-11-29T11:17:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 1 Processor -- start 2023-11-29T11:17:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859710 0x1aef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b6f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1aeb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a34a30 con 0x18a4790 2023-11-29T11:17:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a2f2d0 con 0x1859ae0 2023-11-29T11:17:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a07de0 con 0x1859710 2023-11-29T11:17:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb82954740 10 client.0 _ll_register_callbacks cb 0x19de2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:17:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7dc71700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1aeb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7cc6f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b6f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7cc6f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b6f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59274/0 (socket says 172.21.15.81:59274) 2023-11-29T11:17:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7d470700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859710 0x1aef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7cc6f700 1 -- 172.21.15.81:0/4247413521 learned_addr learned my addr 172.21.15.81:0/4247413521 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7cc6f700 1 -- 172.21.15.81:0/4247413521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859710 msgr2=0x1aef350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859710 0x1aef350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7cc6f700 1 -- 172.21.15.81:0/4247413521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 msgr2=0x1aeb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1aeb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7cc6f700 1 -- 172.21.15.81:0/4247413521 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x18a59e0 con 0x1859ae0 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.056+0000 7feb7d470700 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859710 0x1aef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb7cc6f700 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b6f820 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb74051960 tx=0x7feb74056040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a73a3be9239966a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 1 -- 172.21.15.81:0/4247413521 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7406f040 con 0x1859ae0 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 1 -- 172.21.15.81:0/4247413521 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7feb7405b210 con 0x1859ae0 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 -- 172.21.15.81:0/4247413521 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb74057150 con 0x1859ae0 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 1 -- 172.21.15.81:0/4247413521 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb740020d0 con 0x1859ae0 2023-11-29T11:17:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 10 client.7093 fetch_fsmap learned FSMap version 40 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 -- 172.21.15.81:0/4247413521 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x7feb780705c0 con 0x1859ae0 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 1 -- 172.21.15.81:0/4247413521 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74057150 con 0x1859ae0 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 1 -- 172.21.15.81:0/4247413521 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 40) v1 ==== 3106+0+0 (secure 0 0 0) 0x7feb7406ab20 con 0x1859ae0 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 10 client.7093 fetch_fsmap finished waiting for FSMap version 40 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 10 client.7093 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 20 client.7093 populate_metadata read hostname 'smithi081' 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] conn(0x1aebb60 0x1aed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 4 client.7093 mds_command: new command op to 7185 tid=0[{"prefix": "status"}] 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 -- 172.21.15.81:0/4247413521 --> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] -- command(tid 0: {"prefix": "status"}) v1 -- 0x18d6260 con 0x1aebb60 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb7d470700 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] conn(0x1aebb60 0x1aed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 10 client.7093 ms_handle_connect on v2:172.21.15.81:6836/3247003029 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb7d470700 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] conn(0x1aebb60 0x1aed570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ac29c8c725edbde server_cookie=add0ff2130fa6205 in_seq=0 out_seq=0 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 1 -- 172.21.15.81:0/4247413521 <== mds.0 v2:172.21.15.81:6836/3247003029 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x18d6260 con 0x1aebb60 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 10 client.7093 handle_command_reply: tid=0 2023-11-29T11:17:45.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 client.7093 shutdown 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 -- 172.21.15.81:0/4247413521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 msgr2=0x1b6f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b6f820 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb74051960 tx=0x7feb74056040 comp rx=0 tx=0).stop 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 -- 172.21.15.81:0/4247413521 shutdown_connections 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.81:6836/3247003029,v1:172.21.15.81:6837/3247003029] conn(0x1aebb60 0x1aed570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x18a4790 0x1aeb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1859ae0 0x1b6f820 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb57fff700 0 client.7093 ms_handle_reset on v2:172.21.15.81:6836/3247003029 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 --2- 172.21.15.81:0/4247413521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1859710 0x1aef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 -- 172.21.15.81:0/4247413521 >> 172.21.15.81:0/4247413521 conn(0x1859eb0 msgr2=0x1aefbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 -- 172.21.15.81:0/4247413521 shutdown_connections 2023-11-29T11:17:45.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 1 -- 172.21.15.81:0/4247413521 wait complete. 2023-11-29T11:17:45.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.060+0000 7feb82954740 20 client.7093 trim_cache size 0 max 16384 2023-11-29T11:17:45.072 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:17:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:17:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:17:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7185, 2023-11-29T11:17:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:17:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:17:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.3183673450000004, 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 40, 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 83, 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 9.8807203749999992 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 -- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb5c064ee0 msgr2=0x7feb5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb5c064ee0 0x7feb5c067390 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feb781f8e50 tx=0x7feb68009240 comp rx=0 tx=0).stop 2023-11-29T11:17:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 -- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 msgr2=0x7feb780ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780ca120 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7feb74001f80 tx=0x7feb7400a340 comp rx=0 tx=0).stop 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 -- 172.21.15.81:0/736949382 shutdown_connections 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb5c064ee0 0x7feb5c067390 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb78160680 0x7feb780b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb780cd5e0 0x7feb780ca120 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 --2- 172.21.15.81:0/736949382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb78069c40 0x7feb780c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 -- 172.21.15.81:0/736949382 >> 172.21.15.81:0/736949382 conn(0x7feb7806caf0 msgr2=0x7feb780ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 -- 172.21.15.81:0/736949382 shutdown_connections 2023-11-29T11:17:45.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.064+0000 7feb7f6d4700 1 -- 172.21.15.81:0/736949382 wait complete. 2023-11-29T11:17:45.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3e4d8700 1 Processor -- start 2023-11-29T11:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3e4d8700 1 -- start start 2023-11-29T11:17:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3e4d8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f3815c150 0x7f9f381607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3e4d8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3815c520 con 0x7f9f380cc600 2023-11-29T11:17:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3e4d8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f380ca680 con 0x7f9f380c9e70 2023-11-29T11:17:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3e4d8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380ca960 con 0x7f9f3815c150 2023-11-29T11:17:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3d4d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f3815c150 0x7f9f381607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3dcd7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9f380cc600 0x7f9f380ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54024/0 (socket says 172.21.15.81:54024) 2023-11-29T11:17:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3dcd7700 1 -- 172.21.15.81:0/3893452859 learned_addr learned my addr 172.21.15.81:0/3893452859 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3d4d6700 1 -- 172.21.15.81:0/3893452859 >> v1:172.21.15.176:6789/0 conn(0x7f9f380c9e70 legacy=0x7f9f380cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3d4d6700 1 -- 172.21.15.81:0/3893452859 >> v1:172.21.15.81:6789/0 conn(0x7f9f380cc600 legacy=0x7f9f380ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3d4d6700 1 -- 172.21.15.81:0/3893452859 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380cd840 con 0x7f9f3815c150 2023-11-29T11:17:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f3d4d6700 1 --2- 172.21.15.81:0/3893452859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3815c150 0x7f9f381607b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009850 tx=0x7f9f34009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e4a291f14a7f0c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f2bfff700 1 -- 172.21.15.81:0/3893452859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34011830 con 0x7f9f3815c150 2023-11-29T11:17:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f2bfff700 1 -- 172.21.15.81:0/3893452859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34011990 con 0x7f9f3815c150 2023-11-29T11:17:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.200+0000 7f9f2bfff700 1 -- 172.21.15.81:0/3893452859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34011d20 con 0x7f9f3815c150 2023-11-29T11:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/3893452859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3815c150 msgr2=0x7f9f381607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 --2- 172.21.15.81:0/3893452859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3815c150 0x7f9f381607b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009850 tx=0x7f9f34009b60 comp rx=0 tx=0).stop 2023-11-29T11:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/3893452859 shutdown_connections 2023-11-29T11:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 --2- 172.21.15.81:0/3893452859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3815c150 0x7f9f381607b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/3893452859 >> 172.21.15.81:0/3893452859 conn(0x7f9f3806ec40 msgr2=0x7f9f380b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/3893452859 shutdown_connections 2023-11-29T11:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/3893452859 wait complete. 2023-11-29T11:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 Processor -- start 2023-11-29T11:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.204+0000 7f9f3e4d8700 1 -- start start 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f380c9e70 0x7f9f38153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f380cc600 0x7f9f3815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f3815c150 0x7f9f3806a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381f6090 con 0x7f9f380cc600 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381f51c0 con 0x7f9f3815c150 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3815f560 con 0x7f9f380c9e70 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f380cc600 0x7f9f3815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f380cc600 0x7f9f3815a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48552/0 (socket says 172.21.15.81:48552) 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 -- 172.21.15.81:0/2047511812 learned_addr learned my addr 172.21.15.81:0/2047511812 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3dcd7700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f3815c150 0x7f9f3806a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3d4d6700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f380c9e70 0x7f9f38153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 -- 172.21.15.81:0/2047511812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f380c9e70 msgr2=0x7f9f38153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f380c9e70 0x7f9f38153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 -- 172.21.15.81:0/2047511812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f3815c150 msgr2=0x7f9f3806a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f3815c150 0x7f9f3806a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 -- 172.21.15.81:0/2047511812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340094b0 con 0x7f9f380cc600 2023-11-29T11:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3ccd5700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f380cc600 0x7f9f3815a7e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c001ed0 tx=0x7f9f2c0021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f29ffb700 1 -- 172.21.15.81:0/2047511812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c003c20 con 0x7f9f380cc600 2023-11-29T11:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f29ffb700 1 -- 172.21.15.81:0/2047511812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c003d80 con 0x7f9f380cc600 2023-11-29T11:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f29ffb700 1 -- 172.21.15.81:0/2047511812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00ab40 con 0x7f9f380cc600 2023-11-29T11:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f380cde00 con 0x7f9f380cc600 2023-11-29T11:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f380cdb20 con 0x7f9f380cc600 2023-11-29T11:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.208+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f380ca2f0 con 0x7f9f380cc600 2023-11-29T11:17:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.212+0000 7f9f29ffb700 1 -- 172.21.15.81:0/2047511812 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9f2c010050 con 0x7f9f380cc600 2023-11-29T11:17:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.212+0000 7f9f29ffb700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f1c064f10 0x7f9f1c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.212+0000 7f9f29ffb700 1 -- 172.21.15.81:0/2047511812 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f9f2c082a10 con 0x7f9f380cc600 2023-11-29T11:17:45.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.212+0000 7f9f3d4d6700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f1c064f10 0x7f9f1c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:45.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.212+0000 7f9f3d4d6700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f1c064f10 0x7f9f1c0673c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9f34014040 tx=0x7f9f3401c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:45.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.216+0000 7f9f29ffb700 1 -- 172.21.15.81:0/2047511812 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9f2c050a50 con 0x7f9f380cc600 2023-11-29T11:17:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.412+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9f38072c20 con 0x7f9f380cc600 2023-11-29T11:17:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f29ffb700 1 -- 172.21.15.81:0/2047511812 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9f2c054070 con 0x7f9f380cc600 2023-11-29T11:17:45.422 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:17:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f1c064f10 msgr2=0x7f9f1c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f1c064f10 0x7f9f1c0673c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9f34014040 tx=0x7f9f3401c040 comp rx=0 tx=0).stop 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f380cc600 msgr2=0x7f9f3815a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f380cc600 0x7f9f3815a7e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c001ed0 tx=0x7f9f2c0021e0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 shutdown_connections 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f1c064f10 0x7f9f1c0673c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f3815c150 0x7f9f3806a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f380cc600 0x7f9f3815a7e0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 --2- 172.21.15.81:0/2047511812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f380c9e70 0x7f9f38153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 >> 172.21.15.81:0/2047511812 conn(0x7f9f3806ec40 msgr2=0x7f9f380aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 shutdown_connections 2023-11-29T11:17:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:45.416+0000 7f9f3e4d8700 1 -- 172.21.15.81:0/2047511812 wait complete. 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:17:45.437 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:17:45.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:45.437 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:17:45.442 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:17:45.442 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:17:45.443 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42301sec preferred_lft 42301sec 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:17:45.444 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:17:45.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:45.445 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:17:45.457 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:17:45.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:45.459 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:17:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:17:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:17:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:17:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:17:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:17:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:17:45.511 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:17:45.512 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:17:45.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:45.512 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:17:45.512 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:17:45.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:17:45.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:17:45.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:17:45.512 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:17:45.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:45.542 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:17:45.548 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:17:45.548 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:17:45.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:17:45.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:45.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:17:45.559 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:17:45.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:17:45.559 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:17:45.609 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:17:45.609 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:17:45.609 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:17:45.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:17:45.632 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:17:45.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:17:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:17:45.650 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:17:45.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:45.650 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:17:45.701 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:17:45.701 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:17:45.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:17:45.719 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:17:45.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:17:45.730 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:17:45.731 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:17:45.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:45.731 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:17:45.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:17:45.788+0000 7fe170bf3640 -1 init, newargv = 0x55c78a3d3660 newargc=15 2023-11-29T11:17:45.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[54751]: starting ceph client 2023-11-29T11:17:45.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[54751]: starting fuse 2023-11-29T11:17:46.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:17:46.906 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:17:46.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:17:46.921 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:17:46.921 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:17:46.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:46.922 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:17:46.972 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:17:46.972 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:17:46.973 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:17:46.974 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:17:46.975 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:17:46.975 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:17:46.975 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:17:46.975 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:17:46.975 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:17:47.057 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.54751.asok 2023-11-29T11:17:47.244 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54751.asok 2023-11-29T11:17:47.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:47.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54751.asok status 2023-11-29T11:17:47.345 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:17:47.345 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:17:47.345 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:17:47.345 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:17:47.345 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "54751", 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7365, 2023-11-29T11:17:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7365 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2254920966 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:17:47.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2254920966 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.7365 192.168.0.1:0/2254920966", 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2254920966", 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 40, 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 83, 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:17:47.348 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:17:47.349 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:17:47.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:47.355 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:17:47.355 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:17:47.362 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:17:47.362 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:17:47.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:47.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:17:47.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:47.380 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2023-11-29T11:17:47.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:47.400 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2023-11-29T11:17:47.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:47.456 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2023-11-29T11:17:47.467 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:17:47.467 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:17:47.467 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:17:47.468 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:17:47.468 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2023-11-29T11:17:47.468 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:17:47.535 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627776 2023-11-29T11:17:47.723 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:17:47.723 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:47.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.844+0000 7f5a91142700 1 Processor -- start 2023-11-29T11:17:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.844+0000 7f5a91142700 1 -- start start 2023-11-29T11:17:47.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a8c15c140 0x7f5a8c160850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:47.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5a8c06a860 0x7f5a8c0c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:47.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0ca490 con 0x7f5a8c0b1260 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c160d90 con 0x7f5a8c15c140 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c0ca6c0 con 0x7f5a8c06a860 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a8c15c140 0x7f5a8c160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a8c15c140 0x7f5a8c160850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48566/0 (socket says 172.21.15.81:48566) 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8ad9d700 1 -- 172.21.15.81:0/923277157 learned_addr learned my addr 172.21.15.81:0/923277157 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8259c700 1 --2- 172.21.15.81:0/923277157 >> v2:172.21.15.176:3300/0 conn(0x7f5a8c06a860 0x7f5a8c0c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8ad9d700 1 -- 172.21.15.81:0/923277157 >> v2:172.21.15.176:3300/0 conn(0x7f5a8c06a860 msgr2=0x7f5a8c0c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8ad9d700 1 --2- 172.21.15.81:0/923277157 >> v2:172.21.15.176:3300/0 conn(0x7f5a8c06a860 0x7f5a8c0c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8ad9d700 1 -- 172.21.15.81:0/923277157 >> v1:172.21.15.176:6789/0 conn(0x7f5a8c0b1260 legacy=0x7f5a8c071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8ad9d700 1 -- 172.21.15.81:0/923277157 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0ca9a0 con 0x7f5a8c15c140 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8ad9d700 1 --2- 172.21.15.81:0/923277157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c160850 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0cc200 tx=0x7f5a7c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8388b9cd7c9c305e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8a59c700 1 -- 172.21.15.81:0/923277157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00b8a0 con 0x7f5a8c15c140 2023-11-29T11:17:47.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8a59c700 1 -- 172.21.15.81:0/923277157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c00ba00 con 0x7f5a8c15c140 2023-11-29T11:17:47.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a8a59c700 1 -- 172.21.15.81:0/923277157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00bd90 con 0x7f5a8c15c140 2023-11-29T11:17:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 -- 172.21.15.81:0/923277157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 msgr2=0x7f5a8c160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 --2- 172.21.15.81:0/923277157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c160850 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0cc200 tx=0x7f5a7c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 -- 172.21.15.81:0/923277157 shutdown_connections 2023-11-29T11:17:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 --2- 172.21.15.81:0/923277157 >> v2:172.21.15.176:3300/0 conn(0x7f5a8c06a860 0x7f5a8c0c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 --2- 172.21.15.81:0/923277157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c160850 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 -- 172.21.15.81:0/923277157 >> 172.21.15.81:0/923277157 conn(0x7f5a8c0cc260 msgr2=0x7f5a8c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 -- 172.21.15.81:0/923277157 shutdown_connections 2023-11-29T11:17:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.848+0000 7f5a91142700 1 -- 172.21.15.81:0/923277157 wait complete. 2023-11-29T11:17:47.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 Processor -- start 2023-11-29T11:17:47.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 -- start start 2023-11-29T11:17:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a8c06a860 0x7f5a8c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0b1260 0x7f5a8c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c1eef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1f5f60 con 0x7f5a8c15c140 2023-11-29T11:17:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c15b9c0 con 0x7f5a8c0b1260 2023-11-29T11:17:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1e86c0 con 0x7f5a8c06a860 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c1eef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c1eef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48580/0 (socket says 172.21.15.81:48580) 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 -- 172.21.15.81:0/2483924214 learned_addr learned my addr 172.21.15.81:0/2483924214 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8ad9d700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a8c06a860 0x7f5a8c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8259c700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0b1260 0x7f5a8c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 -- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a8c06a860 msgr2=0x7f5a8c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a8c06a860 0x7f5a8c0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 -- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0b1260 msgr2=0x7f5a8c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0b1260 0x7f5a8c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 -- 172.21.15.81:0/2483924214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c009570 con 0x7f5a8c15c140 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8ad9d700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a8c06a860 0x7f5a8c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a8b59e700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c1eef20 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400cba0 tx=0x7f5a8400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a83fff700 1 -- 172.21.15.81:0/2483924214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84003c20 con 0x7f5a8c15c140 2023-11-29T11:17:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a83fff700 1 -- 172.21.15.81:0/2483924214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a84003d80 con 0x7f5a8c15c140 2023-11-29T11:17:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c0cd980 con 0x7f5a8c15c140 2023-11-29T11:17:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a83fff700 1 -- 172.21.15.81:0/2483924214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400ab10 con 0x7f5a8c15c140 2023-11-29T11:17:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.852+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c0cac80 con 0x7f5a8c15c140 2023-11-29T11:17:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.856+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c15c510 con 0x7f5a8c15c140 2023-11-29T11:17:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.856+0000 7f5a83fff700 1 -- 172.21.15.81:0/2483924214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5a84010050 con 0x7f5a8c15c140 2023-11-29T11:17:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.856+0000 7f5a83fff700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a6c064ee0 0x7f5a6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.856+0000 7f5a83fff700 1 -- 172.21.15.81:0/2483924214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f5a84081ea0 con 0x7f5a8c15c140 2023-11-29T11:17:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.856+0000 7f5a8ad9d700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a6c064ee0 0x7f5a6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.856+0000 7f5a8ad9d700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a6c064ee0 0x7f5a6c067390 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c000c00 tx=0x7f5a7c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:47.860+0000 7f5a83fff700 1 -- 172.21.15.81:0/2483924214 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5a8404fee0 con 0x7f5a8c15c140 2023-11-29T11:17:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.024+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a8c072c20 con 0x7f5a8c15c140 2023-11-29T11:17:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a83fff700 1 -- 172.21.15.81:0/2483924214 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+18071 (secure 0 0 0) 0x7f5a84053500 con 0x7f5a8c15c140 2023-11-29T11:17:48.035 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:48.035 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:43.407732+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a6c064ee0 msgr2=0x7f5a6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a6c064ee0 0x7f5a6c067390 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c000c00 tx=0x7f5a7c008030 comp rx=0 tx=0).stop 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 msgr2=0x7f5a8c1eef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c1eef20 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400cba0 tx=0x7f5a8400ceb0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 shutdown_connections 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a6c064ee0 0x7f5a6c067390 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8c15c140 0x7f5a8c1eef20 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a8c0b1260 0x7f5a8c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 --2- 172.21.15.81:0/2483924214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a8c06a860 0x7f5a8c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 >> 172.21.15.81:0/2483924214 conn(0x7f5a8c0cc260 msgr2=0x7f5a8c0b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 shutdown_connections 2023-11-29T11:17:48.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.028+0000 7f5a91142700 1 -- 172.21.15.81:0/2483924214 wait complete. 2023-11-29T11:17:48.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:17:38.310347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:17:38.742094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:17:48.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:17:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.160+0000 7ffae94f8700 1 Processor -- start 2023-11-29T11:17:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.160+0000 7ffae94f8700 1 -- start start 2023-11-29T11:17:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffae4159ec0 0x7ffae40c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffae4069c40 0x7ffae40cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae40cf690 con 0x7ffae40cf210 2023-11-29T11:17:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae40ca400 con 0x7ffae4069c40 2023-11-29T11:17:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae406b6d0 con 0x7ffae4159ec0 2023-11-29T11:17:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffae4069c40 0x7ffae40cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffae4069c40 0x7ffae40cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48596/0 (socket says 172.21.15.81:48596) 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae37fe700 1 -- 172.21.15.81:0/1509024198 learned_addr learned my addr 172.21.15.81:0/1509024198 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae3fff700 1 --2- 172.21.15.81:0/1509024198 >> v2:172.21.15.176:3300/0 conn(0x7ffae4159ec0 0x7ffae40c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae37fe700 1 -- 172.21.15.81:0/1509024198 >> v2:172.21.15.176:3300/0 conn(0x7ffae4159ec0 msgr2=0x7ffae40c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae37fe700 1 --2- 172.21.15.81:0/1509024198 >> v2:172.21.15.176:3300/0 conn(0x7ffae4159ec0 0x7ffae40c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae37fe700 1 -- 172.21.15.81:0/1509024198 >> v1:172.21.15.176:6789/0 conn(0x7ffae40cf210 legacy=0x7ffae415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae37fe700 1 -- 172.21.15.81:0/1509024198 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae406b9b0 con 0x7ffae4069c40 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae3fff700 1 --2- 172.21.15.81:0/1509024198 >> v2:172.21.15.176:3300/0 conn(0x7ffae4159ec0 0x7ffae40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae37fe700 1 --2- 172.21.15.81:0/1509024198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae40cecd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ffae406d4a0 tx=0x7ffad8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bf223217bfd069 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae2ffd700 1 -- 172.21.15.81:0/1509024198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad800b8a0 con 0x7ffae4069c40 2023-11-29T11:17:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae2ffd700 1 -- 172.21.15.81:0/1509024198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad800ba00 con 0x7ffae4069c40 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae2ffd700 1 -- 172.21.15.81:0/1509024198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad800bd90 con 0x7ffae4069c40 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 -- 172.21.15.81:0/1509024198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 msgr2=0x7ffae40cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1509024198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae40cecd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ffae406d4a0 tx=0x7ffad8009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 -- 172.21.15.81:0/1509024198 shutdown_connections 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1509024198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae40cecd0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1509024198 >> v2:172.21.15.176:3300/0 conn(0x7ffae4159ec0 0x7ffae40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 -- 172.21.15.81:0/1509024198 >> 172.21.15.81:0/1509024198 conn(0x7ffae406c660 msgr2=0x7ffae406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 -- 172.21.15.81:0/1509024198 shutdown_connections 2023-11-29T11:17:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.164+0000 7ffae94f8700 1 -- 172.21.15.81:0/1509024198 wait complete. 2023-11-29T11:17:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae94f8700 1 Processor -- start 2023-11-29T11:17:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae94f8700 1 -- start start 2023-11-29T11:17:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae94f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae94f8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae40cf210 0x7ffae415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae94f8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae4159ec0 0x7ffae4145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae94f8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae41ef690 con 0x7ffae4069c40 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae94f8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae40c6030 con 0x7ffae4159ec0 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae94f8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae40c6310 con 0x7ffae40cf210 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae415c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48604/0 (socket says 172.21.15.81:48604) 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae3fff700 1 -- 172.21.15.81:0/1088822372 learned_addr learned my addr 172.21.15.81:0/1088822372 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.168+0000 7ffae8cf7700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae4159ec0 0x7ffae4145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae37fe700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae40cf210 0x7ffae415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae3fff700 1 -- 172.21.15.81:0/1088822372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae40cf210 msgr2=0x7ffae415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae3fff700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae40cf210 0x7ffae415cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae3fff700 1 -- 172.21.15.81:0/1088822372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae4159ec0 msgr2=0x7ffae4145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae3fff700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae4159ec0 0x7ffae4145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae3fff700 1 -- 172.21.15.81:0/1088822372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad8009570 con 0x7ffae4069c40 2023-11-29T11:17:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae3fff700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae415c850 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ffad400e810 tx=0x7ffad400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae0ff9700 1 -- 172.21.15.81:0/1088822372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4005c40 con 0x7ffae4069c40 2023-11-29T11:17:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae0ff9700 1 -- 172.21.15.81:0/1088822372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad4005da0 con 0x7ffae4069c40 2023-11-29T11:17:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae40caa10 con 0x7ffae4069c40 2023-11-29T11:17:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae0ff9700 1 -- 172.21.15.81:0/1088822372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4004250 con 0x7ffae4069c40 2023-11-29T11:17:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae40cafd0 con 0x7ffae4069c40 2023-11-29T11:17:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae406bc90 con 0x7ffae4069c40 2023-11-29T11:17:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.172+0000 7ffae0ff9700 1 -- 172.21.15.81:0/1088822372 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffad4022070 con 0x7ffae4069c40 2023-11-29T11:17:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.176+0000 7ffae0ff9700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad0064ee0 0x7ffad0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.176+0000 7ffae0ff9700 1 -- 172.21.15.81:0/1088822372 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7ffad4081ef0 con 0x7ffae4069c40 2023-11-29T11:17:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.176+0000 7ffae37fe700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad0064ee0 0x7ffad0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.176+0000 7ffae37fe700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad0064ee0 0x7ffad0067390 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffae406d4a0 tx=0x7ffad8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.180+0000 7ffae0ff9700 1 -- 172.21.15.81:0/1088822372 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffad404ff30 con 0x7ffae4069c40 2023-11-29T11:17:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.336+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffae4072c20 con 0x7ffae4069c40 2023-11-29T11:17:48.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae0ff9700 1 -- 172.21.15.81:0/1088822372 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v83) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffad4053550 con 0x7ffae4069c40 2023-11-29T11:17:48.347 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad0064ee0 msgr2=0x7ffad0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad0064ee0 0x7ffad0067390 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffae406d4a0 tx=0x7ffad8008030 comp rx=0 tx=0).stop 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 msgr2=0x7ffae415c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae415c850 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ffad400e810 tx=0x7ffad400ebd0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 shutdown_connections 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad0064ee0 0x7ffad0067390 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae4159ec0 0x7ffae4145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae40cf210 0x7ffae415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 --2- 172.21.15.81:0/1088822372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffae4069c40 0x7ffae415c850 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 >> 172.21.15.81:0/1088822372 conn(0x7ffae406c660 msgr2=0x7ffae415df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 shutdown_connections 2023-11-29T11:17:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.340+0000 7ffae94f8700 1 -- 172.21.15.81:0/1088822372 wait complete. 2023-11-29T11:17:48.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:17:48.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.472+0000 7fe0d3fff700 1 Processor -- start 2023-11-29T11:17:48.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.472+0000 7fe0d3fff700 1 -- start start 2023-11-29T11:17:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe0d40cb310 0x7fe0d40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0d40cb6e0 0x7fe0d415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d415da30 con 0x7fe0d40b3540 2023-11-29T11:17:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d40b24a0 con 0x7fe0d40cb6e0 2023-11-29T11:17:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d40b2780 con 0x7fe0d40cb310 2023-11-29T11:17:48.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0ca7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0d40cb6e0 0x7fe0d415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0ca7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0d40cb6e0 0x7fe0d415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48618/0 (socket says 172.21.15.81:48618) 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0ca7fc700 1 -- 172.21.15.81:0/1535028726 learned_addr learned my addr 172.21.15.81:0/1535028726 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d2ffd700 1 --2- 172.21.15.81:0/1535028726 >> v2:172.21.15.176:3300/0 conn(0x7fe0d40cb310 0x7fe0d40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0ca7fc700 1 -- 172.21.15.81:0/1535028726 >> v2:172.21.15.176:3300/0 conn(0x7fe0d40cb310 msgr2=0x7fe0d40b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0ca7fc700 1 --2- 172.21.15.81:0/1535028726 >> v2:172.21.15.176:3300/0 conn(0x7fe0d40cb310 0x7fe0d40b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0ca7fc700 1 -- 172.21.15.81:0/1535028726 >> v1:172.21.15.176:6789/0 conn(0x7fe0d40b3540 legacy=0x7fe0d406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0ca7fc700 1 -- 172.21.15.81:0/1535028726 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d40b2a60 con 0x7fe0d40cb6e0 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0ca7fc700 1 --2- 172.21.15.81:0/1535028726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb6e0 0x7fe0d415d4f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4070320 tx=0x7fe0bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1854878549c8d7b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d27fc700 1 -- 172.21.15.81:0/1535028726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc011830 con 0x7fe0d40cb6e0 2023-11-29T11:17:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d27fc700 1 -- 172.21.15.81:0/1535028726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc011990 con 0x7fe0d40cb6e0 2023-11-29T11:17:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d27fc700 1 -- 172.21.15.81:0/1535028726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc011d20 con 0x7fe0d40cb6e0 2023-11-29T11:17:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1535028726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb6e0 msgr2=0x7fe0d415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1535028726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb6e0 0x7fe0d415d4f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4070320 tx=0x7fe0bc009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1535028726 shutdown_connections 2023-11-29T11:17:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1535028726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb6e0 0x7fe0d415d4f0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1535028726 >> v2:172.21.15.176:3300/0 conn(0x7fe0d40cb310 0x7fe0d40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1535028726 >> 172.21.15.81:0/1535028726 conn(0x7fe0d40cef50 msgr2=0x7fe0d40cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1535028726 shutdown_connections 2023-11-29T11:17:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.476+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1535028726 wait complete. 2023-11-29T11:17:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.480+0000 7fe0d3fff700 1 Processor -- start 2023-11-29T11:17:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.480+0000 7fe0d3fff700 1 -- start start 2023-11-29T11:17:48.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0d40b3540 0x7fe0d4140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb310 0x7fe0d4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0d40cb6e0 0x7fe0d415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4135ee0 con 0x7fe0d40cb310 2023-11-29T11:17:48.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4140f70 con 0x7fe0d40b3540 2023-11-29T11:17:48.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d415a810 con 0x7fe0d40cb6e0 2023-11-29T11:17:48.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb310 0x7fe0d4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d2ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0d40b3540 0x7fe0d4140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb310 0x7fe0d4156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48630/0 (socket says 172.21.15.81:48630) 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 -- 172.21.15.81:0/1093899978 learned_addr learned my addr 172.21.15.81:0/1093899978 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d37fe700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0d40cb6e0 0x7fe0d415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 -- 172.21.15.81:0/1093899978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0d40cb6e0 msgr2=0x7fe0d415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0d40cb6e0 0x7fe0d415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 -- 172.21.15.81:0/1093899978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0d40b3540 msgr2=0x7fe0d4140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0d40b3540 0x7fe0d4140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 -- 172.21.15.81:0/1093899978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc009570 con 0x7fe0d40cb310 2023-11-29T11:17:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0ca7fc700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb310 0x7fe0d4156c30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009f40 tx=0x7fe0bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d0ff9700 1 -- 172.21.15.81:0/1093899978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc004510 con 0x7fe0d40cb310 2023-11-29T11:17:48.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d0ff9700 1 -- 172.21.15.81:0/1093899978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc01e070 con 0x7fe0d40cb310 2023-11-29T11:17:48.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d0ff9700 1 -- 172.21.15.81:0/1093899978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc003900 con 0x7fe0d40cb310 2023-11-29T11:17:48.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d40b3020 con 0x7fe0d40cb310 2023-11-29T11:17:48.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.484+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d40b2d40 con 0x7fe0d40cb310 2023-11-29T11:17:48.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.488+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d40b3940 con 0x7fe0d40cb310 2023-11-29T11:17:48.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.488+0000 7fe0d0ff9700 1 -- 172.21.15.81:0/1093899978 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe0bc00f050 con 0x7fe0d40cb310 2023-11-29T11:17:48.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.488+0000 7fe0d0ff9700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0b8064ee0 0x7fe0b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.488+0000 7fe0d0ff9700 1 -- 172.21.15.81:0/1093899978 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fe0bc0831f0 con 0x7fe0d40cb310 2023-11-29T11:17:48.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.488+0000 7fe0d2ffd700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0b8064ee0 0x7fe0b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.488+0000 7fe0d2ffd700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0b8064ee0 0x7fe0b8067390 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009bf0 tx=0x7fe0c4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.496+0000 7fe0d0ff9700 1 -- 172.21.15.81:0/1093899978 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe0bc051140 con 0x7fe0d40cb310 2023-11-29T11:17:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.652+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0d4158b80 con 0x7fe0d40cb310 2023-11-29T11:17:48.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d0ff9700 1 -- 172.21.15.81:0/1093899978 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0d4158b80 con 0x7fe0d40cb310 2023-11-29T11:17:48.662 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0b8064ee0 msgr2=0x7fe0b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0b8064ee0 0x7fe0b8067390 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009bf0 tx=0x7fe0c4009240 comp rx=0 tx=0).stop 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb310 msgr2=0x7fe0d4156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb310 0x7fe0d4156c30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009f40 tx=0x7fe0bc004770 comp rx=0 tx=0).stop 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 shutdown_connections 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0b8064ee0 0x7fe0b8067390 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0d40cb6e0 0x7fe0d415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d40cb310 0x7fe0d4156c30 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 --2- 172.21.15.81:0/1093899978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0d40b3540 0x7fe0d4140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 >> 172.21.15.81:0/1093899978 conn(0x7fe0d40cef50 msgr2=0x7fe0d4164450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:48.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 shutdown_connections 2023-11-29T11:17:48.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.656+0000 7fe0d3fff700 1 -- 172.21.15.81:0/1093899978 wait complete. 2023-11-29T11:17:48.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:17:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918f59e700 1 Processor -- start 2023-11-29T11:17:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918f59e700 1 -- start start 2023-11-29T11:17:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 0x7f919015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f919009bdb0 0x7f919015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91900cbb30 0x7f919015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91900b2db0 con 0x7f919009bdb0 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91900b3240 con 0x7f91900cbb30 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919006d840 con 0x7f91900b00e0 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f919009bdb0 0x7f919015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f919009bdb0 0x7f919015d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48632/0 (socket says 172.21.15.81:48632) 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918dd9b700 1 -- 172.21.15.81:0/4264274681 learned_addr learned my addr 172.21.15.81:0/4264274681 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918ed9d700 1 --2- 172.21.15.81:0/4264274681 >> v2:172.21.15.176:3300/0 conn(0x7f91900cbb30 0x7f919015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918e59c700 1 --2- 172.21.15.81:0/4264274681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 0x7f919015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918dd9b700 1 -- 172.21.15.81:0/4264274681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 msgr2=0x7f919015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918dd9b700 1 --2- 172.21.15.81:0/4264274681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 0x7f919015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918dd9b700 1 -- 172.21.15.81:0/4264274681 >> v2:172.21.15.176:3300/0 conn(0x7f91900cbb30 msgr2=0x7f919015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918dd9b700 1 --2- 172.21.15.81:0/4264274681 >> v2:172.21.15.176:3300/0 conn(0x7f91900cbb30 0x7f919015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.784+0000 7f918dd9b700 1 -- 172.21.15.81:0/4264274681 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919006d560 con 0x7f919009bdb0 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918dd9b700 1 --2- 172.21.15.81:0/4264274681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f919009bdb0 0x7f919015d820 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f91900ac6b0 tx=0x7f9188009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de04167844b90c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918d59a700 1 -- 172.21.15.81:0/4264274681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188011830 con 0x7f919009bdb0 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918d59a700 1 -- 172.21.15.81:0/4264274681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188011990 con 0x7f919009bdb0 2023-11-29T11:17:48.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918d59a700 1 -- 172.21.15.81:0/4264274681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188011d20 con 0x7f919009bdb0 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 -- 172.21.15.81:0/4264274681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f919009bdb0 msgr2=0x7f919015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 --2- 172.21.15.81:0/4264274681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f919009bdb0 0x7f919015d820 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f91900ac6b0 tx=0x7f9188009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 -- 172.21.15.81:0/4264274681 shutdown_connections 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 --2- 172.21.15.81:0/4264274681 >> v2:172.21.15.176:3300/0 conn(0x7f91900cbb30 0x7f919015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 --2- 172.21.15.81:0/4264274681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f919009bdb0 0x7f919015d820 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 --2- 172.21.15.81:0/4264274681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 0x7f919015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 -- 172.21.15.81:0/4264274681 >> 172.21.15.81:0/4264274681 conn(0x7f91900cae70 msgr2=0x7f91900cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 -- 172.21.15.81:0/4264274681 shutdown_connections 2023-11-29T11:17:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 -- 172.21.15.81:0/4264274681 wait complete. 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 Processor -- start 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.788+0000 7f918f59e700 1 -- start start 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919009bdb0 0x7f9190151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 0x7f91900c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbb30 0x7f91901504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190152430 con 0x7f91900cbb30 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91901518b0 con 0x7f919009bdb0 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9190151b90 con 0x7f91900b00e0 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbb30 0x7f91901504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbb30 0x7f91901504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48642/0 (socket says 172.21.15.81:48642) 2023-11-29T11:17:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 -- 172.21.15.81:0/2143857774 learned_addr learned my addr 172.21.15.81:0/2143857774 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918e59c700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919009bdb0 0x7f9190151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918dd9b700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 0x7f91900c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 -- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 msgr2=0x7f91900c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 0x7f91900c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 -- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919009bdb0 msgr2=0x7f9190151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919009bdb0 0x7f9190151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 -- 172.21.15.81:0/2143857774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009570 con 0x7f91900cbb30 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918e59c700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919009bdb0 0x7f9190151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918ed9d700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbb30 0x7f91901504f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f918000efc0 tx=0x7f918000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f9186ffd700 1 -- 172.21.15.81:0/2143857774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180009b20 con 0x7f91900cbb30 2023-11-29T11:17:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f9186ffd700 1 -- 172.21.15.81:0/2143857774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918000f040 con 0x7f91900cbb30 2023-11-29T11:17:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91900ac3d0 con 0x7f91900cbb30 2023-11-29T11:17:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f9186ffd700 1 -- 172.21.15.81:0/2143857774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180009e50 con 0x7f91900cbb30 2023-11-29T11:17:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91900ac0f0 con 0x7f91900cbb30 2023-11-29T11:17:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f9186ffd700 1 -- 172.21.15.81:0/2143857774 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9180014480 con 0x7f91900cbb30 2023-11-29T11:17:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91900cc9f0 con 0x7f91900cbb30 2023-11-29T11:17:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f9186ffd700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9170064ee0 0x7f9170067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f9186ffd700 1 -- 172.21.15.81:0/2143857774 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f9180082cb0 con 0x7f91900cbb30 2023-11-29T11:17:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.792+0000 7f918e59c700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9170064ee0 0x7f9170067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.796+0000 7f918e59c700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9170064ee0 0x7f9170067390 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9178009bc0 tx=0x7f9178008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:48.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.800+0000 7f9186ffd700 1 -- 172.21.15.81:0/2143857774 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9180050c90 con 0x7f91900cbb30 2023-11-29T11:17:48.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.960+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9190072500 con 0x7f91900cbb30 2023-11-29T11:17:48.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f9186ffd700 1 -- 172.21.15.81:0/2143857774 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9180018020 con 0x7f91900cbb30 2023-11-29T11:17:48.971 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:17:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9170064ee0 msgr2=0x7f9170067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9170064ee0 0x7f9170067390 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9178009bc0 tx=0x7f9178008040 comp rx=0 tx=0).stop 2023-11-29T11:17:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbb30 msgr2=0x7f91901504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbb30 0x7f91901504f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f918000efc0 tx=0x7f918000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 shutdown_connections 2023-11-29T11:17:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9170064ee0 0x7f9170067390 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91900cbb30 0x7f91901504f0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91900b00e0 0x7f91900c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 --2- 172.21.15.81:0/2143857774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f919009bdb0 0x7f9190151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 >> 172.21.15.81:0/2143857774 conn(0x7f91900cae70 msgr2=0x7f91900ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 shutdown_connections 2023-11-29T11:17:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:48.964+0000 7f918f59e700 1 -- 172.21.15.81:0/2143857774 wait complete. 2023-11-29T11:17:48.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:17:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.100+0000 7f777e928700 1 Processor -- start 2023-11-29T11:17:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.100+0000 7f777e928700 1 -- start start 2023-11-29T11:17:49.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.100+0000 7f777e928700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7770038560 0x7f777003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.100+0000 7f777e928700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f777003b160 0x7f7770057210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.100+0000 7f777e928700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7770007360 con 0x7f77700e29f0 2023-11-29T11:17:49.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.100+0000 7f777e928700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777003b5e0 con 0x7f7770038560 2023-11-29T11:17:49.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.100+0000 7f777e928700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700e2dc0 con 0x7f777003b160 2023-11-29T11:17:49.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d125700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7770038560 0x7f777003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d125700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7770038560 0x7f777003ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48654/0 (socket says 172.21.15.81:48654) 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d125700 1 -- 172.21.15.81:0/3141972143 learned_addr learned my addr 172.21.15.81:0/3141972143 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d926700 1 --1- 172.21.15.81:0/3141972143 >> v1:172.21.15.81:6789/0 conn(0x7f77700e29f0 0x7f7770055490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54030/0 (socket says 172.21.15.81:54030) 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e127700 1 --2- 172.21.15.81:0/3141972143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f777003b160 0x7f7770057210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d125700 1 -- 172.21.15.81:0/3141972143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f777003b160 msgr2=0x7f7770057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d125700 1 --2- 172.21.15.81:0/3141972143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f777003b160 0x7f7770057210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d125700 1 -- 172.21.15.81:0/3141972143 >> v1:172.21.15.81:6789/0 conn(0x7f77700e29f0 legacy=0x7f7770055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d125700 1 -- 172.21.15.81:0/3141972143 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770053f70 con 0x7f7770038560 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e127700 1 --2- 172.21.15.81:0/3141972143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f777003b160 0x7f7770057210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777d125700 1 --2- 172.21.15.81:0/3141972143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f777003ac20 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7774009910 tx=0x7f7774009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872d58d9c7955192 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777c924700 1 -- 172.21.15.81:0/3141972143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777400ba60 con 0x7f7770038560 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777c924700 1 -- 172.21.15.81:0/3141972143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400bbc0 con 0x7f7770038560 2023-11-29T11:17:49.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777c924700 1 -- 172.21.15.81:0/3141972143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774009e60 con 0x7f7770038560 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e928700 1 -- 172.21.15.81:0/3141972143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 msgr2=0x7f777003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e928700 1 --2- 172.21.15.81:0/3141972143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f777003ac20 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7774009910 tx=0x7f7774009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e928700 1 -- 172.21.15.81:0/3141972143 shutdown_connections 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e928700 1 --2- 172.21.15.81:0/3141972143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f777003b160 0x7f7770057210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e928700 1 --2- 172.21.15.81:0/3141972143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f777003ac20 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e928700 1 -- 172.21.15.81:0/3141972143 >> 172.21.15.81:0/3141972143 conn(0x7f7770055c20 msgr2=0x7f7770056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e928700 1 -- 172.21.15.81:0/3141972143 shutdown_connections 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.104+0000 7f777e928700 1 -- 172.21.15.81:0/3141972143 wait complete. 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 Processor -- start 2023-11-29T11:17:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 -- start start 2023-11-29T11:17:49.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f77701796b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f777003b160 0x7f777017b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77700e29f0 0x7f777004e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777017b920 con 0x7f7770038560 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7770178840 con 0x7f777003b160 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7770178b20 con 0x7f77700e29f0 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f77701796b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f77701796b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48664/0 (socket says 172.21.15.81:48664) 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 -- 172.21.15.81:0/2421664639 learned_addr learned my addr 172.21.15.81:0/2421664639 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e127700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77700e29f0 0x7f777004e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d125700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f777003b160 0x7f777017b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 -- 172.21.15.81:0/2421664639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77700e29f0 msgr2=0x7f777004e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77700e29f0 0x7f777004e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 -- 172.21.15.81:0/2421664639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f777003b160 msgr2=0x7f777017b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f777003b160 0x7f777017b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 -- 172.21.15.81:0/2421664639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774009570 con 0x7f7770038560 2023-11-29T11:17:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777d926700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f77701796b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f776800c4d0 tx=0x7f776800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f776e7fc700 1 -- 172.21.15.81:0/2421664639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768005cd0 con 0x7f7770038560 2023-11-29T11:17:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f776e7fc700 1 -- 172.21.15.81:0/2421664639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768005e30 con 0x7f7770038560 2023-11-29T11:17:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7770007080 con 0x7f7770038560 2023-11-29T11:17:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f776e7fc700 1 -- 172.21.15.81:0/2421664639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680072d0 con 0x7f7770038560 2023-11-29T11:17:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7770006dc0 con 0x7f7770038560 2023-11-29T11:17:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.108+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7770053920 con 0x7f7770038560 2023-11-29T11:17:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.112+0000 7f776e7fc700 1 -- 172.21.15.81:0/2421664639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7768019030 con 0x7f7770038560 2023-11-29T11:17:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.112+0000 7f776e7fc700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f775c064f10 0x7f775c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.112+0000 7f776e7fc700 1 -- 172.21.15.81:0/2421664639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f77680811d0 con 0x7f7770038560 2023-11-29T11:17:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.112+0000 7f777d125700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f775c064f10 0x7f775c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.112+0000 7f777d125700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f775c064f10 0x7f775c0673c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7770038930 tx=0x7f7774008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.120+0000 7f776e7fc700 1 -- 172.21.15.81:0/2421664639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f776804a400 con 0x7f7770038560 2023-11-29T11:17:49.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.284+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f777004ccd0 con 0x7f7770038560 2023-11-29T11:17:49.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.284+0000 7f776e7fc700 1 -- 172.21.15.81:0/2421664639 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7768017020 con 0x7f7770038560 2023-11-29T11:17:49.292 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f775c064f10 msgr2=0x7f775c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f775c064f10 0x7f775c0673c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7770038930 tx=0x7f7774008030 comp rx=0 tx=0).stop 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 msgr2=0x7f77701796b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f77701796b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f776800c4d0 tx=0x7f776800c890 comp rx=0 tx=0).stop 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 shutdown_connections 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f775c064f10 0x7f775c0673c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77700e29f0 0x7f777004e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f777003b160 0x7f777017b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 --2- 172.21.15.81:0/2421664639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7770038560 0x7f77701796b0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 >> 172.21.15.81:0/2421664639 conn(0x7f7770055c20 msgr2=0x7f777003c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 shutdown_connections 2023-11-29T11:17:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.288+0000 7f777e928700 1 -- 172.21.15.81:0/2421664639 wait complete. 2023-11-29T11:17:49.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:17:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.416+0000 7f481d17f700 1 Processor -- start 2023-11-29T11:17:49.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.416+0000 7f481d17f700 1 -- start start 2023-11-29T11:17:49.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4818069c40 0x7f48180cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48180cb2a0 0x7f48180c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481806ace0 con 0x7f4818159e70 2023-11-29T11:17:49.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48180cb720 con 0x7f4818069c40 2023-11-29T11:17:49.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481806a0d0 con 0x7f48180cb2a0 2023-11-29T11:17:49.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481c97e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48180cb2a0 0x7f48180c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f480ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4818069c40 0x7f48180cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481c97e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48180cb2a0 0x7f48180c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:57996/0 (socket says 172.21.15.81:57996) 2023-11-29T11:17:49.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f480ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4818069c40 0x7f48180cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59354/0 (socket says 172.21.15.81:59354) 2023-11-29T11:17:49.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481c97e700 1 -- 172.21.15.81:0/1928669968 learned_addr learned my addr 172.21.15.81:0/1928669968 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:49.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f4817fff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f4818159e70 0x7f481806c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:41982/0 (socket says 172.21.15.81:41982) 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481c97e700 1 -- 172.21.15.81:0/1928669968 >> v2:172.21.15.176:3300/0 conn(0x7f4818069c40 msgr2=0x7f48180cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481c97e700 1 --2- 172.21.15.81:0/1928669968 >> v2:172.21.15.176:3300/0 conn(0x7f4818069c40 0x7f48180cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481c97e700 1 -- 172.21.15.81:0/1928669968 >> v1:172.21.15.176:6789/0 conn(0x7f4818159e70 legacy=0x7f481806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481c97e700 1 -- 172.21.15.81:0/1928669968 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481806a3b0 con 0x7f48180cb2a0 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f480ffff700 1 --2- 172.21.15.81:0/1928669968 >> v2:172.21.15.176:3300/0 conn(0x7f4818069c40 0x7f48180cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481c97e700 1 --2- 172.21.15.81:0/1928669968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48180cb2a0 0x7f48180c91d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4810009e50 tx=0x7f481000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5421f637b306880 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f48177fe700 1 -- 172.21.15.81:0/1928669968 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000e070 con 0x7f48180cb2a0 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f48177fe700 1 -- 172.21.15.81:0/1928669968 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000b910 con 0x7f48180cb2a0 2023-11-29T11:17:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f48177fe700 1 -- 172.21.15.81:0/1928669968 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000bcc0 con 0x7f48180cb2a0 2023-11-29T11:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 -- 172.21.15.81:0/1928669968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48180cb2a0 msgr2=0x7f48180c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 --2- 172.21.15.81:0/1928669968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48180cb2a0 0x7f48180c91d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4810009e50 tx=0x7f481000b330 comp rx=0 tx=0).stop 2023-11-29T11:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 -- 172.21.15.81:0/1928669968 shutdown_connections 2023-11-29T11:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 --2- 172.21.15.81:0/1928669968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48180cb2a0 0x7f48180c91d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 --2- 172.21.15.81:0/1928669968 >> v2:172.21.15.176:3300/0 conn(0x7f4818069c40 0x7f48180cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 -- 172.21.15.81:0/1928669968 >> 172.21.15.81:0/1928669968 conn(0x7f48180ce3e0 msgr2=0x7f48180ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 -- 172.21.15.81:0/1928669968 shutdown_connections 2023-11-29T11:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.420+0000 7f481d17f700 1 -- 172.21.15.81:0/1928669968 wait complete. 2023-11-29T11:17:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 Processor -- start 2023-11-29T11:17:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 -- start start 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4818069c40 0x7f48180ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48180cb2a0 0x7f48180ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4818159e70 0x7f48181f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48181f30d0 con 0x7f48180cb2a0 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48180c34c0 con 0x7f4818069c40 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48181f2430 con 0x7f4818159e70 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48180cb2a0 0x7f48180ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48180cb2a0 0x7f48180ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48674/0 (socket says 172.21.15.81:48674) 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 -- 172.21.15.81:0/2292038894 learned_addr learned my addr 172.21.15.81:0/2292038894 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f4817fff700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4818069c40 0x7f48180ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481c97e700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4818159e70 0x7f48181f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 -- 172.21.15.81:0/2292038894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4818159e70 msgr2=0x7f48181f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4818159e70 0x7f48181f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 -- 172.21.15.81:0/2292038894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4818069c40 msgr2=0x7f48180ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4818069c40 0x7f48180ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 -- 172.21.15.81:0/2292038894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000094b0 con 0x7f48180cb2a0 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f480ffff700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48180cb2a0 0x7f48180ac7e0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f480000ebe0 tx=0x7f480000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f48157fa700 1 -- 172.21.15.81:0/2292038894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480000c850 con 0x7f48180cb2a0 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f48157fa700 1 -- 172.21.15.81:0/2292038894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480000c9b0 con 0x7f48180cb2a0 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4810009b30 con 0x7f48180cb2a0 2023-11-29T11:17:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f48157fa700 1 -- 172.21.15.81:0/2292038894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480000cd40 con 0x7f48180cb2a0 2023-11-29T11:17:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.424+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481806a970 con 0x7f48180cb2a0 2023-11-29T11:17:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.428+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481806a690 con 0x7f48180cb2a0 2023-11-29T11:17:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.428+0000 7f48157fa700 1 -- 172.21.15.81:0/2292038894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4800019030 con 0x7f48180cb2a0 2023-11-29T11:17:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.428+0000 7f48157fa700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f47f8064ee0 0x7f47f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.428+0000 7f48157fa700 1 -- 172.21.15.81:0/2292038894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f4800082020 con 0x7f48180cb2a0 2023-11-29T11:17:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.428+0000 7f4817fff700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f47f8064ee0 0x7f47f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.428+0000 7f4817fff700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f47f8064ee0 0x7f47f8067390 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f48180ad5e0 tx=0x7f4808007f30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.440+0000 7f48157fa700 1 -- 172.21.15.81:0/2292038894 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f480004ffe0 con 0x7f48180cb2a0 2023-11-29T11:17:49.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.616+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f481806b6d0 con 0x7f48180cb2a0 2023-11-29T11:17:49.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.616+0000 7f48157fa700 1 -- 172.21.15.81:0/2292038894 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7f480000cea0 con 0x7f48180cb2a0 2023-11-29T11:17:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f47f8064ee0 msgr2=0x7f47f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f47f8064ee0 0x7f47f8067390 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f48180ad5e0 tx=0x7f4808007f30 comp rx=0 tx=0).stop 2023-11-29T11:17:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48180cb2a0 msgr2=0x7f48180ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48180cb2a0 0x7f48180ac7e0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f480000ebe0 tx=0x7f480000eef0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 shutdown_connections 2023-11-29T11:17:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f47f8064ee0 0x7f47f8067390 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4818159e70 0x7f48181f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48180cb2a0 0x7f48180ac7e0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 --2- 172.21.15.81:0/2292038894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4818069c40 0x7f48180ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 >> 172.21.15.81:0/2292038894 conn(0x7f48180ce3e0 msgr2=0x7f48180b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:49.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 shutdown_connections 2023-11-29T11:17:49.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.620+0000 7f481d17f700 1 -- 172.21.15.81:0/2292038894 wait complete. 2023-11-29T11:17:49.628 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:17:49.639 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:17:49.639 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:17:49.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:17:49.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4bfff700 1 Processor -- start 2023-11-29T11:17:49.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4bfff700 1 -- start start 2023-11-29T11:17:49.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c0d2e90 0x7fba4c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0cf070 con 0x7fba4c0b1ca0 2023-11-29T11:17:49.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0b2070 con 0x7fba4c06a330 2023-11-29T11:17:49.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c06a8a0 con 0x7fba4c0d2e90 2023-11-29T11:17:49.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fba4c0b1ca0 0x7fba4c0cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43930/0 (socket says 172.21.15.81:43930) 2023-11-29T11:17:49.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4affd700 1 -- 172.21.15.81:0/4222245514 learned_addr learned my addr 172.21.15.81:0/4222245514 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:49.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4b7fe700 1 --2- 172.21.15.81:0/4222245514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c0d2e90 0x7fba4c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba49ffb700 1 -- 172.21.15.81:0/4222245514 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737283229 0 0) 0x7fba4c0b2070 con 0x7fba4c06a330 2023-11-29T11:17:49.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba49ffb700 1 -- 172.21.15.81:0/4222245514 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba340035d0 con 0x7fba4c06a330 2023-11-29T11:17:49.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba49ffb700 1 -- 172.21.15.81:0/4222245514 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548547386 0 0) 0x7fba4c0cf070 con 0x7fba4c0b1ca0 2023-11-29T11:17:49.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba49ffb700 1 -- 172.21.15.81:0/4222245514 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba4c0b2070 con 0x7fba4c0b1ca0 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4b7fe700 1 -- 172.21.15.81:0/4222245514 >> v1:172.21.15.176:6789/0 conn(0x7fba4c06a330 legacy=0x7fba4c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4b7fe700 1 -- 172.21.15.81:0/4222245514 >> v1:172.21.15.81:6789/0 conn(0x7fba4c0b1ca0 legacy=0x7fba4c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.744+0000 7fba4b7fe700 1 -- 172.21.15.81:0/4222245514 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c06ab80 con 0x7fba4c0d2e90 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4b7fe700 1 --2- 172.21.15.81:0/4222245514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c0d2e90 0x7fba4c0b6250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fba44009dc0 tx=0x7fba4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3327f79f3d44ea61 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba49ffb700 1 -- 172.21.15.81:0/4222245514 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400e070 con 0x7fba4c0d2e90 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba49ffb700 1 -- 172.21.15.81:0/4222245514 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4400bb20 con 0x7fba4c0d2e90 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba49ffb700 1 -- 172.21.15.81:0/4222245514 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44012430 con 0x7fba4c0d2e90 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 -- 172.21.15.81:0/4222245514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c0d2e90 msgr2=0x7fba4c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 --2- 172.21.15.81:0/4222245514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c0d2e90 0x7fba4c0b6250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fba44009dc0 tx=0x7fba4400b330 comp rx=0 tx=0).stop 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 -- 172.21.15.81:0/4222245514 shutdown_connections 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 --2- 172.21.15.81:0/4222245514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c0d2e90 0x7fba4c0b6250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 -- 172.21.15.81:0/4222245514 >> 172.21.15.81:0/4222245514 conn(0x7fba4c0b5740 msgr2=0x7fba4c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:49.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 -- 172.21.15.81:0/4222245514 shutdown_connections 2023-11-29T11:17:49.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 -- 172.21.15.81:0/4222245514 wait complete. 2023-11-29T11:17:49.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 Processor -- start 2023-11-29T11:17:49.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.748+0000 7fba4bfff700 1 -- start start 2023-11-29T11:17:49.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c06a330 0x7fba4c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4c0b1ca0 0x7fba4c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c0d2e90 0x7fba4c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c150b30 con 0x7fba4c0d2e90 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c15f940 con 0x7fba4c0b1ca0 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c0b3470 con 0x7fba4c06a330 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c0d2e90 0x7fba4c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c0d2e90 0x7fba4c0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37676/0 (socket says 172.21.15.81:37676) 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 -- 172.21.15.81:0/2587568148 learned_addr learned my addr 172.21.15.81:0/2587568148 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4affd700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c06a330 0x7fba4c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4a7fc700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4c0b1ca0 0x7fba4c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 -- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c06a330 msgr2=0x7fba4c1505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c06a330 0x7fba4c1505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 -- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4c0b1ca0 msgr2=0x7fba4c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4c0b1ca0 0x7fba4c15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 -- 172.21.15.81:0/2587568148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44009a70 con 0x7fba4c0d2e90 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4a7fc700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4c0b1ca0 0x7fba4c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4affd700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c06a330 0x7fba4c1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4b7fe700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c0d2e90 0x7fba4c0b48d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fba44013000 tx=0x7fba44004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba337fe700 1 -- 172.21.15.81:0/2587568148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44012430 con 0x7fba4c0d2e90 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba337fe700 1 -- 172.21.15.81:0/2587568148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba44020070 con 0x7fba4c0d2e90 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c06b140 con 0x7fba4c0d2e90 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba337fe700 1 -- 172.21.15.81:0/2587568148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4401ba90 con 0x7fba4c0d2e90 2023-11-29T11:17:49.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c06ae60 con 0x7fba4c0d2e90 2023-11-29T11:17:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.752+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c072c20 con 0x7fba4c0d2e90 2023-11-29T11:17:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.756+0000 7fba337fe700 1 -- 172.21.15.81:0/2587568148 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba4401bbf0 con 0x7fba4c0d2e90 2023-11-29T11:17:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.756+0000 7fba337fe700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba38064ee0 0x7fba38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.756+0000 7fba337fe700 1 -- 172.21.15.81:0/2587568148 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fba44022070 con 0x7fba4c0d2e90 2023-11-29T11:17:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.756+0000 7fba4affd700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba38064ee0 0x7fba38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.756+0000 7fba4affd700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba38064ee0 0x7fba38067390 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba3c007fd0 tx=0x7fba3c007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:49.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.764+0000 7fba337fe700 1 -- 172.21.15.81:0/2587568148 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba44052530 con 0x7fba4c0d2e90 2023-11-29T11:17:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.924+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba4c0b2eb0 con 0x7fba4c0d2e90 2023-11-29T11:17:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.924+0000 7fba337fe700 1 -- 172.21.15.81:0/2587568148 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+18071 (secure 0 0 0) 0x7fba4402c090 con 0x7fba4c0d2e90 2023-11-29T11:17:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:49.934 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:43.407732+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:17:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba38064ee0 msgr2=0x7fba38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba38064ee0 0x7fba38067390 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba3c007fd0 tx=0x7fba3c007de0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c0d2e90 msgr2=0x7fba4c0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c0d2e90 0x7fba4c0b48d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fba44013000 tx=0x7fba44004af0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 shutdown_connections 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba38064ee0 0x7fba38067390 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba4c0d2e90 0x7fba4c0b48d0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba4c0b1ca0 0x7fba4c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 --2- 172.21.15.81:0/2587568148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba4c06a330 0x7fba4c1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 >> 172.21.15.81:0/2587568148 conn(0x7fba4c0b5740 msgr2=0x7fba4c0d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 shutdown_connections 2023-11-29T11:17:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:49.928+0000 7fba4bfff700 1 -- 172.21.15.81:0/2587568148 wait complete. 2023-11-29T11:17:49.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:17:38.310347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:17:38.742094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:17:49.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:17:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd548f7700 1 Processor -- start 2023-11-29T11:17:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd548f7700 1 -- start start 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd548f7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd50158ee0 0x7fdd500ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd548f7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdd500cd5d0 0x7fdd500cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd548f7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5006d1c0 con 0x7fdd500ce060 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd548f7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5006e000 con 0x7fdd50158ee0 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd548f7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd500ce460 con 0x7fdd500cd5d0 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd50158ee0 0x7fdd500ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd500ce060 0x7fdd5015c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43932/0 (socket says 172.21.15.81:43932) 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4ffff700 1 -- 172.21.15.81:0/1646895141 learned_addr learned my addr 172.21.15.81:0/1646895141 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4effd700 1 --2- 172.21.15.81:0/1646895141 >> v2:172.21.15.176:3300/0 conn(0x7fdd500cd5d0 0x7fdd500cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4e7fc700 1 -- 172.21.15.81:0/1646895141 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815322129 0 0) 0x7fdd48001490 con 0x7fdd500ce060 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4e7fc700 1 -- 172.21.15.81:0/1646895141 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd380035d0 con 0x7fdd500ce060 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4f7fe700 1 -- 172.21.15.81:0/1646895141 >> v2:172.21.15.176:3300/0 conn(0x7fdd500cd5d0 msgr2=0x7fdd500cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:50.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4e7fc700 1 -- 172.21.15.81:0/1646895141 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2301118252 0 0) 0x7fdd380035d0 con 0x7fdd500ce060 2023-11-29T11:17:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4f7fe700 1 --2- 172.21.15.81:0/1646895141 >> v2:172.21.15.176:3300/0 conn(0x7fdd500cd5d0 0x7fdd500cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4f7fe700 1 -- 172.21.15.81:0/1646895141 >> v1:172.21.15.81:6789/0 conn(0x7fdd500ce060 legacy=0x7fdd5015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4f7fe700 1 -- 172.21.15.81:0/1646895141 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500ca3a0 con 0x7fdd50158ee0 2023-11-29T11:17:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4effd700 1 --2- 172.21.15.81:0/1646895141 >> v2:172.21.15.176:3300/0 conn(0x7fdd500cd5d0 0x7fdd500cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.060+0000 7fdd4f7fe700 1 --2- 172.21.15.81:0/1646895141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd50158ee0 0x7fdd500ae760 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fdd5015d8f0 tx=0x7fdd44009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9bb1b610f54572 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd4e7fc700 1 -- 172.21.15.81:0/1646895141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48001b80 con 0x7fdd50158ee0 2023-11-29T11:17:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd4e7fc700 1 -- 172.21.15.81:0/1646895141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd44004030 con 0x7fdd50158ee0 2023-11-29T11:17:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd4e7fc700 1 -- 172.21.15.81:0/1646895141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440043c0 con 0x7fdd50158ee0 2023-11-29T11:17:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 -- 172.21.15.81:0/1646895141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd50158ee0 msgr2=0x7fdd500ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 --2- 172.21.15.81:0/1646895141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd50158ee0 0x7fdd500ae760 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fdd5015d8f0 tx=0x7fdd44009b30 comp rx=0 tx=0).stop 2023-11-29T11:17:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 -- 172.21.15.81:0/1646895141 shutdown_connections 2023-11-29T11:17:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 --2- 172.21.15.81:0/1646895141 >> v2:172.21.15.176:3300/0 conn(0x7fdd500cd5d0 0x7fdd500cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 --2- 172.21.15.81:0/1646895141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd50158ee0 0x7fdd500ae760 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 -- 172.21.15.81:0/1646895141 >> 172.21.15.81:0/1646895141 conn(0x7fdd500d0240 msgr2=0x7fdd500cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 -- 172.21.15.81:0/1646895141 shutdown_connections 2023-11-29T11:17:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 -- 172.21.15.81:0/1646895141 wait complete. 2023-11-29T11:17:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 Processor -- start 2023-11-29T11:17:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.064+0000 7fdd548f7700 1 -- start start 2023-11-29T11:17:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd500cd5d0 0x7fdd500c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd500ce060 0x7fdd500c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd50158ee0 0x7fdd5015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c9a40 con 0x7fdd500ce060 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c2f30 con 0x7fdd50158ee0 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5015bcb0 con 0x7fdd500cd5d0 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd500ce060 0x7fdd500c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd500ce060 0x7fdd500c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37702/0 (socket says 172.21.15.81:37702) 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 -- 172.21.15.81:0/2685261948 learned_addr learned my addr 172.21.15.81:0/2685261948 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4ffff700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd50158ee0 0x7fdd5015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4f7fe700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd500cd5d0 0x7fdd500c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 -- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd500cd5d0 msgr2=0x7fdd500c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd500cd5d0 0x7fdd500c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 -- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd50158ee0 msgr2=0x7fdd5015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd50158ee0 0x7fdd5015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 -- 172.21.15.81:0/2685261948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40009450 con 0x7fdd500ce060 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4f7fe700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd500cd5d0 0x7fdd500c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd4effd700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd500ce060 0x7fdd500c9500 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000ebe0 tx=0x7fdd40009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd37fff700 1 -- 172.21.15.81:0/2685261948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40005a40 con 0x7fdd500ce060 2023-11-29T11:17:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd37fff700 1 -- 172.21.15.81:0/2685261948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40005ba0 con 0x7fdd500ce060 2023-11-29T11:17:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd440094b0 con 0x7fdd500ce060 2023-11-29T11:17:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd37fff700 1 -- 172.21.15.81:0/2685261948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000c8b0 con 0x7fdd500ce060 2023-11-29T11:17:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5006cc00 con 0x7fdd500ce060 2023-11-29T11:17:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.068+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5006c920 con 0x7fdd500ce060 2023-11-29T11:17:50.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.072+0000 7fdd37fff700 1 -- 172.21.15.81:0/2685261948 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd40022070 con 0x7fdd500ce060 2023-11-29T11:17:50.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.072+0000 7fdd37fff700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd3c064ee0 0x7fdd3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.072+0000 7fdd37fff700 1 -- 172.21.15.81:0/2685261948 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fdd40082600 con 0x7fdd500ce060 2023-11-29T11:17:50.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.072+0000 7fdd4f7fe700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd3c064ee0 0x7fdd3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.072+0000 7fdd4f7fe700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd3c064ee0 0x7fdd3c067390 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdd500cdf80 tx=0x7fdd44008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.076+0000 7fdd37fff700 1 -- 172.21.15.81:0/2685261948 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd40054110 con 0x7fdd500ce060 2023-11-29T11:17:50.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.240+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd5006cee0 con 0x7fdd500ce060 2023-11-29T11:17:50.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.240+0000 7fdd37fff700 1 -- 172.21.15.81:0/2685261948 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v83) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd40020020 con 0x7fdd500ce060 2023-11-29T11:17:50.249 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:17:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd3c064ee0 msgr2=0x7fdd3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd3c064ee0 0x7fdd3c067390 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdd500cdf80 tx=0x7fdd44008030 comp rx=0 tx=0).stop 2023-11-29T11:17:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd500ce060 msgr2=0x7fdd500c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd500ce060 0x7fdd500c9500 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000ebe0 tx=0x7fdd40009e20 comp rx=0 tx=0).stop 2023-11-29T11:17:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 shutdown_connections 2023-11-29T11:17:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd3c064ee0 0x7fdd3c067390 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd50158ee0 0x7fdd5015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd500ce060 0x7fdd500c9500 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 --2- 172.21.15.81:0/2685261948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd500cd5d0 0x7fdd500c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 >> 172.21.15.81:0/2685261948 conn(0x7fdd500d0240 msgr2=0x7fdd500af400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:50.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 shutdown_connections 2023-11-29T11:17:50.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.244+0000 7fdd548f7700 1 -- 172.21.15.81:0/2685261948 wait complete. 2023-11-29T11:17:50.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:17:50.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 Processor -- start 2023-11-29T11:17:50.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- start start 2023-11-29T11:17:50.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0430158ee0 0x7f04300ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04300cd5d0 0x7f04300cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04300ce060 0x7f043015c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043006e000 con 0x7f0430158ee0 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043006d1c0 con 0x7f04300cd5d0 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04300ce480 con 0x7f04300ce060 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0430158ee0 0x7f04300ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0430158ee0 0x7f04300ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37718/0 (socket says 172.21.15.81:37718) 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 -- 172.21.15.81:0/3528119972 learned_addr learned my addr 172.21.15.81:0/3528119972 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04350fb700 1 --2- 172.21.15.81:0/3528119972 >> v2:172.21.15.176:3300/0 conn(0x7f04300cd5d0 0x7f04300cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04360fd700 1 --2- 172.21.15.81:0/3528119972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04300ce060 0x7f043015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 -- 172.21.15.81:0/3528119972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04300ce060 msgr2=0x7f043015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 --2- 172.21.15.81:0/3528119972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04300ce060 0x7f043015c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 -- 172.21.15.81:0/3528119972 >> v2:172.21.15.176:3300/0 conn(0x7f04300cd5d0 msgr2=0x7f04300cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 --2- 172.21.15.81:0/3528119972 >> v2:172.21.15.176:3300/0 conn(0x7f04300cd5d0 0x7f04300cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 -- 172.21.15.81:0/3528119972 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04300ca3a0 con 0x7f0430158ee0 2023-11-29T11:17:50.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04358fc700 1 --2- 172.21.15.81:0/3528119972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430158ee0 0x7f04300ae760 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f043015d8f0 tx=0x7f042c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7974e247ebc0d8f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04348fa700 1 -- 172.21.15.81:0/3528119972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00b8a0 con 0x7f0430158ee0 2023-11-29T11:17:50.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04348fa700 1 -- 172.21.15.81:0/3528119972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c00ba00 con 0x7f0430158ee0 2023-11-29T11:17:50.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04348fa700 1 -- 172.21.15.81:0/3528119972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00bd90 con 0x7f0430158ee0 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- 172.21.15.81:0/3528119972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430158ee0 msgr2=0x7f04300ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 --2- 172.21.15.81:0/3528119972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430158ee0 0x7f04300ae760 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f043015d8f0 tx=0x7f042c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- 172.21.15.81:0/3528119972 shutdown_connections 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 --2- 172.21.15.81:0/3528119972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04300ce060 0x7f043015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 --2- 172.21.15.81:0/3528119972 >> v2:172.21.15.176:3300/0 conn(0x7f04300cd5d0 0x7f04300cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 --2- 172.21.15.81:0/3528119972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430158ee0 0x7f04300ae760 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- 172.21.15.81:0/3528119972 >> 172.21.15.81:0/3528119972 conn(0x7f04300d0240 msgr2=0x7f04300cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- 172.21.15.81:0/3528119972 shutdown_connections 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.372+0000 7f04368fe700 1 -- 172.21.15.81:0/3528119972 wait complete. 2023-11-29T11:17:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04368fe700 1 Processor -- start 2023-11-29T11:17:50.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04368fe700 1 -- start start 2023-11-29T11:17:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04368fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04300cd5d0 0x7f04300c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04368fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04300ce060 0x7f04300c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04368fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0430158ee0 0x7f04300c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04368fe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0430149b00 con 0x7f04300cd5d0 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04368fe700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04300c3870 con 0x7f04300ce060 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04368fe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04300c3240 con 0x7f0430158ee0 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04300cd5d0 0x7f04300c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04300cd5d0 0x7f04300c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37722/0 (socket says 172.21.15.81:37722) 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 -- 172.21.15.81:0/4024670110 learned_addr learned my addr 172.21.15.81:0/4024670110 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04350fb700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04300ce060 0x7f04300c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04360fd700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0430158ee0 0x7f04300c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 -- 172.21.15.81:0/4024670110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0430158ee0 msgr2=0x7f04300c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0430158ee0 0x7f04300c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 -- 172.21.15.81:0/4024670110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04300ce060 msgr2=0x7f04300c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04300ce060 0x7f04300c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 -- 172.21.15.81:0/4024670110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c009570 con 0x7f04300cd5d0 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.376+0000 7f04358fc700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04300cd5d0 0x7f04300c5cf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f042c000c00 tx=0x7f042c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04267fc700 1 -- 172.21.15.81:0/4024670110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0038c0 con 0x7f04300cd5d0 2023-11-29T11:17:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04267fc700 1 -- 172.21.15.81:0/4024670110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c01e070 con 0x7f04300cd5d0 2023-11-29T11:17:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043006cc00 con 0x7f04300cd5d0 2023-11-29T11:17:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04267fc700 1 -- 172.21.15.81:0/4024670110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c003c80 con 0x7f04300cd5d0 2023-11-29T11:17:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043006c920 con 0x7f04300cd5d0 2023-11-29T11:17:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04267fc700 1 -- 172.21.15.81:0/4024670110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f042c00f050 con 0x7f04300cd5d0 2023-11-29T11:17:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043006cee0 con 0x7f04300cd5d0 2023-11-29T11:17:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04267fc700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0414064f10 0x7f04140673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04350fb700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0414064f10 0x7f04140673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04267fc700 1 -- 172.21.15.81:0/4024670110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f042c020070 con 0x7f04300cd5d0 2023-11-29T11:17:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.380+0000 7f04350fb700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0414064f10 0x7f04140673c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f04300c5890 tx=0x7f0420008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.388+0000 7f04267fc700 1 -- 172.21.15.81:0/4024670110 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f042c051720 con 0x7f04300cd5d0 2023-11-29T11:17:50.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.544+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0430072c20 con 0x7f04300cd5d0 2023-11-29T11:17:50.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.544+0000 7f04267fc700 1 -- 172.21.15.81:0/4024670110 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f042c0243e0 con 0x7f04300cd5d0 2023-11-29T11:17:50.552 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:17:50.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.544+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0414064f10 msgr2=0x7f04140673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.544+0000 7f04368fe700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0414064f10 0x7f04140673c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f04300c5890 tx=0x7f0420008040 comp rx=0 tx=0).stop 2023-11-29T11:17:50.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.544+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04300cd5d0 msgr2=0x7f04300c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.544+0000 7f04368fe700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04300cd5d0 0x7f04300c5cf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f042c000c00 tx=0x7f042c004770 comp rx=0 tx=0).stop 2023-11-29T11:17:50.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.548+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 shutdown_connections 2023-11-29T11:17:50.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.548+0000 7f04368fe700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0414064f10 0x7f04140673c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.548+0000 7f04368fe700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0430158ee0 0x7f04300c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.548+0000 7f04368fe700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04300ce060 0x7f04300c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.548+0000 7f04368fe700 1 --2- 172.21.15.81:0/4024670110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04300cd5d0 0x7f04300c5cf0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.548+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 >> 172.21.15.81:0/4024670110 conn(0x7f04300d0240 msgr2=0x7f04300b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:50.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.548+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 shutdown_connections 2023-11-29T11:17:50.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.548+0000 7f04368fe700 1 -- 172.21.15.81:0/4024670110 wait complete. 2023-11-29T11:17:50.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:17:50.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.680+0000 7f8fc8aac700 1 Processor -- start 2023-11-29T11:17:50.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.680+0000 7f8fc8aac700 1 -- start start 2023-11-29T11:17:50.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.680+0000 7f8fc8aac700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc0e2980 0x7f8fbc0e6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.680+0000 7f8fc8aac700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fbc0e2d50 con 0x7f8fbc039090 2023-11-29T11:17:50.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.680+0000 7f8fc8aac700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fbc0e72c0 con 0x7f8fbc056990 2023-11-29T11:17:50.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.680+0000 7f8fc8aac700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc0e6d00 con 0x7f8fbc0e2980 2023-11-29T11:17:50.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.680+0000 7f8fc3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8fbc039090 0x7f8fbc051d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43948/0 (socket says 172.21.15.81:43948) 2023-11-29T11:17:50.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.680+0000 7f8fc3fff700 1 -- 172.21.15.81:0/3704977285 learned_addr learned my addr 172.21.15.81:0/3704977285 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc37fe700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc0e2980 0x7f8fbc0e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671081958 0 0) 0x7f8fbc0e2d50 con 0x7f8fbc039090 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb40035d0 con 0x7f8fbc039090 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580939868 0 0) 0x7f8fbc0e72c0 con 0x7f8fbc056990 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fbc0e2d50 con 0x7f8fbc056990 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 187980877 0 0) 0x7f8fb40035d0 con 0x7f8fbc039090 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc0e2980 msgr2=0x7f8fbc0e6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc0e2980 0x7f8fbc0e6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 >> v1:172.21.15.176:6789/0 conn(0x7f8fbc056990 legacy=0x7f8fbc038980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc0e6fe0 con 0x7f8fbc039090 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f8fc40008d0 con 0x7f8fbc039090 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 >> v1:172.21.15.81:6789/0 conn(0x7f8fbc039090 legacy=0x7f8fbc051d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fb4003be0 0x7f8fb4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc0e2980 0x7f8fb4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4004db0 0x7f8fb4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc0e6d00 con 0x7f8fb4004db0 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb400b9a0 con 0x7f8fb4003be0 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb400bae0 con 0x7f8fbc0e2980 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc3fff700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4004db0 0x7f8fb4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc37fe700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fb4003be0 0x7f8fb4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc2ffd700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc0e2980 0x7f8fb4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc3fff700 1 -- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc0e2980 msgr2=0x7f8fb4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc3fff700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc0e2980 0x7f8fb4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc3fff700 1 -- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fb4003be0 msgr2=0x7f8fb4003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:50.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc3fff700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fb4003be0 0x7f8fb4003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc3fff700 1 -- 172.21.15.81:0/3704977285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40035d0 con 0x7f8fb4004db0 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc37fe700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fb4003be0 0x7f8fb4003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc3fff700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4004db0 0x7f8fb4005220 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4069450 tx=0x7f8fb40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b20ba0b16aa074e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4066f20 con 0x7f8fb4004db0 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4067080 con 0x7f8fb4004db0 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc27fc700 1 -- 172.21.15.81:0/3704977285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4067d60 con 0x7f8fb4004db0 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc8aac700 1 -- 172.21.15.81:0/3704977285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4004db0 msgr2=0x7f8fb4005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc8aac700 1 --2- 172.21.15.81:0/3704977285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb4004db0 0x7f8fb4005220 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4069450 tx=0x7f8fb40058a0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc3fff700 1 -- 172.21.15.81:0/3704977285 reap_dead start 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc8aac700 1 -- 172.21.15.81:0/3704977285 shutdown_connections 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc8aac700 1 -- 172.21.15.81:0/3704977285 >> 172.21.15.81:0/3704977285 conn(0x7f8fbc053980 msgr2=0x7f8fbc053d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc8aac700 1 -- 172.21.15.81:0/3704977285 shutdown_connections 2023-11-29T11:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.684+0000 7f8fc8aac700 1 -- 172.21.15.81:0/3704977285 wait complete. 2023-11-29T11:17:50.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 Processor -- start 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 -- start start 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc03c440 0x7f8fbc03c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fbc0da1b0 0x7f8fbc16e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc0524e0 0x7f8fbc052950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc039d30 con 0x7f8fbc0524e0 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc052e90 con 0x7f8fbc0da1b0 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc03a590 con 0x7f8fbc03c440 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc0524e0 0x7f8fbc052950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc0524e0 0x7f8fbc052950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37736/0 (socket says 172.21.15.81:37736) 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 -- 172.21.15.81:0/4012502749 learned_addr learned my addr 172.21.15.81:0/4012502749 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc37fe700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc03c440 0x7f8fbc03c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc2ffd700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fbc0da1b0 0x7f8fbc16e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 -- 172.21.15.81:0/4012502749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc03c440 msgr2=0x7f8fbc03c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc03c440 0x7f8fbc03c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 -- 172.21.15.81:0/4012502749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fbc0da1b0 msgr2=0x7f8fbc16e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fbc0da1b0 0x7f8fbc16e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 -- 172.21.15.81:0/4012502749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc051840 con 0x7f8fbc0524e0 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc3fff700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc0524e0 0x7f8fbc052950 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8fc404ed50 tx=0x7f8fc4068770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8faffff700 1 -- 172.21.15.81:0/4012502749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40008d0 con 0x7f8fbc0524e0 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8faffff700 1 -- 172.21.15.81:0/4012502749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4068090 con 0x7f8fbc0524e0 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc051560 con 0x7f8fbc0524e0 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8faffff700 1 -- 172.21.15.81:0/4012502749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4072220 con 0x7f8fbc0524e0 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.688+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fbc0e6460 con 0x7f8fbc0524e0 2023-11-29T11:17:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.692+0000 7f8faffff700 1 -- 172.21.15.81:0/4012502749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8fc4093480 con 0x7f8fbc0524e0 2023-11-29T11:17:50.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.692+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fbc055c30 con 0x7f8fbc0524e0 2023-11-29T11:17:50.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.692+0000 7f8faffff700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8fa8064ee0 0x7f8fa8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:50.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.692+0000 7f8faffff700 1 -- 172.21.15.81:0/4012502749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f8fc40fb120 con 0x7f8fbc0524e0 2023-11-29T11:17:50.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.692+0000 7f8fc37fe700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8fa8064ee0 0x7f8fa8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.692+0000 7f8fc37fe700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8fa8064ee0 0x7f8fa8067390 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009c50 tx=0x7f8fb0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.700+0000 7f8faffff700 1 -- 172.21.15.81:0/4012502749 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8fc40c9130 con 0x7f8fbc0524e0 2023-11-29T11:17:50.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8fbc03a720 con 0x7f8fbc0524e0 2023-11-29T11:17:50.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8faffff700 1 -- 172.21.15.81:0/4012502749 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8fc40cc750 con 0x7f8fbc0524e0 2023-11-29T11:17:50.867 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8fa8064ee0 msgr2=0x7f8fa8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8fa8064ee0 0x7f8fa8067390 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009c50 tx=0x7f8fb0008040 comp rx=0 tx=0).stop 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc0524e0 msgr2=0x7f8fbc052950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc0524e0 0x7f8fbc052950 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8fc404ed50 tx=0x7f8fc4068770 comp rx=0 tx=0).stop 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 shutdown_connections 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8fa8064ee0 0x7f8fa8067390 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc0524e0 0x7f8fbc052950 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fbc0da1b0 0x7f8fbc16e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 --2- 172.21.15.81:0/4012502749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fbc03c440 0x7f8fbc03c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:50.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 >> 172.21.15.81:0/4012502749 conn(0x7f8fbc053980 msgr2=0x7f8fbc009510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:50.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 shutdown_connections 2023-11-29T11:17:50.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.860+0000 7f8fc8aac700 1 -- 172.21.15.81:0/4012502749 wait complete. 2023-11-29T11:17:50.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:17:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f70762fc700 1 Processor -- start 2023-11-29T11:17:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f70762fc700 1 -- start start 2023-11-29T11:17:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f70762fc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f70700ac1f0 0x7f70700cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f70762fc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70700b0910 con 0x7f70700cc830 2023-11-29T11:17:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f70762fc700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70700ccc70 con 0x7f707015c520 2023-11-29T11:17:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f70762fc700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707006a470 con 0x7f70700ac1f0 2023-11-29T11:17:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7075afb700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70700cc830 0x7f70700b1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43960/0 (socket says 172.21.15.81:43960) 2023-11-29T11:17:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7075afb700 1 -- 172.21.15.81:0/4171097119 learned_addr learned my addr 172.21.15.81:0/4171097119 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7074af9700 1 --2- 172.21.15.81:0/4171097119 >> v2:172.21.15.176:3300/0 conn(0x7f70700ac1f0 0x7f70700cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7067fff700 1 -- 172.21.15.81:0/4171097119 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100164224 0 0) 0x7f70700b0910 con 0x7f70700cc830 2023-11-29T11:17:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7067fff700 1 -- 172.21.15.81:0/4171097119 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f705c0035d0 con 0x7f70700cc830 2023-11-29T11:17:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7074af9700 1 -- 172.21.15.81:0/4171097119 >> v1:172.21.15.176:6789/0 conn(0x7f707015c520 legacy=0x7f7070069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7067fff700 1 -- 172.21.15.81:0/4171097119 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853542726 0 0) 0x7f70700ccc70 con 0x7f707015c520 2023-11-29T11:17:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7074af9700 1 -- 172.21.15.81:0/4171097119 >> v1:172.21.15.81:6789/0 conn(0x7f70700cc830 legacy=0x7f70700b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.992+0000 7f7074af9700 1 -- 172.21.15.81:0/4171097119 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707006a750 con 0x7f70700ac1f0 2023-11-29T11:17:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f7074af9700 1 --2- 172.21.15.81:0/4171097119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70700ac1f0 0x7f70700cc2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7060009880 tx=0x7f7060009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f12536b8bfc645f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f7067fff700 1 -- 172.21.15.81:0/4171097119 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060011830 con 0x7f70700ac1f0 2023-11-29T11:17:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f7067fff700 1 -- 172.21.15.81:0/4171097119 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7060011990 con 0x7f70700ac1f0 2023-11-29T11:17:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f7067fff700 1 -- 172.21.15.81:0/4171097119 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060011d00 con 0x7f70700ac1f0 2023-11-29T11:17:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 -- 172.21.15.81:0/4171097119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70700ac1f0 msgr2=0x7f70700cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 --2- 172.21.15.81:0/4171097119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70700ac1f0 0x7f70700cc2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7060009880 tx=0x7f7060009b90 comp rx=0 tx=0).stop 2023-11-29T11:17:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 -- 172.21.15.81:0/4171097119 shutdown_connections 2023-11-29T11:17:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 --2- 172.21.15.81:0/4171097119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70700ac1f0 0x7f70700cc2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 -- 172.21.15.81:0/4171097119 >> 172.21.15.81:0/4171097119 conn(0x7f70700cae70 msgr2=0x7f70700cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 -- 172.21.15.81:0/4171097119 shutdown_connections 2023-11-29T11:17:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 -- 172.21.15.81:0/4171097119 wait complete. 2023-11-29T11:17:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 Processor -- start 2023-11-29T11:17:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:50.996+0000 7f70762fc700 1 -- start start 2023-11-29T11:17:51.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70762fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70700ac1f0 0x7f707015f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70762fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70700cc830 0x7f70700c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70762fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f707015c520 0x7f707015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70762fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70700af7b0 con 0x7f70700cc830 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70762fc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70700989e0 con 0x7f707015c520 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70762fc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70701f53e0 con 0x7f70700ac1f0 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7074af9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70700cc830 0x7f70700c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7075afb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f707015c520 0x7f707015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7074af9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70700cc830 0x7f70700c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37740/0 (socket says 172.21.15.81:37740) 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70752fa700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70700ac1f0 0x7f707015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7074af9700 1 -- 172.21.15.81:0/996276245 learned_addr learned my addr 172.21.15.81:0/996276245 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7075afb700 1 -- 172.21.15.81:0/996276245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70700ac1f0 msgr2=0x7f707015f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7075afb700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70700ac1f0 0x7f707015f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7075afb700 1 -- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70700cc830 msgr2=0x7f70700c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7075afb700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70700cc830 0x7f70700c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7075afb700 1 -- 172.21.15.81:0/996276245 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600094b0 con 0x7f707015c520 2023-11-29T11:17:51.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7074af9700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70700cc830 0x7f70700c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:51.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7075afb700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f707015c520 0x7f707015a500 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f706800caa0 tx=0x7f706800cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:51.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7065ffb700 1 -- 172.21.15.81:0/996276245 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068007480 con 0x7f707015c520 2023-11-29T11:17:51.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7065ffb700 1 -- 172.21.15.81:0/996276245 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70680075e0 con 0x7f707015c520 2023-11-29T11:17:51.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707006ad10 con 0x7f707015c520 2023-11-29T11:17:51.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f7065ffb700 1 -- 172.21.15.81:0/996276245 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068007950 con 0x7f707015c520 2023-11-29T11:17:51.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.000+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707006aa30 con 0x7f707015c520 2023-11-29T11:17:51.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.004+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707006aff0 con 0x7f707015c520 2023-11-29T11:17:51.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.004+0000 7f7065ffb700 1 -- 172.21.15.81:0/996276245 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7068019030 con 0x7f707015c520 2023-11-29T11:17:51.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.004+0000 7f7065ffb700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7054064ee0 0x7f7054067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.004+0000 7f70752fa700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7054064ee0 0x7f7054067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.004+0000 7f7065ffb700 1 -- 172.21.15.81:0/996276245 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f7068081610 con 0x7f707015c520 2023-11-29T11:17:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.004+0000 7f70752fa700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7054064ee0 0x7f7054067390 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f706c007fd0 tx=0x7f706c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:51.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.016+0000 7f7065ffb700 1 -- 172.21.15.81:0/996276245 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f706804a400 con 0x7f707015c520 2023-11-29T11:17:51.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.176+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70700af960 con 0x7f707015c520 2023-11-29T11:17:51.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.176+0000 7f7065ffb700 1 -- 172.21.15.81:0/996276245 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70700af960 con 0x7f707015c520 2023-11-29T11:17:51.185 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:17:51.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7054064ee0 msgr2=0x7f7054067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7054064ee0 0x7f7054067390 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f706c007fd0 tx=0x7f706c009040 comp rx=0 tx=0).stop 2023-11-29T11:17:51.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f707015c520 msgr2=0x7f707015a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f707015c520 0x7f707015a500 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f706800caa0 tx=0x7f706800cad0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 shutdown_connections 2023-11-29T11:17:51.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7054064ee0 0x7f7054067390 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f707015c520 0x7f707015a500 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70700cc830 0x7f70700c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 --2- 172.21.15.81:0/996276245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f70700ac1f0 0x7f707015f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 >> 172.21.15.81:0/996276245 conn(0x7f70700cae70 msgr2=0x7f70700cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 shutdown_connections 2023-11-29T11:17:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.180+0000 7f70762fc700 1 -- 172.21.15.81:0/996276245 wait complete. 2023-11-29T11:17:51.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:17:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03bcfc5700 1 Processor -- start 2023-11-29T11:17:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03bcfc5700 1 -- start start 2023-11-29T11:17:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03bcfc5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f03b8159e70 0x7f03b806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03bcfc5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8069c40 0x7f03b80cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03bcfc5700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b806ace0 con 0x7f03b806cee0 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03bcfc5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b806a0d0 con 0x7f03b8159e70 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03bcfc5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b806a3b0 con 0x7f03b8069c40 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b6ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8069c40 0x7f03b80cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b77fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f03b8159e70 0x7f03b806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b6ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8069c40 0x7f03b80cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:56026/0 (socket says 172.21.15.81:56026) 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b6ffd700 1 -- 172.21.15.81:0/1143883702 learned_addr learned my addr 172.21.15.81:0/1143883702 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b7fff700 1 --1- 172.21.15.81:0/1143883702 >> v1:172.21.15.176:6789/0 conn(0x7f03b806cee0 0x7f03b80b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:41216/0 (socket says 172.21.15.81:41216) 2023-11-29T11:17:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b6ffd700 1 -- 172.21.15.81:0/1143883702 >> v2:172.21.15.176:3300/0 conn(0x7f03b8159e70 msgr2=0x7f03b806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b6ffd700 1 --2- 172.21.15.81:0/1143883702 >> v2:172.21.15.176:3300/0 conn(0x7f03b8159e70 0x7f03b806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b6ffd700 1 -- 172.21.15.81:0/1143883702 >> v1:172.21.15.176:6789/0 conn(0x7f03b806cee0 legacy=0x7f03b80b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b6ffd700 1 -- 172.21.15.81:0/1143883702 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b806a690 con 0x7f03b8069c40 2023-11-29T11:17:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b77fe700 1 --2- 172.21.15.81:0/1143883702 >> v2:172.21.15.176:3300/0 conn(0x7f03b8159e70 0x7f03b806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.308+0000 7f03b6ffd700 1 --2- 172.21.15.81:0/1143883702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8069c40 0x7f03b80cad60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009910 tx=0x7f03b0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=424945c727e44b1d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b67fc700 1 -- 172.21.15.81:0/1143883702 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011830 con 0x7f03b8069c40 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b67fc700 1 -- 172.21.15.81:0/1143883702 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0011990 con 0x7f03b8069c40 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b67fc700 1 -- 172.21.15.81:0/1143883702 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011d40 con 0x7f03b8069c40 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- 172.21.15.81:0/1143883702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8069c40 msgr2=0x7f03b80cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/1143883702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8069c40 0x7f03b80cad60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009910 tx=0x7f03b0009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- 172.21.15.81:0/1143883702 shutdown_connections 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/1143883702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8069c40 0x7f03b80cad60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/1143883702 >> v2:172.21.15.176:3300/0 conn(0x7f03b8159e70 0x7f03b806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- 172.21.15.81:0/1143883702 >> 172.21.15.81:0/1143883702 conn(0x7f03b80ce3e0 msgr2=0x7f03b80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- 172.21.15.81:0/1143883702 shutdown_connections 2023-11-29T11:17:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- 172.21.15.81:0/1143883702 wait complete. 2023-11-29T11:17:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 Processor -- start 2023-11-29T11:17:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- start start 2023-11-29T11:17:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03b8069c40 0x7f03b81f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b806cee0 0x7f03b80972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8159e70 0x7f03b80713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80cca80 con 0x7f03b8069c40 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80cc150 con 0x7f03b806cee0 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03bcfc5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80cc430 con 0x7f03b8159e70 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03b8069c40 0x7f03b81f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03b8069c40 0x7f03b81f1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37754/0 (socket says 172.21.15.81:37754) 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b77fe700 1 -- 172.21.15.81:0/649780872 learned_addr learned my addr 172.21.15.81:0/649780872 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b6ffd700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b806cee0 0x7f03b80972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b7fff700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8159e70 0x7f03b80713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b77fe700 1 -- 172.21.15.81:0/649780872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8159e70 msgr2=0x7f03b80713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b77fe700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8159e70 0x7f03b80713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b77fe700 1 -- 172.21.15.81:0/649780872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b806cee0 msgr2=0x7f03b80972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b77fe700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b806cee0 0x7f03b80972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.312+0000 7f03b77fe700 1 -- 172.21.15.81:0/649780872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00094b0 con 0x7f03b8069c40 2023-11-29T11:17:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.316+0000 7f03b77fe700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03b8069c40 0x7f03b81f1600 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f03a000ebe0 tx=0x7f03a000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.316+0000 7f03affff700 1 -- 172.21.15.81:0/649780872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0009770 con 0x7f03b8069c40 2023-11-29T11:17:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.316+0000 7f03affff700 1 -- 172.21.15.81:0/649780872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000c850 con 0x7f03b8069c40 2023-11-29T11:17:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.316+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b0009570 con 0x7f03b8069c40 2023-11-29T11:17:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.316+0000 7f03affff700 1 -- 172.21.15.81:0/649780872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000cbe0 con 0x7f03b8069c40 2023-11-29T11:17:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.316+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b815a240 con 0x7f03b8069c40 2023-11-29T11:17:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.316+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b806a970 con 0x7f03b8069c40 2023-11-29T11:17:51.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.316+0000 7f03affff700 1 -- 172.21.15.81:0/649780872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f03a0019030 con 0x7f03b8069c40 2023-11-29T11:17:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.320+0000 7f03affff700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0398064ee0 0x7f0398067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.320+0000 7f03affff700 1 -- 172.21.15.81:0/649780872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f03a0081fc0 con 0x7f03b8069c40 2023-11-29T11:17:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.320+0000 7f03b6ffd700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0398064ee0 0x7f0398067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:51.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.320+0000 7f03b6ffd700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0398064ee0 0x7f0398067390 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f03b0000c00 tx=0x7f03b0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:51.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.324+0000 7f03affff700 1 -- 172.21.15.81:0/649780872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f03a004ff10 con 0x7f03b8069c40 2023-11-29T11:17:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.520+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03b80ca1e0 con 0x7f03b8069c40 2023-11-29T11:17:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.520+0000 7f03affff700 1 -- 172.21.15.81:0/649780872 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7f03a0053530 con 0x7f03b8069c40 2023-11-29T11:17:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0398064ee0 msgr2=0x7f0398067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0398064ee0 0x7f0398067390 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f03b0000c00 tx=0x7f03b0008030 comp rx=0 tx=0).stop 2023-11-29T11:17:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03b8069c40 msgr2=0x7f03b81f1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03b8069c40 0x7f03b81f1600 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f03a000ebe0 tx=0x7f03a000eef0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 shutdown_connections 2023-11-29T11:17:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0398064ee0 0x7f0398067390 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03b8159e70 0x7f03b80713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b806cee0 0x7f03b80972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 --2- 172.21.15.81:0/649780872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03b8069c40 0x7f03b81f1600 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 >> 172.21.15.81:0/649780872 conn(0x7f03b80ce3e0 msgr2=0x7f03b80afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 shutdown_connections 2023-11-29T11:17:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:51.524+0000 7f03bcfc5700 1 -- 172.21.15.81:0/649780872 wait complete. 2023-11-29T11:17:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:17:51.546 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:17:51.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:51.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:17:51.560 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[54751]: fuse finished with error 0 and tester_r 0 2023-11-29T11:17:51.561 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:17:56.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:17:56.370 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:17:57.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:17:57.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:17:57.664 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:17:57.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:17:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bbb1c5700 1 Processor -- start 2023-11-29T11:17:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bbb1c5700 1 -- start start 2023-11-29T11:17:57.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bbb1c5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1bb4158e60 0x7f1bb40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:57.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bbb1c5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40ad490 0x7f1bb40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bbb1c5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bb40cad50 0x7f1bb40cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bbb1c5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb40add00 con 0x7f1bb40cad50 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bbb1c5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb40cb710 con 0x7f1bb4158e60 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bbb1c5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40cc4f0 con 0x7f1bb40ad490 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba9c4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bb40cad50 0x7f1bb40cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba9c4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bb40cad50 0x7f1bb40cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37762/0 (socket says 172.21.15.81:37762) 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba9c4700 1 -- 172.21.15.81:0/3303288609 learned_addr learned my addr 172.21.15.81:0/3303288609 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bb99c2700 1 --2- 172.21.15.81:0/3303288609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40ad490 0x7f1bb40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba1c3700 1 --2- 172.21.15.81:0/3303288609 >> v2:172.21.15.176:3300/0 conn(0x7f1bb4158e60 0x7f1bb40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba9c4700 1 -- 172.21.15.81:0/3303288609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40ad490 msgr2=0x7f1bb40cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba9c4700 1 --2- 172.21.15.81:0/3303288609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40ad490 0x7f1bb40cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba9c4700 1 -- 172.21.15.81:0/3303288609 >> v2:172.21.15.176:3300/0 conn(0x7f1bb4158e60 msgr2=0x7f1bb40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba9c4700 1 --2- 172.21.15.81:0/3303288609 >> v2:172.21.15.176:3300/0 conn(0x7f1bb4158e60 0x7f1bb40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba9c4700 1 -- 172.21.15.81:0/3303288609 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40cd8f0 con 0x7f1bb40cad50 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.783+0000 7f1bba1c3700 1 --2- 172.21.15.81:0/3303288609 >> v2:172.21.15.176:3300/0 conn(0x7f1bb4158e60 0x7f1bb40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bba9c4700 1 --2- 172.21.15.81:0/3303288609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40cad50 0x7f1bb40cb1d0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009e80 tx=0x7f1bac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4546b9753759c87a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bb91c1700 1 -- 172.21.15.81:0/3303288609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00e070 con 0x7f1bb40cad50 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bb91c1700 1 -- 172.21.15.81:0/3303288609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac00b890 con 0x7f1bb40cad50 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bb91c1700 1 -- 172.21.15.81:0/3303288609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00bc40 con 0x7f1bb40cad50 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3303288609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40cad50 msgr2=0x7f1bb40cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3303288609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40cad50 0x7f1bb40cb1d0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009e80 tx=0x7f1bac00b330 comp rx=0 tx=0).stop 2023-11-29T11:17:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3303288609 shutdown_connections 2023-11-29T11:17:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3303288609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40ad490 0x7f1bb40cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3303288609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40cad50 0x7f1bb40cb1d0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3303288609 >> v2:172.21.15.176:3300/0 conn(0x7f1bb4158e60 0x7f1bb40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3303288609 >> 172.21.15.81:0/3303288609 conn(0x7f1bb40ce3e0 msgr2=0x7f1bb40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3303288609 shutdown_connections 2023-11-29T11:17:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3303288609 wait complete. 2023-11-29T11:17:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 Processor -- start 2023-11-29T11:17:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.787+0000 7f1bbb1c5700 1 -- start start 2023-11-29T11:17:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40ad490 0x7f1bb41ee940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40cad50 0x7f1bb40ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bb4158e60 0x7f1bb4152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40ae890 con 0x7f1bb40ad490 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40aeb70 con 0x7f1bb4158e60 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40aee50 con 0x7f1bb40cad50 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40ad490 0x7f1bb41ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40ad490 0x7f1bb41ee940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37764/0 (socket says 172.21.15.81:37764) 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 -- 172.21.15.81:0/3091973099 learned_addr learned my addr 172.21.15.81:0/3091973099 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bb99c2700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40cad50 0x7f1bb40ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba9c4700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bb4158e60 0x7f1bb4152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 -- 172.21.15.81:0/3091973099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40cad50 msgr2=0x7f1bb40ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40cad50 0x7f1bb40ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 -- 172.21.15.81:0/3091973099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bb4158e60 msgr2=0x7f1bb4152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bb4158e60 0x7f1bb4152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 -- 172.21.15.81:0/3091973099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac009b30 con 0x7f1bb40ad490 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bba1c3700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40ad490 0x7f1bb41ee940 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400e810 tx=0x7f1ba400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1baaffd700 1 -- 172.21.15.81:0/3091973099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400c070 con 0x7f1bb40ad490 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1baaffd700 1 -- 172.21.15.81:0/3091973099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba4013610 con 0x7f1bb40ad490 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1baaffd700 1 -- 172.21.15.81:0/3091973099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba40139a0 con 0x7f1bb40ad490 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb40cde90 con 0x7f1bb40ad490 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb406dc60 con 0x7f1bb40ad490 2023-11-29T11:17:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb4159230 con 0x7f1bb40ad490 2023-11-29T11:17:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.791+0000 7f1baaffd700 1 -- 172.21.15.81:0/3091973099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1ba4023070 con 0x7f1bb40ad490 2023-11-29T11:17:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.795+0000 7f1baaffd700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b98064ee0 0x7f1b98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.795+0000 7f1baaffd700 1 -- 172.21.15.81:0/3091973099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f1ba4081c40 con 0x7f1bb40ad490 2023-11-29T11:17:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.795+0000 7f1bb99c2700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b98064ee0 0x7f1b98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.795+0000 7f1bb99c2700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b98064ee0 0x7f1b98067390 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40c55d0 tx=0x7f1bb0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:57.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:57.803+0000 7f1baaffd700 1 -- 172.21.15.81:0/3091973099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1ba404fba0 con 0x7f1bb40ad490 2023-11-29T11:17:58.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.003+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bb4072500 con 0x7f1bb40ad490 2023-11-29T11:17:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.003+0000 7f1baaffd700 1 -- 172.21.15.81:0/3091973099 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f1ba40531c0 con 0x7f1bb40ad490 2023-11-29T11:17:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:17:58.014 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:17:42.393858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3247003029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3247003029},{"type":"v1","addr":"172.21.15.81:6837","nonce":3247003029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b98064ee0 msgr2=0x7f1b98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b98064ee0 0x7f1b98067390 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40c55d0 tx=0x7f1bb0009240 comp rx=0 tx=0).stop 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40ad490 msgr2=0x7f1bb41ee940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40ad490 0x7f1bb41ee940 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400e810 tx=0x7f1ba400eb20 comp rx=0 tx=0).stop 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 shutdown_connections 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1b98064ee0 0x7f1b98067390 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bb4158e60 0x7f1bb4152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bb40cad50 0x7f1bb40ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 --2- 172.21.15.81:0/3091973099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb40ad490 0x7f1bb41ee940 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 >> 172.21.15.81:0/3091973099 conn(0x7f1bb40ce3e0 msgr2=0x7f1bb40c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 shutdown_connections 2023-11-29T11:17:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.007+0000 7f1bbb1c5700 1 -- 172.21.15.81:0/3091973099 wait complete. 2023-11-29T11:17:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2023-11-29T11:17:58.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-29T11:17:58.162 INFO:teuthology.orchestra.run.smithi081.stdout:{"message":"","return_code":0} 2023-11-29T11:17:58.162 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:17:58.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:17:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 Processor -- start 2023-11-29T11:17:58.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- start start 2023-11-29T11:17:58.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d380cf050 0x7f7d3806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3815c6d0 con 0x7f7d3806a530 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3806a9d0 con 0x7f7d380b4c10 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3806ac60 con 0x7f7d380cf050 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d377fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d380cf050 0x7f7d3806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d377fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d380cf050 0x7f7d3806d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37768/0 (socket says 172.21.15.81:37768) 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d377fe700 1 -- 172.21.15.81:0/2539344244 learned_addr learned my addr 172.21.15.81:0/2539344244 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d377fe700 1 -- 172.21.15.81:0/2539344244 >> v1:172.21.15.176:6789/0 conn(0x7f7d380b4c10 legacy=0x7f7d380cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d377fe700 1 -- 172.21.15.81:0/2539344244 >> v1:172.21.15.81:6789/0 conn(0x7f7d3806a530 legacy=0x7f7d380cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d377fe700 1 -- 172.21.15.81:0/2539344244 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3806af40 con 0x7f7d380cf050 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d377fe700 1 --2- 172.21.15.81:0/2539344244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380cf050 0x7f7d3806d7d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009910 tx=0x7f7d28009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2221ec033d5798 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d367fc700 1 -- 172.21.15.81:0/2539344244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800ba60 con 0x7f7d380cf050 2023-11-29T11:17:58.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d367fc700 1 -- 172.21.15.81:0/2539344244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2800bbc0 con 0x7f7d380cf050 2023-11-29T11:17:58.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d367fc700 1 -- 172.21.15.81:0/2539344244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28009e60 con 0x7f7d380cf050 2023-11-29T11:17:58.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2539344244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380cf050 msgr2=0x7f7d3806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:58.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 --2- 172.21.15.81:0/2539344244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380cf050 0x7f7d3806d7d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009910 tx=0x7f7d28009c20 comp rx=0 tx=0).stop 2023-11-29T11:17:58.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2539344244 shutdown_connections 2023-11-29T11:17:58.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 --2- 172.21.15.81:0/2539344244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380cf050 0x7f7d3806d7d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:58.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2539344244 >> 172.21.15.81:0/2539344244 conn(0x7f7d3809bb30 msgr2=0x7f7d380b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:58.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2539344244 shutdown_connections 2023-11-29T11:17:58.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.267+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2539344244 wait complete. 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 Processor -- start 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 -- start start 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3806a530 0x7f7d3815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380b4c10 0x7f7d3809c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d380cf050 0x7f7d381f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380a0530 con 0x7f7d380b4c10 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3815ac40 con 0x7f7d380cf050 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3815edc0 con 0x7f7d3806a530 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380b4c10 0x7f7d3809c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380b4c10 0x7f7d3809c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37774/0 (socket says 172.21.15.81:37774) 2023-11-29T11:17:58.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 -- 172.21.15.81:0/2925916014 learned_addr learned my addr 172.21.15.81:0/2925916014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d37fff700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d380cf050 0x7f7d381f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d377fe700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3806a530 0x7f7d3815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 -- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3806a530 msgr2=0x7f7d3815a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3806a530 0x7f7d3815a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 -- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d380cf050 msgr2=0x7f7d381f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d380cf050 0x7f7d381f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 -- 172.21.15.81:0/2925916014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009570 con 0x7f7d380b4c10 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d37fff700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d380cf050 0x7f7d381f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d36ffd700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380b4c10 0x7f7d3809c5a0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00c530 tx=0x7f7d2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d1ffff700 1 -- 172.21.15.81:0/2925916014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0052d0 con 0x7f7d380b4c10 2023-11-29T11:17:58.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d1ffff700 1 -- 172.21.15.81:0/2925916014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c005430 con 0x7f7d380b4c10 2023-11-29T11:17:58.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d380b46f0 con 0x7f7d380b4c10 2023-11-29T11:17:58.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.271+0000 7f7d1ffff700 1 -- 172.21.15.81:0/2925916014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0055a0 con 0x7f7d380b4c10 2023-11-29T11:17:58.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.275+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d380b4410 con 0x7f7d380b4c10 2023-11-29T11:17:58.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.275+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3806b220 con 0x7f7d380b4c10 2023-11-29T11:17:58.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.275+0000 7f7d1ffff700 1 -- 172.21.15.81:0/2925916014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7d2c019030 con 0x7f7d380b4c10 2023-11-29T11:17:58.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.275+0000 7f7d1ffff700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7d24064f10 0x7f7d240673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:58.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.275+0000 7f7d1ffff700 1 -- 172.21.15.81:0/2925916014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f7d2c081390 con 0x7f7d380b4c10 2023-11-29T11:17:58.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.275+0000 7f7d377fe700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7d24064f10 0x7f7d240673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:58.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.275+0000 7f7d377fe700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7d24064f10 0x7f7d240673c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7d28006f80 tx=0x7f7d28008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:58.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.283+0000 7f7d1ffff700 1 -- 172.21.15.81:0/2925916014 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7d2c04f350 con 0x7f7d380b4c10 2023-11-29T11:17:58.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:58.483+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7d38072500 con 0x7f7d380b4c10 2023-11-29T11:17:59.066 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:17:59.059+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:17:59.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.075+0000 7f7d1ffff700 1 -- 172.21.15.81:0/2925916014 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7d2c052970 con 0x7f7d380b4c10 2023-11-29T11:17:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7d24064f10 msgr2=0x7f7d240673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7d24064f10 0x7f7d240673c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7d28006f80 tx=0x7f7d28008030 comp rx=0 tx=0).stop 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380b4c10 msgr2=0x7f7d3809c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380b4c10 0x7f7d3809c5a0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00c530 tx=0x7f7d2c00c8f0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 shutdown_connections 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7d24064f10 0x7f7d240673c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d380cf050 0x7f7d381f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d380b4c10 0x7f7d3809c5a0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 --2- 172.21.15.81:0/2925916014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3806a530 0x7f7d3815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 >> 172.21.15.81:0/2925916014 conn(0x7f7d3809bb30 msgr2=0x7f7d380b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 shutdown_connections 2023-11-29T11:17:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.079+0000 7f7d3cbee700 1 -- 172.21.15.81:0/2925916014 wait complete. 2023-11-29T11:17:59.090 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:17:59.091 INFO:tasks.ceph.mds.c.smithi081.stderr: -3426> 2023-11-29T11:17:41.064+0000 7f1d77650700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:17:59.105 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-11-29T11:17:59.127 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:17:59.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd53388140 1 Processor -- start 2023-11-29T11:17:59.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd53388140 1 -- start start 2023-11-29T11:17:59.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd53388140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40003a60 0x55ee39e6a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd53388140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee39dc3150 0x55ee39e689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd53388140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 0x55ee39e4f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd53388140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee39cb8240 con 0x7efd40003a60 2023-11-29T11:17:59.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd53388140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee39e69430 con 0x55ee39e68f10 2023-11-29T11:17:59.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd53388140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee39e696d0 con 0x55ee39dc3150 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40003a60 0x55ee39e6a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40003a60 0x55ee39e6a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37812/0 (socket says 172.21.15.81:37812) 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 -- 172.21.15.81:0/144705961 learned_addr learned my addr 172.21.15.81:0/144705961 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd4bfff700 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee39dc3150 0x55ee39e689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd516be700 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 0x55ee39e4f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 -- 172.21.15.81:0/144705961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee39dc3150 msgr2=0x55ee39e689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee39dc3150 0x55ee39e689d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 -- 172.21.15.81:0/144705961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 msgr2=0x55ee39e4f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 0x55ee39e4f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 -- 172.21.15.81:0/144705961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee39cc38b0 con 0x7efd40003a60 2023-11-29T11:17:59.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd50ebd700 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40003a60 0x55ee39e6a350 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0097e0 tx=0x7efd3c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593e85b54a7fe91b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd4affd700 1 -- 172.21.15.81:0/144705961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c00f050 con 0x7efd40003a60 2023-11-29T11:17:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd4affd700 1 -- 172.21.15.81:0/144705961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c010040 con 0x7efd40003a60 2023-11-29T11:17:59.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.143+0000 7efd4affd700 1 -- 172.21.15.81:0/144705961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c008bf0 con 0x7efd40003a60 2023-11-29T11:17:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- 172.21.15.81:0/144705961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40003a60 msgr2=0x55ee39e6a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40003a60 0x55ee39e6a350 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0097e0 tx=0x7efd3c005a00 comp rx=0 tx=0).stop 2023-11-29T11:17:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- 172.21.15.81:0/144705961 shutdown_connections 2023-11-29T11:17:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 0x55ee39e4f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee39dc3150 0x55ee39e689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 --2- 172.21.15.81:0/144705961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40003a60 0x55ee39e6a350 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- 172.21.15.81:0/144705961 >> 172.21.15.81:0/144705961 conn(0x55ee39d91000 msgr2=0x55ee39e64fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:59.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- 172.21.15.81:0/144705961 shutdown_connections 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- 172.21.15.81:0/144705961 wait complete. 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 Processor -- start 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- start start 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee39dc3150 0x55ee39dbe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 0x55ee39dbe580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd40003a60 0x55ee39e42390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee39e43220 con 0x55ee39dc3150 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee39e45da0 con 0x55ee39e68f10 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd53388140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee39e46040 con 0x7efd40003a60 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd50ebd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee39dc3150 0x55ee39dbe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd50ebd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee39dc3150 0x55ee39dbe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37820/0 (socket says 172.21.15.81:37820) 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.147+0000 7efd50ebd700 1 -- 172.21.15.81:0/1565287287 learned_addr learned my addr 172.21.15.81:0/1565287287 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd4bfff700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 0x55ee39dbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd516be700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd40003a60 0x55ee39e42390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd50ebd700 1 -- 172.21.15.81:0/1565287287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd40003a60 msgr2=0x55ee39e42390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd50ebd700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd40003a60 0x55ee39e42390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd50ebd700 1 -- 172.21.15.81:0/1565287287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 msgr2=0x55ee39dbe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd50ebd700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee39e68f10 0x55ee39dbe580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd50ebd700 1 -- 172.21.15.81:0/1565287287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c009410 con 0x55ee39dc3150 2023-11-29T11:17:59.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd50ebd700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee39dc3150 0x55ee39dbe040 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7efd3c000c00 tx=0x7efd3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:59.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd49ffb700 1 -- 172.21.15.81:0/1565287287 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c015870 con 0x55ee39dc3150 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd49ffb700 1 -- 172.21.15.81:0/1565287287 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c023070 con 0x55ee39dc3150 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd49ffb700 1 -- 172.21.15.81:0/1565287287 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c015c10 con 0x55ee39dc3150 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ee39cd05d0 con 0x55ee39dc3150 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.151+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee39cd0390 con 0x55ee39dc3150 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd49ffb700 1 -- 172.21.15.81:0/1565287287 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efd3c015d70 con 0x55ee39dc3150 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd49ffb700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd34063810 0x7efd34065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd49ffb700 1 -- 172.21.15.81:0/1565287287 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7efd3c025070 con 0x55ee39dc3150 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd4bfff700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd34063810 0x7efd34065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd53388140 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55ee39f01620 0x55ee39e44eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84) v8 -- 0x55ee39e453f0 con 0x55ee39f01620 2023-11-29T11:17:59.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd516be700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55ee39f01620 0x55ee39e44eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd4bfff700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd34063810 0x7efd34065cc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efd44009900 tx=0x7efd4400c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:59.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.155+0000 7efd516be700 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55ee39f01620 0x55ee39e44eb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd516be700 1 -- 172.21.15.81:0/1565287287 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v84'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7efd4c001250 con 0x55ee39f01620 2023-11-29T11:17:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55ee39f01620 msgr2=0x55ee39e44eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55ee39f01620 0x55ee39e44eb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd34063810 msgr2=0x7efd34065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd34063810 0x7efd34065cc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efd44009900 tx=0x7efd4400c040 comp rx=0 tx=0).stop 2023-11-29T11:17:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee39dc3150 msgr2=0x55ee39dbe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 --2- 172.21.15.81:0/1565287287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee39dc3150 0x55ee39dbe040 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7efd3c000c00 tx=0x7efd3c002fb0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd516be700 1 -- 172.21.15.81:0/1565287287 reap_dead start 2023-11-29T11:17:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 shutdown_connections 2023-11-29T11:17:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 >> 172.21.15.81:0/1565287287 conn(0x55ee39d91000 msgr2=0x55ee39e67dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 shutdown_connections 2023-11-29T11:17:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.159+0000 7efd53388140 1 -- 172.21.15.81:0/1565287287 wait complete. 2023-11-29T11:17:59.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-29T11:17:59.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6bef59e700 1 Processor -- start 2023-11-29T11:17:59.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6bef59e700 1 -- start start 2023-11-29T11:17:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf006b370 0x7f6bf0163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6bef59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf00ccd00 con 0x7f6bf015bb80 2023-11-29T11:17:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6bef59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf00b3270 con 0x7f6bf00aaf40 2023-11-29T11:17:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6bef59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00b19b0 con 0x7f6bf006b370 2023-11-29T11:17:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6bee59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6bf015bb80 0x7f6bf00b2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43996/0 (socket says 172.21.15.81:43996) 2023-11-29T11:17:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6bee59c700 1 -- 172.21.15.81:0/477724597 learned_addr learned my addr 172.21.15.81:0/477724597 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:17:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.327+0000 7f6beed9d700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf006b370 0x7f6bf0163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538507135 0 0) 0x7f6bf00ccd00 con 0x7f6bf015bb80 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd80035d0 con 0x7f6bf015bb80 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013224338 0 0) 0x7f6bf00b3270 con 0x7f6bf00aaf40 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf00ccd00 con 0x7f6bf00aaf40 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1006672190 0 0) 0x7f6bd80035d0 con 0x7f6bf015bb80 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf006b370 msgr2=0x7f6bf0163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf006b370 0x7f6bf0163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 >> v1:172.21.15.176:6789/0 conn(0x7f6bf00aaf40 legacy=0x7f6bf00b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00cd510 con 0x7f6bf015bb80 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f6be4001670 con 0x7f6bf015bb80 2023-11-29T11:17:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 >> v1:172.21.15.81:6789/0 conn(0x7f6bf015bb80 legacy=0x7f6bf00b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd8003be0 0x7f6bd8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8004870 0x7f6bd8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf006b370 0x7f6bd8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00b19b0 con 0x7f6bd8003be0 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8005b00 con 0x7f6bd8004870 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8005cc0 con 0x7f6bf006b370 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bee59c700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd8003be0 0x7f6bd8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bedd9b700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8004870 0x7f6bd8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6beed9d700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf006b370 0x7f6bd8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bee59c700 1 -- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf006b370 msgr2=0x7f6bd8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bee59c700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf006b370 0x7f6bd8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bee59c700 1 -- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8004870 msgr2=0x7f6bd8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bee59c700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8004870 0x7f6bd8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bee59c700 1 -- 172.21.15.81:0/477724597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd80035d0 con 0x7f6bd8003be0 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bedd9b700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8004870 0x7f6bd8004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bee59c700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd8003be0 0x7f6bd8003fd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c210 tx=0x7f6bd80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1de4ea4ac99373 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be400cdb0 con 0x7f6bd8003be0 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4005980 con 0x7f6bd8003be0 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bed59a700 1 -- 172.21.15.81:0/477724597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4005d30 con 0x7f6bd8003be0 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bef59e700 1 -- 172.21.15.81:0/477724597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd8003be0 msgr2=0x7f6bd8003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bef59e700 1 --2- 172.21.15.81:0/477724597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd8003be0 0x7f6bd8003fd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c210 tx=0x7f6bd80058a0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6beed9d700 1 -- 172.21.15.81:0/477724597 reap_dead start 2023-11-29T11:17:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bef59e700 1 -- 172.21.15.81:0/477724597 shutdown_connections 2023-11-29T11:17:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bef59e700 1 -- 172.21.15.81:0/477724597 >> 172.21.15.81:0/477724597 conn(0x7f6bf00cae70 msgr2=0x7f6bf00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:17:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bef59e700 1 -- 172.21.15.81:0/477724597 shutdown_connections 2023-11-29T11:17:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.331+0000 7f6bef59e700 1 -- 172.21.15.81:0/477724597 wait complete. 2023-11-29T11:17:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.335+0000 7f6bef59e700 1 Processor -- start 2023-11-29T11:17:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.335+0000 7f6bef59e700 1 -- start start 2023-11-29T11:17:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.335+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8003be0 0x7f6bf0157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.335+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf00c5ea0 0x7f6bf01f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.335+0000 7f6bef59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf00c6310 0x7f6bf01f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.335+0000 7f6bef59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00c6e70 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.335+0000 7f6bef59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00c68b0 con 0x7f6bd8003be0 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.335+0000 7f6bef59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00c6b90 con 0x7f6bf00c6310 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf00c5ea0 0x7f6bf01f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bee59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8003be0 0x7f6bf0157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf00c5ea0 0x7f6bf01f4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37828/0 (socket says 172.21.15.81:37828) 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 -- 172.21.15.81:0/2853555958 learned_addr learned my addr 172.21.15.81:0/2853555958 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6beed9d700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf00c6310 0x7f6bf01f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 -- 172.21.15.81:0/2853555958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf00c6310 msgr2=0x7f6bf01f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf00c6310 0x7f6bf01f5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 -- 172.21.15.81:0/2853555958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8003be0 msgr2=0x7f6bf0157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8003be0 0x7f6bf0157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:17:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 -- 172.21.15.81:0/2853555958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00cd230 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bee59c700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8003be0 0x7f6bf0157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:17:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bedd9b700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf00c5ea0 0x7f6bf01f4c00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6be0007900 tx=0x7f6be000fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bdeffd700 1 -- 172.21.15.81:0/2853555958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00050d0 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bdeffd700 1 -- 172.21.15.81:0/2853555958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0005230 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf00ccf50 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bdeffd700 1 -- 172.21.15.81:0/2853555958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00036a0 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf00b1c50 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.339+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf0072500 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.343+0000 7f6bdeffd700 1 -- 172.21.15.81:0/2853555958 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6be0003800 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.343+0000 7f6bdeffd700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bd0064ee0 0x7f6bd0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:17:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.343+0000 7f6bdeffd700 1 -- 172.21.15.81:0/2853555958 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f6be0082110 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.343+0000 7f6bee59c700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bd0064ee0 0x7f6bd0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:17:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.343+0000 7f6bee59c700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bd0064ee0 0x7f6bd0067390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6be4000c00 tx=0x7f6be400a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:17:59.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.351+0000 7f6bdeffd700 1 -- 172.21.15.81:0/2853555958 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6be00500f0 con 0x7f6bf00c5ea0 2023-11-29T11:17:59.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:17:59.551+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f6bf01e3ae0 con 0x7f6bf00c5ea0 2023-11-29T11:18:00.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.055+0000 7f6bdeffd700 1 -- 172.21.15.81:0/2853555958 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v42) v1 ==== 162+0+0 (secure 0 0 0) 0x7f6be0053710 con 0x7f6bf00c5ea0 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bd0064ee0 msgr2=0x7f6bd0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bd0064ee0 0x7f6bd0067390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6be4000c00 tx=0x7f6be400a000 comp rx=0 tx=0).stop 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf00c5ea0 msgr2=0x7f6bf01f4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf00c5ea0 0x7f6bf01f4c00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6be0007900 tx=0x7f6be000fdc0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 shutdown_connections 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6bd0064ee0 0x7f6bd0067390 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bf00c6310 0x7f6bf01f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf00c5ea0 0x7f6bf01f4c00 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 --2- 172.21.15.81:0/2853555958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bd8003be0 0x7f6bf0157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 >> 172.21.15.81:0/2853555958 conn(0x7f6bf00cae70 msgr2=0x7f6bf00abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 shutdown_connections 2023-11-29T11:18:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.059+0000 7f6bef59e700 1 -- 172.21.15.81:0/2853555958 wait complete. 2023-11-29T11:18:00.071 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-29T11:18:00.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:18:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.187+0000 7ff2e5750700 1 Processor -- start 2023-11-29T11:18:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.187+0000 7ff2e5750700 1 -- start start 2023-11-29T11:18:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.187+0000 7ff2e5750700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e0152bb0 0x7ff2e015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff2e00b3030 0x7ff2e006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e0152f80 con 0x7ff2e006c640 2023-11-29T11:18:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e006cff0 con 0x7ff2e00b3030 2023-11-29T11:18:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e015cfe0 con 0x7ff2e0152bb0 2023-11-29T11:18:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2df7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff2e006c640 0x7ff2e00706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59536/0 (socket says 172.21.15.81:59536) 2023-11-29T11:18:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2df7fe700 1 -- 172.21.15.81:0/3532579702 learned_addr learned my addr 172.21.15.81:0/3532579702 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2dffff700 1 --2- 172.21.15.81:0/3532579702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e0152bb0 0x7ff2e015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e4f4f700 1 --2- 172.21.15.81:0/3532579702 >> v2:172.21.15.176:3300/0 conn(0x7ff2e00b3030 0x7ff2e006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2deffd700 1 -- 172.21.15.81:0/3532579702 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425165475 0 0) 0x7ff2e0152f80 con 0x7ff2e006c640 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2deffd700 1 -- 172.21.15.81:0/3532579702 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c80057e0 con 0x7ff2e006c640 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e4f4f700 1 -- 172.21.15.81:0/3532579702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e0152bb0 msgr2=0x7ff2e015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e4f4f700 1 --2- 172.21.15.81:0/3532579702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e0152bb0 0x7ff2e015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e4f4f700 1 -- 172.21.15.81:0/3532579702 >> v1:172.21.15.81:6789/0 conn(0x7ff2e006c640 legacy=0x7ff2e00706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2deffd700 1 -- 172.21.15.81:0/3532579702 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2956219106 0 0) 0x7ff2c80057e0 con 0x7ff2e006c640 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e4f4f700 1 -- 172.21.15.81:0/3532579702 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0159a30 con 0x7ff2e00b3030 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e4f4f700 1 --2- 172.21.15.81:0/3532579702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 0x7ff2e006cab0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009d90 tx=0x7ff2d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd669d104214a17 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2deffd700 1 -- 172.21.15.81:0/3532579702 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800e070 con 0x7ff2e00b3030 2023-11-29T11:18:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2deffd700 1 -- 172.21.15.81:0/3532579702 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8003a40 con 0x7ff2e00b3030 2023-11-29T11:18:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2deffd700 1 -- 172.21.15.81:0/3532579702 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4001670 con 0x7ff2e00b3030 2023-11-29T11:18:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 -- 172.21.15.81:0/3532579702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 msgr2=0x7ff2e006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 --2- 172.21.15.81:0/3532579702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 0x7ff2e006cab0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009d90 tx=0x7ff2d800b330 comp rx=0 tx=0).stop 2023-11-29T11:18:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 -- 172.21.15.81:0/3532579702 shutdown_connections 2023-11-29T11:18:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 --2- 172.21.15.81:0/3532579702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 0x7ff2e006cab0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 --2- 172.21.15.81:0/3532579702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e0152bb0 0x7ff2e015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 -- 172.21.15.81:0/3532579702 >> 172.21.15.81:0/3532579702 conn(0x7ff2e006e000 msgr2=0x7ff2e00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 -- 172.21.15.81:0/3532579702 shutdown_connections 2023-11-29T11:18:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.191+0000 7ff2e5750700 1 -- 172.21.15.81:0/3532579702 wait complete. 2023-11-29T11:18:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.195+0000 7ff2e5750700 1 Processor -- start 2023-11-29T11:18:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.195+0000 7ff2e5750700 1 -- start start 2023-11-29T11:18:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e5750700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e006c640 0x7ff2e0148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e5750700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 0x7ff2e014e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e5750700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e0152bb0 0x7ff2e014a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e5750700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e014dbf0 con 0x7ff2e0152bb0 2023-11-29T11:18:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e5750700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e0149710 con 0x7ff2e00b3030 2023-11-29T11:18:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e5750700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e01499f0 con 0x7ff2e006c640 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e0152bb0 0x7ff2e014a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e0152bb0 0x7ff2e014a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57686/0 (socket says 172.21.15.81:57686) 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 -- 172.21.15.81:0/4106857146 learned_addr learned my addr 172.21.15.81:0/4106857146 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2df7fe700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 0x7ff2e014e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2dffff700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e006c640 0x7ff2e0148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 -- 172.21.15.81:0/4106857146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e006c640 msgr2=0x7ff2e0148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e006c640 0x7ff2e0148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 -- 172.21.15.81:0/4106857146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 msgr2=0x7ff2e014e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 0x7ff2e014e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 -- 172.21.15.81:0/4106857146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009a70 con 0x7ff2e0152bb0 2023-11-29T11:18:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e4f4f700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e0152bb0 0x7ff2e014a7b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800b370 tx=0x7ff2d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2dcff9700 1 -- 172.21.15.81:0/4106857146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80044c0 con 0x7ff2e0152bb0 2023-11-29T11:18:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2dcff9700 1 -- 172.21.15.81:0/4106857146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8004620 con 0x7ff2e0152bb0 2023-11-29T11:18:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e0159190 con 0x7ff2e0152bb0 2023-11-29T11:18:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2dcff9700 1 -- 172.21.15.81:0/4106857146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d801b430 con 0x7ff2e0152bb0 2023-11-29T11:18:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.199+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e0158eb0 con 0x7ff2e0152bb0 2023-11-29T11:18:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.203+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e0159470 con 0x7ff2e0152bb0 2023-11-29T11:18:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.203+0000 7ff2dcff9700 1 -- 172.21.15.81:0/4106857146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff2d8023030 con 0x7ff2e0152bb0 2023-11-29T11:18:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.203+0000 7ff2dcff9700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff2cc064ee0 0x7ff2cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.203+0000 7ff2dcff9700 1 -- 172.21.15.81:0/4106857146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7ff2d80834c0 con 0x7ff2e0152bb0 2023-11-29T11:18:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.203+0000 7ff2dffff700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff2cc064ee0 0x7ff2cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:00.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.203+0000 7ff2dffff700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff2cc064ee0 0x7ff2cc067390 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009bf0 tx=0x7ff2d0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.211+0000 7ff2dcff9700 1 -- 172.21.15.81:0/4106857146 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff2d8051440 con 0x7ff2e0152bb0 2023-11-29T11:18:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.407+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2e0072c20 con 0x7ff2e0152bb0 2023-11-29T11:18:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.407+0000 7ff2dcff9700 1 -- 172.21.15.81:0/4106857146 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4657 (secure 0 0 0) 0x7ff2d8054a60 con 0x7ff2e0152bb0 2023-11-29T11:18:00.417 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:18:00.417 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:00.052909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:18:00.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff2cc064ee0 msgr2=0x7ff2cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff2cc064ee0 0x7ff2cc067390 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009bf0 tx=0x7ff2d0009240 comp rx=0 tx=0).stop 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e0152bb0 msgr2=0x7ff2e014a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e0152bb0 0x7ff2e014a7b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800b370 tx=0x7ff2d8004af0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 shutdown_connections 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff2cc064ee0 0x7ff2cc067390 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e0152bb0 0x7ff2e014a7b0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2e00b3030 0x7ff2e014e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 --2- 172.21.15.81:0/4106857146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2e006c640 0x7ff2e0148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 >> 172.21.15.81:0/4106857146 conn(0x7ff2e006e000 msgr2=0x7ff2e0159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 shutdown_connections 2023-11-29T11:18:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:00.411+0000 7ff2e5750700 1 -- 172.21.15.81:0/4106857146 wait complete. 2023-11-29T11:18:00.421 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2023-11-29T11:18:00.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:17:39.743930+0000', 'modified': '2023-11-29T11:18:00.052909+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 84, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7461': {'gid': 7461, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.81:6837/1678973589', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 1678973589}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 1678973589}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:18:00.833 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7461:up:replay 2023-11-29T11:18:01.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 Processor -- start 2023-11-29T11:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- start start 2023-11-29T11:18:01.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6164037f90 0x7f61640e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:01.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61640e7000 0x7f61640e3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640e6b70 con 0x7f6164052210 2023-11-29T11:18:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61640e38a0 con 0x7f6164037f90 2023-11-29T11:18:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61640525e0 con 0x7f61640e7000 2023-11-29T11:18:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617104b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6164037f90 0x7f61640e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617104b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6164037f90 0x7f61640e2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57696/0 (socket says 172.21.15.81:57696) 2023-11-29T11:18:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617104b700 1 -- 172.21.15.81:0/4263968513 learned_addr learned my addr 172.21.15.81:0/4263968513 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617204d700 1 --2- 172.21.15.81:0/4263968513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61640e7000 0x7f61640e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617104b700 1 -- 172.21.15.81:0/4263968513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61640e7000 msgr2=0x7f61640e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617104b700 1 --2- 172.21.15.81:0/4263968513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61640e7000 0x7f61640e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617104b700 1 -- 172.21.15.81:0/4263968513 >> v1:172.21.15.176:6789/0 conn(0x7f6164052210 legacy=0x7f6164037880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617084a700 1 -- 172.21.15.81:0/4263968513 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346956933 0 0) 0x7f61640e6b70 con 0x7f6164052210 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617104b700 1 -- 172.21.15.81:0/4263968513 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640e3ac0 con 0x7f6164037f90 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617104b700 1 --2- 172.21.15.81:0/4263968513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164037f90 0x7f61640e2e20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f615c009910 tx=0x7f615c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2871bdbfe89ead server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617084a700 1 -- 172.21.15.81:0/4263968513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c011830 con 0x7f6164037f90 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617084a700 1 -- 172.21.15.81:0/4263968513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c011990 con 0x7f6164037f90 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617084a700 1 -- 172.21.15.81:0/4263968513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c011d40 con 0x7f6164037f90 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- 172.21.15.81:0/4263968513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164037f90 msgr2=0x7f61640e2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 --2- 172.21.15.81:0/4263968513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164037f90 0x7f61640e2e20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f615c009910 tx=0x7f615c009c20 comp rx=0 tx=0).stop 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- 172.21.15.81:0/4263968513 shutdown_connections 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 --2- 172.21.15.81:0/4263968513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61640e7000 0x7f61640e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 --2- 172.21.15.81:0/4263968513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164037f90 0x7f61640e2e20 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- 172.21.15.81:0/4263968513 >> 172.21.15.81:0/4263968513 conn(0x7f6164052880 msgr2=0x7f6164052c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- 172.21.15.81:0/4263968513 shutdown_connections 2023-11-29T11:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.951+0000 7f617284e700 1 -- 172.21.15.81:0/4263968513 wait complete. 2023-11-29T11:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617284e700 1 Processor -- start 2023-11-29T11:18:01.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617284e700 1 -- start start 2023-11-29T11:18:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617284e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6164037f90 0x7f61640d74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617284e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164052210 0x7f6164031ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617284e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61640e7000 0x7f6164032560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617284e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6164035410 con 0x7f6164052210 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617284e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640d7a00 con 0x7f61640e7000 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617284e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6164032010 con 0x7f6164037f90 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617104b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164052210 0x7f6164031ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617184c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6164037f90 0x7f61640d74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617184c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6164037f90 0x7f61640d74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:39834/0 (socket says 172.21.15.81:39834) 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617104b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164052210 0x7f6164031ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57712/0 (socket says 172.21.15.81:57712) 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617184c700 1 -- 172.21.15.81:0/1200892961 learned_addr learned my addr 172.21.15.81:0/1200892961 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.955+0000 7f617204d700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61640e7000 0x7f6164032560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:01.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617184c700 1 -- 172.21.15.81:0/1200892961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61640e7000 msgr2=0x7f6164032560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:01.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617184c700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61640e7000 0x7f6164032560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:01.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617184c700 1 -- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164052210 msgr2=0x7f6164031ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617184c700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164052210 0x7f6164031ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617184c700 1 -- 172.21.15.81:0/1200892961 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c009570 con 0x7f6164037f90 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617104b700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164052210 0x7f6164031ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617184c700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6164037f90 0x7f61640d74c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61680011e0 tx=0x7f616800ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f61627fc700 1 -- 172.21.15.81:0/1200892961 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680054e0 con 0x7f6164037f90 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f61627fc700 1 -- 172.21.15.81:0/1200892961 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61680036a0 con 0x7f6164037f90 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f61627fc700 1 -- 172.21.15.81:0/1200892961 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168003a50 con 0x7f6164037f90 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61640e6800 con 0x7f6164037f90 2023-11-29T11:18:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.959+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61640e6520 con 0x7f6164037f90 2023-11-29T11:18:01.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.963+0000 7f61627fc700 1 -- 172.21.15.81:0/1200892961 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6168019030 con 0x7f6164037f90 2023-11-29T11:18:01.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.963+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6164050450 con 0x7f6164037f90 2023-11-29T11:18:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.963+0000 7f61627fc700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6150064ee0 0x7f6150067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.963+0000 7f61627fc700 1 -- 172.21.15.81:0/1200892961 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f6168081450 con 0x7f6164037f90 2023-11-29T11:18:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.963+0000 7f617104b700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6150064ee0 0x7f6150067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.963+0000 7f617104b700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6150064ee0 0x7f6150067390 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f615c009910 tx=0x7f615c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:01.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:01.971+0000 7f61627fc700 1 -- 172.21.15.81:0/1200892961 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f616804f340 con 0x7f6164037f90 2023-11-29T11:18:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.171+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61640059c0 con 0x7f6164037f90 2023-11-29T11:18:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.171+0000 7f61627fc700 1 -- 172.21.15.81:0/1200892961 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f6168052960 con 0x7f6164037f90 2023-11-29T11:18:02.182 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:18:02.182 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:02.084708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6150064ee0 msgr2=0x7f6150067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6150064ee0 0x7f6150067390 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f615c009910 tx=0x7f615c008030 comp rx=0 tx=0).stop 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6164037f90 msgr2=0x7f61640d74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6164037f90 0x7f61640d74c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61680011e0 tx=0x7f616800ca30 comp rx=0 tx=0).stop 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 shutdown_connections 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6150064ee0 0x7f6150067390 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61640e7000 0x7f6164032560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6164052210 0x7f6164031ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 --2- 172.21.15.81:0/1200892961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6164037f90 0x7f61640d74c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 >> 172.21.15.81:0/1200892961 conn(0x7f6164052880 msgr2=0x7f6164035980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 shutdown_connections 2023-11-29T11:18:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:02.175+0000 7f617284e700 1 -- 172.21.15.81:0/1200892961 wait complete. 2023-11-29T11:18:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2023-11-29T11:18:02.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:17:39.743930+0000', 'modified': '2023-11-29T11:18:02.084708+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 84, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7461': {'gid': 7461, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.81:6837/1678973589', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 1678973589}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 1678973589}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:18:02.599 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7461:up:rejoin 2023-11-29T11:18:03.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:18:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.719+0000 7f23b962c700 1 Processor -- start 2023-11-29T11:18:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.719+0000 7f23b962c700 1 -- start start 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f23b4069c40 0x7f23b40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b40cb2a0 0x7f23b40c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b406ace0 con 0x7f23b4159e70 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b40cb720 con 0x7f23b4069c40 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b406a0d0 con 0x7f23b40cb2a0 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b3fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f23b4159e70 0x7f23b406c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59540/0 (socket says 172.21.15.81:59540) 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b3fff700 1 -- 172.21.15.81:0/63359446 learned_addr learned my addr 172.21.15.81:0/63359446 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 --2- 172.21.15.81:0/63359446 >> v2:172.21.15.176:3300/0 conn(0x7f23b4069c40 0x7f23b40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b8e2b700 1 --2- 172.21.15.81:0/63359446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b40cb2a0 0x7f23b40c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b2ffd700 1 -- 172.21.15.81:0/63359446 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679304054 0 0) 0x7f23b406ace0 con 0x7f23b4159e70 2023-11-29T11:18:03.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b2ffd700 1 -- 172.21.15.81:0/63359446 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f239c0035d0 con 0x7f23b4159e70 2023-11-29T11:18:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 -- 172.21.15.81:0/63359446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b40cb2a0 msgr2=0x7f23b40c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 --2- 172.21.15.81:0/63359446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b40cb2a0 0x7f23b40c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b2ffd700 1 -- 172.21.15.81:0/63359446 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404398004 0 0) 0x7f239c0035d0 con 0x7f23b4159e70 2023-11-29T11:18:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 -- 172.21.15.81:0/63359446 >> v1:172.21.15.81:6789/0 conn(0x7f23b4159e70 legacy=0x7f23b406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 -- 172.21.15.81:0/63359446 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b406a3b0 con 0x7f23b4069c40 2023-11-29T11:18:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 --2- 172.21.15.81:0/63359446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4069c40 0x7f23b40cad60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009850 tx=0x7f23a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10fdaabeb7e4e98 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b2ffd700 1 -- 172.21.15.81:0/63359446 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4001670 con 0x7f23b4069c40 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b2ffd700 1 -- 172.21.15.81:0/63359446 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8004030 con 0x7f23b4069c40 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b2ffd700 1 -- 172.21.15.81:0/63359446 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80043a0 con 0x7f23b4069c40 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- 172.21.15.81:0/63359446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4069c40 msgr2=0x7f23b40cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 --2- 172.21.15.81:0/63359446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4069c40 0x7f23b40cad60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009850 tx=0x7f23a8009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- 172.21.15.81:0/63359446 shutdown_connections 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 --2- 172.21.15.81:0/63359446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b40cb2a0 0x7f23b40c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 --2- 172.21.15.81:0/63359446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4069c40 0x7f23b40cad60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- 172.21.15.81:0/63359446 >> 172.21.15.81:0/63359446 conn(0x7f23b40ce3e0 msgr2=0x7f23b40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- 172.21.15.81:0/63359446 shutdown_connections 2023-11-29T11:18:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- 172.21.15.81:0/63359446 wait complete. 2023-11-29T11:18:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 Processor -- start 2023-11-29T11:18:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- start start 2023-11-29T11:18:03.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b4069c40 0x7f23b40c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:03.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b40cb2a0 0x7f23b40c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:03.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4159e70 0x7f23b41f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:03.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b41ef620 con 0x7f23b40cb2a0 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b4158850 con 0x7f23b4159e70 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b962c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b41ef8e0 con 0x7f23b4069c40 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b40cb2a0 0x7f23b40c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b40cb2a0 0x7f23b40c2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57718/0 (socket says 172.21.15.81:57718) 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b37fe700 1 -- 172.21.15.81:0/1736199542 learned_addr learned my addr 172.21.15.81:0/1736199542 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b3fff700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b4069c40 0x7f23b40c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.723+0000 7f23b8e2b700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4159e70 0x7f23b41f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b37fe700 1 -- 172.21.15.81:0/1736199542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b4069c40 msgr2=0x7f23b40c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b37fe700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b4069c40 0x7f23b40c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b37fe700 1 -- 172.21.15.81:0/1736199542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4159e70 msgr2=0x7f23b41f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b37fe700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4159e70 0x7f23b41f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b37fe700 1 -- 172.21.15.81:0/1736199542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a80094b0 con 0x7f23b40cb2a0 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b37fe700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b40cb2a0 0x7f23b40c2510 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f23a80090b0 tx=0x7f23a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b0ff9700 1 -- 172.21.15.81:0/1736199542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8003e80 con 0x7f23b40cb2a0 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b0ff9700 1 -- 172.21.15.81:0/1736199542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a801f070 con 0x7f23b40cb2a0 2023-11-29T11:18:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b406a970 con 0x7f23b40cb2a0 2023-11-29T11:18:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b0ff9700 1 -- 172.21.15.81:0/1736199542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011850 con 0x7f23b40cb2a0 2023-11-29T11:18:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b406a690 con 0x7f23b40cb2a0 2023-11-29T11:18:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b406d0b0 con 0x7f23b40cb2a0 2023-11-29T11:18:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b0ff9700 1 -- 172.21.15.81:0/1736199542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f23a8017020 con 0x7f23b40cb2a0 2023-11-29T11:18:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b0ff9700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b0ff9700 1 -- 172.21.15.81:0/1736199542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f23a8021070 con 0x7f23b40cb2a0 2023-11-29T11:18:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.727+0000 7f23b3fff700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.731+0000 7f23b3fff700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f23a40011e0 tx=0x7f23a4001da0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:03.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.739+0000 7f23b0ff9700 1 -- 172.21.15.81:0/1736199542 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23a80518a0 con 0x7f23b40cb2a0 2023-11-29T11:18:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.935+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23b4072500 con 0x7f23b40cb2a0 2023-11-29T11:18:03.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.935+0000 7f23b0ff9700 1 -- 172.21.15.81:0/1736199542 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f23a8054ec0 con 0x7f23b40cb2a0 2023-11-29T11:18:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:18:03.945 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:03.096238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:18:03.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 msgr2=0x7f23a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:03.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f23a40011e0 tx=0x7f23a4001da0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b40cb2a0 msgr2=0x7f23b40c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b40cb2a0 0x7f23b40c2510 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f23a80090b0 tx=0x7f23a8004770 comp rx=0 tx=0).stop 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 shutdown_connections 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b4159e70 0x7f23b41f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b40cb2a0 0x7f23b40c2510 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 --2- 172.21.15.81:0/1736199542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23b4069c40 0x7f23b40c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 >> 172.21.15.81:0/1736199542 conn(0x7f23b40ce3e0 msgr2=0x7f23b40ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 shutdown_connections 2023-11-29T11:18:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:03.939+0000 7f23b962c700 1 -- 172.21.15.81:0/1736199542 wait complete. 2023-11-29T11:18:03.949 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 45 2023-11-29T11:18:04.362 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:17:39.743930+0000', 'modified': '2023-11-29T11:18:03.096238+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 84, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7461': {'gid': 7461, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6837/1678973589', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 1678973589}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 1678973589}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:18:04.362 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:18:04.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-29T11:18:04.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7907f700 1 Processor -- start 2023-11-29T11:18:04.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7907f700 1 -- start start 2023-11-29T11:18:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7907f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7406a6e0 0x7f9f7406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7907f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f740d01d0 0x7f9f740cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7907f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7406aff0 con 0x7f9f7415a470 2023-11-29T11:18:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7907f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7406cb80 con 0x7f9f740d01d0 2023-11-29T11:18:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7907f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7406ce60 con 0x7f9f7406a6e0 2023-11-29T11:18:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7887e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9f7415a470 0x7f9f740c3070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59542/0 (socket says 172.21.15.81:59542) 2023-11-29T11:18:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f7887e700 1 -- 172.21.15.81:0/2735773870 learned_addr learned my addr 172.21.15.81:0/2735773870 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f737fe700 1 --2- 172.21.15.81:0/2735773870 >> v2:172.21.15.81:3300/0 conn(0x7f9f740d01d0 0x7f9f740cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f73fff700 1 --2- 172.21.15.81:0/2735773870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7406a6e0 0x7f9f7406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f72ffd700 1 -- 172.21.15.81:0/2735773870 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987683069 0 0) 0x7f9f7406aff0 con 0x7f9f7415a470 2023-11-29T11:18:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f72ffd700 1 -- 172.21.15.81:0/2735773870 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f600035d0 con 0x7f9f7415a470 2023-11-29T11:18:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f737fe700 1 -- 172.21.15.81:0/2735773870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7406a6e0 msgr2=0x7f9f7406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f737fe700 1 --2- 172.21.15.81:0/2735773870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7406a6e0 0x7f9f7406aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f737fe700 1 -- 172.21.15.81:0/2735773870 >> v1:172.21.15.81:6789/0 conn(0x7f9f7415a470 legacy=0x7f9f740c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f737fe700 1 -- 172.21.15.81:0/2735773870 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740ce5b0 con 0x7f9f740d01d0 2023-11-29T11:18:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f737fe700 1 --2- 172.21.15.81:0/2735773870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f740d01d0 0x7f9f740cead0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009850 tx=0x7f9f5c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a82417af132c8d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f72ffd700 1 -- 172.21.15.81:0/2735773870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c011830 con 0x7f9f740d01d0 2023-11-29T11:18:04.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f72ffd700 1 -- 172.21.15.81:0/2735773870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c011990 con 0x7f9f740d01d0 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.483+0000 7f9f72ffd700 1 -- 172.21.15.81:0/2735773870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c011d40 con 0x7f9f740d01d0 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 -- 172.21.15.81:0/2735773870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f740d01d0 msgr2=0x7f9f740cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 --2- 172.21.15.81:0/2735773870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f740d01d0 0x7f9f740cead0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009850 tx=0x7f9f5c009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 -- 172.21.15.81:0/2735773870 shutdown_connections 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 --2- 172.21.15.81:0/2735773870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f740d01d0 0x7f9f740cead0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 --2- 172.21.15.81:0/2735773870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7406a6e0 0x7f9f7406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 -- 172.21.15.81:0/2735773870 >> 172.21.15.81:0/2735773870 conn(0x7f9f740b1d40 msgr2=0x7f9f740cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 -- 172.21.15.81:0/2735773870 shutdown_connections 2023-11-29T11:18:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 -- 172.21.15.81:0/2735773870 wait complete. 2023-11-29T11:18:04.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 Processor -- start 2023-11-29T11:18:04.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.487+0000 7f9f7907f700 1 -- start start 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7907f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f7406a6e0 0x7f9f7415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7907f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f740d01d0 0x7f9f740adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7907f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7415a470 0x7f9f740c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7907f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740ca890 con 0x7f9f7406a6e0 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7907f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740c9c80 con 0x7f9f740d01d0 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7907f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f740c9f60 con 0x7f9f7415a470 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f7406a6e0 0x7f9f7415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f7406a6e0 0x7f9f7415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57740/0 (socket says 172.21.15.81:57740) 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 -- 172.21.15.81:0/4161930095 learned_addr learned my addr 172.21.15.81:0/4161930095 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f737fe700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f740d01d0 0x7f9f740adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7887e700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7415a470 0x7f9f740c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 -- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7415a470 msgr2=0x7f9f740c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7415a470 0x7f9f740c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 -- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f740d01d0 msgr2=0x7f9f740adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f740d01d0 0x7f9f740adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 -- 172.21.15.81:0/4161930095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0094b0 con 0x7f9f7406a6e0 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f737fe700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f740d01d0 0x7f9f740adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f73fff700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f7406a6e0 0x7f9f7415d460 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400ebe0 tx=0x7f9f64009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f70ff9700 1 -- 172.21.15.81:0/4161930095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64009740 con 0x7f9f7406a6e0 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f70ff9700 1 -- 172.21.15.81:0/4161930095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6400c8b0 con 0x7f9f7406a6e0 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7907f700 1 -- 172.21.15.81:0/4161930095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7406c930 con 0x7f9f7406a6e0 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f70ff9700 1 -- 172.21.15.81:0/4161930095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400cc40 con 0x7f9f7406a6e0 2023-11-29T11:18:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.491+0000 7f9f7907f700 1 -- 172.21.15.81:0/4161930095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7406c7a0 con 0x7f9f7406a6e0 2023-11-29T11:18:04.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.495+0000 7f9f70ff9700 1 -- 172.21.15.81:0/4161930095 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9f64019030 con 0x7f9f7406a6e0 2023-11-29T11:18:04.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.495+0000 7f9f70ff9700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f54064f10 0x7f9f540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.495+0000 7f9f70ff9700 1 -- 172.21.15.81:0/4161930095 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f9f640821b0 con 0x7f9f7406a6e0 2023-11-29T11:18:04.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.495+0000 7f9f737fe700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f54064f10 0x7f9f540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.495+0000 7f9f737fe700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f54064f10 0x7f9f540673c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9f740d05a0 tx=0x7f9f5c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.495+0000 7f9f7d561740 1 Processor -- start 2023-11-29T11:18:04.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.495+0000 7f9f7d561740 1 -- start start 2023-11-29T11:18:04.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80ae0 0x1e30e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 0x1e31340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e31880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cefae0 con 0x1b80ae0 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d5fbd0 con 0x1b80710 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d58ed0 con 0x1bcb790 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80ae0 0x1e30e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80ae0 0x1e30e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57756/0 (socket says 172.21.15.81:57756) 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 -- 172.21.15.81:0/783697729 learned_addr learned my addr 172.21.15.81:0/783697729 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7887e700 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e31880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f737fe700 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 0x1e31340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 -- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 msgr2=0x1e31880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e31880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 -- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 msgr2=0x1e31340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 0x1e31340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 -- 172.21.15.81:0/783697729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d7ecc0 con 0x1b80ae0 2023-11-29T11:18:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7887e700 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e31880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f73fff700 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80ae0 0x1e30e00 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9f6405b8c0 tx=0x7f9f64053790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2211de3aff19e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f69ffb700 1 -- 172.21.15.81:0/783697729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640533f0 con 0x1b80ae0 2023-11-29T11:18:04.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f69ffb700 1 -- 172.21.15.81:0/783697729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6405b960 con 0x1b80ae0 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f69ffb700 1 -- 172.21.15.81:0/783697729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6404faf0 con 0x1b80ae0 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- 172.21.15.81:0/783697729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80ae0 msgr2=0x1e30e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80ae0 0x1e30e00 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9f6405b8c0 tx=0x7f9f64053790 comp rx=0 tx=0).stop 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- 172.21.15.81:0/783697729 shutdown_connections 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e31880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 0x1e31340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 --2- 172.21.15.81:0/783697729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80ae0 0x1e30e00 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- 172.21.15.81:0/783697729 >> 172.21.15.81:0/783697729 conn(0x1b80eb0 msgr2=0x1e19700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- 172.21.15.81:0/783697729 shutdown_connections 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- 172.21.15.81:0/783697729 wait complete. 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 -- start start 2023-11-29T11:18:04.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.499+0000 7f9f7d561740 1 Processor -- start 2023-11-29T11:18:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 0x1e17aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1df2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bcb790 0x1df27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c05b20 con 0x1bcb790 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1df0d30 con 0x1b80710 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1df0fd0 con 0x1b80ae0 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 10 client.0 _ll_register_callbacks cb 0x1db50d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bcb790 0x1df27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bcb790 0x1df27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57770/0 (socket says 172.21.15.81:57770) 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 0x1e17aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 -- 172.21.15.81:0/529428229 learned_addr learned my addr 172.21.15.81:0/529428229 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f737fe700 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1df2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 -- 172.21.15.81:0/529428229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 msgr2=0x1df2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1df2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 -- 172.21.15.81:0/529428229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 msgr2=0x1e17aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 0x1e17aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 -- 172.21.15.81:0/529428229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7406c7a0 con 0x1bcb790 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f737fe700 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1df2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7887e700 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bcb790 0x1df27a0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00f820 tx=0x7f9f6c00f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb786bf7b0129fb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f52ffd700 1 -- 172.21.15.81:0/529428229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0072e0 con 0x1bcb790 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 -- 172.21.15.81:0/529428229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1d51f50 con 0x1bcb790 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f52ffd700 1 -- 172.21.15.81:0/529428229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f9f6c007440 con 0x1bcb790 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f52ffd700 1 -- 172.21.15.81:0/529428229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f6c001bc0 con 0x1bcb790 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 10 client.7512 fetch_fsmap learned FSMap version 45 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 -- 172.21.15.81:0/529428229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x1bcc9e0 con 0x1bcb790 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f52ffd700 1 -- 172.21.15.81:0/529428229 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1d51f50 con 0x1bcb790 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f52ffd700 1 -- 172.21.15.81:0/529428229 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 45) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9f6c012070 con 0x1bcb790 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 10 client.7512 fetch_fsmap finished waiting for FSMap version 45 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 10 client.7512 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 20 client.7512 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:04.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1e1a9a0 0x1def880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 4 client.7512 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:18:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f7d561740 1 -- 172.21.15.81:0/529428229 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1d51c70 con 0x1e1a9a0 2023-11-29T11:18:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f73fff700 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1e1a9a0 0x1def880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f73fff700 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1e1a9a0 0x1def880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81fa4c54276b5d26 server_cookie=cb3d7597b2f3e541 in_seq=0 out_seq=0 2023-11-29T11:18:04.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.503+0000 7f9f52ffd700 10 client.7512 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f52ffd700 1 -- 172.21.15.81:0/529428229 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1d51c70 con 0x1e1a9a0 2023-11-29T11:18:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f52ffd700 10 client.7512 handle_command_reply: tid=0 2023-11-29T11:18:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 client.7512 shutdown 2023-11-29T11:18:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 -- 172.21.15.81:0/529428229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bcb790 msgr2=0x1df27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bcb790 0x1df27a0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00f820 tx=0x7f9f6c00f850 comp rx=0 tx=0).stop 2023-11-29T11:18:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 -- 172.21.15.81:0/529428229 shutdown_connections 2023-11-29T11:18:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1e1a9a0 0x1def880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bcb790 0x1df27a0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f52ffd700 0 client.7512 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1df2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 --2- 172.21.15.81:0/529428229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80710 0x1e17aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 -- 172.21.15.81:0/529428229 >> 172.21.15.81:0/529428229 conn(0x1b80eb0 msgr2=0x1e197d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 -- 172.21.15.81:0/529428229 shutdown_connections 2023-11-29T11:18:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 1 -- 172.21.15.81:0/529428229 wait complete. 2023-11-29T11:18:04.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.507+0000 7f9f7d561740 20 client.7512 trim_cache size 0 max 16384 2023-11-29T11:18:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.527+0000 7f9f7d561740 1 Processor -- start 2023-11-29T11:18:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.527+0000 7f9f7d561740 1 -- start start 2023-11-29T11:18:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.527+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e2dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.527+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1e2e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.527+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bcb790 0x1e3ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.527+0000 7f9f7d561740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d57b80 con 0x1b80710 2023-11-29T11:18:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.527+0000 7f9f7d561740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d17ea0 con 0x1bcb790 2023-11-29T11:18:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.527+0000 7f9f7d561740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d09260 con 0x1b80ae0 2023-11-29T11:18:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e2dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7887e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bcb790 0x1e3ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e2dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57774/0 (socket says 172.21.15.81:57774) 2023-11-29T11:18:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f73fff700 1 -- 172.21.15.81:0/2092113630 learned_addr learned my addr 172.21.15.81:0/2092113630 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f737fe700 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1e2e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7887e700 1 -- 172.21.15.81:0/2092113630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 msgr2=0x1e2e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7887e700 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1e2e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7887e700 1 -- 172.21.15.81:0/2092113630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 msgr2=0x1e2dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7887e700 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e2dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7887e700 1 -- 172.21.15.81:0/2092113630 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d1f8a0 con 0x1bcb790 2023-11-29T11:18:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f73fff700 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e2dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:18:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7887e700 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bcb790 0x1e3ecf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c001220 tx=0x7f9f6c00a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2986c36476f19672 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f6a7fc700 1 -- 172.21.15.81:0/2092113630 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00fc50 con 0x1bcb790 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f6a7fc700 1 -- 172.21.15.81:0/2092113630 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c00d050 con 0x1bcb790 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f6a7fc700 1 -- 172.21.15.81:0/2092113630 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c007740 con 0x1bcb790 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 -- 172.21.15.81:0/2092113630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bcb790 msgr2=0x1e3ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bcb790 0x1e3ecf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c001220 tx=0x7f9f6c00a000 comp rx=0 tx=0).stop 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 -- 172.21.15.81:0/2092113630 shutdown_connections 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1bcb790 0x1e3ecf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1b80ae0 0x1e2e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2092113630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e2dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 -- 172.21.15.81:0/2092113630 >> 172.21.15.81:0/2092113630 conn(0x1b80eb0 msgr2=0x1df1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 -- 172.21.15.81:0/2092113630 shutdown_connections 2023-11-29T11:18:04.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 -- 172.21.15.81:0/2092113630 wait complete. 2023-11-29T11:18:04.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 -- start start 2023-11-29T11:18:04.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.531+0000 7f9f7d561740 1 Processor -- start 2023-11-29T11:18:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e93860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80ae0 0x1e3fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e40280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e4f420 con 0x1b80710 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e2efb0 con 0x1b80ae0 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e4eb60 con 0x1bcb790 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 10 client.0 _ll_register_callbacks cb 0x1d052d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e93860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e93860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57788/0 (socket says 172.21.15.81:57788) 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 -- 172.21.15.81:0/2524438496 learned_addr learned my addr 172.21.15.81:0/2524438496 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f737fe700 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80ae0 0x1e3fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7887e700 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e40280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 -- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 msgr2=0x1e40280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e40280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 -- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80ae0 msgr2=0x1e3fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80ae0 0x1e3fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 -- 172.21.15.81:0/2524438496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6407e040 con 0x1b80710 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f737fe700 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80ae0 0x1e3fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f73fff700 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e93860 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9f64050720 tx=0x7f9f64059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdfa7db6b8c8947 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 1 -- 172.21.15.81:0/2524438496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64067250 con 0x1b80710 2023-11-29T11:18:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 1 -- 172.21.15.81:0/2524438496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f9f64057070 con 0x1b80710 2023-11-29T11:18:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- 172.21.15.81:0/2524438496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f6405b960 con 0x1b80710 2023-11-29T11:18:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 1 -- 172.21.15.81:0/2524438496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f64053ad0 con 0x1b80710 2023-11-29T11:18:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 10 client.7518 fetch_fsmap learned FSMap version 45 2023-11-29T11:18:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- 172.21.15.81:0/2524438496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x1bcc9e0 con 0x1b80710 2023-11-29T11:18:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 1 -- 172.21.15.81:0/2524438496 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6405b960 con 0x1b80710 2023-11-29T11:18:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 1 -- 172.21.15.81:0/2524438496 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 45) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9f640531f0 con 0x1b80710 2023-11-29T11:18:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 10 client.7518 fetch_fsmap finished waiting for FSMap version 45 2023-11-29T11:18:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 10 client.7518 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:18:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 20 client.7518 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1e4e000 0x1e4e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 4 client.7518 mds_command: new command op to 7461 tid=0[{"prefix": "status"}] 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- 172.21.15.81:0/2524438496 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1bfd260 con 0x1e4e000 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f737fe700 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1e4e000 0x1e4e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 10 client.7518 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f737fe700 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1e4e000 0x1e4e3d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414ca8109a2a4fd9 server_cookie=d3b63fbe75505238 in_seq=0 out_seq=0 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 1 -- 172.21.15.81:0/2524438496 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1bfd260 con 0x1e4e000 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 10 client.7518 handle_command_reply: tid=0 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 client.7518 shutdown 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- 172.21.15.81:0/2524438496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 msgr2=0x1e93860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e93860 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9f64050720 tx=0x7f9f64059040 comp rx=0 tx=0).stop 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- 172.21.15.81:0/2524438496 shutdown_connections 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1e4e000 0x1e4e3d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1bcb790 0x1e40280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1b80ae0 0x1e3fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f52ffd700 0 client.7518 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:04.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 --2- 172.21.15.81:0/2524438496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b80710 0x1e93860 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.535+0000 7f9f7d561740 1 -- 172.21.15.81:0/2524438496 >> 172.21.15.81:0/2524438496 conn(0x1b80eb0 msgr2=0x1e47410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7d561740 1 -- 172.21.15.81:0/2524438496 shutdown_connections 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7d561740 1 -- 172.21.15.81:0/2524438496 wait complete. 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7d561740 20 client.7518 trim_cache size 0 max 16384 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7461, 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.4820307750000001, 2023-11-29T11:18:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 45, 2023-11-29T11:18:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 84, 2023-11-29T11:18:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 84, 2023-11-29T11:18:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 5.4125743540000002 2023-11-29T11:18:04.546 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 -- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f54064f10 msgr2=0x7f9f540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f54064f10 0x7f9f540673c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9f740d05a0 tx=0x7f9f5c008030 comp rx=0 tx=0).stop 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 -- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f7406a6e0 msgr2=0x7f9f7415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f7406a6e0 0x7f9f7415d460 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400ebe0 tx=0x7f9f64009e00 comp rx=0 tx=0).stop 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 -- 172.21.15.81:0/4161930095 shutdown_connections 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9f54064f10 0x7f9f540673c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f7415a470 0x7f9f740c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f740d01d0 0x7f9f740adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 --2- 172.21.15.81:0/4161930095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f7406a6e0 0x7f9f7415d460 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 -- 172.21.15.81:0/4161930095 >> 172.21.15.81:0/4161930095 conn(0x7f9f740b1d40 msgr2=0x7f9f740cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 -- 172.21.15.81:0/4161930095 shutdown_connections 2023-11-29T11:18:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.539+0000 7f9f7907f700 1 -- 172.21.15.81:0/4161930095 wait complete. 2023-11-29T11:18:04.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:18:04.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f960c894700 1 Processor -- start 2023-11-29T11:18:04.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f960c894700 1 -- start start 2023-11-29T11:18:04.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f960c894700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9608069c40 0x7f96080cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f960c894700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960806ace0 con 0x7f96080cb2a0 2023-11-29T11:18:04.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f960c894700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96080cb6e0 con 0x7f9608159e70 2023-11-29T11:18:04.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f960c894700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960806a0d0 con 0x7f9608069c40 2023-11-29T11:18:04.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f9607fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f96080cb2a0 0x7f96080c91d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59552/0 (socket says 172.21.15.81:59552) 2023-11-29T11:18:04.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f9607fff700 1 -- 172.21.15.81:0/487441883 learned_addr learned my addr 172.21.15.81:0/487441883 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:04.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f9606ffd700 1 --2- 172.21.15.81:0/487441883 >> v2:172.21.15.176:3300/0 conn(0x7f9608069c40 0x7f96080cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.675+0000 7f96067fc700 1 -- 172.21.15.81:0/487441883 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085428976 0 0) 0x7f960806ace0 con 0x7f96080cb2a0 2023-11-29T11:18:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f96067fc700 1 -- 172.21.15.81:0/487441883 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f00035d0 con 0x7f96080cb2a0 2023-11-29T11:18:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f9606ffd700 1 -- 172.21.15.81:0/487441883 >> v1:172.21.15.176:6789/0 conn(0x7f9608159e70 legacy=0x7f960806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f9606ffd700 1 -- 172.21.15.81:0/487441883 >> v1:172.21.15.81:6789/0 conn(0x7f96080cb2a0 legacy=0x7f96080c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f96067fc700 1 -- 172.21.15.81:0/487441883 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 989256372 0 0) 0x7f95f00035d0 con 0x7f96080cb2a0 2023-11-29T11:18:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f9606ffd700 1 -- 172.21.15.81:0/487441883 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960806a3b0 con 0x7f9608069c40 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f9606ffd700 1 --2- 172.21.15.81:0/487441883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608069c40 0x7f96080cad60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9600009d90 tx=0x7f960000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=906939eb9710a03f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f96067fc700 1 -- 172.21.15.81:0/487441883 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000e070 con 0x7f9608069c40 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f96067fc700 1 -- 172.21.15.81:0/487441883 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600003a40 con 0x7f9608069c40 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f96067fc700 1 -- 172.21.15.81:0/487441883 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc001670 con 0x7f9608069c40 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 -- 172.21.15.81:0/487441883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608069c40 msgr2=0x7f96080cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 --2- 172.21.15.81:0/487441883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608069c40 0x7f96080cad60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9600009d90 tx=0x7f960000b330 comp rx=0 tx=0).stop 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 -- 172.21.15.81:0/487441883 shutdown_connections 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 --2- 172.21.15.81:0/487441883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608069c40 0x7f96080cad60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 -- 172.21.15.81:0/487441883 >> 172.21.15.81:0/487441883 conn(0x7f96080ce3e0 msgr2=0x7f96080ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:04.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 -- 172.21.15.81:0/487441883 shutdown_connections 2023-11-29T11:18:04.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 -- 172.21.15.81:0/487441883 wait complete. 2023-11-29T11:18:04.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 Processor -- start 2023-11-29T11:18:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.679+0000 7f960c894700 1 -- start start 2023-11-29T11:18:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f960c894700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9608069c40 0x7f96081581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f960c894700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96080cb2a0 0x7f960815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f960c894700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608159e70 0x7f96080c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f960c894700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96080c3a00 con 0x7f9608069c40 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f960c894700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960815bab0 con 0x7f9608159e70 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f960c894700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96080c3060 con 0x7f96080cb2a0 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9608069c40 0x7f96081581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9608069c40 0x7f96081581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57798/0 (socket says 172.21.15.81:57798) 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 -- 172.21.15.81:0/2743500737 learned_addr learned my addr 172.21.15.81:0/2743500737 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f9607fff700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608159e70 0x7f96080c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f9606ffd700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96080cb2a0 0x7f960815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 -- 172.21.15.81:0/2743500737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96080cb2a0 msgr2=0x7f960815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96080cb2a0 0x7f960815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 -- 172.21.15.81:0/2743500737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608159e70 msgr2=0x7f96080c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608159e70 0x7f96080c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 -- 172.21.15.81:0/2743500737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600009a70 con 0x7f9608069c40 2023-11-29T11:18:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f96077fe700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9608069c40 0x7f96081581f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c500 tx=0x7f95f800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f95effff700 1 -- 172.21.15.81:0/2743500737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f80052d0 con 0x7f9608069c40 2023-11-29T11:18:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f95effff700 1 -- 172.21.15.81:0/2743500737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8005430 con 0x7f9608069c40 2023-11-29T11:18:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960806a970 con 0x7f9608069c40 2023-11-29T11:18:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f95effff700 1 -- 172.21.15.81:0/2743500737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f80055a0 con 0x7f9608069c40 2023-11-29T11:18:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.683+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960806a690 con 0x7f9608069c40 2023-11-29T11:18:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.687+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960806d0b0 con 0x7f9608069c40 2023-11-29T11:18:04.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.687+0000 7f95effff700 1 -- 172.21.15.81:0/2743500737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f95f8019030 con 0x7f9608069c40 2023-11-29T11:18:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.687+0000 7f95effff700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f95f4064ee0 0x7f95f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.687+0000 7f95effff700 1 -- 172.21.15.81:0/2743500737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f95f8081250 con 0x7f9608069c40 2023-11-29T11:18:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.687+0000 7f9606ffd700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f95f4064ee0 0x7f95f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.687+0000 7f9606ffd700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f95f4064ee0 0x7f95f4067390 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f960000b370 tx=0x7f9600011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.695+0000 7f95effff700 1 -- 172.21.15.81:0/2743500737 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f95f804f230 con 0x7f9608069c40 2023-11-29T11:18:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.887+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96080c3b40 con 0x7f9608069c40 2023-11-29T11:18:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.887+0000 7f95effff700 1 -- 172.21.15.81:0/2743500737 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7f96080c3b40 con 0x7f9608069c40 2023-11-29T11:18:04.893 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:18:04.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f95f4064ee0 msgr2=0x7f95f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f95f4064ee0 0x7f95f4067390 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f960000b370 tx=0x7f9600011000 comp rx=0 tx=0).stop 2023-11-29T11:18:04.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9608069c40 msgr2=0x7f96081581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9608069c40 0x7f96081581f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c500 tx=0x7f95f800c810 comp rx=0 tx=0).stop 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 shutdown_connections 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f95f4064ee0 0x7f95f4067390 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9608159e70 0x7f96080c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96080cb2a0 0x7f960815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 --2- 172.21.15.81:0/2743500737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9608069c40 0x7f96081581f0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 >> 172.21.15.81:0/2743500737 conn(0x7f96080ce3e0 msgr2=0x7f96080ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 shutdown_connections 2023-11-29T11:18:04.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:04.891+0000 7f960c894700 1 -- 172.21.15.81:0/2743500737 wait complete. 2023-11-29T11:18:04.907 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:18:04.907 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:18:04.907 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:18:04.907 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:18:04.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:18:04.908 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:18:04.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:18:04.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:18:04.908 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:18:04.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:04.908 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:18:04.916 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:18:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:18:04.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:04.919 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:18:04.933 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:18:04.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:04.934 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:18:04.986 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:18:04.986 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:18:04.986 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:18:04.986 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:18:04.986 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:18:04.986 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:18:04.986 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:18:04.986 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:18:04.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:04.987 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:18:04.987 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:18:04.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:18:04.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:18:04.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:18:04.987 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:18:05.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:05.024 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:18:05.029 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:18:05.029 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:18:05.030 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:18:05.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:05.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:18:05.044 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:18:05.044 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:18:05.045 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:18:05.093 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:18:05.093 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:18:05.093 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:18:05.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:18:05.116 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:18:05.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:18:05.172 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:18:05.173 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:18:05.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:05.173 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:18:05.179 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:18:05.179 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:18:05.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:18:05.196 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:18:05.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:18:05.250 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:18:05.251 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:18:05.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:05.251 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:18:05.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:18:05.267+0000 7f07f1cae640 -1 init, newargv = 0x56140b7199c0 newargc=15 2023-11-29T11:18:05.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[55474]: starting ceph client 2023-11-29T11:18:05.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[55474]: starting fuse 2023-11-29T11:18:06.072 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-11-29T11:18:06.067+0000 7ff25caa0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:18:06.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:18:06.379 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:18:06.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:18:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:18:06.438 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:18:06.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:06.439 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:18:06.447 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:18:06.447 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:18:06.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:18:06.447 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:18:06.447 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:18:06.448 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:18:06.449 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:18:06.528 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.55474.asok 2023-11-29T11:18:06.714 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55474.asok 2023-11-29T11:18:06.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:06.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55474.asok status 2023-11-29T11:18:06.862 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:18:06.862 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:18:06.863 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:18:06.863 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:18:06.863 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:18:06.863 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:18:06.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:18:06.863 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "55474", 2023-11-29T11:18:06.863 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:18:06.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7533, 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7533 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:18:06.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3533050990 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3533050990 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.7533 192.168.0.1:0/3533050990", 2023-11-29T11:18:06.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/3533050990", 2023-11-29T11:18:06.866 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:18:06.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 45, 2023-11-29T11:18:06.866 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 84, 2023-11-29T11:18:06.866 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:18:06.866 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:18:06.866 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:18:06.866 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:18:06.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:06.873 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:18:06.873 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:18:06.879 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:18:06.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:18:06.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:06.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:18:06.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:06.891 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2023-11-29T11:18:06.903 INFO:teuthology.orchestra.run.smithi081.stdout:file_undamaged 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> import json 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> import sys 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> try: 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> sys.exit(e.errno) 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:18:06.905 DEBUG:teuthology.orchestra.run.smithi081:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-11-29T11:18:06.906 DEBUG:teuthology.orchestra.run.smithi081:> print(json.dumps( 2023-11-29T11:18:06.906 DEBUG:teuthology.orchestra.run.smithi081:> dict([(a, getattr(s, a)) for a in attrs]), 2023-11-29T11:18:06.906 DEBUG:teuthology.orchestra.run.smithi081:> indent=2)) 2023-11-29T11:18:06.906 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:18:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:daemon-helper: command failed with exit status 2 2023-11-29T11:18:07.200 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-11-29T11:18:07.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:07.201 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2023-11-29T11:18:07.214 INFO:teuthology.orchestra.run.smithi081.stdout:2 2023-11-29T11:18:07.214 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:18:07.214 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:18:07.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:18:07.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8e0931700 1 Processor -- start 2023-11-29T11:18:07.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8e0931700 1 -- start start 2023-11-29T11:18:07.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8e0931700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc1606b0 0x7fc8dc0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8e0931700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc164e60 con 0x7fc8dc0ceef0 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8e0931700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0cae70 con 0x7fc8dc0ad610 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8e0931700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0cbc10 con 0x7fc8dc1606b0 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc8dc0ceef0 0x7fc8dc164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59562/0 (socket says 172.21.15.81:59562) 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 -- 172.21.15.81:0/4058142091 learned_addr learned my addr 172.21.15.81:0/4058142091 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8dad9d700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc1606b0 0x7fc8dc0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299497633 0 0) 0x7fc8dc164e60 con 0x7fc8dc0ceef0 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c80035d0 con 0x7fc8dc0ceef0 2023-11-29T11:18:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1195828322 0 0) 0x7fc8c80035d0 con 0x7fc8dc0ceef0 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc1606b0 msgr2=0x7fc8dc0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc1606b0 0x7fc8dc0c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 >> v1:172.21.15.176:6789/0 conn(0x7fc8dc0ad610 legacy=0x7fc8dc164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0cb130 con 0x7fc8dc0ceef0 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fc8d40019f0 con 0x7fc8dc0ceef0 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 >> v1:172.21.15.81:6789/0 conn(0x7fc8dc0ceef0 legacy=0x7fc8dc164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8003a50 0x7fc8c8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8004870 0x7fc8c8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc1606b0 0x7fc8c8005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0cbc10 con 0x7fc8c8004870 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c800bb30 con 0x7fc8c8003a50 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c800bcf0 con 0x7fc8dc1606b0 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8dad9d700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8003a50 0x7fc8c8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8004870 0x7fc8c8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8db59e700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc1606b0 0x7fc8c8005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 -- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc1606b0 msgr2=0x7fc8c8005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc1606b0 0x7fc8c8005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 -- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8003a50 msgr2=0x7fc8c8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8003a50 0x7fc8c8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 -- 172.21.15.81:0/4058142091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80035d0 con 0x7fc8c8004870 2023-11-29T11:18:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8da59c700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8004870 0x7fc8c8004ce0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400a830 tx=0x7fc8c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d691a37d0cc5a5b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400a2f0 con 0x7fc8c8004870 2023-11-29T11:18:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d40072f0 con 0x7fc8c8004870 2023-11-29T11:18:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.383+0000 7fc8d9d9b700 1 -- 172.21.15.81:0/4058142091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d40076a0 con 0x7fc8c8004870 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- 172.21.15.81:0/4058142091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8004870 msgr2=0x7fc8c8004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 --2- 172.21.15.81:0/4058142091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8004870 0x7fc8c8004ce0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400a830 tx=0x7fc8c80058a0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8db59e700 1 -- 172.21.15.81:0/4058142091 reap_dead start 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- 172.21.15.81:0/4058142091 shutdown_connections 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- 172.21.15.81:0/4058142091 >> 172.21.15.81:0/4058142091 conn(0x7fc8dc0ce3e0 msgr2=0x7fc8dc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- 172.21.15.81:0/4058142091 shutdown_connections 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- 172.21.15.81:0/4058142091 wait complete. 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 Processor -- start 2023-11-29T11:18:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- start start 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8004870 0x7fc8dc0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc0ade40 0x7fc8dc1f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc0c13b0 0x7fc8dc0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc1f5bb0 con 0x7fc8dc0ade40 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0c1d60 con 0x7fc8c8004870 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8e0931700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0cce60 con 0x7fc8dc0c13b0 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.387+0000 7fc8da59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc0ade40 0x7fc8dc1f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8da59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc0ade40 0x7fc8dc1f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57816/0 (socket says 172.21.15.81:57816) 2023-11-29T11:18:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8da59c700 1 -- 172.21.15.81:0/2444777588 learned_addr learned my addr 172.21.15.81:0/2444777588 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8dad9d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8004870 0x7fc8dc0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8db59e700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc0c13b0 0x7fc8dc0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8da59c700 1 -- 172.21.15.81:0/2444777588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc0c13b0 msgr2=0x7fc8dc0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8da59c700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc0c13b0 0x7fc8dc0c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8da59c700 1 -- 172.21.15.81:0/2444777588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8004870 msgr2=0x7fc8dc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8da59c700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8004870 0x7fc8dc0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8da59c700 1 -- 172.21.15.81:0/2444777588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0cb6f0 con 0x7fc8dc0ade40 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8db59e700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc0c13b0 0x7fc8dc0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8da59c700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc0ade40 0x7fc8dc1f5670 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400ab40 tx=0x7fc8d4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8d37fe700 1 -- 172.21.15.81:0/2444777588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d40017b0 con 0x7fc8dc0ade40 2023-11-29T11:18:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8d37fe700 1 -- 172.21.15.81:0/2444777588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4001930 con 0x7fc8dc0ade40 2023-11-29T11:18:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc0cb410 con 0x7fc8dc0ade40 2023-11-29T11:18:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8d37fe700 1 -- 172.21.15.81:0/2444777588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4012640 con 0x7fc8dc0ade40 2023-11-29T11:18:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc06ac50 con 0x7fc8dc0ade40 2023-11-29T11:18:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc0ae2b0 con 0x7fc8dc0ade40 2023-11-29T11:18:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8d37fe700 1 -- 172.21.15.81:0/2444777588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc8d4010070 con 0x7fc8dc0ade40 2023-11-29T11:18:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8d37fe700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8bc064f10 0x7fc8bc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.391+0000 7fc8d37fe700 1 -- 172.21.15.81:0/2444777588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fc8d4083cf0 con 0x7fc8dc0ade40 2023-11-29T11:18:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.395+0000 7fc8dad9d700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8bc064f10 0x7fc8bc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.395+0000 7fc8dad9d700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8bc064f10 0x7fc8bc0673c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009c70 tx=0x7fc8c4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.403+0000 7fc8d37fe700 1 -- 172.21.15.81:0/2444777588 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc8d4051c50 con 0x7fc8dc0ade40 2023-11-29T11:18:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.567+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8dc072500 con 0x7fc8dc0ade40 2023-11-29T11:18:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.571+0000 7fc8d37fe700 1 -- 172.21.15.81:0/2444777588 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18200 (secure 0 0 0) 0x7fc8d4023020 con 0x7fc8dc0ade40 2023-11-29T11:18:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:18:07.576 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:58.488981+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3247003029":"2023-11-30T11:17:58.488925+0000","172.21.15.81:6836/3247003029":"2023-11-30T11:17:58.488925+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:18:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8bc064f10 msgr2=0x7fc8bc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8bc064f10 0x7fc8bc0673c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009c70 tx=0x7fc8c4009240 comp rx=0 tx=0).stop 2023-11-29T11:18:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc0ade40 msgr2=0x7fc8dc1f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc0ade40 0x7fc8dc1f5670 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400ab40 tx=0x7fc8d4001d80 comp rx=0 tx=0).stop 2023-11-29T11:18:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 shutdown_connections 2023-11-29T11:18:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc8bc064f10 0x7fc8bc0673c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8dc0c13b0 0x7fc8dc0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc0ade40 0x7fc8dc1f5670 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 --2- 172.21.15.81:0/2444777588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8c8004870 0x7fc8dc0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 >> 172.21.15.81:0/2444777588 conn(0x7fc8dc0ce3e0 msgr2=0x7fc8dc0700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 shutdown_connections 2023-11-29T11:18:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.575+0000 7fc8e0931700 1 -- 172.21.15.81:0/2444777588 wait complete. 2023-11-29T11:18:07.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:17:38.310347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:17:38.742094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:18:07.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:18:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdb0780700 1 Processor -- start 2023-11-29T11:18:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdb0780700 1 -- start start 2023-11-29T11:18:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdb0780700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efda80ca1b0 0x7efda80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdb0780700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80cd6b0 con 0x7efda80c8e60 2023-11-29T11:18:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdb0780700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80ce4f0 con 0x7efda8160980 2023-11-29T11:18:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdb0780700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda80b1010 con 0x7efda80ca1b0 2023-11-29T11:18:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdaed1d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efda80c8e60 0x7efda8069e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59568/0 (socket says 172.21.15.81:59568) 2023-11-29T11:18:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdaed1d700 1 -- 172.21.15.81:0/2283444011 learned_addr learned my addr 172.21.15.81:0/2283444011 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdadd1b700 1 --2- 172.21.15.81:0/2283444011 >> v2:172.21.15.176:3300/0 conn(0x7efda80ca1b0 0x7efda80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdad51a700 1 -- 172.21.15.81:0/2283444011 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270441716 0 0) 0x7efda80cd6b0 con 0x7efda80c8e60 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdad51a700 1 -- 172.21.15.81:0/2283444011 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd940035d0 con 0x7efda80c8e60 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdadd1b700 1 -- 172.21.15.81:0/2283444011 >> v1:172.21.15.176:6789/0 conn(0x7efda8160980 legacy=0x7efda80c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdadd1b700 1 -- 172.21.15.81:0/2283444011 >> v1:172.21.15.81:6789/0 conn(0x7efda80c8e60 legacy=0x7efda8069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdadd1b700 1 -- 172.21.15.81:0/2283444011 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8160d50 con 0x7efda80ca1b0 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdadd1b700 1 --2- 172.21.15.81:0/2283444011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80ca1b0 0x7efda80cd170 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efda4009850 tx=0x7efda4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b763b9b48addd4fa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdad51a700 1 -- 172.21.15.81:0/2283444011 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4011830 con 0x7efda80ca1b0 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdad51a700 1 -- 172.21.15.81:0/2283444011 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda4011990 con 0x7efda80ca1b0 2023-11-29T11:18:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.711+0000 7efdad51a700 1 -- 172.21.15.81:0/2283444011 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4011d40 con 0x7efda80ca1b0 2023-11-29T11:18:07.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- 172.21.15.81:0/2283444011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80ca1b0 msgr2=0x7efda80cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 --2- 172.21.15.81:0/2283444011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80ca1b0 0x7efda80cd170 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efda4009850 tx=0x7efda4009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:07.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- 172.21.15.81:0/2283444011 shutdown_connections 2023-11-29T11:18:07.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 --2- 172.21.15.81:0/2283444011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80ca1b0 0x7efda80cd170 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- 172.21.15.81:0/2283444011 >> 172.21.15.81:0/2283444011 conn(0x7efda80cf4a0 msgr2=0x7efda80cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:07.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- 172.21.15.81:0/2283444011 shutdown_connections 2023-11-29T11:18:07.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- 172.21.15.81:0/2283444011 wait complete. 2023-11-29T11:18:07.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 Processor -- start 2023-11-29T11:18:07.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- start start 2023-11-29T11:18:07.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80c8e60 0x7efda8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ca1b0 0x7efda81620c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda8160980 0x7efda81643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8163720 con 0x7efda8160980 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8162aa0 con 0x7efda80c8e60 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdb0780700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda8162d80 con 0x7efda80ca1b0 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda8160980 0x7efda81643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda8160980 0x7efda81643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57824/0 (socket says 172.21.15.81:57824) 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdae51c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80c8e60 0x7efda8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 -- 172.21.15.81:0/289402105 learned_addr learned my addr 172.21.15.81:0/289402105 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdadd1b700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ca1b0 0x7efda81620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 -- 172.21.15.81:0/289402105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ca1b0 msgr2=0x7efda81620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ca1b0 0x7efda81620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 -- 172.21.15.81:0/289402105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80c8e60 msgr2=0x7efda8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80c8e60 0x7efda8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 -- 172.21.15.81:0/289402105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40094b0 con 0x7efda8160980 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdae51c700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80c8e60 0x7efda8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efdaed1d700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda8160980 0x7efda81643f0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7efda000cb40 tx=0x7efda000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efd9affd700 1 -- 172.21.15.81:0/289402105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0007500 con 0x7efda8160980 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.715+0000 7efd9affd700 1 -- 172.21.15.81:0/289402105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0007660 con 0x7efda8160980 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda80cdbc0 con 0x7efda8160980 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efd9affd700 1 -- 172.21.15.81:0/289402105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00079f0 con 0x7efda8160980 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda80cd8e0 con 0x7efda8160980 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efd9affd700 1 -- 172.21.15.81:0/289402105 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efda0019030 con 0x7efda8160980 2023-11-29T11:18:07.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda80cdea0 con 0x7efda8160980 2023-11-29T11:18:07.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efd9affd700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd8c064ee0 0x7efd8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:07.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efdae51c700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd8c064ee0 0x7efd8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:07.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efd9affd700 1 -- 172.21.15.81:0/289402105 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7efda0081a30 con 0x7efda8160980 2023-11-29T11:18:07.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.719+0000 7efdae51c700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd8c064ee0 0x7efd8c067390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efd9c000f60 tx=0x7efd9c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.727+0000 7efd9affd700 1 -- 172.21.15.81:0/289402105 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efda004f920 con 0x7efda8160980 2023-11-29T11:18:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.883+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efda8163860 con 0x7efda8160980 2023-11-29T11:18:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efd9affd700 1 -- 172.21.15.81:0/289402105 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7efda0017020 con 0x7efda8160980 2023-11-29T11:18:07.891 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:18:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd8c064ee0 msgr2=0x7efd8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd8c064ee0 0x7efd8c067390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efd9c000f60 tx=0x7efd9c009040 comp rx=0 tx=0).stop 2023-11-29T11:18:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda8160980 msgr2=0x7efda81643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda8160980 0x7efda81643f0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7efda000cb40 tx=0x7efda000cb70 comp rx=0 tx=0).stop 2023-11-29T11:18:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 shutdown_connections 2023-11-29T11:18:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efd8c064ee0 0x7efd8c067390 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda8160980 0x7efda81643f0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efda80ca1b0 0x7efda81620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 --2- 172.21.15.81:0/289402105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efda80c8e60 0x7efda8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 >> 172.21.15.81:0/289402105 conn(0x7efda80cf4a0 msgr2=0x7efda80b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 shutdown_connections 2023-11-29T11:18:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:07.887+0000 7efdb0780700 1 -- 172.21.15.81:0/289402105 wait complete. 2023-11-29T11:18:07.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:18:08.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fe53d700 1 Processor -- start 2023-11-29T11:18:08.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fe53d700 1 -- start start 2023-11-29T11:18:08.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fe53d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9f806ce60 0x7ff9f80d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fe53d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9f80cf470 0x7ff9f80cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fe53d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f80cd300 con 0x7ff9f80cce60 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fe53d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f815c8b0 con 0x7ff9f806ce60 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fe53d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f806a7f0 con 0x7ff9f80cf470 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fd53b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9f806ce60 0x7ff9f80d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fcd3a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff9f80cce60 0x7ff9f806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59580/0 (socket says 172.21.15.81:59580) 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fd53b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff9f806ce60 0x7ff9f80d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57826/0 (socket says 172.21.15.81:57826) 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fcd3a700 1 -- 172.21.15.81:0/3890899373 learned_addr learned my addr 172.21.15.81:0/3890899373 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fdd3c700 1 --2- 172.21.15.81:0/3890899373 >> v2:172.21.15.176:3300/0 conn(0x7ff9f80cf470 0x7ff9f80cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fd53b700 1 -- 172.21.15.81:0/3890899373 >> v2:172.21.15.176:3300/0 conn(0x7ff9f80cf470 msgr2=0x7ff9f80cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:08.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fd53b700 1 --2- 172.21.15.81:0/3890899373 >> v2:172.21.15.176:3300/0 conn(0x7ff9f80cf470 0x7ff9f80cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fd53b700 1 -- 172.21.15.81:0/3890899373 >> v1:172.21.15.81:6789/0 conn(0x7ff9f80cce60 legacy=0x7ff9f806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fd53b700 1 -- 172.21.15.81:0/3890899373 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f806aad0 con 0x7ff9f806ce60 2023-11-29T11:18:08.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9fd53b700 1 --2- 172.21.15.81:0/3890899373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 0x7ff9f80d31b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009850 tx=0x7ff9f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d43af1b582c7297 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9effff700 1 -- 172.21.15.81:0/3890899373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4011830 con 0x7ff9f806ce60 2023-11-29T11:18:08.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9effff700 1 -- 172.21.15.81:0/3890899373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4011990 con 0x7ff9f806ce60 2023-11-29T11:18:08.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.019+0000 7ff9effff700 1 -- 172.21.15.81:0/3890899373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4011d20 con 0x7ff9f806ce60 2023-11-29T11:18:08.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- 172.21.15.81:0/3890899373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 msgr2=0x7ff9f80d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/3890899373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 0x7ff9f80d31b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009850 tx=0x7ff9f4009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:08.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- 172.21.15.81:0/3890899373 shutdown_connections 2023-11-29T11:18:08.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/3890899373 >> v2:172.21.15.176:3300/0 conn(0x7ff9f80cf470 0x7ff9f80cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/3890899373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 0x7ff9f80d31b0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- 172.21.15.81:0/3890899373 >> 172.21.15.81:0/3890899373 conn(0x7ff9f80b5760 msgr2=0x7ff9f80b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:08.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- 172.21.15.81:0/3890899373 shutdown_connections 2023-11-29T11:18:08.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- 172.21.15.81:0/3890899373 wait complete. 2023-11-29T11:18:08.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 Processor -- start 2023-11-29T11:18:08.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- start start 2023-11-29T11:18:08.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 0x7ff9f80b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f80cce60 0x7ff9f80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f80cf470 0x7ff9f80c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80b27b0 con 0x7ff9f806ce60 2023-11-29T11:18:08.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80c69e0 con 0x7ff9f80cce60 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.023+0000 7ff9fe53d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80b5030 con 0x7ff9f80cf470 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f80cce60 0x7ff9f80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fd53b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 0x7ff9f80b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fdd3c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f80cf470 0x7ff9f80c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f80cce60 0x7ff9f80b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:56848/0 (socket says 172.21.15.81:56848) 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 -- 172.21.15.81:0/2308288333 learned_addr learned my addr 172.21.15.81:0/2308288333 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 -- 172.21.15.81:0/2308288333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f80cf470 msgr2=0x7ff9f80c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f80cf470 0x7ff9f80c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 -- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 msgr2=0x7ff9f80b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 0x7ff9f80b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 -- 172.21.15.81:0/2308288333 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40094b0 con 0x7ff9f80cce60 2023-11-29T11:18:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fcd3a700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f80cce60 0x7ff9f80b2270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8001eb0 tx=0x7ff9e800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9edffb700 1 -- 172.21.15.81:0/2308288333 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8005d90 con 0x7ff9f80cce60 2023-11-29T11:18:08.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9edffb700 1 -- 172.21.15.81:0/2308288333 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e80070d0 con 0x7ff9f80cce60 2023-11-29T11:18:08.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f806b090 con 0x7ff9f80cce60 2023-11-29T11:18:08.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9edffb700 1 -- 172.21.15.81:0/2308288333 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007440 con 0x7ff9f80cce60 2023-11-29T11:18:08.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f806adb0 con 0x7ff9f80cce60 2023-11-29T11:18:08.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.027+0000 7ff9edffb700 1 -- 172.21.15.81:0/2308288333 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff9e8019030 con 0x7ff9f80cce60 2023-11-29T11:18:08.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.031+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f80b6470 con 0x7ff9f80cce60 2023-11-29T11:18:08.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.031+0000 7ff9edffb700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff9dc064f10 0x7ff9dc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.031+0000 7ff9edffb700 1 -- 172.21.15.81:0/2308288333 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7ff9e8081080 con 0x7ff9f80cce60 2023-11-29T11:18:08.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.031+0000 7ff9fd53b700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff9dc064f10 0x7ff9dc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.031+0000 7ff9fd53b700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff9dc064f10 0x7ff9dc0673c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40090b0 tx=0x7ff9f4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.039+0000 7ff9edffb700 1 -- 172.21.15.81:0/2308288333 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff9e804a400 con 0x7ff9f80cce60 2023-11-29T11:18:08.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.203+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9f80cd300 con 0x7ff9f80cce60 2023-11-29T11:18:08.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.203+0000 7ff9edffb700 1 -- 172.21.15.81:0/2308288333 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9f80cd300 con 0x7ff9f80cce60 2023-11-29T11:18:08.209 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:18:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff9dc064f10 msgr2=0x7ff9dc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff9dc064f10 0x7ff9dc0673c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40090b0 tx=0x7ff9f4008030 comp rx=0 tx=0).stop 2023-11-29T11:18:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f80cce60 msgr2=0x7ff9f80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f80cce60 0x7ff9f80b2270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8001eb0 tx=0x7ff9e800c7b0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 shutdown_connections 2023-11-29T11:18:08.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff9dc064f10 0x7ff9dc0673c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9f80cf470 0x7ff9f80c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9f80cce60 0x7ff9f80b2270 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 --2- 172.21.15.81:0/2308288333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f806ce60 0x7ff9f80b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 >> 172.21.15.81:0/2308288333 conn(0x7ff9f80b5760 msgr2=0x7ff9f815bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 shutdown_connections 2023-11-29T11:18:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.207+0000 7ff9fe53d700 1 -- 172.21.15.81:0/2308288333 wait complete. 2023-11-29T11:18:08.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:18:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.339+0000 7f1df98a7700 1 Processor -- start 2023-11-29T11:18:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df98a7700 1 -- start start 2023-11-29T11:18:08.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df98a7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df406a4c0 0x7f1df406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df98a7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df406a9c0 con 0x7f1df40cf0e0 2023-11-29T11:18:08.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df98a7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df406aca0 con 0x7f1df40b1ae0 2023-11-29T11:18:08.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df98a7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40d0ab0 con 0x7f1df406a4c0 2023-11-29T11:18:08.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df90a6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1df40cf0e0 0x7f1df40b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59582/0 (socket says 172.21.15.81:59582) 2023-11-29T11:18:08.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df90a6700 1 -- 172.21.15.81:0/741728668 learned_addr learned my addr 172.21.15.81:0/741728668 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:08.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df3fff700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df406a4c0 0x7f1df406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370862864 0 0) 0x7f1df406a9c0 con 0x7f1df40cf0e0 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de00035d0 con 0x7f1df40cf0e0 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516648289 0 0) 0x7f1df406aca0 con 0x7f1df40b1ae0 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df406a9c0 con 0x7f1df40b1ae0 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2526211802 0 0) 0x7f1de00035d0 con 0x7f1df40cf0e0 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df406a4c0 msgr2=0x7f1df406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df406a4c0 0x7f1df406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 >> v1:172.21.15.176:6789/0 conn(0x7f1df40b1ae0 legacy=0x7f1df40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df406af80 con 0x7f1df40cf0e0 2023-11-29T11:18:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f1dec0019f0 con 0x7f1df40cf0e0 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 >> v1:172.21.15.81:6789/0 conn(0x7f1df40cf0e0 legacy=0x7f1df40b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df406a4c0 0x7f1de0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1de0004140 0x7f1de0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1de0004db0 0x7f1de0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40d0ab0 con 0x7f1de0004140 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de000bae0 con 0x7f1de0004db0 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de000bca0 con 0x7f1df406a4c0 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df3fff700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1de0004140 0x7f1de0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df90a6700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1de0004db0 0x7f1de0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df88a5700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df406a4c0 0x7f1de0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df3fff700 1 -- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df406a4c0 msgr2=0x7f1de0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df3fff700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df406a4c0 0x7f1de0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df3fff700 1 -- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1de0004db0 msgr2=0x7f1de0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df3fff700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1de0004db0 0x7f1de0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df3fff700 1 -- 172.21.15.81:0/741728668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00035d0 con 0x7f1de0004140 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df90a6700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1de0004db0 0x7f1de0005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df3fff700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1de0004140 0x7f1de0004870 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f1df406a8f0 tx=0x7f1de00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c05773b45b1594 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400e6c0 con 0x7f1de0004140 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de400e820 con 0x7f1de0004140 2023-11-29T11:18:08.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.343+0000 7f1df37fe700 1 -- 172.21.15.81:0/741728668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400ebb0 con 0x7f1de0004140 2023-11-29T11:18:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.347+0000 7f1df98a7700 1 -- 172.21.15.81:0/741728668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1de0004140 msgr2=0x7f1de0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.347+0000 7f1df98a7700 1 --2- 172.21.15.81:0/741728668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1de0004140 0x7f1de0004870 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f1df406a8f0 tx=0x7f1de00058a0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.347+0000 7f1df90a6700 1 -- 172.21.15.81:0/741728668 reap_dead start 2023-11-29T11:18:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.347+0000 7f1df98a7700 1 -- 172.21.15.81:0/741728668 shutdown_connections 2023-11-29T11:18:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.347+0000 7f1df98a7700 1 -- 172.21.15.81:0/741728668 >> 172.21.15.81:0/741728668 conn(0x7f1df409bbd0 msgr2=0x7f1df40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.347+0000 7f1df98a7700 1 -- 172.21.15.81:0/741728668 shutdown_connections 2023-11-29T11:18:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.347+0000 7f1df98a7700 1 -- 172.21.15.81:0/741728668 wait complete. 2023-11-29T11:18:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 Processor -- start 2023-11-29T11:18:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 -- start start 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1de0004140 0x7f1df415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df40c71a0 0x7f1df4150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df40b05e0 0x7f1df40b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40b0f90 con 0x7f1df40b05e0 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df4150ba0 con 0x7f1df40c71a0 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40a04c0 con 0x7f1de0004140 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df40b05e0 0x7f1df40b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df40b05e0 0x7f1df40b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57862/0 (socket says 172.21.15.81:57862) 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 -- 172.21.15.81:0/3027581525 learned_addr learned my addr 172.21.15.81:0/3027581525 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df88a5700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1de0004140 0x7f1df415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df3fff700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df40c71a0 0x7f1df4150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 -- 172.21.15.81:0/3027581525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1de0004140 msgr2=0x7f1df415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1de0004140 0x7f1df415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 -- 172.21.15.81:0/3027581525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df40c71a0 msgr2=0x7f1df4150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df40c71a0 0x7f1df4150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 -- 172.21.15.81:0/3027581525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40b1eb0 con 0x7f1df40b05e0 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df90a6700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df40b05e0 0x7f1df40b0a50 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001370 tx=0x7f1dec007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df17fa700 1 -- 172.21.15.81:0/3027581525 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00e8f0 con 0x7f1df40b05e0 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df17fa700 1 -- 172.21.15.81:0/3027581525 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec00ea50 con 0x7f1df40b05e0 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df40b4380 con 0x7f1df40b05e0 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df17fa700 1 -- 172.21.15.81:0/3027581525 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00edc0 con 0x7f1df40b05e0 2023-11-29T11:18:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.351+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df40b60e0 con 0x7f1df40b05e0 2023-11-29T11:18:08.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.355+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df4072500 con 0x7f1df40b05e0 2023-11-29T11:18:08.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.355+0000 7f1df17fa700 1 -- 172.21.15.81:0/3027581525 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1dec01d460 con 0x7f1df40b05e0 2023-11-29T11:18:08.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.355+0000 7f1df17fa700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd4064ee0 0x7f1dd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.355+0000 7f1df88a5700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd4064ee0 0x7f1dd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.355+0000 7f1df17fa700 1 -- 172.21.15.81:0/3027581525 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f1dec082310 con 0x7f1df40b05e0 2023-11-29T11:18:08.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.355+0000 7f1df88a5700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd4064ee0 0x7f1dd4067390 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc007fd0 tx=0x7f1ddc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.363+0000 7f1df17fa700 1 -- 172.21.15.81:0/3027581525 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1dec050290 con 0x7f1df40b05e0 2023-11-29T11:18:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1df406dc40 con 0x7f1df40b05e0 2023-11-29T11:18:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df17fa700 1 -- 172.21.15.81:0/3027581525 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1dec0538b0 con 0x7f1df40b05e0 2023-11-29T11:18:08.523 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd4064ee0 msgr2=0x7f1dd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd4064ee0 0x7f1dd4067390 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc007fd0 tx=0x7f1ddc009040 comp rx=0 tx=0).stop 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df40b05e0 msgr2=0x7f1df40b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df40b05e0 0x7f1df40b0a50 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001370 tx=0x7f1dec007cb0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 shutdown_connections 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd4064ee0 0x7f1dd4067390 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df40b05e0 0x7f1df40b0a50 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df40c71a0 0x7f1df4150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 --2- 172.21.15.81:0/3027581525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1de0004140 0x7f1df415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 >> 172.21.15.81:0/3027581525 conn(0x7f1df409bbd0 msgr2=0x7f1df40b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 shutdown_connections 2023-11-29T11:18:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.519+0000 7f1df98a7700 1 -- 172.21.15.81:0/3027581525 wait complete. 2023-11-29T11:18:08.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:18:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.651+0000 7f05e7369700 1 Processor -- start 2023-11-29T11:18:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.651+0000 7f05e7369700 1 -- start start 2023-11-29T11:18:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05e00b00e0 0x7f05e015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f05e00b04b0 0x7f05e006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e006d700 con 0x7f05e00cbb30 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e009c150 con 0x7f05e00b00e0 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e00ac050 con 0x7f05e00b04b0 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e5b66700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f05e00cbb30 0x7f05e015d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59594/0 (socket says 172.21.15.81:59594) 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e6367700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05e00b00e0 0x7f05e015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e5b66700 1 -- 172.21.15.81:0/1459752447 learned_addr learned my addr 172.21.15.81:0/1459752447 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e6b68700 1 --2- 172.21.15.81:0/1459752447 >> v2:172.21.15.176:3300/0 conn(0x7f05e00b04b0 0x7f05e006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e5365700 1 -- 172.21.15.81:0/1459752447 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113710197 0 0) 0x7f05e006d700 con 0x7f05e00cbb30 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e5365700 1 -- 172.21.15.81:0/1459752447 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05c80035d0 con 0x7f05e00cbb30 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e6367700 1 -- 172.21.15.81:0/1459752447 >> v2:172.21.15.176:3300/0 conn(0x7f05e00b04b0 msgr2=0x7f05e006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e6367700 1 --2- 172.21.15.81:0/1459752447 >> v2:172.21.15.176:3300/0 conn(0x7f05e00b04b0 0x7f05e006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e6367700 1 -- 172.21.15.81:0/1459752447 >> v1:172.21.15.81:6789/0 conn(0x7f05e00cbb30 legacy=0x7f05e015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e6367700 1 -- 172.21.15.81:0/1459752447 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00ac260 con 0x7f05e00b00e0 2023-11-29T11:18:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e6367700 1 --2- 172.21.15.81:0/1459752447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e015d170 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f05e00aca30 tx=0x7f05d4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fc963c9be6c861 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e5365700 1 -- 172.21.15.81:0/1459752447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4011830 con 0x7f05e00b00e0 2023-11-29T11:18:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e5365700 1 -- 172.21.15.81:0/1459752447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4011990 con 0x7f05e00b00e0 2023-11-29T11:18:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e5365700 1 -- 172.21.15.81:0/1459752447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4011d20 con 0x7f05e00b00e0 2023-11-29T11:18:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 -- 172.21.15.81:0/1459752447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 msgr2=0x7f05e015d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 --2- 172.21.15.81:0/1459752447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e015d170 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f05e00aca30 tx=0x7f05d4009b30 comp rx=0 tx=0).stop 2023-11-29T11:18:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 -- 172.21.15.81:0/1459752447 shutdown_connections 2023-11-29T11:18:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 --2- 172.21.15.81:0/1459752447 >> v2:172.21.15.176:3300/0 conn(0x7f05e00b04b0 0x7f05e006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 --2- 172.21.15.81:0/1459752447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e015d170 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 -- 172.21.15.81:0/1459752447 >> 172.21.15.81:0/1459752447 conn(0x7f05e00cae70 msgr2=0x7f05e00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 -- 172.21.15.81:0/1459752447 shutdown_connections 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.655+0000 7f05e7369700 1 -- 172.21.15.81:0/1459752447 wait complete. 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 Processor -- start 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 -- start start 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e0155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e00b04b0 0x7f05e015e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00cbb30 0x7f05e00ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e0167340 con 0x7f05e00b00e0 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e0166aa0 con 0x7f05e00b04b0 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e0166d80 con 0x7f05e00cbb30 2023-11-29T11:18:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e0155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e0155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57890/0 (socket says 172.21.15.81:57890) 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 -- 172.21.15.81:0/1040176537 learned_addr learned my addr 172.21.15.81:0/1040176537 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e5b66700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e00b04b0 0x7f05e015e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6b68700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00cbb30 0x7f05e00ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 -- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00cbb30 msgr2=0x7f05e00ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00cbb30 0x7f05e00ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 -- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e00b04b0 msgr2=0x7f05e015e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e00b04b0 0x7f05e015e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 -- 172.21.15.81:0/1040176537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40094b0 con 0x7f05e00b00e0 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e5b66700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e00b04b0 0x7f05e015e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6b68700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00cbb30 0x7f05e00ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e6367700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e0155280 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009b70 tx=0x7f05d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05deffd700 1 -- 172.21.15.81:0/1040176537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4004480 con 0x7f05e00b00e0 2023-11-29T11:18:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05deffd700 1 -- 172.21.15.81:0/1040176537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d401f070 con 0x7f05e00b00e0 2023-11-29T11:18:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e009bdb0 con 0x7f05e00b00e0 2023-11-29T11:18:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05deffd700 1 -- 172.21.15.81:0/1040176537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40038c0 con 0x7f05e00b00e0 2023-11-29T11:18:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.659+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e00cc660 con 0x7f05e00b00e0 2023-11-29T11:18:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.663+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e00cc9f0 con 0x7f05e00b00e0 2023-11-29T11:18:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.663+0000 7f05deffd700 1 -- 172.21.15.81:0/1040176537 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f05d402a020 con 0x7f05e00b00e0 2023-11-29T11:18:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.663+0000 7f05deffd700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05cc064ee0 0x7f05cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.663+0000 7f05deffd700 1 -- 172.21.15.81:0/1040176537 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f05d4083560 con 0x7f05e00b00e0 2023-11-29T11:18:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.663+0000 7f05e5b66700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05cc064ee0 0x7f05cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.663+0000 7f05e5b66700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05cc064ee0 0x7f05cc067390 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f05e00ca110 tx=0x7f05d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.671+0000 7f05deffd700 1 -- 172.21.15.81:0/1040176537 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f05d4051540 con 0x7f05e00b00e0 2023-11-29T11:18:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.831+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05e0072500 con 0x7f05e00b00e0 2023-11-29T11:18:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.831+0000 7f05deffd700 1 -- 172.21.15.81:0/1040176537 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05d4054b60 con 0x7f05e00b00e0 2023-11-29T11:18:08.837 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:18:08.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05cc064ee0 msgr2=0x7f05cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05cc064ee0 0x7f05cc067390 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f05e00ca110 tx=0x7f05d0009040 comp rx=0 tx=0).stop 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 msgr2=0x7f05e0155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e0155280 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009b70 tx=0x7f05d4004770 comp rx=0 tx=0).stop 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 shutdown_connections 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05cc064ee0 0x7f05cc067390 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00cbb30 0x7f05e00ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e00b04b0 0x7f05e015e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 --2- 172.21.15.81:0/1040176537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b00e0 0x7f05e0155280 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 >> 172.21.15.81:0/1040176537 conn(0x7f05e00cae70 msgr2=0x7f05e00aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 shutdown_connections 2023-11-29T11:18:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.835+0000 7f05e7369700 1 -- 172.21.15.81:0/1040176537 wait complete. 2023-11-29T11:18:08.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:18:08.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e41df3700 1 Processor -- start 2023-11-29T11:18:08.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e41df3700 1 -- start start 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e41df3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0b5d60 0x7f7e3c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e41df3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7e3c0ce870 0x7f7e3c0cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e41df3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c0b6130 con 0x7f7e3c070480 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e41df3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c0cec70 con 0x7f7e3c0ce870 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e41df3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0cee50 con 0x7f7e3c0b5d60 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e3bfff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f7e3c070480 0x7f7e3c0ce160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:36304/0 (socket says 172.21.15.81:36304) 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e3bfff700 1 -- 172.21.15.81:0/261189632 learned_addr learned my addr 172.21.15.81:0/261189632 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.959+0000 7f7e40df1700 1 --2- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0b5d60 0x7f7e3c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e415f2700 1 --2- 172.21.15.81:0/261189632 >> v2:172.21.15.176:3300/0 conn(0x7f7e3c0ce870 0x7f7e3c0cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/261189632 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628505071 0 0) 0x7f7e3c0b6130 con 0x7f7e3c070480 2023-11-29T11:18:08.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/261189632 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2c0035d0 con 0x7f7e3c070480 2023-11-29T11:18:08.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e415f2700 1 -- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0b5d60 msgr2=0x7f7e3c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e415f2700 1 --2- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0b5d60 0x7f7e3c06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e415f2700 1 -- 172.21.15.81:0/261189632 >> v1:172.21.15.176:6789/0 conn(0x7f7e3c070480 legacy=0x7f7e3c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e415f2700 1 -- 172.21.15.81:0/261189632 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0cf130 con 0x7f7e3c0ce870 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e40df1700 1 --2- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0b5d60 0x7f7e3c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e415f2700 1 --2- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0ce870 0x7f7e3c0cb1f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009d90 tx=0x7f7e3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c9faac77a8cd9c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/261189632 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3400e070 con 0x7f7e3c0ce870 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/261189632 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3400bb20 con 0x7f7e3c0ce870 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e3b7fe700 1 -- 172.21.15.81:0/261189632 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34012430 con 0x7f7e3c0ce870 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e41df3700 1 -- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0ce870 msgr2=0x7f7e3c0cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e41df3700 1 --2- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0ce870 0x7f7e3c0cb1f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009d90 tx=0x7f7e3400b330 comp rx=0 tx=0).stop 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e41df3700 1 -- 172.21.15.81:0/261189632 shutdown_connections 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e41df3700 1 --2- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0ce870 0x7f7e3c0cb1f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e41df3700 1 --2- 172.21.15.81:0/261189632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0b5d60 0x7f7e3c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e41df3700 1 -- 172.21.15.81:0/261189632 >> 172.21.15.81:0/261189632 conn(0x7f7e3c0cdca0 msgr2=0x7f7e3c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e41df3700 1 -- 172.21.15.81:0/261189632 shutdown_connections 2023-11-29T11:18:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.963+0000 7f7e41df3700 1 -- 172.21.15.81:0/261189632 wait complete. 2023-11-29T11:18:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 Processor -- start 2023-11-29T11:18:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 -- start start 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c070480 0x7f7e3c0c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0b5d60 0x7f7e3c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0ce870 0x7f7e3c156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c1ef180 con 0x7f7e3c070480 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0c5650 con 0x7f7e3c0b5d60 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c1f2c00 con 0x7f7e3c0ce870 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c070480 0x7f7e3c0c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c070480 0x7f7e3c0c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57896/0 (socket says 172.21.15.81:57896) 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 -- 172.21.15.81:0/1518877243 learned_addr learned my addr 172.21.15.81:0/1518877243 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e415f2700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0ce870 0x7f7e3c156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e3bfff700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0b5d60 0x7f7e3c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 -- 172.21.15.81:0/1518877243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0ce870 msgr2=0x7f7e3c156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0ce870 0x7f7e3c156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 -- 172.21.15.81:0/1518877243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0b5d60 msgr2=0x7f7e3c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0b5d60 0x7f7e3c1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 -- 172.21.15.81:0/1518877243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300094b0 con 0x7f7e3c070480 2023-11-29T11:18:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e40df1700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c070480 0x7f7e3c0c5110 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000ebe0 tx=0x7f7e3000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e397fa700 1 -- 172.21.15.81:0/1518877243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000c850 con 0x7f7e3c070480 2023-11-29T11:18:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e397fa700 1 -- 172.21.15.81:0/1518877243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3000c9b0 con 0x7f7e3c070480 2023-11-29T11:18:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e34009a70 con 0x7f7e3c070480 2023-11-29T11:18:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e397fa700 1 -- 172.21.15.81:0/1518877243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000cd40 con 0x7f7e3c070480 2023-11-29T11:18:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.967+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c0cf6f0 con 0x7f7e3c070480 2023-11-29T11:18:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.971+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c0cf410 con 0x7f7e3c070480 2023-11-29T11:18:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.971+0000 7f7e397fa700 1 -- 172.21.15.81:0/1518877243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7e30019030 con 0x7f7e3c070480 2023-11-29T11:18:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.971+0000 7f7e397fa700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e20064ee0 0x7f7e20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.971+0000 7f7e3bfff700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e20064ee0 0x7f7e20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.971+0000 7f7e397fa700 1 -- 172.21.15.81:0/1518877243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f7e300820d0 con 0x7f7e3c070480 2023-11-29T11:18:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.971+0000 7f7e3bfff700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e20064ee0 0x7f7e20067390 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c1ecd70 tx=0x7f7e28009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:08.979+0000 7f7e397fa700 1 -- 172.21.15.81:0/1518877243 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7e3004ffc0 con 0x7f7e3c070480 2023-11-29T11:18:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.155+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e3c0cf9d0 con 0x7f7e3c070480 2023-11-29T11:18:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.155+0000 7f7e397fa700 1 -- 172.21.15.81:0/1518877243 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v84) v1 ==== 80+0+122 (secure 0 0 0) 0x7f7e3000cea0 con 0x7f7e3c070480 2023-11-29T11:18:09.161 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6837/3247003029 2023-11-30T11:17:58.488925+0000 2023-11-29T11:18:09.161 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6836/3247003029 2023-11-30T11:17:58.488925+0000 2023-11-29T11:18:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e20064ee0 msgr2=0x7f7e20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e20064ee0 0x7f7e20067390 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c1ecd70 tx=0x7f7e28009040 comp rx=0 tx=0).stop 2023-11-29T11:18:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c070480 msgr2=0x7f7e3c0c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c070480 0x7f7e3c0c5110 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000ebe0 tx=0x7f7e3000eef0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 shutdown_connections 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e20064ee0 0x7f7e20067390 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e3c0ce870 0x7f7e3c156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e3c0b5d60 0x7f7e3c1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 --2- 172.21.15.81:0/1518877243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c070480 0x7f7e3c0c5110 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 >> 172.21.15.81:0/1518877243 conn(0x7f7e3c0cdca0 msgr2=0x7f7e3c0ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 shutdown_connections 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.159+0000 7f7e41df3700 1 -- 172.21.15.81:0/1518877243 wait complete. 2023-11-29T11:18:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:listed 2 entries 2023-11-29T11:18:09.175 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:18:09.175 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:18:09.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:18:09.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f1914d6d700 1 Processor -- start 2023-11-29T11:18:09.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f1914d6d700 1 -- start start 2023-11-29T11:18:09.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f1914d6d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1910158070 0x7f191006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f1914d6d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f191006e000 0x7f191015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f1914d6d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1910158440 con 0x7f19100ad510 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f1914d6d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191006b500 con 0x7f191006e000 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f1914d6d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191006a960 con 0x7f1910158070 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19100ad510 0x7f191006adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59602/0 (socket says 172.21.15.81:59602) 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190effd700 1 -- 172.21.15.81:0/1711962072 learned_addr learned my addr 172.21.15.81:0/1711962072 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f191006e000 0x7f191015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190f7fe700 1 --2- 172.21.15.81:0/1711962072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1910158070 0x7f191006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190e7fc700 1 -- 172.21.15.81:0/1711962072 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165304326 0 0) 0x7f1910158440 con 0x7f19100ad510 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190e7fc700 1 -- 172.21.15.81:0/1711962072 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18fc0057e0 con 0x7f19100ad510 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190ffff700 1 -- 172.21.15.81:0/1711962072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1910158070 msgr2=0x7f191006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190ffff700 1 --2- 172.21.15.81:0/1711962072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1910158070 0x7f191006c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190ffff700 1 -- 172.21.15.81:0/1711962072 >> v1:172.21.15.81:6789/0 conn(0x7f19100ad510 legacy=0x7f191006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190e7fc700 1 -- 172.21.15.81:0/1711962072 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 152808301 0 0) 0x7f18fc0057e0 con 0x7f19100ad510 2023-11-29T11:18:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.331+0000 7f190ffff700 1 -- 172.21.15.81:0/1711962072 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191006ceb0 con 0x7f191006e000 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f190ffff700 1 --2- 172.21.15.81:0/1711962072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191006e000 0x7f191015bad0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f1908009850 tx=0x7f1908009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681d4f9d98384f11 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f190e7fc700 1 -- 172.21.15.81:0/1711962072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000019f0 con 0x7f191006e000 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f190e7fc700 1 -- 172.21.15.81:0/1711962072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1908004030 con 0x7f191006e000 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f190e7fc700 1 -- 172.21.15.81:0/1711962072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080043e0 con 0x7f191006e000 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 -- 172.21.15.81:0/1711962072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191006e000 msgr2=0x7f191015bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 --2- 172.21.15.81:0/1711962072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191006e000 0x7f191015bad0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f1908009850 tx=0x7f1908009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 -- 172.21.15.81:0/1711962072 shutdown_connections 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 --2- 172.21.15.81:0/1711962072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191006e000 0x7f191015bad0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 --2- 172.21.15.81:0/1711962072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1910158070 0x7f191006c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 -- 172.21.15.81:0/1711962072 >> 172.21.15.81:0/1711962072 conn(0x7f19100ce3e0 msgr2=0x7f19100ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 -- 172.21.15.81:0/1711962072 shutdown_connections 2023-11-29T11:18:09.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 -- 172.21.15.81:0/1711962072 wait complete. 2023-11-29T11:18:09.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 Processor -- start 2023-11-29T11:18:09.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.335+0000 7f1914d6d700 1 -- start start 2023-11-29T11:18:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1914d6d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191006e000 0x7f19100c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1914d6d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19100ad510 0x7f19100b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1914d6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910158070 0x7f19100add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1914d6d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1910145990 con 0x7f1910158070 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1914d6d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1910144d80 con 0x7f191006e000 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1914d6d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1910145060 con 0x7f19100ad510 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910158070 0x7f19100add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910158070 0x7f19100add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57904/0 (socket says 172.21.15.81:57904) 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191006e000 0x7f19100c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 -- 172.21.15.81:0/3195511572 learned_addr learned my addr 172.21.15.81:0/3195511572 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190effd700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19100ad510 0x7f19100b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 -- 172.21.15.81:0/3195511572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19100ad510 msgr2=0x7f19100b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19100ad510 0x7f19100b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 -- 172.21.15.81:0/3195511572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191006e000 msgr2=0x7f19100c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191006e000 0x7f19100c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 -- 172.21.15.81:0/3195511572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080094b0 con 0x7f1910158070 2023-11-29T11:18:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f190ffff700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910158070 0x7f19100add20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f19080090b0 tx=0x7f1908004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1907fff700 1 -- 172.21.15.81:0/3195511572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908003c90 con 0x7f1910158070 2023-11-29T11:18:09.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1907fff700 1 -- 172.21.15.81:0/3195511572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190801f070 con 0x7f1910158070 2023-11-29T11:18:09.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1907fff700 1 -- 172.21.15.81:0/3195511572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908011630 con 0x7f1910158070 2023-11-29T11:18:09.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191006d470 con 0x7f1910158070 2023-11-29T11:18:09.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.339+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191006d190 con 0x7f1910158070 2023-11-29T11:18:09.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.343+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1910145b00 con 0x7f1910158070 2023-11-29T11:18:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.343+0000 7f1907fff700 1 -- 172.21.15.81:0/3195511572 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1908017020 con 0x7f1910158070 2023-11-29T11:18:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.343+0000 7f1907fff700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18f0064ee0 0x7f18f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.343+0000 7f1907fff700 1 -- 172.21.15.81:0/3195511572 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f1908021070 con 0x7f1910158070 2023-11-29T11:18:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.343+0000 7f190f7fe700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18f0064ee0 0x7f18f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.343+0000 7f190f7fe700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18f0064ee0 0x7f18f0067390 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009b50 tx=0x7f18f8009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.351+0000 7f1907fff700 1 -- 172.21.15.81:0/3195511572 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1908051780 con 0x7f1910158070 2023-11-29T11:18:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.515+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1910072500 con 0x7f1910158070 2023-11-29T11:18:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.515+0000 7f1907fff700 1 -- 172.21.15.81:0/3195511572 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18200 (secure 0 0 0) 0x7f190802b090 con 0x7f1910158070 2023-11-29T11:18:09.520 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:18:09.521 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:58.488981+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3247003029":"2023-11-30T11:17:58.488925+0000","172.21.15.81:6836/3247003029":"2023-11-30T11:17:58.488925+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18f0064ee0 msgr2=0x7f18f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18f0064ee0 0x7f18f0067390 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009b50 tx=0x7f18f8009240 comp rx=0 tx=0).stop 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910158070 msgr2=0x7f19100add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910158070 0x7f19100add20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f19080090b0 tx=0x7f1908004770 comp rx=0 tx=0).stop 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 shutdown_connections 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18f0064ee0 0x7f18f0067390 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910158070 0x7f19100add20 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19100ad510 0x7f19100b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 --2- 172.21.15.81:0/3195511572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f191006e000 0x7f19100c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 >> 172.21.15.81:0/3195511572 conn(0x7f19100ce3e0 msgr2=0x7f191006be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:09.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 shutdown_connections 2023-11-29T11:18:09.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.519+0000 7f1914d6d700 1 -- 172.21.15.81:0/3195511572 wait complete. 2023-11-29T11:18:09.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:17:38.310347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:17:38.742094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:18:09.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:18:09.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.651+0000 7ff643fff700 1 Processor -- start 2023-11-29T11:18:09.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.651+0000 7ff643fff700 1 -- start start 2023-11-29T11:18:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff6440b1ae0 0x7ff64406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64406a9c0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64406aca0 con 0x7ff64406a4c0 2023-11-29T11:18:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6440d0ab0 con 0x7ff6440b1ae0 2023-11-29T11:18:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff6437fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff6440cf0e0 0x7ff6440cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59608/0 (socket says 172.21.15.81:59608) 2023-11-29T11:18:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff6437fe700 1 -- 172.21.15.81:0/783747048 learned_addr learned my addr 172.21.15.81:0/783747048 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff642ffd700 1 --2- 172.21.15.81:0/783747048 >> v2:172.21.15.176:3300/0 conn(0x7ff6440b1ae0 0x7ff64406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff641ffb700 1 -- 172.21.15.81:0/783747048 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262048632 0 0) 0x7ff64406a9c0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff641ffb700 1 -- 172.21.15.81:0/783747048 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff62c0035d0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff642ffd700 1 -- 172.21.15.81:0/783747048 >> v1:172.21.15.176:6789/0 conn(0x7ff64406a4c0 legacy=0x7ff6440d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff642ffd700 1 -- 172.21.15.81:0/783747048 >> v1:172.21.15.81:6789/0 conn(0x7ff6440cf0e0 legacy=0x7ff6440cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff642ffd700 1 -- 172.21.15.81:0/783747048 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64406af80 con 0x7ff6440b1ae0 2023-11-29T11:18:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff642ffd700 1 --2- 172.21.15.81:0/783747048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6440b1ae0 0x7ff64406d8e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff638009850 tx=0x7ff638009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73750797c2b8b89d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff641ffb700 1 -- 172.21.15.81:0/783747048 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638011830 con 0x7ff6440b1ae0 2023-11-29T11:18:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff641ffb700 1 -- 172.21.15.81:0/783747048 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff638011990 con 0x7ff6440b1ae0 2023-11-29T11:18:09.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff641ffb700 1 -- 172.21.15.81:0/783747048 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638011d40 con 0x7ff6440b1ae0 2023-11-29T11:18:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 -- 172.21.15.81:0/783747048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6440b1ae0 msgr2=0x7ff64406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 --2- 172.21.15.81:0/783747048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6440b1ae0 0x7ff64406d8e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff638009850 tx=0x7ff638009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 -- 172.21.15.81:0/783747048 shutdown_connections 2023-11-29T11:18:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 --2- 172.21.15.81:0/783747048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6440b1ae0 0x7ff64406d8e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 -- 172.21.15.81:0/783747048 >> 172.21.15.81:0/783747048 conn(0x7ff64409bbd0 msgr2=0x7ff6440b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 -- 172.21.15.81:0/783747048 shutdown_connections 2023-11-29T11:18:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.655+0000 7ff643fff700 1 -- 172.21.15.81:0/783747048 wait complete. 2023-11-29T11:18:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff643fff700 1 Processor -- start 2023-11-29T11:18:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff643fff700 1 -- start start 2023-11-29T11:18:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff643fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff64406a4c0 0x7ff6441f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff643fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6440b1ae0 0x7ff6440c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff643fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6440cf0e0 0x7ff6440c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff643fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6441f1b60 con 0x7ff6440cf0e0 2023-11-29T11:18:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff643fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64415e300 con 0x7ff64406a4c0 2023-11-29T11:18:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff643fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64415e5e0 con 0x7ff6440b1ae0 2023-11-29T11:18:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6440cf0e0 0x7ff6440c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6440cf0e0 0x7ff6440c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57920/0 (socket says 172.21.15.81:57920) 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 -- 172.21.15.81:0/2555106632 learned_addr learned my addr 172.21.15.81:0/2555106632 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff642ffd700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff64406a4c0 0x7ff6441f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6427fc700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6440b1ae0 0x7ff6440c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 -- 172.21.15.81:0/2555106632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6440b1ae0 msgr2=0x7ff6440c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6440b1ae0 0x7ff6440c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 -- 172.21.15.81:0/2555106632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff64406a4c0 msgr2=0x7ff6441f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff64406a4c0 0x7ff6441f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 -- 172.21.15.81:0/2555106632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6380094b0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff6437fe700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6440cf0e0 0x7ff6440c8fc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00cb40 tx=0x7ff63c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.659+0000 7ff62bfff700 1 -- 172.21.15.81:0/2555106632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00a9e0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.663+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6440b1eb0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.663+0000 7ff62bfff700 1 -- 172.21.15.81:0/2555106632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c00ab40 con 0x7ff6440cf0e0 2023-11-29T11:18:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.663+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6440b4380 con 0x7ff6440cf0e0 2023-11-29T11:18:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.663+0000 7ff62bfff700 1 -- 172.21.15.81:0/2555106632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00ce60 con 0x7ff6440cf0e0 2023-11-29T11:18:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.663+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6440b60e0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.667+0000 7ff62bfff700 1 -- 172.21.15.81:0/2555106632 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff63c019030 con 0x7ff6440cf0e0 2023-11-29T11:18:09.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.667+0000 7ff62bfff700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff630064f10 0x7ff6300673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.667+0000 7ff62bfff700 1 -- 172.21.15.81:0/2555106632 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7ff63c081d10 con 0x7ff6440cf0e0 2023-11-29T11:18:09.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.667+0000 7ff642ffd700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff630064f10 0x7ff6300673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.667+0000 7ff642ffd700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff630064f10 0x7ff6300673c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff6380090b0 tx=0x7ff63801c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.671+0000 7ff62bfff700 1 -- 172.21.15.81:0/2555106632 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff63c04fda0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.835+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff644072500 con 0x7ff6440cf0e0 2023-11-29T11:18:09.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.835+0000 7ff62bfff700 1 -- 172.21.15.81:0/2555106632 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff63c0533c0 con 0x7ff6440cf0e0 2023-11-29T11:18:09.840 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:18:09.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff630064f10 msgr2=0x7ff6300673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff630064f10 0x7ff6300673c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff6380090b0 tx=0x7ff63801c040 comp rx=0 tx=0).stop 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6440cf0e0 msgr2=0x7ff6440c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6440cf0e0 0x7ff6440c8fc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00cb40 tx=0x7ff63c00cc20 comp rx=0 tx=0).stop 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 shutdown_connections 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff630064f10 0x7ff6300673c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6440cf0e0 0x7ff6440c8fc0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6440b1ae0 0x7ff6440c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 --2- 172.21.15.81:0/2555106632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff64406a4c0 0x7ff6441f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 >> 172.21.15.81:0/2555106632 conn(0x7ff64409bbd0 msgr2=0x7ff64415bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 shutdown_connections 2023-11-29T11:18:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.839+0000 7ff643fff700 1 -- 172.21.15.81:0/2555106632 wait complete. 2023-11-29T11:18:09.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:18:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.959+0000 7fc3c9af6700 1 Processor -- start 2023-11-29T11:18:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.959+0000 7fc3c9af6700 1 -- start start 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3c406a4c0 0x7fc3c406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc3c40cf0e0 0x7fc3c40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c40cfa40 con 0x7fc3c40b1ae0 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c40d0ab0 con 0x7fc3c406a4c0 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c406a9c0 con 0x7fc3c40cf0e0 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3c406a4c0 0x7fc3c406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c8af4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3c40b1ae0 0x7fc3c40d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49320/0 (socket says 172.21.15.81:49320) 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c8af4700 1 -- 172.21.15.81:0/3958437640 learned_addr learned my addr 172.21.15.81:0/3958437640 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c92f5700 1 --2- 172.21.15.81:0/3958437640 >> v2:172.21.15.176:3300/0 conn(0x7fc3c40cf0e0 0x7fc3c40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c3fff700 1 -- 172.21.15.81:0/3958437640 >> v2:172.21.15.176:3300/0 conn(0x7fc3c40cf0e0 msgr2=0x7fc3c40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c3fff700 1 --2- 172.21.15.81:0/3958437640 >> v2:172.21.15.176:3300/0 conn(0x7fc3c40cf0e0 0x7fc3c40cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c3fff700 1 -- 172.21.15.81:0/3958437640 >> v1:172.21.15.81:6789/0 conn(0x7fc3c40b1ae0 legacy=0x7fc3c40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c37fe700 1 -- 172.21.15.81:0/3958437640 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382455801 0 0) 0x7fc3c40cfa40 con 0x7fc3c40b1ae0 2023-11-29T11:18:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c3fff700 1 -- 172.21.15.81:0/3958437640 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c406aca0 con 0x7fc3c406a4c0 2023-11-29T11:18:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c3fff700 1 --2- 172.21.15.81:0/3958437640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c406d8e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40b6440 tx=0x7fc3b4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca48bdffb257460 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c37fe700 1 -- 172.21.15.81:0/3958437640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4011830 con 0x7fc3c406a4c0 2023-11-29T11:18:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c37fe700 1 -- 172.21.15.81:0/3958437640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4011990 con 0x7fc3c406a4c0 2023-11-29T11:18:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c37fe700 1 -- 172.21.15.81:0/3958437640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4011d20 con 0x7fc3c406a4c0 2023-11-29T11:18:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 -- 172.21.15.81:0/3958437640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 msgr2=0x7fc3c406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/3958437640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c406d8e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40b6440 tx=0x7fc3b4009b30 comp rx=0 tx=0).stop 2023-11-29T11:18:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 -- 172.21.15.81:0/3958437640 shutdown_connections 2023-11-29T11:18:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/3958437640 >> v2:172.21.15.176:3300/0 conn(0x7fc3c40cf0e0 0x7fc3c40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/3958437640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c406d8e0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 -- 172.21.15.81:0/3958437640 >> 172.21.15.81:0/3958437640 conn(0x7fc3c409bbd0 msgr2=0x7fc3c40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 -- 172.21.15.81:0/3958437640 shutdown_connections 2023-11-29T11:18:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.963+0000 7fc3c9af6700 1 -- 172.21.15.81:0/3958437640 wait complete. 2023-11-29T11:18:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 Processor -- start 2023-11-29T11:18:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 -- start start 2023-11-29T11:18:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c409c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c40b1ae0 0x7fc3c415f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c40cf0e0 0x7fc3c40b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c409fbf0 con 0x7fc3c406a4c0 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c409f630 con 0x7fc3c40cf0e0 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c409f910 con 0x7fc3c40b1ae0 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c409c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c409c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47716/0 (socket says 172.21.15.81:47716) 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 -- 172.21.15.81:0/2730443413 learned_addr learned my addr 172.21.15.81:0/2730443413 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c92f5700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c40cf0e0 0x7fc3c40b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c3fff700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c40b1ae0 0x7fc3c415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 -- 172.21.15.81:0/2730443413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c40b1ae0 msgr2=0x7fc3c415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c40b1ae0 0x7fc3c415f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 -- 172.21.15.81:0/2730443413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c40cf0e0 msgr2=0x7fc3c40b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c40cf0e0 0x7fc3c40b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 -- 172.21.15.81:0/2730443413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40094b0 con 0x7fc3c406a4c0 2023-11-29T11:18:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c8af4700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c409c900 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00c580 tx=0x7fc3ac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c17fa700 1 -- 172.21.15.81:0/2730443413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac004ca0 con 0x7fc3c406a4c0 2023-11-29T11:18:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c17fa700 1 -- 172.21.15.81:0/2730443413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac004e20 con 0x7fc3c406a4c0 2023-11-29T11:18:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c40b4380 con 0x7fc3c406a4c0 2023-11-29T11:18:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c17fa700 1 -- 172.21.15.81:0/2730443413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac007310 con 0x7fc3c406a4c0 2023-11-29T11:18:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.967+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c406af80 con 0x7fc3c406a4c0 2023-11-29T11:18:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.971+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c40b1eb0 con 0x7fc3c406a4c0 2023-11-29T11:18:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.971+0000 7fc3c17fa700 1 -- 172.21.15.81:0/2730443413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc3ac01a020 con 0x7fc3c406a4c0 2023-11-29T11:18:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.971+0000 7fc3c17fa700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3a4064ee0 0x7fc3a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.971+0000 7fc3c17fa700 1 -- 172.21.15.81:0/2730443413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fc3ac081c40 con 0x7fc3c406a4c0 2023-11-29T11:18:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.971+0000 7fc3c3fff700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3a4064ee0 0x7fc3a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.971+0000 7fc3c3fff700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3a4064ee0 0x7fc3a4067390 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009fd0 tx=0x7fc3b4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:09.979+0000 7fc3c17fa700 1 -- 172.21.15.81:0/2730443413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc3ac04fb30 con 0x7fc3c406a4c0 2023-11-29T11:18:10.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.139+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3c4072500 con 0x7fc3c406a4c0 2023-11-29T11:18:10.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.139+0000 7fc3c17fa700 1 -- 172.21.15.81:0/2730443413 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3ac053150 con 0x7fc3c406a4c0 2023-11-29T11:18:10.146 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:18:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3a4064ee0 msgr2=0x7fc3a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3a4064ee0 0x7fc3a4067390 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009fd0 tx=0x7fc3b4008030 comp rx=0 tx=0).stop 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 msgr2=0x7fc3c409c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c409c900 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00c580 tx=0x7fc3ac00c890 comp rx=0 tx=0).stop 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 shutdown_connections 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc3a4064ee0 0x7fc3a4067390 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3c40cf0e0 0x7fc3c40b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3c40b1ae0 0x7fc3c415f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 --2- 172.21.15.81:0/2730443413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c406a4c0 0x7fc3c409c900 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 >> 172.21.15.81:0/2730443413 conn(0x7fc3c409bbd0 msgr2=0x7fc3c415bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 shutdown_connections 2023-11-29T11:18:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.143+0000 7fc3c9af6700 1 -- 172.21.15.81:0/2730443413 wait complete. 2023-11-29T11:18:10.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:18:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.267+0000 7f96f26e6700 1 Processor -- start 2023-11-29T11:18:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.267+0000 7f96f26e6700 1 -- start start 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96ec06ce60 0x7f96ec0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec0cce60 0x7f96ec06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec0cd2d0 con 0x7f96ec0cf470 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec15c8b0 con 0x7f96ec06ce60 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec06d770 con 0x7f96ec0cce60 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f16e4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96ec06ce60 0x7f96ec0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f16e4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96ec06ce60 0x7f96ec0d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47726/0 (socket says 172.21.15.81:47726) 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f16e4700 1 -- 172.21.15.81:0/2615869776 learned_addr learned my addr 172.21.15.81:0/2615869776 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f0ee3700 1 --2- 172.21.15.81:0/2615869776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec0cce60 0x7f96ec06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f16e4700 1 -- 172.21.15.81:0/2615869776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec0cce60 msgr2=0x7f96ec06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f16e4700 1 --2- 172.21.15.81:0/2615869776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec0cce60 0x7f96ec06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f16e4700 1 -- 172.21.15.81:0/2615869776 >> v1:172.21.15.176:6789/0 conn(0x7f96ec0cf470 legacy=0x7f96ec0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f16e4700 1 -- 172.21.15.81:0/2615869776 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec06a7f0 con 0x7f96ec06ce60 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f16e4700 1 --2- 172.21.15.81:0/2615869776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec06ce60 0x7f96ec0d31b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009e50 tx=0x7f96e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe10a665f5fd77b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96e3fff700 1 -- 172.21.15.81:0/2615869776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400e070 con 0x7f96ec06ce60 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96e3fff700 1 -- 172.21.15.81:0/2615869776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400b910 con 0x7f96ec06ce60 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96e3fff700 1 -- 172.21.15.81:0/2615869776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400bcc0 con 0x7f96ec06ce60 2023-11-29T11:18:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 -- 172.21.15.81:0/2615869776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec06ce60 msgr2=0x7f96ec0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 --2- 172.21.15.81:0/2615869776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec06ce60 0x7f96ec0d31b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009e50 tx=0x7f96e400b330 comp rx=0 tx=0).stop 2023-11-29T11:18:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 -- 172.21.15.81:0/2615869776 shutdown_connections 2023-11-29T11:18:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 --2- 172.21.15.81:0/2615869776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec0cce60 0x7f96ec06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 --2- 172.21.15.81:0/2615869776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec06ce60 0x7f96ec0d31b0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 -- 172.21.15.81:0/2615869776 >> 172.21.15.81:0/2615869776 conn(0x7f96ec0b5760 msgr2=0x7f96ec0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 -- 172.21.15.81:0/2615869776 shutdown_connections 2023-11-29T11:18:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.271+0000 7f96f26e6700 1 -- 172.21.15.81:0/2615869776 wait complete. 2023-11-29T11:18:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 Processor -- start 2023-11-29T11:18:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 -- start start 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec06ce60 0x7f96ec159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96ec0cce60 0x7f96ec0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec0cf470 0x7f96ec15f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0b3330 con 0x7f96ec0cf470 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec15afd0 con 0x7f96ec0cce60 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec15a240 con 0x7f96ec06ce60 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec0cf470 0x7f96ec15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec0cf470 0x7f96ec15f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47734/0 (socket says 172.21.15.81:47734) 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 -- 172.21.15.81:0/1246935445 learned_addr learned my addr 172.21.15.81:0/1246935445 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f16e4700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec06ce60 0x7f96ec159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f0ee3700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96ec0cce60 0x7f96ec0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 -- 172.21.15.81:0/1246935445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec06ce60 msgr2=0x7f96ec159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec06ce60 0x7f96ec159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 -- 172.21.15.81:0/1246935445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96ec0cce60 msgr2=0x7f96ec0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96ec0cce60 0x7f96ec0c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 -- 172.21.15.81:0/1246935445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4009b30 con 0x7f96ec0cf470 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f1ee5700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec0cf470 0x7f96ec15f310 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c430 tx=0x7f96dc00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96e1ffb700 1 -- 172.21.15.81:0/1246935445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0052d0 con 0x7f96ec0cf470 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96e1ffb700 1 -- 172.21.15.81:0/1246935445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc005430 con 0x7f96ec0cf470 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec06adb0 con 0x7f96ec0cf470 2023-11-29T11:18:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96e1ffb700 1 -- 172.21.15.81:0/1246935445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0055a0 con 0x7f96ec0cf470 2023-11-29T11:18:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.275+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec06aad0 con 0x7f96ec0cf470 2023-11-29T11:18:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.279+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec06b090 con 0x7f96ec0cf470 2023-11-29T11:18:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.279+0000 7f96e1ffb700 1 -- 172.21.15.81:0/1246935445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f96dc019030 con 0x7f96ec0cf470 2023-11-29T11:18:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.279+0000 7f96e1ffb700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96d8064ee0 0x7f96d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.279+0000 7f96e1ffb700 1 -- 172.21.15.81:0/1246935445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f96dc0812c0 con 0x7f96ec0cf470 2023-11-29T11:18:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.279+0000 7f96f16e4700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96d8064ee0 0x7f96d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.283+0000 7f96f16e4700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96d8064ee0 0x7f96d8067390 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f96e400b370 tx=0x7f96e4009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.287+0000 7f96e1ffb700 1 -- 172.21.15.81:0/1246935445 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f96dc04f1b0 con 0x7f96ec0cf470 2023-11-29T11:18:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.443+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96ec072c20 con 0x7f96ec0cf470 2023-11-29T11:18:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.443+0000 7f96e1ffb700 1 -- 172.21.15.81:0/1246935445 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96dc0527d0 con 0x7f96ec0cf470 2023-11-29T11:18:10.449 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:18:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96d8064ee0 msgr2=0x7f96d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96d8064ee0 0x7f96d8067390 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f96e400b370 tx=0x7f96e4009000 comp rx=0 tx=0).stop 2023-11-29T11:18:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec0cf470 msgr2=0x7f96ec15f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec0cf470 0x7f96ec15f310 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c430 tx=0x7f96dc00c740 comp rx=0 tx=0).stop 2023-11-29T11:18:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 shutdown_connections 2023-11-29T11:18:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f96d8064ee0 0x7f96d8067390 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec0cf470 0x7f96ec15f310 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96ec0cce60 0x7f96ec0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 --2- 172.21.15.81:0/1246935445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96ec06ce60 0x7f96ec159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 >> 172.21.15.81:0/1246935445 conn(0x7f96ec0b5760 msgr2=0x7f96ec0d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 shutdown_connections 2023-11-29T11:18:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.447+0000 7f96f26e6700 1 -- 172.21.15.81:0/1246935445 wait complete. 2023-11-29T11:18:10.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:18:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd285c9700 1 Processor -- start 2023-11-29T11:18:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd285c9700 1 -- start start 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd285c9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd2015cdb0 0x7fcd200ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd285c9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd285c9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcd200cc090 0x7fcd2006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd285c9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2015fd80 con 0x7fcd2015cdb0 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd285c9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd200ced80 con 0x7fcd200cc090 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd285c9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015d580 con 0x7fcd200cb6e0 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd2015cdb0 0x7fcd200ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd2015cdb0 0x7fcd200ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47746/0 (socket says 172.21.15.81:47746) 2023-11-29T11:18:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 -- 172.21.15.81:0/2483782215 learned_addr learned my addr 172.21.15.81:0/2483782215 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd25b64700 1 --2- 172.21.15.81:0/2483782215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26b66700 1 --2- 172.21.15.81:0/2483782215 >> v2:172.21.15.176:3300/0 conn(0x7fcd200cc090 0x7fcd2006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 -- 172.21.15.81:0/2483782215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 msgr2=0x7fcd200cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 --2- 172.21.15.81:0/2483782215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 -- 172.21.15.81:0/2483782215 >> v2:172.21.15.176:3300/0 conn(0x7fcd200cc090 msgr2=0x7fcd2006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 --2- 172.21.15.81:0/2483782215 >> v2:172.21.15.176:3300/0 conn(0x7fcd200cc090 0x7fcd2006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 -- 172.21.15.81:0/2483782215 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200cb400 con 0x7fcd2015cdb0 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26b66700 1 --2- 172.21.15.81:0/2483782215 >> v2:172.21.15.176:3300/0 conn(0x7fcd200cc090 0x7fcd2006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd26365700 1 --2- 172.21.15.81:0/2483782215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2015cdb0 0x7fcd200ce840 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fcd200c9540 tx=0x7fcd14009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ad86527be874f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd25363700 1 -- 172.21.15.81:0/2483782215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400b8a0 con 0x7fcd2015cdb0 2023-11-29T11:18:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd25363700 1 -- 172.21.15.81:0/2483782215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1400ba00 con 0x7fcd2015cdb0 2023-11-29T11:18:10.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.579+0000 7fcd25363700 1 -- 172.21.15.81:0/2483782215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400bd90 con 0x7fcd2015cdb0 2023-11-29T11:18:10.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- 172.21.15.81:0/2483782215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2015cdb0 msgr2=0x7fcd200ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 --2- 172.21.15.81:0/2483782215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2015cdb0 0x7fcd200ce840 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fcd200c9540 tx=0x7fcd14009bf0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- 172.21.15.81:0/2483782215 shutdown_connections 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 --2- 172.21.15.81:0/2483782215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 --2- 172.21.15.81:0/2483782215 >> v2:172.21.15.176:3300/0 conn(0x7fcd200cc090 0x7fcd2006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 --2- 172.21.15.81:0/2483782215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2015cdb0 0x7fcd200ce840 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- 172.21.15.81:0/2483782215 >> 172.21.15.81:0/2483782215 conn(0x7fcd200b0a90 msgr2=0x7fcd200b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- 172.21.15.81:0/2483782215 shutdown_connections 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- 172.21.15.81:0/2483782215 wait complete. 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 Processor -- start 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- start start 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200cc090 0x7fcd201524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd2015cdb0 0x7fcd20157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd201529e0 con 0x7fcd200cc090 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200b2370 con 0x7fcd2015cdb0 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200b2650 con 0x7fcd200cb6e0 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200cc090 0x7fcd201524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200cc090 0x7fcd201524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47754/0 (socket says 172.21.15.81:47754) 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 -- 172.21.15.81:0/1155627612 learned_addr learned my addr 172.21.15.81:0/1155627612 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd26365700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd26b66700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd2015cdb0 0x7fcd20157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 -- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 msgr2=0x7fcd200b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 -- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd2015cdb0 msgr2=0x7fcd20157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd2015cdb0 0x7fcd20157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 -- 172.21.15.81:0/1155627612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14009570 con 0x7fcd200cc090 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd26365700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd25b64700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200cc090 0x7fcd201524a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00e760 tx=0x7fcd1c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd12ffd700 1 -- 172.21.15.81:0/1155627612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c013610 con 0x7fcd200cc090 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd12ffd700 1 -- 172.21.15.81:0/1155627612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c013770 con 0x7fcd200cc090 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd200cb0f0 con 0x7fcd200cc090 2023-11-29T11:18:10.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd12ffd700 1 -- 172.21.15.81:0/1155627612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c013ae0 con 0x7fcd200cc090 2023-11-29T11:18:10.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.583+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd200c9630 con 0x7fcd200cc090 2023-11-29T11:18:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.587+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd200c9b50 con 0x7fcd200cc090 2023-11-29T11:18:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.587+0000 7fcd12ffd700 1 -- 172.21.15.81:0/1155627612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcd1c023070 con 0x7fcd200cc090 2023-11-29T11:18:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.591+0000 7fcd12ffd700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcd04064ee0 0x7fcd04067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.591+0000 7fcd12ffd700 1 -- 172.21.15.81:0/1155627612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fcd1c0823a0 con 0x7fcd200cc090 2023-11-29T11:18:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.591+0000 7fcd26365700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcd04064ee0 0x7fcd04067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.591+0000 7fcd26365700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcd04064ee0 0x7fcd04067390 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009c30 tx=0x7fcd14008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.595+0000 7fcd12ffd700 1 -- 172.21.15.81:0/1155627612 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcd1c050200 con 0x7fcd200cc090 2023-11-29T11:18:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.755+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd20072c20 con 0x7fcd200cc090 2023-11-29T11:18:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.755+0000 7fcd12ffd700 1 -- 172.21.15.81:0/1155627612 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd1c0210a0 con 0x7fcd200cc090 2023-11-29T11:18:10.761 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:18:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcd04064ee0 msgr2=0x7fcd04067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcd04064ee0 0x7fcd04067390 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009c30 tx=0x7fcd14008030 comp rx=0 tx=0).stop 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200cc090 msgr2=0x7fcd201524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200cc090 0x7fcd201524a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00e760 tx=0x7fcd1c00eb20 comp rx=0 tx=0).stop 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 shutdown_connections 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcd04064ee0 0x7fcd04067390 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd2015cdb0 0x7fcd20157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200cc090 0x7fcd201524a0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 --2- 172.21.15.81:0/1155627612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd200cb6e0 0x7fcd200b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 >> 172.21.15.81:0/1155627612 conn(0x7fcd200b0a90 msgr2=0x7fcd200b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 shutdown_connections 2023-11-29T11:18:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.759+0000 7fcd285c9700 1 -- 172.21.15.81:0/1155627612 wait complete. 2023-11-29T11:18:10.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:18:10.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.883+0000 7f3685402700 1 Processor -- start 2023-11-29T11:18:10.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.883+0000 7f3685402700 1 -- start start 2023-11-29T11:18:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.883+0000 7f3685402700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3680154600 0x7f368015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.883+0000 7f3685402700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368006abe0 0x7f368015b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.883+0000 7f3685402700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368015e300 con 0x7f368006c650 2023-11-29T11:18:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368006ced0 con 0x7f3680154600 2023-11-29T11:18:10.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368015d9d0 con 0x7f368006abe0 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3680154600 0x7f368015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3680154600 0x7f368015aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47756/0 (socket says 172.21.15.81:47756) 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367ffff700 1 -- 172.21.15.81:0/2013574996 learned_addr learned my addr 172.21.15.81:0/2013574996 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3684c01700 1 --2- 172.21.15.81:0/2013574996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368006abe0 0x7f368015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367ffff700 1 -- 172.21.15.81:0/2013574996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368006abe0 msgr2=0x7f368015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367ffff700 1 --2- 172.21.15.81:0/2013574996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368006abe0 0x7f368015b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367ffff700 1 -- 172.21.15.81:0/2013574996 >> v1:172.21.15.176:6789/0 conn(0x7f368006c650 legacy=0x7f368006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367ffff700 1 -- 172.21.15.81:0/2013574996 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368015dcb0 con 0x7f3680154600 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367ffff700 1 --2- 172.21.15.81:0/2013574996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3680154600 0x7f368015aec0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f3670009910 tx=0x7f3670009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fad906179101004 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367effd700 1 -- 172.21.15.81:0/2013574996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670011830 con 0x7f3680154600 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367effd700 1 -- 172.21.15.81:0/2013574996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670011990 con 0x7f3680154600 2023-11-29T11:18:10.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f367effd700 1 -- 172.21.15.81:0/2013574996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670011d40 con 0x7f3680154600 2023-11-29T11:18:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 -- 172.21.15.81:0/2013574996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3680154600 msgr2=0x7f368015aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 --2- 172.21.15.81:0/2013574996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3680154600 0x7f368015aec0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f3670009910 tx=0x7f3670009c20 comp rx=0 tx=0).stop 2023-11-29T11:18:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 -- 172.21.15.81:0/2013574996 shutdown_connections 2023-11-29T11:18:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 --2- 172.21.15.81:0/2013574996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368006abe0 0x7f368015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 --2- 172.21.15.81:0/2013574996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3680154600 0x7f368015aec0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 -- 172.21.15.81:0/2013574996 >> 172.21.15.81:0/2013574996 conn(0x7f368006ec40 msgr2=0x7f36800b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 -- 172.21.15.81:0/2013574996 shutdown_connections 2023-11-29T11:18:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.887+0000 7f3685402700 1 -- 172.21.15.81:0/2013574996 wait complete. 2023-11-29T11:18:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 Processor -- start 2023-11-29T11:18:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 -- start start 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368006abe0 0x7f36801ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368006c650 0x7f36800b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368014c8f0 0x7f3680152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801efee0 con 0x7f368006c650 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800c4210 con 0x7f368006abe0 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800c44f0 con 0x7f368014c8f0 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368006c650 0x7f36800b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368006c650 0x7f36800b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47766/0 (socket says 172.21.15.81:47766) 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 -- 172.21.15.81:0/177834859 learned_addr learned my addr 172.21.15.81:0/177834859 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367ffff700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368006abe0 0x7f36801ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3684c01700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368014c8f0 0x7f3680152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 -- 172.21.15.81:0/177834859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368014c8f0 msgr2=0x7f3680152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368014c8f0 0x7f3680152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 -- 172.21.15.81:0/177834859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368006abe0 msgr2=0x7f36801ef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368006abe0 0x7f36801ef9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 -- 172.21.15.81:0/177834859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009570 con 0x7f368006c650 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367f7fe700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368006c650 0x7f36800b37c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f367400c500 tx=0x7f367400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367cff9700 1 -- 172.21.15.81:0/177834859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36740052d0 con 0x7f368006c650 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367cff9700 1 -- 172.21.15.81:0/177834859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674005430 con 0x7f368006c650 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f367cff9700 1 -- 172.21.15.81:0/177834859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36740055a0 con 0x7f368006c650 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368015e790 con 0x7f368006c650 2023-11-29T11:18:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.891+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368015df90 con 0x7f368006c650 2023-11-29T11:18:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.895+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368006cad0 con 0x7f368006c650 2023-11-29T11:18:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.895+0000 7f367cff9700 1 -- 172.21.15.81:0/177834859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3674019030 con 0x7f368006c650 2023-11-29T11:18:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.895+0000 7f367cff9700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f366c064f10 0x7f366c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.895+0000 7f367ffff700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f366c064f10 0x7f366c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.895+0000 7f367cff9700 1 -- 172.21.15.81:0/177834859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f3674081330 con 0x7f368006c650 2023-11-29T11:18:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.895+0000 7f367ffff700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f366c064f10 0x7f366c0673c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3670000c00 tx=0x7f3670008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:10.903+0000 7f367cff9700 1 -- 172.21.15.81:0/177834859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f367404f220 con 0x7f368006c650 2023-11-29T11:18:11.063 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:18:11.059+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-29T11:18:11.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.075+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f36800ccf80 con 0x7f368006c650 2023-11-29T11:18:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.075+0000 7f367cff9700 1 -- 172.21.15.81:0/177834859 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v84) v1 ==== 80+0+122 (secure 0 0 0) 0x7f3674052840 con 0x7f368006c650 2023-11-29T11:18:11.080 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6837/3247003029 2023-11-30T11:17:58.488925+0000 2023-11-29T11:18:11.080 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6836/3247003029 2023-11-30T11:17:58.488925+0000 2023-11-29T11:18:11.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f366c064f10 msgr2=0x7f366c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f366c064f10 0x7f366c0673c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3670000c00 tx=0x7f3670008030 comp rx=0 tx=0).stop 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368006c650 msgr2=0x7f36800b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368006c650 0x7f36800b37c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f367400c500 tx=0x7f367400c810 comp rx=0 tx=0).stop 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 shutdown_connections 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f366c064f10 0x7f366c0673c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368014c8f0 0x7f3680152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368006c650 0x7f36800b37c0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 --2- 172.21.15.81:0/177834859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368006abe0 0x7f36801ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 >> 172.21.15.81:0/177834859 conn(0x7f368006ec40 msgr2=0x7f368015cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 shutdown_connections 2023-11-29T11:18:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:11.079+0000 7f3685402700 1 -- 172.21.15.81:0/177834859 wait complete. 2023-11-29T11:18:11.084 INFO:teuthology.orchestra.run.smithi081.stderr:listed 2 entries 2023-11-29T11:18:11.094 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:18:11.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:11.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:18:11.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[55474]: fuse finished with error 0 and tester_r 0 2023-11-29T11:18:11.105 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:18:17.207 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:18:17.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:18:17.207 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:18:17.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2023-11-29T11:18:17.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.339+0000 7f35f2e83700 1 Processor -- start 2023-11-29T11:18:17.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f2e83700 1 -- start start 2023-11-29T11:18:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f2e83700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35ec06a4c0 0x7f35ec06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f2e83700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec0cf0e0 0x7f35ec0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f2e83700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec0cfa80 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f2e83700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec0d0ab0 con 0x7f35ec06a4c0 2023-11-29T11:18:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f2e83700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec06a9c0 con 0x7f35ec0cf0e0 2023-11-29T11:18:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f1680700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35ec06a4c0 0x7f35ec06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f1680700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35ec06a4c0 0x7f35ec06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47770/0 (socket says 172.21.15.81:47770) 2023-11-29T11:18:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f1680700 1 -- 172.21.15.81:0/3911846817 learned_addr learned my addr 172.21.15.81:0/3911846817 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f2682700 1 --2- 172.21.15.81:0/3911846817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec0cf0e0 0x7f35ec0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f1680700 1 -- 172.21.15.81:0/3911846817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec0cf0e0 msgr2=0x7f35ec0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f1680700 1 --2- 172.21.15.81:0/3911846817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec0cf0e0 0x7f35ec0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f1680700 1 -- 172.21.15.81:0/3911846817 >> v1:172.21.15.176:6789/0 conn(0x7f35ec0b1ae0 legacy=0x7f35ec0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f1680700 1 -- 172.21.15.81:0/3911846817 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec06aca0 con 0x7f35ec06a4c0 2023-11-29T11:18:17.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f1680700 1 --2- 172.21.15.81:0/3911846817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec06a4c0 0x7f35ec06d8e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009910 tx=0x7f35e8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4de150e6d2035d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f0e7f700 1 -- 172.21.15.81:0/3911846817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e800ba60 con 0x7f35ec06a4c0 2023-11-29T11:18:17.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f0e7f700 1 -- 172.21.15.81:0/3911846817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e800bbc0 con 0x7f35ec06a4c0 2023-11-29T11:18:17.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.343+0000 7f35f0e7f700 1 -- 172.21.15.81:0/3911846817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8009e60 con 0x7f35ec06a4c0 2023-11-29T11:18:17.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- 172.21.15.81:0/3911846817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec06a4c0 msgr2=0x7f35ec06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 --2- 172.21.15.81:0/3911846817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec06a4c0 0x7f35ec06d8e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009910 tx=0x7f35e8009c20 comp rx=0 tx=0).stop 2023-11-29T11:18:17.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- 172.21.15.81:0/3911846817 shutdown_connections 2023-11-29T11:18:17.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 --2- 172.21.15.81:0/3911846817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec0cf0e0 0x7f35ec0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 --2- 172.21.15.81:0/3911846817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec06a4c0 0x7f35ec06d8e0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- 172.21.15.81:0/3911846817 >> 172.21.15.81:0/3911846817 conn(0x7f35ec09bbd0 msgr2=0x7f35ec0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- 172.21.15.81:0/3911846817 shutdown_connections 2023-11-29T11:18:17.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- 172.21.15.81:0/3911846817 wait complete. 2023-11-29T11:18:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 Processor -- start 2023-11-29T11:18:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- start start 2023-11-29T11:18:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec06a4c0 0x7f35ec15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0b1ae0 0x7f35ec1f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ec0cf0e0 0x7f35ec15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec15db30 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec15cf20 con 0x7f35ec0cf0e0 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f2e83700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec15d200 con 0x7f35ec06a4c0 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.347+0000 7f35f1680700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0b1ae0 0x7f35ec1f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1680700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0b1ae0 0x7f35ec1f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47780/0 (socket says 172.21.15.81:47780) 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1680700 1 -- 172.21.15.81:0/1104835014 learned_addr learned my addr 172.21.15.81:0/1104835014 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1e81700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec06a4c0 0x7f35ec15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f2682700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ec0cf0e0 0x7f35ec15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1680700 1 -- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec06a4c0 msgr2=0x7f35ec15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1680700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec06a4c0 0x7f35ec15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1680700 1 -- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ec0cf0e0 msgr2=0x7f35ec15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1680700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ec0cf0e0 0x7f35ec15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1680700 1 -- 172.21.15.81:0/1104835014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8009570 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1e81700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec06a4c0 0x7f35ec15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f1680700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0b1ae0 0x7f35ec1f1010 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f35e8000c00 tx=0x7f35e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35de7fc700 1 -- 172.21.15.81:0/1104835014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8004610 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35de7fc700 1 -- 172.21.15.81:0/1104835014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e801e070 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f2e83700 1 -- 172.21.15.81:0/1104835014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec0b4380 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35de7fc700 1 -- 172.21.15.81:0/1104835014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8003900 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.351+0000 7f35f2e83700 1 -- 172.21.15.81:0/1104835014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec06af80 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35de7fc700 1 -- 172.21.15.81:0/1104835014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f35e800f050 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35de7fc700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f35d0064ee0 0x7f35d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35de7fc700 1 -- 172.21.15.81:0/1104835014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f35e8020070 con 0x7f35ec0b1ae0 2023-11-29T11:18:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f1e81700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f35d0064ee0 0x7f35d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f1e81700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f35d0064ee0 0x7f35d0067390 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f35e0000f60 tx=0x7f35e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f7365740 1 Processor -- start 2023-11-29T11:18:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f7365740 1 -- start start 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f7365740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1b01090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f7365740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1b015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f7365740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 0x1aca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f7365740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b9b80 con 0x184a980 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f7365740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a29c60 con 0x184ad50 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.355+0000 7f35f7365740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a22f60 con 0x1895a00 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1b015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1b015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47792/0 (socket says 172.21.15.81:47792) 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 -- 172.21.15.81:0/4036753568 learned_addr learned my addr 172.21.15.81:0/4036753568 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1e81700 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1b01090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f2682700 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 0x1aca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 -- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 msgr2=0x1aca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 0x1aca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 -- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 msgr2=0x1b01090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1b01090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 -- 172.21.15.81:0/4036753568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a48a60 con 0x184a980 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1e81700 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1b01090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f1680700 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1b015d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f35e8014040 tx=0x7f35e8054b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae2e5b8612534a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35cf7fe700 1 -- 172.21.15.81:0/4036753568 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80546b0 con 0x184a980 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35cf7fe700 1 -- 172.21.15.81:0/4036753568 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8054810 con 0x184a980 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35cf7fe700 1 -- 172.21.15.81:0/4036753568 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8054980 con 0x184a980 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 -- 172.21.15.81:0/4036753568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 msgr2=0x1b015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1b015d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f35e8014040 tx=0x7f35e8054b20 comp rx=0 tx=0).stop 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 -- 172.21.15.81:0/4036753568 shutdown_connections 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 0x1aca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1b015d0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 --2- 172.21.15.81:0/4036753568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1b01090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 -- 172.21.15.81:0/4036753568 >> 172.21.15.81:0/4036753568 conn(0x184b120 msgr2=0x1ae34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 -- 172.21.15.81:0/4036753568 shutdown_connections 2023-11-29T11:18:17.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 -- 172.21.15.81:0/4036753568 wait complete. 2023-11-29T11:18:17.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 -- start start 2023-11-29T11:18:17.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.359+0000 7f35f7365740 1 Processor -- start 2023-11-29T11:18:17.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 0x1abeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1abb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1abb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x18cfd90 con 0x1895a00 2023-11-29T11:18:17.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1abc1f0 con 0x184ad50 2023-11-29T11:18:17.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ae0c00 con 0x184a980 2023-11-29T11:18:17.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1abb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 10 client.0 _ll_register_callbacks cb 0x1a1c8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1abb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47804/0 (socket says 172.21.15.81:47804) 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 -- 172.21.15.81:0/2456442861 learned_addr learned my addr 172.21.15.81:0/2456442861 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f1e81700 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 0x1abeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f1680700 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1abb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 -- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 msgr2=0x1abeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 0x1abeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 -- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 msgr2=0x1abb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1abb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 -- 172.21.15.81:0/2456442861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec06af80 con 0x1895a00 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f1680700 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1abb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f2682700 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1abb8d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f35e40042c0 tx=0x7f35e40045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cbd04b3a84410a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35ccff9700 1 -- 172.21.15.81:0/2456442861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4009d60 con 0x1895a00 2023-11-29T11:18:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35ccff9700 1 -- 172.21.15.81:0/2456442861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f35e40076c0 con 0x1895a00 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 -- 172.21.15.81:0/2456442861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a1bfe0 con 0x1895a00 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35ccff9700 1 -- 172.21.15.81:0/2456442861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35e4007880 con 0x1895a00 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 10 client.7626 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 -- 172.21.15.81:0/2456442861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x1896c50 con 0x1895a00 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35ccff9700 1 -- 172.21.15.81:0/2456442861 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a1bfe0 con 0x1895a00 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35ccff9700 1 -- 172.21.15.81:0/2456442861 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f35e40079e0 con 0x1895a00 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 10 client.7626 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 10 client.7626 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 20 client.7626 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1abd430 0x1ab9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 4 client.7626 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:18:17.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f7365740 1 -- 172.21.15.81:0/2456442861 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a1bd00 con 0x1abd430 2023-11-29T11:18:17.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f1e81700 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1abd430 0x1ab9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35f1e81700 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1abd430 0x1ab9ee0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557c8417ed97d539 server_cookie=7dabeae2cce5d7c5 in_seq=0 out_seq=0 2023-11-29T11:18:17.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.363+0000 7f35ccff9700 10 client.7626 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:17.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35ccff9700 1 -- 172.21.15.81:0/2456442861 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1a1bd00 con 0x1abd430 2023-11-29T11:18:17.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35ccff9700 10 client.7626 handle_command_reply: tid=0 2023-11-29T11:18:17.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 client.7626 shutdown 2023-11-29T11:18:17.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 -- 172.21.15.81:0/2456442861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 msgr2=0x1abb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1abb8d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f35e40042c0 tx=0x7f35e40045d0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 -- 172.21.15.81:0/2456442861 shutdown_connections 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1abd430 0x1ab9ee0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1abb8d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1abb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 --2- 172.21.15.81:0/2456442861 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 0x1abeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 -- 172.21.15.81:0/2456442861 >> 172.21.15.81:0/2456442861 conn(0x184b120 msgr2=0x1ae3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35ccff9700 0 client.7626 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 -- 172.21.15.81:0/2456442861 shutdown_connections 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 1 -- 172.21.15.81:0/2456442861 wait complete. 2023-11-29T11:18:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.367+0000 7f35f7365740 20 client.7626 trim_cache size 0 max 16384 2023-11-29T11:18:17.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f7365740 1 Processor -- start 2023-11-29T11:18:17.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f7365740 1 -- start start 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f7365740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1acc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f7365740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ab8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f7365740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 0x1ab86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f7365740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x19f2c80 con 0x184a980 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f7365740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a20360 con 0x184ad50 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f7365740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a20770 con 0x1895a00 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1acc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1acc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47820/0 (socket says 172.21.15.81:47820) 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 -- 172.21.15.81:0/3996724154 learned_addr learned my addr 172.21.15.81:0/3996724154 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f2682700 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 0x1ab86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1680700 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ab8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 -- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 msgr2=0x1ab86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 0x1ab86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 -- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 msgr2=0x1ab8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ab8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 -- 172.21.15.81:0/3996724154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec15f2a0 con 0x184a980 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1680700 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ab8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.383+0000 7f35f1e81700 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1acc7d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009010 tx=0x7f35e0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15192928f9563825 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35cffff700 1 -- 172.21.15.81:0/3996724154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0005540 con 0x184a980 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35cffff700 1 -- 172.21.15.81:0/3996724154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e0025430 con 0x184a980 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35cffff700 1 -- 172.21.15.81:0/3996724154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0003d60 con 0x184a980 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 -- 172.21.15.81:0/3996724154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 msgr2=0x1acc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1acc7d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009010 tx=0x7f35e0012000 comp rx=0 tx=0).stop 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 -- 172.21.15.81:0/3996724154 shutdown_connections 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1895a00 0x1ab86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ab8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 --2- 172.21.15.81:0/3996724154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x184a980 0x1acc7d0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 -- 172.21.15.81:0/3996724154 >> 172.21.15.81:0/3996724154 conn(0x184b120 msgr2=0x1ab7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 -- 172.21.15.81:0/3996724154 shutdown_connections 2023-11-29T11:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 -- 172.21.15.81:0/3996724154 wait complete. 2023-11-29T11:18:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 -- start start 2023-11-29T11:18:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 Processor -- start 2023-11-29T11:18:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 0x1b16ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.387+0000 7f35f7365740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ae0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1afd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a21df0 con 0x1895a00 2023-11-29T11:18:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ed480 con 0x184ad50 2023-11-29T11:18:17.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a24bd0 con 0x184a980 2023-11-29T11:18:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 10 client.0 _ll_register_callbacks cb 0x195c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f2682700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1afd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1680700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ae0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1e81700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 0x1b16ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f2682700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1afd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47828/0 (socket says 172.21.15.81:47828) 2023-11-29T11:18:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f2682700 1 -- 172.21.15.81:0/1786410757 learned_addr learned my addr 172.21.15.81:0/1786410757 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1680700 1 -- 172.21.15.81:0/1786410757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 msgr2=0x1b16ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1680700 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 0x1b16ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1680700 1 -- 172.21.15.81:0/1786410757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 msgr2=0x1afd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1680700 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1afd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1680700 1 -- 172.21.15.81:0/1786410757 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e001d040 con 0x184ad50 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f2682700 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1afd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1680700 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ae0300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f35e8054ec0 tx=0x7f35e8027000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbbb10e59dbbb44e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35ccff9700 1 -- 172.21.15.81:0/1786410757 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8054980 con 0x184ad50 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35ccff9700 1 -- 172.21.15.81:0/1786410757 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f35e80830c0 con 0x184ad50 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 1 -- 172.21.15.81:0/1786410757 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1abbd00 con 0x184ad50 2023-11-29T11:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35ccff9700 1 -- 172.21.15.81:0/1786410757 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35e80546b0 con 0x184ad50 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 10 client.7354 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 1 -- 172.21.15.81:0/1786410757 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x19cfbd0 con 0x184ad50 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35ccff9700 1 -- 172.21.15.81:0/1786410757 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1abbd00 con 0x184ad50 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35ccff9700 1 -- 172.21.15.81:0/1786410757 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f35e8083280 con 0x184ad50 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 10 client.7354 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 10 client.7354 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 20 client.7354 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1b15360 0x1b15730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 4 client.7354 mds_command: new command op to 7461 tid=0[{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f7365740 1 -- 172.21.15.81:0/1786410757 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) v1 -- 0x7f35e8054810 con 0x1b15360 2023-11-29T11:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1e81700 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1b15360 0x1b15730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35ccff9700 10 client.7354 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.391+0000 7f35f1e81700 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1b15360 0x1b15730 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae4d21a55a862a52 server_cookie=219014336dfc9577 in_seq=0 out_seq=0 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35ccff9700 1 -- 172.21.15.81:0/1786410757 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f35e8054810 con 0x1b15360 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35ccff9700 10 client.7354 handle_command_reply: tid=0 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 client.7354 shutdown 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 -- 172.21.15.81:0/1786410757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 msgr2=0x1ae0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ae0300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f35e8054ec0 tx=0x7f35e8027000 comp rx=0 tx=0).stop 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 -- 172.21.15.81:0/1786410757 shutdown_connections 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1b15360 0x1b15730 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1895a00 0x1afd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x184ad50 0x1ae0300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 --2- 172.21.15.81:0/1786410757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x184a980 0x1b16ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35ccff9700 0 client.7354 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 -- 172.21.15.81:0/1786410757 >> 172.21.15.81:0/1786410757 conn(0x184b120 msgr2=0x1acb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 -- 172.21.15.81:0/1786410757 shutdown_connections 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 1 -- 172.21.15.81:0/1786410757 wait complete. 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f7365740 20 client.7354 trim_cache size 0 max 16384 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "cec24847-a9e4-470a-becd-8c3cc66fc23b", 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:18:17.401 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:18:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 -- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f35d0064ee0 msgr2=0x7f35d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f35d0064ee0 0x7f35d0067390 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f35e0000f60 tx=0x7f35e0009040 comp rx=0 tx=0).stop 2023-11-29T11:18:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 -- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0b1ae0 msgr2=0x7f35ec1f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0b1ae0 0x7f35ec1f1010 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f35e8000c00 tx=0x7f35e8004770 comp rx=0 tx=0).stop 2023-11-29T11:18:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 -- 172.21.15.81:0/1104835014 shutdown_connections 2023-11-29T11:18:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f35d0064ee0 0x7f35d0067390 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35ec0cf0e0 0x7f35ec15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec0b1ae0 0x7f35ec1f1010 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 --2- 172.21.15.81:0/1104835014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35ec06a4c0 0x7f35ec15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 -- 172.21.15.81:0/1104835014 >> 172.21.15.81:0/1104835014 conn(0x7f35ec09bbd0 msgr2=0x7f35ec0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 -- 172.21.15.81:0/1104835014 shutdown_connections 2023-11-29T11:18:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.395+0000 7f35f2e83700 1 -- 172.21.15.81:0/1104835014 wait complete. 2023-11-29T11:18:17.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-11-29T11:18:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e96370700 1 Processor -- start 2023-11-29T11:18:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e96370700 1 -- start start 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e96370700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2e900aaf40 0x7f2e900b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e96370700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e9006b370 0x7f2e9015c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e96370700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e900ccd00 con 0x7f2e9015bb80 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e96370700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e900b19b0 con 0x7f2e9006b370 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e96370700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e900cd510 con 0x7f2e900aaf40 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e95b6f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e9006b370 0x7f2e9015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e95b6f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e9006b370 0x7f2e9015c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47834/0 (socket says 172.21.15.81:47834) 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e95b6f700 1 -- 172.21.15.81:0/2258404479 learned_addr learned my addr 172.21.15.81:0/2258404479 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/2258404479 >> v2:172.21.15.176:3300/0 conn(0x7f2e900aaf40 0x7f2e900b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e95b6f700 1 -- 172.21.15.81:0/2258404479 >> v2:172.21.15.176:3300/0 conn(0x7f2e900aaf40 msgr2=0x7f2e900b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/2258404479 >> v2:172.21.15.176:3300/0 conn(0x7f2e900aaf40 0x7f2e900b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e95b6f700 1 -- 172.21.15.81:0/2258404479 >> v1:172.21.15.176:6789/0 conn(0x7f2e9015bb80 legacy=0x7f2e900b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.527+0000 7f2e95b6f700 1 -- 172.21.15.81:0/2258404479 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e900ccf50 con 0x7f2e9006b370 2023-11-29T11:18:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/2258404479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9006b370 0x7f2e9015c260 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2e9009c290 tx=0x7f2e88009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc43d8c3c3b1c76 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e87fff700 1 -- 172.21.15.81:0/2258404479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88010800 con 0x7f2e9006b370 2023-11-29T11:18:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e87fff700 1 -- 172.21.15.81:0/2258404479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88010960 con 0x7f2e9006b370 2023-11-29T11:18:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e87fff700 1 -- 172.21.15.81:0/2258404479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88010cf0 con 0x7f2e9006b370 2023-11-29T11:18:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e96370700 1 -- 172.21.15.81:0/2258404479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9006b370 msgr2=0x7f2e9015c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e96370700 1 --2- 172.21.15.81:0/2258404479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9006b370 0x7f2e9015c260 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2e9009c290 tx=0x7f2e88009bf0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e96370700 1 -- 172.21.15.81:0/2258404479 shutdown_connections 2023-11-29T11:18:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e96370700 1 --2- 172.21.15.81:0/2258404479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9006b370 0x7f2e9015c260 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e96370700 1 --2- 172.21.15.81:0/2258404479 >> v2:172.21.15.176:3300/0 conn(0x7f2e900aaf40 0x7f2e900b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e96370700 1 -- 172.21.15.81:0/2258404479 >> 172.21.15.81:0/2258404479 conn(0x7f2e900cae70 msgr2=0x7f2e900cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e96370700 1 -- 172.21.15.81:0/2258404479 shutdown_connections 2023-11-29T11:18:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.531+0000 7f2e96370700 1 -- 172.21.15.81:0/2258404479 wait complete. 2023-11-29T11:18:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 Processor -- start 2023-11-29T11:18:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 -- start start 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9006b370 0x7f2e9009b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e900aaf40 0x7f2e90070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9015bb80 0x7f2e9006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90159860 con 0x7f2e9015bb80 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9009bc10 con 0x7f2e9006b370 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90157700 con 0x7f2e900aaf40 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9015bb80 0x7f2e9006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9015bb80 0x7f2e9006cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47838/0 (socket says 172.21.15.81:47838) 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e9536e700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9006b370 0x7f2e9009b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 -- 172.21.15.81:0/1052890862 learned_addr learned my addr 172.21.15.81:0/1052890862 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e900aaf40 0x7f2e90070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 -- 172.21.15.81:0/1052890862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e900aaf40 msgr2=0x7f2e90070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e900aaf40 0x7f2e90070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 -- 172.21.15.81:0/1052890862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9006b370 msgr2=0x7f2e9009b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9006b370 0x7f2e9009b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 -- 172.21.15.81:0/1052890862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009570 con 0x7f2e9015bb80 2023-11-29T11:18:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9015bb80 0x7f2e9006cd40 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2e9006f640 tx=0x7f2e88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e85ffb700 1 -- 172.21.15.81:0/1052890862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8801d070 con 0x7f2e9015bb80 2023-11-29T11:18:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e85ffb700 1 -- 172.21.15.81:0/1052890862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88004600 con 0x7f2e9015bb80 2023-11-29T11:18:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 -- 172.21.15.81:0/1052890862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e900b1c50 con 0x7f2e9015bb80 2023-11-29T11:18:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e85ffb700 1 -- 172.21.15.81:0/1052890862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88003900 con 0x7f2e9015bb80 2023-11-29T11:18:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.535+0000 7f2e96370700 1 -- 172.21.15.81:0/1052890862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e900cd230 con 0x7f2e9015bb80 2023-11-29T11:18:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.539+0000 7f2e85ffb700 1 -- 172.21.15.81:0/1052890862 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2e88028030 con 0x7f2e9015bb80 2023-11-29T11:18:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.539+0000 7f2e85ffb700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e74064f10 0x7f2e740673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.539+0000 7f2e85ffb700 1 -- 172.21.15.81:0/1052890862 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f2e88083d80 con 0x7f2e9015bb80 2023-11-29T11:18:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.539+0000 7f2e9536e700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e74064f10 0x7f2e740673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.539+0000 7f2e9536e700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e74064f10 0x7f2e740673c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2e901f1200 tx=0x7f2e80009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 Processor -- start 2023-11-29T11:18:17.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- start start 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192bc10 0x1be2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1be3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bdf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a9ad20 con 0x192b840 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b0ad60 con 0x19768c0 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b04060 con 0x192bc10 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1be3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1be3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47850/0 (socket says 172.21.15.81:47850) 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 -- 172.21.15.81:0/2276962041 learned_addr learned my addr 172.21.15.81:0/2276962041 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bdf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9536e700 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192bc10 0x1be2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 -- 172.21.15.81:0/2276962041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192bc10 msgr2=0x1be2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192bc10 0x1be2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 -- 172.21.15.81:0/2276962041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 msgr2=0x1bdf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bdf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 -- 172.21.15.81:0/2276962041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b2a0a0 con 0x192b840 2023-11-29T11:18:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1be3340 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2e900b2c60 tx=0x7f2e8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3605f34fa93affd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e7affd700 1 -- 172.21.15.81:0/2276962041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00e040 con 0x192b840 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e7affd700 1 -- 172.21.15.81:0/2276962041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c00f040 con 0x192b840 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e7affd700 1 -- 172.21.15.81:0/2276962041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c004230 con 0x192b840 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- 172.21.15.81:0/2276962041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 msgr2=0x1be3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1be3340 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f2e900b2c60 tx=0x7f2e8c009750 comp rx=0 tx=0).stop 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- 172.21.15.81:0/2276962041 shutdown_connections 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bdf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1be3340 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 --2- 172.21.15.81:0/2276962041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192bc10 0x1be2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- 172.21.15.81:0/2276962041 >> 172.21.15.81:0/2276962041 conn(0x192bfe0 msgr2=0x1bc4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- 172.21.15.81:0/2276962041 shutdown_connections 2023-11-29T11:18:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.543+0000 7f2e9a852740 1 -- 172.21.15.81:0/2276962041 wait complete. 2023-11-29T11:18:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 -- start start 2023-11-29T11:18:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 Processor -- start 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1ba6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x192bc10 0x1bc0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19768c0 0x1ba6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b0c50 con 0x192b840 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bc0690 con 0x192bc10 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba6f50 con 0x19768c0 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 10 client.0 _ll_register_callbacks cb 0x1afd9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1ba6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1ba6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47856/0 (socket says 172.21.15.81:47856) 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 -- 172.21.15.81:0/700999231 learned_addr learned my addr 172.21.15.81:0/700999231 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19768c0 0x1ba6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x192bc10 0x1bc0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 -- 172.21.15.81:0/700999231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19768c0 msgr2=0x1ba6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19768c0 0x1ba6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 -- 172.21.15.81:0/700999231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x192bc10 msgr2=0x1bc0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x192bc10 0x1bc0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 -- 172.21.15.81:0/700999231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c009e30 con 0x192b840 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9536e700 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1ba6010 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f2e80010010 tx=0x7f2e80001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328408df2ab56493 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e6ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e6ffff700 1 -- 172.21.15.81:0/700999231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80014bd0 con 0x192b840 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e6ffff700 1 -- 172.21.15.81:0/700999231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f2e8001c040 con 0x192b840 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 -- 172.21.15.81:0/700999231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1afd0e0 con 0x192b840 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e6ffff700 1 -- 172.21.15.81:0/700999231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e80014d30 con 0x192b840 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 10 client.7644 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 -- 172.21.15.81:0/700999231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x1977b10 con 0x192b840 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e6ffff700 1 -- 172.21.15.81:0/700999231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1afd0e0 con 0x192b840 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e6ffff700 1 -- 172.21.15.81:0/700999231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2e8002a3f0 con 0x192b840 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 10 client.7644 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 10 client.7644 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 20 client.7644 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1bc1a50 0x1bde530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 4 client.7644 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:18:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e9a852740 1 -- 172.21.15.81:0/700999231 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1afce00 con 0x1bc1a50 2023-11-29T11:18:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1bc1a50 0x1bde530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e6ffff700 10 client.7644 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.547+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1bc1a50 0x1bde530 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23ea79535e107ce server_cookie=8b3c4886188be319 in_seq=0 out_seq=0 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e6ffff700 1 -- 172.21.15.81:0/700999231 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1afce00 con 0x1bc1a50 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e6ffff700 10 client.7644 handle_command_reply: tid=0 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 client.7644 shutdown 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 -- 172.21.15.81:0/700999231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 msgr2=0x1ba6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1ba6010 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f2e80010010 tx=0x7f2e80001080 comp rx=0 tx=0).stop 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 -- 172.21.15.81:0/700999231 shutdown_connections 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1bc1a50 0x1bde530 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x19768c0 0x1ba6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x192bc10 0x1bc0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e6ffff700 0 client.7644 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 --2- 172.21.15.81:0/700999231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192b840 0x1ba6010 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 -- 172.21.15.81:0/700999231 >> 172.21.15.81:0/700999231 conn(0x192bfe0 msgr2=0x1bbb660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 -- 172.21.15.81:0/700999231 shutdown_connections 2023-11-29T11:18:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 1 -- 172.21.15.81:0/700999231 wait complete. 2023-11-29T11:18:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.551+0000 7f2e9a852740 20 client.7644 trim_cache size 0 max 16384 2023-11-29T11:18:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9a852740 1 Processor -- start 2023-11-29T11:18:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9a852740 1 -- start start 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1bba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1bba670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bda060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9a852740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bc5770 con 0x192bc10 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9a852740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1acc5b0 con 0x19768c0 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9a852740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b02ef0 con 0x192b840 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e94b6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1bba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e94b6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1bba670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47862/0 (socket says 172.21.15.81:47862) 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e94b6d700 1 -- 172.21.15.81:0/2715694072 learned_addr learned my addr 172.21.15.81:0/2715694072 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e9536e700 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1bba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bda060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e94b6d700 1 -- 172.21.15.81:0/2715694072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 msgr2=0x1bba130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1bba130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e94b6d700 1 -- 172.21.15.81:0/2715694072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 msgr2=0x1bda060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.567+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bda060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e94b6d700 1 -- 172.21.15.81:0/2715694072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90098d40 con 0x192bc10 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1bba670 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c019000 tx=0x7f2e8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd02fe972b3aa5c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e7b7fe700 1 -- 172.21.15.81:0/2715694072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00e040 con 0x192bc10 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e7b7fe700 1 -- 172.21.15.81:0/2715694072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c02b3f0 con 0x192bc10 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e7b7fe700 1 -- 172.21.15.81:0/2715694072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c02bc10 con 0x192bc10 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 -- 172.21.15.81:0/2715694072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 msgr2=0x1bba670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1bba670 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c019000 tx=0x7f2e8c016000 comp rx=0 tx=0).stop 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 -- 172.21.15.81:0/2715694072 shutdown_connections 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bda060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1bba670 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 --2- 172.21.15.81:0/2715694072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1bba130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 -- 172.21.15.81:0/2715694072 >> 172.21.15.81:0/2715694072 conn(0x192bfe0 msgr2=0x1bbf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 -- 172.21.15.81:0/2715694072 shutdown_connections 2023-11-29T11:18:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 -- 172.21.15.81:0/2715694072 wait complete. 2023-11-29T11:18:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 -- start start 2023-11-29T11:18:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 Processor -- start 2023-11-29T11:18:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.571+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1c01290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1c43780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bde330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b01870 con 0x192bc10 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aa3510 con 0x19768c0 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ac6140 con 0x192b840 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 10 client.0 _ll_register_callbacks cb 0x7f2e8c009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e94b6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1c43780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e94b6d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1c43780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47866/0 (socket says 172.21.15.81:47866) 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e94b6d700 1 -- 172.21.15.81:0/1981315518 learned_addr learned my addr 172.21.15.81:0/1981315518 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9536e700 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1c01290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e95b6f700 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bde330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9536e700 1 -- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 msgr2=0x1bde330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9536e700 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bde330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9536e700 1 -- 172.21.15.81:0/1981315518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 msgr2=0x1c43780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9536e700 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1c43780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9536e700 1 -- 172.21.15.81:0/1981315518 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c020040 con 0x192b840 2023-11-29T11:18:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1c43780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:18:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9536e700 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1c01290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e800010c0 tx=0x7f2e80015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452021e3eca2c569 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e6ffff700 10 client.0 ms_handle_connect on v2:172.21.15.176:3301/0 2023-11-29T11:18:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e6ffff700 1 -- 172.21.15.81:0/1981315518 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8003c650 con 0x192b840 2023-11-29T11:18:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 -- 172.21.15.81:0/1981315518 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e8c00f040 con 0x192b840 2023-11-29T11:18:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e6ffff700 1 -- 172.21.15.81:0/1981315518 <== mon.2 v2:172.21.15.176:3301/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f2e8002ab90 con 0x192b840 2023-11-29T11:18:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e6ffff700 1 -- 172.21.15.81:0/1981315518 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e8000f4b0 con 0x192b840 2023-11-29T11:18:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 10 client.6533 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 -- 172.21.15.81:0/1981315518 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x1ab0af0 con 0x192b840 2023-11-29T11:18:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e6ffff700 1 -- 172.21.15.81:0/1981315518 <== mon.2 v2:172.21.15.176:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c00f040 con 0x192b840 2023-11-29T11:18:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e6ffff700 1 -- 172.21.15.81:0/1981315518 <== mon.2 v2:172.21.15.176:3301/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2e8003c7b0 con 0x192b840 2023-11-29T11:18:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 10 client.6533 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 10 client.6533 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 20 client.6533 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1bc13b0 0x1bde870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 4 client.6533 mds_command: new command op to 7461 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e9a852740 1 -- 172.21.15.81:0/1981315518 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x19a8390 con 0x1bc13b0 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1bc13b0 0x1bde870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e6ffff700 10 client.6533 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.575+0000 7f2e94b6d700 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1bc13b0 0x1bde870 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85fdbb4d926f23a server_cookie=1a5561294d66af29 in_seq=0 out_seq=0 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e6ffff700 1 -- 172.21.15.81:0/1981315518 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x19a8390 con 0x1bc13b0 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e6ffff700 10 client.6533 handle_command_reply: tid=0 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 client.6533 shutdown 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 -- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 msgr2=0x1c01290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1c01290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e800010c0 tx=0x7f2e80015000 comp rx=0 tx=0).stop 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 -- 172.21.15.81:0/1981315518 shutdown_connections 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1bc13b0 0x1bde870 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x19768c0 0x1bde330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e6ffff700 0 client.6533 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x192bc10 0x1c43780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 --2- 172.21.15.81:0/1981315518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x192b840 0x1c01290 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 -- 172.21.15.81:0/1981315518 >> 172.21.15.81:0/1981315518 conn(0x192bfe0 msgr2=0x1ba55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 -- 172.21.15.81:0/1981315518 shutdown_connections 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 1 -- 172.21.15.81:0/1981315518 wait complete. 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e9a852740 20 client.6533 trim_cache size 0 max 16384 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "cec24847-a9e4-470a-becd-8c3cc66fc23b": { 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/subdir", 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "cec24847-a9e4-470a-becd-8c3cc66fc23b", 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive" 2023-11-29T11:18:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:18:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:18:17.586 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:18:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 -- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e74064f10 msgr2=0x7f2e740673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e74064f10 0x7f2e740673c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2e901f1200 tx=0x7f2e80009040 comp rx=0 tx=0).stop 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 -- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9015bb80 msgr2=0x7f2e9006cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9015bb80 0x7f2e9006cd40 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2e9006f640 tx=0x7f2e88004770 comp rx=0 tx=0).stop 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 -- 172.21.15.81:0/1052890862 shutdown_connections 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e74064f10 0x7f2e740673c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9015bb80 0x7f2e9006cd40 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e900aaf40 0x7f2e90070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 --2- 172.21.15.81:0/1052890862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e9006b370 0x7f2e9009b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 -- 172.21.15.81:0/1052890862 >> 172.21.15.81:0/1052890862 conn(0x7f2e900cae70 msgr2=0x7f2e900af570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 -- 172.21.15.81:0/1052890862 shutdown_connections 2023-11-29T11:18:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:17.579+0000 7f2e96370700 1 -- 172.21.15.81:0/1052890862 wait complete. 2023-11-29T11:18:17.599 INFO:tasks.cephfs.filesystem:scrub status for tag:cec24847-a9e4-470a-becd-8c3cc66fc23b - {'path': '/subdir', 'tag': 'cec24847-a9e4-470a-becd-8c3cc66fc23b', 'options': 'recursive'} 2023-11-29T11:18:26.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:18:26.425 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:18:47.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-11-29T11:18:47.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.722+0000 7f4f0b59e700 1 Processor -- start 2023-11-29T11:18:47.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.722+0000 7f4f0b59e700 1 -- start start 2023-11-29T11:18:47.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0b1ae0 0x7f4f0c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f0c0cf0e0 0x7f4f0c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0cfa80 con 0x7f4f0c06a4c0 2023-11-29T11:18:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0d0ab0 con 0x7f4f0c0cf0e0 2023-11-29T11:18:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c06a9c0 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f0c0cf0e0 0x7f4f0c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f0c0cf0e0 0x7f4f0c0cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50770/0 (socket says 172.21.15.81:50770) 2023-11-29T11:18:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/2913276544 learned_addr learned my addr 172.21.15.81:0/2913276544 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:47.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2913276544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0b1ae0 0x7f4f0c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/2913276544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0b1ae0 msgr2=0x7f4f0c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2913276544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0b1ae0 0x7f4f0c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/2913276544 >> v1:172.21.15.176:6789/0 conn(0x7f4f0c06a4c0 legacy=0x7f4f0c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/2913276544 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c06aca0 con 0x7f4f0c0cf0e0 2023-11-29T11:18:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2913276544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0cf0e0 0x7f4f0c0cf540 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009e50 tx=0x7f4f0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc66b353a397843 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f09d9b700 1 -- 172.21.15.81:0/2913276544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400e070 con 0x7f4f0c0cf0e0 2023-11-29T11:18:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f09d9b700 1 -- 172.21.15.81:0/2913276544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400b910 con 0x7f4f0c0cf0e0 2023-11-29T11:18:47.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f09d9b700 1 -- 172.21.15.81:0/2913276544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400bcc0 con 0x7f4f0c0cf0e0 2023-11-29T11:18:47.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 -- 172.21.15.81:0/2913276544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0cf0e0 msgr2=0x7f4f0c0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/2913276544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0cf0e0 0x7f4f0c0cf540 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009e50 tx=0x7f4f0400b330 comp rx=0 tx=0).stop 2023-11-29T11:18:47.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 -- 172.21.15.81:0/2913276544 shutdown_connections 2023-11-29T11:18:47.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/2913276544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0cf0e0 0x7f4f0c0cf540 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/2913276544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0b1ae0 0x7f4f0c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 -- 172.21.15.81:0/2913276544 >> 172.21.15.81:0/2913276544 conn(0x7f4f0c09bbd0 msgr2=0x7f4f0c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 -- 172.21.15.81:0/2913276544 shutdown_connections 2023-11-29T11:18:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.726+0000 7f4f0b59e700 1 -- 172.21.15.81:0/2913276544 wait complete. 2023-11-29T11:18:47.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f0b59e700 1 Processor -- start 2023-11-29T11:18:47.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f0b59e700 1 -- start start 2023-11-29T11:18:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f0b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c06a4c0 0x7f4f0c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f0b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0b1ae0 0x7f4f0c15e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f0b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0cf0e0 0x7f4f0c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f0b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0c9620 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f0b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14ba60 con 0x7f4f0c06a4c0 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f0b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14ae50 con 0x7f4f0c0cf0e0 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f01d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0b1ae0 0x7f4f0c15e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f01d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0b1ae0 0x7f4f0c15e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50780/0 (socket says 172.21.15.81:50780) 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.730+0000 7f4f01d9b700 1 -- 172.21.15.81:0/774585227 learned_addr learned my addr 172.21.15.81:0/774585227 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c06a4c0 0x7f4f0c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0cf0e0 0x7f4f0c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f01d9b700 1 -- 172.21.15.81:0/774585227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0cf0e0 msgr2=0x7f4f0c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0cf0e0 0x7f4f0c14bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f01d9b700 1 -- 172.21.15.81:0/774585227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c06a4c0 msgr2=0x7f4f0c0c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c06a4c0 0x7f4f0c0c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f01d9b700 1 -- 172.21.15.81:0/774585227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04009b30 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0b1ae0 0x7f4f0c15e8e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400c500 tx=0x7f4ef400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f037fe700 1 -- 172.21.15.81:0/774585227 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40052d0 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f037fe700 1 -- 172.21.15.81:0/774585227 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef4005430 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f0b59e700 1 -- 172.21.15.81:0/774585227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c0b4380 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f037fe700 1 -- 172.21.15.81:0/774585227 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40055a0 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.734+0000 7f4f0b59e700 1 -- 172.21.15.81:0/774585227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c06af80 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f037fe700 1 -- 172.21.15.81:0/774585227 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ef4019030 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f037fe700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4eec064ee0 0x7f4eec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4eec064ee0 0x7f4eec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f037fe700 1 -- 172.21.15.81:0/774585227 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f4ef40811f0 con 0x7f4f0c0b1ae0 2023-11-29T11:18:47.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f13fc7740 1 Processor -- start 2023-11-29T11:18:47.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4eec064ee0 0x7f4eec067390 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009bf0 tx=0x7f4efc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f13fc7740 1 -- start start 2023-11-29T11:18:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15cac10 0x1881e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1882340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x16158c0 0x187e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1739d20 con 0x15cac10 2023-11-29T11:18:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a9d60 con 0x15ca840 2023-11-29T11:18:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x17a3060 con 0x16158c0 2023-11-29T11:18:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15cac10 0x1881e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15cac10 0x1881e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50782/0 (socket says 172.21.15.81:50782) 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 -- 172.21.15.81:0/2403058507 learned_addr learned my addr 172.21.15.81:0/2403058507 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1882340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x16158c0 0x187e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 -- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x16158c0 msgr2=0x187e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x16158c0 0x187e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 -- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 msgr2=0x1882340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1882340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 -- 172.21.15.81:0/2403058507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17c90a0 con 0x15cac10 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1882340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x16158c0 0x187e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.738+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15cac10 0x1881e00 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0044f0 tx=0x7f4efc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd4605360aef4f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4eebfff700 1 -- 172.21.15.81:0/2403058507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc01c040 con 0x15cac10 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4eebfff700 1 -- 172.21.15.81:0/2403058507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc0038d0 con 0x15cac10 2023-11-29T11:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4eebfff700 1 -- 172.21.15.81:0/2403058507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc003c40 con 0x15cac10 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2403058507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15cac10 msgr2=0x1881e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15cac10 0x1881e00 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0044f0 tx=0x7f4efc014000 comp rx=0 tx=0).stop 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2403058507 shutdown_connections 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x16158c0 0x187e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1882340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2403058507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15cac10 0x1881e00 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2403058507 >> 172.21.15.81:0/2403058507 conn(0x15cafe0 msgr2=0x1863d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2403058507 shutdown_connections 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2403058507 wait complete. 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 -- start start 2023-11-29T11:18:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.742+0000 7f4f13fc7740 1 Processor -- start 2023-11-29T11:18:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15ca840 0x1845040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x16158c0 0x1845ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x164fc50 con 0x15ca840 2023-11-29T11:18:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1845ff0 con 0x16158c0 2023-11-29T11:18:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x185f920 con 0x15cac10 2023-11-29T11:18:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 10 client.0 _ll_register_callbacks cb 0x179c9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15ca840 0x1845040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15ca840 0x1845040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50798/0 (socket says 172.21.15.81:50798) 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 -- 172.21.15.81:0/2985878304 learned_addr learned my addr 172.21.15.81:0/2985878304 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x16158c0 0x1845ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 -- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 msgr2=0x185f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 -- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x16158c0 msgr2=0x1845ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x16158c0 0x1845ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 -- 172.21.15.81:0/2985878304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc0041d0 con 0x15ca840 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x16158c0 0x1845ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15ca840 0x1845040 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f4efc011650 tx=0x7f4efc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e2f30cc3fa9e34 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4ee97fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2985878304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc022c10 con 0x15ca840 2023-11-29T11:18:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2985878304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f4efc022d70 con 0x15ca840 2023-11-29T11:18:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2985878304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x179c0e0 con 0x15ca840 2023-11-29T11:18:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2985878304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4efc036470 con 0x15ca840 2023-11-29T11:18:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 10 client.7662 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2985878304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x1616b10 con 0x15ca840 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2985878304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x179c0e0 con 0x15ca840 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2985878304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f4efc0365d0 con 0x15ca840 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 10 client.7662 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 10 client.7662 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 20 client.7662 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1860840 0x1860c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 4 client.7662 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2985878304 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x179be00 con 0x1860840 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1860840 0x1860c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1860840 0x1860c40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e34e8448e27360e server_cookie=76e1f35efcdbb8a6 in_seq=0 out_seq=0 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.746+0000 7f4ee97fa700 10 client.7662 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2985878304 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x179be00 con 0x1860840 2023-11-29T11:18:47.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4ee97fa700 10 client.7662 handle_command_reply: tid=0 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 client.7662 shutdown 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2985878304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15ca840 msgr2=0x1845040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15ca840 0x1845040 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f4efc011650 tx=0x7f4efc0047e0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2985878304 shutdown_connections 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1860840 0x1860c40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x16158c0 0x1845ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4ee97fa700 0 client.7662 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2985878304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x15ca840 0x1845040 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2985878304 >> 172.21.15.81:0/2985878304 conn(0x15cafe0 msgr2=0x185a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2985878304 shutdown_connections 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2985878304 wait complete. 2023-11-29T11:18:47.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.750+0000 7f4f13fc7740 20 client.7662 trim_cache size 0 max 16384 2023-11-29T11:18:47.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.766+0000 7f4f13fc7740 1 Processor -- start 2023-11-29T11:18:47.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.766+0000 7f4f13fc7740 1 -- start start 2023-11-29T11:18:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1858a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x185c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x174cf10 con 0x16158c0 2023-11-29T11:18:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1768440 con 0x15ca840 2023-11-29T11:18:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1860460 con 0x15cac10 2023-11-29T11:18:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x185c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x185c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50812/0 (socket says 172.21.15.81:50812) 2023-11-29T11:18:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/3521534126 learned_addr learned my addr 172.21.15.81:0/3521534126 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1858a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 msgr2=0x185c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 msgr2=0x1858a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1858a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/3521534126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c14b830 con 0x16158c0 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1858a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x185c970 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c066b70 tx=0x7f4f04010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d1047e05bb8137 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f00d99700 1 -- 172.21.15.81:0/3521534126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04003c40 con 0x16158c0 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f00d99700 1 -- 172.21.15.81:0/3521534126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f04022070 con 0x16158c0 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f00d99700 1 -- 172.21.15.81:0/3521534126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04004040 con 0x16158c0 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- 172.21.15.81:0/3521534126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 msgr2=0x185c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x185c970 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c066b70 tx=0x7f4f04010000 comp rx=0 tx=0).stop 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- 172.21.15.81:0/3521534126 shutdown_connections 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x185c970 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15cac10 0x185c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/3521534126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15ca840 0x1858a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- 172.21.15.81:0/3521534126 >> 172.21.15.81:0/3521534126 conn(0x15cafe0 msgr2=0x1843f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- 172.21.15.81:0/3521534126 shutdown_connections 2023-11-29T11:18:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- 172.21.15.81:0/3521534126 wait complete. 2023-11-29T11:18:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- start start 2023-11-29T11:18:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 Processor -- start 2023-11-29T11:18:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15ca840 0x18d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15cac10 0x18d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x18d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1845eb0 con 0x16158c0 2023-11-29T11:18:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a0870 con 0x15cac10 2023-11-29T11:18:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1742510 con 0x15ca840 2023-11-29T11:18:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f13fc7740 10 client.0 _ll_register_callbacks cb 0x7f4efc004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x18d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x18d6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50822/0 (socket says 172.21.15.81:50822) 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/2976034593 learned_addr learned my addr 172.21.15.81:0/2976034593 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f01d9b700 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15cac10 0x18d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.770+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15ca840 0x18d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/2976034593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15ca840 msgr2=0x18d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15ca840 0x18d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/2976034593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15cac10 msgr2=0x18d5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15cac10 0x18d5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f0ad9d700 1 -- 172.21.15.81:0/2976034593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0400be70 con 0x16158c0 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f0ad9d700 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x18d6110 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400d010 tx=0x7f4f04004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3526e4a7c440ca62 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2976034593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04004240 con 0x16158c0 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2976034593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4efc0038d0 con 0x16158c0 2023-11-29T11:18:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2976034593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f4f04030dd0 con 0x16158c0 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2976034593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f040043a0 con 0x16158c0 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 10 client.7668 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2976034593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x174faf0 con 0x16158c0 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2976034593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc0038d0 con 0x16158c0 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2976034593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f4f0400b050 con 0x16158c0 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 10 client.7668 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 10 client.7668 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 20 client.7668 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x185f070 0x185a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 4 client.7668 mds_command: new command op to 7461 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2976034593 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1647390 con 0x185f070 2023-11-29T11:18:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x185f070 0x185a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f0a59c700 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x185f070 0x185a420 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95012460a82ec1a server_cookie=3324b02a0ec121e6 in_seq=0 out_seq=0 2023-11-29T11:18:47.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 10 client.7668 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:47.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 1 -- 172.21.15.81:0/2976034593 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1647390 con 0x185f070 2023-11-29T11:18:47.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 10 client.7668 handle_command_reply: tid=0 2023-11-29T11:18:47.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 client.7668 shutdown 2023-11-29T11:18:47.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2976034593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 msgr2=0x18d6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x18d6110 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400d010 tx=0x7f4f04004b60 comp rx=0 tx=0).stop 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2976034593 shutdown_connections 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x185f070 0x185a420 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16158c0 0x18d6110 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x15cac10 0x18d5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 --2- 172.21.15.81:0/2976034593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x15ca840 0x18d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4ee97fa700 0 client.7668 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2976034593 >> 172.21.15.81:0/2976034593 conn(0x15cafe0 msgr2=0x18594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2976034593 shutdown_connections 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 1 -- 172.21.15.81:0/2976034593 wait complete. 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.774+0000 7f4f13fc7740 20 client.7668 trim_cache size 0 max 16384 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:18:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:18:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:18:47.785 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:18:47.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 -- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4eec064ee0 msgr2=0x7f4eec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4eec064ee0 0x7f4eec067390 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009bf0 tx=0x7f4efc009240 comp rx=0 tx=0).stop 2023-11-29T11:18:47.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 -- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0b1ae0 msgr2=0x7f4f0c15e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0b1ae0 0x7f4f0c15e8e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400c500 tx=0x7f4ef400c810 comp rx=0 tx=0).stop 2023-11-29T11:18:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 -- 172.21.15.81:0/774585227 shutdown_connections 2023-11-29T11:18:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4eec064ee0 0x7f4eec067390 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0cf0e0 0x7f4f0c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f0c0b1ae0 0x7f4f0c15e8e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 --2- 172.21.15.81:0/774585227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c06a4c0 0x7f4f0c0c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 -- 172.21.15.81:0/774585227 >> 172.21.15.81:0/774585227 conn(0x7f4f0c09bbd0 msgr2=0x7f4f0c15bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 -- 172.21.15.81:0/774585227 shutdown_connections 2023-11-29T11:18:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.778+0000 7f4f0b59e700 1 -- 172.21.15.81:0/774585227 wait complete. 2023-11-29T11:18:47.800 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:18:47.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:18:47.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca21d9700 1 Processor -- start 2023-11-29T11:18:47.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca21d9700 1 -- start start 2023-11-29T11:18:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca21d9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c9c0c1ac0 0x7f1c9c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca21d9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c0cae70 con 0x7f1c9c0ceef0 2023-11-29T11:18:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca21d9700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c0cbc10 con 0x7f1c9c1606b0 2023-11-29T11:18:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca21d9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c0cb130 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca09d6700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c9c0c1ac0 0x7f1c9c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca19d8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c9c0ceef0 0x7f1c9c06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33340/0 (socket says 172.21.15.81:33340) 2023-11-29T11:18:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca19d8700 1 -- 172.21.15.81:0/3128357045 learned_addr learned my addr 172.21.15.81:0/3128357045 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:47.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1c8ffff700 1 -- 172.21.15.81:0/3128357045 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262768468 0 0) 0x7f1c9c0cbc10 con 0x7f1c9c1606b0 2023-11-29T11:18:47.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1c8ffff700 1 -- 172.21.15.81:0/3128357045 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c880035d0 con 0x7f1c9c1606b0 2023-11-29T11:18:47.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca09d6700 1 -- 172.21.15.81:0/3128357045 >> v1:172.21.15.176:6789/0 conn(0x7f1c9c1606b0 legacy=0x7f1c9c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1c8ffff700 1 -- 172.21.15.81:0/3128357045 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578450252 0 0) 0x7f1c9c0cae70 con 0x7f1c9c0ceef0 2023-11-29T11:18:47.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca09d6700 1 -- 172.21.15.81:0/3128357045 >> v1:172.21.15.81:6789/0 conn(0x7f1c9c0ceef0 legacy=0x7f1c9c06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca09d6700 1 -- 172.21.15.81:0/3128357045 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0cb410 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1ca09d6700 1 --2- 172.21.15.81:0/3128357045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0c1ac0 0x7f1c9c069c40 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009850 tx=0x7f1c90009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1066d57cdcf8ff9c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1c8ffff700 1 -- 172.21.15.81:0/3128357045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90011830 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1c8ffff700 1 -- 172.21.15.81:0/3128357045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90011990 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.914+0000 7f1c8ffff700 1 -- 172.21.15.81:0/3128357045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90011d00 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- 172.21.15.81:0/3128357045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0c1ac0 msgr2=0x7f1c9c069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 --2- 172.21.15.81:0/3128357045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0c1ac0 0x7f1c9c069c40 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009850 tx=0x7f1c90009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- 172.21.15.81:0/3128357045 shutdown_connections 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 --2- 172.21.15.81:0/3128357045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0c1ac0 0x7f1c9c069c40 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- 172.21.15.81:0/3128357045 >> 172.21.15.81:0/3128357045 conn(0x7f1c9c0ce3e0 msgr2=0x7f1c9c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- 172.21.15.81:0/3128357045 shutdown_connections 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- 172.21.15.81:0/3128357045 wait complete. 2023-11-29T11:18:47.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 Processor -- start 2023-11-29T11:18:47.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- start start 2023-11-29T11:18:47.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c9c0c1ac0 0x7f1c9c1f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0ceef0 0x7f1c9c0ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c9c1606b0 0x7f1c9c0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c1f5b60 con 0x7f1c9c0ceef0 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0ab4a0 con 0x7f1c9c1606b0 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca21d9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0ab780 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca09d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0ceef0 0x7f1c9c0ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c9c0c1ac0 0x7f1c9c1f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c9c0c1ac0 0x7f1c9c1f5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:43756/0 (socket says 172.21.15.81:43756) 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 -- 172.21.15.81:0/1372434915 learned_addr learned my addr 172.21.15.81:0/1372434915 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca09d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0ceef0 0x7f1c9c0ac540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50834/0 (socket says 172.21.15.81:50834) 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca19d8700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c9c1606b0 0x7f1c9c0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 -- 172.21.15.81:0/1372434915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c9c1606b0 msgr2=0x7f1c9c0c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c9c1606b0 0x7f1c9c0c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 -- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0ceef0 msgr2=0x7f1c9c0ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:47.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0ceef0 0x7f1c9c0ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:47.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 -- 172.21.15.81:0/1372434915 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900094b0 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.918+0000 7f1ca11d7700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c9c0c1ac0 0x7f1c9c1f5620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400cc50 tx=0x7f1c9400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.922+0000 7f1c8dffb700 1 -- 172.21.15.81:0/1372434915 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94003c20 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.922+0000 7f1c8dffb700 1 -- 172.21.15.81:0/1372434915 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c94003d80 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.922+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c0b36c0 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.922+0000 7f1c8dffb700 1 -- 172.21.15.81:0/1372434915 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400ab10 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.922+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c0cb6f0 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.922+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c0ad610 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.922+0000 7f1c8dffb700 1 -- 172.21.15.81:0/1372434915 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c94010050 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.926+0000 7f1c8dffb700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c80064ee0 0x7f1c80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:47.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.926+0000 7f1c8dffb700 1 -- 172.21.15.81:0/1372434915 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f1c94082a50 con 0x7f1c9c0c1ac0 2023-11-29T11:18:47.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.926+0000 7f1ca09d6700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c80064ee0 0x7f1c80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:47.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.926+0000 7f1ca09d6700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c80064ee0 0x7f1c80067390 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0c1eb0 tx=0x7f1c90008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:47.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:47.934+0000 7f1c8dffb700 1 -- 172.21.15.81:0/1372434915 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c94050a30 con 0x7f1c9c0c1ac0 2023-11-29T11:18:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.130+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c9c072500 con 0x7f1c9c0c1ac0 2023-11-29T11:18:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.134+0000 7f1c8dffb700 1 -- 172.21.15.81:0/1372434915 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f1c94054050 con 0x7f1c9c0c1ac0 2023-11-29T11:18:48.139 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:18:48.140 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:11.060671+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c80064ee0 msgr2=0x7f1c80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c80064ee0 0x7f1c80067390 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0c1eb0 tx=0x7f1c90008030 comp rx=0 tx=0).stop 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c9c0c1ac0 msgr2=0x7f1c9c1f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c9c0c1ac0 0x7f1c9c1f5620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400cc50 tx=0x7f1c9400cf60 comp rx=0 tx=0).stop 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 shutdown_connections 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1c80064ee0 0x7f1c80067390 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c9c1606b0 0x7f1c9c0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9c0ceef0 0x7f1c9c0ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 --2- 172.21.15.81:0/1372434915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c9c0c1ac0 0x7f1c9c1f5620 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 >> 172.21.15.81:0/1372434915 conn(0x7f1c9c0ce3e0 msgr2=0x7f1c9c0af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 shutdown_connections 2023-11-29T11:18:48.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.138+0000 7f1ca21d9700 1 -- 172.21.15.81:0/1372434915 wait complete. 2023-11-29T11:18:48.144 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2023-11-29T11:18:48.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2023-11-29T11:18:48.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b9259700 1 Processor -- start 2023-11-29T11:18:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b9259700 1 -- start start 2023-11-29T11:18:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b9259700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b00e0 0x7ff5b415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b9259700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff5b40cbb30 0x7ff5b406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b9259700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b40b2db0 con 0x7ff5b409bdb0 2023-11-29T11:18:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b9259700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b40b3240 con 0x7ff5b40cbb30 2023-11-29T11:18:48.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b9259700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b406d840 con 0x7ff5b40b00e0 2023-11-29T11:18:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b8a58700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff5b40cbb30 0x7ff5b406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b00e0 0x7ff5b415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5ab7fe700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff5b409bdb0 0x7ff5b415d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:46654/0 (socket says 172.21.15.81:46654) 2023-11-29T11:18:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5b8a58700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff5b40cbb30 0x7ff5b406bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:40590/0 (socket says 172.21.15.81:40590) 2023-11-29T11:18:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.266+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/2680649536 learned_addr learned my addr 172.21.15.81:0/2680649536 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2680649536 >> v2:172.21.15.176:3300/0 conn(0x7ff5b40cbb30 msgr2=0x7ff5b406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2680649536 >> v2:172.21.15.176:3300/0 conn(0x7ff5b40cbb30 0x7ff5b406bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2680649536 >> v1:172.21.15.176:6789/0 conn(0x7ff5b409bdb0 legacy=0x7ff5b415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2680649536 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b406d560 con 0x7ff5b40b00e0 2023-11-29T11:18:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/2680649536 >> v2:172.21.15.176:3300/0 conn(0x7ff5b40cbb30 0x7ff5b406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:18:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2680649536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b00e0 0x7ff5b415d2e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009850 tx=0x7ff5a4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7496eabeedeba81 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b37fe700 1 -- 172.21.15.81:0/2680649536 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4011830 con 0x7ff5b40b00e0 2023-11-29T11:18:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b37fe700 1 -- 172.21.15.81:0/2680649536 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4011990 con 0x7ff5b40b00e0 2023-11-29T11:18:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b37fe700 1 -- 172.21.15.81:0/2680649536 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4011d40 con 0x7ff5b40b00e0 2023-11-29T11:18:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b9259700 1 -- 172.21.15.81:0/2680649536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b00e0 msgr2=0x7ff5b415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b9259700 1 --2- 172.21.15.81:0/2680649536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b00e0 0x7ff5b415d2e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009850 tx=0x7ff5a4009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b9259700 1 -- 172.21.15.81:0/2680649536 shutdown_connections 2023-11-29T11:18:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b9259700 1 --2- 172.21.15.81:0/2680649536 >> v2:172.21.15.176:3300/0 conn(0x7ff5b40cbb30 0x7ff5b406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b9259700 1 --2- 172.21.15.81:0/2680649536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b00e0 0x7ff5b415d2e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b9259700 1 -- 172.21.15.81:0/2680649536 >> 172.21.15.81:0/2680649536 conn(0x7ff5b40cae70 msgr2=0x7ff5b40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b9259700 1 -- 172.21.15.81:0/2680649536 shutdown_connections 2023-11-29T11:18:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.270+0000 7ff5b9259700 1 -- 172.21.15.81:0/2680649536 wait complete. 2023-11-29T11:18:48.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 Processor -- start 2023-11-29T11:18:48.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 -- start start 2023-11-29T11:18:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b409bdb0 0x7ff5b40c1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b40b00e0 0x7ff5b4158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40cbb30 0x7ff5b41f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41f2490 con 0x7ff5b409bdb0 2023-11-29T11:18:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41f1ed0 con 0x7ff5b40b00e0 2023-11-29T11:18:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41f21b0 con 0x7ff5b40cbb30 2023-11-29T11:18:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b409bdb0 0x7ff5b40c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b409bdb0 0x7ff5b40c1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50836/0 (socket says 172.21.15.81:50836) 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 -- 172.21.15.81:0/3929971699 learned_addr learned my addr 172.21.15.81:0/3929971699 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40cbb30 0x7ff5b41f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b40b00e0 0x7ff5b4158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 -- 172.21.15.81:0/3929971699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40cbb30 msgr2=0x7ff5b41f14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40cbb30 0x7ff5b41f14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 -- 172.21.15.81:0/3929971699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b40b00e0 msgr2=0x7ff5b4158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b40b00e0 0x7ff5b4158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 -- 172.21.15.81:0/3929971699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac009a70 con 0x7ff5b409bdb0 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b409bdb0 0x7ff5b40c1300 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff5b406d980 tx=0x7ff5a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b17fa700 1 -- 172.21.15.81:0/3929971699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4004480 con 0x7ff5b409bdb0 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b17fa700 1 -- 172.21.15.81:0/3929971699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a401f070 con 0x7ff5b409bdb0 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 -- 172.21.15.81:0/3929971699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a40094b0 con 0x7ff5b409bdb0 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b17fa700 1 -- 172.21.15.81:0/3929971699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40038e0 con 0x7ff5b409bdb0 2023-11-29T11:18:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.274+0000 7ff5b9259700 1 -- 172.21.15.81:0/3929971699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b40ac3d0 con 0x7ff5b409bdb0 2023-11-29T11:18:48.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.278+0000 7ff5b17fa700 1 -- 172.21.15.81:0/3929971699 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff5a402a020 con 0x7ff5b409bdb0 2023-11-29T11:18:48.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.278+0000 7ff5b17fa700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.278+0000 7ff5b17fa700 1 -- 172.21.15.81:0/3929971699 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7ff5a4083510 con 0x7ff5b409bdb0 2023-11-29T11:18:48.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.278+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.278+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff5b406acb0 tx=0x7ff59c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5bd73b740 1 Processor -- start 2023-11-29T11:18:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5bd73b740 1 -- start start 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x221b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f63950 0x221d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1fae9d0 0x221fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x20d2dc0 con 0x1f63950 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2142e20 con 0x1fae9d0 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x213c120 con 0x1f63d20 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f63950 0x221d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f63950 0x221d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50844/0 (socket says 172.21.15.81:50844) 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/1809450071 learned_addr learned my addr 172.21.15.81:0/1809450071 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x221b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1fae9d0 0x221fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 msgr2=0x221b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x221b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1fae9d0 msgr2=0x221fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1fae9d0 0x221fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/1809450071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21629b0 con 0x1f63950 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x221b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1fae9d0 0x221fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f63950 0x221d970 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00f6c0 tx=0x7ff59c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319c770f68280f2b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/1809450071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c00fe40 con 0x1f63950 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/1809450071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c014450 con 0x1f63950 2023-11-29T11:18:48.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.282+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/1809450071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0147c0 con 0x1f63950 2023-11-29T11:18:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- 172.21.15.81:0/1809450071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f63950 msgr2=0x221d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f63950 0x221d970 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00f6c0 tx=0x7ff59c012000 comp rx=0 tx=0).stop 2023-11-29T11:18:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- 172.21.15.81:0/1809450071 shutdown_connections 2023-11-29T11:18:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1fae9d0 0x221fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f63950 0x221d970 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/1809450071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x221b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- 172.21.15.81:0/1809450071 >> 172.21.15.81:0/1809450071 conn(0x1f640f0 msgr2=0x21fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- 172.21.15.81:0/1809450071 shutdown_connections 2023-11-29T11:18:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- 172.21.15.81:0/1809450071 wait complete. 2023-11-29T11:18:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- start start 2023-11-29T11:18:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 Processor -- start 2023-11-29T11:18:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x21cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x21f8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fae9d0 0x22165f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fe8d60 con 0x1fae9d0 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x21fe7e0 con 0x1f63d20 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x21d53f0 con 0x1f63950 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5bd73b740 10 client.0 _ll_register_callbacks cb 0x2135a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fae9d0 0x22165f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fae9d0 0x22165f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50848/0 (socket says 172.21.15.81:50848) 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 -- 172.21.15.81:0/2920897350 learned_addr learned my addr 172.21.15.81:0/2920897350 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x21f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x21cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 -- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 msgr2=0x21cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x21cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 -- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 msgr2=0x21f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x21f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 -- 172.21.15.81:0/2920897350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b40b2db0 con 0x1fae9d0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x21cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x21f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fae9d0 0x22165f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007e50 tx=0x7ff5ac007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8681fe4166b158f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.286+0000 7ff5a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/2920897350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00e040 con 0x1fae9d0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/2920897350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7ff5ac013ca0 con 0x1fae9d0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 -- 172.21.15.81:0/2920897350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21351a0 con 0x1fae9d0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/2920897350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5ac013ea0 con 0x1fae9d0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 10 client.7686 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 -- 172.21.15.81:0/2920897350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x1fafc20 con 0x1fae9d0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/2920897350 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21351a0 con 0x1fae9d0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/2920897350 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7ff5ac003a40 con 0x1fae9d0 2023-11-29T11:18:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 10 client.7686 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:48.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 10 client.7686 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:18:48.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 20 client.7686 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:48.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x21d66f0 0x21d4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 4 client.7686 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:18:48.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 -- 172.21.15.81:0/2920897350 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2134ec0 con 0x21d66f0 2023-11-29T11:18:48.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x21d66f0 0x21d4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 10 client.7686 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:48.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x21d66f0 0x21d4020 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c0af673978258d server_cookie=f5d8200fa8e542f0 in_seq=0 out_seq=0 2023-11-29T11:18:48.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/2920897350 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2134ec0 con 0x21d66f0 2023-11-29T11:18:48.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 10 client.7686 handle_command_reply: tid=0 2023-11-29T11:18:48.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 client.7686 shutdown 2023-11-29T11:18:48.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 -- 172.21.15.81:0/2920897350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fae9d0 msgr2=0x22165f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fae9d0 0x22165f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007e50 tx=0x7ff5ac007f30 comp rx=0 tx=0).stop 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 -- 172.21.15.81:0/2920897350 shutdown_connections 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x21d66f0 0x21d4020 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fae9d0 0x22165f0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x21f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/2920897350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x21cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 -- 172.21.15.81:0/2920897350 >> 172.21.15.81:0/2920897350 conn(0x1f640f0 msgr2=0x21fbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5a2ffd700 0 client.7686 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 -- 172.21.15.81:0/2920897350 shutdown_connections 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 1 -- 172.21.15.81:0/2920897350 wait complete. 2023-11-29T11:18:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.290+0000 7ff5bd73b740 20 client.7686 trim_cache size 0 max 16384 2023-11-29T11:18:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 Processor -- start 2023-11-29T11:18:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- start start 2023-11-29T11:18:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x22162b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x2229b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x222a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x21364c0 con 0x1f640f0 2023-11-29T11:18:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x21a1f80 con 0x1f63d20 2023-11-29T11:18:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2139930 con 0x1f63950 2023-11-29T11:18:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x22162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x22162b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50850/0 (socket says 172.21.15.81:50850) 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 -- 172.21.15.81:0/4152611023 learned_addr learned my addr 172.21.15.81:0/4152611023 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x222a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x2229b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 -- 172.21.15.81:0/4152611023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 msgr2=0x2229b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x2229b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 -- 172.21.15.81:0/4152611023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 msgr2=0x222a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x222a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 -- 172.21.15.81:0/4152611023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4158b90 con 0x1f640f0 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x22162b0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4054eb0 tx=0x7ff5a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388cd8286b53f283 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5aa7fc700 1 -- 172.21.15.81:0/4152611023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4053550 con 0x1f640f0 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5aa7fc700 1 -- 172.21.15.81:0/4152611023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a406c070 con 0x1f640f0 2023-11-29T11:18:48.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5aa7fc700 1 -- 172.21.15.81:0/4152611023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40548a0 con 0x1f640f0 2023-11-29T11:18:48.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- 172.21.15.81:0/4152611023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 msgr2=0x22162b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x22162b0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4054eb0 tx=0x7ff5a40045e0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- 172.21.15.81:0/4152611023 shutdown_connections 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63d20 0x222a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63950 0x2229b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/4152611023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x22162b0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- 172.21.15.81:0/4152611023 >> 172.21.15.81:0/4152611023 conn(0x21f81a0 msgr2=0x2215ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- 172.21.15.81:0/4152611023 shutdown_connections 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- 172.21.15.81:0/4152611023 wait complete. 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 -- start start 2023-11-29T11:18:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.310+0000 7ff5bd73b740 1 Processor -- start 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63950 0x222fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x222f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x222e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2140120 con 0x1f640f0 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x21fc9f0 con 0x1f63950 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x21d43d0 con 0x1f63d20 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 10 client.0 _ll_register_callbacks cb 0x7ff59c017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x222e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x222e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50856/0 (socket says 172.21.15.81:50856) 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 -- 172.21.15.81:0/89466832 learned_addr learned my addr 172.21.15.81:0/89466832 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x222f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63950 0x222fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 -- 172.21.15.81:0/89466832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 msgr2=0x222f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x222f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 -- 172.21.15.81:0/89466832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63950 msgr2=0x222fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63950 0x222fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 -- 172.21.15.81:0/89466832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b40ac3d0 con 0x1f640f0 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b8a58700 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x222e160 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac013720 tx=0x7ff5ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27270b85cc2f508c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/89466832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00e070 con 0x1f640f0 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/89466832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7ff5ac013ca0 con 0x1f640f0 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- 172.21.15.81:0/89466832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff59c014450 con 0x1f640f0 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/89466832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5ac013ea0 con 0x1f640f0 2023-11-29T11:18:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 10 client.7692 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- 172.21.15.81:0/89466832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x20e8b90 con 0x1f640f0 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/89466832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac039030 con 0x1f640f0 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/89466832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7ff5ac004070 con 0x1f640f0 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 10 client.7692 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 10 client.7692 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 20 client.7692 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1fae9d0 0x227a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 4 client.7692 mds_command: new command op to 7461 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- 172.21.15.81:0/89466832 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x1fe04a0 con 0x1fae9d0 2023-11-29T11:18:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1fae9d0 0x227a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 10 client.7692 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:48.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1fae9d0 0x227a790 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efaf11c65eb77edf server_cookie=d2e3033da04ad115 in_seq=0 out_seq=0 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 1 -- 172.21.15.81:0/89466832 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+237 (crc 0 0 0) 0x1fe04a0 con 0x1fae9d0 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 10 client.7692 handle_command_reply: tid=0 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 client.7692 shutdown 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- 172.21.15.81:0/89466832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 msgr2=0x222e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x222e160 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac013720 tx=0x7ff5ac004af0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- 172.21.15.81:0/89466832 shutdown_connections 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x1fae9d0 0x227a790 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5a2ffd700 0 client.7692 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f640f0 0x222e160 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f63d20 0x222f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 --2- 172.21.15.81:0/89466832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f63950 0x222fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.314+0000 7ff5bd73b740 1 -- 172.21.15.81:0/89466832 >> 172.21.15.81:0/89466832 conn(0x21f81a0 msgr2=0x2229b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5bd73b740 1 -- 172.21.15.81:0/89466832 shutdown_connections 2023-11-29T11:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5bd73b740 1 -- 172.21.15.81:0/89466832 wait complete. 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5bd73b740 20 client.7692 trim_cache size 0 max 16384 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "dentry", 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 1699443432, 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627776, 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: "frag": "*", 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: "dname": "file_to_be_damaged", 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_id": "head", 2023-11-29T11:18:48.327 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/subdir/file_to_be_damaged" 2023-11-29T11:18:48.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:18:48.328 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:18:48.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 -- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 msgr2=0x7ff598067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff5b406acb0 tx=0x7ff59c009040 comp rx=0 tx=0).stop 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 -- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b409bdb0 msgr2=0x7ff5b40c1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b409bdb0 0x7ff5b40c1300 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff5b406d980 tx=0x7ff5a4004770 comp rx=0 tx=0).stop 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 -- 172.21.15.81:0/3929971699 shutdown_connections 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40cbb30 0x7ff5b41f14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b40b00e0 0x7ff5b4158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 --2- 172.21.15.81:0/3929971699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b409bdb0 0x7ff5b40c1300 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 -- 172.21.15.81:0/3929971699 >> 172.21.15.81:0/3929971699 conn(0x7ff5b40cae70 msgr2=0x7ff5b415a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 -- 172.21.15.81:0/3929971699 shutdown_connections 2023-11-29T11:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.318+0000 7ff5b9259700 1 -- 172.21.15.81:0/3929971699 wait complete. 2023-11-29T11:18:48.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-29T11:18:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 Processor -- start 2023-11-29T11:18:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 -- start start 2023-11-29T11:18:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d40cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f24d40c1330 0x7f24d40c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d40c1cd0 con 0x7f24d406b540 2023-11-29T11:18:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d40cbca0 con 0x7f24d40c1330 2023-11-29T11:18:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40b38c0 con 0x7f24d406d420 2023-11-29T11:18:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24ca7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d40cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d2ffd700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f24d406b540 0x7f24d40ad660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:46664/0 (socket says 172.21.15.81:46664) 2023-11-29T11:18:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d37fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f24d40c1330 0x7f24d40c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24ca7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d40cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:43828/0 (socket says 172.21.15.81:43828) 2023-11-29T11:18:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d2ffd700 1 -- 172.21.15.81:0/4007008375 learned_addr learned my addr 172.21.15.81:0/4007008375 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d27fc700 1 -- 172.21.15.81:0/4007008375 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900261973 0 0) 0x7f24d40c1cd0 con 0x7f24d406b540 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d27fc700 1 -- 172.21.15.81:0/4007008375 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c00035d0 con 0x7f24d406b540 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24ca7fc700 1 -- 172.21.15.81:0/4007008375 >> v2:172.21.15.176:3300/0 conn(0x7f24d40c1330 msgr2=0x7f24d40c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24ca7fc700 1 --2- 172.21.15.81:0/4007008375 >> v2:172.21.15.176:3300/0 conn(0x7f24d40c1330 0x7f24d40c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24ca7fc700 1 -- 172.21.15.81:0/4007008375 >> v1:172.21.15.176:6789/0 conn(0x7f24d406b540 legacy=0x7f24d40ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24ca7fc700 1 -- 172.21.15.81:0/4007008375 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d40cb2d0 con 0x7f24d406d420 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24ca7fc700 1 --2- 172.21.15.81:0/4007008375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d40cb760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009850 tx=0x7f24bc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d7162d8a8700ea server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d27fc700 1 -- 172.21.15.81:0/4007008375 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc011830 con 0x7f24d406d420 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d27fc700 1 -- 172.21.15.81:0/4007008375 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc011990 con 0x7f24d406d420 2023-11-29T11:18:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d27fc700 1 -- 172.21.15.81:0/4007008375 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc011d00 con 0x7f24d406d420 2023-11-29T11:18:48.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 -- 172.21.15.81:0/4007008375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 msgr2=0x7f24d40cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 --2- 172.21.15.81:0/4007008375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d40cb760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009850 tx=0x7f24bc009b60 comp rx=0 tx=0).stop 2023-11-29T11:18:48.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 -- 172.21.15.81:0/4007008375 shutdown_connections 2023-11-29T11:18:48.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 --2- 172.21.15.81:0/4007008375 >> v2:172.21.15.176:3300/0 conn(0x7f24d40c1330 0x7f24d40c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 --2- 172.21.15.81:0/4007008375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d40cb760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.450+0000 7f24d3fff700 1 -- 172.21.15.81:0/4007008375 >> 172.21.15.81:0/4007008375 conn(0x7f24d40ce360 msgr2=0x7f24d40ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 -- 172.21.15.81:0/4007008375 shutdown_connections 2023-11-29T11:18:48.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 -- 172.21.15.81:0/4007008375 wait complete. 2023-11-29T11:18:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 Processor -- start 2023-11-29T11:18:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 -- start start 2023-11-29T11:18:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406b540 0x7f24d415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d4070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40c1330 0x7f24d40707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d415dc30 con 0x7f24d406b540 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40aef40 con 0x7f24d40c1330 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41f6f80 con 0x7f24d406d420 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406b540 0x7f24d415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406b540 0x7f24d415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50858/0 (socket says 172.21.15.81:50858) 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d2ffd700 1 -- 172.21.15.81:0/397776140 learned_addr learned my addr 172.21.15.81:0/397776140 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d37fe700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40c1330 0x7f24d40707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24ca7fc700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d2ffd700 1 -- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 msgr2=0x7f24d4070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d2ffd700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d4070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d2ffd700 1 -- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40c1330 msgr2=0x7f24d40707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d2ffd700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40c1330 0x7f24d40707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24d2ffd700 1 -- 172.21.15.81:0/397776140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0094b0 con 0x7f24d406b540 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.454+0000 7f24ca7fc700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d4070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24d2ffd700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406b540 0x7f24d415a440 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c4d0 tx=0x7f24c400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24cbfff700 1 -- 172.21.15.81:0/397776140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4005de0 con 0x7f24d406b540 2023-11-29T11:18:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24cbfff700 1 -- 172.21.15.81:0/397776140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c40070d0 con 0x7f24d406b540 2023-11-29T11:18:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24cbfff700 1 -- 172.21.15.81:0/397776140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4007480 con 0x7f24d406b540 2023-11-29T11:18:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d40b3b10 con 0x7f24d406b540 2023-11-29T11:18:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d4160b50 con 0x7f24d406b540 2023-11-29T11:18:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d40b3df0 con 0x7f24d406b540 2023-11-29T11:18:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24cbfff700 1 -- 172.21.15.81:0/397776140 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f24c4019030 con 0x7f24d406b540 2023-11-29T11:18:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24cbfff700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24b4064ee0 0x7f24b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24cbfff700 1 -- 172.21.15.81:0/397776140 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f24c4081330 con 0x7f24d406b540 2023-11-29T11:18:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.458+0000 7f24ca7fc700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24b4064ee0 0x7f24b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.462+0000 7f24ca7fc700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24b4064ee0 0x7f24b4067390 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f24d406d7f0 tx=0x7f24bc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.466+0000 7f24cbfff700 1 -- 172.21.15.81:0/397776140 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f24c404f310 con 0x7f24d406b540 2023-11-29T11:18:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f24d40af2f0 con 0x7f24d406b540 2023-11-29T11:18:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24cbfff700 1 -- 172.21.15.81:0/397776140 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f24d40af2f0 con 0x7f24d406b540 2023-11-29T11:18:48.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:18:48.671 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-29T11:18:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24b4064ee0 msgr2=0x7f24b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24b4064ee0 0x7f24b4067390 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f24d406d7f0 tx=0x7f24bc008030 comp rx=0 tx=0).stop 2023-11-29T11:18:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406b540 msgr2=0x7f24d415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406b540 0x7f24d415a440 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c4d0 tx=0x7f24c400c7e0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 shutdown_connections 2023-11-29T11:18:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f24b4064ee0 0x7f24b4067390 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24d40c1330 0x7f24d40707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24d406d420 0x7f24d4070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 --2- 172.21.15.81:0/397776140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24d406b540 0x7f24d415a440 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 >> 172.21.15.81:0/397776140 conn(0x7f24d40ce360 msgr2=0x7f24d40719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 shutdown_connections 2023-11-29T11:18:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.666+0000 7f24d3fff700 1 -- 172.21.15.81:0/397776140 wait complete. 2023-11-29T11:18:48.685 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-29T11:18:48.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2023-11-29T11:18:48.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.802+0000 7fd5457fd700 1 Processor -- start 2023-11-29T11:18:48.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.802+0000 7fd5457fd700 1 -- start start 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd53804fcc0 0x7fd538006120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5380338c0 0x7fd538006660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd538052e70 con 0x7fd5380defd0 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd538053cd0 con 0x7fd53804fcc0 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5380530c0 con 0x7fd5380338c0 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd53804fcc0 0x7fd538006120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd53804fcc0 0x7fd538006120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50866/0 (socket says 172.21.15.81:50866) 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53f7fe700 1 -- 172.21.15.81:0/570443691 learned_addr learned my addr 172.21.15.81:0/570443691 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd544ffc700 1 --2- 172.21.15.81:0/570443691 >> v2:172.21.15.176:3300/0 conn(0x7fd5380338c0 0x7fd538006660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53f7fe700 1 -- 172.21.15.81:0/570443691 >> v2:172.21.15.176:3300/0 conn(0x7fd5380338c0 msgr2=0x7fd538006660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/570443691 >> v2:172.21.15.176:3300/0 conn(0x7fd5380338c0 0x7fd538006660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53f7fe700 1 -- 172.21.15.81:0/570443691 >> v1:172.21.15.176:6789/0 conn(0x7fd5380defd0 legacy=0x7fd53804f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53f7fe700 1 -- 172.21.15.81:0/570443691 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380533a0 con 0x7fd53804fcc0 2023-11-29T11:18:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/570443691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd53804fcc0 0x7fd538006120 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd538037c10 tx=0x7fd534009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f51b98adfb0a92 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53effd700 1 -- 172.21.15.81:0/570443691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534011830 con 0x7fd53804fcc0 2023-11-29T11:18:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53effd700 1 -- 172.21.15.81:0/570443691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534011990 con 0x7fd53804fcc0 2023-11-29T11:18:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd53effd700 1 -- 172.21.15.81:0/570443691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534011d20 con 0x7fd53804fcc0 2023-11-29T11:18:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 -- 172.21.15.81:0/570443691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd53804fcc0 msgr2=0x7fd538006120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 --2- 172.21.15.81:0/570443691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd53804fcc0 0x7fd538006120 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd538037c10 tx=0x7fd534009bf0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 -- 172.21.15.81:0/570443691 shutdown_connections 2023-11-29T11:18:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 --2- 172.21.15.81:0/570443691 >> v2:172.21.15.176:3300/0 conn(0x7fd5380338c0 0x7fd538006660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 --2- 172.21.15.81:0/570443691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd53804fcc0 0x7fd538006120 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 -- 172.21.15.81:0/570443691 >> 172.21.15.81:0/570443691 conn(0x7fd5380517d0 msgr2=0x7fd538051ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 -- 172.21.15.81:0/570443691 shutdown_connections 2023-11-29T11:18:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.806+0000 7fd5457fd700 1 -- 172.21.15.81:0/570443691 wait complete. 2023-11-29T11:18:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd5457fd700 1 Processor -- start 2023-11-29T11:18:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd5457fd700 1 -- start start 2023-11-29T11:18:48.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd5457fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5380338c0 0x7fd5380cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd5457fd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd53804fcc0 0x7fd538035300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd5457fd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd538036570 0x7fd5380db020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd5457fd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd538048fc0 con 0x7fd5380338c0 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd5457fd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd538036a70 con 0x7fd53804fcc0 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd5457fd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd538048900 con 0x7fd538036570 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5380338c0 0x7fd5380cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5380338c0 0x7fd5380cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50876/0 (socket says 172.21.15.81:50876) 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 -- 172.21.15.81:0/600966510 learned_addr learned my addr 172.21.15.81:0/600966510 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd53804fcc0 0x7fd538035300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd544ffc700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd538036570 0x7fd5380db020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 -- 172.21.15.81:0/600966510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd538036570 msgr2=0x7fd5380db020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd538036570 0x7fd5380db020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 -- 172.21.15.81:0/600966510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd53804fcc0 msgr2=0x7fd538035300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd53804fcc0 0x7fd538035300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 -- 172.21.15.81:0/600966510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009570 con 0x7fd5380338c0 2023-11-29T11:18:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.810+0000 7fd53ffff700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5380338c0 0x7fd5380cd270 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fd53000c500 tx=0x7fd53000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.814+0000 7fd53cff9700 1 -- 172.21.15.81:0/600966510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300052d0 con 0x7fd5380338c0 2023-11-29T11:18:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.814+0000 7fd53cff9700 1 -- 172.21.15.81:0/600966510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd530005430 con 0x7fd5380338c0 2023-11-29T11:18:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.814+0000 7fd5457fd700 1 -- 172.21.15.81:0/600966510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd538053960 con 0x7fd5380338c0 2023-11-29T11:18:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.814+0000 7fd53cff9700 1 -- 172.21.15.81:0/600966510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300055a0 con 0x7fd5380338c0 2023-11-29T11:18:48.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.814+0000 7fd5457fd700 1 -- 172.21.15.81:0/600966510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538053680 con 0x7fd5380338c0 2023-11-29T11:18:48.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.814+0000 7fd53cff9700 1 -- 172.21.15.81:0/600966510 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd530019030 con 0x7fd5380338c0 2023-11-29T11:18:48.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.814+0000 7fd53cff9700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd52c064ee0 0x7fd52c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd52c064ee0 0x7fd52c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53cff9700 1 -- 172.21.15.81:0/600966510 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fd5300812c0 con 0x7fd5380338c0 2023-11-29T11:18:48.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd52c064ee0 0x7fd52c067390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd5380500b0 tx=0x7fd534008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd549cdf740 1 Processor -- start 2023-11-29T11:18:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd549cdf740 1 -- start start 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x2303990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x23054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 0x2305a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd549cdf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2200d30 con 0x20919f0 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd549cdf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2270e20 con 0x2091dc0 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd549cdf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x226a120 con 0x20dca70 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x23054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x23054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50884/0 (socket says 172.21.15.81:50884) 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 -- 172.21.15.81:0/4231255985 learned_addr learned my addr 172.21.15.81:0/4231255985 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53ffff700 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x2303990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd544ffc700 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 0x2305a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 -- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 msgr2=0x2305a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 0x2305a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 -- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 msgr2=0x2303990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x2303990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53f7fe700 1 -- 172.21.15.81:0/4231255985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22909b0 con 0x20919f0 2023-11-29T11:18:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.818+0000 7fd53ffff700 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x2303990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:18:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x23054d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fd534011d00 tx=0x7fd534010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd130a1ea5ecb51 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd525ffb700 1 -- 172.21.15.81:0/4231255985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53401f070 con 0x20919f0 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd525ffb700 1 -- 172.21.15.81:0/4231255985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534003780 con 0x20919f0 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd525ffb700 1 -- 172.21.15.81:0/4231255985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534003b30 con 0x20919f0 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 -- 172.21.15.81:0/4231255985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 msgr2=0x23054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x23054d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fd534011d00 tx=0x7fd534010000 comp rx=0 tx=0).stop 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 -- 172.21.15.81:0/4231255985 shutdown_connections 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 0x2305a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x23054d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 --2- 172.21.15.81:0/4231255985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x2303990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 -- 172.21.15.81:0/4231255985 >> 172.21.15.81:0/4231255985 conn(0x2092190 msgr2=0x232b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 -- 172.21.15.81:0/4231255985 shutdown_connections 2023-11-29T11:18:48.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 -- 172.21.15.81:0/4231255985 wait complete. 2023-11-29T11:18:48.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 -- start start 2023-11-29T11:18:48.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.822+0000 7fd549cdf740 1 Processor -- start 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 0x230bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 0x2353c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x23080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2116e00 con 0x20dca70 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2354f00 con 0x20919f0 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2355170 con 0x2091dc0 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x23080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd53ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 0x230bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x23080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50898/0 (socket says 172.21.15.81:50898) 2023-11-29T11:18:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 -- 172.21.15.81:0/1649962839 learned_addr learned my addr 172.21.15.81:0/1649962839 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 10 client.0 _ll_register_callbacks cb 0x2263a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 0x2353c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 -- 172.21.15.81:0/1649962839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 msgr2=0x2353c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 0x2353c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 -- 172.21.15.81:0/1649962839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 msgr2=0x230bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 0x230bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 -- 172.21.15.81:0/1649962839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5380533a0 con 0x20dca70 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd544ffc700 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x23080c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fd54004ed50 tx=0x7fd5400723e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4cf295ee644369 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd51effd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd51effd700 1 -- 172.21.15.81:0/1649962839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540098070 con 0x20dca70 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd51effd700 1 -- 172.21.15.81:0/1649962839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fd540072aa0 con 0x20dca70 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 -- 172.21.15.81:0/1649962839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22631a0 con 0x20dca70 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd51effd700 1 -- 172.21.15.81:0/1649962839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd54008e040 con 0x20dca70 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 10 client.7707 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 -- 172.21.15.81:0/1649962839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x20ddcc0 con 0x20dca70 2023-11-29T11:18:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd51effd700 1 -- 172.21.15.81:0/1649962839 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22631a0 con 0x20dca70 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd51effd700 1 -- 172.21.15.81:0/1649962839 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd54009b020 con 0x20dca70 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 10 client.7707 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 10 client.7707 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 20 client.7707 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2308c50 0x235ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 4 client.7707 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd549cdf740 1 -- 172.21.15.81:0/1649962839 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2262ec0 con 0x2308c50 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd53ffff700 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2308c50 0x235ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd53ffff700 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2308c50 0x235ed20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37b224a64240880f server_cookie=8491ef747fba28b4 in_seq=0 out_seq=0 2023-11-29T11:18:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.826+0000 7fd51effd700 10 client.7707 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd51effd700 1 -- 172.21.15.81:0/1649962839 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2262ec0 con 0x2308c50 2023-11-29T11:18:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd51effd700 10 client.7707 handle_command_reply: tid=0 2023-11-29T11:18:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 client.7707 shutdown 2023-11-29T11:18:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 -- 172.21.15.81:0/1649962839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 msgr2=0x23080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x23080c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fd54004ed50 tx=0x7fd5400723e0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 -- 172.21.15.81:0/1649962839 shutdown_connections 2023-11-29T11:18:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2308c50 0x235ed20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x23080c0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 0x2353c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 --2- 172.21.15.81:0/1649962839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 0x230bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd51effd700 0 client.7707 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 -- 172.21.15.81:0/1649962839 >> 172.21.15.81:0/1649962839 conn(0x2092190 msgr2=0x232af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 -- 172.21.15.81:0/1649962839 shutdown_connections 2023-11-29T11:18:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 1 -- 172.21.15.81:0/1649962839 wait complete. 2023-11-29T11:18:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.830+0000 7fd549cdf740 20 client.7707 trim_cache size 0 max 16384 2023-11-29T11:18:48.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.842+0000 7fd549cdf740 1 Processor -- start 2023-11-29T11:18:48.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.842+0000 7fd549cdf740 1 -- start start 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x22fe410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x23037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 0x2303ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b8350 con 0x20919f0 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2267930 con 0x2091dc0 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x223e8d0 con 0x20dca70 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x22fe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x22fe410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50908/0 (socket says 172.21.15.81:50908) 2023-11-29T11:18:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 -- 172.21.15.81:0/4281979807 learned_addr learned my addr 172.21.15.81:0/4281979807 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x23037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd544ffc700 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 0x2303ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 -- 172.21.15.81:0/4281979807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 msgr2=0x2303ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 0x2303ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 -- 172.21.15.81:0/4281979807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 msgr2=0x23037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x23037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 -- 172.21.15.81:0/4281979807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53803a3e0 con 0x20919f0 2023-11-29T11:18:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd53ffff700 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x22fe410 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fd5300815f0 tx=0x7fd530052aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3082396ba90750a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd5267fc700 1 -- 172.21.15.81:0/4281979807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5300510a0 con 0x20919f0 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd5267fc700 1 -- 172.21.15.81:0/4281979807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd530051300 con 0x20919f0 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd5267fc700 1 -- 172.21.15.81:0/4281979807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53005ad60 con 0x20919f0 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- 172.21.15.81:0/4281979807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 msgr2=0x22fe410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x22fe410 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fd5300815f0 tx=0x7fd530052aa0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- 172.21.15.81:0/4281979807 shutdown_connections 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x20dca70 0x2303ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2091dc0 0x23037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 --2- 172.21.15.81:0/4281979807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20919f0 0x22fe410 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- 172.21.15.81:0/4281979807 >> 172.21.15.81:0/4281979807 conn(0x2092190 msgr2=0x22fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- 172.21.15.81:0/4281979807 shutdown_connections 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- 172.21.15.81:0/4281979807 wait complete. 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 -- start start 2023-11-29T11:18:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.846+0000 7fd549cdf740 1 Processor -- start 2023-11-29T11:18:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 0x235a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 0x23a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x2358d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x23049e0 con 0x20dca70 2023-11-29T11:18:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2296e00 con 0x20919f0 2023-11-29T11:18:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x21f4060 con 0x2091dc0 2023-11-29T11:18:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 10 client.0 _ll_register_callbacks cb 0x2234440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x2358d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x2358d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50922/0 (socket says 172.21.15.81:50922) 2023-11-29T11:18:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 -- 172.21.15.81:0/2226675741 learned_addr learned my addr 172.21.15.81:0/2226675741 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd53ffff700 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 0x235a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd53f7fe700 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 0x23a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 -- 172.21.15.81:0/2226675741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 msgr2=0x23a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 0x23a8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 -- 172.21.15.81:0/2226675741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 msgr2=0x235a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 0x235a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 -- 172.21.15.81:0/2226675741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538053680 con 0x20dca70 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd544ffc700 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x2358d20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd54004f230 tx=0x7fd5400699b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e96cc1442063eed server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd51effd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd51effd700 1 -- 172.21.15.81:0/2226675741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540098040 con 0x20dca70 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd51effd700 1 -- 172.21.15.81:0/2226675741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fd540072aa0 con 0x20dca70 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 -- 172.21.15.81:0/2226675741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd534003780 con 0x20dca70 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd51effd700 1 -- 172.21.15.81:0/2226675741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd54008e040 con 0x20dca70 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 10 client.7713 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 -- 172.21.15.81:0/2226675741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x2216bd0 con 0x20dca70 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd51effd700 1 -- 172.21.15.81:0/2226675741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534003780 con 0x20dca70 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd51effd700 1 -- 172.21.15.81:0/2226675741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd540072100 con 0x20dca70 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 10 client.7713 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 10 client.7713 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 20 client.7713 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2359260 0x23ac480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 4 client.7713 mds_command: new command op to 7461 tid=0[{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2023-11-29T11:18:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd549cdf740 1 -- 172.21.15.81:0/2226675741 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) v1 -- 0x210e540 con 0x2359260 2023-11-29T11:18:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd53ffff700 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2359260 0x23ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd51effd700 10 client.7713 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.850+0000 7fd53ffff700 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2359260 0x23ac480 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6736957d4447df3f server_cookie=bf8c4bf6296fea6d in_seq=0 out_seq=0 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd51effd700 1 -- 172.21.15.81:0/2226675741 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x210e540 con 0x2359260 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd51effd700 10 client.7713 handle_command_reply: tid=0 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 client.7713 shutdown 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 -- 172.21.15.81:0/2226675741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 msgr2=0x2358d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x2358d20 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd54004f230 tx=0x7fd5400699b0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 -- 172.21.15.81:0/2226675741 shutdown_connections 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2359260 0x23ac480 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x20dca70 0x2358d20 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2091dc0 0x23a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 --2- 172.21.15.81:0/2226675741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x20919f0 0x235a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 -- 172.21.15.81:0/2226675741 >> 172.21.15.81:0/2226675741 conn(0x2092190 msgr2=0x22fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd51effd700 0 client.7713 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 -- 172.21.15.81:0/2226675741 shutdown_connections 2023-11-29T11:18:48.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 1 -- 172.21.15.81:0/2226675741 wait complete. 2023-11-29T11:18:48.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd549cdf740 20 client.7713 trim_cache size 0 max 16384 2023-11-29T11:18:48.863 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:18:48.863 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:18:48.863 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "8cb36039-e4e4-4b4b-9ccf-51ea9981e99f", 2023-11-29T11:18:48.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:18:48.863 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:18:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 -- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd52c064ee0 msgr2=0x7fd52c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd52c064ee0 0x7fd52c067390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd5380500b0 tx=0x7fd534008030 comp rx=0 tx=0).stop 2023-11-29T11:18:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 -- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5380338c0 msgr2=0x7fd5380cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5380338c0 0x7fd5380cd270 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fd53000c500 tx=0x7fd53000c810 comp rx=0 tx=0).stop 2023-11-29T11:18:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 -- 172.21.15.81:0/600966510 shutdown_connections 2023-11-29T11:18:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd52c064ee0 0x7fd52c067390 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd538036570 0x7fd5380db020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd53804fcc0 0x7fd538035300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 --2- 172.21.15.81:0/600966510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5380338c0 0x7fd5380cd270 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 -- 172.21.15.81:0/600966510 >> 172.21.15.81:0/600966510 conn(0x7fd5380517d0 msgr2=0x7fd53804f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 -- 172.21.15.81:0/600966510 shutdown_connections 2023-11-29T11:18:48.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.854+0000 7fd5457fd700 1 -- 172.21.15.81:0/600966510 wait complete. 2023-11-29T11:18:48.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-11-29T11:18:48.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65de4c700 1 Processor -- start 2023-11-29T11:18:48.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65de4c700 1 -- start start 2023-11-29T11:18:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65de4c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6580ce230 0x7fe6580ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65de4c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 0x7fe6580cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65de4c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65806d1c0 con 0x7fe658158ee0 2023-11-29T11:18:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65de4c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65806e000 con 0x7fe6580ce230 2023-11-29T11:18:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65de4c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580ca3a0 con 0x7fe6580cd5d0 2023-11-29T11:18:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65ce4a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe658158ee0 0x7fe6580cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33344/0 (socket says 172.21.15.81:33344) 2023-11-29T11:18:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65ce4a700 1 -- 172.21.15.81:0/1736223704 learned_addr learned my addr 172.21.15.81:0/1736223704 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:18:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe657fff700 1 --2- 172.21.15.81:0/1736223704 >> v2:172.21.15.81:3300/0 conn(0x7fe6580ce230 0x7fe6580ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe65d64b700 1 --2- 172.21.15.81:0/1736223704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 0x7fe6580cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe6577fe700 1 -- 172.21.15.81:0/1736223704 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547914772 0 0) 0x7fe648001110 con 0x7fe658158ee0 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe6577fe700 1 -- 172.21.15.81:0/1736223704 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6440035d0 con 0x7fe658158ee0 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe657fff700 1 -- 172.21.15.81:0/1736223704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 msgr2=0x7fe6580cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe657fff700 1 --2- 172.21.15.81:0/1736223704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 0x7fe6580cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe657fff700 1 -- 172.21.15.81:0/1736223704 >> v1:172.21.15.81:6789/0 conn(0x7fe658158ee0 legacy=0x7fe6580cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe657fff700 1 -- 172.21.15.81:0/1736223704 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65806c920 con 0x7fe6580ce230 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe657fff700 1 --2- 172.21.15.81:0/1736223704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6580ce230 0x7fe6580ae760 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe640009de0 tx=0x7fe64000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6c7ac71030025d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe6577fe700 1 -- 172.21.15.81:0/1736223704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64000e070 con 0x7fe6580ce230 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe6577fe700 1 -- 172.21.15.81:0/1736223704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64000b910 con 0x7fe6580ce230 2023-11-29T11:18:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.986+0000 7fe6577fe700 1 -- 172.21.15.81:0/1736223704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64000bc80 con 0x7fe6580ce230 2023-11-29T11:18:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 -- 172.21.15.81:0/1736223704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6580ce230 msgr2=0x7fe6580ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1736223704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6580ce230 0x7fe6580ae760 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe640009de0 tx=0x7fe64000b330 comp rx=0 tx=0).stop 2023-11-29T11:18:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 -- 172.21.15.81:0/1736223704 shutdown_connections 2023-11-29T11:18:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1736223704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 0x7fe6580cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1736223704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6580ce230 0x7fe6580ae760 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 -- 172.21.15.81:0/1736223704 >> 172.21.15.81:0/1736223704 conn(0x7fe6580d0240 msgr2=0x7fe6580cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 -- 172.21.15.81:0/1736223704 shutdown_connections 2023-11-29T11:18:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 -- 172.21.15.81:0/1736223704 wait complete. 2023-11-29T11:18:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 Processor -- start 2023-11-29T11:18:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.990+0000 7fe65de4c700 1 -- start start 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65de4c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 0x7fe658150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65de4c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6580ce230 0x7fe658151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65de4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe658158ee0 0x7fe65814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65de4c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65814ce30 con 0x7fe658158ee0 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65de4c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65814db30 con 0x7fe6580ce230 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65de4c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65814de10 con 0x7fe6580cd5d0 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe658158ee0 0x7fe65814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65ce4a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 0x7fe658150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe658158ee0 0x7fe65814c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50954/0 (socket says 172.21.15.81:50954) 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 -- 172.21.15.81:0/1567538666 learned_addr learned my addr 172.21.15.81:0/1567538666 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe657fff700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6580ce230 0x7fe658151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 -- 172.21.15.81:0/1567538666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 msgr2=0x7fe658150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 0x7fe658150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 -- 172.21.15.81:0/1567538666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6580ce230 msgr2=0x7fe658151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6580ce230 0x7fe658151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 -- 172.21.15.81:0/1567538666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640009a70 con 0x7fe658158ee0 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65d64b700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe658158ee0 0x7fe65814c8f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe65000e7f0 tx=0x7fe65000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe6557fa700 1 -- 172.21.15.81:0/1567538666 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500095c0 con 0x7fe658158ee0 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe6557fa700 1 -- 172.21.15.81:0/1567538666 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650013680 con 0x7fe658158ee0 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe6557fa700 1 -- 172.21.15.81:0/1567538666 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650013a10 con 0x7fe658158ee0 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65de4c700 1 -- 172.21.15.81:0/1567538666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65806cee0 con 0x7fe658158ee0 2023-11-29T11:18:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.994+0000 7fe65de4c700 1 -- 172.21.15.81:0/1567538666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65806cc00 con 0x7fe658158ee0 2023-11-29T11:18:49.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.998+0000 7fe6557fa700 1 -- 172.21.15.81:0/1567538666 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe650019030 con 0x7fe658158ee0 2023-11-29T11:18:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.998+0000 7fe6557fa700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe638064ee0 0x7fe638067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.998+0000 7fe6557fa700 1 -- 172.21.15.81:0/1567538666 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fe650081e80 con 0x7fe658158ee0 2023-11-29T11:18:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.998+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe638064ee0 0x7fe638067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.998+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe638064ee0 0x7fe638067390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe648005930 tx=0x7fe648009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.998+0000 7fe662330740 1 Processor -- start 2023-11-29T11:18:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:48.998+0000 7fe662330740 1 -- start start 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709c10 0x29897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 0x2989d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x27548c0 0x298a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2878d20 con 0x27548c0 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x28e8d60 con 0x2709840 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x28e2060 con 0x2709c10 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x27548c0 0x298a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x27548c0 0x298a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50966/0 (socket says 172.21.15.81:50966) 2023-11-29T11:18:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 -- 172.21.15.81:0/3171775789 learned_addr learned my addr 172.21.15.81:0/3171775789 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709c10 0x29897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe657fff700 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 0x2989d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 -- 172.21.15.81:0/3171775789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709c10 msgr2=0x29897d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709c10 0x29897d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 -- 172.21.15.81:0/3171775789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 msgr2=0x2989d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 0x2989d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 -- 172.21.15.81:0/3171775789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29080a0 con 0x27548c0 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe65d64b700 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x27548c0 0x298a250 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fe650080290 tx=0x7fe650051bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a482492d391de3f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe64e7fc700 1 -- 172.21.15.81:0/3171775789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65005b630 con 0x27548c0 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe64e7fc700 1 -- 172.21.15.81:0/3171775789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65005b790 con 0x27548c0 2023-11-29T11:18:49.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe64e7fc700 1 -- 172.21.15.81:0/3171775789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65005b900 con 0x27548c0 2023-11-29T11:18:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- 172.21.15.81:0/3171775789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x27548c0 msgr2=0x298a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x27548c0 0x298a250 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fe650080290 tx=0x7fe650051bf0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- 172.21.15.81:0/3171775789 shutdown_connections 2023-11-29T11:18:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x27548c0 0x298a250 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 0x2989d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 --2- 172.21.15.81:0/3171775789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709c10 0x29897d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- 172.21.15.81:0/3171775789 >> 172.21.15.81:0/3171775789 conn(0x2709fe0 msgr2=0x29a2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- 172.21.15.81:0/3171775789 shutdown_connections 2023-11-29T11:18:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- 172.21.15.81:0/3171775789 wait complete. 2023-11-29T11:18:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 -- start start 2023-11-29T11:18:49.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.002+0000 7fe662330740 1 Processor -- start 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 0x2988b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x297a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x27548c0 0x29790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x278ec50 con 0x2709c10 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2978490 con 0x2709840 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2989040 con 0x27548c0 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x297a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 10 client.0 _ll_register_callbacks cb 0x28db9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x297a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50970/0 (socket says 172.21.15.81:50970) 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 -- 172.21.15.81:0/3577905726 learned_addr learned my addr 172.21.15.81:0/3577905726 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 0x2988b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe65d64b700 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x27548c0 0x29790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 -- 172.21.15.81:0/3577905726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x27548c0 msgr2=0x29790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x27548c0 0x29790a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 -- 172.21.15.81:0/3577905726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 msgr2=0x2988b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 0x2988b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 -- 172.21.15.81:0/3577905726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65806cc00 con 0x2709c10 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe657fff700 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x297a500 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe640014040 tx=0x7fe640004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7739b942807e5743 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe6377fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe6377fe700 1 -- 172.21.15.81:0/3577905726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640021070 con 0x2709c10 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe6377fe700 1 -- 172.21.15.81:0/3577905726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fe640004250 con 0x2709c10 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 -- 172.21.15.81:0/3577905726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x28db0e0 con 0x2709c10 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe6377fe700 1 -- 172.21.15.81:0/3577905726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe640004430 con 0x2709c10 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 10 client.7728 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:49.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 -- 172.21.15.81:0/3577905726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x2755b10 con 0x2709c10 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe6377fe700 1 -- 172.21.15.81:0/3577905726 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x28db0e0 con 0x2709c10 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe6377fe700 1 -- 172.21.15.81:0/3577905726 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe640004590 con 0x2709c10 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 10 client.7728 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 10 client.7728 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 20 client.7728 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x29c6c10 0x2976a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 4 client.7728 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe662330740 1 -- 172.21.15.81:0/3577905726 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28dae00 con 0x29c6c10 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x29c6c10 0x2976a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x29c6c10 0x2976a70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a717162d1d082897 server_cookie=b1c64b8bdbfd3e03 in_seq=0 out_seq=0 2023-11-29T11:18:49.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.006+0000 7fe6377fe700 10 client.7728 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:49.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe6377fe700 1 -- 172.21.15.81:0/3577905726 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x28dae00 con 0x29c6c10 2023-11-29T11:18:49.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe6377fe700 10 client.7728 handle_command_reply: tid=0 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 client.7728 shutdown 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 -- 172.21.15.81:0/3577905726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 msgr2=0x297a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x297a500 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe640014040 tx=0x7fe640004b60 comp rx=0 tx=0).stop 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 -- 172.21.15.81:0/3577905726 shutdown_connections 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x29c6c10 0x2976a70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x27548c0 0x29790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x297a500 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe6377fe700 0 client.7728 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 --2- 172.21.15.81:0/3577905726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709840 0x2988b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 -- 172.21.15.81:0/3577905726 >> 172.21.15.81:0/3577905726 conn(0x2709fe0 msgr2=0x29a2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 -- 172.21.15.81:0/3577905726 shutdown_connections 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 1 -- 172.21.15.81:0/3577905726 wait complete. 2023-11-29T11:18:49.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.010+0000 7fe662330740 20 client.7728 trim_cache size 0 max 16384 2023-11-29T11:18:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe662330740 1 Processor -- start 2023-11-29T11:18:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe662330740 1 -- start start 2023-11-29T11:18:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe662330740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709fe0 0x299e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe662330740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709840 0x299e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe662330740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x29c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe662330740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x28e9ff0 con 0x2709c10 2023-11-29T11:18:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe662330740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2978710 con 0x2709fe0 2023-11-29T11:18:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe662330740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x28db610 con 0x2709840 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe65d64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x29c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe65d64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x29c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50976/0 (socket says 172.21.15.81:50976) 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe65d64b700 1 -- 172.21.15.81:0/3363014649 learned_addr learned my addr 172.21.15.81:0/3363014649 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709fe0 0x299e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.026+0000 7fe657fff700 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709840 0x299e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65d64b700 1 -- 172.21.15.81:0/3363014649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709840 msgr2=0x299e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65d64b700 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709840 0x299e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65d64b700 1 -- 172.21.15.81:0/3363014649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709fe0 msgr2=0x299e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65d64b700 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709fe0 0x299e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65d64b700 1 -- 172.21.15.81:0/3363014649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29a36e0 con 0x2709c10 2023-11-29T11:18:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65d64b700 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x29c4ec0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe65000ee50 tx=0x7fe6500536a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e5fbe68c631687 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:49.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe64effd700 1 -- 172.21.15.81:0/3363014649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65005b630 con 0x2709c10 2023-11-29T11:18:49.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe64effd700 1 -- 172.21.15.81:0/3363014649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65004fd70 con 0x2709c10 2023-11-29T11:18:49.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe64effd700 1 -- 172.21.15.81:0/3363014649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650013db0 con 0x2709c10 2023-11-29T11:18:49.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- 172.21.15.81:0/3363014649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 msgr2=0x29c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:49.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x29c4ec0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe65000ee50 tx=0x7fe6500536a0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- 172.21.15.81:0/3363014649 shutdown_connections 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709c10 0x29c4ec0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709840 0x299e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 --2- 172.21.15.81:0/3363014649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709fe0 0x299e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- 172.21.15.81:0/3363014649 >> 172.21.15.81:0/3363014649 conn(0x298bcf0 msgr2=0x29a1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- 172.21.15.81:0/3363014649 shutdown_connections 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- 172.21.15.81:0/3363014649 wait complete. 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- start start 2023-11-29T11:18:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 Processor -- start 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709840 0x29d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709c10 0x29c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709fe0 0x2a20140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x299f5a0 con 0x2709840 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2988e90 con 0x2709c10 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x29c5840 con 0x2709fe0 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe662330740 10 client.0 _ll_register_callbacks cb 0x7fe650053820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65ce4a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709840 0x29d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65ce4a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709840 0x29d47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50982/0 (socket says 172.21.15.81:50982) 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65ce4a700 1 -- 172.21.15.81:0/2566275777 learned_addr learned my addr 172.21.15.81:0/2566275777 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe657fff700 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709c10 0x29c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65d64b700 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709fe0 0x2a20140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65ce4a700 1 -- 172.21.15.81:0/2566275777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709fe0 msgr2=0x2a20140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709fe0 0x2a20140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65ce4a700 1 -- 172.21.15.81:0/2566275777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709c10 msgr2=0x29c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709c10 0x29c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.030+0000 7fe65ce4a700 1 -- 172.21.15.81:0/2566275777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x29080a0 con 0x2709840 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe65ce4a700 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709840 0x29d47d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x2976fb0 tx=0x7fe648000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d53224be4be251 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 1 -- 172.21.15.81:0/2566275777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648028030 con 0x2709840 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 1 -- 172.21.15.81:0/2566275777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fe64801c040 con 0x2709840 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 -- 172.21.15.81:0/2566275777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe65005b790 con 0x2709840 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 1 -- 172.21.15.81:0/2566275777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe648029660 con 0x2709840 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 10 client.7734 fetch_fsmap learned FSMap version 46 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 -- 172.21.15.81:0/2566275777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x28a8970 con 0x2709840 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 1 -- 172.21.15.81:0/2566275777 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65005b790 con 0x2709840 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 1 -- 172.21.15.81:0/2566275777 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 46) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe6480297c0 con 0x2709840 2023-11-29T11:18:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 10 client.7734 fetch_fsmap finished waiting for FSMap version 46 2023-11-29T11:18:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 10 client.7734 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:18:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 20 client.7734 populate_metadata read hostname 'smithi081' 2023-11-29T11:18:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x27548c0 0x2a20700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:18:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 4 client.7734 mds_command: new command op to 7461 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:18:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 -- 172.21.15.81:0/2566275777 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2786390 con 0x27548c0 2023-11-29T11:18:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe657fff700 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x27548c0 0x2a20700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:18:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe657fff700 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x27548c0 0x2a20700 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a9682ea1480e8bf server_cookie=361e9f4b505e6923 in_seq=0 out_seq=0 2023-11-29T11:18:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 10 client.7734 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:49.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 1 -- 172.21.15.81:0/2566275777 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x2786390 con 0x27548c0 2023-11-29T11:18:49.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 10 client.7734 handle_command_reply: tid=0 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 client.7734 shutdown 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 -- 172.21.15.81:0/2566275777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709840 msgr2=0x29d47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709840 0x29d47d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x2976fb0 tx=0x7fe648000ed0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 -- 172.21.15.81:0/2566275777 shutdown_connections 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x27548c0 0x2a20700 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2709fe0 0x2a20140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2709c10 0x29c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe6377fe700 0 client.7734 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 --2- 172.21.15.81:0/2566275777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2709840 0x29d47d0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 -- 172.21.15.81:0/2566275777 >> 172.21.15.81:0/2566275777 conn(0x298bcf0 msgr2=0x2977870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 -- 172.21.15.81:0/2566275777 shutdown_connections 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 1 -- 172.21.15.81:0/2566275777 wait complete. 2023-11-29T11:18:49.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe662330740 20 client.7734 trim_cache size 0 max 16384 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "8cb36039-e4e4-4b4b-9ccf-51ea9981e99f": { 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/subdir", 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "8cb36039-e4e4-4b4b-9ccf-51ea9981e99f", 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,repair" 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:18:49.045 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:18:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe65de4c700 1 -- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe638064ee0 msgr2=0x7fe638067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe638064ee0 0x7fe638067390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe648005930 tx=0x7fe648009040 comp rx=0 tx=0).stop 2023-11-29T11:18:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe65de4c700 1 -- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe658158ee0 msgr2=0x7fe65814c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:18:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.034+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe658158ee0 0x7fe65814c8f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe65000e7f0 tx=0x7fe65000eb00 comp rx=0 tx=0).stop 2023-11-29T11:18:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.038+0000 7fe65de4c700 1 -- 172.21.15.81:0/1567538666 shutdown_connections 2023-11-29T11:18:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.038+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe638064ee0 0x7fe638067390 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.038+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe658158ee0 0x7fe65814c8f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.038+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6580ce230 0x7fe658151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.038+0000 7fe65de4c700 1 --2- 172.21.15.81:0/1567538666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6580cd5d0 0x7fe658150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:18:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.038+0000 7fe65de4c700 1 -- 172.21.15.81:0/1567538666 >> 172.21.15.81:0/1567538666 conn(0x7fe6580d0240 msgr2=0x7fe6580ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:18:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.038+0000 7fe65de4c700 1 -- 172.21.15.81:0/1567538666 shutdown_connections 2023-11-29T11:18:49.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:18:49.038+0000 7fe65de4c700 1 -- 172.21.15.81:0/1567538666 wait complete. 2023-11-29T11:18:49.058 INFO:tasks.cephfs.filesystem:scrub status for tag:8cb36039-e4e4-4b4b-9ccf-51ea9981e99f - {'path': '/subdir', 'tag': '8cb36039-e4e4-4b4b-9ccf-51ea9981e99f', 'options': 'recursive,repair'} 2023-11-29T11:18:56.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:18:56.498 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:19:19.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-11-29T11:19:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.182+0000 7f1223fff700 1 Processor -- start 2023-11-29T11:19:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.182+0000 7f1223fff700 1 -- start start 2023-11-29T11:19:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.182+0000 7f1223fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12240cc590 0x7f12240b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12240cac70 con 0x7f12240b2740 2023-11-29T11:19:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12240d0340 con 0x7f12240cfdd0 2023-11-29T11:19:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122406c8e0 con 0x7f12240cc590 2023-11-29T11:19:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f12237fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f12240b2740 0x7f12240cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50688/0 (socket says 172.21.15.81:50688) 2023-11-29T11:19:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f12237fe700 1 -- 172.21.15.81:0/1587947654 learned_addr learned my addr 172.21.15.81:0/1587947654 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1222ffd700 1 --2- 172.21.15.81:0/1587947654 >> v2:172.21.15.176:3300/0 conn(0x7f12240cc590 0x7f12240b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1221ffb700 1 -- 172.21.15.81:0/1587947654 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763492770 0 0) 0x7f12240cac70 con 0x7f12240b2740 2023-11-29T11:19:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1221ffb700 1 -- 172.21.15.81:0/1587947654 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12100035d0 con 0x7f12240b2740 2023-11-29T11:19:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1221ffb700 1 -- 172.21.15.81:0/1587947654 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446487117 0 0) 0x7f12240d0340 con 0x7f12240cfdd0 2023-11-29T11:19:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1221ffb700 1 -- 172.21.15.81:0/1587947654 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12240cac70 con 0x7f12240cfdd0 2023-11-29T11:19:19.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1222ffd700 1 -- 172.21.15.81:0/1587947654 >> v1:172.21.15.176:6789/0 conn(0x7f12240cfdd0 legacy=0x7f12240b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1222ffd700 1 -- 172.21.15.81:0/1587947654 >> v1:172.21.15.81:6789/0 conn(0x7f12240b2740 legacy=0x7f12240cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1222ffd700 1 -- 172.21.15.81:0/1587947654 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122406d1d0 con 0x7f12240cc590 2023-11-29T11:19:19.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1222ffd700 1 --2- 172.21.15.81:0/1587947654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cc590 0x7f12240b0940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1214009880 tx=0x7f1214009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60d6bbb7e022d51e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1221ffb700 1 -- 172.21.15.81:0/1587947654 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214011830 con 0x7f12240cc590 2023-11-29T11:19:19.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1221ffb700 1 -- 172.21.15.81:0/1587947654 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1214011990 con 0x7f12240cc590 2023-11-29T11:19:19.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1221ffb700 1 -- 172.21.15.81:0/1587947654 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214011d00 con 0x7f12240cc590 2023-11-29T11:19:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 -- 172.21.15.81:0/1587947654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cc590 msgr2=0x7f12240b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 --2- 172.21.15.81:0/1587947654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cc590 0x7f12240b0940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1214009880 tx=0x7f1214009b90 comp rx=0 tx=0).stop 2023-11-29T11:19:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 -- 172.21.15.81:0/1587947654 shutdown_connections 2023-11-29T11:19:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 --2- 172.21.15.81:0/1587947654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cc590 0x7f12240b0940 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 -- 172.21.15.81:0/1587947654 >> 172.21.15.81:0/1587947654 conn(0x7f12240cd0a0 msgr2=0x7f12240cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 -- 172.21.15.81:0/1587947654 shutdown_connections 2023-11-29T11:19:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.186+0000 7f1223fff700 1 -- 172.21.15.81:0/1587947654 wait complete. 2023-11-29T11:19:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f1223fff700 1 Processor -- start 2023-11-29T11:19:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f1223fff700 1 -- start start 2023-11-29T11:19:19.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f1223fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12240b2740 0x7f122414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f1223fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cfdd0 0x7f122415ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f1223fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122415f380 0x7f12240c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f1223fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12240b4080 con 0x7f122415f380 2023-11-29T11:19:19.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f1223fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12241f5d90 con 0x7f12240cfdd0 2023-11-29T11:19:19.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f1223fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12241f5180 con 0x7f12240b2740 2023-11-29T11:19:19.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f12227fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cfdd0 0x7f122415ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.190+0000 7f12237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122415f380 0x7f12240c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f1222ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12240b2740 0x7f122414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12227fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cfdd0 0x7f122415ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:41442/0 (socket says 172.21.15.81:41442) 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12227fc700 1 -- 172.21.15.81:0/3044828162 learned_addr learned my addr 172.21.15.81:0/3044828162 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12237fe700 1 -- 172.21.15.81:0/3044828162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12240b2740 msgr2=0x7f122414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12237fe700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12240b2740 0x7f122414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12237fe700 1 -- 172.21.15.81:0/3044828162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cfdd0 msgr2=0x7f122415ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12237fe700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cfdd0 0x7f122415ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12237fe700 1 -- 172.21.15.81:0/3044828162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140094b0 con 0x7f122415f380 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12227fc700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cfdd0 0x7f122415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:19.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f12237fe700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122415f380 0x7f12240c9700 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f12240680e0 tx=0x7f121c00ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f121b7fe700 1 -- 172.21.15.81:0/3044828162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0074e0 con 0x7f122415f380 2023-11-29T11:19:19.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f121b7fe700 1 -- 172.21.15.81:0/3044828162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c007640 con 0x7f122415f380 2023-11-29T11:19:19.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f121b7fe700 1 -- 172.21.15.81:0/3044828162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0079b0 con 0x7f122415f380 2023-11-29T11:19:19.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f1223fff700 1 -- 172.21.15.81:0/3044828162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12240ce520 con 0x7f122415f380 2023-11-29T11:19:19.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.194+0000 7f1223fff700 1 -- 172.21.15.81:0/3044828162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122406d4b0 con 0x7f122415f380 2023-11-29T11:19:19.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.198+0000 7f121b7fe700 1 -- 172.21.15.81:0/3044828162 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f121c019030 con 0x7f122415f380 2023-11-29T11:19:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.198+0000 7f121b7fe700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1204064ee0 0x7f1204067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.198+0000 7f1222ffd700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1204064ee0 0x7f1204067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.198+0000 7f121b7fe700 1 -- 172.21.15.81:0/3044828162 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f121c081760 con 0x7f122415f380 2023-11-29T11:19:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.198+0000 7f1222ffd700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1204064ee0 0x7f1204067390 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f12140090b0 tx=0x7f1214008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.198+0000 7f122c72a740 1 Processor -- start 2023-11-29T11:19:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- start start 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755c10 0x1a0ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a0d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17a08c0 0x1a096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x18c4d20 con 0x17a08c0 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1934d60 con 0x1755840 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x192e060 con 0x1755c10 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17a08c0 0x1a096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17a08c0 0x1a096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51674/0 (socket says 172.21.15.81:51674) 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 -- 172.21.15.81:0/3986992353 learned_addr learned my addr 172.21.15.81:0/3986992353 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f1222ffd700 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755c10 0x1a0ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12227fc700 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a0d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 -- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755c10 msgr2=0x1a0ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755c10 0x1a0ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 -- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 msgr2=0x1a0d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a0d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 -- 172.21.15.81:0/3986992353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19540a0 con 0x17a08c0 2023-11-29T11:19:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12227fc700 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a0d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f12237fe700 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17a08c0 0x1a096a0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f121c0530c0 tx=0x7f121c05b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5af0e2b38dd74b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f1218ff9700 1 -- 172.21.15.81:0/3986992353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c05b110 con 0x17a08c0 2023-11-29T11:19:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f1218ff9700 1 -- 172.21.15.81:0/3986992353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c0515c0 con 0x17a08c0 2023-11-29T11:19:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f1218ff9700 1 -- 172.21.15.81:0/3986992353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c04f3f0 con 0x17a08c0 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- 172.21.15.81:0/3986992353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17a08c0 msgr2=0x1a096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17a08c0 0x1a096a0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f121c0530c0 tx=0x7f121c05b520 comp rx=0 tx=0).stop 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- 172.21.15.81:0/3986992353 shutdown_connections 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17a08c0 0x1a096a0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a0d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 --2- 172.21.15.81:0/3986992353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755c10 0x1a0ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- 172.21.15.81:0/3986992353 >> 172.21.15.81:0/3986992353 conn(0x1755fe0 msgr2=0x19eed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- 172.21.15.81:0/3986992353 shutdown_connections 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- 172.21.15.81:0/3986992353 wait complete. 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 -- start start 2023-11-29T11:19:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.202+0000 7f122c72a740 1 Processor -- start 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755840 0x19d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 0x19e8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x17a08c0 0x19ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x17dac50 con 0x1755840 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d05e0 con 0x1755c10 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x19e8860 con 0x17a08c0 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 10 client.0 _ll_register_callbacks cb 0x19279a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755840 0x19d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755840 0x19d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51686/0 (socket says 172.21.15.81:51686) 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 -- 172.21.15.81:0/1073195572 learned_addr learned my addr 172.21.15.81:0/1073195572 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f12227fc700 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 0x19e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f12237fe700 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x17a08c0 0x19ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 -- 172.21.15.81:0/1073195572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x17a08c0 msgr2=0x19ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x17a08c0 0x19ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 -- 172.21.15.81:0/1073195572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 msgr2=0x19e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 0x19e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 -- 172.21.15.81:0/1073195572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122406d4b0 con 0x1755840 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1222ffd700 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755840 0x19d00a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f1214006bc0 tx=0x7f121400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfae997f011a486 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1201ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1201ffb700 1 -- 172.21.15.81:0/1073195572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214020070 con 0x1755840 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1201ffb700 1 -- 172.21.15.81:0/1073195572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f1214003cb0 con 0x1755840 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 -- 172.21.15.81:0/1073195572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1926e00 con 0x1755840 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1201ffb700 1 -- 172.21.15.81:0/1073195572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1214003e70 con 0x1755840 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 10 client.7746 fetch_fsmap learned FSMap version 47 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 -- 172.21.15.81:0/1073195572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x17a1b10 con 0x1755840 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1201ffb700 1 -- 172.21.15.81:0/1073195572 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1926e00 con 0x1755840 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1201ffb700 1 -- 172.21.15.81:0/1073195572 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1214030070 con 0x1755840 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 10 client.7746 fetch_fsmap finished waiting for FSMap version 47 2023-11-29T11:19:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 10 client.7746 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:19:19.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 20 client.7746 populate_metadata read hostname 'smithi081' 2023-11-29T11:19:19.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x19d2180 0x1a160e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 4 client.7746 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:19:19.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f122c72a740 1 -- 172.21.15.81:0/1073195572 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17d2390 con 0x19d2180 2023-11-29T11:19:19.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f12227fc700 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x19d2180 0x1a160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f1201ffb700 10 client.7746 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:19:19.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.206+0000 7f12227fc700 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x19d2180 0x1a160e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14ecc755b672f7fa server_cookie=ab908e29908b11ab in_seq=0 out_seq=0 2023-11-29T11:19:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f1201ffb700 1 -- 172.21.15.81:0/1073195572 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x17d2390 con 0x19d2180 2023-11-29T11:19:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f1201ffb700 10 client.7746 handle_command_reply: tid=0 2023-11-29T11:19:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 client.7746 shutdown 2023-11-29T11:19:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 -- 172.21.15.81:0/1073195572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755840 msgr2=0x19d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755840 0x19d00a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f1214006bc0 tx=0x7f121400e000 comp rx=0 tx=0).stop 2023-11-29T11:19:19.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 -- 172.21.15.81:0/1073195572 shutdown_connections 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x19d2180 0x1a160e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x17a08c0 0x19ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 0x19e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f1201ffb700 0 client.7746 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 --2- 172.21.15.81:0/1073195572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755840 0x19d00a0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 -- 172.21.15.81:0/1073195572 >> 172.21.15.81:0/1073195572 conn(0x1755fe0 msgr2=0x19e7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 -- 172.21.15.81:0/1073195572 shutdown_connections 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 1 -- 172.21.15.81:0/1073195572 wait complete. 2023-11-29T11:19:19.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.210+0000 7f122c72a740 20 client.7746 trim_cache size 0 max 16384 2023-11-29T11:19:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f122c72a740 1 Processor -- start 2023-11-29T11:19:19.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f122c72a740 1 -- start start 2023-11-29T11:19:19.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f122c72a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755fe0 0x19ee550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f122c72a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755840 0x19eea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f122c72a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 0x1a06070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f122c72a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d7f10 con 0x1755fe0 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f122c72a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x192b870 con 0x1755c10 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f122c72a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1903f70 con 0x1755840 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f1222ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755fe0 0x19ee550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f1222ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755fe0 0x19ee550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51692/0 (socket says 172.21.15.81:51692) 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f1222ffd700 1 -- 172.21.15.81:0/1487190451 learned_addr learned my addr 172.21.15.81:0/1487190451 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f12237fe700 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 0x1a06070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.226+0000 7f12227fc700 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755840 0x19eea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f1222ffd700 1 -- 172.21.15.81:0/1487190451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755840 msgr2=0x19eea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f1222ffd700 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755840 0x19eea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f1222ffd700 1 -- 172.21.15.81:0/1487190451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 msgr2=0x1a06070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f1222ffd700 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 0x1a06070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f1222ffd700 1 -- 172.21.15.81:0/1487190451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12240c9fa0 con 0x1755fe0 2023-11-29T11:19:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f1222ffd700 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755fe0 0x19ee550 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1214011630 tx=0x7f1214020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dc4eb56bf90fe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12197fa700 1 -- 172.21.15.81:0/1487190451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214039a60 con 0x1755fe0 2023-11-29T11:19:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12197fa700 1 -- 172.21.15.81:0/1487190451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121402d040 con 0x1755fe0 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12197fa700 1 -- 172.21.15.81:0/1487190451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214003ed0 con 0x1755fe0 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- 172.21.15.81:0/1487190451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755fe0 msgr2=0x19ee550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755fe0 0x19ee550 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1214011630 tx=0x7f1214020000 comp rx=0 tx=0).stop 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- 172.21.15.81:0/1487190451 shutdown_connections 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755c10 0x1a06070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755840 0x19eea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 --2- 172.21.15.81:0/1487190451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755fe0 0x19ee550 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- 172.21.15.81:0/1487190451 >> 172.21.15.81:0/1487190451 conn(0x19e8490 msgr2=0x19ebb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- 172.21.15.81:0/1487190451 shutdown_connections 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- 172.21.15.81:0/1487190451 wait complete. 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- start start 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 Processor -- start 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a6cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755c10 0x19ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755fe0 0x19caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x18c4200 con 0x1755c10 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6d450 con 0x1755840 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x19cfbe0 con 0x1755fe0 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f122c72a740 10 client.0 _ll_register_callbacks cb 0x7f121c053130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755c10 0x19ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755c10 0x19ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51700/0 (socket says 172.21.15.81:51700) 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 -- 172.21.15.81:0/3348253310 learned_addr learned my addr 172.21.15.81:0/3348253310 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f1222ffd700 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a6cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12237fe700 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755fe0 0x19caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 -- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755fe0 msgr2=0x19caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755fe0 0x19caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 -- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 msgr2=0x1a6cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a6cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 -- 172.21.15.81:0/3348253310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x17a1b10 con 0x1755c10 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12237fe700 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755fe0 0x19caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f12227fc700 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755c10 0x19ca530 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f122415eb60 tx=0x7f120c007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61574f0950b01fb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.230+0000 7f1201ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 1 -- 172.21.15.81:0/3348253310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c01a410 con 0x1755c10 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 1 -- 172.21.15.81:0/3348253310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f120c0036a0 con 0x1755c10 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 -- 172.21.15.81:0/3348253310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19270e0 con 0x1755c10 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 1 -- 172.21.15.81:0/3348253310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f120c003860 con 0x1755c10 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 10 client.7752 fetch_fsmap learned FSMap version 47 2023-11-29T11:19:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 -- 172.21.15.81:0/3348253310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x18daaf0 con 0x1755c10 2023-11-29T11:19:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 1 -- 172.21.15.81:0/3348253310 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19270e0 con 0x1755c10 2023-11-29T11:19:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 1 -- 172.21.15.81:0/3348253310 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f120c0039c0 con 0x1755c10 2023-11-29T11:19:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 10 client.7752 fetch_fsmap finished waiting for FSMap version 47 2023-11-29T11:19:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 10 client.7752 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-11-29T11:19:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 20 client.7752 populate_metadata read hostname 'smithi081' 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x17a08c0 0x1a08330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 4 client.7752 mds_command: new command op to 7461 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 -- 172.21.15.81:0/3348253310 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1763390 con 0x17a08c0 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1222ffd700 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x17a08c0 0x1a08330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 10 client.7752 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1222ffd700 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x17a08c0 0x1a08330 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f50320e36cbfb9b8 server_cookie=138318c9b997b04 in_seq=0 out_seq=0 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 1 -- 172.21.15.81:0/3348253310 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1763390 con 0x17a08c0 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 10 client.7752 handle_command_reply: tid=0 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 client.7752 shutdown 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 -- 172.21.15.81:0/3348253310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755c10 msgr2=0x19ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755c10 0x19ca530 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f122415eb60 tx=0x7f120c007e90 comp rx=0 tx=0).stop 2023-11-29T11:19:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 -- 172.21.15.81:0/3348253310 shutdown_connections 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x17a08c0 0x1a08330 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1755fe0 0x19caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1755c10 0x19ca530 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 --2- 172.21.15.81:0/3348253310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1755840 0x1a6cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1201ffb700 0 client.7752 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 -- 172.21.15.81:0/3348253310 >> 172.21.15.81:0/3348253310 conn(0x19e8490 msgr2=0x19ee550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 -- 172.21.15.81:0/3348253310 shutdown_connections 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 1 -- 172.21.15.81:0/3348253310 wait complete. 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f122c72a740 20 client.7752 trim_cache size 0 max 16384 2023-11-29T11:19:19.245 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:19:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:19:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:19:19.246 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:19:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 -- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1204064ee0 msgr2=0x7f1204067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1204064ee0 0x7f1204067390 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f12140090b0 tx=0x7f1214008030 comp rx=0 tx=0).stop 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 -- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122415f380 msgr2=0x7f12240c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122415f380 0x7f12240c9700 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f12240680e0 tx=0x7f121c00ca70 comp rx=0 tx=0).stop 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 -- 172.21.15.81:0/3044828162 shutdown_connections 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1204064ee0 0x7f1204067390 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122415f380 0x7f12240c9700 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12240cfdd0 0x7f122415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 --2- 172.21.15.81:0/3044828162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12240b2740 0x7f122414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 -- 172.21.15.81:0/3044828162 >> 172.21.15.81:0/3044828162 conn(0x7f12240cd0a0 msgr2=0x7f12240b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 -- 172.21.15.81:0/3044828162 shutdown_connections 2023-11-29T11:19:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.234+0000 7f1223fff700 1 -- 172.21.15.81:0/3044828162 wait complete. 2023-11-29T11:19:19.258 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:19:19.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 Processor -- start 2023-11-29T11:19:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 -- start start 2023-11-29T11:19:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34281606b0 0x7f34280c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34280ad610 0x7f34280c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34280cae70 con 0x7f34280ceef0 2023-11-29T11:19:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34280cbc10 con 0x7f34280ad610 2023-11-29T11:19:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280cb130 con 0x7f34281606b0 2023-11-29T11:19:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34277fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34280ad610 0x7f34280c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f341e7fc700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f34280ceef0 0x7f3428164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:47650/0 (socket says 172.21.15.81:47650) 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f341e7fc700 1 -- 172.21.15.81:0/983374504 learned_addr learned my addr 172.21.15.81:0/983374504 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3426ffd700 1 --2- 172.21.15.81:0/983374504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34281606b0 0x7f34280c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34267fc700 1 -- 172.21.15.81:0/983374504 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42887172 0 0) 0x7f34280cae70 con 0x7f34280ceef0 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34267fc700 1 -- 172.21.15.81:0/983374504 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34140035d0 con 0x7f34280ceef0 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34277fe700 1 -- 172.21.15.81:0/983374504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34281606b0 msgr2=0x7f34280c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34277fe700 1 --2- 172.21.15.81:0/983374504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34281606b0 0x7f34280c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34277fe700 1 -- 172.21.15.81:0/983374504 >> v1:172.21.15.176:6789/0 conn(0x7f34280ceef0 legacy=0x7f3428164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34277fe700 1 -- 172.21.15.81:0/983374504 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280cb410 con 0x7f34280ad610 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34277fe700 1 --2- 172.21.15.81:0/983374504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34280ad610 0x7f34280c18f0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f3420009d90 tx=0x7f342000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0be34dfcc3fe49 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34267fc700 1 -- 172.21.15.81:0/983374504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000e070 con 0x7f34280ad610 2023-11-29T11:19:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34267fc700 1 -- 172.21.15.81:0/983374504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342000bb20 con 0x7f34280ad610 2023-11-29T11:19:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f34267fc700 1 -- 172.21.15.81:0/983374504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000be90 con 0x7f34280ad610 2023-11-29T11:19:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 -- 172.21.15.81:0/983374504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34280ad610 msgr2=0x7f34280c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 --2- 172.21.15.81:0/983374504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34280ad610 0x7f34280c18f0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f3420009d90 tx=0x7f342000b330 comp rx=0 tx=0).stop 2023-11-29T11:19:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 -- 172.21.15.81:0/983374504 shutdown_connections 2023-11-29T11:19:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 --2- 172.21.15.81:0/983374504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34280ad610 0x7f34280c18f0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 --2- 172.21.15.81:0/983374504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34281606b0 0x7f34280c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.374+0000 7f3427fff700 1 -- 172.21.15.81:0/983374504 >> 172.21.15.81:0/983374504 conn(0x7f34280ce3e0 msgr2=0x7f34280ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 -- 172.21.15.81:0/983374504 shutdown_connections 2023-11-29T11:19:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 -- 172.21.15.81:0/983374504 wait complete. 2023-11-29T11:19:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 Processor -- start 2023-11-29T11:19:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 -- start start 2023-11-29T11:19:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34280ad610 0x7f342815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34280ceef0 0x7f34281f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34281606b0 0x7f342815e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280ae1f0 con 0x7f34281606b0 2023-11-29T11:19:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280ae4d0 con 0x7f34280ad610 2023-11-29T11:19:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3427fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280ae7b0 con 0x7f34280ceef0 2023-11-29T11:19:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f34277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34281606b0 0x7f342815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f34277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34281606b0 0x7f342815e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51724/0 (socket says 172.21.15.81:51724) 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f34277fe700 1 -- 172.21.15.81:0/858282768 learned_addr learned my addr 172.21.15.81:0/858282768 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f341e7fc700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34280ceef0 0x7f34281f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f3426ffd700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34280ad610 0x7f342815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f34277fe700 1 -- 172.21.15.81:0/858282768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34280ceef0 msgr2=0x7f34281f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.378+0000 7f34277fe700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34280ceef0 0x7f34281f9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f34277fe700 1 -- 172.21.15.81:0/858282768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34280ad610 msgr2=0x7f342815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f34277fe700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34280ad610 0x7f342815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f34277fe700 1 -- 172.21.15.81:0/858282768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420009a70 con 0x7f34281606b0 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f34277fe700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34281606b0 0x7f342815e260 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f3420014040 tx=0x7f3420004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f3424ff9700 1 -- 172.21.15.81:0/858282768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420007000 con 0x7f34281606b0 2023-11-29T11:19:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f3424ff9700 1 -- 172.21.15.81:0/858282768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420012650 con 0x7f34281606b0 2023-11-29T11:19:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342806ac50 con 0x7f34281606b0 2023-11-29T11:19:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f3424ff9700 1 -- 172.21.15.81:0/858282768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420012a00 con 0x7f34281606b0 2023-11-29T11:19:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280cb6f0 con 0x7f34281606b0 2023-11-29T11:19:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.382+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34280b3680 con 0x7f34281606b0 2023-11-29T11:19:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.386+0000 7f3424ff9700 1 -- 172.21.15.81:0/858282768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f342002d070 con 0x7f34281606b0 2023-11-29T11:19:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.386+0000 7f3424ff9700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3408064ee0 0x7f3408067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.386+0000 7f3424ff9700 1 -- 172.21.15.81:0/858282768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f3420083bf0 con 0x7f34281606b0 2023-11-29T11:19:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.386+0000 7f3426ffd700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3408064ee0 0x7f3408067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.386+0000 7f3426ffd700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3408064ee0 0x7f3408067390 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3418009b50 tx=0x7f3418009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.390+0000 7f3424ff9700 1 -- 172.21.15.81:0/858282768 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3420051c20 con 0x7f34281606b0 2023-11-29T11:19:19.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.590+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3428072500 con 0x7f34281606b0 2023-11-29T11:19:19.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.590+0000 7f3424ff9700 1 -- 172.21.15.81:0/858282768 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f3420055240 con 0x7f34281606b0 2023-11-29T11:19:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:19.598 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:51.075974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3408064ee0 msgr2=0x7f3408067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3408064ee0 0x7f3408067390 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3418009b50 tx=0x7f3418009240 comp rx=0 tx=0).stop 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34281606b0 msgr2=0x7f342815e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34281606b0 0x7f342815e260 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f3420014040 tx=0x7f3420004af0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 shutdown_connections 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3408064ee0 0x7f3408067390 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34281606b0 0x7f342815e260 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34280ceef0 0x7f34281f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 --2- 172.21.15.81:0/858282768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34280ad610 0x7f342815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 >> 172.21.15.81:0/858282768 conn(0x7f34280ce3e0 msgr2=0x7f342806bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 shutdown_connections 2023-11-29T11:19:19.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.594+0000 7f3427fff700 1 -- 172.21.15.81:0/858282768 wait complete. 2023-11-29T11:19:19.601 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 47 2023-11-29T11:19:19.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2023-11-29T11:19:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.722+0000 7f0a2150b700 1 Processor -- start 2023-11-29T11:19:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.722+0000 7f0a2150b700 1 -- start start 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.722+0000 7f0a2150b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a1c0b1300 0x7f0a1c0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.722+0000 7f0a2150b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0a1c0cd000 0x7f0a1c0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c15a370 con 0x7f0a1c159fa0 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c0b3bb0 con 0x7f0a1c0b1300 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c0cf770 con 0x7f0a1c0cd000 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a1c0b1300 0x7f0a1c0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0a1c159fa0 0x7f0a1c0b34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60692/0 (socket says 172.21.15.81:60692) 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1bfff700 1 -- 172.21.15.81:0/3115306474 learned_addr learned my addr 172.21.15.81:0/3115306474 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/3115306474 >> v2:172.21.15.176:3300/0 conn(0x7f0a1c0cd000 0x7f0a1c0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1b7fe700 1 -- 172.21.15.81:0/3115306474 >> v2:172.21.15.176:3300/0 conn(0x7f0a1c0cd000 msgr2=0x7f0a1c0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/3115306474 >> v2:172.21.15.176:3300/0 conn(0x7f0a1c0cd000 0x7f0a1c0cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1b7fe700 1 -- 172.21.15.81:0/3115306474 >> v1:172.21.15.81:6789/0 conn(0x7f0a1c159fa0 legacy=0x7f0a1c0b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1b7fe700 1 -- 172.21.15.81:0/3115306474 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c0cd9a0 con 0x7f0a1c0b1300 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/3115306474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c0b1300 0x7f0a1c0cf230 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0cdcd0 tx=0x7f0a0c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1144cf1d341fe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1affd700 1 -- 172.21.15.81:0/3115306474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011830 con 0x7f0a1c0b1300 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1affd700 1 -- 172.21.15.81:0/3115306474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c011990 con 0x7f0a1c0b1300 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a1affd700 1 -- 172.21.15.81:0/3115306474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011d20 con 0x7f0a1c0b1300 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 -- 172.21.15.81:0/3115306474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c0b1300 msgr2=0x7f0a1c0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 --2- 172.21.15.81:0/3115306474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c0b1300 0x7f0a1c0cf230 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0cdcd0 tx=0x7f0a0c009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 -- 172.21.15.81:0/3115306474 shutdown_connections 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 --2- 172.21.15.81:0/3115306474 >> v2:172.21.15.176:3300/0 conn(0x7f0a1c0cd000 0x7f0a1c0cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 --2- 172.21.15.81:0/3115306474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c0b1300 0x7f0a1c0cf230 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 -- 172.21.15.81:0/3115306474 >> 172.21.15.81:0/3115306474 conn(0x7f0a1c0b2180 msgr2=0x7f0a1c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 -- 172.21.15.81:0/3115306474 shutdown_connections 2023-11-29T11:19:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 -- 172.21.15.81:0/3115306474 wait complete. 2023-11-29T11:19:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.726+0000 7f0a2150b700 1 Processor -- start 2023-11-29T11:19:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 -- start start 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0cd000 0x7f0a1c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c159fa0 0x7f0a1c1ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c1f2d60 0x7f0a1c0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c8aa0 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c8770 con 0x7f0a1c159fa0 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c1f0030 con 0x7f0a1c0cd000 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c1f2d60 0x7f0a1c0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c1f2d60 0x7f0a1c0c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51544/0 (socket says 172.21.15.81:51544) 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 -- 172.21.15.81:0/1623984990 learned_addr learned my addr 172.21.15.81:0/1623984990 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c159fa0 0x7f0a1c1ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0cd000 0x7f0a1c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 -- 172.21.15.81:0/1623984990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0cd000 msgr2=0x7f0a1c155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0cd000 0x7f0a1c155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 -- 172.21.15.81:0/1623984990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c159fa0 msgr2=0x7f0a1c1ef720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c159fa0 0x7f0a1c1ef720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 -- 172.21.15.81:0/1623984990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c0094b0 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c1f2d60 0x7f0a1c0c8f30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f0a14007e40 tx=0x7f0a1400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a18ff9700 1 -- 172.21.15.81:0/1623984990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400ed30 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a18ff9700 1 -- 172.21.15.81:0/1623984990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14014420 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 -- 172.21.15.81:0/1623984990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c0d0250 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a18ff9700 1 -- 172.21.15.81:0/1623984990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a140147d0 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.730+0000 7f0a2150b700 1 -- 172.21.15.81:0/1623984990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c0cff70 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.734+0000 7f0a18ff9700 1 -- 172.21.15.81:0/1623984990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0a14012050 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.734+0000 7f0a18ff9700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a08064f10 0x7f0a080673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.734+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a08064f10 0x7f0a080673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.734+0000 7f0a18ff9700 1 -- 172.21.15.81:0/1623984990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f0a14082660 con 0x7f0a1c1f2d60 2023-11-29T11:19:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a08064f10 0x7f0a080673c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0a10005930 tx=0x7f0a10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 Processor -- start 2023-11-29T11:19:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- start start 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 0x2714880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 0x273d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x273d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2611dc0 con 0x24ed9d0 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2681e20 con 0x24a2d20 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x267b120 con 0x24a2950 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x273d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x273d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51552/0 (socket says 172.21.15.81:51552) 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 -- 172.21.15.81:0/1325124859 learned_addr learned my addr 172.21.15.81:0/1325124859 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 0x273d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 0x2714880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 -- 172.21.15.81:0/1325124859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 msgr2=0x273d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 0x273d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 -- 172.21.15.81:0/1325124859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 msgr2=0x2714880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 0x2714880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 -- 172.21.15.81:0/1325124859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26a19b0 con 0x24ed9d0 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x273d5b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f0a14053f10 tx=0x7f0a1405c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c078a8bde13d1531 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a01ffb700 1 -- 172.21.15.81:0/1325124859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1405c010 con 0x24ed9d0 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a01ffb700 1 -- 172.21.15.81:0/1325124859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14052410 con 0x24ed9d0 2023-11-29T11:19:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a01ffb700 1 -- 172.21.15.81:0/1325124859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14050200 con 0x24ed9d0 2023-11-29T11:19:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- 172.21.15.81:0/1325124859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 msgr2=0x273d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x273d5b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f0a14053f10 tx=0x7f0a1405c320 comp rx=0 tx=0).stop 2023-11-29T11:19:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- 172.21.15.81:0/1325124859 shutdown_connections 2023-11-29T11:19:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x273d5b0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 0x273d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 --2- 172.21.15.81:0/1325124859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 0x2714880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- 172.21.15.81:0/1325124859 >> 172.21.15.81:0/1325124859 conn(0x24a30f0 msgr2=0x273be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- 172.21.15.81:0/1325124859 shutdown_connections 2023-11-29T11:19:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.738+0000 7f0a259ed740 1 -- 172.21.15.81:0/1325124859 wait complete. 2023-11-29T11:19:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 -- start start 2023-11-29T11:19:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 Processor -- start 2023-11-29T11:19:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x2766630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x2736350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x273d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2527d60 con 0x24a2950 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2765f30 con 0x24ed9d0 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x275d0a0 con 0x24a2d20 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 10 client.0 _ll_register_callbacks cb 0x2674a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x2766630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x2766630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51560/0 (socket says 172.21.15.81:51560) 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 -- 172.21.15.81:0/312807515 learned_addr learned my addr 172.21.15.81:0/312807515 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x273d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x2736350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 -- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 msgr2=0x2736350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x2736350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 -- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 msgr2=0x273d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x273d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 -- 172.21.15.81:0/312807515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c0cff70 con 0x24a2950 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x273d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x2736350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x2766630 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f0a10010010 tx=0x7f0a100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0300667012b50b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f09faffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f09faffd700 1 -- 172.21.15.81:0/312807515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10014ca0 con 0x24a2950 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f09faffd700 1 -- 172.21.15.81:0/312807515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f0a1001c040 con 0x24a2950 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 -- 172.21.15.81:0/312807515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2673ec0 con 0x24a2950 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f09faffd700 1 -- 172.21.15.81:0/312807515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a10014e00 con 0x24a2950 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 10 client.7773 fetch_fsmap learned FSMap version 47 2023-11-29T11:19:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f0a259ed740 1 -- 172.21.15.81:0/312807515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x24eec20 con 0x24a2950 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.742+0000 7f09faffd700 1 -- 172.21.15.81:0/312807515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2673ec0 con 0x24a2950 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f09faffd700 1 -- 172.21.15.81:0/312807515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f0a1002a3f0 con 0x24a2950 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 10 client.7773 fetch_fsmap finished waiting for FSMap version 47 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 10 client.7773 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 20 client.7773 populate_metadata read hostname 'smithi081' 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2764b30 0x2770fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 4 client.7773 mds_command: new command op to 7461 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 -- 172.21.15.81:0/312807515 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x251f4a0 con 0x2764b30 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2764b30 0x2770fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f09faffd700 10 client.7773 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2764b30 0x2770fa0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2973fa1654803a2d server_cookie=96a3a1a6470753b1 in_seq=0 out_seq=0 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f09faffd700 1 -- 172.21.15.81:0/312807515 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x251f4a0 con 0x2764b30 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f09faffd700 10 client.7773 handle_command_reply: tid=0 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 client.7773 shutdown 2023-11-29T11:19:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 -- 172.21.15.81:0/312807515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 msgr2=0x2766630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x2766630 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f0a10010010 tx=0x7f0a100058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 -- 172.21.15.81:0/312807515 shutdown_connections 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x2764b30 0x2770fa0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x273d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x2736350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 --2- 172.21.15.81:0/312807515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x2766630 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 -- 172.21.15.81:0/312807515 >> 172.21.15.81:0/312807515 conn(0x24a30f0 msgr2=0x273bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f09faffd700 0 client.7773 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 -- 172.21.15.81:0/312807515 shutdown_connections 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 1 -- 172.21.15.81:0/312807515 wait complete. 2023-11-29T11:19:19.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.746+0000 7f0a259ed740 20 client.7773 trim_cache size 0 max 16384 2023-11-29T11:19:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 Processor -- start 2023-11-29T11:19:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- start start 2023-11-29T11:19:19.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x27156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x27354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x2735a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x27368f0 con 0x24a2950 2023-11-29T11:19:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x267dc80 con 0x24ed9d0 2023-11-29T11:19:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x267f120 con 0x24a2d20 2023-11-29T11:19:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x27156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x27156a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51562/0 (socket says 172.21.15.81:51562) 2023-11-29T11:19:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 -- 172.21.15.81:0/716687236 learned_addr learned my addr 172.21.15.81:0/716687236 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x2735a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x27354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 -- 172.21.15.81:0/716687236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 msgr2=0x27354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x27354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 -- 172.21.15.81:0/716687236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 msgr2=0x2735a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x2735a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 -- 172.21.15.81:0/716687236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c0b07e0 con 0x24a2950 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x27156a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000fd70 tx=0x7f0a10018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c121262bca30c99 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a027fc700 1 -- 172.21.15.81:0/716687236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100148e0 con 0x24a2950 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a027fc700 1 -- 172.21.15.81:0/716687236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1002ab90 con 0x24a2950 2023-11-29T11:19:19.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a027fc700 1 -- 172.21.15.81:0/716687236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10014ea0 con 0x24a2950 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- 172.21.15.81:0/716687236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 msgr2=0x27156a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x27156a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000fd70 tx=0x7f0a10018000 comp rx=0 tx=0).stop 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- 172.21.15.81:0/716687236 shutdown_connections 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24ed9d0 0x2735a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2d20 0x27354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 --2- 172.21.15.81:0/716687236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24a2950 0x27156a0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- 172.21.15.81:0/716687236 >> 172.21.15.81:0/716687236 conn(0x24a30f0 msgr2=0x273bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- 172.21.15.81:0/716687236 shutdown_connections 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.762+0000 7f0a259ed740 1 -- 172.21.15.81:0/716687236 wait complete. 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 -- start start 2023-11-29T11:19:19.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 Processor -- start 2023-11-29T11:19:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 0x27bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 0x2735840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x27344b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x26830b0 con 0x24ed9d0 2023-11-29T11:19:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2676a90 con 0x24a2d20 2023-11-29T11:19:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2679fb0 con 0x24a2950 2023-11-29T11:19:19.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 10 client.0 _ll_register_callbacks cb 0x7f0a14050550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x27344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x27344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51564/0 (socket says 172.21.15.81:51564) 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 -- 172.21.15.81:0/2394965033 learned_addr learned my addr 172.21.15.81:0/2394965033 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 0x27bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a1b7fe700 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 0x2735840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 -- 172.21.15.81:0/2394965033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 msgr2=0x27bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 0x27bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 -- 172.21.15.81:0/2394965033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 msgr2=0x2735840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 0x2735840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 -- 172.21.15.81:0/2394965033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x24eec20 con 0x24ed9d0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a20d0a700 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x27344b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0a14050710 tx=0x7f0a14016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ad2c7ce3d4e312 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f09faffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f09faffd700 1 -- 172.21.15.81:0/2394965033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14060070 con 0x24ed9d0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f09faffd700 1 -- 172.21.15.81:0/2394965033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f0a14050210 con 0x24ed9d0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 -- 172.21.15.81:0/2394965033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x26741a0 con 0x24ed9d0 2023-11-29T11:19:19.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f09faffd700 1 -- 172.21.15.81:0/2394965033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a14052410 con 0x24ed9d0 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 10 client.7779 fetch_fsmap learned FSMap version 47 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 -- 172.21.15.81:0/2394965033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x2627b90 con 0x24ed9d0 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f09faffd700 1 -- 172.21.15.81:0/2394965033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x26741a0 con 0x24ed9d0 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f09faffd700 1 -- 172.21.15.81:0/2394965033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 47) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f0a1406b170 con 0x24ed9d0 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 10 client.7779 fetch_fsmap finished waiting for FSMap version 47 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 10 client.7779 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 20 client.7779 populate_metadata read hostname 'smithi081' 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x27349f0 0x2761ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 4 client.7779 mds_command: new command op to 7461 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a259ed740 1 -- 172.21.15.81:0/2394965033 --> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x24b04a0 con 0x27349f0 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.766+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x27349f0 0x2761ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f09faffd700 10 client.7779 ms_handle_connect on v2:172.21.15.81:6836/1678973589 2023-11-29T11:19:19.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a1bfff700 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x27349f0 0x2761ef0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cecafa6224cfeaef server_cookie=924e983882a158b in_seq=0 out_seq=0 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f09faffd700 1 -- 172.21.15.81:0/2394965033 <== mds.0 v2:172.21.15.81:6836/1678973589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x24b04a0 con 0x27349f0 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f09faffd700 10 client.7779 handle_command_reply: tid=0 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 client.7779 shutdown 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 -- 172.21.15.81:0/2394965033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 msgr2=0x27344b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x27344b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0a14050710 tx=0x7f0a14016070 comp rx=0 tx=0).stop 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 -- 172.21.15.81:0/2394965033 shutdown_connections 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.81:6836/1678973589,v1:172.21.15.81:6837/1678973589] conn(0x27349f0 0x2761ef0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x24ed9d0 0x27344b0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f09faffd700 0 client.7779 ms_handle_reset on v2:172.21.15.81:6836/1678973589 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x24a2d20 0x2735840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 --2- 172.21.15.81:0/2394965033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x24a2950 0x27bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 -- 172.21.15.81:0/2394965033 >> 172.21.15.81:0/2394965033 conn(0x24a30f0 msgr2=0x273c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 -- 172.21.15.81:0/2394965033 shutdown_connections 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 1 -- 172.21.15.81:0/2394965033 wait complete. 2023-11-29T11:19:19.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a259ed740 20 client.7779 trim_cache size 0 max 16384 2023-11-29T11:19:19.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:19.780 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 -- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a08064f10 msgr2=0x7f0a080673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a08064f10 0x7f0a080673c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0a10005930 tx=0x7f0a10009040 comp rx=0 tx=0).stop 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 -- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c1f2d60 msgr2=0x7f0a1c0c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c1f2d60 0x7f0a1c0c8f30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f0a14007e40 tx=0x7f0a1400e3c0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 -- 172.21.15.81:0/1623984990 shutdown_connections 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a08064f10 0x7f0a080673c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c1f2d60 0x7f0a1c0c8f30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c159fa0 0x7f0a1c1ef720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 --2- 172.21.15.81:0/1623984990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0cd000 0x7f0a1c155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 -- 172.21.15.81:0/1623984990 >> 172.21.15.81:0/1623984990 conn(0x7f0a1c0b2180 msgr2=0x7f0a1c0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 -- 172.21.15.81:0/1623984990 shutdown_connections 2023-11-29T11:19:19.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.770+0000 7f0a2150b700 1 -- 172.21.15.81:0/1623984990 wait complete. 2023-11-29T11:19:19.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-29T11:19:19.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f207404e700 1 Processor -- start 2023-11-29T11:19:19.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f207404e700 1 -- start start 2023-11-29T11:19:19.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f207404e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f206c06b1f0 0x7f206c0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f207404e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f207404e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f206c15c8c0 0x7f206c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f207404e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c156e30 con 0x7f206c15c8c0 2023-11-29T11:19:19.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f207404e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c160860 con 0x7f206c06b1f0 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f207404e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0708a0 con 0x7f206c15feb0 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f206c15c8c0 0x7f206c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f206c15c8c0 0x7f206c15cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51572/0 (socket says 172.21.15.81:51572) 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 -- 172.21.15.81:0/3321685554 learned_addr learned my addr 172.21.15.81:0/3321685554 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20715e9700 1 --2- 172.21.15.81:0/3321685554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f2071dea700 1 --2- 172.21.15.81:0/3321685554 >> v2:172.21.15.176:3300/0 conn(0x7f206c06b1f0 0x7f206c0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 -- 172.21.15.81:0/3321685554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 msgr2=0x7f206c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 --2- 172.21.15.81:0/3321685554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 -- 172.21.15.81:0/3321685554 >> v2:172.21.15.176:3300/0 conn(0x7f206c06b1f0 msgr2=0x7f206c0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 --2- 172.21.15.81:0/3321685554 >> v2:172.21.15.176:3300/0 conn(0x7f206c06b1f0 0x7f206c0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 -- 172.21.15.81:0/3321685554 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c06b5c0 con 0x7f206c15c8c0 2023-11-29T11:19:19.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f20725eb700 1 --2- 172.21.15.81:0/3321685554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c15c8c0 0x7f206c15cd40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f206c0cf700 tx=0x7f206400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dc359a9916449a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f2070de8700 1 -- 172.21.15.81:0/3321685554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400e070 con 0x7f206c15c8c0 2023-11-29T11:19:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f2070de8700 1 -- 172.21.15.81:0/3321685554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206400b980 con 0x7f206c15c8c0 2023-11-29T11:19:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.898+0000 7f2070de8700 1 -- 172.21.15.81:0/3321685554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400bd30 con 0x7f206c15c8c0 2023-11-29T11:19:19.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 -- 172.21.15.81:0/3321685554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c15c8c0 msgr2=0x7f206c15cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 --2- 172.21.15.81:0/3321685554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c15c8c0 0x7f206c15cd40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f206c0cf700 tx=0x7f206400b330 comp rx=0 tx=0).stop 2023-11-29T11:19:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 -- 172.21.15.81:0/3321685554 shutdown_connections 2023-11-29T11:19:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 --2- 172.21.15.81:0/3321685554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 --2- 172.21.15.81:0/3321685554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c15c8c0 0x7f206c15cd40 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 --2- 172.21.15.81:0/3321685554 >> v2:172.21.15.176:3300/0 conn(0x7f206c06b1f0 0x7f206c0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 -- 172.21.15.81:0/3321685554 >> 172.21.15.81:0/3321685554 conn(0x7f206c06caf0 msgr2=0x7f206c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 -- 172.21.15.81:0/3321685554 shutdown_connections 2023-11-29T11:19:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.902+0000 7f207404e700 1 -- 172.21.15.81:0/3321685554 wait complete. 2023-11-29T11:19:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 Processor -- start 2023-11-29T11:19:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 -- start start 2023-11-29T11:19:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c06b1f0 0x7f206c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c15c8c0 0x7f206c0c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c13e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c13dca0 con 0x7f206c06b1f0 2023-11-29T11:19:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0b37a0 con 0x7f206c15c8c0 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0b3a80 con 0x7f206c15feb0 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c06b1f0 0x7f206c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c06b1f0 0x7f206c0c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51576/0 (socket says 172.21.15.81:51576) 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 -- 172.21.15.81:0/511822999 learned_addr learned my addr 172.21.15.81:0/511822999 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f20715e9700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c15c8c0 0x7f206c0c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f20725eb700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c13e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 -- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 msgr2=0x7f206c13e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c13e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 -- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c15c8c0 msgr2=0x7f206c0c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c15c8c0 0x7f206c0c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 -- 172.21.15.81:0/511822999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2064009b30 con 0x7f206c06b1f0 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f20725eb700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c13e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f2071dea700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c06b1f0 0x7f206c0c7c90 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f206800e810 tx=0x7f206800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f205e7fc700 1 -- 172.21.15.81:0/511822999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068013610 con 0x7f206c06b1f0 2023-11-29T11:19:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f205e7fc700 1 -- 172.21.15.81:0/511822999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2068013790 con 0x7f206c06b1f0 2023-11-29T11:19:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f205e7fc700 1 -- 172.21.15.81:0/511822999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068013b40 con 0x7f206c06b1f0 2023-11-29T11:19:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c070dd0 con 0x7f206c06b1f0 2023-11-29T11:19:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.906+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c070af0 con 0x7f206c06b1f0 2023-11-29T11:19:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.910+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c0710b0 con 0x7f206c06b1f0 2023-11-29T11:19:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.910+0000 7f205e7fc700 1 -- 172.21.15.81:0/511822999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2068023070 con 0x7f206c06b1f0 2023-11-29T11:19:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.910+0000 7f205e7fc700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2050064ee0 0x7f2050067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.910+0000 7f20715e9700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2050064ee0 0x7f2050067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.910+0000 7f205e7fc700 1 -- 172.21.15.81:0/511822999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f2068081cc0 con 0x7f206c06b1f0 2023-11-29T11:19:19.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.910+0000 7f20715e9700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2050064ee0 0x7f2050067390 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f206c06e3b0 tx=0x7f2060008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:19.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:19.914+0000 7f205e7fc700 1 -- 172.21.15.81:0/511822999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f206804fbb0 con 0x7f206c06b1f0 2023-11-29T11:19:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.110+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f206c072500 con 0x7f206c06b1f0 2023-11-29T11:19:20.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.110+0000 7f205e7fc700 1 -- 172.21.15.81:0/511822999 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2068009460 con 0x7f206c06b1f0 2023-11-29T11:19:20.117 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:20.117 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2050064ee0 msgr2=0x7f2050067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2050064ee0 0x7f2050067390 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f206c06e3b0 tx=0x7f2060008040 comp rx=0 tx=0).stop 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c06b1f0 msgr2=0x7f206c0c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c06b1f0 0x7f206c0c7c90 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f206800e810 tx=0x7f206800eb20 comp rx=0 tx=0).stop 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 shutdown_connections 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2050064ee0 0x7f2050067390 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f206c15feb0 0x7f206c13e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f206c15c8c0 0x7f206c0c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 --2- 172.21.15.81:0/511822999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f206c06b1f0 0x7f206c0c7c90 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 >> 172.21.15.81:0/511822999 conn(0x7f206c06caf0 msgr2=0x7f206c15cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 shutdown_connections 2023-11-29T11:19:20.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.114+0000 7f207404e700 1 -- 172.21.15.81:0/511822999 wait complete. 2023-11-29T11:19:20.136 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-29T11:19:20.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:19:20.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa877fff700 1 Processor -- start 2023-11-29T11:19:20.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa877fff700 1 -- start start 2023-11-29T11:19:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa877fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8780ceef0 0x7fa87806a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa877fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8780cae70 con 0x7fa8781606b0 2023-11-29T11:19:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa877fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8780cbc10 con 0x7fa8780c1ac0 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa877fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780cb130 con 0x7fa8780ceef0 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa876ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa8781606b0 0x7fa8780c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60696/0 (socket says 172.21.15.81:60696) 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa876ffd700 1 -- 172.21.15.81:0/2629937264 learned_addr learned my addr 172.21.15.81:0/2629937264 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa8777fe700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8780ceef0 0x7fa87806a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926935460 0 0) 0x7fa8780cae70 con 0x7fa8781606b0 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8580035d0 con 0x7fa8781606b0 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3888224626 0 0) 0x7fa8580035d0 con 0x7fa8781606b0 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8780ceef0 msgr2=0x7fa87806a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8780ceef0 0x7fa87806a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 >> v1:172.21.15.176:6789/0 conn(0x7fa8780c1ac0 legacy=0x7fa878069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780cb410 con 0x7fa8781606b0 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fa8600019f0 con 0x7fa8781606b0 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 >> v1:172.21.15.81:6789/0 conn(0x7fa8781606b0 legacy=0x7fa8780c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa858003a50 0x7fa858003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8780ceef0 0x7fa858004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa858004db0 0x7fa858005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780cb130 con 0x7fa858004db0 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85800ba30 con 0x7fa858003a50 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85800bbc0 con 0x7fa8780ceef0 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa8777fe700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa858004db0 0x7fa858005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa876ffd700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa858003a50 0x7fa858003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa8767fc700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8780ceef0 0x7fa858004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa8777fe700 1 -- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8780ceef0 msgr2=0x7fa858004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa8777fe700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8780ceef0 0x7fa858004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa8777fe700 1 -- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa858003a50 msgr2=0x7fa858003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa8777fe700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa858003a50 0x7fa858003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.242+0000 7fa8777fe700 1 -- 172.21.15.81:0/2629937264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580035d0 con 0x7fa858004db0 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa8777fe700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa858004db0 0x7fa858005220 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fa870009b70 tx=0x7fa8580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d127125776d986 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000e6c0 con 0x7fa858004db0 2023-11-29T11:19:20.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87000e820 con 0x7fa858004db0 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa875ffb700 1 -- 172.21.15.81:0/2629937264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000eb90 con 0x7fa858004db0 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa877fff700 1 -- 172.21.15.81:0/2629937264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa858004db0 msgr2=0x7fa858005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa877fff700 1 --2- 172.21.15.81:0/2629937264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa858004db0 0x7fa858005220 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fa870009b70 tx=0x7fa8580058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa8777fe700 1 -- 172.21.15.81:0/2629937264 reap_dead start 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa877fff700 1 -- 172.21.15.81:0/2629937264 shutdown_connections 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa877fff700 1 -- 172.21.15.81:0/2629937264 >> 172.21.15.81:0/2629937264 conn(0x7fa8780ce3e0 msgr2=0x7fa8780ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa877fff700 1 -- 172.21.15.81:0/2629937264 shutdown_connections 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.246+0000 7fa877fff700 1 -- 172.21.15.81:0/2629937264 wait complete. 2023-11-29T11:19:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 Processor -- start 2023-11-29T11:19:20.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 -- start start 2023-11-29T11:19:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878147ce0 0x7fa87815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa878145290 0x7fa878159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8781480b0 0x7fa878148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8781f58e0 con 0x7fa878147ce0 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780af440 con 0x7fa8781480b0 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780af720 con 0x7fa878145290 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878147ce0 0x7fa87815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878147ce0 0x7fa87815bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51582/0 (socket says 172.21.15.81:51582) 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 -- 172.21.15.81:0/2970752282 learned_addr learned my addr 172.21.15.81:0/2970752282 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa8767fc700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa878145290 0x7fa878159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 -- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa878145290 msgr2=0x7fa878159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa8777fe700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8781480b0 0x7fa878148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa878145290 0x7fa878159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 -- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8781480b0 msgr2=0x7fa878148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8781480b0 0x7fa878148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 -- 172.21.15.81:0/2970752282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780b36c0 con 0x7fa878147ce0 2023-11-29T11:19:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa8777fe700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8781480b0 0x7fa878148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:19:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa876ffd700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878147ce0 0x7fa87815bb00 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fa860004c70 tx=0x7fa860001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa86f7fe700 1 -- 172.21.15.81:0/2970752282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860008a90 con 0x7fa878147ce0 2023-11-29T11:19:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa86f7fe700 1 -- 172.21.15.81:0/2970752282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8600143f0 con 0x7fa878147ce0 2023-11-29T11:19:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8780cb6f0 con 0x7fa878147ce0 2023-11-29T11:19:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa86f7fe700 1 -- 172.21.15.81:0/2970752282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600147a0 con 0x7fa878147ce0 2023-11-29T11:19:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8780ad610 con 0x7fa878147ce0 2023-11-29T11:19:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.250+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa878072500 con 0x7fa878147ce0 2023-11-29T11:19:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.254+0000 7fa86f7fe700 1 -- 172.21.15.81:0/2970752282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa860014900 con 0x7fa878147ce0 2023-11-29T11:19:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.254+0000 7fa86f7fe700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa85c064f10 0x7fa85c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.254+0000 7fa86f7fe700 1 -- 172.21.15.81:0/2970752282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fa860083550 con 0x7fa878147ce0 2023-11-29T11:19:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.254+0000 7fa8767fc700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa85c064f10 0x7fa85c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:20.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.254+0000 7fa8767fc700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa85c064f10 0x7fa85c0673c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa8780b8a60 tx=0x7fa868009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:20.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.258+0000 7fa86f7fe700 1 -- 172.21.15.81:0/2970752282 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa8600515d0 con 0x7fa878147ce0 2023-11-29T11:19:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa8780714a0 con 0x7fa878147ce0 2023-11-29T11:19:20.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa86f7fe700 1 -- 172.21.15.81:0/2970752282 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa860054bf0 con 0x7fa878147ce0 2023-11-29T11:19:20.463 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa85c064f10 msgr2=0x7fa85c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa85c064f10 0x7fa85c0673c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa8780b8a60 tx=0x7fa868009040 comp rx=0 tx=0).stop 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878147ce0 msgr2=0x7fa87815bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878147ce0 0x7fa87815bb00 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fa860004c70 tx=0x7fa860001e60 comp rx=0 tx=0).stop 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 shutdown_connections 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa85c064f10 0x7fa85c0673c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8781480b0 0x7fa878148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa878145290 0x7fa878159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 --2- 172.21.15.81:0/2970752282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878147ce0 0x7fa87815bb00 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 >> 172.21.15.81:0/2970752282 conn(0x7fa8780ce3e0 msgr2=0x7fa878070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 shutdown_connections 2023-11-29T11:19:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:20.458+0000 7fa877fff700 1 -- 172.21.15.81:0/2970752282 wait complete. 2023-11-29T11:19:20.478 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:19:20.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:19:20.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:19:20.478 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:19:20.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:20.478 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:19:20.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:19:20.479 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:19:20.479 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:19:20.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:20.479 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:19:20.487 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:20.488 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:20.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:20.489 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:19:20.499 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:19:20.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:20.501 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:19:20.509 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:19:20.509 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:19:20.509 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:19:20.509 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:19:20.509 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:19:20.509 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:19:20.509 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:19:20.510 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:19:20.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:20.510 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:19:20.510 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:19:20.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:19:20.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:19:20.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:19:20.510 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:19:20.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:20.591 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:19:20.596 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:19:20.596 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:19:20.597 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:19:20.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:20.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:19:20.610 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:19:20.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:19:20.611 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:20.616 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:19:20.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:19:20.616 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:20.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:19:20.634 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:19:20.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:19:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:19:20.692 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:19:20.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:20.693 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:19:20.699 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:19:20.699 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:19:20.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:19:20.719 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:19:20.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:19:20.777 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:19:20.777 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:19:20.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:20.778 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:19:20.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:19:20.782+0000 7fdf1e4f2640 -1 init, newargv = 0x5645ba3661a0 newargc=15 2023-11-29T11:19:20.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[56444]: starting ceph client 2023-11-29T11:19:20.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[56444]: starting fuse 2023-11-29T11:19:21.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:19:21.903 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:19:21.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:19:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:19:21.962 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:19:21.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:21.963 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:19:21.970 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:19:21.970 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:19:21.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:19:21.970 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:19:21.971 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:19:21.972 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:19:22.056 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.56444.asok 2023-11-29T11:19:22.240 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.56444.asok 2023-11-29T11:19:22.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:22.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.56444.asok status 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "56444", 2023-11-29T11:19:22.388 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7800, 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7800 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2012664681 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:22.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2012664681 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.7800 192.168.0.1:0/2012664681", 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2012664681", 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 47, 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 84, 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:19:22.390 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:19:22.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:22.398 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:19:22.398 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:22.406 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:19:22.406 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:22.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:22.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:22.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:22.418 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2023-11-29T11:19:22.474 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:19:22.475 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2023-11-29T11:19:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e6b99140 1 Processor -- start 2023-11-29T11:19:22.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e6b99140 1 -- start start 2023-11-29T11:19:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e6b99140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c6fb620 0x55af4c7cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e6b99140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c726470 0x55af4c723010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e6b99140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 0x55af4c7cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e6b99140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4c68b180 con 0x55af4c6fb620 2023-11-29T11:19:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e6b99140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4c61e240 con 0x55af4c7ce5c0 2023-11-29T11:19:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e6b99140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af4c740bb0 con 0x55af4c726470 2023-11-29T11:19:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c6fb620 0x55af4c7cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c6fb620 0x55af4c7cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51588/0 (socket says 172.21.15.81:51588) 2023-11-29T11:19:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 -- 172.21.15.81:0/3791906141 learned_addr learned my addr 172.21.15.81:0/3791906141 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e4ecf700 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 0x55af4c7cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e3ecd700 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c726470 0x55af4c723010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 -- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c726470 msgr2=0x55af4c723010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c726470 0x55af4c723010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 -- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 msgr2=0x55af4c7cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 0x55af4c7cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 -- 172.21.15.81:0/3791906141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4005d20 con 0x55af4c6fb620 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e3ecd700 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c726470 0x55af4c723010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e46ce700 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c6fb620 0x55af4c7cc110 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006f30 tx=0x7f25dc001890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875ab48a8a9e6c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.510+0000 7f25e2ecb700 1 -- 172.21.15.81:0/3791906141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc012600 con 0x55af4c6fb620 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e2ecb700 1 -- 172.21.15.81:0/3791906141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc012780 con 0x55af4c6fb620 2023-11-29T11:19:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e2ecb700 1 -- 172.21.15.81:0/3791906141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc012b30 con 0x55af4c6fb620 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- 172.21.15.81:0/3791906141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c6fb620 msgr2=0x55af4c7cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c6fb620 0x55af4c7cc110 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006f30 tx=0x7f25dc001890 comp rx=0 tx=0).stop 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- 172.21.15.81:0/3791906141 shutdown_connections 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 0x55af4c7cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c726470 0x55af4c723010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 --2- 172.21.15.81:0/3791906141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c6fb620 0x55af4c7cc110 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- 172.21.15.81:0/3791906141 >> 172.21.15.81:0/3791906141 conn(0x55af4c725dd0 msgr2=0x55af4c7cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- 172.21.15.81:0/3791906141 shutdown_connections 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- 172.21.15.81:0/3791906141 wait complete. 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 Processor -- start 2023-11-29T11:19:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- start start 2023-11-29T11:19:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c6fb620 0x55af4c7b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c726470 0x55af4c7cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 0x55af4c7bc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4c7cdc10 con 0x55af4c726470 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4c7b77d0 con 0x55af4c7ce5c0 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af4c7b7a70 con 0x55af4c6fb620 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c726470 0x55af4c7cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c726470 0x55af4c7cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51592/0 (socket says 172.21.15.81:51592) 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 -- 172.21.15.81:0/2296841706 learned_addr learned my addr 172.21.15.81:0/2296841706 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e46ce700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c6fb620 0x55af4c7b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e4ecf700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 0x55af4c7bc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 -- 172.21.15.81:0/2296841706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c6fb620 msgr2=0x55af4c7b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55af4c6fb620 0x55af4c7b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 -- 172.21.15.81:0/2296841706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 msgr2=0x55af4c7bc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55af4c7ce5c0 0x55af4c7bc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 -- 172.21.15.81:0/2296841706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af4c629520 con 0x55af4c726470 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e3ecd700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c726470 0x55af4c7cd6d0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00b540 tx=0x7f25cc00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e1ec9700 1 -- 172.21.15.81:0/2296841706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00be70 con 0x55af4c726470 2023-11-29T11:19:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e1ec9700 1 -- 172.21.15.81:0/2296841706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc010410 con 0x55af4c726470 2023-11-29T11:19:22.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.514+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55af4c6298b0 con 0x55af4c726470 2023-11-29T11:19:22.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e1ec9700 1 -- 172.21.15.81:0/2296841706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc010780 con 0x55af4c726470 2023-11-29T11:19:22.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af4c6365d0 con 0x55af4c726470 2023-11-29T11:19:22.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e1ec9700 1 -- 172.21.15.81:0/2296841706 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f25cc020070 con 0x55af4c726470 2023-11-29T11:19:22.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e1ec9700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25c4063840 0x7f25c4065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e1ec9700 1 -- 172.21.15.81:0/2296841706 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f25cc00a040 con 0x55af4c726470 2023-11-29T11:19:22.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e46ce700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25c4063840 0x7f25c4065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e6b99140 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55af4c7b9bb0 0x55af4c7b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84) v8 -- 0x55af4c7ba4f0 con 0x55af4c7b9bb0 2023-11-29T11:19:22.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.518+0000 7f25e4ecf700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55af4c7b9bb0 0x55af4c7b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e4ecf700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55af4c7b9bb0 0x55af4c7b9fb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:22.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e46ce700 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25c4063840 0x7f25c4065cf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006e20 tx=0x7f25dc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:22.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e4ecf700 1 -- 172.21.15.81:0/2296841706 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v84'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f25d4008b60 con 0x55af4c7b9bb0 2023-11-29T11:19:22.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55af4c7b9bb0 msgr2=0x55af4c7b9fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e6b99140 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55af4c7b9bb0 0x55af4c7b9fb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25c4063840 msgr2=0x7f25c4065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e6b99140 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25c4063840 0x7f25c4065cf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006e20 tx=0x7f25dc008030 comp rx=0 tx=0).stop 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c726470 msgr2=0x55af4c7cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e6b99140 1 --2- 172.21.15.81:0/2296841706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55af4c726470 0x55af4c7cd6d0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00b540 tx=0x7f25cc00b850 comp rx=0 tx=0).stop 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.522+0000 7f25e4ecf700 1 -- 172.21.15.81:0/2296841706 reap_dead start 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.526+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 shutdown_connections 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.526+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 >> 172.21.15.81:0/2296841706 conn(0x55af4c725dd0 msgr2=0x55af4c7cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.526+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 shutdown_connections 2023-11-29T11:19:22.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.526+0000 7f25e6b99140 1 -- 172.21.15.81:0/2296841706 wait complete. 2023-11-29T11:19:22.534 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:19:22.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:19:22.552 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:19:22.573 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:19:22.573 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:19:22.573 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:22.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:22.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5a80f700 1 Processor -- start 2023-11-29T11:19:22.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5a80f700 1 -- start start 2023-11-29T11:19:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5a80f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a541606b0 0x7f5a540c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5a80f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a54164e60 con 0x7f5a540ad610 2023-11-29T11:19:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5a80f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a540cae70 con 0x7f5a540ceef0 2023-11-29T11:19:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5a80f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a540cbc10 con 0x7f5a541606b0 2023-11-29T11:19:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5a00e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5a540ad610 0x7f5a54164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60702/0 (socket says 172.21.15.81:60702) 2023-11-29T11:19:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5a00e700 1 -- 172.21.15.81:0/3567613657 learned_addr learned my addr 172.21.15.81:0/3567613657 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.738+0000 7f5a5980d700 1 --2- 172.21.15.81:0/3567613657 >> v2:172.21.15.81:3300/0 conn(0x7f5a541606b0 0x7f5a540c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5880b700 1 -- 172.21.15.81:0/3567613657 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77874274 0 0) 0x7f5a54164e60 con 0x7f5a540ad610 2023-11-29T11:19:22.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5880b700 1 -- 172.21.15.81:0/3567613657 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a3c0035d0 con 0x7f5a540ad610 2023-11-29T11:19:22.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5980d700 1 -- 172.21.15.81:0/3567613657 >> v1:172.21.15.176:6789/0 conn(0x7f5a540ceef0 legacy=0x7f5a54164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5980d700 1 -- 172.21.15.81:0/3567613657 >> v1:172.21.15.81:6789/0 conn(0x7f5a540ad610 legacy=0x7f5a54164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5980d700 1 -- 172.21.15.81:0/3567613657 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a540cb130 con 0x7f5a541606b0 2023-11-29T11:19:22.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5980d700 1 --2- 172.21.15.81:0/3567613657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a540c13b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009850 tx=0x7f5a50009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4449b781f637de39 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5880b700 1 -- 172.21.15.81:0/3567613657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50011830 con 0x7f5a541606b0 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5880b700 1 -- 172.21.15.81:0/3567613657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a50011990 con 0x7f5a541606b0 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5880b700 1 -- 172.21.15.81:0/3567613657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50011d00 con 0x7f5a541606b0 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3567613657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 msgr2=0x7f5a540c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 --2- 172.21.15.81:0/3567613657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a540c13b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009850 tx=0x7f5a50009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3567613657 shutdown_connections 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 --2- 172.21.15.81:0/3567613657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a540c13b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3567613657 >> 172.21.15.81:0/3567613657 conn(0x7f5a540ce3e0 msgr2=0x7f5a540ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3567613657 shutdown_connections 2023-11-29T11:19:22.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3567613657 wait complete. 2023-11-29T11:19:22.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 Processor -- start 2023-11-29T11:19:22.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.742+0000 7f5a5a80f700 1 -- start start 2023-11-29T11:19:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a80f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a540ad610 0x7f5a5415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a80f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a540ceef0 0x7f5a541f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a80f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a541f9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a80f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541ebae0 con 0x7f5a541606b0 2023-11-29T11:19:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a80f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541f90e0 con 0x7f5a540ad610 2023-11-29T11:19:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a80f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541f96a0 con 0x7f5a540ceef0 2023-11-29T11:19:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a541f9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a541f9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51614/0 (socket says 172.21.15.81:51614) 2023-11-29T11:19:22.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 -- 172.21.15.81:0/3693764620 learned_addr learned my addr 172.21.15.81:0/3693764620 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:22.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5900c700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a540ceef0 0x7f5a541f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5980d700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a540ad610 0x7f5a5415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 -- 172.21.15.81:0/3693764620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a540ceef0 msgr2=0x7f5a541f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a540ceef0 0x7f5a541f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 -- 172.21.15.81:0/3693764620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a540ad610 msgr2=0x7f5a5415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a540ad610 0x7f5a5415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 -- 172.21.15.81:0/3693764620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a500094b0 con 0x7f5a541606b0 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a00e700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a541f9b30 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00caa0 tx=0x7f5a4c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a4a7fc700 1 -- 172.21.15.81:0/3693764620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c007480 con 0x7f5a541606b0 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a4a7fc700 1 -- 172.21.15.81:0/3693764620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c0075e0 con 0x7f5a541606b0 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a4a7fc700 1 -- 172.21.15.81:0/3693764620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c007970 con 0x7f5a541606b0 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a540cb6f0 con 0x7f5a541606b0 2023-11-29T11:19:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.746+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a540cb410 con 0x7f5a541606b0 2023-11-29T11:19:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.750+0000 7f5a4a7fc700 1 -- 172.21.15.81:0/3693764620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5a4c019030 con 0x7f5a541606b0 2023-11-29T11:19:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.750+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5406ac50 con 0x7f5a541606b0 2023-11-29T11:19:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.750+0000 7f5a4a7fc700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a40064f10 0x7f5a400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.750+0000 7f5a4a7fc700 1 -- 172.21.15.81:0/3693764620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f5a4c081800 con 0x7f5a541606b0 2023-11-29T11:19:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.750+0000 7f5a5980d700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a40064f10 0x7f5a400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.750+0000 7f5a5980d700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a40064f10 0x7f5a400673c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5a500090b0 tx=0x7f5a50008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.754+0000 7f5a4a7fc700 1 -- 172.21.15.81:0/3693764620 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5a4c04f780 con 0x7f5a541606b0 2023-11-29T11:19:22.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.914+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a541f9810 con 0x7f5a541606b0 2023-11-29T11:19:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a4a7fc700 1 -- 172.21.15.81:0/3693764620 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18200 (secure 0 0 0) 0x7f5a4c052da0 con 0x7f5a541606b0 2023-11-29T11:19:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:22.924 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:58.488981+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3247003029":"2023-11-30T11:17:58.488925+0000","172.21.15.81:6836/3247003029":"2023-11-30T11:17:58.488925+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a40064f10 msgr2=0x7f5a400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a40064f10 0x7f5a400673c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5a500090b0 tx=0x7f5a50008030 comp rx=0 tx=0).stop 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 msgr2=0x7f5a541f9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a541f9b30 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00caa0 tx=0x7f5a4c00cad0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 shutdown_connections 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a40064f10 0x7f5a400673c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a541606b0 0x7f5a541f9b30 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a540ceef0 0x7f5a541f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 --2- 172.21.15.81:0/3693764620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a540ad610 0x7f5a5415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:22.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 >> 172.21.15.81:0/3693764620 conn(0x7f5a540ce3e0 msgr2=0x7f5a540af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:22.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 shutdown_connections 2023-11-29T11:19:22.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:22.918+0000 7f5a5a80f700 1 -- 172.21.15.81:0/3693764620 wait complete. 2023-11-29T11:19:22.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:17:38.310347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:17:38.742094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:19:22.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:19:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.042+0000 7f71a3fff700 1 Processor -- start 2023-11-29T11:19:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.042+0000 7f71a3fff700 1 -- start start 2023-11-29T11:19:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f719c0dee50 0x7f719c04f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f719c0538d0 0x7f719c04fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0064d0 con 0x7f719c04f880 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c050210 con 0x7f719c0538d0 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0df220 con 0x7f719c0dee50 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a37fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f719c0538d0 0x7f719c04fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f719c04f880 0x7f719c006960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60716/0 (socket says 172.21.15.81:60716) 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a27fc700 1 -- 172.21.15.81:0/209001299 learned_addr learned my addr 172.21.15.81:0/209001299 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a2ffd700 1 --2- 172.21.15.81:0/209001299 >> v2:172.21.15.176:3300/0 conn(0x7f719c0dee50 0x7f719c04f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a37fe700 1 -- 172.21.15.81:0/209001299 >> v2:172.21.15.176:3300/0 conn(0x7f719c0dee50 msgr2=0x7f719c04f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a37fe700 1 --2- 172.21.15.81:0/209001299 >> v2:172.21.15.176:3300/0 conn(0x7f719c0dee50 0x7f719c04f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a37fe700 1 -- 172.21.15.81:0/209001299 >> v1:172.21.15.81:6789/0 conn(0x7f719c04f880 legacy=0x7f719c006960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a37fe700 1 -- 172.21.15.81:0/209001299 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0340b0 con 0x7f719c0538d0 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a1ffb700 1 -- 172.21.15.81:0/209001299 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916959741 0 0) 0x7f719c0064d0 con 0x7f719c04f880 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a2ffd700 1 --2- 172.21.15.81:0/209001299 >> v2:172.21.15.176:3300/0 conn(0x7f719c0dee50 0x7f719c04f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:19:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a37fe700 1 --2- 172.21.15.81:0/209001299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0538d0 0x7f719c04fcd0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f71a402cad0 tx=0x7f71a404e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d7a6384865b370 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a1ffb700 1 -- 172.21.15.81:0/209001299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40727d0 con 0x7f719c0538d0 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a1ffb700 1 -- 172.21.15.81:0/209001299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4072970 con 0x7f719c0538d0 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a1ffb700 1 -- 172.21.15.81:0/209001299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4066b20 con 0x7f719c0538d0 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 -- 172.21.15.81:0/209001299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0538d0 msgr2=0x7f719c04fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 --2- 172.21.15.81:0/209001299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0538d0 0x7f719c04fcd0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f71a402cad0 tx=0x7f71a404e8b0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 -- 172.21.15.81:0/209001299 shutdown_connections 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 --2- 172.21.15.81:0/209001299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0538d0 0x7f719c04fcd0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 --2- 172.21.15.81:0/209001299 >> v2:172.21.15.176:3300/0 conn(0x7f719c0dee50 0x7f719c04f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 -- 172.21.15.81:0/209001299 >> 172.21.15.81:0/209001299 conn(0x7f719c051770 msgr2=0x7f719c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 -- 172.21.15.81:0/209001299 shutdown_connections 2023-11-29T11:19:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.046+0000 7f71a3fff700 1 -- 172.21.15.81:0/209001299 wait complete. 2023-11-29T11:19:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 Processor -- start 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 -- start start 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c04f880 0x7f719c0557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c0538d0 0x7f719c04e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0dee50 0x7f719c038b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0e2290 con 0x7f719c04f880 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0ca230 con 0x7f719c0538d0 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0d61f0 con 0x7f719c0dee50 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c04f880 0x7f719c0557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c04f880 0x7f719c0557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51630/0 (socket says 172.21.15.81:51630) 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 -- 172.21.15.81:0/674357661 learned_addr learned my addr 172.21.15.81:0/674357661 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a27fc700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c0538d0 0x7f719c04e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a37fe700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0dee50 0x7f719c038b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 -- 172.21.15.81:0/674357661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0dee50 msgr2=0x7f719c038b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0dee50 0x7f719c038b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 -- 172.21.15.81:0/674357661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c0538d0 msgr2=0x7f719c04e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c0538d0 0x7f719c04e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 -- 172.21.15.81:0/674357661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a404e720 con 0x7f719c04f880 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a2ffd700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c04f880 0x7f719c0557c0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f719400c770 tx=0x7f719400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f719bfff700 1 -- 172.21.15.81:0/674357661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194011800 con 0x7f719c04f880 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f719bfff700 1 -- 172.21.15.81:0/674357661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194011960 con 0x7f719c04f880 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c054770 con 0x7f719c04f880 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f719bfff700 1 -- 172.21.15.81:0/674357661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194011d10 con 0x7f719c04f880 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c054490 con 0x7f719c04f880 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.050+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c006160 con 0x7f719c04f880 2023-11-29T11:19:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.054+0000 7f719bfff700 1 -- 172.21.15.81:0/674357661 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7194021070 con 0x7f719c04f880 2023-11-29T11:19:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.054+0000 7f719bfff700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7184064ee0 0x7f7184067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.054+0000 7f71a27fc700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7184064ee0 0x7f7184067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.054+0000 7f719bfff700 1 -- 172.21.15.81:0/674357661 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f71940820c0 con 0x7f719c04f880 2023-11-29T11:19:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.054+0000 7f71a27fc700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7184064ee0 0x7f7184067390 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f719c000f90 tx=0x7f718c007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.062+0000 7f719bfff700 1 -- 172.21.15.81:0/674357661 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f719404fed0 con 0x7f719c04f880 2023-11-29T11:19:23.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.225+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f719c005570 con 0x7f719c04f880 2023-11-29T11:19:23.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.225+0000 7f719bfff700 1 -- 172.21.15.81:0/674357661 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f71940534f0 con 0x7f719c04f880 2023-11-29T11:19:23.234 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:19:23.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7184064ee0 msgr2=0x7f7184067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7184064ee0 0x7f7184067390 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f719c000f90 tx=0x7f718c007e90 comp rx=0 tx=0).stop 2023-11-29T11:19:23.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c04f880 msgr2=0x7f719c0557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c04f880 0x7f719c0557c0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f719400c770 tx=0x7f719400ca80 comp rx=0 tx=0).stop 2023-11-29T11:19:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 shutdown_connections 2023-11-29T11:19:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7184064ee0 0x7f7184067390 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0dee50 0x7f719c038b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c0538d0 0x7f719c04e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 --2- 172.21.15.81:0/674357661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c04f880 0x7f719c0557c0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 >> 172.21.15.81:0/674357661 conn(0x7f719c051770 msgr2=0x7f719c035b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 shutdown_connections 2023-11-29T11:19:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.233+0000 7f71a3fff700 1 -- 172.21.15.81:0/674357661 wait complete. 2023-11-29T11:19:23.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:19:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc2215ad700 1 Processor -- start 2023-11-29T11:19:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc2215ad700 1 -- start start 2023-11-29T11:19:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc2215ad700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc21c06ce60 0x7fc21c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc2215ad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cce60 0x7fc21c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc2215ad700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c0cd2d0 con 0x7fc21c0cf470 2023-11-29T11:19:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc2215ad700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c15c8b0 con 0x7fc21c06ce60 2023-11-29T11:19:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc2215ad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c06d770 con 0x7fc21c0cce60 2023-11-29T11:19:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc21c06ce60 0x7fc21c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc21c06ce60 0x7fc21c0d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51640/0 (socket says 172.21.15.81:51640) 2023-11-29T11:19:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21bfff700 1 -- 172.21.15.81:0/4173713308 learned_addr learned my addr 172.21.15.81:0/4173713308 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21b7fe700 1 --2- 172.21.15.81:0/4173713308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cce60 0x7fc21c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21bfff700 1 -- 172.21.15.81:0/4173713308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cce60 msgr2=0x7fc21c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21bfff700 1 --2- 172.21.15.81:0/4173713308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cce60 0x7fc21c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21affd700 1 -- 172.21.15.81:0/4173713308 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885513235 0 0) 0x7fc21c0cd2d0 con 0x7fc21c0cf470 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21bfff700 1 -- 172.21.15.81:0/4173713308 >> v1:172.21.15.176:6789/0 conn(0x7fc21c0cf470 legacy=0x7fc21c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.365+0000 7fc21bfff700 1 -- 172.21.15.81:0/4173713308 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c06a7f0 con 0x7fc21c06ce60 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc21bfff700 1 --2- 172.21.15.81:0/4173713308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0d31b0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fc214009e50 tx=0x7fc21400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2561caa2d8f6641d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc21affd700 1 -- 172.21.15.81:0/4173713308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400e070 con 0x7fc21c06ce60 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc21affd700 1 -- 172.21.15.81:0/4173713308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400b910 con 0x7fc21c06ce60 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc21affd700 1 -- 172.21.15.81:0/4173713308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400bcc0 con 0x7fc21c06ce60 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 -- 172.21.15.81:0/4173713308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 msgr2=0x7fc21c0d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 --2- 172.21.15.81:0/4173713308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0d31b0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fc214009e50 tx=0x7fc21400b330 comp rx=0 tx=0).stop 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 -- 172.21.15.81:0/4173713308 shutdown_connections 2023-11-29T11:19:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 --2- 172.21.15.81:0/4173713308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cce60 0x7fc21c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 --2- 172.21.15.81:0/4173713308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0d31b0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 -- 172.21.15.81:0/4173713308 >> 172.21.15.81:0/4173713308 conn(0x7fc21c0b5760 msgr2=0x7fc21c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 -- 172.21.15.81:0/4173713308 shutdown_connections 2023-11-29T11:19:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 -- 172.21.15.81:0/4173713308 wait complete. 2023-11-29T11:19:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 Processor -- start 2023-11-29T11:19:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.369+0000 7fc2215ad700 1 -- start start 2023-11-29T11:19:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc2215ad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc2215ad700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc21c0cce60 0x7fc21c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc2215ad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cf470 0x7fc21c0b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc2215ad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c14a2e0 con 0x7fc21c06ce60 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc2215ad700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c149ec0 con 0x7fc21c0cce60 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc2215ad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0b45b0 con 0x7fc21c0cf470 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51654/0 (socket says 172.21.15.81:51654) 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 -- 172.21.15.81:0/3857300205 learned_addr learned my addr 172.21.15.81:0/3857300205 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21b7fe700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc21c0cce60 0x7fc21c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc220dac700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cf470 0x7fc21c0b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 -- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cf470 msgr2=0x7fc21c0b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cf470 0x7fc21c0b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 -- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc21c0cce60 msgr2=0x7fc21c149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc21c0cce60 0x7fc21c149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 -- 172.21.15.81:0/3857300205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214009b30 con 0x7fc21c06ce60 2023-11-29T11:19:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc220dac700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cf470 0x7fc21c0b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:19:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc21bfff700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0cc270 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fc21c08a7d0 tx=0x7fc214004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc218ff9700 1 -- 172.21.15.81:0/3857300205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2140099b0 con 0x7fc21c06ce60 2023-11-29T11:19:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc218ff9700 1 -- 172.21.15.81:0/3857300205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc214004250 con 0x7fc21c06ce60 2023-11-29T11:19:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc218ff9700 1 -- 172.21.15.81:0/3857300205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2140045c0 con 0x7fc21c06ce60 2023-11-29T11:19:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c06adb0 con 0x7fc21c06ce60 2023-11-29T11:19:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.373+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c06aad0 con 0x7fc21c06ce60 2023-11-29T11:19:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.377+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c06b090 con 0x7fc21c06ce60 2023-11-29T11:19:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.377+0000 7fc218ff9700 1 -- 172.21.15.81:0/3857300205 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc214004720 con 0x7fc21c06ce60 2023-11-29T11:19:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.377+0000 7fc218ff9700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1fc064ee0 0x7fc1fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.377+0000 7fc218ff9700 1 -- 172.21.15.81:0/3857300205 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fc2140833e0 con 0x7fc21c06ce60 2023-11-29T11:19:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.377+0000 7fc21b7fe700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1fc064ee0 0x7fc1fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.377+0000 7fc21b7fe700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1fc064ee0 0x7fc1fc067390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0d1190 tx=0x7fc204009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.385+0000 7fc218ff9700 1 -- 172.21.15.81:0/3857300205 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc214051380 con 0x7fc21c06ce60 2023-11-29T11:19:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc21c072c20 con 0x7fc21c06ce60 2023-11-29T11:19:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc218ff9700 1 -- 172.21.15.81:0/3857300205 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc21401f020 con 0x7fc21c06ce60 2023-11-29T11:19:23.552 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1fc064ee0 msgr2=0x7fc1fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1fc064ee0 0x7fc1fc067390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0d1190 tx=0x7fc204009240 comp rx=0 tx=0).stop 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 msgr2=0x7fc21c0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0cc270 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fc21c08a7d0 tx=0x7fc214004af0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 shutdown_connections 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc1fc064ee0 0x7fc1fc067390 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc21c0cf470 0x7fc21c0b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc21c0cce60 0x7fc21c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 --2- 172.21.15.81:0/3857300205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc21c06ce60 0x7fc21c0cc270 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 >> 172.21.15.81:0/3857300205 conn(0x7fc21c0b5760 msgr2=0x7fc21c06bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 shutdown_connections 2023-11-29T11:19:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.545+0000 7fc2215ad700 1 -- 172.21.15.81:0/3857300205 wait complete. 2023-11-29T11:19:23.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:19:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.685+0000 7f48d2894700 1 Processor -- start 2023-11-29T11:19:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.685+0000 7f48d2894700 1 -- start start 2023-11-29T11:19:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.685+0000 7f48d2894700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.685+0000 7f48d2894700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f48cc06a4c0 0x7f48cc0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.685+0000 7f48d2894700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc06a9c0 con 0x7f48cc0cf0e0 2023-11-29T11:19:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.685+0000 7f48d2894700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc06aca0 con 0x7f48cc06a4c0 2023-11-29T11:19:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.685+0000 7f48d2894700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06af80 con 0x7f48cc0b1ae0 2023-11-29T11:19:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d1892700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d1091700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f48cc06a4c0 0x7f48cc0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2093700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f48cc0cf0e0 0x7f48cc0b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:35494/0 (socket says 172.21.15.81:35494) 2023-11-29T11:19:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2093700 1 -- 172.21.15.81:0/679755120 learned_addr learned my addr 172.21.15.81:0/679755120 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d1892700 1 --2- 172.21.15.81:0/679755120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:44462/0 (socket says 172.21.15.81:44462) 2023-11-29T11:19:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d1091700 1 -- 172.21.15.81:0/679755120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 msgr2=0x7f48cc06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d1091700 1 --2- 172.21.15.81:0/679755120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d1091700 1 -- 172.21.15.81:0/679755120 >> v1:172.21.15.176:6789/0 conn(0x7f48cc0cf0e0 legacy=0x7f48cc0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d1091700 1 -- 172.21.15.81:0/679755120 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0b4380 con 0x7f48cc06a4c0 2023-11-29T11:19:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d1091700 1 --2- 172.21.15.81:0/679755120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc06a4c0 0x7f48cc0d03a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009850 tx=0x7f48bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34caef4a9b1d047c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d0890700 1 -- 172.21.15.81:0/679755120 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc004230 con 0x7f48cc06a4c0 2023-11-29T11:19:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d0890700 1 -- 172.21.15.81:0/679755120 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc004390 con 0x7f48cc06a4c0 2023-11-29T11:19:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d0890700 1 -- 172.21.15.81:0/679755120 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0036c0 con 0x7f48cc06a4c0 2023-11-29T11:19:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2894700 1 -- 172.21.15.81:0/679755120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc06a4c0 msgr2=0x7f48cc0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2894700 1 --2- 172.21.15.81:0/679755120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc06a4c0 0x7f48cc0d03a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009850 tx=0x7f48bc009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2894700 1 -- 172.21.15.81:0/679755120 shutdown_connections 2023-11-29T11:19:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2894700 1 --2- 172.21.15.81:0/679755120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc06a4c0 0x7f48cc0d03a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2894700 1 --2- 172.21.15.81:0/679755120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2894700 1 -- 172.21.15.81:0/679755120 >> 172.21.15.81:0/679755120 conn(0x7f48cc09bbd0 msgr2=0x7f48cc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2894700 1 -- 172.21.15.81:0/679755120 shutdown_connections 2023-11-29T11:19:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.689+0000 7f48d2894700 1 -- 172.21.15.81:0/679755120 wait complete. 2023-11-29T11:19:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2894700 1 Processor -- start 2023-11-29T11:19:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2894700 1 -- start start 2023-11-29T11:19:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2894700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48cc06a4c0 0x7f48cc14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2894700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2894700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0cf0e0 0x7f48cc0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2894700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0c8ca0 con 0x7f48cc06a4c0 2023-11-29T11:19:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2894700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc150310 con 0x7f48cc0cf0e0 2023-11-29T11:19:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2894700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0c66a0 con 0x7f48cc0b1ae0 2023-11-29T11:19:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d1892700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48cc06a4c0 0x7f48cc14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d1892700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48cc06a4c0 0x7f48cc14fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51664/0 (socket says 172.21.15.81:51664) 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d1892700 1 -- 172.21.15.81:0/273253646 learned_addr learned my addr 172.21.15.81:0/273253646 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d1091700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.693+0000 7f48d2093700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0cf0e0 0x7f48cc0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d1892700 1 -- 172.21.15.81:0/273253646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 msgr2=0x7f48cc15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d1892700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d1892700 1 -- 172.21.15.81:0/273253646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0cf0e0 msgr2=0x7f48cc0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d1892700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0cf0e0 0x7f48cc0b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d1892700 1 -- 172.21.15.81:0/273253646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0094b0 con 0x7f48cc06a4c0 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d1892700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48cc06a4c0 0x7f48cc14fdd0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f48c800e9d0 tx=0x7f48c800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48c27fc700 1 -- 172.21.15.81:0/273253646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c8009720 con 0x7f48cc06a4c0 2023-11-29T11:19:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc0b60e0 con 0x7f48cc06a4c0 2023-11-29T11:19:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48c27fc700 1 -- 172.21.15.81:0/273253646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c800ee70 con 0x7f48cc06a4c0 2023-11-29T11:19:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48c27fc700 1 -- 172.21.15.81:0/273253646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c800ca50 con 0x7f48cc06a4c0 2023-11-29T11:19:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc0b1eb0 con 0x7f48cc06a4c0 2023-11-29T11:19:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.697+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc0d08e0 con 0x7f48cc06a4c0 2023-11-29T11:19:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.701+0000 7f48c27fc700 1 -- 172.21.15.81:0/273253646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f48c8019030 con 0x7f48cc06a4c0 2023-11-29T11:19:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.701+0000 7f48c27fc700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f48b0064ee0 0x7f48b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.701+0000 7f48c27fc700 1 -- 172.21.15.81:0/273253646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f48c8081f30 con 0x7f48cc06a4c0 2023-11-29T11:19:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.701+0000 7f48d1091700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f48b0064ee0 0x7f48b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.701+0000 7f48d1091700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f48b0064ee0 0x7f48b0067390 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009850 tx=0x7f48bc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.709+0000 7f48c27fc700 1 -- 172.21.15.81:0/273253646 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f48c804fe90 con 0x7f48cc06a4c0 2023-11-29T11:19:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.873+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48cc072500 con 0x7f48cc06a4c0 2023-11-29T11:19:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.873+0000 7f48c27fc700 1 -- 172.21.15.81:0/273253646 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48c80534b0 con 0x7f48cc06a4c0 2023-11-29T11:19:23.882 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:19:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f48b0064ee0 msgr2=0x7f48b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f48b0064ee0 0x7f48b0067390 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009850 tx=0x7f48bc008030 comp rx=0 tx=0).stop 2023-11-29T11:19:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48cc06a4c0 msgr2=0x7f48cc14fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48cc06a4c0 0x7f48cc14fdd0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f48c800e9d0 tx=0x7f48c800ece0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 shutdown_connections 2023-11-29T11:19:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f48b0064ee0 0x7f48b0067390 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0cf0e0 0x7f48cc0b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48cc0b1ae0 0x7f48cc15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 --2- 172.21.15.81:0/273253646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48cc06a4c0 0x7f48cc14fdd0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 >> 172.21.15.81:0/273253646 conn(0x7f48cc09bbd0 msgr2=0x7f48cc0d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 shutdown_connections 2023-11-29T11:19:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:23.877+0000 7f48d2894700 1 -- 172.21.15.81:0/273253646 wait complete. 2023-11-29T11:19:23.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:19:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 Processor -- start 2023-11-29T11:19:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 -- start start 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940b1ae0 0x7f899406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89940cf0e0 0x7f89940cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89940cfa80 con 0x7f899406a4c0 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940d0ab0 con 0x7f89940cf0e0 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899406a9c0 con 0x7f89940b1ae0 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f8992d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89940cf0e0 0x7f89940cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f8991d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f899406a4c0 0x7f89940d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60720/0 (socket says 172.21.15.81:60720) 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f8991d9b700 1 -- 172.21.15.81:0/2159094506 learned_addr learned my addr 172.21.15.81:0/2159094506 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899259c700 1 --2- 172.21.15.81:0/2159094506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940b1ae0 0x7f899406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f8992d9d700 1 -- 172.21.15.81:0/2159094506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940b1ae0 msgr2=0x7f899406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f8992d9d700 1 --2- 172.21.15.81:0/2159094506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940b1ae0 0x7f899406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f8992d9d700 1 -- 172.21.15.81:0/2159094506 >> v1:172.21.15.81:6789/0 conn(0x7f899406a4c0 legacy=0x7f89940d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f8992d9d700 1 -- 172.21.15.81:0/2159094506 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899406aca0 con 0x7f89940cf0e0 2023-11-29T11:19:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f8992d9d700 1 --2- 172.21.15.81:0/2159094506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940cf0e0 0x7f89940cf540 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f898c009d90 tx=0x7f898c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8efc454a6ca110e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899159a700 1 -- 172.21.15.81:0/2159094506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00e070 con 0x7f89940cf0e0 2023-11-29T11:19:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899159a700 1 -- 172.21.15.81:0/2159094506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00bbd0 con 0x7f89940cf0e0 2023-11-29T11:19:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899159a700 1 -- 172.21.15.81:0/2159094506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c012430 con 0x7f89940cf0e0 2023-11-29T11:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 -- 172.21.15.81:0/2159094506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940cf0e0 msgr2=0x7f89940cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.013+0000 7f899359e700 1 --2- 172.21.15.81:0/2159094506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940cf0e0 0x7f89940cf540 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f898c009d90 tx=0x7f898c00b330 comp rx=0 tx=0).stop 2023-11-29T11:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.017+0000 7f899359e700 1 -- 172.21.15.81:0/2159094506 shutdown_connections 2023-11-29T11:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.017+0000 7f899359e700 1 --2- 172.21.15.81:0/2159094506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940cf0e0 0x7f89940cf540 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.017+0000 7f899359e700 1 --2- 172.21.15.81:0/2159094506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940b1ae0 0x7f899406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.017+0000 7f899359e700 1 -- 172.21.15.81:0/2159094506 >> 172.21.15.81:0/2159094506 conn(0x7f899409bbd0 msgr2=0x7f89940b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.017+0000 7f899359e700 1 -- 172.21.15.81:0/2159094506 shutdown_connections 2023-11-29T11:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.017+0000 7f899359e700 1 -- 172.21.15.81:0/2159094506 wait complete. 2023-11-29T11:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.017+0000 7f899359e700 1 Processor -- start 2023-11-29T11:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.017+0000 7f899359e700 1 -- start start 2023-11-29T11:19:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899406a4c0 0x7f89940c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940b1ae0 0x7f899415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940cf0e0 0x7f899414bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89940c9620 con 0x7f89940b1ae0 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899414ba60 con 0x7f899406a4c0 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899414ae50 con 0x7f89940cf0e0 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940b1ae0 0x7f899415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940b1ae0 0x7f899415e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51688/0 (socket says 172.21.15.81:51688) 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 -- 172.21.15.81:0/3363858871 learned_addr learned my addr 172.21.15.81:0/3363858871 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899259c700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899406a4c0 0x7f89940c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8992d9d700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940cf0e0 0x7f899414bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 -- 172.21.15.81:0/3363858871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940cf0e0 msgr2=0x7f899414bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940cf0e0 0x7f899414bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 -- 172.21.15.81:0/3363858871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899406a4c0 msgr2=0x7f89940c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899406a4c0 0x7f89940c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 -- 172.21.15.81:0/3363858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c009a70 con 0x7f89940b1ae0 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f8991d9b700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940b1ae0 0x7f899415e8e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f897c00c530 tx=0x7f897c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f898affd700 1 -- 172.21.15.81:0/3363858871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c00cea0 con 0x7f89940b1ae0 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f898affd700 1 -- 172.21.15.81:0/3363858871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c005d90 con 0x7f89940b1ae0 2023-11-29T11:19:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f898affd700 1 -- 172.21.15.81:0/3363858871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0072d0 con 0x7f89940b1ae0 2023-11-29T11:19:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89940b4380 con 0x7f89940b1ae0 2023-11-29T11:19:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899406af80 con 0x7f89940b1ae0 2023-11-29T11:19:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.021+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89940b1eb0 con 0x7f89940b1ae0 2023-11-29T11:19:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.025+0000 7f898affd700 1 -- 172.21.15.81:0/3363858871 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f897c019030 con 0x7f89940b1ae0 2023-11-29T11:19:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.025+0000 7f898affd700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8974064ee0 0x7f8974067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.025+0000 7f898affd700 1 -- 172.21.15.81:0/3363858871 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f897c0810e0 con 0x7f89940b1ae0 2023-11-29T11:19:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.025+0000 7f899259c700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8974064ee0 0x7f8974067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.025+0000 7f899259c700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8974064ee0 0x7f8974067390 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8984009a00 tx=0x7f8984008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.029+0000 7f898affd700 1 -- 172.21.15.81:0/3363858871 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f897c04a400 con 0x7f89940b1ae0 2023-11-29T11:19:24.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.193+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89940a04d0 con 0x7f89940b1ae0 2023-11-29T11:19:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.193+0000 7f898affd700 1 -- 172.21.15.81:0/3363858871 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f897c04f170 con 0x7f89940b1ae0 2023-11-29T11:19:24.200 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:19:24.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8974064ee0 msgr2=0x7f8974067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8974064ee0 0x7f8974067390 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8984009a00 tx=0x7f8984008040 comp rx=0 tx=0).stop 2023-11-29T11:19:24.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940b1ae0 msgr2=0x7f899415e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940b1ae0 0x7f899415e8e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f897c00c530 tx=0x7f897c00c840 comp rx=0 tx=0).stop 2023-11-29T11:19:24.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 shutdown_connections 2023-11-29T11:19:24.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8974064ee0 0x7f8974067390 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89940cf0e0 0x7f899414bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89940b1ae0 0x7f899415e8e0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 --2- 172.21.15.81:0/3363858871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f899406a4c0 0x7f89940c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 >> 172.21.15.81:0/3363858871 conn(0x7f899409bbd0 msgr2=0x7f899415bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:24.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 shutdown_connections 2023-11-29T11:19:24.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.197+0000 7f899359e700 1 -- 172.21.15.81:0/3363858871 wait complete. 2023-11-29T11:19:24.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:19:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e3545700 1 Processor -- start 2023-11-29T11:19:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e3545700 1 -- start start 2023-11-29T11:19:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e3545700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 0x7f10dc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e3545700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10dc0b32e0 0x7f10dc0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e3545700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f10dc06bc80 0x7f10dc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e3545700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc06dbd0 con 0x7f10dc0b32e0 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e3545700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0b3c30 con 0x7f10dc06bc80 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e3545700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0cd0f0 con 0x7f10dc1584c0 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10dc0b32e0 0x7f10dc0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10dc0b32e0 0x7f10dc0b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51698/0 (socket says 172.21.15.81:51698) 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 -- 172.21.15.81:0/686279339 learned_addr learned my addr 172.21.15.81:0/686279339 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e2d44700 1 --2- 172.21.15.81:0/686279339 >> v2:172.21.15.176:3300/0 conn(0x7f10dc06bc80 0x7f10dc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e2543700 1 --2- 172.21.15.81:0/686279339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 0x7f10dc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 -- 172.21.15.81:0/686279339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 msgr2=0x7f10dc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 --2- 172.21.15.81:0/686279339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 0x7f10dc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 -- 172.21.15.81:0/686279339 >> v2:172.21.15.176:3300/0 conn(0x7f10dc06bc80 msgr2=0x7f10dc06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 --2- 172.21.15.81:0/686279339 >> v2:172.21.15.176:3300/0 conn(0x7f10dc06bc80 0x7f10dc06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 -- 172.21.15.81:0/686279339 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0cd3d0 con 0x7f10dc0b32e0 2023-11-29T11:19:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1d42700 1 --2- 172.21.15.81:0/686279339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc0b36f0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f10dc06de10 tx=0x7f10d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be5c6c605241baf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1541700 1 -- 172.21.15.81:0/686279339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400e070 con 0x7f10dc0b32e0 2023-11-29T11:19:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.317+0000 7f10e1541700 1 -- 172.21.15.81:0/686279339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d400b910 con 0x7f10dc0b32e0 2023-11-29T11:19:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e1541700 1 -- 172.21.15.81:0/686279339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400bcc0 con 0x7f10dc0b32e0 2023-11-29T11:19:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 -- 172.21.15.81:0/686279339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 msgr2=0x7f10dc0b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 --2- 172.21.15.81:0/686279339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc0b36f0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f10dc06de10 tx=0x7f10d400b330 comp rx=0 tx=0).stop 2023-11-29T11:19:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 -- 172.21.15.81:0/686279339 shutdown_connections 2023-11-29T11:19:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 --2- 172.21.15.81:0/686279339 >> v2:172.21.15.176:3300/0 conn(0x7f10dc06bc80 0x7f10dc06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 --2- 172.21.15.81:0/686279339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc0b36f0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 --2- 172.21.15.81:0/686279339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 0x7f10dc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 -- 172.21.15.81:0/686279339 >> 172.21.15.81:0/686279339 conn(0x7f10dc0ce3e0 msgr2=0x7f10dc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 -- 172.21.15.81:0/686279339 shutdown_connections 2023-11-29T11:19:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 -- 172.21.15.81:0/686279339 wait complete. 2023-11-29T11:19:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 Processor -- start 2023-11-29T11:19:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 -- start start 2023-11-29T11:19:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc06bc80 0x7f10dc0c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.321+0000 7f10e3545700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc096810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e3545700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 0x7f10dc096d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e3545700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc097be0 con 0x7f10dc0b32e0 2023-11-29T11:19:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e3545700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0c16f0 con 0x7f10dc06bc80 2023-11-29T11:19:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e3545700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc097900 con 0x7f10dc1584c0 2023-11-29T11:19:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc096810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51710/0 (socket says 172.21.15.81:51710) 2023-11-29T11:19:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 -- 172.21.15.81:0/559293946 learned_addr learned my addr 172.21.15.81:0/559293946 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e2543700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc06bc80 0x7f10dc0c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 -- 172.21.15.81:0/559293946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 msgr2=0x7f10dc096d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 0x7f10dc096d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 -- 172.21.15.81:0/559293946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc06bc80 msgr2=0x7f10dc0c11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc06bc80 0x7f10dc0c11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 -- 172.21.15.81:0/559293946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4009b30 con 0x7f10dc0b32e0 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e2543700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc06bc80 0x7f10dc0c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e1d42700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc096810 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f10d400b370 tx=0x7f10d4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10daffd700 1 -- 172.21.15.81:0/559293946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40099b0 con 0x7f10dc0b32e0 2023-11-29T11:19:24.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10daffd700 1 -- 172.21.15.81:0/559293946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d40092e0 con 0x7f10dc0b32e0 2023-11-29T11:19:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc0cd990 con 0x7f10dc0b32e0 2023-11-29T11:19:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10daffd700 1 -- 172.21.15.81:0/559293946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d401c660 con 0x7f10dc0b32e0 2023-11-29T11:19:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc0cd6b0 con 0x7f10dc0b32e0 2023-11-29T11:19:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc0cdc70 con 0x7f10dc0b32e0 2023-11-29T11:19:24.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10daffd700 1 -- 172.21.15.81:0/559293946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f10d4022030 con 0x7f10dc0b32e0 2023-11-29T11:19:24.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10daffd700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10c8064ee0 0x7f10c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10daffd700 1 -- 172.21.15.81:0/559293946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f10d4083990 con 0x7f10dc0b32e0 2023-11-29T11:19:24.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.325+0000 7f10e2543700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10c8064ee0 0x7f10c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.329+0000 7f10e2543700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10c8064ee0 0x7f10c8067390 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097c0 tx=0x7f10d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.333+0000 7f10daffd700 1 -- 172.21.15.81:0/559293946 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f10d4051970 con 0x7f10dc0b32e0 2023-11-29T11:19:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.505+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10dc072500 con 0x7f10dc0b32e0 2023-11-29T11:19:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.505+0000 7f10daffd700 1 -- 172.21.15.81:0/559293946 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v84) v1 ==== 80+0+122 (secure 0 0 0) 0x7f10d4054f90 con 0x7f10dc0b32e0 2023-11-29T11:19:24.514 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6837/3247003029 2023-11-30T11:17:58.488925+0000 2023-11-29T11:19:24.514 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6836/3247003029 2023-11-30T11:17:58.488925+0000 2023-11-29T11:19:24.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10c8064ee0 msgr2=0x7f10c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10c8064ee0 0x7f10c8067390 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097c0 tx=0x7f10d0008040 comp rx=0 tx=0).stop 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 msgr2=0x7f10dc096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc096810 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f10d400b370 tx=0x7f10d4004af0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 shutdown_connections 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f10c8064ee0 0x7f10c8067390 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc1584c0 0x7f10dc096d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10dc0b32e0 0x7f10dc096810 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 --2- 172.21.15.81:0/559293946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc06bc80 0x7f10dc0c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.509+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 >> 172.21.15.81:0/559293946 conn(0x7f10dc0ce3e0 msgr2=0x7f10dc155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.513+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 shutdown_connections 2023-11-29T11:19:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.513+0000 7f10e3545700 1 -- 172.21.15.81:0/559293946 wait complete. 2023-11-29T11:19:24.520 INFO:teuthology.orchestra.run.smithi081.stderr:listed 2 entries 2023-11-29T11:19:24.533 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:19:24.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:24.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:24.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[56444]: fuse finished with error 0 and tester_r 0 2023-11-29T11:19:24.545 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:19:24.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:24.546 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:19:24.579 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:19:24.579 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:24.587 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:19:24.587 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:19:24.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:24.587 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-29T11:19:24.593 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-29T11:19:24.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:19:24.594 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:19:24.594 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:24.629 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:19:24.629 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:19:24.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:24.629 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-29T11:19:24.636 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-29T11:19:24.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:19:24.637 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:19:24.637 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:24.644 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:19:24.644 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:19:24.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:24.645 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-29T11:19:24.650 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-29T11:19:24.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:19:24.651 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.765+0000 7ffbac9bf700 1 Processor -- start 2023-11-29T11:19:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.765+0000 7ffbac9bf700 1 -- start start 2023-11-29T11:19:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.765+0000 7ffbac9bf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffba80b32e0 0x7ffba80b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.765+0000 7ffbac9bf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 0x7ffba806a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.765+0000 7ffbac9bf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba80cbe00 con 0x7ffba81584c0 2023-11-29T11:19:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.765+0000 7ffbac9bf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba806dbd0 con 0x7ffba80b32e0 2023-11-29T11:19:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.765+0000 7ffbac9bf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80b3c60 con 0x7ffba8069cd0 2023-11-29T11:19:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffba80b32e0 0x7ffba80b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffba81584c0 0x7ffba80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60732/0 (socket says 172.21.15.81:60732) 2023-11-29T11:19:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba77fe700 1 -- 172.21.15.81:0/4113683195 learned_addr learned my addr 172.21.15.81:0/4113683195 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba7fff700 1 --2- 172.21.15.81:0/4113683195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 0x7ffba806a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba6ffd700 1 -- 172.21.15.81:0/4113683195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 msgr2=0x7ffba806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba6ffd700 1 --2- 172.21.15.81:0/4113683195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 0x7ffba806a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba6ffd700 1 -- 172.21.15.81:0/4113683195 >> v1:172.21.15.81:6789/0 conn(0x7ffba81584c0 legacy=0x7ffba80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba67fc700 1 -- 172.21.15.81:0/4113683195 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393951152 0 0) 0x7ffba80cbe00 con 0x7ffba81584c0 2023-11-29T11:19:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba6ffd700 1 -- 172.21.15.81:0/4113683195 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80cd0f0 con 0x7ffba80b32e0 2023-11-29T11:19:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba6ffd700 1 --2- 172.21.15.81:0/4113683195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba80b32e0 0x7ffba80b3720 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009880 tx=0x7ffb98009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5360b222951c8198 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba67fc700 1 -- 172.21.15.81:0/4113683195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98011830 con 0x7ffba80b32e0 2023-11-29T11:19:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba67fc700 1 -- 172.21.15.81:0/4113683195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb98011990 con 0x7ffba80b32e0 2023-11-29T11:19:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffba67fc700 1 -- 172.21.15.81:0/4113683195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98011d20 con 0x7ffba80b32e0 2023-11-29T11:19:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 -- 172.21.15.81:0/4113683195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba80b32e0 msgr2=0x7ffba80b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/4113683195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba80b32e0 0x7ffba80b3720 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009880 tx=0x7ffb98009b90 comp rx=0 tx=0).stop 2023-11-29T11:19:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 -- 172.21.15.81:0/4113683195 shutdown_connections 2023-11-29T11:19:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/4113683195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 0x7ffba806a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/4113683195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba80b32e0 0x7ffba80b3720 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 -- 172.21.15.81:0/4113683195 >> 172.21.15.81:0/4113683195 conn(0x7ffba80ce3e0 msgr2=0x7ffba80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 -- 172.21.15.81:0/4113683195 shutdown_connections 2023-11-29T11:19:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 -- 172.21.15.81:0/4113683195 wait complete. 2023-11-29T11:19:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.769+0000 7ffbac9bf700 1 Processor -- start 2023-11-29T11:19:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 -- start start 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 0x7ffba81518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba80b32e0 0x7ffba80c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba81584c0 0x7ffba8070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80af8b0 con 0x7ffba81584c0 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba8151de0 con 0x7ffba80b32e0 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba8097a90 con 0x7ffba8069cd0 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba81584c0 0x7ffba8070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba81584c0 0x7ffba8070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51716/0 (socket says 172.21.15.81:51716) 2023-11-29T11:19:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 -- 172.21.15.81:0/1698045611 learned_addr learned my addr 172.21.15.81:0/1698045611 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba77fe700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 0x7ffba81518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba6ffd700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba80b32e0 0x7ffba80c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 -- 172.21.15.81:0/1698045611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 msgr2=0x7ffba81518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 0x7ffba81518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 -- 172.21.15.81:0/1698045611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba80b32e0 msgr2=0x7ffba80c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba80b32e0 0x7ffba80c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 -- 172.21.15.81:0/1698045611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb980094b0 con 0x7ffba81584c0 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffba7fff700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba81584c0 0x7ffba8070800 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ffba0007ed0 tx=0x7ffba00105d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffb8ffff700 1 -- 172.21.15.81:0/1698045611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0013470 con 0x7ffba81584c0 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffb8ffff700 1 -- 172.21.15.81:0/1698045611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba00135f0 con 0x7ffba81584c0 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba80cd6b0 con 0x7ffba81584c0 2023-11-29T11:19:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffb8ffff700 1 -- 172.21.15.81:0/1698045611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba00139a0 con 0x7ffba81584c0 2023-11-29T11:19:24.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.773+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba80cd3d0 con 0x7ffba81584c0 2023-11-29T11:19:24.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.777+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba80cd990 con 0x7ffba81584c0 2023-11-29T11:19:24.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.777+0000 7ffb8ffff700 1 -- 172.21.15.81:0/1698045611 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffba0024070 con 0x7ffba81584c0 2023-11-29T11:19:24.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.777+0000 7ffb8ffff700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb94064ee0 0x7ffb94067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:24.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.777+0000 7ffb8ffff700 1 -- 172.21.15.81:0/1698045611 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7ffba0084e80 con 0x7ffba81584c0 2023-11-29T11:19:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.777+0000 7ffba77fe700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb94064ee0 0x7ffb94067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.777+0000 7ffba77fe700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb94064ee0 0x7ffb94067390 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c000f60 tx=0x7ffb9c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:24.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.785+0000 7ffb8ffff700 1 -- 172.21.15.81:0/1698045611 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffba0052de0 con 0x7ffba81584c0 2023-11-29T11:19:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.981+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffba8072500 con 0x7ffba81584c0 2023-11-29T11:19:24.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.981+0000 7ffb8ffff700 1 -- 172.21.15.81:0/1698045611 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4658 (secure 0 0 0) 0x7ffba0056400 con 0x7ffba81584c0 2023-11-29T11:19:24.989 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:24.989 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:51.075974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:19:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb94064ee0 msgr2=0x7ffb94067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb94064ee0 0x7ffb94067390 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c000f60 tx=0x7ffb9c009040 comp rx=0 tx=0).stop 2023-11-29T11:19:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba81584c0 msgr2=0x7ffba8070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba81584c0 0x7ffba8070800 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ffba0007ed0 tx=0x7ffba00105d0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 shutdown_connections 2023-11-29T11:19:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffb94064ee0 0x7ffb94067390 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffba81584c0 0x7ffba8070800 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffba80b32e0 0x7ffba80c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 --2- 172.21.15.81:0/1698045611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffba8069cd0 0x7ffba81518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 >> 172.21.15.81:0/1698045611 conn(0x7ffba80ce3e0 msgr2=0x7ffba80c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 shutdown_connections 2023-11-29T11:19:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:24.985+0000 7ffbac9bf700 1 -- 172.21.15.81:0/1698045611 wait complete. 2023-11-29T11:19:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 47 2023-11-29T11:19:25.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:25.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.101+0000 7f90a74e9700 1 Processor -- start 2023-11-29T11:19:25.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.101+0000 7f90a74e9700 1 -- start start 2023-11-29T11:19:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.101+0000 7f90a74e9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90a01606b0 0x7f90a00c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.101+0000 7f90a74e9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90a00ceef0 0x7f90a00c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.101+0000 7f90a74e9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a00cae70 con 0x7f90a00ad610 2023-11-29T11:19:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.101+0000 7f90a74e9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00cbc10 con 0x7f90a01606b0 2023-11-29T11:19:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.101+0000 7f90a74e9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00cb130 con 0x7f90a00ceef0 2023-11-29T11:19:25.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a6ce8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90a00ad610 0x7f90a0164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60742/0 (socket says 172.21.15.81:60742) 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a6ce8700 1 -- 172.21.15.81:0/1710204640 learned_addr learned my addr 172.21.15.81:0/1710204640 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a64e7700 1 --2- 172.21.15.81:0/1710204640 >> v2:172.21.15.81:3300/0 conn(0x7f90a01606b0 0x7f90a00c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a5ce6700 1 --2- 172.21.15.81:0/1710204640 >> v2:172.21.15.176:3300/0 conn(0x7f90a00ceef0 0x7f90a00c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a54e5700 1 -- 172.21.15.81:0/1710204640 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126514541 0 0) 0x7f90a00cae70 con 0x7f90a00ad610 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a54e5700 1 -- 172.21.15.81:0/1710204640 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f908c0035d0 con 0x7f90a00ad610 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a5ce6700 1 -- 172.21.15.81:0/1710204640 >> v2:172.21.15.81:3300/0 conn(0x7f90a01606b0 msgr2=0x7f90a00c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a5ce6700 1 --2- 172.21.15.81:0/1710204640 >> v2:172.21.15.81:3300/0 conn(0x7f90a01606b0 0x7f90a00c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a5ce6700 1 -- 172.21.15.81:0/1710204640 >> v1:172.21.15.81:6789/0 conn(0x7f90a00ad610 legacy=0x7f90a0164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a54e5700 1 -- 172.21.15.81:0/1710204640 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698227757 0 0) 0x7f908c0035d0 con 0x7f90a00ad610 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a5ce6700 1 -- 172.21.15.81:0/1710204640 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00cb410 con 0x7f90a00ceef0 2023-11-29T11:19:25.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a5ce6700 1 --2- 172.21.15.81:0/1710204640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ceef0 0x7f90a00c18f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f90a006b850 tx=0x7f909c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2215675ace47615 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a54e5700 1 -- 172.21.15.81:0/1710204640 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90980019f0 con 0x7f90a00ceef0 2023-11-29T11:19:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a54e5700 1 -- 172.21.15.81:0/1710204640 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c004030 con 0x7f90a00ceef0 2023-11-29T11:19:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a54e5700 1 -- 172.21.15.81:0/1710204640 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c0043c0 con 0x7f90a00ceef0 2023-11-29T11:19:25.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a74e9700 1 -- 172.21.15.81:0/1710204640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ceef0 msgr2=0x7f90a00c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1710204640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ceef0 0x7f90a00c18f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f90a006b850 tx=0x7f909c009b30 comp rx=0 tx=0).stop 2023-11-29T11:19:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a74e9700 1 -- 172.21.15.81:0/1710204640 shutdown_connections 2023-11-29T11:19:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1710204640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ceef0 0x7f90a00c18f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1710204640 >> v2:172.21.15.81:3300/0 conn(0x7f90a01606b0 0x7f90a00c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a74e9700 1 -- 172.21.15.81:0/1710204640 >> 172.21.15.81:0/1710204640 conn(0x7f90a00ce3e0 msgr2=0x7f90a00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a74e9700 1 -- 172.21.15.81:0/1710204640 shutdown_connections 2023-11-29T11:19:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.105+0000 7f90a74e9700 1 -- 172.21.15.81:0/1710204640 wait complete. 2023-11-29T11:19:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 Processor -- start 2023-11-29T11:19:25.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 -- start start 2023-11-29T11:19:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ad610 0x7f90a01f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ceef0 0x7f90a00c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a01606b0 0x7f90a00c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00aca20 con 0x7f90a01606b0 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a015df50 con 0x7f90a00ad610 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a015e230 con 0x7f90a00ceef0 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a01606b0 0x7f90a00c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a01606b0 0x7f90a00c2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51742/0 (socket says 172.21.15.81:51742) 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 -- 172.21.15.81:0/1631711428 learned_addr learned my addr 172.21.15.81:0/1631711428 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a64e7700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ad610 0x7f90a01f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a5ce6700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ceef0 0x7f90a00c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 -- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ceef0 msgr2=0x7f90a00c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ceef0 0x7f90a00c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 -- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ad610 msgr2=0x7f90a01f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ad610 0x7f90a01f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 -- 172.21.15.81:0/1631711428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0094b0 con 0x7f90a01606b0 2023-11-29T11:19:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a64e7700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ad610 0x7f90a01f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a6ce8700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a01606b0 0x7f90a00c2d80 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f909800cc00 tx=0x7f909800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f9096ffd700 1 -- 172.21.15.81:0/1631711428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800aa80 con 0x7f90a01606b0 2023-11-29T11:19:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f9096ffd700 1 -- 172.21.15.81:0/1631711428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800ac00 con 0x7f90a01606b0 2023-11-29T11:19:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a006ac50 con 0x7f90a01606b0 2023-11-29T11:19:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f9096ffd700 1 -- 172.21.15.81:0/1631711428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90980070d0 con 0x7f90a01606b0 2023-11-29T11:19:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.109+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a00cb6f0 con 0x7f90a01606b0 2023-11-29T11:19:25.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.113+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a00b36c0 con 0x7f90a01606b0 2023-11-29T11:19:25.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.113+0000 7f9096ffd700 1 -- 172.21.15.81:0/1631711428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f909801a030 con 0x7f90a01606b0 2023-11-29T11:19:25.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.113+0000 7f9096ffd700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9084064ee0 0x7f9084067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.113+0000 7f9096ffd700 1 -- 172.21.15.81:0/1631711428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f9098081c90 con 0x7f90a01606b0 2023-11-29T11:19:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.113+0000 7f90a64e7700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9084064ee0 0x7f9084067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.113+0000 7f90a64e7700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9084064ee0 0x7f9084067390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9090009f40 tx=0x7f9090009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.117+0000 7f9096ffd700 1 -- 172.21.15.81:0/1631711428 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f909804fc70 con 0x7f90a01606b0 2023-11-29T11:19:25.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.285+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90a0072500 con 0x7f90a01606b0 2023-11-29T11:19:25.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f9096ffd700 1 -- 172.21.15.81:0/1631711428 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18200 (secure 0 0 0) 0x7f9098018090 con 0x7f90a01606b0 2023-11-29T11:19:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:25.295 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:58.488981+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3247003029":"2023-11-30T11:17:58.488925+0000","172.21.15.81:6836/3247003029":"2023-11-30T11:17:58.488925+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9084064ee0 msgr2=0x7f9084067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9084064ee0 0x7f9084067390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9090009f40 tx=0x7f9090009240 comp rx=0 tx=0).stop 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a01606b0 msgr2=0x7f90a00c2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a01606b0 0x7f90a00c2d80 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f909800cc00 tx=0x7f909800cf10 comp rx=0 tx=0).stop 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 shutdown_connections 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9084064ee0 0x7f9084067390 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a01606b0 0x7f90a00c2d80 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90a00ceef0 0x7f90a00c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 --2- 172.21.15.81:0/1631711428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90a00ad610 0x7f90a01f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 >> 172.21.15.81:0/1631711428 conn(0x7f90a00ce3e0 msgr2=0x7f90a006ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 shutdown_connections 2023-11-29T11:19:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.289+0000 7f90a74e9700 1 -- 172.21.15.81:0/1631711428 wait complete. 2023-11-29T11:19:25.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:17:38.310347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:17:38.742094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:19:25.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:19:25.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.421+0000 7f1deffff700 1 Processor -- start 2023-11-29T11:19:25.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.421+0000 7f1deffff700 1 -- start start 2023-11-29T11:19:25.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1df00b00e0 0x7f1df015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1df009bdb0 0x7f1df015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00cbb30 0x7f1df015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df00b2db0 con 0x7f1df009bdb0 2023-11-29T11:19:25.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df00b3240 con 0x7f1df00b00e0 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df006d840 con 0x7f1df00cbb30 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1df009bdb0 0x7f1df015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1df009bdb0 0x7f1df015d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51748/0 (socket says 172.21.15.81:51748) 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 -- 172.21.15.81:0/210698395 learned_addr learned my addr 172.21.15.81:0/210698395 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1def7fe700 1 --2- 172.21.15.81:0/210698395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00cbb30 0x7f1df015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deeffd700 1 --2- 172.21.15.81:0/210698395 >> v2:172.21.15.176:3300/0 conn(0x7f1df00b00e0 0x7f1df015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 -- 172.21.15.81:0/210698395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00cbb30 msgr2=0x7f1df015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 --2- 172.21.15.81:0/210698395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00cbb30 0x7f1df015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 -- 172.21.15.81:0/210698395 >> v2:172.21.15.176:3300/0 conn(0x7f1df00b00e0 msgr2=0x7f1df015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 --2- 172.21.15.81:0/210698395 >> v2:172.21.15.176:3300/0 conn(0x7f1df00b00e0 0x7f1df015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 -- 172.21.15.81:0/210698395 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df006d560 con 0x7f1df009bdb0 2023-11-29T11:19:25.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dee7fc700 1 --2- 172.21.15.81:0/210698395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df009bdb0 0x7f1df015d820 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f1df006fbf0 tx=0x7f1de000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1b50cf1a4486b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dedffb700 1 -- 172.21.15.81:0/210698395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000e070 con 0x7f1df009bdb0 2023-11-29T11:19:25.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dedffb700 1 -- 172.21.15.81:0/210698395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000b9c0 con 0x7f1df009bdb0 2023-11-29T11:19:25.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1dedffb700 1 -- 172.21.15.81:0/210698395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000bd70 con 0x7f1df009bdb0 2023-11-29T11:19:25.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 -- 172.21.15.81:0/210698395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df009bdb0 msgr2=0x7f1df015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 --2- 172.21.15.81:0/210698395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df009bdb0 0x7f1df015d820 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f1df006fbf0 tx=0x7f1de000b330 comp rx=0 tx=0).stop 2023-11-29T11:19:25.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 -- 172.21.15.81:0/210698395 shutdown_connections 2023-11-29T11:19:25.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 --2- 172.21.15.81:0/210698395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00cbb30 0x7f1df015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 --2- 172.21.15.81:0/210698395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df009bdb0 0x7f1df015d820 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 --2- 172.21.15.81:0/210698395 >> v2:172.21.15.176:3300/0 conn(0x7f1df00b00e0 0x7f1df015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 -- 172.21.15.81:0/210698395 >> 172.21.15.81:0/210698395 conn(0x7f1df00cae70 msgr2=0x7f1df00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:25.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 -- 172.21.15.81:0/210698395 shutdown_connections 2023-11-29T11:19:25.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.425+0000 7f1deffff700 1 -- 172.21.15.81:0/210698395 wait complete. 2023-11-29T11:19:25.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deffff700 1 Processor -- start 2023-11-29T11:19:25.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deffff700 1 -- start start 2023-11-29T11:19:25.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df009bdb0 0x7f1df0071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00b00e0 0x7f1df00cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df00cbb30 0x7f1df0156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0071400 con 0x7f1df00cbb30 2023-11-29T11:19:25.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00704e0 con 0x7f1df009bdb0 2023-11-29T11:19:25.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0070780 con 0x7f1df00b00e0 2023-11-29T11:19:25.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1def7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df00cbb30 0x7f1df0156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1def7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df00cbb30 0x7f1df0156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51760/0 (socket says 172.21.15.81:51760) 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1def7fe700 1 -- 172.21.15.81:0/78217530 learned_addr learned my addr 172.21.15.81:0/78217530 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1deeffd700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df009bdb0 0x7f1df0071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1dee7fc700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00b00e0 0x7f1df00cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1def7fe700 1 -- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00b00e0 msgr2=0x7f1df00cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1def7fe700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00b00e0 0x7f1df00cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1def7fe700 1 -- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df009bdb0 msgr2=0x7f1df0071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1def7fe700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df009bdb0 0x7f1df0071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1def7fe700 1 -- 172.21.15.81:0/78217530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0009b30 con 0x7f1df00cbb30 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.429+0000 7f1dee7fc700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00b00e0 0x7f1df00cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1def7fe700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df00cbb30 0x7f1df0156ac0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1de800d800 tx=0x7f1de800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1de77fe700 1 -- 172.21.15.81:0/78217530 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80125f0 con 0x7f1df00cbb30 2023-11-29T11:19:25.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1de77fe700 1 -- 172.21.15.81:0/78217530 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de8012750 con 0x7f1df00cbb30 2023-11-29T11:19:25.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df00ac3d0 con 0x7f1df00cbb30 2023-11-29T11:19:25.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1de77fe700 1 -- 172.21.15.81:0/78217530 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8012b00 con 0x7f1df00cbb30 2023-11-29T11:19:25.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df00ac0f0 con 0x7f1df00cbb30 2023-11-29T11:19:25.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df00cc9f0 con 0x7f1df00cbb30 2023-11-29T11:19:25.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1de77fe700 1 -- 172.21.15.81:0/78217530 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1de8012c60 con 0x7f1df00cbb30 2023-11-29T11:19:25.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1de77fe700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd0064ee0 0x7f1dd0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1de77fe700 1 -- 172.21.15.81:0/78217530 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f1de80822c0 con 0x7f1df00cbb30 2023-11-29T11:19:25.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.433+0000 7f1deeffd700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd0064ee0 0x7f1dd0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.437+0000 7f1deeffd700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd0064ee0 0x7f1dd0067390 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1df0151020 tx=0x7f1dd8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.441+0000 7f1de77fe700 1 -- 172.21.15.81:0/78217530 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1de80502a0 con 0x7f1df00cbb30 2023-11-29T11:19:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.601+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1df00b1bc0 con 0x7f1df00cbb30 2023-11-29T11:19:25.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1de77fe700 1 -- 172.21.15.81:0/78217530 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1de80538c0 con 0x7f1df00cbb30 2023-11-29T11:19:25.611 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd0064ee0 msgr2=0x7f1dd0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd0064ee0 0x7f1dd0067390 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1df0151020 tx=0x7f1dd8008040 comp rx=0 tx=0).stop 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df00cbb30 msgr2=0x7f1df0156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df00cbb30 0x7f1df0156ac0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1de800d800 tx=0x7f1de800db10 comp rx=0 tx=0).stop 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 shutdown_connections 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1dd0064ee0 0x7f1dd0067390 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1df00cbb30 0x7f1df0156ac0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1df00b00e0 0x7f1df00cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 --2- 172.21.15.81:0/78217530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1df009bdb0 0x7f1df0071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 >> 172.21.15.81:0/78217530 conn(0x7f1df00cae70 msgr2=0x7f1df0153b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 shutdown_connections 2023-11-29T11:19:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.605+0000 7f1deffff700 1 -- 172.21.15.81:0/78217530 wait complete. 2023-11-29T11:19:25.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:19:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eda9c700 1 Processor -- start 2023-11-29T11:19:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eda9c700 1 -- start start 2023-11-29T11:19:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eda9c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54e80b1ae0 0x7f54e806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eda9c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f54e80cf0e0 0x7f54e80cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eda9c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e80cfa40 con 0x7f54e806a4c0 2023-11-29T11:19:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eda9c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e80d0ab0 con 0x7f54e80b1ae0 2023-11-29T11:19:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eda9c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e806a9c0 con 0x7f54e80cf0e0 2023-11-29T11:19:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eca9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54e80b1ae0 0x7f54e806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eca9a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54e80b1ae0 0x7f54e806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51766/0 (socket says 172.21.15.81:51766) 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eca9a700 1 -- 172.21.15.81:0/1344174987 learned_addr learned my addr 172.21.15.81:0/1344174987 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54ed29b700 1 --2- 172.21.15.81:0/1344174987 >> v2:172.21.15.176:3300/0 conn(0x7f54e80cf0e0 0x7f54e80cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eca9a700 1 -- 172.21.15.81:0/1344174987 >> v2:172.21.15.176:3300/0 conn(0x7f54e80cf0e0 msgr2=0x7f54e80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eca9a700 1 --2- 172.21.15.81:0/1344174987 >> v2:172.21.15.176:3300/0 conn(0x7f54e80cf0e0 0x7f54e80cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eca9a700 1 -- 172.21.15.81:0/1344174987 >> v1:172.21.15.176:6789/0 conn(0x7f54e806a4c0 legacy=0x7f54e80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eca9a700 1 -- 172.21.15.81:0/1344174987 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e806aca0 con 0x7f54e80b1ae0 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54eca9a700 1 --2- 172.21.15.81:0/1344174987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80b1ae0 0x7f54e806d8e0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f54e80b6440 tx=0x7f54e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7b964fe5a4bff1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54e77fe700 1 -- 172.21.15.81:0/1344174987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e000e070 con 0x7f54e80b1ae0 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54e77fe700 1 -- 172.21.15.81:0/1344174987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0003a40 con 0x7f54e80b1ae0 2023-11-29T11:19:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.737+0000 7f54e77fe700 1 -- 172.21.15.81:0/1344174987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0003df0 con 0x7f54e80b1ae0 2023-11-29T11:19:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- 172.21.15.81:0/1344174987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80b1ae0 msgr2=0x7f54e806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 --2- 172.21.15.81:0/1344174987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80b1ae0 0x7f54e806d8e0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f54e80b6440 tx=0x7f54e000b330 comp rx=0 tx=0).stop 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- 172.21.15.81:0/1344174987 shutdown_connections 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 --2- 172.21.15.81:0/1344174987 >> v2:172.21.15.176:3300/0 conn(0x7f54e80cf0e0 0x7f54e80cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 --2- 172.21.15.81:0/1344174987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80b1ae0 0x7f54e806d8e0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- 172.21.15.81:0/1344174987 >> 172.21.15.81:0/1344174987 conn(0x7f54e809bbd0 msgr2=0x7f54e80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- 172.21.15.81:0/1344174987 shutdown_connections 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- 172.21.15.81:0/1344174987 wait complete. 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 Processor -- start 2023-11-29T11:19:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- start start 2023-11-29T11:19:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54e806a4c0 0x7f54e815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54e80b1ae0 0x7f54e809cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80cf0e0 0x7f54e81586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e809d400 con 0x7f54e80cf0e0 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8158f10 con 0x7f54e80b1ae0 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eda9c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8159a90 con 0x7f54e806a4c0 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80cf0e0 0x7f54e81586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80cf0e0 0x7f54e81586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51772/0 (socket says 172.21.15.81:51772) 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 -- 172.21.15.81:0/3446727721 learned_addr learned my addr 172.21.15.81:0/3446727721 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54eca9a700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54e806a4c0 0x7f54e815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54e7fff700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54e80b1ae0 0x7f54e809cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 -- 172.21.15.81:0/3446727721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54e806a4c0 msgr2=0x7f54e815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54e806a4c0 0x7f54e815b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 -- 172.21.15.81:0/3446727721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54e80b1ae0 msgr2=0x7f54e809cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54e80b1ae0 0x7f54e809cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 -- 172.21.15.81:0/3446727721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0009b30 con 0x7f54e80cf0e0 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.741+0000 7f54ed29b700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80cf0e0 0x7f54e81586e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f54d800e810 tx=0x7f54d800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54e57fa700 1 -- 172.21.15.81:0/3446727721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d800c070 con 0x7f54e80cf0e0 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54e57fa700 1 -- 172.21.15.81:0/3446727721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d8013650 con 0x7f54e80cf0e0 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e80b4380 con 0x7f54e80cf0e0 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54e57fa700 1 -- 172.21.15.81:0/3446727721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8013a00 con 0x7f54e80cf0e0 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e806af80 con 0x7f54e80cf0e0 2023-11-29T11:19:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e80b1eb0 con 0x7f54e80cf0e0 2023-11-29T11:19:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54e57fa700 1 -- 172.21.15.81:0/3446727721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f54d8013b60 con 0x7f54e80cf0e0 2023-11-29T11:19:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54e57fa700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54d4064ee0 0x7f54d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.745+0000 7f54e57fa700 1 -- 172.21.15.81:0/3446727721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f54d8082480 con 0x7f54e80cf0e0 2023-11-29T11:19:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.749+0000 7f54eca9a700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54d4064ee0 0x7f54d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.749+0000 7f54eca9a700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54d4064ee0 0x7f54d4067390 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f54e0000f80 tx=0x7f54e0009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.753+0000 7f54e57fa700 1 -- 172.21.15.81:0/3446727721 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f54d80504a0 con 0x7f54e80cf0e0 2023-11-29T11:19:25.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54e8072500 con 0x7f54e80cf0e0 2023-11-29T11:19:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54e57fa700 1 -- 172.21.15.81:0/3446727721 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54d8053ac0 con 0x7f54e80cf0e0 2023-11-29T11:19:25.916 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:19:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54d4064ee0 msgr2=0x7f54d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54d4064ee0 0x7f54d4067390 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f54e0000f80 tx=0x7f54e0009000 comp rx=0 tx=0).stop 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80cf0e0 msgr2=0x7f54e81586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80cf0e0 0x7f54e81586e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f54d800e810 tx=0x7f54d800eb20 comp rx=0 tx=0).stop 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 shutdown_connections 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f54d4064ee0 0x7f54d4067390 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54e80cf0e0 0x7f54e81586e0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54e80b1ae0 0x7f54e809cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 --2- 172.21.15.81:0/3446727721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54e806a4c0 0x7f54e815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.909+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 >> 172.21.15.81:0/3446727721 conn(0x7f54e809bbd0 msgr2=0x7f54e80d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:25.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.913+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 shutdown_connections 2023-11-29T11:19:25.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:25.913+0000 7f54eda9c700 1 -- 172.21.15.81:0/3446727721 wait complete. 2023-11-29T11:19:25.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:19:26.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.041+0000 7fc2b491a700 1 Processor -- start 2023-11-29T11:19:26.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.041+0000 7fc2b491a700 1 -- start start 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.041+0000 7fc2b491a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b006a4c0 0x7fc2b006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.041+0000 7fc2b491a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2b00cf0e0 0x7fc2b00cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.041+0000 7fc2b491a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b00cfa80 con 0x7fc2b00b1ae0 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.041+0000 7fc2b491a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b00d0ab0 con 0x7fc2b00cf0e0 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.041+0000 7fc2b491a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b006a9c0 con 0x7fc2b006a4c0 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2affff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2b00cf0e0 0x7fc2b00cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2af7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2b00b1ae0 0x7fc2b00d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60754/0 (socket says 172.21.15.81:60754) 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2af7fe700 1 -- 172.21.15.81:0/1971013973 learned_addr learned my addr 172.21.15.81:0/1971013973 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:26.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2aeffd700 1 --2- 172.21.15.81:0/1971013973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b006a4c0 0x7fc2b006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2affff700 1 -- 172.21.15.81:0/1971013973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b006a4c0 msgr2=0x7fc2b006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:26.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2affff700 1 --2- 172.21.15.81:0/1971013973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b006a4c0 0x7fc2b006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2affff700 1 -- 172.21.15.81:0/1971013973 >> v1:172.21.15.81:6789/0 conn(0x7fc2b00b1ae0 legacy=0x7fc2b00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2affff700 1 -- 172.21.15.81:0/1971013973 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b006aca0 con 0x7fc2b00cf0e0 2023-11-29T11:19:26.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2ae7fc700 1 -- 172.21.15.81:0/1971013973 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281447971 0 0) 0x7fc2b00cfa80 con 0x7fc2b00b1ae0 2023-11-29T11:19:26.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2affff700 1 --2- 172.21.15.81:0/1971013973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b00cf0e0 0x7fc2b00cf540 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009d90 tx=0x7fc2a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8699709eecfe4092 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2ae7fc700 1 -- 172.21.15.81:0/1971013973 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a800e070 con 0x7fc2b00cf0e0 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2ae7fc700 1 -- 172.21.15.81:0/1971013973 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a800bb20 con 0x7fc2b00cf0e0 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2ae7fc700 1 -- 172.21.15.81:0/1971013973 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8012430 con 0x7fc2b00cf0e0 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 -- 172.21.15.81:0/1971013973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b00cf0e0 msgr2=0x7fc2b00cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1971013973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b00cf0e0 0x7fc2b00cf540 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009d90 tx=0x7fc2a800b330 comp rx=0 tx=0).stop 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 -- 172.21.15.81:0/1971013973 shutdown_connections 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1971013973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b00cf0e0 0x7fc2b00cf540 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1971013973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b006a4c0 0x7fc2b006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 -- 172.21.15.81:0/1971013973 >> 172.21.15.81:0/1971013973 conn(0x7fc2b009bbd0 msgr2=0x7fc2b00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:26.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 -- 172.21.15.81:0/1971013973 shutdown_connections 2023-11-29T11:19:26.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 -- 172.21.15.81:0/1971013973 wait complete. 2023-11-29T11:19:26.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 Processor -- start 2023-11-29T11:19:26.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.045+0000 7fc2b491a700 1 -- start start 2023-11-29T11:19:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2b491a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b006a4c0 0x7fc2b014bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2b491a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b00b1ae0 0x7fc2b00d1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2b491a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00cf0e0 0x7fc2b00af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2b491a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b014c240 con 0x7fc2b006a4c0 2023-11-29T11:19:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2b491a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00c7050 con 0x7fc2b00cf0e0 2023-11-29T11:19:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2b491a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00c7b40 con 0x7fc2b00b1ae0 2023-11-29T11:19:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b006a4c0 0x7fc2b014bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b006a4c0 0x7fc2b014bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51792/0 (socket says 172.21.15.81:51792) 2023-11-29T11:19:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 -- 172.21.15.81:0/1734992794 learned_addr learned my addr 172.21.15.81:0/1734992794 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2affff700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00cf0e0 0x7fc2b00af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2aeffd700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b00b1ae0 0x7fc2b00d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 -- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b00b1ae0 msgr2=0x7fc2b00d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b00b1ae0 0x7fc2b00d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 -- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00cf0e0 msgr2=0x7fc2b00af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00cf0e0 0x7fc2b00af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 -- 172.21.15.81:0/1734992794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8009a70 con 0x7fc2b006a4c0 2023-11-29T11:19:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2affff700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00cf0e0 0x7fc2b00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2af7fe700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b006a4c0 0x7fc2b014bd00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400c580 tx=0x7fc2a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc297fff700 1 -- 172.21.15.81:0/1734992794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4004ca0 con 0x7fc2b006a4c0 2023-11-29T11:19:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b00b4380 con 0x7fc2b006a4c0 2023-11-29T11:19:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc297fff700 1 -- 172.21.15.81:0/1734992794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4004e20 con 0x7fc2b006a4c0 2023-11-29T11:19:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc297fff700 1 -- 172.21.15.81:0/1734992794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40072d0 con 0x7fc2b006a4c0 2023-11-29T11:19:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.049+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b006af80 con 0x7fc2b006a4c0 2023-11-29T11:19:26.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.053+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b00b1eb0 con 0x7fc2b006a4c0 2023-11-29T11:19:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.053+0000 7fc297fff700 1 -- 172.21.15.81:0/1734992794 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc2a401a020 con 0x7fc2b006a4c0 2023-11-29T11:19:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.053+0000 7fc297fff700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc29c064f10 0x7fc29c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.053+0000 7fc2aeffd700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc29c064f10 0x7fc29c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.053+0000 7fc297fff700 1 -- 172.21.15.81:0/1734992794 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fc2a4081ae0 con 0x7fc2b006a4c0 2023-11-29T11:19:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.053+0000 7fc2aeffd700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc29c064f10 0x7fc29c0673c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00b0710 tx=0x7fc2a0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.057+0000 7fc297fff700 1 -- 172.21.15.81:0/1734992794 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc2a404f950 con 0x7fc2b006a4c0 2023-11-29T11:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2b0072500 con 0x7fc2b006a4c0 2023-11-29T11:19:26.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc297fff700 1 -- 172.21.15.81:0/1734992794 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2a4052f70 con 0x7fc2b006a4c0 2023-11-29T11:19:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc29c064f10 msgr2=0x7fc29c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc29c064f10 0x7fc29c0673c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00b0710 tx=0x7fc2a0009240 comp rx=0 tx=0).stop 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b006a4c0 msgr2=0x7fc2b014bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b006a4c0 0x7fc2b014bd00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400c580 tx=0x7fc2a400c890 comp rx=0 tx=0).stop 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 shutdown_connections 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc29c064f10 0x7fc29c0673c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00cf0e0 0x7fc2b00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b00b1ae0 0x7fc2b00d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 --2- 172.21.15.81:0/1734992794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b006a4c0 0x7fc2b014bd00 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 >> 172.21.15.81:0/1734992794 conn(0x7fc2b009bbd0 msgr2=0x7fc2b00cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:26.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 shutdown_connections 2023-11-29T11:19:26.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.221+0000 7fc2b491a700 1 -- 172.21.15.81:0/1734992794 wait complete. 2023-11-29T11:19:26.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:19:26.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecdd6a700 1 Processor -- start 2023-11-29T11:19:26.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecdd6a700 1 -- start start 2023-11-29T11:19:26.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecdd6a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feec80b00e0 0x7feec815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecdd6a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feec80cbb30 0x7feec806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecdd6a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec80b2db0 con 0x7feec809bdb0 2023-11-29T11:19:26.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecdd6a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec80b3240 con 0x7feec80cbb30 2023-11-29T11:19:26.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecdd6a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec806d840 con 0x7feec80b00e0 2023-11-29T11:19:26.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feec7fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feec809bdb0 0x7feec815d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60768/0 (socket says 172.21.15.81:60768) 2023-11-29T11:19:26.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feec7fff700 1 -- 172.21.15.81:0/202505089 learned_addr learned my addr 172.21.15.81:0/202505089 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:26.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecd569700 1 --2- 172.21.15.81:0/202505089 >> v2:172.21.15.81:3300/0 conn(0x7feec80cbb30 0x7feec806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feeccd68700 1 --2- 172.21.15.81:0/202505089 >> v2:172.21.15.176:3300/0 conn(0x7feec80b00e0 0x7feec815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feec77fe700 1 -- 172.21.15.81:0/202505089 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787084950 0 0) 0x7feec80b2db0 con 0x7feec809bdb0 2023-11-29T11:19:26.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feec77fe700 1 -- 172.21.15.81:0/202505089 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb40035d0 con 0x7feec809bdb0 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feec77fe700 1 -- 172.21.15.81:0/202505089 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1619872112 0 0) 0x7feeb40035d0 con 0x7feec809bdb0 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecd569700 1 -- 172.21.15.81:0/202505089 >> v2:172.21.15.176:3300/0 conn(0x7feec80b00e0 msgr2=0x7feec815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecd569700 1 --2- 172.21.15.81:0/202505089 >> v2:172.21.15.176:3300/0 conn(0x7feec80b00e0 0x7feec815d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecd569700 1 -- 172.21.15.81:0/202505089 >> v1:172.21.15.81:6789/0 conn(0x7feec809bdb0 legacy=0x7feec815d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feecd569700 1 -- 172.21.15.81:0/202505089 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec806d560 con 0x7feec80cbb30 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.349+0000 7feeccd68700 1 --2- 172.21.15.81:0/202505089 >> v2:172.21.15.176:3300/0 conn(0x7feec80b00e0 0x7feec815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecd569700 1 --2- 172.21.15.81:0/202505089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec806bbd0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7feec806fbf0 tx=0x7feec000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2da203151ab82c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feec77fe700 1 -- 172.21.15.81:0/202505089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000e070 con 0x7feec80cbb30 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feec77fe700 1 -- 172.21.15.81:0/202505089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0003a40 con 0x7feec80cbb30 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feec77fe700 1 -- 172.21.15.81:0/202505089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8001670 con 0x7feec80cbb30 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- 172.21.15.81:0/202505089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 msgr2=0x7feec806bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 --2- 172.21.15.81:0/202505089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec806bbd0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7feec806fbf0 tx=0x7feec000b330 comp rx=0 tx=0).stop 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- 172.21.15.81:0/202505089 shutdown_connections 2023-11-29T11:19:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 --2- 172.21.15.81:0/202505089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec806bbd0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 --2- 172.21.15.81:0/202505089 >> v2:172.21.15.176:3300/0 conn(0x7feec80b00e0 0x7feec815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- 172.21.15.81:0/202505089 >> 172.21.15.81:0/202505089 conn(0x7feec80cae70 msgr2=0x7feec80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:26.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- 172.21.15.81:0/202505089 shutdown_connections 2023-11-29T11:19:26.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- 172.21.15.81:0/202505089 wait complete. 2023-11-29T11:19:26.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 Processor -- start 2023-11-29T11:19:26.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- start start 2023-11-29T11:19:26.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec809bdb0 0x7feec815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b00e0 0x7feec815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec80c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80c9c40 con 0x7feec80cbb30 2023-11-29T11:19:26.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80ca7c0 con 0x7feec809bdb0 2023-11-29T11:19:26.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.353+0000 7feecdd6a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec80cac50 con 0x7feec80b00e0 2023-11-29T11:19:26.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec80c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec80c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51814/0 (socket says 172.21.15.81:51814) 2023-11-29T11:19:26.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 -- 172.21.15.81:0/4085504696 learned_addr learned my addr 172.21.15.81:0/4085504696 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:26.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feec7fff700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b00e0 0x7feec815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feeccd68700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec809bdb0 0x7feec815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 -- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b00e0 msgr2=0x7feec815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b00e0 0x7feec815afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 -- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec809bdb0 msgr2=0x7feec815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec809bdb0 0x7feec815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 -- 172.21.15.81:0/4085504696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009a70 con 0x7feec80cbb30 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feec7fff700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b00e0 0x7feec815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecd569700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec80c8a20 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7feec000b020 tx=0x7feec0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feec57fa700 1 -- 172.21.15.81:0/4085504696 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0004600 con 0x7feec80cbb30 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feec57fa700 1 -- 172.21.15.81:0/4085504696 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0004780 con 0x7feec80cbb30 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feec57fa700 1 -- 172.21.15.81:0/4085504696 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0012430 con 0x7feec80cbb30 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec80ac3d0 con 0x7feec80cbb30 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80ac0f0 con 0x7feec80cbb30 2023-11-29T11:19:26.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec80cc9f0 con 0x7feec80cbb30 2023-11-29T11:19:26.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.357+0000 7feec57fa700 1 -- 172.21.15.81:0/4085504696 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feec002d070 con 0x7feec80cbb30 2023-11-29T11:19:26.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.361+0000 7feec57fa700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feea8064ee0 0x7feea8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.361+0000 7feec57fa700 1 -- 172.21.15.81:0/4085504696 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7feec00840d0 con 0x7feec80cbb30 2023-11-29T11:19:26.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.361+0000 7feeccd68700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feea8064ee0 0x7feea8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.361+0000 7feeccd68700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feea8064ee0 0x7feea8067390 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7feeb00099f0 tx=0x7feeb0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.365+0000 7feec57fa700 1 -- 172.21.15.81:0/4085504696 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feec00520b0 con 0x7feec80cbb30 2023-11-29T11:19:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.525+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feec8072500 con 0x7feec80cbb30 2023-11-29T11:19:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feec57fa700 1 -- 172.21.15.81:0/4085504696 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7feec00556d0 con 0x7feec80cbb30 2023-11-29T11:19:26.535 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:19:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feea8064ee0 msgr2=0x7feea8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feea8064ee0 0x7feea8067390 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7feeb00099f0 tx=0x7feeb0008040 comp rx=0 tx=0).stop 2023-11-29T11:19:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 msgr2=0x7feec80c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec80c8a20 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7feec000b020 tx=0x7feec0004af0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 shutdown_connections 2023-11-29T11:19:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feea8064ee0 0x7feea8067390 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80cbb30 0x7feec80c8a20 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feec80b00e0 0x7feec815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 --2- 172.21.15.81:0/4085504696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feec809bdb0 0x7feec815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 >> 172.21.15.81:0/4085504696 conn(0x7feec80cae70 msgr2=0x7feec806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 shutdown_connections 2023-11-29T11:19:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.529+0000 7feecdd6a700 1 -- 172.21.15.81:0/4085504696 wait complete. 2023-11-29T11:19:26.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:26.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:19:26.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:19:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9ff39b700 1 Processor -- start 2023-11-29T11:19:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9ff39b700 1 -- start start 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9ff39b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe9f8152bb0 0x7fe9f815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9ff39b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9ff39b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f8152f80 con 0x7fe9f80706f0 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9ff39b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f806cff0 con 0x7fe9f8152bb0 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9ff39b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f815cfe0 con 0x7fe9f806c640 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9feb9a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe9f80706f0 0x7fe9f8070b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60778/0 (socket says 172.21.15.81:60778) 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9feb9a700 1 -- 172.21.15.81:0/3925069854 learned_addr learned my addr 172.21.15.81:0/3925069854 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fe399700 1 --2- 172.21.15.81:0/3925069854 >> v2:172.21.15.176:3300/0 conn(0x7fe9f8152bb0 0x7fe9f815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fdb98700 1 --2- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fd397700 1 -- 172.21.15.81:0/3925069854 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437998969 0 0) 0x7fe9f8152f80 con 0x7fe9f80706f0 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fd397700 1 -- 172.21.15.81:0/3925069854 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e40046e0 con 0x7fe9f80706f0 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fe399700 1 -- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 msgr2=0x7fe9f806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fe399700 1 --2- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fd397700 1 -- 172.21.15.81:0/3925069854 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044124730 0 0) 0x7fe9e40046e0 con 0x7fe9f80706f0 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fe399700 1 -- 172.21.15.81:0/3925069854 >> v1:172.21.15.81:6789/0 conn(0x7fe9f80706f0 legacy=0x7fe9f8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fe399700 1 -- 172.21.15.81:0/3925069854 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8159a30 con 0x7fe9f8152bb0 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fdb98700 1 --2- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.657+0000 7fe9fe399700 1 --2- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f8152bb0 0x7fe9f815caa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009850 tx=0x7fe9f4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4ee022f17ed755d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9fd397700 1 -- 172.21.15.81:0/3925069854 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00019f0 con 0x7fe9f8152bb0 2023-11-29T11:19:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9fd397700 1 -- 172.21.15.81:0/3925069854 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f4004030 con 0x7fe9f8152bb0 2023-11-29T11:19:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9fd397700 1 -- 172.21.15.81:0/3925069854 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40043a0 con 0x7fe9f8152bb0 2023-11-29T11:19:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 -- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f8152bb0 msgr2=0x7fe9f815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f8152bb0 0x7fe9f815caa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009850 tx=0x7fe9f4009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 -- 172.21.15.81:0/3925069854 shutdown_connections 2023-11-29T11:19:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/3925069854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f8152bb0 0x7fe9f815caa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 -- 172.21.15.81:0/3925069854 >> 172.21.15.81:0/3925069854 conn(0x7fe9f806e000 msgr2=0x7fe9f80b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 -- 172.21.15.81:0/3925069854 shutdown_connections 2023-11-29T11:19:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 -- 172.21.15.81:0/3925069854 wait complete. 2023-11-29T11:19:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 Processor -- start 2023-11-29T11:19:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.661+0000 7fe9ff39b700 1 -- start start 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9ff39b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f80cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9ff39b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f80706f0 0x7fe9f8141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9ff39b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f8152bb0 0x7fe9f814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9ff39b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f814d880 con 0x7fe9f8152bb0 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9ff39b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f814ac40 con 0x7fe9f80706f0 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9ff39b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f814d2c0 con 0x7fe9f806c640 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f8152bb0 0x7fe9f814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f8152bb0 0x7fe9f814c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51820/0 (socket says 172.21.15.81:51820) 2023-11-29T11:19:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 -- 172.21.15.81:0/1389981859 learned_addr learned my addr 172.21.15.81:0/1389981859 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9fdb98700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f80706f0 0x7fe9f8141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9fe399700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f80cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 -- 172.21.15.81:0/1389981859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 msgr2=0x7fe9f80cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f80cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 -- 172.21.15.81:0/1389981859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f80706f0 msgr2=0x7fe9f8141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f80706f0 0x7fe9f8141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 -- 172.21.15.81:0/1389981859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e80094b0 con 0x7fe9f8152bb0 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9feb9a700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f8152bb0 0x7fe9f814c8e0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000cbe0 tx=0x7fe9f000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9eeffd700 1 -- 172.21.15.81:0/1389981859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000aa60 con 0x7fe9f8152bb0 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9eeffd700 1 -- 172.21.15.81:0/1389981859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f000abe0 con 0x7fe9f8152bb0 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f40094b0 con 0x7fe9f8152bb0 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9eeffd700 1 -- 172.21.15.81:0/1389981859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00070d0 con 0x7fe9f8152bb0 2023-11-29T11:19:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.665+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f8159190 con 0x7fe9f8152bb0 2023-11-29T11:19:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.669+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f8158eb0 con 0x7fe9f8152bb0 2023-11-29T11:19:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.669+0000 7fe9eeffd700 1 -- 172.21.15.81:0/1389981859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe9f001a030 con 0x7fe9f8152bb0 2023-11-29T11:19:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.669+0000 7fe9eeffd700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9dc064ee0 0x7fe9dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.669+0000 7fe9eeffd700 1 -- 172.21.15.81:0/1389981859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fe9f0081d80 con 0x7fe9f8152bb0 2023-11-29T11:19:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.669+0000 7fe9fe399700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9dc064ee0 0x7fe9dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.669+0000 7fe9fe399700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9dc064ee0 0x7fe9dc067390 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40090b0 tx=0x7fe9f4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.677+0000 7fe9eeffd700 1 -- 172.21.15.81:0/1389981859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe9f004fc10 con 0x7fe9f8152bb0 2023-11-29T11:19:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.873+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9f8159440 con 0x7fe9f8152bb0 2023-11-29T11:19:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9eeffd700 1 -- 172.21.15.81:0/1389981859 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4658 (secure 0 0 0) 0x7fe9f0018090 con 0x7fe9f8152bb0 2023-11-29T11:19:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:26.882 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:51.075974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9dc064ee0 msgr2=0x7fe9dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9dc064ee0 0x7fe9dc067390 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40090b0 tx=0x7fe9f4008030 comp rx=0 tx=0).stop 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f8152bb0 msgr2=0x7fe9f814c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f8152bb0 0x7fe9f814c8e0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000cbe0 tx=0x7fe9f000cef0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 shutdown_connections 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe9dc064ee0 0x7fe9dc067390 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f8152bb0 0x7fe9f814c8e0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9f80706f0 0x7fe9f8141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 --2- 172.21.15.81:0/1389981859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9f806c640 0x7fe9f80cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 >> 172.21.15.81:0/1389981859 conn(0x7fe9f806e000 msgr2=0x7fe9f806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 shutdown_connections 2023-11-29T11:19:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:26.877+0000 7fe9ff39b700 1 -- 172.21.15.81:0/1389981859 wait complete. 2023-11-29T11:19:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 47 2023-11-29T11:19:26.897 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe57503d700 1 Processor -- start 2023-11-29T11:19:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe57503d700 1 -- start start 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe57503d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe570156c70 0x7fe5700b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe57503d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe57006a350 0x7fe5700b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe57503d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57006abe0 con 0x7fe57015d690 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe57503d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57015c9c0 con 0x7fe57006a350 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe57503d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57006a900 con 0x7fe570156c70 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe56e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe57015d690 0x7fe570069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60784/0 (socket says 172.21.15.81:60784) 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe56e59c700 1 -- 172.21.15.81:0/3899141824 learned_addr learned my addr 172.21.15.81:0/3899141824 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe56f59e700 1 --2- 172.21.15.81:0/3899141824 >> v2:172.21.15.81:3300/0 conn(0x7fe57006a350 0x7fe5700b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe56ed9d700 1 --2- 172.21.15.81:0/3899141824 >> v2:172.21.15.176:3300/0 conn(0x7fe570156c70 0x7fe5700b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe56dd9b700 1 -- 172.21.15.81:0/3899141824 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256981237 0 0) 0x7fe560001110 con 0x7fe57015d690 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.001+0000 7fe56dd9b700 1 -- 172.21.15.81:0/3899141824 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5580035d0 con 0x7fe57015d690 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe56f59e700 1 -- 172.21.15.81:0/3899141824 >> v2:172.21.15.176:3300/0 conn(0x7fe570156c70 msgr2=0x7fe5700b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe56f59e700 1 --2- 172.21.15.81:0/3899141824 >> v2:172.21.15.176:3300/0 conn(0x7fe570156c70 0x7fe5700b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe56f59e700 1 -- 172.21.15.81:0/3899141824 >> v1:172.21.15.81:6789/0 conn(0x7fe57015d690 legacy=0x7fe570069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe56f59e700 1 -- 172.21.15.81:0/3899141824 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57015cbb0 con 0x7fe57006a350 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe56f59e700 1 --2- 172.21.15.81:0/3899141824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe5700b4ba0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe57008bd40 tx=0x7fe56800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848d3613137fae00 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe56dd9b700 1 -- 172.21.15.81:0/3899141824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800e070 con 0x7fe57006a350 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe56dd9b700 1 -- 172.21.15.81:0/3899141824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800bb20 con 0x7fe57006a350 2023-11-29T11:19:27.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe56dd9b700 1 -- 172.21.15.81:0/3899141824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568012430 con 0x7fe57006a350 2023-11-29T11:19:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe57503d700 1 -- 172.21.15.81:0/3899141824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 msgr2=0x7fe5700b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe57503d700 1 --2- 172.21.15.81:0/3899141824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe5700b4ba0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe57008bd40 tx=0x7fe56800b330 comp rx=0 tx=0).stop 2023-11-29T11:19:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe57503d700 1 -- 172.21.15.81:0/3899141824 shutdown_connections 2023-11-29T11:19:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe57503d700 1 --2- 172.21.15.81:0/3899141824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe5700b4ba0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe57503d700 1 --2- 172.21.15.81:0/3899141824 >> v2:172.21.15.176:3300/0 conn(0x7fe570156c70 0x7fe5700b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe57503d700 1 -- 172.21.15.81:0/3899141824 >> 172.21.15.81:0/3899141824 conn(0x7fe57006ca90 msgr2=0x7fe5700cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe57503d700 1 -- 172.21.15.81:0/3899141824 shutdown_connections 2023-11-29T11:19:27.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.005+0000 7fe57503d700 1 -- 172.21.15.81:0/3899141824 wait complete. 2023-11-29T11:19:27.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 Processor -- start 2023-11-29T11:19:27.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 -- start start 2023-11-29T11:19:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe570157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe570156c70 0x7fe57015b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe57015d690 0x7fe5701f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700b89f0 con 0x7fe57006a350 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe570157580 con 0x7fe57015d690 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5701578c0 con 0x7fe570156c70 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe570157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe570157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51846/0 (socket says 172.21.15.81:51846) 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 -- 172.21.15.81:0/1924126015 learned_addr learned my addr 172.21.15.81:0/1924126015 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56e59c700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe570156c70 0x7fe57015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56f59e700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe57015d690 0x7fe5701f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 -- 172.21.15.81:0/1924126015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe570156c70 msgr2=0x7fe57015b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe570156c70 0x7fe57015b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 -- 172.21.15.81:0/1924126015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe57015d690 msgr2=0x7fe5701f19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe57015d690 0x7fe5701f19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 -- 172.21.15.81:0/1924126015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568009a70 con 0x7fe57006a350 2023-11-29T11:19:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe56ed9d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe570157040 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe56400e9d0 tx=0x7fe56400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe5577fe700 1 -- 172.21.15.81:0/1924126015 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564009720 con 0x7fe57006a350 2023-11-29T11:19:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe5577fe700 1 -- 172.21.15.81:0/1924126015 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56400ee70 con 0x7fe57006a350 2023-11-29T11:19:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57015d170 con 0x7fe57006a350 2023-11-29T11:19:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.009+0000 7fe5577fe700 1 -- 172.21.15.81:0/1924126015 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400c9f0 con 0x7fe57006a350 2023-11-29T11:19:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.013+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57015ce90 con 0x7fe57006a350 2023-11-29T11:19:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.013+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5700cda80 con 0x7fe57006a350 2023-11-29T11:19:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.013+0000 7fe5577fe700 1 -- 172.21.15.81:0/1924126015 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe564019030 con 0x7fe57006a350 2023-11-29T11:19:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.013+0000 7fe5577fe700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe55c064ee0 0x7fe55c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.013+0000 7fe56e59c700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe55c064ee0 0x7fe55c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.013+0000 7fe5577fe700 1 -- 172.21.15.81:0/1924126015 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fe564081f20 con 0x7fe57006a350 2023-11-29T11:19:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.017+0000 7fe56e59c700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe55c064ee0 0x7fe55c067390 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe560007fd0 tx=0x7fe560007c60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.021+0000 7fe5577fe700 1 -- 172.21.15.81:0/1924126015 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe56404fe80 con 0x7fe57006a350 2023-11-29T11:19:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.185+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe570072500 con 0x7fe57006a350 2023-11-29T11:19:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe5577fe700 1 -- 172.21.15.81:0/1924126015 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18200 (secure 0 0 0) 0x7fe5640534a0 con 0x7fe57006a350 2023-11-29T11:19:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:27.196 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:58.488981+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3247003029":"2023-11-30T11:17:58.488925+0000","172.21.15.81:6836/3247003029":"2023-11-30T11:17:58.488925+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe55c064ee0 msgr2=0x7fe55c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe55c064ee0 0x7fe55c067390 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe560007fd0 tx=0x7fe560007c60 comp rx=0 tx=0).stop 2023-11-29T11:19:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 msgr2=0x7fe570157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe570157040 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe56400e9d0 tx=0x7fe56400ece0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 shutdown_connections 2023-11-29T11:19:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe55c064ee0 0x7fe55c067390 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe57015d690 0x7fe5701f19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe570156c70 0x7fe57015b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 --2- 172.21.15.81:0/1924126015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57006a350 0x7fe570157040 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 >> 172.21.15.81:0/1924126015 conn(0x7fe57006ca90 msgr2=0x7fe57015ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 shutdown_connections 2023-11-29T11:19:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.189+0000 7fe57503d700 1 -- 172.21.15.81:0/1924126015 wait complete. 2023-11-29T11:19:27.210 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T11:19:27.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:27.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.309+0000 7f501b59e700 1 Processor -- start 2023-11-29T11:19:27.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.309+0000 7f501b59e700 1 -- start start 2023-11-29T11:19:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f501c0cb460 0x7f501c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f501c0ad490 0x7f501c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c0cd8f0 con 0x7f501c158e60 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0add00 con 0x7f501c0cb460 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0cc4f0 con 0x7f501c0ad490 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f5019d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f501c0cb460 0x7f501c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f5019d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f501c0cb460 0x7f501c0c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51848/0 (socket says 172.21.15.81:51848) 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f5019d9b700 1 -- 172.21.15.81:0/3401738432 learned_addr learned my addr 172.21.15.81:0/3401738432 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501a59c700 1 --1- 172.21.15.81:0/3401738432 >> v1:172.21.15.81:6789/0 conn(0x7f501c158e60 0x7f501c0cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60800/0 (socket says 172.21.15.81:60800) 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501ad9d700 1 --2- 172.21.15.81:0/3401738432 >> v2:172.21.15.176:3300/0 conn(0x7f501c0ad490 0x7f501c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f5019d9b700 1 -- 172.21.15.81:0/3401738432 >> v2:172.21.15.176:3300/0 conn(0x7f501c0ad490 msgr2=0x7f501c0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f5019d9b700 1 --2- 172.21.15.81:0/3401738432 >> v2:172.21.15.176:3300/0 conn(0x7f501c0ad490 0x7f501c0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f5019d9b700 1 -- 172.21.15.81:0/3401738432 >> v1:172.21.15.81:6789/0 conn(0x7f501c158e60 legacy=0x7f501c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f5019d9b700 1 -- 172.21.15.81:0/3401738432 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c06dc60 con 0x7f501c0cb460 2023-11-29T11:19:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f5019d9b700 1 --2- 172.21.15.81:0/3401738432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c0cb460 0x7f501c0c8a30 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f501c0afe60 tx=0x7f500c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce9cb011e77e940 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501959a700 1 -- 172.21.15.81:0/3401738432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c011830 con 0x7f501c0cb460 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501959a700 1 -- 172.21.15.81:0/3401738432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c011990 con 0x7f501c0cb460 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501959a700 1 -- 172.21.15.81:0/3401738432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c011d40 con 0x7f501c0cb460 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 -- 172.21.15.81:0/3401738432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c0cb460 msgr2=0x7f501c0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 --2- 172.21.15.81:0/3401738432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c0cb460 0x7f501c0c8a30 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f501c0afe60 tx=0x7f500c009c20 comp rx=0 tx=0).stop 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 -- 172.21.15.81:0/3401738432 shutdown_connections 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 --2- 172.21.15.81:0/3401738432 >> v2:172.21.15.176:3300/0 conn(0x7f501c0ad490 0x7f501c0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 --2- 172.21.15.81:0/3401738432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c0cb460 0x7f501c0c8a30 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 -- 172.21.15.81:0/3401738432 >> 172.21.15.81:0/3401738432 conn(0x7f501c0ce3e0 msgr2=0x7f501c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 -- 172.21.15.81:0/3401738432 shutdown_connections 2023-11-29T11:19:27.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.313+0000 7f501b59e700 1 -- 172.21.15.81:0/3401738432 wait complete. 2023-11-29T11:19:27.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 Processor -- start 2023-11-29T11:19:27.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 -- start start 2023-11-29T11:19:27.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f501c0ad490 0x7f501c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f501c0cb460 0x7f501c152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c158e60 0x7f501c166320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c14f5a0 con 0x7f501c158e60 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c097240 con 0x7f501c0ad490 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c097520 con 0x7f501c0cb460 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c158e60 0x7f501c166320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c158e60 0x7f501c166320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51852/0 (socket says 172.21.15.81:51852) 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501a59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f501c0ad490 0x7f501c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 -- 172.21.15.81:0/1814413182 learned_addr learned my addr 172.21.15.81:0/1814413182 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:27.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f5019d9b700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f501c0cb460 0x7f501c152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 -- 172.21.15.81:0/1814413182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f501c0cb460 msgr2=0x7f501c152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f501c0cb460 0x7f501c152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 -- 172.21.15.81:0/1814413182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f501c0ad490 msgr2=0x7f501c06fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f501c0ad490 0x7f501c06fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 -- 172.21.15.81:0/1814413182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c009570 con 0x7f501c158e60 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501a59c700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f501c0ad490 0x7f501c06fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501ad9d700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c158e60 0x7f501c166320 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f501400efc0 tx=0x7f501400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f500affd700 1 -- 172.21.15.81:0/1814413182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014009ea0 con 0x7f501c158e60 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f500affd700 1 -- 172.21.15.81:0/1814413182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400f040 con 0x7f501c158e60 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c159230 con 0x7f501c158e60 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f500affd700 1 -- 172.21.15.81:0/1814413182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400ced0 con 0x7f501c158e60 2023-11-29T11:19:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.317+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c0cde90 con 0x7f501c158e60 2023-11-29T11:19:27.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.321+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c06d6a0 con 0x7f501c158e60 2023-11-29T11:19:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.325+0000 7f500affd700 1 -- 172.21.15.81:0/1814413182 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5014014480 con 0x7f501c158e60 2023-11-29T11:19:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.325+0000 7f500affd700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ffc064ee0 0x7f4ffc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.325+0000 7f501a59c700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ffc064ee0 0x7f4ffc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.325+0000 7f500affd700 1 -- 172.21.15.81:0/1814413182 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f5014083240 con 0x7f501c158e60 2023-11-29T11:19:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.325+0000 7f501a59c700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ffc064ee0 0x7f4ffc067390 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5010000f60 tx=0x7f5010007f30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.329+0000 7f500affd700 1 -- 172.21.15.81:0/1814413182 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f50140510d0 con 0x7f501c158e60 2023-11-29T11:19:27.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f501c072500 con 0x7f501c158e60 2023-11-29T11:19:27.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f500affd700 1 -- 172.21.15.81:0/1814413182 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f50140546f0 con 0x7f501c158e60 2023-11-29T11:19:27.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:27.532 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:51.075974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:19:27.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ffc064ee0 msgr2=0x7f4ffc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ffc064ee0 0x7f4ffc067390 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5010000f60 tx=0x7f5010007f30 comp rx=0 tx=0).stop 2023-11-29T11:19:27.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c158e60 msgr2=0x7f501c166320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c158e60 0x7f501c166320 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f501400efc0 tx=0x7f501400c3a0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 shutdown_connections 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ffc064ee0 0x7f4ffc067390 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f501c158e60 0x7f501c166320 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f501c0cb460 0x7f501c152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 --2- 172.21.15.81:0/1814413182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f501c0ad490 0x7f501c06fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.525+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 >> 172.21.15.81:0/1814413182 conn(0x7f501c0ce3e0 msgr2=0x7f501c0ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.529+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 shutdown_connections 2023-11-29T11:19:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.529+0000 7f501b59e700 1 -- 172.21.15.81:0/1814413182 wait complete. 2023-11-29T11:19:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 47 2023-11-29T11:19:27.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:27.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d2ee4700 1 Processor -- start 2023-11-29T11:19:27.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d2ee4700 1 -- start start 2023-11-29T11:19:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d2ee4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25cc1606b0 0x7f25cc0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d2ee4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25cc0ceef0 0x7f25cc0c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d2ee4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc0cae70 con 0x7f25cc0ad610 2023-11-29T11:19:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d2ee4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc0cbc10 con 0x7f25cc0ceef0 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d2ee4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc0cb130 con 0x7f25cc1606b0 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d26e3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f25cc0ad610 0x7f25cc164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60802/0 (socket says 172.21.15.81:60802) 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d26e3700 1 -- 172.21.15.81:0/1298411103 learned_addr learned my addr 172.21.15.81:0/1298411103 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d16e1700 1 --2- 172.21.15.81:0/1298411103 >> v2:172.21.15.81:3300/0 conn(0x7f25cc0ceef0 0x7f25cc0c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.653+0000 7f25d1ee2700 1 --2- 172.21.15.81:0/1298411103 >> v2:172.21.15.176:3300/0 conn(0x7f25cc1606b0 0x7f25cc0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d0ee0700 1 -- 172.21.15.81:0/1298411103 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612527975 0 0) 0x7f25cc0cae70 con 0x7f25cc0ad610 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d0ee0700 1 -- 172.21.15.81:0/1298411103 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b80035d0 con 0x7f25cc0ad610 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d16e1700 1 -- 172.21.15.81:0/1298411103 >> v2:172.21.15.176:3300/0 conn(0x7f25cc1606b0 msgr2=0x7f25cc0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d16e1700 1 --2- 172.21.15.81:0/1298411103 >> v2:172.21.15.176:3300/0 conn(0x7f25cc1606b0 0x7f25cc0c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d16e1700 1 -- 172.21.15.81:0/1298411103 >> v1:172.21.15.81:6789/0 conn(0x7f25cc0ad610 legacy=0x7f25cc164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d16e1700 1 -- 172.21.15.81:0/1298411103 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc0cb410 con 0x7f25cc0ceef0 2023-11-29T11:19:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d16e1700 1 --2- 172.21.15.81:0/1298411103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc0ceef0 0x7f25cc0c18f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0b34a0 tx=0x7f25bc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146cfc052c77bf0c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d0ee0700 1 -- 172.21.15.81:0/1298411103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc004230 con 0x7f25cc0ceef0 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d0ee0700 1 -- 172.21.15.81:0/1298411103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc004390 con 0x7f25cc0ceef0 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d0ee0700 1 -- 172.21.15.81:0/1298411103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0036c0 con 0x7f25cc0ceef0 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d2ee4700 1 -- 172.21.15.81:0/1298411103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc0ceef0 msgr2=0x7f25cc0c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/1298411103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc0ceef0 0x7f25cc0c18f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0b34a0 tx=0x7f25bc009b30 comp rx=0 tx=0).stop 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d2ee4700 1 -- 172.21.15.81:0/1298411103 shutdown_connections 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/1298411103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc0ceef0 0x7f25cc0c18f0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/1298411103 >> v2:172.21.15.176:3300/0 conn(0x7f25cc1606b0 0x7f25cc0c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d2ee4700 1 -- 172.21.15.81:0/1298411103 >> 172.21.15.81:0/1298411103 conn(0x7f25cc0ce3e0 msgr2=0x7f25cc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d2ee4700 1 -- 172.21.15.81:0/1298411103 shutdown_connections 2023-11-29T11:19:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.657+0000 7f25d2ee4700 1 -- 172.21.15.81:0/1298411103 wait complete. 2023-11-29T11:19:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 Processor -- start 2023-11-29T11:19:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 -- start start 2023-11-29T11:19:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25cc0ad610 0x7f25cc162b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25cc0ceef0 0x7f25cc1f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc1606b0 0x7f25cc1f9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1f9260 con 0x7f25cc1606b0 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc163060 con 0x7f25cc0ceef0 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc071cb0 con 0x7f25cc0ad610 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc1606b0 0x7f25cc1f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc1606b0 0x7f25cc1f9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51874/0 (socket says 172.21.15.81:51874) 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 -- 172.21.15.81:0/2149747721 learned_addr learned my addr 172.21.15.81:0/2149747721 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d16e1700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25cc0ceef0 0x7f25cc1f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d1ee2700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25cc0ad610 0x7f25cc162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 -- 172.21.15.81:0/2149747721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25cc0ad610 msgr2=0x7f25cc162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25cc0ad610 0x7f25cc162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 -- 172.21.15.81:0/2149747721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25cc0ceef0 msgr2=0x7f25cc1f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25cc0ceef0 0x7f25cc1f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 -- 172.21.15.81:0/2149747721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0094b0 con 0x7f25cc1606b0 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d26e3700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc1606b0 0x7f25cc1f9a20 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f25c400cba0 tx=0x7f25c400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25c27fc700 1 -- 172.21.15.81:0/2149747721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c400aaa0 con 0x7f25cc1606b0 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25c27fc700 1 -- 172.21.15.81:0/2149747721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c400ac20 con 0x7f25cc1606b0 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc06ac50 con 0x7f25cc1606b0 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25c27fc700 1 -- 172.21.15.81:0/2149747721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40070d0 con 0x7f25cc1606b0 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.661+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc0cb6f0 con 0x7f25cc1606b0 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.665+0000 7f25c27fc700 1 -- 172.21.15.81:0/2149747721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f25c401a030 con 0x7f25cc1606b0 2023-11-29T11:19:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.665+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc0b36c0 con 0x7f25cc1606b0 2023-11-29T11:19:27.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.665+0000 7f25c27fc700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25b0064ee0 0x7f25b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:27.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.665+0000 7f25c27fc700 1 -- 172.21.15.81:0/2149747721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f25c4081bf0 con 0x7f25cc1606b0 2023-11-29T11:19:27.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.665+0000 7f25d1ee2700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25b0064ee0 0x7f25b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.665+0000 7f25d1ee2700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25b0064ee0 0x7f25b0067390 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009b50 tx=0x7f25c8009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:27.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.669+0000 7f25c27fc700 1 -- 172.21.15.81:0/2149747721 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f25c404fbd0 con 0x7f25cc1606b0 2023-11-29T11:19:27.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25cc0b8980 con 0x7f25cc1606b0 2023-11-29T11:19:27.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25c27fc700 1 -- 172.21.15.81:0/2149747721 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f25c4018090 con 0x7f25cc1606b0 2023-11-29T11:19:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:27.876 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:17:39.743930+0000","modified":"2023-11-29T11:18:51.075974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":16,"addr":"172.21.15.81:6837/1678973589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1678973589},{"type":"v1","addr":"172.21.15.81:6837","nonce":1678973589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-29T11:19:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25b0064ee0 msgr2=0x7f25b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25b0064ee0 0x7f25b0067390 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009b50 tx=0x7f25c8009240 comp rx=0 tx=0).stop 2023-11-29T11:19:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc1606b0 msgr2=0x7f25cc1f9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc1606b0 0x7f25cc1f9a20 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f25c400cba0 tx=0x7f25c400ceb0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 shutdown_connections 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f25b0064ee0 0x7f25b0067390 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25cc1606b0 0x7f25cc1f9a20 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25cc0ceef0 0x7f25cc1f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 --2- 172.21.15.81:0/2149747721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25cc0ad610 0x7f25cc162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.869+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 >> 172.21.15.81:0/2149747721 conn(0x7f25cc0ce3e0 msgr2=0x7f25cc0ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.873+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 shutdown_connections 2023-11-29T11:19:27.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.873+0000 7f25d2ee4700 1 -- 172.21.15.81:0/2149747721 wait complete. 2023-11-29T11:19:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 47 2023-11-29T11:19:27.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:27.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12529d6700 1 Processor -- start 2023-11-29T11:19:27.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12529d6700 1 -- start start 2023-11-29T11:19:28.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12529d6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f124c069c40 0x7f124c0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12529d6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c06ace0 con 0x7f124c159e70 2023-11-29T11:19:28.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12529d6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c06a0d0 con 0x7f124c0cb2a0 2023-11-29T11:19:28.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12529d6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0cb720 con 0x7f124c069c40 2023-11-29T11:19:28.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12519d4700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f124c159e70 0x7f124c06c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60818/0 (socket says 172.21.15.81:60818) 2023-11-29T11:19:28.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12519d4700 1 -- 172.21.15.81:0/3198501012 learned_addr learned my addr 172.21.15.81:0/3198501012 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:28.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12511d3700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f124c069c40 0x7f124c0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207258599 0 0) 0x7f124c06ace0 con 0x7f124c159e70 2023-11-29T11:19:28.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12340035d0 con 0x7f124c159e70 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150812434 0 0) 0x7f124c06a0d0 con 0x7f124c0cb2a0 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f124c06ace0 con 0x7f124c0cb2a0 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 510746563 0 0) 0x7f12340035d0 con 0x7f124c159e70 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f124c069c40 msgr2=0x7f124c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f124c069c40 0x7f124c0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 >> v1:172.21.15.176:6789/0 conn(0x7f124c0cb2a0 legacy=0x7f124c0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c06a3b0 con 0x7f124c159e70 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f1240001670 con 0x7f124c159e70 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 >> v1:172.21.15.81:6789/0 conn(0x7f124c159e70 legacy=0x7f124c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1234003be0 0x7f1234003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f124c069c40 0x7f1234004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1234004db0 0x7f1234005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0cb720 con 0x7f1234004db0 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123400fef0 con 0x7f1234003be0 2023-11-29T11:19:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234010060 con 0x7f124c069c40 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12521d5700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1234004db0 0x7f1234005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12519d4700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1234003be0 0x7f1234003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12511d3700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f124c069c40 0x7f1234004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12521d5700 1 -- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f124c069c40 msgr2=0x7f1234004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12521d5700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f124c069c40 0x7f1234004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12521d5700 1 -- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1234003be0 msgr2=0x7f1234003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12521d5700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1234003be0 0x7f1234003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12521d5700 1 -- 172.21.15.81:0/3198501012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340035d0 con 0x7f1234004db0 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12519d4700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1234003be0 0x7f1234003fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.993+0000 7f12521d5700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1234004db0 0x7f1234005220 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f123c001960 tx=0x7f12340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b8f034fe61eee6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c001450 con 0x7f1234004db0 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c0052f0 con 0x7f1234004db0 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12509d2700 1 -- 172.21.15.81:0/3198501012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0036a0 con 0x7f1234004db0 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12529d6700 1 -- 172.21.15.81:0/3198501012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1234004db0 msgr2=0x7f1234005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12529d6700 1 --2- 172.21.15.81:0/3198501012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1234004db0 0x7f1234005220 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f123c001960 tx=0x7f12340058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12521d5700 1 -- 172.21.15.81:0/3198501012 reap_dead start 2023-11-29T11:19:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12529d6700 1 -- 172.21.15.81:0/3198501012 shutdown_connections 2023-11-29T11:19:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12529d6700 1 -- 172.21.15.81:0/3198501012 >> 172.21.15.81:0/3198501012 conn(0x7f124c0ce3e0 msgr2=0x7f124c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12529d6700 1 -- 172.21.15.81:0/3198501012 shutdown_connections 2023-11-29T11:19:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12529d6700 1 -- 172.21.15.81:0/3198501012 wait complete. 2023-11-29T11:19:28.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12529d6700 1 Processor -- start 2023-11-29T11:19:28.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:27.997+0000 7f12529d6700 1 -- start start 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1234004db0 0x7f124c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124c0b0ab0 0x7f124c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f124c15c510 0x7f124c158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0c8350 con 0x7f124c0b0ab0 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c15c9b0 con 0x7f124c15c510 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c0c54b0 con 0x7f1234004db0 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124c0b0ab0 0x7f124c157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124c0b0ab0 0x7f124c157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51892/0 (socket says 172.21.15.81:51892) 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 -- 172.21.15.81:0/814583519 learned_addr learned my addr 172.21.15.81:0/814583519 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12521d5700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f124c15c510 0x7f124c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12519d4700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1234004db0 0x7f124c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 -- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1234004db0 msgr2=0x7f124c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1234004db0 0x7f124c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 -- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f124c15c510 msgr2=0x7f124c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f124c15c510 0x7f124c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 -- 172.21.15.81:0/814583519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c06a970 con 0x7f124c0b0ab0 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12521d5700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f124c15c510 0x7f124c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12511d3700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124c0b0ab0 0x7f124c157bd0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1244007f30 tx=0x7f1244011560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f124a7fc700 1 -- 172.21.15.81:0/814583519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400e030 con 0x7f124c0b0ab0 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f124a7fc700 1 -- 172.21.15.81:0/814583519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244011e40 con 0x7f124c0b0ab0 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c06a690 con 0x7f124c0b0ab0 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f124a7fc700 1 -- 172.21.15.81:0/814583519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440166b0 con 0x7f124c0b0ab0 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c06d0b0 con 0x7f124c0b0ab0 2023-11-29T11:19:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c072500 con 0x7f124c0b0ab0 2023-11-29T11:19:28.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.001+0000 7f124a7fc700 1 -- 172.21.15.81:0/814583519 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1244016810 con 0x7f124c0b0ab0 2023-11-29T11:19:28.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.005+0000 7f124a7fc700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1238064f10 0x7f12380673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.005+0000 7f12519d4700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1238064f10 0x7f12380673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.005+0000 7f124a7fc700 1 -- 172.21.15.81:0/814583519 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f124400f070 con 0x7f124c0b0ab0 2023-11-29T11:19:28.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.005+0000 7f12519d4700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1238064f10 0x7f12380673c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1240001eb0 tx=0x7f1240009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:28.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.009+0000 7f124a7fc700 1 -- 172.21.15.81:0/814583519 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1244050ea0 con 0x7f124c0b0ab0 2023-11-29T11:19:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.173+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f124c1599c0 con 0x7f124c0b0ab0 2023-11-29T11:19:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.177+0000 7f124a7fc700 1 -- 172.21.15.81:0/814583519 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18200 (secure 0 0 0) 0x7f12440544c0 con 0x7f124c0b0ab0 2023-11-29T11:19:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:17:58.488981+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:17:38.310347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-11-29T11:17:38.742094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3247003029":"2023-11-30T11:17:58.488925+0000","172.21.15.81:6836/3247003029":"2023-11-30T11:17:58.488925+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1238064f10 msgr2=0x7f12380673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1238064f10 0x7f12380673c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1240001eb0 tx=0x7f1240009040 comp rx=0 tx=0).stop 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124c0b0ab0 msgr2=0x7f124c157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124c0b0ab0 0x7f124c157bd0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1244007f30 tx=0x7f1244011560 comp rx=0 tx=0).stop 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 shutdown_connections 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1238064f10 0x7f12380673c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f124c15c510 0x7f124c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124c0b0ab0 0x7f124c157bd0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 --2- 172.21.15.81:0/814583519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1234004db0 0x7f124c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 >> 172.21.15.81:0/814583519 conn(0x7f124c0ce3e0 msgr2=0x7f124c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 shutdown_connections 2023-11-29T11:19:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.181+0000 7f12529d6700 1 -- 172.21.15.81:0/814583519 wait complete. 2023-11-29T11:19:28.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:19:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f642cf38700 1 Processor -- start 2023-11-29T11:19:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f642cf38700 1 -- start start 2023-11-29T11:19:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f642cf38700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f64281606b0 0x7f64280c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f642cf38700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6428164e60 con 0x7f64280ceef0 2023-11-29T11:19:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f642cf38700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64280cae70 con 0x7f64280ad610 2023-11-29T11:19:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f642cf38700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64280cbc10 con 0x7f64281606b0 2023-11-29T11:19:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f6426ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f64280ceef0 0x7f6428164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60834/0 (socket says 172.21.15.81:60834) 2023-11-29T11:19:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f6426ffd700 1 -- 172.21.15.81:0/1223988141 learned_addr learned my addr 172.21.15.81:0/1223988141 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64277fe700 1 --2- 172.21.15.81:0/1223988141 >> v2:172.21.15.176:3300/0 conn(0x7f64281606b0 0x7f64280c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544462437 0 0) 0x7f6428164e60 con 0x7f64280ceef0 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64100035d0 con 0x7f64280ceef0 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775220286 0 0) 0x7f64280cae70 con 0x7f64280ad610 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6428164e60 con 0x7f64280ad610 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 360946625 0 0) 0x7f64100035d0 con 0x7f64280ceef0 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 >> v2:172.21.15.176:3300/0 conn(0x7f64281606b0 msgr2=0x7f64280c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 --2- 172.21.15.81:0/1223988141 >> v2:172.21.15.176:3300/0 conn(0x7f64281606b0 0x7f64280c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 >> v1:172.21.15.176:6789/0 conn(0x7f64280ad610 legacy=0x7f6428164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280cb130 con 0x7f64280ceef0 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f6418001670 con 0x7f64280ceef0 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 >> v1:172.21.15.81:6789/0 conn(0x7f64280ceef0 legacy=0x7f6428164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6410003bb0 0x7f6410003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410004870 0x7f6410004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6410005220 0x7f641000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64280cbc10 con 0x7f6410003bb0 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641000c130 con 0x7f6410005220 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641000c2f0 con 0x7f6410004870 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64277fe700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6410003bb0 0x7f6410003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f6427fff700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6410005220 0x7f641000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f6426ffd700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410004870 0x7f6410004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64277fe700 1 -- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410004870 msgr2=0x7f6410004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64277fe700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410004870 0x7f6410004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64277fe700 1 -- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6410005220 msgr2=0x7f641000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64277fe700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6410005220 0x7f641000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64277fe700 1 -- 172.21.15.81:0/1223988141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100035d0 con 0x7f6410003bb0 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f6426ffd700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410004870 0x7f6410004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f6427fff700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6410005220 0x7f641000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f6427fff700 1 -- 172.21.15.81:0/1223988141 reap_dead start 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64277fe700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6410003bb0 0x7f6410003fa0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f641c009b40 tx=0x7f64100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8baf20910204a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00e6c0 con 0x7f6410003bb0 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c00e820 con 0x7f6410003bb0 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.313+0000 7f64267fc700 1 -- 172.21.15.81:0/1223988141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00eb90 con 0x7f6410003bb0 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 -- 172.21.15.81:0/1223988141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6410003bb0 msgr2=0x7f6410003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6410003bb0 0x7f6410003fa0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f641c009b40 tx=0x7f64100058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 -- 172.21.15.81:0/1223988141 shutdown_connections 2023-11-29T11:19:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 --2- 172.21.15.81:0/1223988141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6410003bb0 0x7f6410003fa0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 -- 172.21.15.81:0/1223988141 >> 172.21.15.81:0/1223988141 conn(0x7f64280ce3e0 msgr2=0x7f64280ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 -- 172.21.15.81:0/1223988141 shutdown_connections 2023-11-29T11:19:28.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 -- 172.21.15.81:0/1223988141 wait complete. 2023-11-29T11:19:28.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 Processor -- start 2023-11-29T11:19:28.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.317+0000 7f642cf38700 1 -- start start 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410003bb0 0x7f64280ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64281f3500 0x7f64280ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64280c39c0 0x7f64280c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64280ac900 con 0x7f64281f3500 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64280c4d40 con 0x7f64280c39c0 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64280abc80 con 0x7f6410003bb0 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64281f3500 0x7f64280ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64281f3500 0x7f64280ab690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51912/0 (socket says 172.21.15.81:51912) 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 -- 172.21.15.81:0/187156506 learned_addr learned my addr 172.21.15.81:0/187156506 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f64277fe700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410003bb0 0x7f64280ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6427fff700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64280c39c0 0x7f64280c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 -- 172.21.15.81:0/187156506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410003bb0 msgr2=0x7f64280ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410003bb0 0x7f64280ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 -- 172.21.15.81:0/187156506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64280c39c0 msgr2=0x7f64280c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64280c39c0 0x7f64280c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 -- 172.21.15.81:0/187156506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280cb6f0 con 0x7f64281f3500 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f6426ffd700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64281f3500 0x7f64280ab690 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6418001eb0 tx=0x7f641800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f640ffff700 1 -- 172.21.15.81:0/187156506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418004d60 con 0x7f64281f3500 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f640ffff700 1 -- 172.21.15.81:0/187156506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64180070d0 con 0x7f64281f3500 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64280cb410 con 0x7f64281f3500 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f640ffff700 1 -- 172.21.15.81:0/187156506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418007460 con 0x7f64281f3500 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64280b36c0 con 0x7f64281f3500 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6428072500 con 0x7f64281f3500 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.321+0000 7f640ffff700 1 -- 172.21.15.81:0/187156506 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f641801b030 con 0x7f64281f3500 2023-11-29T11:19:28.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.325+0000 7f640ffff700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6414064ee0 0x7f6414067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:28.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.325+0000 7f64277fe700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6414064ee0 0x7f6414067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:28.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.325+0000 7f640ffff700 1 -- 172.21.15.81:0/187156506 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f6418081930 con 0x7f64281f3500 2023-11-29T11:19:28.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.325+0000 7f64277fe700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6414064ee0 0x7f6414067390 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f641c0090b0 tx=0x7f641c01e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.329+0000 7f640ffff700 1 -- 172.21.15.81:0/187156506 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f641804f820 con 0x7f64281f3500 2023-11-29T11:19:28.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:28.525+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6428163d80 con 0x7f64281f3500 2023-11-29T11:19:29.136 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-11-29T11:19:29.129+0000 7ff259299700 -1 MDSIOContextBase: failed with -108, restarting... 2023-11-29T11:19:29.147 INFO:tasks.ceph.mds.c.smithi081.stderr: -3771> 2023-11-29T11:18:06.067+0000 7ff25caa0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:19:29.154 INFO:tasks.ceph.mds.c.smithi081.stderr: -1> 2023-11-29T11:19:29.129+0000 7ff259299700 -1 MDSIOContextBase: failed with -108, restarting... 2023-11-29T11:19:29.178 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:19:29.169+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:19:29.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.181+0000 7f640ffff700 1 -- 172.21.15.81:0/187156506 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6418052e40 con 0x7f64281f3500 2023-11-29T11:19:29.189 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:19:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6414064ee0 msgr2=0x7f6414067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6414064ee0 0x7f6414067390 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f641c0090b0 tx=0x7f641c01e040 comp rx=0 tx=0).stop 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64281f3500 msgr2=0x7f64280ab690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64281f3500 0x7f64280ab690 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6418001eb0 tx=0x7f641800d9d0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 shutdown_connections 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6414064ee0 0x7f6414067390 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64280c39c0 0x7f64280c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64281f3500 0x7f64280ab690 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 --2- 172.21.15.81:0/187156506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6410003bb0 0x7f64280ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 >> 172.21.15.81:0/187156506 conn(0x7f64280ce3e0 msgr2=0x7f642806bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 shutdown_connections 2023-11-29T11:19:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.185+0000 7f642cf38700 1 -- 172.21.15.81:0/187156506 wait complete. 2023-11-29T11:19:29.194 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:19:29.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T11:19:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.321+0000 7f412b59e700 1 Processor -- start 2023-11-29T11:19:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.321+0000 7f412b59e700 1 -- start start 2023-11-29T11:19:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f412c158480 0x7f412c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c06a4d0 con 0x7f412c0cd3a0 2023-11-29T11:19:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0cc1f0 con 0x7f412c158850 2023-11-29T11:19:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c0cc490 con 0x7f412c158480 2023-11-29T11:19:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f412c0cd3a0 0x7f412c0ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60846/0 (socket says 172.21.15.81:60846) 2023-11-29T11:19:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 -- 172.21.15.81:0/1024456056 learned_addr learned my addr 172.21.15.81:0/1024456056 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412a59c700 1 --2- 172.21.15.81:0/1024456056 >> v2:172.21.15.176:3300/0 conn(0x7f412c158480 0x7f412c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151312079 0 0) 0x7f412c06a4d0 con 0x7f412c0cd3a0 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41180034f0 con 0x7f412c0cd3a0 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1566428056 0 0) 0x7f41180034f0 con 0x7f412c0cd3a0 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 >> v2:172.21.15.176:3300/0 conn(0x7f412c158480 msgr2=0x7f412c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 --2- 172.21.15.81:0/1024456056 >> v2:172.21.15.176:3300/0 conn(0x7f412c158480 0x7f412c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 >> v1:172.21.15.176:6789/0 conn(0x7f412c158850 legacy=0x7f412c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c06a720 con 0x7f412c0cd3a0 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f41240019f0 con 0x7f412c0cd3a0 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 >> v1:172.21.15.81:6789/0 conn(0x7f412c0cd3a0 legacy=0x7f412c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118003b10 0x7f4118003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118008900 0x7f411800ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411800b5c0 0x7f411800da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0cc490 con 0x7f411800b5c0 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411800e350 con 0x7f4118008900 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411800e510 con 0x7f4118003b10 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412a59c700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118003b10 0x7f4118003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f4121d9b700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118008900 0x7f411800ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411800b5c0 0x7f411800da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 -- 172.21.15.81:0/1024456056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118003b10 msgr2=0x7f4118003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118003b10 0x7f4118003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 -- 172.21.15.81:0/1024456056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118008900 msgr2=0x7f411800ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118008900 0x7f411800ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 -- 172.21.15.81:0/1024456056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41180034f0 con 0x7f411800b5c0 2023-11-29T11:19:29.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.325+0000 7f412ad9d700 1 -- 172.21.15.81:0/1024456056 reap_dead start 2023-11-29T11:19:29.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412ad9d700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411800b5c0 0x7f411800da70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f412400a830 tx=0x7f41180037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc9ccd4f429aa9c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:29.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412400a2f0 con 0x7f411800b5c0 2023-11-29T11:19:29.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4124007310 con 0x7f411800b5c0 2023-11-29T11:19:29.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f4129d9b700 1 -- 172.21.15.81:0/1024456056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41240076c0 con 0x7f411800b5c0 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 -- 172.21.15.81:0/1024456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411800b5c0 msgr2=0x7f411800da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411800b5c0 0x7f411800da70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f412400a830 tx=0x7f41180037a0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 -- 172.21.15.81:0/1024456056 shutdown_connections 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 --2- 172.21.15.81:0/1024456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411800b5c0 0x7f411800da70 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 -- 172.21.15.81:0/1024456056 >> 172.21.15.81:0/1024456056 conn(0x7f412c06c660 msgr2=0x7f412c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 -- 172.21.15.81:0/1024456056 shutdown_connections 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 -- 172.21.15.81:0/1024456056 wait complete. 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 Processor -- start 2023-11-29T11:19:29.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.329+0000 7f412b59e700 1 -- start start 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411800b5c0 0x7f412c14bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f412c0c3d10 0x7f412c0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f412c0c2770 0x7f412c0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c1540c0 con 0x7f412c0c2770 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c14c320 con 0x7f412c0c3d10 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0c2c70 con 0x7f411800b5c0 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f412c0c2770 0x7f412c0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f412c0c2770 0x7f412c0c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51942/0 (socket says 172.21.15.81:51942) 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 -- 172.21.15.81:0/3725671683 learned_addr learned my addr 172.21.15.81:0/3725671683 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:29.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f4121d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f412c0c3d10 0x7f412c0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412a59c700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411800b5c0 0x7f412c14bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 -- 172.21.15.81:0/3725671683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411800b5c0 msgr2=0x7f412c14bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411800b5c0 0x7f412c14bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 -- 172.21.15.81:0/3725671683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f412c0c3d10 msgr2=0x7f412c0c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f412c0c3d10 0x7f412c0c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 -- 172.21.15.81:0/3725671683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c06ace0 con 0x7f412c0c2770 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412ad9d700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f412c0c2770 0x7f412c0c96c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f412c0cdd30 tx=0x7f4124001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f41237fe700 1 -- 172.21.15.81:0/3725671683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124023030 con 0x7f412c0c2770 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f41237fe700 1 -- 172.21.15.81:0/3725671683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41240017b0 con 0x7f412c0c2770 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f41237fe700 1 -- 172.21.15.81:0/3725671683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412401e420 con 0x7f412c0c2770 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c06aa00 con 0x7f412c0c2770 2023-11-29T11:19:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c0cbcb0 con 0x7f412c0c2770 2023-11-29T11:19:29.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.333+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c072c20 con 0x7f412c0c2770 2023-11-29T11:19:29.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.337+0000 7f41237fe700 1 -- 172.21.15.81:0/3725671683 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4124010070 con 0x7f412c0c2770 2023-11-29T11:19:29.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.337+0000 7f41237fe700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f410c064ee0 0x7f410c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:29.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.337+0000 7f41237fe700 1 -- 172.21.15.81:0/3725671683 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6583+0+0 (secure 0 0 0) 0x7f4124024070 con 0x7f412c0c2770 2023-11-29T11:19:29.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.337+0000 7f412a59c700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f410c064ee0 0x7f410c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:29.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.337+0000 7f412a59c700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f410c064ee0 0x7f410c067390 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f411c009be0 tx=0x7f411c0091c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:29.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.345+0000 7f41237fe700 1 -- 172.21.15.81:0/3725671683 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4124051850 con 0x7f412c0c2770 2023-11-29T11:19:29.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:29.545+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f412c071400 con 0x7f412c0c2770 2023-11-29T11:19:30.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.197+0000 7f41237fe700 1 -- 172.21.15.81:0/3725671683 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4124054e70 con 0x7f412c0c2770 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f410c064ee0 msgr2=0x7f410c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f410c064ee0 0x7f410c067390 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f411c009be0 tx=0x7f411c0091c0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f412c0c2770 msgr2=0x7f412c0c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f412c0c2770 0x7f412c0c96c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f412c0cdd30 tx=0x7f4124001d80 comp rx=0 tx=0).stop 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 shutdown_connections 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f410c064ee0 0x7f410c067390 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f412c0c2770 0x7f412c0c96c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f412c0c3d10 0x7f412c0c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 --2- 172.21.15.81:0/3725671683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411800b5c0 0x7f412c14bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 >> 172.21.15.81:0/3725671683 conn(0x7f412c06c660 msgr2=0x7f412c1504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 shutdown_connections 2023-11-29T11:19:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.201+0000 7f412b59e700 1 -- 172.21.15.81:0/3725671683 wait complete. 2023-11-29T11:19:30.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T11:19:30.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa817fff700 1 Processor -- start 2023-11-29T11:19:30.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa817fff700 1 -- start start 2023-11-29T11:19:30.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa817fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa818158f10 0x7fa81806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa817fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8180c9460 con 0x7fa8180cb520 2023-11-29T11:19:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa817fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8180c9fe0 con 0x7fa8180cd930 2023-11-29T11:19:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa817fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81806dc90 con 0x7fa818158f10 2023-11-29T11:19:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8177fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa8180cb520 0x7fa818162b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50294/0 (socket says 172.21.15.81:50294) 2023-11-29T11:19:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8177fe700 1 -- 172.21.15.81:0/3193922978 learned_addr learned my addr 172.21.15.81:0/3193922978 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa816ffd700 1 --2- 172.21.15.81:0/3193922978 >> v2:172.21.15.176:3300/0 conn(0x7fa818158f10 0x7fa81806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276049656 0 0) 0x7fa8180c9460 con 0x7fa8180cb520 2023-11-29T11:19:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8000057e0 con 0x7fa8180cb520 2023-11-29T11:19:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1680125526 0 0) 0x7fa8000057e0 con 0x7fa8180cb520 2023-11-29T11:19:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 >> v2:172.21.15.176:3300/0 conn(0x7fa818158f10 msgr2=0x7fa81806b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 --2- 172.21.15.81:0/3193922978 >> v2:172.21.15.176:3300/0 conn(0x7fa818158f10 0x7fa81806b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 >> v1:172.21.15.176:6789/0 conn(0x7fa8180cd930 legacy=0x7fa8180cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180c96b0 con 0x7fa8180cb520 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fa8100019f0 con 0x7fa8180cb520 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 >> v1:172.21.15.81:6789/0 conn(0x7fa8180cb520 legacy=0x7fa818162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800005c30 0x7fa800006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa800006a80 0x7fa800006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800007430 0x7fa80000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81806dc90 con 0x7fa800006a80 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80000e2b0 con 0x7fa800005c30 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80000e470 con 0x7fa800007430 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa816ffd700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800005c30 0x7fa800006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8167fc700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa800006a80 0x7fa800006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8177fe700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800007430 0x7fa80000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8167fc700 1 -- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800007430 msgr2=0x7fa80000dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8167fc700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800007430 0x7fa80000dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8167fc700 1 -- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800005c30 msgr2=0x7fa800006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8167fc700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800005c30 0x7fa800006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8167fc700 1 -- 172.21.15.81:0/3193922978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000057e0 con 0x7fa800006a80 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa816ffd700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800005c30 0x7fa800006040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8177fe700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800007430 0x7fa80000dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8177fe700 1 -- 172.21.15.81:0/3193922978 reap_dead start 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa8167fc700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa800006a80 0x7fa800006ef0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0017e0 tx=0x7fa800007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97ac47ef00c9528 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0052d0 con 0x7fa800006a80 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.341+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c005450 con 0x7fa800006a80 2023-11-29T11:19:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa815ffb700 1 -- 172.21.15.81:0/3193922978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0038e0 con 0x7fa800006a80 2023-11-29T11:19:30.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 -- 172.21.15.81:0/3193922978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa800006a80 msgr2=0x7fa800006ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:30.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa800006a80 0x7fa800006ef0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0017e0 tx=0x7fa800007ab0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 -- 172.21.15.81:0/3193922978 shutdown_connections 2023-11-29T11:19:30.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 --2- 172.21.15.81:0/3193922978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa800006a80 0x7fa800006ef0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 -- 172.21.15.81:0/3193922978 >> 172.21.15.81:0/3193922978 conn(0x7fa8180ce400 msgr2=0x7fa8180ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:30.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 -- 172.21.15.81:0/3193922978 shutdown_connections 2023-11-29T11:19:30.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 -- 172.21.15.81:0/3193922978 wait complete. 2023-11-29T11:19:30.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 Processor -- start 2023-11-29T11:19:30.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.345+0000 7fa817fff700 1 -- start start 2023-11-29T11:19:30.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800006a80 0x7fa8180c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:30.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8180c3100 0x7fa818069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:30.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8180c1090 0x7fa8180c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180c2060 con 0x7fa8180c1090 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180c2340 con 0x7fa8180c3100 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180c2620 con 0x7fa800006a80 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8180c1090 0x7fa8180c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8180c1090 0x7fa8180c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54104/0 (socket says 172.21.15.81:54104) 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 -- 172.21.15.81:0/362143393 learned_addr learned my addr 172.21.15.81:0/362143393 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa816ffd700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800006a80 0x7fa8180c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8167fc700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8180c3100 0x7fa818069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 -- 172.21.15.81:0/362143393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800006a80 msgr2=0x7fa8180c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800006a80 0x7fa8180c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 -- 172.21.15.81:0/362143393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8180c3100 msgr2=0x7fa818069eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8180c3100 0x7fa818069eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 -- 172.21.15.81:0/362143393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180c9c70 con 0x7fa8180c1090 2023-11-29T11:19:30.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa8177fe700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8180c1090 0x7fa8180c4190 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fa8180c1f00 tx=0x7fa810007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:30.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa7ff7fe700 1 -- 172.21.15.81:0/362143393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81000e8c0 con 0x7fa8180c1090 2023-11-29T11:19:30.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa7ff7fe700 1 -- 172.21.15.81:0/362143393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81000ea20 con 0x7fa8180c1090 2023-11-29T11:19:30.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8180c9990 con 0x7fa8180c1090 2023-11-29T11:19:30.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa7ff7fe700 1 -- 172.21.15.81:0/362143393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81000ed90 con 0x7fa8180c1090 2023-11-29T11:19:30.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8181592e0 con 0x7fa8180c1090 2023-11-29T11:19:30.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa7ff7fe700 1 -- 172.21.15.81:0/362143393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa81001d460 con 0x7fa8180c1090 2023-11-29T11:19:30.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.349+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa818072500 con 0x7fa8180c1090 2023-11-29T11:19:30.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.353+0000 7fa7ff7fe700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa804064ee0 0x7fa804067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:30.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.353+0000 7fa7ff7fe700 1 -- 172.21.15.81:0/362143393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6583+0+0 (secure 0 0 0) 0x7fa810082350 con 0x7fa8180c1090 2023-11-29T11:19:30.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.353+0000 7fa816ffd700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa804064ee0 0x7fa804067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:30.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.353+0000 7fa816ffd700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa804064ee0 0x7fa804067390 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa808009cf0 tx=0x7fa808009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:30.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.357+0000 7fa7ff7fe700 1 -- 172.21.15.81:0/362143393 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa810050190 con 0x7fa8180c1090 2023-11-29T11:19:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:30.517+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8180cabf0 con 0x7fa8180c1090 2023-11-29T11:19:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.217+0000 7fa7ff7fe700 1 -- 172.21.15.81:0/362143393 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa8100537b0 con 0x7fa8180c1090 2023-11-29T11:19:31.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa804064ee0 msgr2=0x7fa804067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:31.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa804064ee0 0x7fa804067390 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa808009cf0 tx=0x7fa808009240 comp rx=0 tx=0).stop 2023-11-29T11:19:31.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8180c1090 msgr2=0x7fa8180c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:31.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8180c1090 0x7fa8180c4190 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fa8180c1f00 tx=0x7fa810007c90 comp rx=0 tx=0).stop 2023-11-29T11:19:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 shutdown_connections 2023-11-29T11:19:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa804064ee0 0x7fa804067390 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8180c1090 0x7fa8180c4190 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8180c3100 0x7fa818069eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 --2- 172.21.15.81:0/362143393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa800006a80 0x7fa8180c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 >> 172.21.15.81:0/362143393 conn(0x7fa8180ce400 msgr2=0x7fa81806c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 shutdown_connections 2023-11-29T11:19:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.225+0000 7fa817fff700 1 -- 172.21.15.81:0/362143393 wait complete. 2023-11-29T11:19:31.235 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-11-29T11:19:31.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T11:19:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5f15c700 1 Processor -- start 2023-11-29T11:19:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5f15c700 1 -- start start 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5f15c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c500df6d0 0x7f7c500531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5f15c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7c50051400 0x7f7c50051820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5f15c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c500dfaa0 con 0x7f7c500548a0 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5f15c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c50054d00 con 0x7f7c500df6d0 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5f15c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c50051d60 con 0x7f7c50051400 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e15a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c500df6d0 0x7f7c500531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e15a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c500df6d0 0x7f7c500531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54110/0 (socket says 172.21.15.81:54110) 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e15a700 1 -- 172.21.15.81:0/3669388623 learned_addr learned my addr 172.21.15.81:0/3669388623 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5d959700 1 --1- 172.21.15.81:0/3669388623 >> v1:172.21.15.81:6789/0 conn(0x7f7c500548a0 0x7f7c5003b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50296/0 (socket says 172.21.15.81:50296) 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e95b700 1 --2- 172.21.15.81:0/3669388623 >> v2:172.21.15.176:3300/0 conn(0x7f7c50051400 0x7f7c50051820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e15a700 1 -- 172.21.15.81:0/3669388623 >> v2:172.21.15.176:3300/0 conn(0x7f7c50051400 msgr2=0x7f7c50051820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e15a700 1 --2- 172.21.15.81:0/3669388623 >> v2:172.21.15.176:3300/0 conn(0x7f7c50051400 0x7f7c50051820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e15a700 1 -- 172.21.15.81:0/3669388623 >> v1:172.21.15.81:6789/0 conn(0x7f7c500548a0 legacy=0x7f7c5003b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e15a700 1 -- 172.21.15.81:0/3669388623 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50053800 con 0x7f7c500df6d0 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e95b700 1 --2- 172.21.15.81:0/3669388623 >> v2:172.21.15.176:3300/0 conn(0x7f7c50051400 0x7f7c50051820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.357+0000 7f7c5e15a700 1 --2- 172.21.15.81:0/3669388623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c500df6d0 0x7f7c500531b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f7c50050340 tx=0x7f7c4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7731760bc3b605fa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5d158700 1 -- 172.21.15.81:0/3669388623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00b8a0 con 0x7f7c500df6d0 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5d158700 1 -- 172.21.15.81:0/3669388623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c00ba00 con 0x7f7c500df6d0 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5d158700 1 -- 172.21.15.81:0/3669388623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00bd90 con 0x7f7c500df6d0 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3669388623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c500df6d0 msgr2=0x7f7c500531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3669388623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c500df6d0 0x7f7c500531b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f7c50050340 tx=0x7f7c4c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3669388623 shutdown_connections 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3669388623 >> v2:172.21.15.176:3300/0 conn(0x7f7c50051400 0x7f7c50051820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3669388623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c500df6d0 0x7f7c500531b0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3669388623 >> 172.21.15.81:0/3669388623 conn(0x7f7c50052060 msgr2=0x7f7c50052460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3669388623 shutdown_connections 2023-11-29T11:19:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3669388623 wait complete. 2023-11-29T11:19:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 Processor -- start 2023-11-29T11:19:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.361+0000 7f7c5f15c700 1 -- start start 2023-11-29T11:19:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c50051400 0x7f7c5004d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c500548a0 0x7f7c5004e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c500df6d0 0x7f7c500d7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5004ee00 con 0x7f7c50051400 2023-11-29T11:19:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5004e3b0 con 0x7f7c500548a0 2023-11-29T11:19:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5004d7a0 con 0x7f7c500df6d0 2023-11-29T11:19:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c50051400 0x7f7c5004d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c50051400 0x7f7c5004d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54114/0 (socket says 172.21.15.81:54114) 2023-11-29T11:19:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 -- 172.21.15.81:0/3165151124 learned_addr learned my addr 172.21.15.81:0/3165151124 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e95b700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c500df6d0 0x7f7c500d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5d959700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c500548a0 0x7f7c5004e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 -- 172.21.15.81:0/3165151124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c500df6d0 msgr2=0x7f7c500d7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c500df6d0 0x7f7c500d7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 -- 172.21.15.81:0/3165151124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c500548a0 msgr2=0x7f7c5004e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c500548a0 0x7f7c5004e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 -- 172.21.15.81:0/3165151124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c009570 con 0x7f7c50051400 2023-11-29T11:19:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5e15a700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c50051400 0x7f7c5004d0c0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000c00 tx=0x7f7c4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c4affd700 1 -- 172.21.15.81:0/3165151124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c0038c0 con 0x7f7c50051400 2023-11-29T11:19:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c4affd700 1 -- 172.21.15.81:0/3165151124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c01e070 con 0x7f7c50051400 2023-11-29T11:19:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c50053dc0 con 0x7f7c50051400 2023-11-29T11:19:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c4affd700 1 -- 172.21.15.81:0/3165151124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c003c40 con 0x7f7c50051400 2023-11-29T11:19:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c50053ae0 con 0x7f7c50051400 2023-11-29T11:19:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.365+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c500540a0 con 0x7f7c50051400 2023-11-29T11:19:31.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.369+0000 7f7c4affd700 1 -- 172.21.15.81:0/3165151124 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7c4c00f050 con 0x7f7c50051400 2023-11-29T11:19:31.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.369+0000 7f7c4affd700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c3c064ee0 0x7f7c3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.369+0000 7f7c4affd700 1 -- 172.21.15.81:0/3165151124 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f7c4c020070 con 0x7f7c50051400 2023-11-29T11:19:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.369+0000 7f7c5d959700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c3c064ee0 0x7f7c3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.369+0000 7f7c5d959700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c3c064ee0 0x7f7c3c067390 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7c5004f5c0 tx=0x7f7c54007f30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:31.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.373+0000 7f7c4affd700 1 -- 172.21.15.81:0/3165151124 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7c4c051720 con 0x7f7c50051400 2023-11-29T11:19:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:31.541+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c50005990 con 0x7f7c50051400 2023-11-29T11:19:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.233+0000 7f7c4affd700 1 -- 172.21.15.81:0/3165151124 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c4c054d40 con 0x7f7c50051400 2023-11-29T11:19:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c3c064ee0 msgr2=0x7f7c3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c3c064ee0 0x7f7c3c067390 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7c5004f5c0 tx=0x7f7c54007f30 comp rx=0 tx=0).stop 2023-11-29T11:19:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c50051400 msgr2=0x7f7c5004d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c50051400 0x7f7c5004d0c0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000c00 tx=0x7f7c4c004770 comp rx=0 tx=0).stop 2023-11-29T11:19:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 shutdown_connections 2023-11-29T11:19:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c3c064ee0 0x7f7c3c067390 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c500df6d0 0x7f7c500d7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c500548a0 0x7f7c5004e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 --2- 172.21.15.81:0/3165151124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c50051400 0x7f7c5004d0c0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 >> 172.21.15.81:0/3165151124 conn(0x7f7c50052060 msgr2=0x7f7c50052430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 shutdown_connections 2023-11-29T11:19:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.241+0000 7f7c5f15c700 1 -- 172.21.15.81:0/3165151124 wait complete. 2023-11-29T11:19:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-11-29T11:19:32.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-29T11:19:32.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f61be7700 1 Processor -- start 2023-11-29T11:19:32.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f61be7700 1 -- start start 2023-11-29T11:19:32.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f61be7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f5c15c350 0x7f3f5c0b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f61be7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 0x7f3f5c0cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f61be7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0cff00 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f61be7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c0d06f0 con 0x7f3f5c15c350 2023-11-29T11:19:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f61be7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0d0130 con 0x7f3f5c0b2a90 2023-11-29T11:19:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f5b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f5c15c350 0x7f3f5c0b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f5b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f5c15c350 0x7f3f5c0b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54116/0 (socket says 172.21.15.81:54116) 2023-11-29T11:19:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f5b7fe700 1 -- 172.21.15.81:0/52565940 learned_addr learned my addr 172.21.15.81:0/52565940 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:32.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f5bfff700 1 --2- 172.21.15.81:0/52565940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 0x7f3f5c0cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f5b7fe700 1 -- 172.21.15.81:0/52565940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 msgr2=0x7f3f5c0cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:32.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f5b7fe700 1 --2- 172.21.15.81:0/52565940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 0x7f3f5c0cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.369+0000 7f3f5b7fe700 1 -- 172.21.15.81:0/52565940 >> v1:172.21.15.176:6789/0 conn(0x7f3f5c0ce4f0 legacy=0x7f3f5c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f5b7fe700 1 -- 172.21.15.81:0/52565940 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0d0410 con 0x7f3f5c15c350 2023-11-29T11:19:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f5b7fe700 1 --2- 172.21.15.81:0/52565940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c15c350 0x7f3f5c0b0c20 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009910 tx=0x7f3f50009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a41ca09e1825bb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/52565940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50011830 con 0x7f3f5c15c350 2023-11-29T11:19:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/52565940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50011990 con 0x7f3f5c15c350 2023-11-29T11:19:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f5a7fc700 1 -- 172.21.15.81:0/52565940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50011d40 con 0x7f3f5c15c350 2023-11-29T11:19:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 -- 172.21.15.81:0/52565940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c15c350 msgr2=0x7f3f5c0b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 --2- 172.21.15.81:0/52565940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c15c350 0x7f3f5c0b0c20 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009910 tx=0x7f3f50009c20 comp rx=0 tx=0).stop 2023-11-29T11:19:32.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 -- 172.21.15.81:0/52565940 shutdown_connections 2023-11-29T11:19:32.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 --2- 172.21.15.81:0/52565940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 0x7f3f5c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 --2- 172.21.15.81:0/52565940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c15c350 0x7f3f5c0b0c20 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 -- 172.21.15.81:0/52565940 >> 172.21.15.81:0/52565940 conn(0x7f3f5c0cd330 msgr2=0x7f3f5c0cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:32.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 -- 172.21.15.81:0/52565940 shutdown_connections 2023-11-29T11:19:32.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 -- 172.21.15.81:0/52565940 wait complete. 2023-11-29T11:19:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 Processor -- start 2023-11-29T11:19:32.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.373+0000 7f3f61be7700 1 -- start start 2023-11-29T11:19:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f61be7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 0x7f3f5c151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f61be7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c0ce4f0 0x7f3f5c0b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f61be7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f5c15c350 0x7f3f5c151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f61be7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0b5150 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f61be7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0b5430 con 0x7f3f5c15c350 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f61be7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0b5710 con 0x7f3f5c0b2a90 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c0ce4f0 0x7f3f5c0b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c0ce4f0 0x7f3f5c0b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54126/0 (socket says 172.21.15.81:54126) 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 -- 172.21.15.81:0/2087220228 learned_addr learned my addr 172.21.15.81:0/2087220228 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5b7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 0x7f3f5c151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5bfff700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f5c15c350 0x7f3f5c151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 -- 172.21.15.81:0/2087220228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 msgr2=0x7f3f5c151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 0x7f3f5c151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 -- 172.21.15.81:0/2087220228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f5c15c350 msgr2=0x7f3f5c151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f5c15c350 0x7f3f5c151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 -- 172.21.15.81:0/2087220228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50009570 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5bfff700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f5c15c350 0x7f3f5c151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f5affd700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c0ce4f0 0x7f3f5c0b4a70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00c4d0 tx=0x7f3f4c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f43fff700 1 -- 172.21.15.81:0/2087220228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0052d0 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f43fff700 1 -- 172.21.15.81:0/2087220228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c005430 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c0cb360 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f43fff700 1 -- 172.21.15.81:0/2087220228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0055a0 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.377+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c0cb080 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.381+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c0b1160 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.381+0000 7f3f43fff700 1 -- 172.21.15.81:0/2087220228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3f4c019030 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.381+0000 7f3f43fff700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f48064ee0 0x7f3f48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.381+0000 7f3f43fff700 1 -- 172.21.15.81:0/2087220228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f3f4c081100 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.381+0000 7f3f5b7fe700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f48064ee0 0x7f3f48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.381+0000 7f3f5b7fe700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f48064ee0 0x7f3f48067390 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3f50000c00 tx=0x7f3f50008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.389+0000 7f3f43fff700 1 -- 172.21.15.81:0/2087220228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3f4c04f310 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.553+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3f5c0b0080 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f43fff700 1 -- 172.21.15.81:0/2087220228 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3f4c052930 con 0x7f3f5c0ce4f0 2023-11-29T11:19:32.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f48064ee0 msgr2=0x7f3f48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f48064ee0 0x7f3f48067390 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3f50000c00 tx=0x7f3f50008030 comp rx=0 tx=0).stop 2023-11-29T11:19:32.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c0ce4f0 msgr2=0x7f3f5c0b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c0ce4f0 0x7f3f5c0b4a70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00c4d0 tx=0x7f3f4c00c7e0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 shutdown_connections 2023-11-29T11:19:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f48064ee0 0x7f3f48067390 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f5c15c350 0x7f3f5c151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c0ce4f0 0x7f3f5c0b4a70 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 --2- 172.21.15.81:0/2087220228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f5c0b2a90 0x7f3f5c151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 >> 172.21.15.81:0/2087220228 conn(0x7f3f5c0cd330 msgr2=0x7f3f5c0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 shutdown_connections 2023-11-29T11:19:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.565+0000 7f3f61be7700 1 -- 172.21.15.81:0/2087220228 wait complete. 2023-11-29T11:19:32.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2023-11-29T11:19:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f277d7c3700 1 Processor -- start 2023-11-29T11:19:32.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f277d7c3700 1 -- start start 2023-11-29T11:19:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f277d7c3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f277815c1f0 0x7f27780cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f277d7c3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2778070350 0x7f27780cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f277d7c3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780c9750 con 0x7f27780708a0 2023-11-29T11:19:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f277d7c3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277806ac50 con 0x7f277815c1f0 2023-11-29T11:19:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f277d7c3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780c9980 con 0x7f2778070350 2023-11-29T11:19:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f27777fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f27780708a0 0x7f277815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50306/0 (socket says 172.21.15.81:50306) 2023-11-29T11:19:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f27777fe700 1 -- 172.21.15.81:0/2102055526 learned_addr learned my addr 172.21.15.81:0/2102055526 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f2776ffd700 1 --2- 172.21.15.81:0/2102055526 >> v2:172.21.15.176:3300/0 conn(0x7f277815c1f0 0x7f27780cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f27767fc700 1 --2- 172.21.15.81:0/2102055526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2778070350 0x7f27780cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f2775ffb700 1 -- 172.21.15.81:0/2102055526 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774858604 0 0) 0x7f27780c9750 con 0x7f27780708a0 2023-11-29T11:19:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f2775ffb700 1 -- 172.21.15.81:0/2102055526 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27600035d0 con 0x7f27780708a0 2023-11-29T11:19:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f2776ffd700 1 -- 172.21.15.81:0/2102055526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2778070350 msgr2=0x7f27780cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f2776ffd700 1 --2- 172.21.15.81:0/2102055526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2778070350 0x7f27780cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f2776ffd700 1 -- 172.21.15.81:0/2102055526 >> v1:172.21.15.81:6789/0 conn(0x7f27780708a0 legacy=0x7f277815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.709+0000 7f2776ffd700 1 -- 172.21.15.81:0/2102055526 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780c9c60 con 0x7f277815c1f0 2023-11-29T11:19:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f2776ffd700 1 --2- 172.21.15.81:0/2102055526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 0x7f27780cd030 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f276c009850 tx=0x7f276c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c299fe970de1b21 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:32.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f2775ffb700 1 -- 172.21.15.81:0/2102055526 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c011830 con 0x7f277815c1f0 2023-11-29T11:19:32.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f2775ffb700 1 -- 172.21.15.81:0/2102055526 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c011990 con 0x7f277815c1f0 2023-11-29T11:19:32.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f2775ffb700 1 -- 172.21.15.81:0/2102055526 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c011d40 con 0x7f277815c1f0 2023-11-29T11:19:32.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- 172.21.15.81:0/2102055526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 msgr2=0x7f27780cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 --2- 172.21.15.81:0/2102055526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 0x7f27780cd030 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f276c009850 tx=0x7f276c009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:32.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- 172.21.15.81:0/2102055526 shutdown_connections 2023-11-29T11:19:32.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 --2- 172.21.15.81:0/2102055526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2778070350 0x7f27780cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 --2- 172.21.15.81:0/2102055526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 0x7f27780cd030 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- 172.21.15.81:0/2102055526 >> 172.21.15.81:0/2102055526 conn(0x7f277806caf0 msgr2=0x7f27780ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:32.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- 172.21.15.81:0/2102055526 shutdown_connections 2023-11-29T11:19:32.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- 172.21.15.81:0/2102055526 wait complete. 2023-11-29T11:19:32.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 Processor -- start 2023-11-29T11:19:32.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- start start 2023-11-29T11:19:32.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2778070350 0x7f2778145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780708a0 0x7f2778159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 0x7f277815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778148190 con 0x7f2778070350 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27781489f0 con 0x7f277815c1f0 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.713+0000 7f277d7c3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2778145dd0 con 0x7f27780708a0 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f2776ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2778070350 0x7f2778145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f27767fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780708a0 0x7f2778159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f27767fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780708a0 0x7f2778159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:54956/0 (socket says 172.21.15.81:54956) 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f27767fc700 1 -- 172.21.15.81:0/1515785850 learned_addr learned my addr 172.21.15.81:0/1515785850 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f27777fe700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 0x7f277815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f2776ffd700 1 -- 172.21.15.81:0/1515785850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780708a0 msgr2=0x7f2778159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f2776ffd700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780708a0 0x7f2778159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f2776ffd700 1 -- 172.21.15.81:0/1515785850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 msgr2=0x7f277815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f2776ffd700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 0x7f277815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:32.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f2776ffd700 1 -- 172.21.15.81:0/1515785850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0094b0 con 0x7f2778070350 2023-11-29T11:19:32.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f2776ffd700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2778070350 0x7f2778145890 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f276c016000 tx=0x7f276c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:32.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f275f7fe700 1 -- 172.21.15.81:0/1515785850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c0036c0 con 0x7f2778070350 2023-11-29T11:19:32.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27780ca220 con 0x7f2778070350 2023-11-29T11:19:32.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27780c9f40 con 0x7f2778070350 2023-11-29T11:19:32.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f275f7fe700 1 -- 172.21.15.81:0/1515785850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c01e070 con 0x7f2778070350 2023-11-29T11:19:32.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f275f7fe700 1 -- 172.21.15.81:0/1515785850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c003a20 con 0x7f2778070350 2023-11-29T11:19:32.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.717+0000 7f275f7fe700 1 -- 172.21.15.81:0/1515785850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f276c00f050 con 0x7f2778070350 2023-11-29T11:19:32.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.721+0000 7f275f7fe700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2764064f30 0x7f27640673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:32.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.721+0000 7f275f7fe700 1 -- 172.21.15.81:0/1515785850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f276c020070 con 0x7f2778070350 2023-11-29T11:19:32.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.721+0000 7f27767fc700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2764064f30 0x7f27640673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:32.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.721+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2758005310 con 0x7f2778070350 2023-11-29T11:19:32.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.721+0000 7f27767fc700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2764064f30 0x7f27640673e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f27780b3c40 tx=0x7f2770009970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:32.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.725+0000 7f275f7fe700 1 -- 172.21.15.81:0/1515785850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f276c051510 con 0x7f2778070350 2023-11-29T11:19:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:32.937+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f27580055c0 con 0x7f2778070350 2023-11-29T11:19:33.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.233+0000 7f275f7fe700 1 -- 172.21.15.81:0/1515785850 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v319) v1 ==== 166+0+0 (secure 0 0 0) 0x7f276c055170 con 0x7f2778070350 2023-11-29T11:19:33.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.237+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2764064f30 msgr2=0x7f27640673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:33.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.237+0000 7f277d7c3700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2764064f30 0x7f27640673e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f27780b3c40 tx=0x7f2770009970 comp rx=0 tx=0).stop 2023-11-29T11:19:33.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.237+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2778070350 msgr2=0x7f2778145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.237+0000 7f277d7c3700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2778070350 0x7f2778145890 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f276c016000 tx=0x7f276c004770 comp rx=0 tx=0).stop 2023-11-29T11:19:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.241+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 shutdown_connections 2023-11-29T11:19:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.241+0000 7f277d7c3700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2764064f30 0x7f27640673e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.241+0000 7f277d7c3700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f277815c1f0 0x7f277815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.241+0000 7f277d7c3700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27780708a0 0x7f2778159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.241+0000 7f277d7c3700 1 --2- 172.21.15.81:0/1515785850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2778070350 0x7f2778145890 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.241+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 >> 172.21.15.81:0/1515785850 conn(0x7f277806caf0 msgr2=0x7f27780c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.241+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 shutdown_connections 2023-11-29T11:19:33.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.245+0000 7f277d7c3700 1 -- 172.21.15.81:0/1515785850 wait complete. 2023-11-29T11:19:33.266 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2023-11-29T11:19:33.266 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-29T11:19:33.266 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:19:33.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2023-11-29T11:19:33.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.361+0000 7f73da65e700 1 Processor -- start 2023-11-29T11:19:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- start start 2023-11-29T11:19:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 0x7f73d40b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73d4069cd0 0x7f73d406a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d40cbe00 con 0x7f73d41584c0 2023-11-29T11:19:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d406dbd0 con 0x7f73d4069cd0 2023-11-29T11:19:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40b3c30 con 0x7f73d40b32e0 2023-11-29T11:19:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d9e5d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73d4069cd0 0x7f73d406a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d9e5d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73d4069cd0 0x7f73d406a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54144/0 (socket says 172.21.15.81:54144) 2023-11-29T11:19:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d965c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f73d41584c0 0x7f73d40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50314/0 (socket says 172.21.15.81:50314) 2023-11-29T11:19:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d9e5d700 1 -- 172.21.15.81:0/3184744449 learned_addr learned my addr 172.21.15.81:0/3184744449 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d8e5b700 1 --2- 172.21.15.81:0/3184744449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 0x7f73d40b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d9e5d700 1 -- 172.21.15.81:0/3184744449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 msgr2=0x7f73d40b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d9e5d700 1 --2- 172.21.15.81:0/3184744449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 0x7f73d40b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d9e5d700 1 -- 172.21.15.81:0/3184744449 >> v1:172.21.15.81:6789/0 conn(0x7f73d41584c0 legacy=0x7f73d40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d9e5d700 1 -- 172.21.15.81:0/3184744449 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d40cd0f0 con 0x7f73d4069cd0 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73d9e5d700 1 --2- 172.21.15.81:0/3184744449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d4069cd0 0x7f73d406a0f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009e50 tx=0x7f73cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9326288a8fc8fa04 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73cbfff700 1 -- 172.21.15.81:0/3184744449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00e070 con 0x7f73d4069cd0 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73cbfff700 1 -- 172.21.15.81:0/3184744449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc00b9c0 con 0x7f73d4069cd0 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73cbfff700 1 -- 172.21.15.81:0/3184744449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00bd70 con 0x7f73d4069cd0 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- 172.21.15.81:0/3184744449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d4069cd0 msgr2=0x7f73d406a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 --2- 172.21.15.81:0/3184744449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d4069cd0 0x7f73d406a0f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009e50 tx=0x7f73cc00b330 comp rx=0 tx=0).stop 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- 172.21.15.81:0/3184744449 shutdown_connections 2023-11-29T11:19:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 --2- 172.21.15.81:0/3184744449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d4069cd0 0x7f73d406a0f0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 --2- 172.21.15.81:0/3184744449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 0x7f73d40b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- 172.21.15.81:0/3184744449 >> 172.21.15.81:0/3184744449 conn(0x7f73d40ce3e0 msgr2=0x7f73d40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:33.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- 172.21.15.81:0/3184744449 shutdown_connections 2023-11-29T11:19:33.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.365+0000 7f73da65e700 1 -- 172.21.15.81:0/3184744449 wait complete. 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 Processor -- start 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 -- start start 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4069cd0 0x7f73d40acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 0x7f73d4166970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d41584c0 0x7f73d414f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40ab530 con 0x7f73d41584c0 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40ab810 con 0x7f73d4069cd0 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40abaf0 con 0x7f73d40b32e0 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d41584c0 0x7f73d414f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d41584c0 0x7f73d414f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54148/0 (socket says 172.21.15.81:54148) 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 -- 172.21.15.81:0/3115238541 learned_addr learned my addr 172.21.15.81:0/3115238541 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d965c700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4069cd0 0x7f73d40acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d8e5b700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 0x7f73d4166970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 -- 172.21.15.81:0/3115238541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 msgr2=0x7f73d4166970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 0x7f73d4166970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 -- 172.21.15.81:0/3115238541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4069cd0 msgr2=0x7f73d40acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4069cd0 0x7f73d40acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 -- 172.21.15.81:0/3115238541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc009b30 con 0x7f73d41584c0 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73d9e5d700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d41584c0 0x7f73d414f7f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f73d406f880 tx=0x7f73cc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73c9ffb700 1 -- 172.21.15.81:0/3115238541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0048b0 con 0x7f73d41584c0 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73c9ffb700 1 -- 172.21.15.81:0/3115238541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc0099b0 con 0x7f73d41584c0 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73c9ffb700 1 -- 172.21.15.81:0/3115238541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc01c680 con 0x7f73d41584c0 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d40cd6b0 con 0x7f73d41584c0 2023-11-29T11:19:33.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.369+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d40cd3d0 con 0x7f73d41584c0 2023-11-29T11:19:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.373+0000 7f73c9ffb700 1 -- 172.21.15.81:0/3115238541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f73cc02c070 con 0x7f73d41584c0 2023-11-29T11:19:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.373+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d40cd990 con 0x7f73d41584c0 2023-11-29T11:19:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.373+0000 7f73c9ffb700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f73b8064ee0 0x7f73b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.373+0000 7f73c9ffb700 1 -- 172.21.15.81:0/3115238541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f73cc0838c0 con 0x7f73d41584c0 2023-11-29T11:19:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.373+0000 7f73d965c700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f73b8064ee0 0x7f73b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.373+0000 7f73d965c700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f73b8064ee0 0x7f73b8067390 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f73c4000f60 tx=0x7f73c4007ef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:33.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.377+0000 7f73c9ffb700 1 -- 172.21.15.81:0/3115238541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f73cc051bc0 con 0x7f73d41584c0 2023-11-29T11:19:33.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:33.593+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f73d40b4230 con 0x7f73d41584c0 2023-11-29T11:19:34.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.237+0000 7f73c9ffb700 1 -- 172.21.15.81:0/3115238541 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v320) v1 ==== 170+0+0 (secure 0 0 0) 0x7f73cc0551e0 con 0x7f73d41584c0 2023-11-29T11:19:34.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.237+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f73b8064ee0 msgr2=0x7f73b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.237+0000 7f73da65e700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f73b8064ee0 0x7f73b8067390 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f73c4000f60 tx=0x7f73c4007ef0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.237+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d41584c0 msgr2=0x7f73d414f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.237+0000 7f73da65e700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d41584c0 0x7f73d414f7f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f73d406f880 tx=0x7f73cc004af0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.241+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 shutdown_connections 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.241+0000 7f73da65e700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f73b8064ee0 0x7f73b8067390 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.241+0000 7f73da65e700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d41584c0 0x7f73d414f7f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.241+0000 7f73da65e700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73d40b32e0 0x7f73d4166970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.241+0000 7f73da65e700 1 --2- 172.21.15.81:0/3115238541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73d4069cd0 0x7f73d40acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.241+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 >> 172.21.15.81:0/3115238541 conn(0x7f73d40ce3e0 msgr2=0x7f73d414c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.241+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 shutdown_connections 2023-11-29T11:19:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.241+0000 7f73da65e700 1 -- 172.21.15.81:0/3115238541 wait complete. 2023-11-29T11:19:34.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-29T11:19:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.381+0000 7ff8ce240700 1 Processor -- start 2023-11-29T11:19:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.381+0000 7ff8ce240700 1 -- start start 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c806ce60 0x7ff8c80d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff8c80cce60 0x7ff8c806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8c80cf470 0x7ff8c80cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c815c8b0 con 0x7ff8c80cf470 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c80cd2d0 con 0x7ff8c80cce60 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c806d770 con 0x7ff8c806ce60 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8c80cf470 0x7ff8c80cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8c80cf470 0x7ff8c80cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54164/0 (socket says 172.21.15.81:54164) 2023-11-29T11:19:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 -- 172.21.15.81:0/3331673675 learned_addr learned my addr 172.21.15.81:0/3331673675 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cca3d700 1 --2- 172.21.15.81:0/3331673675 >> v2:172.21.15.176:3300/0 conn(0x7ff8c80cce60 0x7ff8c806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cd23e700 1 --2- 172.21.15.81:0/3331673675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c806ce60 0x7ff8c80d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 -- 172.21.15.81:0/3331673675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c806ce60 msgr2=0x7ff8c80d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 --2- 172.21.15.81:0/3331673675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c806ce60 0x7ff8c80d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 -- 172.21.15.81:0/3331673675 >> v2:172.21.15.176:3300/0 conn(0x7ff8c80cce60 msgr2=0x7ff8c806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 --2- 172.21.15.81:0/3331673675 >> v2:172.21.15.176:3300/0 conn(0x7ff8c80cce60 0x7ff8c806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 -- 172.21.15.81:0/3331673675 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c806a7f0 con 0x7ff8c80cf470 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8cda3f700 1 --2- 172.21.15.81:0/3331673675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c80cf470 0x7ff8c80cf8f0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8066160 tx=0x7ff8c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6899f86a06a1c02e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8bbfff700 1 -- 172.21.15.81:0/3331673675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000e070 con 0x7ff8c80cf470 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8bbfff700 1 -- 172.21.15.81:0/3331673675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c000b910 con 0x7ff8c80cf470 2023-11-29T11:19:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8bbfff700 1 -- 172.21.15.81:0/3331673675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000bcc0 con 0x7ff8c80cf470 2023-11-29T11:19:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 -- 172.21.15.81:0/3331673675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c80cf470 msgr2=0x7ff8c80cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 --2- 172.21.15.81:0/3331673675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c80cf470 0x7ff8c80cf8f0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8066160 tx=0x7ff8c000b330 comp rx=0 tx=0).stop 2023-11-29T11:19:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 -- 172.21.15.81:0/3331673675 shutdown_connections 2023-11-29T11:19:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 --2- 172.21.15.81:0/3331673675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c80cf470 0x7ff8c80cf8f0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 --2- 172.21.15.81:0/3331673675 >> v2:172.21.15.176:3300/0 conn(0x7ff8c80cce60 0x7ff8c806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 --2- 172.21.15.81:0/3331673675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c806ce60 0x7ff8c80d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 -- 172.21.15.81:0/3331673675 >> 172.21.15.81:0/3331673675 conn(0x7ff8c80b5760 msgr2=0x7ff8c80b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 -- 172.21.15.81:0/3331673675 shutdown_connections 2023-11-29T11:19:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.385+0000 7ff8ce240700 1 -- 172.21.15.81:0/3331673675 wait complete. 2023-11-29T11:19:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 Processor -- start 2023-11-29T11:19:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 -- start start 2023-11-29T11:19:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c806ce60 0x7ff8c80c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c80cce60 0x7ff8c814dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8c80cf470 0x7ff8c81e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c814e210 con 0x7ff8c806ce60 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81e6690 con 0x7ff8c80cf470 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c80c7eb0 con 0x7ff8c80cce60 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c806ce60 0x7ff8c80c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c806ce60 0x7ff8c80c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54178/0 (socket says 172.21.15.81:54178) 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 -- 172.21.15.81:0/2867807379 learned_addr learned my addr 172.21.15.81:0/2867807379 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cca3d700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c80cce60 0x7ff8c814dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cda3f700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8c80cf470 0x7ff8c81e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 -- 172.21.15.81:0/2867807379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c80cce60 msgr2=0x7ff8c814dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c80cce60 0x7ff8c814dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 -- 172.21.15.81:0/2867807379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8c80cf470 msgr2=0x7ff8c81e4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8c80cf470 0x7ff8c81e4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 -- 172.21.15.81:0/2867807379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c0009b30 con 0x7ff8c806ce60 2023-11-29T11:19:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8cd23e700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c806ce60 0x7ff8c80c8f50 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400d800 tx=0x7ff8c400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8b9ffb700 1 -- 172.21.15.81:0/2867807379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40125f0 con 0x7ff8c806ce60 2023-11-29T11:19:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8b9ffb700 1 -- 172.21.15.81:0/2867807379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4012750 con 0x7ff8c806ce60 2023-11-29T11:19:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c806adb0 con 0x7ff8c806ce60 2023-11-29T11:19:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.389+0000 7ff8b9ffb700 1 -- 172.21.15.81:0/2867807379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4012ac0 con 0x7ff8c806ce60 2023-11-29T11:19:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.393+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c806aad0 con 0x7ff8c806ce60 2023-11-29T11:19:34.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.393+0000 7ff8b9ffb700 1 -- 172.21.15.81:0/2867807379 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff8c4012c20 con 0x7ff8c806ce60 2023-11-29T11:19:34.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.393+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c806b090 con 0x7ff8c806ce60 2023-11-29T11:19:34.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.393+0000 7ff8b9ffb700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ac064ee0 0x7ff8ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.393+0000 7ff8cca3d700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ac064ee0 0x7ff8ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.393+0000 7ff8b9ffb700 1 -- 172.21.15.81:0/2867807379 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff8c4081ed0 con 0x7ff8c806ce60 2023-11-29T11:19:34.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.397+0000 7ff8cca3d700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ac064ee0 0x7ff8ac067390 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff8c81e2ce0 tx=0x7ff8bc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:34.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.401+0000 7ff8b9ffb700 1 -- 172.21.15.81:0/2867807379 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff8c40501d0 con 0x7ff8c806ce60 2023-11-29T11:19:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.569+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff8c8072c20 con 0x7ff8c806ce60 2023-11-29T11:19:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.577+0000 7ff8b9ffb700 1 -- 172.21.15.81:0/2867807379 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff8c40537f0 con 0x7ff8c806ce60 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ac064ee0 msgr2=0x7ff8ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ac064ee0 0x7ff8ac067390 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff8c81e2ce0 tx=0x7ff8bc009240 comp rx=0 tx=0).stop 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c806ce60 msgr2=0x7ff8c80c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c806ce60 0x7ff8c80c8f50 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400d800 tx=0x7ff8c400db10 comp rx=0 tx=0).stop 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 shutdown_connections 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff8ac064ee0 0x7ff8ac067390 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8c80cf470 0x7ff8c81e4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8c80cce60 0x7ff8c814dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 --2- 172.21.15.81:0/2867807379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c806ce60 0x7ff8c80c8f50 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 >> 172.21.15.81:0/2867807379 conn(0x7ff8c80b5760 msgr2=0x7ff8c815bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:34.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 shutdown_connections 2023-11-29T11:19:34.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.581+0000 7ff8ce240700 1 -- 172.21.15.81:0/2867807379 wait complete. 2023-11-29T11:19:34.600 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:19:34.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:19:34.620 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:19:34.640 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:19:34.640 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:19:34.640 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:34.647 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:19:34.648 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:19:34.648 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:34.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:19:34.687 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:19:34.687 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:34.694 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:19:34.694 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:19:34.694 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:34.701 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:19:34.701 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-29T11:19:34.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23c6ed4700 1 Processor -- start 2023-11-29T11:19:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23c6ed4700 1 -- start start 2023-11-29T11:19:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23c6ed4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f23c01510d0 0x7f23c015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23c6ed4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c0069c40 0x7f23c00b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23c6ed4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c00b1170 con 0x7f23c00c98a0 2023-11-29T11:19:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23c6ed4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c00c95d0 con 0x7f23c01510d0 2023-11-29T11:19:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23c6ed4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00c8e00 con 0x7f23c0069c40 2023-11-29T11:19:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c0069c40 0x7f23c00b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c0069c40 0x7f23c00b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:55006/0 (socket says 172.21.15.81:55006) 2023-11-29T11:19:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bffff700 1 -- 172.21.15.81:0/2173315207 learned_addr learned my addr 172.21.15.81:0/2173315207 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23c4c70700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f23c01510d0 0x7f23c015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bffff700 1 -- 172.21.15.81:0/2173315207 >> v2:172.21.15.176:3300/0 conn(0x7f23c01510d0 msgr2=0x7f23c015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bffff700 1 --2- 172.21.15.81:0/2173315207 >> v2:172.21.15.176:3300/0 conn(0x7f23c01510d0 0x7f23c015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bffff700 1 -- 172.21.15.81:0/2173315207 >> v1:172.21.15.176:6789/0 conn(0x7f23c00c98a0 legacy=0x7f23c00c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bf7fe700 1 -- 172.21.15.81:0/2173315207 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572819538 0 0) 0x7f23c00b1170 con 0x7f23c00c98a0 2023-11-29T11:19:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bffff700 1 -- 172.21.15.81:0/2173315207 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00c9010 con 0x7f23c0069c40 2023-11-29T11:19:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bffff700 1 --2- 172.21.15.81:0/2173315207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c0069c40 0x7f23c00b0c30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009e50 tx=0x7f23b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb2065c82ba3fb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bf7fe700 1 -- 172.21.15.81:0/2173315207 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800e070 con 0x7f23c0069c40 2023-11-29T11:19:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bf7fe700 1 -- 172.21.15.81:0/2173315207 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b800b910 con 0x7f23c0069c40 2023-11-29T11:19:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.813+0000 7f23bf7fe700 1 -- 172.21.15.81:0/2173315207 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800bcc0 con 0x7f23c0069c40 2023-11-29T11:19:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.817+0000 7f23c6ed4700 1 -- 172.21.15.81:0/2173315207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c0069c40 msgr2=0x7f23c00b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.817+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/2173315207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c0069c40 0x7f23c00b0c30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009e50 tx=0x7f23b800b330 comp rx=0 tx=0).stop 2023-11-29T11:19:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.817+0000 7f23c6ed4700 1 -- 172.21.15.81:0/2173315207 shutdown_connections 2023-11-29T11:19:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.817+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/2173315207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c0069c40 0x7f23c00b0c30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.817+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/2173315207 >> v2:172.21.15.176:3300/0 conn(0x7f23c01510d0 0x7f23c015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.817+0000 7f23c6ed4700 1 -- 172.21.15.81:0/2173315207 >> 172.21.15.81:0/2173315207 conn(0x7f23c006caf0 msgr2=0x7f23c00ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.817+0000 7f23c6ed4700 1 -- 172.21.15.81:0/2173315207 shutdown_connections 2023-11-29T11:19:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.817+0000 7f23c6ed4700 1 -- 172.21.15.81:0/2173315207 wait complete. 2023-11-29T11:19:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c6ed4700 1 Processor -- start 2023-11-29T11:19:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c6ed4700 1 -- start start 2023-11-29T11:19:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c6ed4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23c0069c40 0x7f23c0143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c6ed4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23c00c98a0 0x7f23c015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c6ed4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c01510d0 0x7f23c01e4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c6ed4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c015ce60 con 0x7f23c00c98a0 2023-11-29T11:19:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c6ed4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c0143860 con 0x7f23c0069c40 2023-11-29T11:19:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c6ed4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c015ba40 con 0x7f23c01510d0 2023-11-29T11:19:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23c00c98a0 0x7f23c015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c4c70700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23c0069c40 0x7f23c0143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c4c70700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23c0069c40 0x7f23c0143320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59474/0 (socket says 172.21.15.81:59474) 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23c00c98a0 0x7f23c015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54186/0 (socket says 172.21.15.81:54186) 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c4c70700 1 -- 172.21.15.81:0/3662296479 learned_addr learned my addr 172.21.15.81:0/3662296479 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c5471700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c01510d0 0x7f23c01e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bffff700 1 -- 172.21.15.81:0/3662296479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c01510d0 msgr2=0x7f23c01e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bffff700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c01510d0 0x7f23c01e4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bffff700 1 -- 172.21.15.81:0/3662296479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23c0069c40 msgr2=0x7f23c0143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bffff700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23c0069c40 0x7f23c0143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bffff700 1 -- 172.21.15.81:0/3662296479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8009b30 con 0x7f23c00c98a0 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23c4c70700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23c0069c40 0x7f23c0143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bffff700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23c00c98a0 0x7f23c015b260 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f23b8015000 tx=0x7f23b8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bd7fa700 1 -- 172.21.15.81:0/3662296479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8004900 con 0x7f23c00c98a0 2023-11-29T11:19:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bd7fa700 1 -- 172.21.15.81:0/3662296479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b80099b0 con 0x7f23c00c98a0 2023-11-29T11:19:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.821+0000 7f23bd7fa700 1 -- 172.21.15.81:0/3662296479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b801b650 con 0x7f23c00c98a0 2023-11-29T11:19:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.825+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c0070170 con 0x7f23c00c98a0 2023-11-29T11:19:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.825+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c00c92f0 con 0x7f23c00c98a0 2023-11-29T11:19:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.825+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c01514a0 con 0x7f23c00c98a0 2023-11-29T11:19:34.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.825+0000 7f23bd7fa700 1 -- 172.21.15.81:0/3662296479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f23b8021030 con 0x7f23c00c98a0 2023-11-29T11:19:34.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.825+0000 7f23bd7fa700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:34.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.825+0000 7f23bd7fa700 1 -- 172.21.15.81:0/3662296479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f23b80830c0 con 0x7f23c00c98a0 2023-11-29T11:19:34.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.825+0000 7f23c4c70700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:34.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.829+0000 7f23c4c70700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f23a80113d0 tx=0x7f23a8009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:34.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:34.837+0000 7f23bd7fa700 1 -- 172.21.15.81:0/3662296479 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23b80513c0 con 0x7f23c00c98a0 2023-11-29T11:19:35.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.037+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23c0072500 con 0x7f23c00c98a0 2023-11-29T11:19:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.037+0000 7f23bd7fa700 1 -- 172.21.15.81:0/3662296479 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f23b801fde0 con 0x7f23c00c98a0 2023-11-29T11:19:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:35.044 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/1977028063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1977028063},{"type":"v1","addr":"172.21.15.176:6834","nonce":1977028063}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6227,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2341189296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2341189296},{"type":"v1","addr":"172.21.15.176:6835","nonce":2341189296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2029878363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2029878363},{"type":"v1","addr":"172.21.15.81:6835","nonce":2029878363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7950,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2983105393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2983105393},{"type":"v1","addr":"172.21.15.81:6837","nonce":2983105393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[]} 2023-11-29T11:19:35.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 msgr2=0x7f23a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:35.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f23a80113d0 tx=0x7f23a8009240 comp rx=0 tx=0).stop 2023-11-29T11:19:35.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23c00c98a0 msgr2=0x7f23c015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:35.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23c00c98a0 0x7f23c015b260 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f23b8015000 tx=0x7f23b8004af0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 shutdown_connections 2023-11-29T11:19:35.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23c01510d0 0x7f23c01e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23c00c98a0 0x7f23c015b260 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 --2- 172.21.15.81:0/3662296479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23c0069c40 0x7f23c0143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 >> 172.21.15.81:0/3662296479 conn(0x7f23c006caf0 msgr2=0x7f23c006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 shutdown_connections 2023-11-29T11:19:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.041+0000 7f23c6ed4700 1 -- 172.21.15.81:0/3662296479 wait complete. 2023-11-29T11:19:35.048 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 49 2023-11-29T11:19:35.059 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-29T11:19:35.059 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-29T11:19:35.059 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T11:19:35.059 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:19:35.060 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-29T11:19:35.060 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-29T11:19:35.060 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T11:19:35.060 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:19:35.060 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-29T11:19:35.060 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-29T11:19:35.060 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T11:19:35.061 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:19:35.061 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-29T11:19:35.061 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-29T11:19:35.061 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T11:19:35.061 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:19:35.070 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T11:19:35.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-29T11:19:35.072 INFO:tasks.ceph.mds.a:Started 2023-11-29T11:19:35.072 DEBUG:teuthology.parallel:result is None 2023-11-29T11:19:35.075 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T11:19:35.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-29T11:19:35.076 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T11:19:35.076 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-29T11:19:35.077 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T11:19:35.077 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-29T11:19:35.079 INFO:tasks.ceph.mds.d:Started 2023-11-29T11:19:35.079 DEBUG:teuthology.parallel:result is None 2023-11-29T11:19:35.079 INFO:tasks.ceph.mds.c:Started 2023-11-29T11:19:35.080 DEBUG:teuthology.parallel:result is None 2023-11-29T11:19:35.080 INFO:tasks.ceph.mds.b:Started 2023-11-29T11:19:35.080 DEBUG:teuthology.parallel:result is None 2023-11-29T11:19:35.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-29T11:19:35.143 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:19:35.145 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:19:35.158 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:19:35.159 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-29T11:19:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.181+0000 7fba77fff700 1 Processor -- start 2023-11-29T11:19:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.181+0000 7fba77fff700 1 -- start start 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.181+0000 7fba77fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fba780ca810 0x7fba780ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.181+0000 7fba77fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba7806a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.181+0000 7fba77fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba780cabe0 con 0x7fba780cf030 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.181+0000 7fba77fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780adc00 con 0x7fba780ca810 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.181+0000 7fba77fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780b3380 con 0x7fba780c8a30 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba7806a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba777fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fba780cf030 0x7fba78071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50334/0 (socket says 172.21.15.81:50334) 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba7806a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:55054/0 (socket says 172.21.15.81:55054) 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba777fe700 1 -- 172.21.15.81:0/3780495968 learned_addr learned my addr 172.21.15.81:0/3780495968 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba76ffd700 1 --2- 172.21.15.81:0/3780495968 >> v2:172.21.15.176:3300/0 conn(0x7fba780ca810 0x7fba780ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:35.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba6ffff700 1 -- 172.21.15.81:0/3780495968 >> v2:172.21.15.176:3300/0 conn(0x7fba780ca810 msgr2=0x7fba780ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:35.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba6ffff700 1 --2- 172.21.15.81:0/3780495968 >> v2:172.21.15.176:3300/0 conn(0x7fba780ca810 0x7fba780ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba6ffff700 1 -- 172.21.15.81:0/3780495968 >> v1:172.21.15.81:6789/0 conn(0x7fba780cf030 legacy=0x7fba78071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:35.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba6ffff700 1 -- 172.21.15.81:0/3780495968 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78158be0 con 0x7fba780c8a30 2023-11-29T11:19:35.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba6ffff700 1 --2- 172.21.15.81:0/3780495968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba7806a650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba60009850 tx=0x7fba60009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=852395b4b1e6f7c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba767fc700 1 -- 172.21.15.81:0/3780495968 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60011830 con 0x7fba780c8a30 2023-11-29T11:19:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba767fc700 1 -- 172.21.15.81:0/3780495968 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60011990 con 0x7fba780c8a30 2023-11-29T11:19:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba767fc700 1 -- 172.21.15.81:0/3780495968 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60011d40 con 0x7fba780c8a30 2023-11-29T11:19:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba77fff700 1 -- 172.21.15.81:0/3780495968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 msgr2=0x7fba7806a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba77fff700 1 --2- 172.21.15.81:0/3780495968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba7806a650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba60009850 tx=0x7fba60009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba77fff700 1 -- 172.21.15.81:0/3780495968 shutdown_connections 2023-11-29T11:19:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.185+0000 7fba77fff700 1 --2- 172.21.15.81:0/3780495968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba7806a650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 --2- 172.21.15.81:0/3780495968 >> v2:172.21.15.176:3300/0 conn(0x7fba780ca810 0x7fba780ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- 172.21.15.81:0/3780495968 >> 172.21.15.81:0/3780495968 conn(0x7fba780b1f90 msgr2=0x7fba780ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:35.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- 172.21.15.81:0/3780495968 shutdown_connections 2023-11-29T11:19:35.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- 172.21.15.81:0/3780495968 wait complete. 2023-11-29T11:19:35.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 Processor -- start 2023-11-29T11:19:35.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- start start 2023-11-29T11:19:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba78151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780ca810 0x7fba780c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba780cf030 0x7fba7814d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7814fdf0 con 0x7fba780ca810 2023-11-29T11:19:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba781500d0 con 0x7fba780cf030 2023-11-29T11:19:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba78150540 con 0x7fba780c8a30 2023-11-29T11:19:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780ca810 0x7fba780c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:35.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780ca810 0x7fba780c10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54214/0 (socket says 172.21.15.81:54214) 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 -- 172.21.15.81:0/146055363 learned_addr learned my addr 172.21.15.81:0/146055363 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba76ffd700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba78151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba777fe700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba780cf030 0x7fba7814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 -- 172.21.15.81:0/146055363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 msgr2=0x7fba78151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba78151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 -- 172.21.15.81:0/146055363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba780cf030 msgr2=0x7fba7814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba780cf030 0x7fba7814d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 -- 172.21.15.81:0/146055363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba600094b0 con 0x7fba780ca810 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6ffff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780ca810 0x7fba780c10d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fba60014040 tx=0x7fba60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6f7fe700 1 -- 172.21.15.81:0/146055363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600036c0 con 0x7fba780ca810 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6f7fe700 1 -- 172.21.15.81:0/146055363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6001e070 con 0x7fba780ca810 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba780b38b0 con 0x7fba780ca810 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba6f7fe700 1 -- 172.21.15.81:0/146055363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60003a80 con 0x7fba780ca810 2023-11-29T11:19:35.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.189+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba780b35d0 con 0x7fba780ca810 2023-11-29T11:19:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.193+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba780b3b90 con 0x7fba780ca810 2023-11-29T11:19:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.193+0000 7fba6f7fe700 1 -- 172.21.15.81:0/146055363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba6000f050 con 0x7fba780ca810 2023-11-29T11:19:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.193+0000 7fba6f7fe700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba58064ee0 0x7fba58067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.193+0000 7fba6f7fe700 1 -- 172.21.15.81:0/146055363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fba60020070 con 0x7fba780ca810 2023-11-29T11:19:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.193+0000 7fba76ffd700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba58064ee0 0x7fba58067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:35.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.193+0000 7fba76ffd700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba58064ee0 0x7fba58067390 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fba68009bf0 tx=0x7fba68009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:35.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.201+0000 7fba6f7fe700 1 -- 172.21.15.81:0/146055363 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba60051100 con 0x7fba780ca810 2023-11-29T11:19:35.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:35.377+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fba78072500 con 0x7fba780ca810 2023-11-29T11:19:36.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.257+0000 7fba6f7fe700 1 -- 172.21.15.81:0/146055363 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) v1 ==== 97+0+0 (secure 0 0 0) 0x7fba60015070 con 0x7fba780ca810 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba58064ee0 msgr2=0x7fba58067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba58064ee0 0x7fba58067390 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fba68009bf0 tx=0x7fba68009240 comp rx=0 tx=0).stop 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780ca810 msgr2=0x7fba780c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780ca810 0x7fba780c10d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fba60014040 tx=0x7fba60004770 comp rx=0 tx=0).stop 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 shutdown_connections 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fba58064ee0 0x7fba58067390 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba780cf030 0x7fba7814d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba780ca810 0x7fba780c10d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 --2- 172.21.15.81:0/146055363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba780c8a30 0x7fba78151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 >> 172.21.15.81:0/146055363 conn(0x7fba780b1f90 msgr2=0x7fba7814e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 shutdown_connections 2023-11-29T11:19:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.261+0000 7fba77fff700 1 -- 172.21.15.81:0/146055363 wait complete. 2023-11-29T11:19:36.269 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-11-29T11:19:36.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-29T11:19:36.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.389+0000 7feb88ae8700 1 Processor -- start 2023-11-29T11:19:36.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.389+0000 7feb88ae8700 1 -- start start 2023-11-29T11:19:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb84159c00 0x7feb840ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8415a020 con 0x7feb8415d650 2023-11-29T11:19:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb840cd720 con 0x7feb840cc730 2023-11-29T11:19:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb840cd990 con 0x7feb84159c00 2023-11-29T11:19:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb83fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb84159c00 0x7feb840ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb83fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb84159c00 0x7feb840ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54218/0 (socket says 172.21.15.81:54218) 2023-11-29T11:19:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb83fff700 1 -- 172.21.15.81:0/315547893 learned_addr learned my addr 172.21.15.81:0/315547893 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb83fff700 1 -- 172.21.15.81:0/315547893 >> v1:172.21.15.176:6789/0 conn(0x7feb840cc730 legacy=0x7feb841594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb83fff700 1 -- 172.21.15.81:0/315547893 >> v1:172.21.15.81:6789/0 conn(0x7feb8415d650 legacy=0x7feb840cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb83fff700 1 -- 172.21.15.81:0/315547893 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840cdc70 con 0x7feb84159c00 2023-11-29T11:19:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb83fff700 1 --2- 172.21.15.81:0/315547893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb84159c00 0x7feb840ce470 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009e50 tx=0x7feb7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2753a58aabe4652c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb82ffd700 1 -- 172.21.15.81:0/315547893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00e070 con 0x7feb84159c00 2023-11-29T11:19:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb82ffd700 1 -- 172.21.15.81:0/315547893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c00b9c0 con 0x7feb84159c00 2023-11-29T11:19:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb82ffd700 1 -- 172.21.15.81:0/315547893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00bd70 con 0x7feb84159c00 2023-11-29T11:19:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 -- 172.21.15.81:0/315547893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb84159c00 msgr2=0x7feb840ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 --2- 172.21.15.81:0/315547893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb84159c00 0x7feb840ce470 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009e50 tx=0x7feb7c00b330 comp rx=0 tx=0).stop 2023-11-29T11:19:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 -- 172.21.15.81:0/315547893 shutdown_connections 2023-11-29T11:19:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 --2- 172.21.15.81:0/315547893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb84159c00 0x7feb840ce470 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 -- 172.21.15.81:0/315547893 >> 172.21.15.81:0/315547893 conn(0x7feb8406ec40 msgr2=0x7feb840b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 -- 172.21.15.81:0/315547893 shutdown_connections 2023-11-29T11:19:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.393+0000 7feb88ae8700 1 -- 172.21.15.81:0/315547893 wait complete. 2023-11-29T11:19:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 Processor -- start 2023-11-29T11:19:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 -- start start 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840cc730 0x7feb840c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb84159c00 0x7feb8414c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8415d650 0x7feb8414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840c6d50 con 0x7feb8415d650 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8414d060 con 0x7feb840cc730 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840c6450 con 0x7feb84159c00 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8415d650 0x7feb8414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8415d650 0x7feb8414cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54228/0 (socket says 172.21.15.81:54228) 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 -- 172.21.15.81:0/3393458513 learned_addr learned my addr 172.21.15.81:0/3393458513 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb7bfff700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb84159c00 0x7feb8414c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb837fe700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840cc730 0x7feb840c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 -- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb84159c00 msgr2=0x7feb8414c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb84159c00 0x7feb8414c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 -- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840cc730 msgr2=0x7feb840c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840cc730 0x7feb840c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 -- 172.21.15.81:0/3393458513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c009b30 con 0x7feb8415d650 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb837fe700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840cc730 0x7feb840c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb83fff700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8415d650 0x7feb8414cb20 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7feb84071fb0 tx=0x7feb7c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb80ff9700 1 -- 172.21.15.81:0/3393458513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0048b0 con 0x7feb8415d650 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb80ff9700 1 -- 172.21.15.81:0/3393458513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0099b0 con 0x7feb8415d650 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8415a250 con 0x7feb8415d650 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb80ff9700 1 -- 172.21.15.81:0/3393458513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c01c680 con 0x7feb8415d650 2023-11-29T11:19:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.397+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb840cdf50 con 0x7feb8415d650 2023-11-29T11:19:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.401+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8406bb80 con 0x7feb8415d650 2023-11-29T11:19:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.401+0000 7feb80ff9700 1 -- 172.21.15.81:0/3393458513 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb7c02c070 con 0x7feb8415d650 2023-11-29T11:19:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.401+0000 7feb80ff9700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb64064ee0 0x7feb64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.401+0000 7feb80ff9700 1 -- 172.21.15.81:0/3393458513 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5530+0+0 (secure 0 0 0) 0x7feb7c083d30 con 0x7feb8415d650 2023-11-29T11:19:36.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.401+0000 7feb837fe700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb64064ee0 0x7feb64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.401+0000 7feb837fe700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb64064ee0 0x7feb64067390 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feb74000f60 tx=0x7feb74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.409+0000 7feb80ff9700 1 -- 172.21.15.81:0/3393458513 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb7c052180 con 0x7feb8415d650 2023-11-29T11:19:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.625+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feb840c6e90 con 0x7feb8415d650 2023-11-29T11:19:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb80ff9700 1 -- 172.21.15.81:0/3393458513 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7feb840c6e90 con 0x7feb8415d650 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlSOayNhAAtezph/rP5i/F81/canwMdA==", 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdl8qMjBRAAuvMDj+jPn1OjXUEcUl34jg==", 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-11-29T11:19:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlIykpOhAAL31egdG19jdsaMglEpIC5w==", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlKA1GCxAAOzBuOUs7pjJJOOFwZq8npA==", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:19:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/HGdl92Q/OhAAXGWXiUvswEMnfzScuUn0cw==", 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-11-29T11:19:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDHGdl8TbZExAA2IBrIVdDMSaeGFjE0oBYFw==", 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCGHGdlUk9QJhAA3rf+afNjbbsQotcH4YjVQg==", 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJHGdlUPFnLRAAk4y/WOW2lDfYd22+GF2QlA==", 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCPHGdlLLatFRAAz4dG1oXNEITKomtPGnDBmw==", 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:19:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCSHGdl34DRKxAAt8kHY0+FALSWN612SIOnsQ==", 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-11-29T11:19:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCVHGdl4zPUMBAAsF8NTRCGqXpRuVduNnWO1A==", 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCYHGdlQv/DNRAAFMTV+dTJZ0UZK2eCJiFDuw==", 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgxnnDhAAfROm0RfwzNurvq62gqmGBQ==", 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgjcpFRAAtcxPbxV34mCHxFVoGYmqmg==", 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlvfbxERAA6d5eRkOBOKhyToZKDKlvYQ==", 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlDrDHGhAAfy4RAK8qFAj2Sf6GuRGhBw==", 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlW+ELKBAAoMzxY7NGqIJ1SNfaQ/4qVQ==", 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:19:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlqaiZMhAAPiboTL+csIYuoxSk+ZwfJA==", 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-11-29T11:19:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlcf6LLxAAqtoEWzgd41N9uT9tC7bZ/Q==", 2023-11-29T11:19:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:19:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:19:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:19:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:19:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-11-29T11:19:36.647 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb64064ee0 msgr2=0x7feb64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb64064ee0 0x7feb64067390 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feb74000f60 tx=0x7feb74009040 comp rx=0 tx=0).stop 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8415d650 msgr2=0x7feb8414cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8415d650 0x7feb8414cb20 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7feb84071fb0 tx=0x7feb7c004af0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 shutdown_connections 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb64064ee0 0x7feb64067390 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb8415d650 0x7feb8414cb20 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb84159c00 0x7feb8414c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 --2- 172.21.15.81:0/3393458513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb840cc730 0x7feb840c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 >> 172.21.15.81:0/3393458513 conn(0x7feb8406ec40 msgr2=0x7feb840cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 shutdown_connections 2023-11-29T11:19:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.629+0000 7feb88ae8700 1 -- 172.21.15.81:0/3393458513 wait complete. 2023-11-29T11:19:36.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4e3ad700 1 Processor -- start 2023-11-29T11:19:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4e3ad700 1 -- start start 2023-11-29T11:19:36.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4e3ad700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbd48069c40 0x7fbd480cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4e3ad700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd480cb2a0 0x7fbd480c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4e3ad700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4806ace0 con 0x7fbd48159e70 2023-11-29T11:19:36.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4e3ad700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd480cb6e0 con 0x7fbd480cb2a0 2023-11-29T11:19:36.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4e3ad700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4806a0d0 con 0x7fbd48069c40 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4dbac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd480cb2a0 0x7fbd480c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4dbac700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd480cb2a0 0x7fbd480c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54236/0 (socket says 172.21.15.81:54236) 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4dbac700 1 -- 172.21.15.81:0/507774729 learned_addr learned my addr 172.21.15.81:0/507774729 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4cbaa700 1 --2- 172.21.15.81:0/507774729 >> v2:172.21.15.176:3300/0 conn(0x7fbd48069c40 0x7fbd480cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4dbac700 1 -- 172.21.15.81:0/507774729 >> v2:172.21.15.176:3300/0 conn(0x7fbd48069c40 msgr2=0x7fbd480cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4dbac700 1 --2- 172.21.15.81:0/507774729 >> v2:172.21.15.176:3300/0 conn(0x7fbd48069c40 0x7fbd480cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4dbac700 1 -- 172.21.15.81:0/507774729 >> v1:172.21.15.176:6789/0 conn(0x7fbd48159e70 legacy=0x7fbd4806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4dbac700 1 -- 172.21.15.81:0/507774729 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4806a3b0 con 0x7fbd480cb2a0 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4cbaa700 1 --2- 172.21.15.81:0/507774729 >> v2:172.21.15.176:3300/0 conn(0x7fbd48069c40 0x7fbd480cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd4dbac700 1 --2- 172.21.15.81:0/507774729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd480cb2a0 0x7fbd480c91d0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fbd480c89e0 tx=0x7fbd40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1dff53c4553065 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.757+0000 7fbd47fff700 1 -- 172.21.15.81:0/507774729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000b8a0 con 0x7fbd480cb2a0 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd47fff700 1 -- 172.21.15.81:0/507774729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4000ba00 con 0x7fbd480cb2a0 2023-11-29T11:19:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd47fff700 1 -- 172.21.15.81:0/507774729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000bd90 con 0x7fbd480cb2a0 2023-11-29T11:19:36.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/507774729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd480cb2a0 msgr2=0x7fbd480c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/507774729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd480cb2a0 0x7fbd480c91d0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fbd480c89e0 tx=0x7fbd40009bf0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/507774729 shutdown_connections 2023-11-29T11:19:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/507774729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd480cb2a0 0x7fbd480c91d0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/507774729 >> v2:172.21.15.176:3300/0 conn(0x7fbd48069c40 0x7fbd480cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/507774729 >> 172.21.15.81:0/507774729 conn(0x7fbd480ce3e0 msgr2=0x7fbd480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/507774729 shutdown_connections 2023-11-29T11:19:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/507774729 wait complete. 2023-11-29T11:19:36.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.761+0000 7fbd4e3ad700 1 Processor -- start 2023-11-29T11:19:36.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 -- start start 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd48069c40 0x7fbd481565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd480cb2a0 0x7fbd480afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd48159e70 0x7fbd480b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4815a9c0 con 0x7fbd48159e70 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480c4440 con 0x7fbd480cb2a0 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480c4720 con 0x7fbd48069c40 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd48159e70 0x7fbd480b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4d3ab700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd48069c40 0x7fbd481565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd48159e70 0x7fbd480b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54250/0 (socket says 172.21.15.81:54250) 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 -- 172.21.15.81:0/1672403441 learned_addr learned my addr 172.21.15.81:0/1672403441 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4cbaa700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd480cb2a0 0x7fbd480afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 -- 172.21.15.81:0/1672403441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd48069c40 msgr2=0x7fbd481565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd48069c40 0x7fbd481565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 -- 172.21.15.81:0/1672403441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd480cb2a0 msgr2=0x7fbd480afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd480cb2a0 0x7fbd480afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 -- 172.21.15.81:0/1672403441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40009570 con 0x7fbd48159e70 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4d3ab700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd48069c40 0x7fbd481565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4dbac700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd48159e70 0x7fbd480b00d0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbd4806f4b0 tx=0x7fbd40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd45ffb700 1 -- 172.21.15.81:0/1672403441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400038c0 con 0x7fbd48159e70 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd45ffb700 1 -- 172.21.15.81:0/1672403441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4001f070 con 0x7fbd48159e70 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4806a970 con 0x7fbd48159e70 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd45ffb700 1 -- 172.21.15.81:0/1672403441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40003c60 con 0x7fbd48159e70 2023-11-29T11:19:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.765+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4806a690 con 0x7fbd48159e70 2023-11-29T11:19:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.769+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4806d0b0 con 0x7fbd48159e70 2023-11-29T11:19:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.769+0000 7fbd45ffb700 1 -- 172.21.15.81:0/1672403441 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbd4000f050 con 0x7fbd48159e70 2023-11-29T11:19:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.769+0000 7fbd45ffb700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd34064ee0 0x7fbd34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.769+0000 7fbd45ffb700 1 -- 172.21.15.81:0/1672403441 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fbd40021070 con 0x7fbd48159e70 2023-11-29T11:19:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.769+0000 7fbd4d3ab700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd34064ee0 0x7fbd34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.769+0000 7fbd4d3ab700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd34064ee0 0x7fbd34067390 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c001bf0 tx=0x7fbd3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:36.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.777+0000 7fbd45ffb700 1 -- 172.21.15.81:0/1672403441 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbd40051a40 con 0x7fbd48159e70 2023-11-29T11:19:36.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.945+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd4806b6d0 con 0x7fbd48159e70 2023-11-29T11:19:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.945+0000 7fbd45ffb700 1 -- 172.21.15.81:0/1672403441 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+14319 (secure 0 0 0) 0x7fbd40055060 con 0x7fbd48159e70 2023-11-29T11:19:36.953 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:36.953 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":92,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:19:36.244739+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:36.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd34064ee0 msgr2=0x7fbd34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd34064ee0 0x7fbd34067390 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c001bf0 tx=0x7fbd3c009040 comp rx=0 tx=0).stop 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd48159e70 msgr2=0x7fbd480b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd48159e70 0x7fbd480b00d0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbd4806f4b0 tx=0x7fbd40004770 comp rx=0 tx=0).stop 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 shutdown_connections 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd34064ee0 0x7fbd34067390 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd48159e70 0x7fbd480b00d0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd480cb2a0 0x7fbd480afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 --2- 172.21.15.81:0/1672403441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd48069c40 0x7fbd481565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 >> 172.21.15.81:0/1672403441 conn(0x7fbd480ce3e0 msgr2=0x7fbd480ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 shutdown_connections 2023-11-29T11:19:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:36.949+0000 7fbd4e3ad700 1 -- 172.21.15.81:0/1672403441 wait complete. 2023-11-29T11:19:36.968 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:19:36.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:19:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8708dd4700 1 Processor -- start 2023-11-29T11:19:37.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8708dd4700 1 -- start start 2023-11-29T11:19:37.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8708dd4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f870415bb80 0x7f87040b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8708dd4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f870406b370 0x7f870415c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8708dd4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87040ccd00 con 0x7f87040aaf40 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8708dd4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87040b19b0 con 0x7f870406b370 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8708dd4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87040cd510 con 0x7f870415bb80 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8703fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f870406b370 0x7f870415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8702ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87040aaf40 0x7f87040b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50354/0 (socket says 172.21.15.81:50354) 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8702ffd700 1 -- 172.21.15.81:0/2155273302 learned_addr learned my addr 172.21.15.81:0/2155273302 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f87037fe700 1 --2- 172.21.15.81:0/2155273302 >> v2:172.21.15.176:3300/0 conn(0x7f870415bb80 0x7f87040b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f87027fc700 1 -- 172.21.15.81:0/2155273302 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352809235 0 0) 0x7f87040ccd00 con 0x7f87040aaf40 2023-11-29T11:19:37.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f87027fc700 1 -- 172.21.15.81:0/2155273302 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86ec0035d0 con 0x7f87040aaf40 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8703fff700 1 -- 172.21.15.81:0/2155273302 >> v2:172.21.15.176:3300/0 conn(0x7f870415bb80 msgr2=0x7f87040b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8703fff700 1 --2- 172.21.15.81:0/2155273302 >> v2:172.21.15.176:3300/0 conn(0x7f870415bb80 0x7f87040b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8703fff700 1 -- 172.21.15.81:0/2155273302 >> v1:172.21.15.81:6789/0 conn(0x7f87040aaf40 legacy=0x7f87040b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8703fff700 1 -- 172.21.15.81:0/2155273302 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040ccf50 con 0x7f870406b370 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f8703fff700 1 --2- 172.21.15.81:0/2155273302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f870415c260 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f8704066100 tx=0x7f86fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e322615fbfc7bf39 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f87027fc700 1 -- 172.21.15.81:0/2155273302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00e070 con 0x7f870406b370 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f87027fc700 1 -- 172.21.15.81:0/2155273302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc00bb20 con 0x7f870406b370 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.085+0000 7f87027fc700 1 -- 172.21.15.81:0/2155273302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00be90 con 0x7f870406b370 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 -- 172.21.15.81:0/2155273302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 msgr2=0x7f870415c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 --2- 172.21.15.81:0/2155273302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f870415c260 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f8704066100 tx=0x7f86fc00b330 comp rx=0 tx=0).stop 2023-11-29T11:19:37.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 -- 172.21.15.81:0/2155273302 shutdown_connections 2023-11-29T11:19:37.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 --2- 172.21.15.81:0/2155273302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f870415c260 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 --2- 172.21.15.81:0/2155273302 >> v2:172.21.15.176:3300/0 conn(0x7f870415bb80 0x7f87040b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 -- 172.21.15.81:0/2155273302 >> 172.21.15.81:0/2155273302 conn(0x7f87040cae70 msgr2=0x7f87040cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:37.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 -- 172.21.15.81:0/2155273302 shutdown_connections 2023-11-29T11:19:37.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 -- 172.21.15.81:0/2155273302 wait complete. 2023-11-29T11:19:37.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 Processor -- start 2023-11-29T11:19:37.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 -- start start 2023-11-29T11:19:37.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f87040c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87040aaf40 0x7f87040c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f870415bb80 0x7f8704152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.089+0000 7f8708dd4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870406c4e0 con 0x7f870406b370 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f8708dd4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870415a7a0 con 0x7f870415bb80 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f8708dd4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870406c730 con 0x7f87040aaf40 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f87040c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f87040c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54260/0 (socket says 172.21.15.81:54260) 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 -- 172.21.15.81:0/3096635604 learned_addr learned my addr 172.21.15.81:0/3096635604 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f8703fff700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f870415bb80 0x7f8704152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f8702ffd700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87040aaf40 0x7f87040c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 -- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87040aaf40 msgr2=0x7f87040c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87040aaf40 0x7f87040c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 -- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f870415bb80 msgr2=0x7f8704152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f870415bb80 0x7f8704152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 -- 172.21.15.81:0/3096635604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc009a70 con 0x7f870406b370 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f8702ffd700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87040aaf40 0x7f87040c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f87037fe700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f87040c7cb0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f86f400e840 tx=0x7f86f400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f86ebfff700 1 -- 172.21.15.81:0/3096635604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40095a0 con 0x7f870406b370 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f86ebfff700 1 -- 172.21.15.81:0/3096635604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f4013680 con 0x7f870406b370 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87040b1c50 con 0x7f870406b370 2023-11-29T11:19:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f86ebfff700 1 -- 172.21.15.81:0/3096635604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40139f0 con 0x7f870406b370 2023-11-29T11:19:37.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87040cd230 con 0x7f870406b370 2023-11-29T11:19:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87040b1f30 con 0x7f870406b370 2023-11-29T11:19:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.093+0000 7f86ebfff700 1 -- 172.21.15.81:0/3096635604 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f86f4019030 con 0x7f870406b370 2023-11-29T11:19:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.097+0000 7f86ebfff700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86f0064ee0 0x7f86f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.097+0000 7f86ebfff700 1 -- 172.21.15.81:0/3096635604 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f86f4081ad0 con 0x7f870406b370 2023-11-29T11:19:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.097+0000 7f8702ffd700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86f0064ee0 0x7f86f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.097+0000 7f8702ffd700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86f0064ee0 0x7f86f0067390 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f87040ac070 tx=0x7f86f8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.105+0000 7f86ebfff700 1 -- 172.21.15.81:0/3096635604 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f86f404fda0 con 0x7f870406b370 2023-11-29T11:19:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.269+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8704072500 con 0x7f870406b370 2023-11-29T11:19:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f86ebfff700 1 -- 172.21.15.81:0/3096635604 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v92) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86f40533c0 con 0x7f870406b370 2023-11-29T11:19:37.279 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86f0064ee0 msgr2=0x7f86f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86f0064ee0 0x7f86f0067390 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f87040ac070 tx=0x7f86f8009040 comp rx=0 tx=0).stop 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 msgr2=0x7f87040c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f87040c7cb0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f86f400e840 tx=0x7f86f400eb50 comp rx=0 tx=0).stop 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 shutdown_connections 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f86f0064ee0 0x7f86f0067390 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f870415bb80 0x7f8704152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87040aaf40 0x7f87040c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 --2- 172.21.15.81:0/3096635604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f870406b370 0x7f87040c7cb0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 >> 172.21.15.81:0/3096635604 conn(0x7f87040cae70 msgr2=0x7f87040c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 shutdown_connections 2023-11-29T11:19:37.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.273+0000 7f8708dd4700 1 -- 172.21.15.81:0/3096635604 wait complete. 2023-11-29T11:19:37.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:19:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb485f75700 1 Processor -- start 2023-11-29T11:19:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb485f75700 1 -- start start 2023-11-29T11:19:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb485f75700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4800ce8a0 0x7fb4801609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb485f75700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb4800ad880 0x7fb4800add20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb485f75700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb480160550 con 0x7fb48015c100 2023-11-29T11:19:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb485f75700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48015d490 con 0x7fb4800ce8a0 2023-11-29T11:19:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb485f75700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48015ff00 con 0x7fb4800ad880 2023-11-29T11:19:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb47ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4800ce8a0 0x7fb4801609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb484f73700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb48015c100 0x7fb4800ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50364/0 (socket says 172.21.15.81:50364) 2023-11-29T11:19:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb484f73700 1 -- 172.21.15.81:0/994657613 learned_addr learned my addr 172.21.15.81:0/994657613 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.405+0000 7fb485774700 1 --2- 172.21.15.81:0/994657613 >> v2:172.21.15.176:3300/0 conn(0x7fb4800ad880 0x7fb4800add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb47ffff700 1 -- 172.21.15.81:0/994657613 >> v2:172.21.15.176:3300/0 conn(0x7fb4800ad880 msgr2=0x7fb4800add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb47ffff700 1 --2- 172.21.15.81:0/994657613 >> v2:172.21.15.176:3300/0 conn(0x7fb4800ad880 0x7fb4800add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb47ffff700 1 -- 172.21.15.81:0/994657613 >> v1:172.21.15.81:6789/0 conn(0x7fb48015c100 legacy=0x7fb4800ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb47ffff700 1 -- 172.21.15.81:0/994657613 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4801601e0 con 0x7fb4800ce8a0 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb47ffff700 1 --2- 172.21.15.81:0/994657613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800ce8a0 0x7fb4801609e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb4800706f0 tx=0x7fb46c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58cf2c07afa6abe server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb47f7fe700 1 -- 172.21.15.81:0/994657613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c011830 con 0x7fb4800ce8a0 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb47f7fe700 1 -- 172.21.15.81:0/994657613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c011990 con 0x7fb4800ce8a0 2023-11-29T11:19:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb47f7fe700 1 -- 172.21.15.81:0/994657613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c011d20 con 0x7fb4800ce8a0 2023-11-29T11:19:37.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb485f75700 1 -- 172.21.15.81:0/994657613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800ce8a0 msgr2=0x7fb4801609e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb485f75700 1 --2- 172.21.15.81:0/994657613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800ce8a0 0x7fb4801609e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb4800706f0 tx=0x7fb46c009b30 comp rx=0 tx=0).stop 2023-11-29T11:19:37.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb485f75700 1 -- 172.21.15.81:0/994657613 shutdown_connections 2023-11-29T11:19:37.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb485f75700 1 --2- 172.21.15.81:0/994657613 >> v2:172.21.15.176:3300/0 conn(0x7fb4800ad880 0x7fb4800add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb485f75700 1 --2- 172.21.15.81:0/994657613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800ce8a0 0x7fb4801609e0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb485f75700 1 -- 172.21.15.81:0/994657613 >> 172.21.15.81:0/994657613 conn(0x7fb48006c660 msgr2=0x7fb48006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:37.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb485f75700 1 -- 172.21.15.81:0/994657613 shutdown_connections 2023-11-29T11:19:37.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.409+0000 7fb485f75700 1 -- 172.21.15.81:0/994657613 wait complete. 2023-11-29T11:19:37.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 Processor -- start 2023-11-29T11:19:37.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 -- start start 2023-11-29T11:19:37.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4800ad880 0x7fb4800b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4800ce8a0 0x7fb480148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb48015c100 0x7fb4800ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800c7ee0 con 0x7fb48015c100 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800b3210 con 0x7fb4800ce8a0 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4801487a0 con 0x7fb4800ad880 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb48015c100 0x7fb4800ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb48015c100 0x7fb4800ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54280/0 (socket says 172.21.15.81:54280) 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 -- 172.21.15.81:0/3459544055 learned_addr learned my addr 172.21.15.81:0/3459544055 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb484f73700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4800ad880 0x7fb4800b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb47ffff700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4800ce8a0 0x7fb480148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 -- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4800ad880 msgr2=0x7fb4800b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4800ad880 0x7fb4800b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 -- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4800ce8a0 msgr2=0x7fb480148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4800ce8a0 0x7fb480148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 -- 172.21.15.81:0/3459544055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0094b0 con 0x7fb48015c100 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb47ffff700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4800ce8a0 0x7fb480148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb484f73700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4800ad880 0x7fb4800b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485774700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb48015c100 0x7fb4800ae660 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fb478009dd0 tx=0x7fb47800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb47d7fa700 1 -- 172.21.15.81:0/3459544055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800cce0 con 0x7fb48015c100 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb47d7fa700 1 -- 172.21.15.81:0/3459544055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800f040 con 0x7fb48015c100 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4800c99d0 con 0x7fb48015c100 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb47d7fa700 1 -- 172.21.15.81:0/3459544055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478014480 con 0x7fb48015c100 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.413+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48015d770 con 0x7fb48015c100 2023-11-29T11:19:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.417+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4800ae260 con 0x7fb48015c100 2023-11-29T11:19:37.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.417+0000 7fb47d7fa700 1 -- 172.21.15.81:0/3459544055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb4780145e0 con 0x7fb48015c100 2023-11-29T11:19:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.417+0000 7fb47d7fa700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb464064ee0 0x7fb464067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.417+0000 7fb47d7fa700 1 -- 172.21.15.81:0/3459544055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb478082820 con 0x7fb48015c100 2023-11-29T11:19:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.421+0000 7fb484f73700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb464064ee0 0x7fb464067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.421+0000 7fb484f73700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb464064ee0 0x7fb464067390 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb4740010e0 tx=0x7fb474009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.425+0000 7fb47d7fa700 1 -- 172.21.15.81:0/3459544055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb478050ac0 con 0x7fb48015c100 2023-11-29T11:19:37.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.585+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4800c8020 con 0x7fb48015c100 2023-11-29T11:19:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb47d7fa700 1 -- 172.21.15.81:0/3459544055 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4800c8020 con 0x7fb48015c100 2023-11-29T11:19:37.595 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:19:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb464064ee0 msgr2=0x7fb464067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb464064ee0 0x7fb464067390 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb4740010e0 tx=0x7fb474009040 comp rx=0 tx=0).stop 2023-11-29T11:19:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb48015c100 msgr2=0x7fb4800ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb48015c100 0x7fb4800ae660 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fb478009dd0 tx=0x7fb47800c3a0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 shutdown_connections 2023-11-29T11:19:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb464064ee0 0x7fb464067390 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb48015c100 0x7fb4800ae660 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4800ce8a0 0x7fb480148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 --2- 172.21.15.81:0/3459544055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4800ad880 0x7fb4800b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 >> 172.21.15.81:0/3459544055 conn(0x7fb48006c660 msgr2=0x7fb48006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 shutdown_connections 2023-11-29T11:19:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.589+0000 7fb485f75700 1 -- 172.21.15.81:0/3459544055 wait complete. 2023-11-29T11:19:37.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-29T11:19:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.713+0000 7f6b46995700 1 Processor -- start 2023-11-29T11:19:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- start start 2023-11-29T11:19:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b400cc730 0x7f6b400ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b401594f0 0x7f6b40159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b400cd720 con 0x7f6b4015d650 2023-11-29T11:19:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400cd990 con 0x7f6b400cc730 2023-11-29T11:19:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400cdc70 con 0x7f6b401594f0 2023-11-29T11:19:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45192700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b400cc730 0x7f6b400ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46194700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b401594f0 0x7f6b40159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45192700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b400cc730 0x7f6b400ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59572/0 (socket says 172.21.15.81:59572) 2023-11-29T11:19:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45192700 1 -- 172.21.15.81:0/2611151183 learned_addr learned my addr 172.21.15.81:0/2611151183 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45993700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6b4015d650 0x7f6b400cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:57268/0 (socket says 172.21.15.81:57268) 2023-11-29T11:19:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45192700 1 -- 172.21.15.81:0/2611151183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b401594f0 msgr2=0x7f6b40159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45192700 1 --2- 172.21.15.81:0/2611151183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b401594f0 0x7f6b40159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45192700 1 -- 172.21.15.81:0/2611151183 >> v1:172.21.15.176:6789/0 conn(0x7f6b4015d650 legacy=0x7f6b400cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45192700 1 -- 172.21.15.81:0/2611151183 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400cdf50 con 0x7f6b400cc730 2023-11-29T11:19:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b45192700 1 --2- 172.21.15.81:0/2611151183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b400cc730 0x7f6b400ce470 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000b9c0 tx=0x7f6b3000bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cb55fd6fc8e10 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b44991700 1 -- 172.21.15.81:0/2611151183 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000cc60 con 0x7f6b400cc730 2023-11-29T11:19:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b44991700 1 -- 172.21.15.81:0/2611151183 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3000cdc0 con 0x7f6b400cc730 2023-11-29T11:19:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b44991700 1 -- 172.21.15.81:0/2611151183 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000f680 con 0x7f6b400cc730 2023-11-29T11:19:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- 172.21.15.81:0/2611151183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b400cc730 msgr2=0x7f6b400ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 --2- 172.21.15.81:0/2611151183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b400cc730 0x7f6b400ce470 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000b9c0 tx=0x7f6b3000bcd0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- 172.21.15.81:0/2611151183 shutdown_connections 2023-11-29T11:19:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 --2- 172.21.15.81:0/2611151183 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b401594f0 0x7f6b40159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 --2- 172.21.15.81:0/2611151183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b400cc730 0x7f6b400ce470 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- 172.21.15.81:0/2611151183 >> 172.21.15.81:0/2611151183 conn(0x7f6b4006ec40 msgr2=0x7f6b400b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- 172.21.15.81:0/2611151183 shutdown_connections 2023-11-29T11:19:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.717+0000 7f6b46995700 1 -- 172.21.15.81:0/2611151183 wait complete. 2023-11-29T11:19:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46995700 1 Processor -- start 2023-11-29T11:19:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46995700 1 -- start start 2023-11-29T11:19:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46995700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b400cc730 0x7f6b400af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46995700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b401594f0 0x7f6b400b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46995700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4015d650 0x7f6b400c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46995700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b2120 con 0x7f6b4015d650 2023-11-29T11:19:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46995700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400c3120 con 0x7f6b401594f0 2023-11-29T11:19:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46995700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b1470 con 0x7f6b400cc730 2023-11-29T11:19:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46194700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4015d650 0x7f6b400c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b45993700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b400cc730 0x7f6b400af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46194700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4015d650 0x7f6b400c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54296/0 (socket says 172.21.15.81:54296) 2023-11-29T11:19:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b45192700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b401594f0 0x7f6b400b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46194700 1 -- 172.21.15.81:0/3509258450 learned_addr learned my addr 172.21.15.81:0/3509258450 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b45192700 1 -- 172.21.15.81:0/3509258450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b400cc730 msgr2=0x7f6b400af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b45192700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b400cc730 0x7f6b400af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b45192700 1 -- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4015d650 msgr2=0x7f6b400c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b45192700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4015d650 0x7f6b400c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b45192700 1 -- 172.21.15.81:0/3509258450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3000b620 con 0x7f6b401594f0 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.721+0000 7f6b46194700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4015d650 0x7f6b400c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.725+0000 7f6b45192700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b401594f0 0x7f6b400b1be0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6b30016000 tx=0x7f6b30004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.725+0000 7f6b367fc700 1 -- 172.21.15.81:0/3509258450 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3001c070 con 0x7f6b401594f0 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.725+0000 7f6b367fc700 1 -- 172.21.15.81:0/3509258450 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b300038d0 con 0x7f6b401594f0 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.725+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b40159e90 con 0x7f6b401594f0 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.725+0000 7f6b367fc700 1 -- 172.21.15.81:0/3509258450 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30003c60 con 0x7f6b401594f0 2023-11-29T11:19:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.725+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4015a250 con 0x7f6b401594f0 2023-11-29T11:19:37.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.725+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4015a020 con 0x7f6b401594f0 2023-11-29T11:19:37.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.729+0000 7f6b367fc700 1 -- 172.21.15.81:0/3509258450 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6b3000f460 con 0x7f6b401594f0 2023-11-29T11:19:37.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.729+0000 7f6b367fc700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b24064f10 0x7f6b240673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:37.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.729+0000 7f6b367fc700 1 -- 172.21.15.81:0/3509258450 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6b300834a0 con 0x7f6b401594f0 2023-11-29T11:19:37.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.729+0000 7f6b45993700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b24064f10 0x7f6b240673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:37.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.729+0000 7f6b45993700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b24064f10 0x7f6b240673c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000f60 tx=0x7f6b3c007ef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.733+0000 7f6b367fc700 1 -- 172.21.15.81:0/3509258450 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6b30051890 con 0x7f6b401594f0 2023-11-29T11:19:37.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.897+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6b40072c20 con 0x7f6b401594f0 2023-11-29T11:19:37.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.897+0000 7f6b367fc700 1 -- 172.21.15.81:0/3509258450 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6b30026090 con 0x7f6b401594f0 2023-11-29T11:19:37.906 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:37.906 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:19:37.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:37.906 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-11-29T11:19:37.906 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-11-29T11:19:37.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:37.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:19:37.907 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-11-29T11:19:37.907 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-11-29T11:19:37.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:37.907 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b24064f10 msgr2=0x7f6b240673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b24064f10 0x7f6b240673c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000f60 tx=0x7f6b3c007ef0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b401594f0 msgr2=0x7f6b400b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b401594f0 0x7f6b400b1be0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6b30016000 tx=0x7f6b30004770 comp rx=0 tx=0).stop 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 shutdown_connections 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6b24064f10 0x7f6b240673c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4015d650 0x7f6b400c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b401594f0 0x7f6b400b1be0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 --2- 172.21.15.81:0/3509258450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b400cc730 0x7f6b400af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 >> 172.21.15.81:0/3509258450 conn(0x7f6b4006ec40 msgr2=0x7f6b400ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 shutdown_connections 2023-11-29T11:19:37.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:37.901+0000 7f6b46995700 1 -- 172.21.15.81:0/3509258450 wait complete. 2023-11-29T11:19:37.921 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-29T11:19:37.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-29T11:19:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 Processor -- start 2023-11-29T11:19:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- start start 2023-11-29T11:19:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd70c06d730 0x7fd70c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd70c06b110 0x7fd70c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c0adc10 con 0x7fd70c0cc2c0 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0b3930 con 0x7fd70c06d730 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0c1840 con 0x7fd70c06b110 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd70c06d730 0x7fd70c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd70c0cc2c0 0x7fd70c0cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50370/0 (socket says 172.21.15.81:50370) 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70b7fe700 1 -- 172.21.15.81:0/1640498766 learned_addr learned my addr 172.21.15.81:0/1640498766 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70bfff700 1 --2- 172.21.15.81:0/1640498766 >> v2:172.21.15.176:3300/0 conn(0x7fd70c06b110 0x7fd70c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70affd700 1 -- 172.21.15.81:0/1640498766 >> v2:172.21.15.176:3300/0 conn(0x7fd70c06b110 msgr2=0x7fd70c06bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70affd700 1 --2- 172.21.15.81:0/1640498766 >> v2:172.21.15.176:3300/0 conn(0x7fd70c06b110 0x7fd70c06bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70affd700 1 -- 172.21.15.81:0/1640498766 >> v1:172.21.15.81:6789/0 conn(0x7fd70c0cc2c0 legacy=0x7fd70c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70affd700 1 -- 172.21.15.81:0/1640498766 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0c1b20 con 0x7fd70c06d730 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70affd700 1 --2- 172.21.15.81:0/1640498766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06d730 0x7fd70c0b3d50 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0c1420 tx=0x7fd6fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfad135238f4ac8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70a7fc700 1 -- 172.21.15.81:0/1640498766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc00e070 con 0x7fd70c06d730 2023-11-29T11:19:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70a7fc700 1 -- 172.21.15.81:0/1640498766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc00bbd0 con 0x7fd70c06d730 2023-11-29T11:19:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd70a7fc700 1 -- 172.21.15.81:0/1640498766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc012430 con 0x7fd70c06d730 2023-11-29T11:19:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- 172.21.15.81:0/1640498766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06d730 msgr2=0x7fd70c0b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 --2- 172.21.15.81:0/1640498766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06d730 0x7fd70c0b3d50 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0c1420 tx=0x7fd6fc00b330 comp rx=0 tx=0).stop 2023-11-29T11:19:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- 172.21.15.81:0/1640498766 shutdown_connections 2023-11-29T11:19:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 --2- 172.21.15.81:0/1640498766 >> v2:172.21.15.176:3300/0 conn(0x7fd70c06b110 0x7fd70c06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 --2- 172.21.15.81:0/1640498766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06d730 0x7fd70c0b3d50 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- 172.21.15.81:0/1640498766 >> 172.21.15.81:0/1640498766 conn(0x7fd70c0ce3c0 msgr2=0x7fd70c0ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- 172.21.15.81:0/1640498766 shutdown_connections 2023-11-29T11:19:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.037+0000 7fd710a13700 1 -- 172.21.15.81:0/1640498766 wait complete. 2023-11-29T11:19:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.041+0000 7fd710a13700 1 Processor -- start 2023-11-29T11:19:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.041+0000 7fd710a13700 1 -- start start 2023-11-29T11:19:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06b110 0x7fd70c0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd70c06d730 0x7fd70c156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd70c0cc2c0 0x7fd70c0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c161c10 con 0x7fd70c06b110 2023-11-29T11:19:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c2d40 con 0x7fd70c0cc2c0 2023-11-29T11:19:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c161930 con 0x7fd70c06d730 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06b110 0x7fd70c0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06b110 0x7fd70c0c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54326/0 (socket says 172.21.15.81:54326) 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 -- 172.21.15.81:0/188830821 learned_addr learned my addr 172.21.15.81:0/188830821 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70affd700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd70c06d730 0x7fd70c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70bfff700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd70c0cc2c0 0x7fd70c0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 -- 172.21.15.81:0/188830821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd70c06d730 msgr2=0x7fd70c156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd70c06d730 0x7fd70c156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 -- 172.21.15.81:0/188830821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd70c0cc2c0 msgr2=0x7fd70c0aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd70c0cc2c0 0x7fd70c0aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 -- 172.21.15.81:0/188830821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc009a70 con 0x7fd70c06b110 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd70b7fe700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06b110 0x7fd70c0c31d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c700 tx=0x7fd70000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd6f3fff700 1 -- 172.21.15.81:0/188830821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000074e0 con 0x7fd70c06b110 2023-11-29T11:19:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd6f3fff700 1 -- 172.21.15.81:0/188830821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700007640 con 0x7fd70c06b110 2023-11-29T11:19:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0b3550 con 0x7fd70c06b110 2023-11-29T11:19:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd6f3fff700 1 -- 172.21.15.81:0/188830821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700005a90 con 0x7fd70c06b110 2023-11-29T11:19:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c0b3270 con 0x7fd70c06b110 2023-11-29T11:19:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.045+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c06b530 con 0x7fd70c06b110 2023-11-29T11:19:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.049+0000 7fd6f3fff700 1 -- 172.21.15.81:0/188830821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd700019030 con 0x7fd70c06b110 2023-11-29T11:19:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.049+0000 7fd6f3fff700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd6f8064ee0 0x7fd6f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.049+0000 7fd6f3fff700 1 -- 172.21.15.81:0/188830821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd7000810e0 con 0x7fd70c06b110 2023-11-29T11:19:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.049+0000 7fd70affd700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd6f8064ee0 0x7fd6f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.049+0000 7fd70affd700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd6f8064ee0 0x7fd6f8067390 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc014040 tx=0x7fd6fc011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:38.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.053+0000 7fd6f3fff700 1 -- 172.21.15.81:0/188830821 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd70004f410 con 0x7fd70c06b110 2023-11-29T11:19:38.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.217+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd70c0c2550 con 0x7fd70c06b110 2023-11-29T11:19:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.281+0000 7fd6f3fff700 1 -- 172.21.15.81:0/188830821 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd70c0c2550 con 0x7fd70c06b110 2023-11-29T11:19:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd6f8064ee0 msgr2=0x7fd6f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd6f8064ee0 0x7fd6f8067390 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc014040 tx=0x7fd6fc011000 comp rx=0 tx=0).stop 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06b110 msgr2=0x7fd70c0c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06b110 0x7fd70c0c31d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c700 tx=0x7fd70000cac0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 shutdown_connections 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd6f8064ee0 0x7fd6f8067390 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd70c0cc2c0 0x7fd70c0aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd70c06d730 0x7fd70c156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 --2- 172.21.15.81:0/188830821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd70c06b110 0x7fd70c0c31d0 secure :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c700 tx=0x7fd70000cac0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.285+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 >> 172.21.15.81:0/188830821 conn(0x7fd70c0ce3c0 msgr2=0x7fd70c0aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.289+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 shutdown_connections 2023-11-29T11:19:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.289+0000 7fd710a13700 1 -- 172.21.15.81:0/188830821 wait complete. 2023-11-29T11:19:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-11-29T11:19:38.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-29T11:19:38.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.413+0000 7fa379cd8700 1 Processor -- start 2023-11-29T11:19:38.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.413+0000 7fa379cd8700 1 -- start start 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa3740ad840 0x7fa3740cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37406bfb0 con 0x7fa37406d760 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37406c290 con 0x7fa3740c8a50 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37406c570 con 0x7fa3740ad840 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3794d7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa37406d760 0x7fa3740b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50372/0 (socket says 172.21.15.81:50372) 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3794d7700 1 -- 172.21.15.81:0/2597292797 learned_addr learned my addr 172.21.15.81:0/2597292797 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa378cd6700 1 --2- 172.21.15.81:0/2597292797 >> v2:172.21.15.176:3300/0 conn(0x7fa3740ad840 0x7fa3740cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592686169 0 0) 0x7fa37406bfb0 con 0x7fa37406d760 2023-11-29T11:19:38.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa35c0035d0 con 0x7fa37406d760 2023-11-29T11:19:38.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4092404203 0 0) 0x7fa35c0035d0 con 0x7fa37406d760 2023-11-29T11:19:38.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 >> v2:172.21.15.176:3300/0 conn(0x7fa3740ad840 msgr2=0x7fa3740cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 --2- 172.21.15.81:0/2597292797 >> v2:172.21.15.176:3300/0 conn(0x7fa3740ad840 0x7fa3740cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 >> v1:172.21.15.176:6789/0 conn(0x7fa3740c8a50 legacy=0x7fa37406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37406c850 con 0x7fa37406d760 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fa364001670 con 0x7fa37406d760 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 >> v1:172.21.15.81:6789/0 conn(0x7fa37406d760 legacy=0x7fa3740b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa35c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c004410 0x7fa35c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c0050d0 0x7fa35c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37406c570 con 0x7fa35c003a20 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c00bf70 con 0x7fa35c0050d0 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c00c130 con 0x7fa35c004410 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa378cd6700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa35c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa373fff700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c004410 0x7fa35c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3794d7700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c0050d0 0x7fa35c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa378cd6700 1 -- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c004410 msgr2=0x7fa35c0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa378cd6700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c004410 0x7fa35c0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa378cd6700 1 -- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c0050d0 msgr2=0x7fa35c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa378cd6700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c0050d0 0x7fa35c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa378cd6700 1 -- 172.21.15.81:0/2597292797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0035d0 con 0x7fa35c003a20 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3794d7700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c0050d0 0x7fa35c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3794d7700 1 -- 172.21.15.81:0/2597292797 reap_dead start 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa378cd6700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa35c003df0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa368009b70 tx=0x7fa35c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f85e57a012b0e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800e6c0 con 0x7fa35c003a20 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36800e820 con 0x7fa35c003a20 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa3737fe700 1 -- 172.21.15.81:0/2597292797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800eb90 con 0x7fa35c003a20 2023-11-29T11:19:38.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 -- 172.21.15.81:0/2597292797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 msgr2=0x7fa35c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa35c003df0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa368009b70 tx=0x7fa35c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 -- 172.21.15.81:0/2597292797 shutdown_connections 2023-11-29T11:19:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 --2- 172.21.15.81:0/2597292797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa35c003df0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.417+0000 7fa379cd8700 1 -- 172.21.15.81:0/2597292797 >> 172.21.15.81:0/2597292797 conn(0x7fa3740ce400 msgr2=0x7fa3740ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 -- 172.21.15.81:0/2597292797 shutdown_connections 2023-11-29T11:19:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 -- 172.21.15.81:0/2597292797 wait complete. 2023-11-29T11:19:38.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 Processor -- start 2023-11-29T11:19:38.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 -- start start 2023-11-29T11:19:38.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa37414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3740b3a10 0x7fa3740c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3740c34c0 0x7fa3740c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37406b3f0 con 0x7fa35c003a20 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740cb270 con 0x7fa3740b3a10 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa379cd8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37406b150 con 0x7fa3740c34c0 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa37414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa37414d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54340/0 (socket says 172.21.15.81:54340) 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 -- 172.21.15.81:0/3580244921 learned_addr learned my addr 172.21.15.81:0/3580244921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa373fff700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3740b3a10 0x7fa3740c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa3794d7700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3740c34c0 0x7fa3740c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 -- 172.21.15.81:0/3580244921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3740c34c0 msgr2=0x7fa3740c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3740c34c0 0x7fa3740c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 -- 172.21.15.81:0/3580244921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3740b3a10 msgr2=0x7fa3740c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3740b3a10 0x7fa3740c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 -- 172.21.15.81:0/3580244921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740adc10 con 0x7fa35c003a20 2023-11-29T11:19:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.421+0000 7fa378cd6700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa37414d340 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa36800e4b0 tx=0x7fa3680047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa3717fa700 1 -- 172.21.15.81:0/3580244921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36800e6c0 con 0x7fa35c003a20 2023-11-29T11:19:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa3717fa700 1 -- 172.21.15.81:0/3580244921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa368003af0 con 0x7fa35c003a20 2023-11-29T11:19:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa3717fa700 1 -- 172.21.15.81:0/3580244921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa368003ea0 con 0x7fa35c003a20 2023-11-29T11:19:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37406cb30 con 0x7fa35c003a20 2023-11-29T11:19:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37406bc80 con 0x7fa35c003a20 2023-11-29T11:19:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa374072500 con 0x7fa35c003a20 2023-11-29T11:19:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa3717fa700 1 -- 172.21.15.81:0/3580244921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa36802c030 con 0x7fa35c003a20 2023-11-29T11:19:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa3717fa700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa360064f10 0x7fa3600673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa3717fa700 1 -- 172.21.15.81:0/3580244921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fa368083210 con 0x7fa35c003a20 2023-11-29T11:19:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa373fff700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa360064f10 0x7fa3600673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.425+0000 7fa373fff700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa360064f10 0x7fa3600673c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b3de0 tx=0x7fa36c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:38.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.433+0000 7fa3717fa700 1 -- 172.21.15.81:0/3580244921 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa368051450 con 0x7fa35c003a20 2023-11-29T11:19:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:38.597+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa37406b3f0 con 0x7fa35c003a20 2023-11-29T11:19:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.305+0000 7fa3717fa700 1 -- 172.21.15.81:0/3580244921 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa37406b3f0 con 0x7fa35c003a20 2023-11-29T11:19:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa360064f10 msgr2=0x7fa3600673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa360064f10 0x7fa3600673c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b3de0 tx=0x7fa36c009040 comp rx=0 tx=0).stop 2023-11-29T11:19:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 msgr2=0x7fa37414d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa37414d340 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa36800e4b0 tx=0x7fa3680047e0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 shutdown_connections 2023-11-29T11:19:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa360064f10 0x7fa3600673c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3740c34c0 0x7fa3740c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3740b3a10 0x7fa3740c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.317+0000 7fa379cd8700 1 --2- 172.21.15.81:0/3580244921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa35c003a20 0x7fa37414d340 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.321+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 >> 172.21.15.81:0/3580244921 conn(0x7fa3740ce400 msgr2=0x7fa3740b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.321+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 shutdown_connections 2023-11-29T11:19:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.321+0000 7fa379cd8700 1 -- 172.21.15.81:0/3580244921 wait complete. 2023-11-29T11:19:39.330 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-11-29T11:19:39.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-29T11:19:39.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.441+0000 7fc6ab59e700 1 Processor -- start 2023-11-29T11:19:39.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.441+0000 7fc6ab59e700 1 -- start start 2023-11-29T11:19:39.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac0d31b0 0x7fc6ac0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac06a7f0 con 0x7fc6ac06ce60 2023-11-29T11:19:39.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac06aad0 con 0x7fc6ac0cf470 2023-11-29T11:19:39.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac15c8b0 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6aa59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc6ac06ce60 0x7fc6ac06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50384/0 (socket says 172.21.15.81:50384) 2023-11-29T11:19:39.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6aa59c700 1 -- 172.21.15.81:0/1236734075 learned_addr learned my addr 172.21.15.81:0/1236734075 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:39.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a1d9b700 1 --2- 172.21.15.81:0/1236734075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac0d31b0 0x7fc6ac0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a9d9b700 1 -- 172.21.15.81:0/1236734075 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414003596 0 0) 0x7fc6ac06a7f0 con 0x7fc6ac06ce60 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a9d9b700 1 -- 172.21.15.81:0/1236734075 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6980035d0 con 0x7fc6ac06ce60 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a1d9b700 1 -- 172.21.15.81:0/1236734075 >> v1:172.21.15.176:6789/0 conn(0x7fc6ac0cf470 legacy=0x7fc6ac0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a1d9b700 1 -- 172.21.15.81:0/1236734075 >> v1:172.21.15.81:6789/0 conn(0x7fc6ac06ce60 legacy=0x7fc6ac06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a1d9b700 1 -- 172.21.15.81:0/1236734075 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac06adb0 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a1d9b700 1 --2- 172.21.15.81:0/1236734075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac0d31b0 0x7fc6ac0cce60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc694009880 tx=0x7fc694009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35e9efb94b4bf2b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a9d9b700 1 -- 172.21.15.81:0/1236734075 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011830 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a9d9b700 1 -- 172.21.15.81:0/1236734075 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694011990 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6a9d9b700 1 -- 172.21.15.81:0/1236734075 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011d00 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 -- 172.21.15.81:0/1236734075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac0d31b0 msgr2=0x7fc6ac0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 --2- 172.21.15.81:0/1236734075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac0d31b0 0x7fc6ac0cce60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc694009880 tx=0x7fc694009b90 comp rx=0 tx=0).stop 2023-11-29T11:19:39.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 -- 172.21.15.81:0/1236734075 shutdown_connections 2023-11-29T11:19:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 --2- 172.21.15.81:0/1236734075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac0d31b0 0x7fc6ac0cce60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 -- 172.21.15.81:0/1236734075 >> 172.21.15.81:0/1236734075 conn(0x7fc6ac0b5760 msgr2=0x7fc6ac0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 -- 172.21.15.81:0/1236734075 shutdown_connections 2023-11-29T11:19:39.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.445+0000 7fc6ab59e700 1 -- 172.21.15.81:0/1236734075 wait complete. 2023-11-29T11:19:39.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6ab59e700 1 Processor -- start 2023-11-29T11:19:39.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6ab59e700 1 -- start start 2023-11-29T11:19:39.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6ab59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac06ce60 0x7fc6ac1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6ab59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6ac0cf470 0x7fc6ac0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6ab59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0d31b0 0x7fc6ac159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6ab59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c7430 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6ab59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c66a0 con 0x7fc6ac0cf470 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6ab59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac1597a0 con 0x7fc6ac06ce60 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0d31b0 0x7fc6ac159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0d31b0 0x7fc6ac159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54352/0 (socket says 172.21.15.81:54352) 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aad9d700 1 -- 172.21.15.81:0/4028403495 learned_addr learned my addr 172.21.15.81:0/4028403495 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6a1d9b700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6ac0cf470 0x7fc6ac0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aa59c700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac06ce60 0x7fc6ac1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aad9d700 1 -- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac06ce60 msgr2=0x7fc6ac1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aad9d700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac06ce60 0x7fc6ac1599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aad9d700 1 -- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6ac0cf470 msgr2=0x7fc6ac0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aad9d700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6ac0cf470 0x7fc6ac0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6aad9d700 1 -- 172.21.15.81:0/4028403495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6940094b0 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.449+0000 7fc6a1d9b700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6ac0cf470 0x7fc6ac0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6aad9d700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0d31b0 0x7fc6ac159260 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400cb80 tx=0x7fc6a400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6a37fe700 1 -- 172.21.15.81:0/4028403495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4003c20 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6a37fe700 1 -- 172.21.15.81:0/4028403495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4003d80 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac0d0000 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6a37fe700 1 -- 172.21.15.81:0/4028403495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400aaa0 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac06b090 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac0b6470 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6a37fe700 1 -- 172.21.15.81:0/4028403495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc6a4010050 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.453+0000 7fc6a37fe700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc68c064f10 0x7fc68c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.457+0000 7fc6a37fe700 1 -- 172.21.15.81:0/4028403495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fc6a4081d40 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.457+0000 7fc6aa59c700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc68c064f10 0x7fc68c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.457+0000 7fc6aa59c700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc68c064f10 0x7fc68c0673c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc69c007fd0 tx=0x7fc69c007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:39.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.461+0000 7fc6a37fe700 1 -- 172.21.15.81:0/4028403495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc6a404fe00 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.661+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc6ac0c7570 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.673+0000 7fc6a37fe700 1 -- 172.21.15.81:0/4028403495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc6ac0c7570 con 0x7fc6ac0d31b0 2023-11-29T11:19:39.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc68c064f10 msgr2=0x7fc68c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc68c064f10 0x7fc68c0673c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc69c007fd0 tx=0x7fc69c007de0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0d31b0 msgr2=0x7fc6ac159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0d31b0 0x7fc6ac159260 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400cb80 tx=0x7fc6a400ce90 comp rx=0 tx=0).stop 2023-11-29T11:19:39.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 shutdown_connections 2023-11-29T11:19:39.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc68c064f10 0x7fc68c0673c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0d31b0 0x7fc6ac159260 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6ac0cf470 0x7fc6ac0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 --2- 172.21.15.81:0/4028403495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6ac06ce60 0x7fc6ac1599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.701+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 >> 172.21.15.81:0/4028403495 conn(0x7fc6ac0b5760 msgr2=0x7fc6ac0cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:39.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.705+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 shutdown_connections 2023-11-29T11:19:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.705+0000 7fc6ab59e700 1 -- 172.21.15.81:0/4028403495 wait complete. 2023-11-29T11:19:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 14 and data pool 15 2023-11-29T11:19:39.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:39.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.817+0000 7fe865124700 1 Processor -- start 2023-11-29T11:19:39.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.817+0000 7fe865124700 1 -- start start 2023-11-29T11:19:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe865124700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600b32e0 0x7fe8600b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe865124700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8600cbe00 con 0x7fe8601584c0 2023-11-29T11:19:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe865124700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8600b3c30 con 0x7fe860069cd0 2023-11-29T11:19:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe865124700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86006dbd0 con 0x7fe8600b32e0 2023-11-29T11:19:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe8601584c0 0x7fe8600cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33272/0 (socket says 172.21.15.81:33272) 2023-11-29T11:19:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 -- 172.21.15.81:0/1971623474 learned_addr learned my addr 172.21.15.81:0/1971623474 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:39.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685372956 0 0) 0x7fe8600cbe00 con 0x7fe8601584c0 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8480034f0 con 0x7fe8601584c0 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85f7fe700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600b32e0 0x7fe8600b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4047633430 0 0) 0x7fe8480034f0 con 0x7fe8601584c0 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600b32e0 msgr2=0x7fe8600b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600b32e0 0x7fe8600b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 >> v1:172.21.15.176:6789/0 conn(0x7fe860069cd0 legacy=0x7fe86006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600cd0f0 con 0x7fe8601584c0 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fe8580019f0 con 0x7fe8601584c0 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 >> v1:172.21.15.81:6789/0 conn(0x7fe8601584c0 legacy=0x7fe8600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe848003b40 0x7fe848003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600b32e0 0x7fe84800a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe84800b100 0x7fe84800d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86006dbd0 con 0x7fe848003b40 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84800dd90 con 0x7fe84800b100 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84800df50 con 0x7fe8600b32e0 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe848003b40 0x7fe848003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85f7fe700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600b32e0 0x7fe84800a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe864923700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe84800b100 0x7fe84800d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 -- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600b32e0 msgr2=0x7fe84800a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600b32e0 0x7fe84800a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 -- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe84800b100 msgr2=0x7fe84800d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe84800b100 0x7fe84800d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 -- 172.21.15.81:0/1971623474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8480034f0 con 0x7fe848003b40 2023-11-29T11:19:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85ffff700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe848003b40 0x7fe848003f50 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe85800a830 tx=0x7fe8480037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349931a098ae3325 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85800a2f0 con 0x7fe848003b40 2023-11-29T11:19:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8580072f0 con 0x7fe848003b40 2023-11-29T11:19:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.821+0000 7fe85effd700 1 -- 172.21.15.81:0/1971623474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580076a0 con 0x7fe848003b40 2023-11-29T11:19:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe865124700 1 -- 172.21.15.81:0/1971623474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe848003b40 msgr2=0x7fe848003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe865124700 1 --2- 172.21.15.81:0/1971623474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe848003b40 0x7fe848003f50 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe85800a830 tx=0x7fe8480037a0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe864923700 1 -- 172.21.15.81:0/1971623474 reap_dead start 2023-11-29T11:19:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe865124700 1 -- 172.21.15.81:0/1971623474 shutdown_connections 2023-11-29T11:19:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe865124700 1 -- 172.21.15.81:0/1971623474 >> 172.21.15.81:0/1971623474 conn(0x7fe8600ce3e0 msgr2=0x7fe8600ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe865124700 1 -- 172.21.15.81:0/1971623474 shutdown_connections 2023-11-29T11:19:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe865124700 1 -- 172.21.15.81:0/1971623474 wait complete. 2023-11-29T11:19:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe865124700 1 Processor -- start 2023-11-29T11:19:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.825+0000 7fe865124700 1 -- start start 2023-11-29T11:19:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe865124700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600c9110 0x7fe8600c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe865124700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8600c49b0 0x7fe8601f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe865124700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600c94e0 0x7fe8601f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe865124700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c3070 con 0x7fe8600c49b0 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe865124700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860097790 con 0x7fe8600c9110 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe865124700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600974b0 con 0x7fe8600c94e0 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8600c49b0 0x7fe8601f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8600c49b0 0x7fe8601f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46772/0 (socket says 172.21.15.81:46772) 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 -- 172.21.15.81:0/15896051 learned_addr learned my addr 172.21.15.81:0/15896051 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe864923700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600c94e0 0x7fe8601f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85ffff700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600c9110 0x7fe8600c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 -- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600c94e0 msgr2=0x7fe8601f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600c94e0 0x7fe8601f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 -- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600c9110 msgr2=0x7fe8600c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600c9110 0x7fe8600c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 -- 172.21.15.81:0/15896051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600cd6b0 con 0x7fe8600c49b0 2023-11-29T11:19:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe864923700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600c94e0 0x7fe8601f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85f7fe700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8600c49b0 0x7fe8601f4da0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe8540116d0 tx=0x7fe854011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85cff9700 1 -- 172.21.15.81:0/15896051 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400c070 con 0x7fe8600c49b0 2023-11-29T11:19:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85cff9700 1 -- 172.21.15.81:0/15896051 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854015870 con 0x7fe8600c49b0 2023-11-29T11:19:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8600cd3d0 con 0x7fe8600c49b0 2023-11-29T11:19:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85cff9700 1 -- 172.21.15.81:0/15896051 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854015c00 con 0x7fe8600c49b0 2023-11-29T11:19:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8600cd990 con 0x7fe8600c49b0 2023-11-29T11:19:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.829+0000 7fe85cff9700 1 -- 172.21.15.81:0/15896051 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe85401b030 con 0x7fe8600c49b0 2023-11-29T11:19:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.833+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe860072500 con 0x7fe8600c49b0 2023-11-29T11:19:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.833+0000 7fe85cff9700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe84c064ee0 0x7fe84c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.833+0000 7fe85ffff700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe84c064ee0 0x7fe84c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.833+0000 7fe85cff9700 1 -- 172.21.15.81:0/15896051 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe854081e70 con 0x7fe8600c49b0 2023-11-29T11:19:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.833+0000 7fe85ffff700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe84c064ee0 0x7fe84c067390 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe86006b780 tx=0x7fe858007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:39.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:39.841+0000 7fe85cff9700 1 -- 172.21.15.81:0/15896051 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe85404fed0 con 0x7fe8600c49b0 2023-11-29T11:19:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.005+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8600ca680 con 0x7fe8600c49b0 2023-11-29T11:19:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.009+0000 7fe85cff9700 1 -- 172.21.15.81:0/15896051 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17982 (secure 0 0 0) 0x7fe8540534f0 con 0x7fe8600c49b0 2023-11-29T11:19:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:40.016 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:19:39.666106+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.009+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe84c064ee0 msgr2=0x7fe84c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.009+0000 7fe865124700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe84c064ee0 0x7fe84c067390 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe86006b780 tx=0x7fe858007000 comp rx=0 tx=0).stop 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.009+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8600c49b0 msgr2=0x7fe8601f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.009+0000 7fe865124700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8600c49b0 0x7fe8601f4da0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe8540116d0 tx=0x7fe854011a90 comp rx=0 tx=0).stop 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.013+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 shutdown_connections 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.013+0000 7fe865124700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe84c064ee0 0x7fe84c067390 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.013+0000 7fe865124700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8600c94e0 0x7fe8601f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.013+0000 7fe865124700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8600c49b0 0x7fe8601f4da0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.013+0000 7fe865124700 1 --2- 172.21.15.81:0/15896051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8600c9110 0x7fe8600c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.013+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 >> 172.21.15.81:0/15896051 conn(0x7fe8600ce3e0 msgr2=0x7fe860156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:40.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.013+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 shutdown_connections 2023-11-29T11:19:40.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.013+0000 7fe865124700 1 -- 172.21.15.81:0/15896051 wait complete. 2023-11-29T11:19:40.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4ffff700 1 Processor -- start 2023-11-29T11:19:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4ffff700 1 -- start start 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 0x7f8e5015b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5015e9f0 con 0x7f8e5015da90 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5015e710 con 0x7f8e5013cef0 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5015a620 con 0x7f8e5006cd50 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8e5015da90 0x7f8e5015df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33276/0 (socket says 172.21.15.81:33276) 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4f7fe700 1 -- 172.21.15.81:0/2504034902 learned_addr learned my addr 172.21.15.81:0/2504034902 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4e7fc700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 0x7f8e5015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165801899 0 0) 0x7f8e5015e9f0 con 0x7f8e5015da90 2023-11-29T11:19:40.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e380035d0 con 0x7f8e5015da90 2023-11-29T11:19:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 13346477 0 0) 0x7f8e380035d0 con 0x7f8e5015da90 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 msgr2=0x7f8e5015b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 0x7f8e5015b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 >> v1:172.21.15.176:6789/0 conn(0x7f8e5013cef0 legacy=0x7f8e5006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5015a900 con 0x7f8e5015da90 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f8e48001670 con 0x7f8e5015da90 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4e7fc700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 0x7f8e5015b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 >> v1:172.21.15.81:6789/0 conn(0x7f8e5015da90 legacy=0x7f8e5015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e38003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 0x7f8e38004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e38004db0 0x7f8e38005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5015a620 con 0x7f8e38003a50 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3800bae0 con 0x7f8e38004db0 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3800bc20 con 0x7f8e5006cd50 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4effd700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e38003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4e7fc700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 0x7f8e38004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4f7fe700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e38004db0 0x7f8e38005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4effd700 1 -- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 msgr2=0x7f8e38004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4effd700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 0x7f8e38004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4effd700 1 -- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e38004db0 msgr2=0x7f8e38005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4effd700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e38004db0 0x7f8e38005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4effd700 1 -- 172.21.15.81:0/2504034902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009a70 con 0x7f8e38003a50 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4e7fc700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e5006cd50 0x7f8e38004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.133+0000 7f8e4effd700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e38003e60 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f8e440017e0 tx=0x7f8e380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cb70e3dd971b24 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440052d0 con 0x7f8e38003a50 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44005430 con 0x7f8e38003a50 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4dffb700 1 -- 172.21.15.81:0/2504034902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440055a0 con 0x7f8e38003a50 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2504034902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 msgr2=0x7f8e38003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4ffff700 1 --2- 172.21.15.81:0/2504034902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e38003e60 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f8e440017e0 tx=0x7f8e380058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4f7fe700 1 -- 172.21.15.81:0/2504034902 reap_dead start 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2504034902 shutdown_connections 2023-11-29T11:19:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2504034902 >> 172.21.15.81:0/2504034902 conn(0x7f8e5006e000 msgr2=0x7f8e500b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2504034902 shutdown_connections 2023-11-29T11:19:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2504034902 wait complete. 2023-11-29T11:19:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4ffff700 1 Processor -- start 2023-11-29T11:19:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.137+0000 7f8e4ffff700 1 -- start start 2023-11-29T11:19:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e50140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e50155600 0x7f8e5013ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e50155a70 0x7f8e5013f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e501414c0 con 0x7f8e38003a50 2023-11-29T11:19:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e501417a0 con 0x7f8e50155600 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50141a80 con 0x7f8e50155a70 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e50140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e50140e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46798/0 (socket says 172.21.15.81:46798) 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 -- 172.21.15.81:0/2914704896 learned_addr learned my addr 172.21.15.81:0/2914704896 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4e7fc700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e50155600 0x7f8e5013ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4f7fe700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e50155a70 0x7f8e5013f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 -- 172.21.15.81:0/2914704896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e50155a70 msgr2=0x7f8e5013f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e50155a70 0x7f8e5013f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 -- 172.21.15.81:0/2914704896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e50155600 msgr2=0x7f8e5013ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e50155600 0x7f8e5013ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 -- 172.21.15.81:0/2914704896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5013d2c0 con 0x7f8e38003a50 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4effd700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e50140e50 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8e44001dd0 tx=0x7f8e44001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e37fff700 1 -- 172.21.15.81:0/2914704896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440055a0 con 0x7f8e38003a50 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e37fff700 1 -- 172.21.15.81:0/2914704896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44007450 con 0x7f8e38003a50 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5015abe0 con 0x7f8e38003a50 2023-11-29T11:19:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e37fff700 1 -- 172.21.15.81:0/2914704896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44001290 con 0x7f8e38003a50 2023-11-29T11:19:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5015b100 con 0x7f8e38003a50 2023-11-29T11:19:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.141+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e50072c20 con 0x7f8e38003a50 2023-11-29T11:19:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.145+0000 7f8e37fff700 1 -- 172.21.15.81:0/2914704896 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8e4402e070 con 0x7f8e38003a50 2023-11-29T11:19:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.145+0000 7f8e37fff700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e3c064ee0 0x7f8e3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.145+0000 7f8e37fff700 1 -- 172.21.15.81:0/2914704896 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8e44083060 con 0x7f8e38003a50 2023-11-29T11:19:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.145+0000 7f8e4e7fc700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e3c064ee0 0x7f8e3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.145+0000 7f8e4e7fc700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e3c064ee0 0x7f8e3c067390 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8e501595a0 tx=0x7f8e4000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.149+0000 7f8e37fff700 1 -- 172.21.15.81:0/2914704896 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8e440b3400 con 0x7f8e38003a50 2023-11-29T11:19:40.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.309+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e500ce870 con 0x7f8e38003a50 2023-11-29T11:19:40.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.313+0000 7f8e37fff700 1 -- 172.21.15.81:0/2914704896 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17982 (secure 0 0 0) 0x7f8e44017090 con 0x7f8e38003a50 2023-11-29T11:19:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:40.321 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:19:39.666106+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e3c064ee0 msgr2=0x7f8e3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e3c064ee0 0x7f8e3c067390 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8e501595a0 tx=0x7f8e4000b040 comp rx=0 tx=0).stop 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 msgr2=0x7f8e50140e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e50140e50 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8e44001dd0 tx=0x7f8e44001120 comp rx=0 tx=0).stop 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 shutdown_connections 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8e3c064ee0 0x7f8e3c067390 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e50155a70 0x7f8e5013f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e50155600 0x7f8e5013ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 --2- 172.21.15.81:0/2914704896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e38003a50 0x7f8e50140e50 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 >> 172.21.15.81:0/2914704896 conn(0x7f8e5006e000 msgr2=0x7f8e5015ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 shutdown_connections 2023-11-29T11:19:40.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.317+0000 7f8e4ffff700 1 -- 172.21.15.81:0/2914704896 wait complete. 2023-11-29T11:19:40.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-29T11:19:40.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c8488700 1 Processor -- start 2023-11-29T11:19:40.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c8488700 1 -- start start 2023-11-29T11:19:40.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c8488700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa8c015a140 0x7fa8c006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c8488700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c006cce0 con 0x7fa8c00b1970 2023-11-29T11:19:40.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c8488700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c006cfc0 con 0x7fa8c015e5e0 2023-11-29T11:19:40.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c8488700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c015a510 con 0x7fa8c015a140 2023-11-29T11:19:40.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c6a25700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa8c00b1970 0x7fa8c00caa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33278/0 (socket says 172.21.15.81:33278) 2023-11-29T11:19:40.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c6a25700 1 -- 172.21.15.81:0/1709858935 learned_addr learned my addr 172.21.15.81:0/1709858935 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:40.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c6224700 1 --2- 172.21.15.81:0/1709858935 >> v2:172.21.15.176:3300/0 conn(0x7fa8c015a140 0x7fa8c006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c5222700 1 -- 172.21.15.81:0/1709858935 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073040167 0 0) 0x7fa8c006cce0 con 0x7fa8c00b1970 2023-11-29T11:19:40.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c5222700 1 -- 172.21.15.81:0/1709858935 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ac0035d0 con 0x7fa8c00b1970 2023-11-29T11:19:40.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c6224700 1 -- 172.21.15.81:0/1709858935 >> v1:172.21.15.176:6789/0 conn(0x7fa8c015e5e0 legacy=0x7fa8c00b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c6224700 1 -- 172.21.15.81:0/1709858935 >> v1:172.21.15.81:6789/0 conn(0x7fa8c00b1970 legacy=0x7fa8c00caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.457+0000 7fa8c6224700 1 -- 172.21.15.81:0/1709858935 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00ca560 con 0x7fa8c015a140 2023-11-29T11:19:40.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c6224700 1 --2- 172.21.15.81:0/1709858935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015a140 0x7fa8c006aee0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009850 tx=0x7fa8bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2993b7d29bc4884b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:40.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c5222700 1 -- 172.21.15.81:0/1709858935 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011830 con 0x7fa8c015a140 2023-11-29T11:19:40.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c5222700 1 -- 172.21.15.81:0/1709858935 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc011990 con 0x7fa8c015a140 2023-11-29T11:19:40.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c5222700 1 -- 172.21.15.81:0/1709858935 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011d00 con 0x7fa8c015a140 2023-11-29T11:19:40.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c8488700 1 -- 172.21.15.81:0/1709858935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015a140 msgr2=0x7fa8c006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c8488700 1 --2- 172.21.15.81:0/1709858935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015a140 0x7fa8c006aee0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009850 tx=0x7fa8bc009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:40.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c8488700 1 -- 172.21.15.81:0/1709858935 shutdown_connections 2023-11-29T11:19:40.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c8488700 1 --2- 172.21.15.81:0/1709858935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015a140 0x7fa8c006aee0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c8488700 1 -- 172.21.15.81:0/1709858935 >> 172.21.15.81:0/1709858935 conn(0x7fa8c00cc260 msgr2=0x7fa8c00cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:40.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c8488700 1 -- 172.21.15.81:0/1709858935 shutdown_connections 2023-11-29T11:19:40.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.461+0000 7fa8c8488700 1 -- 172.21.15.81:0/1709858935 wait complete. 2023-11-29T11:19:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c8488700 1 Processor -- start 2023-11-29T11:19:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c8488700 1 -- start start 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c8488700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c00b1970 0x7fa8c00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c8488700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8c015a140 0x7fa8c0143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c8488700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015e5e0 0x7fa8c00c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c8488700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c9a80 con 0x7fa8c00b1970 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c8488700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c4fb0 con 0x7fa8c015e5e0 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c8488700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c4610 con 0x7fa8c015a140 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6224700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c00b1970 0x7fa8c00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6224700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c00b1970 0x7fa8c00b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46810/0 (socket says 172.21.15.81:46810) 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6224700 1 -- 172.21.15.81:0/2624043362 learned_addr learned my addr 172.21.15.81:0/2624043362 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c5a23700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8c015a140 0x7fa8c0143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6a25700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015e5e0 0x7fa8c00c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6224700 1 -- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8c015a140 msgr2=0x7fa8c0143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6224700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8c015a140 0x7fa8c0143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6224700 1 -- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015e5e0 msgr2=0x7fa8c00c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6224700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015e5e0 0x7fa8c00c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6224700 1 -- 172.21.15.81:0/2624043362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0094b0 con 0x7fa8c00b1970 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c5a23700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8c015a140 0x7fa8c0143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.465+0000 7fa8c6a25700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015e5e0 0x7fa8c00c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8c6224700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c00b1970 0x7fa8c00b4fe0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc000c00 tx=0x7fa8bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8b6ffd700 1 -- 172.21.15.81:0/2624043362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0036c0 con 0x7fa8c00b1970 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8b6ffd700 1 -- 172.21.15.81:0/2624043362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc01f070 con 0x7fa8c00b1970 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c015ea30 con 0x7fa8c00b1970 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8b6ffd700 1 -- 172.21.15.81:0/2624043362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc003a80 con 0x7fa8c00b1970 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c006c990 con 0x7fa8c00b1970 2023-11-29T11:19:40.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c00cb190 con 0x7fa8c00b1970 2023-11-29T11:19:40.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8b6ffd700 1 -- 172.21.15.81:0/2624043362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa8bc00f050 con 0x7fa8c00b1970 2023-11-29T11:19:40.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8b6ffd700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa8a4064ee0 0x7fa8a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:40.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8c5a23700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa8a4064ee0 0x7fa8a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:40.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.469+0000 7fa8b6ffd700 1 -- 172.21.15.81:0/2624043362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa8bc021070 con 0x7fa8c00b1970 2023-11-29T11:19:40.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.473+0000 7fa8c5a23700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa8a4064ee0 0x7fa8a4067390 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa8c01f2d70 tx=0x7fa8b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:40.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.473+0000 7fa8b6ffd700 1 -- 172.21.15.81:0/2624043362 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa8bc0519e0 con 0x7fa8c00b1970 2023-11-29T11:19:40.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:40.673+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa8c0072c20 con 0x7fa8c00b1970 2023-11-29T11:19:41.115 INFO:tasks.ceph.mds.d.smithi176.stderr:2023-11-29T11:19:41.107+0000 7fa4d4ea3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:19:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.677+0000 7fa8b6ffd700 1 -- 172.21.15.81:0/2624043362 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa8bc0150b0 con 0x7fa8c00b1970 2023-11-29T11:19:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa8a4064ee0 msgr2=0x7fa8a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa8a4064ee0 0x7fa8a4067390 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa8c01f2d70 tx=0x7fa8b0009040 comp rx=0 tx=0).stop 2023-11-29T11:19:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c00b1970 msgr2=0x7fa8c00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c00b1970 0x7fa8c00b4fe0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc000c00 tx=0x7fa8bc004770 comp rx=0 tx=0).stop 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 shutdown_connections 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa8a4064ee0 0x7fa8a4067390 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8c015e5e0 0x7fa8c00c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8c015a140 0x7fa8c0143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 --2- 172.21.15.81:0/2624043362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8c00b1970 0x7fa8c00b4fe0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 >> 172.21.15.81:0/2624043362 conn(0x7fa8c00cc260 msgr2=0x7fa8c006a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 shutdown_connections 2023-11-29T11:19:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.681+0000 7fa8c8488700 1 -- 172.21.15.81:0/2624043362 wait complete. 2023-11-29T11:19:41.706 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-29T11:19:41.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-29T11:19:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.825+0000 7f3e521cf700 1 Processor -- start 2023-11-29T11:19:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.825+0000 7f3e521cf700 1 -- start start 2023-11-29T11:19:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e521cf700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3e4c158ee0 0x7f3e4c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e521cf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e4c0ce230 0x7f3e4c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e521cf700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c06d1c0 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e521cf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c06e000 con 0x7f3e4c0ce230 2023-11-29T11:19:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e521cf700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0ca3a0 con 0x7f3e4c158ee0 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e519ce700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e4c0ce230 0x7f3e4c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e519ce700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e4c0ce230 0x7f3e4c0cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46812/0 (socket says 172.21.15.81:46812) 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e519ce700 1 -- 172.21.15.81:0/3581192661 learned_addr learned my addr 172.21.15.81:0/3581192661 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e511cd700 1 --2- 172.21.15.81:0/3581192661 >> v2:172.21.15.176:3300/0 conn(0x7f3e4c158ee0 0x7f3e4c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e519ce700 1 -- 172.21.15.81:0/3581192661 >> v2:172.21.15.176:3300/0 conn(0x7f3e4c158ee0 msgr2=0x7f3e4c0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e519ce700 1 --2- 172.21.15.81:0/3581192661 >> v2:172.21.15.176:3300/0 conn(0x7f3e4c158ee0 0x7f3e4c0ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e519ce700 1 -- 172.21.15.81:0/3581192661 >> v1:172.21.15.176:6789/0 conn(0x7f3e4c0cd5d0 legacy=0x7f3e4c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e519ce700 1 -- 172.21.15.81:0/3581192661 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c06c920 con 0x7f3e4c0ce230 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e519ce700 1 --2- 172.21.15.81:0/3581192661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0ce230 0x7f3e4c0cab60 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0ccec0 tx=0x7f3e4400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca08c4c1633b4429 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e43fff700 1 -- 172.21.15.81:0/3581192661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44010070 con 0x7f3e4c0ce230 2023-11-29T11:19:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e43fff700 1 -- 172.21.15.81:0/3581192661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400dd90 con 0x7f3e4c0ce230 2023-11-29T11:19:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.829+0000 7f3e43fff700 1 -- 172.21.15.81:0/3581192661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400b310 con 0x7f3e4c0ce230 2023-11-29T11:19:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 -- 172.21.15.81:0/3581192661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0ce230 msgr2=0x7f3e4c0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 --2- 172.21.15.81:0/3581192661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0ce230 0x7f3e4c0cab60 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0ccec0 tx=0x7f3e4400d430 comp rx=0 tx=0).stop 2023-11-29T11:19:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 -- 172.21.15.81:0/3581192661 shutdown_connections 2023-11-29T11:19:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 --2- 172.21.15.81:0/3581192661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0ce230 0x7f3e4c0cab60 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 --2- 172.21.15.81:0/3581192661 >> v2:172.21.15.176:3300/0 conn(0x7f3e4c158ee0 0x7f3e4c0ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 -- 172.21.15.81:0/3581192661 >> 172.21.15.81:0/3581192661 conn(0x7f3e4c0d0240 msgr2=0x7f3e4c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 -- 172.21.15.81:0/3581192661 shutdown_connections 2023-11-29T11:19:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 -- 172.21.15.81:0/3581192661 wait complete. 2023-11-29T11:19:41.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 Processor -- start 2023-11-29T11:19:41.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.833+0000 7f3e521cf700 1 -- start start 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0cd5d0 0x7f3e4c0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e4c0ce230 0x7f3e4c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e4c158ee0 0x7f3e4c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c06f680 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b4840 con 0x7f3e4c0ce230 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c06f150 con 0x7f3e4c158ee0 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0cd5d0 0x7f3e4c0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0cd5d0 0x7f3e4c0b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46814/0 (socket says 172.21.15.81:46814) 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 -- 172.21.15.81:0/2985280463 learned_addr learned my addr 172.21.15.81:0/2985280463 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e509cc700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e4c0ce230 0x7f3e4c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e519ce700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e4c158ee0 0x7f3e4c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 -- 172.21.15.81:0/2985280463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e4c158ee0 msgr2=0x7f3e4c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e4c158ee0 0x7f3e4c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 -- 172.21.15.81:0/2985280463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e4c0ce230 msgr2=0x7f3e4c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e4c0ce230 0x7f3e4c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 -- 172.21.15.81:0/2985280463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4400bd40 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e511cd700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0cd5d0 0x7f3e4c0b2420 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800d830 tx=0x7f3e4800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e41ffb700 1 -- 172.21.15.81:0/2985280463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480125f0 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e41ffb700 1 -- 172.21.15.81:0/2985280463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48012750 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c06cee0 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e41ffb700 1 -- 172.21.15.81:0/2985280463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48012b00 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c06cc00 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.837+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c0ca640 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.841+0000 7f3e41ffb700 1 -- 172.21.15.81:0/2985280463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3e48012c60 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.841+0000 7f3e41ffb700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e30064ee0 0x7f3e30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.841+0000 7f3e41ffb700 1 -- 172.21.15.81:0/2985280463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3e480821a0 con 0x7f3e4c0cd5d0 2023-11-29T11:19:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.841+0000 7f3e509cc700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e30064ee0 0x7f3e30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.841+0000 7f3e509cc700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e30064ee0 0x7f3e30067390 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c152e70 tx=0x7f3e3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:41.845+0000 7f3e41ffb700 1 -- 172.21.15.81:0/2985280463 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3e48050200 con 0x7f3e4c0cd5d0 2023-11-29T11:19:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.041+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3e4c072c20 con 0x7f3e4c0cd5d0 2023-11-29T11:19:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.693+0000 7f3e41ffb700 1 -- 172.21.15.81:0/2985280463 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e48053820 con 0x7f3e4c0cd5d0 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e30064ee0 msgr2=0x7f3e30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e30064ee0 0x7f3e30067390 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c152e70 tx=0x7f3e3c009040 comp rx=0 tx=0).stop 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0cd5d0 msgr2=0x7f3e4c0b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0cd5d0 0x7f3e4c0b2420 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800d830 tx=0x7f3e4800db40 comp rx=0 tx=0).stop 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 shutdown_connections 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e30064ee0 0x7f3e30067390 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e4c158ee0 0x7f3e4c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e4c0ce230 0x7f3e4c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 --2- 172.21.15.81:0/2985280463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c0cd5d0 0x7f3e4c0b2420 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 >> 172.21.15.81:0/2985280463 conn(0x7f3e4c0d0240 msgr2=0x7f3e4c0caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 shutdown_connections 2023-11-29T11:19:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.697+0000 7f3e521cf700 1 -- 172.21.15.81:0/2985280463 wait complete. 2023-11-29T11:19:42.720 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-29T11:19:42.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:42.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f13469a4700 1 Processor -- start 2023-11-29T11:19:42.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f13469a4700 1 -- start start 2023-11-29T11:19:42.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f13469a4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401510d0 0x7f134015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:42.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f13469a4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1340069c40 0x7f13400b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:42.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f13469a4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13400b1170 con 0x7f13400c98a0 2023-11-29T11:19:42.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f13469a4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400c95d0 con 0x7f1340069c40 2023-11-29T11:19:42.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f13469a4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c8e00 con 0x7f13401510d0 2023-11-29T11:19:42.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1340069c40 0x7f13400b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:42.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1340069c40 0x7f13400b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46830/0 (socket says 172.21.15.81:46830) 2023-11-29T11:19:42.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133f7fe700 1 -- 172.21.15.81:0/22532563 learned_addr learned my addr 172.21.15.81:0/22532563 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:42.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133ffff700 1 --2- 172.21.15.81:0/22532563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401510d0 0x7f134015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:42.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133f7fe700 1 -- 172.21.15.81:0/22532563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401510d0 msgr2=0x7f134015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133f7fe700 1 --2- 172.21.15.81:0/22532563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401510d0 0x7f134015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133f7fe700 1 -- 172.21.15.81:0/22532563 >> v1:172.21.15.176:6789/0 conn(0x7f13400c98a0 legacy=0x7f13400c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133f7fe700 1 -- 172.21.15.81:0/22532563 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400c9010 con 0x7f1340069c40 2023-11-29T11:19:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133f7fe700 1 --2- 172.21.15.81:0/22532563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1340069c40 0x7f13400b0c30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f1328009910 tx=0x7f1328009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97de5f61b1191fa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133effd700 1 -- 172.21.15.81:0/22532563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328011830 con 0x7f1340069c40 2023-11-29T11:19:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.829+0000 7f133effd700 1 -- 172.21.15.81:0/22532563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1328011990 con 0x7f1340069c40 2023-11-29T11:19:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f133effd700 1 -- 172.21.15.81:0/22532563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328011d40 con 0x7f1340069c40 2023-11-29T11:19:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f13469a4700 1 -- 172.21.15.81:0/22532563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1340069c40 msgr2=0x7f13400b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f13469a4700 1 --2- 172.21.15.81:0/22532563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1340069c40 0x7f13400b0c30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f1328009910 tx=0x7f1328009c20 comp rx=0 tx=0).stop 2023-11-29T11:19:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f13469a4700 1 -- 172.21.15.81:0/22532563 shutdown_connections 2023-11-29T11:19:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f13469a4700 1 --2- 172.21.15.81:0/22532563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1340069c40 0x7f13400b0c30 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f13469a4700 1 --2- 172.21.15.81:0/22532563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13401510d0 0x7f134015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f13469a4700 1 -- 172.21.15.81:0/22532563 >> 172.21.15.81:0/22532563 conn(0x7f134006caf0 msgr2=0x7f13400ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f13469a4700 1 -- 172.21.15.81:0/22532563 shutdown_connections 2023-11-29T11:19:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.833+0000 7f13469a4700 1 -- 172.21.15.81:0/22532563 wait complete. 2023-11-29T11:19:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f13469a4700 1 Processor -- start 2023-11-29T11:19:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f13469a4700 1 -- start start 2023-11-29T11:19:42.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f13469a4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1340069c40 0x7f13401f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:42.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f13469a4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400c98a0 0x7f13400c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:42.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f13469a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13401510d0 0x7f13400cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f13469a4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13401f0b70 con 0x7f13401510d0 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f13469a4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c7580 con 0x7f1340069c40 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f13469a4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c7860 con 0x7f13400c98a0 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13401510d0 0x7f13400cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13401510d0 0x7f13400cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46844/0 (socket says 172.21.15.81:46844) 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 -- 172.21.15.81:0/3656360854 learned_addr learned my addr 172.21.15.81:0/3656360854 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f133ffff700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1340069c40 0x7f13401f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f133f7fe700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400c98a0 0x7f13400c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 -- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400c98a0 msgr2=0x7f13400c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400c98a0 0x7f13400c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 -- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1340069c40 msgr2=0x7f13401f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1340069c40 0x7f13401f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 -- 172.21.15.81:0/3656360854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328009570 con 0x7f13401510d0 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f133ffff700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1340069c40 0x7f13401f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:42.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.837+0000 7f1344f41700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13401510d0 0x7f13400cafa0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f133800cc50 tx=0x7f133800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f133cff9700 1 -- 172.21.15.81:0/3656360854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338003c20 con 0x7f13401510d0 2023-11-29T11:19:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f133cff9700 1 -- 172.21.15.81:0/3656360854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1338003d80 con 0x7f13401510d0 2023-11-29T11:19:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1340070170 con 0x7f13401510d0 2023-11-29T11:19:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f133cff9700 1 -- 172.21.15.81:0/3656360854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800aab0 con 0x7f13401510d0 2023-11-29T11:19:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13400c92f0 con 0x7f13401510d0 2023-11-29T11:19:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13401514a0 con 0x7f13401510d0 2023-11-29T11:19:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f133cff9700 1 -- 172.21.15.81:0/3656360854 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1338010050 con 0x7f13401510d0 2023-11-29T11:19:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f133cff9700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064ee0 0x7f1320067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f133cff9700 1 -- 172.21.15.81:0/3656360854 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1338081e50 con 0x7f13401510d0 2023-11-29T11:19:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.841+0000 7f133ffff700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064ee0 0x7f1320067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.845+0000 7f133ffff700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064ee0 0x7f1320067390 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f13300112c0 tx=0x7f1330009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:42.849+0000 7f133cff9700 1 -- 172.21.15.81:0/3656360854 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f133804feb0 con 0x7f13401510d0 2023-11-29T11:19:43.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.053+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1340072500 con 0x7f13401510d0 2023-11-29T11:19:43.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.053+0000 7f133cff9700 1 -- 172.21.15.81:0/3656360854 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f13380534d0 con 0x7f13401510d0 2023-11-29T11:19:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:43.060 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:19:42.677504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8016":{"gid":8016,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1691706444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1691706444},{"type":"v1","addr":"172.21.15.176:6833","nonce":1691706444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064ee0 msgr2=0x7f1320067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064ee0 0x7f1320067390 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f13300112c0 tx=0x7f1330009240 comp rx=0 tx=0).stop 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13401510d0 msgr2=0x7f13400cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13401510d0 0x7f13400cafa0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f133800cc50 tx=0x7f133800cf60 comp rx=0 tx=0).stop 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 shutdown_connections 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1320064ee0 0x7f1320067390 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13401510d0 0x7f13400cafa0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13400c98a0 0x7f13400c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 --2- 172.21.15.81:0/3656360854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1340069c40 0x7f13401f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 >> 172.21.15.81:0/3656360854 conn(0x7f134006caf0 msgr2=0x7f134006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:43.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 shutdown_connections 2023-11-29T11:19:43.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.057+0000 7f13469a4700 1 -- 172.21.15.81:0/3656360854 wait complete. 2023-11-29T11:19:43.064 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 54 2023-11-29T11:19:43.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:43.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc911e700 1 Processor -- start 2023-11-29T11:19:43.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc911e700 1 -- start start 2023-11-29T11:19:43.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc911e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4dc4158e60 0x7f4dc40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc911e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40cd8f0 con 0x7f4dc40cb460 2023-11-29T11:19:43.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc911e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc406dc60 con 0x7f4dc40ad490 2023-11-29T11:19:43.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc911e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40add00 con 0x7f4dc4158e60 2023-11-29T11:19:43.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc891d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4dc40cb460 0x7f4dc406c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33286/0 (socket says 172.21.15.81:33286) 2023-11-29T11:19:43.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc891d700 1 -- 172.21.15.81:0/3990087959 learned_addr learned my addr 172.21.15.81:0/3990087959 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:43.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc3fff700 1 --2- 172.21.15.81:0/3990087959 >> v2:172.21.15.176:3300/0 conn(0x7f4dc4158e60 0x7f4dc40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837492447 0 0) 0x7f4dc40cd8f0 con 0x7f4dc40cb460 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dac0035d0 con 0x7f4dc40cb460 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059136182 0 0) 0x7f4dc406dc60 con 0x7f4dc40ad490 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc40cd8f0 con 0x7f4dc40ad490 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609757499 0 0) 0x7f4dac0035d0 con 0x7f4dc40cb460 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 >> v2:172.21.15.176:3300/0 conn(0x7f4dc4158e60 msgr2=0x7f4dc40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 --2- 172.21.15.81:0/3990087959 >> v2:172.21.15.176:3300/0 conn(0x7f4dc4158e60 0x7f4dc40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 >> v1:172.21.15.176:6789/0 conn(0x7f4dc40ad490 legacy=0x7f4dc40cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40cde90 con 0x7f4dc40cb460 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f4dbc001670 con 0x7f4dc40cb460 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 >> v1:172.21.15.81:6789/0 conn(0x7f4dc40cb460 legacy=0x7f4dc406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac003bb0 0x7f4dac003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dac004870 0x7f4dac004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dac005220 0x7f4dac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40add00 con 0x7f4dac004870 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac00c130 con 0x7f4dac005220 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.185+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac00c2f0 con 0x7f4dac003bb0 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc37fe700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dac004870 0x7f4dac004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc3fff700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac003bb0 0x7f4dac003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc891d700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dac005220 0x7f4dac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc37fe700 1 -- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac003bb0 msgr2=0x7f4dac003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc37fe700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac003bb0 0x7f4dac003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc37fe700 1 -- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dac005220 msgr2=0x7f4dac00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc37fe700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dac005220 0x7f4dac00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc37fe700 1 -- 172.21.15.81:0/3990087959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0035d0 con 0x7f4dac004870 2023-11-29T11:19:43.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc891d700 1 -- 172.21.15.81:0/3990087959 reap_dead start 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc3fff700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac003bb0 0x7f4dac003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc37fe700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dac004870 0x7f4dac004ce0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f4db4002230 tx=0x7f4dac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bedae5932ec90ac server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4001f30 con 0x7f4dac004870 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db400ce80 con 0x7f4dac004870 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc2ffd700 1 -- 172.21.15.81:0/3990087959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4003c60 con 0x7f4dac004870 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 -- 172.21.15.81:0/3990087959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dac004870 msgr2=0x7f4dac004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dac004870 0x7f4dac004ce0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f4db4002230 tx=0x7f4dac0058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 -- 172.21.15.81:0/3990087959 shutdown_connections 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 --2- 172.21.15.81:0/3990087959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dac004870 0x7f4dac004ce0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 -- 172.21.15.81:0/3990087959 >> 172.21.15.81:0/3990087959 conn(0x7f4dc40ce3e0 msgr2=0x7f4dc40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 -- 172.21.15.81:0/3990087959 shutdown_connections 2023-11-29T11:19:43.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 -- 172.21.15.81:0/3990087959 wait complete. 2023-11-29T11:19:43.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 Processor -- start 2023-11-29T11:19:43.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.189+0000 7f4dc911e700 1 -- start start 2023-11-29T11:19:43.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac004870 0x7f4dc4069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc41f2940 0x7f4dc41562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dc415b5d0 0x7f4dc415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc415bf80 con 0x7f4dc41f2940 2023-11-29T11:19:43.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41f3120 con 0x7f4dc415b5d0 2023-11-29T11:19:43.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41f3400 con 0x7f4dac004870 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc41f2940 0x7f4dc41562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac004870 0x7f4dc4069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc41f2940 0x7f4dc41562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46874/0 (socket says 172.21.15.81:46874) 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc891d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dc415b5d0 0x7f4dc415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc37fe700 1 -- 172.21.15.81:0/1245329129 learned_addr learned my addr 172.21.15.81:0/1245329129 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc3fff700 1 -- 172.21.15.81:0/1245329129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dc415b5d0 msgr2=0x7f4dc415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc3fff700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dc415b5d0 0x7f4dc415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc3fff700 1 -- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc41f2940 msgr2=0x7f4dc41562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc3fff700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc41f2940 0x7f4dc41562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc3fff700 1 -- 172.21.15.81:0/1245329129 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc406d6a0 con 0x7f4dac004870 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc37fe700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc41f2940 0x7f4dc41562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc3fff700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac004870 0x7f4dc4069d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40b4430 tx=0x7f4db80117e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc0ff9700 1 -- 172.21.15.81:0/1245329129 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8015870 con 0x7f4dac004870 2023-11-29T11:19:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc4159230 con 0x7f4dac004870 2023-11-29T11:19:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc0ff9700 1 -- 172.21.15.81:0/1245329129 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db80159d0 con 0x7f4dac004870 2023-11-29T11:19:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc0ff9700 1 -- 172.21.15.81:0/1245329129 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8015d60 con 0x7f4dac004870 2023-11-29T11:19:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc406d980 con 0x7f4dac004870 2023-11-29T11:19:43.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.193+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4072500 con 0x7f4dac004870 2023-11-29T11:19:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.197+0000 7f4dc0ff9700 1 -- 172.21.15.81:0/1245329129 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4db8025070 con 0x7f4dac004870 2023-11-29T11:19:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.197+0000 7f4dc0ff9700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4db0064ee0 0x7f4db0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.197+0000 7f4dc0ff9700 1 -- 172.21.15.81:0/1245329129 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4db8082720 con 0x7f4dac004870 2023-11-29T11:19:43.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.197+0000 7f4dc37fe700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4db0064ee0 0x7f4db0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.197+0000 7f4dc37fe700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4db0064ee0 0x7f4db0067390 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40afb10 tx=0x7f4db400a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.205+0000 7f4dc0ff9700 1 -- 172.21.15.81:0/1245329129 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4db8050780 con 0x7f4dac004870 2023-11-29T11:19:43.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.369+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dc41f3540 con 0x7f4dac004870 2023-11-29T11:19:43.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.373+0000 7f4dc0ff9700 1 -- 172.21.15.81:0/1245329129 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17969 (secure 0 0 0) 0x7f4dc41f3540 con 0x7f4dac004870 2023-11-29T11:19:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:43.382 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":96,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:19:40.670291+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4db0064ee0 msgr2=0x7f4db0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4db0064ee0 0x7f4db0067390 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40afb10 tx=0x7f4db400a000 comp rx=0 tx=0).stop 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac004870 msgr2=0x7f4dc4069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac004870 0x7f4dc4069d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40b4430 tx=0x7f4db80117e0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 shutdown_connections 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4db0064ee0 0x7f4db0067390 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4dc415b5d0 0x7f4dc415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc41f2940 0x7f4dc41562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 --2- 172.21.15.81:0/1245329129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4dac004870 0x7f4dc4069d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 >> 172.21.15.81:0/1245329129 conn(0x7f4dc40ce3e0 msgr2=0x7f4dc40ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 shutdown_connections 2023-11-29T11:19:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.377+0000 7f4dc911e700 1 -- 172.21.15.81:0/1245329129 wait complete. 2023-11-29T11:19:43.401 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-29T11:19:43.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:19:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.509+0000 7f058b28d700 1 Processor -- start 2023-11-29T11:19:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.509+0000 7f058b28d700 1 -- start start 2023-11-29T11:19:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.509+0000 7f058b28d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05840cc730 0x7f05840ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.509+0000 7f058b28d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05840cd720 con 0x7f05841594f0 2023-11-29T11:19:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.509+0000 7f058b28d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05840cd990 con 0x7f058415d650 2023-11-29T11:19:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.509+0000 7f058b28d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05840cdc70 con 0x7f05840cc730 2023-11-29T11:19:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f05841594f0 0x7f0584159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33302/0 (socket says 172.21.15.81:33302) 2023-11-29T11:19:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 -- 172.21.15.81:0/3258933046 learned_addr learned my addr 172.21.15.81:0/3258933046 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589a8a700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05840cc730 0x7f05840ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325995890 0 0) 0x7f05840cd720 con 0x7f05841594f0 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f056c0035d0 con 0x7f05841594f0 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758680878 0 0) 0x7f056c0035d0 con 0x7f05841594f0 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05840cc730 msgr2=0x7f05840ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05840cc730 0x7f05840ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 >> v1:172.21.15.176:6789/0 conn(0x7f058415d650 legacy=0x7f05840cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05840cdf50 con 0x7f05841594f0 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f057c0019f0 con 0x7f05841594f0 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 >> v1:172.21.15.81:6789/0 conn(0x7f05841594f0 legacy=0x7f0584159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05840cc730 0x7f056c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056c003fd0 0x7f056c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f056c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05840cdc70 con 0x7f056c004db0 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c00bb10 con 0x7f056c003fd0 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c00bcd0 con 0x7f05840cc730 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f056c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589a8a700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056c003fd0 0x7f056c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058a28b700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05840cc730 0x7f056c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 -- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05840cc730 msgr2=0x7f056c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05840cc730 0x7f056c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 -- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056c003fd0 msgr2=0x7f056c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056c003fd0 0x7f056c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 -- 172.21.15.81:0/3258933046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0035d0 con 0x7f056c004db0 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f056c005220 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f057c00a800 tx=0x7f056c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a7cb7a81a388 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00a2f0 con 0x7f056c004db0 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c0072f0 con 0x7f056c004db0 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f0589289700 1 -- 172.21.15.81:0/3258933046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0076a0 con 0x7f056c004db0 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058b28d700 1 -- 172.21.15.81:0/3258933046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 msgr2=0x7f056c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058b28d700 1 --2- 172.21.15.81:0/3258933046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f056c005220 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f057c00a800 tx=0x7f056c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058aa8c700 1 -- 172.21.15.81:0/3258933046 reap_dead start 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058b28d700 1 -- 172.21.15.81:0/3258933046 shutdown_connections 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058b28d700 1 -- 172.21.15.81:0/3258933046 >> 172.21.15.81:0/3258933046 conn(0x7f058406ec40 msgr2=0x7f05840b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058b28d700 1 -- 172.21.15.81:0/3258933046 shutdown_connections 2023-11-29T11:19:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.513+0000 7f058b28d700 1 -- 172.21.15.81:0/3258933046 wait complete. 2023-11-29T11:19:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.517+0000 7f058b28d700 1 Processor -- start 2023-11-29T11:19:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.517+0000 7f058b28d700 1 -- start start 2023-11-29T11:19:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.517+0000 7f058b28d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f058406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.517+0000 7f058b28d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f058406aa10 0x7f05840ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.517+0000 7f058b28d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f058414b090 0x7f05840abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.517+0000 7f058b28d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058406b1e0 con 0x7f056c004db0 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058b28d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058414a320 con 0x7f058406aa10 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058b28d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058406af00 con 0x7f058414b090 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f058406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f058406a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46892/0 (socket says 172.21.15.81:46892) 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 -- 172.21.15.81:0/4178216745 learned_addr learned my addr 172.21.15.81:0/4178216745 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058aa8c700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f058414b090 0x7f05840abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f0589a8a700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f058406aa10 0x7f05840ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 -- 172.21.15.81:0/4178216745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f058414b090 msgr2=0x7f05840abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f058414b090 0x7f05840abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 -- 172.21.15.81:0/4178216745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f058406aa10 msgr2=0x7f05840ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f058406aa10 0x7f05840ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 -- 172.21.15.81:0/4178216745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05840ce470 con 0x7f056c004db0 2023-11-29T11:19:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058a28b700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f058406a4d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f057800e7b0 tx=0x7f057800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f0582ffd700 1 -- 172.21.15.81:0/4178216745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780052e0 con 0x7f056c004db0 2023-11-29T11:19:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f0582ffd700 1 -- 172.21.15.81:0/4178216745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578005460 con 0x7f056c004db0 2023-11-29T11:19:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058415a250 con 0x7f056c004db0 2023-11-29T11:19:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f0582ffd700 1 -- 172.21.15.81:0/4178216745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780038e0 con 0x7f056c004db0 2023-11-29T11:19:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05840ce600 con 0x7f056c004db0 2023-11-29T11:19:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0584072c20 con 0x7f056c004db0 2023-11-29T11:19:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f0582ffd700 1 -- 172.21.15.81:0/4178216745 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f057801b030 con 0x7f056c004db0 2023-11-29T11:19:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f0582ffd700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0570064f10 0x7f05700673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f0582ffd700 1 -- 172.21.15.81:0/4178216745 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0578081810 con 0x7f056c004db0 2023-11-29T11:19:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.521+0000 7f0589a8a700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0570064f10 0x7f05700673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.525+0000 7f0589a8a700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0570064f10 0x7f05700673c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f058414ea70 tx=0x7f0574008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.529+0000 7f0582ffd700 1 -- 172.21.15.81:0/4178216745 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f057804f780 con 0x7f056c004db0 2023-11-29T11:19:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.685+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05840cc480 con 0x7f0570064f10 2023-11-29T11:19:43.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.701+0000 7f0582ffd700 1 -- 172.21.15.81:0/4178216745 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310436 (secure 0 0 0) 0x7f05840cc480 con 0x7f0570064f10 2023-11-29T11:19:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0570064f10 msgr2=0x7f05700673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0570064f10 0x7f05700673c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f058414ea70 tx=0x7f0574008040 comp rx=0 tx=0).stop 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 msgr2=0x7f058406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f058406a4d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f057800e7b0 tx=0x7f057800eb70 comp rx=0 tx=0).stop 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 shutdown_connections 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0570064f10 0x7f05700673c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f058414b090 0x7f05840abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f058406aa10 0x7f05840ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 --2- 172.21.15.81:0/4178216745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c004db0 0x7f058406a4d0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 >> 172.21.15.81:0/4178216745 conn(0x7f058406ec40 msgr2=0x7f0584158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 shutdown_connections 2023-11-29T11:19:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.705+0000 7f058b28d700 1 -- 172.21.15.81:0/4178216745 wait complete. 2023-11-29T11:19:43.718 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:19:43.730 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2023-11-29T11:19:42.567923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":109716,"kb_used_data":10324,"kb_used_omap":0,"kb_used_meta":99328,"kb_avail":754865004,"statfs":{"total":773094113280,"available":772981764096,"internally_reserved":0,"allocated":10571776,"data_stored":5652844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101711872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.286062"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712571+0000","last_change":"2023-11-29T11:19:39.709221+0000","last_active":"2023-11-29T11:19:39.712571+0000","last_peered":"2023-11-29T11:19:39.712571+0000","last_clean":"2023-11-29T11:19:39.712571+0000","last_became_active":"2023-11-29T11:19:39.708908+0000","last_became_peered":"2023-11-29T11:19:39.708908+0000","last_unstale":"2023-11-29T11:19:39.712571+0000","last_undegraded":"2023-11-29T11:19:39.712571+0000","last_fullsized":"2023-11-29T11:19:39.712571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:59:20.144370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712316+0000","last_change":"2023-11-29T11:19:39.708495+0000","last_active":"2023-11-29T11:19:39.712316+0000","last_peered":"2023-11-29T11:19:39.712316+0000","last_clean":"2023-11-29T11:19:39.712316+0000","last_became_active":"2023-11-29T11:19:39.708185+0000","last_became_peered":"2023-11-29T11:19:39.708185+0000","last_unstale":"2023-11-29T11:19:39.712316+0000","last_undegraded":"2023-11-29T11:19:39.712316+0000","last_fullsized":"2023-11-29T11:19:39.712316+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:56:48.618768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712578+0000","last_change":"2023-11-29T11:19:39.708158+0000","last_active":"2023-11-29T11:19:39.712578+0000","last_peered":"2023-11-29T11:19:39.712578+0000","last_clean":"2023-11-29T11:19:39.712578+0000","last_became_active":"2023-11-29T11:19:39.707744+0000","last_became_peered":"2023-11-29T11:19:39.707744+0000","last_unstale":"2023-11-29T11:19:39.712578+0000","last_undegraded":"2023-11-29T11:19:39.712578+0000","last_fullsized":"2023-11-29T11:19:39.712578+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:18:46.229563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.702553+0000","last_change":"2023-11-29T11:19:39.696342+0000","last_active":"2023-11-29T11:19:39.702553+0000","last_peered":"2023-11-29T11:19:39.702553+0000","last_clean":"2023-11-29T11:19:39.702553+0000","last_became_active":"2023-11-29T11:19:39.696085+0000","last_became_peered":"2023-11-29T11:19:39.696085+0000","last_unstale":"2023-11-29T11:19:39.702553+0000","last_undegraded":"2023-11-29T11:19:39.702553+0000","last_fullsized":"2023-11-29T11:19:39.702553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:28:52.649116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710144+0000","last_change":"2023-11-29T11:19:39.704448+0000","last_active":"2023-11-29T11:19:39.710144+0000","last_peered":"2023-11-29T11:19:39.710144+0000","last_clean":"2023-11-29T11:19:39.710144+0000","last_became_active":"2023-11-29T11:19:39.704123+0000","last_became_peered":"2023-11-29T11:19:39.704123+0000","last_unstale":"2023-11-29T11:19:39.710144+0000","last_undegraded":"2023-11-29T11:19:39.710144+0000","last_fullsized":"2023-11-29T11:19:39.710144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:24:21.932785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711117+0000","last_change":"2023-11-29T11:19:39.707880+0000","last_active":"2023-11-29T11:19:39.711117+0000","last_peered":"2023-11-29T11:19:39.711117+0000","last_clean":"2023-11-29T11:19:39.711117+0000","last_became_active":"2023-11-29T11:19:39.707609+0000","last_became_peered":"2023-11-29T11:19:39.707609+0000","last_unstale":"2023-11-29T11:19:39.711117+0000","last_undegraded":"2023-11-29T11:19:39.711117+0000","last_fullsized":"2023-11-29T11:19:39.711117+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:28:52.649116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711101+0000","last_change":"2023-11-29T11:19:39.707855+0000","last_active":"2023-11-29T11:19:39.711101+0000","last_peered":"2023-11-29T11:19:39.711101+0000","last_clean":"2023-11-29T11:19:39.711101+0000","last_became_active":"2023-11-29T11:19:39.707579+0000","last_became_peered":"2023-11-29T11:19:39.707579+0000","last_unstale":"2023-11-29T11:19:39.711101+0000","last_undegraded":"2023-11-29T11:19:39.711101+0000","last_fullsized":"2023-11-29T11:19:39.711101+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:52:08.892399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708761+0000","last_change":"2023-11-29T11:19:39.701009+0000","last_active":"2023-11-29T11:19:39.708761+0000","last_peered":"2023-11-29T11:19:39.708761+0000","last_clean":"2023-11-29T11:19:39.708761+0000","last_became_active":"2023-11-29T11:19:39.700711+0000","last_became_peered":"2023-11-29T11:19:39.700711+0000","last_unstale":"2023-11-29T11:19:39.708761+0000","last_undegraded":"2023-11-29T11:19:39.708761+0000","last_fullsized":"2023-11-29T11:19:39.708761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:37:09.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700643+0000","last_change":"2023-11-29T11:19:39.695248+0000","last_active":"2023-11-29T11:19:39.700643+0000","last_peered":"2023-11-29T11:19:39.700643+0000","last_clean":"2023-11-29T11:19:39.700643+0000","last_became_active":"2023-11-29T11:19:39.694973+0000","last_became_peered":"2023-11-29T11:19:39.694973+0000","last_unstale":"2023-11-29T11:19:39.700643+0000","last_undegraded":"2023-11-29T11:19:39.700643+0000","last_fullsized":"2023-11-29T11:19:39.700643+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:47:29.321195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711099+0000","last_change":"2023-11-29T11:19:39.706956+0000","last_active":"2023-11-29T11:19:39.711099+0000","last_peered":"2023-11-29T11:19:39.711099+0000","last_clean":"2023-11-29T11:19:39.711099+0000","last_became_active":"2023-11-29T11:19:39.706667+0000","last_became_peered":"2023-11-29T11:19:39.706667+0000","last_unstale":"2023-11-29T11:19:39.711099+0000","last_undegraded":"2023-11-29T11:19:39.711099+0000","last_fullsized":"2023-11-29T11:19:39.711099+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:13:20.530039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.702856+0000","last_change":"2023-11-29T11:19:39.699221+0000","last_active":"2023-11-29T11:19:39.702856+0000","last_peered":"2023-11-29T11:19:39.702856+0000","last_clean":"2023-11-29T11:19:39.702856+0000","last_became_active":"2023-11-29T11:19:39.698331+0000","last_became_peered":"2023-11-29T11:19:39.698331+0000","last_unstale":"2023-11-29T11:19:39.702856+0000","last_undegraded":"2023-11-29T11:19:39.702856+0000","last_fullsized":"2023-11-29T11:19:39.702856+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:44.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.698060+0000","last_change":"2023-11-29T11:19:39.692833+0000","last_active":"2023-11-29T11:19:39.698060+0000","last_peered":"2023-11-29T11:19:39.698060+0000","last_clean":"2023-11-29T11:19:39.698060+0000","last_became_active":"2023-11-29T11:19:39.692321+0000","last_became_peered":"2023-11-29T11:19:39.692321+0000","last_unstale":"2023-11-29T11:19:39.698060+0000","last_undegraded":"2023-11-29T11:19:39.698060+0000","last_fullsized":"2023-11-29T11:19:39.698060+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:24.451446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.701332+0000","last_change":"2023-11-29T11:19:39.695633+0000","last_active":"2023-11-29T11:19:39.701332+0000","last_peered":"2023-11-29T11:19:39.701332+0000","last_clean":"2023-11-29T11:19:39.701332+0000","last_became_active":"2023-11-29T11:19:39.695389+0000","last_became_peered":"2023-11-29T11:19:39.695389+0000","last_unstale":"2023-11-29T11:19:39.701332+0000","last_undegraded":"2023-11-29T11:19:39.701332+0000","last_fullsized":"2023-11-29T11:19:39.701332+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:52:20.251497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703299+0000","last_change":"2023-11-29T11:19:39.698215+0000","last_active":"2023-11-29T11:19:39.703299+0000","last_peered":"2023-11-29T11:19:39.703299+0000","last_clean":"2023-11-29T11:19:39.703299+0000","last_became_active":"2023-11-29T11:19:39.697984+0000","last_became_peered":"2023-11-29T11:19:39.697984+0000","last_unstale":"2023-11-29T11:19:39.703299+0000","last_undegraded":"2023-11-29T11:19:39.703299+0000","last_fullsized":"2023-11-29T11:19:39.703299+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:49.828982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.698014+0000","last_change":"2023-11-29T11:19:39.693072+0000","last_active":"2023-11-29T11:19:39.698014+0000","last_peered":"2023-11-29T11:19:39.698014+0000","last_clean":"2023-11-29T11:19:39.698014+0000","last_became_active":"2023-11-29T11:19:39.692885+0000","last_became_peered":"2023-11-29T11:19:39.692885+0000","last_unstale":"2023-11-29T11:19:39.698014+0000","last_undegraded":"2023-11-29T11:19:39.698014+0000","last_fullsized":"2023-11-29T11:19:39.698014+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:33.512915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.705415+0000","last_change":"2023-11-29T11:19:39.703384+0000","last_active":"2023-11-29T11:19:39.705415+0000","last_peered":"2023-11-29T11:19:39.705415+0000","last_clean":"2023-11-29T11:19:39.705415+0000","last_became_active":"2023-11-29T11:19:39.703069+0000","last_became_peered":"2023-11-29T11:19:39.703069+0000","last_unstale":"2023-11-29T11:19:39.705415+0000","last_undegraded":"2023-11-29T11:19:39.705415+0000","last_fullsized":"2023-11-29T11:19:39.705415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:06:55.752556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704160+0000","last_change":"2023-11-29T11:19:39.696126+0000","last_active":"2023-11-29T11:19:39.704160+0000","last_peered":"2023-11-29T11:19:39.704160+0000","last_clean":"2023-11-29T11:19:39.704160+0000","last_became_active":"2023-11-29T11:19:39.695866+0000","last_became_peered":"2023-11-29T11:19:39.695866+0000","last_unstale":"2023-11-29T11:19:39.704160+0000","last_undegraded":"2023-11-29T11:19:39.704160+0000","last_fullsized":"2023-11-29T11:19:39.704160+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:59:01.297330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706733+0000","last_change":"2023-11-29T11:19:39.696635+0000","last_active":"2023-11-29T11:19:39.706733+0000","last_peered":"2023-11-29T11:19:39.706733+0000","last_clean":"2023-11-29T11:19:39.706733+0000","last_became_active":"2023-11-29T11:19:39.696362+0000","last_became_peered":"2023-11-29T11:19:39.696362+0000","last_unstale":"2023-11-29T11:19:39.706733+0000","last_undegraded":"2023-11-29T11:19:39.706733+0000","last_fullsized":"2023-11-29T11:19:39.706733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:53:44.192234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704012+0000","last_change":"2023-11-29T11:19:39.701360+0000","last_active":"2023-11-29T11:19:39.704012+0000","last_peered":"2023-11-29T11:19:39.704012+0000","last_clean":"2023-11-29T11:19:39.704012+0000","last_became_active":"2023-11-29T11:19:39.700973+0000","last_became_peered":"2023-11-29T11:19:39.700973+0000","last_unstale":"2023-11-29T11:19:39.704012+0000","last_undegraded":"2023-11-29T11:19:39.704012+0000","last_fullsized":"2023-11-29T11:19:39.704012+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:43:35.697373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700701+0000","last_change":"2023-11-29T11:19:39.696446+0000","last_active":"2023-11-29T11:19:39.700701+0000","last_peered":"2023-11-29T11:19:39.700701+0000","last_clean":"2023-11-29T11:19:39.700701+0000","last_became_active":"2023-11-29T11:19:39.696105+0000","last_became_peered":"2023-11-29T11:19:39.696105+0000","last_unstale":"2023-11-29T11:19:39.700701+0000","last_undegraded":"2023-11-29T11:19:39.700701+0000","last_fullsized":"2023-11-29T11:19:39.700701+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:33:18.369349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712503+0000","last_change":"2023-11-29T11:19:39.707943+0000","last_active":"2023-11-29T11:19:39.712503+0000","last_peered":"2023-11-29T11:19:39.712503+0000","last_clean":"2023-11-29T11:19:39.712503+0000","last_became_active":"2023-11-29T11:19:39.707650+0000","last_became_peered":"2023-11-29T11:19:39.707650+0000","last_unstale":"2023-11-29T11:19:39.712503+0000","last_undegraded":"2023-11-29T11:19:39.712503+0000","last_fullsized":"2023-11-29T11:19:39.712503+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:46:28.758774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708557+0000","last_change":"2023-11-29T11:19:39.701896+0000","last_active":"2023-11-29T11:19:39.708557+0000","last_peered":"2023-11-29T11:19:39.708557+0000","last_clean":"2023-11-29T11:19:39.708557+0000","last_became_active":"2023-11-29T11:19:39.701629+0000","last_became_peered":"2023-11-29T11:19:39.701629+0000","last_unstale":"2023-11-29T11:19:39.708557+0000","last_undegraded":"2023-11-29T11:19:39.708557+0000","last_fullsized":"2023-11-29T11:19:39.708557+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:10:03.559481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708591+0000","last_change":"2023-11-29T11:19:39.702146+0000","last_active":"2023-11-29T11:19:39.708591+0000","last_peered":"2023-11-29T11:19:39.708591+0000","last_clean":"2023-11-29T11:19:39.708591+0000","last_became_active":"2023-11-29T11:19:39.701879+0000","last_became_peered":"2023-11-29T11:19:39.701879+0000","last_unstale":"2023-11-29T11:19:39.708591+0000","last_undegraded":"2023-11-29T11:19:39.708591+0000","last_fullsized":"2023-11-29T11:19:39.708591+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:45:29.263997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.705045+0000","last_change":"2023-11-29T11:19:39.702107+0000","last_active":"2023-11-29T11:19:39.705045+0000","last_peered":"2023-11-29T11:19:39.705045+0000","last_clean":"2023-11-29T11:19:39.705045+0000","last_became_active":"2023-11-29T11:19:39.701854+0000","last_became_peered":"2023-11-29T11:19:39.701854+0000","last_unstale":"2023-11-29T11:19:39.705045+0000","last_undegraded":"2023-11-29T11:19:39.705045+0000","last_fullsized":"2023-11-29T11:19:39.705045+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:53:44.192234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712529+0000","last_change":"2023-11-29T11:19:39.711045+0000","last_active":"2023-11-29T11:19:39.712529+0000","last_peered":"2023-11-29T11:19:39.712529+0000","last_clean":"2023-11-29T11:19:39.712529+0000","last_became_active":"2023-11-29T11:19:39.710579+0000","last_became_peered":"2023-11-29T11:19:39.710579+0000","last_unstale":"2023-11-29T11:19:39.712529+0000","last_undegraded":"2023-11-29T11:19:39.712529+0000","last_fullsized":"2023-11-29T11:19:39.712529+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:19:30.903749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708436+0000","last_change":"2023-11-29T11:19:39.697616+0000","last_active":"2023-11-29T11:19:39.708436+0000","last_peered":"2023-11-29T11:19:39.708436+0000","last_clean":"2023-11-29T11:19:39.708436+0000","last_became_active":"2023-11-29T11:19:39.697077+0000","last_became_peered":"2023-11-29T11:19:39.697077+0000","last_unstale":"2023-11-29T11:19:39.708436+0000","last_undegraded":"2023-11-29T11:19:39.708436+0000","last_fullsized":"2023-11-29T11:19:39.708436+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:35:08.337704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.705824+0000","last_change":"2023-11-29T11:19:39.699994+0000","last_active":"2023-11-29T11:19:39.705824+0000","last_peered":"2023-11-29T11:19:39.705824+0000","last_clean":"2023-11-29T11:19:39.705824+0000","last_became_active":"2023-11-29T11:19:39.699447+0000","last_became_peered":"2023-11-29T11:19:39.699447+0000","last_unstale":"2023-11-29T11:19:39.705824+0000","last_undegraded":"2023-11-29T11:19:39.705824+0000","last_fullsized":"2023-11-29T11:19:39.705824+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:33.512915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711034+0000","last_change":"2023-11-29T11:19:39.706633+0000","last_active":"2023-11-29T11:19:39.711034+0000","last_peered":"2023-11-29T11:19:39.711034+0000","last_clean":"2023-11-29T11:19:39.711034+0000","last_became_active":"2023-11-29T11:19:39.706349+0000","last_became_peered":"2023-11-29T11:19:39.706349+0000","last_unstale":"2023-11-29T11:19:39.711034+0000","last_undegraded":"2023-11-29T11:19:39.711034+0000","last_fullsized":"2023-11-29T11:19:39.711034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:19:38.499483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703618+0000","last_change":"2023-11-29T11:19:39.694898+0000","last_active":"2023-11-29T11:19:39.703618+0000","last_peered":"2023-11-29T11:19:39.703618+0000","last_clean":"2023-11-29T11:19:39.703618+0000","last_became_active":"2023-11-29T11:19:39.691157+0000","last_became_peered":"2023-11-29T11:19:39.691157+0000","last_unstale":"2023-11-29T11:19:39.703618+0000","last_undegraded":"2023-11-29T11:19:39.703618+0000","last_fullsized":"2023-11-29T11:19:39.703618+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:53:42.215372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712379+0000","last_change":"2023-11-29T11:19:39.707782+0000","last_active":"2023-11-29T11:19:39.712379+0000","last_peered":"2023-11-29T11:19:39.712379+0000","last_clean":"2023-11-29T11:19:39.712379+0000","last_became_active":"2023-11-29T11:19:39.707499+0000","last_became_peered":"2023-11-29T11:19:39.707499+0000","last_unstale":"2023-11-29T11:19:39.712379+0000","last_undegraded":"2023-11-29T11:19:39.712379+0000","last_fullsized":"2023-11-29T11:19:39.712379+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:39.819430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706919+0000","last_change":"2023-11-29T11:19:39.698545+0000","last_active":"2023-11-29T11:19:39.706919+0000","last_peered":"2023-11-29T11:19:39.706919+0000","last_clean":"2023-11-29T11:19:39.706919+0000","last_became_active":"2023-11-29T11:19:39.698259+0000","last_became_peered":"2023-11-29T11:19:39.698259+0000","last_unstale":"2023-11-29T11:19:39.706919+0000","last_undegraded":"2023-11-29T11:19:39.706919+0000","last_fullsized":"2023-11-29T11:19:39.706919+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:52:08.892399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.709816+0000","last_change":"2023-11-29T11:19:39.704494+0000","last_active":"2023-11-29T11:19:39.709816+0000","last_peered":"2023-11-29T11:19:39.709816+0000","last_clean":"2023-11-29T11:19:39.709816+0000","last_became_active":"2023-11-29T11:19:39.704247+0000","last_became_peered":"2023-11-29T11:19:39.704247+0000","last_unstale":"2023-11-29T11:19:39.709816+0000","last_undegraded":"2023-11-29T11:19:39.709816+0000","last_fullsized":"2023-11-29T11:19:39.709816+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:30:15.497376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704062+0000","last_change":"2023-11-29T11:19:39.702930+0000","last_active":"2023-11-29T11:19:39.704062+0000","last_peered":"2023-11-29T11:19:39.704062+0000","last_clean":"2023-11-29T11:19:39.704062+0000","last_became_active":"2023-11-29T11:19:39.702663+0000","last_became_peered":"2023-11-29T11:19:39.702663+0000","last_unstale":"2023-11-29T11:19:39.704062+0000","last_undegraded":"2023-11-29T11:19:39.704062+0000","last_fullsized":"2023-11-29T11:19:39.704062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:50:13.599393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704110+0000","last_change":"2023-11-29T11:19:39.317536+0000","last_active":"2023-11-29T11:19:39.704110+0000","last_peered":"2023-11-29T11:19:39.704110+0000","last_clean":"2023-11-29T11:19:39.704110+0000","last_became_active":"2023-11-29T11:19:39.317252+0000","last_became_peered":"2023-11-29T11:19:39.317252+0000","last_unstale":"2023-11-29T11:19:39.704110+0000","last_undegraded":"2023-11-29T11:19:39.704110+0000","last_fullsized":"2023-11-29T11:19:39.704110+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:41:30.119883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706940+0000","last_change":"2023-11-29T11:19:39.698486+0000","last_active":"2023-11-29T11:19:39.706940+0000","last_peered":"2023-11-29T11:19:39.706940+0000","last_clean":"2023-11-29T11:19:39.706940+0000","last_became_active":"2023-11-29T11:19:39.698221+0000","last_became_peered":"2023-11-29T11:19:39.698221+0000","last_unstale":"2023-11-29T11:19:39.706940+0000","last_undegraded":"2023-11-29T11:19:39.706940+0000","last_fullsized":"2023-11-29T11:19:39.706940+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:13:21.910339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.699438+0000","last_change":"2023-11-29T11:19:39.322558+0000","last_active":"2023-11-29T11:19:39.699438+0000","last_peered":"2023-11-29T11:19:39.699438+0000","last_clean":"2023-11-29T11:19:39.699438+0000","last_became_active":"2023-11-29T11:19:39.321891+0000","last_became_peered":"2023-11-29T11:19:39.321891+0000","last_unstale":"2023-11-29T11:19:39.699438+0000","last_undegraded":"2023-11-29T11:19:39.699438+0000","last_fullsized":"2023-11-29T11:19:39.699438+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:50:41.776181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706956+0000","last_change":"2023-11-29T11:19:39.693284+0000","last_active":"2023-11-29T11:19:39.706956+0000","last_peered":"2023-11-29T11:19:39.706956+0000","last_clean":"2023-11-29T11:19:39.706956+0000","last_became_active":"2023-11-29T11:19:39.693016+0000","last_became_peered":"2023-11-29T11:19:39.693016+0000","last_unstale":"2023-11-29T11:19:39.706956+0000","last_undegraded":"2023-11-29T11:19:39.706956+0000","last_fullsized":"2023-11-29T11:19:39.706956+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:03:26.019133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703586+0000","last_change":"2023-11-29T11:19:39.319062+0000","last_active":"2023-11-29T11:19:39.703586+0000","last_peered":"2023-11-29T11:19:39.703586+0000","last_clean":"2023-11-29T11:19:39.703586+0000","last_became_active":"2023-11-29T11:19:39.318771+0000","last_became_peered":"2023-11-29T11:19:39.318771+0000","last_unstale":"2023-11-29T11:19:39.703586+0000","last_undegraded":"2023-11-29T11:19:39.703586+0000","last_fullsized":"2023-11-29T11:19:39.703586+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:20:30.749185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704117+0000","last_change":"2023-11-29T11:19:39.701173+0000","last_active":"2023-11-29T11:19:39.704117+0000","last_peered":"2023-11-29T11:19:39.704117+0000","last_clean":"2023-11-29T11:19:39.704117+0000","last_became_active":"2023-11-29T11:19:39.700364+0000","last_became_peered":"2023-11-29T11:19:39.700364+0000","last_unstale":"2023-11-29T11:19:39.704117+0000","last_undegraded":"2023-11-29T11:19:39.704117+0000","last_fullsized":"2023-11-29T11:19:39.704117+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:34:13.016538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703482+0000","last_change":"2023-11-29T11:19:39.317456+0000","last_active":"2023-11-29T11:19:39.703482+0000","last_peered":"2023-11-29T11:19:39.703482+0000","last_clean":"2023-11-29T11:19:39.703482+0000","last_became_active":"2023-11-29T11:19:39.317143+0000","last_became_peered":"2023-11-29T11:19:39.317143+0000","last_unstale":"2023-11-29T11:19:39.703482+0000","last_undegraded":"2023-11-29T11:19:39.703482+0000","last_fullsized":"2023-11-29T11:19:39.703482+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:24:22.376022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712343+0000","last_change":"2023-11-29T11:19:39.700375+0000","last_active":"2023-11-29T11:19:39.712343+0000","last_peered":"2023-11-29T11:19:39.712343+0000","last_clean":"2023-11-29T11:19:39.712343+0000","last_became_active":"2023-11-29T11:19:39.700103+0000","last_became_peered":"2023-11-29T11:19:39.700103+0000","last_unstale":"2023-11-29T11:19:39.712343+0000","last_undegraded":"2023-11-29T11:19:39.712343+0000","last_fullsized":"2023-11-29T11:19:39.712343+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:40:43.353758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700488+0000","last_change":"2023-11-29T11:19:39.323249+0000","last_active":"2023-11-29T11:19:39.700488+0000","last_peered":"2023-11-29T11:19:39.700488+0000","last_clean":"2023-11-29T11:19:39.700488+0000","last_became_active":"2023-11-29T11:19:39.322966+0000","last_became_peered":"2023-11-29T11:19:39.322966+0000","last_unstale":"2023-11-29T11:19:39.700488+0000","last_undegraded":"2023-11-29T11:19:39.700488+0000","last_fullsized":"2023-11-29T11:19:39.700488+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:37:53.098568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711585+0000","last_change":"2023-11-29T11:19:39.710439+0000","last_active":"2023-11-29T11:19:39.711585+0000","last_peered":"2023-11-29T11:19:39.711585+0000","last_clean":"2023-11-29T11:19:39.711585+0000","last_became_active":"2023-11-29T11:19:39.710169+0000","last_became_peered":"2023-11-29T11:19:39.710169+0000","last_unstale":"2023-11-29T11:19:39.711585+0000","last_undegraded":"2023-11-29T11:19:39.711585+0000","last_fullsized":"2023-11-29T11:19:39.711585+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:24:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703388+0000","last_change":"2023-11-29T11:19:39.325075+0000","last_active":"2023-11-29T11:19:39.703388+0000","last_peered":"2023-11-29T11:19:39.703388+0000","last_clean":"2023-11-29T11:19:39.703388+0000","last_became_active":"2023-11-29T11:19:39.324583+0000","last_became_peered":"2023-11-29T11:19:39.324583+0000","last_unstale":"2023-11-29T11:19:39.703388+0000","last_undegraded":"2023-11-29T11:19:39.703388+0000","last_fullsized":"2023-11-29T11:19:39.703388+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:06:54.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.709525+0000","last_change":"2023-11-29T11:19:39.701619+0000","last_active":"2023-11-29T11:19:39.709525+0000","last_peered":"2023-11-29T11:19:39.709525+0000","last_clean":"2023-11-29T11:19:39.709525+0000","last_became_active":"2023-11-29T11:19:39.701348+0000","last_became_peered":"2023-11-29T11:19:39.701348+0000","last_unstale":"2023-11-29T11:19:39.709525+0000","last_undegraded":"2023-11-29T11:19:39.709525+0000","last_fullsized":"2023-11-29T11:19:39.709525+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:24:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697318+0000","last_change":"2023-11-29T11:19:39.320961+0000","last_active":"2023-11-29T11:19:39.697318+0000","last_peered":"2023-11-29T11:19:39.697318+0000","last_clean":"2023-11-29T11:19:39.697318+0000","last_became_active":"2023-11-29T11:19:39.320684+0000","last_became_peered":"2023-11-29T11:19:39.320684+0000","last_unstale":"2023-11-29T11:19:39.697318+0000","last_undegraded":"2023-11-29T11:19:39.697318+0000","last_fullsized":"2023-11-29T11:19:39.697318+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:02:37.594540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704065+0000","last_change":"2023-11-29T11:19:39.701912+0000","last_active":"2023-11-29T11:19:39.704065+0000","last_peered":"2023-11-29T11:19:39.704065+0000","last_clean":"2023-11-29T11:19:39.704065+0000","last_became_active":"2023-11-29T11:19:39.701563+0000","last_became_peered":"2023-11-29T11:19:39.701563+0000","last_unstale":"2023-11-29T11:19:39.704065+0000","last_undegraded":"2023-11-29T11:19:39.704065+0000","last_fullsized":"2023-11-29T11:19:39.704065+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:33:20.535533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.683058+0000","last_change":"2023-11-29T11:19:39.327264+0000","last_active":"2023-11-29T11:19:39.683058+0000","last_peered":"2023-11-29T11:19:39.683058+0000","last_clean":"2023-11-29T11:19:39.683058+0000","last_became_active":"2023-11-29T11:19:39.326953+0000","last_became_peered":"2023-11-29T11:19:39.326953+0000","last_unstale":"2023-11-29T11:19:39.683058+0000","last_undegraded":"2023-11-29T11:19:39.683058+0000","last_fullsized":"2023-11-29T11:19:39.683058+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:48:29.242623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708459+0000","last_change":"2023-11-29T11:19:39.697773+0000","last_active":"2023-11-29T11:19:39.708459+0000","last_peered":"2023-11-29T11:19:39.708459+0000","last_clean":"2023-11-29T11:19:39.708459+0000","last_became_active":"2023-11-29T11:19:39.697361+0000","last_became_peered":"2023-11-29T11:19:39.697361+0000","last_unstale":"2023-11-29T11:19:39.708459+0000","last_undegraded":"2023-11-29T11:19:39.708459+0000","last_fullsized":"2023-11-29T11:19:39.708459+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:42.898869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.685385+0000","last_change":"2023-11-29T11:19:39.319821+0000","last_active":"2023-11-29T11:19:39.685385+0000","last_peered":"2023-11-29T11:19:39.685385+0000","last_clean":"2023-11-29T11:19:39.685385+0000","last_became_active":"2023-11-29T11:19:39.319562+0000","last_became_peered":"2023-11-29T11:19:39.319562+0000","last_unstale":"2023-11-29T11:19:39.685385+0000","last_undegraded":"2023-11-29T11:19:39.685385+0000","last_fullsized":"2023-11-29T11:19:39.685385+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:36:24.343676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704634+0000","last_change":"2023-11-29T11:19:39.702489+0000","last_active":"2023-11-29T11:19:39.704634+0000","last_peered":"2023-11-29T11:19:39.704634+0000","last_clean":"2023-11-29T11:19:39.704634+0000","last_became_active":"2023-11-29T11:19:39.702233+0000","last_became_peered":"2023-11-29T11:19:39.702233+0000","last_unstale":"2023-11-29T11:19:39.704634+0000","last_undegraded":"2023-11-29T11:19:39.704634+0000","last_fullsized":"2023-11-29T11:19:39.704634+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:26:28.412415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.688563+0000","last_change":"2023-11-29T11:19:39.329311+0000","last_active":"2023-11-29T11:19:39.688563+0000","last_peered":"2023-11-29T11:19:39.688563+0000","last_clean":"2023-11-29T11:19:39.688563+0000","last_became_active":"2023-11-29T11:19:39.328980+0000","last_became_peered":"2023-11-29T11:19:39.328980+0000","last_unstale":"2023-11-29T11:19:39.688563+0000","last_undegraded":"2023-11-29T11:19:39.688563+0000","last_fullsized":"2023-11-29T11:19:39.688563+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:13:43.988079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712067+0000","last_change":"2023-11-29T11:19:39.709652+0000","last_active":"2023-11-29T11:19:39.712067+0000","last_peered":"2023-11-29T11:19:39.712067+0000","last_clean":"2023-11-29T11:19:39.712067+0000","last_became_active":"2023-11-29T11:19:39.709315+0000","last_became_peered":"2023-11-29T11:19:39.709315+0000","last_unstale":"2023-11-29T11:19:39.712067+0000","last_undegraded":"2023-11-29T11:19:39.712067+0000","last_fullsized":"2023-11-29T11:19:39.712067+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:12:30.596743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700922+0000","last_change":"2023-11-29T11:19:39.316091+0000","last_active":"2023-11-29T11:19:39.700922+0000","last_peered":"2023-11-29T11:19:39.700922+0000","last_clean":"2023-11-29T11:19:39.700922+0000","last_became_active":"2023-11-29T11:19:39.315808+0000","last_became_peered":"2023-11-29T11:19:39.315808+0000","last_unstale":"2023-11-29T11:19:39.700922+0000","last_undegraded":"2023-11-29T11:19:39.700922+0000","last_fullsized":"2023-11-29T11:19:39.700922+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:19:36.802998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.705833+0000","last_change":"2023-11-29T11:19:39.703172+0000","last_active":"2023-11-29T11:19:39.705833+0000","last_peered":"2023-11-29T11:19:39.705833+0000","last_clean":"2023-11-29T11:19:39.705833+0000","last_became_active":"2023-11-29T11:19:39.702893+0000","last_became_peered":"2023-11-29T11:19:39.702893+0000","last_unstale":"2023-11-29T11:19:39.705833+0000","last_undegraded":"2023-11-29T11:19:39.705833+0000","last_fullsized":"2023-11-29T11:19:39.705833+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:20:31.761576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"95'6","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711714+0000","last_change":"2023-11-29T11:19:39.328852+0000","last_active":"2023-11-29T11:19:39.711714+0000","last_peered":"2023-11-29T11:19:39.711714+0000","last_clean":"2023-11-29T11:19:39.711714+0000","last_became_active":"2023-11-29T11:19:39.328553+0000","last_became_peered":"2023-11-29T11:19:39.328553+0000","last_unstale":"2023-11-29T11:19:39.711714+0000","last_undegraded":"2023-11-29T11:19:39.711714+0000","last_fullsized":"2023-11-29T11:19:39.711714+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:57.935119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.707109+0000","last_change":"2023-11-29T11:19:39.699823+0000","last_active":"2023-11-29T11:19:39.707109+0000","last_peered":"2023-11-29T11:19:39.707109+0000","last_clean":"2023-11-29T11:19:39.707109+0000","last_became_active":"2023-11-29T11:19:39.699586+0000","last_became_peered":"2023-11-29T11:19:39.699586+0000","last_unstale":"2023-11-29T11:19:39.707109+0000","last_undegraded":"2023-11-29T11:19:39.707109+0000","last_fullsized":"2023-11-29T11:19:39.707109+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:44.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.699767+0000","last_change":"2023-11-29T11:19:39.315276+0000","last_active":"2023-11-29T11:19:39.699767+0000","last_peered":"2023-11-29T11:19:39.699767+0000","last_clean":"2023-11-29T11:19:39.699767+0000","last_became_active":"2023-11-29T11:19:39.315006+0000","last_became_peered":"2023-11-29T11:19:39.315006+0000","last_unstale":"2023-11-29T11:19:39.699767+0000","last_undegraded":"2023-11-29T11:19:39.699767+0000","last_fullsized":"2023-11-29T11:19:39.699767+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:20.256819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.707249+0000","last_change":"2023-11-29T11:19:39.696121+0000","last_active":"2023-11-29T11:19:39.707249+0000","last_peered":"2023-11-29T11:19:39.707249+0000","last_clean":"2023-11-29T11:19:39.707249+0000","last_became_active":"2023-11-29T11:19:39.695852+0000","last_became_peered":"2023-11-29T11:19:39.695852+0000","last_unstale":"2023-11-29T11:19:39.707249+0000","last_undegraded":"2023-11-29T11:19:39.707249+0000","last_fullsized":"2023-11-29T11:19:39.707249+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:14.580406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.691436+0000","last_change":"2023-11-29T11:19:39.324198+0000","last_active":"2023-11-29T11:19:39.691436+0000","last_peered":"2023-11-29T11:19:39.691436+0000","last_clean":"2023-11-29T11:19:39.691436+0000","last_became_active":"2023-11-29T11:19:39.323671+0000","last_became_peered":"2023-11-29T11:19:39.323671+0000","last_unstale":"2023-11-29T11:19:39.691436+0000","last_undegraded":"2023-11-29T11:19:39.691436+0000","last_fullsized":"2023-11-29T11:19:39.691436+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:07:33.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704088+0000","last_change":"2023-11-29T11:19:39.701922+0000","last_active":"2023-11-29T11:19:39.704088+0000","last_peered":"2023-11-29T11:19:39.704088+0000","last_clean":"2023-11-29T11:19:39.704088+0000","last_became_active":"2023-11-29T11:19:39.701596+0000","last_became_peered":"2023-11-29T11:19:39.701596+0000","last_unstale":"2023-11-29T11:19:39.704088+0000","last_undegraded":"2023-11-29T11:19:39.704088+0000","last_fullsized":"2023-11-29T11:19:39.704088+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:39:07.979441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.678958+0000","last_change":"2023-11-29T11:19:39.315970+0000","last_active":"2023-11-29T11:19:39.678958+0000","last_peered":"2023-11-29T11:19:39.678958+0000","last_clean":"2023-11-29T11:19:39.678958+0000","last_became_active":"2023-11-29T11:19:39.315666+0000","last_became_peered":"2023-11-29T11:19:39.315666+0000","last_unstale":"2023-11-29T11:19:39.678958+0000","last_undegraded":"2023-11-29T11:19:39.678958+0000","last_fullsized":"2023-11-29T11:19:39.678958+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:45:29.716768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697719+0000","last_change":"2023-11-29T11:19:39.695698+0000","last_active":"2023-11-29T11:19:39.697719+0000","last_peered":"2023-11-29T11:19:39.697719+0000","last_clean":"2023-11-29T11:19:39.697719+0000","last_became_active":"2023-11-29T11:19:39.695397+0000","last_became_peered":"2023-11-29T11:19:39.695397+0000","last_unstale":"2023-11-29T11:19:39.697719+0000","last_undegraded":"2023-11-29T11:19:39.697719+0000","last_fullsized":"2023-11-29T11:19:39.697719+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:23:45.155334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"95'8","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.707084+0000","last_change":"2023-11-29T11:19:39.323993+0000","last_active":"2023-11-29T11:19:39.707084+0000","last_peered":"2023-11-29T11:19:39.707084+0000","last_clean":"2023-11-29T11:19:39.707084+0000","last_became_active":"2023-11-29T11:19:39.323675+0000","last_became_peered":"2023-11-29T11:19:39.323675+0000","last_unstale":"2023-11-29T11:19:39.707084+0000","last_undegraded":"2023-11-29T11:19:39.707084+0000","last_fullsized":"2023-11-29T11:19:39.707084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:56:30.353227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708574+0000","last_change":"2023-11-29T11:19:39.701754+0000","last_active":"2023-11-29T11:19:39.708574+0000","last_peered":"2023-11-29T11:19:39.708574+0000","last_clean":"2023-11-29T11:19:39.708574+0000","last_became_active":"2023-11-29T11:19:39.701496+0000","last_became_peered":"2023-11-29T11:19:39.701496+0000","last_unstale":"2023-11-29T11:19:39.708574+0000","last_undegraded":"2023-11-29T11:19:39.708574+0000","last_fullsized":"2023-11-29T11:19:39.708574+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:43:36.195739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706514+0000","last_change":"2023-11-29T11:19:39.314707+0000","last_active":"2023-11-29T11:19:39.706514+0000","last_peered":"2023-11-29T11:19:39.706514+0000","last_clean":"2023-11-29T11:19:39.706514+0000","last_became_active":"2023-11-29T11:19:39.314326+0000","last_became_peered":"2023-11-29T11:19:39.314326+0000","last_unstale":"2023-11-29T11:19:39.706514+0000","last_undegraded":"2023-11-29T11:19:39.706514+0000","last_fullsized":"2023-11-29T11:19:39.706514+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:45:37.319157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.707250+0000","last_change":"2023-11-29T11:19:39.699046+0000","last_active":"2023-11-29T11:19:39.707250+0000","last_peered":"2023-11-29T11:19:39.707250+0000","last_clean":"2023-11-29T11:19:39.707250+0000","last_became_active":"2023-11-29T11:19:39.696482+0000","last_became_peered":"2023-11-29T11:19:39.696482+0000","last_unstale":"2023-11-29T11:19:39.707250+0000","last_undegraded":"2023-11-29T11:19:39.707250+0000","last_fullsized":"2023-11-29T11:19:39.707250+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:08:37.802477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:40.163397+0000","last_change":"2023-11-29T11:19:39.319093+0000","last_active":"2023-11-29T11:19:40.163397+0000","last_peered":"2023-11-29T11:19:40.163397+0000","last_clean":"2023-11-29T11:19:40.163397+0000","last_became_active":"2023-11-29T11:19:39.318807+0000","last_became_peered":"2023-11-29T11:19:39.318807+0000","last_unstale":"2023-11-29T11:19:40.163397+0000","last_undegraded":"2023-11-29T11:19:40.163397+0000","last_fullsized":"2023-11-29T11:19:40.163397+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:32.500524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.718134+0000","last_change":"2023-11-29T11:19:39.710456+0000","last_active":"2023-11-29T11:19:39.718134+0000","last_peered":"2023-11-29T11:19:39.718134+0000","last_clean":"2023-11-29T11:19:39.718134+0000","last_became_active":"2023-11-29T11:19:39.710234+0000","last_became_peered":"2023-11-29T11:19:39.710234+0000","last_unstale":"2023-11-29T11:19:39.718134+0000","last_undegraded":"2023-11-29T11:19:39.718134+0000","last_fullsized":"2023-11-29T11:19:39.718134+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:50:26.530550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.678208+0000","last_change":"2023-11-29T11:19:39.317488+0000","last_active":"2023-11-29T11:19:39.678208+0000","last_peered":"2023-11-29T11:19:39.678208+0000","last_clean":"2023-11-29T11:19:39.678208+0000","last_became_active":"2023-11-29T11:19:39.317179+0000","last_became_peered":"2023-11-29T11:19:39.317179+0000","last_unstale":"2023-11-29T11:19:39.678208+0000","last_undegraded":"2023-11-29T11:19:39.678208+0000","last_fullsized":"2023-11-29T11:19:39.678208+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:43.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710134+0000","last_change":"2023-11-29T11:19:39.704280+0000","last_active":"2023-11-29T11:19:39.710134+0000","last_peered":"2023-11-29T11:19:39.710134+0000","last_clean":"2023-11-29T11:19:39.710134+0000","last_became_active":"2023-11-29T11:19:39.703948+0000","last_became_peered":"2023-11-29T11:19:39.703948+0000","last_unstale":"2023-11-29T11:19:39.710134+0000","last_undegraded":"2023-11-29T11:19:39.710134+0000","last_fullsized":"2023-11-29T11:19:39.710134+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:02:28.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697575+0000","last_change":"2023-11-29T11:19:39.316601+0000","last_active":"2023-11-29T11:19:39.697575+0000","last_peered":"2023-11-29T11:19:39.697575+0000","last_clean":"2023-11-29T11:19:39.697575+0000","last_became_active":"2023-11-29T11:19:39.316330+0000","last_became_peered":"2023-11-29T11:19:39.316330+0000","last_unstale":"2023-11-29T11:19:39.697575+0000","last_undegraded":"2023-11-29T11:19:39.697575+0000","last_fullsized":"2023-11-29T11:19:39.697575+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:35:27.590686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703281+0000","last_change":"2023-11-29T11:19:39.697690+0000","last_active":"2023-11-29T11:19:39.703281+0000","last_peered":"2023-11-29T11:19:39.703281+0000","last_clean":"2023-11-29T11:19:39.703281+0000","last_became_active":"2023-11-29T11:19:39.697418+0000","last_became_peered":"2023-11-29T11:19:39.697418+0000","last_unstale":"2023-11-29T11:19:39.703281+0000","last_undegraded":"2023-11-29T11:19:39.703281+0000","last_fullsized":"2023-11-29T11:19:39.703281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:18:16.246588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.677699+0000","last_change":"2023-11-29T11:19:39.327095+0000","last_active":"2023-11-29T11:19:39.677699+0000","last_peered":"2023-11-29T11:19:39.677699+0000","last_clean":"2023-11-29T11:19:39.677699+0000","last_became_active":"2023-11-29T11:19:39.326811+0000","last_became_peered":"2023-11-29T11:19:39.326811+0000","last_unstale":"2023-11-29T11:19:39.677699+0000","last_undegraded":"2023-11-29T11:19:39.677699+0000","last_fullsized":"2023-11-29T11:19:39.677699+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:17:50.466008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711558+0000","last_change":"2023-11-29T11:19:39.709856+0000","last_active":"2023-11-29T11:19:39.711558+0000","last_peered":"2023-11-29T11:19:39.711558+0000","last_clean":"2023-11-29T11:19:39.711558+0000","last_became_active":"2023-11-29T11:19:39.709573+0000","last_became_peered":"2023-11-29T11:19:39.709573+0000","last_unstale":"2023-11-29T11:19:39.711558+0000","last_undegraded":"2023-11-29T11:19:39.711558+0000","last_fullsized":"2023-11-29T11:19:39.711558+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:03:42.689092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697458+0000","last_change":"2023-11-29T11:19:39.322905+0000","last_active":"2023-11-29T11:19:39.697458+0000","last_peered":"2023-11-29T11:19:39.697458+0000","last_clean":"2023-11-29T11:19:39.697458+0000","last_became_active":"2023-11-29T11:19:39.322653+0000","last_became_peered":"2023-11-29T11:19:39.322653+0000","last_unstale":"2023-11-29T11:19:39.697458+0000","last_undegraded":"2023-11-29T11:19:39.697458+0000","last_fullsized":"2023-11-29T11:19:39.697458+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:10:50.986147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697263+0000","last_change":"2023-11-29T11:19:39.692387+0000","last_active":"2023-11-29T11:19:39.697263+0000","last_peered":"2023-11-29T11:19:39.697263+0000","last_clean":"2023-11-29T11:19:39.697263+0000","last_became_active":"2023-11-29T11:19:39.692127+0000","last_became_peered":"2023-11-29T11:19:39.692127+0000","last_unstale":"2023-11-29T11:19:39.697263+0000","last_undegraded":"2023-11-29T11:19:39.697263+0000","last_fullsized":"2023-11-29T11:19:39.697263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:01:28.008645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.683697+0000","last_change":"2023-11-29T11:19:39.323801+0000","last_active":"2023-11-29T11:19:39.683697+0000","last_peered":"2023-11-29T11:19:39.683697+0000","last_clean":"2023-11-29T11:19:39.683697+0000","last_became_active":"2023-11-29T11:19:39.323469+0000","last_became_peered":"2023-11-29T11:19:39.323469+0000","last_unstale":"2023-11-29T11:19:39.683697+0000","last_undegraded":"2023-11-29T11:19:39.683697+0000","last_fullsized":"2023-11-29T11:19:39.683697+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:13:11.518007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710107+0000","last_change":"2023-11-29T11:19:39.704150+0000","last_active":"2023-11-29T11:19:39.710107+0000","last_peered":"2023-11-29T11:19:39.710107+0000","last_clean":"2023-11-29T11:19:39.710107+0000","last_became_active":"2023-11-29T11:19:39.703829+0000","last_became_peered":"2023-11-29T11:19:39.703829+0000","last_unstale":"2023-11-29T11:19:39.710107+0000","last_undegraded":"2023-11-29T11:19:39.710107+0000","last_fullsized":"2023-11-29T11:19:39.710107+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:21:28.319281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.687878+0000","last_change":"2023-11-29T11:19:39.321101+0000","last_active":"2023-11-29T11:19:39.687878+0000","last_peered":"2023-11-29T11:19:39.687878+0000","last_clean":"2023-11-29T11:19:39.687878+0000","last_became_active":"2023-11-29T11:19:39.320816+0000","last_became_peered":"2023-11-29T11:19:39.320816+0000","last_unstale":"2023-11-29T11:19:39.687878+0000","last_undegraded":"2023-11-29T11:19:39.687878+0000","last_fullsized":"2023-11-29T11:19:39.687878+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:20:42.513781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711026+0000","last_change":"2023-11-29T11:19:39.706746+0000","last_active":"2023-11-29T11:19:39.711026+0000","last_peered":"2023-11-29T11:19:39.711026+0000","last_clean":"2023-11-29T11:19:39.711026+0000","last_became_active":"2023-11-29T11:19:39.706472+0000","last_became_peered":"2023-11-29T11:19:39.706472+0000","last_unstale":"2023-11-29T11:19:39.711026+0000","last_undegraded":"2023-11-29T11:19:39.711026+0000","last_fullsized":"2023-11-29T11:19:39.711026+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:45:53.563342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.676289+0000","last_change":"2023-11-29T11:19:39.325294+0000","last_active":"2023-11-29T11:19:39.676289+0000","last_peered":"2023-11-29T11:19:39.676289+0000","last_clean":"2023-11-29T11:19:39.676289+0000","last_became_active":"2023-11-29T11:19:39.325012+0000","last_became_peered":"2023-11-29T11:19:39.325012+0000","last_unstale":"2023-11-29T11:19:39.676289+0000","last_undegraded":"2023-11-29T11:19:39.676289+0000","last_fullsized":"2023-11-29T11:19:39.676289+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:28:51.636725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":78,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.310186+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:19:39.310186+0000","last_peered":"2023-11-29T11:19:39.310186+0000","last_clean":"2023-11-29T11:19:39.310186+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:19:39.310186+0000","last_undegraded":"2023-11-29T11:19:39.310186+0000","last_fullsized":"2023-11-29T11:19:39.310186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.698522+0000","last_change":"2023-11-29T11:19:39.696081+0000","last_active":"2023-11-29T11:19:39.698522+0000","last_peered":"2023-11-29T11:19:39.698522+0000","last_clean":"2023-11-29T11:19:39.698522+0000","last_became_active":"2023-11-29T11:19:39.695823+0000","last_became_peered":"2023-11-29T11:19:39.695823+0000","last_unstale":"2023-11-29T11:19:39.698522+0000","last_undegraded":"2023-11-29T11:19:39.698522+0000","last_fullsized":"2023-11-29T11:19:39.698522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:46:53.636825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.684502+0000","last_change":"2023-11-29T11:19:39.321311+0000","last_active":"2023-11-29T11:19:39.684502+0000","last_peered":"2023-11-29T11:19:39.684502+0000","last_clean":"2023-11-29T11:19:39.684502+0000","last_became_active":"2023-11-29T11:19:39.321046+0000","last_became_peered":"2023-11-29T11:19:39.321046+0000","last_unstale":"2023-11-29T11:19:39.684502+0000","last_undegraded":"2023-11-29T11:19:39.684502+0000","last_fullsized":"2023-11-29T11:19:39.684502+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:25:02.516746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":79,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.309345+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:19:39.309345+0000","last_peered":"2023-11-29T11:19:39.309345+0000","last_clean":"2023-11-29T11:19:39.309345+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:19:39.309345+0000","last_undegraded":"2023-11-29T11:19:39.309345+0000","last_fullsized":"2023-11-29T11:19:39.309345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.709716+0000","last_change":"2023-11-29T11:19:39.704271+0000","last_active":"2023-11-29T11:19:39.709716+0000","last_peered":"2023-11-29T11:19:39.709716+0000","last_clean":"2023-11-29T11:19:39.709716+0000","last_became_active":"2023-11-29T11:19:39.703968+0000","last_became_peered":"2023-11-29T11:19:39.703968+0000","last_unstale":"2023-11-29T11:19:39.709716+0000","last_undegraded":"2023-11-29T11:19:39.709716+0000","last_fullsized":"2023-11-29T11:19:39.709716+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:37:23.247809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.684598+0000","last_change":"2023-11-29T11:19:39.322528+0000","last_active":"2023-11-29T11:19:39.684598+0000","last_peered":"2023-11-29T11:19:39.684598+0000","last_clean":"2023-11-29T11:19:39.684598+0000","last_became_active":"2023-11-29T11:19:39.322275+0000","last_became_peered":"2023-11-29T11:19:39.322275+0000","last_unstale":"2023-11-29T11:19:39.684598+0000","last_undegraded":"2023-11-29T11:19:39.684598+0000","last_fullsized":"2023-11-29T11:19:39.684598+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:28:23.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":79,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.306874+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:19:39.306874+0000","last_peered":"2023-11-29T11:19:39.306874+0000","last_clean":"2023-11-29T11:19:39.306874+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:19:39.306874+0000","last_undegraded":"2023-11-29T11:19:39.306874+0000","last_fullsized":"2023-11-29T11:19:39.306874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703313+0000","last_change":"2023-11-29T11:19:39.698598+0000","last_active":"2023-11-29T11:19:39.703313+0000","last_peered":"2023-11-29T11:19:39.703313+0000","last_clean":"2023-11-29T11:19:39.703313+0000","last_became_active":"2023-11-29T11:19:39.698372+0000","last_became_peered":"2023-11-29T11:19:39.698372+0000","last_unstale":"2023-11-29T11:19:39.703313+0000","last_undegraded":"2023-11-29T11:19:39.703313+0000","last_fullsized":"2023-11-29T11:19:39.703313+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:01:10.920439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703551+0000","last_change":"2023-11-29T11:19:39.318664+0000","last_active":"2023-11-29T11:19:39.703551+0000","last_peered":"2023-11-29T11:19:39.703551+0000","last_clean":"2023-11-29T11:19:39.703551+0000","last_became_active":"2023-11-29T11:19:39.318200+0000","last_became_peered":"2023-11-29T11:19:39.318200+0000","last_unstale":"2023-11-29T11:19:39.703551+0000","last_undegraded":"2023-11-29T11:19:39.703551+0000","last_fullsized":"2023-11-29T11:19:39.703551+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:59:44.950290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.322452+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:19:39.322452+0000","last_peered":"2023-11-29T11:19:39.322452+0000","last_clean":"2023-11-29T11:19:39.322452+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:19:39.322452+0000","last_undegraded":"2023-11-29T11:19:39.322452+0000","last_fullsized":"2023-11-29T11:19:39.322452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.702875+0000","last_change":"2023-11-29T11:19:39.699703+0000","last_active":"2023-11-29T11:19:39.702875+0000","last_peered":"2023-11-29T11:19:39.702875+0000","last_clean":"2023-11-29T11:19:39.702875+0000","last_became_active":"2023-11-29T11:19:39.698990+0000","last_became_peered":"2023-11-29T11:19:39.698990+0000","last_unstale":"2023-11-29T11:19:39.702875+0000","last_undegraded":"2023-11-29T11:19:39.702875+0000","last_fullsized":"2023-11-29T11:19:39.702875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:03:25.912654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.677301+0000","last_change":"2023-11-29T11:19:39.318344+0000","last_active":"2023-11-29T11:19:39.677301+0000","last_peered":"2023-11-29T11:19:39.677301+0000","last_clean":"2023-11-29T11:19:39.677301+0000","last_became_active":"2023-11-29T11:19:39.318084+0000","last_became_peered":"2023-11-29T11:19:39.318084+0000","last_unstale":"2023-11-29T11:19:39.677301+0000","last_undegraded":"2023-11-29T11:19:39.677301+0000","last_fullsized":"2023-11-29T11:19:39.677301+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:03:24.900263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":231,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.308767+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:19:39.308767+0000","last_peered":"2023-11-29T11:19:39.308767+0000","last_clean":"2023-11-29T11:19:39.308767+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:19:39.308767+0000","last_undegraded":"2023-11-29T11:19:39.308767+0000","last_fullsized":"2023-11-29T11:19:39.308767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":81,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.316609+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:19:39.316609+0000","last_peered":"2023-11-29T11:19:39.316609+0000","last_clean":"2023-11-29T11:19:39.316609+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:19:39.316609+0000","last_undegraded":"2023-11-29T11:19:39.316609+0000","last_fullsized":"2023-11-29T11:19:39.316609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.713471+0000","last_change":"2023-11-29T11:19:39.707564+0000","last_active":"2023-11-29T11:19:39.713471+0000","last_peered":"2023-11-29T11:19:39.713471+0000","last_clean":"2023-11-29T11:19:39.713471+0000","last_became_active":"2023-11-29T11:19:39.707294+0000","last_became_peered":"2023-11-29T11:19:39.707294+0000","last_unstale":"2023-11-29T11:19:39.713471+0000","last_undegraded":"2023-11-29T11:19:39.713471+0000","last_fullsized":"2023-11-29T11:19:39.713471+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:40:03.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710061+0000","last_change":"2023-11-29T11:19:39.317111+0000","last_active":"2023-11-29T11:19:39.710061+0000","last_peered":"2023-11-29T11:19:39.710061+0000","last_clean":"2023-11-29T11:19:39.710061+0000","last_became_active":"2023-11-29T11:19:39.316851+0000","last_became_peered":"2023-11-29T11:19:39.316851+0000","last_unstale":"2023-11-29T11:19:39.710061+0000","last_undegraded":"2023-11-29T11:19:39.710061+0000","last_fullsized":"2023-11-29T11:19:39.710061+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:17:22.251002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":82,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.309674+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:19:39.309674+0000","last_peered":"2023-11-29T11:19:39.309674+0000","last_clean":"2023-11-29T11:19:39.309674+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:19:39.309674+0000","last_undegraded":"2023-11-29T11:19:39.309674+0000","last_fullsized":"2023-11-29T11:19:39.309674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710913+0000","last_change":"2023-11-29T11:19:39.706353+0000","last_active":"2023-11-29T11:19:39.710913+0000","last_peered":"2023-11-29T11:19:39.710913+0000","last_clean":"2023-11-29T11:19:39.710913+0000","last_became_active":"2023-11-29T11:19:39.705938+0000","last_became_peered":"2023-11-29T11:19:39.705938+0000","last_unstale":"2023-11-29T11:19:39.710913+0000","last_undegraded":"2023-11-29T11:19:39.710913+0000","last_fullsized":"2023-11-29T11:19:39.710913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:59.193925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.698151+0000","last_change":"2023-11-29T11:19:39.318235+0000","last_active":"2023-11-29T11:19:39.698151+0000","last_peered":"2023-11-29T11:19:39.698151+0000","last_clean":"2023-11-29T11:19:39.698151+0000","last_became_active":"2023-11-29T11:19:39.317875+0000","last_became_peered":"2023-11-29T11:19:39.317875+0000","last_unstale":"2023-11-29T11:19:39.698151+0000","last_undegraded":"2023-11-29T11:19:39.698151+0000","last_fullsized":"2023-11-29T11:19:39.698151+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:10:02.547090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":89,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.302645+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:19:39.302645+0000","last_peered":"2023-11-29T11:19:39.302645+0000","last_clean":"2023-11-29T11:19:39.302645+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:19:39.302645+0000","last_undegraded":"2023-11-29T11:19:39.302645+0000","last_fullsized":"2023-11-29T11:19:39.302645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700417+0000","last_change":"2023-11-29T11:19:39.697039+0000","last_active":"2023-11-29T11:19:39.700417+0000","last_peered":"2023-11-29T11:19:39.700417+0000","last_clean":"2023-11-29T11:19:39.700417+0000","last_became_active":"2023-11-29T11:19:39.696776+0000","last_became_peered":"2023-11-29T11:19:39.696776+0000","last_unstale":"2023-11-29T11:19:39.700417+0000","last_undegraded":"2023-11-29T11:19:39.700417+0000","last_fullsized":"2023-11-29T11:19:39.700417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:36:54.380565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700236+0000","last_change":"2023-11-29T11:19:39.325886+0000","last_active":"2023-11-29T11:19:39.700236+0000","last_peered":"2023-11-29T11:19:39.700236+0000","last_clean":"2023-11-29T11:19:39.700236+0000","last_became_active":"2023-11-29T11:19:39.325676+0000","last_became_peered":"2023-11-29T11:19:39.325676+0000","last_unstale":"2023-11-29T11:19:39.700236+0000","last_undegraded":"2023-11-29T11:19:39.700236+0000","last_fullsized":"2023-11-29T11:19:39.700236+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:17:56.622855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":82,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.308844+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:19:39.308844+0000","last_peered":"2023-11-29T11:19:39.308844+0000","last_clean":"2023-11-29T11:19:39.308844+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:19:39.308844+0000","last_undegraded":"2023-11-29T11:19:39.308844+0000","last_fullsized":"2023-11-29T11:19:39.308844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542229,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11912,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":10176,"kb_avail":94359928,"statfs":{"total":96636764160,"available":96624566272,"internally_reserved":0,"allocated":1769472,"data_stored":1149974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10420224},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.214,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83299999999999996,"15min":0.82499999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1100000000000001,"5min":1.327,"15min":1.327},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.89200000000000002,"15min":0.90500000000000003},"min":{"1min":0.59999999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.242,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.89800000000000002},"min":{"1min":0.623,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1080000000000001,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":1.111}]},{"osd":2,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97999999999999998,"15min":1.014},"min":{"1min":0.76200000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.254,"5min":1.4850000000000001,"15min":1.8009999999999999},"last":1.012},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.93200000000000005,"15min":0.97299999999999998},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92500000000000004,"15min":0.96499999999999997},"min":{"1min":0.82699999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.294,"5min":1.667,"15min":1.667},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91800000000000004,"15min":0.96499999999999997},"min":{"1min":0.68799999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.111,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81699999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86199999999999999,"15min":0.95999999999999996},"min":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.194,"5min":1.446,"15min":1.446},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.01,"5min":1.0109999999999999,"15min":1.069},"min":{"1min":0.63700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.389,"5min":1.736,"15min":1.736},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":1.0940000000000001},"min":{"1min":0.65200000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3100000000000001,"5min":2.403,"15min":2.403},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.034,"5min":1.0329999999999999,"15min":1.119},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4239999999999999,"5min":1.53,"15min":1.53},"last":1.0700000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.052,"15min":1.1539999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.339,"5min":1.708,"15min":1.7230000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.153,"5min":1.1379999999999999,"15min":1.1899999999999999},"min":{"1min":1.0129999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5600000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.1359999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14916,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356924,"statfs":{"total":96636764160,"available":96621490176,"internally_reserved":0,"allocated":1175552,"data_stored":560130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1910000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":0.83699999999999997},"min":{"1min":0.53200000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.1859999999999999,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":1.089}]},{"osd":1,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91200000000000003,"15min":0.92100000000000004},"min":{"1min":0.56200000000000006,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0429999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.038},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.0369999999999999,"15min":0.96599999999999997},"min":{"1min":0.71699999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1830000000000001,"5min":7.8479999999999999,"15min":7.8479999999999999},"last":0.96199999999999997}]},{"osd":2,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.071,"5min":1.369,"15min":1.369},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.92300000000000004,"15min":0.90300000000000002},"min":{"1min":0.59499999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.107,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.997,"15min":0.93700000000000006},"min":{"1min":0.66100000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.236,"5min":7.923,"15min":7.923},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93300000000000005,"15min":0.93100000000000005},"min":{"1min":0.80500000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.99399999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91000000000000003,"15min":0.92200000000000004},"min":{"1min":0.60599999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.161,"5min":2.746,"15min":2.746},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0489999999999999,"15min":0.998},"min":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2410000000000001,"5min":7.9569999999999999,"15min":7.9569999999999999},"last":1.1830000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89500000000000002,"15min":0.89700000000000002},"min":{"1min":0.69699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.135,"5min":1.26,"15min":1.26},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0469999999999999,"15min":1.0589999999999999},"min":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2370000000000001,"5min":1.593,"15min":1.593},"last":1.1299999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1120000000000001,"15min":1.0980000000000001},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.288,"5min":8.0060000000000002,"15min":8.0060000000000002},"last":1.254},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.1259999999999999,"15min":1.1000000000000001},"min":{"1min":0.86399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2110000000000001,"5min":7.5730000000000004,"15min":7.5730000000000004},"last":1.0660000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542229,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14768,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94357072,"statfs":{"total":96636764160,"available":96621641728,"internally_reserved":0,"allocated":1155072,"data_stored":552046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.218,"5min":1.242,"15min":1.242},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.65900000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1799999999999999,"5min":1.52,"15min":1.52},"last":0.92400000000000004}]},{"osd":1,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.92600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2350000000000001,"5min":1.512,"15min":1.512},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.84699999999999998,"15min":0.88200000000000001},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0700000000000001,"5min":1.377,"15min":1.377},"last":1.091}]},{"osd":2,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.86599999999999999,"15min":0.877},"min":{"1min":0.74099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.115,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92200000000000004,"15min":0.94699999999999995},"min":{"1min":0.748,"5min":0.55300000000000005,"15min":0.51500000000000001},"max":{"1min":1.141,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.016}]},{"osd":3,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91700000000000004,"15min":0.90300000000000002},"min":{"1min":0.66800000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.004,"15min":1.0069999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.196,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.67600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.143,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.008,"5min":1.006,"15min":1.0600000000000001},"min":{"1min":0.72299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2609999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.153}]},{"osd":6,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0049999999999999,"15min":1.0489999999999999},"min":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.155,"5min":1.585,"15min":1.585},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0149999999999999,"15min":1.044},"min":{"1min":0.82599999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2350000000000001,"5min":1.4870000000000001,"15min":1.575},"last":1.1339999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.101,"15min":1.097},"min":{"1min":0.80100000000000005,"5min":0.77900000000000003,"15min":0.58199999999999996},"max":{"1min":1.3120000000000001,"5min":1.6379999999999999,"15min":1.6419999999999999},"last":1.107},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.129,"15min":1.1839999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.208,"5min":1.6779999999999999,"15min":1.889},"last":1.0740000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542229,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11024,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":9856,"kb_avail":94360816,"statfs":{"total":96636764160,"available":96625475584,"internally_reserved":0,"allocated":1187840,"data_stored":561166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10092544},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.431},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83999999999999997,"15min":0.84599999999999997},"min":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.49399999999999999},"max":{"1min":1.1220000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90700000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.88300000000000001,"15min":0.88800000000000001},"min":{"1min":0.68700000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.2450000000000001,"5min":1.458,"15min":1.458},"last":1.052},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.90700000000000003,"15min":0.88700000000000001},"min":{"1min":0.79900000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.1870000000000001,"15min":1.401},"last":1.0289999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.67100000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.97099999999999997},"min":{"1min":0.66300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.2430000000000001,"5min":1.343,"15min":1.343},"last":1.077}]},{"osd":3,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.65300000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.1659999999999999,"5min":1.294,"15min":1.294},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.96299999999999997,"15min":1.0129999999999999},"min":{"1min":0.81499999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1919999999999999,"5min":1.536,"15min":1.8160000000000001},"last":0.751}]},{"osd":5,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95299999999999996,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.59099999999999997},"max":{"1min":1.3919999999999999,"5min":1.492,"15min":1.492},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97799999999999998,"15min":0.96899999999999997},"min":{"1min":0.82399999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.21,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98699999999999999,"15min":1.012},"min":{"1min":0.69799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2569999999999999,"5min":1.585,"15min":1.6120000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0820000000000001,"15min":1.1060000000000001},"min":{"1min":0.72599999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4390000000000001,"5min":1.542,"15min":1.542},"last":0.875}]},{"osd":7,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0489999999999999,"15min":1.091},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.29,"5min":1.498,"15min":1.498},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.135,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.399,"5min":1.625,"15min":1.905},"last":0.83899999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542230,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15052,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":13888,"kb_avail":94356788,"statfs":{"total":96636764160,"available":96621350912,"internally_reserved":0,"allocated":1183744,"data_stored":561064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14221312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.63},"min":{"1min":0.44,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.872,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.28499999999999998,"15min":0.27500000000000002},"max":{"1min":0.96199999999999997,"5min":1.282,"15min":1.282},"last":0.73599999999999999}]},{"osd":1,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.872,"15min":0.68700000000000006},"min":{"1min":0.53800000000000003,"5min":0.40699999999999997,"15min":0.34999999999999998},"max":{"1min":0.94099999999999995,"5min":19.015999999999998,"15min":19.015999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78600000000000003,"15min":0.74399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35899999999999999,"15min":0.31},"max":{"1min":1.018,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73299999999999998,"15min":0.68899999999999995},"min":{"1min":0.59499999999999997,"5min":0.39900000000000002,"15min":0.372},"max":{"1min":0.999,"5min":1.494,"15min":1.494},"last":0.623},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.97199999999999998,"15min":0.78600000000000003},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.1579999999999999,"5min":23.466000000000001,"15min":23.466000000000001},"last":0.79700000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.83199999999999996,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.266,"5min":15.255000000000001,"15min":15.255000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.1639999999999999,"15min":1.038},"min":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1870000000000001,"5min":23.792999999999999,"15min":23.792999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.1970000000000001,"15min":1.0269999999999999},"min":{"1min":0.81899999999999995,"5min":0.68300000000000005,"15min":0.63500000000000001},"max":{"1min":1.167,"5min":23.751000000000001,"15min":23.751000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.091,"15min":1.089},"min":{"1min":0.91600000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.2290000000000001,"5min":7.0110000000000001,"15min":7.0110000000000001},"last":1.1699999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.1830000000000001,"15min":1.0609999999999999},"min":{"1min":0.84299999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.288,"5min":15.292999999999999,"15min":15.292999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.335,"15min":1.139},"min":{"1min":0.80700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.272,"5min":23.428999999999998,"15min":23.428999999999998},"last":1.2290000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1319999999999999,"15min":1.1439999999999999},"min":{"1min":0.76500000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.29,"5min":6.4199999999999999,"15min":6.4199999999999999},"last":1.048},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2549999999999999,"15min":1.101},"min":{"1min":0.81699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.3680000000000001,"5min":15.428000000000001,"15min":15.428000000000001},"last":0.88400000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542229,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10816,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94361024,"statfs":{"total":96636764160,"available":96625688576,"internally_reserved":0,"allocated":1171456,"data_stored":559528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.82499999999999996,"5min":0.89800000000000002,"15min":0.97699999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68400000000000005,"15min":0.65900000000000003},"min":{"1min":0.56599999999999995,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":1.0229999999999999,"15min":1.107},"last":0.55200000000000005}]},{"osd":1,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.52200000000000002,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.82399999999999995,"5min":1.026,"15min":1.2410000000000001},"last":0.438},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.63500000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":1.095,"15min":1.095},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.59999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98299999999999998,"5min":1.1220000000000001,"15min":1.3069999999999999},"last":0.91900000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.90400000000000003,"15min":0.95899999999999996},"min":{"1min":0.65000000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.28,"15min":1.371},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91100000000000003,"15min":0.96299999999999997},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.141,"5min":1.385,"15min":1.532},"last":0.82899999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.82599999999999996,"5min":0.68100000000000005,"15min":0.622},"max":{"1min":1.173,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.66800000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.254,"5min":1.3540000000000001,"15min":1.7989999999999999},"last":1.1599999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95699999999999996,"15min":0.99299999999999999},"min":{"1min":0.74199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.135,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1,"5min":0.98699999999999999,"15min":1.0429999999999999},"min":{"1min":0.76300000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.212,"5min":1.302,"15min":1.7270000000000001},"last":0.96899999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0309999999999999,"15min":1.05},"min":{"1min":0.85499999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1850000000000001,"5min":1.569,"15min":1.76},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0269999999999999,"15min":1.0629999999999999},"min":{"1min":0.92200000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.208,"5min":1.3839999999999999,"15min":1.4910000000000001},"last":1.2470000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542229,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16064,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94355776,"statfs":{"total":96636764160,"available":96620314624,"internally_reserved":0,"allocated":1761280,"data_stored":1149862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.374},"max":{"1min":0.879,"5min":1.0469999999999999,"15min":1.2190000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.36499999999999999},"max":{"1min":0.93999999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.81100000000000005,"5min":0.98699999999999999,"15min":1.1439999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.01,"5min":1.081,"15min":1.393},"last":0.73499999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.998,"5min":1.2010000000000001,"15min":1.3520000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.50700000000000001,"5min":0.39300000000000002,"15min":0.38100000000000001},"max":{"1min":0.88100000000000001,"5min":1.0600000000000001,"15min":1.744},"last":0.443}]},{"osd":4,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93600000000000005,"15min":0.95599999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60399999999999998},"max":{"1min":1.137,"5min":1.3879999999999999,"15min":1.609},"last":1.1619999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.98599999999999999,"15min":1.0249999999999999},"min":{"1min":0.71899999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.202,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.2230000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.99099999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.0820000000000001,"5min":1.4770000000000001,"15min":1.8660000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0029999999999999,"15min":1.014},"min":{"1min":0.85199999999999998,"5min":0.77500000000000002,"15min":0.65000000000000002},"max":{"1min":1.0920000000000001,"5min":1.4139999999999999,"15min":1.5609999999999999},"last":1.0629999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0029999999999999,"15min":1.0740000000000001},"min":{"1min":0.75800000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.319,"5min":1.575,"15min":1.575},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":0.98999999999999999},"min":{"1min":0.752,"5min":0.66700000000000004,"15min":0.65400000000000003},"max":{"1min":1.228,"5min":1.4099999999999999,"15min":2.1920000000000002},"last":1.2030000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0069999999999999,"15min":1.0609999999999999},"min":{"1min":0.84199999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.3029999999999999,"5min":1.444,"15min":2.2320000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0669999999999999,"15min":1.111},"min":{"1min":0.83799999999999997,"5min":0.78600000000000003,"15min":0.59099999999999997},"max":{"1min":1.2709999999999999,"5min":1.4850000000000001,"15min":1.6599999999999999},"last":1.1180000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542229,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15164,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94356676,"statfs":{"total":96636764160,"available":96621236224,"internally_reserved":0,"allocated":1167360,"data_stored":559074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.52000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.88600000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64600000000000002,"15min":0.66200000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90500000000000003,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68200000000000005,"15min":0.72599999999999998},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93999999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.74399999999999999},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.0509999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92500000000000004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80400000000000005,"15min":0.79600000000000004},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.41699999999999998},"max":{"1min":1.105,"5min":1.262,"15min":1.262},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.872,"15min":0.873},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.052,"5min":1.296,"15min":1.423},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.96099999999999997,"15min":1.002},"min":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2909999999999999,"5min":1.337,"15min":1.399},"last":0.94099999999999995}]},{"osd":5,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0049999999999999,"15min":1.0209999999999999},"min":{"1min":0.83299999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3149999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0089999999999999,"15min":1.0049999999999999},"min":{"1min":0.77400000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2989999999999999,"5min":1.3680000000000001,"15min":1.5089999999999999},"last":0.95999999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0369999999999999,"15min":1.083},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3740000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.753},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.1120000000000001},"min":{"1min":0.74199999999999999,"5min":0.629,"15min":0.629},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.5389999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0700000000000001,"15min":1.1319999999999999},"min":{"1min":0.78700000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3600000000000001,"5min":1.395,"15min":1.5649999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.0549999999999999,"15min":1.0800000000000001},"min":{"1min":0.90700000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3819999999999999,"5min":1.4730000000000001,"15min":1.5700000000000001},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:19:43.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:19:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ae04a700 1 Processor -- start 2023-11-29T11:19:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ae04a700 1 -- start start 2023-11-29T11:19:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ae04a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a80cb460 0x7fc5a80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ae04a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5a80ad490 0x7fc5a80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ae04a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80cd8f0 con 0x7fc5a8158e60 2023-11-29T11:19:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ae04a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a80add00 con 0x7fc5a80ad490 2023-11-29T11:19:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ae04a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80cc4f0 con 0x7fc5a80cb460 2023-11-29T11:19:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ad849700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5a80ad490 0x7fc5a80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ac847700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a80cb460 0x7fc5a80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ad048700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc5a8158e60 0x7fc5a80cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:34744/0 (socket says 172.21.15.81:34744) 2023-11-29T11:19:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ad048700 1 -- 172.21.15.81:0/3195434967 learned_addr learned my addr 172.21.15.81:0/3195434967 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.841+0000 7fc5ad849700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5a80ad490 0x7fc5a80cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46904/0 (socket says 172.21.15.81:46904) 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ac847700 1 -- 172.21.15.81:0/3195434967 >> v2:172.21.15.81:3300/0 conn(0x7fc5a80ad490 msgr2=0x7fc5a80cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ac847700 1 --2- 172.21.15.81:0/3195434967 >> v2:172.21.15.81:3300/0 conn(0x7fc5a80ad490 0x7fc5a80cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ac847700 1 -- 172.21.15.81:0/3195434967 >> v1:172.21.15.176:6789/0 conn(0x7fc5a8158e60 legacy=0x7fc5a80cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ac847700 1 -- 172.21.15.81:0/3195434967 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a806dc60 con 0x7fc5a80cb460 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc59ffff700 1 -- 172.21.15.81:0/3195434967 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840777563 0 0) 0x7fc5a80cd8f0 con 0x7fc5a8158e60 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ac847700 1 --2- 172.21.15.81:0/3195434967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a80cb460 0x7fc5a80c8a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc59800bb20 tx=0x7fc59800be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20fc1fa20d11aff6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc59ffff700 1 -- 172.21.15.81:0/3195434967 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59800dc30 con 0x7fc5a80cb460 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc59ffff700 1 -- 172.21.15.81:0/3195434967 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59800dd90 con 0x7fc5a80cb460 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc59ffff700 1 -- 172.21.15.81:0/3195434967 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598010690 con 0x7fc5a80cb460 2023-11-29T11:19:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 -- 172.21.15.81:0/3195434967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a80cb460 msgr2=0x7fc5a80c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/3195434967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a80cb460 0x7fc5a80c8a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc59800bb20 tx=0x7fc59800be30 comp rx=0 tx=0).stop 2023-11-29T11:19:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 -- 172.21.15.81:0/3195434967 shutdown_connections 2023-11-29T11:19:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/3195434967 >> v2:172.21.15.81:3300/0 conn(0x7fc5a80ad490 0x7fc5a80cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/3195434967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a80cb460 0x7fc5a80c8a30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 -- 172.21.15.81:0/3195434967 >> 172.21.15.81:0/3195434967 conn(0x7fc5a80ce3e0 msgr2=0x7fc5a80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 -- 172.21.15.81:0/3195434967 shutdown_connections 2023-11-29T11:19:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 -- 172.21.15.81:0/3195434967 wait complete. 2023-11-29T11:19:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 Processor -- start 2023-11-29T11:19:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.845+0000 7fc5ae04a700 1 -- start start 2023-11-29T11:19:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5a80ad490 0x7fc5a806a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a80cb460 0x7fc5a80c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a8158e60 0x7fc5a80c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80c2280 con 0x7fc5a80cb460 2023-11-29T11:19:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a815a380 con 0x7fc5a80ad490 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a806a760 con 0x7fc5a8158e60 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a80cb460 0x7fc5a80c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a80cb460 0x7fc5a80c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46908/0 (socket says 172.21.15.81:46908) 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 -- 172.21.15.81:0/2363379643 learned_addr learned my addr 172.21.15.81:0/2363379643 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ad048700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5a80ad490 0x7fc5a806a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ad849700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a8158e60 0x7fc5a80c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 -- 172.21.15.81:0/2363379643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a8158e60 msgr2=0x7fc5a80c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a8158e60 0x7fc5a80c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 -- 172.21.15.81:0/2363379643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5a80ad490 msgr2=0x7fc5a806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5a80ad490 0x7fc5a806a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 -- 172.21.15.81:0/2363379643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59800b750 con 0x7fc5a80cb460 2023-11-29T11:19:43.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ac847700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a80cb460 0x7fc5a80c1d40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fc598000c00 tx=0x7fc5980047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc59dffb700 1 -- 172.21.15.81:0/2363379643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59801e040 con 0x7fc5a80cb460 2023-11-29T11:19:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc59dffb700 1 -- 172.21.15.81:0/2363379643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598019600 con 0x7fc5a80cb460 2023-11-29T11:19:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a8159230 con 0x7fc5a80cb460 2023-11-29T11:19:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc59dffb700 1 -- 172.21.15.81:0/2363379643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598019990 con 0x7fc5a80cb460 2023-11-29T11:19:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a80cde90 con 0x7fc5a80cb460 2023-11-29T11:19:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.849+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a806d6a0 con 0x7fc5a80cb460 2023-11-29T11:19:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.853+0000 7fc59dffb700 1 -- 172.21.15.81:0/2363379643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc598019af0 con 0x7fc5a80cb460 2023-11-29T11:19:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.853+0000 7fc59dffb700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc58c064ee0 0x7fc58c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.853+0000 7fc59dffb700 1 -- 172.21.15.81:0/2363379643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc598085ad0 con 0x7fc5a80cb460 2023-11-29T11:19:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.853+0000 7fc5ad048700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc58c064ee0 0x7fc58c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.853+0000 7fc5ad048700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc58c064ee0 0x7fc58c067390 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4000f60 tx=0x7fc5a4007e00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:43.861+0000 7fc59dffb700 1 -- 172.21.15.81:0/2363379643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc5980539c0 con 0x7fc5a80cb460 2023-11-29T11:19:44.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.017+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5a8072500 con 0x7fc58c064ee0 2023-11-29T11:19:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.033+0000 7fc59dffb700 1 -- 172.21.15.81:0/2363379643 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310436 (secure 0 0 0) 0x7fc5a8072500 con 0x7fc58c064ee0 2023-11-29T11:19:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc58c064ee0 msgr2=0x7fc58c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc58c064ee0 0x7fc58c067390 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4000f60 tx=0x7fc5a4007e00 comp rx=0 tx=0).stop 2023-11-29T11:19:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a80cb460 msgr2=0x7fc5a80c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a80cb460 0x7fc5a80c1d40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fc598000c00 tx=0x7fc5980047e0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 shutdown_connections 2023-11-29T11:19:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc58c064ee0 0x7fc58c067390 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc5a8158e60 0x7fc5a80c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5a80cb460 0x7fc5a80c1d40 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 --2- 172.21.15.81:0/2363379643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5a80ad490 0x7fc5a806a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 >> 172.21.15.81:0/2363379643 conn(0x7fc5a80ce3e0 msgr2=0x7fc5a8158450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 shutdown_connections 2023-11-29T11:19:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.037+0000 7fc5ae04a700 1 -- 172.21.15.81:0/2363379643 wait complete. 2023-11-29T11:19:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:19:44.061 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2023-11-29T11:19:42.567923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":109716,"kb_used_data":10324,"kb_used_omap":0,"kb_used_meta":99328,"kb_avail":754865004,"statfs":{"total":773094113280,"available":772981764096,"internally_reserved":0,"allocated":10571776,"data_stored":5652844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101711872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.286062"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712571+0000","last_change":"2023-11-29T11:19:39.709221+0000","last_active":"2023-11-29T11:19:39.712571+0000","last_peered":"2023-11-29T11:19:39.712571+0000","last_clean":"2023-11-29T11:19:39.712571+0000","last_became_active":"2023-11-29T11:19:39.708908+0000","last_became_peered":"2023-11-29T11:19:39.708908+0000","last_unstale":"2023-11-29T11:19:39.712571+0000","last_undegraded":"2023-11-29T11:19:39.712571+0000","last_fullsized":"2023-11-29T11:19:39.712571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:59:20.144370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712316+0000","last_change":"2023-11-29T11:19:39.708495+0000","last_active":"2023-11-29T11:19:39.712316+0000","last_peered":"2023-11-29T11:19:39.712316+0000","last_clean":"2023-11-29T11:19:39.712316+0000","last_became_active":"2023-11-29T11:19:39.708185+0000","last_became_peered":"2023-11-29T11:19:39.708185+0000","last_unstale":"2023-11-29T11:19:39.712316+0000","last_undegraded":"2023-11-29T11:19:39.712316+0000","last_fullsized":"2023-11-29T11:19:39.712316+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:56:48.618768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712578+0000","last_change":"2023-11-29T11:19:39.708158+0000","last_active":"2023-11-29T11:19:39.712578+0000","last_peered":"2023-11-29T11:19:39.712578+0000","last_clean":"2023-11-29T11:19:39.712578+0000","last_became_active":"2023-11-29T11:19:39.707744+0000","last_became_peered":"2023-11-29T11:19:39.707744+0000","last_unstale":"2023-11-29T11:19:39.712578+0000","last_undegraded":"2023-11-29T11:19:39.712578+0000","last_fullsized":"2023-11-29T11:19:39.712578+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:18:46.229563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.702553+0000","last_change":"2023-11-29T11:19:39.696342+0000","last_active":"2023-11-29T11:19:39.702553+0000","last_peered":"2023-11-29T11:19:39.702553+0000","last_clean":"2023-11-29T11:19:39.702553+0000","last_became_active":"2023-11-29T11:19:39.696085+0000","last_became_peered":"2023-11-29T11:19:39.696085+0000","last_unstale":"2023-11-29T11:19:39.702553+0000","last_undegraded":"2023-11-29T11:19:39.702553+0000","last_fullsized":"2023-11-29T11:19:39.702553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:28:52.649116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710144+0000","last_change":"2023-11-29T11:19:39.704448+0000","last_active":"2023-11-29T11:19:39.710144+0000","last_peered":"2023-11-29T11:19:39.710144+0000","last_clean":"2023-11-29T11:19:39.710144+0000","last_became_active":"2023-11-29T11:19:39.704123+0000","last_became_peered":"2023-11-29T11:19:39.704123+0000","last_unstale":"2023-11-29T11:19:39.710144+0000","last_undegraded":"2023-11-29T11:19:39.710144+0000","last_fullsized":"2023-11-29T11:19:39.710144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:24:21.932785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711117+0000","last_change":"2023-11-29T11:19:39.707880+0000","last_active":"2023-11-29T11:19:39.711117+0000","last_peered":"2023-11-29T11:19:39.711117+0000","last_clean":"2023-11-29T11:19:39.711117+0000","last_became_active":"2023-11-29T11:19:39.707609+0000","last_became_peered":"2023-11-29T11:19:39.707609+0000","last_unstale":"2023-11-29T11:19:39.711117+0000","last_undegraded":"2023-11-29T11:19:39.711117+0000","last_fullsized":"2023-11-29T11:19:39.711117+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:28:52.649116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711101+0000","last_change":"2023-11-29T11:19:39.707855+0000","last_active":"2023-11-29T11:19:39.711101+0000","last_peered":"2023-11-29T11:19:39.711101+0000","last_clean":"2023-11-29T11:19:39.711101+0000","last_became_active":"2023-11-29T11:19:39.707579+0000","last_became_peered":"2023-11-29T11:19:39.707579+0000","last_unstale":"2023-11-29T11:19:39.711101+0000","last_undegraded":"2023-11-29T11:19:39.711101+0000","last_fullsized":"2023-11-29T11:19:39.711101+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:52:08.892399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708761+0000","last_change":"2023-11-29T11:19:39.701009+0000","last_active":"2023-11-29T11:19:39.708761+0000","last_peered":"2023-11-29T11:19:39.708761+0000","last_clean":"2023-11-29T11:19:39.708761+0000","last_became_active":"2023-11-29T11:19:39.700711+0000","last_became_peered":"2023-11-29T11:19:39.700711+0000","last_unstale":"2023-11-29T11:19:39.708761+0000","last_undegraded":"2023-11-29T11:19:39.708761+0000","last_fullsized":"2023-11-29T11:19:39.708761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:37:09.445587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700643+0000","last_change":"2023-11-29T11:19:39.695248+0000","last_active":"2023-11-29T11:19:39.700643+0000","last_peered":"2023-11-29T11:19:39.700643+0000","last_clean":"2023-11-29T11:19:39.700643+0000","last_became_active":"2023-11-29T11:19:39.694973+0000","last_became_peered":"2023-11-29T11:19:39.694973+0000","last_unstale":"2023-11-29T11:19:39.700643+0000","last_undegraded":"2023-11-29T11:19:39.700643+0000","last_fullsized":"2023-11-29T11:19:39.700643+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:47:29.321195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711099+0000","last_change":"2023-11-29T11:19:39.706956+0000","last_active":"2023-11-29T11:19:39.711099+0000","last_peered":"2023-11-29T11:19:39.711099+0000","last_clean":"2023-11-29T11:19:39.711099+0000","last_became_active":"2023-11-29T11:19:39.706667+0000","last_became_peered":"2023-11-29T11:19:39.706667+0000","last_unstale":"2023-11-29T11:19:39.711099+0000","last_undegraded":"2023-11-29T11:19:39.711099+0000","last_fullsized":"2023-11-29T11:19:39.711099+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:13:20.530039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.702856+0000","last_change":"2023-11-29T11:19:39.699221+0000","last_active":"2023-11-29T11:19:39.702856+0000","last_peered":"2023-11-29T11:19:39.702856+0000","last_clean":"2023-11-29T11:19:39.702856+0000","last_became_active":"2023-11-29T11:19:39.698331+0000","last_became_peered":"2023-11-29T11:19:39.698331+0000","last_unstale":"2023-11-29T11:19:39.702856+0000","last_undegraded":"2023-11-29T11:19:39.702856+0000","last_fullsized":"2023-11-29T11:19:39.702856+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:44.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.698060+0000","last_change":"2023-11-29T11:19:39.692833+0000","last_active":"2023-11-29T11:19:39.698060+0000","last_peered":"2023-11-29T11:19:39.698060+0000","last_clean":"2023-11-29T11:19:39.698060+0000","last_became_active":"2023-11-29T11:19:39.692321+0000","last_became_peered":"2023-11-29T11:19:39.692321+0000","last_unstale":"2023-11-29T11:19:39.698060+0000","last_undegraded":"2023-11-29T11:19:39.698060+0000","last_fullsized":"2023-11-29T11:19:39.698060+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:26:24.451446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.701332+0000","last_change":"2023-11-29T11:19:39.695633+0000","last_active":"2023-11-29T11:19:39.701332+0000","last_peered":"2023-11-29T11:19:39.701332+0000","last_clean":"2023-11-29T11:19:39.701332+0000","last_became_active":"2023-11-29T11:19:39.695389+0000","last_became_peered":"2023-11-29T11:19:39.695389+0000","last_unstale":"2023-11-29T11:19:39.701332+0000","last_undegraded":"2023-11-29T11:19:39.701332+0000","last_fullsized":"2023-11-29T11:19:39.701332+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:52:20.251497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703299+0000","last_change":"2023-11-29T11:19:39.698215+0000","last_active":"2023-11-29T11:19:39.703299+0000","last_peered":"2023-11-29T11:19:39.703299+0000","last_clean":"2023-11-29T11:19:39.703299+0000","last_became_active":"2023-11-29T11:19:39.697984+0000","last_became_peered":"2023-11-29T11:19:39.697984+0000","last_unstale":"2023-11-29T11:19:39.703299+0000","last_undegraded":"2023-11-29T11:19:39.703299+0000","last_fullsized":"2023-11-29T11:19:39.703299+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:49.828982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.698014+0000","last_change":"2023-11-29T11:19:39.693072+0000","last_active":"2023-11-29T11:19:39.698014+0000","last_peered":"2023-11-29T11:19:39.698014+0000","last_clean":"2023-11-29T11:19:39.698014+0000","last_became_active":"2023-11-29T11:19:39.692885+0000","last_became_peered":"2023-11-29T11:19:39.692885+0000","last_unstale":"2023-11-29T11:19:39.698014+0000","last_undegraded":"2023-11-29T11:19:39.698014+0000","last_fullsized":"2023-11-29T11:19:39.698014+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:33.512915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.705415+0000","last_change":"2023-11-29T11:19:39.703384+0000","last_active":"2023-11-29T11:19:39.705415+0000","last_peered":"2023-11-29T11:19:39.705415+0000","last_clean":"2023-11-29T11:19:39.705415+0000","last_became_active":"2023-11-29T11:19:39.703069+0000","last_became_peered":"2023-11-29T11:19:39.703069+0000","last_unstale":"2023-11-29T11:19:39.705415+0000","last_undegraded":"2023-11-29T11:19:39.705415+0000","last_fullsized":"2023-11-29T11:19:39.705415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:06:55.752556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704160+0000","last_change":"2023-11-29T11:19:39.696126+0000","last_active":"2023-11-29T11:19:39.704160+0000","last_peered":"2023-11-29T11:19:39.704160+0000","last_clean":"2023-11-29T11:19:39.704160+0000","last_became_active":"2023-11-29T11:19:39.695866+0000","last_became_peered":"2023-11-29T11:19:39.695866+0000","last_unstale":"2023-11-29T11:19:39.704160+0000","last_undegraded":"2023-11-29T11:19:39.704160+0000","last_fullsized":"2023-11-29T11:19:39.704160+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:59:01.297330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706733+0000","last_change":"2023-11-29T11:19:39.696635+0000","last_active":"2023-11-29T11:19:39.706733+0000","last_peered":"2023-11-29T11:19:39.706733+0000","last_clean":"2023-11-29T11:19:39.706733+0000","last_became_active":"2023-11-29T11:19:39.696362+0000","last_became_peered":"2023-11-29T11:19:39.696362+0000","last_unstale":"2023-11-29T11:19:39.706733+0000","last_undegraded":"2023-11-29T11:19:39.706733+0000","last_fullsized":"2023-11-29T11:19:39.706733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:53:44.192234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704012+0000","last_change":"2023-11-29T11:19:39.701360+0000","last_active":"2023-11-29T11:19:39.704012+0000","last_peered":"2023-11-29T11:19:39.704012+0000","last_clean":"2023-11-29T11:19:39.704012+0000","last_became_active":"2023-11-29T11:19:39.700973+0000","last_became_peered":"2023-11-29T11:19:39.700973+0000","last_unstale":"2023-11-29T11:19:39.704012+0000","last_undegraded":"2023-11-29T11:19:39.704012+0000","last_fullsized":"2023-11-29T11:19:39.704012+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:43:35.697373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700701+0000","last_change":"2023-11-29T11:19:39.696446+0000","last_active":"2023-11-29T11:19:39.700701+0000","last_peered":"2023-11-29T11:19:39.700701+0000","last_clean":"2023-11-29T11:19:39.700701+0000","last_became_active":"2023-11-29T11:19:39.696105+0000","last_became_peered":"2023-11-29T11:19:39.696105+0000","last_unstale":"2023-11-29T11:19:39.700701+0000","last_undegraded":"2023-11-29T11:19:39.700701+0000","last_fullsized":"2023-11-29T11:19:39.700701+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:33:18.369349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712503+0000","last_change":"2023-11-29T11:19:39.707943+0000","last_active":"2023-11-29T11:19:39.712503+0000","last_peered":"2023-11-29T11:19:39.712503+0000","last_clean":"2023-11-29T11:19:39.712503+0000","last_became_active":"2023-11-29T11:19:39.707650+0000","last_became_peered":"2023-11-29T11:19:39.707650+0000","last_unstale":"2023-11-29T11:19:39.712503+0000","last_undegraded":"2023-11-29T11:19:39.712503+0000","last_fullsized":"2023-11-29T11:19:39.712503+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:46:28.758774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708557+0000","last_change":"2023-11-29T11:19:39.701896+0000","last_active":"2023-11-29T11:19:39.708557+0000","last_peered":"2023-11-29T11:19:39.708557+0000","last_clean":"2023-11-29T11:19:39.708557+0000","last_became_active":"2023-11-29T11:19:39.701629+0000","last_became_peered":"2023-11-29T11:19:39.701629+0000","last_unstale":"2023-11-29T11:19:39.708557+0000","last_undegraded":"2023-11-29T11:19:39.708557+0000","last_fullsized":"2023-11-29T11:19:39.708557+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:10:03.559481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708591+0000","last_change":"2023-11-29T11:19:39.702146+0000","last_active":"2023-11-29T11:19:39.708591+0000","last_peered":"2023-11-29T11:19:39.708591+0000","last_clean":"2023-11-29T11:19:39.708591+0000","last_became_active":"2023-11-29T11:19:39.701879+0000","last_became_peered":"2023-11-29T11:19:39.701879+0000","last_unstale":"2023-11-29T11:19:39.708591+0000","last_undegraded":"2023-11-29T11:19:39.708591+0000","last_fullsized":"2023-11-29T11:19:39.708591+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:45:29.263997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.705045+0000","last_change":"2023-11-29T11:19:39.702107+0000","last_active":"2023-11-29T11:19:39.705045+0000","last_peered":"2023-11-29T11:19:39.705045+0000","last_clean":"2023-11-29T11:19:39.705045+0000","last_became_active":"2023-11-29T11:19:39.701854+0000","last_became_peered":"2023-11-29T11:19:39.701854+0000","last_unstale":"2023-11-29T11:19:39.705045+0000","last_undegraded":"2023-11-29T11:19:39.705045+0000","last_fullsized":"2023-11-29T11:19:39.705045+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:53:44.192234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712529+0000","last_change":"2023-11-29T11:19:39.711045+0000","last_active":"2023-11-29T11:19:39.712529+0000","last_peered":"2023-11-29T11:19:39.712529+0000","last_clean":"2023-11-29T11:19:39.712529+0000","last_became_active":"2023-11-29T11:19:39.710579+0000","last_became_peered":"2023-11-29T11:19:39.710579+0000","last_unstale":"2023-11-29T11:19:39.712529+0000","last_undegraded":"2023-11-29T11:19:39.712529+0000","last_fullsized":"2023-11-29T11:19:39.712529+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:19:30.903749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708436+0000","last_change":"2023-11-29T11:19:39.697616+0000","last_active":"2023-11-29T11:19:39.708436+0000","last_peered":"2023-11-29T11:19:39.708436+0000","last_clean":"2023-11-29T11:19:39.708436+0000","last_became_active":"2023-11-29T11:19:39.697077+0000","last_became_peered":"2023-11-29T11:19:39.697077+0000","last_unstale":"2023-11-29T11:19:39.708436+0000","last_undegraded":"2023-11-29T11:19:39.708436+0000","last_fullsized":"2023-11-29T11:19:39.708436+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:35:08.337704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.705824+0000","last_change":"2023-11-29T11:19:39.699994+0000","last_active":"2023-11-29T11:19:39.705824+0000","last_peered":"2023-11-29T11:19:39.705824+0000","last_clean":"2023-11-29T11:19:39.705824+0000","last_became_active":"2023-11-29T11:19:39.699447+0000","last_became_peered":"2023-11-29T11:19:39.699447+0000","last_unstale":"2023-11-29T11:19:39.705824+0000","last_undegraded":"2023-11-29T11:19:39.705824+0000","last_fullsized":"2023-11-29T11:19:39.705824+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:33.512915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711034+0000","last_change":"2023-11-29T11:19:39.706633+0000","last_active":"2023-11-29T11:19:39.711034+0000","last_peered":"2023-11-29T11:19:39.711034+0000","last_clean":"2023-11-29T11:19:39.711034+0000","last_became_active":"2023-11-29T11:19:39.706349+0000","last_became_peered":"2023-11-29T11:19:39.706349+0000","last_unstale":"2023-11-29T11:19:39.711034+0000","last_undegraded":"2023-11-29T11:19:39.711034+0000","last_fullsized":"2023-11-29T11:19:39.711034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:19:38.499483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703618+0000","last_change":"2023-11-29T11:19:39.694898+0000","last_active":"2023-11-29T11:19:39.703618+0000","last_peered":"2023-11-29T11:19:39.703618+0000","last_clean":"2023-11-29T11:19:39.703618+0000","last_became_active":"2023-11-29T11:19:39.691157+0000","last_became_peered":"2023-11-29T11:19:39.691157+0000","last_unstale":"2023-11-29T11:19:39.703618+0000","last_undegraded":"2023-11-29T11:19:39.703618+0000","last_fullsized":"2023-11-29T11:19:39.703618+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:53:42.215372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712379+0000","last_change":"2023-11-29T11:19:39.707782+0000","last_active":"2023-11-29T11:19:39.712379+0000","last_peered":"2023-11-29T11:19:39.712379+0000","last_clean":"2023-11-29T11:19:39.712379+0000","last_became_active":"2023-11-29T11:19:39.707499+0000","last_became_peered":"2023-11-29T11:19:39.707499+0000","last_unstale":"2023-11-29T11:19:39.712379+0000","last_undegraded":"2023-11-29T11:19:39.712379+0000","last_fullsized":"2023-11-29T11:19:39.712379+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:39.819430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706919+0000","last_change":"2023-11-29T11:19:39.698545+0000","last_active":"2023-11-29T11:19:39.706919+0000","last_peered":"2023-11-29T11:19:39.706919+0000","last_clean":"2023-11-29T11:19:39.706919+0000","last_became_active":"2023-11-29T11:19:39.698259+0000","last_became_peered":"2023-11-29T11:19:39.698259+0000","last_unstale":"2023-11-29T11:19:39.706919+0000","last_undegraded":"2023-11-29T11:19:39.706919+0000","last_fullsized":"2023-11-29T11:19:39.706919+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:52:08.892399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.709816+0000","last_change":"2023-11-29T11:19:39.704494+0000","last_active":"2023-11-29T11:19:39.709816+0000","last_peered":"2023-11-29T11:19:39.709816+0000","last_clean":"2023-11-29T11:19:39.709816+0000","last_became_active":"2023-11-29T11:19:39.704247+0000","last_became_peered":"2023-11-29T11:19:39.704247+0000","last_unstale":"2023-11-29T11:19:39.709816+0000","last_undegraded":"2023-11-29T11:19:39.709816+0000","last_fullsized":"2023-11-29T11:19:39.709816+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:30:15.497376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704062+0000","last_change":"2023-11-29T11:19:39.702930+0000","last_active":"2023-11-29T11:19:39.704062+0000","last_peered":"2023-11-29T11:19:39.704062+0000","last_clean":"2023-11-29T11:19:39.704062+0000","last_became_active":"2023-11-29T11:19:39.702663+0000","last_became_peered":"2023-11-29T11:19:39.702663+0000","last_unstale":"2023-11-29T11:19:39.704062+0000","last_undegraded":"2023-11-29T11:19:39.704062+0000","last_fullsized":"2023-11-29T11:19:39.704062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:50:13.599393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704110+0000","last_change":"2023-11-29T11:19:39.317536+0000","last_active":"2023-11-29T11:19:39.704110+0000","last_peered":"2023-11-29T11:19:39.704110+0000","last_clean":"2023-11-29T11:19:39.704110+0000","last_became_active":"2023-11-29T11:19:39.317252+0000","last_became_peered":"2023-11-29T11:19:39.317252+0000","last_unstale":"2023-11-29T11:19:39.704110+0000","last_undegraded":"2023-11-29T11:19:39.704110+0000","last_fullsized":"2023-11-29T11:19:39.704110+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:41:30.119883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706940+0000","last_change":"2023-11-29T11:19:39.698486+0000","last_active":"2023-11-29T11:19:39.706940+0000","last_peered":"2023-11-29T11:19:39.706940+0000","last_clean":"2023-11-29T11:19:39.706940+0000","last_became_active":"2023-11-29T11:19:39.698221+0000","last_became_peered":"2023-11-29T11:19:39.698221+0000","last_unstale":"2023-11-29T11:19:39.706940+0000","last_undegraded":"2023-11-29T11:19:39.706940+0000","last_fullsized":"2023-11-29T11:19:39.706940+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:13:21.910339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.699438+0000","last_change":"2023-11-29T11:19:39.322558+0000","last_active":"2023-11-29T11:19:39.699438+0000","last_peered":"2023-11-29T11:19:39.699438+0000","last_clean":"2023-11-29T11:19:39.699438+0000","last_became_active":"2023-11-29T11:19:39.321891+0000","last_became_peered":"2023-11-29T11:19:39.321891+0000","last_unstale":"2023-11-29T11:19:39.699438+0000","last_undegraded":"2023-11-29T11:19:39.699438+0000","last_fullsized":"2023-11-29T11:19:39.699438+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:50:41.776181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706956+0000","last_change":"2023-11-29T11:19:39.693284+0000","last_active":"2023-11-29T11:19:39.706956+0000","last_peered":"2023-11-29T11:19:39.706956+0000","last_clean":"2023-11-29T11:19:39.706956+0000","last_became_active":"2023-11-29T11:19:39.693016+0000","last_became_peered":"2023-11-29T11:19:39.693016+0000","last_unstale":"2023-11-29T11:19:39.706956+0000","last_undegraded":"2023-11-29T11:19:39.706956+0000","last_fullsized":"2023-11-29T11:19:39.706956+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:03:26.019133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703586+0000","last_change":"2023-11-29T11:19:39.319062+0000","last_active":"2023-11-29T11:19:39.703586+0000","last_peered":"2023-11-29T11:19:39.703586+0000","last_clean":"2023-11-29T11:19:39.703586+0000","last_became_active":"2023-11-29T11:19:39.318771+0000","last_became_peered":"2023-11-29T11:19:39.318771+0000","last_unstale":"2023-11-29T11:19:39.703586+0000","last_undegraded":"2023-11-29T11:19:39.703586+0000","last_fullsized":"2023-11-29T11:19:39.703586+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:20:30.749185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704117+0000","last_change":"2023-11-29T11:19:39.701173+0000","last_active":"2023-11-29T11:19:39.704117+0000","last_peered":"2023-11-29T11:19:39.704117+0000","last_clean":"2023-11-29T11:19:39.704117+0000","last_became_active":"2023-11-29T11:19:39.700364+0000","last_became_peered":"2023-11-29T11:19:39.700364+0000","last_unstale":"2023-11-29T11:19:39.704117+0000","last_undegraded":"2023-11-29T11:19:39.704117+0000","last_fullsized":"2023-11-29T11:19:39.704117+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:34:13.016538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703482+0000","last_change":"2023-11-29T11:19:39.317456+0000","last_active":"2023-11-29T11:19:39.703482+0000","last_peered":"2023-11-29T11:19:39.703482+0000","last_clean":"2023-11-29T11:19:39.703482+0000","last_became_active":"2023-11-29T11:19:39.317143+0000","last_became_peered":"2023-11-29T11:19:39.317143+0000","last_unstale":"2023-11-29T11:19:39.703482+0000","last_undegraded":"2023-11-29T11:19:39.703482+0000","last_fullsized":"2023-11-29T11:19:39.703482+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:24:22.376022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712343+0000","last_change":"2023-11-29T11:19:39.700375+0000","last_active":"2023-11-29T11:19:39.712343+0000","last_peered":"2023-11-29T11:19:39.712343+0000","last_clean":"2023-11-29T11:19:39.712343+0000","last_became_active":"2023-11-29T11:19:39.700103+0000","last_became_peered":"2023-11-29T11:19:39.700103+0000","last_unstale":"2023-11-29T11:19:39.712343+0000","last_undegraded":"2023-11-29T11:19:39.712343+0000","last_fullsized":"2023-11-29T11:19:39.712343+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:40:43.353758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700488+0000","last_change":"2023-11-29T11:19:39.323249+0000","last_active":"2023-11-29T11:19:39.700488+0000","last_peered":"2023-11-29T11:19:39.700488+0000","last_clean":"2023-11-29T11:19:39.700488+0000","last_became_active":"2023-11-29T11:19:39.322966+0000","last_became_peered":"2023-11-29T11:19:39.322966+0000","last_unstale":"2023-11-29T11:19:39.700488+0000","last_undegraded":"2023-11-29T11:19:39.700488+0000","last_fullsized":"2023-11-29T11:19:39.700488+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:37:53.098568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711585+0000","last_change":"2023-11-29T11:19:39.710439+0000","last_active":"2023-11-29T11:19:39.711585+0000","last_peered":"2023-11-29T11:19:39.711585+0000","last_clean":"2023-11-29T11:19:39.711585+0000","last_became_active":"2023-11-29T11:19:39.710169+0000","last_became_peered":"2023-11-29T11:19:39.710169+0000","last_unstale":"2023-11-29T11:19:39.711585+0000","last_undegraded":"2023-11-29T11:19:39.711585+0000","last_fullsized":"2023-11-29T11:19:39.711585+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:24:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703388+0000","last_change":"2023-11-29T11:19:39.325075+0000","last_active":"2023-11-29T11:19:39.703388+0000","last_peered":"2023-11-29T11:19:39.703388+0000","last_clean":"2023-11-29T11:19:39.703388+0000","last_became_active":"2023-11-29T11:19:39.324583+0000","last_became_peered":"2023-11-29T11:19:39.324583+0000","last_unstale":"2023-11-29T11:19:39.703388+0000","last_undegraded":"2023-11-29T11:19:39.703388+0000","last_fullsized":"2023-11-29T11:19:39.703388+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:06:54.740164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.709525+0000","last_change":"2023-11-29T11:19:39.701619+0000","last_active":"2023-11-29T11:19:39.709525+0000","last_peered":"2023-11-29T11:19:39.709525+0000","last_clean":"2023-11-29T11:19:39.709525+0000","last_became_active":"2023-11-29T11:19:39.701348+0000","last_became_peered":"2023-11-29T11:19:39.701348+0000","last_unstale":"2023-11-29T11:19:39.709525+0000","last_undegraded":"2023-11-29T11:19:39.709525+0000","last_fullsized":"2023-11-29T11:19:39.709525+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:24:23.388413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697318+0000","last_change":"2023-11-29T11:19:39.320961+0000","last_active":"2023-11-29T11:19:39.697318+0000","last_peered":"2023-11-29T11:19:39.697318+0000","last_clean":"2023-11-29T11:19:39.697318+0000","last_became_active":"2023-11-29T11:19:39.320684+0000","last_became_peered":"2023-11-29T11:19:39.320684+0000","last_unstale":"2023-11-29T11:19:39.697318+0000","last_undegraded":"2023-11-29T11:19:39.697318+0000","last_fullsized":"2023-11-29T11:19:39.697318+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:02:37.594540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704065+0000","last_change":"2023-11-29T11:19:39.701912+0000","last_active":"2023-11-29T11:19:39.704065+0000","last_peered":"2023-11-29T11:19:39.704065+0000","last_clean":"2023-11-29T11:19:39.704065+0000","last_became_active":"2023-11-29T11:19:39.701563+0000","last_became_peered":"2023-11-29T11:19:39.701563+0000","last_unstale":"2023-11-29T11:19:39.704065+0000","last_undegraded":"2023-11-29T11:19:39.704065+0000","last_fullsized":"2023-11-29T11:19:39.704065+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:33:20.535533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.683058+0000","last_change":"2023-11-29T11:19:39.327264+0000","last_active":"2023-11-29T11:19:39.683058+0000","last_peered":"2023-11-29T11:19:39.683058+0000","last_clean":"2023-11-29T11:19:39.683058+0000","last_became_active":"2023-11-29T11:19:39.326953+0000","last_became_peered":"2023-11-29T11:19:39.326953+0000","last_unstale":"2023-11-29T11:19:39.683058+0000","last_undegraded":"2023-11-29T11:19:39.683058+0000","last_fullsized":"2023-11-29T11:19:39.683058+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:48:29.242623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708459+0000","last_change":"2023-11-29T11:19:39.697773+0000","last_active":"2023-11-29T11:19:39.708459+0000","last_peered":"2023-11-29T11:19:39.708459+0000","last_clean":"2023-11-29T11:19:39.708459+0000","last_became_active":"2023-11-29T11:19:39.697361+0000","last_became_peered":"2023-11-29T11:19:39.697361+0000","last_unstale":"2023-11-29T11:19:39.708459+0000","last_undegraded":"2023-11-29T11:19:39.708459+0000","last_fullsized":"2023-11-29T11:19:39.708459+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:02:42.898869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.685385+0000","last_change":"2023-11-29T11:19:39.319821+0000","last_active":"2023-11-29T11:19:39.685385+0000","last_peered":"2023-11-29T11:19:39.685385+0000","last_clean":"2023-11-29T11:19:39.685385+0000","last_became_active":"2023-11-29T11:19:39.319562+0000","last_became_peered":"2023-11-29T11:19:39.319562+0000","last_unstale":"2023-11-29T11:19:39.685385+0000","last_undegraded":"2023-11-29T11:19:39.685385+0000","last_fullsized":"2023-11-29T11:19:39.685385+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:36:24.343676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704634+0000","last_change":"2023-11-29T11:19:39.702489+0000","last_active":"2023-11-29T11:19:39.704634+0000","last_peered":"2023-11-29T11:19:39.704634+0000","last_clean":"2023-11-29T11:19:39.704634+0000","last_became_active":"2023-11-29T11:19:39.702233+0000","last_became_peered":"2023-11-29T11:19:39.702233+0000","last_unstale":"2023-11-29T11:19:39.704634+0000","last_undegraded":"2023-11-29T11:19:39.704634+0000","last_fullsized":"2023-11-29T11:19:39.704634+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:26:28.412415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.688563+0000","last_change":"2023-11-29T11:19:39.329311+0000","last_active":"2023-11-29T11:19:39.688563+0000","last_peered":"2023-11-29T11:19:39.688563+0000","last_clean":"2023-11-29T11:19:39.688563+0000","last_became_active":"2023-11-29T11:19:39.328980+0000","last_became_peered":"2023-11-29T11:19:39.328980+0000","last_unstale":"2023-11-29T11:19:39.688563+0000","last_undegraded":"2023-11-29T11:19:39.688563+0000","last_fullsized":"2023-11-29T11:19:39.688563+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:13:43.988079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.712067+0000","last_change":"2023-11-29T11:19:39.709652+0000","last_active":"2023-11-29T11:19:39.712067+0000","last_peered":"2023-11-29T11:19:39.712067+0000","last_clean":"2023-11-29T11:19:39.712067+0000","last_became_active":"2023-11-29T11:19:39.709315+0000","last_became_peered":"2023-11-29T11:19:39.709315+0000","last_unstale":"2023-11-29T11:19:39.712067+0000","last_undegraded":"2023-11-29T11:19:39.712067+0000","last_fullsized":"2023-11-29T11:19:39.712067+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:12:30.596743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700922+0000","last_change":"2023-11-29T11:19:39.316091+0000","last_active":"2023-11-29T11:19:39.700922+0000","last_peered":"2023-11-29T11:19:39.700922+0000","last_clean":"2023-11-29T11:19:39.700922+0000","last_became_active":"2023-11-29T11:19:39.315808+0000","last_became_peered":"2023-11-29T11:19:39.315808+0000","last_unstale":"2023-11-29T11:19:39.700922+0000","last_undegraded":"2023-11-29T11:19:39.700922+0000","last_fullsized":"2023-11-29T11:19:39.700922+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:19:36.802998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.705833+0000","last_change":"2023-11-29T11:19:39.703172+0000","last_active":"2023-11-29T11:19:39.705833+0000","last_peered":"2023-11-29T11:19:39.705833+0000","last_clean":"2023-11-29T11:19:39.705833+0000","last_became_active":"2023-11-29T11:19:39.702893+0000","last_became_peered":"2023-11-29T11:19:39.702893+0000","last_unstale":"2023-11-29T11:19:39.705833+0000","last_undegraded":"2023-11-29T11:19:39.705833+0000","last_fullsized":"2023-11-29T11:19:39.705833+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:20:31.761576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"95'6","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711714+0000","last_change":"2023-11-29T11:19:39.328852+0000","last_active":"2023-11-29T11:19:39.711714+0000","last_peered":"2023-11-29T11:19:39.711714+0000","last_clean":"2023-11-29T11:19:39.711714+0000","last_became_active":"2023-11-29T11:19:39.328553+0000","last_became_peered":"2023-11-29T11:19:39.328553+0000","last_unstale":"2023-11-29T11:19:39.711714+0000","last_undegraded":"2023-11-29T11:19:39.711714+0000","last_fullsized":"2023-11-29T11:19:39.711714+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:18:57.935119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.707109+0000","last_change":"2023-11-29T11:19:39.699823+0000","last_active":"2023-11-29T11:19:39.707109+0000","last_peered":"2023-11-29T11:19:39.707109+0000","last_clean":"2023-11-29T11:19:39.707109+0000","last_became_active":"2023-11-29T11:19:39.699586+0000","last_became_peered":"2023-11-29T11:19:39.699586+0000","last_unstale":"2023-11-29T11:19:39.707109+0000","last_undegraded":"2023-11-29T11:19:39.707109+0000","last_fullsized":"2023-11-29T11:19:39.707109+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:44.633362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.699767+0000","last_change":"2023-11-29T11:19:39.315276+0000","last_active":"2023-11-29T11:19:39.699767+0000","last_peered":"2023-11-29T11:19:39.699767+0000","last_clean":"2023-11-29T11:19:39.699767+0000","last_became_active":"2023-11-29T11:19:39.315006+0000","last_became_peered":"2023-11-29T11:19:39.315006+0000","last_unstale":"2023-11-29T11:19:39.699767+0000","last_undegraded":"2023-11-29T11:19:39.699767+0000","last_fullsized":"2023-11-29T11:19:39.699767+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:18:20.256819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.707249+0000","last_change":"2023-11-29T11:19:39.696121+0000","last_active":"2023-11-29T11:19:39.707249+0000","last_peered":"2023-11-29T11:19:39.707249+0000","last_clean":"2023-11-29T11:19:39.707249+0000","last_became_active":"2023-11-29T11:19:39.695852+0000","last_became_peered":"2023-11-29T11:19:39.695852+0000","last_unstale":"2023-11-29T11:19:39.707249+0000","last_undegraded":"2023-11-29T11:19:39.707249+0000","last_fullsized":"2023-11-29T11:19:39.707249+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:21:14.580406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.691436+0000","last_change":"2023-11-29T11:19:39.324198+0000","last_active":"2023-11-29T11:19:39.691436+0000","last_peered":"2023-11-29T11:19:39.691436+0000","last_clean":"2023-11-29T11:19:39.691436+0000","last_became_active":"2023-11-29T11:19:39.323671+0000","last_became_peered":"2023-11-29T11:19:39.323671+0000","last_unstale":"2023-11-29T11:19:39.691436+0000","last_undegraded":"2023-11-29T11:19:39.691436+0000","last_fullsized":"2023-11-29T11:19:39.691436+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:07:33.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.704088+0000","last_change":"2023-11-29T11:19:39.701922+0000","last_active":"2023-11-29T11:19:39.704088+0000","last_peered":"2023-11-29T11:19:39.704088+0000","last_clean":"2023-11-29T11:19:39.704088+0000","last_became_active":"2023-11-29T11:19:39.701596+0000","last_became_peered":"2023-11-29T11:19:39.701596+0000","last_unstale":"2023-11-29T11:19:39.704088+0000","last_undegraded":"2023-11-29T11:19:39.704088+0000","last_fullsized":"2023-11-29T11:19:39.704088+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:39:07.979441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.678958+0000","last_change":"2023-11-29T11:19:39.315970+0000","last_active":"2023-11-29T11:19:39.678958+0000","last_peered":"2023-11-29T11:19:39.678958+0000","last_clean":"2023-11-29T11:19:39.678958+0000","last_became_active":"2023-11-29T11:19:39.315666+0000","last_became_peered":"2023-11-29T11:19:39.315666+0000","last_unstale":"2023-11-29T11:19:39.678958+0000","last_undegraded":"2023-11-29T11:19:39.678958+0000","last_fullsized":"2023-11-29T11:19:39.678958+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:45:29.716768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697719+0000","last_change":"2023-11-29T11:19:39.695698+0000","last_active":"2023-11-29T11:19:39.697719+0000","last_peered":"2023-11-29T11:19:39.697719+0000","last_clean":"2023-11-29T11:19:39.697719+0000","last_became_active":"2023-11-29T11:19:39.695397+0000","last_became_peered":"2023-11-29T11:19:39.695397+0000","last_unstale":"2023-11-29T11:19:39.697719+0000","last_undegraded":"2023-11-29T11:19:39.697719+0000","last_fullsized":"2023-11-29T11:19:39.697719+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:23:45.155334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"95'8","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.707084+0000","last_change":"2023-11-29T11:19:39.323993+0000","last_active":"2023-11-29T11:19:39.707084+0000","last_peered":"2023-11-29T11:19:39.707084+0000","last_clean":"2023-11-29T11:19:39.707084+0000","last_became_active":"2023-11-29T11:19:39.323675+0000","last_became_peered":"2023-11-29T11:19:39.323675+0000","last_unstale":"2023-11-29T11:19:39.707084+0000","last_undegraded":"2023-11-29T11:19:39.707084+0000","last_fullsized":"2023-11-29T11:19:39.707084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:56:30.353227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.708574+0000","last_change":"2023-11-29T11:19:39.701754+0000","last_active":"2023-11-29T11:19:39.708574+0000","last_peered":"2023-11-29T11:19:39.708574+0000","last_clean":"2023-11-29T11:19:39.708574+0000","last_became_active":"2023-11-29T11:19:39.701496+0000","last_became_peered":"2023-11-29T11:19:39.701496+0000","last_unstale":"2023-11-29T11:19:39.708574+0000","last_undegraded":"2023-11-29T11:19:39.708574+0000","last_fullsized":"2023-11-29T11:19:39.708574+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:43:36.195739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.706514+0000","last_change":"2023-11-29T11:19:39.314707+0000","last_active":"2023-11-29T11:19:39.706514+0000","last_peered":"2023-11-29T11:19:39.706514+0000","last_clean":"2023-11-29T11:19:39.706514+0000","last_became_active":"2023-11-29T11:19:39.314326+0000","last_became_peered":"2023-11-29T11:19:39.314326+0000","last_unstale":"2023-11-29T11:19:39.706514+0000","last_undegraded":"2023-11-29T11:19:39.706514+0000","last_fullsized":"2023-11-29T11:19:39.706514+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:45:37.319157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.707250+0000","last_change":"2023-11-29T11:19:39.699046+0000","last_active":"2023-11-29T11:19:39.707250+0000","last_peered":"2023-11-29T11:19:39.707250+0000","last_clean":"2023-11-29T11:19:39.707250+0000","last_became_active":"2023-11-29T11:19:39.696482+0000","last_became_peered":"2023-11-29T11:19:39.696482+0000","last_unstale":"2023-11-29T11:19:39.707250+0000","last_undegraded":"2023-11-29T11:19:39.707250+0000","last_fullsized":"2023-11-29T11:19:39.707250+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:08:37.802477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:40.163397+0000","last_change":"2023-11-29T11:19:39.319093+0000","last_active":"2023-11-29T11:19:40.163397+0000","last_peered":"2023-11-29T11:19:40.163397+0000","last_clean":"2023-11-29T11:19:40.163397+0000","last_became_active":"2023-11-29T11:19:39.318807+0000","last_became_peered":"2023-11-29T11:19:39.318807+0000","last_unstale":"2023-11-29T11:19:40.163397+0000","last_undegraded":"2023-11-29T11:19:40.163397+0000","last_fullsized":"2023-11-29T11:19:40.163397+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:08:32.500524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.718134+0000","last_change":"2023-11-29T11:19:39.710456+0000","last_active":"2023-11-29T11:19:39.718134+0000","last_peered":"2023-11-29T11:19:39.718134+0000","last_clean":"2023-11-29T11:19:39.718134+0000","last_became_active":"2023-11-29T11:19:39.710234+0000","last_became_peered":"2023-11-29T11:19:39.710234+0000","last_unstale":"2023-11-29T11:19:39.718134+0000","last_undegraded":"2023-11-29T11:19:39.718134+0000","last_fullsized":"2023-11-29T11:19:39.718134+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:50:26.530550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.678208+0000","last_change":"2023-11-29T11:19:39.317488+0000","last_active":"2023-11-29T11:19:39.678208+0000","last_peered":"2023-11-29T11:19:39.678208+0000","last_clean":"2023-11-29T11:19:39.678208+0000","last_became_active":"2023-11-29T11:19:39.317179+0000","last_became_peered":"2023-11-29T11:19:39.317179+0000","last_unstale":"2023-11-29T11:19:39.678208+0000","last_undegraded":"2023-11-29T11:19:39.678208+0000","last_fullsized":"2023-11-29T11:19:39.678208+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:43.620971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710134+0000","last_change":"2023-11-29T11:19:39.704280+0000","last_active":"2023-11-29T11:19:39.710134+0000","last_peered":"2023-11-29T11:19:39.710134+0000","last_clean":"2023-11-29T11:19:39.710134+0000","last_became_active":"2023-11-29T11:19:39.703948+0000","last_became_peered":"2023-11-29T11:19:39.703948+0000","last_unstale":"2023-11-29T11:19:39.710134+0000","last_undegraded":"2023-11-29T11:19:39.710134+0000","last_fullsized":"2023-11-29T11:19:39.710134+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:02:28.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697575+0000","last_change":"2023-11-29T11:19:39.316601+0000","last_active":"2023-11-29T11:19:39.697575+0000","last_peered":"2023-11-29T11:19:39.697575+0000","last_clean":"2023-11-29T11:19:39.697575+0000","last_became_active":"2023-11-29T11:19:39.316330+0000","last_became_peered":"2023-11-29T11:19:39.316330+0000","last_unstale":"2023-11-29T11:19:39.697575+0000","last_undegraded":"2023-11-29T11:19:39.697575+0000","last_fullsized":"2023-11-29T11:19:39.697575+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:35:27.590686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703281+0000","last_change":"2023-11-29T11:19:39.697690+0000","last_active":"2023-11-29T11:19:39.703281+0000","last_peered":"2023-11-29T11:19:39.703281+0000","last_clean":"2023-11-29T11:19:39.703281+0000","last_became_active":"2023-11-29T11:19:39.697418+0000","last_became_peered":"2023-11-29T11:19:39.697418+0000","last_unstale":"2023-11-29T11:19:39.703281+0000","last_undegraded":"2023-11-29T11:19:39.703281+0000","last_fullsized":"2023-11-29T11:19:39.703281+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:18:16.246588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.677699+0000","last_change":"2023-11-29T11:19:39.327095+0000","last_active":"2023-11-29T11:19:39.677699+0000","last_peered":"2023-11-29T11:19:39.677699+0000","last_clean":"2023-11-29T11:19:39.677699+0000","last_became_active":"2023-11-29T11:19:39.326811+0000","last_became_peered":"2023-11-29T11:19:39.326811+0000","last_unstale":"2023-11-29T11:19:39.677699+0000","last_undegraded":"2023-11-29T11:19:39.677699+0000","last_fullsized":"2023-11-29T11:19:39.677699+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:17:50.466008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711558+0000","last_change":"2023-11-29T11:19:39.709856+0000","last_active":"2023-11-29T11:19:39.711558+0000","last_peered":"2023-11-29T11:19:39.711558+0000","last_clean":"2023-11-29T11:19:39.711558+0000","last_became_active":"2023-11-29T11:19:39.709573+0000","last_became_peered":"2023-11-29T11:19:39.709573+0000","last_unstale":"2023-11-29T11:19:39.711558+0000","last_undegraded":"2023-11-29T11:19:39.711558+0000","last_fullsized":"2023-11-29T11:19:39.711558+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:03:42.689092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697458+0000","last_change":"2023-11-29T11:19:39.322905+0000","last_active":"2023-11-29T11:19:39.697458+0000","last_peered":"2023-11-29T11:19:39.697458+0000","last_clean":"2023-11-29T11:19:39.697458+0000","last_became_active":"2023-11-29T11:19:39.322653+0000","last_became_peered":"2023-11-29T11:19:39.322653+0000","last_unstale":"2023-11-29T11:19:39.697458+0000","last_undegraded":"2023-11-29T11:19:39.697458+0000","last_fullsized":"2023-11-29T11:19:39.697458+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:10:50.986147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.697263+0000","last_change":"2023-11-29T11:19:39.692387+0000","last_active":"2023-11-29T11:19:39.697263+0000","last_peered":"2023-11-29T11:19:39.697263+0000","last_clean":"2023-11-29T11:19:39.697263+0000","last_became_active":"2023-11-29T11:19:39.692127+0000","last_became_peered":"2023-11-29T11:19:39.692127+0000","last_unstale":"2023-11-29T11:19:39.697263+0000","last_undegraded":"2023-11-29T11:19:39.697263+0000","last_fullsized":"2023-11-29T11:19:39.697263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:01:28.008645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.683697+0000","last_change":"2023-11-29T11:19:39.323801+0000","last_active":"2023-11-29T11:19:39.683697+0000","last_peered":"2023-11-29T11:19:39.683697+0000","last_clean":"2023-11-29T11:19:39.683697+0000","last_became_active":"2023-11-29T11:19:39.323469+0000","last_became_peered":"2023-11-29T11:19:39.323469+0000","last_unstale":"2023-11-29T11:19:39.683697+0000","last_undegraded":"2023-11-29T11:19:39.683697+0000","last_fullsized":"2023-11-29T11:19:39.683697+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:13:11.518007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710107+0000","last_change":"2023-11-29T11:19:39.704150+0000","last_active":"2023-11-29T11:19:39.710107+0000","last_peered":"2023-11-29T11:19:39.710107+0000","last_clean":"2023-11-29T11:19:39.710107+0000","last_became_active":"2023-11-29T11:19:39.703829+0000","last_became_peered":"2023-11-29T11:19:39.703829+0000","last_unstale":"2023-11-29T11:19:39.710107+0000","last_undegraded":"2023-11-29T11:19:39.710107+0000","last_fullsized":"2023-11-29T11:19:39.710107+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:21:28.319281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.687878+0000","last_change":"2023-11-29T11:19:39.321101+0000","last_active":"2023-11-29T11:19:39.687878+0000","last_peered":"2023-11-29T11:19:39.687878+0000","last_clean":"2023-11-29T11:19:39.687878+0000","last_became_active":"2023-11-29T11:19:39.320816+0000","last_became_peered":"2023-11-29T11:19:39.320816+0000","last_unstale":"2023-11-29T11:19:39.687878+0000","last_undegraded":"2023-11-29T11:19:39.687878+0000","last_fullsized":"2023-11-29T11:19:39.687878+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:20:42.513781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.711026+0000","last_change":"2023-11-29T11:19:39.706746+0000","last_active":"2023-11-29T11:19:39.711026+0000","last_peered":"2023-11-29T11:19:39.711026+0000","last_clean":"2023-11-29T11:19:39.711026+0000","last_became_active":"2023-11-29T11:19:39.706472+0000","last_became_peered":"2023-11-29T11:19:39.706472+0000","last_unstale":"2023-11-29T11:19:39.711026+0000","last_undegraded":"2023-11-29T11:19:39.711026+0000","last_fullsized":"2023-11-29T11:19:39.711026+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:45:53.563342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.676289+0000","last_change":"2023-11-29T11:19:39.325294+0000","last_active":"2023-11-29T11:19:39.676289+0000","last_peered":"2023-11-29T11:19:39.676289+0000","last_clean":"2023-11-29T11:19:39.676289+0000","last_became_active":"2023-11-29T11:19:39.325012+0000","last_became_peered":"2023-11-29T11:19:39.325012+0000","last_unstale":"2023-11-29T11:19:39.676289+0000","last_undegraded":"2023-11-29T11:19:39.676289+0000","last_fullsized":"2023-11-29T11:19:39.676289+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:28:51.636725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":78,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.310186+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:19:39.310186+0000","last_peered":"2023-11-29T11:19:39.310186+0000","last_clean":"2023-11-29T11:19:39.310186+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:19:39.310186+0000","last_undegraded":"2023-11-29T11:19:39.310186+0000","last_fullsized":"2023-11-29T11:19:39.310186+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.698522+0000","last_change":"2023-11-29T11:19:39.696081+0000","last_active":"2023-11-29T11:19:39.698522+0000","last_peered":"2023-11-29T11:19:39.698522+0000","last_clean":"2023-11-29T11:19:39.698522+0000","last_became_active":"2023-11-29T11:19:39.695823+0000","last_became_peered":"2023-11-29T11:19:39.695823+0000","last_unstale":"2023-11-29T11:19:39.698522+0000","last_undegraded":"2023-11-29T11:19:39.698522+0000","last_fullsized":"2023-11-29T11:19:39.698522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:46:53.636825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.684502+0000","last_change":"2023-11-29T11:19:39.321311+0000","last_active":"2023-11-29T11:19:39.684502+0000","last_peered":"2023-11-29T11:19:39.684502+0000","last_clean":"2023-11-29T11:19:39.684502+0000","last_became_active":"2023-11-29T11:19:39.321046+0000","last_became_peered":"2023-11-29T11:19:39.321046+0000","last_unstale":"2023-11-29T11:19:39.684502+0000","last_undegraded":"2023-11-29T11:19:39.684502+0000","last_fullsized":"2023-11-29T11:19:39.684502+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:25:02.516746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":79,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.309345+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:19:39.309345+0000","last_peered":"2023-11-29T11:19:39.309345+0000","last_clean":"2023-11-29T11:19:39.309345+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:19:39.309345+0000","last_undegraded":"2023-11-29T11:19:39.309345+0000","last_fullsized":"2023-11-29T11:19:39.309345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.709716+0000","last_change":"2023-11-29T11:19:39.704271+0000","last_active":"2023-11-29T11:19:39.709716+0000","last_peered":"2023-11-29T11:19:39.709716+0000","last_clean":"2023-11-29T11:19:39.709716+0000","last_became_active":"2023-11-29T11:19:39.703968+0000","last_became_peered":"2023-11-29T11:19:39.703968+0000","last_unstale":"2023-11-29T11:19:39.709716+0000","last_undegraded":"2023-11-29T11:19:39.709716+0000","last_fullsized":"2023-11-29T11:19:39.709716+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:37:23.247809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.684598+0000","last_change":"2023-11-29T11:19:39.322528+0000","last_active":"2023-11-29T11:19:39.684598+0000","last_peered":"2023-11-29T11:19:39.684598+0000","last_clean":"2023-11-29T11:19:39.684598+0000","last_became_active":"2023-11-29T11:19:39.322275+0000","last_became_peered":"2023-11-29T11:19:39.322275+0000","last_unstale":"2023-11-29T11:19:39.684598+0000","last_undegraded":"2023-11-29T11:19:39.684598+0000","last_fullsized":"2023-11-29T11:19:39.684598+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:28:23.027266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":79,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.306874+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:19:39.306874+0000","last_peered":"2023-11-29T11:19:39.306874+0000","last_clean":"2023-11-29T11:19:39.306874+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:19:39.306874+0000","last_undegraded":"2023-11-29T11:19:39.306874+0000","last_fullsized":"2023-11-29T11:19:39.306874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703313+0000","last_change":"2023-11-29T11:19:39.698598+0000","last_active":"2023-11-29T11:19:39.703313+0000","last_peered":"2023-11-29T11:19:39.703313+0000","last_clean":"2023-11-29T11:19:39.703313+0000","last_became_active":"2023-11-29T11:19:39.698372+0000","last_became_peered":"2023-11-29T11:19:39.698372+0000","last_unstale":"2023-11-29T11:19:39.703313+0000","last_undegraded":"2023-11-29T11:19:39.703313+0000","last_fullsized":"2023-11-29T11:19:39.703313+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:01:10.920439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.703551+0000","last_change":"2023-11-29T11:19:39.318664+0000","last_active":"2023-11-29T11:19:39.703551+0000","last_peered":"2023-11-29T11:19:39.703551+0000","last_clean":"2023-11-29T11:19:39.703551+0000","last_became_active":"2023-11-29T11:19:39.318200+0000","last_became_peered":"2023-11-29T11:19:39.318200+0000","last_unstale":"2023-11-29T11:19:39.703551+0000","last_undegraded":"2023-11-29T11:19:39.703551+0000","last_fullsized":"2023-11-29T11:19:39.703551+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:59:44.950290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.322452+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:19:39.322452+0000","last_peered":"2023-11-29T11:19:39.322452+0000","last_clean":"2023-11-29T11:19:39.322452+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:19:39.322452+0000","last_undegraded":"2023-11-29T11:19:39.322452+0000","last_fullsized":"2023-11-29T11:19:39.322452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.702875+0000","last_change":"2023-11-29T11:19:39.699703+0000","last_active":"2023-11-29T11:19:39.702875+0000","last_peered":"2023-11-29T11:19:39.702875+0000","last_clean":"2023-11-29T11:19:39.702875+0000","last_became_active":"2023-11-29T11:19:39.698990+0000","last_became_peered":"2023-11-29T11:19:39.698990+0000","last_unstale":"2023-11-29T11:19:39.702875+0000","last_undegraded":"2023-11-29T11:19:39.702875+0000","last_fullsized":"2023-11-29T11:19:39.702875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:03:25.912654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.677301+0000","last_change":"2023-11-29T11:19:39.318344+0000","last_active":"2023-11-29T11:19:39.677301+0000","last_peered":"2023-11-29T11:19:39.677301+0000","last_clean":"2023-11-29T11:19:39.677301+0000","last_became_active":"2023-11-29T11:19:39.318084+0000","last_became_peered":"2023-11-29T11:19:39.318084+0000","last_unstale":"2023-11-29T11:19:39.677301+0000","last_undegraded":"2023-11-29T11:19:39.677301+0000","last_fullsized":"2023-11-29T11:19:39.677301+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:03:24.900263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":231,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.308767+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:19:39.308767+0000","last_peered":"2023-11-29T11:19:39.308767+0000","last_clean":"2023-11-29T11:19:39.308767+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:19:39.308767+0000","last_undegraded":"2023-11-29T11:19:39.308767+0000","last_fullsized":"2023-11-29T11:19:39.308767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":81,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.316609+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:19:39.316609+0000","last_peered":"2023-11-29T11:19:39.316609+0000","last_clean":"2023-11-29T11:19:39.316609+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:19:39.316609+0000","last_undegraded":"2023-11-29T11:19:39.316609+0000","last_fullsized":"2023-11-29T11:19:39.316609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.713471+0000","last_change":"2023-11-29T11:19:39.707564+0000","last_active":"2023-11-29T11:19:39.713471+0000","last_peered":"2023-11-29T11:19:39.713471+0000","last_clean":"2023-11-29T11:19:39.713471+0000","last_became_active":"2023-11-29T11:19:39.707294+0000","last_became_peered":"2023-11-29T11:19:39.707294+0000","last_unstale":"2023-11-29T11:19:39.713471+0000","last_undegraded":"2023-11-29T11:19:39.713471+0000","last_fullsized":"2023-11-29T11:19:39.713471+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:40:03.660244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710061+0000","last_change":"2023-11-29T11:19:39.317111+0000","last_active":"2023-11-29T11:19:39.710061+0000","last_peered":"2023-11-29T11:19:39.710061+0000","last_clean":"2023-11-29T11:19:39.710061+0000","last_became_active":"2023-11-29T11:19:39.316851+0000","last_became_peered":"2023-11-29T11:19:39.316851+0000","last_unstale":"2023-11-29T11:19:39.710061+0000","last_undegraded":"2023-11-29T11:19:39.710061+0000","last_fullsized":"2023-11-29T11:19:39.710061+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:17:22.251002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":82,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.309674+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:19:39.309674+0000","last_peered":"2023-11-29T11:19:39.309674+0000","last_clean":"2023-11-29T11:19:39.309674+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:19:39.309674+0000","last_undegraded":"2023-11-29T11:19:39.309674+0000","last_fullsized":"2023-11-29T11:19:39.309674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.710913+0000","last_change":"2023-11-29T11:19:39.706353+0000","last_active":"2023-11-29T11:19:39.710913+0000","last_peered":"2023-11-29T11:19:39.710913+0000","last_clean":"2023-11-29T11:19:39.710913+0000","last_became_active":"2023-11-29T11:19:39.705938+0000","last_became_peered":"2023-11-29T11:19:39.705938+0000","last_unstale":"2023-11-29T11:19:39.710913+0000","last_undegraded":"2023-11-29T11:19:39.710913+0000","last_fullsized":"2023-11-29T11:19:39.710913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:59.193925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.698151+0000","last_change":"2023-11-29T11:19:39.318235+0000","last_active":"2023-11-29T11:19:39.698151+0000","last_peered":"2023-11-29T11:19:39.698151+0000","last_clean":"2023-11-29T11:19:39.698151+0000","last_became_active":"2023-11-29T11:19:39.317875+0000","last_became_peered":"2023-11-29T11:19:39.317875+0000","last_unstale":"2023-11-29T11:19:39.698151+0000","last_undegraded":"2023-11-29T11:19:39.698151+0000","last_fullsized":"2023-11-29T11:19:39.698151+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:10:02.547090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":89,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.302645+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:19:39.302645+0000","last_peered":"2023-11-29T11:19:39.302645+0000","last_clean":"2023-11-29T11:19:39.302645+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:19:39.302645+0000","last_undegraded":"2023-11-29T11:19:39.302645+0000","last_fullsized":"2023-11-29T11:19:39.302645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700417+0000","last_change":"2023-11-29T11:19:39.697039+0000","last_active":"2023-11-29T11:19:39.700417+0000","last_peered":"2023-11-29T11:19:39.700417+0000","last_clean":"2023-11-29T11:19:39.700417+0000","last_became_active":"2023-11-29T11:19:39.696776+0000","last_became_peered":"2023-11-29T11:19:39.696776+0000","last_unstale":"2023-11-29T11:19:39.700417+0000","last_undegraded":"2023-11-29T11:19:39.700417+0000","last_fullsized":"2023-11-29T11:19:39.700417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:39.280551+0000","last_clean_scrub_stamp":"2023-11-29T11:19:39.280551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:36:54.380565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.700236+0000","last_change":"2023-11-29T11:19:39.325886+0000","last_active":"2023-11-29T11:19:39.700236+0000","last_peered":"2023-11-29T11:19:39.700236+0000","last_clean":"2023-11-29T11:19:39.700236+0000","last_became_active":"2023-11-29T11:19:39.325676+0000","last_became_peered":"2023-11-29T11:19:39.325676+0000","last_unstale":"2023-11-29T11:19:39.700236+0000","last_undegraded":"2023-11-29T11:19:39.700236+0000","last_fullsized":"2023-11-29T11:19:39.700236+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:19:38.268160+0000","last_clean_scrub_stamp":"2023-11-29T11:19:38.268160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:17:56.622855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":82,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-29T11:19:39.308844+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:19:39.308844+0000","last_peered":"2023-11-29T11:19:39.308844+0000","last_clean":"2023-11-29T11:19:39.308844+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:19:39.308844+0000","last_undegraded":"2023-11-29T11:19:39.308844+0000","last_fullsized":"2023-11-29T11:19:39.308844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542229,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11912,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":10176,"kb_avail":94359928,"statfs":{"total":96636764160,"available":96624566272,"internally_reserved":0,"allocated":1769472,"data_stored":1149974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10420224},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.214,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83299999999999996,"15min":0.82499999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1100000000000001,"5min":1.327,"15min":1.327},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.89200000000000002,"15min":0.90500000000000003},"min":{"1min":0.59999999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.242,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.89800000000000002},"min":{"1min":0.623,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1080000000000001,"5min":3.0449999999999999,"15min":3.0449999999999999},"last":1.111}]},{"osd":2,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97999999999999998,"15min":1.014},"min":{"1min":0.76200000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.254,"5min":1.4850000000000001,"15min":1.8009999999999999},"last":1.012},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.93200000000000005,"15min":0.97299999999999998},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92500000000000004,"15min":0.96499999999999997},"min":{"1min":0.82699999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.294,"5min":1.667,"15min":1.667},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91800000000000004,"15min":0.96499999999999997},"min":{"1min":0.68799999999999994,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.111,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81699999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86199999999999999,"15min":0.95999999999999996},"min":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.194,"5min":1.446,"15min":1.446},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.01,"5min":1.0109999999999999,"15min":1.069},"min":{"1min":0.63700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.389,"5min":1.736,"15min":1.736},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":1.0940000000000001},"min":{"1min":0.65200000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3100000000000001,"5min":2.403,"15min":2.403},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.034,"5min":1.0329999999999999,"15min":1.119},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4239999999999999,"5min":1.53,"15min":1.53},"last":1.0700000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.052,"15min":1.1539999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.339,"5min":1.708,"15min":1.7230000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.153,"5min":1.1379999999999999,"15min":1.1899999999999999},"min":{"1min":1.0129999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5600000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.1359999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14916,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356924,"statfs":{"total":96636764160,"available":96621490176,"internally_reserved":0,"allocated":1175552,"data_stored":560130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1910000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":0.83699999999999997},"min":{"1min":0.53200000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.1859999999999999,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":1.089}]},{"osd":1,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91200000000000003,"15min":0.92100000000000004},"min":{"1min":0.56200000000000006,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0429999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.038},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.0369999999999999,"15min":0.96599999999999997},"min":{"1min":0.71699999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1830000000000001,"5min":7.8479999999999999,"15min":7.8479999999999999},"last":0.96199999999999997}]},{"osd":2,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.071,"5min":1.369,"15min":1.369},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.92300000000000004,"15min":0.90300000000000002},"min":{"1min":0.59499999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.107,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.997,"15min":0.93700000000000006},"min":{"1min":0.66100000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.236,"5min":7.923,"15min":7.923},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93300000000000005,"15min":0.93100000000000005},"min":{"1min":0.80500000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.99399999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91000000000000003,"15min":0.92200000000000004},"min":{"1min":0.60599999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.161,"5min":2.746,"15min":2.746},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0489999999999999,"15min":0.998},"min":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2410000000000001,"5min":7.9569999999999999,"15min":7.9569999999999999},"last":1.1830000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89500000000000002,"15min":0.89700000000000002},"min":{"1min":0.69699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.135,"5min":1.26,"15min":1.26},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0469999999999999,"15min":1.0589999999999999},"min":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2370000000000001,"5min":1.593,"15min":1.593},"last":1.1299999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.1120000000000001,"15min":1.0980000000000001},"min":{"1min":0.50700000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.288,"5min":8.0060000000000002,"15min":8.0060000000000002},"last":1.254},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.1259999999999999,"15min":1.1000000000000001},"min":{"1min":0.86399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2110000000000001,"5min":7.5730000000000004,"15min":7.5730000000000004},"last":1.0660000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542229,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14768,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94357072,"statfs":{"total":96636764160,"available":96621641728,"internally_reserved":0,"allocated":1155072,"data_stored":552046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.218,"5min":1.242,"15min":1.242},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.65900000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1799999999999999,"5min":1.52,"15min":1.52},"last":0.92400000000000004}]},{"osd":1,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.92600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2350000000000001,"5min":1.512,"15min":1.512},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.84699999999999998,"15min":0.88200000000000001},"min":{"1min":0.63300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0700000000000001,"5min":1.377,"15min":1.377},"last":1.091}]},{"osd":2,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.86599999999999999,"15min":0.877},"min":{"1min":0.74099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.115,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92200000000000004,"15min":0.94699999999999995},"min":{"1min":0.748,"5min":0.55300000000000005,"15min":0.51500000000000001},"max":{"1min":1.141,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.016}]},{"osd":3,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91700000000000004,"15min":0.90300000000000002},"min":{"1min":0.66800000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.004,"15min":1.0069999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.196,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.67600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.143,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.008,"5min":1.006,"15min":1.0600000000000001},"min":{"1min":0.72299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2609999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.153}]},{"osd":6,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0049999999999999,"15min":1.0489999999999999},"min":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.155,"5min":1.585,"15min":1.585},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0149999999999999,"15min":1.044},"min":{"1min":0.82599999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2350000000000001,"5min":1.4870000000000001,"15min":1.575},"last":1.1339999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:18:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.101,"15min":1.097},"min":{"1min":0.80100000000000005,"5min":0.77900000000000003,"15min":0.58199999999999996},"max":{"1min":1.3120000000000001,"5min":1.6379999999999999,"15min":1.6419999999999999},"last":1.107},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.129,"15min":1.1839999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.208,"5min":1.6779999999999999,"15min":1.889},"last":1.0740000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542229,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11024,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":9856,"kb_avail":94360816,"statfs":{"total":96636764160,"available":96625475584,"internally_reserved":0,"allocated":1187840,"data_stored":561166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10092544},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.431},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83999999999999997,"15min":0.84599999999999997},"min":{"1min":0.56299999999999994,"5min":0.53600000000000003,"15min":0.49399999999999999},"max":{"1min":1.1220000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90700000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.88300000000000001,"15min":0.88800000000000001},"min":{"1min":0.68700000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.2450000000000001,"5min":1.458,"15min":1.458},"last":1.052},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.90700000000000003,"15min":0.88700000000000001},"min":{"1min":0.79900000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.171,"5min":1.1870000000000001,"15min":1.401},"last":1.0289999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.67100000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.97099999999999997},"min":{"1min":0.66300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.2430000000000001,"5min":1.343,"15min":1.343},"last":1.077}]},{"osd":3,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85999999999999999,"15min":0.875},"min":{"1min":0.65300000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.1659999999999999,"5min":1.294,"15min":1.294},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.96299999999999997,"15min":1.0129999999999999},"min":{"1min":0.81499999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1919999999999999,"5min":1.536,"15min":1.8160000000000001},"last":0.751}]},{"osd":5,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95299999999999996,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.59099999999999997},"max":{"1min":1.3919999999999999,"5min":1.492,"15min":1.492},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.97799999999999998,"15min":0.96899999999999997},"min":{"1min":0.82399999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.21,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98699999999999999,"15min":1.012},"min":{"1min":0.69799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2569999999999999,"5min":1.585,"15min":1.6120000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0820000000000001,"15min":1.1060000000000001},"min":{"1min":0.72599999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4390000000000001,"5min":1.542,"15min":1.542},"last":0.875}]},{"osd":7,"last update":"Wed Nov 29 11:18:53 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0489999999999999,"15min":1.091},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.29,"5min":1.498,"15min":1.498},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.135,"15min":1.167},"min":{"1min":0.77800000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.399,"5min":1.625,"15min":1.905},"last":0.83899999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542230,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15052,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":13888,"kb_avail":94356788,"statfs":{"total":96636764160,"available":96621350912,"internally_reserved":0,"allocated":1183744,"data_stored":561064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14221312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68700000000000006,"15min":0.63},"min":{"1min":0.44,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.872,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.28499999999999998,"15min":0.27500000000000002},"max":{"1min":0.96199999999999997,"5min":1.282,"15min":1.282},"last":0.73599999999999999}]},{"osd":1,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.872,"15min":0.68700000000000006},"min":{"1min":0.53800000000000003,"5min":0.40699999999999997,"15min":0.34999999999999998},"max":{"1min":0.94099999999999995,"5min":19.015999999999998,"15min":19.015999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78600000000000003,"15min":0.74399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35899999999999999,"15min":0.31},"max":{"1min":1.018,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73299999999999998,"15min":0.68899999999999995},"min":{"1min":0.59499999999999997,"5min":0.39900000000000002,"15min":0.372},"max":{"1min":0.999,"5min":1.494,"15min":1.494},"last":0.623},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.97199999999999998,"15min":0.78600000000000003},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.1579999999999999,"5min":23.466000000000001,"15min":23.466000000000001},"last":0.79700000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.83199999999999996,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.266,"5min":15.255000000000001,"15min":15.255000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.1639999999999999,"15min":1.038},"min":{"1min":0.66700000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1870000000000001,"5min":23.792999999999999,"15min":23.792999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.1970000000000001,"15min":1.0269999999999999},"min":{"1min":0.81899999999999995,"5min":0.68300000000000005,"15min":0.63500000000000001},"max":{"1min":1.167,"5min":23.751000000000001,"15min":23.751000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.091,"15min":1.089},"min":{"1min":0.91600000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.2290000000000001,"5min":7.0110000000000001,"15min":7.0110000000000001},"last":1.1699999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.1830000000000001,"15min":1.0609999999999999},"min":{"1min":0.84299999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.288,"5min":15.292999999999999,"15min":15.292999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.335,"15min":1.139},"min":{"1min":0.80700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.272,"5min":23.428999999999998,"15min":23.428999999999998},"last":1.2290000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1319999999999999,"15min":1.1439999999999999},"min":{"1min":0.76500000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.29,"5min":6.4199999999999999,"15min":6.4199999999999999},"last":1.048},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2549999999999999,"15min":1.101},"min":{"1min":0.81699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.3680000000000001,"5min":15.428000000000001,"15min":15.428000000000001},"last":0.88400000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542229,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10816,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94361024,"statfs":{"total":96636764160,"available":96625688576,"internally_reserved":0,"allocated":1171456,"data_stored":559528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59799999999999998,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.82499999999999996,"5min":0.89800000000000002,"15min":0.97699999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68400000000000005,"15min":0.65900000000000003},"min":{"1min":0.56599999999999995,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92000000000000004,"5min":1.0229999999999999,"15min":1.107},"last":0.55200000000000005}]},{"osd":1,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.52200000000000002,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.82399999999999995,"5min":1.026,"15min":1.2410000000000001},"last":0.438},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.63500000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":1.095,"15min":1.095},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.59999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98299999999999998,"5min":1.1220000000000001,"15min":1.3069999999999999},"last":0.91900000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.90400000000000003,"15min":0.95899999999999996},"min":{"1min":0.65000000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.28,"15min":1.371},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91100000000000003,"15min":0.96299999999999997},"min":{"1min":0.76400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.141,"5min":1.385,"15min":1.532},"last":0.82899999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.82599999999999996,"5min":0.68100000000000005,"15min":0.622},"max":{"1min":1.173,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.66800000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.254,"5min":1.3540000000000001,"15min":1.7989999999999999},"last":1.1599999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95699999999999996,"15min":0.99299999999999999},"min":{"1min":0.74199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.135,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1,"5min":0.98699999999999999,"15min":1.0429999999999999},"min":{"1min":0.76300000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.212,"5min":1.302,"15min":1.7270000000000001},"last":0.96899999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0309999999999999,"15min":1.05},"min":{"1min":0.85499999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1850000000000001,"5min":1.569,"15min":1.76},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0269999999999999,"15min":1.0629999999999999},"min":{"1min":0.92200000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.208,"5min":1.3839999999999999,"15min":1.4910000000000001},"last":1.2470000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542229,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16064,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94355776,"statfs":{"total":96636764160,"available":96620314624,"internally_reserved":0,"allocated":1761280,"data_stored":1149862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.374},"max":{"1min":0.879,"5min":1.0469999999999999,"15min":1.2190000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.36499999999999999},"max":{"1min":0.93999999999999995,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.81100000000000005,"5min":0.98699999999999999,"15min":1.1439999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.01,"5min":1.081,"15min":1.393},"last":0.73499999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.998,"5min":1.2010000000000001,"15min":1.3520000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67700000000000005,"15min":0.70299999999999996},"min":{"1min":0.50700000000000001,"5min":0.39300000000000002,"15min":0.38100000000000001},"max":{"1min":0.88100000000000001,"5min":1.0600000000000001,"15min":1.744},"last":0.443}]},{"osd":4,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93600000000000005,"15min":0.95599999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60399999999999998},"max":{"1min":1.137,"5min":1.3879999999999999,"15min":1.609},"last":1.1619999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.98599999999999999,"15min":1.0249999999999999},"min":{"1min":0.71899999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.202,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.2230000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95499999999999996,"15min":0.99099999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.0820000000000001,"5min":1.4770000000000001,"15min":1.8660000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0029999999999999,"15min":1.014},"min":{"1min":0.85199999999999998,"5min":0.77500000000000002,"15min":0.65000000000000002},"max":{"1min":1.0920000000000001,"5min":1.4139999999999999,"15min":1.5609999999999999},"last":1.0629999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0029999999999999,"15min":1.0740000000000001},"min":{"1min":0.75800000000000001,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.319,"5min":1.575,"15min":1.575},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":0.98999999999999999},"min":{"1min":0.752,"5min":0.66700000000000004,"15min":0.65400000000000003},"max":{"1min":1.228,"5min":1.4099999999999999,"15min":2.1920000000000002},"last":1.2030000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:18:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0069999999999999,"15min":1.0609999999999999},"min":{"1min":0.84199999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.3029999999999999,"5min":1.444,"15min":2.2320000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0669999999999999,"15min":1.111},"min":{"1min":0.83799999999999997,"5min":0.78600000000000003,"15min":0.59099999999999997},"max":{"1min":1.2709999999999999,"5min":1.4850000000000001,"15min":1.6599999999999999},"last":1.1180000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542229,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15164,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94356676,"statfs":{"total":96636764160,"available":96621236224,"internally_reserved":0,"allocated":1167360,"data_stored":559074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.52000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.88600000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64600000000000002,"15min":0.66200000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90500000000000003,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68200000000000005,"15min":0.72599999999999998},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93999999999999995,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.74399999999999999},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.0509999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92500000000000004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80400000000000005,"15min":0.79600000000000004},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.41699999999999998},"max":{"1min":1.105,"5min":1.262,"15min":1.262},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.872,"15min":0.873},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.052,"5min":1.296,"15min":1.423},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.96099999999999997,"15min":1.002},"min":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2909999999999999,"5min":1.337,"15min":1.399},"last":0.94099999999999995}]},{"osd":5,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0049999999999999,"15min":1.0209999999999999},"min":{"1min":0.83299999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3149999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0089999999999999,"15min":1.0049999999999999},"min":{"1min":0.77400000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2989999999999999,"5min":1.3680000000000001,"15min":1.5089999999999999},"last":0.95999999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0369999999999999,"15min":1.083},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3740000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.753},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.1120000000000001},"min":{"1min":0.74199999999999999,"5min":0.629,"15min":0.629},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.5389999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0700000000000001,"15min":1.1319999999999999},"min":{"1min":0.78700000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3600000000000001,"5min":1.395,"15min":1.5649999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.0549999999999999,"15min":1.0800000000000001},"min":{"1min":0.90700000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3819999999999999,"5min":1.4730000000000001,"15min":1.5700000000000001},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:19:44.066 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-29T11:19:44.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-29T11:19:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.181+0000 7fceda19c700 1 Processor -- start 2023-11-29T11:19:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.181+0000 7fceda19c700 1 -- start start 2023-11-29T11:19:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fced406e000 0x7fced415c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced40cb100 0x7fced40c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced40c98e0 con 0x7fced406e3d0 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced40cb550 con 0x7fced406e000 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced415c940 con 0x7fced40cb100 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced999b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fced406e3d0 0x7fced40706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33312/0 (socket says 172.21.15.81:33312) 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced999b700 1 -- 172.21.15.81:0/1194366201 learned_addr learned my addr 172.21.15.81:0/1194366201 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced919a700 1 --2- 172.21.15.81:0/1194366201 >> v2:172.21.15.81:3300/0 conn(0x7fced406e000 0x7fced415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced8999700 1 --2- 172.21.15.81:0/1194366201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced40cb100 0x7fced40c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fcecbfff700 1 -- 172.21.15.81:0/1194366201 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398266392 0 0) 0x7fced40c98e0 con 0x7fced406e3d0 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fcecbfff700 1 -- 172.21.15.81:0/1194366201 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec00035d0 con 0x7fced406e3d0 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced919a700 1 -- 172.21.15.81:0/1194366201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced40cb100 msgr2=0x7fced40c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced919a700 1 --2- 172.21.15.81:0/1194366201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced40cb100 0x7fced40c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced919a700 1 -- 172.21.15.81:0/1194366201 >> v1:172.21.15.81:6789/0 conn(0x7fced406e3d0 legacy=0x7fced40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced919a700 1 -- 172.21.15.81:0/1194366201 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced415cc20 con 0x7fced406e000 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fced919a700 1 --2- 172.21.15.81:0/1194366201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced406e000 0x7fced415c250 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009850 tx=0x7fcec4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2861e2bbc352296b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fcecbfff700 1 -- 172.21.15.81:0/1194366201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4011830 con 0x7fced406e000 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fcecbfff700 1 -- 172.21.15.81:0/1194366201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4011990 con 0x7fced406e000 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fcecbfff700 1 -- 172.21.15.81:0/1194366201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4011d40 con 0x7fced406e000 2023-11-29T11:19:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 -- 172.21.15.81:0/1194366201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced406e000 msgr2=0x7fced415c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 --2- 172.21.15.81:0/1194366201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced406e000 0x7fced415c250 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009850 tx=0x7fcec4009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 -- 172.21.15.81:0/1194366201 shutdown_connections 2023-11-29T11:19:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 --2- 172.21.15.81:0/1194366201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced40cb100 0x7fced40c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 --2- 172.21.15.81:0/1194366201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced406e000 0x7fced415c250 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 -- 172.21.15.81:0/1194366201 >> 172.21.15.81:0/1194366201 conn(0x7fced40b1510 msgr2=0x7fced40ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 -- 172.21.15.81:0/1194366201 shutdown_connections 2023-11-29T11:19:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.185+0000 7fceda19c700 1 -- 172.21.15.81:0/1194366201 wait complete. 2023-11-29T11:19:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 Processor -- start 2023-11-29T11:19:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 -- start start 2023-11-29T11:19:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced406e000 0x7fced41f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced406e3d0 0x7fced4159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced40cb100 0x7fced40b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced415a860 con 0x7fced40cb100 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced41f1500 con 0x7fced406e3d0 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced4159fc0 con 0x7fced406e000 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced40cb100 0x7fced40b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced40cb100 0x7fced40b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46926/0 (socket says 172.21.15.81:46926) 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 -- 172.21.15.81:0/4052246176 learned_addr learned my addr 172.21.15.81:0/4052246176 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced8999700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced406e3d0 0x7fced4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced919a700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced406e000 0x7fced41f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 -- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced406e000 msgr2=0x7fced41f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced406e000 0x7fced41f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 -- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced406e3d0 msgr2=0x7fced4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced406e3d0 0x7fced4159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 -- 172.21.15.81:0/4052246176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec40094b0 con 0x7fced40cb100 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced919a700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced406e000 0x7fced41f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fced999b700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced40cb100 0x7fced40b1b80 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00cb40 tx=0x7fcecc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fcec9ffb700 1 -- 172.21.15.81:0/4052246176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00a7b0 con 0x7fced40cb100 2023-11-29T11:19:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fcec9ffb700 1 -- 172.21.15.81:0/4052246176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00a910 con 0x7fced40cb100 2023-11-29T11:19:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced415d1e0 con 0x7fced40cb100 2023-11-29T11:19:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.189+0000 7fcec9ffb700 1 -- 172.21.15.81:0/4052246176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00ac80 con 0x7fced40cb100 2023-11-29T11:19:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.193+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced415cf00 con 0x7fced40cb100 2023-11-29T11:19:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.193+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced406e810 con 0x7fced40cb100 2023-11-29T11:19:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.193+0000 7fcec9ffb700 1 -- 172.21.15.81:0/4052246176 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcecc019030 con 0x7fced40cb100 2023-11-29T11:19:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.193+0000 7fcec9ffb700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fceb8064ee0 0x7fceb8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.193+0000 7fced919a700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fceb8064ee0 0x7fceb8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.193+0000 7fcec9ffb700 1 -- 172.21.15.81:0/4052246176 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcecc081850 con 0x7fced40cb100 2023-11-29T11:19:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.197+0000 7fced919a700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fceb8064ee0 0x7fceb8067390 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcec40090b0 tx=0x7fcec4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:44.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.201+0000 7fcec9ffb700 1 -- 172.21.15.81:0/4052246176 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcecc04a400 con 0x7fced40cb100 2023-11-29T11:19:44.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.425+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fced415ea00 con 0x7fced40cb100 2023-11-29T11:19:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.433+0000 7fcec9ffb700 1 -- 172.21.15.81:0/4052246176 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcecc07fe60 con 0x7fced40cb100 2023-11-29T11:19:44.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fceb8064ee0 msgr2=0x7fceb8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fceb8064ee0 0x7fceb8067390 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcec40090b0 tx=0x7fcec4008030 comp rx=0 tx=0).stop 2023-11-29T11:19:44.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced40cb100 msgr2=0x7fced40b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced40cb100 0x7fced40b1b80 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00cb40 tx=0x7fcecc00cb70 comp rx=0 tx=0).stop 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 shutdown_connections 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fceb8064ee0 0x7fceb8067390 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced40cb100 0x7fced40b1b80 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fced406e3d0 0x7fced4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 --2- 172.21.15.81:0/4052246176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fced406e000 0x7fced41f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 >> 172.21.15.81:0/4052246176 conn(0x7fced40b1510 msgr2=0x7fced415ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 shutdown_connections 2023-11-29T11:19:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.437+0000 7fceda19c700 1 -- 172.21.15.81:0/4052246176 wait complete. 2023-11-29T11:19:44.445 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-11-29T11:19:44.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:44.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.561+0000 7f989f4fd700 1 Processor -- start 2023-11-29T11:19:44.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.561+0000 7f989f4fd700 1 -- start start 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f989806efd0 0x7f989806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f98980ca3d0 0x7f989806e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989806c9c0 con 0x7f9898158ee0 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980cd420 con 0x7f989806efd0 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980aede0 con 0x7f98980ca3d0 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989ca98700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f989806efd0 0x7f989806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989d299700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9898158ee0 0x7f98980ae6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33322/0 (socket says 172.21.15.81:33322) 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989d299700 1 -- 172.21.15.81:0/4108791948 learned_addr learned my addr 172.21.15.81:0/4108791948 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989da9a700 1 --2- 172.21.15.81:0/4108791948 >> v2:172.21.15.176:3300/0 conn(0x7f98980ca3d0 0x7f989806e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989ca98700 1 -- 172.21.15.81:0/4108791948 >> v2:172.21.15.176:3300/0 conn(0x7f98980ca3d0 msgr2=0x7f989806e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989ca98700 1 --2- 172.21.15.81:0/4108791948 >> v2:172.21.15.176:3300/0 conn(0x7f98980ca3d0 0x7f989806e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989ca98700 1 -- 172.21.15.81:0/4108791948 >> v1:172.21.15.81:6789/0 conn(0x7f9898158ee0 legacy=0x7f98980ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989ca98700 1 -- 172.21.15.81:0/4108791948 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98981592b0 con 0x7f989806efd0 2023-11-29T11:19:44.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989ca98700 1 --2- 172.21.15.81:0/4108791948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f989806e000 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f9888009850 tx=0x7f9888009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3029185ef6defb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:44.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f988ffff700 1 -- 172.21.15.81:0/4108791948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888011830 con 0x7f989806efd0 2023-11-29T11:19:44.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f988ffff700 1 -- 172.21.15.81:0/4108791948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888011990 con 0x7f989806efd0 2023-11-29T11:19:44.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f988ffff700 1 -- 172.21.15.81:0/4108791948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888011d20 con 0x7f989806efd0 2023-11-29T11:19:44.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 -- 172.21.15.81:0/4108791948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 msgr2=0x7f989806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 --2- 172.21.15.81:0/4108791948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f989806e000 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f9888009850 tx=0x7f9888009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:44.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 -- 172.21.15.81:0/4108791948 shutdown_connections 2023-11-29T11:19:44.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 --2- 172.21.15.81:0/4108791948 >> v2:172.21.15.176:3300/0 conn(0x7f98980ca3d0 0x7f989806e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 --2- 172.21.15.81:0/4108791948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f989806e000 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 -- 172.21.15.81:0/4108791948 >> 172.21.15.81:0/4108791948 conn(0x7f98980d02a0 msgr2=0x7f98980b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:44.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.565+0000 7f989f4fd700 1 -- 172.21.15.81:0/4108791948 shutdown_connections 2023-11-29T11:19:44.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 -- 172.21.15.81:0/4108791948 wait complete. 2023-11-29T11:19:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 Processor -- start 2023-11-29T11:19:44.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 -- start start 2023-11-29T11:19:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f98980c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98980ca3d0 0x7f98980b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9898158ee0 0x7f98980acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980b5430 con 0x7f989806efd0 2023-11-29T11:19:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980c4d60 con 0x7f98980ca3d0 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989f4fd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98980c5040 con 0x7f9898158ee0 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989d299700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f98980c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989d299700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f98980c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46948/0 (socket says 172.21.15.81:46948) 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989d299700 1 -- 172.21.15.81:0/835885831 learned_addr learned my addr 172.21.15.81:0/835885831 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989ca98700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98980ca3d0 0x7f98980b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.569+0000 7f989da9a700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9898158ee0 0x7f98980acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989d299700 1 -- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9898158ee0 msgr2=0x7f98980acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989d299700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9898158ee0 0x7f98980acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989d299700 1 -- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98980ca3d0 msgr2=0x7f98980b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989d299700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98980ca3d0 0x7f98980b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989d299700 1 -- 172.21.15.81:0/835885831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98880094b0 con 0x7f989806efd0 2023-11-29T11:19:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989ca98700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98980ca3d0 0x7f98980b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989d299700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f98980c4660 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f9894001eb0 tx=0x7f989400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f988dffb700 1 -- 172.21.15.81:0/835885831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894005d90 con 0x7f989806efd0 2023-11-29T11:19:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f988dffb700 1 -- 172.21.15.81:0/835885831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98940070d0 con 0x7f989806efd0 2023-11-29T11:19:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989806c400 con 0x7f989806efd0 2023-11-29T11:19:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f988dffb700 1 -- 172.21.15.81:0/835885831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894007440 con 0x7f989806efd0 2023-11-29T11:19:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989806c120 con 0x7f989806efd0 2023-11-29T11:19:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.573+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989806c6e0 con 0x7f989806efd0 2023-11-29T11:19:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.577+0000 7f988dffb700 1 -- 172.21.15.81:0/835885831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9894019030 con 0x7f989806efd0 2023-11-29T11:19:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.577+0000 7f988dffb700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f987c064ee0 0x7f987c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.577+0000 7f988dffb700 1 -- 172.21.15.81:0/835885831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9894081190 con 0x7f989806efd0 2023-11-29T11:19:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.577+0000 7f989ca98700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f987c064ee0 0x7f987c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:44.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.577+0000 7f989ca98700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f987c064ee0 0x7f987c067390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9888009850 tx=0x7f9888008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.585+0000 7f988dffb700 1 -- 172.21.15.81:0/835885831 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f989404a400 con 0x7f989806efd0 2023-11-29T11:19:44.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.781+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98980008d0 con 0x7f989806efd0 2023-11-29T11:19:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f988dffb700 1 -- 172.21.15.81:0/835885831 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f989404f1b0 con 0x7f989806efd0 2023-11-29T11:19:44.791 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:44.791 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:19:42.677504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8016":{"gid":8016,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1691706444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1691706444},{"type":"v1","addr":"172.21.15.176:6833","nonce":1691706444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:19:44.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f987c064ee0 msgr2=0x7f987c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f987c064ee0 0x7f987c067390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9888009850 tx=0x7f9888008030 comp rx=0 tx=0).stop 2023-11-29T11:19:44.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 msgr2=0x7f98980c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:44.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f98980c4660 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f9894001eb0 tx=0x7f989400c7b0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 shutdown_connections 2023-11-29T11:19:44.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f987c064ee0 0x7f987c067390 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9898158ee0 0x7f98980acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98980ca3d0 0x7f98980b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 --2- 172.21.15.81:0/835885831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f989806efd0 0x7f98980c4660 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 >> 172.21.15.81:0/835885831 conn(0x7f98980d02a0 msgr2=0x7f98980ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 shutdown_connections 2023-11-29T11:19:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:44.785+0000 7f989f4fd700 1 -- 172.21.15.81:0/835885831 wait complete. 2023-11-29T11:19:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 54 2023-11-29T11:19:45.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:19:39.666846+0000', 'modified': '2023-11-29T11:19:42.677504+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8016}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8016': {'gid': 8016, 'name': 'd', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6833/1691706444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6832', 'nonce': 1691706444}, {'type': 'v1', 'addr': '172.21.15.176:6833', 'nonce': 1691706444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:19:45.210 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:19:45.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-29T11:19:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b77343700 1 Processor -- start 2023-11-29T11:19:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b77343700 1 -- start start 2023-11-29T11:19:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b77343700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b70069c40 0x7f3b700cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b77343700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7006ace0 con 0x7f3b70159e70 2023-11-29T11:19:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b77343700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7006a0d0 con 0x7f3b700cb2a0 2023-11-29T11:19:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b77343700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b700cb720 con 0x7f3b70069c40 2023-11-29T11:19:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b76341700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3b70159e70 0x7f3b7006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33328/0 (socket says 172.21.15.81:33328) 2023-11-29T11:19:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b76341700 1 -- 172.21.15.81:0/2012524397 learned_addr learned my addr 172.21.15.81:0/2012524397 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:45.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b75b40700 1 --2- 172.21.15.81:0/2012524397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b70069c40 0x7f3b700cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b7533f700 1 -- 172.21.15.81:0/2012524397 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910680204 0 0) 0x7f3b7006ace0 con 0x7f3b70159e70 2023-11-29T11:19:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b7533f700 1 -- 172.21.15.81:0/2012524397 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b5c0035d0 con 0x7f3b70159e70 2023-11-29T11:19:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b7533f700 1 -- 172.21.15.81:0/2012524397 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705760905 0 0) 0x7f3b7006a0d0 con 0x7f3b700cb2a0 2023-11-29T11:19:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b7533f700 1 -- 172.21.15.81:0/2012524397 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b7006ace0 con 0x7f3b700cb2a0 2023-11-29T11:19:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b75b40700 1 -- 172.21.15.81:0/2012524397 >> v1:172.21.15.176:6789/0 conn(0x7f3b700cb2a0 legacy=0x7f3b700c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b75b40700 1 -- 172.21.15.81:0/2012524397 >> v1:172.21.15.81:6789/0 conn(0x7f3b70159e70 legacy=0x7f3b7006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b75b40700 1 -- 172.21.15.81:0/2012524397 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7006a3b0 con 0x7f3b70069c40 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b75b40700 1 --2- 172.21.15.81:0/2012524397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b70069c40 0x7f3b700cad60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009880 tx=0x7f3b60009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf5240f8652c67f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b7533f700 1 -- 172.21.15.81:0/2012524397 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60011830 con 0x7f3b70069c40 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b7533f700 1 -- 172.21.15.81:0/2012524397 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b60011990 con 0x7f3b70069c40 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b7533f700 1 -- 172.21.15.81:0/2012524397 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60011d00 con 0x7f3b70069c40 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b77343700 1 -- 172.21.15.81:0/2012524397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b70069c40 msgr2=0x7f3b700cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.329+0000 7f3b77343700 1 --2- 172.21.15.81:0/2012524397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b70069c40 0x7f3b700cad60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009880 tx=0x7f3b60009b90 comp rx=0 tx=0).stop 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 -- 172.21.15.81:0/2012524397 shutdown_connections 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 --2- 172.21.15.81:0/2012524397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b70069c40 0x7f3b700cad60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 -- 172.21.15.81:0/2012524397 >> 172.21.15.81:0/2012524397 conn(0x7f3b700ce3e0 msgr2=0x7f3b700ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 -- 172.21.15.81:0/2012524397 shutdown_connections 2023-11-29T11:19:45.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 -- 172.21.15.81:0/2012524397 wait complete. 2023-11-29T11:19:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 Processor -- start 2023-11-29T11:19:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 -- start start 2023-11-29T11:19:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b70069c40 0x7f3b701f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b700cb2a0 0x7f3b7015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70159e70 0x7f3b7015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7015cc20 con 0x7f3b70069c40 2023-11-29T11:19:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7015c910 con 0x7f3b70159e70 2023-11-29T11:19:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b77343700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7014f710 con 0x7f3b700cb2a0 2023-11-29T11:19:45.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b76341700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b70069c40 0x7f3b701f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b75b40700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b700cb2a0 0x7f3b7015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b76341700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b70069c40 0x7f3b701f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46958/0 (socket says 172.21.15.81:46958) 2023-11-29T11:19:45.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b76b42700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70159e70 0x7f3b7015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b75b40700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b700cb2a0 0x7f3b7015a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:60458/0 (socket says 172.21.15.81:60458) 2023-11-29T11:19:45.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.333+0000 7f3b76341700 1 -- 172.21.15.81:0/319432246 learned_addr learned my addr 172.21.15.81:0/319432246 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:45.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b76b42700 1 -- 172.21.15.81:0/319432246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b700cb2a0 msgr2=0x7f3b7015a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b76b42700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b700cb2a0 0x7f3b7015a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b76b42700 1 -- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b70069c40 msgr2=0x7f3b701f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b76b42700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b70069c40 0x7f3b701f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b76b42700 1 -- 172.21.15.81:0/319432246 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b600094b0 con 0x7f3b70159e70 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b76341700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b70069c40 0x7f3b701f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b76b42700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70159e70 0x7f3b7015a780 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800cbc0 tx=0x7f3b6800ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b66ffd700 1 -- 172.21.15.81:0/319432246 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68003c20 con 0x7f3b70159e70 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b77343700 1 -- 172.21.15.81:0/319432246 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7006a970 con 0x7f3b70159e70 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b66ffd700 1 -- 172.21.15.81:0/319432246 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68003d80 con 0x7f3b70159e70 2023-11-29T11:19:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b66ffd700 1 -- 172.21.15.81:0/319432246 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800aa80 con 0x7f3b70159e70 2023-11-29T11:19:45.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b77343700 1 -- 172.21.15.81:0/319432246 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7006a690 con 0x7f3b70159e70 2023-11-29T11:19:45.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.337+0000 7f3b66ffd700 1 -- 172.21.15.81:0/319432246 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3b68010050 con 0x7f3b70159e70 2023-11-29T11:19:45.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b66ffd700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b54064ee0 0x7f3b54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b66ffd700 1 -- 172.21.15.81:0/319432246 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3b68081e90 con 0x7f3b70159e70 2023-11-29T11:19:45.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76341700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b54064ee0 0x7f3b54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76341700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b54064ee0 0x7f3b54067390 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c000f60 tx=0x7f3b6c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b7b825740 1 Processor -- start 2023-11-29T11:19:45.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b7b825740 1 -- start start 2023-11-29T11:19:45.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26dee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 0x26df340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26df880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b7b825740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x259dae0 con 0x2479790 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b7b825740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x260dbd0 con 0x242e710 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b7b825740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2606ed0 con 0x242eae0 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26df880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26df880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46970/0 (socket says 172.21.15.81:46970) 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 -- 172.21.15.81:0/4028938021 learned_addr learned my addr 172.21.15.81:0/4028938021 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76341700 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26dee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b75b40700 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 0x26df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 -- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 msgr2=0x26dee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26dee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 -- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 msgr2=0x26df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 0x26df340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 -- 172.21.15.81:0/4028938021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x262ccc0 con 0x2479790 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76341700 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.341+0000 7f3b76b42700 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26df880 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f3b6805bc70 tx=0x7f3b6805bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1604f9a2ed32fb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b53fff700 1 -- 172.21.15.81:0/4028938021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68051f90 con 0x2479790 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b53fff700 1 -- 172.21.15.81:0/4028938021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68053020 con 0x2479790 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b53fff700 1 -- 172.21.15.81:0/4028938021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6805b730 con 0x2479790 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- 172.21.15.81:0/4028938021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 msgr2=0x26df880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26df880 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f3b6805bc70 tx=0x7f3b6805bca0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- 172.21.15.81:0/4028938021 shutdown_connections 2023-11-29T11:19:45.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26df880 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 0x26df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 --2- 172.21.15.81:0/4028938021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- 172.21.15.81:0/4028938021 >> 172.21.15.81:0/4028938021 conn(0x242eeb0 msgr2=0x26c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:45.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- 172.21.15.81:0/4028938021 shutdown_connections 2023-11-29T11:19:45.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- 172.21.15.81:0/4028938021 wait complete. 2023-11-29T11:19:45.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- start start 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 Processor -- start 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242e710 0x269d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x269f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 0x26c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x24b3b20 con 0x242e710 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x269f560 con 0x2479790 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x26c75c0 con 0x242eae0 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b7b825740 10 client.0 _ll_register_callbacks cb 0x26630d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b76341700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242e710 0x269d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b76341700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242e710 0x269d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46978/0 (socket says 172.21.15.81:46978) 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b76341700 1 -- 172.21.15.81:0/894817727 learned_addr learned my addr 172.21.15.81:0/894817727 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b75b40700 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x269f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b76b42700 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 0x26c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b76341700 1 -- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 msgr2=0x269f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b76341700 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x269f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b76341700 1 -- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 msgr2=0x26c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.345+0000 7f3b76341700 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 0x26c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b76341700 1 -- 172.21.15.81:0/894817727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7006a690 con 0x242e710 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b75b40700 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x269f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:45.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b76341700 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242e710 0x269d4d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c014a50 tx=0x7f3b6c001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226efc04bf4479c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b517fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b517fa700 1 -- 172.21.15.81:0/894817727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0135c0 con 0x242e710 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b517fa700 1 -- 172.21.15.81:0/894817727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3b6c01c040 con 0x242e710 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 1 -- 172.21.15.81:0/894817727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25fff50 con 0x242e710 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b517fa700 1 -- 172.21.15.81:0/894817727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b6c013720 con 0x242e710 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 10 client.8154 fetch_fsmap learned FSMap version 54 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 1 -- 172.21.15.81:0/894817727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x247a9e0 con 0x242e710 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b517fa700 1 -- 172.21.15.81:0/894817727 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25fff50 con 0x242e710 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b517fa700 1 -- 172.21.15.81:0/894817727 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 54) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f3b6c013880 con 0x242e710 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 10 client.8154 fetch_fsmap finished waiting for FSMap version 54 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 10 client.8154 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 20 client.8154 populate_metadata read hostname 'smithi081' 2023-11-29T11:19:45.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] conn(0x269c050 0x26eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 4 client.8154 mds_command: new command op to 8016 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:19:45.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b7b825740 1 -- 172.21.15.81:0/894817727 --> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25ffc70 con 0x269c050 2023-11-29T11:19:45.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b75b40700 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] conn(0x269c050 0x26eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b517fa700 10 client.8154 ms_handle_connect on v2:172.21.15.176:6832/1691706444 2023-11-29T11:19:45.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.349+0000 7f3b75b40700 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] conn(0x269c050 0x26eb6f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c11878f3d6fae771 server_cookie=d9d0720ca0a10eac in_seq=0 out_seq=0 2023-11-29T11:19:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b517fa700 1 -- 172.21.15.81:0/894817727 <== mds.0 v2:172.21.15.176:6832/1691706444 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x25ffc70 con 0x269c050 2023-11-29T11:19:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b517fa700 10 client.8154 handle_command_reply: tid=0 2023-11-29T11:19:45.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 client.8154 shutdown 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 -- 172.21.15.81:0/894817727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242e710 msgr2=0x269d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242e710 0x269d4d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c014a50 tx=0x7f3b6c001150 comp rx=0 tx=0).stop 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 -- 172.21.15.81:0/894817727 shutdown_connections 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] conn(0x269c050 0x26eb6f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 0x26c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x269f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b517fa700 0 client.8154 ms_handle_reset on v2:172.21.15.176:6832/1691706444 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 --2- 172.21.15.81:0/894817727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242e710 0x269d4d0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 -- 172.21.15.81:0/894817727 >> 172.21.15.81:0/894817727 conn(0x242eeb0 msgr2=0x26c7780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 -- 172.21.15.81:0/894817727 shutdown_connections 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 1 -- 172.21.15.81:0/894817727 wait complete. 2023-11-29T11:19:45.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.353+0000 7f3b7b825740 20 client.8154 trim_cache size 0 max 16384 2023-11-29T11:19:45.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.373+0000 7f3b7b825740 1 Processor -- start 2023-11-29T11:19:45.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.373+0000 7f3b7b825740 1 -- start start 2023-11-29T11:19:45.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242e710 0x269d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242eae0 0x26ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 0x26ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x26042d0 con 0x242eae0 2023-11-29T11:19:45.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x269fd00 con 0x2479790 2023-11-29T11:19:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x260b040 con 0x242e710 2023-11-29T11:19:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242eae0 0x26ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242eae0 0x26ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46990/0 (socket says 172.21.15.81:46990) 2023-11-29T11:19:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 -- 172.21.15.81:0/199271658 learned_addr learned my addr 172.21.15.81:0/199271658 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b76b42700 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 0x26ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b76341700 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242e710 0x269d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 -- 172.21.15.81:0/199271658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242e710 msgr2=0x269d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242e710 0x269d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 -- 172.21.15.81:0/199271658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 msgr2=0x26ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 0x26ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 -- 172.21.15.81:0/199271658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b700701e0 con 0x242eae0 2023-11-29T11:19:45.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b75b40700 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242eae0 0x26ac8c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3b60013040 tx=0x7f3b60009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03cd0c6f06c9e6e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b64ff9700 1 -- 172.21.15.81:0/199271658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60020040 con 0x242eae0 2023-11-29T11:19:45.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b64ff9700 1 -- 172.21.15.81:0/199271658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b60021040 con 0x242eae0 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b64ff9700 1 -- 172.21.15.81:0/199271658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60028290 con 0x242eae0 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- 172.21.15.81:0/199271658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242eae0 msgr2=0x26ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242eae0 0x26ac8c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3b60013040 tx=0x7f3b60009f90 comp rx=0 tx=0).stop 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- 172.21.15.81:0/199271658 shutdown_connections 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2479790 0x26ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242eae0 0x26ac8c0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 --2- 172.21.15.81:0/199271658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242e710 0x269d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- 172.21.15.81:0/199271658 >> 172.21.15.81:0/199271658 conn(0x242eeb0 msgr2=0x26c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- 172.21.15.81:0/199271658 shutdown_connections 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- 172.21.15.81:0/199271658 wait complete. 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 -- start start 2023-11-29T11:19:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.377+0000 7f3b7b825740 1 Processor -- start 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 0x2741b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26fbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2742070 con 0x2479790 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x26fc490 con 0x242e710 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x26fa100 con 0x242eae0 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 10 client.0 _ll_register_callbacks cb 0x25b32d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26fbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26fbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47006/0 (socket says 172.21.15.81:47006) 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 -- 172.21.15.81:0/3370264832 learned_addr learned my addr 172.21.15.81:0/3370264832 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76341700 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 0x2741b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b75b40700 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 -- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 msgr2=0x26fba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26fba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 -- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 msgr2=0x2741b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 0x2741b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 -- 172.21.15.81:0/3370264832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7006a3b0 con 0x2479790 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76b42700 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26fbf50 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f3b68053a60 tx=0x7f3b68056070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837271988f3831f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b517fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b517fa700 1 -- 172.21.15.81:0/3370264832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6805b930 con 0x2479790 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b517fa700 1 -- 172.21.15.81:0/3370264832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3b6807f040 con 0x2479790 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 -- 172.21.15.81:0/3370264832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b68053020 con 0x2479790 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b517fa700 1 -- 172.21.15.81:0/3370264832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b680538a0 con 0x2479790 2023-11-29T11:19:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 10 client.8160 fetch_fsmap learned FSMap version 54 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 -- 172.21.15.81:0/3370264832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x25b3a20 con 0x2479790 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b517fa700 1 -- 172.21.15.81:0/3370264832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68053020 con 0x2479790 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b517fa700 1 -- 172.21.15.81:0/3370264832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 54) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f3b6804f920 con 0x2479790 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 10 client.8160 fetch_fsmap finished waiting for FSMap version 54 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 10 client.8160 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 20 client.8160 populate_metadata read hostname 'smithi081' 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] conn(0x26f91a0 0x26f9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 4 client.8160 mds_command: new command op to 8016 tid=0[{"prefix": "status"}] 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b7b825740 1 -- 172.21.15.81:0/3370264832 --> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] -- command(tid 0: {"prefix": "status"}) v1 -- 0x24ab260 con 0x26f91a0 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76341700 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] conn(0x26f91a0 0x26f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b517fa700 10 client.8160 ms_handle_connect on v2:172.21.15.176:6832/1691706444 2023-11-29T11:19:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.381+0000 7f3b76341700 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] conn(0x26f91a0 0x26f9570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14e55af36810ad4 server_cookie=9dc7acf049397c68 in_seq=0 out_seq=0 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b517fa700 1 -- 172.21.15.81:0/3370264832 <== mds.0 v2:172.21.15.176:6832/1691706444 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x24ab260 con 0x26f91a0 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b517fa700 10 client.8160 handle_command_reply: tid=0 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 client.8160 shutdown 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 -- 172.21.15.81:0/3370264832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 msgr2=0x26fbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26fbf50 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f3b68053a60 tx=0x7f3b68056070 comp rx=0 tx=0).stop 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 -- 172.21.15.81:0/3370264832 shutdown_connections 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:6832/1691706444,v1:172.21.15.176:6833/1691706444] conn(0x26f91a0 0x26f9570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2479790 0x26fbf50 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b517fa700 0 client.8160 ms_handle_reset on v2:172.21.15.176:6832/1691706444 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x242eae0 0x26fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 --2- 172.21.15.81:0/3370264832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x242e710 0x2741b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 -- 172.21.15.81:0/3370264832 >> 172.21.15.81:0/3370264832 conn(0x242eeb0 msgr2=0x26c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 -- 172.21.15.81:0/3370264832 shutdown_connections 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 1 -- 172.21.15.81:0/3370264832 wait complete. 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b7b825740 20 client.8160 trim_cache size 0 max 16384 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8016, 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:19:45.396 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:19:45.397 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:19:45.397 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.7160241190000001, 2023-11-29T11:19:45.397 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 54, 2023-11-29T11:19:45.397 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 96, 2023-11-29T11:19:45.397 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 96, 2023-11-29T11:19:45.397 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 10.230200223000001 2023-11-29T11:19:45.397 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:19:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 -- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b54064ee0 msgr2=0x7f3b54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b54064ee0 0x7f3b54067390 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c000f60 tx=0x7f3b6c009040 comp rx=0 tx=0).stop 2023-11-29T11:19:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 -- 172.21.15.81:0/319432246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70159e70 msgr2=0x7f3b7015a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70159e70 0x7f3b7015a780 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800cbc0 tx=0x7f3b6800ced0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 -- 172.21.15.81:0/319432246 shutdown_connections 2023-11-29T11:19:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3b54064ee0 0x7f3b54067390 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b70159e70 0x7f3b7015a780 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b700cb2a0 0x7f3b7015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 --2- 172.21.15.81:0/319432246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b70069c40 0x7f3b701f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 -- 172.21.15.81:0/319432246 >> 172.21.15.81:0/319432246 conn(0x7f3b700ce3e0 msgr2=0x7f3b700ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 -- 172.21.15.81:0/319432246 shutdown_connections 2023-11-29T11:19:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.385+0000 7f3b77343700 1 -- 172.21.15.81:0/319432246 wait complete. 2023-11-29T11:19:45.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:19:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0188aaf700 1 Processor -- start 2023-11-29T11:19:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0188aaf700 1 -- start start 2023-11-29T11:19:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0188aaf700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f01840cb460 0x7f01840c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0188aaf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840ad490 0x7f01840cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0188aaf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01840cd8f0 con 0x7f0184158e60 2023-11-29T11:19:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0188aaf700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01840add00 con 0x7f01840cb460 2023-11-29T11:19:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0188aaf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01840cc4f0 con 0x7f01840ad490 2023-11-29T11:19:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f01837fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0184158e60 0x7f01840cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33342/0 (socket says 172.21.15.81:33342) 2023-11-29T11:19:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f01837fe700 1 -- 172.21.15.81:0/3874778118 learned_addr learned my addr 172.21.15.81:0/3874778118 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0182ffd700 1 --2- 172.21.15.81:0/3874778118 >> v2:172.21.15.176:3300/0 conn(0x7f01840cb460 0x7f01840c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0183fff700 1 --2- 172.21.15.81:0/3874778118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840ad490 0x7f01840cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f01827fc700 1 -- 172.21.15.81:0/3874778118 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314353436 0 0) 0x7f01840cd8f0 con 0x7f0184158e60 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f01827fc700 1 -- 172.21.15.81:0/3874778118 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f016c0035d0 con 0x7f0184158e60 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0183fff700 1 -- 172.21.15.81:0/3874778118 >> v2:172.21.15.176:3300/0 conn(0x7f01840cb460 msgr2=0x7f01840c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0183fff700 1 --2- 172.21.15.81:0/3874778118 >> v2:172.21.15.176:3300/0 conn(0x7f01840cb460 0x7f01840c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0183fff700 1 -- 172.21.15.81:0/3874778118 >> v1:172.21.15.81:6789/0 conn(0x7f0184158e60 legacy=0x7f01840cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0183fff700 1 -- 172.21.15.81:0/3874778118 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018406dc60 con 0x7f01840ad490 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.517+0000 7f0182ffd700 1 --2- 172.21.15.81:0/3874778118 >> v2:172.21.15.176:3300/0 conn(0x7f01840cb460 0x7f01840c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0183fff700 1 --2- 172.21.15.81:0/3874778118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840ad490 0x7f01840cbfb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f017c009850 tx=0x7f017c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bb4454261bc68e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f01827fc700 1 -- 172.21.15.81:0/3874778118 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c011830 con 0x7f01840ad490 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f01827fc700 1 -- 172.21.15.81:0/3874778118 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c011990 con 0x7f01840ad490 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f01827fc700 1 -- 172.21.15.81:0/3874778118 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c011d40 con 0x7f01840ad490 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 -- 172.21.15.81:0/3874778118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840ad490 msgr2=0x7f01840cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 --2- 172.21.15.81:0/3874778118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840ad490 0x7f01840cbfb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f017c009850 tx=0x7f017c009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 -- 172.21.15.81:0/3874778118 shutdown_connections 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 --2- 172.21.15.81:0/3874778118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840ad490 0x7f01840cbfb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 --2- 172.21.15.81:0/3874778118 >> v2:172.21.15.176:3300/0 conn(0x7f01840cb460 0x7f01840c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 -- 172.21.15.81:0/3874778118 >> 172.21.15.81:0/3874778118 conn(0x7f01840ce3e0 msgr2=0x7f01840ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 -- 172.21.15.81:0/3874778118 shutdown_connections 2023-11-29T11:19:45.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 -- 172.21.15.81:0/3874778118 wait complete. 2023-11-29T11:19:45.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 Processor -- start 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.521+0000 7f0188aaf700 1 -- start start 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01840ad490 0x7f0184155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840cb460 0x7f01840c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184158e60 0x7f01840aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01841562e0 con 0x7f0184158e60 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0184156a60 con 0x7f01840ad490 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0184156d40 con 0x7f01840cb460 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184158e60 0x7f01840aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184158e60 0x7f01840aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47018/0 (socket says 172.21.15.81:47018) 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 -- 172.21.15.81:0/2091640352 learned_addr learned my addr 172.21.15.81:0/2091640352 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0182ffd700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840cb460 0x7f01840c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f01837fe700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01840ad490 0x7f0184155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 -- 172.21.15.81:0/2091640352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840cb460 msgr2=0x7f01840c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840cb460 0x7f01840c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 -- 172.21.15.81:0/2091640352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01840ad490 msgr2=0x7f0184155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01840ad490 0x7f0184155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 -- 172.21.15.81:0/2091640352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0174009a70 con 0x7f0184158e60 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0183fff700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184158e60 0x7f01840aefc0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f017c0090b0 tx=0x7f017c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f016bfff700 1 -- 172.21.15.81:0/2091640352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c01a850 con 0x7f0184158e60 2023-11-29T11:19:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f016bfff700 1 -- 172.21.15.81:0/2091640352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c01f070 con 0x7f0184158e60 2023-11-29T11:19:45.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c0094b0 con 0x7f0184158e60 2023-11-29T11:19:45.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f016bfff700 1 -- 172.21.15.81:0/2091640352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c01ac10 con 0x7f0184158e60 2023-11-29T11:19:45.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0184159230 con 0x7f0184158e60 2023-11-29T11:19:45.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01840cde90 con 0x7f0184158e60 2023-11-29T11:19:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.525+0000 7f016bfff700 1 -- 172.21.15.81:0/2091640352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f017c00f050 con 0x7f0184158e60 2023-11-29T11:19:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.529+0000 7f016bfff700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0170064f10 0x7f01700673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.529+0000 7f016bfff700 1 -- 172.21.15.81:0/2091640352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f017c083050 con 0x7f0184158e60 2023-11-29T11:19:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.529+0000 7f01837fe700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0170064f10 0x7f01700673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.529+0000 7f01837fe700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0170064f10 0x7f01700673c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f01780011e0 tx=0x7f0178009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.537+0000 7f016bfff700 1 -- 172.21.15.81:0/2091640352 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f017c0510b0 con 0x7f0184158e60 2023-11-29T11:19:45.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.733+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f018406d6a0 con 0x7f0184158e60 2023-11-29T11:19:45.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.733+0000 7f016bfff700 1 -- 172.21.15.81:0/2091640352 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7f017c021060 con 0x7f0184158e60 2023-11-29T11:19:45.740 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0170064f10 msgr2=0x7f01700673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0170064f10 0x7f01700673c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f01780011e0 tx=0x7f0178009040 comp rx=0 tx=0).stop 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184158e60 msgr2=0x7f01840aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184158e60 0x7f01840aefc0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f017c0090b0 tx=0x7f017c004770 comp rx=0 tx=0).stop 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 shutdown_connections 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0170064f10 0x7f01700673c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0184158e60 0x7f01840aefc0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01840cb460 0x7f01840c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 --2- 172.21.15.81:0/2091640352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01840ad490 0x7f0184155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 >> 172.21.15.81:0/2091640352 conn(0x7f01840ce3e0 msgr2=0x7f0184158220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 shutdown_connections 2023-11-29T11:19:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:45.737+0000 7f0188aaf700 1 -- 172.21.15.81:0/2091640352 wait complete. 2023-11-29T11:19:45.755 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:19:45.755 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:19:45.755 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:19:45.756 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:19:45.756 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:45.756 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:19:45.756 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:19:45.756 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:19:45.756 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:19:45.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:45.756 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:19:45.766 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:19:45.766 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:19:45.766 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:19:45.766 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:45.766 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:19:45.766 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:45.766 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42181sec preferred_lft 42181sec 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:45.767 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:19:45.768 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:19:45.769 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:19:45.769 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:45.769 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:19:45.769 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:19:45.769 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:19:45.769 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:19:45.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:45.770 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:19:45.783 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:19:45.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:45.785 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:19:45.834 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:19:45.835 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:19:45.835 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:19:45.835 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:19:45.835 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:19:45.835 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:19:45.835 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:19:45.835 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:19:45.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:45.836 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:19:45.836 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:19:45.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:19:45.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:19:45.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:19:45.836 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:19:45.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:45.876 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:19:45.884 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:19:45.884 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:19:45.885 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:19:45.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:45.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:19:45.941 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:19:45.941 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:19:45.941 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:45.948 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:19:45.949 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:19:45.949 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:45.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:19:46.013 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:19:46.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:19:46.025 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:19:46.026 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:19:46.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:46.027 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:19:46.033 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:19:46.033 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:19:46.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:19:46.092 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:19:46.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:19:46.102 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:19:46.102 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:19:46.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:46.103 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:19:46.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:19:46.161+0000 7f260afff640 -1 init, newargv = 0x55903f213a20 newargc=15 2023-11-29T11:19:46.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[57941]: starting ceph client 2023-11-29T11:19:46.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[57941]: starting fuse 2023-11-29T11:19:47.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:19:47.230 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:19:47.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:19:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:19:47.248 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:19:47.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:47.249 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:19:47.298 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:19:47.298 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:19:47.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:19:47.298 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:19:47.298 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:19:47.299 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:19:47.300 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:19:47.385 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.57941.asok 2023-11-29T11:19:47.570 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57941.asok 2023-11-29T11:19:47.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:47.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57941.asok status 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "57941", 2023-11-29T11:19:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8172, 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8172 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:19:47.724 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 4134260749 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 4134260749 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.8172 192.168.0.1:0/4134260749", 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/4134260749", 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:19:47.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 54, 2023-11-29T11:19:47.726 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 96, 2023-11-29T11:19:47.726 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:19:47.726 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:19:47.726 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:19:47.726 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:19:47.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:47.733 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:19:47.733 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:47.739 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:19:47.739 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:47.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:47.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:47.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:47.755 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2023-11-29T11:19:47.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:47.775 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2023-11-29T11:19:47.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:47.832 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2023-11-29T11:19:47.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:47.845 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2023-11-29T11:19:47.867 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:19:47.867 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:19:47.867 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:19:47.867 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:19:47.867 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2023-11-29T11:19:47.867 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:19:47.936 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627776 2023-11-29T11:19:48.125 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:19:48.125 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:48.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.241+0000 7f040a648700 1 Processor -- start 2023-11-29T11:19:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.241+0000 7f040a648700 1 -- start start 2023-11-29T11:19:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f040a648700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04040ab850 0x7f0404145460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f040a648700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0404069ce0 con 0x7f0404145090 2023-11-29T11:19:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f040a648700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0404069fc0 con 0x7f040406cd50 2023-11-29T11:19:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f040a648700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040406a2a0 con 0x7f04040ab850 2023-11-29T11:19:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409646700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0404145090 0x7f040406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33346/0 (socket says 172.21.15.81:33346) 2023-11-29T11:19:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409646700 1 -- 172.21.15.81:0/3503975969 learned_addr learned my addr 172.21.15.81:0/3503975969 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 --2- 172.21.15.81:0/3503975969 >> v2:172.21.15.176:3300/0 conn(0x7f04040ab850 0x7f0404145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006368331 0 0) 0x7f0404069ce0 con 0x7f0404145090 2023-11-29T11:19:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03f00035d0 con 0x7f0404145090 2023-11-29T11:19:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 972028234 0 0) 0x7f03f00035d0 con 0x7f0404145090 2023-11-29T11:19:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 >> v2:172.21.15.176:3300/0 conn(0x7f04040ab850 msgr2=0x7f0404145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 --2- 172.21.15.81:0/3503975969 >> v2:172.21.15.176:3300/0 conn(0x7f04040ab850 0x7f0404145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 >> v1:172.21.15.176:6789/0 conn(0x7f040406cd50 legacy=0x7f040406ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040406a580 con 0x7f0404145090 2023-11-29T11:19:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f0400001670 con 0x7f0404145090 2023-11-29T11:19:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 >> v1:172.21.15.81:6789/0 conn(0x7f0404145090 legacy=0x7f040406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0003a20 0x7f03f0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f0004410 0x7f03f00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f03f000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040406a2a0 con 0x7f03f00050d0 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f000c020 con 0x7f03f0004410 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f000c1e0 con 0x7f03f0003a20 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f03f000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0408e45700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f0004410 0x7f03f00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409646700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0003a20 0x7f03f0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 -- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0003a20 msgr2=0x7f03f0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0003a20 0x7f03f0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 -- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f0004410 msgr2=0x7f03f00048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f0004410 0x7f03f00048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 -- 172.21.15.81:0/3503975969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00035d0 con 0x7f03f00050d0 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409646700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0003a20 0x7f03f0003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 -- 172.21.15.81:0/3503975969 reap_dead start 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f0409e47700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f03f000ba30 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009fc0 tx=0x7f03f00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278e04611b4ea6c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc003a40 con 0x7f03f00050d0 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc00f040 con 0x7f03f00050d0 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.245+0000 7f03fbfff700 1 -- 172.21.15.81:0/3503975969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc003e00 con 0x7f03f00050d0 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 -- 172.21.15.81:0/3503975969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 msgr2=0x7f03f000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f03f000ba30 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009fc0 tx=0x7f03f00058a0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 -- 172.21.15.81:0/3503975969 shutdown_connections 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 --2- 172.21.15.81:0/3503975969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f03f000ba30 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 -- 172.21.15.81:0/3503975969 >> 172.21.15.81:0/3503975969 conn(0x7f040406e000 msgr2=0x7f04040b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 -- 172.21.15.81:0/3503975969 shutdown_connections 2023-11-29T11:19:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 -- 172.21.15.81:0/3503975969 wait complete. 2023-11-29T11:19:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 Processor -- start 2023-11-29T11:19:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 -- start start 2023-11-29T11:19:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f040415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04041e5b70 0x7f04041e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f040415e730 0x7f040415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.249+0000 7f040a648700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04041e6520 con 0x7f03f00050d0 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f040a648700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040415f0e0 con 0x7f040415e730 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f040a648700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04041f4a10 con 0x7f04041e5b70 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f040415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f040415ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47038/0 (socket says 172.21.15.81:47038) 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 -- 172.21.15.81:0/1617232984 learned_addr learned my addr 172.21.15.81:0/1617232984 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409e47700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f040415e730 0x7f040415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0408e45700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04041e5b70 0x7f04041e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 -- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04041e5b70 msgr2=0x7f04041e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04041e5b70 0x7f04041e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 -- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f040415e730 msgr2=0x7f040415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f040415e730 0x7f040415eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 -- 172.21.15.81:0/1617232984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040b2850 con 0x7f03f00050d0 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0408e45700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04041e5b70 0x7f04041e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f0409646700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f040415ae50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0400000fd0 tx=0x7f040000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f03f9ffb700 1 -- 172.21.15.81:0/1617232984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400005e40 con 0x7f03f00050d0 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f03f9ffb700 1 -- 172.21.15.81:0/1617232984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040000c7e0 con 0x7f03f00050d0 2023-11-29T11:19:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f03f9ffb700 1 -- 172.21.15.81:0/1617232984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040000cb50 con 0x7f03f00050d0 2023-11-29T11:19:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040406a860 con 0x7f03f00050d0 2023-11-29T11:19:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04040b29e0 con 0x7f03f00050d0 2023-11-29T11:19:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.253+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0404072c20 con 0x7f03f00050d0 2023-11-29T11:19:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.257+0000 7f03f9ffb700 1 -- 172.21.15.81:0/1617232984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f040000ccb0 con 0x7f03f00050d0 2023-11-29T11:19:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.257+0000 7f03f9ffb700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f03e8064ee0 0x7f03e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.257+0000 7f03f9ffb700 1 -- 172.21.15.81:0/1617232984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0400081e40 con 0x7f03f00050d0 2023-11-29T11:19:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.257+0000 7f0408e45700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f03e8064ee0 0x7f03e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.257+0000 7f0408e45700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f03e8064ee0 0x7f03e8067390 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f04041f47d0 tx=0x7f03f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.265+0000 7f03f9ffb700 1 -- 172.21.15.81:0/1617232984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f040004fea0 con 0x7f03f00050d0 2023-11-29T11:19:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.429+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04040657e0 con 0x7f03f00050d0 2023-11-29T11:19:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f03f9ffb700 1 -- 172.21.15.81:0/1617232984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17969 (secure 0 0 0) 0x7f04000534c0 con 0x7f03f00050d0 2023-11-29T11:19:48.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:48.441 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":96,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:19:40.670291+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f03e8064ee0 msgr2=0x7f03e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f03e8064ee0 0x7f03e8067390 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f04041f47d0 tx=0x7f03f4009040 comp rx=0 tx=0).stop 2023-11-29T11:19:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 msgr2=0x7f040415ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f040415ae50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0400000fd0 tx=0x7f040000edd0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 shutdown_connections 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f03e8064ee0 0x7f03e8067390 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f040415e730 0x7f040415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04041e5b70 0x7f04041e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 --2- 172.21.15.81:0/1617232984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f00050d0 0x7f040415ae50 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 >> 172.21.15.81:0/1617232984 conn(0x7f040406e000 msgr2=0x7f0404143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 shutdown_connections 2023-11-29T11:19:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.433+0000 7f040a648700 1 -- 172.21.15.81:0/1617232984 wait complete. 2023-11-29T11:19:48.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:19:38.262251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:19:38.644298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:19:48.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:19:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 Processor -- start 2023-11-29T11:19:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- start start 2023-11-29T11:19:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840c13c0 0x7fa6840c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6841642e0 0x7fa684164740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa684160c50 con 0x7fa684160880 2023-11-29T11:19:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6840c1d50 con 0x7fa6841642e0 2023-11-29T11:19:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840b3050 con 0x7fa6840c13c0 2023-11-29T11:19:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689047700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6841642e0 0x7fa684164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689047700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6841642e0 0x7fa684164740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47050/0 (socket says 172.21.15.81:47050) 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689047700 1 -- 172.21.15.81:0/3566248878 learned_addr learned my addr 172.21.15.81:0/3566248878 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa683fff700 1 --2- 172.21.15.81:0/3566248878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840c13c0 0x7fa6840c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689047700 1 -- 172.21.15.81:0/3566248878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840c13c0 msgr2=0x7fa6840c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689047700 1 --2- 172.21.15.81:0/3566248878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840c13c0 0x7fa6840c1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689047700 1 -- 172.21.15.81:0/3566248878 >> v1:172.21.15.81:6789/0 conn(0x7fa684160880 legacy=0x7fa68406aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689047700 1 -- 172.21.15.81:0/3566248878 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68406b630 con 0x7fa6841642e0 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689047700 1 --2- 172.21.15.81:0/3566248878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6841642e0 0x7fa684164740 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009910 tx=0x7fa67c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e09a57d5e7ff95 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa6837fe700 1 -- 172.21.15.81:0/3566248878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00ba60 con 0x7fa6841642e0 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa6837fe700 1 -- 172.21.15.81:0/3566248878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c00bbc0 con 0x7fa6841642e0 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa6837fe700 1 -- 172.21.15.81:0/3566248878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c009e60 con 0x7fa6841642e0 2023-11-29T11:19:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- 172.21.15.81:0/3566248878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6841642e0 msgr2=0x7fa684164740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 --2- 172.21.15.81:0/3566248878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6841642e0 0x7fa684164740 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009910 tx=0x7fa67c009c20 comp rx=0 tx=0).stop 2023-11-29T11:19:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- 172.21.15.81:0/3566248878 shutdown_connections 2023-11-29T11:19:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 --2- 172.21.15.81:0/3566248878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6841642e0 0x7fa684164740 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 --2- 172.21.15.81:0/3566248878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6840c13c0 0x7fa6840c1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- 172.21.15.81:0/3566248878 >> 172.21.15.81:0/3566248878 conn(0x7fa6840cae70 msgr2=0x7fa6840cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- 172.21.15.81:0/3566248878 shutdown_connections 2023-11-29T11:19:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.561+0000 7fa689848700 1 -- 172.21.15.81:0/3566248878 wait complete. 2023-11-29T11:19:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 Processor -- start 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 -- start start 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6840c13c0 0x7fa684162540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa684160880 0x7fa6840af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6841642e0 0x7fa684163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684162a80 con 0x7fa6840c13c0 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840af930 con 0x7fa6841642e0 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840afc10 con 0x7fa684160880 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6840c13c0 0x7fa684162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6840c13c0 0x7fa684162540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47060/0 (socket says 172.21.15.81:47060) 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 -- 172.21.15.81:0/3101016146 learned_addr learned my addr 172.21.15.81:0/3101016146 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689047700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6841642e0 0x7fa684163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa683fff700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa684160880 0x7fa6840af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 -- 172.21.15.81:0/3101016146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa684160880 msgr2=0x7fa6840af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa684160880 0x7fa6840af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 -- 172.21.15.81:0/3101016146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6841642e0 msgr2=0x7fa684163160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6841642e0 0x7fa684163160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 -- 172.21.15.81:0/3101016146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c009570 con 0x7fa6840c13c0 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa688846700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6840c13c0 0x7fa684162540 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c500 tx=0x7fa67800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa6817fa700 1 -- 172.21.15.81:0/3101016146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6780052d0 con 0x7fa6840c13c0 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa6817fa700 1 -- 172.21.15.81:0/3101016146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa678005430 con 0x7fa6840c13c0 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa684069fc0 con 0x7fa6840c13c0 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.565+0000 7fa6817fa700 1 -- 172.21.15.81:0/3101016146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6780055a0 con 0x7fa6840c13c0 2023-11-29T11:19:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.569+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684069ce0 con 0x7fa6840c13c0 2023-11-29T11:19:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.569+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68406a2a0 con 0x7fa6840c13c0 2023-11-29T11:19:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.569+0000 7fa6817fa700 1 -- 172.21.15.81:0/3101016146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa678019030 con 0x7fa6840c13c0 2023-11-29T11:19:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.569+0000 7fa6817fa700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa670064f10 0x7fa6700673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.569+0000 7fa683fff700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa670064f10 0x7fa6700673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.569+0000 7fa6817fa700 1 -- 172.21.15.81:0/3101016146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa678081290 con 0x7fa6840c13c0 2023-11-29T11:19:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.573+0000 7fa683fff700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa670064f10 0x7fa6700673c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa6840c5300 tx=0x7fa674009830 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.573+0000 7fa6817fa700 1 -- 172.21.15.81:0/3101016146 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa67804f200 con 0x7fa6840c13c0 2023-11-29T11:19:48.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.737+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa684072500 con 0x7fa6840c13c0 2023-11-29T11:19:48.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa6817fa700 1 -- 172.21.15.81:0/3101016146 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa678052820 con 0x7fa6840c13c0 2023-11-29T11:19:48.747 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:19:48.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa670064f10 msgr2=0x7fa6700673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa670064f10 0x7fa6700673c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa6840c5300 tx=0x7fa674009830 comp rx=0 tx=0).stop 2023-11-29T11:19:48.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6840c13c0 msgr2=0x7fa684162540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6840c13c0 0x7fa684162540 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c500 tx=0x7fa67800c810 comp rx=0 tx=0).stop 2023-11-29T11:19:48.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 shutdown_connections 2023-11-29T11:19:48.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa670064f10 0x7fa6700673c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6841642e0 0x7fa684163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa684160880 0x7fa6840af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 --2- 172.21.15.81:0/3101016146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6840c13c0 0x7fa684162540 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 >> 172.21.15.81:0/3101016146 conn(0x7fa6840cae70 msgr2=0x7fa68406a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:48.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 shutdown_connections 2023-11-29T11:19:48.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.741+0000 7fa689848700 1 -- 172.21.15.81:0/3101016146 wait complete. 2023-11-29T11:19:48.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:19:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.869+0000 7fa94b59e700 1 Processor -- start 2023-11-29T11:19:48.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.869+0000 7fa94b59e700 1 -- start start 2023-11-29T11:19:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa94c0b2d30 0x7fa94c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c09c0e0 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c0b13e0 con 0x7fa94c15a3e0 2023-11-29T11:19:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c0b16c0 con 0x7fa94c0b2d30 2023-11-29T11:19:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa94c0cc2f0 0x7fa94c0cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33358/0 (socket says 172.21.15.81:33358) 2023-11-29T11:19:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa94c0b2d30 0x7fa94c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94a59c700 1 -- 172.21.15.81:0/960877965 learned_addr learned my addr 172.21.15.81:0/960877965 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:48.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94959a700 1 -- 172.21.15.81:0/960877965 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076412005 0 0) 0x7fa94c09c0e0 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94959a700 1 -- 172.21.15.81:0/960877965 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9380035d0 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94959a700 1 -- 172.21.15.81:0/960877965 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712898106 0 0) 0x7fa94c0b13e0 con 0x7fa94c15a3e0 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94ad9d700 1 -- 172.21.15.81:0/960877965 >> v1:172.21.15.176:6789/0 conn(0x7fa94c15a3e0 legacy=0x7fa94c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94ad9d700 1 -- 172.21.15.81:0/960877965 >> v1:172.21.15.81:6789/0 conn(0x7fa94c0cc2f0 legacy=0x7fa94c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94ad9d700 1 -- 172.21.15.81:0/960877965 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c0b19a0 con 0x7fa94c0b2d30 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94ad9d700 1 --2- 172.21.15.81:0/960877965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0b2d30 0x7fa94c0ac280 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009850 tx=0x7fa93c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09e5c899724e532 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94959a700 1 -- 172.21.15.81:0/960877965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c011830 con 0x7fa94c0b2d30 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94959a700 1 -- 172.21.15.81:0/960877965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c011990 con 0x7fa94c0b2d30 2023-11-29T11:19:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94959a700 1 -- 172.21.15.81:0/960877965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c011d00 con 0x7fa94c0b2d30 2023-11-29T11:19:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 -- 172.21.15.81:0/960877965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0b2d30 msgr2=0x7fa94c0ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 --2- 172.21.15.81:0/960877965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0b2d30 0x7fa94c0ac280 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009850 tx=0x7fa93c009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 -- 172.21.15.81:0/960877965 shutdown_connections 2023-11-29T11:19:48.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 --2- 172.21.15.81:0/960877965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0b2d30 0x7fa94c0ac280 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 -- 172.21.15.81:0/960877965 >> 172.21.15.81:0/960877965 conn(0x7fa94c0cae70 msgr2=0x7fa94c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 -- 172.21.15.81:0/960877965 shutdown_connections 2023-11-29T11:19:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.873+0000 7fa94b59e700 1 -- 172.21.15.81:0/960877965 wait complete. 2023-11-29T11:19:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94b59e700 1 Processor -- start 2023-11-29T11:19:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94b59e700 1 -- start start 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa94c0b2d30 0x7fa94c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0cc2f0 0x7fa94c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa94c15a3e0 0x7fa94c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c06c4a0 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c06c780 con 0x7fa94c0b2d30 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c06ca60 con 0x7fa94c15a3e0 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0cc2f0 0x7fa94c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0cc2f0 0x7fa94c06d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47078/0 (socket says 172.21.15.81:47078) 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 -- 172.21.15.81:0/2220946514 learned_addr learned my addr 172.21.15.81:0/2220946514 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94a59c700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa94c0b2d30 0x7fa94c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94ad9d700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa94c15a3e0 0x7fa94c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 -- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa94c15a3e0 msgr2=0x7fa94c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa94c15a3e0 0x7fa94c070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 -- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa94c0b2d30 msgr2=0x7fa94c152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa94c0b2d30 0x7fa94c152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 -- 172.21.15.81:0/2220946514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0094b0 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa94ad9d700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa94c15a3e0 0x7fa94c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.877+0000 7fa949d9b700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0cc2f0 0x7fa94c06d540 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa94400cc20 tx=0x7fa94400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa942ffd700 1 -- 172.21.15.81:0/2220946514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944003e50 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa942ffd700 1 -- 172.21.15.81:0/2220946514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94400a740 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c06a350 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa942ffd700 1 -- 172.21.15.81:0/2220946514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94400aaf0 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c0b1c80 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c0b21a0 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa942ffd700 1 -- 172.21.15.81:0/2220946514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa944019030 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa942ffd700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa92c064ee0 0x7fa92c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.881+0000 7fa94a59c700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa92c064ee0 0x7fa92c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.885+0000 7fa942ffd700 1 -- 172.21.15.81:0/2220946514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa944081a00 con 0x7fa94c0cc2f0 2023-11-29T11:19:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.885+0000 7fa94a59c700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa92c064ee0 0x7fa92c067390 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa934007fd0 tx=0x7fa934009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:48.889+0000 7fa942ffd700 1 -- 172.21.15.81:0/2220946514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa94404f9d0 con 0x7fa94c0cc2f0 2023-11-29T11:19:49.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.041+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa94c0cdb60 con 0x7fa94c0cc2f0 2023-11-29T11:19:49.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.041+0000 7fa942ffd700 1 -- 172.21.15.81:0/2220946514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa94c0cdb60 con 0x7fa94c0cc2f0 2023-11-29T11:19:49.050 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:19:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa92c064ee0 msgr2=0x7fa92c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa92c064ee0 0x7fa92c067390 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa934007fd0 tx=0x7fa934009040 comp rx=0 tx=0).stop 2023-11-29T11:19:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0cc2f0 msgr2=0x7fa94c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0cc2f0 0x7fa94c06d540 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa94400cc20 tx=0x7fa94400cf30 comp rx=0 tx=0).stop 2023-11-29T11:19:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 shutdown_connections 2023-11-29T11:19:49.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa92c064ee0 0x7fa92c067390 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa94c15a3e0 0x7fa94c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c0cc2f0 0x7fa94c06d540 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 --2- 172.21.15.81:0/2220946514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa94c0b2d30 0x7fa94c152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 >> 172.21.15.81:0/2220946514 conn(0x7fa94c0cae70 msgr2=0x7fa94c0ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:49.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 shutdown_connections 2023-11-29T11:19:49.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.045+0000 7fa94b59e700 1 -- 172.21.15.81:0/2220946514 wait complete. 2023-11-29T11:19:49.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:19:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.169+0000 7fe95ffff700 1 Processor -- start 2023-11-29T11:19:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.169+0000 7fe95ffff700 1 -- start start 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600b1ae0 0x7fe96006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe96006a4c0 0x7fe9600d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9600cf0e0 0x7fe9600cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9600cfa80 con 0x7fe9600cf0e0 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96006a9c0 con 0x7fe96006a4c0 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96006aca0 con 0x7fe9600b1ae0 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9600cf0e0 0x7fe9600cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9600cf0e0 0x7fe9600cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47080/0 (socket says 172.21.15.81:47080) 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 -- 172.21.15.81:0/3071078820 learned_addr learned my addr 172.21.15.81:0/3071078820 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95e7fc700 1 --2- 172.21.15.81:0/3071078820 >> v2:172.21.15.176:3300/0 conn(0x7fe96006a4c0 0x7fe9600d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95effd700 1 --2- 172.21.15.81:0/3071078820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600b1ae0 0x7fe96006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 -- 172.21.15.81:0/3071078820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600b1ae0 msgr2=0x7fe96006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 --2- 172.21.15.81:0/3071078820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600b1ae0 0x7fe96006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 -- 172.21.15.81:0/3071078820 >> v2:172.21.15.176:3300/0 conn(0x7fe96006a4c0 msgr2=0x7fe9600d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 --2- 172.21.15.81:0/3071078820 >> v2:172.21.15.176:3300/0 conn(0x7fe96006a4c0 0x7fe9600d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 -- 172.21.15.81:0/3071078820 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96006af80 con 0x7fe9600cf0e0 2023-11-29T11:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95e7fc700 1 --2- 172.21.15.81:0/3071078820 >> v2:172.21.15.176:3300/0 conn(0x7fe96006a4c0 0x7fe9600d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95effd700 1 --2- 172.21.15.81:0/3071078820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600b1ae0 0x7fe96006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95f7fe700 1 --2- 172.21.15.81:0/3071078820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9600cf0e0 0x7fe9600cf540 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe96008ba60 tx=0x7fe95800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70196755e73a9c17 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95dffb700 1 -- 172.21.15.81:0/3071078820 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800e070 con 0x7fe9600cf0e0 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95dffb700 1 -- 172.21.15.81:0/3071078820 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95800b9c0 con 0x7fe9600cf0e0 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95dffb700 1 -- 172.21.15.81:0/3071078820 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800bd70 con 0x7fe9600cf0e0 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 -- 172.21.15.81:0/3071078820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9600cf0e0 msgr2=0x7fe9600cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 --2- 172.21.15.81:0/3071078820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9600cf0e0 0x7fe9600cf540 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe96008ba60 tx=0x7fe95800b330 comp rx=0 tx=0).stop 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 -- 172.21.15.81:0/3071078820 shutdown_connections 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 --2- 172.21.15.81:0/3071078820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9600cf0e0 0x7fe9600cf540 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 --2- 172.21.15.81:0/3071078820 >> v2:172.21.15.176:3300/0 conn(0x7fe96006a4c0 0x7fe9600d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 --2- 172.21.15.81:0/3071078820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600b1ae0 0x7fe96006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 -- 172.21.15.81:0/3071078820 >> 172.21.15.81:0/3071078820 conn(0x7fe96009bbd0 msgr2=0x7fe9600b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 -- 172.21.15.81:0/3071078820 shutdown_connections 2023-11-29T11:19:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.173+0000 7fe95ffff700 1 -- 172.21.15.81:0/3071078820 wait complete. 2023-11-29T11:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.177+0000 7fe95ffff700 1 Processor -- start 2023-11-29T11:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.177+0000 7fe95ffff700 1 -- start start 2023-11-29T11:19:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96006a4c0 0x7fe96015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9600b1ae0 0x7fe9601f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600cf0e0 0x7fe9600c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96009e650 con 0x7fe96006a4c0 2023-11-29T11:19:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9601f2810 con 0x7fe9600b1ae0 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600c71a0 con 0x7fe9600cf0e0 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96006a4c0 0x7fe96015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96006a4c0 0x7fe96015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47088/0 (socket says 172.21.15.81:47088) 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 -- 172.21.15.81:0/440617670 learned_addr learned my addr 172.21.15.81:0/440617670 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95e7fc700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9600b1ae0 0x7fe9601f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95f7fe700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600cf0e0 0x7fe9600c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 -- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600cf0e0 msgr2=0x7fe9600c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600cf0e0 0x7fe9600c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 -- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9600b1ae0 msgr2=0x7fe9601f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9600b1ae0 0x7fe9601f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 -- 172.21.15.81:0/440617670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe958009b30 con 0x7fe96006a4c0 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95f7fe700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600cf0e0 0x7fe9600c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95effd700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96006a4c0 0x7fe96015a9c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fe94800e790 tx=0x7fe94800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe9577fe700 1 -- 172.21.15.81:0/440617670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948004230 con 0x7fe96006a4c0 2023-11-29T11:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe9577fe700 1 -- 172.21.15.81:0/440617670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe948004390 con 0x7fe96006a4c0 2023-11-29T11:19:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9600b1eb0 con 0x7fe96006a4c0 2023-11-29T11:19:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe9577fe700 1 -- 172.21.15.81:0/440617670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9480036c0 con 0x7fe96006a4c0 2023-11-29T11:19:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9600b4380 con 0x7fe96006a4c0 2023-11-29T11:19:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.181+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9600b60e0 con 0x7fe96006a4c0 2023-11-29T11:19:49.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.185+0000 7fe9577fe700 1 -- 172.21.15.81:0/440617670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe948022070 con 0x7fe96006a4c0 2023-11-29T11:19:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.185+0000 7fe9577fe700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe940064f10 0x7fe9400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.185+0000 7fe9577fe700 1 -- 172.21.15.81:0/440617670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe948081a70 con 0x7fe96006a4c0 2023-11-29T11:19:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.185+0000 7fe95e7fc700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe940064f10 0x7fe9400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.185+0000 7fe95e7fc700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe940064f10 0x7fe9400673c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe9600d1e60 tx=0x7fe950008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.193+0000 7fe9577fe700 1 -- 172.21.15.81:0/440617670 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe94804fa70 con 0x7fe96006a4c0 2023-11-29T11:19:49.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.353+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe960072500 con 0x7fe96006a4c0 2023-11-29T11:19:49.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.353+0000 7fe9577fe700 1 -- 172.21.15.81:0/440617670 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe948053090 con 0x7fe96006a4c0 2023-11-29T11:19:49.361 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:19:49.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe940064f10 msgr2=0x7fe9400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe940064f10 0x7fe9400673c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe9600d1e60 tx=0x7fe950008040 comp rx=0 tx=0).stop 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96006a4c0 msgr2=0x7fe96015a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96006a4c0 0x7fe96015a9c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fe94800e790 tx=0x7fe94800eb50 comp rx=0 tx=0).stop 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 shutdown_connections 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe940064f10 0x7fe9400673c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9600cf0e0 0x7fe9600c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9600b1ae0 0x7fe9601f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 --2- 172.21.15.81:0/440617670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96006a4c0 0x7fe96015a9c0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 >> 172.21.15.81:0/440617670 conn(0x7fe96009bbd0 msgr2=0x7fe9600b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 shutdown_connections 2023-11-29T11:19:49.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.357+0000 7fe95ffff700 1 -- 172.21.15.81:0/440617670 wait complete. 2023-11-29T11:19:49.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:19:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 Processor -- start 2023-11-29T11:19:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 -- start start 2023-11-29T11:19:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64380b1ae0 0x7f643806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64380cf0e0 0x7f64380cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64380cfa80 con 0x7f643806a4c0 2023-11-29T11:19:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64380d0ab0 con 0x7f64380b1ae0 2023-11-29T11:19:49.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643806a9c0 con 0x7f64380cf0e0 2023-11-29T11:19:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6437fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64380b1ae0 0x7f643806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6437fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64380b1ae0 0x7f643806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47100/0 (socket says 172.21.15.81:47100) 2023-11-29T11:19:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6437fff700 1 -- 172.21.15.81:0/2883989498 learned_addr learned my addr 172.21.15.81:0/2883989498 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643c828700 1 --2- 172.21.15.81:0/2883989498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64380cf0e0 0x7f64380cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6437fff700 1 -- 172.21.15.81:0/2883989498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64380cf0e0 msgr2=0x7f64380cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6437fff700 1 --2- 172.21.15.81:0/2883989498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64380cf0e0 0x7f64380cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6437fff700 1 -- 172.21.15.81:0/2883989498 >> v1:172.21.15.176:6789/0 conn(0x7f643806a4c0 legacy=0x7f64380d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6437fff700 1 -- 172.21.15.81:0/2883989498 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643806aca0 con 0x7f64380b1ae0 2023-11-29T11:19:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6437fff700 1 --2- 172.21.15.81:0/2883989498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380b1ae0 0x7f643806d8e0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6428009910 tx=0x7f6428009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f6dd31cc8df5a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6436ffd700 1 -- 172.21.15.81:0/2883989498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800ba60 con 0x7f64380b1ae0 2023-11-29T11:19:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6436ffd700 1 -- 172.21.15.81:0/2883989498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642800bbc0 con 0x7f64380b1ae0 2023-11-29T11:19:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f6436ffd700 1 -- 172.21.15.81:0/2883989498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428009e60 con 0x7f64380b1ae0 2023-11-29T11:19:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 -- 172.21.15.81:0/2883989498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380b1ae0 msgr2=0x7f643806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 --2- 172.21.15.81:0/2883989498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380b1ae0 0x7f643806d8e0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6428009910 tx=0x7f6428009c20 comp rx=0 tx=0).stop 2023-11-29T11:19:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 -- 172.21.15.81:0/2883989498 shutdown_connections 2023-11-29T11:19:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 --2- 172.21.15.81:0/2883989498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64380cf0e0 0x7f64380cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 --2- 172.21.15.81:0/2883989498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380b1ae0 0x7f643806d8e0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.481+0000 7f643d029700 1 -- 172.21.15.81:0/2883989498 >> 172.21.15.81:0/2883989498 conn(0x7f643809bbd0 msgr2=0x7f64380b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 -- 172.21.15.81:0/2883989498 shutdown_connections 2023-11-29T11:19:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 -- 172.21.15.81:0/2883989498 wait complete. 2023-11-29T11:19:49.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 Processor -- start 2023-11-29T11:19:49.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 -- start start 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806a4c0 0x7f643815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380cf0e0 0x7f643815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815c6d0 0x7f643815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64381586e0 con 0x7f64380cf0e0 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643815e2f0 con 0x7f643815c6d0 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643d029700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643809d770 con 0x7f643806a4c0 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f64377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380cf0e0 0x7f643815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f64377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380cf0e0 0x7f643815ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47114/0 (socket says 172.21.15.81:47114) 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f64377fe700 1 -- 172.21.15.81:0/1190017077 learned_addr learned my addr 172.21.15.81:0/1190017077 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f643c828700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815c6d0 0x7f643815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f6437fff700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806a4c0 0x7f643815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f64377fe700 1 -- 172.21.15.81:0/1190017077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806a4c0 msgr2=0x7f643815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f64377fe700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806a4c0 0x7f643815d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.485+0000 7f64377fe700 1 -- 172.21.15.81:0/1190017077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815c6d0 msgr2=0x7f643815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f64377fe700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815c6d0 0x7f643815cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f64377fe700 1 -- 172.21.15.81:0/1190017077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428009570 con 0x7f64380cf0e0 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f64377fe700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380cf0e0 0x7f643815ddb0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f642000c500 tx=0x7f642000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f6434ff9700 1 -- 172.21.15.81:0/1190017077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64200052d0 con 0x7f64380cf0e0 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f6434ff9700 1 -- 172.21.15.81:0/1190017077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420005430 con 0x7f64380cf0e0 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64380b4380 con 0x7f64380cf0e0 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f6434ff9700 1 -- 172.21.15.81:0/1190017077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64200055a0 con 0x7f64380cf0e0 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643806af80 con 0x7f64380cf0e0 2023-11-29T11:19:49.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64380b1eb0 con 0x7f64380cf0e0 2023-11-29T11:19:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f6434ff9700 1 -- 172.21.15.81:0/1190017077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6420019030 con 0x7f64380cf0e0 2023-11-29T11:19:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f6434ff9700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6418064ee0 0x7f6418067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f6434ff9700 1 -- 172.21.15.81:0/1190017077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f64200812e0 con 0x7f64380cf0e0 2023-11-29T11:19:49.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.489+0000 7f6437fff700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6418064ee0 0x7f6418067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.493+0000 7f6437fff700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6418064ee0 0x7f6418067390 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f643808c240 tx=0x7f6428008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.497+0000 7f6434ff9700 1 -- 172.21.15.81:0/1190017077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f642004f2c0 con 0x7f64380cf0e0 2023-11-29T11:19:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.657+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6438072500 con 0x7f64380cf0e0 2023-11-29T11:19:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f6434ff9700 1 -- 172.21.15.81:0/1190017077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f64200528e0 con 0x7f64380cf0e0 2023-11-29T11:19:49.667 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:19:49.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6418064ee0 msgr2=0x7f6418067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6418064ee0 0x7f6418067390 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f643808c240 tx=0x7f6428008030 comp rx=0 tx=0).stop 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380cf0e0 msgr2=0x7f643815ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380cf0e0 0x7f643815ddb0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f642000c500 tx=0x7f642000c810 comp rx=0 tx=0).stop 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 shutdown_connections 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6418064ee0 0x7f6418067390 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815c6d0 0x7f643815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64380cf0e0 0x7f643815ddb0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 --2- 172.21.15.81:0/1190017077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806a4c0 0x7f643815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 >> 172.21.15.81:0/1190017077 conn(0x7f643809bbd0 msgr2=0x7f64380b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 shutdown_connections 2023-11-29T11:19:49.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.661+0000 7f643d029700 1 -- 172.21.15.81:0/1190017077 wait complete. 2023-11-29T11:19:49.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:19:49.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9683fff700 1 Processor -- start 2023-11-29T11:19:49.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9683fff700 1 -- start start 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9683fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f96841607b0 0x7f96840cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9683fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96840cc430 0x7f96840ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9683fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968415c520 con 0x7f968415c150 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9683fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96840ca680 con 0x7f96840cc430 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9683fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96840ca960 con 0x7f96841607b0 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96837fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96840cc430 0x7f96840ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96837fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96840cc430 0x7f96840ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43512/0 (socket says 172.21.15.81:43512) 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96837fe700 1 -- 172.21.15.81:0/366973219 learned_addr learned my addr 172.21.15.81:0/366973219 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:49.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96827fc700 1 --2- 172.21.15.81:0/366973219 >> v2:172.21.15.176:3300/0 conn(0x7f96841607b0 0x7f96840cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96837fe700 1 -- 172.21.15.81:0/366973219 >> v2:172.21.15.176:3300/0 conn(0x7f96841607b0 msgr2=0x7f96840cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:49.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96837fe700 1 --2- 172.21.15.81:0/366973219 >> v2:172.21.15.176:3300/0 conn(0x7f96841607b0 0x7f96840cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96837fe700 1 -- 172.21.15.81:0/366973219 >> v1:172.21.15.176:6789/0 conn(0x7f968415c150 legacy=0x7f96840c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96837fe700 1 -- 172.21.15.81:0/366973219 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840cd840 con 0x7f96840cc430 2023-11-29T11:19:49.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f96837fe700 1 --2- 172.21.15.81:0/366973219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96840cc430 0x7f96840ce320 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f96840af140 tx=0x7f9674009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc921de9c78f38da server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9681ffb700 1 -- 172.21.15.81:0/366973219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674011830 con 0x7f96840cc430 2023-11-29T11:19:49.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9681ffb700 1 -- 172.21.15.81:0/366973219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9674011990 con 0x7f96840cc430 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.793+0000 7f9681ffb700 1 -- 172.21.15.81:0/366973219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674011d20 con 0x7f96840cc430 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- 172.21.15.81:0/366973219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96840cc430 msgr2=0x7f96840ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 --2- 172.21.15.81:0/366973219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96840cc430 0x7f96840ce320 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f96840af140 tx=0x7f9674009bf0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- 172.21.15.81:0/366973219 shutdown_connections 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 --2- 172.21.15.81:0/366973219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96840cc430 0x7f96840ce320 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 --2- 172.21.15.81:0/366973219 >> v2:172.21.15.176:3300/0 conn(0x7f96841607b0 0x7f96840cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- 172.21.15.81:0/366973219 >> 172.21.15.81:0/366973219 conn(0x7f968406ec40 msgr2=0x7f96840b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- 172.21.15.81:0/366973219 shutdown_connections 2023-11-29T11:19:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- 172.21.15.81:0/366973219 wait complete. 2023-11-29T11:19:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 Processor -- start 2023-11-29T11:19:49.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- start start 2023-11-29T11:19:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96840cc430 0x7f96840ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f968415c150 0x7f96840b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96841607b0 0x7f9684154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968415ea00 con 0x7f96841607b0 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96841f5a80 con 0x7f96840cc430 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9683fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96840b2a40 con 0x7f968415c150 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f96837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96841607b0 0x7f9684154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f96837fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96841607b0 0x7f9684154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43526/0 (socket says 172.21.15.81:43526) 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f96837fe700 1 -- 172.21.15.81:0/1720067794 learned_addr learned my addr 172.21.15.81:0/1720067794 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f96827fc700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f968415c150 0x7f96840b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.797+0000 7f9682ffd700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96840cc430 0x7f96840ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f96837fe700 1 -- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f968415c150 msgr2=0x7f96840b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f96837fe700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f968415c150 0x7f96840b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f96837fe700 1 -- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96840cc430 msgr2=0x7f96840ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f96837fe700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96840cc430 0x7f96840ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f96837fe700 1 -- 172.21.15.81:0/1720067794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009570 con 0x7f96841607b0 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f96827fc700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f968415c150 0x7f96840b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f96837fe700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96841607b0 0x7f9684154d20 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f9674014040 tx=0x7f9674004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f966b7fe700 1 -- 172.21.15.81:0/1720067794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674004550 con 0x7f96841607b0 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f966b7fe700 1 -- 172.21.15.81:0/1720067794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967401e070 con 0x7f96841607b0 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96840cde00 con 0x7f96841607b0 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f966b7fe700 1 -- 172.21.15.81:0/1720067794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674003900 con 0x7f96841607b0 2023-11-29T11:19:49.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96840cdb20 con 0x7f96841607b0 2023-11-29T11:19:49.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96840cc8b0 con 0x7f96841607b0 2023-11-29T11:19:49.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f966b7fe700 1 -- 172.21.15.81:0/1720067794 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f967400f050 con 0x7f96841607b0 2023-11-29T11:19:49.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f966b7fe700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9670064ee0 0x7f9670067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:49.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f966b7fe700 1 -- 172.21.15.81:0/1720067794 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9674083060 con 0x7f96841607b0 2023-11-29T11:19:49.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.801+0000 7f9682ffd700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9670064ee0 0x7f9670067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:49.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.805+0000 7f9682ffd700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9670064ee0 0x7f9670067390 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f96841579b0 tx=0x7f9678009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.809+0000 7f966b7fe700 1 -- 172.21.15.81:0/1720067794 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9674051040 con 0x7f96841607b0 2023-11-29T11:19:49.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.985+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9684155260 con 0x7f96841607b0 2023-11-29T11:19:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.985+0000 7f966b7fe700 1 -- 172.21.15.81:0/1720067794 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v96) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9684155260 con 0x7f96841607b0 2023-11-29T11:19:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9670064ee0 msgr2=0x7f9670067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9670064ee0 0x7f9670067390 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f96841579b0 tx=0x7f9678009040 comp rx=0 tx=0).stop 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96841607b0 msgr2=0x7f9684154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96841607b0 0x7f9684154d20 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f9674014040 tx=0x7f9674004770 comp rx=0 tx=0).stop 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 shutdown_connections 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9670064ee0 0x7f9670067390 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96841607b0 0x7f9684154d20 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f968415c150 0x7f96840b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 --2- 172.21.15.81:0/1720067794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96840cc430 0x7f96840ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 >> 172.21.15.81:0/1720067794 conn(0x7f968406ec40 msgr2=0x7f96840ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 shutdown_connections 2023-11-29T11:19:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:49.989+0000 7f9683fff700 1 -- 172.21.15.81:0/1720067794 wait complete. 2023-11-29T11:19:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:19:50.009 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:19:50.009 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:19:50.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:19:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.117+0000 7f2e92d2f700 1 Processor -- start 2023-11-29T11:19:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.117+0000 7f2e92d2f700 1 -- start start 2023-11-29T11:19:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.117+0000 7f2e92d2f700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e8c0b1ca0 0x7f2e8c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.117+0000 7f2e92d2f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c0cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.117+0000 7f2e92d2f700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c0cf070 con 0x7f2e8c0d2780 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.117+0000 7f2e92d2f700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b2070 con 0x7f2e8c0b1ca0 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.117+0000 7f2e92d2f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c06a8a0 con 0x7f2e8c06a330 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e9252e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2e8c0d2780 0x7f2e8c0cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36186/0 (socket says 172.21.15.81:36186) 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e9252e700 1 -- 172.21.15.81:0/4230235556 learned_addr learned my addr 172.21.15.81:0/4230235556 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e91d2d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e8c0b1ca0 0x7f2e8c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e9152c700 1 --2- 172.21.15.81:0/4230235556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c0cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e90d2b700 1 -- 172.21.15.81:0/4230235556 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817719317 0 0) 0x7f2e8c0cf070 con 0x7f2e8c0d2780 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e90d2b700 1 -- 172.21.15.81:0/4230235556 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e780035d0 con 0x7f2e8c0d2780 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e91d2d700 1 -- 172.21.15.81:0/4230235556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 msgr2=0x7f2e8c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e91d2d700 1 --2- 172.21.15.81:0/4230235556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c0cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e91d2d700 1 -- 172.21.15.81:0/4230235556 >> v1:172.21.15.81:6789/0 conn(0x7f2e8c0d2780 legacy=0x7f2e8c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e90d2b700 1 -- 172.21.15.81:0/4230235556 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1544372383 0 0) 0x7f2e780035d0 con 0x7f2e8c0d2780 2023-11-29T11:19:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e91d2d700 1 -- 172.21.15.81:0/4230235556 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c06ab80 con 0x7f2e8c0b1ca0 2023-11-29T11:19:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e91d2d700 1 --2- 172.21.15.81:0/4230235556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0b1ca0 0x7f2e8c0b6250 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009850 tx=0x7f2e88009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4273fbd00f6384e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e90d2b700 1 -- 172.21.15.81:0/4230235556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840019f0 con 0x7f2e8c0b1ca0 2023-11-29T11:19:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e90d2b700 1 -- 172.21.15.81:0/4230235556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88004030 con 0x7f2e8c0b1ca0 2023-11-29T11:19:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e90d2b700 1 -- 172.21.15.81:0/4230235556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880043e0 con 0x7f2e8c0b1ca0 2023-11-29T11:19:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e92d2f700 1 -- 172.21.15.81:0/4230235556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0b1ca0 msgr2=0x7f2e8c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/4230235556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0b1ca0 0x7f2e8c0b6250 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009850 tx=0x7f2e88009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e92d2f700 1 -- 172.21.15.81:0/4230235556 shutdown_connections 2023-11-29T11:19:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/4230235556 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c0cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/4230235556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0b1ca0 0x7f2e8c0b6250 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e92d2f700 1 -- 172.21.15.81:0/4230235556 >> 172.21.15.81:0/4230235556 conn(0x7f2e8c0b5740 msgr2=0x7f2e8c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e92d2f700 1 -- 172.21.15.81:0/4230235556 shutdown_connections 2023-11-29T11:19:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.121+0000 7f2e92d2f700 1 -- 172.21.15.81:0/4230235556 wait complete. 2023-11-29T11:19:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 Processor -- start 2023-11-29T11:19:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 -- start start 2023-11-29T11:19:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c1f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e8c0b1ca0 0x7f2e8c14b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0d2780 0x7f2e8c14bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c14c5c0 con 0x7f2e8c0d2780 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c1f4cf0 con 0x7f2e8c0b1ca0 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0cc1d0 con 0x7f2e8c06a330 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0d2780 0x7f2e8c14bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e91d2d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c1f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0d2780 0x7f2e8c14bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43540/0 (socket says 172.21.15.81:43540) 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 -- 172.21.15.81:0/3244233120 learned_addr learned my addr 172.21.15.81:0/3244233120 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e91d2d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c1f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:34194/0 (socket says 172.21.15.81:34194) 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9152c700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e8c0b1ca0 0x7f2e8c14b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 -- 172.21.15.81:0/3244233120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 msgr2=0x7f2e8c1f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c1f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 -- 172.21.15.81:0/3244233120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e8c0b1ca0 msgr2=0x7f2e8c14b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e8c0b1ca0 0x7f2e8c14b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 -- 172.21.15.81:0/3244233120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880094b0 con 0x7f2e8c0d2780 2023-11-29T11:19:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e9252e700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0d2780 0x7f2e8c14bc10 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400ccd0 tx=0x7f2e8400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e827fc700 1 -- 172.21.15.81:0/3244233120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400ab30 con 0x7f2e8c0d2780 2023-11-29T11:19:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e827fc700 1 -- 172.21.15.81:0/3244233120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400ac90 con 0x7f2e8c0d2780 2023-11-29T11:19:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e827fc700 1 -- 172.21.15.81:0/3244233120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840070d0 con 0x7f2e8c0d2780 2023-11-29T11:19:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c06b140 con 0x7f2e8c0d2780 2023-11-29T11:19:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.125+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c06ae60 con 0x7f2e8c0d2780 2023-11-29T11:19:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.129+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c0cd380 con 0x7f2e8c0d2780 2023-11-29T11:19:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.129+0000 7f2e827fc700 1 -- 172.21.15.81:0/3244233120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2e84010070 con 0x7f2e8c0d2780 2023-11-29T11:19:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.129+0000 7f2e827fc700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e70064ee0 0x7f2e70067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.129+0000 7f2e827fc700 1 -- 172.21.15.81:0/3244233120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2e84081910 con 0x7f2e8c0d2780 2023-11-29T11:19:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.129+0000 7f2e91d2d700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e70064ee0 0x7f2e70067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.129+0000 7f2e91d2d700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e70064ee0 0x7f2e70067390 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2e880090b0 tx=0x7f2e88008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.133+0000 7f2e827fc700 1 -- 172.21.15.81:0/3244233120 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2e8404f970 con 0x7f2e8c0d2780 2023-11-29T11:19:50.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.297+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e8c072c20 con 0x7f2e8c0d2780 2023-11-29T11:19:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.301+0000 7f2e827fc700 1 -- 172.21.15.81:0/3244233120 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17969 (secure 0 0 0) 0x7f2e84052f90 con 0x7f2e8c0d2780 2023-11-29T11:19:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:50.309 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":96,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:19:40.670291+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:19:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e70064ee0 msgr2=0x7f2e70067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e70064ee0 0x7f2e70067390 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2e880090b0 tx=0x7f2e88008030 comp rx=0 tx=0).stop 2023-11-29T11:19:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0d2780 msgr2=0x7f2e8c14bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0d2780 0x7f2e8c14bc10 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400ccd0 tx=0x7f2e8400a060 comp rx=0 tx=0).stop 2023-11-29T11:19:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 shutdown_connections 2023-11-29T11:19:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e70064ee0 0x7f2e70067390 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e8c0d2780 0x7f2e8c14bc10 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e8c0b1ca0 0x7f2e8c14b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 --2- 172.21.15.81:0/3244233120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8c06a330 0x7f2e8c1f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 >> 172.21.15.81:0/3244233120 conn(0x7f2e8c0b5740 msgr2=0x7f2e8c0d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 shutdown_connections 2023-11-29T11:19:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.305+0000 7f2e92d2f700 1 -- 172.21.15.81:0/3244233120 wait complete. 2023-11-29T11:19:50.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:19:38.262251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:19:38.644298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:19:50.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:19:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.437+0000 7ff4526df700 1 Processor -- start 2023-11-29T11:19:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.437+0000 7ff4526df700 1 -- start start 2023-11-29T11:19:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0b2110 0x7ff44c0cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff44c0c4170 0x7ff44c0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c0cb050 con 0x7ff44c0cf740 2023-11-29T11:19:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c15da00 con 0x7ff44c0c4170 2023-11-29T11:19:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0d0310 con 0x7ff44c0b2110 2023-11-29T11:19:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4516dd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0b2110 0x7ff44c0cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff451ede700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff44c0c4170 0x7ff44c0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4516dd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0b2110 0x7ff44c0cfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:34202/0 (socket says 172.21.15.81:34202) 2023-11-29T11:19:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff451ede700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff44c0c4170 0x7ff44c0c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:55944/0 (socket says 172.21.15.81:55944) 2023-11-29T11:19:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4516dd700 1 -- 172.21.15.81:0/2318555776 learned_addr learned my addr 172.21.15.81:0/2318555776 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff451ede700 1 -- 172.21.15.81:0/2318555776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0b2110 msgr2=0x7ff44c0cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff451ede700 1 --2- 172.21.15.81:0/2318555776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0b2110 0x7ff44c0cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff451ede700 1 -- 172.21.15.81:0/2318555776 >> v1:172.21.15.176:6789/0 conn(0x7ff44c0cf740 legacy=0x7ff44c0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff451ede700 1 -- 172.21.15.81:0/2318555776 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c15dc50 con 0x7ff44c0c4170 2023-11-29T11:19:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff451ede700 1 --2- 172.21.15.81:0/2318555776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0c4170 0x7ff44c0c45c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff444009d90 tx=0x7ff44400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bde77c8459a49bc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff443fff700 1 -- 172.21.15.81:0/2318555776 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44400e070 con 0x7ff44c0c4170 2023-11-29T11:19:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff443fff700 1 -- 172.21.15.81:0/2318555776 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44400bb20 con 0x7ff44c0c4170 2023-11-29T11:19:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff443fff700 1 -- 172.21.15.81:0/2318555776 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444012430 con 0x7ff44c0c4170 2023-11-29T11:19:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 -- 172.21.15.81:0/2318555776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0c4170 msgr2=0x7ff44c0c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 --2- 172.21.15.81:0/2318555776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0c4170 0x7ff44c0c45c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff444009d90 tx=0x7ff44400b330 comp rx=0 tx=0).stop 2023-11-29T11:19:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 -- 172.21.15.81:0/2318555776 shutdown_connections 2023-11-29T11:19:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 --2- 172.21.15.81:0/2318555776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0c4170 0x7ff44c0c45c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 --2- 172.21.15.81:0/2318555776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0b2110 0x7ff44c0cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 -- 172.21.15.81:0/2318555776 >> 172.21.15.81:0/2318555776 conn(0x7ff44c0cd0a0 msgr2=0x7ff44c0cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 -- 172.21.15.81:0/2318555776 shutdown_connections 2023-11-29T11:19:50.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.441+0000 7ff4526df700 1 -- 172.21.15.81:0/2318555776 wait complete. 2023-11-29T11:19:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4526df700 1 Processor -- start 2023-11-29T11:19:50.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4526df700 1 -- start start 2023-11-29T11:19:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4526df700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0b2110 0x7ff44c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4526df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44c0c4170 0x7ff44c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4526df700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0cf740 0x7ff44c1eea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4526df700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c15cd10 con 0x7ff44c0c4170 2023-11-29T11:19:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4526df700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0c97e0 con 0x7ff44c0b2110 2023-11-29T11:19:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4526df700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0c9500 con 0x7ff44c0cf740 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff450edc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44c0c4170 0x7ff44c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff450edc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44c0c4170 0x7ff44c157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43546/0 (socket says 172.21.15.81:43546) 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff450edc700 1 -- 172.21.15.81:0/1073771388 learned_addr learned my addr 172.21.15.81:0/1073771388 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff451ede700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0cf740 0x7ff44c1eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.445+0000 7ff4516dd700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0b2110 0x7ff44c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff450edc700 1 -- 172.21.15.81:0/1073771388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0cf740 msgr2=0x7ff44c1eea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff450edc700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0cf740 0x7ff44c1eea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff450edc700 1 -- 172.21.15.81:0/1073771388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0b2110 msgr2=0x7ff44c15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff450edc700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0b2110 0x7ff44c15c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff450edc700 1 -- 172.21.15.81:0/1073771388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff444009a70 con 0x7ff44c0c4170 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff450edc700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44c0c4170 0x7ff44c157790 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00c500 tx=0x7ff43c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff441ffb700 1 -- 172.21.15.81:0/1073771388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0052d0 con 0x7ff44c0c4170 2023-11-29T11:19:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff441ffb700 1 -- 172.21.15.81:0/1073771388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c005430 con 0x7ff44c0c4170 2023-11-29T11:19:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c15e210 con 0x7ff44c0c4170 2023-11-29T11:19:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff441ffb700 1 -- 172.21.15.81:0/1073771388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0055a0 con 0x7ff44c0c4170 2023-11-29T11:19:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c15df30 con 0x7ff44c0c4170 2023-11-29T11:19:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c15e4f0 con 0x7ff44c0c4170 2023-11-29T11:19:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.449+0000 7ff441ffb700 1 -- 172.21.15.81:0/1073771388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff43c019030 con 0x7ff44c0c4170 2023-11-29T11:19:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.453+0000 7ff441ffb700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff430064ee0 0x7ff430067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.453+0000 7ff441ffb700 1 -- 172.21.15.81:0/1073771388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff43c0811a0 con 0x7ff44c0c4170 2023-11-29T11:19:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.453+0000 7ff4516dd700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff430064ee0 0x7ff430067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.453+0000 7ff4516dd700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff430064ee0 0x7ff430067390 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff448009b50 tx=0x7ff4480092e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.461+0000 7ff441ffb700 1 -- 172.21.15.81:0/1073771388 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff43c04f200 con 0x7ff44c0c4170 2023-11-29T11:19:50.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.617+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff44c072c20 con 0x7ff44c0c4170 2023-11-29T11:19:50.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.617+0000 7ff441ffb700 1 -- 172.21.15.81:0/1073771388 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff43c052820 con 0x7ff44c0c4170 2023-11-29T11:19:50.625 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:19:50.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff430064ee0 msgr2=0x7ff430067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff430064ee0 0x7ff430067390 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff448009b50 tx=0x7ff4480092e0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44c0c4170 msgr2=0x7ff44c157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44c0c4170 0x7ff44c157790 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00c500 tx=0x7ff43c00c810 comp rx=0 tx=0).stop 2023-11-29T11:19:50.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 shutdown_connections 2023-11-29T11:19:50.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff430064ee0 0x7ff430067390 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff44c0cf740 0x7ff44c1eea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44c0c4170 0x7ff44c157790 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 --2- 172.21.15.81:0/1073771388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff44c0b2110 0x7ff44c15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 >> 172.21.15.81:0/1073771388 conn(0x7ff44c0cd0a0 msgr2=0x7ff44c159080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:50.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 shutdown_connections 2023-11-29T11:19:50.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.621+0000 7ff4526df700 1 -- 172.21.15.81:0/1073771388 wait complete. 2023-11-29T11:19:50.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:19:50.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff29a491700 1 Processor -- start 2023-11-29T11:19:50.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff29a491700 1 -- start start 2023-11-29T11:19:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff29a491700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940b00e0 0x7ff29415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff29a491700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff29409bdb0 0x7ff29415d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff29a491700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2940b2db0 con 0x7ff2940cbb30 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff29a491700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2940b3240 con 0x7ff29409bdb0 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff29a491700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29406d840 con 0x7ff2940b00e0 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff298c8e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff29409bdb0 0x7ff29415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff299c90700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff2940cbb30 0x7ff2940ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36194/0 (socket says 172.21.15.81:36194) 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.749+0000 7ff299c90700 1 -- 172.21.15.81:0/661842897 learned_addr learned my addr 172.21.15.81:0/661842897 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29948f700 1 --2- 172.21.15.81:0/661842897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940b00e0 0x7ff29415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff298c8e700 1 -- 172.21.15.81:0/661842897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940b00e0 msgr2=0x7ff29415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff298c8e700 1 --2- 172.21.15.81:0/661842897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940b00e0 0x7ff29415d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff298c8e700 1 -- 172.21.15.81:0/661842897 >> v1:172.21.15.81:6789/0 conn(0x7ff2940cbb30 legacy=0x7ff2940ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff293fff700 1 -- 172.21.15.81:0/661842897 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712010120 0 0) 0x7ff2940b2db0 con 0x7ff2940cbb30 2023-11-29T11:19:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff298c8e700 1 -- 172.21.15.81:0/661842897 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29406d560 con 0x7ff29409bdb0 2023-11-29T11:19:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29948f700 1 --2- 172.21.15.81:0/661842897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940b00e0 0x7ff29415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff298c8e700 1 --2- 172.21.15.81:0/661842897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29409bdb0 0x7ff29415d820 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7ff288009850 tx=0x7ff288009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e4ce99b1df0054 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff293fff700 1 -- 172.21.15.81:0/661842897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288011830 con 0x7ff29409bdb0 2023-11-29T11:19:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff293fff700 1 -- 172.21.15.81:0/661842897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288011990 con 0x7ff29409bdb0 2023-11-29T11:19:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff293fff700 1 -- 172.21.15.81:0/661842897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288011d20 con 0x7ff29409bdb0 2023-11-29T11:19:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29a491700 1 -- 172.21.15.81:0/661842897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29409bdb0 msgr2=0x7ff29415d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29a491700 1 --2- 172.21.15.81:0/661842897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29409bdb0 0x7ff29415d820 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7ff288009850 tx=0x7ff288009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29a491700 1 -- 172.21.15.81:0/661842897 shutdown_connections 2023-11-29T11:19:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29a491700 1 --2- 172.21.15.81:0/661842897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff29409bdb0 0x7ff29415d820 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29a491700 1 --2- 172.21.15.81:0/661842897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940b00e0 0x7ff29415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29a491700 1 -- 172.21.15.81:0/661842897 >> 172.21.15.81:0/661842897 conn(0x7ff2940cae70 msgr2=0x7ff2940cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29a491700 1 -- 172.21.15.81:0/661842897 shutdown_connections 2023-11-29T11:19:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.753+0000 7ff29a491700 1 -- 172.21.15.81:0/661842897 wait complete. 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 Processor -- start 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 -- start start 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff29409bdb0 0x7ff2940989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940b00e0 0x7ff2941571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940cbb30 0x7ff2941666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941662e0 con 0x7ff2940b00e0 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff294165520 con 0x7ff29409bdb0 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff294165800 con 0x7ff2940cbb30 2023-11-29T11:19:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940b00e0 0x7ff2941571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940b00e0 0x7ff2941571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43576/0 (socket says 172.21.15.81:43576) 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 -- 172.21.15.81:0/4024654876 learned_addr learned my addr 172.21.15.81:0/4024654876 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29948f700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff29409bdb0 0x7ff2940989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff299c90700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940cbb30 0x7ff2941666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 -- 172.21.15.81:0/4024654876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940cbb30 msgr2=0x7ff2941666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940cbb30 0x7ff2941666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 -- 172.21.15.81:0/4024654876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff29409bdb0 msgr2=0x7ff2940989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff29409bdb0 0x7ff2940989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 -- 172.21.15.81:0/4024654876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880094b0 con 0x7ff2940b00e0 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff298c8e700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940b00e0 0x7ff2941571f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7ff288013000 tx=0x7ff288004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff291ffb700 1 -- 172.21.15.81:0/4024654876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880045b0 con 0x7ff2940b00e0 2023-11-29T11:19:50.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff291ffb700 1 -- 172.21.15.81:0/4024654876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28801f070 con 0x7ff2940b00e0 2023-11-29T11:19:50.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff291ffb700 1 -- 172.21.15.81:0/4024654876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880038e0 con 0x7ff2940b00e0 2023-11-29T11:19:50.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2940ac3d0 con 0x7ff2940b00e0 2023-11-29T11:19:50.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.757+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2940ac0f0 con 0x7ff2940b00e0 2023-11-29T11:19:50.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.761+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29406cbe0 con 0x7ff2940b00e0 2023-11-29T11:19:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.761+0000 7ff291ffb700 1 -- 172.21.15.81:0/4024654876 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff28802a020 con 0x7ff2940b00e0 2023-11-29T11:19:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.761+0000 7ff291ffb700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff280064ee0 0x7ff280067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.761+0000 7ff291ffb700 1 -- 172.21.15.81:0/4024654876 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff2880837a0 con 0x7ff2940b00e0 2023-11-29T11:19:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.761+0000 7ff29948f700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff280064ee0 0x7ff280067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.761+0000 7ff29948f700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff280064ee0 0x7ff280067390 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff284009950 tx=0x7ff284008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.765+0000 7ff291ffb700 1 -- 172.21.15.81:0/4024654876 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff288051750 con 0x7ff2940b00e0 2023-11-29T11:19:50.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.925+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff294072500 con 0x7ff2940b00e0 2023-11-29T11:19:50.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.925+0000 7ff291ffb700 1 -- 172.21.15.81:0/4024654876 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff288054d70 con 0x7ff2940b00e0 2023-11-29T11:19:50.933 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:19:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff280064ee0 msgr2=0x7ff280067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff280064ee0 0x7ff280067390 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff284009950 tx=0x7ff284008040 comp rx=0 tx=0).stop 2023-11-29T11:19:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940b00e0 msgr2=0x7ff2941571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940b00e0 0x7ff2941571f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7ff288013000 tx=0x7ff288004770 comp rx=0 tx=0).stop 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 shutdown_connections 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff280064ee0 0x7ff280067390 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2940cbb30 0x7ff2941666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940b00e0 0x7ff2941571f0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 --2- 172.21.15.81:0/4024654876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff29409bdb0 0x7ff2940989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 >> 172.21.15.81:0/4024654876 conn(0x7ff2940cae70 msgr2=0x7ff2940cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 shutdown_connections 2023-11-29T11:19:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:50.929+0000 7ff29a491700 1 -- 172.21.15.81:0/4024654876 wait complete. 2023-11-29T11:19:50.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:19:51.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.061+0000 7fe72aca1700 1 Processor -- start 2023-11-29T11:19:51.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.061+0000 7fe72aca1700 1 -- start start 2023-11-29T11:19:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe72406e530 0x7fe72406e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe724070b60 con 0x7fe7240ceca0 2023-11-29T11:19:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7240ce810 con 0x7fe7240ccbf0 2023-11-29T11:19:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72406ee40 con 0x7fe72406e530 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72923e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe7240ceca0 0x7fe7240cf120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36206/0 (socket says 172.21.15.81:36206) 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72923e700 1 -- 172.21.15.81:0/2439537426 learned_addr learned my addr 172.21.15.81:0/2439537426 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe728a3d700 1 --2- 172.21.15.81:0/2439537426 >> v2:172.21.15.81:3300/0 conn(0x7fe72406e530 0x7fe72406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe7237fe700 1 -- 172.21.15.81:0/2439537426 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749531341 0 0) 0x7fe724070b60 con 0x7fe7240ceca0 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe7237fe700 1 -- 172.21.15.81:0/2439537426 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7100035d0 con 0x7fe7240ceca0 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe7237fe700 1 -- 172.21.15.81:0/2439537426 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537735696 0 0) 0x7fe7240ce810 con 0x7fe7240ccbf0 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe7237fe700 1 -- 172.21.15.81:0/2439537426 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe724070b60 con 0x7fe7240ccbf0 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe728a3d700 1 -- 172.21.15.81:0/2439537426 >> v1:172.21.15.176:6789/0 conn(0x7fe7240ccbf0 legacy=0x7fe724070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe728a3d700 1 -- 172.21.15.81:0/2439537426 >> v1:172.21.15.81:6789/0 conn(0x7fe7240ceca0 legacy=0x7fe7240cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe728a3d700 1 -- 172.21.15.81:0/2439537426 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240cc070 con 0x7fe72406e530 2023-11-29T11:19:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe728a3d700 1 --2- 172.21.15.81:0/2439537426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe72406e530 0x7fe72406e900 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009850 tx=0x7fe70c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2fb49f3b389397 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe7237fe700 1 -- 172.21.15.81:0/2439537426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c011830 con 0x7fe72406e530 2023-11-29T11:19:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe7237fe700 1 -- 172.21.15.81:0/2439537426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c011990 con 0x7fe72406e530 2023-11-29T11:19:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe7237fe700 1 -- 172.21.15.81:0/2439537426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c011d00 con 0x7fe72406e530 2023-11-29T11:19:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 -- 172.21.15.81:0/2439537426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe72406e530 msgr2=0x7fe72406e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 --2- 172.21.15.81:0/2439537426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe72406e530 0x7fe72406e900 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009850 tx=0x7fe70c009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 -- 172.21.15.81:0/2439537426 shutdown_connections 2023-11-29T11:19:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 --2- 172.21.15.81:0/2439537426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe72406e530 0x7fe72406e900 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 -- 172.21.15.81:0/2439537426 >> 172.21.15.81:0/2439537426 conn(0x7fe7240cdef0 msgr2=0x7fe7240d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 -- 172.21.15.81:0/2439537426 shutdown_connections 2023-11-29T11:19:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.065+0000 7fe72aca1700 1 -- 172.21.15.81:0/2439537426 wait complete. 2023-11-29T11:19:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 Processor -- start 2023-11-29T11:19:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 -- start start 2023-11-29T11:19:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe72406e530 0x7fe724155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7240ccbf0 0x7fe72406ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7240ceca0 0x7fe7241f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe724157aa0 con 0x7fe7240ceca0 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7241574b0 con 0x7fe7240ccbf0 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe724156210 con 0x7fe72406e530 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7240ceca0 0x7fe7241f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7240ceca0 0x7fe7241f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43596/0 (socket says 172.21.15.81:43596) 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 -- 172.21.15.81:0/3200469562 learned_addr learned my addr 172.21.15.81:0/3200469562 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe723fff700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7240ccbf0 0x7fe72406ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe728a3d700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe72406e530 0x7fe724155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 -- 172.21.15.81:0/3200469562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe72406e530 msgr2=0x7fe724155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe72406e530 0x7fe724155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 -- 172.21.15.81:0/3200469562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7240ccbf0 msgr2=0x7fe72406ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7240ccbf0 0x7fe72406ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 -- 172.21.15.81:0/3200469562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c0094b0 con 0x7fe7240ceca0 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72923e700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7240ceca0 0x7fe7241f4e70 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00cb70 tx=0x7fe71c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe7217fa700 1 -- 172.21.15.81:0/3200469562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00a9e0 con 0x7fe7240ceca0 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe7217fa700 1 -- 172.21.15.81:0/3200469562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c00ab40 con 0x7fe7240ceca0 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7240cc630 con 0x7fe7240ceca0 2023-11-29T11:19:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.069+0000 7fe7217fa700 1 -- 172.21.15.81:0/3200469562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c012400 con 0x7fe7240ceca0 2023-11-29T11:19:51.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.073+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7240cc350 con 0x7fe7240ceca0 2023-11-29T11:19:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.073+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7240cc910 con 0x7fe7240ceca0 2023-11-29T11:19:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.073+0000 7fe7217fa700 1 -- 172.21.15.81:0/3200469562 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe71c019030 con 0x7fe7240ceca0 2023-11-29T11:19:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.073+0000 7fe7217fa700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe704064ee0 0x7fe704067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.073+0000 7fe7217fa700 1 -- 172.21.15.81:0/3200469562 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe71c081e10 con 0x7fe7240ceca0 2023-11-29T11:19:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.073+0000 7fe728a3d700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe704064ee0 0x7fe704067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.073+0000 7fe728a3d700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe704064ee0 0x7fe704067390 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0090b0 tx=0x7fe70c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.081+0000 7fe7217fa700 1 -- 172.21.15.81:0/3200469562 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe71c04ff20 con 0x7fe7240ceca0 2023-11-29T11:19:51.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.241+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe724072c20 con 0x7fe7240ceca0 2023-11-29T11:19:51.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.241+0000 7fe7217fa700 1 -- 172.21.15.81:0/3200469562 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe71c053540 con 0x7fe7240ceca0 2023-11-29T11:19:51.250 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:19:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe704064ee0 msgr2=0x7fe704067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe704064ee0 0x7fe704067390 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0090b0 tx=0x7fe70c008030 comp rx=0 tx=0).stop 2023-11-29T11:19:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7240ceca0 msgr2=0x7fe7241f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7240ceca0 0x7fe7241f4e70 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00cb70 tx=0x7fe71c00ce80 comp rx=0 tx=0).stop 2023-11-29T11:19:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 shutdown_connections 2023-11-29T11:19:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe704064ee0 0x7fe704067390 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7240ceca0 0x7fe7241f4e70 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7240ccbf0 0x7fe72406ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 --2- 172.21.15.81:0/3200469562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe72406e530 0x7fe724155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 >> 172.21.15.81:0/3200469562 conn(0x7fe7240cdef0 msgr2=0x7fe7240c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:51.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 shutdown_connections 2023-11-29T11:19:51.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.245+0000 7fe72aca1700 1 -- 172.21.15.81:0/3200469562 wait complete. 2023-11-29T11:19:51.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:19:51.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b3fff700 1 Processor -- start 2023-11-29T11:19:51.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b3fff700 1 -- start start 2023-11-29T11:19:51.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59b406aef0 0x7f59b40cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b40d0140 con 0x7f59b406cdd0 2023-11-29T11:19:51.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b3fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b415c670 con 0x7f59b406b320 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b3fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b40cf530 con 0x7f59b406aef0 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f59b406cdd0 0x7f59b406d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36218/0 (socket says 172.21.15.81:36218) 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b2ffd700 1 -- 172.21.15.81:0/1012499386 learned_addr learned my addr 172.21.15.81:0/1012499386 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b27fc700 1 --2- 172.21.15.81:0/1012499386 >> v2:172.21.15.81:3300/0 conn(0x7f59b406aef0 0x7f59b40cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b1ffb700 1 -- 172.21.15.81:0/1012499386 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723394602 0 0) 0x7f59b40d0140 con 0x7f59b406cdd0 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b1ffb700 1 -- 172.21.15.81:0/1012499386 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a00035d0 con 0x7f59b406cdd0 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b27fc700 1 -- 172.21.15.81:0/1012499386 >> v1:172.21.15.176:6789/0 conn(0x7f59b406b320 legacy=0x7f59b40cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b27fc700 1 -- 172.21.15.81:0/1012499386 >> v1:172.21.15.81:6789/0 conn(0x7f59b406cdd0 legacy=0x7f59b406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b1ffb700 1 -- 172.21.15.81:0/1012499386 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3919298019 0 0) 0x7f59a00035d0 con 0x7f59b406cdd0 2023-11-29T11:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b27fc700 1 -- 172.21.15.81:0/1012499386 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40cf810 con 0x7f59b406aef0 2023-11-29T11:19:51.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b27fc700 1 --2- 172.21.15.81:0/1012499386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40cd070 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009850 tx=0x7f59a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2e45e093231712 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b1ffb700 1 -- 172.21.15.81:0/1012499386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0017f0 con 0x7f59b406aef0 2023-11-29T11:19:51.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b1ffb700 1 -- 172.21.15.81:0/1012499386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a4004030 con 0x7f59b406aef0 2023-11-29T11:19:51.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.377+0000 7f59b1ffb700 1 -- 172.21.15.81:0/1012499386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40043c0 con 0x7f59b406aef0 2023-11-29T11:19:51.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 -- 172.21.15.81:0/1012499386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 msgr2=0x7f59b40cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 --2- 172.21.15.81:0/1012499386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40cd070 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009850 tx=0x7f59a4009b60 comp rx=0 tx=0).stop 2023-11-29T11:19:51.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 -- 172.21.15.81:0/1012499386 shutdown_connections 2023-11-29T11:19:51.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 --2- 172.21.15.81:0/1012499386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40cd070 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 -- 172.21.15.81:0/1012499386 >> 172.21.15.81:0/1012499386 conn(0x7f59b409bb10 msgr2=0x7f59b40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 -- 172.21.15.81:0/1012499386 shutdown_connections 2023-11-29T11:19:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 -- 172.21.15.81:0/1012499386 wait complete. 2023-11-29T11:19:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 Processor -- start 2023-11-29T11:19:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.381+0000 7f59b3fff700 1 -- start start 2023-11-29T11:19:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b406b320 0x7f59b41f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b406cdd0 0x7f59b40cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40c96a0 con 0x7f59b406aef0 2023-11-29T11:19:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40d1e40 con 0x7f59b406b320 2023-11-29T11:19:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b41f2200 con 0x7f59b406cdd0 2023-11-29T11:19:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43608/0 (socket says 172.21.15.81:43608) 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 -- 172.21.15.81:0/482647151 learned_addr learned my addr 172.21.15.81:0/482647151 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b27fc700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b406b320 0x7f59b41f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b37fe700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b406cdd0 0x7f59b40cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 -- 172.21.15.81:0/482647151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b406cdd0 msgr2=0x7f59b40cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b406cdd0 0x7f59b40cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 -- 172.21.15.81:0/482647151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b406b320 msgr2=0x7f59b41f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b406b320 0x7f59b41f1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 -- 172.21.15.81:0/482647151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40094b0 con 0x7f59b406aef0 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b2ffd700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40c9160 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f599c00c730 tx=0x7f599c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59abfff700 1 -- 172.21.15.81:0/482647151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0074e0 con 0x7f59b406aef0 2023-11-29T11:19:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59abfff700 1 -- 172.21.15.81:0/482647151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c007640 con 0x7f59b406aef0 2023-11-29T11:19:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b40cfdd0 con 0x7f59b406aef0 2023-11-29T11:19:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59abfff700 1 -- 172.21.15.81:0/482647151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c005a90 con 0x7f59b406aef0 2023-11-29T11:19:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b40cfaf0 con 0x7f59b406aef0 2023-11-29T11:19:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.385+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b40b1df0 con 0x7f59b406aef0 2023-11-29T11:19:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.389+0000 7f59abfff700 1 -- 172.21.15.81:0/482647151 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f599c019030 con 0x7f59b406aef0 2023-11-29T11:19:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.389+0000 7f59abfff700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5994064f10 0x7f59940673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.389+0000 7f59abfff700 1 -- 172.21.15.81:0/482647151 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f599c0813e0 con 0x7f59b406aef0 2023-11-29T11:19:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.389+0000 7f59b27fc700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5994064f10 0x7f59940673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.389+0000 7f59b27fc700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5994064f10 0x7f59940673c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f59a40090b0 tx=0x7f59a4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.393+0000 7f59abfff700 1 -- 172.21.15.81:0/482647151 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f599c04f3c0 con 0x7f59b406aef0 2023-11-29T11:19:51.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.561+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59b40008d0 con 0x7f59b406aef0 2023-11-29T11:19:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.561+0000 7f59abfff700 1 -- 172.21.15.81:0/482647151 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f599c017020 con 0x7f59b406aef0 2023-11-29T11:19:51.569 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:19:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5994064f10 msgr2=0x7f59940673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5994064f10 0x7f59940673c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f59a40090b0 tx=0x7f59a4008030 comp rx=0 tx=0).stop 2023-11-29T11:19:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 msgr2=0x7f59b40c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40c9160 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f599c00c730 tx=0x7f599c00ca40 comp rx=0 tx=0).stop 2023-11-29T11:19:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 shutdown_connections 2023-11-29T11:19:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5994064f10 0x7f59940673c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59b406cdd0 0x7f59b40cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59b406b320 0x7f59b41f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 --2- 172.21.15.81:0/482647151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b406aef0 0x7f59b40c9160 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 >> 172.21.15.81:0/482647151 conn(0x7f59b409bb10 msgr2=0x7f59b40b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 shutdown_connections 2023-11-29T11:19:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.565+0000 7f59b3fff700 1 -- 172.21.15.81:0/482647151 wait complete. 2023-11-29T11:19:51.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:19:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.689+0000 7f719b59e700 1 Processor -- start 2023-11-29T11:19:51.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.689+0000 7f719b59e700 1 -- start start 2023-11-29T11:19:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f719c1584c0 0x7f719c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f719c0b32e0 0x7f719c0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0b3c60 con 0x7f719c0caea0 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c06dbd0 con 0x7f719c1584c0 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0cd0f0 con 0x7f719c0b32e0 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f719c1584c0 0x7f719c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f719c1584c0 0x7f719c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43616/0 (socket says 172.21.15.81:43616) 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719a59c700 1 -- 172.21.15.81:0/4189525201 learned_addr learned my addr 172.21.15.81:0/4189525201 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f7199d9b700 1 --2- 172.21.15.81:0/4189525201 >> v2:172.21.15.176:3300/0 conn(0x7f719c0b32e0 0x7f719c0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719a59c700 1 -- 172.21.15.81:0/4189525201 >> v2:172.21.15.176:3300/0 conn(0x7f719c0b32e0 msgr2=0x7f719c0b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719a59c700 1 --2- 172.21.15.81:0/4189525201 >> v2:172.21.15.176:3300/0 conn(0x7f719c0b32e0 0x7f719c0b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719a59c700 1 -- 172.21.15.81:0/4189525201 >> v1:172.21.15.176:6789/0 conn(0x7f719c0caea0 legacy=0x7f719c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719a59c700 1 -- 172.21.15.81:0/4189525201 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0cd3d0 con 0x7f719c1584c0 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719a59c700 1 --2- 172.21.15.81:0/4189525201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c1584c0 0x7f719c0cb6f0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f719c0cae10 tx=0x7f7184009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64c7166b022f2e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719959a700 1 -- 172.21.15.81:0/4189525201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184011830 con 0x7f719c1584c0 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719959a700 1 -- 172.21.15.81:0/4189525201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7184011990 con 0x7f719c1584c0 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719959a700 1 -- 172.21.15.81:0/4189525201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184011d20 con 0x7f719c1584c0 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 -- 172.21.15.81:0/4189525201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c1584c0 msgr2=0x7f719c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 --2- 172.21.15.81:0/4189525201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c1584c0 0x7f719c0cb6f0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f719c0cae10 tx=0x7f7184009bf0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 -- 172.21.15.81:0/4189525201 shutdown_connections 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 --2- 172.21.15.81:0/4189525201 >> v2:172.21.15.176:3300/0 conn(0x7f719c0b32e0 0x7f719c0b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 --2- 172.21.15.81:0/4189525201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c1584c0 0x7f719c0cb6f0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 -- 172.21.15.81:0/4189525201 >> 172.21.15.81:0/4189525201 conn(0x7f719c0ce3e0 msgr2=0x7f719c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 -- 172.21.15.81:0/4189525201 shutdown_connections 2023-11-29T11:19:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.693+0000 7f719b59e700 1 -- 172.21.15.81:0/4189525201 wait complete. 2023-11-29T11:19:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719b59e700 1 Processor -- start 2023-11-29T11:19:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719b59e700 1 -- start start 2023-11-29T11:19:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0b32e0 0x7f719c0c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0caea0 0x7f719c097800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c1584c0 0x7f719c0c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c1ef4c0 con 0x7f719c0caea0 2023-11-29T11:19:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c2720 con 0x7f719c1584c0 2023-11-29T11:19:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c2a00 con 0x7f719c0b32e0 2023-11-29T11:19:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0caea0 0x7f719c097800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0caea0 0x7f719c097800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43620/0 (socket says 172.21.15.81:43620) 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 -- 172.21.15.81:0/2697521190 learned_addr learned my addr 172.21.15.81:0/2697521190 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719a59c700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0b32e0 0x7f719c0c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f719ad9d700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c1584c0 0x7f719c0c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 -- 172.21.15.81:0/2697521190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0b32e0 msgr2=0x7f719c0c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0b32e0 0x7f719c0c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 -- 172.21.15.81:0/2697521190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c1584c0 msgr2=0x7f719c0c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c1584c0 0x7f719c0c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 -- 172.21.15.81:0/2697521190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184009570 con 0x7f719c0caea0 2023-11-29T11:19:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.697+0000 7f7199d9b700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0caea0 0x7f719c097800 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f718c00efc0 tx=0x7f718c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f7192ffd700 1 -- 172.21.15.81:0/2697521190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00cd10 con 0x7f719c0caea0 2023-11-29T11:19:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f7192ffd700 1 -- 172.21.15.81:0/2697521190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c00f040 con 0x7f719c0caea0 2023-11-29T11:19:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0cd990 con 0x7f719c0caea0 2023-11-29T11:19:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f7192ffd700 1 -- 172.21.15.81:0/2697521190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0146a0 con 0x7f719c0caea0 2023-11-29T11:19:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c0cd6b0 con 0x7f719c0caea0 2023-11-29T11:19:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c0cdc70 con 0x7f719c0caea0 2023-11-29T11:19:51.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f7192ffd700 1 -- 172.21.15.81:0/2697521190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f718c014800 con 0x7f719c0caea0 2023-11-29T11:19:51.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f7192ffd700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f717c064ee0 0x7f717c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:51.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f7192ffd700 1 -- 172.21.15.81:0/2697521190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f718c082d70 con 0x7f719c0caea0 2023-11-29T11:19:51.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f719a59c700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f717c064ee0 0x7f717c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:51.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.701+0000 7f719a59c700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f717c064ee0 0x7f717c067390 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7184000c00 tx=0x7f7184008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:51.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.709+0000 7f7192ffd700 1 -- 172.21.15.81:0/2697521190 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f718c050c70 con 0x7f719c0caea0 2023-11-29T11:19:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.881+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f719c072500 con 0x7f719c0caea0 2023-11-29T11:19:51.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f7192ffd700 1 -- 172.21.15.81:0/2697521190 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v96) v1 ==== 80+0+0 (secure 0 0 0) 0x7f718c054290 con 0x7f719c0caea0 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f717c064ee0 msgr2=0x7f717c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f717c064ee0 0x7f717c067390 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7184000c00 tx=0x7f7184008030 comp rx=0 tx=0).stop 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0caea0 msgr2=0x7f719c097800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0caea0 0x7f719c097800 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f718c00efc0 tx=0x7f718c00c3a0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 shutdown_connections 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f717c064ee0 0x7f717c067390 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719c1584c0 0x7f719c0c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f719c0caea0 0x7f719c097800 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 --2- 172.21.15.81:0/2697521190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719c0b32e0 0x7f719c0c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 >> 172.21.15.81:0/2697521190 conn(0x7f719c0ce3e0 msgr2=0x7f719c1576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 shutdown_connections 2023-11-29T11:19:51.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:51.885+0000 7f719b59e700 1 -- 172.21.15.81:0/2697521190 wait complete. 2023-11-29T11:19:51.894 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:19:51.905 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:19:51.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:51.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:19:51.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[57941]: fuse finished with error 0 and tester_r 0 2023-11-29T11:19:51.956 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:19:56.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:19:56.666 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:19:58.058 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:19:58.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:19:58.058 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:19:58.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:19:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f5076700 1 Processor -- start 2023-11-29T11:19:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f5076700 1 -- start start 2023-11-29T11:19:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f5076700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0159e70 0x7f02f006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f5076700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02f00cb470 0x7f02f00c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f5076700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f006ace0 con 0x7f02f0069c40 2023-11-29T11:19:58.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f5076700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f006a0d0 con 0x7f02f00cb470 2023-11-29T11:19:58.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f5076700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f006a3b0 con 0x7f02f0159e70 2023-11-29T11:19:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02effff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0159e70 0x7f02f006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f4875700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02f00cb470 0x7f02f00c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02e77fe700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f02f0069c40 0x7f02f00cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:59770/0 (socket says 172.21.15.81:59770) 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02f4875700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02f00cb470 0x7f02f00c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:56010/0 (socket says 172.21.15.81:56010) 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.181+0000 7f02e77fe700 1 -- 172.21.15.81:0/2205610585 learned_addr learned my addr 172.21.15.81:0/2205610585 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02ef7fe700 1 -- 172.21.15.81:0/2205610585 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375096191 0 0) 0x7f02f006ace0 con 0x7f02f0069c40 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02ef7fe700 1 -- 172.21.15.81:0/2205610585 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02dc0035d0 con 0x7f02f0069c40 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f4875700 1 -- 172.21.15.81:0/2205610585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0159e70 msgr2=0x7f02f006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f4875700 1 --2- 172.21.15.81:0/2205610585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0159e70 0x7f02f006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f4875700 1 -- 172.21.15.81:0/2205610585 >> v1:172.21.15.176:6789/0 conn(0x7f02f0069c40 legacy=0x7f02f00cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f4875700 1 -- 172.21.15.81:0/2205610585 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f006a690 con 0x7f02f00cb470 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f4875700 1 --2- 172.21.15.81:0/2205610585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00cb470 0x7f02f00c91d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009d90 tx=0x7f02e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14bbd0de1a647a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02ef7fe700 1 -- 172.21.15.81:0/2205610585 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800e070 con 0x7f02f00cb470 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02ef7fe700 1 -- 172.21.15.81:0/2205610585 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e800bb20 con 0x7f02f00cb470 2023-11-29T11:19:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02ef7fe700 1 -- 172.21.15.81:0/2205610585 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8012430 con 0x7f02f00cb470 2023-11-29T11:19:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 -- 172.21.15.81:0/2205610585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00cb470 msgr2=0x7f02f00c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 --2- 172.21.15.81:0/2205610585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00cb470 0x7f02f00c91d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009d90 tx=0x7f02e800b330 comp rx=0 tx=0).stop 2023-11-29T11:19:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 -- 172.21.15.81:0/2205610585 shutdown_connections 2023-11-29T11:19:58.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 --2- 172.21.15.81:0/2205610585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f00cb470 0x7f02f00c91d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 --2- 172.21.15.81:0/2205610585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f0159e70 0x7f02f006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 -- 172.21.15.81:0/2205610585 >> 172.21.15.81:0/2205610585 conn(0x7f02f00ce3e0 msgr2=0x7f02f00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:58.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 -- 172.21.15.81:0/2205610585 shutdown_connections 2023-11-29T11:19:58.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 -- 172.21.15.81:0/2205610585 wait complete. 2023-11-29T11:19:58.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 Processor -- start 2023-11-29T11:19:58.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.185+0000 7f02f5076700 1 -- start start 2023-11-29T11:19:58.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f5076700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02f0069c40 0x7f02f00c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f5076700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f00cb470 0x7f02f01ef520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f5076700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f0159e70 0x7f02f01efa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f5076700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01f0400 con 0x7f02f0069c40 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f5076700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0156b30 con 0x7f02f0159e70 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f5076700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00b0890 con 0x7f02f00cb470 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02f0069c40 0x7f02f00c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02f0069c40 0x7f02f00c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43632/0 (socket says 172.21.15.81:43632) 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 -- 172.21.15.81:0/2106434546 learned_addr learned my addr 172.21.15.81:0/2106434546 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02e77fe700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f00cb470 0x7f02f01ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f4875700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f0159e70 0x7f02f01efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 -- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f00cb470 msgr2=0x7f02f01ef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f00cb470 0x7f02f01ef520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 -- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f0159e70 msgr2=0x7f02f01efa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f0159e70 0x7f02f01efa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 -- 172.21.15.81:0/2106434546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009a70 con 0x7f02f0069c40 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02e77fe700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f00cb470 0x7f02f01ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f4875700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f0159e70 0x7f02f01efa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02effff700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02f0069c40 0x7f02f00c6380 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f02e000e9d0 tx=0x7f02e000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02ed7fa700 1 -- 172.21.15.81:0/2106434546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0009720 con 0x7f02f0069c40 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02ed7fa700 1 -- 172.21.15.81:0/2106434546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e000ee70 con 0x7f02f0069c40 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f015a240 con 0x7f02f0069c40 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02ed7fa700 1 -- 172.21.15.81:0/2106434546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000c9f0 con 0x7f02f0069c40 2023-11-29T11:19:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.189+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f006a970 con 0x7f02f0069c40 2023-11-29T11:19:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.193+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f006cee0 con 0x7f02f0069c40 2023-11-29T11:19:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.193+0000 7f02ed7fa700 1 -- 172.21.15.81:0/2106434546 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f02e0019030 con 0x7f02f0069c40 2023-11-29T11:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.193+0000 7f02ed7fa700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02d0064f10 0x7f02d00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.193+0000 7f02ed7fa700 1 -- 172.21.15.81:0/2106434546 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f02e0081ea0 con 0x7f02f0069c40 2023-11-29T11:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.193+0000 7f02e77fe700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02d0064f10 0x7f02d00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.193+0000 7f02e77fe700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02d0064f10 0x7f02d00673c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f02f009c4a0 tx=0x7f02d8007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.201+0000 7f02ed7fa700 1 -- 172.21.15.81:0/2106434546 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f02e004fe80 con 0x7f02f0069c40 2023-11-29T11:19:58.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.389+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02f0072500 con 0x7f02f0069c40 2023-11-29T11:19:58.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.389+0000 7f02ed7fa700 1 -- 172.21.15.81:0/2106434546 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f02e00534a0 con 0x7f02f0069c40 2023-11-29T11:19:58.398 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:19:58.399 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:19:42.677504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8016":{"gid":8016,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6833/1691706444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1691706444},{"type":"v1","addr":"172.21.15.176:6833","nonce":1691706444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02d0064f10 msgr2=0x7f02d00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02d0064f10 0x7f02d00673c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f02f009c4a0 tx=0x7f02d8007de0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02f0069c40 msgr2=0x7f02f00c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02f0069c40 0x7f02f00c6380 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f02e000e9d0 tx=0x7f02e000ece0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 shutdown_connections 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f02d0064f10 0x7f02d00673c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02f0159e70 0x7f02f01efa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02f00cb470 0x7f02f01ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 --2- 172.21.15.81:0/2106434546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02f0069c40 0x7f02f00c6380 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 >> 172.21.15.81:0/2106434546 conn(0x7f02f00ce3e0 msgr2=0x7f02f00acba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:58.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 shutdown_connections 2023-11-29T11:19:58.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.393+0000 7f02f5076700 1 -- 172.21.15.81:0/2106434546 wait complete. 2023-11-29T11:19:58.402 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 54 2023-11-29T11:19:58.413 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-11-29T11:19:58.563 INFO:teuthology.orchestra.run.smithi176.stdout:{"message":"","return_code":0} 2023-11-29T11:19:58.563 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:19:58.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:19:58.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.669+0000 7f9d5894c700 1 Processor -- start 2023-11-29T11:19:58.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5894c700 1 -- start start 2023-11-29T11:19:58.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5894c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d5415c780 0x7f9d540cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5894c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9d540ce4a0 0x7f9d54071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5894c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d540ca490 con 0x7f9d5415c3b0 2023-11-29T11:19:58.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5894c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d540cdad0 con 0x7f9d540ce4a0 2023-11-29T11:19:58.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5894c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540cd4c0 con 0x7f9d5415c780 2023-11-29T11:19:58.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5359e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9d540ce4a0 0x7f9d54071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5359e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9d540ce4a0 0x7f9d54071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:56026/0 (socket says 172.21.15.81:56026) 2023-11-29T11:19:58.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5359e700 1 -- 172.21.15.81:0/1225217336 learned_addr learned my addr 172.21.15.81:0/1225217336 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:58.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d4bfff700 1 --2- 172.21.15.81:0/1225217336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d5415c780 0x7f9d540cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5359e700 1 -- 172.21.15.81:0/1225217336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d5415c780 msgr2=0x7f9d540cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:58.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5359e700 1 --2- 172.21.15.81:0/1225217336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d5415c780 0x7f9d540cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5359e700 1 -- 172.21.15.81:0/1225217336 >> v1:172.21.15.176:6789/0 conn(0x7f9d5415c3b0 legacy=0x7f9d540c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5359e700 1 -- 172.21.15.81:0/1225217336 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540ca6d0 con 0x7f9d540ce4a0 2023-11-29T11:19:58.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5359e700 1 --2- 172.21.15.81:0/1225217336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d540ce4a0 0x7f9d54071030 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009e50 tx=0x7f9d4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7dd02ecbe64e94c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:58.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5259c700 1 -- 172.21.15.81:0/1225217336 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00e070 con 0x7f9d540ce4a0 2023-11-29T11:19:58.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5259c700 1 -- 172.21.15.81:0/1225217336 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c00b910 con 0x7f9d540ce4a0 2023-11-29T11:19:58.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.673+0000 7f9d5259c700 1 -- 172.21.15.81:0/1225217336 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00bcc0 con 0x7f9d540ce4a0 2023-11-29T11:19:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.677+0000 7f9d5894c700 1 -- 172.21.15.81:0/1225217336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d540ce4a0 msgr2=0x7f9d54071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.677+0000 7f9d5894c700 1 --2- 172.21.15.81:0/1225217336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d540ce4a0 0x7f9d54071030 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009e50 tx=0x7f9d4c00b330 comp rx=0 tx=0).stop 2023-11-29T11:19:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.677+0000 7f9d5894c700 1 -- 172.21.15.81:0/1225217336 shutdown_connections 2023-11-29T11:19:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.677+0000 7f9d5894c700 1 --2- 172.21.15.81:0/1225217336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d540ce4a0 0x7f9d54071030 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.677+0000 7f9d5894c700 1 --2- 172.21.15.81:0/1225217336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d5415c780 0x7f9d540cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.677+0000 7f9d5894c700 1 -- 172.21.15.81:0/1225217336 >> 172.21.15.81:0/1225217336 conn(0x7f9d540b1d40 msgr2=0x7f9d540cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.677+0000 7f9d5894c700 1 -- 172.21.15.81:0/1225217336 shutdown_connections 2023-11-29T11:19:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.677+0000 7f9d5894c700 1 -- 172.21.15.81:0/1225217336 wait complete. 2023-11-29T11:19:58.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 Processor -- start 2023-11-29T11:19:58.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 -- start start 2023-11-29T11:19:58.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d540ce4a0 0x7f9d54157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5415c3b0 0x7f9d5415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d5415c780 0x7f9d5415f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540b53a0 con 0x7f9d5415c3b0 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540acda0 con 0x7f9d5415c780 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5415e300 con 0x7f9d540ce4a0 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5415c3b0 0x7f9d5415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5415c3b0 0x7f9d5415edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43640/0 (socket says 172.21.15.81:43640) 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 -- 172.21.15.81:0/2944558851 learned_addr learned my addr 172.21.15.81:0/2944558851 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d52d9d700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d540ce4a0 0x7f9d54157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5359e700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d5415c780 0x7f9d5415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 -- 172.21.15.81:0/2944558851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d540ce4a0 msgr2=0x7f9d54157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d540ce4a0 0x7f9d54157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 -- 172.21.15.81:0/2944558851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d5415c780 msgr2=0x7f9d5415f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d5415c780 0x7f9d5415f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 -- 172.21.15.81:0/2944558851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c009b30 con 0x7f9d5415c3b0 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4bfff700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5415c3b0 0x7f9d5415edc0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00e9d0 tx=0x7f9d3c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4b7fe700 1 -- 172.21.15.81:0/2944558851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c009720 con 0x7f9d5415c3b0 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4b7fe700 1 -- 172.21.15.81:0/2944558851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c00ee70 con 0x7f9d5415c3b0 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d540ca9b0 con 0x7f9d5415c3b0 2023-11-29T11:19:58.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d4b7fe700 1 -- 172.21.15.81:0/2944558851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00ca50 con 0x7f9d5415c3b0 2023-11-29T11:19:58.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.681+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d540cd760 con 0x7f9d5415c3b0 2023-11-29T11:19:58.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.685+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d540cab40 con 0x7f9d5415c3b0 2023-11-29T11:19:58.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.685+0000 7f9d4b7fe700 1 -- 172.21.15.81:0/2944558851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d3c019030 con 0x7f9d5415c3b0 2023-11-29T11:19:58.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.685+0000 7f9d4b7fe700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d34064f10 0x7f9d340673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:58.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.685+0000 7f9d4b7fe700 1 -- 172.21.15.81:0/2944558851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9d3c081e70 con 0x7f9d5415c3b0 2023-11-29T11:19:58.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.685+0000 7f9d52d9d700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d34064f10 0x7f9d340673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:58.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.689+0000 7f9d52d9d700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d34064f10 0x7f9d340673c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9d440018a0 tx=0x7f9d44009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:58.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.693+0000 7f9d4b7fe700 1 -- 172.21.15.81:0/2944558851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9d3c04fed0 con 0x7f9d5415c3b0 2023-11-29T11:19:58.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:58.889+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9d5415dda0 con 0x7f9d5415c3b0 2023-11-29T11:19:59.114 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:19:59.105+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:19:59.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.117+0000 7f9d4b7fe700 1 -- 172.21.15.81:0/2944558851 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9d3c0534f0 con 0x7f9d5415c3b0 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d34064f10 msgr2=0x7f9d340673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d34064f10 0x7f9d340673c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9d440018a0 tx=0x7f9d44009040 comp rx=0 tx=0).stop 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5415c3b0 msgr2=0x7f9d5415edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5415c3b0 0x7f9d5415edc0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00e9d0 tx=0x7f9d3c00ece0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 shutdown_connections 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d34064f10 0x7f9d340673c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d5415c780 0x7f9d5415f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5415c3b0 0x7f9d5415edc0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 --2- 172.21.15.81:0/2944558851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d540ce4a0 0x7f9d54157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 >> 172.21.15.81:0/2944558851 conn(0x7f9d540b1d40 msgr2=0x7f9d540af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:59.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 shutdown_connections 2023-11-29T11:19:59.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.121+0000 7f9d5894c700 1 -- 172.21.15.81:0/2944558851 wait complete. 2023-11-29T11:19:59.130 INFO:tasks.ceph.mds.d.smithi176.stderr: -3807> 2023-11-29T11:19:41.107+0000 7fa4d4ea3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:19:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:19:59.146 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2023-11-29T11:19:59.165 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:19:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c4253140 1 Processor -- start 2023-11-29T11:19:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c4253140 1 -- start start 2023-11-29T11:19:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c4253140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a867e0 0x558ba4bbf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c4253140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ea90 0x558ba4bbf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c4253140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a9ee60 0x558ba4bbfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c4253140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ba497d240 con 0x558ba4a867e0 2023-11-29T11:19:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c4253140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ba4a9be40 con 0x558ba4a9ee60 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c4253140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ba4a9c0a0 con 0x558ba4a9ea90 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a867e0 0x558ba4bbf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a867e0 0x558ba4bbf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43664/0 (socket says 172.21.15.81:43664) 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 -- 172.21.15.81:0/995905298 learned_addr learned my addr 172.21.15.81:0/995905298 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1587700 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ea90 0x558ba4bbf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c2589700 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a9ee60 0x558ba4bbfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 -- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ea90 msgr2=0x558ba4bbf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ea90 0x558ba4bbf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 -- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a9ee60 msgr2=0x558ba4bbfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a9ee60 0x558ba4bbfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 -- 172.21.15.81:0/995905298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc005d20 con 0x558ba4a867e0 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1587700 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ea90 0x558ba4bbf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.181+0000 7fe0c1d88700 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a867e0 0x558ba4bbf280 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0099a0 tx=0x7fe0bc005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fed835a651ab5a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0bbfff700 1 -- 172.21.15.81:0/995905298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc017070 con 0x558ba4a867e0 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0bbfff700 1 -- 172.21.15.81:0/995905298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc009e80 con 0x558ba4a867e0 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0bbfff700 1 -- 172.21.15.81:0/995905298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00f040 con 0x558ba4a867e0 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 -- 172.21.15.81:0/995905298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a867e0 msgr2=0x558ba4bbf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a867e0 0x558ba4bbf280 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0099a0 tx=0x7fe0bc005a00 comp rx=0 tx=0).stop 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 -- 172.21.15.81:0/995905298 shutdown_connections 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a9ee60 0x558ba4bbfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ea90 0x558ba4bbf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 --2- 172.21.15.81:0/995905298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a867e0 0x558ba4bbf280 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 -- 172.21.15.81:0/995905298 >> 172.21.15.81:0/995905298 conn(0x558ba4a84dc0 msgr2=0x558ba4a59dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 -- 172.21.15.81:0/995905298 shutdown_connections 2023-11-29T11:19:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 -- 172.21.15.81:0/995905298 wait complete. 2023-11-29T11:19:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 Processor -- start 2023-11-29T11:19:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.185+0000 7fe0c4253140 1 -- start start 2023-11-29T11:19:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c4253140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a867e0 0x558ba4a9c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c4253140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a9ea90 0x558ba4b0be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c4253140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ee60 0x558ba4b0c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c4253140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ba4b0ca20 con 0x558ba4a9ea90 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c4253140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ba4b0ccc0 con 0x558ba4a867e0 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c4253140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ba4bb12b0 con 0x558ba4a9ee60 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a9ea90 0x558ba4b0be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a9ea90 0x558ba4b0be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43666/0 (socket says 172.21.15.81:43666) 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c2589700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ee60 0x558ba4b0c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1d88700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a867e0 0x558ba4a9c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 -- 172.21.15.81:0/3754148017 learned_addr learned my addr 172.21.15.81:0/3754148017 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:59.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 -- 172.21.15.81:0/3754148017 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ee60 msgr2=0x558ba4b0c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558ba4a9ee60 0x558ba4b0c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 -- 172.21.15.81:0/3754148017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a867e0 msgr2=0x558ba4a9c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558ba4a867e0 0x558ba4a9c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 -- 172.21.15.81:0/3754148017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc009600 con 0x558ba4a9ea90 2023-11-29T11:19:59.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.189+0000 7fe0c1587700 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a9ea90 0x558ba4b0be30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00a920 tx=0x7fe0ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0baffd700 1 -- 172.21.15.81:0/3754148017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac005350 con 0x558ba4a9ea90 2023-11-29T11:19:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0baffd700 1 -- 172.21.15.81:0/3754148017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac01d420 con 0x558ba4a9ea90 2023-11-29T11:19:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ba49888b0 con 0x558ba4a9ea90 2023-11-29T11:19:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0baffd700 1 -- 172.21.15.81:0/3754148017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac01d7b0 con 0x558ba4a9ea90 2023-11-29T11:19:59.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac005de0 con 0x558ba4a9ea90 2023-11-29T11:19:59.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0baffd700 1 -- 172.21.15.81:0/3754148017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe0ac01d910 con 0x558ba4a9ea90 2023-11-29T11:19:59.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0baffd700 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0a4063840 0x7fe0a4065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0baffd700 1 -- 172.21.15.81:0/3754148017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fe0ac082130 con 0x558ba4a9ea90 2023-11-29T11:19:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.193+0000 7fe0c1d88700 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0a4063840 0x7fe0a4065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.197+0000 7fe0c4253140 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558ba4a9cd50 0x558ba4bb5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.197+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:1 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e97) v8 -- 0x558ba4bb5f40 con 0x558ba4a9cd50 2023-11-29T11:19:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.197+0000 7fe0c2589700 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558ba4a9cd50 0x558ba4bb5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.197+0000 7fe0c1d88700 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0a4063840 0x7fe0a4065cf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc005a40 tx=0x7fe0bc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.197+0000 7fe0c2589700 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558ba4a9cd50 0x558ba4bb5a00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.201+0000 7fe0c2589700 1 -- 172.21.15.81:0/3754148017 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v97'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe0b40038d0 con 0x558ba4a9cd50 2023-11-29T11:19:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.201+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558ba4a9cd50 msgr2=0x558ba4bb5a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.201+0000 7fe0c4253140 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558ba4a9cd50 0x558ba4bb5a00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.201+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0a4063840 msgr2=0x7fe0a4065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.201+0000 7fe0c4253140 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe0a4063840 0x7fe0a4065cf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc005a40 tx=0x7fe0bc00b040 comp rx=0 tx=0).stop 2023-11-29T11:19:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.201+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a9ea90 msgr2=0x558ba4b0be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.205+0000 7fe0c4253140 1 --2- 172.21.15.81:0/3754148017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558ba4a9ea90 0x558ba4b0be30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00a920 tx=0x7fe0ac002fb0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.205+0000 7fe0c2589700 1 -- 172.21.15.81:0/3754148017 reap_dead start 2023-11-29T11:19:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.205+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 shutdown_connections 2023-11-29T11:19:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.205+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 >> 172.21.15.81:0/3754148017 conn(0x558ba4a84dc0 msgr2=0x558ba4bbfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.205+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 shutdown_connections 2023-11-29T11:19:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.205+0000 7fe0c4253140 1 -- 172.21.15.81:0/3754148017 wait complete. 2023-11-29T11:19:59.215 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2023-11-29T11:19:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b3ed2380 1 -- start start 2023-11-29T11:19:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b3ed2380 1 Processor -- start 2023-11-29T11:19:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbf775000 0x55acbf816580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbf775400 0x55acbf816b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbf775800 0x55acbf817080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7aa780 con 0x55acbf775800 2023-11-29T11:19:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7abcc0 con 0x55acbf775000 2023-11-29T11:19:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7abe00 con 0x55acbf775400 2023-11-29T11:19:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b2e8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbf775800 0x55acbf817080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b2e8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbf775800 0x55acbf817080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43678/0 (socket says 172.21.15.81:43678) 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/172371961 learned_addr learned my addr 172.21.15.81:0/172371961 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbf775400 0x55acbf816b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.249+0000 7fe1b268c700 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbf775000 0x55acbf816580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbf775400 msgr2=0x55acbf816b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b2e8d700 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbf775400 0x55acbf816b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbf775000 msgr2=0x55acbf816580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b2e8d700 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbf775000 0x55acbf816580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/172371961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acbf7969c0 con 0x55acbf775800 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b268c700 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbf775000 0x55acbf816580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b2e8d700 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbf775800 0x55acbf817080 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x55acc05f66f0 tx=0x55acc0556480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83138c06e47b345 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1afe87700 1 -- 172.21.15.81:0/172371961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55acbf7a9600 con 0x55acbf775800 2023-11-29T11:19:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1afe87700 1 -- 172.21.15.81:0/172371961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55acbf7c1200 con 0x55acbf775800 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/172371961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acbf797380 con 0x55acbf775800 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/172371961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55acbf796b60 con 0x55acbf775800 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 4 waiting for MDS map... 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1afe87700 1 -- 172.21.15.81:0/172371961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55acbf7a91e0 con 0x55acbf775800 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1afe87700 1 -- 172.21.15.81:0/172371961 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x55acbf7b0c40 con 0x55acbf775800 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1afe87700 1 -- 172.21.15.81:0/172371961 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 55) v1 ==== 2565+0+0 (secure 0 0 0) 0x55acc0567200 con 0x55acbf775800 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 4 Got MDS map 55 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 10 main: JournalTool::main 2023-11-29T11:19:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 4 main: JournalTool: connecting to RADOS... 2023-11-29T11:19:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 1 Processor -- start 2023-11-29T11:19:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 1 -- start start 2023-11-29T11:19:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.253+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 0x55acbf817600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 0x55acbf817b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7ab680 con 0x55acbfac8c00 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7fa780 con 0x55acbfac8400 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7fa3c0 con 0x55acbfac8800 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43684/0 (socket says 172.21.15.81:43684) 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/656970038 learned_addr learned my addr 172.21.15.81:0/656970038 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 0x55acbf817600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b268c700 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 0x55acbf817b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/656970038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 msgr2=0x55acbf817b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 0x55acbf817b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/656970038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 msgr2=0x55acbf817600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 0x55acbf817600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/656970038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acbf797860 con 0x55acbfac8c00 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818100 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x55acc05f7b90 tx=0x55acc05562a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd828c9b15b40da0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1ade83700 1 -- 172.21.15.81:0/656970038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55acbf7a9080 con 0x55acbfac8c00 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1ade83700 1 -- 172.21.15.81:0/656970038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55acbfa5a000 con 0x55acbfac8c00 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1ade83700 1 -- 172.21.15.81:0/656970038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55acbf7a9600 con 0x55acbfac8c00 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/656970038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 msgr2=0x55acbf818100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818100 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x55acc05f7b90 tx=0x55acc05562a0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/656970038 shutdown_connections 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818100 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 0x55acbf817b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/656970038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 0x55acbf817600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/656970038 >> 172.21.15.81:0/656970038 conn(0x55acbfac8000 msgr2=0x55acbf875800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/656970038 shutdown_connections 2023-11-29T11:19:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/656970038 wait complete. 2023-11-29T11:19:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 Processor -- start 2023-11-29T11:19:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.257+0000 7fe1b3ed2380 1 -- start start 2023-11-29T11:19:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 0x55acbf819180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 0x55acbf818c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7fa280 con 0x55acbfac8c00 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7abcc0 con 0x55acbfac8400 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7ab900 con 0x55acbfac8800 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43686/0 (socket says 172.21.15.81:43686) 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/3177992127 learned_addr learned my addr 172.21.15.81:0/3177992127 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 0x55acbf819180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b268c700 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 0x55acbf818c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/3177992127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 msgr2=0x55acbf818c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 0x55acbf818c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/3177992127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 msgr2=0x55acbf819180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 0x55acbf819180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/3177992127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acbf797860 con 0x55acbfac8c00 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818680 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x55acc05f7ce0 tx=0x55acc0556240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1ac680700 1 -- 172.21.15.81:0/3177992127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55acbf7a91e0 con 0x55acbfac8c00 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1ac680700 1 -- 172.21.15.81:0/3177992127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55acbfa5a180 con 0x55acbfac8c00 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1ac680700 1 -- 172.21.15.81:0/3177992127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55acbf7a8dc0 con 0x55acbfac8c00 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/3177992127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55acbf796000 con 0x55acbfac8c00 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/3177992127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acbf797a00 con 0x55acbfac8c00 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1b3ed2380 4 main: JournalTool: resolving pool 14 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1ac680700 1 -- 172.21.15.81:0/3177992127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x55acbf7d2840 con 0x55acbfac8c00 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1ac680700 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x55acbfac9400 0x55acbf819700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.261+0000 7fe1ac680700 1 -- 172.21.15.81:0/3177992127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x55acbf7b0a80 con 0x55acbfac8c00 2023-11-29T11:19:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b268c700 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x55acbfac9400 0x55acbf819700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 4 main: JournalTool: creating IoCtx.. 2023-11-29T11:19:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 4 main: Executing for rank 0 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b268c700 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x55acbfac9400 0x55acbf819700 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x55acc04eddd0 tx=0x55acbfa61920 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 -- start start 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 Processor -- start 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac9c00 0x55acbf818100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfc28000 0x55acbf817b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfc28400 0x55acbf817600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7fa3c0 con 0x55acbfac9c00 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7fa780 con 0x55acbfc28000 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acbf7fa140 con 0x55acbfc28400 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac9c00 0x55acbf818100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac9c00 0x55acbf818100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43696/0 (socket says 172.21.15.81:43696) 2023-11-29T11:19:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/1596558346 learned_addr learned my addr 172.21.15.81:0/1596558346 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfc28400 0x55acbf817600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b268c700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfc28000 0x55acbf817b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfc28400 msgr2=0x55acbf817600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfc28400 0x55acbf817600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfc28000 msgr2=0x55acbf817b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfc28000 0x55acbf817b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acbf797d40 con 0x55acbfac9c00 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b2e8d700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac9c00 0x55acbf818100 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x55acbfba2840 tx=0x55acc05563c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbb500b3e1e25a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1a967a700 1 -- 172.21.15.81:0/1596558346 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55acbf7a8f20 con 0x55acbfac9c00 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1a967a700 1 -- 172.21.15.81:0/1596558346 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55acbf7c0900 con 0x55acbfac9c00 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acbfb19a00 con 0x55acbfac9c00 2023-11-29T11:19:59.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55acbfb19860 con 0x55acbfac9c00 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1b3ed2380 4 waiting for MDS map... 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1a967a700 1 -- 172.21.15.81:0/1596558346 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55acbf7a9600 con 0x55acbfac9c00 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1a967a700 1 -- 172.21.15.81:0/1596558346 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x55acbf7b08c0 con 0x55acbfac9c00 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.265+0000 7fe1a967a700 1 -- 172.21.15.81:0/1596558346 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 55) v1 ==== 2565+0+0 (secure 0 0 0) 0x55acbfbcdb00 con 0x55acbfac9c00 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b3ed2380 4 Got MDS map 55 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x55acbfc28800 0x55acbfc4a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc28c00 con 0x55acbfc28800 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b268c700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x55acbfc28800 0x55acbfc4a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b268c700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x55acbfc28800 0x55acbfc4a000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=3d18a387c4ce9f48 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b268c700 1 -- 172.21.15.81:0/1596558346 <== osd.7 v2:172.21.15.176:6800/36814 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55acc0563200 con 0x55acbfc28800 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x55acbfc29000 0x55acbfc4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc29400 con 0x55acbfc29000 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x55acbfc29000 0x55acbfc4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b1e8b700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x55acbfc29000 0x55acbfc4a580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=ac97868fedab53da server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.269+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/1596558346 <== osd.4 v2:172.21.15.176:6808/36811 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55acc0563440 con 0x55acbfc29000 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.273+0000 7fe1a7e77700 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc52000 con 0x55acbfc29000 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.273+0000 7fe1a7e77700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x55acbfc52400 0x55acbfc4c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.273+0000 7fe1a7e77700 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc52800 con 0x55acbfc52400 2023-11-29T11:19:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.273+0000 7fe1b2e8d700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x55acbfc52400 0x55acbfc4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.273+0000 7fe1b2e8d700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x55acbfc52400 0x55acbfc4c680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=20f2728596b0102f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.273+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/1596558346 <== osd.4 v2:172.21.15.176:6808/36811 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55acc0563440 con 0x55acbfc29000 2023-11-29T11:19:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.273+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/1596558346 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563680 con 0x55acbfc52400 2023-11-29T11:19:59.281 INFO:teuthology.orchestra.run.smithi081.stdout:old journal was 4209689~892 2023-11-29T11:19:59.281 INFO:teuthology.orchestra.run.smithi081.stdout:new journal start will be 8388608 (4178027 bytes past old end) 2023-11-29T11:19:59.281 INFO:teuthology.orchestra.run.smithi081.stdout:writing journal head 2023-11-29T11:19:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.273+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:5 14.14 14:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc52c00 con 0x55acbfc29000 2023-11-29T11:19:59.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/1596558346 <== osd.4 v2:172.21.15.176:6808/36811 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v97'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563440 con 0x55acbfc29000 2023-11-29T11:19:59.284 INFO:teuthology.orchestra.run.smithi081.stdout:writing EResetJournal entry 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:6 14.1b 14:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc53000 con 0x55acbfc52400 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55acbfc53400 0x55acbfc4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:7 14.b 14:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc53800 con 0x55acbfc53400 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:8 14.1f 14:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc53c00 con 0x55acbfc53400 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:9 14.1a 14:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc52000 con 0x55acbfc53400 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:10 14.1e 14:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc52c00 con 0x55acbfc28800 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:11 14.1d 14:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc29400 con 0x55acbfc53400 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b268c700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55acbfc53400 0x55acbfc4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.277+0000 7fe1b268c700 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55acbfc53400 0x55acbfc4ab00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=8cdbd17e33c06473 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.281+0000 7fe1b268c700 1 -- 172.21.15.81:0/1596558346 <== osd.7 v2:172.21.15.176:6800/36814 2 ==== osd_op_reply(10 200.00000006 [delete] v97'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563200 con 0x55acbfc28800 2023-11-29T11:19:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.281+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/1596558346 <== osd.1 v2:172.21.15.81:6803/36538 2 ==== osd_op_reply(6 200.00000002 [delete] v97'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563680 con 0x55acbfc52400 2023-11-29T11:19:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.281+0000 7fe1b268c700 1 -- 172.21.15.81:0/1596558346 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(11 200.00000007 [delete] v97'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563200 con 0x55acbfc53400 2023-11-29T11:19:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.281+0000 7fe1b268c700 1 -- 172.21.15.81:0/1596558346 <== osd.0 v2:172.21.15.81:6802/36537 2 ==== osd_op_reply(8 200.00000004 [delete] v97'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563200 con 0x55acbfc53400 2023-11-29T11:19:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.281+0000 7fe1b268c700 1 -- 172.21.15.81:0/1596558346 <== osd.0 v2:172.21.15.81:6802/36537 3 ==== osd_op_reply(9 200.00000005 [delete] v97'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563200 con 0x55acbfc53400 2023-11-29T11:19:59.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.285+0000 7fe1b268c700 1 -- 172.21.15.81:0/1596558346 <== osd.0 v2:172.21.15.81:6802/36537 4 ==== osd_op_reply(7 200.00000003 [delete] v97'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563200 con 0x55acbfc53400 2023-11-29T11:19:59.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.285+0000 7fe1a7e77700 1 -- 172.21.15.81:0/1596558346 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:12 14.1b 14:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v8 -- 0x55acbfc53800 con 0x55acbfc52400 2023-11-29T11:19:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.285+0000 7fe1b2e8d700 1 -- 172.21.15.81:0/1596558346 <== osd.1 v2:172.21.15.81:6803/36538 3 ==== osd_op_reply(12 200.00000002 [write 0~48] v97'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55acc0563680 con 0x55acbfc52400 2023-11-29T11:19:59.294 INFO:teuthology.orchestra.run.smithi081.stdout:done 2023-11-29T11:19:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55acbfc53400 msgr2=0x55acbfc4ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x55acbfc53400 0x55acbfc4ab00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x55acbfc52400 msgr2=0x55acbfc4c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x55acbfc52400 0x55acbfc4c680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x55acbfc29000 msgr2=0x55acbfc4a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x55acbfc29000 0x55acbfc4a580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x55acbfc28800 msgr2=0x55acbfc4a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x55acbfc28800 0x55acbfc4a000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b1e8b700 1 -- 172.21.15.81:0/1596558346 reap_dead start 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac9c00 msgr2=0x55acbf818100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac9c00 0x55acbf818100 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x55acbfba2840 tx=0x55acc05563c0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 shutdown_connections 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x55acbfc28800 0x55acbfc4a000 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/1596558346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac9c00 0x55acbf818100 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 >> 172.21.15.81:0/1596558346 conn(0x55acbfac9800 msgr2=0x55acbf876000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 shutdown_connections 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/1596558346 wait complete. 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x55acbfac9400 msgr2=0x55acbf819700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x55acbfac9400 0x55acbf819700 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x55acc04eddd0 tx=0x55acbfa61920 comp rx=0 tx=0).stop 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 msgr2=0x55acbf818680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818680 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x55acc05f7ce0 tx=0x55acc0556240 comp rx=0 tx=0).stop 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/3177992127 shutdown_connections 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x55acbfac9400 0x55acbf819700 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbfac8c00 0x55acbf818680 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbfac8800 0x55acbf818c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/3177992127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbfac8400 0x55acbf819180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/3177992127 >> 172.21.15.81:0/3177992127 conn(0x55acbfac8000 msgr2=0x55acbf875800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/3177992127 shutdown_connections 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/3177992127 wait complete. 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/172371961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbf775800 msgr2=0x55acbf817080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbf775800 0x55acbf817080 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x55acc05f66f0 tx=0x55acc0556480 comp rx=0 tx=0).stop 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/172371961 shutdown_connections 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acbf775800 0x55acbf817080 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55acbf775400 0x55acbf816b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 --2- 172.21.15.81:0/172371961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55acbf775000 0x55acbf816580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/172371961 >> 172.21.15.81:0/172371961 conn(0x55acbf774c00 msgr2=0x55acbf875000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:59.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/172371961 shutdown_connections 2023-11-29T11:19:59.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.289+0000 7fe1b3ed2380 1 -- 172.21.15.81:0/172371961 wait complete. 2023-11-29T11:19:59.300 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.085948, result: old journal was 4209689~892 new journal start will be 8388608 (4178027 bytes past old end) writing journal head writing EResetJournal entry done 2023-11-29T11:19:59.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-29T11:19:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.413+0000 7fe97adb0700 1 Processor -- start 2023-11-29T11:19:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.413+0000 7fe97adb0700 1 -- start start 2023-11-29T11:19:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe974158890 0x7fe9740cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 0x7fe97406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97406c3b0 con 0x7fe9740cb890 2023-11-29T11:19:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97406c690 con 0x7fe974158890 2023-11-29T11:19:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97406c970 con 0x7fe9740c9590 2023-11-29T11:19:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe978b4c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe974158890 0x7fe9740cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe978b4c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe974158890 0x7fe9740cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43710/0 (socket says 172.21.15.81:43710) 2023-11-29T11:19:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe978b4c700 1 -- 172.21.15.81:0/3250204326 learned_addr learned my addr 172.21.15.81:0/3250204326 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe96bfff700 1 --2- 172.21.15.81:0/3250204326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 0x7fe97406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe978b4c700 1 -- 172.21.15.81:0/3250204326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 msgr2=0x7fe97406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:19:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe978b4c700 1 --2- 172.21.15.81:0/3250204326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 0x7fe97406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe978b4c700 1 -- 172.21.15.81:0/3250204326 >> v1:172.21.15.176:6789/0 conn(0x7fe9740cb890 legacy=0x7fe97406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe978b4c700 1 -- 172.21.15.81:0/3250204326 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97406cc50 con 0x7fe974158890 2023-11-29T11:19:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe978b4c700 1 --2- 172.21.15.81:0/3250204326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe974158890 0x7fe9740cd520 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fe970009910 tx=0x7fe970009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fc202cb55ac8c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe96b7fe700 1 -- 172.21.15.81:0/3250204326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970011830 con 0x7fe974158890 2023-11-29T11:19:59.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe96b7fe700 1 -- 172.21.15.81:0/3250204326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970011990 con 0x7fe974158890 2023-11-29T11:19:59.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe96b7fe700 1 -- 172.21.15.81:0/3250204326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970011d40 con 0x7fe974158890 2023-11-29T11:19:59.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 -- 172.21.15.81:0/3250204326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe974158890 msgr2=0x7fe9740cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 --2- 172.21.15.81:0/3250204326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe974158890 0x7fe9740cd520 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fe970009910 tx=0x7fe970009c20 comp rx=0 tx=0).stop 2023-11-29T11:19:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 -- 172.21.15.81:0/3250204326 shutdown_connections 2023-11-29T11:19:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 --2- 172.21.15.81:0/3250204326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 0x7fe97406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 --2- 172.21.15.81:0/3250204326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe974158890 0x7fe9740cd520 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.417+0000 7fe97adb0700 1 -- 172.21.15.81:0/3250204326 >> 172.21.15.81:0/3250204326 conn(0x7fe9740b0a90 msgr2=0x7fe9740b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:19:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.421+0000 7fe97adb0700 1 -- 172.21.15.81:0/3250204326 shutdown_connections 2023-11-29T11:19:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.421+0000 7fe97adb0700 1 -- 172.21.15.81:0/3250204326 wait complete. 2023-11-29T11:19:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.421+0000 7fe97adb0700 1 Processor -- start 2023-11-29T11:19:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.421+0000 7fe97adb0700 1 -- start start 2023-11-29T11:19:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97adb0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 0x7fe974150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97adb0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9740cb890 0x7fe9740b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97adb0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe974158890 0x7fe9740c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97adb0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740c2fe0 con 0x7fe9740cb890 2023-11-29T11:19:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97adb0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740c7190 con 0x7fe974158890 2023-11-29T11:19:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97adb0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740c7470 con 0x7fe9740c9590 2023-11-29T11:19:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9740cb890 0x7fe9740b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9740cb890 0x7fe9740b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43722/0 (socket says 172.21.15.81:43722) 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 -- 172.21.15.81:0/4036532554 learned_addr learned my addr 172.21.15.81:0/4036532554 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe978b4c700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 0x7fe974150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97934d700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe974158890 0x7fe9740c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 -- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 msgr2=0x7fe974150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 0x7fe974150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 -- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe974158890 msgr2=0x7fe9740c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe974158890 0x7fe9740c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 -- 172.21.15.81:0/4036532554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970009570 con 0x7fe9740cb890 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97934d700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe974158890 0x7fe9740c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe96bfff700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9740cb890 0x7fe9740b2ac0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fe96400e9d0 tx=0x7fe96400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe9697fa700 1 -- 172.21.15.81:0/4036532554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964009720 con 0x7fe9740cb890 2023-11-29T11:19:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe9697fa700 1 -- 172.21.15.81:0/4036532554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400c850 con 0x7fe9740cb890 2023-11-29T11:19:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9740cbce0 con 0x7fe9740cb890 2023-11-29T11:19:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe9697fa700 1 -- 172.21.15.81:0/4036532554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400cbc0 con 0x7fe9740cb890 2023-11-29T11:19:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.425+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97406cf30 con 0x7fe9740cb890 2023-11-29T11:19:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.429+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9740cbe70 con 0x7fe9740cb890 2023-11-29T11:19:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.429+0000 7fe9697fa700 1 -- 172.21.15.81:0/4036532554 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe964020030 con 0x7fe9740cb890 2023-11-29T11:19:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.429+0000 7fe9697fa700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe960064ee0 0x7fe960067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:19:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.429+0000 7fe9697fa700 1 -- 172.21.15.81:0/4036532554 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fe964083e10 con 0x7fe9740cb890 2023-11-29T11:19:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.429+0000 7fe978b4c700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe960064ee0 0x7fe960067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:19:59.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.429+0000 7fe978b4c700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe960064ee0 0x7fe960067390 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe970014040 tx=0x7fe970008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:19:59.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.433+0000 7fe9697fa700 1 -- 172.21.15.81:0/4036532554 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe964087030 con 0x7fe9740cb890 2023-11-29T11:19:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:19:59.633+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fe9740cb320 con 0x7fe9740cb890 2023-11-29T11:20:00.003 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:19:59.997+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2023-11-29T11:20:00.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.105+0000 7fe9697fa700 1 -- 172.21.15.81:0/4036532554 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v56) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe96401e0b0 con 0x7fe9740cb890 2023-11-29T11:20:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe960064ee0 msgr2=0x7fe960067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe960064ee0 0x7fe960067390 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe970014040 tx=0x7fe970008030 comp rx=0 tx=0).stop 2023-11-29T11:20:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9740cb890 msgr2=0x7fe9740b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9740cb890 0x7fe9740b2ac0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fe96400e9d0 tx=0x7fe96400ed90 comp rx=0 tx=0).stop 2023-11-29T11:20:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 shutdown_connections 2023-11-29T11:20:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe960064ee0 0x7fe960067390 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe974158890 0x7fe9740c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9740cb890 0x7fe9740b2ac0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 --2- 172.21.15.81:0/4036532554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9740c9590 0x7fe974150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 >> 172.21.15.81:0/4036532554 conn(0x7fe9740b0a90 msgr2=0x7fe9741561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 shutdown_connections 2023-11-29T11:20:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.109+0000 7fe97adb0700 1 -- 172.21.15.81:0/4036532554 wait complete. 2023-11-29T11:20:00.119 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-29T11:20:00.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:20:00.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.237+0000 7faabffff700 1 Processor -- start 2023-11-29T11:20:00.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.237+0000 7faabffff700 1 -- start start 2023-11-29T11:20:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.237+0000 7faabffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faac00cb520 0x7faac00cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.237+0000 7faabffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac00cd0f0 con 0x7faac01584c0 2023-11-29T11:20:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.237+0000 7faabffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac00cd3d0 con 0x7faac00b39f0 2023-11-29T11:20:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.237+0000 7faabffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac006dbd0 con 0x7faac00cb520 2023-11-29T11:20:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabeffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faac01584c0 0x7faac00b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57540/0 (socket says 172.21.15.81:57540) 2023-11-29T11:20:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabeffd700 1 -- 172.21.15.81:0/1287974118 learned_addr learned my addr 172.21.15.81:0/1287974118 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:20:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabf7fe700 1 --2- 172.21.15.81:0/1287974118 >> v2:172.21.15.176:3300/0 conn(0x7faac00cb520 0x7faac00cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabdffb700 1 -- 172.21.15.81:0/1287974118 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672494851 0 0) 0x7faac00cd0f0 con 0x7faac01584c0 2023-11-29T11:20:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabdffb700 1 -- 172.21.15.81:0/1287974118 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa80035d0 con 0x7faac01584c0 2023-11-29T11:20:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabf7fe700 1 -- 172.21.15.81:0/1287974118 >> v1:172.21.15.176:6789/0 conn(0x7faac00b39f0 legacy=0x7faac00cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabf7fe700 1 -- 172.21.15.81:0/1287974118 >> v1:172.21.15.81:6789/0 conn(0x7faac01584c0 legacy=0x7faac00b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabf7fe700 1 -- 172.21.15.81:0/1287974118 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00cd6b0 con 0x7faac00cb520 2023-11-29T11:20:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabf7fe700 1 --2- 172.21.15.81:0/1287974118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 0x7faac00cb950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faab8009850 tx=0x7faab8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a2acc8cb70d0d51 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:00.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabdffb700 1 -- 172.21.15.81:0/1287974118 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8011830 con 0x7faac00cb520 2023-11-29T11:20:00.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabdffb700 1 -- 172.21.15.81:0/1287974118 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8011990 con 0x7faac00cb520 2023-11-29T11:20:00.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabdffb700 1 -- 172.21.15.81:0/1287974118 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8011d00 con 0x7faac00cb520 2023-11-29T11:20:00.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 -- 172.21.15.81:0/1287974118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 msgr2=0x7faac00cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 --2- 172.21.15.81:0/1287974118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 0x7faac00cb950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faab8009850 tx=0x7faab8009b60 comp rx=0 tx=0).stop 2023-11-29T11:20:00.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 -- 172.21.15.81:0/1287974118 shutdown_connections 2023-11-29T11:20:00.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 --2- 172.21.15.81:0/1287974118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 0x7faac00cb950 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 -- 172.21.15.81:0/1287974118 >> 172.21.15.81:0/1287974118 conn(0x7faac00ce3e0 msgr2=0x7faac00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:00.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 -- 172.21.15.81:0/1287974118 shutdown_connections 2023-11-29T11:20:00.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 -- 172.21.15.81:0/1287974118 wait complete. 2023-11-29T11:20:00.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 Processor -- start 2023-11-29T11:20:00.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.241+0000 7faabffff700 1 -- start start 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac00b39f0 0x7faac0153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 0x7faac00c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01584c0 0x7faac00c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac01f35e0 con 0x7faac01584c0 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac01e3880 con 0x7faac00cb520 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac0154470 con 0x7faac00b39f0 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01584c0 0x7faac00c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01584c0 0x7faac00c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36792/0 (socket says 172.21.15.81:36792) 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 -- 172.21.15.81:0/1405846792 learned_addr learned my addr 172.21.15.81:0/1405846792 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabe7fc700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 0x7faac00c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabeffd700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac00b39f0 0x7faac0153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:00.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 -- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac00b39f0 msgr2=0x7faac0153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac00b39f0 0x7faac0153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 -- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 msgr2=0x7faac00c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 0x7faac00c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 -- 172.21.15.81:0/1405846792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab80094b0 con 0x7faac01584c0 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabeffd700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac00b39f0 0x7faac0153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabf7fe700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01584c0 0x7faac00c6610 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7faab8009ba0 tx=0x7faab8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faaa77fe700 1 -- 172.21.15.81:0/1405846792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80045d0 con 0x7faac01584c0 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faaa77fe700 1 -- 172.21.15.81:0/1405846792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab80036c0 con 0x7faac01584c0 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faaa77fe700 1 -- 172.21.15.81:0/1405846792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8003a50 con 0x7faac01584c0 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac00cdc70 con 0x7faac01584c0 2023-11-29T11:20:00.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac00cd990 con 0x7faac01584c0 2023-11-29T11:20:00.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.245+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac00cdf50 con 0x7faac01584c0 2023-11-29T11:20:00.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.249+0000 7faaa77fe700 1 -- 172.21.15.81:0/1405846792 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faab802d070 con 0x7faac01584c0 2023-11-29T11:20:00.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.249+0000 7faaa77fe700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faaac064ee0 0x7faaac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:00.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.249+0000 7faabeffd700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faaac064ee0 0x7faaac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:00.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.249+0000 7faaa77fe700 1 -- 172.21.15.81:0/1405846792 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7faab8021030 con 0x7faac01584c0 2023-11-29T11:20:00.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.249+0000 7faabeffd700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faaac064ee0 0x7faaac067390 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faab40011e0 tx=0x7faab4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.253+0000 7faaa77fe700 1 -- 172.21.15.81:0/1405846792 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faab8051640 con 0x7faac01584c0 2023-11-29T11:20:00.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.449+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faac0072500 con 0x7faac01584c0 2023-11-29T11:20:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.449+0000 7faaa77fe700 1 -- 172.21.15.81:0/1405846792 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4654 (secure 0 0 0) 0x7faab802b090 con 0x7faac01584c0 2023-11-29T11:20:00.456 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:20:00.456 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:20:00.099745+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"a","rank":0,"incarnation":56,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:20:00.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.449+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faaac064ee0 msgr2=0x7faaac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.449+0000 7faabffff700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faaac064ee0 0x7faaac067390 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faab40011e0 tx=0x7faab4009040 comp rx=0 tx=0).stop 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.449+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01584c0 msgr2=0x7faac00c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.449+0000 7faabffff700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01584c0 0x7faac00c6610 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7faab8009ba0 tx=0x7faab8004770 comp rx=0 tx=0).stop 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.453+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 shutdown_connections 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.453+0000 7faabffff700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faaac064ee0 0x7faaac067390 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.453+0000 7faabffff700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01584c0 0x7faac00c6610 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.453+0000 7faabffff700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faac00cb520 0x7faac00c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.453+0000 7faabffff700 1 --2- 172.21.15.81:0/1405846792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faac00b39f0 0x7faac0153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.453+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 >> 172.21.15.81:0/1405846792 conn(0x7faac00ce3e0 msgr2=0x7faac0156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.453+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 shutdown_connections 2023-11-29T11:20:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:00.453+0000 7faabffff700 1 -- 172.21.15.81:0/1405846792 wait complete. 2023-11-29T11:20:00.460 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 56 2023-11-29T11:20:00.873 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:19:39.666846+0000', 'modified': '2023-11-29T11:20:00.099745+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8010}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8010': {'gid': 8010, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.81:6837/353227086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 353227086}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 353227086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:20:00.873 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8010:up:replay 2023-11-29T11:20:01.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:20:01.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874ab2e700 1 Processor -- start 2023-11-29T11:20:01.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874ab2e700 1 -- start start 2023-11-29T11:20:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874ab2e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0e6e60 0x7f873c04f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874ab2e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f873c0512b0 0x7f873c036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874ab2e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c053df0 con 0x7f873c036cb0 2023-11-29T11:20:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874ab2e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c037150 con 0x7f873c0512b0 2023-11-29T11:20:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874ab2e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c0486b0 con 0x7f873c0e6e60 2023-11-29T11:20:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8749b2c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0e6e60 0x7f873c04f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8749b2c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0e6e60 0x7f873c04f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:42066/0 (socket says 172.21.15.81:42066) 2023-11-29T11:20:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8749b2c700 1 -- 172.21.15.81:0/1732893355 learned_addr learned my addr 172.21.15.81:0/1732893355 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:02.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874932b700 1 --2- 172.21.15.81:0/1732893355 >> v2:172.21.15.176:3300/0 conn(0x7f873c0512b0 0x7f873c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:02.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8749b2c700 1 -- 172.21.15.81:0/1732893355 >> v2:172.21.15.176:3300/0 conn(0x7f873c0512b0 msgr2=0x7f873c036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:02.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8749b2c700 1 --2- 172.21.15.81:0/1732893355 >> v2:172.21.15.176:3300/0 conn(0x7f873c0512b0 0x7f873c036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8749b2c700 1 -- 172.21.15.81:0/1732893355 >> v1:172.21.15.176:6789/0 conn(0x7f873c036cb0 legacy=0x7f873c0060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:02.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8749b2c700 1 -- 172.21.15.81:0/1732893355 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c033a80 con 0x7f873c0e6e60 2023-11-29T11:20:02.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f874932b700 1 --2- 172.21.15.81:0/1732893355 >> v2:172.21.15.176:3300/0 conn(0x7f873c0512b0 0x7f873c036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:20:02.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8749b2c700 1 --2- 172.21.15.81:0/1732893355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0e6e60 0x7f873c04f340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8734009910 tx=0x7f8734009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9093617d357f436 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8748b2a700 1 -- 172.21.15.81:0/1732893355 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734011830 con 0x7f873c0e6e60 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8748b2a700 1 -- 172.21.15.81:0/1732893355 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8734011990 con 0x7f873c0e6e60 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.993+0000 7f8748b2a700 1 -- 172.21.15.81:0/1732893355 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734011d40 con 0x7f873c0e6e60 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- 172.21.15.81:0/1732893355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0e6e60 msgr2=0x7f873c04f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 --2- 172.21.15.81:0/1732893355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0e6e60 0x7f873c04f340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8734009910 tx=0x7f8734009c20 comp rx=0 tx=0).stop 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- 172.21.15.81:0/1732893355 shutdown_connections 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 --2- 172.21.15.81:0/1732893355 >> v2:172.21.15.176:3300/0 conn(0x7f873c0512b0 0x7f873c036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 --2- 172.21.15.81:0/1732893355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0e6e60 0x7f873c04f340 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- 172.21.15.81:0/1732893355 >> 172.21.15.81:0/1732893355 conn(0x7f873c051770 msgr2=0x7f873c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:02.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- 172.21.15.81:0/1732893355 shutdown_connections 2023-11-29T11:20:02.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- 172.21.15.81:0/1732893355 wait complete. 2023-11-29T11:20:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 Processor -- start 2023-11-29T11:20:02.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- start start 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873c036cb0 0x7f873c17c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0512b0 0x7f873c180530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873c0e6e60 0x7f873c0dd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c17ca50 con 0x7f873c0e6e60 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c0e8350 con 0x7f873c036cb0 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:01.997+0000 7f874ab2e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c180a70 con 0x7f873c0512b0 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874a32d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873c0e6e60 0x7f873c0dd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874932b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0512b0 0x7f873c180530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f8749b2c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873c036cb0 0x7f873c17c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874a32d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873c0e6e60 0x7f873c0dd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36796/0 (socket says 172.21.15.81:36796) 2023-11-29T11:20:02.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874a32d700 1 -- 172.21.15.81:0/3463495621 learned_addr learned my addr 172.21.15.81:0/3463495621 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:02.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874932b700 1 -- 172.21.15.81:0/3463495621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873c036cb0 msgr2=0x7f873c17c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:02.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874932b700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873c036cb0 0x7f873c17c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874932b700 1 -- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873c0e6e60 msgr2=0x7f873c0dd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874932b700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873c0e6e60 0x7f873c0dd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874932b700 1 -- 172.21.15.81:0/3463495621 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400094b0 con 0x7f873c0512b0 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874a32d700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873c0e6e60 0x7f873c0dd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874932b700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0512b0 0x7f873c180530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f874000e9e0 tx=0x7f874000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f873a7fc700 1 -- 172.21.15.81:0/3463495621 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874000ee80 con 0x7f873c0512b0 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8734009570 con 0x7f873c0512b0 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f873a7fc700 1 -- 172.21.15.81:0/3463495621 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874000c850 con 0x7f873c0512b0 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f873a7fc700 1 -- 172.21.15.81:0/3463495621 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874000cbc0 con 0x7f873c0512b0 2023-11-29T11:20:02.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.001+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c034040 con 0x7f873c0512b0 2023-11-29T11:20:02.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.005+0000 7f873a7fc700 1 -- 172.21.15.81:0/3463495621 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8740023070 con 0x7f873c0512b0 2023-11-29T11:20:02.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.005+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c033d60 con 0x7f873c0512b0 2023-11-29T11:20:02.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.005+0000 7f873a7fc700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8728064ee0 0x7f8728067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:02.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.005+0000 7f873a7fc700 1 -- 172.21.15.81:0/3463495621 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f8740082360 con 0x7f873c0512b0 2023-11-29T11:20:02.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.005+0000 7f8749b2c700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8728064ee0 0x7f8728067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:02.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.005+0000 7f8749b2c700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8728064ee0 0x7f8728067390 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8734000c00 tx=0x7f8734008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.013+0000 7f873a7fc700 1 -- 172.21.15.81:0/3463495621 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f87400501f0 con 0x7f873c0512b0 2023-11-29T11:20:02.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.209+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f873c034320 con 0x7f873c0512b0 2023-11-29T11:20:02.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.213+0000 7f873a7fc700 1 -- 172.21.15.81:0/3463495621 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f8740053810 con 0x7f873c0512b0 2023-11-29T11:20:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:20:02.219 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:20:02.116081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"a","rank":0,"incarnation":56,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:20:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8728064ee0 msgr2=0x7f8728067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8728064ee0 0x7f8728067390 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8734000c00 tx=0x7f8734008030 comp rx=0 tx=0).stop 2023-11-29T11:20:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0512b0 msgr2=0x7f873c180530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0512b0 0x7f873c180530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f874000e9e0 tx=0x7f874000ecf0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 shutdown_connections 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8728064ee0 0x7f8728067390 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873c0e6e60 0x7f873c0dd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f873c0512b0 0x7f873c180530 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 --2- 172.21.15.81:0/3463495621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f873c036cb0 0x7f873c17c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 >> 172.21.15.81:0/3463495621 conn(0x7f873c051770 msgr2=0x7f873c052ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 shutdown_connections 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:02.217+0000 7f874ab2e700 1 -- 172.21.15.81:0/3463495621 wait complete. 2023-11-29T11:20:02.224 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2023-11-29T11:20:02.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:19:39.666846+0000', 'modified': '2023-11-29T11:20:02.116081+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8010}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8010': {'gid': 8010, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:rejoin', 'state_seq': 9, 'addr': '172.21.15.81:6837/353227086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 353227086}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 353227086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:20:02.642 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8010:up:rejoin 2023-11-29T11:20:03.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:20:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.757+0000 7f7a39b80700 1 Processor -- start 2023-11-29T11:20:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.757+0000 7f7a39b80700 1 -- start start 2023-11-29T11:20:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.757+0000 7f7a39b80700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a3406c640 0x7f7a3406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.757+0000 7f7a39b80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a340b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.757+0000 7f7a39b80700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a34152f80 con 0x7f7a34152bb0 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3406d020 con 0x7f7a3406c640 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34159a30 con 0x7f7a340b2020 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a38b7e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7a34152bb0 0x7f7a3415caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57546/0 (socket says 172.21.15.81:57546) 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a38b7e700 1 -- 172.21.15.81:0/4271218692 learned_addr learned my addr 172.21.15.81:0/4271218692 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a33fff700 1 --2- 172.21.15.81:0/4271218692 >> v2:172.21.15.176:3300/0 conn(0x7f7a3406c640 0x7f7a3406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a3937f700 1 --2- 172.21.15.81:0/4271218692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a340b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a337fe700 1 -- 172.21.15.81:0/4271218692 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963159862 0 0) 0x7f7a34152f80 con 0x7f7a34152bb0 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a337fe700 1 -- 172.21.15.81:0/4271218692 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a1c0046e0 con 0x7f7a34152bb0 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a337fe700 1 -- 172.21.15.81:0/4271218692 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1035553008 0 0) 0x7f7a1c0046e0 con 0x7f7a34152bb0 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a3937f700 1 -- 172.21.15.81:0/4271218692 >> v2:172.21.15.176:3300/0 conn(0x7f7a3406c640 msgr2=0x7f7a3406cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a3937f700 1 --2- 172.21.15.81:0/4271218692 >> v2:172.21.15.176:3300/0 conn(0x7f7a3406c640 0x7f7a3406cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a3937f700 1 -- 172.21.15.81:0/4271218692 >> v1:172.21.15.81:6789/0 conn(0x7f7a34152bb0 legacy=0x7f7a3415caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a3937f700 1 -- 172.21.15.81:0/4271218692 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34158eb0 con 0x7f7a340b2020 2023-11-29T11:20:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a3937f700 1 --2- 172.21.15.81:0/4271218692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a340b24a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009d90 tx=0x7f7a2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c5431488590203b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a337fe700 1 -- 172.21.15.81:0/4271218692 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00e070 con 0x7f7a340b2020 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a337fe700 1 -- 172.21.15.81:0/4271218692 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c003a40 con 0x7f7a340b2020 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a337fe700 1 -- 172.21.15.81:0/4271218692 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24001670 con 0x7f7a340b2020 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 -- 172.21.15.81:0/4271218692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 msgr2=0x7f7a340b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 --2- 172.21.15.81:0/4271218692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a340b24a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009d90 tx=0x7f7a2c00b330 comp rx=0 tx=0).stop 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 -- 172.21.15.81:0/4271218692 shutdown_connections 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 --2- 172.21.15.81:0/4271218692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a340b24a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 --2- 172.21.15.81:0/4271218692 >> v2:172.21.15.176:3300/0 conn(0x7f7a3406c640 0x7f7a3406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 -- 172.21.15.81:0/4271218692 >> 172.21.15.81:0/4271218692 conn(0x7f7a3406e000 msgr2=0x7f7a340b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 -- 172.21.15.81:0/4271218692 shutdown_connections 2023-11-29T11:20:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.761+0000 7f7a39b80700 1 -- 172.21.15.81:0/4271218692 wait complete. 2023-11-29T11:20:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a39b80700 1 Processor -- start 2023-11-29T11:20:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a39b80700 1 -- start start 2023-11-29T11:20:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a39b80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a3406c640 0x7f7a34145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a39b80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a3414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a39b80700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a34152bb0 0x7f7a3414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a39b80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340ccfc0 con 0x7f7a3406c640 2023-11-29T11:20:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a39b80700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a341f14f0 con 0x7f7a34152bb0 2023-11-29T11:20:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a39b80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340cd1d0 con 0x7f7a340b2020 2023-11-29T11:20:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a38b7e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a3406c640 0x7f7a34145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a38b7e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a3406c640 0x7f7a34145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36812/0 (socket says 172.21.15.81:36812) 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a38b7e700 1 -- 172.21.15.81:0/1384850225 learned_addr learned my addr 172.21.15.81:0/1384850225 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a3937f700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a34152bb0 0x7f7a3414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.765+0000 7f7a33fff700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a3414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a38b7e700 1 -- 172.21.15.81:0/1384850225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 msgr2=0x7f7a3414df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a38b7e700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a3414df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a38b7e700 1 -- 172.21.15.81:0/1384850225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a34152bb0 msgr2=0x7f7a3414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a38b7e700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a34152bb0 0x7f7a3414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a38b7e700 1 -- 172.21.15.81:0/1384850225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c009a70 con 0x7f7a3406c640 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a38b7e700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a3406c640 0x7f7a34145cf0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f7a240011e0 tx=0x7f7a2400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a317fa700 1 -- 172.21.15.81:0/1384850225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24004ca0 con 0x7f7a3406c640 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a34159470 con 0x7f7a3406c640 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a317fa700 1 -- 172.21.15.81:0/1384850225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24004e00 con 0x7f7a3406c640 2023-11-29T11:20:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a34159190 con 0x7f7a3406c640 2023-11-29T11:20:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a317fa700 1 -- 172.21.15.81:0/1384850225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240072d0 con 0x7f7a3406c640 2023-11-29T11:20:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a34159750 con 0x7f7a3406c640 2023-11-29T11:20:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a317fa700 1 -- 172.21.15.81:0/1384850225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a2401a020 con 0x7f7a3406c640 2023-11-29T11:20:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a317fa700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a20064ee0 0x7f7a20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a317fa700 1 -- 172.21.15.81:0/1384850225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f7a24081bd0 con 0x7f7a3406c640 2023-11-29T11:20:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.769+0000 7f7a33fff700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a20064ee0 0x7f7a20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.773+0000 7f7a33fff700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a20064ee0 0x7f7a20067390 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7a3406cd90 tx=0x7f7a28009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:03.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.777+0000 7f7a317fa700 1 -- 172.21.15.81:0/1384850225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7a2404fa60 con 0x7f7a3406c640 2023-11-29T11:20:03.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a34072c20 con 0x7f7a3406c640 2023-11-29T11:20:03.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a317fa700 1 -- 172.21.15.81:0/1384850225 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f7a24053080 con 0x7f7a3406c640 2023-11-29T11:20:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:20:03.980 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:20:03.118788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:20:03.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a20064ee0 msgr2=0x7f7a20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:03.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a20064ee0 0x7f7a20067390 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7a3406cd90 tx=0x7f7a28009240 comp rx=0 tx=0).stop 2023-11-29T11:20:03.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a3406c640 msgr2=0x7f7a34145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a3406c640 0x7f7a34145cf0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f7a240011e0 tx=0x7f7a2400ca50 comp rx=0 tx=0).stop 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 shutdown_connections 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7a20064ee0 0x7f7a20067390 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a34152bb0 0x7f7a3414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a340b2020 0x7f7a3414df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 --2- 172.21.15.81:0/1384850225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a3406c640 0x7f7a34145cf0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 >> 172.21.15.81:0/1384850225 conn(0x7f7a3406e000 msgr2=0x7f7a340b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.973+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 shutdown_connections 2023-11-29T11:20:03.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:03.977+0000 7f7a39b80700 1 -- 172.21.15.81:0/1384850225 wait complete. 2023-11-29T11:20:03.984 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2023-11-29T11:20:04.396 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:19:39.666846+0000', 'modified': '2023-11-29T11:20:03.118788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8010}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8010': {'gid': 8010, 'name': 'a', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.81:6837/353227086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 353227086}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 353227086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:20:04.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:20:04.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-29T11:20:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebf0f0700 1 Processor -- start 2023-11-29T11:20:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebf0f0700 1 -- start start 2023-11-29T11:20:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebf0f0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb81606b0 0x7feeb80c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebf0f0700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb8164e60 con 0x7feeb80ceef0 2023-11-29T11:20:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebf0f0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80cae70 con 0x7feeb80ad610 2023-11-29T11:20:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebf0f0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80cbc10 con 0x7feeb81606b0 2023-11-29T11:20:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebd8ed700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feeb80ceef0 0x7feeb8164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57558/0 (socket says 172.21.15.81:57558) 2023-11-29T11:20:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebd8ed700 1 -- 172.21.15.81:0/1653546107 learned_addr learned my addr 172.21.15.81:0/1653546107 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:20:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebe0ee700 1 --2- 172.21.15.81:0/1653546107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb81606b0 0x7feeb80c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebd0ec700 1 -- 172.21.15.81:0/1653546107 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333589745 0 0) 0x7feeb8164e60 con 0x7feeb80ceef0 2023-11-29T11:20:04.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebe0ee700 1 -- 172.21.15.81:0/1653546107 >> v1:172.21.15.176:6789/0 conn(0x7feeb80ad610 legacy=0x7feeb8164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebe0ee700 1 -- 172.21.15.81:0/1653546107 >> v1:172.21.15.81:6789/0 conn(0x7feeb80ceef0 legacy=0x7feeb8164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebe0ee700 1 -- 172.21.15.81:0/1653546107 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80cb130 con 0x7feeb81606b0 2023-11-29T11:20:04.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebe0ee700 1 --2- 172.21.15.81:0/1653546107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb81606b0 0x7feeb80c13b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009dc0 tx=0x7feeb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50cc80bd00ff471c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebd0ec700 1 -- 172.21.15.81:0/1653546107 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000e070 con 0x7feeb81606b0 2023-11-29T11:20:04.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebd0ec700 1 -- 172.21.15.81:0/1653546107 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000bad0 con 0x7feeb81606b0 2023-11-29T11:20:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.517+0000 7feebd0ec700 1 -- 172.21.15.81:0/1653546107 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000be80 con 0x7feeb81606b0 2023-11-29T11:20:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- 172.21.15.81:0/1653546107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb81606b0 msgr2=0x7feeb80c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 --2- 172.21.15.81:0/1653546107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb81606b0 0x7feeb80c13b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009dc0 tx=0x7feeb000b330 comp rx=0 tx=0).stop 2023-11-29T11:20:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- 172.21.15.81:0/1653546107 shutdown_connections 2023-11-29T11:20:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 --2- 172.21.15.81:0/1653546107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb81606b0 0x7feeb80c13b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- 172.21.15.81:0/1653546107 >> 172.21.15.81:0/1653546107 conn(0x7feeb80ce3e0 msgr2=0x7feeb80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- 172.21.15.81:0/1653546107 shutdown_connections 2023-11-29T11:20:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- 172.21.15.81:0/1653546107 wait complete. 2023-11-29T11:20:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 Processor -- start 2023-11-29T11:20:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- start start 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb80ad610 0x7feeb8071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80ceef0 0x7feeb815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb81606b0 0x7feeb80c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c1450 con 0x7feeb81606b0 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb815d660 con 0x7feeb80ad610 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebf0f0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb815d940 con 0x7feeb80ceef0 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebe8ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb81606b0 0x7feeb80c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebe8ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb81606b0 0x7feeb80c1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36818/0 (socket says 172.21.15.81:36818) 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebe8ef700 1 -- 172.21.15.81:0/1309960860 learned_addr learned my addr 172.21.15.81:0/1309960860 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebd8ed700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80ceef0 0x7feeb815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.521+0000 7feebe0ee700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb80ad610 0x7feeb8071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feebd8ed700 1 -- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb80ad610 msgr2=0x7feeb8071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feebd8ed700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb80ad610 0x7feeb8071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feebd8ed700 1 -- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb81606b0 msgr2=0x7feeb80c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feebd8ed700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb81606b0 0x7feeb80c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feebd8ed700 1 -- 172.21.15.81:0/1309960860 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0009a70 con 0x7feeb80ceef0 2023-11-29T11:20:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feebd8ed700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80ceef0 0x7feeb815ccf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feea800c3e0 tx=0x7feea800c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feeaeffd700 1 -- 172.21.15.81:0/1309960860 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8004a90 con 0x7feeb80ceef0 2023-11-29T11:20:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feeaeffd700 1 -- 172.21.15.81:0/1309960860 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8004bf0 con 0x7feeb80ceef0 2023-11-29T11:20:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feeaeffd700 1 -- 172.21.15.81:0/1309960860 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80070d0 con 0x7feeb80ceef0 2023-11-29T11:20:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feebf0f0700 1 -- 172.21.15.81:0/1309960860 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb80cb6f0 con 0x7feeb80ceef0 2023-11-29T11:20:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feebf0f0700 1 -- 172.21.15.81:0/1309960860 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb80cb410 con 0x7feeb80ceef0 2023-11-29T11:20:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.525+0000 7feeaeffd700 1 -- 172.21.15.81:0/1309960860 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feea801a020 con 0x7feeb80ceef0 2023-11-29T11:20:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feeaeffd700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee9c064f10 0x7fee9c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feebe0ee700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee9c064f10 0x7fee9c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feeaeffd700 1 -- 172.21.15.81:0/1309960860 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7feea8081a40 con 0x7feeb80ceef0 2023-11-29T11:20:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feebe0ee700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee9c064f10 0x7fee9c0673c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7feeb000b020 tx=0x7feeb0011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feec35d2740 1 Processor -- start 2023-11-29T11:20:04.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feec35d2740 1 -- start start 2023-11-29T11:20:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feec35d2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9dae0 0x114de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feec35d2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 0x114e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feec35d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x114e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feec35d2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x100cae0 con 0xe9dae0 2023-11-29T11:20:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feec35d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x107cbd0 con 0xee8790 2023-11-29T11:20:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.529+0000 7feec35d2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1075ed0 con 0xe9d710 2023-11-29T11:20:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9dae0 0x114de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9dae0 0x114de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36832/0 (socket says 172.21.15.81:36832) 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 -- 172.21.15.81:0/1626607968 learned_addr learned my addr 172.21.15.81:0/1626607968 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebd8ed700 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 0x114e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe8ef700 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x114e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 -- 172.21.15.81:0/1626607968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 msgr2=0x114e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 0x114e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 -- 172.21.15.81:0/1626607968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 msgr2=0x114e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x114e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 -- 172.21.15.81:0/1626607968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x109bcc0 con 0xe9dae0 2023-11-29T11:20:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feebe0ee700 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9dae0 0x114de00 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7feeb00042f0 tx=0x7feeb0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64446626fc0d2b5e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7fee9bfff700 1 -- 172.21.15.81:0/1626607968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0029440 con 0xe9dae0 2023-11-29T11:20:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7fee9bfff700 1 -- 172.21.15.81:0/1626607968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0021070 con 0xe9dae0 2023-11-29T11:20:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7fee9bfff700 1 -- 172.21.15.81:0/1626607968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00297e0 con 0xe9dae0 2023-11-29T11:20:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 -- 172.21.15.81:0/1626607968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9dae0 msgr2=0x114de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9dae0 0x114de00 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7feeb00042f0 tx=0x7feeb0010000 comp rx=0 tx=0).stop 2023-11-29T11:20:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 -- 172.21.15.81:0/1626607968 shutdown_connections 2023-11-29T11:20:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x114e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 0x114e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 --2- 172.21.15.81:0/1626607968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9dae0 0x114de00 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 -- 172.21.15.81:0/1626607968 >> 172.21.15.81:0/1626607968 conn(0xe9deb0 msgr2=0x1136700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 -- 172.21.15.81:0/1626607968 shutdown_connections 2023-11-29T11:20:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.533+0000 7feec35d2740 1 -- 172.21.15.81:0/1626607968 wait complete. 2023-11-29T11:20:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 -- start start 2023-11-29T11:20:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 Processor -- start 2023-11-29T11:20:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9d710 0x114b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 0x1137930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x1124ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf22b20 con 0xee8790 2023-11-29T11:20:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x114bc80 con 0xe9d710 2023-11-29T11:20:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1137e70 con 0xe9dae0 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 10 client.0 _ll_register_callbacks cb 0x10d20d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x1124ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x1124ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36838/0 (socket says 172.21.15.81:36838) 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 -- 172.21.15.81:0/359002982 learned_addr learned my addr 172.21.15.81:0/359002982 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe0ee700 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9d710 0x114b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebd8ed700 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 0x1137930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 -- 172.21.15.81:0/359002982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 msgr2=0x1137930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 0x1137930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 -- 172.21.15.81:0/359002982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9d710 msgr2=0x114b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9d710 0x114b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 -- 172.21.15.81:0/359002982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb80cb130 con 0xee8790 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe8ef700 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x1124ee0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7feeb4012540 tx=0x7feeb4012850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf2204b3a87080 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7fee997fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7fee997fa700 1 -- 172.21.15.81:0/359002982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb401a030 con 0xee8790 2023-11-29T11:20:04.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7fee997fa700 1 -- 172.21.15.81:0/359002982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7feeb401b070 con 0xee8790 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 -- 172.21.15.81:0/359002982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x106ef50 con 0xee8790 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7fee997fa700 1 -- 172.21.15.81:0/359002982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb4012e50 con 0xee8790 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 10 client.8328 fetch_fsmap learned FSMap version 59 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 -- 172.21.15.81:0/359002982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0xee99e0 con 0xee8790 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7fee997fa700 1 -- 172.21.15.81:0/359002982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4025020 con 0xee8790 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7fee997fa700 1 -- 172.21.15.81:0/359002982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3106+0+0 (secure 0 0 0) 0x7feeb4005320 con 0xee8790 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 10 client.8328 fetch_fsmap finished waiting for FSMap version 59 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 10 client.8328 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 20 client.8328 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1123940 0x1168140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 4 client.8328 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feec35d2740 1 -- 172.21.15.81:0/359002982 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x106ec70 con 0x1123940 2023-11-29T11:20:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.537+0000 7feebe0ee700 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1123940 0x1168140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7fee997fa700 10 client.8328 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feebe0ee700 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1123940 0x1168140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=595c7c58285e9d58 server_cookie=98ca1dfb97c748d in_seq=0 out_seq=0 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7fee997fa700 1 -- 172.21.15.81:0/359002982 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x106ec70 con 0x1123940 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7fee997fa700 10 client.8328 handle_command_reply: tid=0 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 client.8328 shutdown 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 -- 172.21.15.81:0/359002982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 msgr2=0x1124ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x1124ee0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7feeb4012540 tx=0x7feeb4012850 comp rx=0 tx=0).stop 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 -- 172.21.15.81:0/359002982 shutdown_connections 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x1124ee0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1123940 0x1168140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 0x1137930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 --2- 172.21.15.81:0/359002982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9d710 0x114b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 -- 172.21.15.81:0/359002982 >> 172.21.15.81:0/359002982 conn(0xe9deb0 msgr2=0x114f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7fee997fa700 0 client.8328 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 -- 172.21.15.81:0/359002982 shutdown_connections 2023-11-29T11:20:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 1 -- 172.21.15.81:0/359002982 wait complete. 2023-11-29T11:20:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.541+0000 7feec35d2740 20 client.8328 trim_cache size 0 max 16384 2023-11-29T11:20:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 Processor -- start 2023-11-29T11:20:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- start start 2023-11-29T11:20:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 0x1135d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9dae0 0x110f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x110fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x104bde0 con 0xee8790 2023-11-29T11:20:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x10736e0 con 0xe9dae0 2023-11-29T11:20:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x100c130 con 0xe9d710 2023-11-29T11:20:04.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x110fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x110fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36850/0 (socket says 172.21.15.81:36850) 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 -- 172.21.15.81:0/177467656 learned_addr learned my addr 172.21.15.81:0/177467656 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe0ee700 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 0x1135d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebd8ed700 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9dae0 0x110f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 -- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 msgr2=0x1135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 0x1135d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 -- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9dae0 msgr2=0x110f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9dae0 0x110f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 -- 172.21.15.81:0/177467656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80cd150 con 0xee8790 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebd8ed700 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9dae0 0x110f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:20:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feebe8ef700 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x110fb00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7feeb4001b00 tx=0x7feeb400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee340e62fe6c9817 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feeacdb8700 1 -- 172.21.15.81:0/177467656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb401a070 con 0xee8790 2023-11-29T11:20:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feeacdb8700 1 -- 172.21.15.81:0/177467656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4025030 con 0xee8790 2023-11-29T11:20:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feeacdb8700 1 -- 172.21.15.81:0/177467656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4006950 con 0xee8790 2023-11-29T11:20:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- 172.21.15.81:0/177467656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 msgr2=0x110fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x110fb00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7feeb4001b00 tx=0x7feeb400f000 comp rx=0 tx=0).stop 2023-11-29T11:20:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- 172.21.15.81:0/177467656 shutdown_connections 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xee8790 0x110fb00 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe9dae0 0x110f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 --2- 172.21.15.81:0/177467656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9d710 0x1135d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- 172.21.15.81:0/177467656 >> 172.21.15.81:0/177467656 conn(0xe9deb0 msgr2=0x110eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- 172.21.15.81:0/177467656 shutdown_connections 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- 172.21.15.81:0/177467656 wait complete. 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 -- start start 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.561+0000 7feec35d2740 1 Processor -- start 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9d710 0x111ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 0x11b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x11b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1046ec0 con 0xe9d710 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x107de60 con 0xee8790 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1078a30 con 0xe9dae0 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 10 client.0 _ll_register_callbacks cb 0x10222d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9d710 0x111ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9d710 0x111ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36858/0 (socket says 172.21.15.81:36858) 2023-11-29T11:20:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 -- 172.21.15.81:0/3988833608 learned_addr learned my addr 172.21.15.81:0/3988833608 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebd8ed700 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 0x11b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe8ef700 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x11b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 -- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 msgr2=0x11b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 0x11b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 -- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 msgr2=0x11b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x11b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 -- 172.21.15.81:0/3988833608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xee99e0 con 0xe9d710 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe8ef700 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x11b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebe0ee700 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9d710 0x111ecd0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009dc0 tx=0x7feeb0004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac11a47ec44bd7f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7fee997fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7fee997fa700 1 -- 172.21.15.81:0/3988833608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb003e480 con 0xe9d710 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7fee997fa700 1 -- 172.21.15.81:0/3988833608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7feeb0037040 con 0xe9d710 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 -- 172.21.15.81:0/3988833608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feeb0021070 con 0xe9d710 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7fee997fa700 1 -- 172.21.15.81:0/3988833608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb003e830 con 0xe9d710 2023-11-29T11:20:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 10 client.8334 fetch_fsmap learned FSMap version 59 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 -- 172.21.15.81:0/3988833608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x1022a20 con 0xe9d710 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7fee997fa700 1 -- 172.21.15.81:0/3988833608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0021070 con 0xe9d710 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7fee997fa700 1 -- 172.21.15.81:0/3988833608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3106+0+0 (secure 0 0 0) 0x7feeb0026050 con 0xe9d710 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 10 client.8334 fetch_fsmap finished waiting for FSMap version 59 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 10 client.8334 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 20 client.8334 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x11b4cf0 0x11bb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 4 client.8334 mds_command: new command op to 8010 tid=0[{"prefix": "status"}] 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feec35d2740 1 -- 172.21.15.81:0/3988833608 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "status"}) v1 -- 0xf1a260 con 0x11b4cf0 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebd8ed700 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x11b4cf0 0x11bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7fee997fa700 10 client.8334 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.565+0000 7feebd8ed700 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x11b4cf0 0x11bb530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1402868a939419b6 server_cookie=d34ee435f39902d9 in_seq=0 out_seq=0 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7fee997fa700 1 -- 172.21.15.81:0/3988833608 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0xf1a260 con 0x11b4cf0 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7fee997fa700 10 client.8334 handle_command_reply: tid=0 2023-11-29T11:20:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 client.8334 shutdown 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 -- 172.21.15.81:0/3988833608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9d710 msgr2=0x111ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9d710 0x111ecd0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009dc0 tx=0x7feeb0004b60 comp rx=0 tx=0).stop 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 -- 172.21.15.81:0/3988833608 shutdown_connections 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xee8790 0x11b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x11b4cf0 0x11bb530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe9dae0 0x11b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 --2- 172.21.15.81:0/3988833608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe9d710 0x111ecd0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7fee997fa700 0 client.8334 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 -- 172.21.15.81:0/3988833608 >> 172.21.15.81:0/3988833608 conn(0xe9deb0 msgr2=0x1123e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 -- 172.21.15.81:0/3988833608 shutdown_connections 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 1 -- 172.21.15.81:0/3988833608 wait complete. 2023-11-29T11:20:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feec35d2740 20 client.8334 trim_cache size 0 max 16384 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8010, 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.4675411799999996, 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 59, 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 97, 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 97, 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 29.427093736 2023-11-29T11:20:04.579 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:20:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 -- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee9c064f10 msgr2=0x7fee9c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee9c064f10 0x7fee9c0673c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7feeb000b020 tx=0x7feeb0011000 comp rx=0 tx=0).stop 2023-11-29T11:20:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 -- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80ceef0 msgr2=0x7feeb815ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80ceef0 0x7feeb815ccf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feea800c3e0 tx=0x7feea800c6f0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 -- 172.21.15.81:0/1309960860 shutdown_connections 2023-11-29T11:20:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fee9c064f10 0x7fee9c0673c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeb81606b0 0x7feeb80c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeb80ceef0 0x7feeb815ccf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 --2- 172.21.15.81:0/1309960860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeb80ad610 0x7feeb8071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 -- 172.21.15.81:0/1309960860 >> 172.21.15.81:0/1309960860 conn(0x7feeb80ce3e0 msgr2=0x7feeb80cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 -- 172.21.15.81:0/1309960860 shutdown_connections 2023-11-29T11:20:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.569+0000 7feebf0f0700 1 -- 172.21.15.81:0/1309960860 wait complete. 2023-11-29T11:20:04.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:20:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a93fff700 1 Processor -- start 2023-11-29T11:20:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a93fff700 1 -- start start 2023-11-29T11:20:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a94158e60 0x7f8a940c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a93fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a940cd8f0 con 0x7f8a940cb460 2023-11-29T11:20:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a93fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9406dc60 con 0x7f8a940ad490 2023-11-29T11:20:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a93fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940add00 con 0x7f8a94158e60 2023-11-29T11:20:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a937fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8a940cb460 0x7f8a9406c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57568/0 (socket says 172.21.15.81:57568) 2023-11-29T11:20:04.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a937fe700 1 -- 172.21.15.81:0/2822881709 learned_addr learned my addr 172.21.15.81:0/2822881709 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:20:04.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/2822881709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a94158e60 0x7f8a940c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a91ffb700 1 -- 172.21.15.81:0/2822881709 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291790384 0 0) 0x7f8a9406dc60 con 0x7f8a940ad490 2023-11-29T11:20:04.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a91ffb700 1 -- 172.21.15.81:0/2822881709 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a7c0035d0 con 0x7f8a940ad490 2023-11-29T11:20:04.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a91ffb700 1 -- 172.21.15.81:0/2822881709 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397501518 0 0) 0x7f8a940cd8f0 con 0x7f8a940cb460 2023-11-29T11:20:04.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.705+0000 7f8a91ffb700 1 -- 172.21.15.81:0/2822881709 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a9406dc60 con 0x7f8a940cb460 2023-11-29T11:20:04.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a92ffd700 1 -- 172.21.15.81:0/2822881709 >> v1:172.21.15.176:6789/0 conn(0x7f8a940ad490 legacy=0x7f8a940cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a92ffd700 1 -- 172.21.15.81:0/2822881709 >> v1:172.21.15.81:6789/0 conn(0x7f8a940cb460 legacy=0x7f8a9406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a92ffd700 1 -- 172.21.15.81:0/2822881709 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a940cde90 con 0x7f8a94158e60 2023-11-29T11:20:04.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/2822881709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a94158e60 0x7f8a940c8a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8a88009880 tx=0x7f8a88009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55564ea8d53495fc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a91ffb700 1 -- 172.21.15.81:0/2822881709 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88011830 con 0x7f8a94158e60 2023-11-29T11:20:04.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a91ffb700 1 -- 172.21.15.81:0/2822881709 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a88011990 con 0x7f8a94158e60 2023-11-29T11:20:04.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a91ffb700 1 -- 172.21.15.81:0/2822881709 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88011d00 con 0x7f8a94158e60 2023-11-29T11:20:04.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a93fff700 1 -- 172.21.15.81:0/2822881709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a94158e60 msgr2=0x7f8a940c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2822881709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a94158e60 0x7f8a940c8a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8a88009880 tx=0x7f8a88009b90 comp rx=0 tx=0).stop 2023-11-29T11:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a93fff700 1 -- 172.21.15.81:0/2822881709 shutdown_connections 2023-11-29T11:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2822881709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a94158e60 0x7f8a940c8a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a93fff700 1 -- 172.21.15.81:0/2822881709 >> 172.21.15.81:0/2822881709 conn(0x7f8a940ce3e0 msgr2=0x7f8a940ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a93fff700 1 -- 172.21.15.81:0/2822881709 shutdown_connections 2023-11-29T11:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.709+0000 7f8a93fff700 1 -- 172.21.15.81:0/2822881709 wait complete. 2023-11-29T11:20:04.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 Processor -- start 2023-11-29T11:20:04.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 -- start start 2023-11-29T11:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a940ad490 0x7f8a94159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940cb460 0x7f8a94159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a94158e60 0x7f8a94159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94071490 con 0x7f8a94158e60 2023-11-29T11:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9406fed0 con 0x7f8a940cb460 2023-11-29T11:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94070e40 con 0x7f8a940ad490 2023-11-29T11:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a927fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940cb460 0x7f8a94159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a937fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a94158e60 0x7f8a94159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a927fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940cb460 0x7f8a94159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:38268/0 (socket says 172.21.15.81:38268) 2023-11-29T11:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a927fc700 1 -- 172.21.15.81:0/2534346736 learned_addr learned my addr 172.21.15.81:0/2534346736 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a940ad490 0x7f8a94159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a92ffd700 1 -- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940cb460 msgr2=0x7f8a94159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940cb460 0x7f8a94159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a92ffd700 1 -- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a94158e60 msgr2=0x7f8a94159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a94158e60 0x7f8a94159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a92ffd700 1 -- 172.21.15.81:0/2534346736 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a880094b0 con 0x7f8a940ad490 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a927fc700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940cb460 0x7f8a94159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a92ffd700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a940ad490 0x7f8a94159420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a88015000 tx=0x7f8a88004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a7bfff700 1 -- 172.21.15.81:0/2534346736 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88004450 con 0x7f8a940ad490 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a7bfff700 1 -- 172.21.15.81:0/2534346736 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a880045b0 con 0x7f8a940ad490 2023-11-29T11:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9406d6a0 con 0x7f8a940ad490 2023-11-29T11:20:04.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a7bfff700 1 -- 172.21.15.81:0/2534346736 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a880038e0 con 0x7f8a940ad490 2023-11-29T11:20:04.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.713+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a94159230 con 0x7f8a940ad490 2023-11-29T11:20:04.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.717+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9406d980 con 0x7f8a940ad490 2023-11-29T11:20:04.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.717+0000 7f8a7bfff700 1 -- 172.21.15.81:0/2534346736 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8a8800f050 con 0x7f8a940ad490 2023-11-29T11:20:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.717+0000 7f8a7bfff700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a80064ee0 0x7f8a80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.717+0000 7f8a7bfff700 1 -- 172.21.15.81:0/2534346736 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f8a88083500 con 0x7f8a940ad490 2023-11-29T11:20:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.717+0000 7f8a927fc700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a80064ee0 0x7f8a80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:04.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.717+0000 7f8a927fc700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a80064ee0 0x7f8a80067390 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8a940ca5b0 tx=0x7f8a84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:04.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.725+0000 7f8a7bfff700 1 -- 172.21.15.81:0/2534346736 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8a88051520 con 0x7f8a940ad490 2023-11-29T11:20:04.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.921+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8a94070f80 con 0x7f8a940ad490 2023-11-29T11:20:04.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.921+0000 7f8a7bfff700 1 -- 172.21.15.81:0/2534346736 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8a94070f80 con 0x7f8a940ad490 2023-11-29T11:20:04.930 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:20:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a80064ee0 msgr2=0x7f8a80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a80064ee0 0x7f8a80067390 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8a940ca5b0 tx=0x7f8a84009040 comp rx=0 tx=0).stop 2023-11-29T11:20:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a940ad490 msgr2=0x7f8a94159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a940ad490 0x7f8a94159420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a88015000 tx=0x7f8a88004770 comp rx=0 tx=0).stop 2023-11-29T11:20:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 shutdown_connections 2023-11-29T11:20:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a80064ee0 0x7f8a80067390 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a94158e60 0x7f8a94159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a940cb460 0x7f8a94159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 --2- 172.21.15.81:0/2534346736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a940ad490 0x7f8a94159420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 >> 172.21.15.81:0/2534346736 conn(0x7f8a940ce3e0 msgr2=0x7f8a940afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 shutdown_connections 2023-11-29T11:20:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:04.925+0000 7f8a93fff700 1 -- 172.21.15.81:0/2534346736 wait complete. 2023-11-29T11:20:04.944 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:20:04.944 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:20:04.944 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:20:04.944 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:20:04.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:20:04.945 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:20:04.945 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:20:04.945 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:20:04.945 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:20:04.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:04.945 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:20:04.952 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:20:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42161sec preferred_lft 42161sec 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:20:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:20:04.955 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:20:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:20:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:20:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:20:04.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:04.955 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:20:04.968 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:20:04.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:04.970 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:20:05.022 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:20:05.022 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:20:05.023 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:20:05.023 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:20:05.023 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:20:05.023 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:20:05.023 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:20:05.023 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:20:05.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:05.023 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:20:05.023 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:20:05.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:20:05.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:20:05.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:20:05.023 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:20:05.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:05.064 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:20:05.113 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:20:05.113 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:20:05.113 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:20:05.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:05.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:20:05.125 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:20:05.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:20:05.126 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:20:05.131 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:20:05.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:20:05.131 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:20:05.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:20:05.196 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:20:05.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:20:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:20:05.211 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:20:05.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:05.211 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:20:05.218 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:20:05.218 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:20:05.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:20:05.235 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:20:05.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:20:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:20:05.289 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:20:05.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:05.290 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:20:05.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:20:05.301+0000 7fa452805640 -1 init, newargv = 0x56049b3bbb10 newargc=15 2023-11-29T11:20:05.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[58672]: starting ceph client 2023-11-29T11:20:05.318 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[58672]: starting fuse 2023-11-29T11:20:06.114 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:20:06.105+0000 7fe2f1598700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:20:06.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:20:06.416 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:20:06.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:20:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:20:06.477 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:20:06.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:06.478 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:20:06.484 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:20:06.484 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:20:06.484 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:20:06.485 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:20:06.569 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.58672.asok 2023-11-29T11:20:06.753 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58672.asok 2023-11-29T11:20:06.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:06.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58672.asok status 2023-11-29T11:20:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "58672", 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8346, 2023-11-29T11:20:06.899 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8346 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 488304491 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:20:06.900 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 488304491 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.8346 192.168.0.1:0/488304491", 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/488304491", 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 59, 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 97, 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:20:06.901 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:20:06.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:06.909 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:20:06.909 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:20:06.917 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:20:06.917 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:20:06.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:06.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:20:06.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:20:06.929 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2023-11-29T11:20:06.942 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:20:06.932+0000 7fe2edd91700 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2023-11-29T11:20:06.943 INFO:teuthology.orchestra.run.smithi081.stderr:stat: cannot stat 'testdir/hardlink': Input/output error 2023-11-29T11:20:06.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:20:06.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2023-11-29T11:20:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd6d72a700 1 Processor -- start 2023-11-29T11:20:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd6d72a700 1 -- start start 2023-11-29T11:20:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd6d72a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdd6815a2c0 0x7fdd680b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd6d72a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd680d0370 con 0x7fdd680caef0 2023-11-29T11:20:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd6d72a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6815a770 con 0x7fdd68159ef0 2023-11-29T11:20:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd6d72a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd680d0650 con 0x7fdd6815a2c0 2023-11-29T11:20:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd6cf29700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd680caef0 0x7fdd6815db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57584/0 (socket says 172.21.15.81:57584) 2023-11-29T11:20:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd6cf29700 1 -- 172.21.15.81:0/1778614378 learned_addr learned my addr 172.21.15.81:0/1778614378 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:20:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/1778614378 >> v2:172.21.15.176:3300/0 conn(0x7fdd6815a2c0 0x7fdd680b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd677fe700 1 -- 172.21.15.81:0/1778614378 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463612523 0 0) 0x7fdd680d0370 con 0x7fdd680caef0 2023-11-29T11:20:07.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd677fe700 1 -- 172.21.15.81:0/1778614378 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd540035d0 con 0x7fdd680caef0 2023-11-29T11:20:07.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd5ffff700 1 -- 172.21.15.81:0/1778614378 >> v1:172.21.15.176:6789/0 conn(0x7fdd68159ef0 legacy=0x7fdd680cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd5ffff700 1 -- 172.21.15.81:0/1778614378 >> v1:172.21.15.81:6789/0 conn(0x7fdd680caef0 legacy=0x7fdd6815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd5ffff700 1 -- 172.21.15.81:0/1778614378 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6815aa50 con 0x7fdd6815a2c0 2023-11-29T11:20:07.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.108+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/1778614378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815a2c0 0x7fdd680b22d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009850 tx=0x7fdd50009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68d18c25074b2575 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd677fe700 1 -- 172.21.15.81:0/1778614378 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50011830 con 0x7fdd6815a2c0 2023-11-29T11:20:07.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd677fe700 1 -- 172.21.15.81:0/1778614378 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50011990 con 0x7fdd6815a2c0 2023-11-29T11:20:07.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd677fe700 1 -- 172.21.15.81:0/1778614378 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50011d00 con 0x7fdd6815a2c0 2023-11-29T11:20:07.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd6d72a700 1 -- 172.21.15.81:0/1778614378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815a2c0 msgr2=0x7fdd680b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd6d72a700 1 --2- 172.21.15.81:0/1778614378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815a2c0 0x7fdd680b22d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009850 tx=0x7fdd50009b60 comp rx=0 tx=0).stop 2023-11-29T11:20:07.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd6d72a700 1 -- 172.21.15.81:0/1778614378 shutdown_connections 2023-11-29T11:20:07.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd6d72a700 1 --2- 172.21.15.81:0/1778614378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815a2c0 0x7fdd680b22d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd6d72a700 1 -- 172.21.15.81:0/1778614378 >> 172.21.15.81:0/1778614378 conn(0x7fdd680cd2b0 msgr2=0x7fdd680cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd6d72a700 1 -- 172.21.15.81:0/1778614378 shutdown_connections 2023-11-29T11:20:07.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.112+0000 7fdd6d72a700 1 -- 172.21.15.81:0/1778614378 wait complete. 2023-11-29T11:20:07.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6d72a700 1 Processor -- start 2023-11-29T11:20:07.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6d72a700 1 -- start start 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6d72a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd680caef0 0x7fdd680c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6d72a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd68159ef0 0x7fdd68152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6d72a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd6815a2c0 0x7fdd68152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6d72a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6815ae30 con 0x7fdd68159ef0 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6d72a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68153080 con 0x7fdd680caef0 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6d72a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd680c9690 con 0x7fdd6815a2c0 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd68159ef0 0x7fdd68152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd68159ef0 0x7fdd68152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36876/0 (socket says 172.21.15.81:36876) 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 -- 172.21.15.81:0/4183812480 learned_addr learned my addr 172.21.15.81:0/4183812480 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd67fff700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd680caef0 0x7fdd680c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd6815a2c0 0x7fdd68152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 -- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd6815a2c0 msgr2=0x7fdd68152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd6815a2c0 0x7fdd68152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 -- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd680caef0 msgr2=0x7fdd680c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd680caef0 0x7fdd680c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 -- 172.21.15.81:0/4183812480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500094b0 con 0x7fdd68159ef0 2023-11-29T11:20:07.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd6815a2c0 0x7fdd68152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:07.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.116+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd68159ef0 0x7fdd68152600 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009ba0 tx=0x7fdd50004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd657fa700 1 -- 172.21.15.81:0/4183812480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500045d0 con 0x7fdd68159ef0 2023-11-29T11:20:07.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd657fa700 1 -- 172.21.15.81:0/4183812480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5001e070 con 0x7fdd68159ef0 2023-11-29T11:20:07.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd6d72a700 1 -- 172.21.15.81:0/4183812480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6815b3e0 con 0x7fdd68159ef0 2023-11-29T11:20:07.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd657fa700 1 -- 172.21.15.81:0/4183812480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500038e0 con 0x7fdd68159ef0 2023-11-29T11:20:07.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd6d72a700 1 -- 172.21.15.81:0/4183812480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6815b250 con 0x7fdd68159ef0 2023-11-29T11:20:07.128 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd657fa700 1 -- 172.21.15.81:0/4183812480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd5002a020 con 0x7fdd68159ef0 2023-11-29T11:20:07.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd657fa700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd48064ee0 0x7fdd48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd657fa700 1 -- 172.21.15.81:0/4183812480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fdd50083090 con 0x7fdd68159ef0 2023-11-29T11:20:07.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd67fff700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd48064ee0 0x7fdd48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.120+0000 7fdd67fff700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd48064ee0 0x7fdd48067390 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdd680b3fe0 tx=0x7fdd58009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 Processor -- start 2023-11-29T11:20:07.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- start start 2023-11-29T11:20:07.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1170420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1170960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1175470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1023c00 con 0xeff9c0 2023-11-29T11:20:07.133 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1093cf0 con 0xeb4940 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x108cff0 con 0xeb4d10 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1175470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1175470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36892/0 (socket says 172.21.15.81:36892) 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 -- 172.21.15.81:0/120785510 learned_addr learned my addr 172.21.15.81:0/120785510 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd67fff700 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1170420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1170960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 -- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 msgr2=0x1170420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1170420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 -- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 msgr2=0x1170960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1170960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 -- 172.21.15.81:0/120785510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10b2ec0 con 0xeff9c0 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1170960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd67fff700 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1170420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1175470 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fdd600020b0 tx=0x7fdd600020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bf29ac2f97b890 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd5dffb700 1 -- 172.21.15.81:0/120785510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000e920 con 0xeff9c0 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd5dffb700 1 -- 172.21.15.81:0/120785510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6000ea80 con 0xeff9c0 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd5dffb700 1 -- 172.21.15.81:0/120785510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000edf0 con 0xeff9c0 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- 172.21.15.81:0/120785510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 msgr2=0x1175470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1175470 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fdd600020b0 tx=0x7fdd600020e0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- 172.21.15.81:0/120785510 shutdown_connections 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1175470 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1170960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/120785510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1170420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- 172.21.15.81:0/120785510 >> 172.21.15.81:0/120785510 conn(0xeb50e0 msgr2=0x114d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- 172.21.15.81:0/120785510 shutdown_connections 2023-11-29T11:20:07.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- 172.21.15.81:0/120785510 wait complete. 2023-11-29T11:20:07.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 -- start start 2023-11-29T11:20:07.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.124+0000 7fdd71c0c740 1 Processor -- start 2023-11-29T11:20:07.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x1164020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x114dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 0x114e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf39d50 con 0xeb4940 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1164560 con 0xeb4d10 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x11647a0 con 0xeff9c0 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 10 client.0 _ll_register_callbacks cb 0x10e98f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x1164020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x1164020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36898/0 (socket says 172.21.15.81:36898) 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 -- 172.21.15.81:0/2957454822 learned_addr learned my addr 172.21.15.81:0/2957454822 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x114dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 0x114e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 -- 172.21.15.81:0/2957454822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 msgr2=0x114e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 0x114e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 -- 172.21.15.81:0/2957454822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 msgr2=0x114dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x114dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 -- 172.21.15.81:0/2957454822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6000f040 con 0xeb4940 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x1164020 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fdd580154e0 tx=0x7fdd58007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9305a7a464aa8a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2957454822 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58015bb0 con 0xeb4940 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2957454822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10bae30 con 0xeb4940 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2957454822 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fdd58015d10 con 0xeb4940 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2957454822 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd58021420 con 0xeb4940 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 10 client.8358 fetch_fsmap learned FSMap version 59 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2957454822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0xf00c10 con 0xeb4940 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2957454822 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10bae30 con 0xeb4940 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2957454822 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdd58029350 con 0xeb4940 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 10 client.8358 fetch_fsmap finished waiting for FSMap version 59 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 10 client.8358 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 20 client.8358 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1149d30 0x114a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 4 client.8358 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2957454822 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1086070 con 0x1149d30 2023-11-29T11:20:07.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.128+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1149d30 0x114a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd46ffd700 10 client.8358 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1149d30 0x114a130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d455d83b4e8564e server_cookie=4f5783ca37bdce5f in_seq=0 out_seq=0 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2957454822 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1086070 con 0x1149d30 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd46ffd700 10 client.8358 handle_command_reply: tid=0 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 client.8358 shutdown 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2957454822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 msgr2=0x1164020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x1164020 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fdd580154e0 tx=0x7fdd58007f90 comp rx=0 tx=0).stop 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2957454822 shutdown_connections 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1149d30 0x114a130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd46ffd700 0 client.8358 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 0x114e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x114dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2957454822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x1164020 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2957454822 >> 172.21.15.81:0/2957454822 conn(0xeb50e0 msgr2=0x116ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2957454822 shutdown_connections 2023-11-29T11:20:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2957454822 wait complete. 2023-11-29T11:20:07.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.132+0000 7fdd71c0c740 20 client.8358 trim_cache size 0 max 16384 2023-11-29T11:20:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.152+0000 7fdd71c0c740 1 Processor -- start 2023-11-29T11:20:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.152+0000 7fdd71c0c740 1 -- start start 2023-11-29T11:20:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x116e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x116e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 0x116ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1088960 con 0xeb4940 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x104bf60 con 0xeb4d10 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x108bd10 con 0xeff9c0 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x116e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x116e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36910/0 (socket says 172.21.15.81:36910) 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 -- 172.21.15.81:0/2455334019 learned_addr learned my addr 172.21.15.81:0/2455334019 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x116e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 0x116ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 -- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 msgr2=0x116ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 0x116ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 -- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 msgr2=0x116e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x116e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 -- 172.21.15.81:0/2455334019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd680ce4f0 con 0xeb4940 2023-11-29T11:20:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x116e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:20:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x116e2a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fdd580011d0 tx=0x7fdd58014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0679ff504d2648d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/2455334019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580298b0 con 0xeb4940 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/2455334019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58001ce0 con 0xeb4940 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd5e7fc700 1 -- 172.21.15.81:0/2455334019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58029350 con 0xeb4940 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2455334019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 msgr2=0x116e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x116e2a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fdd580011d0 tx=0x7fdd58014000 comp rx=0 tx=0).stop 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2455334019 shutdown_connections 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeff9c0 0x116ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4d10 0x116e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2455334019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeb4940 0x116e2a0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2455334019 >> 172.21.15.81:0/2455334019 conn(0xeb50e0 msgr2=0x1163500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2455334019 shutdown_connections 2023-11-29T11:20:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2455334019 wait complete. 2023-11-29T11:20:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.156+0000 7fdd71c0c740 1 -- start start 2023-11-29T11:20:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 Processor -- start 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1124b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1123f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1121e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1164a90 con 0xeff9c0 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x116f830 con 0xeb4940 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x116f5d0 con 0xeb4d10 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 10 client.0 _ll_register_callbacks cb 0x1057a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1121e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1121e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36916/0 (socket says 172.21.15.81:36916) 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 -- 172.21.15.81:0/2124481742 learned_addr learned my addr 172.21.15.81:0/2124481742 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1124b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd5ffff700 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1123f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 -- 172.21.15.81:0/2124481742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 msgr2=0x1123f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1123f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 -- 172.21.15.81:0/2124481742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 msgr2=0x1124b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1124b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 -- 172.21.15.81:0/2124481742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xf00c10 con 0xeff9c0 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd6cf29700 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1121e20 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fdd60017040 tx=0x7fdd60001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d3f600c429116a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd46ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2124481742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000ee00 con 0xeff9c0 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2124481742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fdd60014480 con 0xeff9c0 2023-11-29T11:20:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2124481742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd6000ea80 con 0xeff9c0 2023-11-29T11:20:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2124481742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd60014660 con 0xeff9c0 2023-11-29T11:20:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 10 client.8364 fetch_fsmap learned FSMap version 59 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.160+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2124481742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x1039b70 con 0xeff9c0 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2124481742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6000ea80 con 0xeff9c0 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2124481742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdd600147c0 con 0xeff9c0 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 10 client.8364 fetch_fsmap finished waiting for FSMap version 59 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 10 client.8364 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 20 client.8364 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1149d30 0x1122360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 4 client.8364 mds_command: new command op to 8010 tid=0[{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2124481742 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) v1 -- 0x1085d90 con 0x1149d30 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1149d30 0x1122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd67fff700 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1149d30 0x1122360 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69b2d77391f4168d server_cookie=edf910d5bd9fe473 in_seq=0 out_seq=0 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd46ffd700 10 client.8364 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd46ffd700 1 -- 172.21.15.81:0/2124481742 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1085d90 con 0x1149d30 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd46ffd700 10 client.8364 handle_command_reply: tid=0 2023-11-29T11:20:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 client.8364 shutdown 2023-11-29T11:20:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2124481742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 msgr2=0x1121e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1121e20 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fdd60017040 tx=0x7fdd60001250 comp rx=0 tx=0).stop 2023-11-29T11:20:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2124481742 shutdown_connections 2023-11-29T11:20:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xeff9c0 0x1121e20 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1149d30 0x1122360 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xeb4d10 0x1123f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd46ffd700 0 client.8364 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 --2- 172.21.15.81:0/2124481742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xeb4940 0x1124b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2124481742 >> 172.21.15.81:0/2124481742 conn(0xeb50e0 msgr2=0x1146010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.175 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fe2edd91700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 ap=1 f(v0 m2023-11-29T11:19:47.824838+0000 1=1+0) n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x5596f4264100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2023-11-29T11:19:47.824838+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2023-11-29T11:20:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2124481742 shutdown_connections 2023-11-29T11:20:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 1 -- 172.21.15.81:0/2124481742 wait complete. 2023-11-29T11:20:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.164+0000 7fdd71c0c740 20 client.8364 trim_cache size 0 max 16384 2023-11-29T11:20:07.176 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:20:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:20:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "18d7ea11-d027-42cf-a581-34f115f9220c", 2023-11-29T11:20:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:20:07.176 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 -- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd48064ee0 msgr2=0x7fdd48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd48064ee0 0x7fdd48067390 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdd680b3fe0 tx=0x7fdd58009040 comp rx=0 tx=0).stop 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 -- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd68159ef0 msgr2=0x7fdd68152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd68159ef0 0x7fdd68152600 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009ba0 tx=0x7fdd50004770 comp rx=0 tx=0).stop 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 -- 172.21.15.81:0/4183812480 shutdown_connections 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd48064ee0 0x7fdd48067390 secure :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdd680b3fe0 tx=0x7fdd58009040 comp rx=0 tx=0).stop 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd6815a2c0 0x7fdd68152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd68159ef0 0x7fdd68152600 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 --2- 172.21.15.81:0/4183812480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd680caef0 0x7fdd680c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 -- 172.21.15.81:0/4183812480 >> 172.21.15.81:0/4183812480 conn(0x7fdd680cd2b0 msgr2=0x7fdd6806e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 -- 172.21.15.81:0/4183812480 shutdown_connections 2023-11-29T11:20:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.168+0000 7fdd6d72a700 1 -- 172.21.15.81:0/4183812480 wait complete. 2023-11-29T11:20:07.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-11-29T11:20:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.308+0000 7f05c7fff700 1 Processor -- start 2023-11-29T11:20:07.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.308+0000 7f05c7fff700 1 -- start start 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.308+0000 7f05c7fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05c815cda0 0x7f05c815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.308+0000 7f05c7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 0x7f05c80cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.308+0000 7f05c7fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c80ce8e0 con 0x7f05c80cc070 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.308+0000 7f05c7fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80ce600 con 0x7f05c815cda0 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c8159490 con 0x7f05c8159f70 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c6ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05c815cda0 0x7f05c815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f05c80cc070 0x7f05c8070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57600/0 (socket says 172.21.15.81:57600) 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c77fe700 1 -- 172.21.15.81:0/4065081703 learned_addr learned my addr 172.21.15.81:0/4065081703 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c67fc700 1 --2- 172.21.15.81:0/4065081703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 0x7f05c80cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c6ffd700 1 -- 172.21.15.81:0/4065081703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 msgr2=0x7f05c80cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/4065081703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 0x7f05c80cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c6ffd700 1 -- 172.21.15.81:0/4065081703 >> v1:172.21.15.81:6789/0 conn(0x7f05c80cc070 legacy=0x7f05c8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c6ffd700 1 -- 172.21.15.81:0/4065081703 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c8159770 con 0x7f05c815cda0 2023-11-29T11:20:07.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/4065081703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c815d170 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009d90 tx=0x7f05b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61de42230618b3c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c5ffb700 1 -- 172.21.15.81:0/4065081703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000e070 con 0x7f05c815cda0 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c5ffb700 1 -- 172.21.15.81:0/4065081703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000bbd0 con 0x7f05c815cda0 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c5ffb700 1 -- 172.21.15.81:0/4065081703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0012430 con 0x7f05c815cda0 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 -- 172.21.15.81:0/4065081703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 msgr2=0x7f05c815d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4065081703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c815d170 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009d90 tx=0x7f05b000b330 comp rx=0 tx=0).stop 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 -- 172.21.15.81:0/4065081703 shutdown_connections 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4065081703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 0x7f05c80cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4065081703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c815d170 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 -- 172.21.15.81:0/4065081703 >> 172.21.15.81:0/4065081703 conn(0x7f05c80b26e0 msgr2=0x7f05c80b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 -- 172.21.15.81:0/4065081703 shutdown_connections 2023-11-29T11:20:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 -- 172.21.15.81:0/4065081703 wait complete. 2023-11-29T11:20:07.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.312+0000 7f05c7fff700 1 Processor -- start 2023-11-29T11:20:07.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 -- start start 2023-11-29T11:20:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c80cc070 0x7f05c814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 0x7f05c814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c814b7a0 con 0x7f05c815cda0 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c814ce40 con 0x7f05c80cc070 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c814d120 con 0x7f05c8159f70 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c806a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36930/0 (socket says 172.21.15.81:36930) 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 -- 172.21.15.81:0/4031225173 learned_addr learned my addr 172.21.15.81:0/4031225173 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c67fc700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 0x7f05c814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c80cc070 0x7f05c814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 -- 172.21.15.81:0/4031225173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 msgr2=0x7f05c814c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 0x7f05c814c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 -- 172.21.15.81:0/4031225173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c80cc070 msgr2=0x7f05c814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c80cc070 0x7f05c814b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 -- 172.21.15.81:0/4031225173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0009a70 con 0x7f05c815cda0 2023-11-29T11:20:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c77fe700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c806a4d0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c420 tx=0x7f05b800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05bffff700 1 -- 172.21.15.81:0/4031225173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8005d90 con 0x7f05c815cda0 2023-11-29T11:20:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 -- 172.21.15.81:0/4031225173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c815d6b0 con 0x7f05c815cda0 2023-11-29T11:20:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05bffff700 1 -- 172.21.15.81:0/4031225173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b800ce30 con 0x7f05c815cda0 2023-11-29T11:20:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05bffff700 1 -- 172.21.15.81:0/4031225173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80072d0 con 0x7f05c815cda0 2023-11-29T11:20:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.316+0000 7f05c7fff700 1 -- 172.21.15.81:0/4031225173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c8159a50 con 0x7f05c815cda0 2023-11-29T11:20:07.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.320+0000 7f05bffff700 1 -- 172.21.15.81:0/4031225173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f05b8019030 con 0x7f05c815cda0 2023-11-29T11:20:07.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.320+0000 7f05bffff700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05ac064ee0 0x7f05ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.320+0000 7f05bffff700 1 -- 172.21.15.81:0/4031225173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f05b8081230 con 0x7f05c815cda0 2023-11-29T11:20:07.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.320+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05ac064ee0 0x7f05ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.320+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05ac064ee0 0x7f05ac067390 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f05b0014040 tx=0x7f05b0011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05d0ab3740 1 Processor -- start 2023-11-29T11:20:07.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05d0ab3740 1 -- start start 2023-11-29T11:20:07.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x20faef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ed28c0 0x20fb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ff6d20 con 0x1e87840 2023-11-29T11:20:07.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2066d60 con 0x1e87c10 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2060060 con 0x1ed28c0 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x20faef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x20faef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36936/0 (socket says 172.21.15.81:36936) 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 -- 172.21.15.81:0/1648765507 learned_addr learned my addr 172.21.15.81:0/1648765507 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c77fe700 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ed28c0 0x20fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 -- 172.21.15.81:0/1648765507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ed28c0 msgr2=0x20fb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ed28c0 0x20fb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 -- 172.21.15.81:0/1648765507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 msgr2=0x20f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 -- 172.21.15.81:0/1648765507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20860a0 con 0x1e87840 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05c67fc700 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x20faef0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009a00 tx=0x7f05c0009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a2afcc18ff3a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05bd7fa700 1 -- 172.21.15.81:0/1648765507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0004230 con 0x1e87840 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05bd7fa700 1 -- 172.21.15.81:0/1648765507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0004390 con 0x1e87840 2023-11-29T11:20:07.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.324+0000 7f05bd7fa700 1 -- 172.21.15.81:0/1648765507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011750 con 0x1e87840 2023-11-29T11:20:07.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1648765507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 msgr2=0x20faef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x20faef0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009a00 tx=0x7f05c0009d10 comp rx=0 tx=0).stop 2023-11-29T11:20:07.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1648765507 shutdown_connections 2023-11-29T11:20:07.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ed28c0 0x20fb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x20faef0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1648765507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1648765507 >> 172.21.15.81:0/1648765507 conn(0x1e87fe0 msgr2=0x2120d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1648765507 shutdown_connections 2023-11-29T11:20:07.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1648765507 wait complete. 2023-11-29T11:20:07.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- start start 2023-11-29T11:20:07.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 Processor -- start 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 0x21256f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87c10 0x213ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x213f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f0cc50 con 0x1e87c10 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x213f880 con 0x1ed28c0 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2125c30 con 0x1e87840 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 10 client.0 _ll_register_callbacks cb 0x20599a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87c10 0x213ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87c10 0x213ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36938/0 (socket says 172.21.15.81:36938) 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 -- 172.21.15.81:0/1828700565 learned_addr learned my addr 172.21.15.81:0/1828700565 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c6ffd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 0x21256f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c77fe700 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x213f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 -- 172.21.15.81:0/1828700565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 msgr2=0x21256f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 0x21256f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 -- 172.21.15.81:0/1828700565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 msgr2=0x213f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x213f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 -- 172.21.15.81:0/1828700565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c000e040 con 0x1e87c10 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c77fe700 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x213f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05c67fc700 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87c10 0x213ee00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f05c0000c00 tx=0x7f05c00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46499016f600ba58 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05b67fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05b67fc700 1 -- 172.21.15.81:0/1828700565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0023070 con 0x1e87c10 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05b67fc700 1 -- 172.21.15.81:0/1828700565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f05c0028470 con 0x1e87c10 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1828700565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x20590e0 con 0x1e87c10 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05b67fc700 1 -- 172.21.15.81:0/1828700565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05c0028630 con 0x1e87c10 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 10 client.8379 fetch_fsmap learned FSMap version 59 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.328+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1828700565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x1ed3b10 con 0x1e87c10 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05b67fc700 1 -- 172.21.15.81:0/1828700565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x20590e0 con 0x1e87c10 2023-11-29T11:20:07.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05b67fc700 1 -- 172.21.15.81:0/1828700565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f05c0028790 con 0x1e87c10 2023-11-29T11:20:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 10 client.8379 fetch_fsmap finished waiting for FSMap version 59 2023-11-29T11:20:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 10 client.8379 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 20 client.8379 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x21239e0 0x21224b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 4 client.8379 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:20:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1828700565 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2058e00 con 0x21239e0 2023-11-29T11:20:07.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x21239e0 0x21224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x21239e0 0x21224b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e4c57fc9319afee server_cookie=afcfb5b39c0821ea in_seq=0 out_seq=0 2023-11-29T11:20:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05b67fc700 10 client.8379 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05b67fc700 1 -- 172.21.15.81:0/1828700565 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2058e00 con 0x21239e0 2023-11-29T11:20:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05b67fc700 10 client.8379 handle_command_reply: tid=0 2023-11-29T11:20:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 client.8379 shutdown 2023-11-29T11:20:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1828700565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87c10 msgr2=0x213ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87c10 0x213ee00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f05c0000c00 tx=0x7f05c00047e0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1828700565 shutdown_connections 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x213f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87c10 0x213ee00 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x21239e0 0x21224b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/1828700565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 0x21256f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05b67fc700 0 client.8379 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1828700565 >> 172.21.15.81:0/1828700565 conn(0x1e87fe0 msgr2=0x2120e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1828700565 shutdown_connections 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 1 -- 172.21.15.81:0/1828700565 wait complete. 2023-11-29T11:20:07.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.332+0000 7f05d0ab3740 20 client.8379 trim_cache size 0 max 16384 2023-11-29T11:20:07.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.352+0000 7f05d0ab3740 1 Processor -- start 2023-11-29T11:20:07.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.352+0000 7f05d0ab3740 1 -- start start 2023-11-29T11:20:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x211d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87c10 0x211d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x211da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2025440 con 0x1e87840 2023-11-29T11:20:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fff510 con 0x1ed28c0 2023-11-29T11:20:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x205b9d0 con 0x1e87c10 2023-11-29T11:20:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x211d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x211d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36946/0 (socket says 172.21.15.81:36946) 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 -- 172.21.15.81:0/699708261 learned_addr learned my addr 172.21.15.81:0/699708261 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c67fc700 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87c10 0x211d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c77fe700 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x211da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 -- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87c10 msgr2=0x211d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87c10 0x211d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 -- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 msgr2=0x211da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x211da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 -- 172.21.15.81:0/699708261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c806ad70 con 0x1e87840 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c67fc700 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87c10 0x211d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x211d000 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f05b0013000 tx=0x7f05b0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc38c949176dec12 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05bdffb700 1 -- 172.21.15.81:0/699708261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b002c040 con 0x1e87840 2023-11-29T11:20:07.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05bdffb700 1 -- 172.21.15.81:0/699708261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b002d040 con 0x1e87840 2023-11-29T11:20:07.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05bdffb700 1 -- 172.21.15.81:0/699708261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0036050 con 0x1e87840 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- 172.21.15.81:0/699708261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 msgr2=0x211d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x211d000 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f05b0013000 tx=0x7f05b0012000 comp rx=0 tx=0).stop 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- 172.21.15.81:0/699708261 shutdown_connections 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ed28c0 0x211da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87c10 0x211d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/699708261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e87840 0x211d000 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- 172.21.15.81:0/699708261 >> 172.21.15.81:0/699708261 conn(0x1e87fe0 msgr2=0x21422c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- 172.21.15.81:0/699708261 shutdown_connections 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- 172.21.15.81:0/699708261 wait complete. 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 -- start start 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.356+0000 7f05d0ab3740 1 Processor -- start 2023-11-29T11:20:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 0x219ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed28c0 0x20f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x205d460 con 0x1ed28c0 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ff6200 con 0x1e87c10 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x215a0a0 con 0x1e87840 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 10 client.0 _ll_register_callbacks cb 0x7f05c00096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed28c0 0x20f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed28c0 0x20f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36962/0 (socket says 172.21.15.81:36962) 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 -- 172.21.15.81:0/3314870544 learned_addr learned my addr 172.21.15.81:0/3314870544 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c67fc700 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 0x219ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 -- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 msgr2=0x219ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 0x219ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 -- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 msgr2=0x20f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 -- 172.21.15.81:0/3314870544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b0022070 con 0x1ed28c0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c67fc700 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05b67fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c77fe700 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed28c0 0x20f43c0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f05b805a8e0 tx=0x7f05b8052600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441acb1065a92f14 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05b67fc700 1 -- 172.21.15.81:0/3314870544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8051d90 con 0x1ed28c0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05b67fc700 1 -- 172.21.15.81:0/3314870544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f05b8051ef0 con 0x1ed28c0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 -- 172.21.15.81:0/3314870544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05c0004390 con 0x1ed28c0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05b67fc700 1 -- 172.21.15.81:0/3314870544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05b80520b0 con 0x1ed28c0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 10 client.8385 fetch_fsmap learned FSMap version 59 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 -- 172.21.15.81:0/3314870544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x200caf0 con 0x1ed28c0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05b67fc700 1 -- 172.21.15.81:0/3314870544 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0004390 con 0x1ed28c0 2023-11-29T11:20:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05b67fc700 1 -- 172.21.15.81:0/3314870544 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f05b807f0c0 con 0x1ed28c0 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 10 client.8385 fetch_fsmap finished waiting for FSMap version 59 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 10 client.8385 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 20 client.8385 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x2158680 0x2158c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 4 client.8385 mds_command: new command op to 8010 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05d0ab3740 1 -- 172.21.15.81:0/3314870544 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1f04390 con 0x2158680 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.360+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x2158680 0x2158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c6ffd700 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x2158680 0x2158c70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0d50e29a3d81712 server_cookie=102ce334a53ddceb in_seq=0 out_seq=0 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05b67fc700 10 client.8385 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05b67fc700 1 -- 172.21.15.81:0/3314870544 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+256 (crc 0 0 0) 0x1f04390 con 0x2158680 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05b67fc700 10 client.8385 handle_command_reply: tid=0 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 client.8385 shutdown 2023-11-29T11:20:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 -- 172.21.15.81:0/3314870544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed28c0 msgr2=0x20f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed28c0 0x20f43c0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f05b805a8e0 tx=0x7f05b8052600 comp rx=0 tx=0).stop 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 -- 172.21.15.81:0/3314870544 shutdown_connections 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed28c0 0x20f43c0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1e87c10 0x20f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x2158680 0x2158c70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05b67fc700 0 client.8385 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 --2- 172.21.15.81:0/3314870544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1e87840 0x219ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 -- 172.21.15.81:0/3314870544 >> 172.21.15.81:0/3314870544 conn(0x1e87fe0 msgr2=0x211d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 -- 172.21.15.81:0/3314870544 shutdown_connections 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 1 -- 172.21.15.81:0/3314870544 wait complete. 2023-11-29T11:20:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05d0ab3740 20 client.8385 trim_cache size 0 max 16384 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout: "18d7ea11-d027-42cf-a581-34f115f9220c": { 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/dir", 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "18d7ea11-d027-42cf-a581-34f115f9220c", 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive" 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:20:07.376 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:20:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 -- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05ac064ee0 msgr2=0x7f05ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05ac064ee0 0x7f05ac067390 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f05b0014040 tx=0x7f05b0011000 comp rx=0 tx=0).stop 2023-11-29T11:20:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 -- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 msgr2=0x7f05c806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c806a4d0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c420 tx=0x7f05b800c730 comp rx=0 tx=0).stop 2023-11-29T11:20:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 -- 172.21.15.81:0/4031225173 shutdown_connections 2023-11-29T11:20:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f05ac064ee0 0x7f05ac067390 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c815cda0 0x7f05c806a4d0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05c8159f70 0x7f05c814c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 --2- 172.21.15.81:0/4031225173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05c80cc070 0x7f05c814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:07.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 -- 172.21.15.81:0/4031225173 >> 172.21.15.81:0/4031225173 conn(0x7f05c80b26e0 msgr2=0x7f05c81587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:07.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 -- 172.21.15.81:0/4031225173 shutdown_connections 2023-11-29T11:20:07.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:07.364+0000 7f05c7fff700 1 -- 172.21.15.81:0/4031225173 wait complete. 2023-11-29T11:20:07.389 INFO:tasks.cephfs.filesystem:scrub status for tag:18d7ea11-d027-42cf-a581-34f115f9220c - {'path': '/dir', 'tag': '18d7ea11-d027-42cf-a581-34f115f9220c', 'options': 'recursive'} 2023-11-29T11:20:14.128 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:20:14.120+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-29T11:20:26.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:20:26.762 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:20:37.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-11-29T11:20:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b48870700 1 Processor -- start 2023-11-29T11:20:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b48870700 1 -- start start 2023-11-29T11:20:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b48870700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b3c0e05f0 0x7f9b3c0530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b48870700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c037000 0x7f9b3c037400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b48870700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c037940 con 0x7f9b3c0e09c0 2023-11-29T11:20:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b48870700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c04fb40 con 0x7f9b3c0e05f0 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b48870700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0536a0 con 0x7f9b3c037000 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b437fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b3c0e05f0 0x7f9b3c0530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b437fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b3c0e05f0 0x7f9b3c0530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48918/0 (socket says 172.21.15.81:48918) 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b437fe700 1 -- 172.21.15.81:0/2459399659 learned_addr learned my addr 172.21.15.81:0/2459399659 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b43fff700 1 --2- 172.21.15.81:0/2459399659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c037000 0x7f9b3c037400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b437fe700 1 -- 172.21.15.81:0/2459399659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c037000 msgr2=0x7f9b3c037400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b437fe700 1 --2- 172.21.15.81:0/2459399659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c037000 0x7f9b3c037400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b437fe700 1 -- 172.21.15.81:0/2459399659 >> v1:172.21.15.176:6789/0 conn(0x7f9b3c0e09c0 legacy=0x7f9b3c054dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b437fe700 1 -- 172.21.15.81:0/2459399659 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c053980 con 0x7f9b3c0e05f0 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b437fe700 1 --2- 172.21.15.81:0/2459399659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0e05f0 0x7f9b3c0530c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009910 tx=0x7f9b38009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6898f99087fd5d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b427fc700 1 -- 172.21.15.81:0/2459399659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3800ba60 con 0x7f9b3c0e05f0 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b427fc700 1 -- 172.21.15.81:0/2459399659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3800bbc0 con 0x7f9b3c0e05f0 2023-11-29T11:20:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.512+0000 7f9b427fc700 1 -- 172.21.15.81:0/2459399659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38009e60 con 0x7f9b3c0e05f0 2023-11-29T11:20:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 -- 172.21.15.81:0/2459399659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0e05f0 msgr2=0x7f9b3c0530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 --2- 172.21.15.81:0/2459399659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0e05f0 0x7f9b3c0530c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009910 tx=0x7f9b38009c20 comp rx=0 tx=0).stop 2023-11-29T11:20:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 -- 172.21.15.81:0/2459399659 shutdown_connections 2023-11-29T11:20:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 --2- 172.21.15.81:0/2459399659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c037000 0x7f9b3c037400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 --2- 172.21.15.81:0/2459399659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c0e05f0 0x7f9b3c0530c0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 -- 172.21.15.81:0/2459399659 >> 172.21.15.81:0/2459399659 conn(0x7f9b3c052000 msgr2=0x7f9b3c052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 -- 172.21.15.81:0/2459399659 shutdown_connections 2023-11-29T11:20:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 -- 172.21.15.81:0/2459399659 wait complete. 2023-11-29T11:20:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 Processor -- start 2023-11-29T11:20:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.516+0000 7f9b48870700 1 -- start start 2023-11-29T11:20:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b48870700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c037000 0x7f9b3c0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b48870700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0e05f0 0x7f9b3c0d9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b48870700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0e09c0 0x7f9b3c0da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b48870700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0d8690 con 0x7f9b3c037000 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b48870700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0da700 con 0x7f9b3c0e05f0 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b48870700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0d88e0 con 0x7f9b3c0e09c0 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c037000 0x7f9b3c0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c037000 0x7f9b3c0d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48934/0 (socket says 172.21.15.81:48934) 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 -- 172.21.15.81:0/454016530 learned_addr learned my addr 172.21.15.81:0/454016530 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b43fff700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0e09c0 0x7f9b3c0da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0e05f0 0x7f9b3c0d9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 -- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0e09c0 msgr2=0x7f9b3c0da0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0e09c0 0x7f9b3c0da0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 -- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0e05f0 msgr2=0x7f9b3c0d9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0e05f0 0x7f9b3c0d9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 -- 172.21.15.81:0/454016530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b38009570 con 0x7f9b3c037000 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b43fff700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0e09c0 0x7f9b3c0da0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b437fe700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c037000 0x7f9b3c0d0b60 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9b38000c00 tx=0x7f9b38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b2ffff700 1 -- 172.21.15.81:0/454016530 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38004550 con 0x7f9b3c037000 2023-11-29T11:20:37.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b2ffff700 1 -- 172.21.15.81:0/454016530 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3801f070 con 0x7f9b3c037000 2023-11-29T11:20:37.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b48870700 1 -- 172.21.15.81:0/454016530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c053f40 con 0x7f9b3c037000 2023-11-29T11:20:37.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b2ffff700 1 -- 172.21.15.81:0/454016530 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38003900 con 0x7f9b3c037000 2023-11-29T11:20:37.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.520+0000 7f9b48870700 1 -- 172.21.15.81:0/454016530 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c053c60 con 0x7f9b3c037000 2023-11-29T11:20:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b2ffff700 1 -- 172.21.15.81:0/454016530 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9b3800f050 con 0x7f9b3c037000 2023-11-29T11:20:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b2ffff700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064f10 0x7f9b280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b2ffff700 1 -- 172.21.15.81:0/454016530 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f9b38021070 con 0x7f9b3c037000 2023-11-29T11:20:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064f10 0x7f9b280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064f10 0x7f9b280673c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c179120 tx=0x7f9b30009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b4cd52740 1 Processor -- start 2023-11-29T11:20:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b4cd52740 1 -- start start 2023-11-29T11:20:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1ec7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1ec8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 0x1ec46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d7fd20 con 0x1c10c10 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1defd60 con 0x1c10840 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1de9060 con 0x1c5b8c0 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.524+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1ec7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1ec7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48948/0 (socket says 172.21.15.81:48948) 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b437fe700 1 -- 172.21.15.81:0/2965559718 learned_addr learned my addr 172.21.15.81:0/2965559718 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1ec8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b43fff700 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 0x1ec46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b437fe700 1 -- 172.21.15.81:0/2965559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 msgr2=0x1ec46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b437fe700 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 0x1ec46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b437fe700 1 -- 172.21.15.81:0/2965559718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 msgr2=0x1ec8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b437fe700 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1ec8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b437fe700 1 -- 172.21.15.81:0/2965559718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e0f0a0 con 0x1c10c10 2023-11-29T11:20:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b437fe700 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1ec7e00 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9b38055020 tx=0x7f9b38054d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f87f86971917ce server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b2d7fa700 1 -- 172.21.15.81:0/2965559718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3805d3b0 con 0x1c10c10 2023-11-29T11:20:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b2d7fa700 1 -- 172.21.15.81:0/2965559718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3805cf20 con 0x1c10c10 2023-11-29T11:20:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b2d7fa700 1 -- 172.21.15.81:0/2965559718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38051110 con 0x1c10c10 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 -- 172.21.15.81:0/2965559718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 msgr2=0x1ec7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1ec7e00 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9b38055020 tx=0x7f9b38054d50 comp rx=0 tx=0).stop 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 -- 172.21.15.81:0/2965559718 shutdown_connections 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 0x1ec46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1ec8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/2965559718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1ec7e00 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 -- 172.21.15.81:0/2965559718 >> 172.21.15.81:0/2965559718 conn(0x1c10fe0 msgr2=0x1ea9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 -- 172.21.15.81:0/2965559718 shutdown_connections 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 -- 172.21.15.81:0/2965559718 wait complete. 2023-11-29T11:20:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 -- start start 2023-11-29T11:20:37.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.528+0000 7f9b4cd52740 1 Processor -- start 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1e9fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 0x1ea7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5b8c0 0x1ed0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c95c50 con 0x1c5b8c0 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e87460 con 0x1c10840 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ea0310 con 0x1c10c10 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 10 client.0 _ll_register_callbacks cb 0x1de29a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5b8c0 0x1ed0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5b8c0 0x1ed0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48952/0 (socket says 172.21.15.81:48952) 2023-11-29T11:20:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 -- 172.21.15.81:0/4024216951 learned_addr learned my addr 172.21.15.81:0/4024216951 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 0x1ea7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b437fe700 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1e9fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 -- 172.21.15.81:0/4024216951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 msgr2=0x1ea7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 0x1ea7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 -- 172.21.15.81:0/4024216951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 msgr2=0x1e9fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1e9fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 -- 172.21.15.81:0/4024216951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c053c60 con 0x1c5b8c0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b43fff700 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5b8c0 0x1ed0fe0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f9b44066910 tx=0x7f9b44073710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917d554d30e32e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b227fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b227fc700 1 -- 172.21.15.81:0/4024216951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4408f040 con 0x1c5b8c0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b227fc700 1 -- 172.21.15.81:0/4024216951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f9b440009b0 con 0x1c5b8c0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 -- 172.21.15.81:0/4024216951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1de20e0 con 0x1c5b8c0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b227fc700 1 -- 172.21.15.81:0/4024216951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b44072be0 con 0x1c5b8c0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 10 client.8397 fetch_fsmap learned FSMap version 60 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 -- 172.21.15.81:0/4024216951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x1c5cb10 con 0x1c5b8c0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b227fc700 1 -- 172.21.15.81:0/4024216951 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1de20e0 con 0x1c5b8c0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b227fc700 1 -- 172.21.15.81:0/4024216951 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9b44066b20 con 0x1c5b8c0 2023-11-29T11:20:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 10 client.8397 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:20:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 10 client.8397 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 20 client.8397 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1ed1a10 0x1e894b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 4 client.8397 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:20:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b4cd52740 1 -- 172.21.15.81:0/4024216951 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1de1e00 con 0x1ed1a10 2023-11-29T11:20:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b437fe700 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1ed1a10 0x1e894b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b227fc700 10 client.8397 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.532+0000 7f9b437fe700 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1ed1a10 0x1e894b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd41a7166d7e3309 server_cookie=b5d01454088fa3f7 in_seq=0 out_seq=0 2023-11-29T11:20:37.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b227fc700 1 -- 172.21.15.81:0/4024216951 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1de1e00 con 0x1ed1a10 2023-11-29T11:20:37.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b227fc700 10 client.8397 handle_command_reply: tid=0 2023-11-29T11:20:37.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 client.8397 shutdown 2023-11-29T11:20:37.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 -- 172.21.15.81:0/4024216951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5b8c0 msgr2=0x1ed0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5b8c0 0x1ed0fe0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f9b44066910 tx=0x7f9b44073710 comp rx=0 tx=0).stop 2023-11-29T11:20:37.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 -- 172.21.15.81:0/4024216951 shutdown_connections 2023-11-29T11:20:37.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5b8c0 0x1ed0fe0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1ed1a10 0x1e894b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 0x1ea7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/4024216951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1e9fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 -- 172.21.15.81:0/4024216951 >> 172.21.15.81:0/4024216951 conn(0x1c10fe0 msgr2=0x1ea0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b227fc700 0 client.8397 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 -- 172.21.15.81:0/4024216951 shutdown_connections 2023-11-29T11:20:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 1 -- 172.21.15.81:0/4024216951 wait complete. 2023-11-29T11:20:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.536+0000 7f9b4cd52740 20 client.8397 trim_cache size 0 max 16384 2023-11-29T11:20:37.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.552+0000 7f9b4cd52740 1 Processor -- start 2023-11-29T11:20:37.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.552+0000 7f9b4cd52740 1 -- start start 2023-11-29T11:20:37.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.552+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1ea6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.552+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1e85f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.552+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 0x1e86440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.552+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dae440 con 0x1c10c10 2023-11-29T11:20:37.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.552+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1de49d0 con 0x1c10840 2023-11-29T11:20:37.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.552+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1dbef70 con 0x1c5b8c0 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1e85f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1e85f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48956/0 (socket says 172.21.15.81:48956) 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 -- 172.21.15.81:0/3384978145 learned_addr learned my addr 172.21.15.81:0/3384978145 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b43fff700 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 0x1e86440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b437fe700 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1ea6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 -- 172.21.15.81:0/3384978145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 msgr2=0x1e86440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 0x1e86440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 -- 172.21.15.81:0/3384978145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 msgr2=0x1ea6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1ea6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 -- 172.21.15.81:0/3384978145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0d9160 con 0x1c10c10 2023-11-29T11:20:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1e85f00 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0e5240 tx=0x7f9b30017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78f3ece7c8f3061 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b2dffb700 1 -- 172.21.15.81:0/3384978145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30003d60 con 0x1c10c10 2023-11-29T11:20:37.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b2dffb700 1 -- 172.21.15.81:0/3384978145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3001b050 con 0x1c10c10 2023-11-29T11:20:37.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b2dffb700 1 -- 172.21.15.81:0/3384978145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30013620 con 0x1c10c10 2023-11-29T11:20:37.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 -- 172.21.15.81:0/3384978145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 msgr2=0x1e85f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1e85f00 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0e5240 tx=0x7f9b30017040 comp rx=0 tx=0).stop 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 -- 172.21.15.81:0/3384978145 shutdown_connections 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c5b8c0 0x1e86440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10c10 0x1e85f00 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/3384978145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c10840 0x1ea6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 -- 172.21.15.81:0/3384978145 >> 172.21.15.81:0/3384978145 conn(0x1c10fe0 msgr2=0x1e9ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 -- 172.21.15.81:0/3384978145 shutdown_connections 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 -- 172.21.15.81:0/3384978145 wait complete. 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 -- start start 2023-11-29T11:20:37.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 Processor -- start 2023-11-29T11:20:37.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10840 0x1f2c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.556+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 0x1ea2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c5b8c0 0x1ea2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d92f10 con 0x1c10840 2023-11-29T11:20:37.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e83560 con 0x1c5b8c0 2023-11-29T11:20:37.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e832c0 con 0x1c10c10 2023-11-29T11:20:37.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 10 client.0 _ll_register_callbacks cb 0x7f9b38051660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10840 0x1f2c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10840 0x1f2c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48962/0 (socket says 172.21.15.81:48962) 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 -- 172.21.15.81:0/44475704 learned_addr learned my addr 172.21.15.81:0/44475704 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 0x1ea2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b43fff700 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c5b8c0 0x1ea2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 -- 172.21.15.81:0/44475704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 msgr2=0x1ea2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 0x1ea2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 -- 172.21.15.81:0/44475704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c5b8c0 msgr2=0x1ea2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c5b8c0 0x1ea2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 -- 172.21.15.81:0/44475704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3000f040 con 0x1c10840 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b227fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b437fe700 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10840 0x1f2c7f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f9b3800bb90 tx=0x7f9b38083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c7ea4556ac5832 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b227fc700 1 -- 172.21.15.81:0/44475704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38072070 con 0x1c10840 2023-11-29T11:20:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b227fc700 1 -- 172.21.15.81:0/44475704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f9b3805d3b0 con 0x1c10840 2023-11-29T11:20:37.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 1 -- 172.21.15.81:0/44475704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b3805cf20 con 0x1c10840 2023-11-29T11:20:37.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b227fc700 1 -- 172.21.15.81:0/44475704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b38062040 con 0x1c10840 2023-11-29T11:20:37.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 10 client.8403 fetch_fsmap learned FSMap version 60 2023-11-29T11:20:37.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 1 -- 172.21.15.81:0/44475704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x1daf970 con 0x1c10840 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b227fc700 1 -- 172.21.15.81:0/44475704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3805cf20 con 0x1c10840 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b227fc700 1 -- 172.21.15.81:0/44475704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9b38051110 con 0x1c10840 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 10 client.8403 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 10 client.8403 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 20 client.8403 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1ea1960 0x1ea3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 4 client.8403 mds_command: new command op to 8010 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b4cd52740 1 -- 172.21.15.81:0/44475704 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1c8d390 con 0x1ea1960 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1ea1960 0x1ea3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b227fc700 10 client.8403 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b42ffd700 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1ea1960 0x1ea3730 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa1035c3f435924a server_cookie=ff5552d4781086f8 in_seq=0 out_seq=0 2023-11-29T11:20:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.560+0000 7f9b227fc700 1 -- 172.21.15.81:0/44475704 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1c8d390 con 0x1ea1960 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b227fc700 10 client.8403 handle_command_reply: tid=0 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 client.8403 shutdown 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 -- 172.21.15.81:0/44475704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10840 msgr2=0x1f2c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10840 0x1f2c7f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f9b3800bb90 tx=0x7f9b38083000 comp rx=0 tx=0).stop 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 -- 172.21.15.81:0/44475704 shutdown_connections 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1c5b8c0 0x1ea2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1ea1960 0x1ea3730 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1c10c10 0x1ea2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 --2- 172.21.15.81:0/44475704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c10840 0x1f2c7f0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b227fc700 0 client.8403 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 -- 172.21.15.81:0/44475704 >> 172.21.15.81:0/44475704 conn(0x1c10fe0 msgr2=0x1ea0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 -- 172.21.15.81:0/44475704 shutdown_connections 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 1 -- 172.21.15.81:0/44475704 wait complete. 2023-11-29T11:20:37.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b4cd52740 20 client.8403 trim_cache size 0 max 16384 2023-11-29T11:20:37.574 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:20:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:20:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:20:37.574 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 -- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064f10 msgr2=0x7f9b280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064f10 0x7f9b280673c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c179120 tx=0x7f9b30009040 comp rx=0 tx=0).stop 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 -- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c037000 msgr2=0x7f9b3c0d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c037000 0x7f9b3c0d0b60 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9b38000c00 tx=0x7f9b38004770 comp rx=0 tx=0).stop 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 -- 172.21.15.81:0/454016530 shutdown_connections 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b28064f10 0x7f9b280673c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b3c0e09c0 0x7f9b3c0da0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b3c0e05f0 0x7f9b3c0d9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 --2- 172.21.15.81:0/454016530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3c037000 0x7f9b3c0d0b60 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 -- 172.21.15.81:0/454016530 >> 172.21.15.81:0/454016530 conn(0x7f9b3c052000 msgr2=0x7f9b3c0341c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 -- 172.21.15.81:0/454016530 shutdown_connections 2023-11-29T11:20:37.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.564+0000 7f9b48870700 1 -- 172.21.15.81:0/454016530 wait complete. 2023-11-29T11:20:37.587 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:20:37.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:20:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a34f1700 1 Processor -- start 2023-11-29T11:20:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a34f1700 1 -- start start 2023-11-29T11:20:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a34f1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd49c0cfd80 0x7fd49c0cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a34f1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c0ce3a0 con 0x7fd49c0b09a0 2023-11-29T11:20:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a34f1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49c0ce640 con 0x7fd49c0cd000 2023-11-29T11:20:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a34f1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49c0b0e10 con 0x7fd49c0cfd80 2023-11-29T11:20:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a1cee700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd49c0b09a0 0x7fd49c0b3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44010/0 (socket says 172.21.15.81:44010) 2023-11-29T11:20:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a1cee700 1 -- 172.21.15.81:0/4040427422 learned_addr learned my addr 172.21.15.81:0/4040427422 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:20:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a2cf0700 1 --2- 172.21.15.81:0/4040427422 >> v2:172.21.15.176:3300/0 conn(0x7fd49c0cfd80 0x7fd49c0cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a14ed700 1 -- 172.21.15.81:0/4040427422 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668289155 0 0) 0x7fd49c0ce3a0 con 0x7fd49c0b09a0 2023-11-29T11:20:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a14ed700 1 -- 172.21.15.81:0/4040427422 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4840035d0 con 0x7fd49c0b09a0 2023-11-29T11:20:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a2cf0700 1 -- 172.21.15.81:0/4040427422 >> v1:172.21.15.176:6789/0 conn(0x7fd49c0cd000 legacy=0x7fd49c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a14ed700 1 -- 172.21.15.81:0/4040427422 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837826187 0 0) 0x7fd4840035d0 con 0x7fd49c0b09a0 2023-11-29T11:20:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a2cf0700 1 -- 172.21.15.81:0/4040427422 >> v1:172.21.15.81:6789/0 conn(0x7fd49c0b09a0 legacy=0x7fd49c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a2cf0700 1 -- 172.21.15.81:0/4040427422 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c0ce920 con 0x7fd49c0cfd80 2023-11-29T11:20:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a2cf0700 1 --2- 172.21.15.81:0/4040427422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0cfd80 0x7fd49c0cf120 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd494009850 tx=0x7fd494009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cfda46b4c753b06 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a14ed700 1 -- 172.21.15.81:0/4040427422 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494011830 con 0x7fd49c0cfd80 2023-11-29T11:20:37.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a14ed700 1 -- 172.21.15.81:0/4040427422 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494011990 con 0x7fd49c0cfd80 2023-11-29T11:20:37.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.700+0000 7fd4a14ed700 1 -- 172.21.15.81:0/4040427422 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494011d00 con 0x7fd49c0cfd80 2023-11-29T11:20:37.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- 172.21.15.81:0/4040427422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0cfd80 msgr2=0x7fd49c0cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 --2- 172.21.15.81:0/4040427422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0cfd80 0x7fd49c0cf120 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd494009850 tx=0x7fd494009b60 comp rx=0 tx=0).stop 2023-11-29T11:20:37.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- 172.21.15.81:0/4040427422 shutdown_connections 2023-11-29T11:20:37.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 --2- 172.21.15.81:0/4040427422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0cfd80 0x7fd49c0cf120 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- 172.21.15.81:0/4040427422 >> 172.21.15.81:0/4040427422 conn(0x7fd49c0b2140 msgr2=0x7fd49c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:37.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- 172.21.15.81:0/4040427422 shutdown_connections 2023-11-29T11:20:37.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- 172.21.15.81:0/4040427422 wait complete. 2023-11-29T11:20:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 Processor -- start 2023-11-29T11:20:37.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- start start 2023-11-29T11:20:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0b09a0 0x7fd49c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd49c0cd000 0x7fd49c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd49c0cfd80 0x7fd49c0afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c0c9370 con 0x7fd49c0cd000 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c0c9650 con 0x7fd49c0b09a0 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a34f1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c0c9930 con 0x7fd49c0cfd80 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a1cee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd49c0cd000 0x7fd49c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a1cee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd49c0cd000 0x7fd49c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48974/0 (socket says 172.21.15.81:48974) 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a1cee700 1 -- 172.21.15.81:0/3590329917 learned_addr learned my addr 172.21.15.81:0/3590329917 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a24ef700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0b09a0 0x7fd49c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.704+0000 7fd4a2cf0700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd49c0cfd80 0x7fd49c0afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a1cee700 1 -- 172.21.15.81:0/3590329917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd49c0cfd80 msgr2=0x7fd49c0afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a1cee700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd49c0cfd80 0x7fd49c0afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a1cee700 1 -- 172.21.15.81:0/3590329917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0b09a0 msgr2=0x7fd49c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a1cee700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0b09a0 0x7fd49c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a1cee700 1 -- 172.21.15.81:0/3590329917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940094b0 con 0x7fd49c0cd000 2023-11-29T11:20:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a1cee700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd49c0cd000 0x7fd49c06c9d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00cc00 tx=0x7fd48c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd49affd700 1 -- 172.21.15.81:0/3590329917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00a6c0 con 0x7fd49c0cd000 2023-11-29T11:20:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd49affd700 1 -- 172.21.15.81:0/3590329917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00a820 con 0x7fd49c0cd000 2023-11-29T11:20:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c0d01a0 con 0x7fd49c0cd000 2023-11-29T11:20:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd49affd700 1 -- 172.21.15.81:0/3590329917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00abb0 con 0x7fd49c0cd000 2023-11-29T11:20:37.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c0cec00 con 0x7fd49c0cd000 2023-11-29T11:20:37.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49c15d6a0 con 0x7fd49c0cd000 2023-11-29T11:20:37.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.708+0000 7fd49affd700 1 -- 172.21.15.81:0/3590329917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd48c019030 con 0x7fd49c0cd000 2023-11-29T11:20:37.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.712+0000 7fd49affd700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd488064ee0 0x7fd488067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:37.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.712+0000 7fd4a24ef700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd488064ee0 0x7fd488067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:37.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.712+0000 7fd49affd700 1 -- 172.21.15.81:0/3590329917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fd48c0819c0 con 0x7fd49c0cd000 2023-11-29T11:20:37.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.712+0000 7fd4a24ef700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd488064ee0 0x7fd488067390 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd490000f60 tx=0x7fd490009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.716+0000 7fd49affd700 1 -- 172.21.15.81:0/3590329917 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd48c04f9c0 con 0x7fd49c0cd000 2023-11-29T11:20:37.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.912+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd49c072500 con 0x7fd49c0cd000 2023-11-29T11:20:37.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.912+0000 7fd49affd700 1 -- 172.21.15.81:0/3590329917 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fd48c017090 con 0x7fd49c0cd000 2023-11-29T11:20:37.922 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:20:37.922 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:20:14.125061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:20:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd488064ee0 msgr2=0x7fd488067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd488064ee0 0x7fd488067390 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd490000f60 tx=0x7fd490009040 comp rx=0 tx=0).stop 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd49c0cd000 msgr2=0x7fd49c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd49c0cd000 0x7fd49c06c9d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00cc00 tx=0x7fd48c00cf10 comp rx=0 tx=0).stop 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 shutdown_connections 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd488064ee0 0x7fd488067390 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd49c0cfd80 0x7fd49c0afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd49c0cd000 0x7fd49c06c9d0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 --2- 172.21.15.81:0/3590329917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49c0b09a0 0x7fd49c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 >> 172.21.15.81:0/3590329917 conn(0x7fd49c0b2140 msgr2=0x7fd49c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 shutdown_connections 2023-11-29T11:20:37.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:37.916+0000 7fd4a34f1700 1 -- 172.21.15.81:0/3590329917 wait complete. 2023-11-29T11:20:37.926 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2023-11-29T11:20:37.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-11-29T11:20:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.040+0000 7fbe22ee2700 1 Processor -- start 2023-11-29T11:20:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.040+0000 7fbe22ee2700 1 -- start start 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.040+0000 7fbe22ee2700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbe1c06a4c0 0x7fbe1c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.040+0000 7fbe22ee2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe1c0cf0e0 0x7fbe1c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.040+0000 7fbe22ee2700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c0cfa40 con 0x7fbe1c0b1ae0 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.040+0000 7fbe22ee2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c0d0ab0 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.040+0000 7fbe22ee2700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c06a9c0 con 0x7fbe1c06a4c0 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe226e1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe1c0cf0e0 0x7fbe1c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe226e1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe1c0cf0e0 0x7fbe1c0cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48982/0 (socket says 172.21.15.81:48982) 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe226e1700 1 -- 172.21.15.81:0/1270093335 learned_addr learned my addr 172.21.15.81:0/1270093335 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe216df700 1 --2- 172.21.15.81:0/1270093335 >> v2:172.21.15.176:3300/0 conn(0x7fbe1c06a4c0 0x7fbe1c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe226e1700 1 -- 172.21.15.81:0/1270093335 >> v2:172.21.15.176:3300/0 conn(0x7fbe1c06a4c0 msgr2=0x7fbe1c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe226e1700 1 --2- 172.21.15.81:0/1270093335 >> v2:172.21.15.176:3300/0 conn(0x7fbe1c06a4c0 0x7fbe1c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe226e1700 1 -- 172.21.15.81:0/1270093335 >> v1:172.21.15.81:6789/0 conn(0x7fbe1c0b1ae0 legacy=0x7fbe1c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe226e1700 1 -- 172.21.15.81:0/1270093335 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c06aca0 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe226e1700 1 --2- 172.21.15.81:0/1270093335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0cf500 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0b88d0 tx=0x7fbe1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8601a8fd97bbc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe20ede700 1 -- 172.21.15.81:0/1270093335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400e070 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe20ede700 1 -- 172.21.15.81:0/1270093335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1400b9c0 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe20ede700 1 -- 172.21.15.81:0/1270093335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400bd70 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe22ee2700 1 -- 172.21.15.81:0/1270093335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 msgr2=0x7fbe1c0cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/1270093335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0cf500 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0b88d0 tx=0x7fbe1400b330 comp rx=0 tx=0).stop 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe22ee2700 1 -- 172.21.15.81:0/1270093335 shutdown_connections 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/1270093335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0cf500 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/1270093335 >> v2:172.21.15.176:3300/0 conn(0x7fbe1c06a4c0 0x7fbe1c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe22ee2700 1 -- 172.21.15.81:0/1270093335 >> 172.21.15.81:0/1270093335 conn(0x7fbe1c09bbd0 msgr2=0x7fbe1c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe22ee2700 1 -- 172.21.15.81:0/1270093335 shutdown_connections 2023-11-29T11:20:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.044+0000 7fbe22ee2700 1 -- 172.21.15.81:0/1270093335 wait complete. 2023-11-29T11:20:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 Processor -- start 2023-11-29T11:20:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 -- start start 2023-11-29T11:20:38.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe1c06a4c0 0x7fbe1c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe1c0b1ae0 0x7fbe1c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c1f2310 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c0c8730 con 0x7fbe1c0b1ae0 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c1594c0 con 0x7fbe1c06a4c0 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48990/0 (socket says 172.21.15.81:48990) 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 -- 172.21.15.81:0/3184974157 learned_addr learned my addr 172.21.15.81:0/3184974157 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe1c06a4c0 0x7fbe1c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe216df700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe1c0b1ae0 0x7fbe1c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 -- 172.21.15.81:0/3184974157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe1c06a4c0 msgr2=0x7fbe1c158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe1c06a4c0 0x7fbe1c158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 -- 172.21.15.81:0/3184974157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe1c0b1ae0 msgr2=0x7fbe1c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe1c0b1ae0 0x7fbe1c0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 -- 172.21.15.81:0/3184974157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe14009b30 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe226e1700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0b0410 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c066b70 tx=0x7fbe14004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe127fc700 1 -- 172.21.15.81:0/3184974157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140092e0 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe127fc700 1 -- 172.21.15.81:0/3184974157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1401c440 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 -- 172.21.15.81:0/3184974157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c0b4380 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe127fc700 1 -- 172.21.15.81:0/3184974157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1401c7f0 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.048+0000 7fbe22ee2700 1 -- 172.21.15.81:0/3184974157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c06af80 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe127fc700 1 -- 172.21.15.81:0/3184974157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe14022030 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe127fc700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe00064ee0 0x7fbe00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe127fc700 1 -- 172.21.15.81:0/3184974157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fbe14083990 con 0x7fbe1c0cf0e0 2023-11-29T11:20:38.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe00064ee0 0x7fbe00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe00064ee0 0x7fbe00067390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0d0730 tx=0x7fbe0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe273c4740 1 Processor -- start 2023-11-29T11:20:38.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe273c4740 1 -- start start 2023-11-29T11:20:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x2806420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2808970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x280aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe273c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x26bddc0 con 0x254e950 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe273c4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x272de20 con 0x25999d0 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.052+0000 7fbe273c4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2727120 con 0x254ed20 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2808970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2808970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49002/0 (socket says 172.21.15.81:49002) 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 -- 172.21.15.81:0/34684801 learned_addr learned my addr 172.21.15.81:0/34684801 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe226e1700 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x280aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x2806420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 -- 172.21.15.81:0/34684801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 msgr2=0x2806420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x2806420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 -- 172.21.15.81:0/34684801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 msgr2=0x280aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x280aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 -- 172.21.15.81:0/34684801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x274d9b0 con 0x254e950 2023-11-29T11:20:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe216df700 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2808970 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800b8b0 tx=0x7fbe1800bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc8940aebbd2ccd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbdff7fe700 1 -- 172.21.15.81:0/34684801 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18014660 con 0x254e950 2023-11-29T11:20:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbdff7fe700 1 -- 172.21.15.81:0/34684801 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe180147c0 con 0x254e950 2023-11-29T11:20:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbdff7fe700 1 -- 172.21.15.81:0/34684801 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18014b30 con 0x254e950 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 -- 172.21.15.81:0/34684801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 msgr2=0x2808970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2808970 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800b8b0 tx=0x7fbe1800bbc0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 -- 172.21.15.81:0/34684801 shutdown_connections 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x280aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2808970 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 --2- 172.21.15.81:0/34684801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x2806420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 -- 172.21.15.81:0/34684801 >> 172.21.15.81:0/34684801 conn(0x254f0f0 msgr2=0x27e7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 -- 172.21.15.81:0/34684801 shutdown_connections 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 -- 172.21.15.81:0/34684801 wait complete. 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 -- start start 2023-11-29T11:20:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.056+0000 7fbe273c4740 1 Processor -- start 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2800c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x27befa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x27bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x25d3d60 con 0x254e950 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x27c1a20 con 0x25999d0 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x27c1780 con 0x254ed20 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2800c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 10 client.0 _ll_register_callbacks cb 0x2720a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2800c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49004/0 (socket says 172.21.15.81:49004) 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 -- 172.21.15.81:0/1409610642 learned_addr learned my addr 172.21.15.81:0/1409610642 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe226e1700 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x27bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe216df700 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x27befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 -- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 msgr2=0x27befa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x27befa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 -- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 msgr2=0x27bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x27bf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 -- 172.21.15.81:0/1409610642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1800e040 con 0x254e950 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe216df700 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x27befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2800c00 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c003c50 tx=0x7fbe0c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ddba4b486ddb00 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbdfcff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbdfcff9700 1 -- 172.21.15.81:0/1409610642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0052f0 con 0x254e950 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbdfcff9700 1 -- 172.21.15.81:0/1409610642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fbe0c014ad0 con 0x254e950 2023-11-29T11:20:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 -- 172.21.15.81:0/1409610642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27201a0 con 0x254e950 2023-11-29T11:20:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbdfcff9700 1 -- 172.21.15.81:0/1409610642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe0c014c90 con 0x254e950 2023-11-29T11:20:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 10 client.8424 fetch_fsmap learned FSMap version 60 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 -- 172.21.15.81:0/1409610642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x259ac20 con 0x254e950 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbdfcff9700 1 -- 172.21.15.81:0/1409610642 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27201a0 con 0x254e950 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbdfcff9700 1 -- 172.21.15.81:0/1409610642 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fbe0c020070 con 0x254e950 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 10 client.8424 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 10 client.8424 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 20 client.8424 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x27e7db0 0x280e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 4 client.8424 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe273c4740 1 -- 172.21.15.81:0/1409610642 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x271fec0 con 0x27e7db0 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.060+0000 7fbe216df700 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x27e7db0 0x280e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbdfcff9700 10 client.8424 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe216df700 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x27e7db0 0x280e1e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323dc6b2a2897dee server_cookie=7350696e7b33c3f8 in_seq=0 out_seq=0 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbdfcff9700 1 -- 172.21.15.81:0/1409610642 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x271fec0 con 0x27e7db0 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbdfcff9700 10 client.8424 handle_command_reply: tid=0 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 client.8424 shutdown 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 -- 172.21.15.81:0/1409610642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 msgr2=0x2800c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2800c00 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c003c50 tx=0x7fbe0c001120 comp rx=0 tx=0).stop 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 -- 172.21.15.81:0/1409610642 shutdown_connections 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x27bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x27e7db0 0x280e1e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254ed20 0x27befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1409610642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2800c00 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbdfcff9700 0 client.8424 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 -- 172.21.15.81:0/1409610642 >> 172.21.15.81:0/1409610642 conn(0x254f0f0 msgr2=0x27e70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 -- 172.21.15.81:0/1409610642 shutdown_connections 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 1 -- 172.21.15.81:0/1409610642 wait complete. 2023-11-29T11:20:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.064+0000 7fbe273c4740 20 client.8424 trim_cache size 0 max 16384 2023-11-29T11:20:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 Processor -- start 2023-11-29T11:20:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- start start 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254e950 0x27bda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254ed20 0x27ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x2800260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x27216a0 con 0x254ed20 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x26c66b0 con 0x25999d0 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x27e9580 con 0x254e950 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254ed20 0x27ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254ed20 0x27ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49006/0 (socket says 172.21.15.81:49006) 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 -- 172.21.15.81:0/1588027922 learned_addr learned my addr 172.21.15.81:0/1588027922 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254e950 0x27bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe226e1700 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x2800260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 -- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254e950 msgr2=0x27bda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254e950 0x27bda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 -- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 msgr2=0x2800260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x2800260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 -- 172.21.15.81:0/1588027922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c0b0cb0 con 0x254ed20 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe226e1700 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x2800260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe216df700 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254ed20 0x27ffd20 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800bc00 tx=0x7fbe18009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f45d89c6815f75 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbdfffff700 1 -- 172.21.15.81:0/1588027922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18022040 con 0x254ed20 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbdfffff700 1 -- 172.21.15.81:0/1588027922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe18014b50 con 0x254ed20 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbdfffff700 1 -- 172.21.15.81:0/1588027922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18014460 con 0x254ed20 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- 172.21.15.81:0/1588027922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254ed20 msgr2=0x27ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254ed20 0x27ffd20 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800bc00 tx=0x7fbe18009000 comp rx=0 tx=0).stop 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- 172.21.15.81:0/1588027922 shutdown_connections 2023-11-29T11:20:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25999d0 0x2800260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254ed20 0x27ffd20 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 --2- 172.21.15.81:0/1588027922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x254e950 0x27bda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- 172.21.15.81:0/1588027922 >> 172.21.15.81:0/1588027922 conn(0x254f0f0 msgr2=0x27c02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- 172.21.15.81:0/1588027922 shutdown_connections 2023-11-29T11:20:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.080+0000 7fbe273c4740 1 -- 172.21.15.81:0/1588027922 wait complete. 2023-11-29T11:20:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 1 -- start start 2023-11-29T11:20:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 1 Processor -- start 2023-11-29T11:20:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2819ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x254ed20 0x27e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25999d0 0x28644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x272b120 con 0x254e950 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2819050 con 0x254ed20 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x27e91f0 con 0x25999d0 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2819ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe273c4740 10 client.0 _ll_register_callbacks cb 0x7fbe1800b2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2819ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49016/0 (socket says 172.21.15.81:49016) 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 -- 172.21.15.81:0/2221118026 learned_addr learned my addr 172.21.15.81:0/2221118026 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe216df700 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x254ed20 0x27e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe226e1700 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25999d0 0x28644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 -- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25999d0 msgr2=0x28644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25999d0 0x28644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 -- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x254ed20 msgr2=0x27e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x254ed20 0x27e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 -- 172.21.15.81:0/2221118026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x274d9b0 con 0x254e950 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe226e1700 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25999d0 0x28644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:20:38.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbdfcff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.084+0000 7fbe21ee0700 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2819ff0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c001420 tx=0x7fbe0c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107da5750ffd0563 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 1 -- 172.21.15.81:0/2221118026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c029350 con 0x254e950 2023-11-29T11:20:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 1 -- 172.21.15.81:0/2221118026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fbe0c029750 con 0x254e950 2023-11-29T11:20:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 -- 172.21.15.81:0/2221118026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe180147c0 con 0x254e950 2023-11-29T11:20:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 1 -- 172.21.15.81:0/2221118026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe0c014710 con 0x254e950 2023-11-29T11:20:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 10 client.8430 fetch_fsmap learned FSMap version 60 2023-11-29T11:20:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 -- 172.21.15.81:0/2221118026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x26d3b90 con 0x254e950 2023-11-29T11:20:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 1 -- 172.21.15.81:0/2221118026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe180147c0 con 0x254e950 2023-11-29T11:20:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 1 -- 172.21.15.81:0/2221118026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fbe0c029910 con 0x254e950 2023-11-29T11:20:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 10 client.8430 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:20:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 10 client.8430 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:20:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 20 client.8430 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x27fed10 0x27ff0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 4 client.8430 mds_command: new command op to 8010 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 -- 172.21.15.81:0/2221118026 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x25cb4a0 con 0x27fed10 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe216df700 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x27fed10 0x27ff0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 10 client.8430 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe216df700 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x27fed10 0x27ff0e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3db679df371d5bb5 server_cookie=1cea148ba42df3c8 in_seq=0 out_seq=0 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 1 -- 172.21.15.81:0/2221118026 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+416 (crc 0 0 0) 0x25cb4a0 con 0x27fed10 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 10 client.8430 handle_command_reply: tid=0 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 client.8430 shutdown 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 -- 172.21.15.81:0/2221118026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 msgr2=0x2819ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2819ff0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c001420 tx=0x7fbe0c013000 comp rx=0 tx=0).stop 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 -- 172.21.15.81:0/2221118026 shutdown_connections 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x27fed10 0x27ff0e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25999d0 0x28644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbdfcff9700 0 client.8430 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x254ed20 0x27e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 --2- 172.21.15.81:0/2221118026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x254e950 0x2819ff0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 -- 172.21.15.81:0/2221118026 >> 172.21.15.81:0/2221118026 conn(0x254f0f0 msgr2=0x27bc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 -- 172.21.15.81:0/2221118026 shutdown_connections 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 1 -- 172.21.15.81:0/2221118026 wait complete. 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe273c4740 20 client.8430 trim_cache size 0 max 16384 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:20:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 76671306, 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627777, 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/testdir/hardlink" 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 293830864, 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627776, 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/dir" 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "dir_frag", 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 316647463, 2023-11-29T11:20:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627776, 2023-11-29T11:20:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "frag": "*", 2023-11-29T11:20:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/dir" 2023-11-29T11:20:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:20:38.102 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe22ee2700 1 -- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe00064ee0 msgr2=0x7fbe00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.088+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe00064ee0 0x7fbe00067390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0d0730 tx=0x7fbe0c009040 comp rx=0 tx=0).stop 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 -- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 msgr2=0x7fbe1c0b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0b0410 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c066b70 tx=0x7fbe14004af0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 -- 172.21.15.81:0/3184974157 shutdown_connections 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbe00064ee0 0x7fbe00067390 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe1c0cf0e0 0x7fbe1c0b0410 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe1c0b1ae0 0x7fbe1c0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 --2- 172.21.15.81:0/3184974157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe1c06a4c0 0x7fbe1c158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 -- 172.21.15.81:0/3184974157 >> 172.21.15.81:0/3184974157 conn(0x7fbe1c09bbd0 msgr2=0x7fbe1c15bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 -- 172.21.15.81:0/3184974157 shutdown_connections 2023-11-29T11:20:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.092+0000 7fbe22ee2700 1 -- 172.21.15.81:0/3184974157 wait complete. 2023-11-29T11:20:38.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-29T11:20:38.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11e143700 1 Processor -- start 2023-11-29T11:20:38.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11e143700 1 -- start start 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11e143700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd118158410 0x7fd1180ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11e143700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1180c8f40 con 0x7fd1180cce00 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11e143700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1180c9200 con 0x7fd11806a4d0 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11e143700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1180c94e0 con 0x7fd118158410 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11d141700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd118158410 0x7fd1180ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11d141700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd118158410 0x7fd1180ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49022/0 (socket says 172.21.15.81:49022) 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11d141700 1 -- 172.21.15.81:0/4047334857 learned_addr learned my addr 172.21.15.81:0/4047334857 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11d141700 1 -- 172.21.15.81:0/4047334857 >> v1:172.21.15.176:6789/0 conn(0x7fd11806a4d0 legacy=0x7fd1180c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11d141700 1 -- 172.21.15.81:0/4047334857 >> v1:172.21.15.81:6789/0 conn(0x7fd1180cce00 legacy=0x7fd1180af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11d141700 1 -- 172.21.15.81:0/4047334857 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180c97c0 con 0x7fd118158410 2023-11-29T11:20:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.216+0000 7fd11d141700 1 --2- 172.21.15.81:0/4047334857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd1180ae220 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fd114009940 tx=0x7fd114009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602f275a6ec618eb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd10ffff700 1 -- 172.21.15.81:0/4047334857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114004230 con 0x7fd118158410 2023-11-29T11:20:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd10ffff700 1 -- 172.21.15.81:0/4047334857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114009e90 con 0x7fd118158410 2023-11-29T11:20:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd10ffff700 1 -- 172.21.15.81:0/4047334857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140045b0 con 0x7fd118158410 2023-11-29T11:20:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd11e143700 1 -- 172.21.15.81:0/4047334857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 msgr2=0x7fd1180ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd11e143700 1 --2- 172.21.15.81:0/4047334857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd1180ae220 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fd114009940 tx=0x7fd114009c50 comp rx=0 tx=0).stop 2023-11-29T11:20:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd11e143700 1 -- 172.21.15.81:0/4047334857 shutdown_connections 2023-11-29T11:20:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd11e143700 1 --2- 172.21.15.81:0/4047334857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd1180ae220 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd11e143700 1 -- 172.21.15.81:0/4047334857 >> 172.21.15.81:0/4047334857 conn(0x7fd1180cb2d0 msgr2=0x7fd1180cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd11e143700 1 -- 172.21.15.81:0/4047334857 shutdown_connections 2023-11-29T11:20:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.220+0000 7fd11e143700 1 -- 172.21.15.81:0/4047334857 wait complete. 2023-11-29T11:20:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 Processor -- start 2023-11-29T11:20:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 -- start start 2023-11-29T11:20:38.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd11806a4d0 0x7fd11814b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1180cce00 0x7fd118071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd118071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180c3750 con 0x7fd118158410 2023-11-29T11:20:38.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180c4760 con 0x7fd11806a4d0 2023-11-29T11:20:38.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180c39a0 con 0x7fd1180cce00 2023-11-29T11:20:38.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd118071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd118071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49036/0 (socket says 172.21.15.81:49036) 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 -- 172.21.15.81:0/1213303741 learned_addr learned my addr 172.21.15.81:0/1213303741 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d141700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd11806a4d0 0x7fd11814b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11c940700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1180cce00 0x7fd118071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 -- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1180cce00 msgr2=0x7fd118071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1180cce00 0x7fd118071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 -- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd11806a4d0 msgr2=0x7fd11814b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd11806a4d0 0x7fd11814b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 -- 172.21.15.81:0/1213303741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009570 con 0x7fd118158410 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11c940700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1180cce00 0x7fd118071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11d942700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd118071d90 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fd11000ee30 tx=0x7fd11000c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd10dffb700 1 -- 172.21.15.81:0/1213303741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110011470 con 0x7fd118158410 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd10dffb700 1 -- 172.21.15.81:0/1213303741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1100115d0 con 0x7fd118158410 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1180af890 con 0x7fd118158410 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd10dffb700 1 -- 172.21.15.81:0/1213303741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110011980 con 0x7fd118158410 2023-11-29T11:20:38.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.224+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1180c9aa0 con 0x7fd118158410 2023-11-29T11:20:38.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.228+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1180cd280 con 0x7fd118158410 2023-11-29T11:20:38.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.228+0000 7fd10dffb700 1 -- 172.21.15.81:0/1213303741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd110011ae0 con 0x7fd118158410 2023-11-29T11:20:38.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.228+0000 7fd10dffb700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd0fc064ee0 0x7fd0fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.228+0000 7fd10dffb700 1 -- 172.21.15.81:0/1213303741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fd110084d20 con 0x7fd118158410 2023-11-29T11:20:38.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.228+0000 7fd11d141700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd0fc064ee0 0x7fd0fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.228+0000 7fd11d141700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd0fc064ee0 0x7fd0fc067390 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd114009c90 tx=0x7fd114008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.236+0000 7fd10dffb700 1 -- 172.21.15.81:0/1213303741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd110052d20 con 0x7fd118158410 2023-11-29T11:20:38.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.432+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd11806b430 con 0x7fd118158410 2023-11-29T11:20:38.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.432+0000 7fd10dffb700 1 -- 172.21.15.81:0/1213303741 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fd110056340 con 0x7fd118158410 2023-11-29T11:20:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:20:38.442 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd0fc064ee0 msgr2=0x7fd0fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd0fc064ee0 0x7fd0fc067390 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd114009c90 tx=0x7fd114008030 comp rx=0 tx=0).stop 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 msgr2=0x7fd118071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd118071d90 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fd11000ee30 tx=0x7fd11000c550 comp rx=0 tx=0).stop 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 shutdown_connections 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd0fc064ee0 0x7fd0fc067390 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118158410 0x7fd118071d90 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1180cce00 0x7fd118071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 --2- 172.21.15.81:0/1213303741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd11806a4d0 0x7fd11814b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 >> 172.21.15.81:0/1213303741 conn(0x7fd1180cb2d0 msgr2=0x7fd1181576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 shutdown_connections 2023-11-29T11:20:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.436+0000 7fd11e143700 1 -- 172.21.15.81:0/1213303741 wait complete. 2023-11-29T11:20:38.457 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-29T11:20:38.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2023-11-29T11:20:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.568+0000 7feae492c700 1 Processor -- start 2023-11-29T11:20:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.568+0000 7feae492c700 1 -- start start 2023-11-29T11:20:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.568+0000 7feae492c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feae00b1ae0 0x7feae006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.568+0000 7feae492c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00cf0e0 0x7feae00cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.568+0000 7feae492c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae00cfa80 con 0x7feae006a4c0 2023-11-29T11:20:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.568+0000 7feae492c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae00d0ab0 con 0x7feae00b1ae0 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.568+0000 7feae492c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae006a9c0 con 0x7feae00cf0e0 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadeffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feae006a4c0 0x7feae00d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44034/0 (socket says 172.21.15.81:44034) 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadeffd700 1 -- 172.21.15.81:0/3722536376 learned_addr learned my addr 172.21.15.81:0/3722536376 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadffff700 1 --2- 172.21.15.81:0/3722536376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00cf0e0 0x7feae00cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadf7fe700 1 --2- 172.21.15.81:0/3722536376 >> v2:172.21.15.176:3300/0 conn(0x7feae00b1ae0 0x7feae006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feade7fc700 1 -- 172.21.15.81:0/3722536376 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243341485 0 0) 0x7feae00cfa80 con 0x7feae006a4c0 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feade7fc700 1 -- 172.21.15.81:0/3722536376 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feacc0035d0 con 0x7feae006a4c0 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feade7fc700 1 -- 172.21.15.81:0/3722536376 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2701405104 0 0) 0x7feacc0035d0 con 0x7feae006a4c0 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadffff700 1 -- 172.21.15.81:0/3722536376 >> v2:172.21.15.176:3300/0 conn(0x7feae00b1ae0 msgr2=0x7feae006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadffff700 1 --2- 172.21.15.81:0/3722536376 >> v2:172.21.15.176:3300/0 conn(0x7feae00b1ae0 0x7feae006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadffff700 1 -- 172.21.15.81:0/3722536376 >> v1:172.21.15.81:6789/0 conn(0x7feae006a4c0 legacy=0x7feae00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadffff700 1 -- 172.21.15.81:0/3722536376 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae006aca0 con 0x7feae00cf0e0 2023-11-29T11:20:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feadffff700 1 --2- 172.21.15.81:0/3722536376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00cf0e0 0x7feae00cf540 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86903f91b63c2a21 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feade7fc700 1 -- 172.21.15.81:0/3722536376 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800e070 con 0x7feae00cf0e0 2023-11-29T11:20:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feade7fc700 1 -- 172.21.15.81:0/3722536376 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8003a40 con 0x7feae00cf0e0 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feade7fc700 1 -- 172.21.15.81:0/3722536376 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0001670 con 0x7feae00cf0e0 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feae492c700 1 -- 172.21.15.81:0/3722536376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00cf0e0 msgr2=0x7feae00cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feae492c700 1 --2- 172.21.15.81:0/3722536376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00cf0e0 0x7feae00cf540 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead800b330 comp rx=0 tx=0).stop 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feae492c700 1 -- 172.21.15.81:0/3722536376 shutdown_connections 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feae492c700 1 --2- 172.21.15.81:0/3722536376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00cf0e0 0x7feae00cf540 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feae492c700 1 --2- 172.21.15.81:0/3722536376 >> v2:172.21.15.176:3300/0 conn(0x7feae00b1ae0 0x7feae006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feae492c700 1 -- 172.21.15.81:0/3722536376 >> 172.21.15.81:0/3722536376 conn(0x7feae009bbd0 msgr2=0x7feae00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feae492c700 1 -- 172.21.15.81:0/3722536376 shutdown_connections 2023-11-29T11:20:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.572+0000 7feae492c700 1 -- 172.21.15.81:0/3722536376 wait complete. 2023-11-29T11:20:38.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feae492c700 1 Processor -- start 2023-11-29T11:20:38.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feae492c700 1 -- start start 2023-11-29T11:20:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feae492c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae006a4c0 0x7feae00b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feae492c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00b1ae0 0x7feae00cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feae492c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae00cf0e0 0x7feae00ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feae492c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae00a0550 con 0x7feae006a4c0 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feae492c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae015e260 con 0x7feae00cf0e0 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feae492c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae009e390 con 0x7feae00b1ae0 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feadf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae006a4c0 0x7feae00b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feadf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae006a4c0 0x7feae00b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49052/0 (socket says 172.21.15.81:49052) 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feadf7fe700 1 -- 172.21.15.81:0/1605866943 learned_addr learned my addr 172.21.15.81:0/1605866943 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feadffff700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae00cf0e0 0x7feae00ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.576+0000 7feadeffd700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00b1ae0 0x7feae00cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7feadf7fe700 1 -- 172.21.15.81:0/1605866943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00b1ae0 msgr2=0x7feae00cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7feadf7fe700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00b1ae0 0x7feae00cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7feadf7fe700 1 -- 172.21.15.81:0/1605866943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae00cf0e0 msgr2=0x7feae00ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7feadf7fe700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae00cf0e0 0x7feae00ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7feadf7fe700 1 -- 172.21.15.81:0/1605866943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009a70 con 0x7feae006a4c0 2023-11-29T11:20:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7feadf7fe700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae006a4c0 0x7feae00b0770 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7feac800e840 tx=0x7feac800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7fead7fff700 1 -- 172.21.15.81:0/1605866943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80095a0 con 0x7feae006a4c0 2023-11-29T11:20:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7fead7fff700 1 -- 172.21.15.81:0/1605866943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac8013680 con 0x7feae006a4c0 2023-11-29T11:20:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7fead7fff700 1 -- 172.21.15.81:0/1605866943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80139f0 con 0x7feae006a4c0 2023-11-29T11:20:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7feae492c700 1 -- 172.21.15.81:0/1605866943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae00b4380 con 0x7feae006a4c0 2023-11-29T11:20:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.580+0000 7feae492c700 1 -- 172.21.15.81:0/1605866943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae006af80 con 0x7feae006a4c0 2023-11-29T11:20:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.584+0000 7fead7fff700 1 -- 172.21.15.81:0/1605866943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feac8019030 con 0x7feae006a4c0 2023-11-29T11:20:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.584+0000 7fead7fff700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feac0064ee0 0x7feac0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.584+0000 7fead7fff700 1 -- 172.21.15.81:0/1605866943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7feac8081f20 con 0x7feae006a4c0 2023-11-29T11:20:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.584+0000 7feadeffd700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feac0064ee0 0x7feac0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.584+0000 7feadeffd700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feac0064ee0 0x7feac0067390 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feae00cea20 tx=0x7fead0001da0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.584+0000 7feae8e0e740 1 Processor -- start 2023-11-29T11:20:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.584+0000 7feae8e0e740 1 -- start start 2023-11-29T11:20:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cfd80 0x157dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x1586e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 0x1587340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x143ec80 con 0x12cf9b0 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x14aed60 con 0x12cfd80 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x14a8060 con 0x131aa30 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x1586e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x1586e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49064/0 (socket says 172.21.15.81:49064) 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 -- 172.21.15.81:0/3840842276 learned_addr learned my addr 172.21.15.81:0/3840842276 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadffff700 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 0x1587340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadf7fe700 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cfd80 0x157dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 -- 172.21.15.81:0/3840842276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 msgr2=0x1587340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 0x1587340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 -- 172.21.15.81:0/3840842276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cfd80 msgr2=0x157dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cfd80 0x157dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 -- 172.21.15.81:0/3840842276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14cd4e0 con 0x12cf9b0 2023-11-29T11:20:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feadeffd700 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x1586e00 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fead000fa00 tx=0x7fead0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecba0890a02c303a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7fead57fa700 1 -- 172.21.15.81:0/3840842276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0013600 con 0x12cf9b0 2023-11-29T11:20:38.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7fead57fa700 1 -- 172.21.15.81:0/3840842276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0013760 con 0x12cf9b0 2023-11-29T11:20:38.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7fead57fa700 1 -- 172.21.15.81:0/3840842276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0013af0 con 0x12cf9b0 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- 172.21.15.81:0/3840842276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 msgr2=0x1586e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x1586e00 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fead000fa00 tx=0x7fead0012000 comp rx=0 tx=0).stop 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- 172.21.15.81:0/3840842276 shutdown_connections 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 0x1587340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x1586e00 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 --2- 172.21.15.81:0/3840842276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cfd80 0x157dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- 172.21.15.81:0/3840842276 >> 172.21.15.81:0/3840842276 conn(0x12d0150 msgr2=0x1568350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- 172.21.15.81:0/3840842276 shutdown_connections 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- 172.21.15.81:0/3840842276 wait complete. 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.588+0000 7feae8e0e740 1 -- start start 2023-11-29T11:20:38.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 Processor -- start 2023-11-29T11:20:38.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cf9b0 0x1567180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x153f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 0x158c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1354dc0 con 0x12cfd80 2023-11-29T11:20:38.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x157da90 con 0x12cf9b0 2023-11-29T11:20:38.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x153e430 con 0x131aa30 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 10 client.0 _ll_register_callbacks cb 0x1503b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x153f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x153f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49080/0 (socket says 172.21.15.81:49080) 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 -- 172.21.15.81:0/2412064173 learned_addr learned my addr 172.21.15.81:0/2412064173 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadf7fe700 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cf9b0 0x1567180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadffff700 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 0x158c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 -- 172.21.15.81:0/2412064173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 msgr2=0x158c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 0x158c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 -- 172.21.15.81:0/2412064173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cf9b0 msgr2=0x1567180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cf9b0 0x1567180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 -- 172.21.15.81:0/2412064173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead000f710 con 0x12cfd80 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadeffd700 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x153f010 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fead0023040 tx=0x7fead0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebffd0611f97a340 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feabe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:38.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feabe7fc700 1 -- 172.21.15.81:0/2412064173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0013600 con 0x12cfd80 2023-11-29T11:20:38.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feabe7fc700 1 -- 172.21.15.81:0/2412064173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fead001b050 con 0x12cfd80 2023-11-29T11:20:38.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 -- 172.21.15.81:0/2412064173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14a10e0 con 0x12cfd80 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feabe7fc700 1 -- 172.21.15.81:0/2412064173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fead00016b0 con 0x12cfd80 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 10 client.8451 fetch_fsmap learned FSMap version 60 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 -- 172.21.15.81:0/2412064173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x131bc80 con 0x12cfd80 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feabe7fc700 1 -- 172.21.15.81:0/2412064173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14a10e0 con 0x12cfd80 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feabe7fc700 1 -- 172.21.15.81:0/2412064173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fead0034350 con 0x12cfd80 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 10 client.8451 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 10 client.8451 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 20 client.8451 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x15866c0 0x1540c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 4 client.8451 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feae8e0e740 1 -- 172.21.15.81:0/2412064173 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14a0e00 con 0x15866c0 2023-11-29T11:20:38.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.592+0000 7feadf7fe700 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x15866c0 0x1540c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feabe7fc700 10 client.8451 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feadf7fe700 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x15866c0 0x1540c40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4074aa92553cbe3 server_cookie=93daf4cec893140b in_seq=0 out_seq=0 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feabe7fc700 1 -- 172.21.15.81:0/2412064173 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x14a0e00 con 0x15866c0 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feabe7fc700 10 client.8451 handle_command_reply: tid=0 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 client.8451 shutdown 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 -- 172.21.15.81:0/2412064173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 msgr2=0x153f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x153f010 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fead0023040 tx=0x7fead0000ed0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 -- 172.21.15.81:0/2412064173 shutdown_connections 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x15866c0 0x1540c40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x131aa30 0x158c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feabe7fc700 0 client.8451 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x153f010 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2412064173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x12cf9b0 0x1567180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 -- 172.21.15.81:0/2412064173 >> 172.21.15.81:0/2412064173 conn(0x12d0150 msgr2=0x15515a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 -- 172.21.15.81:0/2412064173 shutdown_connections 2023-11-29T11:20:38.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 1 -- 172.21.15.81:0/2412064173 wait complete. 2023-11-29T11:20:38.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.596+0000 7feae8e0e740 20 client.8451 trim_cache size 0 max 16384 2023-11-29T11:20:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feae8e0e740 1 Processor -- start 2023-11-29T11:20:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feae8e0e740 1 -- start start 2023-11-29T11:20:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cf9b0 0x1551720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x1595cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 0x1596210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feae8e0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1568130 con 0x12cfd80 2023-11-29T11:20:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feae8e0e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x144d780 con 0x131aa30 2023-11-29T11:20:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feae8e0e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1462a80 con 0x12cf9b0 2023-11-29T11:20:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feadeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x1595cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feadeffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x1595cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49094/0 (socket says 172.21.15.81:49094) 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feadeffd700 1 -- 172.21.15.81:0/2755442341 learned_addr learned my addr 172.21.15.81:0/2755442341 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feadf7fe700 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cf9b0 0x1551720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.616+0000 7feadffff700 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 0x1596210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feadeffd700 1 -- 172.21.15.81:0/2755442341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cf9b0 msgr2=0x1551720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feadeffd700 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cf9b0 0x1551720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feadeffd700 1 -- 172.21.15.81:0/2755442341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 msgr2=0x1596210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feadeffd700 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 0x1596210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feadeffd700 1 -- 172.21.15.81:0/2755442341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00b3190 con 0x12cfd80 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feadeffd700 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x1595cd0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fead000f660 tx=0x7fead002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4365b2068580151c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7fead5ffb700 1 -- 172.21.15.81:0/2755442341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0034ac0 con 0x12cfd80 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7fead5ffb700 1 -- 172.21.15.81:0/2755442341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0041070 con 0x12cfd80 2023-11-29T11:20:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7fead5ffb700 1 -- 172.21.15.81:0/2755442341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead00016b0 con 0x12cfd80 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 -- 172.21.15.81:0/2755442341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 msgr2=0x1595cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x1595cd0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fead000f660 tx=0x7fead002b000 comp rx=0 tx=0).stop 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 -- 172.21.15.81:0/2755442341 shutdown_connections 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 0x1596210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cfd80 0x1595cd0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 --2- 172.21.15.81:0/2755442341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cf9b0 0x1551720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 -- 172.21.15.81:0/2755442341 >> 172.21.15.81:0/2755442341 conn(0x12d0150 msgr2=0x1562bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 -- 172.21.15.81:0/2755442341 shutdown_connections 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 -- 172.21.15.81:0/2755442341 wait complete. 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 -- start start 2023-11-29T11:20:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.620+0000 7feae8e0e740 1 Processor -- start 2023-11-29T11:20:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x15e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cfd80 0x1588ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 0x1595ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x15635d0 con 0x12cf9b0 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1588aa0 con 0x131aa30 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x15e5d30 con 0x12cfd80 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 10 client.0 _ll_register_callbacks cb 0x14ce910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x15e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x15e57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49110/0 (socket says 172.21.15.81:49110) 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 -- 172.21.15.81:0/607022995 learned_addr learned my addr 172.21.15.81:0/607022995 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadffff700 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 0x1595ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadeffd700 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cfd80 0x1588ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 -- 172.21.15.81:0/607022995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cfd80 msgr2=0x1588ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cfd80 0x1588ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 -- 172.21.15.81:0/607022995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 msgr2=0x1595ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 0x1595ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 -- 172.21.15.81:0/607022995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x131bc80 con 0x12cf9b0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadf7fe700 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x15e57f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7feac8009fd0 tx=0x7feac8053600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34fbfbd842e19fc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feabe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feabe7fc700 1 -- 172.21.15.81:0/607022995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8013b50 con 0x12cf9b0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feabe7fc700 1 -- 172.21.15.81:0/607022995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7feac8013cb0 con 0x12cf9b0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 -- 172.21.15.81:0/607022995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fead0013760 con 0x12cf9b0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feabe7fc700 1 -- 172.21.15.81:0/607022995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac8013e70 con 0x12cf9b0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 10 client.8457 fetch_fsmap learned FSMap version 60 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 -- 172.21.15.81:0/607022995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x1454bb0 con 0x12cf9b0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feabe7fc700 1 -- 172.21.15.81:0/607022995 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0013760 con 0x12cf9b0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feabe7fc700 1 -- 172.21.15.81:0/607022995 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7feac807a240 con 0x12cf9b0 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 10 client.8457 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 10 client.8457 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 20 client.8457 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x15866c0 0x15961e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 4 client.8457 mds_command: new command op to 8010 tid=0[{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2023-11-29T11:20:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feae8e0e740 1 -- 172.21.15.81:0/607022995 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x134c500 con 0x15866c0 2023-11-29T11:20:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.624+0000 7feadeffd700 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x15866c0 0x15961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feabe7fc700 10 client.8457 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feadeffd700 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x15866c0 0x15961e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa032e87c5bd853f server_cookie=d348d6b958f26756 in_seq=0 out_seq=0 2023-11-29T11:20:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feabe7fc700 1 -- 172.21.15.81:0/607022995 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x134c500 con 0x15866c0 2023-11-29T11:20:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feabe7fc700 10 client.8457 handle_command_reply: tid=0 2023-11-29T11:20:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 client.8457 shutdown 2023-11-29T11:20:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 -- 172.21.15.81:0/607022995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 msgr2=0x15e57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x15e57f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7feac8009fd0 tx=0x7feac8053600 comp rx=0 tx=0).stop 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 -- 172.21.15.81:0/607022995 shutdown_connections 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x131aa30 0x1595ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x15866c0 0x15961e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x12cfd80 0x1588ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feabe7fc700 0 client.8457 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 --2- 172.21.15.81:0/607022995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12cf9b0 0x15e57f0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 -- 172.21.15.81:0/607022995 >> 172.21.15.81:0/607022995 conn(0x12d0150 msgr2=0x153ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 -- 172.21.15.81:0/607022995 shutdown_connections 2023-11-29T11:20:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 1 -- 172.21.15.81:0/607022995 wait complete. 2023-11-29T11:20:38.639 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:20:38.628+0000 7fe2edd91700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 pv17 ap=3 DIRTYPARENT f(v0 m2023-11-29T11:19:47.824838+0000 1=1+0)->f(v1 m2023-11-29T11:19:47.824838+0000) n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1)->n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5596f4264100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2023-11-29T11:19:47.824838+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2023-11-29T11:20:38.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae8e0e740 20 client.8457 trim_cache size 0 max 16384 2023-11-29T11:20:38.640 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:20:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:20:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "3d53dd68-3961-44ec-8519-e3be159fc3cc", 2023-11-29T11:20:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:20:38.640 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 -- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feac0064ee0 msgr2=0x7feac0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feac0064ee0 0x7feac0067390 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feae00cea20 tx=0x7fead0001da0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 -- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae006a4c0 msgr2=0x7feae00b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae006a4c0 0x7feae00b0770 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7feac800e840 tx=0x7feac800eb50 comp rx=0 tx=0).stop 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 -- 172.21.15.81:0/1605866943 shutdown_connections 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feac0064ee0 0x7feac0067390 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae00cf0e0 0x7feae00ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae00b1ae0 0x7feae00cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 --2- 172.21.15.81:0/1605866943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae006a4c0 0x7feae00b0770 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.628+0000 7feae492c700 1 -- 172.21.15.81:0/1605866943 >> 172.21.15.81:0/1605866943 conn(0x7feae009bbd0 msgr2=0x7feae015b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.632+0000 7feae492c700 1 -- 172.21.15.81:0/1605866943 shutdown_connections 2023-11-29T11:20:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.632+0000 7feae492c700 1 -- 172.21.15.81:0/1605866943 wait complete. 2023-11-29T11:20:38.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-11-29T11:20:38.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.764+0000 7f3f66256700 1 Processor -- start 2023-11-29T11:20:38.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.764+0000 7f3f66256700 1 -- start start 2023-11-29T11:20:38.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.764+0000 7f3f66256700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3f6015d7e0 0x7f3f600cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.764+0000 7f3f66256700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f600ce460 0x7f3f6006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.764+0000 7f3f66256700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f600cda90 con 0x7f3f60159040 2023-11-29T11:20:38.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.764+0000 7f3f66256700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f600cd480 con 0x7f3f6015d7e0 2023-11-29T11:20:38.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.764+0000 7f3f66256700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f60159410 con 0x7f3f600ce460 2023-11-29T11:20:38.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f64a53700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3f6015d7e0 0x7f3f600cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f65a55700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f600ce460 0x7f3f6006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f64a53700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3f6015d7e0 0x7f3f600cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:53602/0 (socket says 172.21.15.81:53602) 2023-11-29T11:20:38.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f64a53700 1 -- 172.21.15.81:0/4178001106 learned_addr learned my addr 172.21.15.81:0/4178001106 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f65a55700 1 -- 172.21.15.81:0/4178001106 >> v2:172.21.15.176:3300/0 conn(0x7f3f6015d7e0 msgr2=0x7f3f600cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f65a55700 1 --2- 172.21.15.81:0/4178001106 >> v2:172.21.15.176:3300/0 conn(0x7f3f6015d7e0 0x7f3f600cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f65a55700 1 -- 172.21.15.81:0/4178001106 >> v1:172.21.15.176:6789/0 conn(0x7f3f60159040 legacy=0x7f3f600c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f65a55700 1 -- 172.21.15.81:0/4178001106 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600ca7e0 con 0x7f3f600ce460 2023-11-29T11:20:38.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f64a53700 1 --2- 172.21.15.81:0/4178001106 >> v2:172.21.15.176:3300/0 conn(0x7f3f6015d7e0 0x7f3f600cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:20:38.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f65a55700 1 --2- 172.21.15.81:0/4178001106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f600ce460 0x7f3f6006a4e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009d90 tx=0x7f3f5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917f3426a677276a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f57fff700 1 -- 172.21.15.81:0/4178001106 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5800e070 con 0x7f3f600ce460 2023-11-29T11:20:38.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f57fff700 1 -- 172.21.15.81:0/4178001106 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5800bb20 con 0x7f3f600ce460 2023-11-29T11:20:38.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f57fff700 1 -- 172.21.15.81:0/4178001106 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58012430 con 0x7f3f600ce460 2023-11-29T11:20:38.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f66256700 1 -- 172.21.15.81:0/4178001106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f600ce460 msgr2=0x7f3f6006a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f66256700 1 --2- 172.21.15.81:0/4178001106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f600ce460 0x7f3f6006a4e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009d90 tx=0x7f3f5800b330 comp rx=0 tx=0).stop 2023-11-29T11:20:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f66256700 1 -- 172.21.15.81:0/4178001106 shutdown_connections 2023-11-29T11:20:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f66256700 1 --2- 172.21.15.81:0/4178001106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f600ce460 0x7f3f6006a4e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f66256700 1 --2- 172.21.15.81:0/4178001106 >> v2:172.21.15.176:3300/0 conn(0x7f3f6015d7e0 0x7f3f600cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f66256700 1 -- 172.21.15.81:0/4178001106 >> 172.21.15.81:0/4178001106 conn(0x7f3f6006c660 msgr2=0x7f3f6006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f66256700 1 -- 172.21.15.81:0/4178001106 shutdown_connections 2023-11-29T11:20:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.768+0000 7f3f66256700 1 -- 172.21.15.81:0/4178001106 wait complete. 2023-11-29T11:20:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.772+0000 7f3f66256700 1 Processor -- start 2023-11-29T11:20:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.772+0000 7f3f66256700 1 -- start start 2023-11-29T11:20:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.772+0000 7f3f66256700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f600ce460 0x7f3f601495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.772+0000 7f3f66256700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f60159040 0x7f3f600c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.772+0000 7f3f66256700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6015d7e0 0x7f3f601ee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.772+0000 7f3f66256700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f60149af0 con 0x7f3f6015d7e0 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.772+0000 7f3f66256700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600c4b50 con 0x7f3f600ce460 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.772+0000 7f3f66256700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600c4e10 con 0x7f3f60159040 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6015d7e0 0x7f3f601ee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6015d7e0 0x7f3f601ee1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49114/0 (socket says 172.21.15.81:49114) 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 -- 172.21.15.81:0/1686832506 learned_addr learned my addr 172.21.15.81:0/1686832506 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65254700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f600ce460 0x7f3f601495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f64a53700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f60159040 0x7f3f600c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 -- 172.21.15.81:0/1686832506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f60159040 msgr2=0x7f3f600c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f60159040 0x7f3f600c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 -- 172.21.15.81:0/1686832506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f600ce460 msgr2=0x7f3f601495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f600ce460 0x7f3f601495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 -- 172.21.15.81:0/1686832506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50009570 con 0x7f3f6015d7e0 2023-11-29T11:20:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65a55700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6015d7e0 0x7f3f601ee1c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009790 tx=0x7f3f58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f55ffb700 1 -- 172.21.15.81:0/1686832506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580129f0 con 0x7f3f6015d7e0 2023-11-29T11:20:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f55ffb700 1 -- 172.21.15.81:0/1686832506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58020070 con 0x7f3f6015d7e0 2023-11-29T11:20:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f66256700 1 -- 172.21.15.81:0/1686832506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f58009a70 con 0x7f3f6015d7e0 2023-11-29T11:20:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f55ffb700 1 -- 172.21.15.81:0/1686832506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58012d90 con 0x7f3f6015d7e0 2023-11-29T11:20:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f66256700 1 -- 172.21.15.81:0/1686832506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f600caac0 con 0x7f3f6015d7e0 2023-11-29T11:20:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f55ffb700 1 -- 172.21.15.81:0/1686832506 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3f58004040 con 0x7f3f6015d7e0 2023-11-29T11:20:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f55ffb700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f44064f10 0x7f3f440673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f55ffb700 1 -- 172.21.15.81:0/1686832506 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f3f58022070 con 0x7f3f6015d7e0 2023-11-29T11:20:38.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.776+0000 7f3f65254700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f44064f10 0x7f3f440673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.780+0000 7f3f65254700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f44064f10 0x7f3f440673c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3f6014cad0 tx=0x7f3f5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.780+0000 7f3f6a738740 1 Processor -- start 2023-11-29T11:20:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.780+0000 7f3f6a738740 1 -- start start 2023-11-29T11:20:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x14ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x123e8c0 0x14a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1362d20 con 0x11f3840 2023-11-29T11:20:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x13d2d60 con 0x123e8c0 2023-11-29T11:20:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x13cc060 con 0x11f3c10 2023-11-29T11:20:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14ad5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49124/0 (socket says 172.21.15.81:49124) 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 -- 172.21.15.81:0/3731947194 learned_addr learned my addr 172.21.15.81:0/3731947194 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f65254700 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x14ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f65a55700 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x123e8c0 0x14a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 -- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 msgr2=0x14ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x14ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 -- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x123e8c0 msgr2=0x14a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x123e8c0 0x14a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 -- 172.21.15.81:0/3731947194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13f20a0 con 0x11f3840 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f65254700 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x14ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f64a53700 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14ad5d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009da0 tx=0x7f3f500115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2899b02861ce13 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f4affd700 1 -- 172.21.15.81:0/3731947194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50011dc0 con 0x11f3840 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f4affd700 1 -- 172.21.15.81:0/3731947194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50014440 con 0x11f3840 2023-11-29T11:20:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f4affd700 1 -- 172.21.15.81:0/3731947194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500147b0 con 0x11f3840 2023-11-29T11:20:38.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- 172.21.15.81:0/3731947194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 msgr2=0x14ad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14ad5d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009da0 tx=0x7f3f500115a0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- 172.21.15.81:0/3731947194 shutdown_connections 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x123e8c0 0x14a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14ad5d0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 --2- 172.21.15.81:0/3731947194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x14ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- 172.21.15.81:0/3731947194 >> 172.21.15.81:0/3731947194 conn(0x11f3fe0 msgr2=0x148cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- 172.21.15.81:0/3731947194 shutdown_connections 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- 172.21.15.81:0/3731947194 wait complete. 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 -- start start 2023-11-29T11:20:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.784+0000 7f3f6a738740 1 Processor -- start 2023-11-29T11:20:38.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14aa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x1465140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x123e8c0 0x1465680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1278c50 con 0x11f3840 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x14666f0 con 0x11f3c10 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x14aab60 con 0x123e8c0 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 10 client.0 _ll_register_callbacks cb 0x13c59a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49136/0 (socket says 172.21.15.81:49136) 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 -- 172.21.15.81:0/1439682079 learned_addr learned my addr 172.21.15.81:0/1439682079 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f64a53700 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x1465140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65a55700 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x123e8c0 0x1465680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 -- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x123e8c0 msgr2=0x1465680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x123e8c0 0x1465680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 -- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 msgr2=0x1465140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x1465140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 -- 172.21.15.81:0/1439682079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f500099d0 con 0x11f3840 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f64a53700 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x1465140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f65254700 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14aa620 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c001680 tx=0x7f3f5c001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac85de485f9de55 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f3ffff700 1 -- 172.21.15.81:0/1439682079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c014c50 con 0x11f3840 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f3ffff700 1 -- 172.21.15.81:0/1439682079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f3f5c01c040 con 0x11f3840 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 -- 172.21.15.81:0/1439682079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x13c50e0 con 0x11f3840 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f3ffff700 1 -- 172.21.15.81:0/1439682079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f5c014db0 con 0x11f3840 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 10 client.8466 fetch_fsmap learned FSMap version 60 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 -- 172.21.15.81:0/1439682079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x123fb10 con 0x11f3840 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f3ffff700 1 -- 172.21.15.81:0/1439682079 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x13c50e0 con 0x11f3840 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f3ffff700 1 -- 172.21.15.81:0/1439682079 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f3f5c029350 con 0x11f3840 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 10 client.8466 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 10 client.8466 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 20 client.8466 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1489d80 0x14b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 4 client.8466 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:20:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f6a738740 1 -- 172.21.15.81:0/1439682079 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x13c4e00 con 0x1489d80 2023-11-29T11:20:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f64a53700 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1489d80 0x14b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f3ffff700 10 client.8466 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.788+0000 7f3f64a53700 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1489d80 0x14b6190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d572c0a76bd7077 server_cookie=dad955f6f9d3af5f in_seq=0 out_seq=0 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f3ffff700 1 -- 172.21.15.81:0/1439682079 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x13c4e00 con 0x1489d80 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f3ffff700 10 client.8466 handle_command_reply: tid=0 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 client.8466 shutdown 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 -- 172.21.15.81:0/1439682079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 msgr2=0x14aa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14aa620 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c001680 tx=0x7f3f5c001170 comp rx=0 tx=0).stop 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 -- 172.21.15.81:0/1439682079 shutdown_connections 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1489d80 0x14b6190 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f3ffff700 0 client.8466 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x123e8c0 0x1465680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x1465140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 --2- 172.21.15.81:0/1439682079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11f3840 0x14aa620 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 -- 172.21.15.81:0/1439682079 >> 172.21.15.81:0/1439682079 conn(0x11f3fe0 msgr2=0x14604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 -- 172.21.15.81:0/1439682079 shutdown_connections 2023-11-29T11:20:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 1 -- 172.21.15.81:0/1439682079 wait complete. 2023-11-29T11:20:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.792+0000 7f3f6a738740 20 client.8466 trim_cache size 0 max 16384 2023-11-29T11:20:38.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 Processor -- start 2023-11-29T11:20:38.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- start start 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3840 0x14c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x14c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x14c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14ab310 con 0x123e8c0 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x13c79d0 con 0x11f3c10 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x13d3ff0 con 0x11f3840 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x14c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x14c21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49148/0 (socket says 172.21.15.81:49148) 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 -- 172.21.15.81:0/3122499108 learned_addr learned my addr 172.21.15.81:0/3122499108 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65254700 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3840 0x14c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f64a53700 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x14c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 -- 172.21.15.81:0/3122499108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3840 msgr2=0x14c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3840 0x14c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 -- 172.21.15.81:0/3122499108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 msgr2=0x14c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x14c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 -- 172.21.15.81:0/3122499108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600aebf0 con 0x123e8c0 2023-11-29T11:20:38.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f65a55700 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x14c21e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f3f58052320 tx=0x7f3f58055c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13649dac17c4ed43 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f4b7fe700 1 -- 172.21.15.81:0/3122499108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5806d1c0 con 0x123e8c0 2023-11-29T11:20:38.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f4b7fe700 1 -- 172.21.15.81:0/3122499108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5805df10 con 0x123e8c0 2023-11-29T11:20:38.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f4b7fe700 1 -- 172.21.15.81:0/3122499108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58055310 con 0x123e8c0 2023-11-29T11:20:38.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- 172.21.15.81:0/3122499108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 msgr2=0x14c21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x14c21e0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f3f58052320 tx=0x7f3f58055c70 comp rx=0 tx=0).stop 2023-11-29T11:20:38.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- 172.21.15.81:0/3122499108 shutdown_connections 2023-11-29T11:20:38.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x14c21e0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3c10 0x14c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 --2- 172.21.15.81:0/3122499108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3840 0x14c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- 172.21.15.81:0/3122499108 >> 172.21.15.81:0/3122499108 conn(0x11f3fe0 msgr2=0x14a8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- 172.21.15.81:0/3122499108 shutdown_connections 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- 172.21.15.81:0/3122499108 wait complete. 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 -- start start 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.812+0000 7f3f6a738740 1 Processor -- start 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3840 0x1485630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x1509070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x15095b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x138e140 con 0x123e8c0 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1391440 con 0x11f3840 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x13c9870 con 0x11f3c10 2023-11-29T11:20:38.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 10 client.0 _ll_register_callbacks cb 0x7f3f500098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x15095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x15095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49162/0 (socket says 172.21.15.81:49162) 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 -- 172.21.15.81:0/520518502 learned_addr learned my addr 172.21.15.81:0/520518502 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65254700 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3840 0x1485630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f64a53700 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x1509070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 -- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 msgr2=0x1509070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x1509070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 -- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3840 msgr2=0x1485630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3840 0x1485630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 -- 172.21.15.81:0/520518502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f600caac0 con 0x123e8c0 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f64a53700 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x1509070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65a55700 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x15095b0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f3f58055b20 tx=0x7f3f58084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692a201b749d0e91 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:20:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 1 -- 172.21.15.81:0/520518502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58078070 con 0x123e8c0 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 1 -- 172.21.15.81:0/520518502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f3f580721d0 con 0x123e8c0 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 -- 172.21.15.81:0/520518502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f50014440 con 0x123e8c0 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 1 -- 172.21.15.81:0/520518502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f5806d1c0 con 0x123e8c0 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 10 client.8472 fetch_fsmap learned FSMap version 60 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 -- 172.21.15.81:0/520518502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x1378af0 con 0x123e8c0 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 1 -- 172.21.15.81:0/520518502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50014440 con 0x123e8c0 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 1 -- 172.21.15.81:0/520518502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f3f5807b030 con 0x123e8c0 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 10 client.8472 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 10 client.8472 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 20 client.8472 populate_metadata read hostname 'smithi081' 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1489d80 0x1482fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 4 client.8472 mds_command: new command op to 8010 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 -- 172.21.15.81:0/520518502 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1270390 con 0x1489d80 2023-11-29T11:20:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65254700 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1489d80 0x1482fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 10 client.8472 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f65254700 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1489d80 0x1482fd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91459d2f9d911ec9 server_cookie=24803d592c76ef77 in_seq=0 out_seq=0 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 1 -- 172.21.15.81:0/520518502 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x1270390 con 0x1489d80 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f3ffff700 10 client.8472 handle_command_reply: tid=0 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 client.8472 shutdown 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 -- 172.21.15.81:0/520518502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 msgr2=0x15095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.816+0000 7f3f6a738740 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x15095b0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f3f58055b20 tx=0x7f3f58084040 comp rx=0 tx=0).stop 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 1 -- 172.21.15.81:0/520518502 shutdown_connections 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x123e8c0 0x15095b0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x1489d80 0x1482fd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11f3c10 0x1509070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f3ffff700 0 client.8472 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:20:38.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 1 --2- 172.21.15.81:0/520518502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x11f3840 0x1485630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 1 -- 172.21.15.81:0/520518502 >> 172.21.15.81:0/520518502 conn(0x11f3fe0 msgr2=0x14604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 1 -- 172.21.15.81:0/520518502 shutdown_connections 2023-11-29T11:20:38.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 1 -- 172.21.15.81:0/520518502 wait complete. 2023-11-29T11:20:38.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f6a738740 20 client.8472 trim_cache size 0 max 16384 2023-11-29T11:20:38.831 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout: "3d53dd68-3961-44ec-8519-e3be159fc3cc": { 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/dir", 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "3d53dd68-3961-44ec-8519-e3be159fc3cc", 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,repair" 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:20:38.832 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:20:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 -- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f44064f10 msgr2=0x7f3f440673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f44064f10 0x7f3f440673c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3f6014cad0 tx=0x7f3f5c009040 comp rx=0 tx=0).stop 2023-11-29T11:20:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 -- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6015d7e0 msgr2=0x7f3f601ee1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:20:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6015d7e0 0x7f3f601ee1c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009790 tx=0x7f3f58004af0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 -- 172.21.15.81:0/1686832506 shutdown_connections 2023-11-29T11:20:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3f44064f10 0x7f3f440673c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f6015d7e0 0x7f3f601ee1c0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f60159040 0x7f3f600c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 --2- 172.21.15.81:0/1686832506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f600ce460 0x7f3f601495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:20:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 -- 172.21.15.81:0/1686832506 >> 172.21.15.81:0/1686832506 conn(0x7f3f6006c660 msgr2=0x7f3f6015cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:20:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 -- 172.21.15.81:0/1686832506 shutdown_connections 2023-11-29T11:20:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:20:38.820+0000 7f3f66256700 1 -- 172.21.15.81:0/1686832506 wait complete. 2023-11-29T11:20:38.843 INFO:tasks.cephfs.filesystem:scrub status for tag:3d53dd68-3961-44ec-8519-e3be159fc3cc - {'path': '/dir', 'tag': '3d53dd68-3961-44ec-8519-e3be159fc3cc', 'options': 'recursive,repair'} 2023-11-29T11:20:56.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:20:56.817 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:21:08.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-11-29T11:21:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.963+0000 7fdcb56cc700 1 Processor -- start 2023-11-29T11:21:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.963+0000 7fdcb56cc700 1 -- start start 2023-11-29T11:21:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcb56cc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcb00ced30 0x7fdcb00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcb56cc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb015e6e0 con 0x7fdcb015a1c0 2023-11-29T11:21:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcb56cc700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb006b740 con 0x7fdcb0069c40 2023-11-29T11:21:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcb56cc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb006ba20 con 0x7fdcb00ced30 2023-11-29T11:21:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcb00ced30 0x7fdcb00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdca77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdcb015a1c0 0x7fdcb00cf100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54074/0 (socket says 172.21.15.81:54074) 2023-11-29T11:21:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdca77fe700 1 -- 172.21.15.81:0/2333294 learned_addr learned my addr 172.21.15.81:0/2333294 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaffff700 1 -- 172.21.15.81:0/2333294 >> v1:172.21.15.176:6789/0 conn(0x7fdcb0069c40 legacy=0x7fdcb00cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaffff700 1 -- 172.21.15.81:0/2333294 >> v1:172.21.15.81:6789/0 conn(0x7fdcb015a1c0 legacy=0x7fdcb00cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaffff700 1 -- 172.21.15.81:0/2333294 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb006bd00 con 0x7fdcb00ced30 2023-11-29T11:21:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaf7fe700 1 -- 172.21.15.81:0/2333294 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20173732 0 0) 0x7fdcb015e6e0 con 0x7fdcb015a1c0 2023-11-29T11:21:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaffff700 1 --2- 172.21.15.81:0/2333294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb00715a0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009840 tx=0x7fdca0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de14e29de203cff6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaf7fe700 1 -- 172.21.15.81:0/2333294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0005e50 con 0x7fdcb00ced30 2023-11-29T11:21:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaf7fe700 1 -- 172.21.15.81:0/2333294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca0006030 con 0x7fdcb00ced30 2023-11-29T11:21:08.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.967+0000 7fdcaf7fe700 1 -- 172.21.15.81:0/2333294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca00063c0 con 0x7fdcb00ced30 2023-11-29T11:21:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- 172.21.15.81:0/2333294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 msgr2=0x7fdcb00715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 --2- 172.21.15.81:0/2333294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb00715a0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009840 tx=0x7fdca0009b50 comp rx=0 tx=0).stop 2023-11-29T11:21:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- 172.21.15.81:0/2333294 shutdown_connections 2023-11-29T11:21:08.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 --2- 172.21.15.81:0/2333294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb00715a0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- 172.21.15.81:0/2333294 >> 172.21.15.81:0/2333294 conn(0x7fdcb006c660 msgr2=0x7fdcb006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- 172.21.15.81:0/2333294 shutdown_connections 2023-11-29T11:21:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- 172.21.15.81:0/2333294 wait complete. 2023-11-29T11:21:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 Processor -- start 2023-11-29T11:21:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- start start 2023-11-29T11:21:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcb0069c40 0x7fdcb014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb01f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcb015a1c0 0x7fdcb015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb015b2d0 con 0x7fdcb00ced30 2023-11-29T11:21:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb014e9b0 con 0x7fdcb015a1c0 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.971+0000 7fdcb56cc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb015a650 con 0x7fdcb0069c40 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb01f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdcaffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcb0069c40 0x7fdcb014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb01f1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50522/0 (socket says 172.21.15.81:50522) 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 -- 172.21.15.81:0/3980221565 learned_addr learned my addr 172.21.15.81:0/3980221565 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcb015a1c0 0x7fdcb015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 -- 172.21.15.81:0/3980221565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcb0069c40 msgr2=0x7fdcb014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcb0069c40 0x7fdcb014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 -- 172.21.15.81:0/3980221565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcb015a1c0 msgr2=0x7fdcb015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcb015a1c0 0x7fdcb015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 -- 172.21.15.81:0/3980221565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009450 con 0x7fdcb00ced30 2023-11-29T11:21:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdca77fe700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb01f1790 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c4a0 tx=0x7fdc9800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdcad7fa700 1 -- 172.21.15.81:0/3980221565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98004ca0 con 0x7fdcb00ced30 2023-11-29T11:21:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdcad7fa700 1 -- 172.21.15.81:0/3980221565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98004e00 con 0x7fdcb00ced30 2023-11-29T11:21:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdcb56cc700 1 -- 172.21.15.81:0/3980221565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb00cba90 con 0x7fdcb00ced30 2023-11-29T11:21:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdcad7fa700 1 -- 172.21.15.81:0/3980221565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98007310 con 0x7fdcb00ced30 2023-11-29T11:21:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdcb56cc700 1 -- 172.21.15.81:0/3980221565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb015e9c0 con 0x7fdcb00ced30 2023-11-29T11:21:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.975+0000 7fdcad7fa700 1 -- 172.21.15.81:0/3980221565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc9801a020 con 0x7fdcb00ced30 2023-11-29T11:21:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcad7fa700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc90064ee0 0x7fdc90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcad7fa700 1 -- 172.21.15.81:0/3980221565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fdc98081b10 con 0x7fdcb00ced30 2023-11-29T11:21:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcaffff700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc90064ee0 0x7fdc90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcaffff700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc90064ee0 0x7fdc90067390 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdca0000c00 tx=0x7fdca0008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb9bae740 1 Processor -- start 2023-11-29T11:21:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb9bae740 1 -- start start 2023-11-29T11:21:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x2843e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x2844340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x28406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x26fbd20 con 0x25d78c0 2023-11-29T11:21:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x276bd60 con 0x258cc10 2023-11-29T11:21:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2765060 con 0x258c840 2023-11-29T11:21:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x28406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x28406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50532/0 (socket says 172.21.15.81:50532) 2023-11-29T11:21:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 -- 172.21.15.81:0/568007051 learned_addr learned my addr 172.21.15.81:0/568007051 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcaffff700 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x2843e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdca77fe700 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x2844340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 -- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 msgr2=0x2844340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x2844340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 -- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 msgr2=0x2843e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x2843e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 -- 172.21.15.81:0/568007051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x278b0a0 con 0x25d78c0 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdca77fe700 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x2844340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x28406a0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fdca800f1d0 tx=0x7fdca8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1b4644c8da5eba server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdca5ffb700 1 -- 172.21.15.81:0/568007051 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800fdb0 con 0x25d78c0 2023-11-29T11:21:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdca5ffb700 1 -- 172.21.15.81:0/568007051 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca8003a20 con 0x25d78c0 2023-11-29T11:21:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.979+0000 7fdca5ffb700 1 -- 172.21.15.81:0/568007051 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8003d90 con 0x25d78c0 2023-11-29T11:21:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- 172.21.15.81:0/568007051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 msgr2=0x28406a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x28406a0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fdca800f1d0 tx=0x7fdca8001b10 comp rx=0 tx=0).stop 2023-11-29T11:21:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- 172.21.15.81:0/568007051 shutdown_connections 2023-11-29T11:21:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x28406a0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x2844340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/568007051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x2843e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- 172.21.15.81:0/568007051 >> 172.21.15.81:0/568007051 conn(0x258cfe0 msgr2=0x2825d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- 172.21.15.81:0/568007051 shutdown_connections 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- 172.21.15.81:0/568007051 wait complete. 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- start start 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 Processor -- start 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x28070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x2807ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x2821250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2611c50 con 0x25d78c0 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2807ff0 con 0x258cc10 2023-11-29T11:21:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2821a40 con 0x258c840 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 10 client.0 _ll_register_callbacks cb 0x275e9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x2821250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x2821250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50540/0 (socket says 172.21.15.81:50540) 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 -- 172.21.15.81:0/432570127 learned_addr learned my addr 172.21.15.81:0/432570127 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcaffff700 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x28070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdca77fe700 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x2807ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 -- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 msgr2=0x28070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x28070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 -- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 msgr2=0x2807ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x2807ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 -- 172.21.15.81:0/432570127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb006b740 con 0x25d78c0 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcaffff700 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x28070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x2821250 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x2705850 tx=0x7fdca8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90072b064d1922a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdc8effd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdc8effd700 1 -- 172.21.15.81:0/432570127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8001850 con 0x25d78c0 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdc8effd700 1 -- 172.21.15.81:0/432570127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fdca801e420 con 0x25d78c0 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 1 -- 172.21.15.81:0/432570127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x275e0e0 con 0x25d78c0 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdc8effd700 1 -- 172.21.15.81:0/432570127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdca801e5e0 con 0x25d78c0 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.983+0000 7fdcb9bae740 10 client.8487 fetch_fsmap learned FSMap version 60 2023-11-29T11:21:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 -- 172.21.15.81:0/432570127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x25d8b10 con 0x25d78c0 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdc8effd700 1 -- 172.21.15.81:0/432570127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x275e0e0 con 0x25d78c0 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdc8effd700 1 -- 172.21.15.81:0/432570127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdca8012070 con 0x25d78c0 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 10 client.8487 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 10 client.8487 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 20 client.8487 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x2823540 0x2823940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 4 client.8487 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 -- 172.21.15.81:0/432570127 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x275de00 con 0x2823540 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcaffff700 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x2823540 0x2823940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdc8effd700 10 client.8487 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:21:09.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcaffff700 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x2823540 0x2823940 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dc2537a0ae537af server_cookie=50d707ece737eb07 in_seq=0 out_seq=0 2023-11-29T11:21:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdc8effd700 1 -- 172.21.15.81:0/432570127 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x275de00 con 0x2823540 2023-11-29T11:21:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdc8effd700 10 client.8487 handle_command_reply: tid=0 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 client.8487 shutdown 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 -- 172.21.15.81:0/432570127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 msgr2=0x2821250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x2821250 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x2705850 tx=0x7fdca8001250 comp rx=0 tx=0).stop 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 -- 172.21.15.81:0/432570127 shutdown_connections 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x25d78c0 0x2821250 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x2807ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x2823540 0x2823940 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/432570127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x28070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 -- 172.21.15.81:0/432570127 >> 172.21.15.81:0/432570127 conn(0x258cfe0 msgr2=0x281c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdc8effd700 0 client.8487 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:21:09.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 -- 172.21.15.81:0/432570127 shutdown_connections 2023-11-29T11:21:09.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 1 -- 172.21.15.81:0/432570127 wait complete. 2023-11-29T11:21:09.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:08.987+0000 7fdcb9bae740 20 client.8487 trim_cache size 0 max 16384 2023-11-29T11:21:09.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb9bae740 1 Processor -- start 2023-11-29T11:21:09.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb9bae740 1 -- start start 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258c840 0x281c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x281cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25d78c0 0x281d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x271d3d0 con 0x258c840 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2842b20 con 0x258cc10 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2725ad0 con 0x25d78c0 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258c840 0x281c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258c840 0x281c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50552/0 (socket says 172.21.15.81:50552) 2023-11-29T11:21:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 -- 172.21.15.81:0/1396185444 learned_addr learned my addr 172.21.15.81:0/1396185444 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25d78c0 0x281d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdca77fe700 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x281cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 -- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25d78c0 msgr2=0x281d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25d78c0 0x281d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 -- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 msgr2=0x281cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x281cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 -- 172.21.15.81:0/1396185444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb015d270 con 0x258c840 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdca77fe700 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x281cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdcaffff700 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258c840 0x281c660 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fdca0012000 tx=0x7fdca0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225bc5e3e4cb44cd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdca67fc700 1 -- 172.21.15.81:0/1396185444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0021070 con 0x258c840 2023-11-29T11:21:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdca67fc700 1 -- 172.21.15.81:0/1396185444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca0030040 con 0x258c840 2023-11-29T11:21:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.011+0000 7fdca67fc700 1 -- 172.21.15.81:0/1396185444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0009140 con 0x258c840 2023-11-29T11:21:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- 172.21.15.81:0/1396185444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258c840 msgr2=0x281c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258c840 0x281c660 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fdca0012000 tx=0x7fdca0010000 comp rx=0 tx=0).stop 2023-11-29T11:21:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- 172.21.15.81:0/1396185444 shutdown_connections 2023-11-29T11:21:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x25d78c0 0x281d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x258cc10 0x281cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/1396185444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258c840 0x281c660 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- 172.21.15.81:0/1396185444 >> 172.21.15.81:0/1396185444 conn(0x258cfe0 msgr2=0x2805f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- 172.21.15.81:0/1396185444 shutdown_connections 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- 172.21.15.81:0/1396185444 wait complete. 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- start start 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 Processor -- start 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x283bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258cc10 0x283b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25d78c0 0x289f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x283fe40 con 0x258cc10 2023-11-29T11:21:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x281b950 con 0x25d78c0 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2840070 con 0x258c840 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcb9bae740 10 client.0 _ll_register_callbacks cb 0x7fdca8001e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258cc10 0x283b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdca77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258cc10 0x283b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50560/0 (socket says 172.21.15.81:50560) 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdca77fe700 1 -- 172.21.15.81:0/203934103 learned_addr learned my addr 172.21.15.81:0/203934103 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.015+0000 7fdcaffff700 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x283bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25d78c0 0x289f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdca77fe700 1 -- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 msgr2=0x283bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdca77fe700 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x283bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdca77fe700 1 -- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25d78c0 msgr2=0x289f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdca77fe700 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25d78c0 0x289f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdca77fe700 1 -- 172.21.15.81:0/203934103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb006bd00 con 0x258cc10 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb4ecb700 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25d78c0 0x289f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdca77fe700 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258cc10 0x283b460 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fdc98001eb0 tx=0x7fdc980531d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd319b1692b76f80 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 1 -- 172.21.15.81:0/203934103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9805b620 con 0x258cc10 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 -- 172.21.15.81:0/203934103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdca8003a20 con 0x258cc10 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 1 -- 172.21.15.81:0/203934103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fdc9807cde0 con 0x258cc10 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 1 -- 172.21.15.81:0/203934103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc98007670 con 0x258cc10 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 10 client.8493 fetch_fsmap learned FSMap version 60 2023-11-29T11:21:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 -- 172.21.15.81:0/203934103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x2711af0 con 0x258cc10 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 1 -- 172.21.15.81:0/203934103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca8003a20 con 0x258cc10 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 1 -- 172.21.15.81:0/203934103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdc98059030 con 0x258cc10 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 10 client.8493 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 10 client.8493 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 20 client.8493 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x289fdf0 0x281f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 4 client.8493 mds_command: new command op to 8010 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 -- 172.21.15.81:0/203934103 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2609390 con 0x289fdf0 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcaffff700 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x289fdf0 0x281f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 10 client.8493 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:21:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcaffff700 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x289fdf0 0x281f970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e71819ce222f9eba server_cookie=c888941bdb4840a2 in_seq=0 out_seq=0 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 1 -- 172.21.15.81:0/203934103 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x2609390 con 0x289fdf0 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 10 client.8493 handle_command_reply: tid=0 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 client.8493 shutdown 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 -- 172.21.15.81:0/203934103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258cc10 msgr2=0x283b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258cc10 0x283b460 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fdc98001eb0 tx=0x7fdc980531d0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 -- 172.21.15.81:0/203934103 shutdown_connections 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x25d78c0 0x289f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x258cc10 0x283b460 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x289fdf0 0x281f970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdc8effd700 0 client.8493 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 --2- 172.21.15.81:0/203934103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x258c840 0x283bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 -- 172.21.15.81:0/203934103 >> 172.21.15.81:0/203934103 conn(0x258cfe0 msgr2=0x28067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 -- 172.21.15.81:0/203934103 shutdown_connections 2023-11-29T11:21:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.019+0000 7fdcb9bae740 1 -- 172.21.15.81:0/203934103 wait complete. 2023-11-29T11:21:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb9bae740 20 client.8493 trim_cache size 0 max 16384 2023-11-29T11:21:09.033 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:21:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:21:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:21:09.033 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 -- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc90064ee0 msgr2=0x7fdc90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc90064ee0 0x7fdc90067390 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdca0000c00 tx=0x7fdca0008070 comp rx=0 tx=0).stop 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 -- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 msgr2=0x7fdcb01f1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb01f1790 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c4a0 tx=0x7fdc9800c7b0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 -- 172.21.15.81:0/3980221565 shutdown_connections 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc90064ee0 0x7fdc90067390 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdcb015a1c0 0x7fdcb015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcb00ced30 0x7fdcb01f1790 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 --2- 172.21.15.81:0/3980221565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcb0069c40 0x7fdcb014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 -- 172.21.15.81:0/3980221565 >> 172.21.15.81:0/3980221565 conn(0x7fdcb006c660 msgr2=0x7fdcb015dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 -- 172.21.15.81:0/3980221565 shutdown_connections 2023-11-29T11:21:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.023+0000 7fdcb56cc700 1 -- 172.21.15.81:0/3980221565 wait complete. 2023-11-29T11:21:09.042 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:21:09.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:21:09.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.147+0000 7fb16ffff700 1 Processor -- start 2023-11-29T11:21:09.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.147+0000 7fb16ffff700 1 -- start start 2023-11-29T11:21:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.147+0000 7fb16ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb17015c300 0x7fb1700adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.147+0000 7fb16ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17006b830 con 0x7fb1700ae290 2023-11-29T11:21:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.147+0000 7fb16ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17006a080 con 0x7fb17006c640 2023-11-29T11:21:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.147+0000 7fb16ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17006ad00 con 0x7fb17015c300 2023-11-29T11:21:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb17015c300 0x7fb1700adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb1667fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb1700ae290 0x7fb17006b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54086/0 (socket says 172.21.15.81:54086) 2023-11-29T11:21:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb1667fc700 1 -- 172.21.15.81:0/3194579106 learned_addr learned my addr 172.21.15.81:0/3194579106 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16e7fc700 1 -- 172.21.15.81:0/3194579106 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344351092 0 0) 0x7fb17006b830 con 0x7fb1700ae290 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16e7fc700 1 -- 172.21.15.81:0/3194579106 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb15c0035d0 con 0x7fb1700ae290 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16effd700 1 -- 172.21.15.81:0/3194579106 >> v1:172.21.15.176:6789/0 conn(0x7fb17006c640 legacy=0x7fb17006ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16effd700 1 -- 172.21.15.81:0/3194579106 >> v1:172.21.15.81:6789/0 conn(0x7fb1700ae290 legacy=0x7fb17006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16effd700 1 -- 172.21.15.81:0/3194579106 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17006a360 con 0x7fb17015c300 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16effd700 1 --2- 172.21.15.81:0/3194579106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700adbb0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fb160009850 tx=0x7fb160009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5d2c17b67f7512 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16e7fc700 1 -- 172.21.15.81:0/3194579106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160011830 con 0x7fb17015c300 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16e7fc700 1 -- 172.21.15.81:0/3194579106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160011990 con 0x7fb17015c300 2023-11-29T11:21:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16e7fc700 1 -- 172.21.15.81:0/3194579106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160011d40 con 0x7fb17015c300 2023-11-29T11:21:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16ffff700 1 -- 172.21.15.81:0/3194579106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 msgr2=0x7fb1700adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16ffff700 1 --2- 172.21.15.81:0/3194579106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700adbb0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fb160009850 tx=0x7fb160009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16ffff700 1 -- 172.21.15.81:0/3194579106 shutdown_connections 2023-11-29T11:21:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16ffff700 1 --2- 172.21.15.81:0/3194579106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700adbb0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16ffff700 1 -- 172.21.15.81:0/3194579106 >> 172.21.15.81:0/3194579106 conn(0x7fb17006e000 msgr2=0x7fb1700b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16ffff700 1 -- 172.21.15.81:0/3194579106 shutdown_connections 2023-11-29T11:21:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.151+0000 7fb16ffff700 1 -- 172.21.15.81:0/3194579106 wait complete. 2023-11-29T11:21:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 Processor -- start 2023-11-29T11:21:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 -- start start 2023-11-29T11:21:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb17006c640 0x7fb1700ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1700ae290 0x7fb1700af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170151ff0 con 0x7fb17015c300 2023-11-29T11:21:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1701522d0 con 0x7fb17006c640 2023-11-29T11:21:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1701525b0 con 0x7fb1700ae290 2023-11-29T11:21:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50584/0 (socket says 172.21.15.81:50584) 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 -- 172.21.15.81:0/2909824590 learned_addr learned my addr 172.21.15.81:0/2909824590 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb1667fc700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1700ae290 0x7fb1700af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16effd700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb17006c640 0x7fb1700ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 -- 172.21.15.81:0/2909824590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1700ae290 msgr2=0x7fb1700af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1700ae290 0x7fb1700af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 -- 172.21.15.81:0/2909824590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb17006c640 msgr2=0x7fb1700ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb17006c640 0x7fb1700ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 -- 172.21.15.81:0/2909824590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600094b0 con 0x7fb17015c300 2023-11-29T11:21:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16f7fe700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700afdf0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fb16800cc50 tx=0x7fb16800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16cff9700 1 -- 172.21.15.81:0/2909824590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168003c20 con 0x7fb17015c300 2023-11-29T11:21:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16cff9700 1 -- 172.21.15.81:0/2909824590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168003d80 con 0x7fb17015c300 2023-11-29T11:21:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16cff9700 1 -- 172.21.15.81:0/2909824590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16800aab0 con 0x7fb17015c300 2023-11-29T11:21:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17006a920 con 0x7fb17015c300 2023-11-29T11:21:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.155+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17006a640 con 0x7fb17015c300 2023-11-29T11:21:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.159+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1700ab850 con 0x7fb17015c300 2023-11-29T11:21:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.159+0000 7fb16cff9700 1 -- 172.21.15.81:0/2909824590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb168010050 con 0x7fb17015c300 2023-11-29T11:21:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.159+0000 7fb16cff9700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb150064ee0 0x7fb150067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.159+0000 7fb16effd700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb150064ee0 0x7fb150067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.159+0000 7fb16cff9700 1 -- 172.21.15.81:0/2909824590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fb168081eb0 con 0x7fb17015c300 2023-11-29T11:21:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.159+0000 7fb16effd700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb150064ee0 0x7fb150067390 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb1600090b0 tx=0x7fb16001c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.163+0000 7fb16cff9700 1 -- 172.21.15.81:0/2909824590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb16804feb0 con 0x7fb17015c300 2023-11-29T11:21:09.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.359+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1700ce750 con 0x7fb17015c300 2023-11-29T11:21:09.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.359+0000 7fb16cff9700 1 -- 172.21.15.81:0/2909824590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4655 (secure 0 0 0) 0x7fb1680534d0 con 0x7fb17015c300 2023-11-29T11:21:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:09.367 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:20:14.125061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:21:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb150064ee0 msgr2=0x7fb150067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb150064ee0 0x7fb150067390 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb1600090b0 tx=0x7fb16001c040 comp rx=0 tx=0).stop 2023-11-29T11:21:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 msgr2=0x7fb1700afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700afdf0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fb16800cc50 tx=0x7fb16800cf60 comp rx=0 tx=0).stop 2023-11-29T11:21:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 shutdown_connections 2023-11-29T11:21:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb150064ee0 0x7fb150067390 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17015c300 0x7fb1700afdf0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1700ae290 0x7fb1700af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 --2- 172.21.15.81:0/2909824590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb17006c640 0x7fb1700ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 >> 172.21.15.81:0/2909824590 conn(0x7fb17006e000 msgr2=0x7fb1701514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 shutdown_connections 2023-11-29T11:21:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.363+0000 7fb16ffff700 1 -- 172.21.15.81:0/2909824590 wait complete. 2023-11-29T11:21:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2023-11-29T11:21:09.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-11-29T11:21:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.491+0000 7f7b2ffff700 1 Processor -- start 2023-11-29T11:21:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2ffff700 1 -- start start 2023-11-29T11:21:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3009bdb0 0x7f7b3015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7b300cbb30 0x7f7b3006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b300b2db0 con 0x7f7b300b00e0 2023-11-29T11:21:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b300b3240 con 0x7f7b300cbb30 2023-11-29T11:21:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3006d840 con 0x7f7b3009bdb0 2023-11-29T11:21:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2effd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7b300b00e0 0x7f7b3015d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54088/0 (socket says 172.21.15.81:54088) 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2effd700 1 -- 172.21.15.81:0/3418508577 learned_addr learned my addr 172.21.15.81:0/3418508577 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3418508577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3009bdb0 0x7f7b3015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/3418508577 >> v2:172.21.15.176:3300/0 conn(0x7f7b300cbb30 0x7f7b3006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2dffb700 1 -- 172.21.15.81:0/3418508577 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699001246 0 0) 0x7f7b300b2db0 con 0x7f7b300b00e0 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2dffb700 1 -- 172.21.15.81:0/3418508577 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c0057e0 con 0x7f7b300b00e0 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3418508577 >> v2:172.21.15.176:3300/0 conn(0x7f7b300cbb30 msgr2=0x7f7b3006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3418508577 >> v2:172.21.15.176:3300/0 conn(0x7f7b300cbb30 0x7f7b3006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3418508577 >> v1:172.21.15.81:6789/0 conn(0x7f7b300b00e0 legacy=0x7f7b3015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3418508577 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3006d560 con 0x7f7b3009bdb0 2023-11-29T11:21:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3418508577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3009bdb0 0x7f7b3015d9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009850 tx=0x7f7b18009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96a15cd79d2982d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2dffb700 1 -- 172.21.15.81:0/3418508577 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18011830 con 0x7f7b3009bdb0 2023-11-29T11:21:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2dffb700 1 -- 172.21.15.81:0/3418508577 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18011990 con 0x7f7b3009bdb0 2023-11-29T11:21:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.495+0000 7f7b2dffb700 1 -- 172.21.15.81:0/3418508577 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18011d00 con 0x7f7b3009bdb0 2023-11-29T11:21:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3418508577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3009bdb0 msgr2=0x7f7b3015d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3418508577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3009bdb0 0x7f7b3015d9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009850 tx=0x7f7b18009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3418508577 shutdown_connections 2023-11-29T11:21:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3418508577 >> v2:172.21.15.176:3300/0 conn(0x7f7b300cbb30 0x7f7b3006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3418508577 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3009bdb0 0x7f7b3015d9f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3418508577 >> 172.21.15.81:0/3418508577 conn(0x7f7b300cae70 msgr2=0x7f7b300cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3418508577 shutdown_connections 2023-11-29T11:21:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3418508577 wait complete. 2023-11-29T11:21:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 Processor -- start 2023-11-29T11:21:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- start start 2023-11-29T11:21:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3009bdb0 0x7f7b30159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b300b00e0 0x7f7b300c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b300cbb30 0x7f7b300c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015abe0 con 0x7f7b300cbb30 2023-11-29T11:21:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015aec0 con 0x7f7b3009bdb0 2023-11-29T11:21:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.499+0000 7f7b2ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015b1a0 con 0x7f7b300b00e0 2023-11-29T11:21:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b300cbb30 0x7f7b300c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b300cbb30 0x7f7b300c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50590/0 (socket says 172.21.15.81:50590) 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2f7fe700 1 -- 172.21.15.81:0/3663020792 learned_addr learned my addr 172.21.15.81:0/3663020792 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b300b00e0 0x7f7b300c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2effd700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3009bdb0 0x7f7b30159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3009bdb0 msgr2=0x7f7b30159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3009bdb0 0x7f7b30159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b300cbb30 msgr2=0x7f7b300c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b300cbb30 0x7f7b300c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3663020792 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180094b0 con 0x7f7b300b00e0 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b300cbb30 0x7f7b300c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b300b00e0 0x7f7b300c9640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b18016000 tx=0x7f7b18004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b277fe700 1 -- 172.21.15.81:0/3663020792 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180044d0 con 0x7f7b300b00e0 2023-11-29T11:21:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b277fe700 1 -- 172.21.15.81:0/3663020792 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1801e070 con 0x7f7b300b00e0 2023-11-29T11:21:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3663020792 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300ac3d0 con 0x7f7b300b00e0 2023-11-29T11:21:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b277fe700 1 -- 172.21.15.81:0/3663020792 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18003900 con 0x7f7b300b00e0 2023-11-29T11:21:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.503+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3663020792 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b300ac0f0 con 0x7f7b300b00e0 2023-11-29T11:21:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.507+0000 7f7b277fe700 1 -- 172.21.15.81:0/3663020792 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b1800f050 con 0x7f7b300b00e0 2023-11-29T11:21:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.507+0000 7f7b277fe700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7b10064ee0 0x7f7b10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.507+0000 7f7b277fe700 1 -- 172.21.15.81:0/3663020792 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f7b18082f40 con 0x7f7b300b00e0 2023-11-29T11:21:09.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.507+0000 7f7b2effd700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7b10064ee0 0x7f7b10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.507+0000 7f7b2effd700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7b10064ee0 0x7f7b10067390 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007fd0 tx=0x7f7b20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b38a5d740 1 Processor -- start 2023-11-29T11:21:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b38a5d740 1 -- start start 2023-11-29T11:21:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x230b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x230d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x230fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x21c2dc0 con 0x2053950 2023-11-29T11:21:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2232e20 con 0x209e9d0 2023-11-29T11:21:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x222c120 con 0x2053d20 2023-11-29T11:21:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x230d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x230d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50594/0 (socket says 172.21.15.81:50594) 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/651226280 learned_addr learned my addr 172.21.15.81:0/651226280 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x230fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2effd700 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x230b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 msgr2=0x230b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x230b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 msgr2=0x230fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x230fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/651226280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22529b0 con 0x2053950 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.511+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x230fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x230d970 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7b18054ad0 tx=0x7f7b18054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8786dbad330458 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b24ff9700 1 -- 172.21.15.81:0/651226280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180540f0 con 0x2053950 2023-11-29T11:21:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b24ff9700 1 -- 172.21.15.81:0/651226280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18054250 con 0x2053950 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b24ff9700 1 -- 172.21.15.81:0/651226280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180543c0 con 0x2053950 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- 172.21.15.81:0/651226280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 msgr2=0x230d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x230d970 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7b18054ad0 tx=0x7f7b18054560 comp rx=0 tx=0).stop 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- 172.21.15.81:0/651226280 shutdown_connections 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x230fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x230d970 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/651226280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x230b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- 172.21.15.81:0/651226280 >> 172.21.15.81:0/651226280 conn(0x20540f0 msgr2=0x22ece40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- 172.21.15.81:0/651226280 shutdown_connections 2023-11-29T11:21:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- 172.21.15.81:0/651226280 wait complete. 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- start start 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 Processor -- start 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 0x22ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2053d20 0x22bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x209e9d0 0x23106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x20d8d60 con 0x209e9d0 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x22c58c0 con 0x2053d20 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x22c5390 con 0x2053950 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b38a5d740 10 client.0 _ll_register_callbacks cb 0x2225a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.515+0000 7f7b2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x209e9d0 0x23106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2effd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 0x22ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x209e9d0 0x23106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50596/0 (socket says 172.21.15.81:50596) 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2f7fe700 1 -- 172.21.15.81:0/1213800075 learned_addr learned my addr 172.21.15.81:0/1213800075 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2053d20 0x22bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2f7fe700 1 -- 172.21.15.81:0/1213800075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 msgr2=0x22ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 0x22ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2f7fe700 1 -- 172.21.15.81:0/1213800075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2053d20 msgr2=0x22bbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2053d20 0x22bbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2f7fe700 1 -- 172.21.15.81:0/1213800075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b300ac0f0 con 0x209e9d0 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2053d20 0x22bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x209e9d0 0x23106b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009d90 tx=0x7f7b28007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df33af69f7bd0c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 1 -- 172.21.15.81:0/1213800075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28015420 con 0x209e9d0 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 1 -- 172.21.15.81:0/1213800075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f7b28015580 con 0x209e9d0 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 -- 172.21.15.81:0/1213800075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22251a0 con 0x209e9d0 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 1 -- 172.21.15.81:0/1213800075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b28015740 con 0x209e9d0 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 10 client.8514 fetch_fsmap learned FSMap version 60 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 -- 172.21.15.81:0/1213800075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x209fc20 con 0x209e9d0 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 1 -- 172.21.15.81:0/1213800075 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22251a0 con 0x209e9d0 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 1 -- 172.21.15.81:0/1213800075 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7b280158a0 con 0x209e9d0 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 10 client.8514 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 10 client.8514 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 20 client.8514 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x23110e0 0x22c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 4 client.8514 mds_command: new command op to 8010 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 -- 172.21.15.81:0/1213800075 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2224ec0 con 0x23110e0 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2effd700 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x23110e0 0x22c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 10 client.8514 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b2effd700 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x23110e0 0x22c4260 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ea7e7d3c82ced91 server_cookie=ea0d16adda675a83 in_seq=0 out_seq=0 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 1 -- 172.21.15.81:0/1213800075 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2224ec0 con 0x23110e0 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 10 client.8514 handle_command_reply: tid=0 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 client.8514 shutdown 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 -- 172.21.15.81:0/1213800075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x209e9d0 msgr2=0x23106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x209e9d0 0x23106b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009d90 tx=0x7f7b28007610 comp rx=0 tx=0).stop 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 -- 172.21.15.81:0/1213800075 shutdown_connections 2023-11-29T11:21:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x209e9d0 0x23106b0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2053d20 0x22bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x23110e0 0x22c4260 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/1213800075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 0x22ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 -- 172.21.15.81:0/1213800075 >> 172.21.15.81:0/1213800075 conn(0x20540f0 msgr2=0x22ebec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b0dffb700 0 client.8514 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:21:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 -- 172.21.15.81:0/1213800075 shutdown_connections 2023-11-29T11:21:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.519+0000 7f7b38a5d740 1 -- 172.21.15.81:0/1213800075 wait complete. 2023-11-29T11:21:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.523+0000 7f7b38a5d740 20 client.8514 trim_cache size 0 max 16384 2023-11-29T11:21:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b38a5d740 1 Processor -- start 2023-11-29T11:21:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b38a5d740 1 -- start start 2023-11-29T11:21:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x2312250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x22ea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x22eaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2230120 con 0x2053950 2023-11-29T11:21:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x22266a0 con 0x209e9d0 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x22264c0 con 0x2053d20 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x2312250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x2312250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50610/0 (socket says 172.21.15.81:50610) 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2effd700 1 -- 172.21.15.81:0/2565549923 learned_addr learned my addr 172.21.15.81:0/2565549923 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x22ea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x22eaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2effd700 1 -- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 msgr2=0x22ea9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2effd700 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x22ea9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2effd700 1 -- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 msgr2=0x22eaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2effd700 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x22eaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2effd700 1 -- 172.21.15.81:0/2565549923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21f2a10 con 0x2053950 2023-11-29T11:21:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x22eaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.539+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x22ea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b2effd700 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x2312250 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f7b200017c0 tx=0x7f7b20000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1264dd1f6e4f5e20 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b257fa700 1 -- 172.21.15.81:0/2565549923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000fc10 con 0x2053950 2023-11-29T11:21:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b257fa700 1 -- 172.21.15.81:0/2565549923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000fd70 con 0x2053950 2023-11-29T11:21:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b257fa700 1 -- 172.21.15.81:0/2565549923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000fee0 con 0x2053950 2023-11-29T11:21:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 -- 172.21.15.81:0/2565549923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 msgr2=0x2312250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x2312250 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f7b200017c0 tx=0x7f7b20000ed0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 -- 172.21.15.81:0/2565549923 shutdown_connections 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x22eaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053d20 0x22ea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/2565549923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053950 0x2312250 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 -- 172.21.15.81:0/2565549923 >> 172.21.15.81:0/2565549923 conn(0x20540f0 msgr2=0x2311b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 -- 172.21.15.81:0/2565549923 shutdown_connections 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 -- 172.21.15.81:0/2565549923 wait complete. 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 -- start start 2023-11-29T11:21:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.543+0000 7f7b38a5d740 1 Processor -- start 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 0x22c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053d20 0x231eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x231f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x222ec80 con 0x2053d20 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x23128e0 con 0x209e9d0 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x21d1290 con 0x2053950 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 10 client.0 _ll_register_callbacks cb 0x7f7b28009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053d20 0x231eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053d20 0x231eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50614/0 (socket says 172.21.15.81:50614) 2023-11-29T11:21:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3430354265 learned_addr learned my addr 172.21.15.81:0/3430354265 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2effd700 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 0x22c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2f7fe700 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x231f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3430354265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 msgr2=0x22c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 0x22c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3430354265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 msgr2=0x231f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x231f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 -- 172.21.15.81:0/3430354265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2001d040 con 0x2053d20 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b2e7fc700 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053d20 0x231eb30 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f7b1806c080 tx=0x7f7b1805a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bc89f6e11d17ad server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b0dffb700 1 -- 172.21.15.81:0/3430354265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180543c0 con 0x2053d20 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b0dffb700 1 -- 172.21.15.81:0/3430354265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f7b18058b60 con 0x2053d20 2023-11-29T11:21:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 -- 172.21.15.81:0/3430354265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b18054250 con 0x2053d20 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b0dffb700 1 -- 172.21.15.81:0/3430354265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b180540f0 con 0x2053d20 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 10 client.8520 fetch_fsmap learned FSMap version 60 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 -- 172.21.15.81:0/3430354265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x21d84f0 con 0x2053d20 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b0dffb700 1 -- 172.21.15.81:0/3430354265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18054250 con 0x2053d20 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b0dffb700 1 -- 172.21.15.81:0/3430354265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7b18058d20 con 0x2053d20 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 10 client.8520 fetch_fsmap finished waiting for FSMap version 60 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 10 client.8520 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 20 client.8520 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x23205b0 0x2320980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 4 client.8520 mds_command: new command op to 8010 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.547+0000 7f7b38a5d740 1 -- 172.21.15.81:0/3430354265 --> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x20d04a0 con 0x23205b0 2023-11-29T11:21:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2effd700 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x23205b0 0x2320980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b0dffb700 10 client.8520 ms_handle_connect on v2:172.21.15.81:6836/353227086 2023-11-29T11:21:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2effd700 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x23205b0 0x2320980 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e10d863cfb7d8a server_cookie=ab8303ef1ee52d34 in_seq=0 out_seq=0 2023-11-29T11:21:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b0dffb700 1 -- 172.21.15.81:0/3430354265 <== mds.0 v2:172.21.15.81:6836/353227086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+142 (crc 0 0 0) 0x20d04a0 con 0x23205b0 2023-11-29T11:21:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b0dffb700 10 client.8520 handle_command_reply: tid=0 2023-11-29T11:21:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 client.8520 shutdown 2023-11-29T11:21:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 -- 172.21.15.81:0/3430354265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053d20 msgr2=0x231eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053d20 0x231eb30 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f7b1806c080 tx=0x7f7b1805a070 comp rx=0 tx=0).stop 2023-11-29T11:21:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 -- 172.21.15.81:0/3430354265 shutdown_connections 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x209e9d0 0x231f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2053d20 0x231eb30 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.81:6836/353227086,v1:172.21.15.81:6837/353227086] conn(0x23205b0 0x2320980 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 --2- 172.21.15.81:0/3430354265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2053950 0x22c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b0dffb700 0 client.8520 ms_handle_reset on v2:172.21.15.81:6836/353227086 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 -- 172.21.15.81:0/3430354265 >> 172.21.15.81:0/3430354265 conn(0x20540f0 msgr2=0x2311ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 -- 172.21.15.81:0/3430354265 shutdown_connections 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 1 -- 172.21.15.81:0/3430354265 wait complete. 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b38a5d740 20 client.8520 trim_cache size 0 max 16384 2023-11-29T11:21:09.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:09.561 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:21:09.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:21:09.561 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2023-11-29T11:21:09.561 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 76671306, 2023-11-29T11:21:09.561 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627777, 2023-11-29T11:21:09.561 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/testdir/hardlink" 2023-11-29T11:21:09.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:21:09.561 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:21:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7b10064ee0 msgr2=0x7f7b10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7b10064ee0 0x7f7b10067390 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007fd0 tx=0x7f7b20009040 comp rx=0 tx=0).stop 2023-11-29T11:21:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b300b00e0 msgr2=0x7f7b300c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b300b00e0 0x7f7b300c9640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b18016000 tx=0x7f7b18004770 comp rx=0 tx=0).stop 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3663020792 shutdown_connections 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7b10064ee0 0x7f7b10067390 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b300cbb30 0x7f7b300c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b300b00e0 0x7f7b300c9640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 --2- 172.21.15.81:0/3663020792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3009bdb0 0x7f7b30159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3663020792 >> 172.21.15.81:0/3663020792 conn(0x7f7b300cae70 msgr2=0x7f7b300aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3663020792 shutdown_connections 2023-11-29T11:21:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.551+0000 7f7b2ffff700 1 -- 172.21.15.81:0/3663020792 wait complete. 2023-11-29T11:21:09.571 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:21:09.571 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:21:09.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:21:09.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038d443700 1 Processor -- start 2023-11-29T11:21:09.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038d443700 1 -- start start 2023-11-29T11:21:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038d443700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880727d0 0x7f038814f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038d443700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f03880c99d0 0x7f03880c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038d443700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03880ca360 con 0x7f03881585d0 2023-11-29T11:21:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038d443700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03881595e0 con 0x7f03880c99d0 2023-11-29T11:21:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038d443700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0388159300 con 0x7f03880727d0 2023-11-29T11:21:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038cc42700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03881585d0 0x7f0388158a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54098/0 (socket says 172.21.15.81:54098) 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f038cc42700 1 -- 172.21.15.81:0/2247932735 learned_addr learned my addr 172.21.15.81:0/2247932735 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f0387fff700 1 --2- 172.21.15.81:0/2247932735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880727d0 0x7f038814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.683+0000 7f03877fe700 1 --2- 172.21.15.81:0/2247932735 >> v2:172.21.15.176:3300/0 conn(0x7f03880c99d0 0x7f03880c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f0386ffd700 1 -- 172.21.15.81:0/2247932735 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163242210 0 0) 0x7f0380001490 con 0x7f03881585d0 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f0386ffd700 1 -- 172.21.15.81:0/2247932735 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03700035d0 con 0x7f03881585d0 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f03877fe700 1 -- 172.21.15.81:0/2247932735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880727d0 msgr2=0x7f038814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f03877fe700 1 --2- 172.21.15.81:0/2247932735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880727d0 0x7f038814f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f03877fe700 1 -- 172.21.15.81:0/2247932735 >> v1:172.21.15.81:6789/0 conn(0x7f03881585d0 legacy=0x7f0388158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f03877fe700 1 -- 172.21.15.81:0/2247932735 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03880cd010 con 0x7f03880c99d0 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f03877fe700 1 --2- 172.21.15.81:0/2247932735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880c99d0 0x7f03880c9e20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0378009850 tx=0x7f0378009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c0a9738c672a25d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f0386ffd700 1 -- 172.21.15.81:0/2247932735 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378010800 con 0x7f03880c99d0 2023-11-29T11:21:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f0386ffd700 1 -- 172.21.15.81:0/2247932735 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0378010960 con 0x7f03880c99d0 2023-11-29T11:21:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f0386ffd700 1 -- 172.21.15.81:0/2247932735 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378010cd0 con 0x7f03880c99d0 2023-11-29T11:21:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f038d443700 1 -- 172.21.15.81:0/2247932735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880c99d0 msgr2=0x7f03880c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f038d443700 1 --2- 172.21.15.81:0/2247932735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880c99d0 0x7f03880c9e20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0378009850 tx=0x7f0378009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f038d443700 1 -- 172.21.15.81:0/2247932735 shutdown_connections 2023-11-29T11:21:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f038d443700 1 --2- 172.21.15.81:0/2247932735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880c99d0 0x7f03880c9e20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f038d443700 1 --2- 172.21.15.81:0/2247932735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03880727d0 0x7f038814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f038d443700 1 -- 172.21.15.81:0/2247932735 >> 172.21.15.81:0/2247932735 conn(0x7f03880cb2d0 msgr2=0x7f03880cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f038d443700 1 -- 172.21.15.81:0/2247932735 shutdown_connections 2023-11-29T11:21:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.687+0000 7f038d443700 1 -- 172.21.15.81:0/2247932735 wait complete. 2023-11-29T11:21:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.691+0000 7f038d443700 1 Processor -- start 2023-11-29T11:21:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.691+0000 7f038d443700 1 -- start start 2023-11-29T11:21:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.691+0000 7f038d443700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880727d0 0x7f0388071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.691+0000 7f038d443700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03880c99d0 0x7f0388146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.691+0000 7f038d443700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03881585d0 0x7f0388147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.691+0000 7f038d443700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0388150c90 con 0x7f03880c99d0 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f038d443700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0388150420 con 0x7f03880727d0 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f038d443700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0388150700 con 0x7f03881585d0 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03880c99d0 0x7f0388146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03880c99d0 0x7f0388146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50626/0 (socket says 172.21.15.81:50626) 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 -- 172.21.15.81:0/4131678514 learned_addr learned my addr 172.21.15.81:0/4131678514 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f0387fff700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880727d0 0x7f0388071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f038cc42700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03881585d0 0x7f0388147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 -- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03881585d0 msgr2=0x7f0388147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03881585d0 0x7f0388147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 -- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880727d0 msgr2=0x7f0388071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880727d0 0x7f0388071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 -- 172.21.15.81:0/4131678514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780094b0 con 0x7f03880c99d0 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f0387fff700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880727d0 0x7f0388071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f03877fe700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03880c99d0 0x7f0388146ed0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f03780090b0 tx=0x7f0378004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f0384ff9700 1 -- 172.21.15.81:0/4131678514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037801c040 con 0x7f03880c99d0 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f0384ff9700 1 -- 172.21.15.81:0/4131678514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03780038e0 con 0x7f03880c99d0 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03880cd5d0 con 0x7f03880c99d0 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f0384ff9700 1 -- 172.21.15.81:0/4131678514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378003c90 con 0x7f03880c99d0 2023-11-29T11:21:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03880cd2f0 con 0x7f03880c99d0 2023-11-29T11:21:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03880cdaf0 con 0x7f03880c99d0 2023-11-29T11:21:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.695+0000 7f0384ff9700 1 -- 172.21.15.81:0/4131678514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f037800e040 con 0x7f03880c99d0 2023-11-29T11:21:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.699+0000 7f0384ff9700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0374064ee0 0x7f0374067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.699+0000 7f0384ff9700 1 -- 172.21.15.81:0/4131678514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f0378083ab0 con 0x7f03880c99d0 2023-11-29T11:21:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.699+0000 7f0387fff700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0374064ee0 0x7f0374067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.699+0000 7f0387fff700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0374064ee0 0x7f0374067390 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f037c009c40 tx=0x7f037c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.703+0000 7f0384ff9700 1 -- 172.21.15.81:0/4131678514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f03780519c0 con 0x7f03880c99d0 2023-11-29T11:21:09.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.867+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0388072500 con 0x7f03880c99d0 2023-11-29T11:21:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.871+0000 7f0384ff9700 1 -- 172.21.15.81:0/4131678514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18100 (secure 0 0 0) 0x7f0378054fe0 con 0x7f03880c99d0 2023-11-29T11:21:09.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:09.878 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:19:58.895482+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6833/1691706444":"2023-11-30T11:19:58.895424+0000","172.21.15.176:6832/1691706444":"2023-11-30T11:19:58.895424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:21:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0374064ee0 msgr2=0x7f0374067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0374064ee0 0x7f0374067390 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f037c009c40 tx=0x7f037c008040 comp rx=0 tx=0).stop 2023-11-29T11:21:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03880c99d0 msgr2=0x7f0388146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03880c99d0 0x7f0388146ed0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f03780090b0 tx=0x7f0378004770 comp rx=0 tx=0).stop 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 shutdown_connections 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0374064ee0 0x7f0374067390 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03881585d0 0x7f0388147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03880c99d0 0x7f0388146ed0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 --2- 172.21.15.81:0/4131678514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03880727d0 0x7f0388071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 >> 172.21.15.81:0/4131678514 conn(0x7f03880cb2d0 msgr2=0x7f038815a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 shutdown_connections 2023-11-29T11:21:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:09.875+0000 7f038d443700 1 -- 172.21.15.81:0/4131678514 wait complete. 2023-11-29T11:21:09.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:19:38.262251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:19:38.644298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:21:09.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:21:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.007+0000 7f5f2220c700 1 Processor -- start 2023-11-29T11:21:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.007+0000 7f5f2220c700 1 -- start start 2023-11-29T11:21:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5f1c0ce230 0x7f5f1c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f1c0cd5d0 0x7f5f1c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c06d1c0 con 0x7f5f1c158ee0 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c06e000 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c0ca3a0 con 0x7f5f1c0ce230 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2120a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5f1c158ee0 0x7f5f1c0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33452/0 (socket says 172.21.15.81:33452) 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f21a0b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f1c0cd5d0 0x7f5f1c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2120a700 1 -- 172.21.15.81:0/1973059062 learned_addr learned my addr 172.21.15.81:0/1973059062 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f20a09700 1 --2- 172.21.15.81:0/1973059062 >> v2:172.21.15.176:3300/0 conn(0x7f5f1c0ce230 0x7f5f1c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f13fff700 1 -- 172.21.15.81:0/1973059062 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853713851 0 0) 0x7f5f18001490 con 0x7f5f1c158ee0 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f13fff700 1 -- 172.21.15.81:0/1973059062 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f080035d0 con 0x7f5f1c158ee0 2023-11-29T11:21:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f21a0b700 1 -- 172.21.15.81:0/1973059062 >> v2:172.21.15.176:3300/0 conn(0x7f5f1c0ce230 msgr2=0x7f5f1c0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f21a0b700 1 --2- 172.21.15.81:0/1973059062 >> v2:172.21.15.176:3300/0 conn(0x7f5f1c0ce230 0x7f5f1c0ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f21a0b700 1 -- 172.21.15.81:0/1973059062 >> v1:172.21.15.81:6789/0 conn(0x7f5f1c158ee0 legacy=0x7f5f1c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f21a0b700 1 -- 172.21.15.81:0/1973059062 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c06c920 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f21a0b700 1 --2- 172.21.15.81:0/1973059062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c0cab60 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c066160 tx=0x7f5f14009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33502f29dd50d813 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f13fff700 1 -- 172.21.15.81:0/1973059062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14011830 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f13fff700 1 -- 172.21.15.81:0/1973059062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f14011990 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f13fff700 1 -- 172.21.15.81:0/1973059062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14011d20 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 -- 172.21.15.81:0/1973059062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 msgr2=0x7f5f1c0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 --2- 172.21.15.81:0/1973059062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c0cab60 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c066160 tx=0x7f5f14009b30 comp rx=0 tx=0).stop 2023-11-29T11:21:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 -- 172.21.15.81:0/1973059062 shutdown_connections 2023-11-29T11:21:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 --2- 172.21.15.81:0/1973059062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c0cab60 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 --2- 172.21.15.81:0/1973059062 >> v2:172.21.15.176:3300/0 conn(0x7f5f1c0ce230 0x7f5f1c0ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 -- 172.21.15.81:0/1973059062 >> 172.21.15.81:0/1973059062 conn(0x7f5f1c0d0240 msgr2=0x7f5f1c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 -- 172.21.15.81:0/1973059062 shutdown_connections 2023-11-29T11:21:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.011+0000 7f5f2220c700 1 -- 172.21.15.81:0/1973059062 wait complete. 2023-11-29T11:21:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.015+0000 7f5f2220c700 1 Processor -- start 2023-11-29T11:21:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.015+0000 7f5f2220c700 1 -- start start 2023-11-29T11:21:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c14a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1c0ce230 0x7f5f1c145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1c158ee0 0x7f5f1c165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c1665b0 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c14aa30 con 0x7f5f1c0ce230 2023-11-29T11:21:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c165c80 con 0x7f5f1c158ee0 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c14a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c14a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55046/0 (socket says 172.21.15.81:55046) 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 -- 172.21.15.81:0/3739046916 learned_addr learned my addr 172.21.15.81:0/3739046916 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f20a09700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1c0ce230 0x7f5f1c145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f21a0b700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1c158ee0 0x7f5f1c165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 -- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1c158ee0 msgr2=0x7f5f1c165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1c158ee0 0x7f5f1c165360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 -- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1c0ce230 msgr2=0x7f5f1c145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1c0ce230 0x7f5f1c145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 -- 172.21.15.81:0/3739046916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140094b0 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f21a0b700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1c158ee0 0x7f5f1c165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f20a09700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1c0ce230 0x7f5f1c145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2120a700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c14a400 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800cbc0 tx=0x7f5f1800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f11ffb700 1 -- 172.21.15.81:0/3739046916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1800a9e0 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c06cee0 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f11ffb700 1 -- 172.21.15.81:0/3739046916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1800ab40 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f11ffb700 1 -- 172.21.15.81:0/3739046916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18012400 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c06cc00 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c0ca640 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.019+0000 7f5f11ffb700 1 -- 172.21.15.81:0/3739046916 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f18019030 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.023+0000 7f5f11ffb700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064f10 0x7f5f000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.023+0000 7f5f11ffb700 1 -- 172.21.15.81:0/3739046916 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f5f180818e0 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.023+0000 7f5f20a09700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064f10 0x7f5f000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.023+0000 7f5f20a09700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064f10 0x7f5f000673c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c1492b0 tx=0x7f5f0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.027+0000 7f5f11ffb700 1 -- 172.21.15.81:0/3739046916 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f1804f860 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.187+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f1c06d1c0 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.187+0000 7f5f11ffb700 1 -- 172.21.15.81:0/3739046916 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f1c06d1c0 con 0x7f5f1c0cd5d0 2023-11-29T11:21:10.194 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:21:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064f10 msgr2=0x7f5f000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064f10 0x7f5f000673c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c1492b0 tx=0x7f5f0c008040 comp rx=0 tx=0).stop 2023-11-29T11:21:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 msgr2=0x7f5f1c14a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c14a400 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800cbc0 tx=0x7f5f1800cca0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 shutdown_connections 2023-11-29T11:21:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f00064f10 0x7f5f000673c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1c158ee0 0x7f5f1c165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f1c0ce230 0x7f5f1c145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 --2- 172.21.15.81:0/3739046916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f1c0cd5d0 0x7f5f1c14a400 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 >> 172.21.15.81:0/3739046916 conn(0x7f5f1c0d0240 msgr2=0x7f5f1c0b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 shutdown_connections 2023-11-29T11:21:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.191+0000 7f5f2220c700 1 -- 172.21.15.81:0/3739046916 wait complete. 2023-11-29T11:21:10.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:21:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f334a4da700 1 Processor -- start 2023-11-29T11:21:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f334a4da700 1 -- start start 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f334a4da700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f33440c9c00 0x7f334406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f334a4da700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334406f990 con 0x7f334415c160 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f334a4da700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334406ee90 con 0x7f334406ea10 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f334a4da700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334406a4d0 con 0x7f33440c9c00 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f33494d8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f33440c9c00 0x7f334406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f33494d8700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f33440c9c00 0x7f334406cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55058/0 (socket says 172.21.15.81:55058) 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f33494d8700 1 -- 172.21.15.81:0/285152837 learned_addr learned my addr 172.21.15.81:0/285152837 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f3348cd7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f334415c160 0x7f33440c9fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33458/0 (socket says 172.21.15.81:33458) 2023-11-29T11:21:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f33494d8700 1 -- 172.21.15.81:0/285152837 >> v1:172.21.15.176:6789/0 conn(0x7f334406ea10 legacy=0x7f33440cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f33494d8700 1 -- 172.21.15.81:0/285152837 >> v1:172.21.15.81:6789/0 conn(0x7f334415c160 legacy=0x7f33440c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f3337fff700 1 -- 172.21.15.81:0/285152837 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006925660 0 0) 0x7f334406f990 con 0x7f334415c160 2023-11-29T11:21:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f33494d8700 1 -- 172.21.15.81:0/285152837 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334406f0f0 con 0x7f33440c9c00 2023-11-29T11:21:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f33494d8700 1 --2- 172.21.15.81:0/285152837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f334406cd30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f3340009e50 tx=0x7f334000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693b6adb52dca87d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f3337fff700 1 -- 172.21.15.81:0/285152837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000e070 con 0x7f33440c9c00 2023-11-29T11:21:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f3337fff700 1 -- 172.21.15.81:0/285152837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334000b9c0 con 0x7f33440c9c00 2023-11-29T11:21:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.323+0000 7f3337fff700 1 -- 172.21.15.81:0/285152837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000bd70 con 0x7f33440c9c00 2023-11-29T11:21:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- 172.21.15.81:0/285152837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 msgr2=0x7f334406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 --2- 172.21.15.81:0/285152837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f334406cd30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f3340009e50 tx=0x7f334000b330 comp rx=0 tx=0).stop 2023-11-29T11:21:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- 172.21.15.81:0/285152837 shutdown_connections 2023-11-29T11:21:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 --2- 172.21.15.81:0/285152837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f334406cd30 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- 172.21.15.81:0/285152837 >> 172.21.15.81:0/285152837 conn(0x7f33440d0240 msgr2=0x7f33440cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- 172.21.15.81:0/285152837 shutdown_connections 2023-11-29T11:21:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- 172.21.15.81:0/285152837 wait complete. 2023-11-29T11:21:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 Processor -- start 2023-11-29T11:21:10.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- start start 2023-11-29T11:21:10.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f334406ea10 0x7f33440c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f3344071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f334415c160 0x7f3344071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c9690 con 0x7f33440c9c00 2023-11-29T11:21:10.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c30e0 con 0x7f334415c160 2023-11-29T11:21:10.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f334a4da700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c93b0 con 0x7f334406ea10 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f3348cd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f3344071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.327+0000 7f3348cd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f3344071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55074/0 (socket says 172.21.15.81:55074) 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3348cd7700 1 -- 172.21.15.81:0/3790313257 learned_addr learned my addr 172.21.15.81:0/3790313257 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3349cd9700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f334415c160 0x7f3344071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f33494d8700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f334406ea10 0x7f33440c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3348cd7700 1 -- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f334406ea10 msgr2=0x7f33440c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3348cd7700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f334406ea10 0x7f33440c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3348cd7700 1 -- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f334415c160 msgr2=0x7f3344071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3348cd7700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f334415c160 0x7f3344071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3348cd7700 1 -- 172.21.15.81:0/3790313257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340009b30 con 0x7f33440c9c00 2023-11-29T11:21:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3349cd9700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f334415c160 0x7f3344071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:21:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f33494d8700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f334406ea10 0x7f33440c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:21:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3348cd7700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f3344071750 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f333800c520 tx=0x7f333800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3335ffb700 1 -- 172.21.15.81:0/3790313257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338004ca0 con 0x7f33440c9c00 2023-11-29T11:21:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3335ffb700 1 -- 172.21.15.81:0/3790313257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338004e00 con 0x7f33440c9c00 2023-11-29T11:21:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3335ffb700 1 -- 172.21.15.81:0/3790313257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380072f0 con 0x7f33440c9c00 2023-11-29T11:21:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334406f6b0 con 0x7f33440c9c00 2023-11-29T11:21:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334406f3d0 con 0x7f33440c9c00 2023-11-29T11:21:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33440cd910 con 0x7f33440c9c00 2023-11-29T11:21:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3335ffb700 1 -- 172.21.15.81:0/3790313257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f333801a020 con 0x7f33440c9c00 2023-11-29T11:21:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.331+0000 7f3335ffb700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3328064ee0 0x7f3328067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.335+0000 7f3335ffb700 1 -- 172.21.15.81:0/3790313257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f3338081c20 con 0x7f33440c9c00 2023-11-29T11:21:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.335+0000 7f33494d8700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3328064ee0 0x7f3328067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.335+0000 7f33494d8700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3328064ee0 0x7f3328067390 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3340000f80 tx=0x7f3340009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.339+0000 7f3335ffb700 1 -- 172.21.15.81:0/3790313257 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f333804fc20 con 0x7f33440c9c00 2023-11-29T11:21:10.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.499+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3344144690 con 0x7f33440c9c00 2023-11-29T11:21:10.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.499+0000 7f3335ffb700 1 -- 172.21.15.81:0/3790313257 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3344144690 con 0x7f33440c9c00 2023-11-29T11:21:10.506 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:21:10.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3328064ee0 msgr2=0x7f3328067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3328064ee0 0x7f3328067390 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3340000f80 tx=0x7f3340009000 comp rx=0 tx=0).stop 2023-11-29T11:21:10.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 msgr2=0x7f3344071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f3344071750 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f333800c520 tx=0x7f333800c8e0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 shutdown_connections 2023-11-29T11:21:10.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3328064ee0 0x7f3328067390 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f334415c160 0x7f3344071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33440c9c00 0x7f3344071750 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 --2- 172.21.15.81:0/3790313257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f334406ea10 0x7f33440c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 >> 172.21.15.81:0/3790313257 conn(0x7f33440d0240 msgr2=0x7f33440b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:10.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 shutdown_connections 2023-11-29T11:21:10.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.503+0000 7f334a4da700 1 -- 172.21.15.81:0/3790313257 wait complete. 2023-11-29T11:21:10.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:21:10.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.631+0000 7f1ac1cf5700 1 Processor -- start 2023-11-29T11:21:10.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.631+0000 7f1ac1cf5700 1 -- start start 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1abc06e000 0x7f1abc06e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1abc06d5b0 con 0x7f1abc06e990 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1abc06b5e0 con 0x7f1abc06e000 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0d0580 con 0x7f1abc15c410 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abaffd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1abc06e000 0x7f1abc06e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abb7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abbfff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f1abc06e990 0x7f1abc15ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:56376/0 (socket says 172.21.15.81:56376) 2023-11-29T11:21:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abbfff700 1 -- 172.21.15.81:0/3009877011 learned_addr learned my addr 172.21.15.81:0/3009877011 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1aba7fc700 1 -- 172.21.15.81:0/3009877011 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292061825 0 0) 0x7f1abc06d5b0 con 0x7f1abc06e990 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1aba7fc700 1 -- 172.21.15.81:0/3009877011 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa40035d0 con 0x7f1abc06e990 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abaffd700 1 -- 172.21.15.81:0/3009877011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 msgr2=0x7f1abc0d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abaffd700 1 --2- 172.21.15.81:0/3009877011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abaffd700 1 -- 172.21.15.81:0/3009877011 >> v1:172.21.15.176:6789/0 conn(0x7f1abc06e990 legacy=0x7f1abc15ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abaffd700 1 -- 172.21.15.81:0/3009877011 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc0ce440 con 0x7f1abc06e000 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abb7fe700 1 --2- 172.21.15.81:0/3009877011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1abaffd700 1 --2- 172.21.15.81:0/3009877011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 0x7f1abc06e450 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009850 tx=0x7f1aac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52e81b5d3d1a1d2b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1aba7fc700 1 -- 172.21.15.81:0/3009877011 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac011830 con 0x7f1abc06e000 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1aba7fc700 1 -- 172.21.15.81:0/3009877011 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac011990 con 0x7f1abc06e000 2023-11-29T11:21:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1aba7fc700 1 -- 172.21.15.81:0/3009877011 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac011d40 con 0x7f1abc06e000 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/3009877011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 msgr2=0x7f1abc06e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/3009877011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 0x7f1abc06e450 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009850 tx=0x7f1aac009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/3009877011 shutdown_connections 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/3009877011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 0x7f1abc06e450 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/3009877011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/3009877011 >> 172.21.15.81:0/3009877011 conn(0x7f1abc0cdf80 msgr2=0x7f1abc0d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/3009877011 shutdown_connections 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.635+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/3009877011 wait complete. 2023-11-29T11:21:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 Processor -- start 2023-11-29T11:21:10.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 -- start start 2023-11-29T11:21:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 0x7f1abc157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06e990 0x7f1abc0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0b31f0 con 0x7f1abc06e990 2023-11-29T11:21:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0b26b0 con 0x7f1abc06e000 2023-11-29T11:21:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc1582c0 con 0x7f1abc15c410 2023-11-29T11:21:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06e990 0x7f1abc0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06e990 0x7f1abc0b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55084/0 (socket says 172.21.15.81:55084) 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 -- 172.21.15.81:0/708666904 learned_addr learned my addr 172.21.15.81:0/708666904 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abbfff700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abb7fe700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 0x7f1abc157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 -- 172.21.15.81:0/708666904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 msgr2=0x7f1abc0b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 -- 172.21.15.81:0/708666904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 msgr2=0x7f1abc157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 0x7f1abc157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 -- 172.21.15.81:0/708666904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00094b0 con 0x7f1abc06e990 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1abaffd700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06e990 0x7f1abc0b09a0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0090b0 tx=0x7f1aac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1aa3fff700 1 -- 172.21.15.81:0/708666904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac004380 con 0x7f1abc06e990 2023-11-29T11:21:10.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac0094b0 con 0x7f1abc06e990 2023-11-29T11:21:10.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1aa3fff700 1 -- 172.21.15.81:0/708666904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac01f070 con 0x7f1abc06e990 2023-11-29T11:21:10.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1aa3fff700 1 -- 172.21.15.81:0/708666904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0036c0 con 0x7f1abc06e990 2023-11-29T11:21:10.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.639+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc0cea00 con 0x7f1abc06e990 2023-11-29T11:21:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.643+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc0ce720 con 0x7f1abc06e990 2023-11-29T11:21:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.643+0000 7f1aa3fff700 1 -- 172.21.15.81:0/708666904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1aac02a020 con 0x7f1abc06e990 2023-11-29T11:21:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.643+0000 7f1aa3fff700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1aa8064ee0 0x7f1aa8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.643+0000 7f1aa3fff700 1 -- 172.21.15.81:0/708666904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f1aac083570 con 0x7f1abc06e990 2023-11-29T11:21:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.643+0000 7f1abb7fe700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1aa8064ee0 0x7f1aa8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.643+0000 7f1abb7fe700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1aa8064ee0 0x7f1aa8067390 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009c70 tx=0x7f1ab0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.651+0000 7f1aa3fff700 1 -- 172.21.15.81:0/708666904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1aac0514f0 con 0x7f1abc06e990 2023-11-29T11:21:10.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.807+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1abc072500 con 0x7f1abc06e990 2023-11-29T11:21:10.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.807+0000 7f1aa3fff700 1 -- 172.21.15.81:0/708666904 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1aac054b10 con 0x7f1abc06e990 2023-11-29T11:21:10.814 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1aa8064ee0 msgr2=0x7f1aa8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1aa8064ee0 0x7f1aa8067390 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009c70 tx=0x7f1ab0008040 comp rx=0 tx=0).stop 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06e990 msgr2=0x7f1abc0b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06e990 0x7f1abc0b09a0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0090b0 tx=0x7f1aac004770 comp rx=0 tx=0).stop 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 shutdown_connections 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1aa8064ee0 0x7f1aa8067390 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1abc15c410 0x7f1abc0b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1abc06e990 0x7f1abc0b09a0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 --2- 172.21.15.81:0/708666904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc06e000 0x7f1abc157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 >> 172.21.15.81:0/708666904 conn(0x7f1abc0cdf80 msgr2=0x7f1abc15a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 shutdown_connections 2023-11-29T11:21:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.811+0000 7f1ac1cf5700 1 -- 172.21.15.81:0/708666904 wait complete. 2023-11-29T11:21:10.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:21:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f33708e2700 1 Processor -- start 2023-11-29T11:21:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f33708e2700 1 -- start start 2023-11-29T11:21:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f33708e2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f33708e2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f336c06a4c0 0x7f336c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f33708e2700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c06a9c0 con 0x7f336c0cf0e0 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f33708e2700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c06aca0 con 0x7f336c06a4c0 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f33708e2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c06af80 con 0x7f336c0b1ae0 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f336c06a4c0 0x7f336c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f336c06a4c0 0x7f336c0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55098/0 (socket says 172.21.15.81:55098) 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336a59c700 1 -- 172.21.15.81:0/3015983530 learned_addr learned my addr 172.21.15.81:0/3015983530 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336ad9d700 1 --2- 172.21.15.81:0/3015983530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336a59c700 1 -- 172.21.15.81:0/3015983530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 msgr2=0x7f336c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336a59c700 1 --2- 172.21.15.81:0/3015983530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336a59c700 1 -- 172.21.15.81:0/3015983530 >> v1:172.21.15.176:6789/0 conn(0x7f336c0cf0e0 legacy=0x7f336c0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336a59c700 1 -- 172.21.15.81:0/3015983530 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0b4380 con 0x7f336c06a4c0 2023-11-29T11:21:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f336a59c700 1 --2- 172.21.15.81:0/3015983530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c06a4c0 0x7f336c0d03a0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f3360009910 tx=0x7f3360009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7b85bfbd26fada server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f3369d9b700 1 -- 172.21.15.81:0/3015983530 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360004230 con 0x7f336c06a4c0 2023-11-29T11:21:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f3369d9b700 1 -- 172.21.15.81:0/3015983530 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3360004390 con 0x7f336c06a4c0 2023-11-29T11:21:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.947+0000 7f3369d9b700 1 -- 172.21.15.81:0/3015983530 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360009e60 con 0x7f336c06a4c0 2023-11-29T11:21:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- 172.21.15.81:0/3015983530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c06a4c0 msgr2=0x7f336c0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 --2- 172.21.15.81:0/3015983530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c06a4c0 0x7f336c0d03a0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f3360009910 tx=0x7f3360009c20 comp rx=0 tx=0).stop 2023-11-29T11:21:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- 172.21.15.81:0/3015983530 shutdown_connections 2023-11-29T11:21:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 --2- 172.21.15.81:0/3015983530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c06a4c0 0x7f336c0d03a0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 --2- 172.21.15.81:0/3015983530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- 172.21.15.81:0/3015983530 >> 172.21.15.81:0/3015983530 conn(0x7f336c09bbd0 msgr2=0x7f336c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- 172.21.15.81:0/3015983530 shutdown_connections 2023-11-29T11:21:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- 172.21.15.81:0/3015983530 wait complete. 2023-11-29T11:21:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 Processor -- start 2023-11-29T11:21:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- start start 2023-11-29T11:21:10.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336c06a4c0 0x7f336c1f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c0d2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c0cf0e0 0x7f336c0d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0c7980 con 0x7f336c0cf0e0 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0c7c60 con 0x7f336c06a4c0 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f33708e2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0c7f40 con 0x7f336c0b1ae0 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c0cf0e0 0x7f336c0d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c0cf0e0 0x7f336c0d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55108/0 (socket says 172.21.15.81:55108) 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336b59e700 1 -- 172.21.15.81:0/1880596712 learned_addr learned my addr 172.21.15.81:0/1880596712 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336a59c700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c0d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336ad9d700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336c06a4c0 0x7f336c1f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336b59e700 1 -- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 msgr2=0x7f336c0d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336b59e700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c0d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336b59e700 1 -- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336c06a4c0 msgr2=0x7f336c1f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.951+0000 7f336b59e700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336c06a4c0 0x7f336c1f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f336b59e700 1 -- 172.21.15.81:0/1880596712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3360009570 con 0x7f336c0cf0e0 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f336a59c700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c0d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f336ad9d700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336c06a4c0 0x7f336c1f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f336b59e700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c0cf0e0 0x7f336c0d2da0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f336400cc10 tx=0x7f336400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33537fe700 1 -- 172.21.15.81:0/1880596712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400abb0 con 0x7f336c0cf0e0 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33537fe700 1 -- 172.21.15.81:0/1880596712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336400ad10 con 0x7f336c0cf0e0 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c0b60e0 con 0x7f336c0cf0e0 2023-11-29T11:21:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33537fe700 1 -- 172.21.15.81:0/1880596712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364012660 con 0x7f336c0cf0e0 2023-11-29T11:21:10.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c0b1eb0 con 0x7f336c0cf0e0 2023-11-29T11:21:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c0d08e0 con 0x7f336c0cf0e0 2023-11-29T11:21:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33537fe700 1 -- 172.21.15.81:0/1880596712 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3364022070 con 0x7f336c0cf0e0 2023-11-29T11:21:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33537fe700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3358064f10 0x7f33580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f33537fe700 1 -- 172.21.15.81:0/1880596712 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f33640827b0 con 0x7f336c0cf0e0 2023-11-29T11:21:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.955+0000 7f336ad9d700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3358064f10 0x7f33580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.959+0000 7f336ad9d700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3358064f10 0x7f33580673c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f335c007a70 tx=0x7f335c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:10.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:10.963+0000 7f33537fe700 1 -- 172.21.15.81:0/1880596712 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f33640506d0 con 0x7f336c0cf0e0 2023-11-29T11:21:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.123+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f336c072500 con 0x7f336c0cf0e0 2023-11-29T11:21:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.123+0000 7f33537fe700 1 -- 172.21.15.81:0/1880596712 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3364053cf0 con 0x7f336c0cf0e0 2023-11-29T11:21:11.130 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:21:11.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3358064f10 msgr2=0x7f33580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3358064f10 0x7f33580673c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f335c007a70 tx=0x7f335c008040 comp rx=0 tx=0).stop 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c0cf0e0 msgr2=0x7f336c0d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c0cf0e0 0x7f336c0d2da0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f336400cc10 tx=0x7f336400a060 comp rx=0 tx=0).stop 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 shutdown_connections 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3358064f10 0x7f33580673c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f336c0cf0e0 0x7f336c0d2da0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f336c0b1ae0 0x7f336c0d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 --2- 172.21.15.81:0/1880596712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f336c06a4c0 0x7f336c1f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 >> 172.21.15.81:0/1880596712 conn(0x7f336c09bbd0 msgr2=0x7f336c15be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 shutdown_connections 2023-11-29T11:21:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.127+0000 7f33708e2700 1 -- 172.21.15.81:0/1880596712 wait complete. 2023-11-29T11:21:11.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:21:11.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bec80700 1 Processor -- start 2023-11-29T11:21:11.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bec80700 1 -- start start 2023-11-29T11:21:11.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bec80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b8071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bec80700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f57b8069c40 0x7f57b80cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bec80700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b80cc420 con 0x7f57b80b0c30 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bec80700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80cc6c0 con 0x7f57b8069c40 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bec80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80cc9a0 con 0x7f57b8160680 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bd21d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f57b80b0c30 0x7f57b80c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33472/0 (socket says 172.21.15.81:33472) 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bd21d700 1 -- 172.21.15.81:0/769475801 learned_addr learned my addr 172.21.15.81:0/769475801 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57b7fff700 1 --2- 172.21.15.81:0/769475801 >> v2:172.21.15.176:3300/0 conn(0x7f57b8069c40 0x7f57b80cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bca1c700 1 --2- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b8071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57b77fe700 1 -- 172.21.15.81:0/769475801 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46523683 0 0) 0x7f57b80cc420 con 0x7f57b80b0c30 2023-11-29T11:21:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57b77fe700 1 -- 172.21.15.81:0/769475801 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a40035d0 con 0x7f57b80b0c30 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57b7fff700 1 -- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 msgr2=0x7f57b8071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57b7fff700 1 --2- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b8071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57b7fff700 1 -- 172.21.15.81:0/769475801 >> v1:172.21.15.81:6789/0 conn(0x7f57b80b0c30 legacy=0x7f57b80c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57b7fff700 1 -- 172.21.15.81:0/769475801 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80705c0 con 0x7f57b8069c40 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57bca1c700 1 --2- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b8071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.259+0000 7f57b7fff700 1 --2- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b8069c40 0x7f57b80cced0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009d90 tx=0x7f57a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=822ee07e1e6faf80 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57b77fe700 1 -- 172.21.15.81:0/769475801 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a800e070 con 0x7f57b8069c40 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57b77fe700 1 -- 172.21.15.81:0/769475801 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a800bb20 con 0x7f57b8069c40 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57b77fe700 1 -- 172.21.15.81:0/769475801 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a800be90 con 0x7f57b8069c40 2023-11-29T11:21:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b8069c40 msgr2=0x7f57b80cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 --2- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b8069c40 0x7f57b80cced0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009d90 tx=0x7f57a800b330 comp rx=0 tx=0).stop 2023-11-29T11:21:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- 172.21.15.81:0/769475801 shutdown_connections 2023-11-29T11:21:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 --2- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b8069c40 0x7f57b80cced0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 --2- 172.21.15.81:0/769475801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b8071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- 172.21.15.81:0/769475801 >> 172.21.15.81:0/769475801 conn(0x7f57b806caf0 msgr2=0x7f57b80ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- 172.21.15.81:0/769475801 shutdown_connections 2023-11-29T11:21:11.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- 172.21.15.81:0/769475801 wait complete. 2023-11-29T11:21:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 Processor -- start 2023-11-29T11:21:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- start start 2023-11-29T11:21:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8069c40 0x7f57b80b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b80b0c30 0x7f57b80c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b814e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80c67d0 con 0x7f57b8069c40 2023-11-29T11:21:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80c69e0 con 0x7f57b80b0c30 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bec80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80c6cc0 con 0x7f57b8160680 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8069c40 0x7f57b80b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8069c40 0x7f57b80b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55110/0 (socket says 172.21.15.81:55110) 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 -- 172.21.15.81:0/2056026113 learned_addr learned my addr 172.21.15.81:0/2056026113 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bd21d700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57b7fff700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b80b0c30 0x7f57b80c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 -- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 msgr2=0x7f57b814e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b814e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 -- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b80b0c30 msgr2=0x7f57b80c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b80b0c30 0x7f57b80c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 -- 172.21.15.81:0/2056026113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00094b0 con 0x7f57b8069c40 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57b7fff700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b80b0c30 0x7f57b80c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57bca1c700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8069c40 0x7f57b80b3240 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f57a000ebe0 tx=0x7f57a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.263+0000 7f57b57fa700 1 -- 172.21.15.81:0/2056026113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000c8b0 con 0x7f57b8069c40 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.267+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a8009a70 con 0x7f57b8069c40 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.267+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b80c9750 con 0x7f57b8069c40 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.267+0000 7f57b57fa700 1 -- 172.21.15.81:0/2056026113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0005a40 con 0x7f57b8069c40 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.267+0000 7f57b57fa700 1 -- 172.21.15.81:0/2056026113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0005db0 con 0x7f57b8069c40 2023-11-29T11:21:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.267+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c005310 con 0x7f57b8069c40 2023-11-29T11:21:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.267+0000 7f57b57fa700 1 -- 172.21.15.81:0/2056026113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f57a0019030 con 0x7f57b8069c40 2023-11-29T11:21:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.267+0000 7f57b57fa700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.267+0000 7f57b57fa700 1 -- 172.21.15.81:0/2056026113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f57a0082890 con 0x7f57b8069c40 2023-11-29T11:21:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.271+0000 7f57b7fff700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.271+0000 7f57b7fff700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f57a800b370 tx=0x7f57a8011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.271+0000 7f57b57fa700 1 -- 172.21.15.81:0/2056026113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f57a0050740 con 0x7f57b8069c40 2023-11-29T11:21:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.443+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f579c005890 con 0x7f57b8069c40 2023-11-29T11:21:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.443+0000 7f57b57fa700 1 -- 172.21.15.81:0/2056026113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v97) v1 ==== 80+0+124 (secure 0 0 0) 0x7f57a0021090 con 0x7f57b8069c40 2023-11-29T11:21:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.176:6833/1691706444 2023-11-30T11:19:58.895424+0000 2023-11-29T11:21:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.176:6832/1691706444 2023-11-30T11:19:58.895424+0000 2023-11-29T11:21:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 msgr2=0x7f5798067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f57a800b370 tx=0x7f57a8011000 comp rx=0 tx=0).stop 2023-11-29T11:21:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8069c40 msgr2=0x7f57b80b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8069c40 0x7f57b80b3240 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f57a000ebe0 tx=0x7f57a0009e30 comp rx=0 tx=0).stop 2023-11-29T11:21:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 shutdown_connections 2023-11-29T11:21:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5798064ee0 0x7f5798067390 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57b8160680 0x7f57b814e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57b80b0c30 0x7f57b80c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 --2- 172.21.15.81:0/2056026113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8069c40 0x7f57b80b3240 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 >> 172.21.15.81:0/2056026113 conn(0x7f57b806caf0 msgr2=0x7f57b80c36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 shutdown_connections 2023-11-29T11:21:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.447+0000 7f57bec80700 1 -- 172.21.15.81:0/2056026113 wait complete. 2023-11-29T11:21:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:listed 2 entries 2023-11-29T11:21:11.464 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:21:11.464 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:21:11.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:21:11.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafd284700 1 Processor -- start 2023-11-29T11:21:11.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafd284700 1 -- start start 2023-11-29T11:21:11.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafd284700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf8159e70 0x7ffaf806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafd284700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffaf80cb470 0x7ffaf80c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafd284700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf806ace0 con 0x7ffaf8069c40 2023-11-29T11:21:11.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafd284700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf806a0d0 con 0x7ffaf80cb470 2023-11-29T11:21:11.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafd284700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf806a3b0 con 0x7ffaf8159e70 2023-11-29T11:21:11.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafca83700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffaf80cb470 0x7ffaf80c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafca83700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffaf80cb470 0x7ffaf80c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55116/0 (socket says 172.21.15.81:55116) 2023-11-29T11:21:11.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafca83700 1 -- 172.21.15.81:0/2596381829 learned_addr learned my addr 172.21.15.81:0/2596381829 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffaf7fff700 1 --2- 172.21.15.81:0/2596381829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf8159e70 0x7ffaf806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffaf6ffd700 1 -- 172.21.15.81:0/2596381829 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973951464 0 0) 0x7ffaf806ace0 con 0x7ffaf8069c40 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafca83700 1 -- 172.21.15.81:0/2596381829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf8159e70 msgr2=0x7ffaf806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafca83700 1 --2- 172.21.15.81:0/2596381829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf8159e70 0x7ffaf806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafca83700 1 -- 172.21.15.81:0/2596381829 >> v1:172.21.15.176:6789/0 conn(0x7ffaf8069c40 legacy=0x7ffaf80cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafca83700 1 -- 172.21.15.81:0/2596381829 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf806a690 con 0x7ffaf80cb470 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffafca83700 1 --2- 172.21.15.81:0/2596381829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf80cb470 0x7ffaf80c91d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009910 tx=0x7ffaf0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14217972f306d5f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffaf6ffd700 1 -- 172.21.15.81:0/2596381829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011830 con 0x7ffaf80cb470 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffaf6ffd700 1 -- 172.21.15.81:0/2596381829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf0011990 con 0x7ffaf80cb470 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.583+0000 7ffaf6ffd700 1 -- 172.21.15.81:0/2596381829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011d40 con 0x7ffaf80cb470 2023-11-29T11:21:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 -- 172.21.15.81:0/2596381829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf80cb470 msgr2=0x7ffaf80c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 --2- 172.21.15.81:0/2596381829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf80cb470 0x7ffaf80c91d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009910 tx=0x7ffaf0009c20 comp rx=0 tx=0).stop 2023-11-29T11:21:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 -- 172.21.15.81:0/2596381829 shutdown_connections 2023-11-29T11:21:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 --2- 172.21.15.81:0/2596381829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf80cb470 0x7ffaf80c91d0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 --2- 172.21.15.81:0/2596381829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf8159e70 0x7ffaf806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 -- 172.21.15.81:0/2596381829 >> 172.21.15.81:0/2596381829 conn(0x7ffaf80ce3e0 msgr2=0x7ffaf80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 -- 172.21.15.81:0/2596381829 shutdown_connections 2023-11-29T11:21:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 -- 172.21.15.81:0/2596381829 wait complete. 2023-11-29T11:21:11.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 Processor -- start 2023-11-29T11:21:11.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.587+0000 7ffafd284700 1 -- start start 2023-11-29T11:21:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf8069c40 0x7ffaf81eee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf80cb470 0x7ffaf80c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf8159e70 0x7ffaf80c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf815bf20 con 0x7ffaf8069c40 2023-11-29T11:21:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf815c200 con 0x7ffaf8159e70 2023-11-29T11:21:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf815c4e0 con 0x7ffaf80cb470 2023-11-29T11:21:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf8069c40 0x7ffaf81eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf8069c40 0x7ffaf81eee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55126/0 (socket says 172.21.15.81:55126) 2023-11-29T11:21:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafca83700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf8159e70 0x7ffaf80c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf77fe700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf80cb470 0x7ffaf80c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf7fff700 1 -- 172.21.15.81:0/902916764 learned_addr learned my addr 172.21.15.81:0/902916764 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafca83700 1 -- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf80cb470 msgr2=0x7ffaf80c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafca83700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf80cb470 0x7ffaf80c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafca83700 1 -- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf8069c40 msgr2=0x7ffaf81eee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafca83700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf8069c40 0x7ffaf81eee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafca83700 1 -- 172.21.15.81:0/902916764 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf0009570 con 0x7ffaf8159e70 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf77fe700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf80cb470 0x7ffaf80c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf7fff700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf8069c40 0x7ffaf81eee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafca83700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf8159e70 0x7ffaf80c83b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0016000 tx=0x7ffaf0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf4ff9700 1 -- 172.21.15.81:0/902916764 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0004510 con 0x7ffaf8159e70 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf4ff9700 1 -- 172.21.15.81:0/902916764 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf00036c0 con 0x7ffaf8159e70 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf815a240 con 0x7ffaf8159e70 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffaf4ff9700 1 -- 172.21.15.81:0/902916764 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0003a50 con 0x7ffaf8159e70 2023-11-29T11:21:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf806a970 con 0x7ffaf8159e70 2023-11-29T11:21:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.591+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf806cee0 con 0x7ffaf8159e70 2023-11-29T11:21:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.595+0000 7ffaf4ff9700 1 -- 172.21.15.81:0/902916764 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffaf000f050 con 0x7ffaf8159e70 2023-11-29T11:21:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.595+0000 7ffaf4ff9700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad8064ee0 0x7ffad8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.595+0000 7ffaf4ff9700 1 -- 172.21.15.81:0/902916764 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7ffaf0083850 con 0x7ffaf8159e70 2023-11-29T11:21:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.595+0000 7ffaf7fff700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad8064ee0 0x7ffad8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.595+0000 7ffaf7fff700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad8064ee0 0x7ffad8067390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ffae00112c0 tx=0x7ffae0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.603+0000 7ffaf4ff9700 1 -- 172.21.15.81:0/902916764 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffaf0051760 con 0x7ffaf8159e70 2023-11-29T11:21:11.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.763+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaf815c340 con 0x7ffaf8159e70 2023-11-29T11:21:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.767+0000 7ffaf4ff9700 1 -- 172.21.15.81:0/902916764 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18100 (secure 0 0 0) 0x7ffaf815c340 con 0x7ffaf8159e70 2023-11-29T11:21:11.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:11.774 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:19:58.895482+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6833/1691706444":"2023-11-30T11:19:58.895424+0000","172.21.15.176:6832/1691706444":"2023-11-30T11:19:58.895424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:21:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad8064ee0 msgr2=0x7ffad8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad8064ee0 0x7ffad8067390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ffae00112c0 tx=0x7ffae0009240 comp rx=0 tx=0).stop 2023-11-29T11:21:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf8159e70 msgr2=0x7ffaf80c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf8159e70 0x7ffaf80c83b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0016000 tx=0x7ffaf0004770 comp rx=0 tx=0).stop 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 shutdown_connections 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffad8064ee0 0x7ffad8067390 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffaf8159e70 0x7ffaf80c83b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffaf80cb470 0x7ffaf80c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 --2- 172.21.15.81:0/902916764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf8069c40 0x7ffaf81eee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 >> 172.21.15.81:0/902916764 conn(0x7ffaf80ce3e0 msgr2=0x7ffaf806fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 shutdown_connections 2023-11-29T11:21:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.771+0000 7ffafd284700 1 -- 172.21.15.81:0/902916764 wait complete. 2023-11-29T11:21:11.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:19:38.262251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:19:38.644298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:21:11.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:21:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.899+0000 7f65bffff700 1 Processor -- start 2023-11-29T11:21:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.899+0000 7f65bffff700 1 -- start start 2023-11-29T11:21:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.899+0000 7f65bffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c00cf7f0 0x7f65c006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.899+0000 7f65bffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c006a9c0 con 0x7f65c006a4c0 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.899+0000 7f65bffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c006aca0 con 0x7f65c00b1ae0 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.899+0000 7f65bffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c00d0ab0 con 0x7f65c00cf7f0 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65be7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f65c006a4c0 0x7f65c00cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33486/0 (socket says 172.21.15.81:33486) 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65be7fc700 1 -- 172.21.15.81:0/335259373 learned_addr learned my addr 172.21.15.81:0/335259373 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bf7fe700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c00cf7f0 0x7f65c006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490370499 0 0) 0x7f65c006a9c0 con 0x7f65c006a4c0 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a80035d0 con 0x7f65c006a4c0 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863497113 0 0) 0x7f65a80035d0 con 0x7f65c006a4c0 2023-11-29T11:21:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c00cf7f0 msgr2=0x7f65c006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c00cf7f0 0x7f65c006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 >> v1:172.21.15.176:6789/0 conn(0x7f65c00b1ae0 legacy=0x7f65c00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c006af80 con 0x7f65c006a4c0 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f65b4001670 con 0x7f65c006a4c0 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 >> v1:172.21.15.81:6789/0 conn(0x7f65c006a4c0 legacy=0x7f65c00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8003a50 0x7f65a8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8004870 0x7f65a8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c00cf7f0 0x7f65a8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c00d0ab0 con 0x7f65a8003a50 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a800bae0 con 0x7f65a8004870 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a800bca0 con 0x7f65c00cf7f0 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65beffd700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8003a50 0x7f65a8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65be7fc700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8004870 0x7f65a8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bf7fe700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c00cf7f0 0x7f65a8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65beffd700 1 -- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c00cf7f0 msgr2=0x7f65a8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65beffd700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c00cf7f0 0x7f65a8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65beffd700 1 -- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8004870 msgr2=0x7f65a8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65beffd700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8004870 0x7f65a8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65beffd700 1 -- 172.21.15.81:0/335259373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80035d0 con 0x7f65a8003a50 2023-11-29T11:21:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65beffd700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8003a50 0x7f65a8003e60 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f65b00017e0 tx=0x7f65a80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cd3dc795f1992a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00052d0 con 0x7f65a8003a50 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0005430 con 0x7f65a8003a50 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bdffb700 1 -- 172.21.15.81:0/335259373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00055a0 con 0x7f65a8003a50 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bffff700 1 -- 172.21.15.81:0/335259373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8003a50 msgr2=0x7f65a8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bffff700 1 --2- 172.21.15.81:0/335259373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8003a50 0x7f65a8003e60 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f65b00017e0 tx=0x7f65a80058a0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bf7fe700 1 -- 172.21.15.81:0/335259373 reap_dead start 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bffff700 1 -- 172.21.15.81:0/335259373 shutdown_connections 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bffff700 1 -- 172.21.15.81:0/335259373 >> 172.21.15.81:0/335259373 conn(0x7f65c009bbd0 msgr2=0x7f65c00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bffff700 1 -- 172.21.15.81:0/335259373 shutdown_connections 2023-11-29T11:21:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bffff700 1 -- 172.21.15.81:0/335259373 wait complete. 2023-11-29T11:21:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bffff700 1 Processor -- start 2023-11-29T11:21:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.903+0000 7f65bffff700 1 -- start start 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8003a50 0x7f65c015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65c0159ad0 0x7f65c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c009c770 0x7f65c00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0159f40 con 0x7f65c0159ad0 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c009f0d0 con 0x7f65a8003a50 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c015b0c0 con 0x7f65c009c770 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65c0159ad0 0x7f65c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65c0159ad0 0x7f65c015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55144/0 (socket says 172.21.15.81:55144) 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 -- 172.21.15.81:0/3718798799 learned_addr learned my addr 172.21.15.81:0/3718798799 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:11.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65beffd700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8003a50 0x7f65c015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bf7fe700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c009c770 0x7f65c00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 -- 172.21.15.81:0/3718798799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c009c770 msgr2=0x7f65c00d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c009c770 0x7f65c00d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 -- 172.21.15.81:0/3718798799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8003a50 msgr2=0x7f65c015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8003a50 0x7f65c015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 -- 172.21.15.81:0/3718798799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00b1eb0 con 0x7f65c0159ad0 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65be7fc700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65c0159ad0 0x7f65c015d5d0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f65b400eaf0 tx=0x7f65b400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65a7fff700 1 -- 172.21.15.81:0/3718798799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400c5d0 con 0x7f65c0159ad0 2023-11-29T11:21:11.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65a7fff700 1 -- 172.21.15.81:0/3718798799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400c750 con 0x7f65c0159ad0 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c00b4380 con 0x7f65c0159ad0 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65a7fff700 1 -- 172.21.15.81:0/3718798799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400cb00 con 0x7f65c0159ad0 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c00b60e0 con 0x7f65c0159ad0 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.907+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c009e8e0 con 0x7f65c0159ad0 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.911+0000 7f65a7fff700 1 -- 172.21.15.81:0/3718798799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f65b400cc60 con 0x7f65c0159ad0 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.911+0000 7f65a7fff700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65ac064ee0 0x7f65ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.911+0000 7f65a7fff700 1 -- 172.21.15.81:0/3718798799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f65b4081ef0 con 0x7f65c0159ad0 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.911+0000 7f65beffd700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65ac064ee0 0x7f65ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.911+0000 7f65beffd700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65ac064ee0 0x7f65ac067390 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f65c00d2260 tx=0x7f65b0009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:11.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:11.915+0000 7f65a7fff700 1 -- 172.21.15.81:0/3718798799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f65c009e8e0 con 0x7f65c0159ad0 2023-11-29T11:21:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.075+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65c009e8e0 con 0x7f65c0159ad0 2023-11-29T11:21:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65a7fff700 1 -- 172.21.15.81:0/3718798799 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65c009e8e0 con 0x7f65c0159ad0 2023-11-29T11:21:12.083 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:21:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65ac064ee0 msgr2=0x7f65ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65ac064ee0 0x7f65ac067390 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f65c00d2260 tx=0x7f65b0009030 comp rx=0 tx=0).stop 2023-11-29T11:21:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65c0159ad0 msgr2=0x7f65c015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65c0159ad0 0x7f65c015d5d0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f65b400eaf0 tx=0x7f65b400ee00 comp rx=0 tx=0).stop 2023-11-29T11:21:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 shutdown_connections 2023-11-29T11:21:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f65ac064ee0 0x7f65ac067390 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65c009c770 0x7f65c00d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65c0159ad0 0x7f65c015d5d0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 --2- 172.21.15.81:0/3718798799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a8003a50 0x7f65c015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 >> 172.21.15.81:0/3718798799 conn(0x7f65c009bbd0 msgr2=0x7f65c015bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 shutdown_connections 2023-11-29T11:21:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.079+0000 7f65bffff700 1 -- 172.21.15.81:0/3718798799 wait complete. 2023-11-29T11:21:12.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:21:12.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff582d8d700 1 Processor -- start 2023-11-29T11:21:12.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff582d8d700 1 -- start start 2023-11-29T11:21:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff582d8d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff57c160980 0x7ff57c0cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff582d8d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0cd6b0 con 0x7ff57c0c8e60 2023-11-29T11:21:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff582d8d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0ce4f0 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff582d8d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c0b1010 con 0x7ff57c160980 2023-11-29T11:21:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff57bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff57c0c8e60 0x7ff57c0c9aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33502/0 (socket says 172.21.15.81:33502) 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff57bfff700 1 -- 172.21.15.81:0/1862752550 learned_addr learned my addr 172.21.15.81:0/1862752550 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff580b29700 1 --2- 172.21.15.81:0/1862752550 >> v2:172.21.15.176:3300/0 conn(0x7ff57c160980 0x7ff57c0cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff57b7fe700 1 -- 172.21.15.81:0/1862752550 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855551849 0 0) 0x7ff57c0cd6b0 con 0x7ff57c0c8e60 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff57b7fe700 1 -- 172.21.15.81:0/1862752550 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5640035d0 con 0x7ff57c0c8e60 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff580b29700 1 -- 172.21.15.81:0/1862752550 >> v1:172.21.15.176:6789/0 conn(0x7ff57c0ca1b0 legacy=0x7ff57c069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff580b29700 1 -- 172.21.15.81:0/1862752550 >> v1:172.21.15.81:6789/0 conn(0x7ff57c0c8e60 legacy=0x7ff57c0c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff57b7fe700 1 -- 172.21.15.81:0/1862752550 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2400265409 0 0) 0x7ff5640035d0 con 0x7ff57c0c8e60 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff580b29700 1 -- 172.21.15.81:0/1862752550 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c160d50 con 0x7ff57c160980 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff580b29700 1 --2- 172.21.15.81:0/1862752550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 0x7ff57c0cd170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff570009850 tx=0x7ff570009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5bc06a2ffce086 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff57b7fe700 1 -- 172.21.15.81:0/1862752550 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570011830 con 0x7ff57c160980 2023-11-29T11:21:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff57b7fe700 1 -- 172.21.15.81:0/1862752550 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff570011990 con 0x7ff57c160980 2023-11-29T11:21:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.207+0000 7ff57b7fe700 1 -- 172.21.15.81:0/1862752550 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570011d40 con 0x7ff57c160980 2023-11-29T11:21:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 -- 172.21.15.81:0/1862752550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 msgr2=0x7ff57c0cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 --2- 172.21.15.81:0/1862752550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 0x7ff57c0cd170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff570009850 tx=0x7ff570009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 -- 172.21.15.81:0/1862752550 shutdown_connections 2023-11-29T11:21:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 --2- 172.21.15.81:0/1862752550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 0x7ff57c0cd170 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 -- 172.21.15.81:0/1862752550 >> 172.21.15.81:0/1862752550 conn(0x7ff57c0cf4a0 msgr2=0x7ff57c0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 -- 172.21.15.81:0/1862752550 shutdown_connections 2023-11-29T11:21:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 -- 172.21.15.81:0/1862752550 wait complete. 2023-11-29T11:21:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 Processor -- start 2023-11-29T11:21:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.211+0000 7ff582d8d700 1 -- start start 2023-11-29T11:21:12.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c0c8e60 0x7ff57c162cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c0ca1b0 0x7ff57c14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 0x7ff57c15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1628d0 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c14e270 con 0x7ff57c160980 2023-11-29T11:21:12.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c161c50 con 0x7ff57c0c8e60 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c0ca1b0 0x7ff57c14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c0ca1b0 0x7ff57c14dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55160/0 (socket says 172.21.15.81:55160) 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 -- 172.21.15.81:0/4252960683 learned_addr learned my addr 172.21.15.81:0/4252960683 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff58132a700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 0x7ff57c15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff580b29700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c0c8e60 0x7ff57c162cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 -- 172.21.15.81:0/4252960683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c0c8e60 msgr2=0x7ff57c162cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c0c8e60 0x7ff57c162cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 -- 172.21.15.81:0/4252960683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 msgr2=0x7ff57c15ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 0x7ff57c15ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 -- 172.21.15.81:0/4252960683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700094b0 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff57bfff700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c0ca1b0 0x7ff57c14dd30 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c780 tx=0x7ff56c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff5797fa700 1 -- 172.21.15.81:0/4252960683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c005d90 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff5797fa700 1 -- 172.21.15.81:0/4252960683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c0070d0 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c0cdbc0 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff5797fa700 1 -- 172.21.15.81:0/4252960683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0074c0 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c0cd8e0 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.215+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c0cdea0 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.219+0000 7ff5797fa700 1 -- 172.21.15.81:0/4252960683 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff56c019030 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.219+0000 7ff5797fa700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff568064f10 0x7ff5680673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.219+0000 7ff580b29700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff568064f10 0x7ff5680673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.219+0000 7ff5797fa700 1 -- 172.21.15.81:0/4252960683 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7ff56c081920 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.219+0000 7ff580b29700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff568064f10 0x7ff5680673c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff5700090b0 tx=0x7ff57001c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.223+0000 7ff5797fa700 1 -- 172.21.15.81:0/4252960683 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff56c04f820 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff57c162a10 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff5797fa700 1 -- 172.21.15.81:0/4252960683 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff57c162a10 con 0x7ff57c0ca1b0 2023-11-29T11:21:12.392 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:21:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff568064f10 msgr2=0x7ff5680673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff568064f10 0x7ff5680673c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff5700090b0 tx=0x7ff57001c040 comp rx=0 tx=0).stop 2023-11-29T11:21:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c0ca1b0 msgr2=0x7ff57c14dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c0ca1b0 0x7ff57c14dd30 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c780 tx=0x7ff56c00ca90 comp rx=0 tx=0).stop 2023-11-29T11:21:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 shutdown_connections 2023-11-29T11:21:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff568064f10 0x7ff5680673c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c160980 0x7ff57c15ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff57c0ca1b0 0x7ff57c14dd30 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 --2- 172.21.15.81:0/4252960683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c0c8e60 0x7ff57c162cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.387+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 >> 172.21.15.81:0/4252960683 conn(0x7ff57c0cf4a0 msgr2=0x7ff57c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.391+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 shutdown_connections 2023-11-29T11:21:12.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.391+0000 7ff582d8d700 1 -- 172.21.15.81:0/4252960683 wait complete. 2023-11-29T11:21:12.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:21:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.523+0000 7f365ffff700 1 Processor -- start 2023-11-29T11:21:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.523+0000 7f365ffff700 1 -- start start 2023-11-29T11:21:12.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f366006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f36600cf0e0 0x7f36600cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36600cfa80 con 0x7f366006a4c0 2023-11-29T11:21:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36600d0ab0 con 0x7f36600cf0e0 2023-11-29T11:21:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366006a9c0 con 0x7f36600b1ae0 2023-11-29T11:21:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365effd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f366006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365f7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f36600cf0e0 0x7f36600cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365effd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f366006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:33162/0 (socket says 172.21.15.81:33162) 2023-11-29T11:21:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365f7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f36600cf0e0 0x7f36600cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:44654/0 (socket says 172.21.15.81:44654) 2023-11-29T11:21:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365effd700 1 -- 172.21.15.81:0/3429695959 learned_addr learned my addr 172.21.15.81:0/3429695959 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365effd700 1 -- 172.21.15.81:0/3429695959 >> v2:172.21.15.176:3300/0 conn(0x7f36600cf0e0 msgr2=0x7f36600cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365effd700 1 --2- 172.21.15.81:0/3429695959 >> v2:172.21.15.176:3300/0 conn(0x7f36600cf0e0 0x7f36600cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365effd700 1 -- 172.21.15.81:0/3429695959 >> v1:172.21.15.176:6789/0 conn(0x7f366006a4c0 legacy=0x7f36600d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365effd700 1 -- 172.21.15.81:0/3429695959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366006aca0 con 0x7f36600b1ae0 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365f7fe700 1 --2- 172.21.15.81:0/3429695959 >> v2:172.21.15.176:3300/0 conn(0x7f36600cf0e0 0x7f36600cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365effd700 1 --2- 172.21.15.81:0/3429695959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f366006d8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3650009910 tx=0x7f3650009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341d9ae7b6d437d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365e7fc700 1 -- 172.21.15.81:0/3429695959 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650011830 con 0x7f36600b1ae0 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365e7fc700 1 -- 172.21.15.81:0/3429695959 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650011990 con 0x7f36600b1ae0 2023-11-29T11:21:12.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365e7fc700 1 -- 172.21.15.81:0/3429695959 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650011d40 con 0x7f36600b1ae0 2023-11-29T11:21:12.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 -- 172.21.15.81:0/3429695959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 msgr2=0x7f366006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 --2- 172.21.15.81:0/3429695959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f366006d8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3650009910 tx=0x7f3650009c20 comp rx=0 tx=0).stop 2023-11-29T11:21:12.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 -- 172.21.15.81:0/3429695959 shutdown_connections 2023-11-29T11:21:12.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 --2- 172.21.15.81:0/3429695959 >> v2:172.21.15.176:3300/0 conn(0x7f36600cf0e0 0x7f36600cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 --2- 172.21.15.81:0/3429695959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f366006d8e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 -- 172.21.15.81:0/3429695959 >> 172.21.15.81:0/3429695959 conn(0x7f366009bbd0 msgr2=0x7f36600b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 -- 172.21.15.81:0/3429695959 shutdown_connections 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.527+0000 7f365ffff700 1 -- 172.21.15.81:0/3429695959 wait complete. 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 Processor -- start 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 -- start start 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366006a4c0 0x7f366015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f36601576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36600cf0e0 0x7f366006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c7200 con 0x7f36600cf0e0 2023-11-29T11:21:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c90e0 con 0x7f366006a4c0 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3660157c10 con 0x7f36600b1ae0 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36600cf0e0 0x7f366006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36600cf0e0 0x7f366006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55166/0 (socket says 172.21.15.81:55166) 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 -- 172.21.15.81:0/3334449315 learned_addr learned my addr 172.21.15.81:0/3334449315 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f3657fff700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f36601576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365effd700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366006a4c0 0x7f366015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 -- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 msgr2=0x7f36601576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f36601576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 -- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366006a4c0 msgr2=0x7f366015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366006a4c0 0x7f366015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 -- 172.21.15.81:0/3334449315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658009a70 con 0x7f36600cf0e0 2023-11-29T11:21:12.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365effd700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366006a4c0 0x7f366015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:12.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365f7fe700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36600cf0e0 0x7f366006cff0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f365800efc0 tx=0x7f365800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f36577fe700 1 -- 172.21.15.81:0/3334449315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658009d70 con 0x7f36600cf0e0 2023-11-29T11:21:12.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f36577fe700 1 -- 172.21.15.81:0/3334449315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365800f040 con 0x7f36600cf0e0 2023-11-29T11:21:12.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3650009570 con 0x7f36600cf0e0 2023-11-29T11:21:12.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f36577fe700 1 -- 172.21.15.81:0/3334449315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365800cda0 con 0x7f36600cf0e0 2023-11-29T11:21:12.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.531+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36600b4380 con 0x7f36600cf0e0 2023-11-29T11:21:12.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.535+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366006af80 con 0x7f36600cf0e0 2023-11-29T11:21:12.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.535+0000 7f36577fe700 1 -- 172.21.15.81:0/3334449315 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3658014480 con 0x7f36600cf0e0 2023-11-29T11:21:12.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.535+0000 7f36577fe700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3644064ee0 0x7f3644067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.539+0000 7f365effd700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3644064ee0 0x7f3644067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.539+0000 7f36577fe700 1 -- 172.21.15.81:0/3334449315 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f3658082930 con 0x7f36600cf0e0 2023-11-29T11:21:12.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.539+0000 7f365effd700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3644064ee0 0x7f3644067390 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3650014040 tx=0x7f3650008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.543+0000 7f36577fe700 1 -- 172.21.15.81:0/3334449315 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3658050850 con 0x7f36600cf0e0 2023-11-29T11:21:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.703+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36600b1eb0 con 0x7f36600cf0e0 2023-11-29T11:21:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.703+0000 7f36577fe700 1 -- 172.21.15.81:0/3334449315 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3658053e70 con 0x7f36600cf0e0 2023-11-29T11:21:12.709 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:21:12.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3644064ee0 msgr2=0x7f3644067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3644064ee0 0x7f3644067390 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3650014040 tx=0x7f3650008030 comp rx=0 tx=0).stop 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36600cf0e0 msgr2=0x7f366006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36600cf0e0 0x7f366006cff0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f365800efc0 tx=0x7f365800c3a0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 shutdown_connections 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3644064ee0 0x7f3644067390 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36600cf0e0 0x7f366006cff0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36600b1ae0 0x7f36601576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 --2- 172.21.15.81:0/3334449315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f366006a4c0 0x7f366015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 >> 172.21.15.81:0/3334449315 conn(0x7f366009bbd0 msgr2=0x7f36600d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 shutdown_connections 2023-11-29T11:21:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.707+0000 7f365ffff700 1 -- 172.21.15.81:0/3334449315 wait complete. 2023-11-29T11:21:12.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:21:12.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6bfff700 1 Processor -- start 2023-11-29T11:21:12.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6bfff700 1 -- start start 2023-11-29T11:21:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6bfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb6c158ee0 0x7fbb6c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6c06d1c0 con 0x7fbb6c0ce230 2023-11-29T11:21:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6c0ca3a0 con 0x7fbb6c0cd5d0 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6bfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6c06e000 con 0x7fbb6c158ee0 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbb6c0ce230 0x7fbb6c0cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33516/0 (socket says 172.21.15.81:33516) 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6b7fe700 1 -- 172.21.15.81:0/1459683864 learned_addr learned my addr 172.21.15.81:0/1459683864 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6affd700 1 --2- 172.21.15.81:0/1459683864 >> v2:172.21.15.176:3300/0 conn(0x7fbb6c158ee0 0x7fbb6c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb69ffb700 1 -- 172.21.15.81:0/1459683864 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997099887 0 0) 0x7fbb64001110 con 0x7fbb6c0ce230 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb69ffb700 1 -- 172.21.15.81:0/1459683864 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb580035d0 con 0x7fbb6c0ce230 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6affd700 1 -- 172.21.15.81:0/1459683864 >> v1:172.21.15.176:6789/0 conn(0x7fbb6c0cd5d0 legacy=0x7fbb6c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6affd700 1 -- 172.21.15.81:0/1459683864 >> v1:172.21.15.81:6789/0 conn(0x7fbb6c0ce230 legacy=0x7fbb6c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.839+0000 7fbb6affd700 1 -- 172.21.15.81:0/1459683864 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c06c920 con 0x7fbb6c158ee0 2023-11-29T11:21:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb6affd700 1 --2- 172.21.15.81:0/1459683864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c0ae760 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009850 tx=0x7fbb5c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4827134ada2c03a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb69ffb700 1 -- 172.21.15.81:0/1459683864 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c011830 con 0x7fbb6c158ee0 2023-11-29T11:21:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb69ffb700 1 -- 172.21.15.81:0/1459683864 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c011990 con 0x7fbb6c158ee0 2023-11-29T11:21:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb69ffb700 1 -- 172.21.15.81:0/1459683864 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c011d00 con 0x7fbb6c158ee0 2023-11-29T11:21:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb6bfff700 1 -- 172.21.15.81:0/1459683864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c158ee0 msgr2=0x7fbb6c0ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb6bfff700 1 --2- 172.21.15.81:0/1459683864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c0ae760 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009850 tx=0x7fbb5c009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb6bfff700 1 -- 172.21.15.81:0/1459683864 shutdown_connections 2023-11-29T11:21:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb6bfff700 1 --2- 172.21.15.81:0/1459683864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c0ae760 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb6bfff700 1 -- 172.21.15.81:0/1459683864 >> 172.21.15.81:0/1459683864 conn(0x7fbb6c0d0240 msgr2=0x7fbb6c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb6bfff700 1 -- 172.21.15.81:0/1459683864 shutdown_connections 2023-11-29T11:21:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.843+0000 7fbb6bfff700 1 -- 172.21.15.81:0/1459683864 wait complete. 2023-11-29T11:21:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6bfff700 1 Processor -- start 2023-11-29T11:21:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6bfff700 1 -- start start 2023-11-29T11:21:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c0cd5d0 0x7fbb6c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6c0ce230 0x7fbb6c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c1f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c1f3350 con 0x7fbb6c158ee0 2023-11-29T11:21:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c1f01a0 con 0x7fbb6c0cd5d0 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c1f0480 con 0x7fbb6c0ce230 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c1f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c1f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55182/0 (socket says 172.21.15.81:55182) 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6b7fe700 1 -- 172.21.15.81:0/2348907085 learned_addr learned my addr 172.21.15.81:0/2348907085 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6a7fc700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6c0ce230 0x7fbb6c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6affd700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c0cd5d0 0x7fbb6c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6b7fe700 1 -- 172.21.15.81:0/2348907085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6c0ce230 msgr2=0x7fbb6c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6b7fe700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6c0ce230 0x7fbb6c150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6b7fe700 1 -- 172.21.15.81:0/2348907085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c0cd5d0 msgr2=0x7fbb6c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6b7fe700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c0cd5d0 0x7fbb6c0b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.847+0000 7fbb6b7fe700 1 -- 172.21.15.81:0/2348907085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0094b0 con 0x7fbb6c158ee0 2023-11-29T11:21:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb6b7fe700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c1f3770 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400c4d0 tx=0x7fbb6400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb63fff700 1 -- 172.21.15.81:0/2348907085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64005d90 con 0x7fbb6c158ee0 2023-11-29T11:21:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb63fff700 1 -- 172.21.15.81:0/2348907085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6400ce80 con 0x7fbb6c158ee0 2023-11-29T11:21:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c06cee0 con 0x7fbb6c158ee0 2023-11-29T11:21:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb63fff700 1 -- 172.21.15.81:0/2348907085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb640072f0 con 0x7fbb6c158ee0 2023-11-29T11:21:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6c06cc00 con 0x7fbb6c158ee0 2023-11-29T11:21:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6c0ca640 con 0x7fbb6c158ee0 2023-11-29T11:21:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb63fff700 1 -- 172.21.15.81:0/2348907085 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb64019030 con 0x7fbb6c158ee0 2023-11-29T11:21:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb63fff700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb4c064ee0 0x7fbb4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.851+0000 7fbb63fff700 1 -- 172.21.15.81:0/2348907085 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fbb64081140 con 0x7fbb6c158ee0 2023-11-29T11:21:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.855+0000 7fbb6affd700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb4c064ee0 0x7fbb4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.855+0000 7fbb6affd700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb4c064ee0 0x7fbb4c067390 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0090b0 tx=0x7fbb5c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:12.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:12.859+0000 7fbb63fff700 1 -- 172.21.15.81:0/2348907085 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb6404f0e0 con 0x7fbb6c158ee0 2023-11-29T11:21:13.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.019+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb6c1f3490 con 0x7fbb6c158ee0 2023-11-29T11:21:13.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.019+0000 7fbb63fff700 1 -- 172.21.15.81:0/2348907085 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb6c1f3490 con 0x7fbb6c158ee0 2023-11-29T11:21:13.026 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:21:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb4c064ee0 msgr2=0x7fbb4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb4c064ee0 0x7fbb4c067390 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0090b0 tx=0x7fbb5c008030 comp rx=0 tx=0).stop 2023-11-29T11:21:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c158ee0 msgr2=0x7fbb6c1f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c1f3770 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400c4d0 tx=0x7fbb6400c7e0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 shutdown_connections 2023-11-29T11:21:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb4c064ee0 0x7fbb4c067390 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c158ee0 0x7fbb6c1f3770 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6c0ce230 0x7fbb6c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 --2- 172.21.15.81:0/2348907085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6c0cd5d0 0x7fbb6c0b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 >> 172.21.15.81:0/2348907085 conn(0x7fbb6c0d0240 msgr2=0x7fbb6c0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 shutdown_connections 2023-11-29T11:21:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.023+0000 7fbb6bfff700 1 -- 172.21.15.81:0/2348907085 wait complete. 2023-11-29T11:21:13.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:21:13.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e2280700 1 Processor -- start 2023-11-29T11:21:13.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e2280700 1 -- start start 2023-11-29T11:21:13.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e2280700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc1547c0 0x7f74dc06b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:13.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e2280700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74dc15b060 0x7f74dc0c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:13.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e2280700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f74dc0c9ad0 0x7f74dc06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:13.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e2280700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc154b90 con 0x7f74dc15b060 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e2280700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0c9f30 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e2280700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc071090 con 0x7f74dc1547c0 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74db7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74dc15b060 0x7f74dc0c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74db7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74dc15b060 0x7f74dc0c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55196/0 (socket says 172.21.15.81:55196) 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74db7fe700 1 -- 172.21.15.81:0/1771214035 learned_addr learned my addr 172.21.15.81:0/1771214035 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74dbfff700 1 --2- 172.21.15.81:0/1771214035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc1547c0 0x7f74dc06b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.147+0000 7f74e081d700 1 --2- 172.21.15.81:0/1771214035 >> v2:172.21.15.176:3300/0 conn(0x7f74dc0c9ad0 0x7f74dc06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74dbfff700 1 -- 172.21.15.81:0/1771214035 >> v2:172.21.15.176:3300/0 conn(0x7f74dc0c9ad0 msgr2=0x7f74dc06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74dbfff700 1 --2- 172.21.15.81:0/1771214035 >> v2:172.21.15.176:3300/0 conn(0x7f74dc0c9ad0 0x7f74dc06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74dbfff700 1 -- 172.21.15.81:0/1771214035 >> v2:172.21.15.81:3300/0 conn(0x7f74dc15b060 msgr2=0x7f74dc0c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74dbfff700 1 --2- 172.21.15.81:0/1771214035 >> v2:172.21.15.81:3300/0 conn(0x7f74dc15b060 0x7f74dc0c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74dbfff700 1 -- 172.21.15.81:0/1771214035 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0718a0 con 0x7f74dc1547c0 2023-11-29T11:21:13.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74db7fe700 1 --2- 172.21.15.81:0/1771214035 >> v2:172.21.15.81:3300/0 conn(0x7f74dc15b060 0x7f74dc0c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:13.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74dbfff700 1 --2- 172.21.15.81:0/1771214035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc1547c0 0x7f74dc06b610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74dc158200 tx=0x7f74cc009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ae4513f9b9399bd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74daffd700 1 -- 172.21.15.81:0/1771214035 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc011830 con 0x7f74dc1547c0 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74daffd700 1 -- 172.21.15.81:0/1771214035 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc011990 con 0x7f74dc1547c0 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74daffd700 1 -- 172.21.15.81:0/1771214035 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc011d20 con 0x7f74dc1547c0 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 -- 172.21.15.81:0/1771214035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc1547c0 msgr2=0x7f74dc06b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 --2- 172.21.15.81:0/1771214035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc1547c0 0x7f74dc06b610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74dc158200 tx=0x7f74cc009b30 comp rx=0 tx=0).stop 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 -- 172.21.15.81:0/1771214035 shutdown_connections 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 --2- 172.21.15.81:0/1771214035 >> v2:172.21.15.176:3300/0 conn(0x7f74dc0c9ad0 0x7f74dc06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 --2- 172.21.15.81:0/1771214035 >> v2:172.21.15.81:3300/0 conn(0x7f74dc15b060 0x7f74dc0c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 --2- 172.21.15.81:0/1771214035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc1547c0 0x7f74dc06b610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 -- 172.21.15.81:0/1771214035 >> 172.21.15.81:0/1771214035 conn(0x7f74dc0b0a90 msgr2=0x7f74dc0b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 -- 172.21.15.81:0/1771214035 shutdown_connections 2023-11-29T11:21:13.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.151+0000 7f74e2280700 1 -- 172.21.15.81:0/1771214035 wait complete. 2023-11-29T11:21:13.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74e2280700 1 Processor -- start 2023-11-29T11:21:13.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74e2280700 1 -- start start 2023-11-29T11:21:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74e2280700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc0c9ad0 0x7f74dc0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74e2280700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74dc1547c0 0x7f74dc157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74e2280700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc15b060 0x7f74dc150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74e2280700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc150ac0 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74e2280700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0b37d0 con 0x7f74dc1547c0 2023-11-29T11:21:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74e2280700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0b3ab0 con 0x7f74dc15b060 2023-11-29T11:21:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc0c9ad0 0x7f74dc0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc0c9ad0 0x7f74dc0b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55202/0 (socket says 172.21.15.81:55202) 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.155+0000 7f74dbfff700 1 -- 172.21.15.81:0/1350284067 learned_addr learned my addr 172.21.15.81:0/1350284067 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74db7fe700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74dc1547c0 0x7f74dc157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74e081d700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc15b060 0x7f74dc150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74dbfff700 1 -- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc15b060 msgr2=0x7f74dc150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74dbfff700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc15b060 0x7f74dc150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74dbfff700 1 -- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74dc1547c0 msgr2=0x7f74dc157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74dbfff700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74dc1547c0 0x7f74dc157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74dbfff700 1 -- 172.21.15.81:0/1350284067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0009570 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74db7fe700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74dc1547c0 0x7f74dc157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74e081d700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc15b060 0x7f74dc150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74dbfff700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc0c9ad0 0x7f74dc0b4870 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009b70 tx=0x7f74cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74d8ff9700 1 -- 172.21.15.81:0/1350284067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc004380 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74d8ff9700 1 -- 172.21.15.81:0/1350284067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc01f070 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc0094b0 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74d8ff9700 1 -- 172.21.15.81:0/1350284067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0036c0 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc0712e0 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.159+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc06bcd0 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.163+0000 7f74d8ff9700 1 -- 172.21.15.81:0/1350284067 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f74cc02a020 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.163+0000 7f74d8ff9700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74c8064f10 0x7f74c80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.163+0000 7f74d8ff9700 1 -- 172.21.15.81:0/1350284067 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f74cc083380 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.163+0000 7f74db7fe700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74c8064f10 0x7f74c80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.163+0000 7f74db7fe700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74c8064f10 0x7f74c80673c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0cc3a0 tx=0x7f74d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:13.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.171+0000 7f74d8ff9700 1 -- 172.21.15.81:0/1350284067 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f74cc051380 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.339+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74dc0715c0 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.339+0000 7f74d8ff9700 1 -- 172.21.15.81:0/1350284067 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v97) v1 ==== 80+0+124 (secure 0 0 0) 0x7f74cc0549a0 con 0x7f74dc0c9ad0 2023-11-29T11:21:13.346 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.176:6833/1691706444 2023-11-30T11:19:58.895424+0000 2023-11-29T11:21:13.346 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.176:6832/1691706444 2023-11-30T11:19:58.895424+0000 2023-11-29T11:21:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74c8064f10 msgr2=0x7f74c80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74c8064f10 0x7f74c80673c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0cc3a0 tx=0x7f74d0008040 comp rx=0 tx=0).stop 2023-11-29T11:21:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc0c9ad0 msgr2=0x7f74dc0b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc0c9ad0 0x7f74dc0b4870 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009b70 tx=0x7f74cc004770 comp rx=0 tx=0).stop 2023-11-29T11:21:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 shutdown_connections 2023-11-29T11:21:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f74c8064f10 0x7f74c80673c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74dc15b060 0x7f74dc150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74dc1547c0 0x7f74dc157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 --2- 172.21.15.81:0/1350284067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74dc0c9ad0 0x7f74dc0b4870 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 >> 172.21.15.81:0/1350284067 conn(0x7f74dc0b0a90 msgr2=0x7f74dc0cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 shutdown_connections 2023-11-29T11:21:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:13.343+0000 7f74e2280700 1 -- 172.21.15.81:0/1350284067 wait complete. 2023-11-29T11:21:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:listed 2 entries 2023-11-29T11:21:13.366 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:21:13.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:13.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:21:13.378 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[58672]: fuse finished with error 0 and tester_r 0 2023-11-29T11:21:13.380 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:21:19.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:21:19.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:19.483 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:21:19.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:21:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99cffff700 1 Processor -- start 2023-11-29T11:21:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99cffff700 1 -- start start 2023-11-29T11:21:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99cffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f99d00cb460 0x7f99d00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99cffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d00cd8f0 con 0x7f99d00ad490 2023-11-29T11:21:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99cffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d006dc60 con 0x7f99d0158e60 2023-11-29T11:21:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99cffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d00add00 con 0x7f99d00cb460 2023-11-29T11:21:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99cf7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f99d00ad490 0x7f99d006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33520/0 (socket says 172.21.15.81:33520) 2023-11-29T11:21:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99cf7fe700 1 -- 172.21.15.81:0/179260082 learned_addr learned my addr 172.21.15.81:0/179260082 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99c67fc700 1 --2- 172.21.15.81:0/179260082 >> v2:172.21.15.176:3300/0 conn(0x7f99d00cb460 0x7f99d00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99ce7fc700 1 -- 172.21.15.81:0/179260082 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909308756 0 0) 0x7f99d00cd8f0 con 0x7f99d00ad490 2023-11-29T11:21:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99ce7fc700 1 -- 172.21.15.81:0/179260082 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99bc0035d0 con 0x7f99d00ad490 2023-11-29T11:21:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99ce7fc700 1 -- 172.21.15.81:0/179260082 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393690947 0 0) 0x7f99bc0035d0 con 0x7f99d00ad490 2023-11-29T11:21:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99c67fc700 1 -- 172.21.15.81:0/179260082 >> v1:172.21.15.176:6789/0 conn(0x7f99d0158e60 legacy=0x7f99d00cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99c67fc700 1 -- 172.21.15.81:0/179260082 >> v1:172.21.15.81:6789/0 conn(0x7f99d00ad490 legacy=0x7f99d006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99c67fc700 1 -- 172.21.15.81:0/179260082 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d00cde90 con 0x7f99d00cb460 2023-11-29T11:21:19.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99c67fc700 1 --2- 172.21.15.81:0/179260082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 0x7f99d00c8a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009850 tx=0x7f99b8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81068df4268b346c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:19.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99ce7fc700 1 -- 172.21.15.81:0/179260082 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c80019f0 con 0x7f99d00cb460 2023-11-29T11:21:19.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99ce7fc700 1 -- 172.21.15.81:0/179260082 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b8004030 con 0x7f99d00cb460 2023-11-29T11:21:19.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.651+0000 7f99ce7fc700 1 -- 172.21.15.81:0/179260082 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b80043a0 con 0x7f99d00cb460 2023-11-29T11:21:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 -- 172.21.15.81:0/179260082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 msgr2=0x7f99d00c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 --2- 172.21.15.81:0/179260082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 0x7f99d00c8a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009850 tx=0x7f99b8009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 -- 172.21.15.81:0/179260082 shutdown_connections 2023-11-29T11:21:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 --2- 172.21.15.81:0/179260082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 0x7f99d00c8a30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 -- 172.21.15.81:0/179260082 >> 172.21.15.81:0/179260082 conn(0x7f99d00ce3e0 msgr2=0x7f99d00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 -- 172.21.15.81:0/179260082 shutdown_connections 2023-11-29T11:21:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 -- 172.21.15.81:0/179260082 wait complete. 2023-11-29T11:21:19.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 Processor -- start 2023-11-29T11:21:19.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.655+0000 7f99cffff700 1 -- start start 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99cffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99d00ad490 0x7f99d0156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99cffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 0x7f99d00c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99cffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99d0158e60 0x7f99d00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99cffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00c84a0 con 0x7f99d00ad490 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99cffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d01f1900 con 0x7f99d00cb460 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99cffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d01f21a0 con 0x7f99d0158e60 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99d00ad490 0x7f99d0156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99d00ad490 0x7f99d0156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55206/0 (socket says 172.21.15.81:55206) 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 -- 172.21.15.81:0/415428336 learned_addr learned my addr 172.21.15.81:0/415428336 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99c67fc700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 0x7f99d00c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99cf7fe700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99d0158e60 0x7f99d00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 -- 172.21.15.81:0/415428336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99d0158e60 msgr2=0x7f99d00c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99d0158e60 0x7f99d00c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 -- 172.21.15.81:0/415428336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 msgr2=0x7f99d00c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 0x7f99d00c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 -- 172.21.15.81:0/415428336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80094b0 con 0x7f99d00ad490 2023-11-29T11:21:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.659+0000 7f99ceffd700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99d00ad490 0x7f99d0156360 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f99c000e970 tx=0x7f99c000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99ccff9700 1 -- 172.21.15.81:0/415428336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00052d0 con 0x7f99d00ad490 2023-11-29T11:21:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99ccff9700 1 -- 172.21.15.81:0/415428336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0005430 con 0x7f99d00ad490 2023-11-29T11:21:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d006d6a0 con 0x7f99d00ad490 2023-11-29T11:21:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99ccff9700 1 -- 172.21.15.81:0/415428336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00055a0 con 0x7f99d00ad490 2023-11-29T11:21:19.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d0159230 con 0x7f99d00ad490 2023-11-29T11:21:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d006d980 con 0x7f99d00ad490 2023-11-29T11:21:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99ccff9700 1 -- 172.21.15.81:0/415428336 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f99c0021070 con 0x7f99d00ad490 2023-11-29T11:21:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99ccff9700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f99b0064ee0 0x7f99b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99c67fc700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f99b0064ee0 0x7f99b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.667+0000 7f99ccff9700 1 -- 172.21.15.81:0/415428336 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f99c0083da0 con 0x7f99d00ad490 2023-11-29T11:21:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.671+0000 7f99c67fc700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f99b0064ee0 0x7f99b0067390 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f99d00cb850 tx=0x7f99b8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.679+0000 7f99ccff9700 1 -- 172.21.15.81:0/415428336 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f99c0051da0 con 0x7f99d00ad490 2023-11-29T11:21:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.871+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99d0072500 con 0x7f99d00ad490 2023-11-29T11:21:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.871+0000 7f99ccff9700 1 -- 172.21.15.81:0/415428336 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4655 (secure 0 0 0) 0x7f99c001f090 con 0x7f99d00ad490 2023-11-29T11:21:19.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:19.878 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:20:14.125061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"a","rank":0,"incarnation":56,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/353227086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":353227086},{"type":"v1","addr":"172.21.15.81:6837","nonce":353227086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:21:19.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f99b0064ee0 msgr2=0x7f99b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f99b0064ee0 0x7f99b0067390 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f99d00cb850 tx=0x7f99b8008030 comp rx=0 tx=0).stop 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99d00ad490 msgr2=0x7f99d0156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99d00ad490 0x7f99d0156360 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f99c000e970 tx=0x7f99c000ec80 comp rx=0 tx=0).stop 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 shutdown_connections 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f99b0064ee0 0x7f99b0067390 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99d0158e60 0x7f99d00c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99d00cb460 0x7f99d00c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 --2- 172.21.15.81:0/415428336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99d00ad490 0x7f99d0156360 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 >> 172.21.15.81:0/415428336 conn(0x7f99d00ce3e0 msgr2=0x7f99d00b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 shutdown_connections 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:19.875+0000 7f99cffff700 1 -- 172.21.15.81:0/415428336 wait complete. 2023-11-29T11:21:19.880 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2023-11-29T11:21:19.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-29T11:21:20.025 INFO:teuthology.orchestra.run.smithi081.stdout:{"message":"","return_code":0} 2023-11-29T11:21:20.025 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:21:20.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:21:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8817563700 1 Processor -- start 2023-11-29T11:21:20.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8817563700 1 -- start start 2023-11-29T11:21:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8817563700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88101584c0 0x7f88100cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8817563700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f881006ace0 0x7f88100b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8817563700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88100b3c60 con 0x7f88100b32e0 2023-11-29T11:21:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8817563700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881006dbd0 con 0x7f88101584c0 2023-11-29T11:21:20.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8817563700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88100cd0f0 con 0x7f881006ace0 2023-11-29T11:21:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8816561700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88101584c0 0x7f88100cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:20.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8816d62700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f881006ace0 0x7f88100b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8816561700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88101584c0 0x7f88100cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50430/0 (socket says 172.21.15.81:50430) 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8815d60700 1 --1- 172.21.15.81:0/4233089451 >> v1:172.21.15.176:6789/0 conn(0x7f88100b32e0 0x7f881006bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:51634/0 (socket says 172.21.15.81:51634) 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8816561700 1 -- 172.21.15.81:0/4233089451 learned_addr learned my addr 172.21.15.81:0/4233089451 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f881555f700 1 -- 172.21.15.81:0/4233089451 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335337684 0 0) 0x7f88100b3c60 con 0x7f88100b32e0 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f881555f700 1 -- 172.21.15.81:0/4233089451 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87fc0035d0 con 0x7f88100b32e0 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8816d62700 1 -- 172.21.15.81:0/4233089451 >> v2:172.21.15.81:3300/0 conn(0x7f88101584c0 msgr2=0x7f88100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8816d62700 1 --2- 172.21.15.81:0/4233089451 >> v2:172.21.15.81:3300/0 conn(0x7f88101584c0 0x7f88100cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8816d62700 1 -- 172.21.15.81:0/4233089451 >> v1:172.21.15.176:6789/0 conn(0x7f88100b32e0 legacy=0x7f881006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:20.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.131+0000 7f8816d62700 1 -- 172.21.15.81:0/4233089451 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100cd3d0 con 0x7f881006ace0 2023-11-29T11:21:20.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8816d62700 1 --2- 172.21.15.81:0/4233089451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f881006ace0 0x7f88100b3720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8808009850 tx=0x7f8808009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99d384bf3414c730 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:20.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f881555f700 1 -- 172.21.15.81:0/4233089451 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808011830 con 0x7f881006ace0 2023-11-29T11:21:20.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f881555f700 1 -- 172.21.15.81:0/4233089451 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808011990 con 0x7f881006ace0 2023-11-29T11:21:20.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f881555f700 1 -- 172.21.15.81:0/4233089451 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808011d00 con 0x7f881006ace0 2023-11-29T11:21:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8817563700 1 -- 172.21.15.81:0/4233089451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f881006ace0 msgr2=0x7f88100b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8817563700 1 --2- 172.21.15.81:0/4233089451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f881006ace0 0x7f88100b3720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8808009850 tx=0x7f8808009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8817563700 1 -- 172.21.15.81:0/4233089451 shutdown_connections 2023-11-29T11:21:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8817563700 1 --2- 172.21.15.81:0/4233089451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f881006ace0 0x7f88100b3720 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8817563700 1 --2- 172.21.15.81:0/4233089451 >> v2:172.21.15.81:3300/0 conn(0x7f88101584c0 0x7f88100cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8817563700 1 -- 172.21.15.81:0/4233089451 >> 172.21.15.81:0/4233089451 conn(0x7f88100ce3e0 msgr2=0x7f88100ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8817563700 1 -- 172.21.15.81:0/4233089451 shutdown_connections 2023-11-29T11:21:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.135+0000 7f8817563700 1 -- 172.21.15.81:0/4233089451 wait complete. 2023-11-29T11:21:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 Processor -- start 2023-11-29T11:21:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 -- start start 2023-11-29T11:21:20.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f881006ace0 0x7f8810070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:20.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88100b32e0 0x7f88100aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:20.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88101584c0 0x7f8810097490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:20.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810071f40 con 0x7f88100b32e0 2023-11-29T11:21:20.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88100713c0 con 0x7f881006ace0 2023-11-29T11:21:20.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88100716a0 con 0x7f88101584c0 2023-11-29T11:21:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8815d60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88100b32e0 0x7f88100aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8815d60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88100b32e0 0x7f88100aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50444/0 (socket says 172.21.15.81:50444) 2023-11-29T11:21:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8815d60700 1 -- 172.21.15.81:0/2510776649 learned_addr learned my addr 172.21.15.81:0/2510776649 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8816561700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f881006ace0 0x7f8810070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8816d62700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88101584c0 0x7f8810097490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8816561700 1 -- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88101584c0 msgr2=0x7f8810097490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8816561700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88101584c0 0x7f8810097490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8816561700 1 -- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88100b32e0 msgr2=0x7f88100aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8816561700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88100b32e0 0x7f88100aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8816561700 1 -- 172.21.15.81:0/2510776649 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080094b0 con 0x7f881006ace0 2023-11-29T11:21:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8815d60700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88100b32e0 0x7f88100aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8816561700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f881006ace0 0x7f8810070cc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f880000e870 tx=0x7f880000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8806ffd700 1 -- 172.21.15.81:0/2510776649 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800013680 con 0x7f881006ace0 2023-11-29T11:21:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8806ffd700 1 -- 172.21.15.81:0/2510776649 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000137e0 con 0x7f881006ace0 2023-11-29T11:21:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88100cd990 con 0x7f881006ace0 2023-11-29T11:21:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8806ffd700 1 -- 172.21.15.81:0/2510776649 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800013b50 con 0x7f881006ace0 2023-11-29T11:21:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.139+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88100cd6b0 con 0x7f881006ace0 2023-11-29T11:21:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.143+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88100cdc70 con 0x7f881006ace0 2023-11-29T11:21:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.143+0000 7f8806ffd700 1 -- 172.21.15.81:0/2510776649 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8800019030 con 0x7f881006ace0 2023-11-29T11:21:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.143+0000 7f8806ffd700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87f4064ee0 0x7f87f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.143+0000 7f8815d60700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87f4064ee0 0x7f87f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.143+0000 7f8806ffd700 1 -- 172.21.15.81:0/2510776649 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f8800081ca0 con 0x7f881006ace0 2023-11-29T11:21:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.143+0000 7f8815d60700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87f4064ee0 0x7f87f4067390 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f88100adba0 tx=0x7f880c001ba0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.151+0000 7f8806ffd700 1 -- 172.21.15.81:0/2510776649 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f880004fd40 con 0x7f881006ace0 2023-11-29T11:21:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:20.351+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8810072500 con 0x7f881006ace0 2023-11-29T11:21:21.160 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:21:21.155+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:21:21.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.163+0000 7f8806ffd700 1 -- 172.21.15.81:0/2510776649 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8800017090 con 0x7f881006ace0 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87f4064ee0 msgr2=0x7f87f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87f4064ee0 0x7f87f4067390 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f88100adba0 tx=0x7f880c001ba0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f881006ace0 msgr2=0x7f8810070cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f881006ace0 0x7f8810070cc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f880000e870 tx=0x7f880000eb80 comp rx=0 tx=0).stop 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 shutdown_connections 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f87f4064ee0 0x7f87f4067390 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88101584c0 0x7f8810097490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88100b32e0 0x7f88100aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 --2- 172.21.15.81:0/2510776649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f881006ace0 0x7f8810070cc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 >> 172.21.15.81:0/2510776649 conn(0x7f88100ce3e0 msgr2=0x7f8810153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 shutdown_connections 2023-11-29T11:21:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.167+0000 7f8817563700 1 -- 172.21.15.81:0/2510776649 wait complete. 2023-11-29T11:21:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:21:21.176 INFO:tasks.ceph.mds.a.smithi081.stderr: -4170> 2023-11-29T11:20:06.105+0000 7fe2f1598700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:21:21.176 INFO:tasks.ceph.mds.a.smithi081.stderr: -3964> 2023-11-29T11:20:06.932+0000 7fe2edd91700 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2023-11-29T11:21:21.176 INFO:tasks.ceph.mds.a.smithi081.stderr: -3784> 2023-11-29T11:20:07.164+0000 7fe2edd91700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 ap=1 f(v0 m2023-11-29T11:19:47.824838+0000 1=1+0) n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x5596f4264100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2023-11-29T11:19:47.824838+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2023-11-29T11:21:21.178 INFO:tasks.ceph.mds.a.smithi081.stderr: -2267> 2023-11-29T11:20:38.628+0000 7fe2edd91700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 pv17 ap=3 DIRTYPARENT f(v0 m2023-11-29T11:19:47.824838+0000 1=1+0)->f(v1 m2023-11-29T11:19:47.824838+0000) n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1)->n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5596f4264100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2023-11-29T11:19:47.824838+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-11-29T11:19:47.859093+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2023-11-29T11:21:21.190 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2023-11-29T11:21:21.211 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:21:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d58f5840 1 -- start start 2023-11-29T11:21:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d58f5840 1 Processor -- start 2023-11-29T11:21:21.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb2e29800 0x556fb2eca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb2e29400 0x556fb2ecab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb2e29000 0x556fb2ecb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2e5fcc0 con 0x556fb2e29800 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2eae780 con 0x556fb2e29400 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fb2e5e780 con 0x556fb2e29000 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d40b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb2e29800 0x556fb2eca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d40b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb2e29800 0x556fb2eca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50470/0 (socket says 172.21.15.81:50470) 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d40b1700 1 -- 172.21.15.81:0/1737185699 learned_addr learned my addr 172.21.15.81:0/1737185699 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb2e29400 0x556fb2ecab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb2e29000 0x556fb2ecb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d40b1700 1 -- 172.21.15.81:0/1737185699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb2e29000 msgr2=0x556fb2ecb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb2e29000 0x556fb2ecb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d40b1700 1 -- 172.21.15.81:0/1737185699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb2e29400 msgr2=0x556fb2ecab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.223+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb2e29400 0x556fb2ecab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d40b1700 1 -- 172.21.15.81:0/1737185699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb2e4b6c0 con 0x556fb2e29800 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb2e29800 0x556fb2eca580 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x556fb2f86c30 tx=0x556fb2eff380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f9b102adc4d911 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d18ac700 1 -- 172.21.15.81:0/1737185699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556fb2e5d080 con 0x556fb2e29800 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d18ac700 1 -- 172.21.15.81:0/1737185699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556fb2e75200 con 0x556fb2e29800 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d18ac700 1 -- 172.21.15.81:0/1737185699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556fb2e5d600 con 0x556fb2e29800 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 -- 172.21.15.81:0/1737185699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb2e4ab60 con 0x556fb2e29800 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 -- 172.21.15.81:0/1737185699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x556fb2e4b860 con 0x556fb2e29800 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 4 waiting for MDS map... 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d18ac700 1 -- 172.21.15.81:0/1737185699 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x556fb2e64c40 con 0x556fb2e29800 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d18ac700 1 -- 172.21.15.81:0/1737185699 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 61) v1 ==== 2565+0+0 (secure 0 0 0) 0x556fb2e6af00 con 0x556fb2e29800 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 4 Got MDS map 61 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 4 datascan.main: Using metadata pool output 2023-11-29T11:21:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 4 datascan.main: connecting to RADOS... 2023-11-29T11:21:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 Processor -- start 2023-11-29T11:21:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 -- start start 2023-11-29T11:21:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311a400 0x556fb2ecb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311ac00 0x556fb2ecc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2e5f680 con 0x556fb311ac00 2023-11-29T11:21:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2e5f900 con 0x556fb311a800 2023-11-29T11:21:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.227+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fb2eae3c0 con 0x556fb311a400 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311ac00 0x556fb2ecc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d40b1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311ac00 0x556fb2ecc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50476/0 (socket says 172.21.15.81:50476) 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d48b2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311a400 0x556fb2ecb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 -- 172.21.15.81:0/4061254088 learned_addr learned my addr 172.21.15.81:0/4061254088 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 -- 172.21.15.81:0/4061254088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311a400 msgr2=0x556fb2ecb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/4061254088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311a400 0x556fb2ecb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 -- 172.21.15.81:0/4061254088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a800 msgr2=0x556fb2ecbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/4061254088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 -- 172.21.15.81:0/4061254088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb2e4ba00 con 0x556fb311ac00 2023-11-29T11:21:21.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/4061254088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311ac00 0x556fb2ecc100 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x556fb317c0f0 tx=0x556fb3c9ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5064391c866a934 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/4061254088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556fb2e5d080 con 0x556fb311ac00 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/4061254088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556fb2e75e00 con 0x556fb311ac00 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/4061254088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556fb2e5d600 con 0x556fb311ac00 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d58f5840 1 -- 172.21.15.81:0/4061254088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311ac00 msgr2=0x556fb2ecc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/4061254088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311ac00 0x556fb2ecc100 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x556fb317c0f0 tx=0x556fb3c9ec00 comp rx=0 tx=0).stop 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d58f5840 1 -- 172.21.15.81:0/4061254088 shutdown_connections 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/4061254088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311ac00 0x556fb2ecc100 secure :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x556fb317c0f0 tx=0x556fb3c9ec00 comp rx=0 tx=0).stop 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/4061254088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/4061254088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311a400 0x556fb2ecb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.231+0000 7fa3d58f5840 1 -- 172.21.15.81:0/4061254088 >> 172.21.15.81:0/4061254088 conn(0x556fb2e28c00 msgr2=0x556fb2f19800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 -- 172.21.15.81:0/4061254088 shutdown_connections 2023-11-29T11:21:21.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 -- 172.21.15.81:0/4061254088 wait complete. 2023-11-29T11:21:21.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 Processor -- start 2023-11-29T11:21:21.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 -- start start 2023-11-29T11:21:21.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a400 0x556fb2ecb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311b000 0x556fb2ecc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2eae280 con 0x556fb311a800 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb2eae140 con 0x556fb311a400 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fb2eae000 con 0x556fb311b000 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50482/0 (socket says 172.21.15.81:50482) 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 learned_addr learned my addr 172.21.15.81:0/3509618035 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a400 0x556fb2ecb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311b000 0x556fb2ecc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311b000 msgr2=0x556fb2ecc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb311b000 0x556fb2ecc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a400 msgr2=0x556fb2ecb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb311a400 0x556fb2ecb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb2e4bba0 con 0x556fb311a800 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x556fb317cdb0 tx=0x556fb2eff500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3ce0a5700 1 -- 172.21.15.81:0/3509618035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556fb2e5d1e0 con 0x556fb311a800 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3ce0a5700 1 -- 172.21.15.81:0/3509618035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556fb319c000 con 0x556fb311a800 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fb2e4bd40 con 0x556fb311a800 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3ce0a5700 1 -- 172.21.15.81:0/3509618035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556fb2e5cf20 con 0x556fb311a800 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb2e4ab60 con 0x556fb311a800 2023-11-29T11:21:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.235+0000 7fa3d58f5840 4 datascan.init: resolving metadata pool 14 2023-11-29T11:21:21.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3ce0a5700 1 -- 172.21.15.81:0/3509618035 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x556fb2e86840 con 0x556fb311a800 2023-11-29T11:21:21.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3ce0a5700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x556fb327c000 0x556fb2ecd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3ce0a5700 1 -- 172.21.15.81:0/3509618035 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x556fb2e64a80 con 0x556fb311a800 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d58f5840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d58f5840 4 datascan.main: data pool 'cephfs_data' has ID 15 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d58f5840 4 datascan.main: opening data pool 'cephfs_data' 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x556fb327c000 0x556fb2ecd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x556fb311b400 0x556fb2eccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:1 15.0 15:00000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb311b800 con 0x556fb311b400 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x556fb311b400 0x556fb2eccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x556fb327c000 0x556fb2ecd700 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x556fb2f861e0 tx=0x556fb3c9fbc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.239+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x556fb311b400 0x556fb2eccc00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 1 ==== osd_op_reply(1 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3cf0a7700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x556fb311ac00 0x556fb3290000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:2 15.20 15:04000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327c400 con 0x556fb311ac00 2023-11-29T11:21:21.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x556fb311ac00 0x556fb3290000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x556fb311ac00 0x556fb3290000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== osd_op_reply(2 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3cf8a8700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x556fb327c800 0x556fb3290580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:3 15.10 15:08000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327cc00 con 0x556fb327c800 2023-11-29T11:21:21.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x556fb327c800 0x556fb3290580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x556fb327c800 0x556fb3290580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.4 v2:172.21.15.176:6808/36811 1 ==== osd_op_reply(3 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327c800 2023-11-29T11:21:21.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3cf0a7700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x556fb311b800 0x556fb3290b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.243+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:4 15.30 15:0c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327d400 con 0x556fb311b800 2023-11-29T11:21:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x556fb311b800 0x556fb3290b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x556fb311b800 0x556fb3290b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 1 ==== osd_op_reply(4 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:5 15.8 15:10000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327d000 con 0x556fb311b400 2023-11-29T11:21:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 2 ==== osd_op_reply(5 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:6 15.28 15:14000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327d800 con 0x556fb311b800 2023-11-29T11:21:21.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 2 ==== osd_op_reply(6 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3cf8a8700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x556fb327d400 0x556fb3291600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:7 15.18 15:18000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327d000 con 0x556fb327d400 2023-11-29T11:21:21.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x556fb327d400 0x556fb3291600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.247+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x556fb327d400 0x556fb3291600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.3 v2:172.21.15.81:6824/36540 1 ==== osd_op_reply(7 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb327d400 2023-11-29T11:21:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3cf0a7700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x556fb327dc00 0x556fb3291080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:8 15.38 15:1c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327c400 con 0x556fb327dc00 2023-11-29T11:21:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x556fb327dc00 0x556fb3291080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3d40b1700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x556fb327dc00 0x556fb3291080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(8 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:9 15.4 15:20000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327d800 con 0x556fb311ac00 2023-11-29T11:21:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 2 ==== osd_op_reply(9 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3cf0a7700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x556fb327d000 0x556fb3292100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:10 15.24 15:24000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa000 con 0x556fb327d000 2023-11-29T11:21:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x556fb327d000 0x556fb3292100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.251+0000 7fa3d38b0700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x556fb327d000 0x556fb3292100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 1 ==== osd_op_reply(10 [pgnls start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:11 15.14 15:28000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32ab400 con 0x556fb327d000 2023-11-29T11:21:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 2 ==== osd_op_reply(11 [pgnls start_epoch 98 out=49b] v96'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:12 15.34 15:2c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa400 con 0x556fb327c800 2023-11-29T11:21:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.4 v2:172.21.15.176:6808/36811 2 ==== osd_op_reply(12 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327c800 2023-11-29T11:21:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3cf8a8700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x556fb32ab800 0x556fb3291b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:13 15.c 15:30000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32abc00 con 0x556fb32ab800 2023-11-29T11:21:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x556fb32ab800 0x556fb3291b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3d48b2700 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x556fb32ab800 0x556fb3291b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(13 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb32ab800 2023-11-29T11:21:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.255+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:14 15.2c 15:34000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa800 con 0x556fb327c800 2023-11-29T11:21:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.4 v2:172.21.15.176:6808/36811 3 ==== osd_op_reply(14 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327c800 2023-11-29T11:21:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:15 15.1c 15:38000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa400 con 0x556fb311ac00 2023-11-29T11:21:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 3 ==== osd_op_reply(15 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:16 15.3c 15:3c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aac00 con 0x556fb327d400 2023-11-29T11:21:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.3 v2:172.21.15.81:6824/36540 2 ==== osd_op_reply(16 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb327d400 2023-11-29T11:21:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:17 15.2 15:40000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa800 con 0x556fb311b400 2023-11-29T11:21:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 3 ==== osd_op_reply(17 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:18 15.22 15:44000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32ab000 con 0x556fb311b400 2023-11-29T11:21:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.259+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 4 ==== osd_op_reply(18 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:19 15.12 15:48000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327cc00 con 0x556fb327d400 2023-11-29T11:21:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.3 v2:172.21.15.81:6824/36540 3 ==== osd_op_reply(19 [pgnls start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb327d400 2023-11-29T11:21:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:20 15.32 15:4c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa000 con 0x556fb311b400 2023-11-29T11:21:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 5 ==== osd_op_reply(20 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:21 15.a 15:50000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327c400 con 0x556fb311b400 2023-11-29T11:21:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 6 ==== osd_op_reply(21 [pgnls start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:22 15.2a 15:54000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32ab400 con 0x556fb327dc00 2023-11-29T11:21:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 2 ==== osd_op_reply(22 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:23 15.1a 15:58000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa400 con 0x556fb32ab800 2023-11-29T11:21:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.5 v2:172.21.15.176:6824/36812 2 ==== osd_op_reply(23 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb32ab800 2023-11-29T11:21:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.263+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:24 15.3a 15:5c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa800 con 0x556fb311b800 2023-11-29T11:21:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.267+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 3 ==== osd_op_reply(24 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.267+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:25 15.6 15:60000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0000 con 0x556fb327dc00 2023-11-29T11:21:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.267+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 3 ==== osd_op_reply(25 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.267+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:26 15.26 15:64000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32ab000 con 0x556fb327dc00 2023-11-29T11:21:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.267+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 4 ==== osd_op_reply(26 [pgnls start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.267+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:27 15.16 15:68000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0400 con 0x556fb327dc00 2023-11-29T11:21:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.267+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 5 ==== osd_op_reply(27 [pgnls start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.267+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:28 15.36 15:6c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32abc00 con 0x556fb327d000 2023-11-29T11:21:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 3 ==== osd_op_reply(28 [pgnls start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:29 15.e 15:70000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0800 con 0x556fb311b400 2023-11-29T11:21:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 7 ==== osd_op_reply(29 [pgnls start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:30 15.2e 15:74000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327d800 con 0x556fb327d400 2023-11-29T11:21:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.3 v2:172.21.15.81:6824/36540 4 ==== osd_op_reply(30 [pgnls start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb327d400 2023-11-29T11:21:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:31 15.1e 15:78000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0c00 con 0x556fb311b400 2023-11-29T11:21:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 8 ==== osd_op_reply(31 [pgnls start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:32 15.3e 15:7c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aac00 con 0x556fb327dc00 2023-11-29T11:21:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 6 ==== osd_op_reply(32 [pgnls start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.271+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:33 15.1 15:80000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1000 con 0x556fb327d000 2023-11-29T11:21:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 4 ==== osd_op_reply(33 [pgnls start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:34 15.21 15:84000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa400 con 0x556fb327d400 2023-11-29T11:21:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.3 v2:172.21.15.81:6824/36540 5 ==== osd_op_reply(34 [pgnls start_epoch 98 out=49b] v96'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb327d400 2023-11-29T11:21:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:35 15.11 15:88000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1400 con 0x556fb311b400 2023-11-29T11:21:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 9 ==== osd_op_reply(35 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:36 15.31 15:8c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa000 con 0x556fb327d400 2023-11-29T11:21:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.3 v2:172.21.15.81:6824/36540 6 ==== osd_op_reply(36 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb327d400 2023-11-29T11:21:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:37 15.9 15:90000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1800 con 0x556fb327d000 2023-11-29T11:21:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 5 ==== osd_op_reply(37 [pgnls start_epoch 98 out=49b] v96'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.275+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:38 15.29 15:94000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa800 con 0x556fb327dc00 2023-11-29T11:21:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.279+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 7 ==== osd_op_reply(38 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.279+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:39 15.19 15:98000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0000 con 0x556fb327c800 2023-11-29T11:21:21.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.279+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.4 v2:172.21.15.176:6808/36811 4 ==== osd_op_reply(39 [pgnls start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327c800 2023-11-29T11:21:21.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.279+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:40 15.39 15:9c000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327cc00 con 0x556fb311b800 2023-11-29T11:21:21.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.279+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 4 ==== osd_op_reply(40 [pgnls start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.279+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:41 15.5 15:a0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0400 con 0x556fb327d000 2023-11-29T11:21:21.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.279+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 6 ==== osd_op_reply(41 [pgnls start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.279+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:42 15.25 15:a4000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327d800 con 0x556fb311b800 2023-11-29T11:21:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 5 ==== osd_op_reply(42 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:43 15.15 15:a8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0800 con 0x556fb311b800 2023-11-29T11:21:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 6 ==== osd_op_reply(43 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:44 15.35 15:ac000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327c400 con 0x556fb311b800 2023-11-29T11:21:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 7 ==== osd_op_reply(44 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:45 15.d 15:b0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1c00 con 0x556fb311b800 2023-11-29T11:21:21.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 8 ==== osd_op_reply(45 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:46 15.2d 15:b4000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0c00 con 0x556fb311b400 2023-11-29T11:21:21.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.283+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 10 ==== osd_op_reply(46 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.287+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:47 15.1d 15:b8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32ab400 con 0x556fb327c800 2023-11-29T11:21:21.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.287+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.4 v2:172.21.15.176:6808/36811 5 ==== osd_op_reply(47 [pgnls start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327c800 2023-11-29T11:21:21.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.287+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:48 15.3d 15:bc000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1000 con 0x556fb311ac00 2023-11-29T11:21:21.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.287+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 4 ==== osd_op_reply(48 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.287+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:49 15.3 15:c0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32ab000 con 0x556fb327c800 2023-11-29T11:21:21.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.287+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.4 v2:172.21.15.176:6808/36811 6 ==== osd_op_reply(49 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327c800 2023-11-29T11:21:21.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.287+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:50 15.23 15:c4000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1400 con 0x556fb327dc00 2023-11-29T11:21:21.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.291+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 8 ==== osd_op_reply(50 [pgnls start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.291+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:51 15.13 15:c8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aac00 con 0x556fb311ac00 2023-11-29T11:21:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.291+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 5 ==== osd_op_reply(51 [pgnls start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.291+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:52 15.33 15:cc000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1800 con 0x556fb327d400 2023-11-29T11:21:21.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.291+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.3 v2:172.21.15.81:6824/36540 7 ==== osd_op_reply(52 [pgnls start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb327d400 2023-11-29T11:21:21.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.291+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:53 15.b 15:d0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32abc00 con 0x556fb311b400 2023-11-29T11:21:21.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.291+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 11 ==== osd_op_reply(53 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.291+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:54 15.2b 15:d4000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0400 con 0x556fb311b400 2023-11-29T11:21:21.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.295+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.2 v2:172.21.15.81:6800/36539 12 ==== osd_op_reply(54 [pgnls start_epoch 98 out=49b] v96'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b400 2023-11-29T11:21:21.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.295+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:55 15.1b 15:d8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0800 con 0x556fb311b800 2023-11-29T11:21:21.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.295+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.7 v2:172.21.15.176:6800/36814 9 ==== osd_op_reply(55 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb311b800 2023-11-29T11:21:21.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.295+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:56 15.3b 15:dc000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb327cc00 con 0x556fb327d000 2023-11-29T11:21:21.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.295+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 7 ==== osd_op_reply(56 [pgnls start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.295+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:57 15.7 15:e0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1c00 con 0x556fb311ac00 2023-11-29T11:21:21.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.295+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 6 ==== osd_op_reply(57 [pgnls start_epoch 98 out=81b] v96'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.295+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:58 15.7 15:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0400 con 0x556fb311ac00 2023-11-29T11:21:21.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.299+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 7 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.299+0000 7fa3d58f5840 10 datascan.operator(): handling object 1099511627777.0 2023-11-29T11:21:21.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.299+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:59 15.7 15:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1000 con 0x556fb311ac00 2023-11-29T11:21:21.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.303+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 8 ==== osd_op_reply(59 10000000001.00000000 [call] v98'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.303+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:60 15.27 15:e4000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1800 con 0x556fb327d000 2023-11-29T11:21:21.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.303+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 8 ==== osd_op_reply(60 [pgnls start_epoch 98 out=49b] v96'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.303+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:61 15.17 15:e8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0c00 con 0x556fb327c800 2023-11-29T11:21:21.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.303+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.4 v2:172.21.15.176:6808/36811 7 ==== osd_op_reply(61 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327c800 2023-11-29T11:21:21.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.303+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:62 15.37 15:ec000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0000 con 0x556fb327c800 2023-11-29T11:21:21.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.303+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.4 v2:172.21.15.176:6808/36811 8 ==== osd_op_reply(62 [pgnls start_epoch 98 out=49b] v96'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327c800 2023-11-29T11:21:21.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.303+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:63 15.f 15:f0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32abc00 con 0x556fb327d000 2023-11-29T11:21:21.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 <== osd.6 v2:172.21.15.176:6816/36813 9 ==== osd_op_reply(63 [pgnls start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c94fc0 con 0x556fb327d000 2023-11-29T11:21:21.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:64 15.2f 15:f4000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b1400 con 0x556fb327dc00 2023-11-29T11:21:21.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d40b1700 1 -- 172.21.15.81:0/3509618035 <== osd.0 v2:172.21.15.81:6802/36537 9 ==== osd_op_reply(64 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95440 con 0x556fb327dc00 2023-11-29T11:21:21.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3cf8a8700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:65 15.1f 15:f8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32aa400 con 0x556fb327d400 2023-11-29T11:21:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.3 v2:172.21.15.81:6824/36540 8 ==== osd_op_reply(65 [pgnls start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb327d400 2023-11-29T11:21:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3cf0a7700 1 -- 172.21.15.81:0/3509618035 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:66 15.3f 15:fc000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x556fb32b0c00 con 0x556fb311ac00 2023-11-29T11:21:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d48b2700 1 -- 172.21.15.81:0/3509618035 <== osd.1 v2:172.21.15.81:6803/36538 9 ==== osd_op_reply(66 [pgnls start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556fb3c95200 con 0x556fb311ac00 2023-11-29T11:21:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x556fb327dc00 msgr2=0x556fb3291080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x556fb327dc00 0x556fb3291080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x556fb311ac00 msgr2=0x556fb3290000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x556fb311ac00 0x556fb3290000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x556fb311b400 msgr2=0x556fb2eccc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x556fb311b400 0x556fb2eccc00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x556fb327d400 msgr2=0x556fb3291600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x556fb327d400 0x556fb3291600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 reap_dead start 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x556fb327c800 msgr2=0x556fb3290580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x556fb327c800 0x556fb3290580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x556fb32ab800 msgr2=0x556fb3291b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x556fb32ab800 0x556fb3291b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x556fb327d000 msgr2=0x556fb3292100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x556fb327d000 0x556fb3292100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x556fb311b800 msgr2=0x556fb3290b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d38b0700 1 -- 172.21.15.81:0/3509618035 reap_dead start 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x556fb311b800 0x556fb3290b00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x556fb327c000 msgr2=0x556fb2ecd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x556fb327c000 0x556fb2ecd700 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x556fb2f861e0 tx=0x556fb3c9fbc0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311a800 msgr2=0x556fb2ecbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x556fb317cdb0 tx=0x556fb2eff500 comp rx=0 tx=0).stop 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 shutdown_connections 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x556fb311b800 0x556fb3290b00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x556fb327c000 0x556fb2ecd700 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.307+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/3509618035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb311a800 0x556fb2ecbb80 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 >> 172.21.15.81:0/3509618035 conn(0x556fb2e28c00 msgr2=0x556fb2f19800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 shutdown_connections 2023-11-29T11:21:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 -- 172.21.15.81:0/3509618035 wait complete. 2023-11-29T11:21:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 -- 172.21.15.81:0/1737185699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb2e29800 msgr2=0x556fb2eca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb2e29800 0x556fb2eca580 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x556fb2f86c30 tx=0x556fb2eff380 comp rx=0 tx=0).stop 2023-11-29T11:21:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 -- 172.21.15.81:0/1737185699 shutdown_connections 2023-11-29T11:21:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556fb2e29000 0x556fb2ecb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556fb2e29400 0x556fb2ecab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 --2- 172.21.15.81:0/1737185699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fb2e29800 0x556fb2eca580 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 -- 172.21.15.81:0/1737185699 >> 172.21.15.81:0/1737185699 conn(0x556fb2e29c00 msgr2=0x556fb2f19000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 -- 172.21.15.81:0/1737185699 shutdown_connections 2023-11-29T11:21:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.311+0000 7fa3d58f5840 1 -- 172.21.15.81:0/1737185699 wait complete. 2023-11-29T11:21:21.321 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.131640, result: 2023-11-29T11:21:21.322 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2023-11-29T11:21:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 -- start start 2023-11-29T11:21:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 Processor -- start 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cabefb800 0x558cabf9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cabefb400 0x558cabf9cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cabefb000 0x558cabf9d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cabf31cc0 con 0x558cabefb400 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cabf31680 con 0x558cabefb800 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cabf30780 con 0x558cabefb000 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cabefb400 0x558cabf9cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cabefb400 0x558cabf9cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50488/0 (socket says 172.21.15.81:50488) 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 -- 172.21.15.81:0/3419568253 learned_addr learned my addr 172.21.15.81:0/3419568253 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f32206cd700 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cabefb000 0x558cabf9d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321fecc700 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cabefb800 0x558cabf9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 -- 172.21.15.81:0/3419568253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cabefb000 msgr2=0x558cabf9d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cabefb000 0x558cabf9d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 -- 172.21.15.81:0/3419568253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cabefb800 msgr2=0x558cabf9c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cabefb800 0x558cabf9c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 -- 172.21.15.81:0/3419568253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cabf1c9c0 con 0x558cabefb400 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321f6cb700 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cabefb400 0x558cabf9cb00 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x558cac05cd80 tx=0x558cabfd1260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a9e5fddfce2db7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321d6c7700 1 -- 172.21.15.81:0/3419568253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558cabf2f600 con 0x558cabefb400 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321d6c7700 1 -- 172.21.15.81:0/3419568253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558cabf46d80 con 0x558cabefb400 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f321d6c7700 1 -- 172.21.15.81:0/3419568253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558cabf2f1e0 con 0x558cabefb400 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 -- 172.21.15.81:0/3419568253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cabf1cb60 con 0x558cabefb400 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 1 -- 172.21.15.81:0/3419568253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558cabf1d860 con 0x558cabefb400 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.399+0000 7f3221710840 4 waiting for MDS map... 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f321d6c7700 1 -- 172.21.15.81:0/3419568253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x558cabf36c40 con 0x558cabefb400 2023-11-29T11:21:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f321d6c7700 1 -- 172.21.15.81:0/3419568253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 61) v1 ==== 2565+0+0 (secure 0 0 0) 0x558cabf3cf00 con 0x558cabefb400 2023-11-29T11:21:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 4 Got MDS map 61 2023-11-29T11:21:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 4 datascan.main: Using metadata pool output 2023-11-29T11:21:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 4 datascan.main: connecting to RADOS... 2023-11-29T11:21:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 1 Processor -- start 2023-11-29T11:21:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 1 -- start start 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c400 0x558cabf9d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c800 0x558cabf9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 0x558cabf9e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cabf31e00 con 0x558cacd7c800 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cabf80780 con 0x558cacd7cc00 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f3221710840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cabf803c0 con 0x558cacd7c400 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.403+0000 7f321fecc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c800 0x558cabf9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321fecc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c800 0x558cabf9db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50504/0 (socket says 172.21.15.81:50504) 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321fecc700 1 -- 172.21.15.81:0/3288075192 learned_addr learned my addr 172.21.15.81:0/3288075192 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321f6cb700 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 0x558cabf9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f32206cd700 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c400 0x558cabf9d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321fecc700 1 -- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c400 msgr2=0x558cabf9d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321fecc700 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c400 0x558cabf9d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321fecc700 1 -- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 msgr2=0x558cabf9e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321fecc700 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 0x558cabf9e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321fecc700 1 -- 172.21.15.81:0/3288075192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cabf1da00 con 0x558cacd7c800 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f32206cd700 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c400 0x558cabf9d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321fecc700 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c800 0x558cabf9db80 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x558cac25c000 tx=0x558cac1f4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6d4fa53b5b1734 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321b6c3700 1 -- 172.21.15.81:0/3288075192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558cabf2f600 con 0x558cacd7c800 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321b6c3700 1 -- 172.21.15.81:0/3288075192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558cabf47e00 con 0x558cacd7c800 2023-11-29T11:21:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f321b6c3700 1 -- 172.21.15.81:0/3288075192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558cabf2f1e0 con 0x558cacd7c800 2023-11-29T11:21:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 -- 172.21.15.81:0/3288075192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c800 msgr2=0x558cabf9db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c800 0x558cabf9db80 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x558cac25c000 tx=0x558cac1f4c00 comp rx=0 tx=0).stop 2023-11-29T11:21:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 -- 172.21.15.81:0/3288075192 shutdown_connections 2023-11-29T11:21:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 0x558cabf9e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c800 0x558cabf9db80 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 --2- 172.21.15.81:0/3288075192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c400 0x558cabf9d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 -- 172.21.15.81:0/3288075192 >> 172.21.15.81:0/3288075192 conn(0x558cabefac00 msgr2=0x558cabfeb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 -- 172.21.15.81:0/3288075192 shutdown_connections 2023-11-29T11:21:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 -- 172.21.15.81:0/3288075192 wait complete. 2023-11-29T11:21:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 Processor -- start 2023-11-29T11:21:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.407+0000 7f3221710840 1 -- start start 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c400 0x558cabf9f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c800 0x558cabf9ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 0x558cabf9e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cabf31680 con 0x558cacd7c400 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cabf31cc0 con 0x558cacd7cc00 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cabf31900 con 0x558cacd7c800 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c400 0x558cabf9f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c400 0x558cabf9f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50520/0 (socket says 172.21.15.81:50520) 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 learned_addr learned my addr 172.21.15.81:0/1113633291 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f321f6cb700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 0x558cabf9e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f321fecc700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c800 0x558cabf9ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c800 msgr2=0x558cabf9ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cacd7c800 0x558cabf9ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 msgr2=0x558cabf9e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cacd7cc00 0x558cabf9e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cac262000 con 0x558cacd7c400 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c400 0x558cabf9f180 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x558cac25d320 tx=0x558cac1f4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3219ec0700 1 -- 172.21.15.81:0/1113633291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558cabf2f600 con 0x558cacd7c400 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3219ec0700 1 -- 172.21.15.81:0/1113633291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558cac26a000 con 0x558cacd7c400 2023-11-29T11:21:21.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cabf1dba0 con 0x558cacd7c400 2023-11-29T11:21:21.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3219ec0700 1 -- 172.21.15.81:0/1113633291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558cabf2f1e0 con 0x558cacd7c400 2023-11-29T11:21:21.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cac2621a0 con 0x558cacd7c400 2023-11-29T11:21:21.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.411+0000 7f3221710840 4 datascan.init: resolving metadata pool 14 2023-11-29T11:21:21.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3219ec0700 1 -- 172.21.15.81:0/1113633291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x558cabf58840 con 0x558cacd7c400 2023-11-29T11:21:21.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3219ec0700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x558cac346000 0x558cabf9f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3219ec0700 1 -- 172.21.15.81:0/1113633291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x558cabf36a80 con 0x558cacd7c400 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f321fecc700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x558cac346000 0x558cabf9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3221710840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3221710840 4 datascan.main: data pool 'cephfs_data' has ID 15 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3221710840 4 datascan.main: opening data pool 'cephfs_data' 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x558cacd7d000 0x558cabf9e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cacd7d400 con 0x558cacd7d000 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f321f6cb700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x558cacd7d000 0x558cabf9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f321fecc700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x558cac346000 0x558cabf9f700 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x558cac25c000 tx=0x558cacd6ec60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f321f6cb700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x558cacd7d000 0x558cabf9e100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv24 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x558cacd7d800 0x558cabf9db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:2 14.1f 14:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346400 con 0x558cacd7d800 2023-11-29T11:21:21.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.415+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x558cacd7d800 0x558cabf9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x558cacd7d800 0x558cabf9db80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x558cac346800 0x558cabf9d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:3 15.0 15:00000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346c00 con 0x558cac346800 2023-11-29T11:21:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f321fecc700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x558cac346800 0x558cabf9d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f321fecc700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x558cac346800 0x558cabf9d600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f321aec2700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558cac360000 0x558cac366000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:4 15.20 15:04000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360400 con 0x558cac360000 2023-11-29T11:21:21.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f321f6cb700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558cac360000 0x558cac366000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.419+0000 7f321f6cb700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558cac360000 0x558cac366000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:5 15.10 15:08000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360c00 con 0x558cacd7d000 2023-11-29T11:21:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f321aec2700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x558cac360800 0x558cac366580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:6 15.30 15:0c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360400 con 0x558cac360800 2023-11-29T11:21:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x558cac360800 0x558cac366580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x558cac360800 0x558cac366580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.423+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:7 15.8 15:10000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361000 con 0x558cac346800 2023-11-29T11:21:21.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:8 15.28 15:14000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360c00 con 0x558cac360800 2023-11-29T11:21:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321b6c3700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x558cac361400 0x558cac367080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:9 15.18 15:18000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360400 con 0x558cac361400 2023-11-29T11:21:21.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321fecc700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x558cac361400 0x558cac367080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321fecc700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x558cac361400 0x558cac367080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:10 15.38 15:1c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cacd7d400 con 0x558cacd7d800 2023-11-29T11:21:21.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.427+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:11 15.4 15:20000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346400 con 0x558cac360000 2023-11-29T11:21:21.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321aec2700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x558cac360c00 0x558cac366b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:12 15.24 15:24000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361000 con 0x558cac360c00 2023-11-29T11:21:21.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321f6cb700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x558cac360c00 0x558cac366b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321f6cb700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x558cac360c00 0x558cac366b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 1 ==== osd_op_reply(12 [pgnls-filter start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:13 15.14 15:28000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346c00 con 0x558cac360c00 2023-11-29T11:21:21.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 2 ==== osd_op_reply(13 [pgnls-filter start_epoch 98 out=49b] v96'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.431+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:14 15.34 15:2c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361800 con 0x558cacd7d000 2023-11-29T11:21:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 3 ==== osd_op_reply(14 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f321b6c3700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x558cac361000 0x558cac367600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:15 15.c 15:30000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361800 con 0x558cac361000 2023-11-29T11:21:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x558cac361000 0x558cac367600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f32206cd700 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x558cac361000 0x558cac367600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(15 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac361000 2023-11-29T11:21:21.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:16 15.2c 15:34000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361c00 con 0x558cacd7d000 2023-11-29T11:21:21.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 4 ==== osd_op_reply(16 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.435+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:17 15.1c 15:38000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346400 con 0x558cac360000 2023-11-29T11:21:21.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 3 ==== osd_op_reply(17 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:18 15.3c 15:3c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386000 con 0x558cac361400 2023-11-29T11:21:21.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 2 ==== osd_op_reply(18 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:19 15.2 15:40000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346c00 con 0x558cac346800 2023-11-29T11:21:21.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:20 15.22 15:44000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386400 con 0x558cac346800 2023-11-29T11:21:21.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 4 ==== osd_op_reply(20 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:21 15.12 15:48000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386000 con 0x558cac361400 2023-11-29T11:21:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 3 ==== osd_op_reply(21 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.439+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:22 15.32 15:4c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386800 con 0x558cac346800 2023-11-29T11:21:21.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.443+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.443+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:23 15.a 15:50000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387400 con 0x558cac346800 2023-11-29T11:21:21.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.443+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 6 ==== osd_op_reply(23 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.443+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:24 15.2a 15:54000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386c00 con 0x558cacd7d800 2023-11-29T11:21:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.443+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 3 ==== osd_op_reply(24 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.443+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:25 15.1a 15:58000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387800 con 0x558cac361000 2023-11-29T11:21:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.443+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.5 v2:172.21.15.176:6824/36812 2 ==== osd_op_reply(25 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac361000 2023-11-29T11:21:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.443+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:26 15.3a 15:5c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387000 con 0x558cac360800 2023-11-29T11:21:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 3 ==== osd_op_reply(26 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:27 15.6 15:60000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346c00 con 0x558cacd7d800 2023-11-29T11:21:21.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 4 ==== osd_op_reply(27 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:28 15.26 15:64000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386c00 con 0x558cacd7d800 2023-11-29T11:21:21.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:29 15.16 15:68000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360400 con 0x558cacd7d800 2023-11-29T11:21:21.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 6 ==== osd_op_reply(29 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:30 15.36 15:6c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387800 con 0x558cac360c00 2023-11-29T11:21:21.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 3 ==== osd_op_reply(30 [pgnls-filter start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.447+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:31 15.e 15:70000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386800 con 0x558cac346800 2023-11-29T11:21:21.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.451+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 7 ==== osd_op_reply(31 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.451+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:32 15.2e 15:74000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386400 con 0x558cac361400 2023-11-29T11:21:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.451+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 4 ==== osd_op_reply(32 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.451+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:33 15.1e 15:78000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387400 con 0x558cac346800 2023-11-29T11:21:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.451+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 8 ==== osd_op_reply(33 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.451+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:34 15.3e 15:7c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386000 con 0x558cacd7d800 2023-11-29T11:21:21.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.451+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 7 ==== osd_op_reply(34 [pgnls-filter start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.451+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:35 15.1 15:80000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387c00 con 0x558cac360c00 2023-11-29T11:21:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:36 15.21 15:84000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361800 con 0x558cac361400 2023-11-29T11:21:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 5 ==== osd_op_reply(36 [pgnls-filter start_epoch 98 out=49b] v96'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:37 15.11 15:88000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387000 con 0x558cac346800 2023-11-29T11:21:21.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 9 ==== osd_op_reply(37 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:38 15.31 15:8c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cacd7d400 con 0x558cac361400 2023-11-29T11:21:21.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 6 ==== osd_op_reply(38 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:39 15.9 15:90000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386c00 con 0x558cac360c00 2023-11-29T11:21:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 98 out=49b] v96'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.455+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:40 15.29 15:94000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387800 con 0x558cacd7d800 2023-11-29T11:21:21.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.459+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 8 ==== osd_op_reply(40 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.459+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:41 15.19 15:98000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386000 con 0x558cacd7d000 2023-11-29T11:21:21.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.459+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.459+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:42 15.39 15:9c000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387c00 con 0x558cac360800 2023-11-29T11:21:21.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.459+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 4 ==== osd_op_reply(42 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.459+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:43 15.5 15:a0000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360400 con 0x558cac360c00 2023-11-29T11:21:21.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.463+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 6 ==== osd_op_reply(43 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.463+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:44 15.25 15:a4000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386c00 con 0x558cac360800 2023-11-29T11:21:21.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.463+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.463+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:45 15.15 15:a8000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346c00 con 0x558cac360800 2023-11-29T11:21:21.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.463+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 6 ==== osd_op_reply(45 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.463+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:46 15.35 15:ac000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386800 con 0x558cac360800 2023-11-29T11:21:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.463+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 7 ==== osd_op_reply(46 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.463+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:47 15.d 15:b0000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386400 con 0x558cac360800 2023-11-29T11:21:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.467+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 8 ==== osd_op_reply(47 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.467+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:48 15.2d 15:b4000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361c00 con 0x558cac346800 2023-11-29T11:21:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.467+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 10 ==== osd_op_reply(48 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.467+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:49 15.1d 15:b8000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387400 con 0x558cacd7d000 2023-11-29T11:21:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.467+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 6 ==== osd_op_reply(49 [pgnls-filter start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.467+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:50 15.3d 15:bc000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361800 con 0x558cac360000 2023-11-29T11:21:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.467+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 4 ==== osd_op_reply(50 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.467+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:51 15.3 15:c0000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387000 con 0x558cacd7d000 2023-11-29T11:21:21.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.471+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 7 ==== osd_op_reply(51 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.471+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:52 15.23 15:c4000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346400 con 0x558cacd7d800 2023-11-29T11:21:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.471+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 9 ==== osd_op_reply(52 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.471+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:53 15.13 15:c8000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387800 con 0x558cac360000 2023-11-29T11:21:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.471+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 5 ==== osd_op_reply(53 [pgnls-filter start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.471+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:54 15.33 15:cc000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386000 con 0x558cac361400 2023-11-29T11:21:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.471+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 7 ==== osd_op_reply(54 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.471+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:55 15.b 15:d0000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387c00 con 0x558cac346800 2023-11-29T11:21:21.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.475+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 11 ==== osd_op_reply(55 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.475+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:56 15.2b 15:d4000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387400 con 0x558cac346800 2023-11-29T11:21:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.475+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 12 ==== osd_op_reply(56 [pgnls-filter start_epoch 98 out=49b] v96'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.475+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:57 15.1b 15:d8000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386c00 con 0x558cac360800 2023-11-29T11:21:21.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.475+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 9 ==== osd_op_reply(57 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.475+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:58 15.3b 15:dc000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387000 con 0x558cac360c00 2023-11-29T11:21:21.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.475+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 7 ==== osd_op_reply(58 [pgnls-filter start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.475+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:59 15.7 15:e0000000::::head [pgnls-filter start_epoch 98 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386800 con 0x558cac360000 2023-11-29T11:21:21.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.479+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 6 ==== osd_op_reply(59 [pgnls-filter start_epoch 98 out=81b] v98'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.479+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:60 15.0 15:00000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac347000 con 0x558cac346800 2023-11-29T11:21:21.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.479+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 13 ==== osd_op_reply(60 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.479+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:61 15.20 15:04000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386400 con 0x558cac360000 2023-11-29T11:21:21.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.479+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 7 ==== osd_op_reply(61 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.479+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:62 15.10 15:08000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387800 con 0x558cacd7d000 2023-11-29T11:21:21.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.483+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 8 ==== osd_op_reply(62 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.483+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:63 15.30 15:0c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346c00 con 0x558cac360800 2023-11-29T11:21:21.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.483+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 10 ==== osd_op_reply(63 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.483+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:64 15.8 15:10000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360400 con 0x558cac346800 2023-11-29T11:21:21.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.483+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 14 ==== osd_op_reply(64 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.483+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:65 15.28 15:14000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac347000 con 0x558cac360800 2023-11-29T11:21:21.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.483+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 11 ==== osd_op_reply(65 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.483+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:66 15.18 15:18000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361800 con 0x558cac361400 2023-11-29T11:21:21.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.487+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 8 ==== osd_op_reply(66 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.487+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:67 15.38 15:1c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386000 con 0x558cacd7d800 2023-11-29T11:21:21.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.487+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 10 ==== osd_op_reply(67 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.487+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:68 15.4 15:20000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392000 con 0x558cac360000 2023-11-29T11:21:21.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.487+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 8 ==== osd_op_reply(68 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.487+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:69 15.24 15:24000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387c00 con 0x558cac360c00 2023-11-29T11:21:21.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.487+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.487+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:70 15.14 15:28000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392400 con 0x558cac360c00 2023-11-29T11:21:21.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.491+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 9 ==== osd_op_reply(70 [pgnls-filter start_epoch 98 out=49b] v96'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.491+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:71 15.34 15:2c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387400 con 0x558cacd7d000 2023-11-29T11:21:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.491+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 9 ==== osd_op_reply(71 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.491+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:72 15.c 15:30000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392800 con 0x558cac361000 2023-11-29T11:21:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.491+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.5 v2:172.21.15.176:6824/36812 3 ==== osd_op_reply(72 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac361000 2023-11-29T11:21:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.491+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:73 15.2c 15:34000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361c00 con 0x558cacd7d000 2023-11-29T11:21:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.491+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 10 ==== osd_op_reply(73 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.491+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:74 15.1c 15:38000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392c00 con 0x558cac360000 2023-11-29T11:21:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.495+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 9 ==== osd_op_reply(74 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.495+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:75 15.3c 15:3c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cacd7d400 con 0x558cac361400 2023-11-29T11:21:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.495+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 9 ==== osd_op_reply(75 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.495+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:76 15.2 15:40000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac393000 con 0x558cac346800 2023-11-29T11:21:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.495+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 15 ==== osd_op_reply(76 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.495+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:77 15.22 15:44000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392000 con 0x558cac346800 2023-11-29T11:21:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.495+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 16 ==== osd_op_reply(77 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.495+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:78 15.12 15:48000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac393400 con 0x558cac361400 2023-11-29T11:21:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.499+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 10 ==== osd_op_reply(78 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.499+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:79 15.32 15:4c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392400 con 0x558cac346800 2023-11-29T11:21:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.499+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 17 ==== osd_op_reply(79 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.499+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:80 15.a 15:50000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac393800 con 0x558cac346800 2023-11-29T11:21:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.499+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 18 ==== osd_op_reply(80 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.499+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:81 15.2a 15:54000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387000 con 0x558cacd7d800 2023-11-29T11:21:21.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.499+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 11 ==== osd_op_reply(81 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.499+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:82 15.1a 15:58000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac393c00 con 0x558cac361000 2023-11-29T11:21:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.503+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.5 v2:172.21.15.176:6824/36812 4 ==== osd_op_reply(82 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac361000 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.503+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:83 15.3a 15:5c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386800 con 0x558cac360800 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.503+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 12 ==== osd_op_reply(83 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.503+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:84 15.6 15:60000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392800 con 0x558cacd7d800 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.503+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 12 ==== osd_op_reply(84 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.503+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:85 15.26 15:64000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386400 con 0x558cacd7d800 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.503+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 13 ==== osd_op_reply(85 [pgnls-filter start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.503+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:86 15.16 15:68000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cacd7d400 con 0x558cacd7d800 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 14 ==== osd_op_reply(86 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:87 15.36 15:6c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387800 con 0x558cac360c00 2023-11-29T11:21:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 10 ==== osd_op_reply(87 [pgnls-filter start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:88 15.e 15:70000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac360400 con 0x558cac346800 2023-11-29T11:21:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 19 ==== osd_op_reply(88 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:89 15.2e 15:74000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387c00 con 0x558cac361400 2023-11-29T11:21:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 11 ==== osd_op_reply(89 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:90 15.1e 15:78000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac361800 con 0x558cac346800 2023-11-29T11:21:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 20 ==== osd_op_reply(90 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.507+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:91 15.3e 15:7c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac393000 con 0x558cacd7d800 2023-11-29T11:21:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.511+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 15 ==== osd_op_reply(91 [pgnls-filter start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.511+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:92 15.1 15:80000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386c00 con 0x558cac360c00 2023-11-29T11:21:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.511+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 11 ==== osd_op_reply(92 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.511+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:93 15.21 15:84000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392000 con 0x558cac361400 2023-11-29T11:21:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.511+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 12 ==== osd_op_reply(93 [pgnls-filter start_epoch 98 out=49b] v96'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.511+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:94 15.11 15:88000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386000 con 0x558cac346800 2023-11-29T11:21:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.511+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 21 ==== osd_op_reply(94 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.511+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:95 15.31 15:8c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac393400 con 0x558cac361400 2023-11-29T11:21:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.515+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 13 ==== osd_op_reply(95 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.515+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:96 15.9 15:90000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387000 con 0x558cac360c00 2023-11-29T11:21:21.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.515+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 12 ==== osd_op_reply(96 [pgnls-filter start_epoch 98 out=49b] v96'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.515+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:97 15.29 15:94000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392400 con 0x558cacd7d800 2023-11-29T11:21:21.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.515+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 16 ==== osd_op_reply(97 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.515+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:98 15.19 15:98000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346400 con 0x558cacd7d000 2023-11-29T11:21:21.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.515+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 11 ==== osd_op_reply(98 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.515+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:99 15.39 15:9c000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39c000 con 0x558cac360800 2023-11-29T11:21:21.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.519+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 13 ==== osd_op_reply(99 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.519+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:100 15.5 15:a0000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346c00 con 0x558cac360c00 2023-11-29T11:21:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.519+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 13 ==== osd_op_reply(100 [pgnls-filter start_epoch 98 out=49b] v96'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.519+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:101 15.25 15:a4000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39c400 con 0x558cac360800 2023-11-29T11:21:21.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.519+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 14 ==== osd_op_reply(101 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.519+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:102 15.15 15:a8000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac347000 con 0x558cac360800 2023-11-29T11:21:21.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.519+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 15 ==== osd_op_reply(102 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.523+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:103 15.35 15:ac000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39c800 con 0x558cac360800 2023-11-29T11:21:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.523+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 16 ==== osd_op_reply(103 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.523+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:104 15.d 15:b0000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392c00 con 0x558cac360800 2023-11-29T11:21:21.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.523+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 17 ==== osd_op_reply(104 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.523+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:105 15.2d 15:b4000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39cc00 con 0x558cac346800 2023-11-29T11:21:21.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.523+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 22 ==== osd_op_reply(105 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.523+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:106 15.1d 15:b8000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cacd7d400 con 0x558cacd7d000 2023-11-29T11:21:21.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.527+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 12 ==== osd_op_reply(106 [pgnls-filter start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.527+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:107 15.3d 15:bc000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39d000 con 0x558cac360000 2023-11-29T11:21:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.527+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 10 ==== osd_op_reply(107 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.527+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:108 15.3 15:c0000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387400 con 0x558cacd7d000 2023-11-29T11:21:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.527+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 13 ==== osd_op_reply(108 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.527+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:109 15.23 15:c4000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39d400 con 0x558cacd7d800 2023-11-29T11:21:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.527+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 17 ==== osd_op_reply(109 [pgnls-filter start_epoch 98 out=49b] v96'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.527+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:110 15.13 15:c8000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387800 con 0x558cac360000 2023-11-29T11:21:21.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.531+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 11 ==== osd_op_reply(110 [pgnls-filter start_epoch 98 out=49b] v96'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.531+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:111 15.33 15:cc000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39d800 con 0x558cac361400 2023-11-29T11:21:21.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.531+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 14 ==== osd_op_reply(111 [pgnls-filter start_epoch 98 out=49b] v96'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.531+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:112 15.b 15:d0000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386c00 con 0x558cac346800 2023-11-29T11:21:21.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.531+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 23 ==== osd_op_reply(112 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.531+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:113 15.2b 15:d4000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39dc00 con 0x558cac346800 2023-11-29T11:21:21.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.531+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.2 v2:172.21.15.81:6800/36539 24 ==== osd_op_reply(113 [pgnls-filter start_epoch 98 out=49b] v96'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac346800 2023-11-29T11:21:21.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.531+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:114 15.1b 15:d8000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387000 con 0x558cac360800 2023-11-29T11:21:21.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.535+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.7 v2:172.21.15.176:6800/36814 18 ==== osd_op_reply(114 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cac360800 2023-11-29T11:21:21.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.535+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:115 15.3b 15:dc000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39cc00 con 0x558cac360c00 2023-11-29T11:21:21.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.535+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 14 ==== osd_op_reply(115 [pgnls-filter start_epoch 98 out=49b] v96'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.535+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:116 15.7 15:e0000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386800 con 0x558cac360000 2023-11-29T11:21:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.535+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 12 ==== osd_op_reply(116 [pgnls-filter start_epoch 98 out=81b] v98'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.535+0000 7f3221710840 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-11-29T11:21:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.535+0000 7f3221710840 10 datascan.operator(): handling object 10000000001.0 2023-11-29T11:21:21.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.535+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:117 15.7 15:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac347800 con 0x558cac360000 2023-11-29T11:21:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 13 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 374+0+157 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-11-29T11:21:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2023-11-29T11:21:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2023-11-29T11:21:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:118 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac347c00 con 0x558cac360000 2023-11-29T11:21:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 14 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+59 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2023-11-29T11:21:21.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:119 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac347400 con 0x558cacd7d800 2023-11-29T11:21:21.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 18 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+520 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2023-11-29T11:21:21.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2023-11-29T11:21:21.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 20 datascan.get_frag_of: frag is * 2023-11-29T11:21:21.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:120 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387400 con 0x558cac360000 2023-11-29T11:21:21.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 15 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-11-29T11:21:21.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-11-29T11:21:21.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.539+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:121 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac387800 con 0x558cac360000 2023-11-29T11:21:21.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.543+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 16 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.543+0000 7f3221710840 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2023-11-29T11:21:21.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.543+0000 7f3221710840 20 datascan.read_dentry: file_head not found in result 2023-11-29T11:21:21.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.543+0000 7f3221710840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2023-11-29T11:21:21.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.543+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:122 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386800 con 0x558cac360000 2023-11-29T11:21:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.543+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 17 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v98'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.543+0000 7f3221710840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2023-11-29T11:21:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.543+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:123 15.27 15:e4000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39d000 con 0x558cac360c00 2023-11-29T11:21:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.547+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 15 ==== osd_op_reply(123 [pgnls-filter start_epoch 98 out=49b] v96'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.547+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:124 15.17 15:e8000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac386400 con 0x558cacd7d000 2023-11-29T11:21:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.547+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 14 ==== osd_op_reply(124 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.547+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:125 15.37 15:ec000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac39c000 con 0x558cacd7d000 2023-11-29T11:21:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.547+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.4 v2:172.21.15.176:6808/36811 15 ==== osd_op_reply(125 [pgnls-filter start_epoch 98 out=49b] v96'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cacd7d000 2023-11-29T11:21:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.547+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:126 15.f 15:f0000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346400 con 0x558cac360c00 2023-11-29T11:21:21.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.6 v2:172.21.15.176:6816/36813 16 ==== osd_op_reply(126 [pgnls-filter start_epoch 98 out=49b] v96'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360c00 2023-11-29T11:21:21.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:127 15.2f 15:f4000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac393800 con 0x558cacd7d800 2023-11-29T11:21:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f32206cd700 1 -- 172.21.15.81:0/1113633291 <== osd.0 v2:172.21.15.81:6802/36537 19 ==== osd_op_reply(127 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5200 con 0x558cacd7d800 2023-11-29T11:21:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f321aec2700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:128 15.1f 15:f8000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac346c00 con 0x558cac361400 2023-11-29T11:21:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 <== osd.3 v2:172.21.15.81:6824/36540 15 ==== osd_op_reply(128 [pgnls-filter start_epoch 98 out=49b] v96'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd5440 con 0x558cac361400 2023-11-29T11:21:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f321b6c3700 1 -- 172.21.15.81:0/1113633291 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:129 15.3f 15:fc000000::::head [pgnls-filter start_epoch 98 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x558cac392000 con 0x558cac360000 2023-11-29T11:21:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f321f6cb700 1 -- 172.21.15.81:0/1113633291 <== osd.1 v2:172.21.15.81:6803/36538 18 ==== osd_op_reply(129 [pgnls-filter start_epoch 98 out=49b] v96'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558caccd4fc0 con 0x558cac360000 2023-11-29T11:21:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x558cacd7d800 msgr2=0x558cabf9db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x558cacd7d800 0x558cabf9db80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558cac360000 msgr2=0x558cac366000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x558cac360000 0x558cac366000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x558cac346800 msgr2=0x558cabf9d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x558cac346800 0x558cabf9d600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x558cac361400 msgr2=0x558cac367080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 reap_dead start 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x558cac361400 0x558cac367080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x558cacd7d000 msgr2=0x558cabf9e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x558cacd7d000 0x558cabf9e100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x558cac361000 msgr2=0x558cac367600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x558cac361000 0x558cac367600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x558cac360c00 msgr2=0x558cac366b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x558cac360c00 0x558cac366b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x558cac360800 msgr2=0x558cac366580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x558cac360800 0x558cac366580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.551+0000 7f321fecc700 1 -- 172.21.15.81:0/1113633291 reap_dead start 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x558cac346000 msgr2=0x558cabf9f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x558cac346000 0x558cabf9f700 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x558cac25c000 tx=0x558cacd6ec60 comp rx=0 tx=0).stop 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c400 msgr2=0x558cabf9f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c400 0x558cabf9f180 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x558cac25d320 tx=0x558cac1f4d20 comp rx=0 tx=0).stop 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 shutdown_connections 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x558cac346000 0x558cabf9f700 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 --2- 172.21.15.81:0/1113633291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cacd7c400 0x558cabf9f180 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 >> 172.21.15.81:0/1113633291 conn(0x558cabefac00 msgr2=0x558cabfeb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 shutdown_connections 2023-11-29T11:21:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/1113633291 wait complete. 2023-11-29T11:21:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/3419568253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cabefb400 msgr2=0x558cabf9cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cabefb400 0x558cabf9cb00 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x558cac05cd80 tx=0x558cabfd1260 comp rx=0 tx=0).stop 2023-11-29T11:21:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/3419568253 shutdown_connections 2023-11-29T11:21:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558cabefb000 0x558cabf9d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558cabefb400 0x558cabf9cb00 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 --2- 172.21.15.81:0/3419568253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558cabefb800 0x558cabf9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/3419568253 >> 172.21.15.81:0/3419568253 conn(0x558cabefbc00 msgr2=0x558cabfeb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/3419568253 shutdown_connections 2023-11-29T11:21:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.555+0000 7f3221710840 1 -- 172.21.15.81:0/3419568253 wait complete. 2023-11-29T11:21:21.565 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.243611, result: 2023-11-29T11:21:21.565 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-11-29T11:21:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.595+0000 7f421a25e840 1 -- start start 2023-11-29T11:21:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.595+0000 7f421a25e840 1 Processor -- start 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56054829d800 0x56054833fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56054829d400 0x56054833f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56054829d000 0x56054833f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605482d2780 con 0x56054829d000 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605482d3e00 con 0x56054829d400 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605482d3680 con 0x56054829d800 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56054829d000 0x56054833f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56054829d000 0x56054833f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50550/0 (socket says 172.21.15.81:50550) 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 -- 172.21.15.81:0/1686982501 learned_addr learned my addr 172.21.15.81:0/1686982501 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f4218a1a700 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56054829d800 0x56054833fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f4218219700 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56054829d400 0x56054833f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 -- 172.21.15.81:0/1686982501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56054829d800 msgr2=0x56054833fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56054829d800 0x56054833fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 -- 172.21.15.81:0/1686982501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56054829d400 msgr2=0x56054833f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56054829d400 0x56054833f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 -- 172.21.15.81:0/1686982501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605482be9c0 con 0x56054829d000 2023-11-29T11:21:21.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421921b700 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56054829d000 0x56054833f080 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x560549076cf0 tx=0x56054909ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb6313547dc6f52 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f4216215700 1 -- 172.21.15.81:0/1686982501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5605482d1600 con 0x56054829d000 2023-11-29T11:21:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f4216215700 1 -- 172.21.15.81:0/1686982501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5605482e8d80 con 0x56054829d000 2023-11-29T11:21:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f4216215700 1 -- 172.21.15.81:0/1686982501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5605482d11e0 con 0x56054829d000 2023-11-29T11:21:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 1 -- 172.21.15.81:0/1686982501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605482bf380 con 0x56054829d000 2023-11-29T11:21:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 1 -- 172.21.15.81:0/1686982501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5605482beb60 con 0x56054829d000 2023-11-29T11:21:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 4 waiting for MDS map... 2023-11-29T11:21:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f4216215700 1 -- 172.21.15.81:0/1686982501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x5605482d8c40 con 0x56054829d000 2023-11-29T11:21:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f4216215700 1 -- 172.21.15.81:0/1686982501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 61) v1 ==== 2565+0+0 (secure 0 0 0) 0x560549090900 con 0x56054829d000 2023-11-29T11:21:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.599+0000 7f421a25e840 4 Got MDS map 61 2023-11-29T11:21:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 4 datascan.main: Using metadata pool output 2023-11-29T11:21:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 4 datascan.main: connecting to RADOS... 2023-11-29T11:21:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 1 Processor -- start 2023-11-29T11:21:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 1 -- start start 2023-11-29T11:21:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 0x56054833e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 0x560548340100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605482d3900 con 0x560548590400 2023-11-29T11:21:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548322780 con 0x560548590800 2023-11-29T11:21:21.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f421a25e840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605483223c0 con 0x560548590c00 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218219700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218219700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50554/0 (socket says 172.21.15.81:50554) 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218219700 1 -- 172.21.15.81:0/4115117071 learned_addr learned my addr 172.21.15.81:0/4115117071 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218a1a700 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 0x56054833e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218219700 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 0x560548340100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218219700 1 -- 172.21.15.81:0/4115117071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 msgr2=0x560548340100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218219700 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 0x560548340100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218219700 1 -- 172.21.15.81:0/4115117071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 msgr2=0x56054833e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.603+0000 7f4218219700 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 0x56054833e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 -- 172.21.15.81:0/4115117071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605482bf860 con 0x560548590400 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x5605485f40f0 tx=0x560549096c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3512389bad8dbc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4214211700 1 -- 172.21.15.81:0/4115117071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5605482d1600 con 0x560548590400 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4214211700 1 -- 172.21.15.81:0/4115117071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56054860a180 con 0x560548590400 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4214211700 1 -- 172.21.15.81:0/4115117071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5605482d11e0 con 0x560548590400 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- 172.21.15.81:0/4115117071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 msgr2=0x56054833eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x5605485f40f0 tx=0x560549096c60 comp rx=0 tx=0).stop 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- 172.21.15.81:0/4115117071 shutdown_connections 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 0x560548340100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 0x56054833e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 --2- 172.21.15.81:0/4115117071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- 172.21.15.81:0/4115117071 >> 172.21.15.81:0/4115117071 conn(0x56054829cc00 msgr2=0x56054838d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- 172.21.15.81:0/4115117071 shutdown_connections 2023-11-29T11:21:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- 172.21.15.81:0/4115117071 wait complete. 2023-11-29T11:21:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 Processor -- start 2023-11-29T11:21:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- start start 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 0x56054833e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 0x560548340100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548322280 con 0x560548590400 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548322140 con 0x560548590800 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f421a25e840 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5605482d3e00 con 0x560548590c00 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50562/0 (socket says 172.21.15.81:50562) 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 learned_addr learned my addr 172.21.15.81:0/506747215 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 0x56054833e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 0x560548340100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 msgr2=0x560548340100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560548590c00 0x560548340100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 msgr2=0x56054833e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 0x56054833e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605482bfa00 con 0x560548590400 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560548590800 0x56054833e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.607+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x5605485f4db0 tx=0x560549096cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f4212a0e700 1 -- 172.21.15.81:0/506747215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5605482d0dc0 con 0x560548590400 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f4212a0e700 1 -- 172.21.15.81:0/506747215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56054860a300 con 0x560548590400 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605482bfd40 con 0x560548590400 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f4212a0e700 1 -- 172.21.15.81:0/506747215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5605482d1600 con 0x560548590400 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560548618000 con 0x560548590400 2023-11-29T11:21:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f421a25e840 4 datascan.init: resolving metadata pool 14 2023-11-29T11:21:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f4212a0e700 1 -- 172.21.15.81:0/506747215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x5605482fa840 con 0x560548590400 2023-11-29T11:21:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f4212a0e700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x5605486f2000 0x5605486f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f4212a0e700 1 -- 172.21.15.81:0/506747215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x5605482d8a80 con 0x560548590400 2023-11-29T11:21:21.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f421a25e840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-29T11:21:21.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f421a25e840 4 datascan.main: resolving metadata pool 14 2023-11-29T11:21:21.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x5605486f2000 0x5605486f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x560548591000 0x560548340680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548591400 con 0x560548591000 2023-11-29T11:21:21.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.611+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x560548591000 0x560548340680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x5605486f2000 0x5605486f4000 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x5605482f3800 tx=0x56054909a120 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x560548591000 0x560548340680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 1 ==== osd_op_reply(1 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x560548591400 0x5605486f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:2 14.10 14:08000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f2400 con 0x560548591400 2023-11-29T11:21:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x560548591400 0x5605486f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x560548591400 0x5605486f4580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== osd_op_reply(2 [pgnls start_epoch 98 out=177b] v98'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x5605486f2400 0x5605486f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:3 14.8 14:10000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f2c00 con 0x5605486f2400 2023-11-29T11:21:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x5605486f2400 0x5605486f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.615+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x5605486f2400 0x5605486f4b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(3 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:4 14.18 14:18000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f2c00 con 0x560548591400 2023-11-29T11:21:21.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 2 ==== osd_op_reply(4 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x5605486f2c00 0x5605486f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:5 14.4 14:20000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f3000 con 0x5605486f2c00 2023-11-29T11:21:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x5605486f2c00 0x5605486f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x5605486f2c00 0x5605486f5080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 1 ==== osd_op_reply(5 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x5605486f3000 0x5605486f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:6 14.14 14:28000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f2800 con 0x5605486f3000 2023-11-29T11:21:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.619+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x5605486f3000 0x5605486f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x5605486f3000 0x5605486f5b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 1 ==== osd_op_reply(6 [pgnls start_epoch 98 out=149b] v97'27 uv27 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:7 14.c 14:30000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f2800 con 0x5605486f2400 2023-11-29T11:21:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 2 ==== osd_op_reply(7 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:8 14.1c 14:38000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f2800 con 0x5605486f2400 2023-11-29T11:21:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 3 ==== osd_op_reply(8 [pgnls start_epoch 98 out=73b] v97'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:9 14.2 14:40000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f2800 con 0x5605486f2c00 2023-11-29T11:21:21.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 2 ==== osd_op_reply(9 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.623+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:10 14.12 14:48000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f2800 con 0x560548591000 2023-11-29T11:21:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 2 ==== osd_op_reply(10 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605486f2800 0x5605486f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:11 14.a 14:50000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f3400 con 0x5605486f2800 2023-11-29T11:21:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605486f2800 0x5605486f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605486f2800 0x5605486f6100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(11 [pgnls start_epoch 98 out=81b] v97'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:12 14.1a 14:58000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f3400 con 0x5605486f2400 2023-11-29T11:21:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 4 ==== osd_op_reply(12 [pgnls start_epoch 98 out=49b] v97'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.627+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:13 14.6 14:60000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x5605486f3400 con 0x5605486f2400 2023-11-29T11:21:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 5 ==== osd_op_reply(13 [pgnls start_epoch 98 out=77b] v97'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f4218a1a700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x5605486f3400 0x5605486f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:14 14.16 14:68000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716000 con 0x5605486f3400 2023-11-29T11:21:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x5605486f3400 0x5605486f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f4218219700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x5605486f3400 0x5605486f6680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.3 v2:172.21.15.81:6824/36540 1 ==== osd_op_reply(14 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f3400 2023-11-29T11:21:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:15 14.e 14:70000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716000 con 0x5605486f3000 2023-11-29T11:21:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 2 ==== osd_op_reply(15 [pgnls start_epoch 98 out=73b] v97'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x560548716000 0x5605486f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:16 14.1e 14:78000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x560548716000 2023-11-29T11:21:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x560548716000 0x5605486f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.631+0000 7f421921b700 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x560548716000 0x5605486f5600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.635+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.7 v2:172.21.15.176:6800/36814 1 ==== osd_op_reply(16 [pgnls start_epoch 98 out=49b] v97'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127200 con 0x560548716000 2023-11-29T11:21:21.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.635+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:17 14.1 14:80000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f3400 2023-11-29T11:21:21.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.635+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.3 v2:172.21.15.81:6824/36540 2 ==== osd_op_reply(17 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f3400 2023-11-29T11:21:21.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.635+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:18 14.11 14:88000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f3000 2023-11-29T11:21:21.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.635+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 3 ==== osd_op_reply(18 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.635+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:19 14.9 14:90000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2800 2023-11-29T11:21:21.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.635+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 2 ==== osd_op_reply(19 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.635+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:20 14.19 14:98000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2c00 2023-11-29T11:21:21.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 3 ==== osd_op_reply(20 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:21 14.5 14:a0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2400 2023-11-29T11:21:21.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 6 ==== osd_op_reply(21 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:22 14.15 14:a8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x560548716000 2023-11-29T11:21:21.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.7 v2:172.21.15.176:6800/36814 2 ==== osd_op_reply(22 [pgnls start_epoch 98 out=97b] v97'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x560549127200 con 0x560548716000 2023-11-29T11:21:21.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:23 14.d 14:b0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2c00 2023-11-29T11:21:21.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 4 ==== osd_op_reply(23 [pgnls start_epoch 98 out=74b] v95'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:24 14.1d 14:b8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2400 2023-11-29T11:21:21.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 7 ==== osd_op_reply(24 [pgnls start_epoch 98 out=73b] v97'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.639+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:25 14.3 14:c0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2400 2023-11-29T11:21:21.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.643+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 8 ==== osd_op_reply(25 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.643+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:26 14.13 14:c8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x560548591000 2023-11-29T11:21:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.643+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 3 ==== osd_op_reply(26 [pgnls start_epoch 98 out=98b] v97'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.643+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:27 14.b 14:d0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2400 2023-11-29T11:21:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.643+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 9 ==== osd_op_reply(27 [pgnls start_epoch 98 out=76b] v97'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.643+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:28 14.1b 14:d8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x560548591400 2023-11-29T11:21:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.643+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 3 ==== osd_op_reply(28 [pgnls start_epoch 98 out=73b] v97'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.643+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:29 14.7 14:e0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2800 2023-11-29T11:21:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 3 ==== osd_op_reply(29 [pgnls start_epoch 98 out=73b] v97'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:30 14.17 14:e8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x560548591400 2023-11-29T11:21:21.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 4 ==== osd_op_reply(30 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:31 14.f 14:f0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x560548716000 2023-11-29T11:21:21.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.7 v2:172.21.15.176:6800/36814 3 ==== osd_op_reply(31 [pgnls start_epoch 98 out=73b] v95'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127200 con 0x560548716000 2023-11-29T11:21:21.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:32 14.1f 14:f8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2400 2023-11-29T11:21:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 10 ==== osd_op_reply(32 [pgnls start_epoch 98 out=101b] v97'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 601.00000000 2023-11-29T11:21:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.647+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:33 14.10 14:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548591800 con 0x560548591400 2023-11-29T11:21:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 602.00000000 2023-11-29T11:21:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:34 14.10 14:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717000 con 0x560548591400 2023-11-29T11:21:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-11-29T11:21:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:35 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717400 con 0x560548591400 2023-11-29T11:21:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 20 datascan.scan_links: injected ino detected 2023-11-29T11:21:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 600.00000000 2023-11-29T11:21:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:36 14.10 14:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717800 con 0x560548591400 2023-11-29T11:21:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 603.00000000 2023-11-29T11:21:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:37 14.10 14:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717c00 con 0x560548591400 2023-11-29T11:21:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-11-29T11:21:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-11-29T11:21:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 200.00000000 2023-11-29T11:21:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-11-29T11:21:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 200.00000001 2023-11-29T11:21:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-11-29T11:21:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 606.00000000 2023-11-29T11:21:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.651+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:38 14.14 14:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716c00 con 0x5605486f3000 2023-11-29T11:21:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 4 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 607.00000000 2023-11-29T11:21:21.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:39 14.1c 14:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716800 con 0x5605486f2400 2023-11-29T11:21:21.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 11 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2023-11-29T11:21:21.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:40 14.a 14:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717000 con 0x5605486f2800 2023-11-29T11:21:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 4 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2023-11-29T11:21:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-11-29T11:21:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 608.00000000 2023-11-29T11:21:21.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:41 14.e 14:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717400 con 0x5605486f3000 2023-11-29T11:21:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 5 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 604.00000000 2023-11-29T11:21:21.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.655+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:42 14.15 14:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548591800 con 0x560548716000 2023-11-29T11:21:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.7 v2:172.21.15.176:6800/36814 4 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548716000 2023-11-29T11:21:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 500.00000000 2023-11-29T11:21:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-11-29T11:21:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-11-29T11:21:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-11-29T11:21:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 605.00000000 2023-11-29T11:21:21.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:43 14.1d 14:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x5605486f2400 2023-11-29T11:21:21.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 12 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-11-29T11:21:21.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-11-29T11:21:21.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 100.00000000 2023-11-29T11:21:21.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:44 14.13 14:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716800 con 0x560548591000 2023-11-29T11:21:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 4 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-11-29T11:21:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-11-29T11:21:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 200.00000002 2023-11-29T11:21:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2023-11-29T11:21:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 609.00000000 2023-11-29T11:21:21.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:45 14.7 14:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717000 con 0x5605486f2800 2023-11-29T11:21:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 5 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 400.00000000 2023-11-29T11:21:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-11-29T11:21:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-11-29T11:21:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-11-29T11:21:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 10 datascan.scan_links: step 1: handling object 1.00000000 2023-11-29T11:21:21.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.659+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:46 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.663+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 13 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.663+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:47 14.0 14:00000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726400 con 0x560548591000 2023-11-29T11:21:21.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.663+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 5 ==== osd_op_reply(47 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.663+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:48 14.10 14:08000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726400 con 0x560548591400 2023-11-29T11:21:21.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.663+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 10 ==== osd_op_reply(48 [pgnls start_epoch 98 out=177b] v98'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.663+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:49 14.8 14:10000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726400 con 0x5605486f2400 2023-11-29T11:21:21.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.663+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 14 ==== osd_op_reply(49 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.663+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:50 14.18 14:18000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548591400 2023-11-29T11:21:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.667+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 11 ==== osd_op_reply(50 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.667+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:51 14.4 14:20000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2c00 2023-11-29T11:21:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.667+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 5 ==== osd_op_reply(51 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.667+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:52 14.14 14:28000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f3000 2023-11-29T11:21:21.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.667+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 6 ==== osd_op_reply(52 [pgnls start_epoch 98 out=149b] v97'27 uv27 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.667+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:53 14.c 14:30000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.667+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 15 ==== osd_op_reply(53 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.667+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:54 14.1c 14:38000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.671+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 16 ==== osd_op_reply(54 [pgnls start_epoch 98 out=73b] v97'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.671+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:55 14.2 14:40000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2c00 2023-11-29T11:21:21.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.671+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 6 ==== osd_op_reply(55 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.671+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:56 14.12 14:48000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548591000 2023-11-29T11:21:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.671+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 6 ==== osd_op_reply(56 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.671+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:57 14.a 14:50000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2800 2023-11-29T11:21:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.671+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 6 ==== osd_op_reply(57 [pgnls start_epoch 98 out=81b] v97'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.671+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:58 14.1a 14:58000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.675+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 17 ==== osd_op_reply(58 [pgnls start_epoch 98 out=49b] v97'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.675+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:59 14.6 14:60000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.675+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 18 ==== osd_op_reply(59 [pgnls start_epoch 98 out=77b] v97'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.675+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:60 14.16 14:68000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f3400 2023-11-29T11:21:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.675+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.3 v2:172.21.15.81:6824/36540 3 ==== osd_op_reply(60 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f3400 2023-11-29T11:21:21.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.675+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:61 14.e 14:70000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f3000 2023-11-29T11:21:21.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.675+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 7 ==== osd_op_reply(61 [pgnls start_epoch 98 out=73b] v97'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.675+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:62 14.1e 14:78000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548716000 2023-11-29T11:21:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.679+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.7 v2:172.21.15.176:6800/36814 5 ==== osd_op_reply(62 [pgnls start_epoch 98 out=49b] v97'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127200 con 0x560548716000 2023-11-29T11:21:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.679+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- osd_op(unknown.0.0:63 14.1 14:80000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f3400 2023-11-29T11:21:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.679+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.3 v2:172.21.15.81:6824/36540 4 ==== osd_op_reply(63 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f3400 2023-11-29T11:21:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.679+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:64 14.11 14:88000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f3000 2023-11-29T11:21:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.679+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 8 ==== osd_op_reply(64 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.679+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:65 14.9 14:90000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2800 2023-11-29T11:21:21.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.679+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 7 ==== osd_op_reply(65 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.679+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:66 14.19 14:98000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2c00 2023-11-29T11:21:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 7 ==== osd_op_reply(66 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:67 14.5 14:a0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 19 ==== osd_op_reply(67 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:68 14.15 14:a8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548716000 2023-11-29T11:21:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.7 v2:172.21.15.176:6800/36814 6 ==== osd_op_reply(68 [pgnls start_epoch 98 out=97b] v97'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x560549127200 con 0x560548716000 2023-11-29T11:21:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:69 14.d 14:b0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2c00 2023-11-29T11:21:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 8 ==== osd_op_reply(69 [pgnls start_epoch 98 out=74b] v95'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:70 14.1d 14:b8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 20 ==== osd_op_reply(70 [pgnls start_epoch 98 out=73b] v97'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:71 14.3 14:c0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 21 ==== osd_op_reply(71 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.683+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:72 14.13 14:c8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548591000 2023-11-29T11:21:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.687+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 7 ==== osd_op_reply(72 [pgnls start_epoch 98 out=98b] v97'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.687+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:73 14.b 14:d0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.687+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 22 ==== osd_op_reply(73 [pgnls start_epoch 98 out=76b] v97'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.687+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:74 14.1b 14:d8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548591400 2023-11-29T11:21:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.687+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 12 ==== osd_op_reply(74 [pgnls start_epoch 98 out=73b] v97'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.687+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:75 14.7 14:e0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2800 2023-11-29T11:21:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.687+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 8 ==== osd_op_reply(75 [pgnls start_epoch 98 out=73b] v97'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.687+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:76 14.17 14:e8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548591400 2023-11-29T11:21:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 13 ==== osd_op_reply(76 [pgnls start_epoch 98 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:77 14.f 14:f0000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548716000 2023-11-29T11:21:21.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.7 v2:172.21.15.176:6800/36814 7 ==== osd_op_reply(77 [pgnls start_epoch 98 out=73b] v95'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x560549127200 con 0x560548716000 2023-11-29T11:21:21.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:78 14.1f 14:f8000000::::head [pgnls start_epoch 98 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x5605486f2400 2023-11-29T11:21:21.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 23 ==== osd_op_reply(78 [pgnls start_epoch 98 out=101b] v97'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 601.00000000 2023-11-29T11:21:21.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:79 14.10 14:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726800 con 0x560548591400 2023-11-29T11:21:21.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 14 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 602.00000000 2023-11-29T11:21:21.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.691+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:80 14.10 14:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726c00 con 0x560548591400 2023-11-29T11:21:21.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 15 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-11-29T11:21:21.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:81 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548727000 con 0x560548591400 2023-11-29T11:21:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 16 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 20 datascan.scan_links: injected ino detected 2023-11-29T11:21:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2023-11-29T11:21:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-11-29T11:21:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 600.00000000 2023-11-29T11:21:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:82 14.10 14:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548727400 con 0x560548591400 2023-11-29T11:21:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 17 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 603.00000000 2023-11-29T11:21:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:83 14.10 14:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548727800 con 0x560548591400 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 18 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 200.00000000 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 200.00000001 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 606.00000000 2023-11-29T11:21:21.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.695+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:84 14.14 14:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548727c00 con 0x5605486f3000 2023-11-29T11:21:21.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 9 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 607.00000000 2023-11-29T11:21:21.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:85 14.1c 14:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726800 con 0x5605486f2400 2023-11-29T11:21:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 24 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2023-11-29T11:21:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:86 14.a 14:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726c00 con 0x5605486f2800 2023-11-29T11:21:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 9 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2023-11-29T11:21:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-11-29T11:21:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 608.00000000 2023-11-29T11:21:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- osd_op(unknown.0.0:87 14.e 14:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548727000 con 0x5605486f3000 2023-11-29T11:21:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.4 v2:172.21.15.176:6808/36811 10 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x5605486f3000 2023-11-29T11:21:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 604.00000000 2023-11-29T11:21:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- osd_op(unknown.0.0:88 14.15 14:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548591800 con 0x560548716000 2023-11-29T11:21:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.7 v2:172.21.15.176:6800/36814 8 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127200 con 0x560548716000 2023-11-29T11:21:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 500.00000000 2023-11-29T11:21:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-11-29T11:21:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-11-29T11:21:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-11-29T11:21:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.699+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 605.00000000 2023-11-29T11:21:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:89 14.1d 14:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717400 con 0x5605486f2400 2023-11-29T11:21:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 25 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-11-29T11:21:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-11-29T11:21:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 100.00000000 2023-11-29T11:21:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:90 14.13 14:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716c00 con 0x560548591000 2023-11-29T11:21:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 8 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-11-29T11:21:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-11-29T11:21:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 200.00000002 2023-11-29T11:21:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2023-11-29T11:21:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 609.00000000 2023-11-29T11:21:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:91 14.7 14:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717c00 con 0x5605486f2800 2023-11-29T11:21:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.5 v2:172.21.15.176:6824/36812 10 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x560549127440 con 0x5605486f2800 2023-11-29T11:21:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 400.00000000 2023-11-29T11:21:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-11-29T11:21:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-11-29T11:21:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-11-29T11:21:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: step 2: handling object 1.00000000 2023-11-29T11:21:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:92 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717800 con 0x5605486f2400 2023-11-29T11:21:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 <== osd.0 v2:172.21.15.81:6802/36537 26 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x560549127440 con 0x5605486f2400 2023-11-29T11:21:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2023-11-29T11:21:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: removing dup dentries from 0 objects 2023-11-29T11:21:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: processing 1 bad_nlink_inos 2023-11-29T11:21:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.703+0000 7f421a25e840 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2023-11-29T11:21:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.707+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:93 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726400 con 0x560548591400 2023-11-29T11:21:21.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.707+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 19 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.707+0000 7f421a25e840 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2023-11-29T11:21:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.707+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:94 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726000 con 0x560548591400 2023-11-29T11:21:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 20 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v98'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421a25e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2023-11-29T11:21:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421a25e840 10 datascan.scan_links: processing 1 injected_inos 2023-11-29T11:21:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421a25e840 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-11-29T11:21:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421a25e840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2023-11-29T11:21:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:95 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726800 con 0x560548591400 2023-11-29T11:21:21.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 21 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421a25e840 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2023-11-29T11:21:21.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421a25e840 20 datascan.scan_links: first is now 2 2023-11-29T11:21:21.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:96 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548726c00 con 0x560548591400 2023-11-29T11:21:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.711+0000 7f421921b700 1 -- 172.21.15.81:0/506747215 <== osd.1 v2:172.21.15.81:6803/36538 22 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v98'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560549127200 con 0x560548591400 2023-11-29T11:21:21.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.715+0000 7f421a25e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2023-11-29T11:21:21.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.715+0000 7f421a25e840 10 datascan.scan_links: updating inotable 2023-11-29T11:21:21.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.715+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:97 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548717000 con 0x560548591000 2023-11-29T11:21:21.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.715+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 9 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.715+0000 7f421a25e840 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2023-11-29T11:21:21.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.715+0000 7f421a25e840 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2023-11-29T11:21:21.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.715+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- osd_op(unknown.0.0:98 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548716400 con 0x560548591000 2023-11-29T11:21:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.2 v2:172.21.15.81:6800/36539 10 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v98'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x560549126fc0 con 0x560548591000 2023-11-29T11:21:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 10 datascan.scan_links: updating snaptable 2023-11-29T11:21:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- osd_op(unknown.0.0:99 14.d 14:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98) v8 -- 0x560548591800 con 0x5605486f2c00 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f4218219700 1 -- 172.21.15.81:0/506747215 <== osd.6 v2:172.21.15.176:6816/36813 9 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x560549126fc0 con 0x5605486f2c00 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x5605486f2400 msgr2=0x5605486f4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x5605486f2400 0x5605486f4b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x560548591400 msgr2=0x5605486f4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x560548591400 0x5605486f4580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x560548591000 msgr2=0x560548340680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x560548591000 0x560548340680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x5605486f3400 msgr2=0x5605486f6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x5605486f3400 0x5605486f6680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x5605486f3000 msgr2=0x5605486f5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 reap_dead start 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x5605486f3000 0x5605486f5b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605486f2800 msgr2=0x5605486f6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x5605486f2800 0x5605486f6100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x5605486f2c00 msgr2=0x5605486f5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x5605486f2c00 0x5605486f5080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x560548716000 msgr2=0x5605486f5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x560548716000 0x5605486f5600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x5605486f2000 msgr2=0x5605486f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x5605486f2000 0x5605486f4000 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x5605482f3800 tx=0x56054909a120 comp rx=0 tx=0).stop 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 msgr2=0x56054833eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/506747215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560548590400 0x56054833eb00 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x5605485f4db0 tx=0x560549096cc0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 reap_dead start 2023-11-29T11:21:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f4218a1a700 1 -- 172.21.15.81:0/506747215 reap_dead start 2023-11-29T11:21:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 shutdown_connections 2023-11-29T11:21:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 >> 172.21.15.81:0/506747215 conn(0x56054829cc00 msgr2=0x56054838d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 shutdown_connections 2023-11-29T11:21:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/506747215 wait complete. 2023-11-29T11:21:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/1686982501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56054829d000 msgr2=0x56054833f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56054829d000 0x56054833f080 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x560549076cf0 tx=0x56054909ae40 comp rx=0 tx=0).stop 2023-11-29T11:21:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/1686982501 shutdown_connections 2023-11-29T11:21:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56054829d000 0x56054833f080 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56054829d400 0x56054833f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 --2- 172.21.15.81:0/1686982501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56054829d800 0x56054833fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/1686982501 >> 172.21.15.81:0/1686982501 conn(0x56054829dc00 msgr2=0x56054838d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/1686982501 shutdown_connections 2023-11-29T11:21:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.719+0000 7f421a25e840 1 -- 172.21.15.81:0/1686982501 wait complete. 2023-11-29T11:21:21.731 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.165341, result: 2023-11-29T11:21:21.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-29T11:21:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8883fff700 1 Processor -- start 2023-11-29T11:21:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8883fff700 1 -- start start 2023-11-29T11:21:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8883fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f888406d8e0 0x7f88840d2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8883fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88840cfb60 con 0x7f888406ae70 2023-11-29T11:21:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8883fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88840cf230 con 0x7f88840b1a10 2023-11-29T11:21:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8883fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888406b440 con 0x7f888406d8e0 2023-11-29T11:21:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f88827fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f888406ae70 0x7f88840d2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43460/0 (socket says 172.21.15.81:43460) 2023-11-29T11:21:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f88827fc700 1 -- 172.21.15.81:0/3879865032 learned_addr learned my addr 172.21.15.81:0/3879865032 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f88837fe700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f888406d8e0 0x7f88840d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390947280 0 0) 0x7f88840cfb60 con 0x7f888406ae70 2023-11-29T11:21:21.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f886c0035d0 con 0x7f888406ae70 2023-11-29T11:21:21.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186817056 0 0) 0x7f886c0035d0 con 0x7f888406ae70 2023-11-29T11:21:21.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f888406d8e0 msgr2=0x7f88840d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8881ffb700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f888406d8e0 0x7f88840d2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.855+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 >> v1:172.21.15.176:6789/0 conn(0x7f88840b1a10 legacy=0x7f888406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840cf510 con 0x7f888406ae70 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f8874001670 con 0x7f888406ae70 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 >> v1:172.21.15.81:6789/0 conn(0x7f888406ae70 legacy=0x7f88840d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886c003a50 0x7f886c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f886c0043f0 0x7f886c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f888406d8e0 0x7f886c005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888406b440 con 0x7f886c003a50 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c00ba30 con 0x7f886c0043f0 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c00bbc0 con 0x7f888406d8e0 2023-11-29T11:21:21.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8882ffd700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886c003a50 0x7f886c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f88827fc700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f886c0043f0 0x7f886c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f88837fe700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f888406d8e0 0x7f886c005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8882ffd700 1 -- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f888406d8e0 msgr2=0x7f886c005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8882ffd700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f888406d8e0 0x7f886c005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8882ffd700 1 -- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f886c0043f0 msgr2=0x7f886c0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8882ffd700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f886c0043f0 0x7f886c0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8882ffd700 1 -- 172.21.15.81:0/3879865032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c0035d0 con 0x7f886c003a50 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f88827fc700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f886c0043f0 0x7f886c0048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8882ffd700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886c003a50 0x7f886c003e20 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f88780018f0 tx=0x7f886c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4e7ef5f9aa4c73 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878001390 con 0x7f886c003a50 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800c690 con 0x7f886c003a50 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8881ffb700 1 -- 172.21.15.81:0/3879865032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800ca40 con 0x7f886c003a50 2023-11-29T11:21:21.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8883fff700 1 -- 172.21.15.81:0/3879865032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886c003a50 msgr2=0x7f886c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8883fff700 1 --2- 172.21.15.81:0/3879865032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886c003a50 0x7f886c003e20 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f88780018f0 tx=0x7f886c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f88837fe700 1 -- 172.21.15.81:0/3879865032 reap_dead start 2023-11-29T11:21:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8883fff700 1 -- 172.21.15.81:0/3879865032 shutdown_connections 2023-11-29T11:21:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8883fff700 1 -- 172.21.15.81:0/3879865032 >> 172.21.15.81:0/3879865032 conn(0x7f88840b5760 msgr2=0x7f88840b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8883fff700 1 -- 172.21.15.81:0/3879865032 shutdown_connections 2023-11-29T11:21:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.859+0000 7f8883fff700 1 -- 172.21.15.81:0/3879865032 wait complete. 2023-11-29T11:21:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8883fff700 1 Processor -- start 2023-11-29T11:21:21.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8883fff700 1 -- start start 2023-11-29T11:21:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8883fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88841e2620 0x7f88840b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8883fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88840b27f0 0x7f88841ea710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8883fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88841eac50 0x7f88841e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8883fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840b6650 con 0x7f88840b27f0 2023-11-29T11:21:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8883fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840cadb0 con 0x7f88841eac50 2023-11-29T11:21:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8883fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88840c8e90 con 0x7f88841e2620 2023-11-29T11:21:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f88827fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88840b27f0 0x7f88841ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f88827fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88840b27f0 0x7f88841ea710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50586/0 (socket says 172.21.15.81:50586) 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f88827fc700 1 -- 172.21.15.81:0/1935627666 learned_addr learned my addr 172.21.15.81:0/1935627666 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f8882ffd700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88841e2620 0x7f88840b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.863+0000 7f88837fe700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88841eac50 0x7f88841e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8882ffd700 1 -- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88841eac50 msgr2=0x7f88841e7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8882ffd700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88841eac50 0x7f88841e7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8882ffd700 1 -- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88840b27f0 msgr2=0x7f88841ea710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8882ffd700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88840b27f0 0x7f88841ea710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8882ffd700 1 -- 172.21.15.81:0/1935627666 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840cfff0 con 0x7f88841e2620 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f88827fc700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88840b27f0 0x7f88841ea710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:21.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8882ffd700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88841e2620 0x7f88840b48c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8878016000 tx=0x7f8878001230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f886b7fe700 1 -- 172.21.15.81:0/1935627666 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878001330 con 0x7f88841e2620 2023-11-29T11:21:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f886b7fe700 1 -- 172.21.15.81:0/1935627666 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8878020070 con 0x7f88841e2620 2023-11-29T11:21:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f886b7fe700 1 -- 172.21.15.81:0/1935627666 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800cc50 con 0x7f88841e2620 2023-11-29T11:21:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88840cf7f0 con 0x7f88841e2620 2023-11-29T11:21:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88840b6270 con 0x7f88841e2620 2023-11-29T11:21:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.867+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8884072c20 con 0x7f88841e2620 2023-11-29T11:21:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.871+0000 7f886b7fe700 1 -- 172.21.15.81:0/1935627666 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8878010050 con 0x7f88841e2620 2023-11-29T11:21:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.871+0000 7f886b7fe700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8870064ee0 0x7f8870067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.871+0000 7f886b7fe700 1 -- 172.21.15.81:0/1935627666 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f8878022070 con 0x7f88841e2620 2023-11-29T11:21:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.871+0000 7f88827fc700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8870064ee0 0x7f8870067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.871+0000 7f88827fc700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8870064ee0 0x7f8870067390 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f88841eb350 tx=0x7f88740048b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:21.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:21.879+0000 7f886b7fe700 1 -- 172.21.15.81:0/1935627666 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8878050ed0 con 0x7f88841e2620 2023-11-29T11:21:22.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.075+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f88841eb020 con 0x7f88841e2620 2023-11-29T11:21:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.171+0000 7f886b7fe700 1 -- 172.21.15.81:0/1935627666 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v62) v1 ==== 162+0+0 (secure 0 0 0) 0x7f88780544f0 con 0x7f88841e2620 2023-11-29T11:21:22.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8870064ee0 msgr2=0x7f8870067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:22.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8870064ee0 0x7f8870067390 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f88841eb350 tx=0x7f88740048b0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88841e2620 msgr2=0x7f88840b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88841e2620 0x7f88840b48c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8878016000 tx=0x7f8878001230 comp rx=0 tx=0).stop 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 shutdown_connections 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8870064ee0 0x7f8870067390 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88841eac50 0x7f88841e7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88840b27f0 0x7f88841ea710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 --2- 172.21.15.81:0/1935627666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88841e2620 0x7f88840b48c0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8878016000 tx=0x7f8878001230 comp rx=0 tx=0).stop 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 >> 172.21.15.81:0/1935627666 conn(0x7f88840b5760 msgr2=0x7f888406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 shutdown_connections 2023-11-29T11:21:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.175+0000 7f8883fff700 1 -- 172.21.15.81:0/1935627666 wait complete. 2023-11-29T11:21:22.184 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-29T11:21:22.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:21:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.299+0000 7fbed69bc700 1 Processor -- start 2023-11-29T11:21:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.299+0000 7fbed69bc700 1 -- start start 2023-11-29T11:21:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.299+0000 7fbed69bc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbed00c6bd0 0x7fbed00cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed00cc4f0 0x7fbed00cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed00c6fa0 con 0x7fbed00cc970 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed00b2b10 con 0x7fbed00cc4f0 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed00b21b0 con 0x7fbed00c6bd0 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed51b9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed00cc4f0 0x7fbed00cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed51b9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbed00cc4f0 0x7fbed00cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50588/0 (socket says 172.21.15.81:50588) 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed51b9700 1 -- 172.21.15.81:0/529778907 learned_addr learned my addr 172.21.15.81:0/529778907 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed59ba700 1 --2- 172.21.15.81:0/529778907 >> v2:172.21.15.176:3300/0 conn(0x7fbed00c6bd0 0x7fbed00cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed51b9700 1 -- 172.21.15.81:0/529778907 >> v2:172.21.15.176:3300/0 conn(0x7fbed00c6bd0 msgr2=0x7fbed00cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed51b9700 1 --2- 172.21.15.81:0/529778907 >> v2:172.21.15.176:3300/0 conn(0x7fbed00c6bd0 0x7fbed00cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed51b9700 1 -- 172.21.15.81:0/529778907 >> v1:172.21.15.176:6789/0 conn(0x7fbed00cc970 legacy=0x7fbed00ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed51b9700 1 -- 172.21.15.81:0/529778907 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00b2f30 con 0x7fbed00cc4f0 2023-11-29T11:21:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed51b9700 1 --2- 172.21.15.81:0/529778907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc4f0 0x7fbed00cd420 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fbed00d1690 tx=0x7fbec0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2e4558bcdd06b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed49b8700 1 -- 172.21.15.81:0/529778907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000b8a0 con 0x7fbed00cc4f0 2023-11-29T11:21:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed49b8700 1 -- 172.21.15.81:0/529778907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec000ba00 con 0x7fbed00cc4f0 2023-11-29T11:21:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed49b8700 1 -- 172.21.15.81:0/529778907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000bd90 con 0x7fbed00cc4f0 2023-11-29T11:21:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 -- 172.21.15.81:0/529778907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc4f0 msgr2=0x7fbed00cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 --2- 172.21.15.81:0/529778907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc4f0 0x7fbed00cd420 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fbed00d1690 tx=0x7fbec0009bf0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 -- 172.21.15.81:0/529778907 shutdown_connections 2023-11-29T11:21:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 --2- 172.21.15.81:0/529778907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc4f0 0x7fbed00cd420 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 --2- 172.21.15.81:0/529778907 >> v2:172.21.15.176:3300/0 conn(0x7fbed00c6bd0 0x7fbed00cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 -- 172.21.15.81:0/529778907 >> 172.21.15.81:0/529778907 conn(0x7fbed0069c40 msgr2=0x7fbed006a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 -- 172.21.15.81:0/529778907 shutdown_connections 2023-11-29T11:21:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.303+0000 7fbed69bc700 1 -- 172.21.15.81:0/529778907 wait complete. 2023-11-29T11:21:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed69bc700 1 Processor -- start 2023-11-29T11:21:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed69bc700 1 -- start start 2023-11-29T11:21:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed69bc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed00c6bd0 0x7fbed01e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed69bc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed00cc4f0 0x7fbed01e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed69bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc970 0x7fbed01e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed69bc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed01e2460 con 0x7fbed00cc970 2023-11-29T11:21:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed69bc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed01e2740 con 0x7fbed00cc4f0 2023-11-29T11:21:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed69bc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed01e2a20 con 0x7fbed00c6bd0 2023-11-29T11:21:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc970 0x7fbed01e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc970 0x7fbed01e46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50600/0 (socket says 172.21.15.81:50600) 2023-11-29T11:21:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed59ba700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed00c6bd0 0x7fbed01e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 -- 172.21.15.81:0/846014388 learned_addr learned my addr 172.21.15.81:0/846014388 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed51b9700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed00cc4f0 0x7fbed01e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 -- 172.21.15.81:0/846014388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed00c6bd0 msgr2=0x7fbed01e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed00c6bd0 0x7fbed01e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 -- 172.21.15.81:0/846014388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed00cc4f0 msgr2=0x7fbed01e1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed00cc4f0 0x7fbed01e1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 -- 172.21.15.81:0/846014388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0009570 con 0x7fbed00cc970 2023-11-29T11:21:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbed61bb700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc970 0x7fbed01e46c0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fbec800cb50 tx=0x7fbec800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbec67fc700 1 -- 172.21.15.81:0/846014388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8003c20 con 0x7fbed00cc970 2023-11-29T11:21:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.307+0000 7fbec67fc700 1 -- 172.21.15.81:0/846014388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8003d80 con 0x7fbed00cc970 2023-11-29T11:21:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.311+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed00b2730 con 0x7fbed00cc970 2023-11-29T11:21:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.311+0000 7fbec67fc700 1 -- 172.21.15.81:0/846014388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800aa20 con 0x7fbed00cc970 2023-11-29T11:21:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.311+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00b2450 con 0x7fbed00cc970 2023-11-29T11:21:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.311+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed00cce20 con 0x7fbed00cc970 2023-11-29T11:21:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.311+0000 7fbec67fc700 1 -- 172.21.15.81:0/846014388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbec8010050 con 0x7fbed00cc970 2023-11-29T11:21:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.311+0000 7fbec67fc700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbeb4064ee0 0x7fbeb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.311+0000 7fbec67fc700 1 -- 172.21.15.81:0/846014388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fbec8081fb0 con 0x7fbed00cc970 2023-11-29T11:21:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.311+0000 7fbed59ba700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbeb4064ee0 0x7fbeb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.315+0000 7fbed59ba700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbeb4064ee0 0x7fbeb4067390 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009a00 tx=0x7fbecc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.319+0000 7fbec67fc700 1 -- 172.21.15.81:0/846014388 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbec804fee0 con 0x7fbed00cc970 2023-11-29T11:21:22.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.519+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbed0072c20 con 0x7fbed00cc970 2023-11-29T11:21:22.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.519+0000 7fbec67fc700 1 -- 172.21.15.81:0/846014388 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4657 (secure 0 0 0) 0x7fbec8053500 con 0x7fbed00cc970 2023-11-29T11:21:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:22.526 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:21:22.168874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8610":{"gid":8610,"name":"a","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6837/2322035611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2322035611},{"type":"v1","addr":"172.21.15.81:6837","nonce":2322035611}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:21:22.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbeb4064ee0 msgr2=0x7fbeb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:22.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbeb4064ee0 0x7fbeb4067390 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009a00 tx=0x7fbecc008040 comp rx=0 tx=0).stop 2023-11-29T11:21:22.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc970 msgr2=0x7fbed01e46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc970 0x7fbed01e46c0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fbec800cb50 tx=0x7fbec800ce60 comp rx=0 tx=0).stop 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 shutdown_connections 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbeb4064ee0 0x7fbeb4067390 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbed00cc970 0x7fbed01e46c0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed00cc4f0 0x7fbed01e1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 --2- 172.21.15.81:0/846014388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed00c6bd0 0x7fbed01e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 >> 172.21.15.81:0/846014388 conn(0x7fbed0069c40 msgr2=0x7fbed00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 shutdown_connections 2023-11-29T11:21:22.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:22.523+0000 7fbed69bc700 1 -- 172.21.15.81:0/846014388 wait complete. 2023-11-29T11:21:22.530 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 63 2023-11-29T11:21:22.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:19:39.666846+0000', 'modified': '2023-11-29T11:21:22.168874+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8610': {'gid': 8610, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.81:6837/2322035611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2322035611}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2322035611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:21:22.942 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8610:up:replay 2023-11-29T11:21:23.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:21:24.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.051+0000 7f904b59e700 1 Processor -- start 2023-11-29T11:21:24.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.051+0000 7f904b59e700 1 -- start start 2023-11-29T11:21:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c1607b0 0x7f904c0cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0cc730 con 0x7f904c0cc360 2023-11-29T11:21:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0b1f30 con 0x7f904c0cd000 2023-11-29T11:21:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0d04c0 con 0x7f904c1607b0 2023-11-29T11:21:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904a59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f904c0cc360 0x7f904c0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43470/0 (socket says 172.21.15.81:43470) 2023-11-29T11:21:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904a59c700 1 -- 172.21.15.81:0/546269376 learned_addr learned my addr 172.21.15.81:0/546269376 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f9049d9b700 1 --2- 172.21.15.81:0/546269376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c1607b0 0x7f904c0cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:24.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904959a700 1 -- 172.21.15.81:0/546269376 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558252303 0 0) 0x7f904c0cc730 con 0x7f904c0cc360 2023-11-29T11:21:24.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904959a700 1 -- 172.21.15.81:0/546269376 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90340035d0 con 0x7f904c0cc360 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904959a700 1 -- 172.21.15.81:0/546269376 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309588488 0 0) 0x7f904c0b1f30 con 0x7f904c0cd000 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904959a700 1 -- 172.21.15.81:0/546269376 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f904c0cc730 con 0x7f904c0cd000 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f9049d9b700 1 -- 172.21.15.81:0/546269376 >> v1:172.21.15.176:6789/0 conn(0x7f904c0cd000 legacy=0x7f904c0afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f9049d9b700 1 -- 172.21.15.81:0/546269376 >> v1:172.21.15.81:6789/0 conn(0x7f904c0cc360 legacy=0x7f904c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f9049d9b700 1 -- 172.21.15.81:0/546269376 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0d01e0 con 0x7f904c1607b0 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f9049d9b700 1 --2- 172.21.15.81:0/546269376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c1607b0 0x7f904c0cfbd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f903c009870 tx=0x7f903c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df14505b61018243 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904959a700 1 -- 172.21.15.81:0/546269376 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c005e50 con 0x7f904c1607b0 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904959a700 1 -- 172.21.15.81:0/546269376 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c006030 con 0x7f904c1607b0 2023-11-29T11:21:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904959a700 1 -- 172.21.15.81:0/546269376 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0063c0 con 0x7f904c1607b0 2023-11-29T11:21:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904b59e700 1 -- 172.21.15.81:0/546269376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c1607b0 msgr2=0x7f904c0cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904b59e700 1 --2- 172.21.15.81:0/546269376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c1607b0 0x7f904c0cfbd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f903c009870 tx=0x7f903c009b80 comp rx=0 tx=0).stop 2023-11-29T11:21:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904b59e700 1 -- 172.21.15.81:0/546269376 shutdown_connections 2023-11-29T11:21:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.055+0000 7f904b59e700 1 --2- 172.21.15.81:0/546269376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c1607b0 0x7f904c0cfbd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.059+0000 7f904b59e700 1 -- 172.21.15.81:0/546269376 >> 172.21.15.81:0/546269376 conn(0x7f904c0b2140 msgr2=0x7f904c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:24.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.059+0000 7f904b59e700 1 -- 172.21.15.81:0/546269376 shutdown_connections 2023-11-29T11:21:24.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.059+0000 7f904b59e700 1 -- 172.21.15.81:0/546269376 wait complete. 2023-11-29T11:21:24.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.059+0000 7f904b59e700 1 Processor -- start 2023-11-29T11:21:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.059+0000 7f904b59e700 1 -- start start 2023-11-29T11:21:24.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c0cc360 0x7f904c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:24.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c0cd000 0x7f904c0c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:24.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f904c1607b0 0x7f904c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:24.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c15f1f0 con 0x7f904c0cc360 2023-11-29T11:21:24.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c15f4d0 con 0x7f904c1607b0 2023-11-29T11:21:24.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c15f7b0 con 0x7f904c0cd000 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c0cc360 0x7f904c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c0cc360 0x7f904c0c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50602/0 (socket says 172.21.15.81:50602) 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 -- 172.21.15.81:0/3416525773 learned_addr learned my addr 172.21.15.81:0/3416525773 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f9049d9b700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c0cd000 0x7f904c0c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904ad9d700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f904c1607b0 0x7f904c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 -- 172.21.15.81:0/3416525773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c0cd000 msgr2=0x7f904c0c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c0cd000 0x7f904c0c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 -- 172.21.15.81:0/3416525773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f904c1607b0 msgr2=0x7f904c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f904c1607b0 0x7f904c0c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 -- 172.21.15.81:0/3416525773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c009450 con 0x7f904c0cc360 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904a59c700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c0cc360 0x7f904c0c7700 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f904000c560 tx=0x7f904000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f903affd700 1 -- 172.21.15.81:0/3416525773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040005d90 con 0x7f904c0cc360 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f903affd700 1 -- 172.21.15.81:0/3416525773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90400070d0 con 0x7f904c0cc360 2023-11-29T11:21:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c15ffb0 con 0x7f904c0cc360 2023-11-29T11:21:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f903affd700 1 -- 172.21.15.81:0/3416525773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040007440 con 0x7f904c0cc360 2023-11-29T11:21:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c15fcd0 con 0x7f904c0cc360 2023-11-29T11:21:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.063+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c160290 con 0x7f904c0cc360 2023-11-29T11:21:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.067+0000 7f903affd700 1 -- 172.21.15.81:0/3416525773 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9040019030 con 0x7f904c0cc360 2023-11-29T11:21:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.067+0000 7f903affd700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f902c064f10 0x7f902c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.067+0000 7f903affd700 1 -- 172.21.15.81:0/3416525773 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f9040081830 con 0x7f904c0cc360 2023-11-29T11:21:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.067+0000 7f9049d9b700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f902c064f10 0x7f902c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.067+0000 7f9049d9b700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f902c064f10 0x7f902c0673c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f903c009870 tx=0x7f903c008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.075+0000 7f903affd700 1 -- 172.21.15.81:0/3416525773 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f904004f890 con 0x7f904c0cc360 2023-11-29T11:21:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.275+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f904c072500 con 0x7f904c0cc360 2023-11-29T11:21:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.275+0000 7f903affd700 1 -- 172.21.15.81:0/3416525773 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f9040052eb0 con 0x7f904c0cc360 2023-11-29T11:21:24.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:24.281 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:21:24.184581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8610":{"gid":8610,"name":"a","rank":0,"incarnation":63,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.81:6837/2322035611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2322035611},{"type":"v1","addr":"172.21.15.81:6837","nonce":2322035611}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.275+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f902c064f10 msgr2=0x7f902c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.275+0000 7f904b59e700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f902c064f10 0x7f902c0673c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f903c009870 tx=0x7f903c008070 comp rx=0 tx=0).stop 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.275+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c0cc360 msgr2=0x7f904c0c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.275+0000 7f904b59e700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c0cc360 0x7f904c0c7700 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f904000c560 tx=0x7f904000c920 comp rx=0 tx=0).stop 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.279+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 shutdown_connections 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.279+0000 7f904b59e700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f902c064f10 0x7f902c0673c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.279+0000 7f904b59e700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f904c1607b0 0x7f904c0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.279+0000 7f904b59e700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f904c0cd000 0x7f904c0c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.279+0000 7f904b59e700 1 --2- 172.21.15.81:0/3416525773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c0cc360 0x7f904c0c7700 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.279+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 >> 172.21.15.81:0/3416525773 conn(0x7f904c0b2140 msgr2=0x7f904c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.279+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 shutdown_connections 2023-11-29T11:21:24.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:24.279+0000 7f904b59e700 1 -- 172.21.15.81:0/3416525773 wait complete. 2023-11-29T11:21:24.284 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 65 2023-11-29T11:21:24.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:19:39.666846+0000', 'modified': '2023-11-29T11:21:24.184581+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8610': {'gid': 8610, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.81:6837/2322035611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2322035611}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2322035611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:21:24.697 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8610:up:rejoin 2023-11-29T11:21:25.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:21:25.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.811+0000 7ff70d78d700 1 Processor -- start 2023-11-29T11:21:25.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff70d78d700 1 -- start start 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff70d78d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff70815c150 0x7ff7081607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff70d78d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff7080c9e70 0x7ff7080cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff70d78d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70815c520 con 0x7ff7080cc430 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff70d78d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7080ca680 con 0x7ff70815c150 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff70d78d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7080ca960 con 0x7ff7080c9e70 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff707fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff70815c150 0x7ff7081607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff707fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff70815c150 0x7ff7081607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50604/0 (socket says 172.21.15.81:50604) 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff707fff700 1 -- 172.21.15.81:0/1853337116 learned_addr learned my addr 172.21.15.81:0/1853337116 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/1853337116 >> v2:172.21.15.176:3300/0 conn(0x7ff7080c9e70 0x7ff7080cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff707fff700 1 -- 172.21.15.81:0/1853337116 >> v2:172.21.15.176:3300/0 conn(0x7ff7080c9e70 msgr2=0x7ff7080cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff707fff700 1 --2- 172.21.15.81:0/1853337116 >> v2:172.21.15.176:3300/0 conn(0x7ff7080c9e70 0x7ff7080cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff707fff700 1 -- 172.21.15.81:0/1853337116 >> v1:172.21.15.176:6789/0 conn(0x7ff7080cc430 legacy=0x7ff708070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff707fff700 1 -- 172.21.15.81:0/1853337116 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7080cf330 con 0x7ff70815c150 2023-11-29T11:21:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff707fff700 1 --2- 172.21.15.81:0/1853337116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff70815c150 0x7ff7081607b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7ff7080af140 tx=0x7ff6f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b4a72823c21f6d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff7077fe700 1 -- 172.21.15.81:0/1853337116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8011830 con 0x7ff70815c150 2023-11-29T11:21:25.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff7077fe700 1 -- 172.21.15.81:0/1853337116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8011990 con 0x7ff70815c150 2023-11-29T11:21:25.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.815+0000 7ff7077fe700 1 -- 172.21.15.81:0/1853337116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8011d20 con 0x7ff70815c150 2023-11-29T11:21:25.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 -- 172.21.15.81:0/1853337116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff70815c150 msgr2=0x7ff7081607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:25.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 --2- 172.21.15.81:0/1853337116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff70815c150 0x7ff7081607b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7ff7080af140 tx=0x7ff6f8009bf0 comp rx=0 tx=0).stop 2023-11-29T11:21:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 -- 172.21.15.81:0/1853337116 shutdown_connections 2023-11-29T11:21:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 --2- 172.21.15.81:0/1853337116 >> v2:172.21.15.176:3300/0 conn(0x7ff7080c9e70 0x7ff7080cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 --2- 172.21.15.81:0/1853337116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff70815c150 0x7ff7081607b0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 -- 172.21.15.81:0/1853337116 >> 172.21.15.81:0/1853337116 conn(0x7ff70806ec40 msgr2=0x7ff7080b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 -- 172.21.15.81:0/1853337116 shutdown_connections 2023-11-29T11:21:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 -- 172.21.15.81:0/1853337116 wait complete. 2023-11-29T11:21:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 Processor -- start 2023-11-29T11:21:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.819+0000 7ff70d78d700 1 -- start start 2023-11-29T11:21:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7080c9e70 0x7ff7080c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7080cc430 0x7ff708155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff70815c150 0x7ff708156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080c7600 con 0x7ff7080cc430 2023-11-29T11:21:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080b49b0 con 0x7ff7080c9e70 2023-11-29T11:21:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080c7e70 con 0x7ff70815c150 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7080cc430 0x7ff708155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7080cc430 0x7ff708155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50608/0 (socket says 172.21.15.81:50608) 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/2394745881 learned_addr learned my addr 172.21.15.81:0/2394745881 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff707fff700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7080c9e70 0x7ff7080c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70cf8c700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff70815c150 0x7ff708156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/2394745881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff70815c150 msgr2=0x7ff708156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff70815c150 0x7ff708156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/2394745881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7080c9e70 msgr2=0x7ff7080c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7080c9e70 0x7ff7080c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/2394745881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8009570 con 0x7ff7080cc430 2023-11-29T11:21:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7080cc430 0x7ff708155aa0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000e9d0 tx=0x7ff6f000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:25.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff7057fa700 1 -- 172.21.15.81:0/2394745881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0009720 con 0x7ff7080cc430 2023-11-29T11:21:25.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff7057fa700 1 -- 172.21.15.81:0/2394745881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000ee70 con 0x7ff7080cc430 2023-11-29T11:21:25.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7080cdb20 con 0x7ff7080cc430 2023-11-29T11:21:25.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff7057fa700 1 -- 172.21.15.81:0/2394745881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000ca50 con 0x7ff7080cc430 2023-11-29T11:21:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7080cd840 con 0x7ff7080cc430 2023-11-29T11:21:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.823+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7080cde00 con 0x7ff7080cc430 2023-11-29T11:21:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.827+0000 7ff7057fa700 1 -- 172.21.15.81:0/2394745881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff6f0019030 con 0x7ff7080cc430 2023-11-29T11:21:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.827+0000 7ff7057fa700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6e8064ee0 0x7ff6e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.827+0000 7ff7057fa700 1 -- 172.21.15.81:0/2394745881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7ff6f0081f50 con 0x7ff7080cc430 2023-11-29T11:21:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.827+0000 7ff707fff700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6e8064ee0 0x7ff6e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.827+0000 7ff707fff700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6e8064ee0 0x7ff6e8067390 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8000c00 tx=0x7ff6f8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:25.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:25.831+0000 7ff7057fa700 1 -- 172.21.15.81:0/2394745881 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff6f004ff00 con 0x7ff7080cc430 2023-11-29T11:21:26.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.031+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff708072c20 con 0x7ff7080cc430 2023-11-29T11:21:26.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.031+0000 7ff7057fa700 1 -- 172.21.15.81:0/2394745881 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4657 (secure 0 0 0) 0x7ff6f0053520 con 0x7ff7080cc430 2023-11-29T11:21:26.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:26.037 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:21:25.188265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8610":{"gid":8610,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/2322035611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2322035611},{"type":"v1","addr":"172.21.15.81:6837","nonce":2322035611}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:21:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6e8064ee0 msgr2=0x7ff6e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6e8064ee0 0x7ff6e8067390 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8000c00 tx=0x7ff6f8008030 comp rx=0 tx=0).stop 2023-11-29T11:21:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7080cc430 msgr2=0x7ff708155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7080cc430 0x7ff708155aa0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000e9d0 tx=0x7ff6f000ece0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 shutdown_connections 2023-11-29T11:21:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff6e8064ee0 0x7ff6e8067390 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff70815c150 0x7ff708156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7080cc430 0x7ff708155aa0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 --2- 172.21.15.81:0/2394745881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7080c9e70 0x7ff7080c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 >> 172.21.15.81:0/2394745881 conn(0x7ff70806ec40 msgr2=0x7ff708157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 shutdown_connections 2023-11-29T11:21:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.035+0000 7ff70d78d700 1 -- 172.21.15.81:0/2394745881 wait complete. 2023-11-29T11:21:26.044 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-11-29T11:21:26.460 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:19:39.666846+0000', 'modified': '2023-11-29T11:21:25.188265+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8610': {'gid': 8610, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6837/2322035611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2322035611}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2322035611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:21:26.461 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:21:26.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-29T11:21:26.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.579+0000 7fbfd12ba700 1 Processor -- start 2023-11-29T11:21:26.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.579+0000 7fbfd12ba700 1 -- start start 2023-11-29T11:21:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbfcc0707d0 0x7fbfcc0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc070c20 0x7fbfcc0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfcc069fb0 con 0x7fbfcc15bed0 2023-11-29T11:21:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc06a290 con 0x7fbfcc0707d0 2023-11-29T11:21:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc06a570 con 0x7fbfcc070c20 2023-11-29T11:21:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfca7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbfcc0707d0 0x7fbfcc0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfcaffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbfcc15bed0 0x7fbfcc06b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43484/0 (socket says 172.21.15.81:43484) 2023-11-29T11:21:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfcaffd700 1 -- 172.21.15.81:0/177508633 learned_addr learned my addr 172.21.15.81:0/177508633 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/177508633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc070c20 0x7fbfcc0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfca7fc700 1 -- 172.21.15.81:0/177508633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc070c20 msgr2=0x7fbfcc0cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/177508633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc070c20 0x7fbfcc0cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfca7fc700 1 -- 172.21.15.81:0/177508633 >> v1:172.21.15.81:6789/0 conn(0x7fbfcc15bed0 legacy=0x7fbfcc06b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfca7fc700 1 -- 172.21.15.81:0/177508633 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc06a850 con 0x7fbfcc0707d0 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/177508633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc070c20 0x7fbfcc0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/177508633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc0707d0 0x7fbfcc0cc380 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009850 tx=0x7fbfbc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d33dea73c2a11d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfc9ffb700 1 -- 172.21.15.81:0/177508633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc011830 con 0x7fbfcc0707d0 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfc9ffb700 1 -- 172.21.15.81:0/177508633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc011990 con 0x7fbfcc0707d0 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfc9ffb700 1 -- 172.21.15.81:0/177508633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc011d20 con 0x7fbfcc0707d0 2023-11-29T11:21:26.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 -- 172.21.15.81:0/177508633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc0707d0 msgr2=0x7fbfcc0cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/177508633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc0707d0 0x7fbfcc0cc380 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009850 tx=0x7fbfbc009b60 comp rx=0 tx=0).stop 2023-11-29T11:21:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 -- 172.21.15.81:0/177508633 shutdown_connections 2023-11-29T11:21:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/177508633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc070c20 0x7fbfcc0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/177508633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc0707d0 0x7fbfcc0cc380 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 -- 172.21.15.81:0/177508633 >> 172.21.15.81:0/177508633 conn(0x7fbfcc06caf0 msgr2=0x7fbfcc0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 -- 172.21.15.81:0/177508633 shutdown_connections 2023-11-29T11:21:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.583+0000 7fbfd12ba700 1 -- 172.21.15.81:0/177508633 wait complete. 2023-11-29T11:21:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 Processor -- start 2023-11-29T11:21:26.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 -- start start 2023-11-29T11:21:26.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc0707d0 0x7fbfcc157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc070c20 0x7fbfcc0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc15bed0 0x7fbfcc1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0b29d0 con 0x7fbfcc070c20 2023-11-29T11:21:26.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0b1dc0 con 0x7fbfcc15bed0 2023-11-29T11:21:26.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0b20a0 con 0x7fbfcc0707d0 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc070c20 0x7fbfcc0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc070c20 0x7fbfcc0b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50630/0 (socket says 172.21.15.81:50630) 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 -- 172.21.15.81:0/540930514 learned_addr learned my addr 172.21.15.81:0/540930514 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc0707d0 0x7fbfcc157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc15bed0 0x7fbfcc1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 -- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc0707d0 msgr2=0x7fbfcc157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc0707d0 0x7fbfcc157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 -- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc15bed0 msgr2=0x7fbfcc1566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc15bed0 0x7fbfcc1566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 -- 172.21.15.81:0/540930514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0094b0 con 0x7fbfcc070c20 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc15bed0 0x7fbfcc1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:26.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc070c20 0x7fbfcc0b16e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc000c00 tx=0x7fbfbc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfc37fe700 1 -- 172.21.15.81:0/540930514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc004480 con 0x7fbfcc070c20 2023-11-29T11:21:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfc37fe700 1 -- 172.21.15.81:0/540930514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc01f070 con 0x7fbfcc070c20 2023-11-29T11:21:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 -- 172.21.15.81:0/540930514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfcc069c40 con 0x7fbfcc070c20 2023-11-29T11:21:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfc37fe700 1 -- 172.21.15.81:0/540930514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc003900 con 0x7fbfcc070c20 2023-11-29T11:21:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.587+0000 7fbfd12ba700 1 -- 172.21.15.81:0/540930514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc06ab30 con 0x7fbfcc070c20 2023-11-29T11:21:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.591+0000 7fbfc37fe700 1 -- 172.21.15.81:0/540930514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbfbc02a020 con 0x7fbfcc070c20 2023-11-29T11:21:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.591+0000 7fbfc37fe700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfac064ee0 0x7fbfac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.591+0000 7fbfc37fe700 1 -- 172.21.15.81:0/540930514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fbfbc0837d0 con 0x7fbfcc070c20 2023-11-29T11:21:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.591+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfac064ee0 0x7fbfac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.591+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfac064ee0 0x7fbfac067390 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005930 tx=0x7fbfb4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfd453a740 1 Processor -- start 2023-11-29T11:21:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfd453a740 1 -- start start 2023-11-29T11:21:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29ae0 0x10d83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe29710 0x10e8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe74790 0x10ea670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfd453a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf98ae0 con 0xe29ae0 2023-11-29T11:21:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfd453a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1008bd0 con 0xe74790 2023-11-29T11:21:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfd453a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1001ed0 con 0xe29710 2023-11-29T11:21:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29ae0 0x10d83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfca7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe29710 0x10e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29ae0 0x10d83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50644/0 (socket says 172.21.15.81:50644) 2023-11-29T11:21:26.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 -- 172.21.15.81:0/4239161427 learned_addr learned my addr 172.21.15.81:0/4239161427 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:26.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/4239161427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe74790 0x10ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 -- 172.21.15.81:0/4239161427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe29710 msgr2=0x10e8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/4239161427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe29710 0x10e8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 -- 172.21.15.81:0/4239161427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe74790 msgr2=0x10ea670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/4239161427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe74790 0x10ea670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 -- 172.21.15.81:0/4239161427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1027cc0 con 0xe29ae0 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/4239161427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29ae0 0x10d83b0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400f740 tx=0x7fbfb4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822767e54990883e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfc0ff9700 1 -- 172.21.15.81:0/4239161427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400fe10 con 0xe29ae0 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfc0ff9700 1 -- 172.21.15.81:0/4239161427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4014450 con 0xe29ae0 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.595+0000 7fbfc0ff9700 1 -- 172.21.15.81:0/4239161427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40147c0 con 0xe29ae0 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- 172.21.15.81:0/4239161427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29ae0 msgr2=0x10d83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 --2- 172.21.15.81:0/4239161427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29ae0 0x10d83b0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400f740 tx=0x7fbfb4012000 comp rx=0 tx=0).stop 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- 172.21.15.81:0/4239161427 shutdown_connections 2023-11-29T11:21:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 --2- 172.21.15.81:0/4239161427 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe74790 0x10ea670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 --2- 172.21.15.81:0/4239161427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe29710 0x10e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 --2- 172.21.15.81:0/4239161427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29ae0 0x10d83b0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- 172.21.15.81:0/4239161427 >> 172.21.15.81:0/4239161427 conn(0xe29eb0 msgr2=0x10c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- 172.21.15.81:0/4239161427 shutdown_connections 2023-11-29T11:21:26.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- 172.21.15.81:0/4239161427 wait complete. 2023-11-29T11:21:26.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- start start 2023-11-29T11:21:26.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 Processor -- start 2023-11-29T11:21:26.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe29710 0x10d9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10dda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10dc280 0x10ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xeaeb20 con 0x10dc280 2023-11-29T11:21:26.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e4f10 con 0xe29710 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x10d8f40 con 0xe74790 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfd453a740 10 client.0 _ll_register_callbacks cb 0x105e0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10dc280 0x10ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10dc280 0x10ddfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50654/0 (socket says 172.21.15.81:50654) 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcb7fe700 1 -- 172.21.15.81:0/3855606473 learned_addr learned my addr 172.21.15.81:0/3855606473 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe29710 0x10d9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcb7fe700 1 -- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 msgr2=0x10dda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10dda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcb7fe700 1 -- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe29710 msgr2=0x10d9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe29710 0x10d9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcb7fe700 1 -- 172.21.15.81:0/3855606473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc069fb0 con 0x10dc280 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.599+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe29710 0x10d9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10dc280 0x10ddfd0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4008a20 tx=0x7fbfc4008de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3249346dffb542 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/3855606473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400f050 con 0x10dc280 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 -- 172.21.15.81:0/3855606473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xffaf50 con 0x10dc280 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/3855606473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fbfc4012b30 con 0x10dc280 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/3855606473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfc4012cf0 con 0x10dc280 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 10 client.8688 fetch_fsmap learned FSMap version 66 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 -- 172.21.15.81:0/3855606473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0xe759e0 con 0x10dc280 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/3855606473 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xffaf50 con 0x10dc280 2023-11-29T11:21:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/3855606473 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fbfc401f430 con 0x10dc280 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 10 client.8688 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 10 client.8688 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 20 client.8688 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x10daed0 0x10e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 4 client.8688 mds_command: new command op to 8610 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 -- 172.21.15.81:0/3855606473 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xffac70 con 0x10daed0 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x10daed0 0x10e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x10daed0 0x10e41e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6c31c148bc85a44 server_cookie=dc2c36f144e8e8a4 in_seq=0 out_seq=0 2023-11-29T11:21:26.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 10 client.8688 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:26.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/3855606473 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xffac70 con 0x10daed0 2023-11-29T11:21:26.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 10 client.8688 handle_command_reply: tid=0 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 client.8688 shutdown 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 -- 172.21.15.81:0/3855606473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10dc280 msgr2=0x10ddfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10dc280 0x10ddfd0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4008a20 tx=0x7fbfc4008de0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 -- 172.21.15.81:0/3855606473 shutdown_connections 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x10daed0 0x10e41e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10dc280 0x10ddfd0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfa9ffb700 0 client.8688 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10dda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 --2- 172.21.15.81:0/3855606473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xe29710 0x10d9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 -- 172.21.15.81:0/3855606473 >> 172.21.15.81:0/3855606473 conn(0xe29eb0 msgr2=0x10db990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 -- 172.21.15.81:0/3855606473 shutdown_connections 2023-11-29T11:21:26.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.603+0000 7fbfd453a740 1 -- 172.21.15.81:0/3855606473 wait complete. 2023-11-29T11:21:26.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.607+0000 7fbfd453a740 20 client.8688 trim_cache size 0 max 16384 2023-11-29T11:21:26.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfd453a740 1 Processor -- start 2023-11-29T11:21:26.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfd453a740 1 -- start start 2023-11-29T11:21:26.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10c2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 0x10c2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfd453a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1009e60 con 0xe29710 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfd453a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xfd7de0 con 0x10daed0 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfd453a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1004a30 con 0xe74790 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10bf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50658/0 (socket says 172.21.15.81:50658) 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcaffd700 1 -- 172.21.15.81:0/571229354 learned_addr learned my addr 172.21.15.81:0/571229354 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 0x10c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcaffd700 1 -- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 msgr2=0x10c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcaffd700 1 -- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 msgr2=0x10c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 0x10c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfcaffd700 1 -- 172.21.15.81:0/571229354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc0b31a0 con 0xe29710 2023-11-29T11:21:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.627+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10bf980 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4011010 tx=0x7fbfb4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17f22013d2a10ba server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfc17fa700 1 -- 172.21.15.81:0/571229354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400b030 con 0xe29710 2023-11-29T11:21:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfc17fa700 1 -- 172.21.15.81:0/571229354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4032460 con 0xe29710 2023-11-29T11:21:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfc17fa700 1 -- 172.21.15.81:0/571229354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4014be0 con 0xe29710 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 -- 172.21.15.81:0/571229354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 msgr2=0x10bf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10bf980 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4011010 tx=0x7fbfb4015000 comp rx=0 tx=0).stop 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 -- 172.21.15.81:0/571229354 shutdown_connections 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 0x10c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 --2- 172.21.15.81:0/571229354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10bf980 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 -- 172.21.15.81:0/571229354 >> 172.21.15.81:0/571229354 conn(0xe29eb0 msgr2=0x10ed920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 -- 172.21.15.81:0/571229354 shutdown_connections 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 -- 172.21.15.81:0/571229354 wait complete. 2023-11-29T11:21:26.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 -- start start 2023-11-29T11:21:26.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.631+0000 7fbfd453a740 1 Processor -- start 2023-11-29T11:21:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10e10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10992a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 0x1095580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xfff2d0 con 0xe29710 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xfff6e0 con 0x10daed0 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1096f40 con 0xe74790 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 10 client.0 _ll_register_callbacks cb 0xfae2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10e10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10e10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50660/0 (socket says 172.21.15.81:50660) 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 -- 172.21.15.81:0/2692002844 learned_addr learned my addr 172.21.15.81:0/2692002844 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcb7fe700 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 0x1095580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 -- 172.21.15.81:0/2692002844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 msgr2=0x10992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 -- 172.21.15.81:0/2692002844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 msgr2=0x1095580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 0x1095580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 -- 172.21.15.81:0/2692002844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1027cc0 con 0xe29710 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfa9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfcaffd700 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10e10d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4020000 tx=0x7fbfb4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d300e540751dc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/2692002844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40146a0 con 0xe29710 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 -- 172.21.15.81:0/2692002844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbfb4014450 con 0xe29710 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/2692002844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fbfb401c040 con 0xe29710 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/2692002844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfb4014b70 con 0xe29710 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 10 client.8694 fetch_fsmap learned FSMap version 66 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 -- 172.21.15.81:0/2692002844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0xfaea20 con 0xe29710 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/2692002844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4014450 con 0xe29710 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/2692002844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fbfb4039030 con 0xe29710 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 10 client.8694 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 10 client.8694 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 20 client.8694 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x10dc280 0x1095ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 4 client.8694 mds_command: new command op to 8610 tid=0[{"prefix": "status"}] 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfd453a740 1 -- 172.21.15.81:0/2692002844 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "status"}) v1 -- 0xea6260 con 0x10dc280 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x10dc280 0x1095ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.635+0000 7fbfa9ffb700 10 client.8694 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfca7fc700 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x10dc280 0x1095ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f106a1b890aff233 server_cookie=36faceb23c45d2cb in_seq=0 out_seq=0 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfa9ffb700 1 -- 172.21.15.81:0/2692002844 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xea6260 con 0x10dc280 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfa9ffb700 10 client.8694 handle_command_reply: tid=0 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 client.8694 shutdown 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 -- 172.21.15.81:0/2692002844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 msgr2=0x10e10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10e10d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4020000 tx=0x7fbfb4000ed0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 -- 172.21.15.81:0/2692002844 shutdown_connections 2023-11-29T11:21:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x10dc280 0x1095ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10daed0 0x1095580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfa9ffb700 0 client.8694 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xe74790 0x10992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 --2- 172.21.15.81:0/2692002844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xe29710 0x10e10d0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 -- 172.21.15.81:0/2692002844 >> 172.21.15.81:0/2692002844 conn(0xe29eb0 msgr2=0x10ed920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 -- 172.21.15.81:0/2692002844 shutdown_connections 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 1 -- 172.21.15.81:0/2692002844 wait complete. 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd453a740 20 client.8694 trim_cache size 0 max 16384 2023-11-29T11:21:26.648 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8610, 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.4629304239999996, 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 66, 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 98, 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 98, 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 5.4306560729999998 2023-11-29T11:21:26.649 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:21:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 -- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfac064ee0 msgr2=0x7fbfac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfac064ee0 0x7fbfac067390 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005930 tx=0x7fbfb4009040 comp rx=0 tx=0).stop 2023-11-29T11:21:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 -- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc070c20 msgr2=0x7fbfcc0b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc070c20 0x7fbfcc0b16e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc000c00 tx=0x7fbfbc004770 comp rx=0 tx=0).stop 2023-11-29T11:21:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 -- 172.21.15.81:0/540930514 shutdown_connections 2023-11-29T11:21:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbfac064ee0 0x7fbfac067390 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfcc15bed0 0x7fbfcc1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfcc070c20 0x7fbfcc0b16e0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 --2- 172.21.15.81:0/540930514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbfcc0707d0 0x7fbfcc157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 -- 172.21.15.81:0/540930514 >> 172.21.15.81:0/540930514 conn(0x7fbfcc06caf0 msgr2=0x7fbfcc0ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 -- 172.21.15.81:0/540930514 shutdown_connections 2023-11-29T11:21:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.639+0000 7fbfd12ba700 1 -- 172.21.15.81:0/540930514 wait complete. 2023-11-29T11:21:26.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:21:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.771+0000 7f7c7d26c700 1 Processor -- start 2023-11-29T11:21:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.771+0000 7f7c7d26c700 1 -- start start 2023-11-29T11:21:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.771+0000 7f7c7d26c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c78158e60 0x7f7c780c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.771+0000 7f7c7d26c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7c780ad490 0x7f7c780cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.771+0000 7f7c7d26c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c780cd8f0 con 0x7f7c780cad50 2023-11-29T11:21:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.771+0000 7f7c7d26c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c780add00 con 0x7f7c780ad490 2023-11-29T11:21:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.771+0000 7f7c7d26c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780cc4f0 con 0x7f7c78158e60 2023-11-29T11:21:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7ca6b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7c780cad50 0x7f7c7806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43486/0 (socket says 172.21.15.81:43486) 2023-11-29T11:21:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7ca6b700 1 -- 172.21.15.81:0/2145673324 learned_addr learned my addr 172.21.15.81:0/2145673324 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:26.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2145673324 >> v2:172.21.15.176:3300/0 conn(0x7f7c780ad490 0x7f7c780cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c77fff700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c78158e60 0x7f7c780c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986662496 0 0) 0x7f7c780cd8f0 con 0x7f7c780cad50 2023-11-29T11:21:26.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c640035d0 con 0x7f7c780cad50 2023-11-29T11:21:26.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 590411516 0 0) 0x7f7c640035d0 con 0x7f7c780cad50 2023-11-29T11:21:26.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c78158e60 msgr2=0x7f7c780c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c78158e60 0x7f7c780c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 >> v2:172.21.15.176:3300/0 conn(0x7f7c780ad490 msgr2=0x7f7c780cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 --2- 172.21.15.81:0/2145673324 >> v2:172.21.15.176:3300/0 conn(0x7f7c780ad490 0x7f7c780cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7806dc60 con 0x7f7c780cad50 2023-11-29T11:21:26.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f7c700019f0 con 0x7f7c780cad50 2023-11-29T11:21:26.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2145673324 >> v2:172.21.15.176:3300/0 conn(0x7f7c780ad490 0x7f7c780cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:26.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 >> v1:172.21.15.81:6789/0 conn(0x7f7c780cad50 legacy=0x7f7c7806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c64003a50 0x7f7c64003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c64004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c78158e60 0x7f7c64005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780add00 con 0x7f7c64004870 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780cc4f0 con 0x7f7c64003a50 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6400ba60 con 0x7f7c78158e60 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c64004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7ca6b700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c78158e60 0x7f7c64005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c77fff700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c64003a50 0x7f7c64003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 -- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c78158e60 msgr2=0x7f7c64005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c78158e60 0x7f7c64005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 -- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c64003a50 msgr2=0x7f7c64003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c64003a50 0x7f7c64003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 -- 172.21.15.81:0/2145673324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640035d0 con 0x7f7c64004870 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c64004ce0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009d40 tx=0x7f7c640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7902e941f835f773 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60009e90 con 0x7f7c64004870 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000e940 con 0x7f7c64004870 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c777fe700 1 -- 172.21.15.81:0/2145673324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000ecb0 con 0x7f7c64004870 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2145673324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 msgr2=0x7f7c64004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7d26c700 1 --2- 172.21.15.81:0/2145673324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c64004ce0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009d40 tx=0x7f7c640058a0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7ca6b700 1 -- 172.21.15.81:0/2145673324 reap_dead start 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2145673324 shutdown_connections 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2145673324 >> 172.21.15.81:0/2145673324 conn(0x7f7c780ce3e0 msgr2=0x7f7c780ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2145673324 shutdown_connections 2023-11-29T11:21:26.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.775+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2145673324 wait complete. 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 Processor -- start 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 -- start start 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c78097500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c78158700 0x7f7c780948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c781656c0 0x7f7c78157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780acf40 con 0x7f7c64004870 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78166580 con 0x7f7c78158700 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78164990 con 0x7f7c781656c0 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c78097500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c78097500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50690/0 (socket says 172.21.15.81:50690) 2023-11-29T11:21:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 -- 172.21.15.81:0/2087843922 learned_addr learned my addr 172.21.15.81:0/2087843922 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c78158700 0x7f7c780948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7ca6b700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c781656c0 0x7f7c78157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 -- 172.21.15.81:0/2087843922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c781656c0 msgr2=0x7f7c78157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c781656c0 0x7f7c78157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 -- 172.21.15.81:0/2087843922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c78158700 msgr2=0x7f7c780948e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c78158700 0x7f7c780948e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 -- 172.21.15.81:0/2087843922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78159230 con 0x7f7c64004870 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c77fff700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c78097500 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f7c68010920 tx=0x7f7c68010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c757fa700 1 -- 172.21.15.81:0/2087843922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800e6c0 con 0x7f7c64004870 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c757fa700 1 -- 172.21.15.81:0/2087843922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800e820 con 0x7f7c64004870 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c780cde90 con 0x7f7c64004870 2023-11-29T11:21:26.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c757fa700 1 -- 172.21.15.81:0/2087843922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800eb90 con 0x7f7c64004870 2023-11-29T11:21:26.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.779+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7806d6a0 con 0x7f7c64004870 2023-11-29T11:21:26.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.783+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c78094e20 con 0x7f7c64004870 2023-11-29T11:21:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.783+0000 7f7c757fa700 1 -- 172.21.15.81:0/2087843922 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7c6801c030 con 0x7f7c64004870 2023-11-29T11:21:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.783+0000 7f7c757fa700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c58064ee0 0x7f7c58067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.783+0000 7f7c757fa700 1 -- 172.21.15.81:0/2087843922 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f7c68082210 con 0x7f7c64004870 2023-11-29T11:21:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.783+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c58064ee0 0x7f7c58067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:26.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.783+0000 7f7c6f7fe700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c58064ee0 0x7f7c58067390 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7c600090b0 tx=0x7f7c6001e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.791+0000 7f7c757fa700 1 -- 172.21.15.81:0/2087843922 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7c68050050 con 0x7f7c64004870 2023-11-29T11:21:26.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:21:26.874 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.987+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c78072500 con 0x7f7c64004870 2023-11-29T11:21:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c757fa700 1 -- 172.21.15.81:0/2087843922 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7c6800ecf0 con 0x7f7c64004870 2023-11-29T11:21:26.995 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c58064ee0 msgr2=0x7f7c58067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c58064ee0 0x7f7c58067390 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7c600090b0 tx=0x7f7c6001e040 comp rx=0 tx=0).stop 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 msgr2=0x7f7c78097500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c78097500 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f7c68010920 tx=0x7f7c68010c30 comp rx=0 tx=0).stop 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 shutdown_connections 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7c58064ee0 0x7f7c58067390 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c781656c0 0x7f7c78157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c78158700 0x7f7c780948e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 --2- 172.21.15.81:0/2087843922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c64004870 0x7f7c78097500 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 >> 172.21.15.81:0/2087843922 conn(0x7f7c780ce3e0 msgr2=0x7f7c780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 shutdown_connections 2023-11-29T11:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:26.991+0000 7f7c7d26c700 1 -- 172.21.15.81:0/2087843922 wait complete. 2023-11-29T11:21:27.010 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:21:27.010 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:21:27.010 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:21:27.010 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:21:27.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:21:27.010 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:21:27.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:21:27.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:21:27.011 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:21:27.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:27.011 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:21:27.016 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:21:27.016 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:21:27.016 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:21:27.016 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:21:27.016 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:21:27.016 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42079sec preferred_lft 42079sec 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:21:27.017 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:21:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:21:27.019 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:21:27.019 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:21:27.019 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:21:27.019 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:21:27.019 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:21:27.019 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:21:27.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:27.019 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:21:27.077 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:21:27.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:27.078 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:21:27.087 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:21:27.087 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:21:27.087 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:21:27.087 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:21:27.087 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:21:27.087 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:21:27.087 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:21:27.088 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:21:27.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:27.088 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:21:27.088 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:21:27.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:21:27.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:21:27.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:21:27.088 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:21:27.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:27.125 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:21:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:21:27.174 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:21:27.174 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:21:27.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:27.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:21:27.189 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:21:27.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:21:27.189 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:21:27.196 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:21:27.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:21:27.197 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:21:27.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:21:27.265 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:21:27.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:21:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:21:27.276 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:21:27.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:27.277 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:21:27.282 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:21:27.283 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:21:27.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:21:27.345 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:21:27.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:21:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:21:27.355 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:21:27.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:27.356 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:21:27.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:21:27.415+0000 7f9ade700640 -1 init, newargv = 0x55e85c799320 newargc=15 2023-11-29T11:21:27.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[59944]: starting ceph client 2023-11-29T11:21:27.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[59944]: starting fuse 2023-11-29T11:21:28.179 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:21:28.175+0000 7f1ec0cf6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:21:28.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:21:28.481 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:21:28.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:21:28.496 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:21:28.496 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:21:28.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:28.497 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:21:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:21:28.546 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:21:28.546 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:21:28.547 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:21:28.631 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.59944.asok 2023-11-29T11:21:28.817 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59944.asok 2023-11-29T11:21:28.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:28.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.59944.asok status 2023-11-29T11:21:28.917 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "59944", 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:21:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8706, 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8706 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 380839944 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:21:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 380839944 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.8706 192.168.0.1:0/380839944", 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/380839944", 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 66, 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 98, 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:21:28.920 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:21:28.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:28.927 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:21:28.927 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:21:28.933 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:21:28.933 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:21:28.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:21:28.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:21:28.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2023-11-29T11:21:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9079366700 1 Processor -- start 2023-11-29T11:21:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9079366700 1 -- start start 2023-11-29T11:21:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9079366700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9074158f10 0x7f907406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9079366700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90740cd930 0x7f90740cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9079366700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90740cdd40 0x7f90740cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9079366700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740c9460 con 0x7f90740cdd40 2023-11-29T11:21:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9079366700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740c9fe0 con 0x7f90740cd930 2023-11-29T11:21:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9079366700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907406dc90 con 0x7f9074158f10 2023-11-29T11:21:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9078b65700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90740cdd40 0x7f90740cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9078b65700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90740cdd40 0x7f90740cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50702/0 (socket says 172.21.15.81:50702) 2023-11-29T11:21:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9078b65700 1 -- 172.21.15.81:0/2702390579 learned_addr learned my addr 172.21.15.81:0/2702390579 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f9073fff700 1 --2- 172.21.15.81:0/2702390579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9074158f10 0x7f907406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.063+0000 7f90737fe700 1 --2- 172.21.15.81:0/2702390579 >> v2:172.21.15.176:3300/0 conn(0x7f90740cd930 0x7f90740cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9078b65700 1 -- 172.21.15.81:0/2702390579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9074158f10 msgr2=0x7f907406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9078b65700 1 --2- 172.21.15.81:0/2702390579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9074158f10 0x7f907406b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9078b65700 1 -- 172.21.15.81:0/2702390579 >> v2:172.21.15.176:3300/0 conn(0x7f90740cd930 msgr2=0x7f90740cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9078b65700 1 --2- 172.21.15.81:0/2702390579 >> v2:172.21.15.176:3300/0 conn(0x7f90740cd930 0x7f90740cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9078b65700 1 -- 172.21.15.81:0/2702390579 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740c96b0 con 0x7f90740cdd40 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9078b65700 1 --2- 172.21.15.81:0/2702390579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90740cdd40 0x7f90740cb350 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f907406f3f0 tx=0x7f906c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e5b62c74a1d5b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9072ffd700 1 -- 172.21.15.81:0/2702390579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c011830 con 0x7f90740cdd40 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9072ffd700 1 -- 172.21.15.81:0/2702390579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c011990 con 0x7f90740cdd40 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9072ffd700 1 -- 172.21.15.81:0/2702390579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c011d20 con 0x7f90740cdd40 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 -- 172.21.15.81:0/2702390579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90740cdd40 msgr2=0x7f90740cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 --2- 172.21.15.81:0/2702390579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90740cdd40 0x7f90740cb350 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f907406f3f0 tx=0x7f906c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 -- 172.21.15.81:0/2702390579 shutdown_connections 2023-11-29T11:21:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 --2- 172.21.15.81:0/2702390579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90740cdd40 0x7f90740cb350 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 --2- 172.21.15.81:0/2702390579 >> v2:172.21.15.176:3300/0 conn(0x7f90740cd930 0x7f90740cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 --2- 172.21.15.81:0/2702390579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9074158f10 0x7f907406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 -- 172.21.15.81:0/2702390579 >> 172.21.15.81:0/2702390579 conn(0x7f90740ce400 msgr2=0x7f90740ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 -- 172.21.15.81:0/2702390579 shutdown_connections 2023-11-29T11:21:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.067+0000 7f9079366700 1 -- 172.21.15.81:0/2702390579 wait complete. 2023-11-29T11:21:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 Processor -- start 2023-11-29T11:21:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 -- start start 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90740cd930 0x7f90741564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90740cdd40 0x7f9074097270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074158f10 0x7f90740977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90741551a0 con 0x7f9074158f10 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90741588f0 con 0x7f90740cdd40 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9074151970 con 0x7f90740cd930 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074158f10 0x7f90740977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9073fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90740cd930 0x7f90741564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074158f10 0x7f90740977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50712/0 (socket says 172.21.15.81:50712) 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 -- 172.21.15.81:0/3120576745 learned_addr learned my addr 172.21.15.81:0/3120576745 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f90737fe700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90740cdd40 0x7f9074097270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 -- 172.21.15.81:0/3120576745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90740cd930 msgr2=0x7f90741564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90740cd930 0x7f90741564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 -- 172.21.15.81:0/3120576745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90740cdd40 msgr2=0x7f9074097270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90740cdd40 0x7f9074097270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 -- 172.21.15.81:0/3120576745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c009570 con 0x7f9074158f10 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9078b65700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074158f10 0x7f90740977b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f907406f7e0 tx=0x7f906c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9070ff9700 1 -- 172.21.15.81:0/3120576745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c004450 con 0x7f9074158f10 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9070ff9700 1 -- 172.21.15.81:0/3120576745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c01e070 con 0x7f9074158f10 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 -- 172.21.15.81:0/3120576745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90740c9c70 con 0x7f9074158f10 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9070ff9700 1 -- 172.21.15.81:0/3120576745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c003900 con 0x7f9074158f10 2023-11-29T11:21:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.071+0000 7f9079366700 1 -- 172.21.15.81:0/3120576745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90740c9990 con 0x7f9074158f10 2023-11-29T11:21:29.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.075+0000 7f9070ff9700 1 -- 172.21.15.81:0/3120576745 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f906c00f050 con 0x7f9074158f10 2023-11-29T11:21:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.075+0000 7f9070ff9700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9054064ee0 0x7f9054067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.075+0000 7f9073fff700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9054064ee0 0x7f9054067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.075+0000 7f9070ff9700 1 -- 172.21.15.81:0/3120576745 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f906c020070 con 0x7f9074158f10 2023-11-29T11:21:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.075+0000 7f9073fff700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9054064ee0 0x7f9054067390 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f905c009b70 tx=0x7f905c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.075+0000 7f907d848740 1 Processor -- start 2023-11-29T11:21:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.075+0000 7f907d848740 1 -- start start 2023-11-29T11:21:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 0x21e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21efe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21f0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x20a7c80 con 0x1f389b0 2023-11-29T11:21:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2117d60 con 0x1f83a30 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2111060 con 0x1f38d80 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50726/0 (socket says 172.21.15.81:50726) 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 -- 172.21.15.81:0/3682847736 learned_addr learned my addr 172.21.15.81:0/3682847736 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f9078b65700 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f9073fff700 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 0x21e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 -- 172.21.15.81:0/3682847736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 msgr2=0x21e6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 0x21e6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 -- 172.21.15.81:0/3682847736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 msgr2=0x21f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 -- 172.21.15.81:0/3682847736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21364e0 con 0x1f389b0 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f90737fe700 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21efe00 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f90640074c0 tx=0x7f9064009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe55ecf57d1bf67c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f9069ffb700 1 -- 172.21.15.81:0/3682847736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400e030 con 0x1f389b0 2023-11-29T11:21:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f9069ffb700 1 -- 172.21.15.81:0/3682847736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90640153f0 con 0x1f389b0 2023-11-29T11:21:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f9069ffb700 1 -- 172.21.15.81:0/3682847736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90640157a0 con 0x1f389b0 2023-11-29T11:21:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 -- 172.21.15.81:0/3682847736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 msgr2=0x21efe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21efe00 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f90640074c0 tx=0x7f9064009750 comp rx=0 tx=0).stop 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 -- 172.21.15.81:0/3682847736 shutdown_connections 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21efe00 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 --2- 172.21.15.81:0/3682847736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 0x21e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 -- 172.21.15.81:0/3682847736 >> 172.21.15.81:0/3682847736 conn(0x1f39150 msgr2=0x21d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 -- 172.21.15.81:0/3682847736 shutdown_connections 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.079+0000 7f907d848740 1 -- 172.21.15.81:0/3682847736 wait complete. 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 -- start start 2023-11-29T11:21:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 Processor -- start 2023-11-29T11:21:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21e6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 0x21d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fbddc0 con 0x1f389b0 2023-11-29T11:21:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x21e6aa0 con 0x1f83a30 2023-11-29T11:21:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x21d0a20 con 0x1f38d80 2023-11-29T11:21:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 10 client.0 _ll_register_callbacks cb 0x216cb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21e6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50738/0 (socket says 172.21.15.81:50738) 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 -- 172.21.15.81:0/1908496003 learned_addr learned my addr 172.21.15.81:0/1908496003 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f90737fe700 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 0x21d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9078b65700 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 -- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 msgr2=0x21d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 0x21d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 -- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 msgr2=0x21d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 -- 172.21.15.81:0/1908496003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9064009d40 con 0x1f389b0 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9078b65700 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9073fff700 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21e6560 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f905c011dc0 tx=0x7f905c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e7acfac27e84ce server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9052ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9052ffd700 1 -- 172.21.15.81:0/1908496003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c01c040 con 0x1f389b0 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9052ffd700 1 -- 172.21.15.81:0/1908496003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f905c023660 con 0x1f389b0 2023-11-29T11:21:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 -- 172.21.15.81:0/1908496003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x210a0e0 con 0x1f389b0 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f9052ffd700 1 -- 172.21.15.81:0/1908496003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f905c004110 con 0x1f389b0 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 10 client.8718 fetch_fsmap learned FSMap version 66 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.083+0000 7f907d848740 1 -- 172.21.15.81:0/1908496003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x1f84c80 con 0x1f389b0 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f9052ffd700 1 -- 172.21.15.81:0/1908496003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x210a0e0 con 0x1f389b0 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f9052ffd700 1 -- 172.21.15.81:0/1908496003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f905c023820 con 0x1f389b0 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 10 client.8718 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 10 client.8718 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 20 client.8718 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x21a6130 0x21e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 4 client.8718 mds_command: new command op to 8610 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 -- 172.21.15.81:0/1908496003 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2109e00 con 0x21a6130 2023-11-29T11:21:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f90737fe700 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x21a6130 0x21e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f9052ffd700 10 client.8718 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f90737fe700 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x21a6130 0x21e7b90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59a8ecc95c00f150 server_cookie=67b2d02cfa38e69f in_seq=0 out_seq=0 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f9052ffd700 1 -- 172.21.15.81:0/1908496003 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2109e00 con 0x21a6130 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f9052ffd700 10 client.8718 handle_command_reply: tid=0 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 client.8718 shutdown 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 -- 172.21.15.81:0/1908496003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 msgr2=0x21e6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21e6560 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f905c011dc0 tx=0x7f905c004770 comp rx=0 tx=0).stop 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 -- 172.21.15.81:0/1908496003 shutdown_connections 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x21a6130 0x21e7b90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f83a30 0x21d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f38d80 0x21d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 --2- 172.21.15.81:0/1908496003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21e6560 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f9052ffd700 0 client.8718 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 -- 172.21.15.81:0/1908496003 >> 172.21.15.81:0/1908496003 conn(0x1f39150 msgr2=0x21ba5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 -- 172.21.15.81:0/1908496003 shutdown_connections 2023-11-29T11:21:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 1 -- 172.21.15.81:0/1908496003 wait complete. 2023-11-29T11:21:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.087+0000 7f907d848740 20 client.8718 trim_cache size 0 max 16384 2023-11-29T11:21:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f907d848740 1 Processor -- start 2023-11-29T11:21:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f907d848740 1 -- start start 2023-11-29T11:21:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f907d848740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f39150 0x21b9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f907d848740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21b9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f907d848740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 0x21e5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f907d848740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x21d1d40 con 0x1f389b0 2023-11-29T11:21:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f907d848740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x20b71d0 con 0x1f38d80 2023-11-29T11:21:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f907d848740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x210fef0 con 0x1f39150 2023-11-29T11:21:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f90737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f90737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21b9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50742/0 (socket says 172.21.15.81:50742) 2023-11-29T11:21:29.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f90737fe700 1 -- 172.21.15.81:0/1142837782 learned_addr learned my addr 172.21.15.81:0/1142837782 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f9078b65700 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 0x21e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.103+0000 7f9073fff700 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f39150 0x21b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f90737fe700 1 -- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f39150 msgr2=0x21b9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f90737fe700 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f39150 0x21b9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f90737fe700 1 -- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 msgr2=0x21e5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f90737fe700 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 0x21e5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f90737fe700 1 -- 172.21.15.81:0/1142837782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20d7a30 con 0x1f389b0 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f9073fff700 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f39150 0x21b9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f90737fe700 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21b9850 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f9064000f80 tx=0x7f906400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88050aeee60fcd27 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f906a7fc700 1 -- 172.21.15.81:0/1142837782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400e040 con 0x1f389b0 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f906a7fc700 1 -- 172.21.15.81:0/1142837782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064009b30 con 0x1f389b0 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f906a7fc700 1 -- 172.21.15.81:0/1142837782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064003c80 con 0x1f389b0 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 -- 172.21.15.81:0/1142837782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 msgr2=0x21b9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21b9850 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f9064000f80 tx=0x7f906400f000 comp rx=0 tx=0).stop 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 -- 172.21.15.81:0/1142837782 shutdown_connections 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 0x21e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f389b0 0x21b9850 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 --2- 172.21.15.81:0/1142837782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f39150 0x21b9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 -- 172.21.15.81:0/1142837782 >> 172.21.15.81:0/1142837782 conn(0x21e66d0 msgr2=0x21a7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 -- 172.21.15.81:0/1142837782 shutdown_connections 2023-11-29T11:21:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 -- 172.21.15.81:0/1142837782 wait complete. 2023-11-29T11:21:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 -- start start 2023-11-29T11:21:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.107+0000 7f907d848740 1 Processor -- start 2023-11-29T11:21:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f389b0 0x2253e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 0x2205a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f39150 0x2205fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2203e60 con 0x1f39150 2023-11-29T11:21:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x21cc350 con 0x1f38d80 2023-11-29T11:21:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x21cc0b0 con 0x1f389b0 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 10 client.0 _ll_register_callbacks cb 0x2137910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f39150 0x2205fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f90737fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 0x2205a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f39150 0x2205fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50746/0 (socket says 172.21.15.81:50746) 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 -- 172.21.15.81:0/3062747658 learned_addr learned my addr 172.21.15.81:0/3062747658 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9073fff700 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f389b0 0x2253e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 -- 172.21.15.81:0/3062747658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f389b0 msgr2=0x2253e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f389b0 0x2253e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 -- 172.21.15.81:0/3062747658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 msgr2=0x2205a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 0x2205a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 -- 172.21.15.81:0/3062747658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x21364e0 con 0x1f39150 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9078b65700 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f39150 0x2205fb0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f906c014040 tx=0x7f906c051340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41e9dfabbb4e819 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9052ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9052ffd700 1 -- 172.21.15.81:0/3062747658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c05d090 con 0x1f39150 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9052ffd700 1 -- 172.21.15.81:0/3062747658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f906c0544f0 con 0x1f39150 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 -- 172.21.15.81:0/3062747658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90640153f0 con 0x1f39150 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9052ffd700 1 -- 172.21.15.81:0/3062747658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f906c0546b0 con 0x1f39150 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 10 client.8724 fetch_fsmap learned FSMap version 66 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 -- 172.21.15.81:0/3062747658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x20bd510 con 0x1f39150 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9052ffd700 1 -- 172.21.15.81:0/3062747658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c075020 con 0x1f39150 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9052ffd700 1 -- 172.21.15.81:0/3062747658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f906c071220 con 0x1f39150 2023-11-29T11:21:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 10 client.8724 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 10 client.8724 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 20 client.8724 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x1f83a30 0x22064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 4 client.8724 mds_command: new command op to 8610 tid=0[{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f907d848740 1 -- 172.21.15.81:0/3062747658 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x1fb5500 con 0x1f83a30 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9073fff700 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x1f83a30 0x22064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9052ffd700 10 client.8724 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.111+0000 7f9073fff700 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x1f83a30 0x22064f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f0fd52bb4aa9b3d server_cookie=fac1cc0da773f966 in_seq=0 out_seq=0 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9052ffd700 1 -- 172.21.15.81:0/3062747658 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1fb5500 con 0x1f83a30 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9052ffd700 10 client.8724 handle_command_reply: tid=0 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 client.8724 shutdown 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 -- 172.21.15.81:0/3062747658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f39150 msgr2=0x2205fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f39150 0x2205fb0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f906c014040 tx=0x7f906c051340 comp rx=0 tx=0).stop 2023-11-29T11:21:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 -- 172.21.15.81:0/3062747658 shutdown_connections 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x1f83a30 0x22064f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f39150 0x2205fb0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f38d80 0x2205a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 --2- 172.21.15.81:0/3062747658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f389b0 0x2253e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 -- 172.21.15.81:0/3062747658 >> 172.21.15.81:0/3062747658 conn(0x21e66d0 msgr2=0x21cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9052ffd700 0 client.8724 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 -- 172.21.15.81:0/3062747658 shutdown_connections 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 1 -- 172.21.15.81:0/3062747658 wait complete. 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f907d848740 20 client.8724 trim_cache size 0 max 16384 2023-11-29T11:21:29.122 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:21:29.123 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:21:29.123 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "c7657937-9459-4797-9d01-4cff116a2ced", 2023-11-29T11:21:29.123 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:21:29.123 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 -- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9054064ee0 msgr2=0x7f9054067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9054064ee0 0x7f9054067390 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f905c009b70 tx=0x7f905c009240 comp rx=0 tx=0).stop 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 -- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074158f10 msgr2=0x7f90740977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074158f10 0x7f90740977b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f907406f7e0 tx=0x7f906c004770 comp rx=0 tx=0).stop 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 -- 172.21.15.81:0/3120576745 shutdown_connections 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9054064ee0 0x7f9054067390 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9074158f10 0x7f90740977b0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90740cdd40 0x7f9074097270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 --2- 172.21.15.81:0/3120576745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90740cd930 0x7f90741564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 -- 172.21.15.81:0/3120576745 >> 172.21.15.81:0/3120576745 conn(0x7f90740ce400 msgr2=0x7f90740b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 -- 172.21.15.81:0/3120576745 shutdown_connections 2023-11-29T11:21:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f9079366700 1 -- 172.21.15.81:0/3120576745 wait complete. 2023-11-29T11:21:29.125 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:21:29.115+0000 7f1ebd4ef700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x564e1472a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(15)0x10000000001:[<0x10000000000/file v6>,<0x1/dir v13>]//[]","memoryvalue":"(15)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v21>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-29T11:21:29.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-11-29T11:21:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78e139700 1 Processor -- start 2023-11-29T11:21:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78e139700 1 -- start start 2023-11-29T11:21:29.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78e139700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc7880cbeb0 0x7fc78815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78e139700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7880c9b60 con 0x7fc7881569f0 2023-11-29T11:21:29.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78e139700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78815d6e0 con 0x7fc788156dc0 2023-11-29T11:21:29.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78e139700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78815d9c0 con 0x7fc7880cbeb0 2023-11-29T11:21:29.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78d137700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc7881569f0 0x7fc78815cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43502/0 (socket says 172.21.15.81:43502) 2023-11-29T11:21:29.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78d137700 1 -- 172.21.15.81:0/930482760 learned_addr learned my addr 172.21.15.81:0/930482760 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:29.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc78d938700 1 --2- 172.21.15.81:0/930482760 >> v2:172.21.15.176:3300/0 conn(0x7fc7880cbeb0 0x7fc78815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621861653 0 0) 0x7fc7880c9b60 con 0x7fc7881569f0 2023-11-29T11:21:29.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7740057e0 con 0x7fc7881569f0 2023-11-29T11:21:29.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2072265461 0 0) 0x7fc7740057e0 con 0x7fc7881569f0 2023-11-29T11:21:29.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 >> v2:172.21.15.176:3300/0 conn(0x7fc7880cbeb0 msgr2=0x7fc78815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 --2- 172.21.15.81:0/930482760 >> v2:172.21.15.176:3300/0 conn(0x7fc7880cbeb0 0x7fc78815a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 >> v1:172.21.15.176:6789/0 conn(0x7fc788156dc0 legacy=0x7fc7880cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7881598d0 con 0x7fc7881569f0 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fc7840017f0 con 0x7fc7881569f0 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 >> v1:172.21.15.81:6789/0 conn(0x7fc7881569f0 legacy=0x7fc78815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc774005c30 0x7fc774006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc774006620 0x7fc774006ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740072e0 0x7fc77400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78815d9c0 con 0x7fc7740072e0 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77400e230 con 0x7fc774006620 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.251+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77400e3f0 con 0x7fc774005c30 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d137700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc774005c30 0x7fc774006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78c936700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc774006620 0x7fc774006ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d938700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740072e0 0x7fc77400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d137700 1 -- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc774006620 msgr2=0x7fc774006ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d137700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc774006620 0x7fc774006ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d137700 1 -- 172.21.15.81:0/930482760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740072e0 msgr2=0x7fc77400dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d137700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740072e0 0x7fc77400dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d137700 1 -- 172.21.15.81:0/930482760 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7740057e0 con 0x7fc774005c30 2023-11-29T11:21:29.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d938700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7740072e0 0x7fc77400dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:29.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d938700 1 -- 172.21.15.81:0/930482760 reap_dead start 2023-11-29T11:21:29.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78d137700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc774005c30 0x7fc774006000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc78400c240 tx=0x7fc774007ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e443a1b0974ed17 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400cd80 con 0x7fc774005c30 2023-11-29T11:21:29.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784007b40 con 0x7fc774005c30 2023-11-29T11:21:29.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc77ffff700 1 -- 172.21.15.81:0/930482760 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784007310 con 0x7fc774005c30 2023-11-29T11:21:29.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 -- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc774005c30 msgr2=0x7fc774006000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc774005c30 0x7fc774006000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc78400c240 tx=0x7fc774007ab0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 -- 172.21.15.81:0/930482760 shutdown_connections 2023-11-29T11:21:29.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 --2- 172.21.15.81:0/930482760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc774005c30 0x7fc774006000 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 -- 172.21.15.81:0/930482760 >> 172.21.15.81:0/930482760 conn(0x7fc78806c660 msgr2=0x7fc78806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 -- 172.21.15.81:0/930482760 shutdown_connections 2023-11-29T11:21:29.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 -- 172.21.15.81:0/930482760 wait complete. 2023-11-29T11:21:29.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 Processor -- start 2023-11-29T11:21:29.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.255+0000 7fc78e139700 1 -- start start 2023-11-29T11:21:29.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78e139700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc774005c30 0x7fc788154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78e139700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc788155340 0x7fc7880b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78e139700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7880ac8b0 0x7fc7880acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78e139700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880ad260 con 0x7fc774005c30 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78e139700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880c6880 con 0x7fc7880ac8b0 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78e139700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880c88d0 con 0x7fc788155340 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc774005c30 0x7fc788154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc774005c30 0x7fc788154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50762/0 (socket says 172.21.15.81:50762) 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 -- 172.21.15.81:0/4055946286 learned_addr learned my addr 172.21.15.81:0/4055946286 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78c936700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc788155340 0x7fc7880b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d938700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7880ac8b0 0x7fc7880acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 -- 172.21.15.81:0/4055946286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc788155340 msgr2=0x7fc7880b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc788155340 0x7fc7880b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 -- 172.21.15.81:0/4055946286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7880ac8b0 msgr2=0x7fc7880acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7880ac8b0 0x7fc7880acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 -- 172.21.15.81:0/4055946286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788159520 con 0x7fc774005c30 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78d137700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc774005c30 0x7fc788154dc0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fc77400e580 tx=0x7fc784001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc77dffb700 1 -- 172.21.15.81:0/4055946286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840074e0 con 0x7fc774005c30 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc77dffb700 1 -- 172.21.15.81:0/4055946286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784007660 con 0x7fc774005c30 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78e139700 1 -- 172.21.15.81:0/4055946286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc788159bb0 con 0x7fc774005c30 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc77dffb700 1 -- 172.21.15.81:0/4055946286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784005a90 con 0x7fc774005c30 2023-11-29T11:21:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.259+0000 7fc78e139700 1 -- 172.21.15.81:0/4055946286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78815a0d0 con 0x7fc774005c30 2023-11-29T11:21:29.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.263+0000 7fc77dffb700 1 -- 172.21.15.81:0/4055946286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc784024030 con 0x7fc774005c30 2023-11-29T11:21:29.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.263+0000 7fc77dffb700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc76c064f10 0x7fc76c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.263+0000 7fc77dffb700 1 -- 172.21.15.81:0/4055946286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fc784083010 con 0x7fc774005c30 2023-11-29T11:21:29.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.263+0000 7fc78c936700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc76c064f10 0x7fc76c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.263+0000 7fc78c936700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc76c064f10 0x7fc76c0673c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc78815d5e0 tx=0x7fc778009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.263+0000 7fc79261b740 1 Processor -- start 2023-11-29T11:21:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- start start 2023-11-29T11:21:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31c10 0xcb17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa7c8c0 0xcb2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xba0d20 con 0xa7c8c0 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xc10d60 con 0xa31c10 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0xc0a060 con 0xa31840 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa7c8c0 0xcb2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa7c8c0 0xcb2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50764/0 (socket says 172.21.15.81:50764) 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 -- 172.21.15.81:0/2401919921 learned_addr learned my addr 172.21.15.81:0/2401919921 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d137700 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31c10 0xcb17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78c936700 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 -- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 msgr2=0xcb1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 -- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31c10 msgr2=0xcb17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31c10 0xcb17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 -- 172.21.15.81:0/2401919921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc300a0 con 0xa7c8c0 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78c936700 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d137700 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31c10 0xcb17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc78d938700 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa7c8c0 0xcb2250 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fc7800145f0 tx=0x7fc780009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82376b54001a8fa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc772ffd700 1 -- 172.21.15.81:0/2401919921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000e040 con 0xa7c8c0 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc772ffd700 1 -- 172.21.15.81:0/2401919921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000f040 con 0xa7c8c0 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc772ffd700 1 -- 172.21.15.81:0/2401919921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780003e60 con 0xa7c8c0 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- 172.21.15.81:0/2401919921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa7c8c0 msgr2=0xcb2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa7c8c0 0xcb2250 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fc7800145f0 tx=0x7fc780009750 comp rx=0 tx=0).stop 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- 172.21.15.81:0/2401919921 shutdown_connections 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa7c8c0 0xcb2250 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 --2- 172.21.15.81:0/2401919921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31c10 0xcb17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- 172.21.15.81:0/2401919921 >> 172.21.15.81:0/2401919921 conn(0xa31fe0 msgr2=0xccab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- 172.21.15.81:0/2401919921 shutdown_connections 2023-11-29T11:21:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.267+0000 7fc79261b740 1 -- 172.21.15.81:0/2401919921 wait complete. 2023-11-29T11:21:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 -- start start 2023-11-29T11:21:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 Processor -- start 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xcb0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 0xc9e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xab6c50 con 0xa31c10 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xcf19e0 con 0xa7c8c0 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0xcf0ac0 con 0xa31840 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 10 client.0 _ll_register_callbacks cb 0xc039a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xcb0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xcb0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50770/0 (socket says 172.21.15.81:50770) 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 -- 172.21.15.81:0/3435592273 learned_addr learned my addr 172.21.15.81:0/3435592273 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78d137700 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78d938700 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 0xc9e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 -- 172.21.15.81:0/3435592273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 msgr2=0xcb0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 -- 172.21.15.81:0/3435592273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 msgr2=0xc9e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 0xc9e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 -- 172.21.15.81:0/3435592273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc780014320 con 0xa31c10 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78c936700 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xcb0cc0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fc778015810 tx=0x7fc7780012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb04b8877a08343 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc767fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc767fff700 1 -- 172.21.15.81:0/3435592273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780226c0 con 0xa31c10 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc767fff700 1 -- 172.21.15.81:0/3435592273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fc778022820 con 0xa31c10 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 -- 172.21.15.81:0/3435592273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc030e0 con 0xa31c10 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc767fff700 1 -- 172.21.15.81:0/3435592273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7780229e0 con 0xa31c10 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 10 client.8736 fetch_fsmap learned FSMap version 66 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 -- 172.21.15.81:0/3435592273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0xa7db10 con 0xa31c10 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc767fff700 1 -- 172.21.15.81:0/3435592273 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc030e0 con 0xa31c10 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc767fff700 1 -- 172.21.15.81:0/3435592273 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc778022b40 con 0xa31c10 2023-11-29T11:21:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 10 client.8736 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:21:29.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 10 client.8736 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:21:29.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 20 client.8736 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:29.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0xc9ef90 0xcef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 4 client.8736 mds_command: new command op to 8610 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:21:29.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc79261b740 1 -- 172.21.15.81:0/3435592273 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc02e00 con 0xc9ef90 2023-11-29T11:21:29.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.271+0000 7fc78d137700 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0xc9ef90 0xcef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc767fff700 10 client.8736 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:29.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc78d137700 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0xc9ef90 0xcef0f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2587748729faaa6 server_cookie=f2ccc33f771dba0b in_seq=0 out_seq=0 2023-11-29T11:21:29.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc767fff700 1 -- 172.21.15.81:0/3435592273 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xc02e00 con 0xc9ef90 2023-11-29T11:21:29.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc767fff700 10 client.8736 handle_command_reply: tid=0 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 client.8736 shutdown 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 -- 172.21.15.81:0/3435592273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 msgr2=0xcb0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xcb0cc0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fc778015810 tx=0x7fc7780012b0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 -- 172.21.15.81:0/3435592273 shutdown_connections 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0xc9ef90 0xcef0f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 0xc9e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc767fff700 0 client.8736 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xcb0cc0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 --2- 172.21.15.81:0/3435592273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31840 0xcb0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 -- 172.21.15.81:0/3435592273 >> 172.21.15.81:0/3435592273 conn(0xa31fe0 msgr2=0xca37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 -- 172.21.15.81:0/3435592273 shutdown_connections 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 1 -- 172.21.15.81:0/3435592273 wait complete. 2023-11-29T11:21:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.275+0000 7fc79261b740 20 client.8736 trim_cache size 0 max 16384 2023-11-29T11:21:29.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc79261b740 1 Processor -- start 2023-11-29T11:21:29.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc79261b740 1 -- start start 2023-11-29T11:21:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc79261b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31840 0xced0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc79261b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31c10 0xced5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc79261b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 0xca2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc79261b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xc07460 con 0xa31840 2023-11-29T11:21:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc79261b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xbb3f10 con 0xa7c8c0 2023-11-29T11:21:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc79261b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0xbd9ba0 con 0xa31c10 2023-11-29T11:21:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31840 0xced0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31840 0xced0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50778/0 (socket says 172.21.15.81:50778) 2023-11-29T11:21:29.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 -- 172.21.15.81:0/2226622130 learned_addr learned my addr 172.21.15.81:0/2226622130 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78c936700 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31c10 0xced5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d938700 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 0xca2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 -- 172.21.15.81:0/2226622130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31c10 msgr2=0xced5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31c10 0xced5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 -- 172.21.15.81:0/2226622130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 msgr2=0xca2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 0xca2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 -- 172.21.15.81:0/2226622130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788155f60 con 0xa31840 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc78d137700 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31840 0xced0b0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fc784000ef0 tx=0x7fc784029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d108890bcabc782 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc7737fe700 1 -- 172.21.15.81:0/2226622130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784052e80 con 0xa31840 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc7737fe700 1 -- 172.21.15.81:0/2226622130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7840811c0 con 0xa31840 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.295+0000 7fc7737fe700 1 -- 172.21.15.81:0/2226622130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784005bf0 con 0xa31840 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 -- 172.21.15.81:0/2226622130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31840 msgr2=0xced0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31840 0xced0b0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fc784000ef0 tx=0x7fc784029040 comp rx=0 tx=0).stop 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 -- 172.21.15.81:0/2226622130 shutdown_connections 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa7c8c0 0xca2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa31c10 0xced5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 --2- 172.21.15.81:0/2226622130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31840 0xced0b0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 -- 172.21.15.81:0/2226622130 >> 172.21.15.81:0/2226622130 conn(0xa31fe0 msgr2=0xcc63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 -- 172.21.15.81:0/2226622130 shutdown_connections 2023-11-29T11:21:29.304 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 -- 172.21.15.81:0/2226622130 wait complete. 2023-11-29T11:21:29.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 -- start start 2023-11-29T11:21:29.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.299+0000 7fc79261b740 1 Processor -- start 2023-11-29T11:21:29.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31840 0xcfca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xceffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa7c8c0 0xd44c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xc08ef0 con 0xa31c10 2023-11-29T11:21:29.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0xcc77c0 con 0xa31840 2023-11-29T11:21:29.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0xca31a0 con 0xa7c8c0 2023-11-29T11:21:29.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xceffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 10 client.0 _ll_register_callbacks cb 0x7fc780009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xceffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50782/0 (socket says 172.21.15.81:50782) 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 -- 172.21.15.81:0/787625390 learned_addr learned my addr 172.21.15.81:0/787625390 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78d137700 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31840 0xcfca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78d938700 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa7c8c0 0xd44c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 -- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa7c8c0 msgr2=0xd44c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa7c8c0 0xd44c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 -- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31840 msgr2=0xcfca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31840 0xcfca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 -- 172.21.15.81:0/787625390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78815a0d0 con 0xa31c10 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78d938700 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa7c8c0 0xd44c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78c936700 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xceffa0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fc778007fd0 tx=0x7fc778018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c57887c3c4d26f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:29.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 1 -- 172.21.15.81:0/787625390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778012780 con 0xa31c10 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- 172.21.15.81:0/787625390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc78000f040 con 0xa31c10 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 1 -- 172.21.15.81:0/787625390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fc77803a070 con 0xa31c10 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 1 -- 172.21.15.81:0/787625390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc77802b650 con 0xa31c10 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 10 client.8742 fetch_fsmap learned FSMap version 66 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- 172.21.15.81:0/787625390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0xbb6af0 con 0xa31c10 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 1 -- 172.21.15.81:0/787625390 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000f040 con 0xa31c10 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 1 -- 172.21.15.81:0/787625390 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fc77802b7b0 con 0xa31c10 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 10 client.8742 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 10 client.8742 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 20 client.8742 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0xd45300 0xca1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 4 client.8742 mds_command: new command op to 8610 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- 172.21.15.81:0/787625390 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xaae390 con 0xd45300 2023-11-29T11:21:29.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78d137700 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0xd45300 0xca1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:29.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 10 client.8742 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:29.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc78d137700 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0xd45300 0xca1460 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f5c3d2f23fb1b2e server_cookie=908cdc8b5d9582a4 in_seq=0 out_seq=0 2023-11-29T11:21:29.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 1 -- 172.21.15.81:0/787625390 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0xaae390 con 0xd45300 2023-11-29T11:21:29.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 10 client.8742 handle_command_reply: tid=0 2023-11-29T11:21:29.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 client.8742 shutdown 2023-11-29T11:21:29.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- 172.21.15.81:0/787625390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 msgr2=0xceffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xceffa0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fc778007fd0 tx=0x7fc778018000 comp rx=0 tx=0).stop 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- 172.21.15.81:0/787625390 shutdown_connections 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0xd45300 0xca1460 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0xa7c8c0 0xd44c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa31c10 0xceffa0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 --2- 172.21.15.81:0/787625390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0xa31840 0xcfca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc767fff700 0 client.8742 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.303+0000 7fc79261b740 1 -- 172.21.15.81:0/787625390 >> 172.21.15.81:0/787625390 conn(0xa31fe0 msgr2=0xcebeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc79261b740 1 -- 172.21.15.81:0/787625390 shutdown_connections 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc79261b740 1 -- 172.21.15.81:0/787625390 wait complete. 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc79261b740 20 client.8742 trim_cache size 0 max 16384 2023-11-29T11:21:29.314 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout: "c7657937-9459-4797-9d01-4cff116a2ced": { 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/dir", 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "c7657937-9459-4797-9d01-4cff116a2ced", 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,repair" 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:21:29.315 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:21:29.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 -- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc76c064f10 msgr2=0x7fc76c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc76c064f10 0x7fc76c0673c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc78815d5e0 tx=0x7fc778009040 comp rx=0 tx=0).stop 2023-11-29T11:21:29.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 -- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc774005c30 msgr2=0x7fc788154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:29.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc774005c30 0x7fc788154dc0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fc77400e580 tx=0x7fc784001b00 comp rx=0 tx=0).stop 2023-11-29T11:21:29.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 -- 172.21.15.81:0/4055946286 shutdown_connections 2023-11-29T11:21:29.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc76c064f10 0x7fc76c0673c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7880ac8b0 0x7fc7880acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc788155340 0x7fc7880b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 --2- 172.21.15.81:0/4055946286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc774005c30 0x7fc788154dc0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:29.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 -- 172.21.15.81:0/4055946286 >> 172.21.15.81:0/4055946286 conn(0x7fc78806c660 msgr2=0x7fc7880cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:29.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 -- 172.21.15.81:0/4055946286 shutdown_connections 2023-11-29T11:21:29.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:29.307+0000 7fc78e139700 1 -- 172.21.15.81:0/4055946286 wait complete. 2023-11-29T11:21:29.326 INFO:tasks.cephfs.filesystem:scrub status for tag:c7657937-9459-4797-9d01-4cff116a2ced - {'path': '/dir', 'tag': 'c7657937-9459-4797-9d01-4cff116a2ced', 'options': 'recursive,repair'} 2023-11-29T11:21:56.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:21:56.933 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:21:59.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-11-29T11:21:59.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b8ad1700 1 Processor -- start 2023-11-29T11:21:59.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b8ad1700 1 -- start start 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b8ad1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b406a4c0 0x7ff5b406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b8ad1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5b40cf0e0 0x7ff5b40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b8ad1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b40cfa80 con 0x7ff5b40b1ae0 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b8ad1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b40d0ab0 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b8ad1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b406a9c0 con 0x7ff5b406a4c0 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5b40cf0e0 0x7ff5b40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b3fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5b40cf0e0 0x7ff5b40cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40716/0 (socket says 172.21.15.81:40716) 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b3fff700 1 -- 172.21.15.81:0/186047308 learned_addr learned my addr 172.21.15.81:0/186047308 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/186047308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b406a4c0 0x7ff5b406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b3fff700 1 -- 172.21.15.81:0/186047308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b406a4c0 msgr2=0x7ff5b406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/186047308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b406a4c0 0x7ff5b406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b3fff700 1 -- 172.21.15.81:0/186047308 >> v1:172.21.15.176:6789/0 conn(0x7ff5b40b1ae0 legacy=0x7ff5b40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b3fff700 1 -- 172.21.15.81:0/186047308 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b406aca0 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.446+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/186047308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40cf540 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009e50 tx=0x7ff5ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5742a620547c15b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b2ffd700 1 -- 172.21.15.81:0/186047308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00e070 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b2ffd700 1 -- 172.21.15.81:0/186047308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac00b9c0 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b2ffd700 1 -- 172.21.15.81:0/186047308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00bd70 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/186047308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 msgr2=0x7ff5b40cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/186047308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40cf540 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009e50 tx=0x7ff5ac00b330 comp rx=0 tx=0).stop 2023-11-29T11:21:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/186047308 shutdown_connections 2023-11-29T11:21:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/186047308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40cf540 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/186047308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b406a4c0 0x7ff5b406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/186047308 >> 172.21.15.81:0/186047308 conn(0x7ff5b409bbd0 msgr2=0x7ff5b40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/186047308 shutdown_connections 2023-11-29T11:21:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/186047308 wait complete. 2023-11-29T11:21:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 Processor -- start 2023-11-29T11:21:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.450+0000 7ff5b8ad1700 1 -- start start 2023-11-29T11:21:59.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b8ad1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b406a4c0 0x7ff5b415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b8ad1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b1ae0 0x7ff5b415d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b8ad1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b8ad1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b415e6c0 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b8ad1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41f1970 con 0x7ff5b406a4c0 2023-11-29T11:21:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b8ad1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b415de20 con 0x7ff5b40b1ae0 2023-11-29T11:21:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40722/0 (socket says 172.21.15.81:40722) 2023-11-29T11:21:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b37fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b406a4c0 0x7ff5b415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 -- 172.21.15.81:0/701866325 learned_addr learned my addr 172.21.15.81:0/701866325 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b1ae0 0x7ff5b415d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 -- 172.21.15.81:0/701866325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b1ae0 msgr2=0x7ff5b415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b1ae0 0x7ff5b415d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 -- 172.21.15.81:0/701866325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b406a4c0 msgr2=0x7ff5b415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b406a4c0 0x7ff5b415ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 -- 172.21.15.81:0/701866325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac009b30 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40b0460 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4066b70 tx=0x7ff5ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b0ff9700 1 -- 172.21.15.81:0/701866325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac004800 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b0ff9700 1 -- 172.21.15.81:0/701866325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0092e0 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/701866325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b40b4380 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b0ff9700 1 -- 172.21.15.81:0/701866325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac01c660 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.454+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/701866325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b406af80 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.458+0000 7ff5b0ff9700 1 -- 172.21.15.81:0/701866325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff5ac02c070 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.458+0000 7ff5b0ff9700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff594064ee0 0x7ff594067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.458+0000 7ff5b0ff9700 1 -- 172.21.15.81:0/701866325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7ff5ac083af0 con 0x7ff5b40cf0e0 2023-11-29T11:21:59.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.458+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff594064ee0 0x7ff594067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.458+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff594064ee0 0x7ff594067390 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000f60 tx=0x7ff5a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5bcfb3740 1 Processor -- start 2023-11-29T11:21:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5bcfb3740 1 -- start start 2023-11-29T11:21:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x13797d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1379d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x137a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1268d20 con 0x11448c0 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x12d8d60 con 0x10f9840 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x12d2060 con 0x10f9c10 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x137a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x137a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40730/0 (socket says 172.21.15.81:40730) 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2477579864 learned_addr learned my addr 172.21.15.81:0/2477579864 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1379d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x13797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 msgr2=0x13797d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x13797d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 msgr2=0x1379d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1379d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2477579864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12f80a0 con 0x11448c0 2023-11-29T11:21:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1379d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:21:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x137a250 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0555a0 tx=0x7ff5ac0555d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611631e0ebf1f839 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5a97fa700 1 -- 172.21.15.81:0/2477579864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac068ea0 con 0x11448c0 2023-11-29T11:21:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5a97fa700 1 -- 172.21.15.81:0/2477579864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac05d7f0 con 0x11448c0 2023-11-29T11:21:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.462+0000 7ff5a97fa700 1 -- 172.21.15.81:0/2477579864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac05b2d0 con 0x11448c0 2023-11-29T11:21:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2477579864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 msgr2=0x137a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x137a250 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0555a0 tx=0x7ff5ac0555d0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2477579864 shutdown_connections 2023-11-29T11:21:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x137a250 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1379d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2477579864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x13797d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2477579864 >> 172.21.15.81:0/2477579864 conn(0x10f9fe0 msgr2=0x1392b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2477579864 shutdown_connections 2023-11-29T11:21:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2477579864 wait complete. 2023-11-29T11:21:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- start start 2023-11-29T11:21:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 Processor -- start 2023-11-29T11:21:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10f9840 0x13b8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9c10 0x1367fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11448c0 0x13684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x117ec50 con 0x10f9840 2023-11-29T11:21:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x13b91b0 con 0x10f9c10 2023-11-29T11:21:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.466+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x13b9450 con 0x11448c0 2023-11-29T11:21:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 10 client.0 _ll_register_callbacks cb 0x12cb9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10f9840 0x13b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10f9840 0x13b8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40738/0 (socket says 172.21.15.81:40738) 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 -- 172.21.15.81:0/2340731549 learned_addr learned my addr 172.21.15.81:0/2340731549 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11448c0 0x13684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9c10 0x1367fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 -- 172.21.15.81:0/2340731549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11448c0 msgr2=0x13684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11448c0 0x13684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 -- 172.21.15.81:0/2340731549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9c10 msgr2=0x1367fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9c10 0x1367fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 -- 172.21.15.81:0/2340731549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b406af80 con 0x10f9840 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10f9840 0x13b8980 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40144f0 tx=0x7ff5a4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff27629ce8f0f28 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 1 -- 172.21.15.81:0/2340731549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4014b40 con 0x10f9840 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2340731549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x12cb0e0 con 0x10f9840 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 1 -- 172.21.15.81:0/2340731549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7ff5a401c040 con 0x10f9840 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 1 -- 172.21.15.81:0/2340731549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5a4014ca0 con 0x10f9840 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 10 client.8754 fetch_fsmap learned FSMap version 66 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2340731549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x1145b10 con 0x10f9840 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 1 -- 172.21.15.81:0/2340731549 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x12cb0e0 con 0x10f9840 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 1 -- 172.21.15.81:0/2340731549 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7ff5a402a3f0 con 0x10f9840 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 10 client.8754 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 10 client.8754 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 20 client.8754 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x1368fa0 0x13c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 4 client.8754 mds_command: new command op to 8610 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:21:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2340731549 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x12cae00 con 0x1368fa0 2023-11-29T11:21:59.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x1368fa0 0x13c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x1368fa0 0x13c2cb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdf72b6f64af6cc7 server_cookie=a3091b33c98febcf in_seq=0 out_seq=0 2023-11-29T11:21:59.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 10 client.8754 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:59.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 1 -- 172.21.15.81:0/2340731549 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x12cae00 con 0x1368fa0 2023-11-29T11:21:59.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 10 client.8754 handle_command_reply: tid=0 2023-11-29T11:21:59.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 client.8754 shutdown 2023-11-29T11:21:59.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2340731549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10f9840 msgr2=0x13b8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10f9840 0x13b8980 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40144f0 tx=0x7ff5a4001120 comp rx=0 tx=0).stop 2023-11-29T11:21:59.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2340731549 shutdown_connections 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x1368fa0 0x13c2cb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x11448c0 0x13684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5927fc700 0 client.8754 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9c10 0x1367fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2340731549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x10f9840 0x13b8980 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.470+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2340731549 >> 172.21.15.81:0/2340731549 conn(0x10f9fe0 msgr2=0x137a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.474+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2340731549 shutdown_connections 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.474+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2340731549 wait complete. 2023-11-29T11:21:59.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.474+0000 7ff5bcfb3740 20 client.8754 trim_cache size 0 max 16384 2023-11-29T11:21:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 Processor -- start 2023-11-29T11:21:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- start start 2023-11-29T11:21:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1392ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x1393220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13bb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1268200 con 0x11448c0 2023-11-29T11:21:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x127e310 con 0x10f9840 2023-11-29T11:21:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x12a1ba0 con 0x10f9c10 2023-11-29T11:21:59.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13bb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40754/0 (socket says 172.21.15.81:40754) 2023-11-29T11:21:59.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 -- 172.21.15.81:0/1451161433 learned_addr learned my addr 172.21.15.81:0/1451161433 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:59.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x1393220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1392ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 -- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 msgr2=0x1393220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x1393220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 -- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 msgr2=0x1392ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1392ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 -- 172.21.15.81:0/1451161433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1368900 con 0x11448c0 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x1393220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13bb910 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac053ab0 tx=0x7ff5ac05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48a0969d2babd05 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/1451161433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac053b00 con 0x11448c0 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/1451161433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac05b0d0 con 0x11448c0 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/1451161433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac023c30 con 0x11448c0 2023-11-29T11:21:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/1451161433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 msgr2=0x13bb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13bb910 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac053ab0 tx=0x7ff5ac05b000 comp rx=0 tx=0).stop 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/1451161433 shutdown_connections 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13bb910 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x1393220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/1451161433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x1392ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/1451161433 >> 172.21.15.81:0/1451161433 conn(0x10f9fe0 msgr2=0x13b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/1451161433 shutdown_connections 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.494+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/1451161433 wait complete. 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 -- start start 2023-11-29T11:21:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 Processor -- start 2023-11-29T11:21:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x13bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x140ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1268d20 con 0x11448c0 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x13b5a10 con 0x10f9840 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x13b2880 con 0x10f9c10 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 10 client.0 _ll_register_callbacks cb 0x7ff5ac0099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40758/0 (socket says 172.21.15.81:40758) 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2826307386 learned_addr learned my addr 172.21.15.81:0/2826307386 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x140ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x13bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 msgr2=0x140ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x140ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 msgr2=0x13bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x13bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 -- 172.21.15.81:0/2826307386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x12f80a0 con 0x11448c0 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x140ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x13bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b3fff700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13b3260 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac051c60 tx=0x7ff5ac058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffae70c62c2f40a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5927fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5927fc700 1 -- 172.21.15.81:0/2826307386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac053b00 con 0x11448c0 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2826307386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5ac05d7f0 con 0x11448c0 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5927fc700 1 -- 172.21.15.81:0/2826307386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7ff5ac054e60 con 0x11448c0 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5927fc700 1 -- 172.21.15.81:0/2826307386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5ac05d360 con 0x11448c0 2023-11-29T11:21:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 10 client.8760 fetch_fsmap learned FSMap version 66 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2826307386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x1298970 con 0x11448c0 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5927fc700 1 -- 172.21.15.81:0/2826307386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac05d7f0 con 0x11448c0 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5927fc700 1 -- 172.21.15.81:0/2826307386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7ff5ac056af0 con 0x11448c0 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 10 client.8760 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 10 client.8760 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 20 client.8760 populate_metadata read hostname 'smithi081' 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x13b5040 0x13b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 4 client.8760 mds_command: new command op to 8610 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2826307386 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1176390 con 0x13b5040 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x13b5040 0x13b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5927fc700 10 client.8760 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.498+0000 7ff5b37fe700 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x13b5040 0x13b5410 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5817f7933a9f6c19 server_cookie=50dea3a0ce180917 in_seq=0 out_seq=0 2023-11-29T11:21:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5927fc700 1 -- 172.21.15.81:0/2826307386 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1176390 con 0x13b5040 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5927fc700 10 client.8760 handle_command_reply: tid=0 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 client.8760 shutdown 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2826307386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 msgr2=0x13b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13b3260 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac051c60 tx=0x7ff5ac058040 comp rx=0 tx=0).stop 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2826307386 shutdown_connections 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x13b5040 0x13b5410 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11448c0 0x13b3260 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5927fc700 0 client.8760 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x10f9c10 0x140ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 --2- 172.21.15.81:0/2826307386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x10f9840 0x13bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2826307386 >> 172.21.15.81:0/2826307386 conn(0x10f9fe0 msgr2=0x1391cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2826307386 shutdown_connections 2023-11-29T11:21:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 1 -- 172.21.15.81:0/2826307386 wait complete. 2023-11-29T11:21:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5bcfb3740 20 client.8760 trim_cache size 0 max 16384 2023-11-29T11:21:59.512 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:21:59.512 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:21:59.512 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:21:59.512 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:21:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff594064ee0 msgr2=0x7ff594067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff594064ee0 0x7ff594067390 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000f60 tx=0x7ff5a4009040 comp rx=0 tx=0).stop 2023-11-29T11:21:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 msgr2=0x7ff5b40b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40b0460 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4066b70 tx=0x7ff5ac004af0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/701866325 shutdown_connections 2023-11-29T11:21:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff594064ee0 0x7ff594067390 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b40cf0e0 0x7ff5b40b0460 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5b40b1ae0 0x7ff5b415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 --2- 172.21.15.81:0/701866325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5b406a4c0 0x7ff5b415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/701866325 >> 172.21.15.81:0/701866325 conn(0x7ff5b409bbd0 msgr2=0x7ff5b40b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/701866325 shutdown_connections 2023-11-29T11:21:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.502+0000 7ff5b8ad1700 1 -- 172.21.15.81:0/701866325 wait complete. 2023-11-29T11:21:59.523 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:21:59.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:21:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.634+0000 7f0a23292700 1 Processor -- start 2023-11-29T11:21:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.634+0000 7f0a23292700 1 -- start start 2023-11-29T11:21:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.634+0000 7f0a23292700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0a1c158e60 0x7f0a1c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.634+0000 7f0a23292700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.634+0000 7f0a23292700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c0cd8f0 con 0x7f0a1c0cad50 2023-11-29T11:21:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.634+0000 7f0a23292700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c0add00 con 0x7f0a1c158e60 2023-11-29T11:21:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.634+0000 7f0a23292700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0cc4f0 con 0x7f0a1c0ad490 2023-11-29T11:21:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a22290700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0a1c158e60 0x7f0a1c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a21a8f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a22a91700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f0a1c0cad50 0x7f0a1c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:44214/0 (socket says 172.21.15.81:44214) 2023-11-29T11:21:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a22a91700 1 -- 172.21.15.81:0/2373983444 learned_addr learned my addr 172.21.15.81:0/2373983444 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:21:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a21a8f700 1 -- 172.21.15.81:0/2373983444 >> v2:172.21.15.176:3300/0 conn(0x7f0a1c158e60 msgr2=0x7f0a1c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:21:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a21a8f700 1 --2- 172.21.15.81:0/2373983444 >> v2:172.21.15.176:3300/0 conn(0x7f0a1c158e60 0x7f0a1c0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a21a8f700 1 -- 172.21.15.81:0/2373983444 >> v1:172.21.15.176:6789/0 conn(0x7f0a1c0cad50 legacy=0x7f0a1c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a2128e700 1 -- 172.21.15.81:0/2373983444 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366110924 0 0) 0x7f0a1c0cd8f0 con 0x7f0a1c0cad50 2023-11-29T11:21:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a21a8f700 1 -- 172.21.15.81:0/2373983444 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c06dc60 con 0x7f0a1c0ad490 2023-11-29T11:21:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a22290700 1 --2- 172.21.15.81:0/2373983444 >> v2:172.21.15.176:3300/0 conn(0x7f0a1c158e60 0x7f0a1c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:21:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a21a8f700 1 --2- 172.21.15.81:0/2373983444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0cbfb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009dc0 tx=0x7f0a1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfecd6a76c513919 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a2128e700 1 -- 172.21.15.81:0/2373983444 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400e070 con 0x7f0a1c0ad490 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a2128e700 1 -- 172.21.15.81:0/2373983444 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1400bae0 con 0x7f0a1c0ad490 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a2128e700 1 -- 172.21.15.81:0/2373983444 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400be90 con 0x7f0a1c0ad490 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a23292700 1 -- 172.21.15.81:0/2373983444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 msgr2=0x7f0a1c0cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a23292700 1 --2- 172.21.15.81:0/2373983444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0cbfb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009dc0 tx=0x7f0a1400b330 comp rx=0 tx=0).stop 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a23292700 1 -- 172.21.15.81:0/2373983444 shutdown_connections 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a23292700 1 --2- 172.21.15.81:0/2373983444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0cbfb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a23292700 1 --2- 172.21.15.81:0/2373983444 >> v2:172.21.15.176:3300/0 conn(0x7f0a1c158e60 0x7f0a1c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a23292700 1 -- 172.21.15.81:0/2373983444 >> 172.21.15.81:0/2373983444 conn(0x7f0a1c0ce3e0 msgr2=0x7f0a1c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:59.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a23292700 1 -- 172.21.15.81:0/2373983444 shutdown_connections 2023-11-29T11:21:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.638+0000 7f0a23292700 1 -- 172.21.15.81:0/2373983444 wait complete. 2023-11-29T11:21:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 Processor -- start 2023-11-29T11:21:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 -- start start 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c0cad50 0x7f0a1c1f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c158e60 0x7f0a1c1f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c1f1270 con 0x7f0a1c158e60 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c62a0 con 0x7f0a1c0cad50 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c33c0 con 0x7f0a1c0ad490 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c158e60 0x7f0a1c1f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c158e60 0x7f0a1c1f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40762/0 (socket says 172.21.15.81:40762) 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 -- 172.21.15.81:0/1185578164 learned_addr learned my addr 172.21.15.81:0/1185578164 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:21:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a21a8f700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c0cad50 0x7f0a1c1f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22290700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 -- 172.21.15.81:0/1185578164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 msgr2=0x7f0a1c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 -- 172.21.15.81:0/1185578164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c0cad50 msgr2=0x7f0a1c1f07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c0cad50 0x7f0a1c1f07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 -- 172.21.15.81:0/1185578164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c00b750 con 0x7f0a1c158e60 2023-11-29T11:21:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a22a91700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c158e60 0x7f0a1c1f0d30 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800c520 tx=0x7f0a1800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a12ffd700 1 -- 172.21.15.81:0/1185578164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18004ca0 con 0x7f0a1c158e60 2023-11-29T11:21:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a12ffd700 1 -- 172.21.15.81:0/1185578164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a18004e20 con 0x7f0a1c158e60 2023-11-29T11:21:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a12ffd700 1 -- 172.21.15.81:0/1185578164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18007310 con 0x7f0a1c158e60 2023-11-29T11:21:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a14009a70 con 0x7f0a1c158e60 2023-11-29T11:21:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.642+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c159230 con 0x7f0a1c158e60 2023-11-29T11:21:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.646+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c0cde90 con 0x7f0a1c158e60 2023-11-29T11:21:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.646+0000 7f0a12ffd700 1 -- 172.21.15.81:0/1185578164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0a1801a020 con 0x7f0a1c158e60 2023-11-29T11:21:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.646+0000 7f0a12ffd700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a00064f10 0x7f0a000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:21:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.646+0000 7f0a22290700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a00064f10 0x7f0a000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:21:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.646+0000 7f0a12ffd700 1 -- 172.21.15.81:0/1185578164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f0a18081c40 con 0x7f0a1c158e60 2023-11-29T11:21:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.646+0000 7f0a22290700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a00064f10 0x7f0a000673c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0c1f10 tx=0x7f0a0c00b450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:21:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.654+0000 7f0a12ffd700 1 -- 172.21.15.81:0/1185578164 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0a1804faa0 con 0x7f0a1c158e60 2023-11-29T11:21:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.850+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a1c06d6a0 con 0x7f0a1c158e60 2023-11-29T11:21:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.850+0000 7f0a12ffd700 1 -- 172.21.15.81:0/1185578164 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f0a180530c0 con 0x7f0a1c158e60 2023-11-29T11:21:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:21:59.859 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:21:25.188265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8610":{"gid":8610,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/2322035611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2322035611},{"type":"v1","addr":"172.21.15.81:6837","nonce":2322035611}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:21:59.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a00064f10 msgr2=0x7f0a000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a00064f10 0x7f0a000673c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0c1f10 tx=0x7f0a0c00b450 comp rx=0 tx=0).stop 2023-11-29T11:21:59.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c158e60 msgr2=0x7f0a1c1f0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:21:59.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c158e60 0x7f0a1c1f0d30 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800c520 tx=0x7f0a1800c830 comp rx=0 tx=0).stop 2023-11-29T11:21:59.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 shutdown_connections 2023-11-29T11:21:59.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0a00064f10 0x7f0a000673c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a1c158e60 0x7f0a1c1f0d30 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a1c0cad50 0x7f0a1c1f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 --2- 172.21.15.81:0/1185578164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a1c0ad490 0x7f0a1c0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:21:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 >> 172.21.15.81:0/1185578164 conn(0x7f0a1c0ce3e0 msgr2=0x7f0a1c069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:21:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 shutdown_connections 2023-11-29T11:21:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.854+0000 7f0a23292700 1 -- 172.21.15.81:0/1185578164 wait complete. 2023-11-29T11:21:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-11-29T11:21:59.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-11-29T11:21:59.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.990+0000 7fcaa93c9700 1 Processor -- start 2023-11-29T11:21:59.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.990+0000 7fcaa93c9700 1 -- start start 2023-11-29T11:22:00.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcaa406a6e0 0x7fcaa406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cbaf0 0x7fcaa406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa415a3a0 con 0x7fcaa40cb5a0 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa406aff0 con 0x7fcaa406a6e0 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40ca430 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa8bc8700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcaa40cb5a0 0x7fcaa406e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40122/0 (socket says 172.21.15.81:40122) 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/2974388922 learned_addr learned my addr 172.21.15.81:0/2974388922 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/2974388922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cbaf0 0x7fcaa406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/2974388922 >> v2:172.21.15.176:3300/0 conn(0x7fcaa406a6e0 0x7fcaa406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa37fe700 1 -- 172.21.15.81:0/2974388922 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374363701 0 0) 0x7fca9c001490 con 0x7fcaa40cb5a0 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa37fe700 1 -- 172.21.15.81:0/2974388922 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca900035d0 con 0x7fcaa40cb5a0 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fca9b7fe700 1 -- 172.21.15.81:0/2974388922 >> v2:172.21.15.176:3300/0 conn(0x7fcaa406a6e0 msgr2=0x7fcaa406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/2974388922 >> v2:172.21.15.176:3300/0 conn(0x7fcaa406a6e0 0x7fcaa406aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fca9b7fe700 1 -- 172.21.15.81:0/2974388922 >> v1:172.21.15.81:6789/0 conn(0x7fcaa40cb5a0 legacy=0x7fcaa406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fca9b7fe700 1 -- 172.21.15.81:0/2974388922 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40ca710 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/2974388922 >> v2:172.21.15.176:3300/0 conn(0x7fcaa406a6e0 0x7fcaa406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:00.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/2974388922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cbaf0 0x7fcaa406e000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009840 tx=0x7fca8c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ece9d74e24e2d23 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa37fe700 1 -- 172.21.15.81:0/2974388922 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c005e50 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa37fe700 1 -- 172.21.15.81:0/2974388922 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c006030 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa37fe700 1 -- 172.21.15.81:0/2974388922 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0063c0 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 -- 172.21.15.81:0/2974388922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cbaf0 msgr2=0x7fcaa406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/2974388922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cbaf0 0x7fcaa406e000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009840 tx=0x7fca8c009b50 comp rx=0 tx=0).stop 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 -- 172.21.15.81:0/2974388922 shutdown_connections 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/2974388922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cbaf0 0x7fcaa406e000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/2974388922 >> v2:172.21.15.176:3300/0 conn(0x7fcaa406a6e0 0x7fcaa406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 -- 172.21.15.81:0/2974388922 >> 172.21.15.81:0/2974388922 conn(0x7fcaa40d0240 msgr2=0x7fcaa40cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 -- 172.21.15.81:0/2974388922 shutdown_connections 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.994+0000 7fcaa93c9700 1 -- 172.21.15.81:0/2974388922 wait complete. 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 Processor -- start 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 -- start start 2023-11-29T11:22:00.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaa406a6e0 0x7fcaa414d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cb5a0 0x7fcaa40b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa40cbaf0 0x7fcaa40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40cdd70 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40cd180 con 0x7fcaa406a6e0 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40cd3d0 con 0x7fcaa40cb5a0 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa40cbaf0 0x7fcaa40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa40cbaf0 0x7fcaa40b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53180/0 (socket says 172.21.15.81:53180) 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/970469986 learned_addr learned my addr 172.21.15.81:0/970469986 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaa406a6e0 0x7fcaa414d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cb5a0 0x7fcaa40b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cb5a0 msgr2=0x7fcaa40b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cb5a0 0x7fcaa40b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaa406a6e0 msgr2=0x7fcaa414d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaa406a6e0 0x7fcaa414d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/970469986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca940094b0 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaa406a6e0 0x7fcaa414d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa40cbaf0 0x7fcaa40b3d40 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00cae0 tx=0x7fca9c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa17fa700 1 -- 172.21.15.81:0/970469986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c00a7e0 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 -- 172.21.15.81:0/970469986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c009450 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa93c9700 1 -- 172.21.15.81:0/970469986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40cacd0 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa17fa700 1 -- 172.21.15.81:0/970469986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c001b70 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:21:59.998+0000 7fcaa17fa700 1 -- 172.21.15.81:0/970469986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c00ab40 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.002+0000 7fcaa17fa700 1 -- 172.21.15.81:0/970469986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fca9c019030 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.002+0000 7fcaa17fa700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fca84064ee0 0x7fca84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.002+0000 7fcaa17fa700 1 -- 172.21.15.81:0/970469986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fca9c0816b0 con 0x7fcaa40cbaf0 2023-11-29T11:22:00.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.002+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fca84064ee0 0x7fca84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.002+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fca84064ee0 0x7fca84067390 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fca94009d30 tx=0x7fca94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaad8ab740 1 Processor -- start 2023-11-29T11:22:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaad8ab740 1 -- start start 2023-11-29T11:22:00.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243d20 0x24fb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243950 0x24fd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228e9d0 0x24ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x23b2dc0 con 0x2243950 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2422e20 con 0x2243d20 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x241c120 con 0x228e9d0 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243950 0x24fd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243950 0x24fd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53190/0 (socket says 172.21.15.81:53190) 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fca9b7fe700 1 -- 172.21.15.81:0/2577306627 learned_addr learned my addr 172.21.15.81:0/2577306627 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243d20 0x24fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.006+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228e9d0 0x24ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 -- 172.21.15.81:0/2577306627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228e9d0 msgr2=0x24ffec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228e9d0 0x24ffec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 -- 172.21.15.81:0/2577306627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243d20 msgr2=0x24fb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243d20 0x24fb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 -- 172.21.15.81:0/2577306627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24429b0 con 0x2243950 2023-11-29T11:22:00.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243950 0x24fd970 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009ea0 tx=0x7fca8c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422fce519866a28c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca99ffb700 1 -- 172.21.15.81:0/2577306627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c004240 con 0x2243950 2023-11-29T11:22:00.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca99ffb700 1 -- 172.21.15.81:0/2577306627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c0043a0 con 0x2243950 2023-11-29T11:22:00.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca99ffb700 1 -- 172.21.15.81:0/2577306627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c005dd0 con 0x2243950 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- 172.21.15.81:0/2577306627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243950 msgr2=0x24fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243950 0x24fd970 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009ea0 tx=0x7fca8c010000 comp rx=0 tx=0).stop 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- 172.21.15.81:0/2577306627 shutdown_connections 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228e9d0 0x24ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243950 0x24fd970 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/2577306627 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243d20 0x24fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- 172.21.15.81:0/2577306627 >> 172.21.15.81:0/2577306627 conn(0x22440f0 msgr2=0x24dce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- 172.21.15.81:0/2577306627 shutdown_connections 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- 172.21.15.81:0/2577306627 wait complete. 2023-11-29T11:22:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- start start 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 Processor -- start 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243950 0x24d7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228e9d0 0x24f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x22c8d60 con 0x2243d20 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x24b5390 con 0x228e9d0 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x24df7d0 con 0x2243950 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaad8ab740 10 client.0 _ll_register_callbacks cb 0x2415a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaa8bc8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228e9d0 0x24f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24f65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53204/0 (socket says 172.21.15.81:53204) 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fca9b7fe700 1 -- 172.21.15.81:0/1575557440 learned_addr learned my addr 172.21.15.81:0/1575557440 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.010+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243950 0x24d7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca9b7fe700 1 -- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243950 msgr2=0x24d7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243950 0x24d7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca9b7fe700 1 -- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228e9d0 msgr2=0x24f6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228e9d0 0x24f6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca9b7fe700 1 -- 172.21.15.81:0/1575557440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40ca710 con 0x2243d20 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243950 0x24d7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228e9d0 0x24f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24f65f0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009fd0 tx=0x7fca8c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717f4cb97310d6c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 1 -- 172.21.15.81:0/1575557440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c02c070 con 0x2243d20 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1575557440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24151a0 con 0x2243d20 2023-11-29T11:22:00.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 1 -- 172.21.15.81:0/1575557440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fca8c006470 con 0x2243d20 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 1 -- 172.21.15.81:0/1575557440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca8c006630 con 0x2243d20 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 10 client.8775 fetch_fsmap learned FSMap version 66 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1575557440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x228fc20 con 0x2243d20 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 1 -- 172.21.15.81:0/1575557440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x24151a0 con 0x2243d20 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 1 -- 172.21.15.81:0/1575557440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fca8c006790 con 0x2243d20 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 10 client.8775 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 10 client.8775 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 20 client.8775 populate_metadata read hostname 'smithi081' 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x24abd90 0x24b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 4 client.8775 mds_command: new command op to 8610 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1575557440 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2414ec0 con 0x24abd90 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x24abd90 0x24b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x24abd90 0x24b4020 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca8e5e20e75578cd server_cookie=794a3f648de88535 in_seq=0 out_seq=0 2023-11-29T11:22:00.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 10 client.8775 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 1 -- 172.21.15.81:0/1575557440 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2414ec0 con 0x24abd90 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 10 client.8775 handle_command_reply: tid=0 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 client.8775 shutdown 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1575557440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 msgr2=0x24f65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24f65f0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009fd0 tx=0x7fca8c0047e0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1575557440 shutdown_connections 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x24abd90 0x24b4020 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228e9d0 0x24f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24f65f0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1575557440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243950 0x24d7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1575557440 >> 172.21.15.81:0/1575557440 conn(0x22440f0 msgr2=0x24dbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fca82ffd700 0 client.8775 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1575557440 shutdown_connections 2023-11-29T11:22:00.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1575557440 wait complete. 2023-11-29T11:22:00.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.014+0000 7fcaad8ab740 20 client.8775 trim_cache size 0 max 16384 2023-11-29T11:22:00.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 Processor -- start 2023-11-29T11:22:00.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 -- start start 2023-11-29T11:22:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22440f0 0x24b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x24b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x241afb0 con 0x2243d20 2023-11-29T11:22:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x24240b0 con 0x2243950 2023-11-29T11:22:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2417a90 con 0x22440f0 2023-11-29T11:22:00.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaa8bc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x24b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaa3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22440f0 0x24b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaa8bc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53218/0 (socket says 172.21.15.81:53218) 2023-11-29T11:22:00.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/3814625006 learned_addr learned my addr 172.21.15.81:0/3814625006 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9b7fe700 1 -- 172.21.15.81:0/3814625006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22440f0 msgr2=0x24b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/3814625006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22440f0 0x24b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9b7fe700 1 -- 172.21.15.81:0/3814625006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 msgr2=0x24b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/3814625006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9b7fe700 1 -- 172.21.15.81:0/3814625006 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23e2a10 con 0x2243950 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/3814625006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9b7fe700 1 --2- 172.21.15.81:0/3814625006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x24b1f30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fca8c026710 tx=0x7fca8c02c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f395caf010411eb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9a7fc700 1 -- 172.21.15.81:0/3814625006 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c005cd0 con 0x2243950 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9a7fc700 1 -- 172.21.15.81:0/3814625006 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c006470 con 0x2243950 2023-11-29T11:22:00.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fca9a7fc700 1 -- 172.21.15.81:0/3814625006 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c006820 con 0x2243950 2023-11-29T11:22:00.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 -- 172.21.15.81:0/3814625006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 msgr2=0x24b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.034+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/3814625006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x24b1f30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fca8c026710 tx=0x7fca8c02c000 comp rx=0 tx=0).stop 2023-11-29T11:22:00.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- 172.21.15.81:0/3814625006 shutdown_connections 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/3814625006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2243d20 0x24b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/3814625006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x24b1f30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/3814625006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22440f0 0x24b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- 172.21.15.81:0/3814625006 >> 172.21.15.81:0/3814625006 conn(0x24d8110 msgr2=0x2509a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- 172.21.15.81:0/3814625006 shutdown_connections 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- 172.21.15.81:0/3814625006 wait complete. 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- start start 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 Processor -- start 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x2559950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243d20 0x2559e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22440f0 0x25103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x250f910 con 0x22440f0 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x24d8580 con 0x2243950 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x255a3d0 con 0x2243d20 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 10 client.0 _ll_register_callbacks cb 0x7fca940090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22440f0 0x25103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fca9b7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243d20 0x2559e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22440f0 0x25103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53230/0 (socket says 172.21.15.81:53230) 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/1432410215 learned_addr learned my addr 172.21.15.81:0/1432410215 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x2559950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/1432410215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243d20 msgr2=0x2559e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243d20 0x2559e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/1432410215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 msgr2=0x2559950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x2559950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 -- 172.21.15.81:0/1432410215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40cacd0 con 0x22440f0 2023-11-29T11:22:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fca82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:22:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaa8bc8700 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22440f0 0x25103f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fca9c053210 tx=0x7fca9c05b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663db1241f7c5186 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fca82ffd700 1 -- 172.21.15.81:0/1432410215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c04f2d0 con 0x22440f0 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fca82ffd700 1 -- 172.21.15.81:0/1432410215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fca9c04f430 con 0x22440f0 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1432410215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24ddcf0 con 0x22440f0 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fca82ffd700 1 -- 172.21.15.81:0/1432410215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca9c052240 con 0x22440f0 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 10 client.8781 fetch_fsmap learned FSMap version 66 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1432410215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x228fc20 con 0x22440f0 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.038+0000 7fca82ffd700 1 -- 172.21.15.81:0/1432410215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x24ddcf0 con 0x22440f0 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fca82ffd700 1 -- 172.21.15.81:0/1432410215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fca9c0523a0 con 0x22440f0 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 10 client.8781 fetch_fsmap finished waiting for FSMap version 66 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 10 client.8781 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 20 client.8781 populate_metadata read hostname 'smithi081' 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x228e9d0 0x2510930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 4 client.8781 mds_command: new command op to 8610 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1432410215 --> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x7fca8c0043a0 con 0x228e9d0 2023-11-29T11:22:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x228e9d0 0x2510930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fca82ffd700 10 client.8781 ms_handle_connect on v2:172.21.15.81:6836/2322035611 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa3fff700 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x228e9d0 0x2510930 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12361a44f3153b47 server_cookie=cfadcc81f82519 in_seq=0 out_seq=0 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fca82ffd700 1 -- 172.21.15.81:0/1432410215 <== mds.0 v2:172.21.15.81:6836/2322035611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fca8c0043a0 con 0x228e9d0 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fca82ffd700 10 client.8781 handle_command_reply: tid=0 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 client.8781 shutdown 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1432410215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22440f0 msgr2=0x25103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22440f0 0x25103f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fca9c053210 tx=0x7fca9c05b4b0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1432410215 shutdown_connections 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.81:6836/2322035611,v1:172.21.15.81:6837/2322035611] conn(0x228e9d0 0x2510930 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22440f0 0x25103f0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fca82ffd700 0 client.8781 ms_handle_reset on v2:172.21.15.81:6836/2322035611 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x2243d20 0x2559e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 --2- 172.21.15.81:0/1432410215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x2243950 0x2559950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1432410215 >> 172.21.15.81:0/1432410215 conn(0x24d8110 msgr2=0x24b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1432410215 shutdown_connections 2023-11-29T11:22:00.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 1 -- 172.21.15.81:0/1432410215 wait complete. 2023-11-29T11:22:00.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaad8ab740 20 client.8781 trim_cache size 0 max 16384 2023-11-29T11:22:00.053 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:00.053 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2023-11-29T11:22:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 -- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fca84064ee0 msgr2=0x7fca84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fca84064ee0 0x7fca84067390 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fca94009d30 tx=0x7fca94008040 comp rx=0 tx=0).stop 2023-11-29T11:22:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 -- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa40cbaf0 msgr2=0x7fcaa40b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa40cbaf0 0x7fcaa40b3d40 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00cae0 tx=0x7fca9c00cbc0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 -- 172.21.15.81:0/970469986 shutdown_connections 2023-11-29T11:22:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fca84064ee0 0x7fca84067390 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa40cbaf0 0x7fcaa40b3d40 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaa40cb5a0 0x7fcaa40b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 --2- 172.21.15.81:0/970469986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaa406a6e0 0x7fcaa414d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 -- 172.21.15.81:0/970469986 >> 172.21.15.81:0/970469986 conn(0x7fcaa40d0240 msgr2=0x7fcaa40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 -- 172.21.15.81:0/970469986 shutdown_connections 2023-11-29T11:22:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.042+0000 7fcaa93c9700 1 -- 172.21.15.81:0/970469986 wait complete. 2023-11-29T11:22:00.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-29T11:22:00.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf1927e700 1 Processor -- start 2023-11-29T11:22:00.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf1927e700 1 -- start start 2023-11-29T11:22:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf1927e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf1415d650 0x7fdf140ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf1927e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf14159c00 0x7fdf140cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf1927e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf140cc9b0 con 0x7fdf140cc020 2023-11-29T11:22:00.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf1927e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1415a040 con 0x7fdf1415d650 2023-11-29T11:22:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf1927e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf140cd720 con 0x7fdf14159c00 2023-11-29T11:22:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf13fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf1415d650 0x7fdf140ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf13fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf1415d650 0x7fdf140ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53244/0 (socket says 172.21.15.81:53244) 2023-11-29T11:22:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf13fff700 1 -- 172.21.15.81:0/1502385761 learned_addr learned my addr 172.21.15.81:0/1502385761 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.178+0000 7fdf18a7d700 1 --2- 172.21.15.81:0/1502385761 >> v2:172.21.15.176:3300/0 conn(0x7fdf14159c00 0x7fdf140cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf13fff700 1 -- 172.21.15.81:0/1502385761 >> v2:172.21.15.176:3300/0 conn(0x7fdf14159c00 msgr2=0x7fdf140cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf13fff700 1 --2- 172.21.15.81:0/1502385761 >> v2:172.21.15.176:3300/0 conn(0x7fdf14159c00 0x7fdf140cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf13fff700 1 -- 172.21.15.81:0/1502385761 >> v1:172.21.15.176:6789/0 conn(0x7fdf140cc020 legacy=0x7fdf141594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf13fff700 1 -- 172.21.15.81:0/1502385761 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140cd990 con 0x7fdf1415d650 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf13fff700 1 --2- 172.21.15.81:0/1502385761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1415d650 0x7fdf140ce470 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fdf140af100 tx=0x7fdf04009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aa97f86316e0eb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf12ffd700 1 -- 172.21.15.81:0/1502385761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400b8a0 con 0x7fdf1415d650 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf12ffd700 1 -- 172.21.15.81:0/1502385761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0400ba00 con 0x7fdf1415d650 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf12ffd700 1 -- 172.21.15.81:0/1502385761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400bd90 con 0x7fdf1415d650 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf1927e700 1 -- 172.21.15.81:0/1502385761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1415d650 msgr2=0x7fdf140ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf1927e700 1 --2- 172.21.15.81:0/1502385761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1415d650 0x7fdf140ce470 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fdf140af100 tx=0x7fdf04009bf0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf1927e700 1 -- 172.21.15.81:0/1502385761 shutdown_connections 2023-11-29T11:22:00.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf1927e700 1 --2- 172.21.15.81:0/1502385761 >> v2:172.21.15.176:3300/0 conn(0x7fdf14159c00 0x7fdf140cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf1927e700 1 --2- 172.21.15.81:0/1502385761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1415d650 0x7fdf140ce470 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf1927e700 1 -- 172.21.15.81:0/1502385761 >> 172.21.15.81:0/1502385761 conn(0x7fdf1406ec40 msgr2=0x7fdf140b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf1927e700 1 -- 172.21.15.81:0/1502385761 shutdown_connections 2023-11-29T11:22:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.182+0000 7fdf1927e700 1 -- 172.21.15.81:0/1502385761 wait complete. 2023-11-29T11:22:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf1927e700 1 Processor -- start 2023-11-29T11:22:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf1927e700 1 -- start start 2023-11-29T11:22:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf1927e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf140cc020 0x7fdf140c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf1927e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf14159c00 0x7fdf140b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf1927e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1415d650 0x7fdf140b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf1927e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140c3350 con 0x7fdf14159c00 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf1927e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140b4cb0 con 0x7fdf1415d650 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf1927e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140b4f90 con 0x7fdf140cc020 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf137fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf14159c00 0x7fdf140b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf137fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf14159c00 0x7fdf140b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53250/0 (socket says 172.21.15.81:53250) 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf137fe700 1 -- 172.21.15.81:0/3056214279 learned_addr learned my addr 172.21.15.81:0/3056214279 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf13fff700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf140cc020 0x7fdf140c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf18a7d700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1415d650 0x7fdf140b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf13fff700 1 -- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1415d650 msgr2=0x7fdf140b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf13fff700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1415d650 0x7fdf140b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf13fff700 1 -- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf14159c00 msgr2=0x7fdf140b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf13fff700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf14159c00 0x7fdf140b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf13fff700 1 -- 172.21.15.81:0/3056214279 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04009570 con 0x7fdf140cc020 2023-11-29T11:22:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.186+0000 7fdf137fe700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf14159c00 0x7fdf140b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf13fff700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf140cc020 0x7fdf140c5cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdf04016000 tx=0x7fdf04004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf10ff9700 1 -- 172.21.15.81:0/3056214279 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040038c0 con 0x7fdf140cc020 2023-11-29T11:22:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf10ff9700 1 -- 172.21.15.81:0/3056214279 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0401e070 con 0x7fdf140cc020 2023-11-29T11:22:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf140cdf50 con 0x7fdf140cc020 2023-11-29T11:22:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf10ff9700 1 -- 172.21.15.81:0/3056214279 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04003c60 con 0x7fdf140cc020 2023-11-29T11:22:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf140cdc70 con 0x7fdf140cc020 2023-11-29T11:22:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1415a250 con 0x7fdf140cc020 2023-11-29T11:22:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf10ff9700 1 -- 172.21.15.81:0/3056214279 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdf0400f050 con 0x7fdf140cc020 2023-11-29T11:22:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.190+0000 7fdf10ff9700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdef4064ee0 0x7fdef4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.194+0000 7fdf10ff9700 1 -- 172.21.15.81:0/3056214279 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fdf04020070 con 0x7fdf140cc020 2023-11-29T11:22:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.194+0000 7fdf137fe700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdef4064ee0 0x7fdef4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.194+0000 7fdf137fe700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdef4064ee0 0x7fdef4067390 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdf1414e8e0 tx=0x7fdefc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.202+0000 7fdf10ff9700 1 -- 172.21.15.81:0/3056214279 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdf04051650 con 0x7fdf140cc020 2023-11-29T11:22:00.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.398+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdf140b54b0 con 0x7fdf140cc020 2023-11-29T11:22:00.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.398+0000 7fdf10ff9700 1 -- 172.21.15.81:0/3056214279 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdf140b54b0 con 0x7fdf140cc020 2023-11-29T11:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdef4064ee0 msgr2=0x7fdef4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdef4064ee0 0x7fdef4067390 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdf1414e8e0 tx=0x7fdefc009040 comp rx=0 tx=0).stop 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf140cc020 msgr2=0x7fdf140c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf140cc020 0x7fdf140c5cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdf04016000 tx=0x7fdf04004770 comp rx=0 tx=0).stop 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 shutdown_connections 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdef4064ee0 0x7fdef4067390 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1415d650 0x7fdf140b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf14159c00 0x7fdf140b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 --2- 172.21.15.81:0/3056214279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf140cc020 0x7fdf140c5cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 >> 172.21.15.81:0/3056214279 conn(0x7fdf1406ec40 msgr2=0x7fdf140cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 shutdown_connections 2023-11-29T11:22:00.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.402+0000 7fdf1927e700 1 -- 172.21.15.81:0/3056214279 wait complete. 2023-11-29T11:22:00.419 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-29T11:22:00.419 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:22:00.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:22:00.434 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:22:00.454 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:22:00.455 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:00.455 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:00.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.610+0000 7f98616d4700 1 Processor -- start 2023-11-29T11:22:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.610+0000 7f98616d4700 1 -- start start 2023-11-29T11:22:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c1606b0 0x7f985c0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c164e60 con 0x7f985c0ad610 2023-11-29T11:22:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c0cae70 con 0x7f985c0ceef0 2023-11-29T11:22:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0cbc10 con 0x7f985c1606b0 2023-11-29T11:22:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f9860ed3700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f985c0ad610 0x7f985c164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40124/0 (socket says 172.21.15.81:40124) 2023-11-29T11:22:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f9860ed3700 1 -- 172.21.15.81:0/4021242593 learned_addr learned my addr 172.21.15.81:0/4021242593 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:00.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985bfff700 1 --2- 172.21.15.81:0/4021242593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c1606b0 0x7f985c0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985affd700 1 -- 172.21.15.81:0/4021242593 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621747172 0 0) 0x7f985c164e60 con 0x7f985c0ad610 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985affd700 1 -- 172.21.15.81:0/4021242593 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98440035d0 con 0x7f985c0ad610 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985affd700 1 -- 172.21.15.81:0/4021242593 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382855720 0 0) 0x7f985c0cae70 con 0x7f985c0ceef0 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985affd700 1 -- 172.21.15.81:0/4021242593 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f985c164e60 con 0x7f985c0ceef0 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985bfff700 1 -- 172.21.15.81:0/4021242593 >> v1:172.21.15.176:6789/0 conn(0x7f985c0ceef0 legacy=0x7f985c164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985bfff700 1 -- 172.21.15.81:0/4021242593 >> v1:172.21.15.81:6789/0 conn(0x7f985c0ad610 legacy=0x7f985c164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985bfff700 1 -- 172.21.15.81:0/4021242593 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0cb130 con 0x7f985c1606b0 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985bfff700 1 --2- 172.21.15.81:0/4021242593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c1606b0 0x7f985c0c13b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9850009880 tx=0x7f9850009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85458a891c007ad9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985affd700 1 -- 172.21.15.81:0/4021242593 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850011830 con 0x7f985c1606b0 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985affd700 1 -- 172.21.15.81:0/4021242593 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9850011990 con 0x7f985c1606b0 2023-11-29T11:22:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f985affd700 1 -- 172.21.15.81:0/4021242593 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850011d00 con 0x7f985c1606b0 2023-11-29T11:22:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 -- 172.21.15.81:0/4021242593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c1606b0 msgr2=0x7f985c0c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 --2- 172.21.15.81:0/4021242593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c1606b0 0x7f985c0c13b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9850009880 tx=0x7f9850009b90 comp rx=0 tx=0).stop 2023-11-29T11:22:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 -- 172.21.15.81:0/4021242593 shutdown_connections 2023-11-29T11:22:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 --2- 172.21.15.81:0/4021242593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c1606b0 0x7f985c0c13b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 -- 172.21.15.81:0/4021242593 >> 172.21.15.81:0/4021242593 conn(0x7f985c0ce3e0 msgr2=0x7f985c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 -- 172.21.15.81:0/4021242593 shutdown_connections 2023-11-29T11:22:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.614+0000 7f98616d4700 1 -- 172.21.15.81:0/4021242593 wait complete. 2023-11-29T11:22:00.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 Processor -- start 2023-11-29T11:22:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 -- start start 2023-11-29T11:22:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ad610 0x7f985c09b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c0ceef0 0x7f985c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c1606b0 0x7f985c15f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0c2e00 con 0x7f985c1606b0 2023-11-29T11:22:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c09bea0 con 0x7f985c0ceef0 2023-11-29T11:22:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0c1f10 con 0x7f985c0ad610 2023-11-29T11:22:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c1606b0 0x7f985c15f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c1606b0 0x7f985c15f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53260/0 (socket says 172.21.15.81:53260) 2023-11-29T11:22:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 -- 172.21.15.81:0/2331597254 learned_addr learned my addr 172.21.15.81:0/2331597254 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f985bfff700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ad610 0x7f985c09b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f985b7fe700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c0ceef0 0x7f985c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 -- 172.21.15.81:0/2331597254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ad610 msgr2=0x7f985c09b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ad610 0x7f985c09b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 -- 172.21.15.81:0/2331597254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c0ceef0 msgr2=0x7f985c15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c0ceef0 0x7f985c15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 -- 172.21.15.81:0/2331597254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98500094b0 con 0x7f985c1606b0 2023-11-29T11:22:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9860ed3700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c1606b0 0x7f985c15f6e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f985400caf0 tx=0x7f985400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9858ff9700 1 -- 172.21.15.81:0/2331597254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854007480 con 0x7f985c1606b0 2023-11-29T11:22:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c0cb6f0 con 0x7f985c1606b0 2023-11-29T11:22:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.618+0000 7f9858ff9700 1 -- 172.21.15.81:0/2331597254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98540075e0 con 0x7f985c1606b0 2023-11-29T11:22:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.622+0000 7f9858ff9700 1 -- 172.21.15.81:0/2331597254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854007970 con 0x7f985c1606b0 2023-11-29T11:22:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.622+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c0cb410 con 0x7f985c1606b0 2023-11-29T11:22:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.622+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c06ac50 con 0x7f985c1606b0 2023-11-29T11:22:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.622+0000 7f9858ff9700 1 -- 172.21.15.81:0/2331597254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9854019030 con 0x7f985c1606b0 2023-11-29T11:22:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.622+0000 7f9858ff9700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9848064ee0 0x7f9848067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.622+0000 7f985bfff700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9848064ee0 0x7f9848067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.622+0000 7f9858ff9700 1 -- 172.21.15.81:0/2331597254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f98540818c0 con 0x7f985c1606b0 2023-11-29T11:22:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.626+0000 7f985bfff700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9848064ee0 0x7f9848067390 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f98500090b0 tx=0x7f9850010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.630+0000 7f9858ff9700 1 -- 172.21.15.81:0/2331597254 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f985404f7f0 con 0x7f985c1606b0 2023-11-29T11:22:00.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.790+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f985c09c340 con 0x7f985c1606b0 2023-11-29T11:22:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f9858ff9700 1 -- 172.21.15.81:0/2331597254 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18228 (secure 0 0 0) 0x7f9854052e10 con 0x7f985c1606b0 2023-11-29T11:22:00.800 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:00.801 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":98,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:21:20.356075+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/353227086":"2023-11-30T11:21:20.356024+0000","172.21.15.81:6836/353227086":"2023-11-30T11:21:20.356024+0000","172.21.15.176:6833/1691706444":"2023-11-30T11:19:58.895424+0000","172.21.15.176:6832/1691706444":"2023-11-30T11:19:58.895424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9848064ee0 msgr2=0x7f9848067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9848064ee0 0x7f9848067390 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f98500090b0 tx=0x7f9850010000 comp rx=0 tx=0).stop 2023-11-29T11:22:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c1606b0 msgr2=0x7f985c15f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c1606b0 0x7f985c15f6e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f985400caf0 tx=0x7f985400cb20 comp rx=0 tx=0).stop 2023-11-29T11:22:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 shutdown_connections 2023-11-29T11:22:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9848064ee0 0x7f9848067390 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c1606b0 0x7f985c15f6e0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c0ceef0 0x7f985c15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 --2- 172.21.15.81:0/2331597254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ad610 0x7f985c09b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 >> 172.21.15.81:0/2331597254 conn(0x7f985c0ce3e0 msgr2=0x7f985c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 shutdown_connections 2023-11-29T11:22:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.794+0000 7f98616d4700 1 -- 172.21.15.81:0/2331597254 wait complete. 2023-11-29T11:22:00.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:19:38.262251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:19:38.644298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:22:00.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:22:00.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77daa62700 1 Processor -- start 2023-11-29T11:22:00.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77daa62700 1 -- start start 2023-11-29T11:22:00.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77daa62700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f77d406a4c0 0x7f77d406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77daa62700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d406a9c0 con 0x7f77d40cf0e0 2023-11-29T11:22:00.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77daa62700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d406aca0 con 0x7f77d40b1ae0 2023-11-29T11:22:00.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77daa62700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d40d0ab0 con 0x7f77d406a4c0 2023-11-29T11:22:00.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77da261700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f77d40cf0e0 0x7f77d40cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40132/0 (socket says 172.21.15.81:40132) 2023-11-29T11:22:00.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77da261700 1 -- 172.21.15.81:0/3183586781 learned_addr learned my addr 172.21.15.81:0/3183586781 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:00.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77d925f700 1 --2- 172.21.15.81:0/3183586781 >> v2:172.21.15.176:3300/0 conn(0x7f77d406a4c0 0x7f77d406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77d8a5e700 1 -- 172.21.15.81:0/3183586781 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877600414 0 0) 0x7f77d406a9c0 con 0x7f77d40cf0e0 2023-11-29T11:22:00.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77d8a5e700 1 -- 172.21.15.81:0/3183586781 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c00035d0 con 0x7f77d40cf0e0 2023-11-29T11:22:00.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77d925f700 1 -- 172.21.15.81:0/3183586781 >> v1:172.21.15.176:6789/0 conn(0x7f77d40b1ae0 legacy=0x7f77d40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77d925f700 1 -- 172.21.15.81:0/3183586781 >> v1:172.21.15.81:6789/0 conn(0x7f77d40cf0e0 legacy=0x7f77d40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77d925f700 1 -- 172.21.15.81:0/3183586781 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d406af80 con 0x7f77d406a4c0 2023-11-29T11:22:00.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.926+0000 7f77d925f700 1 --2- 172.21.15.81:0/3183586781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 0x7f77d406d8e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009850 tx=0x7f77c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=791d573b06202c88 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77d8a5e700 1 -- 172.21.15.81:0/3183586781 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4011830 con 0x7f77d406a4c0 2023-11-29T11:22:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77d8a5e700 1 -- 172.21.15.81:0/3183586781 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c4011990 con 0x7f77d406a4c0 2023-11-29T11:22:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77d8a5e700 1 -- 172.21.15.81:0/3183586781 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4011d40 con 0x7f77d406a4c0 2023-11-29T11:22:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 -- 172.21.15.81:0/3183586781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 msgr2=0x7f77d406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 --2- 172.21.15.81:0/3183586781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 0x7f77d406d8e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009850 tx=0x7f77c4009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 -- 172.21.15.81:0/3183586781 shutdown_connections 2023-11-29T11:22:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 --2- 172.21.15.81:0/3183586781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 0x7f77d406d8e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 -- 172.21.15.81:0/3183586781 >> 172.21.15.81:0/3183586781 conn(0x7f77d409bbd0 msgr2=0x7f77d40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:00.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 -- 172.21.15.81:0/3183586781 shutdown_connections 2023-11-29T11:22:00.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 -- 172.21.15.81:0/3183586781 wait complete. 2023-11-29T11:22:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 Processor -- start 2023-11-29T11:22:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.930+0000 7f77daa62700 1 -- start start 2023-11-29T11:22:00.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77daa62700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 0x7f77d40c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77daa62700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d40b1ae0 0x7f77d4155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77daa62700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77d40cf0e0 0x7f77d415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77daa62700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4156cc0 con 0x7f77d40cf0e0 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77daa62700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4156e30 con 0x7f77d406a4c0 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77daa62700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4156400 con 0x7f77d40b1ae0 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77d40cf0e0 0x7f77d415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77d40cf0e0 0x7f77d415d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53272/0 (socket says 172.21.15.81:53272) 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 -- 172.21.15.81:0/271737684 learned_addr learned my addr 172.21.15.81:0/271737684 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77d9a60700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 0x7f77d40c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77d925f700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d40b1ae0 0x7f77d4155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 -- 172.21.15.81:0/271737684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d40b1ae0 msgr2=0x7f77d4155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d40b1ae0 0x7f77d4155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 -- 172.21.15.81:0/271737684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 msgr2=0x7f77d40c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:00.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 0x7f77d40c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:00.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 -- 172.21.15.81:0/271737684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40094b0 con 0x7f77d40cf0e0 2023-11-29T11:22:00.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77da261700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77d40cf0e0 0x7f77d415d7e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00cb40 tx=0x7f77cc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77ca7fc700 1 -- 172.21.15.81:0/271737684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc007500 con 0x7f77d40cf0e0 2023-11-29T11:22:00.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77ca7fc700 1 -- 172.21.15.81:0/271737684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc007660 con 0x7f77d40cf0e0 2023-11-29T11:22:00.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d40b1eb0 con 0x7f77d40cf0e0 2023-11-29T11:22:00.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77ca7fc700 1 -- 172.21.15.81:0/271737684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0079f0 con 0x7f77d40cf0e0 2023-11-29T11:22:00.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.934+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d40b4380 con 0x7f77d40cf0e0 2023-11-29T11:22:00.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.938+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d40b60e0 con 0x7f77d40cf0e0 2023-11-29T11:22:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.938+0000 7f77ca7fc700 1 -- 172.21.15.81:0/271737684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f77cc019030 con 0x7f77d40cf0e0 2023-11-29T11:22:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.938+0000 7f77ca7fc700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77b8064ee0 0x7f77b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.938+0000 7f77ca7fc700 1 -- 172.21.15.81:0/271737684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f77cc081990 con 0x7f77d40cf0e0 2023-11-29T11:22:00.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.938+0000 7f77d9a60700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77b8064ee0 0x7f77b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:00.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.938+0000 7f77d9a60700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77b8064ee0 0x7f77b8067390 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000f60 tx=0x7f77d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:00.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:00.942+0000 7f77ca7fc700 1 -- 172.21.15.81:0/271737684 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f77cc04f8c0 con 0x7f77d40cf0e0 2023-11-29T11:22:01.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.102+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f77d4156fa0 con 0x7f77d40cf0e0 2023-11-29T11:22:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77ca7fc700 1 -- 172.21.15.81:0/271737684 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f77cc017020 con 0x7f77d40cf0e0 2023-11-29T11:22:01.111 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77b8064ee0 msgr2=0x7f77b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77b8064ee0 0x7f77b8067390 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000f60 tx=0x7f77d0009040 comp rx=0 tx=0).stop 2023-11-29T11:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77d40cf0e0 msgr2=0x7f77d415d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77d40cf0e0 0x7f77d415d7e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00cb40 tx=0x7f77cc00cb70 comp rx=0 tx=0).stop 2023-11-29T11:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 shutdown_connections 2023-11-29T11:22:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f77b8064ee0 0x7f77b8067390 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77d40cf0e0 0x7f77d415d7e0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d40b1ae0 0x7f77d4155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 --2- 172.21.15.81:0/271737684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d406a4c0 0x7f77d40c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 >> 172.21.15.81:0/271737684 conn(0x7f77d409bbd0 msgr2=0x7f77d40d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 shutdown_connections 2023-11-29T11:22:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.106+0000 7f77daa62700 1 -- 172.21.15.81:0/271737684 wait complete. 2023-11-29T11:22:01.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 Processor -- start 2023-11-29T11:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- start start 2023-11-29T11:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19040b0bf0 0x7f19040cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f190406ad50 0x7f190406b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19040b16e0 con 0x7f190415c6f0 2023-11-29T11:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190406b6d0 con 0x7f19040b0bf0 2023-11-29T11:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190415cac0 con 0x7f190406ad50 2023-11-29T11:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f190259c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f190415c6f0 0x7f19040b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40138/0 (socket says 172.21.15.81:40138) 2023-11-29T11:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1901d9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19040b0bf0 0x7f19040cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f190259c700 1 -- 172.21.15.81:0/896748364 learned_addr learned my addr 172.21.15.81:0/896748364 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1902d9d700 1 --2- 172.21.15.81:0/896748364 >> v2:172.21.15.176:3300/0 conn(0x7f190406ad50 0x7f190406b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1901d9b700 1 -- 172.21.15.81:0/896748364 >> v2:172.21.15.176:3300/0 conn(0x7f190406ad50 msgr2=0x7f190406b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1901d9b700 1 --2- 172.21.15.81:0/896748364 >> v2:172.21.15.176:3300/0 conn(0x7f190406ad50 0x7f190406b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1901d9b700 1 -- 172.21.15.81:0/896748364 >> v1:172.21.15.81:6789/0 conn(0x7f190415c6f0 legacy=0x7f19040b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1901d9b700 1 -- 172.21.15.81:0/896748364 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190415daa0 con 0x7f19040b0bf0 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1902d9d700 1 --2- 172.21.15.81:0/896748364 >> v2:172.21.15.176:3300/0 conn(0x7f190406ad50 0x7f190406b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1901d9b700 1 --2- 172.21.15.81:0/896748364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19040b0bf0 0x7f19040cac60 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f190406ffd0 tx=0x7f18f4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e99cedded6991 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f190159a700 1 -- 172.21.15.81:0/896748364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400f8a0 con 0x7f19040b0bf0 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f190159a700 1 -- 172.21.15.81:0/896748364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400fa00 con 0x7f19040b0bf0 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f190159a700 1 -- 172.21.15.81:0/896748364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400fdb0 con 0x7f19040b0bf0 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- 172.21.15.81:0/896748364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19040b0bf0 msgr2=0x7f19040cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 --2- 172.21.15.81:0/896748364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19040b0bf0 0x7f19040cac60 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f190406ffd0 tx=0x7f18f4009b30 comp rx=0 tx=0).stop 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- 172.21.15.81:0/896748364 shutdown_connections 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 --2- 172.21.15.81:0/896748364 >> v2:172.21.15.176:3300/0 conn(0x7f190406ad50 0x7f190406b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 --2- 172.21.15.81:0/896748364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19040b0bf0 0x7f19040cac60 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- 172.21.15.81:0/896748364 >> 172.21.15.81:0/896748364 conn(0x7f19040cf4a0 msgr2=0x7f19040cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- 172.21.15.81:0/896748364 shutdown_connections 2023-11-29T11:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.242+0000 7f1908d45700 1 -- 172.21.15.81:0/896748364 wait complete. 2023-11-29T11:22:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f1908d45700 1 Processor -- start 2023-11-29T11:22:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f1908d45700 1 -- start start 2023-11-29T11:22:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f1908d45700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190406ad50 0x7f190413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f1908d45700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19040b0bf0 0x7f190413eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f1908d45700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415c6f0 0x7f19041f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f1908d45700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19040c1990 con 0x7f190406ad50 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f1908d45700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19040c86a0 con 0x7f19040b0bf0 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f1908d45700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1904156ed0 con 0x7f190415c6f0 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f190259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190406ad50 0x7f190413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.246+0000 7f190259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190406ad50 0x7f190413e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53294/0 (socket says 172.21.15.81:53294) 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f190259c700 1 -- 172.21.15.81:0/4143815433 learned_addr learned my addr 172.21.15.81:0/4143815433 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f1901d9b700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19040b0bf0 0x7f190413eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f1902d9d700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415c6f0 0x7f19041f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f190259c700 1 -- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415c6f0 msgr2=0x7f19041f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f190259c700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415c6f0 0x7f19041f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f190259c700 1 -- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19040b0bf0 msgr2=0x7f190413eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f190259c700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19040b0bf0 0x7f190413eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f190259c700 1 -- 172.21.15.81:0/4143815433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f40094b0 con 0x7f190406ad50 2023-11-29T11:22:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f1901d9b700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19040b0bf0 0x7f190413eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f190259c700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190406ad50 0x7f190413e5c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f18ec001eb0 tx=0x7f18ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f18faffd700 1 -- 172.21.15.81:0/4143815433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec005d90 con 0x7f190406ad50 2023-11-29T11:22:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f18faffd700 1 -- 172.21.15.81:0/4143815433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec0070d0 con 0x7f190406ad50 2023-11-29T11:22:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19040b1c10 con 0x7f190406ad50 2023-11-29T11:22:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f18faffd700 1 -- 172.21.15.81:0/4143815433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec007440 con 0x7f190406ad50 2023-11-29T11:22:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19040b1930 con 0x7f190406ad50 2023-11-29T11:22:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f18faffd700 1 -- 172.21.15.81:0/4143815433 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f18ec019030 con 0x7f190406ad50 2023-11-29T11:22:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19040c8e60 con 0x7f190406ad50 2023-11-29T11:22:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.250+0000 7f18faffd700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18e8064ee0 0x7f18e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.254+0000 7f18faffd700 1 -- 172.21.15.81:0/4143815433 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f18ec081260 con 0x7f190406ad50 2023-11-29T11:22:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.254+0000 7f1901d9b700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18e8064ee0 0x7f18e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.254+0000 7f1901d9b700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18e8064ee0 0x7f18e8067390 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f18f40090b0 tx=0x7f18f4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.258+0000 7f18faffd700 1 -- 172.21.15.81:0/4143815433 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f18ec04a400 con 0x7f190406ad50 2023-11-29T11:22:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.422+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1904072500 con 0x7f190406ad50 2023-11-29T11:22:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.422+0000 7f18faffd700 1 -- 172.21.15.81:0/4143815433 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18ec04f2c0 con 0x7f190406ad50 2023-11-29T11:22:01.428 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.422+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18e8064ee0 msgr2=0x7f18e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.422+0000 7f1908d45700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18e8064ee0 0x7f18e8067390 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f18f40090b0 tx=0x7f18f4008030 comp rx=0 tx=0).stop 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.422+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190406ad50 msgr2=0x7f190413e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.422+0000 7f1908d45700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190406ad50 0x7f190413e5c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f18ec001eb0 tx=0x7f18ec00c860 comp rx=0 tx=0).stop 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.426+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 shutdown_connections 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.426+0000 7f1908d45700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f18e8064ee0 0x7f18e8067390 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.426+0000 7f1908d45700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415c6f0 0x7f19041f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.426+0000 7f1908d45700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19040b0bf0 0x7f190413eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.426+0000 7f1908d45700 1 --2- 172.21.15.81:0/4143815433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f190406ad50 0x7f190413e5c0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.426+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 >> 172.21.15.81:0/4143815433 conn(0x7f19040cf4a0 msgr2=0x7f19040cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:01.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.426+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 shutdown_connections 2023-11-29T11:22:01.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.426+0000 7f1908d45700 1 -- 172.21.15.81:0/4143815433 wait complete. 2023-11-29T11:22:01.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:22:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.554+0000 7f8d2b59e700 1 Processor -- start 2023-11-29T11:22:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.554+0000 7f8d2b59e700 1 -- start start 2023-11-29T11:22:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d2c0cd960 0x7f8d2c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c0cf3c0 con 0x7f8d2c071b00 2023-11-29T11:22:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c15a1d0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0cb530 con 0x7f8d2c159e00 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2ad9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d2c0cd960 0x7f8d2c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2a59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2ad9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d2c0cd960 0x7f8d2c0cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59234/0 (socket says 172.21.15.81:59234) 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d29d9b700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8d2c071b00 0x7f8d2c0cd250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:56456/0 (socket says 172.21.15.81:56456) 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2ad9d700 1 -- 172.21.15.81:0/4020433407 learned_addr learned my addr 172.21.15.81:0/4020433407 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2a59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c0caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:38662/0 (socket says 172.21.15.81:38662) 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2ad9d700 1 -- 172.21.15.81:0/4020433407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 msgr2=0x7f8d2c0caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2ad9d700 1 --2- 172.21.15.81:0/4020433407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c0caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2ad9d700 1 -- 172.21.15.81:0/4020433407 >> v1:172.21.15.176:6789/0 conn(0x7f8d2c071b00 legacy=0x7f8d2c0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2ad9d700 1 -- 172.21.15.81:0/4020433407 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c15fcf0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2959a700 1 -- 172.21.15.81:0/4020433407 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577208366 0 0) 0x7f8d20001110 con 0x7f8d2c071b00 2023-11-29T11:22:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2a59c700 1 --2- 172.21.15.81:0/4020433407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c0caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2ad9d700 1 --2- 172.21.15.81:0/4020433407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0cee80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009e50 tx=0x7f8d2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd0b28057ab7c4e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2959a700 1 -- 172.21.15.81:0/4020433407 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2400e070 con 0x7f8d2c0cd960 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2959a700 1 -- 172.21.15.81:0/4020433407 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2400b910 con 0x7f8d2c0cd960 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2959a700 1 -- 172.21.15.81:0/4020433407 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2400bcc0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2b59e700 1 -- 172.21.15.81:0/4020433407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0cd960 msgr2=0x7f8d2c0cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.558+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/4020433407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0cee80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009e50 tx=0x7f8d2400b330 comp rx=0 tx=0).stop 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 -- 172.21.15.81:0/4020433407 shutdown_connections 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/4020433407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0cee80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/4020433407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c0caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 -- 172.21.15.81:0/4020433407 >> 172.21.15.81:0/4020433407 conn(0x7f8d2c0b26e0 msgr2=0x7f8d2c0b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 -- 172.21.15.81:0/4020433407 shutdown_connections 2023-11-29T11:22:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 -- 172.21.15.81:0/4020433407 wait complete. 2023-11-29T11:22:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 Processor -- start 2023-11-29T11:22:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 -- start start 2023-11-29T11:22:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c1474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0a9a30 0x7f8d2c0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0a7980 con 0x7f8d2c0cd960 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0aa410 con 0x7f8d2c0a9a30 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c1479f0 con 0x7f8d2c159e00 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53306/0 (socket says 172.21.15.81:53306) 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2a59c700 1 -- 172.21.15.81:0/3135402228 learned_addr learned my addr 172.21.15.81:0/3135402228 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d29d9b700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c1474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.562+0000 7f8d2ad9d700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0a9a30 0x7f8d2c0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2a59c700 1 -- 172.21.15.81:0/3135402228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 msgr2=0x7f8d2c1474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2a59c700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c1474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2a59c700 1 -- 172.21.15.81:0/3135402228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0a9a30 msgr2=0x7f8d2c0a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2a59c700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0a9a30 0x7f8d2c0a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2a59c700 1 -- 172.21.15.81:0/3135402228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c0094b0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2a59c700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0a7440 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00ebe0 tx=0x7f8d1c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d1affd700 1 -- 172.21.15.81:0/3135402228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c009770 con 0x7f8d2c0cd960 2023-11-29T11:22:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d1affd700 1 -- 172.21.15.81:0/3135402228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c00c850 con 0x7f8d2c0cd960 2023-11-29T11:22:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d24009b30 con 0x7f8d2c0cd960 2023-11-29T11:22:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d1affd700 1 -- 172.21.15.81:0/3135402228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00cbe0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c1602b0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.566+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c15ffd0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.570+0000 7f8d1affd700 1 -- 172.21.15.81:0/3135402228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d1c019030 con 0x7f8d2c0cd960 2023-11-29T11:22:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.570+0000 7f8d1affd700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8d0c064ee0 0x7f8d0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.570+0000 7f8d1affd700 1 -- 172.21.15.81:0/3135402228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f8d1c082070 con 0x7f8d2c0cd960 2023-11-29T11:22:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.570+0000 7f8d29d9b700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8d0c064ee0 0x7f8d0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.570+0000 7f8d29d9b700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8d0c064ee0 0x7f8d0c067390 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c15e8e0 tx=0x7f8d20007c40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.574+0000 7f8d1affd700 1 -- 172.21.15.81:0/3135402228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d1c04fed0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.734+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d2c160590 con 0x7f8d2c0cd960 2023-11-29T11:22:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.734+0000 7f8d1affd700 1 -- 172.21.15.81:0/3135402228 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d1c0534f0 con 0x7f8d2c0cd960 2023-11-29T11:22:01.742 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:22:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8d0c064ee0 msgr2=0x7f8d0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8d0c064ee0 0x7f8d0c067390 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c15e8e0 tx=0x7f8d20007c40 comp rx=0 tx=0).stop 2023-11-29T11:22:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d2c0cd960 msgr2=0x7f8d2c0a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0a7440 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00ebe0 tx=0x7f8d1c00eef0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 shutdown_connections 2023-11-29T11:22:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8d0c064ee0 0x7f8d0c067390 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d2c0a9a30 0x7f8d2c0a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d2c159e00 0x7f8d2c1474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 --2- 172.21.15.81:0/3135402228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d2c0cd960 0x7f8d2c0a7440 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 >> 172.21.15.81:0/3135402228 conn(0x7f8d2c0b26e0 msgr2=0x7f8d2c0cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 shutdown_connections 2023-11-29T11:22:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.738+0000 7f8d2b59e700 1 -- 172.21.15.81:0/3135402228 wait complete. 2023-11-29T11:22:01.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:22:01.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb37fff700 1 Processor -- start 2023-11-29T11:22:01.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb37fff700 1 -- start start 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb37fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb380cc590 0x7fcb380b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb37fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcb380cfdd0 0x7fcb380b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb37fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb380cac70 con 0x7fcb380b2570 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb37fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3806c8e0 con 0x7fcb380cc590 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb37fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb380b29f0 con 0x7fcb380cfdd0 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb36ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb380cc590 0x7fcb380b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb36ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb380cc590 0x7fcb380b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53308/0 (socket says 172.21.15.81:53308) 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb36ffd700 1 -- 172.21.15.81:0/4129226939 learned_addr learned my addr 172.21.15.81:0/4129226939 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:01.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb2ffff700 1 --2- 172.21.15.81:0/4129226939 >> v2:172.21.15.176:3300/0 conn(0x7fcb380cfdd0 0x7fcb380b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb36ffd700 1 -- 172.21.15.81:0/4129226939 >> v2:172.21.15.176:3300/0 conn(0x7fcb380cfdd0 msgr2=0x7fcb380b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb36ffd700 1 --2- 172.21.15.81:0/4129226939 >> v2:172.21.15.176:3300/0 conn(0x7fcb380cfdd0 0x7fcb380b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb36ffd700 1 -- 172.21.15.81:0/4129226939 >> v1:172.21.15.176:6789/0 conn(0x7fcb380b2570 legacy=0x7fcb3815fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.866+0000 7fcb36ffd700 1 -- 172.21.15.81:0/4129226939 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb380cfa50 con 0x7fcb380cc590 2023-11-29T11:22:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb36ffd700 1 --2- 172.21.15.81:0/4129226939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cc590 0x7fcb380b0940 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009910 tx=0x7fcb28009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aefce357fd7593f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb367fc700 1 -- 172.21.15.81:0/4129226939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800ba20 con 0x7fcb380cc590 2023-11-29T11:22:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb367fc700 1 -- 172.21.15.81:0/4129226939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2800bb80 con 0x7fcb380cc590 2023-11-29T11:22:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb367fc700 1 -- 172.21.15.81:0/4129226939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28009e60 con 0x7fcb380cc590 2023-11-29T11:22:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- 172.21.15.81:0/4129226939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cc590 msgr2=0x7fcb380b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 --2- 172.21.15.81:0/4129226939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cc590 0x7fcb380b0940 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009910 tx=0x7fcb28009c20 comp rx=0 tx=0).stop 2023-11-29T11:22:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- 172.21.15.81:0/4129226939 shutdown_connections 2023-11-29T11:22:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 --2- 172.21.15.81:0/4129226939 >> v2:172.21.15.176:3300/0 conn(0x7fcb380cfdd0 0x7fcb380b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 --2- 172.21.15.81:0/4129226939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cc590 0x7fcb380b0940 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- 172.21.15.81:0/4129226939 >> 172.21.15.81:0/4129226939 conn(0x7fcb380cd0a0 msgr2=0x7fcb380cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- 172.21.15.81:0/4129226939 shutdown_connections 2023-11-29T11:22:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- 172.21.15.81:0/4129226939 wait complete. 2023-11-29T11:22:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 Processor -- start 2023-11-29T11:22:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- start start 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb380b2570 0x7fcb3815db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cfdd0 0x7fcb38156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb380b3e60 0x7fcb380d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb381571b0 con 0x7fcb380cfdd0 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380b4690 con 0x7fcb380b3e60 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb37fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380b4970 con 0x7fcb380b2570 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cfdd0 0x7fcb38156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cfdd0 0x7fcb38156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53310/0 (socket says 172.21.15.81:53310) 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb36ffd700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb380b2570 0x7fcb3815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb2ffff700 1 -- 172.21.15.81:0/2034588787 learned_addr learned my addr 172.21.15.81:0/2034588787 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.870+0000 7fcb377fe700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb380b3e60 0x7fcb380d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb2ffff700 1 -- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb380b2570 msgr2=0x7fcb3815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb2ffff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb380b2570 0x7fcb3815db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb2ffff700 1 -- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb380b3e60 msgr2=0x7fcb380d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb2ffff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb380b3e60 0x7fcb380d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb2ffff700 1 -- 172.21.15.81:0/2034588787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28009570 con 0x7fcb380cfdd0 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb36ffd700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb380b2570 0x7fcb3815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb2ffff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cfdd0 0x7fcb38156c70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000e760 tx=0x7fcb2000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb34ff9700 1 -- 172.21.15.81:0/2034588787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000c070 con 0x7fcb380cfdd0 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb34ff9700 1 -- 172.21.15.81:0/2034588787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb20013610 con 0x7fcb380cfdd0 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3806d1d0 con 0x7fcb380cfdd0 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb34ff9700 1 -- 172.21.15.81:0/2034588787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20013980 con 0x7fcb380cfdd0 2023-11-29T11:22:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb380d0340 con 0x7fcb380cfdd0 2023-11-29T11:22:01.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3806d4b0 con 0x7fcb380cfdd0 2023-11-29T11:22:01.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.874+0000 7fcb34ff9700 1 -- 172.21.15.81:0/2034588787 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcb20023070 con 0x7fcb380cfdd0 2023-11-29T11:22:01.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.878+0000 7fcb34ff9700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb18064ee0 0x7fcb18067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:01.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.878+0000 7fcb36ffd700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb18064ee0 0x7fcb18067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:01.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.878+0000 7fcb34ff9700 1 -- 172.21.15.81:0/2034588787 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fcb20081e70 con 0x7fcb380cfdd0 2023-11-29T11:22:01.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.878+0000 7fcb36ffd700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb18064ee0 0x7fcb18067390 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcb28000c00 tx=0x7fcb28008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:01.882+0000 7fcb34ff9700 1 -- 172.21.15.81:0/2034588787 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcb2004fd30 con 0x7fcb380cfdd0 2023-11-29T11:22:02.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.042+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb38072c20 con 0x7fcb380cfdd0 2023-11-29T11:22:02.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.042+0000 7fcb34ff9700 1 -- 172.21.15.81:0/2034588787 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb2000f040 con 0x7fcb380cfdd0 2023-11-29T11:22:02.050 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb18064ee0 msgr2=0x7fcb18067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb18064ee0 0x7fcb18067390 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcb28000c00 tx=0x7fcb28008030 comp rx=0 tx=0).stop 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cfdd0 msgr2=0x7fcb38156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cfdd0 0x7fcb38156c70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000e760 tx=0x7fcb2000ea70 comp rx=0 tx=0).stop 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 shutdown_connections 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcb18064ee0 0x7fcb18067390 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb380b3e60 0x7fcb380d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb380cfdd0 0x7fcb38156c70 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 --2- 172.21.15.81:0/2034588787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb380b2570 0x7fcb3815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 >> 172.21.15.81:0/2034588787 conn(0x7fcb380cd0a0 msgr2=0x7fcb380ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 shutdown_connections 2023-11-29T11:22:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.046+0000 7fcb37fff700 1 -- 172.21.15.81:0/2034588787 wait complete. 2023-11-29T11:22:02.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:22:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a283c700 1 Processor -- start 2023-11-29T11:22:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a283c700 1 -- start start 2023-11-29T11:22:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a283c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c1585e0 0x7f059c0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a283c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c0718c0 con 0x7f059c15c6f0 2023-11-29T11:22:02.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a283c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c15c260 con 0x7f059c0cb240 2023-11-29T11:22:02.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a283c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0cb7e0 con 0x7f059c1585e0 2023-11-29T11:22:02.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a203b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f059c15c6f0 0x7f059c0ccb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40148/0 (socket says 172.21.15.81:40148) 2023-11-29T11:22:02.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a203b700 1 -- 172.21.15.81:0/1689146908 learned_addr learned my addr 172.21.15.81:0/1689146908 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a183a700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c1585e0 0x7f059c0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381259087 0 0) 0x7f059c0718c0 con 0x7f059c15c6f0 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05840035d0 con 0x7f059c15c6f0 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4149680382 0 0) 0x7f05840035d0 con 0x7f059c15c6f0 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c1585e0 msgr2=0x7f059c0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c1585e0 0x7f059c0b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 >> v1:172.21.15.176:6789/0 conn(0x7f059c0cb240 legacy=0x7f059c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0cbac0 con 0x7f059c15c6f0 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f0594001670 con 0x7f059c15c6f0 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 >> v1:172.21.15.81:6789/0 conn(0x7f059c15c6f0 legacy=0x7f059c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0584003a50 0x7f0584003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.184 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f0584004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0584005270 0x7f058400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0cb7e0 con 0x7f0584004870 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058400c160 con 0x7f0584005270 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058400c320 con 0x7f0584003a50 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a1039700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f0584004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a183a700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c1585e0 0x7f059c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a203b700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0584005270 0x7f058400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a1039700 1 -- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0584003a50 msgr2=0x7f0584003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a1039700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0584003a50 0x7f0584003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a1039700 1 -- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0584005270 msgr2=0x7f058400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a1039700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0584005270 0x7f058400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a1039700 1 -- 172.21.15.81:0/1689146908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05840035d0 con 0x7f0584004870 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a1039700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f0584004ce0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f058c00c190 tx=0x7f05840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d828875c38fee474 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.174+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c001db0 con 0x7f0584004870 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00ccd0 con 0x7f0584004870 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a0838700 1 -- 172.21.15.81:0/1689146908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c003c60 con 0x7f0584004870 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- 172.21.15.81:0/1689146908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 msgr2=0x7f0584004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 --2- 172.21.15.81:0/1689146908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f0584004ce0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f058c00c190 tx=0x7f05840058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a203b700 1 -- 172.21.15.81:0/1689146908 reap_dead start 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- 172.21.15.81:0/1689146908 shutdown_connections 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- 172.21.15.81:0/1689146908 >> 172.21.15.81:0/1689146908 conn(0x7f059c06c640 msgr2=0x7f059c06ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- 172.21.15.81:0/1689146908 shutdown_connections 2023-11-29T11:22:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- 172.21.15.81:0/1689146908 wait complete. 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 Processor -- start 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- start start 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f059c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c0c8c70 0x7f059c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059c164490 0x7f059c164900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c164e40 con 0x7f0584004870 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0c5f80 con 0x7f059c164490 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.178+0000 7f05a283c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c15bab0 con 0x7f059c0c8c70 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f059c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f059c15af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53318/0 (socket says 172.21.15.81:53318) 2023-11-29T11:22:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 -- 172.21.15.81:0/2834687685 learned_addr learned my addr 172.21.15.81:0/2834687685 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a1039700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c0c8c70 0x7f059c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a203b700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059c164490 0x7f059c164900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 -- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c0c8c70 msgr2=0x7f059c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c0c8c70 0x7f059c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 -- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059c164490 msgr2=0x7f059c164900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059c164490 0x7f059c164900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 -- 172.21.15.81:0/2834687685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c1589b0 con 0x7f0584004870 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a203b700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059c164490 0x7f059c164900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a183a700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f059c15af40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f059000e7c0 tx=0x7f059000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f059a7fc700 1 -- 172.21.15.81:0/2834687685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000c070 con 0x7f0584004870 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f059a7fc700 1 -- 172.21.15.81:0/2834687685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590004020 con 0x7f0584004870 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c0cbda0 con 0x7f0584004870 2023-11-29T11:22:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f059a7fc700 1 -- 172.21.15.81:0/2834687685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900043b0 con 0x7f0584004870 2023-11-29T11:22:02.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c0c9af0 con 0x7f0584004870 2023-11-29T11:22:02.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f059a7fc700 1 -- 172.21.15.81:0/2834687685 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f05900036c0 con 0x7f0584004870 2023-11-29T11:22:02.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c072500 con 0x7f0584004870 2023-11-29T11:22:02.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f059a7fc700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0588064f10 0x7f05880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f059a7fc700 1 -- 172.21.15.81:0/2834687685 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f0590081bc0 con 0x7f0584004870 2023-11-29T11:22:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.182+0000 7f05a1039700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0588064f10 0x7f05880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.186+0000 7f05a1039700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0588064f10 0x7f05880673c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f058c005040 tx=0x7f058c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:02.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.190+0000 7f059a7fc700 1 -- 172.21.15.81:0/2834687685 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f059004fb70 con 0x7f0584004870 2023-11-29T11:22:02.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.366+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f059c0b4b60 con 0x7f0584004870 2023-11-29T11:22:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.366+0000 7f059a7fc700 1 -- 172.21.15.81:0/2834687685 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v98) v1 ==== 80+0+244 (secure 0 0 0) 0x7f0590053190 con 0x7f0584004870 2023-11-29T11:22:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6837/353227086 2023-11-30T11:21:20.356024+0000 2023-11-29T11:22:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6836/353227086 2023-11-30T11:21:20.356024+0000 2023-11-29T11:22:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.176:6833/1691706444 2023-11-30T11:19:58.895424+0000 2023-11-29T11:22:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.176:6832/1691706444 2023-11-30T11:19:58.895424+0000 2023-11-29T11:22:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0588064f10 msgr2=0x7f05880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0588064f10 0x7f05880673c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f058c005040 tx=0x7f058c009030 comp rx=0 tx=0).stop 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 msgr2=0x7f059c15af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f059c15af40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f059000e7c0 tx=0x7f059000ead0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 shutdown_connections 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0588064f10 0x7f05880673c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f059c164490 0x7f059c164900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f059c0c8c70 0x7f059c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 --2- 172.21.15.81:0/2834687685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0584004870 0x7f059c15af40 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 >> 172.21.15.81:0/2834687685 conn(0x7f059c06c640 msgr2=0x7f059c0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 shutdown_connections 2023-11-29T11:22:02.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.370+0000 7f05a283c700 1 -- 172.21.15.81:0/2834687685 wait complete. 2023-11-29T11:22:02.377 INFO:teuthology.orchestra.run.smithi081.stderr:listed 4 entries 2023-11-29T11:22:02.387 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:22:02.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:02.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:02.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[59944]: fuse finished with error 0 and tester_r 0 2023-11-29T11:22:02.404 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:22:02.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:02.404 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:22:02.454 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:22:02.454 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:02.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:22:02.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:22:02.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:02.463 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-29T11:22:02.469 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-29T11:22:02.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:22:02.470 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:02.470 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:02.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:22:02.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:22:02.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:02.478 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-29T11:22:02.528 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-29T11:22:02.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:22:02.529 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:22:02.529 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:02.537 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:22:02.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:22:02.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:02.537 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-29T11:22:02.584 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-29T11:22:02.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:22:02.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a3fff700 1 Processor -- start 2023-11-29T11:22:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a3fff700 1 -- start start 2023-11-29T11:22:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc9a40cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40cc730 con 0x7fc9a41607b0 2023-11-29T11:22:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a3fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40b1f30 con 0x7fc9a40cc360 2023-11-29T11:22:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40d04c0 con 0x7fc9a40cd710 2023-11-29T11:22:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc9a41607b0 0x7fc9a40cd000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40164/0 (socket says 172.21.15.81:40164) 2023-11-29T11:22:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a27fc700 1 -- 172.21.15.81:0/1111963398 learned_addr learned my addr 172.21.15.81:0/1111963398 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a37fe700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc9a40cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142488203 0 0) 0x7fc9a40cc730 con 0x7fc9a41607b0 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9900035d0 con 0x7fc9a41607b0 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1726608264 0 0) 0x7fc9900035d0 con 0x7fc9a41607b0 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 msgr2=0x7fc9a40cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc9a40cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 >> v1:172.21.15.176:6789/0 conn(0x7fc9a40cc360 legacy=0x7fc9a40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40d01e0 con 0x7fc9a41607b0 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fc994001b70 con 0x7fc9a41607b0 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 >> v1:172.21.15.81:6789/0 conn(0x7fc9a41607b0 legacy=0x7fc9a40cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc990003a50 0x7fc990003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc990004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990004db0 0x7fc990005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40d04c0 con 0x7fc990004db0 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99000bae0 con 0x7fc990003a50 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99000bca0 con 0x7fc9a40cd710 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a37fe700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990004db0 0x7fc990005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a27fc700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc990004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a2ffd700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc990003a50 0x7fc990003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a27fc700 1 -- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc990003a50 msgr2=0x7fc990003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a27fc700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc990003a50 0x7fc990003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a27fc700 1 -- 172.21.15.81:0/1111963398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990004db0 msgr2=0x7fc990005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a27fc700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990004db0 0x7fc990005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a27fc700 1 -- 172.21.15.81:0/1111963398 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900035d0 con 0x7fc9a40cd710 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a37fe700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc990004db0 0x7fc990005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.702+0000 7fc9a2ffd700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc990003a50 0x7fc990003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a27fc700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc990004870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc99400a920 tx=0x7fc9900058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=644b3fc2ff62e67d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994005dd0 con 0x7fc9a40cd710 2023-11-29T11:22:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400a390 con 0x7fc9a40cd710 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a1ffb700 1 -- 172.21.15.81:0/1111963398 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940072b0 con 0x7fc9a40cd710 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a3fff700 1 -- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 msgr2=0x7fc990004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a3fff700 1 --2- 172.21.15.81:0/1111963398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc990004870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc99400a920 tx=0x7fc9900058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a37fe700 1 -- 172.21.15.81:0/1111963398 reap_dead start 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a3fff700 1 -- 172.21.15.81:0/1111963398 shutdown_connections 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a3fff700 1 -- 172.21.15.81:0/1111963398 >> 172.21.15.81:0/1111963398 conn(0x7fc9a40b2140 msgr2=0x7fc9a40b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a3fff700 1 -- 172.21.15.81:0/1111963398 shutdown_connections 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a3fff700 1 -- 172.21.15.81:0/1111963398 wait complete. 2023-11-29T11:22:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a3fff700 1 Processor -- start 2023-11-29T11:22:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.706+0000 7fc9a3fff700 1 -- start start 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc9a40c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a40cac50 0x7fc9a40b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a41f1820 0x7fc9a41f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4159400 con 0x7fc9a41f1820 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40b6120 con 0x7fc9a40cac50 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40cb0c0 con 0x7fc9a40cd710 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a41f1820 0x7fc9a41f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a41f1820 0x7fc9a41f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53330/0 (socket says 172.21.15.81:53330) 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 -- 172.21.15.81:0/3896450318 learned_addr learned my addr 172.21.15.81:0/3896450318 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a27fc700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a40cac50 0x7fc9a40b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a2ffd700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc9a40c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 -- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 msgr2=0x7fc9a40c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc9a40c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 -- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a40cac50 msgr2=0x7fc9a40b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a40cac50 0x7fc9a40b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 -- 172.21.15.81:0/3896450318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a415ffb0 con 0x7fc9a41f1820 2023-11-29T11:22:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a27fc700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a40cac50 0x7fc9a40b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.710+0000 7fc9a37fe700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a41f1820 0x7fc9a41f1c90 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc99c011bd0 tx=0x7fc99c011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc99b7fe700 1 -- 172.21.15.81:0/3896450318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c004240 con 0x7fc9a41f1820 2023-11-29T11:22:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc99b7fe700 1 -- 172.21.15.81:0/3896450318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c0043a0 con 0x7fc9a41f1820 2023-11-29T11:22:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a415fcd0 con 0x7fc9a41f1820 2023-11-29T11:22:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc99b7fe700 1 -- 172.21.15.81:0/3896450318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0036c0 con 0x7fc9a41f1820 2023-11-29T11:22:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a4160290 con 0x7fc9a41f1820 2023-11-29T11:22:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a406cd60 con 0x7fc9a41f1820 2023-11-29T11:22:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc99b7fe700 1 -- 172.21.15.81:0/3896450318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc99c003820 con 0x7fc9a41f1820 2023-11-29T11:22:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc99b7fe700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc984064f10 0x7fc9840673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc9a2ffd700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc984064f10 0x7fc9840673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc99b7fe700 1 -- 172.21.15.81:0/3896450318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fc99c082110 con 0x7fc9a41f1820 2023-11-29T11:22:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.714+0000 7fc9a2ffd700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc984064f10 0x7fc9840673c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc98c007fd0 tx=0x7fc98c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:02.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.722+0000 7fc99b7fe700 1 -- 172.21.15.81:0/3896450318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc99c0500c0 con 0x7fc9a41f1820 2023-11-29T11:22:02.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.918+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a4072500 con 0x7fc9a41f1820 2023-11-29T11:22:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.918+0000 7fc99b7fe700 1 -- 172.21.15.81:0/3896450318 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4657 (secure 0 0 0) 0x7fc99c009740 con 0x7fc9a41f1820 2023-11-29T11:22:02.926 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:02.926 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:21:25.188265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8610":{"gid":8610,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/2322035611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2322035611},{"type":"v1","addr":"172.21.15.81:6837","nonce":2322035611}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:22:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc984064f10 msgr2=0x7fc9840673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc984064f10 0x7fc9840673c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc98c007fd0 tx=0x7fc98c009040 comp rx=0 tx=0).stop 2023-11-29T11:22:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a41f1820 msgr2=0x7fc9a41f1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:02.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a41f1820 0x7fc9a41f1c90 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc99c011bd0 tx=0x7fc99c011ee0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 shutdown_connections 2023-11-29T11:22:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc984064f10 0x7fc9840673c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9a41f1820 0x7fc9a41f1c90 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9a40cac50 0x7fc9a40b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 --2- 172.21.15.81:0/3896450318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9a40cd710 0x7fc9a40c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 >> 172.21.15.81:0/3896450318 conn(0x7fc9a40b2140 msgr2=0x7fc9a40ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 shutdown_connections 2023-11-29T11:22:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:02.922+0000 7fc9a3fff700 1 -- 172.21.15.81:0/3896450318 wait complete. 2023-11-29T11:22:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-11-29T11:22:02.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:03.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f855d696700 1 Processor -- start 2023-11-29T11:22:03.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f855d696700 1 -- start start 2023-11-29T11:22:03.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f855d696700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f855d696700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f85580ad610 0x7f85580c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f855d696700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85580cae70 con 0x7f85580ceef0 2023-11-29T11:22:03.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f855d696700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580cbc10 con 0x7f85580ad610 2023-11-29T11:22:03.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f855d696700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580cb130 con 0x7f85581606b0 2023-11-29T11:22:03.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8557fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8557fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:38756/0 (socket says 172.21.15.81:38756) 2023-11-29T11:22:03.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f855ce95700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f85580ad610 0x7f85580c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8557fff700 1 -- 172.21.15.81:0/293285320 learned_addr learned my addr 172.21.15.81:0/293285320 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:03.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8557fff700 1 -- 172.21.15.81:0/293285320 >> v2:172.21.15.176:3300/0 conn(0x7f85580ad610 msgr2=0x7f85580c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:03.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8557fff700 1 --2- 172.21.15.81:0/293285320 >> v2:172.21.15.176:3300/0 conn(0x7f85580ad610 0x7f85580c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8557fff700 1 -- 172.21.15.81:0/293285320 >> v1:172.21.15.176:6789/0 conn(0x7f85580ceef0 legacy=0x7f8558164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8557fff700 1 -- 172.21.15.81:0/293285320 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580cb410 con 0x7f85581606b0 2023-11-29T11:22:03.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8557fff700 1 --2- 172.21.15.81:0/293285320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580c13b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8548009910 tx=0x7f8548009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a312e0f1cff655 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8556ffd700 1 -- 172.21.15.81:0/293285320 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548011830 con 0x7f85581606b0 2023-11-29T11:22:03.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8556ffd700 1 -- 172.21.15.81:0/293285320 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548011990 con 0x7f85581606b0 2023-11-29T11:22:03.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.050+0000 7f8556ffd700 1 -- 172.21.15.81:0/293285320 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548011d40 con 0x7f85581606b0 2023-11-29T11:22:03.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- 172.21.15.81:0/293285320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 msgr2=0x7f85580c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 --2- 172.21.15.81:0/293285320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580c13b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8548009910 tx=0x7f8548009c20 comp rx=0 tx=0).stop 2023-11-29T11:22:03.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- 172.21.15.81:0/293285320 shutdown_connections 2023-11-29T11:22:03.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 --2- 172.21.15.81:0/293285320 >> v2:172.21.15.176:3300/0 conn(0x7f85580ad610 0x7f85580c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 --2- 172.21.15.81:0/293285320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580c13b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- 172.21.15.81:0/293285320 >> 172.21.15.81:0/293285320 conn(0x7f85580ce3e0 msgr2=0x7f85580ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:03.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- 172.21.15.81:0/293285320 shutdown_connections 2023-11-29T11:22:03.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- 172.21.15.81:0/293285320 wait complete. 2023-11-29T11:22:03.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 Processor -- start 2023-11-29T11:22:03.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- start start 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580ad610 0x7f855815d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85580ceef0 0x7f85580ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580c4df0 con 0x7f85580ceef0 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855815cb80 con 0x7f85580ad610 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855d696700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855815ce60 con 0x7f85581606b0 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f85577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85580ceef0 0x7f85580ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f85577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85580ceef0 0x7f85580ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53344/0 (socket says 172.21.15.81:53344) 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f85577fe700 1 -- 172.21.15.81:0/2582269167 learned_addr learned my addr 172.21.15.81:0/2582269167 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f8557fff700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580ad610 0x7f855815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.054+0000 7f855ce95700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f85577fe700 1 -- 172.21.15.81:0/2582269167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 msgr2=0x7f85580ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f85577fe700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f85577fe700 1 -- 172.21.15.81:0/2582269167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580ad610 msgr2=0x7f855815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f85577fe700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580ad610 0x7f855815d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f85577fe700 1 -- 172.21.15.81:0/2582269167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548009570 con 0x7f85580ceef0 2023-11-29T11:22:03.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f85577fe700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85580ceef0 0x7f85580ac2d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f855000cbd0 tx=0x7f855000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f8554ff9700 1 -- 172.21.15.81:0/2582269167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550003c20 con 0x7f85580ceef0 2023-11-29T11:22:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f8554ff9700 1 -- 172.21.15.81:0/2582269167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8550003d80 con 0x7f85580ceef0 2023-11-29T11:22:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855806ac50 con 0x7f85580ceef0 2023-11-29T11:22:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f8554ff9700 1 -- 172.21.15.81:0/2582269167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000aae0 con 0x7f85580ceef0 2023-11-29T11:22:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85580cb6f0 con 0x7f85580ceef0 2023-11-29T11:22:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85580b36c0 con 0x7f85580ceef0 2023-11-29T11:22:03.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.058+0000 7f8554ff9700 1 -- 172.21.15.81:0/2582269167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8550010050 con 0x7f85580ceef0 2023-11-29T11:22:03.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.062+0000 7f8554ff9700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8538064ee0 0x7f8538067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.062+0000 7f8557fff700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8538064ee0 0x7f8538067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.062+0000 7f8554ff9700 1 -- 172.21.15.81:0/2582269167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f8550081ec0 con 0x7f85580ceef0 2023-11-29T11:22:03.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.062+0000 7f8557fff700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8538064ee0 0x7f8538067390 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8548014040 tx=0x7f8548008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.066+0000 7f8554ff9700 1 -- 172.21.15.81:0/2582269167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f855004fe70 con 0x7f85580ceef0 2023-11-29T11:22:03.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.234+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8558072500 con 0x7f85580ceef0 2023-11-29T11:22:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.234+0000 7f8554ff9700 1 -- 172.21.15.81:0/2582269167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18228 (secure 0 0 0) 0x7f8550053490 con 0x7f85580ceef0 2023-11-29T11:22:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:03.243 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":98,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:21:20.356075+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/353227086":"2023-11-30T11:21:20.356024+0000","172.21.15.81:6836/353227086":"2023-11-30T11:21:20.356024+0000","172.21.15.176:6833/1691706444":"2023-11-30T11:19:58.895424+0000","172.21.15.176:6832/1691706444":"2023-11-30T11:19:58.895424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8538064ee0 msgr2=0x7f8538067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8538064ee0 0x7f8538067390 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8548014040 tx=0x7f8548008030 comp rx=0 tx=0).stop 2023-11-29T11:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85580ceef0 msgr2=0x7f85580ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85580ceef0 0x7f85580ac2d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f855000cbd0 tx=0x7f855000cee0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 shutdown_connections 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8538064ee0 0x7f8538067390 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85581606b0 0x7f85580ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85580ceef0 0x7f85580ac2d0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 --2- 172.21.15.81:0/2582269167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580ad610 0x7f855815d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 >> 172.21.15.81:0/2582269167 conn(0x7f85580ce3e0 msgr2=0x7f85580afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 shutdown_connections 2023-11-29T11:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.238+0000 7f855d696700 1 -- 172.21.15.81:0/2582269167 wait complete. 2023-11-29T11:22:03.258 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:19:38.262251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:19:38.644298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:22:03.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:22:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.366+0000 7efebf503700 1 Processor -- start 2023-11-29T11:22:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebf503700 1 -- start start 2023-11-29T11:22:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebf503700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 0x7efeb806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebf503700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb80cf0e0 0x7efeb80cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebf503700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80cfa80 con 0x7efeb806a4c0 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebf503700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80d0ab0 con 0x7efeb80cf0e0 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebf503700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb806a9c0 con 0x7efeb80b1ae0 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebed02700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb80cf0e0 0x7efeb80cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebed02700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb80cf0e0 0x7efeb80cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53348/0 (socket says 172.21.15.81:53348) 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebdd00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efeb806a4c0 0x7efeb80d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40176/0 (socket says 172.21.15.81:40176) 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebed02700 1 -- 172.21.15.81:0/1378704144 learned_addr learned my addr 172.21.15.81:0/1378704144 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebe501700 1 --2- 172.21.15.81:0/1378704144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 0x7efeb806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebed02700 1 -- 172.21.15.81:0/1378704144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 msgr2=0x7efeb806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebed02700 1 --2- 172.21.15.81:0/1378704144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 0x7efeb806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebed02700 1 -- 172.21.15.81:0/1378704144 >> v1:172.21.15.81:6789/0 conn(0x7efeb806a4c0 legacy=0x7efeb80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebed02700 1 -- 172.21.15.81:0/1378704144 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb806aca0 con 0x7efeb80cf0e0 2023-11-29T11:22:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebed02700 1 --2- 172.21.15.81:0/1378704144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb80cf0e0 0x7efeb80cf540 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009e50 tx=0x7efeb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d20c3ef8fbd8771 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebd4ff700 1 -- 172.21.15.81:0/1378704144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000e070 con 0x7efeb80cf0e0 2023-11-29T11:22:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebd4ff700 1 -- 172.21.15.81:0/1378704144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb000b9c0 con 0x7efeb80cf0e0 2023-11-29T11:22:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.370+0000 7efebd4ff700 1 -- 172.21.15.81:0/1378704144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000bd70 con 0x7efeb80cf0e0 2023-11-29T11:22:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- 172.21.15.81:0/1378704144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb80cf0e0 msgr2=0x7efeb80cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 --2- 172.21.15.81:0/1378704144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb80cf0e0 0x7efeb80cf540 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009e50 tx=0x7efeb000b330 comp rx=0 tx=0).stop 2023-11-29T11:22:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- 172.21.15.81:0/1378704144 shutdown_connections 2023-11-29T11:22:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 --2- 172.21.15.81:0/1378704144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb80cf0e0 0x7efeb80cf540 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 --2- 172.21.15.81:0/1378704144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 0x7efeb806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- 172.21.15.81:0/1378704144 >> 172.21.15.81:0/1378704144 conn(0x7efeb809bbd0 msgr2=0x7efeb80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- 172.21.15.81:0/1378704144 shutdown_connections 2023-11-29T11:22:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- 172.21.15.81:0/1378704144 wait complete. 2023-11-29T11:22:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 Processor -- start 2023-11-29T11:22:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- start start 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb806a4c0 0x7efeb809ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 0x7efeb81f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb80cf0e0 0x7efeb80b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb81f2800 con 0x7efeb806a4c0 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb81f2520 con 0x7efeb80cf0e0 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.374+0000 7efebf503700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c6260 con 0x7efeb80b1ae0 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb806a4c0 0x7efeb809ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb806a4c0 0x7efeb809ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53350/0 (socket says 172.21.15.81:53350) 2023-11-29T11:22:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 -- 172.21.15.81:0/1394812603 learned_addr learned my addr 172.21.15.81:0/1394812603 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebed02700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb80cf0e0 0x7efeb80b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebdd00700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 0x7efeb81f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 -- 172.21.15.81:0/1394812603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 msgr2=0x7efeb81f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 0x7efeb81f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 -- 172.21.15.81:0/1394812603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb80cf0e0 msgr2=0x7efeb80b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb80cf0e0 0x7efeb80b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 -- 172.21.15.81:0/1394812603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0009b30 con 0x7efeb806a4c0 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebe501700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb806a4c0 0x7efeb809ff40 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e760 tx=0x7efeb400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efeaeffd700 1 -- 172.21.15.81:0/1394812603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400c070 con 0x7efeb806a4c0 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efeaeffd700 1 -- 172.21.15.81:0/1394812603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4013610 con 0x7efeb806a4c0 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efeaeffd700 1 -- 172.21.15.81:0/1394812603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4013980 con 0x7efeb806a4c0 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb80b4380 con 0x7efeb806a4c0 2023-11-29T11:22:03.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb806af80 con 0x7efeb806a4c0 2023-11-29T11:22:03.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.378+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb80b1eb0 con 0x7efeb806a4c0 2023-11-29T11:22:03.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.382+0000 7efeaeffd700 1 -- 172.21.15.81:0/1394812603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efeb4023070 con 0x7efeb806a4c0 2023-11-29T11:22:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.382+0000 7efeaeffd700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe9c064ee0 0x7efe9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.382+0000 7efeaeffd700 1 -- 172.21.15.81:0/1394812603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7efeb4081ef0 con 0x7efeb806a4c0 2023-11-29T11:22:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.382+0000 7efebdd00700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe9c064ee0 0x7efe9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.382+0000 7efebdd00700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe9c064ee0 0x7efe9c067390 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7efeb81f29d0 tx=0x7efea8007ef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.390+0000 7efeaeffd700 1 -- 172.21.15.81:0/1394812603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efeb404fd30 con 0x7efeb806a4c0 2023-11-29T11:22:03.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efeb8072500 con 0x7efeb806a4c0 2023-11-29T11:22:03.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efeaeffd700 1 -- 172.21.15.81:0/1394812603 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7efeb400f040 con 0x7efeb806a4c0 2023-11-29T11:22:03.556 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:22:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe9c064ee0 msgr2=0x7efe9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe9c064ee0 0x7efe9c067390 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7efeb81f29d0 tx=0x7efea8007ef0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb806a4c0 msgr2=0x7efeb809ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb806a4c0 0x7efeb809ff40 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e760 tx=0x7efeb400ea70 comp rx=0 tx=0).stop 2023-11-29T11:22:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 shutdown_connections 2023-11-29T11:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efe9c064ee0 0x7efe9c067390 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb80cf0e0 0x7efeb80b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeb80b1ae0 0x7efeb81f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 --2- 172.21.15.81:0/1394812603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb806a4c0 0x7efeb809ff40 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 >> 172.21.15.81:0/1394812603 conn(0x7efeb809bbd0 msgr2=0x7efeb80d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 shutdown_connections 2023-11-29T11:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.550+0000 7efebf503700 1 -- 172.21.15.81:0/1394812603 wait complete. 2023-11-29T11:22:03.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:22:03.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.686+0000 7f427895a700 1 Processor -- start 2023-11-29T11:22:03.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.686+0000 7f427895a700 1 -- start start 2023-11-29T11:22:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42740b45f0 0x7f42740d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42740d0740 con 0x7f4274160ac0 2023-11-29T11:22:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42740d1c90 con 0x7f42740cd1c0 2023-11-29T11:22:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42740d0990 con 0x7f42740b45f0 2023-11-29T11:22:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f4271d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4274160ac0 0x7f42740b49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40182/0 (socket says 172.21.15.81:40182) 2023-11-29T11:22:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f4271d9b700 1 -- 172.21.15.81:0/740980813 learned_addr learned my addr 172.21.15.81:0/740980813 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427259c700 1 --2- 172.21.15.81:0/740980813 >> v2:172.21.15.81:3300/0 conn(0x7f42740b45f0 0x7f42740d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427259c700 1 -- 172.21.15.81:0/740980813 >> v1:172.21.15.176:6789/0 conn(0x7f42740cd1c0 legacy=0x7f42740b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427259c700 1 -- 172.21.15.81:0/740980813 >> v1:172.21.15.81:6789/0 conn(0x7f4274160ac0 legacy=0x7f42740b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427259c700 1 -- 172.21.15.81:0/740980813 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42740d0c70 con 0x7f42740b45f0 2023-11-29T11:22:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427259c700 1 --2- 172.21.15.81:0/740980813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740b45f0 0x7f42740d1750 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f425c009850 tx=0x7f425c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd315bf632a250 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427159a700 1 -- 172.21.15.81:0/740980813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c011830 con 0x7f42740b45f0 2023-11-29T11:22:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427159a700 1 -- 172.21.15.81:0/740980813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c011990 con 0x7f42740b45f0 2023-11-29T11:22:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427159a700 1 -- 172.21.15.81:0/740980813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c011d20 con 0x7f42740b45f0 2023-11-29T11:22:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 -- 172.21.15.81:0/740980813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740b45f0 msgr2=0x7f42740d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 --2- 172.21.15.81:0/740980813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740b45f0 0x7f42740d1750 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f425c009850 tx=0x7f425c009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 -- 172.21.15.81:0/740980813 shutdown_connections 2023-11-29T11:22:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 --2- 172.21.15.81:0/740980813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740b45f0 0x7f42740d1750 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 -- 172.21.15.81:0/740980813 >> 172.21.15.81:0/740980813 conn(0x7f427406cb40 msgr2=0x7f42740cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 -- 172.21.15.81:0/740980813 shutdown_connections 2023-11-29T11:22:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 -- 172.21.15.81:0/740980813 wait complete. 2023-11-29T11:22:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.690+0000 7f427895a700 1 Processor -- start 2023-11-29T11:22:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 -- start start 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42740b45f0 0x7f4274153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740cd1c0 0x7f42741f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274160ac0 0x7f427415ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42741f2e50 con 0x7f42740cd1c0 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42741f2c20 con 0x7f42740b45f0 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42741f30f0 con 0x7f4274160ac0 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740cd1c0 0x7f42741f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740cd1c0 0x7f42741f26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53378/0 (socket says 172.21.15.81:53378) 2023-11-29T11:22:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 -- 172.21.15.81:0/3547425431 learned_addr learned my addr 172.21.15.81:0/3547425431 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427259c700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42740b45f0 0x7f4274153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4272d9d700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274160ac0 0x7f427415ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 -- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274160ac0 msgr2=0x7f427415ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274160ac0 0x7f427415ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 -- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42740b45f0 msgr2=0x7f4274153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42740b45f0 0x7f4274153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 -- 172.21.15.81:0/3547425431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c0094b0 con 0x7f42740cd1c0 2023-11-29T11:22:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427259c700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42740b45f0 0x7f4274153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f4271d9b700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740cd1c0 0x7f42741f26e0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f4264001eb0 tx=0x7f426400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f426affd700 1 -- 172.21.15.81:0/3547425431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264005d90 con 0x7f42740cd1c0 2023-11-29T11:22:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f426affd700 1 -- 172.21.15.81:0/3547425431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42640070d0 con 0x7f42740cd1c0 2023-11-29T11:22:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42740d1230 con 0x7f42740cd1c0 2023-11-29T11:22:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f426affd700 1 -- 172.21.15.81:0/3547425431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264007440 con 0x7f42740cd1c0 2023-11-29T11:22:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.694+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42740d0f50 con 0x7f42740cd1c0 2023-11-29T11:22:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.698+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4258005310 con 0x7f42740cd1c0 2023-11-29T11:22:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.698+0000 7f426affd700 1 -- 172.21.15.81:0/3547425431 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4264019030 con 0x7f42740cd1c0 2023-11-29T11:22:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.698+0000 7f426affd700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064f30 0x7f42540673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.698+0000 7f426affd700 1 -- 172.21.15.81:0/3547425431 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f4264081390 con 0x7f42740cd1c0 2023-11-29T11:22:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.698+0000 7f427259c700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064f30 0x7f42540673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:03.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.702+0000 7f427259c700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064f30 0x7f42540673e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f425c009ba0 tx=0x7f425c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:03.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.706+0000 7f426affd700 1 -- 172.21.15.81:0/3547425431 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f426404a400 con 0x7f42740cd1c0 2023-11-29T11:22:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.866+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4258005b40 con 0x7f42740cd1c0 2023-11-29T11:22:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.866+0000 7f426affd700 1 -- 172.21.15.81:0/3547425431 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f426404f380 con 0x7f42740cd1c0 2023-11-29T11:22:03.872 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:22:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064f30 msgr2=0x7f42540673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064f30 0x7f42540673e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f425c009ba0 tx=0x7f425c008030 comp rx=0 tx=0).stop 2023-11-29T11:22:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740cd1c0 msgr2=0x7f42741f26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740cd1c0 0x7f42741f26e0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f4264001eb0 tx=0x7f426400c860 comp rx=0 tx=0).stop 2023-11-29T11:22:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 shutdown_connections 2023-11-29T11:22:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4254064f30 0x7f42540673e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274160ac0 0x7f427415ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740cd1c0 0x7f42741f26e0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 --2- 172.21.15.81:0/3547425431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42740b45f0 0x7f4274153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 >> 172.21.15.81:0/3547425431 conn(0x7f427406cb40 msgr2=0x7f42740cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 shutdown_connections 2023-11-29T11:22:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:03.870+0000 7f427895a700 1 -- 172.21.15.81:0/3547425431 wait complete. 2023-11-29T11:22:03.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:22:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8f59e700 1 Processor -- start 2023-11-29T11:22:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8f59e700 1 -- start start 2023-11-29T11:22:04.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4c900b1ae0 0x7f4c9006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c900cf0e0 0x7f4c900cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c900cfa40 con 0x7f4c9006a4c0 2023-11-29T11:22:04.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c900d0ab0 con 0x7f4c900cf0e0 2023-11-29T11:22:04.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9006a9c0 con 0x7f4c900b1ae0 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c900cf0e0 0x7f4c900cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8ed9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c900cf0e0 0x7f4c900cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53388/0 (socket says 172.21.15.81:53388) 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8dd9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4c9006a4c0 0x7f4c900d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40184/0 (socket says 172.21.15.81:40184) 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8ed9d700 1 -- 172.21.15.81:0/2193438040 learned_addr learned my addr 172.21.15.81:0/2193438040 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8e59c700 1 --2- 172.21.15.81:0/2193438040 >> v2:172.21.15.176:3300/0 conn(0x7f4c900b1ae0 0x7f4c9006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8ed9d700 1 -- 172.21.15.81:0/2193438040 >> v2:172.21.15.176:3300/0 conn(0x7f4c900b1ae0 msgr2=0x7f4c9006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8ed9d700 1 --2- 172.21.15.81:0/2193438040 >> v2:172.21.15.176:3300/0 conn(0x7f4c900b1ae0 0x7f4c9006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8ed9d700 1 -- 172.21.15.81:0/2193438040 >> v1:172.21.15.81:6789/0 conn(0x7f4c9006a4c0 legacy=0x7f4c900d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8ed9d700 1 -- 172.21.15.81:0/2193438040 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9006aca0 con 0x7f4c900cf0e0 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8ed9d700 1 --2- 172.21.15.81:0/2193438040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900cf500 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f4c900b8870 tx=0x7f4c8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c665e49efd74cef5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8d59a700 1 -- 172.21.15.81:0/2193438040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800e070 con 0x7f4c900cf0e0 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8d59a700 1 -- 172.21.15.81:0/2193438040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8800b9c0 con 0x7f4c900cf0e0 2023-11-29T11:22:04.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.006+0000 7f4c8d59a700 1 -- 172.21.15.81:0/2193438040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800bd70 con 0x7f4c900cf0e0 2023-11-29T11:22:04.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- 172.21.15.81:0/2193438040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 msgr2=0x7f4c900cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/2193438040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900cf500 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f4c900b8870 tx=0x7f4c8800b330 comp rx=0 tx=0).stop 2023-11-29T11:22:04.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- 172.21.15.81:0/2193438040 shutdown_connections 2023-11-29T11:22:04.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/2193438040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900cf500 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/2193438040 >> v2:172.21.15.176:3300/0 conn(0x7f4c900b1ae0 0x7f4c9006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- 172.21.15.81:0/2193438040 >> 172.21.15.81:0/2193438040 conn(0x7f4c9009bbd0 msgr2=0x7f4c900b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:04.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- 172.21.15.81:0/2193438040 shutdown_connections 2023-11-29T11:22:04.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- 172.21.15.81:0/2193438040 wait complete. 2023-11-29T11:22:04.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 Processor -- start 2023-11-29T11:22:04.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- start start 2023-11-29T11:22:04.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9006a4c0 0x7f4c900c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c900b1ae0 0x7f4c901f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900c91f0 con 0x7f4c900cf0e0 2023-11-29T11:22:04.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900c8260 con 0x7f4c900b1ae0 2023-11-29T11:22:04.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900c8820 con 0x7f4c9006a4c0 2023-11-29T11:22:04.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53400/0 (socket says 172.21.15.81:53400) 2023-11-29T11:22:04.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.010+0000 7f4c8ed9d700 1 -- 172.21.15.81:0/800987698 learned_addr learned my addr 172.21.15.81:0/800987698 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8e59c700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9006a4c0 0x7f4c900c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8dd9b700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c900b1ae0 0x7f4c901f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8ed9d700 1 -- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9006a4c0 msgr2=0x7f4c900c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8ed9d700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9006a4c0 0x7f4c900c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8ed9d700 1 -- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c900b1ae0 msgr2=0x7f4c901f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8ed9d700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c900b1ae0 0x7f4c901f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8ed9d700 1 -- 172.21.15.81:0/800987698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c88009b30 con 0x7f4c900cf0e0 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8dd9b700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c900b1ae0 0x7f4c901f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8e59c700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9006a4c0 0x7f4c900c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8ed9d700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900c6300 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800b730 tx=0x7f4c88004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c86ffd700 1 -- 172.21.15.81:0/800987698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c880092e0 con 0x7f4c900cf0e0 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c86ffd700 1 -- 172.21.15.81:0/800987698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8801c440 con 0x7f4c900cf0e0 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c86ffd700 1 -- 172.21.15.81:0/800987698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8801c7f0 con 0x7f4c900cf0e0 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900b4380 con 0x7f4c900cf0e0 2023-11-29T11:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9006af80 con 0x7f4c900cf0e0 2023-11-29T11:22:04.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c900b1eb0 con 0x7f4c900cf0e0 2023-11-29T11:22:04.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.014+0000 7f4c86ffd700 1 -- 172.21.15.81:0/800987698 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4c88022030 con 0x7f4c900cf0e0 2023-11-29T11:22:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.018+0000 7f4c86ffd700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c70064ee0 0x7f4c70067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.018+0000 7f4c86ffd700 1 -- 172.21.15.81:0/800987698 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f4c88083970 con 0x7f4c900cf0e0 2023-11-29T11:22:04.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.018+0000 7f4c8e59c700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c70064ee0 0x7f4c70067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.018+0000 7f4c8e59c700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c70064ee0 0x7f4c70067390 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009a20 tx=0x7f4c78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.022+0000 7f4c86ffd700 1 -- 172.21.15.81:0/800987698 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4c88051920 con 0x7f4c900cf0e0 2023-11-29T11:22:04.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.182+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c900c7070 con 0x7f4c900cf0e0 2023-11-29T11:22:04.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.182+0000 7f4c86ffd700 1 -- 172.21.15.81:0/800987698 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c88054f40 con 0x7f4c900cf0e0 2023-11-29T11:22:04.190 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:22:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c70064ee0 msgr2=0x7f4c70067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c70064ee0 0x7f4c70067390 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009a20 tx=0x7f4c78008040 comp rx=0 tx=0).stop 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 msgr2=0x7f4c900c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900c6300 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800b730 tx=0x7f4c88004af0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 shutdown_connections 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4c70064ee0 0x7f4c70067390 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c900cf0e0 0x7f4c900c6300 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c900b1ae0 0x7f4c901f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 --2- 172.21.15.81:0/800987698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c9006a4c0 0x7f4c900c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 >> 172.21.15.81:0/800987698 conn(0x7f4c9009bbd0 msgr2=0x7f4c900b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 shutdown_connections 2023-11-29T11:22:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.186+0000 7f4c8f59e700 1 -- 172.21.15.81:0/800987698 wait complete. 2023-11-29T11:22:04.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:22:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.318+0000 7fac62f41700 1 Processor -- start 2023-11-29T11:22:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.318+0000 7fac62f41700 1 -- start start 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 0x7fac5c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac5c0ac230 0x7fac5c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c06a490 con 0x7fac5c15a060 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0b2250 con 0x7fac5c0ac230 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c06a770 con 0x7fac5c15a430 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62740700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac5c0ac230 0x7fac5c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62740700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac5c0ac230 0x7fac5c0cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53404/0 (socket says 172.21.15.81:53404) 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62740700 1 -- 172.21.15.81:0/1888441330 learned_addr learned my addr 172.21.15.81:0/1888441330 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac61f3f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fac5c15a060 0x7fac5c069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40188/0 (socket says 172.21.15.81:40188) 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac6173e700 1 --2- 172.21.15.81:0/1888441330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 0x7fac5c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62740700 1 -- 172.21.15.81:0/1888441330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 msgr2=0x7fac5c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62740700 1 --2- 172.21.15.81:0/1888441330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 0x7fac5c0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62740700 1 -- 172.21.15.81:0/1888441330 >> v1:172.21.15.81:6789/0 conn(0x7fac5c15a060 legacy=0x7fac5c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62740700 1 -- 172.21.15.81:0/1888441330 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c06aa50 con 0x7fac5c0ac230 2023-11-29T11:22:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62740700 1 --2- 172.21.15.81:0/1888441330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c0cc830 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009e50 tx=0x7fac4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae786c6a0e6e2e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac60f3d700 1 -- 172.21.15.81:0/1888441330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00e070 con 0x7fac5c0ac230 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac60f3d700 1 -- 172.21.15.81:0/1888441330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c00b9c0 con 0x7fac5c0ac230 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac60f3d700 1 -- 172.21.15.81:0/1888441330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00bd70 con 0x7fac5c0ac230 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 -- 172.21.15.81:0/1888441330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 msgr2=0x7fac5c0cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 --2- 172.21.15.81:0/1888441330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c0cc830 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009e50 tx=0x7fac4c00b330 comp rx=0 tx=0).stop 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 -- 172.21.15.81:0/1888441330 shutdown_connections 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 --2- 172.21.15.81:0/1888441330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c0cc830 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 --2- 172.21.15.81:0/1888441330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 0x7fac5c0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 -- 172.21.15.81:0/1888441330 >> 172.21.15.81:0/1888441330 conn(0x7fac5c0cae70 msgr2=0x7fac5c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 -- 172.21.15.81:0/1888441330 shutdown_connections 2023-11-29T11:22:04.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.322+0000 7fac62f41700 1 -- 172.21.15.81:0/1888441330 wait complete. 2023-11-29T11:22:04.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.326+0000 7fac62f41700 1 Processor -- start 2023-11-29T11:22:04.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.326+0000 7fac62f41700 1 -- start start 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.326+0000 7fac62f41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62f41700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c15a060 0x7fac5c14f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62f41700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 0x7fac5c099390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62f41700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c14fc20 con 0x7fac5c0ac230 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62f41700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15adf0 con 0x7fac5c15a060 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c15a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53414/0 (socket says 172.21.15.81:53414) 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 -- 172.21.15.81:0/4166808220 learned_addr learned my addr 172.21.15.81:0/4166808220 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c14f6d0 con 0x7fac5c15a430 2023-11-29T11:22:04.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac6173e700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c15a060 0x7fac5c14f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62740700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 0x7fac5c099390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 -- 172.21.15.81:0/4166808220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 msgr2=0x7fac5c099390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 0x7fac5c099390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 -- 172.21.15.81:0/4166808220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c15a060 msgr2=0x7fac5c14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c15a060 0x7fac5c14f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 -- 172.21.15.81:0/4166808220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c009b30 con 0x7fac5c0ac230 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac61f3f700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c15a8b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c4d0 tx=0x7fac5000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac5a7fc700 1 -- 172.21.15.81:0/4166808220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50005cd0 con 0x7fac5c0ac230 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac5a7fc700 1 -- 172.21.15.81:0/4166808220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50005e30 con 0x7fac5c0ac230 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c06b010 con 0x7fac5c0ac230 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac5a7fc700 1 -- 172.21.15.81:0/4166808220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac500072d0 con 0x7fac5c0ac230 2023-11-29T11:22:04.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c06ad30 con 0x7fac5c0ac230 2023-11-29T11:22:04.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c06b530 con 0x7fac5c0ac230 2023-11-29T11:22:04.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.330+0000 7fac5a7fc700 1 -- 172.21.15.81:0/4166808220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fac50019030 con 0x7fac5c0ac230 2023-11-29T11:22:04.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.334+0000 7fac5a7fc700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac48064ee0 0x7fac48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.334+0000 7fac6173e700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac48064ee0 0x7fac48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.334+0000 7fac5a7fc700 1 -- 172.21.15.81:0/4166808220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fac50081230 con 0x7fac5c0ac230 2023-11-29T11:22:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.334+0000 7fac6173e700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac48064ee0 0x7fac48067390 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fac5c071dc0 tx=0x7fac54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.338+0000 7fac5a7fc700 1 -- 172.21.15.81:0/4166808220 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fac5004a400 con 0x7fac5c0ac230 2023-11-29T11:22:04.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.490+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac5c072500 con 0x7fac5c0ac230 2023-11-29T11:22:04.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.490+0000 7fac5a7fc700 1 -- 172.21.15.81:0/4166808220 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac50017020 con 0x7fac5c0ac230 2023-11-29T11:22:04.497 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:22:04.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac48064ee0 msgr2=0x7fac48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac48064ee0 0x7fac48067390 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fac5c071dc0 tx=0x7fac54008040 comp rx=0 tx=0).stop 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 msgr2=0x7fac5c15a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c15a8b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c4d0 tx=0x7fac5000c890 comp rx=0 tx=0).stop 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 shutdown_connections 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fac48064ee0 0x7fac48067390 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac5c15a430 0x7fac5c099390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac5c15a060 0x7fac5c14f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 --2- 172.21.15.81:0/4166808220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac5c0ac230 0x7fac5c15a8b0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 >> 172.21.15.81:0/4166808220 conn(0x7fac5c0cae70 msgr2=0x7fac5c159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 shutdown_connections 2023-11-29T11:22:04.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.494+0000 7fac62f41700 1 -- 172.21.15.81:0/4166808220 wait complete. 2023-11-29T11:22:04.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:04.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d6ad3b700 1 Processor -- start 2023-11-29T11:22:04.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d6ad3b700 1 -- start start 2023-11-29T11:22:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d6ad3b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d6406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d6ad3b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6415c6d0 con 0x7f9d640b4c10 2023-11-29T11:22:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d6ad3b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6406a9a0 con 0x7f9d6406a530 2023-11-29T11:22:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d6ad3b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6406ac60 con 0x7f9d640cf050 2023-11-29T11:22:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d6a53a700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9d640b4c10 0x7f9d640cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40198/0 (socket says 172.21.15.81:40198) 2023-11-29T11:22:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d6a53a700 1 -- 172.21.15.81:0/1420183110 learned_addr learned my addr 172.21.15.81:0/1420183110 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:04.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d69d39700 1 --2- 172.21.15.81:0/1420183110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d6406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d68d37700 1 -- 172.21.15.81:0/1420183110 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463159383 0 0) 0x7f9d6406a9a0 con 0x7f9d6406a530 2023-11-29T11:22:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d69d39700 1 -- 172.21.15.81:0/1420183110 >> v1:172.21.15.176:6789/0 conn(0x7f9d6406a530 legacy=0x7f9d640cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d69d39700 1 -- 172.21.15.81:0/1420183110 >> v1:172.21.15.81:6789/0 conn(0x7f9d640b4c10 legacy=0x7f9d640cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d69d39700 1 -- 172.21.15.81:0/1420183110 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6406af40 con 0x7f9d640cf050 2023-11-29T11:22:04.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d69d39700 1 --2- 172.21.15.81:0/1420183110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d6406d7d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009880 tx=0x7f9d54009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ad1e852ea9df80 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d68d37700 1 -- 172.21.15.81:0/1420183110 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54011830 con 0x7f9d640cf050 2023-11-29T11:22:04.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d68d37700 1 -- 172.21.15.81:0/1420183110 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54011990 con 0x7f9d640cf050 2023-11-29T11:22:04.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.618+0000 7f9d68d37700 1 -- 172.21.15.81:0/1420183110 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54011d20 con 0x7f9d640cf050 2023-11-29T11:22:04.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1420183110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 msgr2=0x7f9d6406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 --2- 172.21.15.81:0/1420183110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d6406d7d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009880 tx=0x7f9d54009b90 comp rx=0 tx=0).stop 2023-11-29T11:22:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1420183110 shutdown_connections 2023-11-29T11:22:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 --2- 172.21.15.81:0/1420183110 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d6406d7d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1420183110 >> 172.21.15.81:0/1420183110 conn(0x7f9d6409bb30 msgr2=0x7f9d640b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1420183110 shutdown_connections 2023-11-29T11:22:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1420183110 wait complete. 2023-11-29T11:22:04.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 Processor -- start 2023-11-29T11:22:04.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- start start 2023-11-29T11:22:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d6406a530 0x7f9d6409fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d640b4c10 0x7f9d641f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d640b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640a0290 con 0x7f9d640b4c10 2023-11-29T11:22:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640d09b0 con 0x7f9d6406a530 2023-11-29T11:22:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6ad3b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640c6300 con 0x7f9d640cf050 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69538700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d640b4c10 0x7f9d641f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69538700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d640b4c10 0x7f9d641f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53428/0 (socket says 172.21.15.81:53428) 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69538700 1 -- 172.21.15.81:0/1780306483 learned_addr learned my addr 172.21.15.81:0/1780306483 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6a53a700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d640b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69d39700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d6406a530 0x7f9d6409fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69538700 1 -- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 msgr2=0x7f9d640b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69538700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d640b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69538700 1 -- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d6406a530 msgr2=0x7f9d6409fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69538700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d6406a530 0x7f9d6409fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d69538700 1 -- 172.21.15.81:0/1780306483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540094b0 con 0x7f9d640b4c10 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.622+0000 7f9d6a53a700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d640b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d69538700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d640b4c10 0x7f9d641f5030 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800cc50 tx=0x7f9d5800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d627fc700 1 -- 172.21.15.81:0/1780306483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d58003e50 con 0x7f9d640b4c10 2023-11-29T11:22:04.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d627fc700 1 -- 172.21.15.81:0/1780306483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5800a770 con 0x7f9d640b4c10 2023-11-29T11:22:04.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d640b46f0 con 0x7f9d640b4c10 2023-11-29T11:22:04.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d627fc700 1 -- 172.21.15.81:0/1780306483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5800ab20 con 0x7f9d640b4c10 2023-11-29T11:22:04.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d640b4410 con 0x7f9d640b4c10 2023-11-29T11:22:04.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d627fc700 1 -- 172.21.15.81:0/1780306483 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d58019030 con 0x7f9d640b4c10 2023-11-29T11:22:04.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d627fc700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d50064ee0 0x7f9d50067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d627fc700 1 -- 172.21.15.81:0/1780306483 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f9d58081a60 con 0x7f9d640b4c10 2023-11-29T11:22:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d69d39700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d50064ee0 0x7f9d50067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.626+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6406b220 con 0x7f9d640b4c10 2023-11-29T11:22:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.630+0000 7f9d69d39700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d50064ee0 0x7f9d50067390 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9d540090b0 tx=0x7f9d54008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.634+0000 7f9d627fc700 1 -- 172.21.15.81:0/1780306483 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9d5804fa10 con 0x7f9d640b4c10 2023-11-29T11:22:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.830+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d640d0b20 con 0x7f9d640b4c10 2023-11-29T11:22:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.830+0000 7f9d627fc700 1 -- 172.21.15.81:0/1780306483 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f9d58017020 con 0x7f9d640b4c10 2023-11-29T11:22:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:04.837 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:21:25.188265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8610":{"gid":8610,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/2322035611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2322035611},{"type":"v1","addr":"172.21.15.81:6837","nonce":2322035611}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:22:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d50064ee0 msgr2=0x7f9d50067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d50064ee0 0x7f9d50067390 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9d540090b0 tx=0x7f9d54008030 comp rx=0 tx=0).stop 2023-11-29T11:22:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d640b4c10 msgr2=0x7f9d641f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d640b4c10 0x7f9d641f5030 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800cc50 tx=0x7f9d5800cf60 comp rx=0 tx=0).stop 2023-11-29T11:22:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 shutdown_connections 2023-11-29T11:22:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9d50064ee0 0x7f9d50067390 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d640cf050 0x7f9d640b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d640b4c10 0x7f9d641f5030 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 --2- 172.21.15.81:0/1780306483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d6406a530 0x7f9d6409fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 >> 172.21.15.81:0/1780306483 conn(0x7f9d6409bb30 msgr2=0x7f9d6415be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 shutdown_connections 2023-11-29T11:22:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.834+0000 7f9d6ad3b700 1 -- 172.21.15.81:0/1780306483 wait complete. 2023-11-29T11:22:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-11-29T11:22:04.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 Processor -- start 2023-11-29T11:22:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- start start 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f29841606b0 0x7f29840c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29840ad610 0x7f29840c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840cae70 con 0x7f29840ceef0 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29840cbc10 con 0x7f29840ad610 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29840cb130 con 0x7f29841606b0 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989520700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29840ad610 0x7f29840c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989520700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29840ad610 0x7f29840c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53444/0 (socket says 172.21.15.81:53444) 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989520700 1 -- 172.21.15.81:0/385636178 learned_addr learned my addr 172.21.15.81:0/385636178 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2988d1f700 1 --2- 172.21.15.81:0/385636178 >> v2:172.21.15.176:3300/0 conn(0x7f29841606b0 0x7f29840c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989520700 1 -- 172.21.15.81:0/385636178 >> v2:172.21.15.176:3300/0 conn(0x7f29841606b0 msgr2=0x7f29840c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989520700 1 --2- 172.21.15.81:0/385636178 >> v2:172.21.15.176:3300/0 conn(0x7f29841606b0 0x7f29840c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989520700 1 -- 172.21.15.81:0/385636178 >> v1:172.21.15.176:6789/0 conn(0x7f29840ceef0 legacy=0x7f2984164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989520700 1 -- 172.21.15.81:0/385636178 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840cb410 con 0x7f29840ad610 2023-11-29T11:22:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989520700 1 --2- 172.21.15.81:0/385636178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ad610 0x7f29840c18f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f29840b34a0 tx=0x7f297c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e515add652c81c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f297b7fe700 1 -- 172.21.15.81:0/385636178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00e070 con 0x7f29840ad610 2023-11-29T11:22:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f297b7fe700 1 -- 172.21.15.81:0/385636178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c00b9c0 con 0x7f29840ad610 2023-11-29T11:22:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f297b7fe700 1 -- 172.21.15.81:0/385636178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00bd70 con 0x7f29840ad610 2023-11-29T11:22:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- 172.21.15.81:0/385636178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ad610 msgr2=0x7f29840c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 --2- 172.21.15.81:0/385636178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ad610 0x7f29840c18f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f29840b34a0 tx=0x7f297c00b330 comp rx=0 tx=0).stop 2023-11-29T11:22:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- 172.21.15.81:0/385636178 shutdown_connections 2023-11-29T11:22:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 --2- 172.21.15.81:0/385636178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ad610 0x7f29840c18f0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 --2- 172.21.15.81:0/385636178 >> v2:172.21.15.176:3300/0 conn(0x7f29841606b0 0x7f29840c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- 172.21.15.81:0/385636178 >> 172.21.15.81:0/385636178 conn(0x7f29840ce3e0 msgr2=0x7f29840ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- 172.21.15.81:0/385636178 shutdown_connections 2023-11-29T11:22:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.962+0000 7f2989d21700 1 -- 172.21.15.81:0/385636178 wait complete. 2023-11-29T11:22:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 Processor -- start 2023-11-29T11:22:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 -- start start 2023-11-29T11:22:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29840ad610 0x7f298415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ceef0 0x7f2984070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29841606b0 0x7f29840c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29840c2e20 con 0x7f29840ceef0 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29840c2210 con 0x7f29840ad610 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29840c24f0 con 0x7f29841606b0 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ceef0 0x7f2984070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ceef0 0x7f2984070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53448/0 (socket says 172.21.15.81:53448) 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 -- 172.21.15.81:0/4234189135 learned_addr learned my addr 172.21.15.81:0/4234189135 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989520700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29841606b0 0x7f29840c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 -- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29841606b0 msgr2=0x7f29840c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2988d1f700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29840ad610 0x7f298415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29841606b0 0x7f29840c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 -- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29840ad610 msgr2=0x7f298415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29840ad610 0x7f298415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 -- 172.21.15.81:0/4234189135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c009b30 con 0x7f29840ceef0 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989520700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29841606b0 0x7f29840c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2988d1f700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29840ad610 0x7f298415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f297bfff700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ceef0 0x7f2984070a00 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f297400c500 tx=0x7f297400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f29797fa700 1 -- 172.21.15.81:0/4234189135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29740052d0 con 0x7f29840ceef0 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f29797fa700 1 -- 172.21.15.81:0/4234189135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974005430 con 0x7f29840ceef0 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298406ac50 con 0x7f29840ceef0 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f29797fa700 1 -- 172.21.15.81:0/4234189135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29740055a0 con 0x7f29840ceef0 2023-11-29T11:22:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.966+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29840cb6f0 con 0x7f29840ceef0 2023-11-29T11:22:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.970+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29840b36c0 con 0x7f29840ceef0 2023-11-29T11:22:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.970+0000 7f29797fa700 1 -- 172.21.15.81:0/4234189135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2974019030 con 0x7f29840ceef0 2023-11-29T11:22:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.970+0000 7f29797fa700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2970064ee0 0x7f2970067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.970+0000 7f2988d1f700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2970064ee0 0x7f2970067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.970+0000 7f29797fa700 1 -- 172.21.15.81:0/4234189135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f29740813b0 con 0x7f29840ceef0 2023-11-29T11:22:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.970+0000 7f2988d1f700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2970064ee0 0x7f2970067390 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2980009840 tx=0x7f2980008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:04.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:04.978+0000 7f29797fa700 1 -- 172.21.15.81:0/4234189135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f297404f360 con 0x7f29840ceef0 2023-11-29T11:22:05.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.134+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2984072500 con 0x7f29840ceef0 2023-11-29T11:22:05.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.134+0000 7f29797fa700 1 -- 172.21.15.81:0/4234189135 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18228 (secure 0 0 0) 0x7f2974052980 con 0x7f29840ceef0 2023-11-29T11:22:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:05.142 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":98,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:21:20.356075+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/353227086":"2023-11-30T11:21:20.356024+0000","172.21.15.81:6836/353227086":"2023-11-30T11:21:20.356024+0000","172.21.15.176:6833/1691706444":"2023-11-30T11:19:58.895424+0000","172.21.15.176:6832/1691706444":"2023-11-30T11:19:58.895424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2970064ee0 msgr2=0x7f2970067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2970064ee0 0x7f2970067390 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2980009840 tx=0x7f2980008040 comp rx=0 tx=0).stop 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ceef0 msgr2=0x7f2984070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ceef0 0x7f2984070a00 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f297400c500 tx=0x7f297400c8c0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 shutdown_connections 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2970064ee0 0x7f2970067390 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29841606b0 0x7f29840c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29840ceef0 0x7f2984070a00 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 --2- 172.21.15.81:0/4234189135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29840ad610 0x7f298415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 >> 172.21.15.81:0/4234189135 conn(0x7f29840ce3e0 msgr2=0x7f298406bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:05.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 shutdown_connections 2023-11-29T11:22:05.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.138+0000 7f2989d21700 1 -- 172.21.15.81:0/4234189135 wait complete. 2023-11-29T11:22:05.156 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T11:22:05.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a3fff700 1 Processor -- start 2023-11-29T11:22:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a3fff700 1 -- start start 2023-11-29T11:22:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a3fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f65a40b1ca0 0x7f65a40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a40d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a3fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a40cf070 con 0x7f65a406a330 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a3fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40d3140 con 0x7f65a40b1ca0 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40b2070 con 0x7f65a40d2780 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a27fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f65a406a330 0x7f65a40cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40212/0 (socket says 172.21.15.81:40212) 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a27fc700 1 -- 172.21.15.81:0/1395392737 learned_addr learned my addr 172.21.15.81:0/1395392737 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a37fe700 1 --2- 172.21.15.81:0/1395392737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a40d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a2ffd700 1 --2- 172.21.15.81:0/1395392737 >> v2:172.21.15.176:3300/0 conn(0x7f65a40b1ca0 0x7f65a40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a1ffb700 1 -- 172.21.15.81:0/1395392737 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536217763 0 0) 0x7f65a40cf070 con 0x7f65a406a330 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a1ffb700 1 -- 172.21.15.81:0/1395392737 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f658c0035d0 con 0x7f65a406a330 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a37fe700 1 -- 172.21.15.81:0/1395392737 >> v2:172.21.15.176:3300/0 conn(0x7f65a40b1ca0 msgr2=0x7f65a40b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a37fe700 1 --2- 172.21.15.81:0/1395392737 >> v2:172.21.15.176:3300/0 conn(0x7f65a40b1ca0 0x7f65a40b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a37fe700 1 -- 172.21.15.81:0/1395392737 >> v1:172.21.15.81:6789/0 conn(0x7f65a406a330 legacy=0x7f65a40cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a37fe700 1 -- 172.21.15.81:0/1395392737 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a406a8a0 con 0x7f65a40d2780 2023-11-29T11:22:05.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.262+0000 7f65a2ffd700 1 --2- 172.21.15.81:0/1395392737 >> v2:172.21.15.176:3300/0 conn(0x7f65a40b1ca0 0x7f65a40b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:05.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a37fe700 1 --2- 172.21.15.81:0/1395392737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a40d2c00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f659c009d90 tx=0x7f659c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d14c6c0e9b685dc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a1ffb700 1 -- 172.21.15.81:0/1395392737 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00e070 con 0x7f65a40d2780 2023-11-29T11:22:05.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a1ffb700 1 -- 172.21.15.81:0/1395392737 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c00bb20 con 0x7f65a40d2780 2023-11-29T11:22:05.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a1ffb700 1 -- 172.21.15.81:0/1395392737 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00be90 con 0x7f65a40d2780 2023-11-29T11:22:05.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 -- 172.21.15.81:0/1395392737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 msgr2=0x7f65a40d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 --2- 172.21.15.81:0/1395392737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a40d2c00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f659c009d90 tx=0x7f659c00b330 comp rx=0 tx=0).stop 2023-11-29T11:22:05.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 -- 172.21.15.81:0/1395392737 shutdown_connections 2023-11-29T11:22:05.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 --2- 172.21.15.81:0/1395392737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a40d2c00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 --2- 172.21.15.81:0/1395392737 >> v2:172.21.15.176:3300/0 conn(0x7f65a40b1ca0 0x7f65a40b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 -- 172.21.15.81:0/1395392737 >> 172.21.15.81:0/1395392737 conn(0x7f65a40b5740 msgr2=0x7f65a40b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:05.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 -- 172.21.15.81:0/1395392737 shutdown_connections 2023-11-29T11:22:05.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 -- 172.21.15.81:0/1395392737 wait complete. 2023-11-29T11:22:05.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 Processor -- start 2023-11-29T11:22:05.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.266+0000 7f65a3fff700 1 -- start start 2023-11-29T11:22:05.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a406a330 0x7f65a40c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a40b1ca0 0x7f65a41f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a41f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40cb830 con 0x7f65a40b1ca0 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4159640 con 0x7f65a406a330 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40c8100 con 0x7f65a40d2780 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a40b1ca0 0x7f65a41f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a40b1ca0 0x7f65a41f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53460/0 (socket says 172.21.15.81:53460) 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 -- 172.21.15.81:0/2878180009 learned_addr learned my addr 172.21.15.81:0/2878180009 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a2ffd700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a406a330 0x7f65a40c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a37fe700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a41f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 -- 172.21.15.81:0/2878180009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 msgr2=0x7f65a41f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a41f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 -- 172.21.15.81:0/2878180009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a406a330 msgr2=0x7f65a40c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a406a330 0x7f65a40c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 -- 172.21.15.81:0/2878180009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65980094b0 con 0x7f65a40b1ca0 2023-11-29T11:22:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a27fc700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a40b1ca0 0x7f65a41f1e10 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f659400c4d0 tx=0x7f659400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f658b7fe700 1 -- 172.21.15.81:0/2878180009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940011d0 con 0x7f65a40b1ca0 2023-11-29T11:22:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f658b7fe700 1 -- 172.21.15.81:0/2878180009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594005d90 con 0x7f65a40b1ca0 2023-11-29T11:22:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f658b7fe700 1 -- 172.21.15.81:0/2878180009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940072d0 con 0x7f65a40b1ca0 2023-11-29T11:22:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c009a70 con 0x7f65a40b1ca0 2023-11-29T11:22:05.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a406ae60 con 0x7f65a40b1ca0 2023-11-29T11:22:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a406ab80 con 0x7f65a40b1ca0 2023-11-29T11:22:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f658b7fe700 1 -- 172.21.15.81:0/2878180009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6594019030 con 0x7f65a40b1ca0 2023-11-29T11:22:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.270+0000 7f658b7fe700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6590064ee0 0x7f6590067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.274+0000 7f658b7fe700 1 -- 172.21.15.81:0/2878180009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f6594081280 con 0x7f65a40b1ca0 2023-11-29T11:22:05.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.274+0000 7f65a2ffd700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6590064ee0 0x7f6590067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.274+0000 7f65a2ffd700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6590064ee0 0x7f6590067390 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6598009c70 tx=0x7f6598008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.278+0000 7f658b7fe700 1 -- 172.21.15.81:0/2878180009 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f659404a400 con 0x7f65a40b1ca0 2023-11-29T11:22:05.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.474+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65a406b140 con 0x7f65a40b1ca0 2023-11-29T11:22:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.474+0000 7f658b7fe700 1 -- 172.21.15.81:0/2878180009 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f659404f2e0 con 0x7f65a40b1ca0 2023-11-29T11:22:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:05.482 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:21:25.188265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8610":{"gid":8610,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/2322035611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2322035611},{"type":"v1","addr":"172.21.15.81:6837","nonce":2322035611}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6590064ee0 msgr2=0x7f6590067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6590064ee0 0x7f6590067390 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6598009c70 tx=0x7f6598008040 comp rx=0 tx=0).stop 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a40b1ca0 msgr2=0x7f65a41f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a40b1ca0 0x7f65a41f1e10 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f659400c4d0 tx=0x7f659400c890 comp rx=0 tx=0).stop 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 shutdown_connections 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6590064ee0 0x7f6590067390 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65a40d2780 0x7f65a41f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a40b1ca0 0x7f65a41f1e10 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 --2- 172.21.15.81:0/2878180009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65a406a330 0x7f65a40c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 >> 172.21.15.81:0/2878180009 conn(0x7f65a40b5740 msgr2=0x7f65a415bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 shutdown_connections 2023-11-29T11:22:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.478+0000 7f65a3fff700 1 -- 172.21.15.81:0/2878180009 wait complete. 2023-11-29T11:22:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-11-29T11:22:05.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 Processor -- start 2023-11-29T11:22:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- start start 2023-11-29T11:22:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd898158e60 0x7fd8980c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd8980cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8980cd8f0 con 0x7fd8980ad490 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980add00 con 0x7fd898158e60 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980cc4f0 con 0x7fd8980cb460 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e029700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd898158e60 0x7fd8980c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e029700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd898158e60 0x7fd8980c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53464/0 (socket says 172.21.15.81:53464) 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e029700 1 -- 172.21.15.81:0/1158401076 learned_addr learned my addr 172.21.15.81:0/1158401076 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e82a700 1 --2- 172.21.15.81:0/1158401076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd8980cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e029700 1 -- 172.21.15.81:0/1158401076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 msgr2=0x7fd8980cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e029700 1 --2- 172.21.15.81:0/1158401076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd8980cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e029700 1 -- 172.21.15.81:0/1158401076 >> v1:172.21.15.176:6789/0 conn(0x7fd8980ad490 legacy=0x7fd8980cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e029700 1 -- 172.21.15.81:0/1158401076 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89806dc60 con 0x7fd898158e60 2023-11-29T11:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89e029700 1 --2- 172.21.15.81:0/1158401076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd8980c8a30 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd894009910 tx=0x7fd894009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24989b28abb9dc server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89d027700 1 -- 172.21.15.81:0/1158401076 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894011830 con 0x7fd898158e60 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89d027700 1 -- 172.21.15.81:0/1158401076 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894011990 con 0x7fd898158e60 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89d027700 1 -- 172.21.15.81:0/1158401076 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894011d40 con 0x7fd898158e60 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- 172.21.15.81:0/1158401076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 msgr2=0x7fd8980c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 --2- 172.21.15.81:0/1158401076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd8980c8a30 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd894009910 tx=0x7fd894009c20 comp rx=0 tx=0).stop 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- 172.21.15.81:0/1158401076 shutdown_connections 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 --2- 172.21.15.81:0/1158401076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd8980cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 --2- 172.21.15.81:0/1158401076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd8980c8a30 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- 172.21.15.81:0/1158401076 >> 172.21.15.81:0/1158401076 conn(0x7fd8980ce3e0 msgr2=0x7fd8980ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- 172.21.15.81:0/1158401076 shutdown_connections 2023-11-29T11:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.602+0000 7fd89f02b700 1 -- 172.21.15.81:0/1158401076 wait complete. 2023-11-29T11:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 Processor -- start 2023-11-29T11:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 -- start start 2023-11-29T11:22:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8980ad490 0x7fd898071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd898152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd898155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd898152a10 con 0x7fd898158e60 2023-11-29T11:22:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980707c0 con 0x7fd8980ad490 2023-11-29T11:22:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd898070aa0 con 0x7fd8980cb460 2023-11-29T11:22:05.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd898155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd898155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53474/0 (socket says 172.21.15.81:53474) 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 -- 172.21.15.81:0/22054254 learned_addr learned my addr 172.21.15.81:0/22054254 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e029700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8980ad490 0x7fd898071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89d828700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd898152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 -- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 msgr2=0x7fd898152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd898152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 -- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8980ad490 msgr2=0x7fd898071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8980ad490 0x7fd898071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 -- 172.21.15.81:0/22054254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894009570 con 0x7fd898158e60 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89d828700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd898152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89e82a700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd898155c10 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd89000efc0 tx=0x7fd89000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd88affd700 1 -- 172.21.15.81:0/22054254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890009ea0 con 0x7fd898158e60 2023-11-29T11:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd88affd700 1 -- 172.21.15.81:0/22054254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89000f040 con 0x7fd898158e60 2023-11-29T11:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd88affd700 1 -- 172.21.15.81:0/22054254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890014480 con 0x7fd898158e60 2023-11-29T11:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd898159230 con 0x7fd898158e60 2023-11-29T11:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.606+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8980cde90 con 0x7fd898158e60 2023-11-29T11:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.610+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89806d6a0 con 0x7fd898158e60 2023-11-29T11:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.610+0000 7fd88affd700 1 -- 172.21.15.81:0/22054254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd8900145e0 con 0x7fd898158e60 2023-11-29T11:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.610+0000 7fd88affd700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd87c064ee0 0x7fd87c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.610+0000 7fd89e029700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd87c064ee0 0x7fd87c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.610+0000 7fd88affd700 1 -- 172.21.15.81:0/22054254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fd890082d30 con 0x7fd898158e60 2023-11-29T11:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.610+0000 7fd89e029700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd87c064ee0 0x7fd87c067390 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd894014040 tx=0x7fd894008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.618+0000 7fd88affd700 1 -- 172.21.15.81:0/22054254 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd890050ce0 con 0x7fd898158e60 2023-11-29T11:22:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.814+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd89806e270 con 0x7fd898158e60 2023-11-29T11:22:05.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.814+0000 7fd88affd700 1 -- 172.21.15.81:0/22054254 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4657 (secure 0 0 0) 0x7fd890018090 con 0x7fd898158e60 2023-11-29T11:22:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:05.822 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:19:39.666846+0000","modified":"2023-11-29T11:21:25.188265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8610":{"gid":8610,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6837/2322035611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2322035611},{"type":"v1","addr":"172.21.15.81:6837","nonce":2322035611}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd87c064ee0 msgr2=0x7fd87c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd87c064ee0 0x7fd87c067390 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd894014040 tx=0x7fd894008030 comp rx=0 tx=0).stop 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 msgr2=0x7fd898155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd898155c10 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd89000efc0 tx=0x7fd89000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 shutdown_connections 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd87c064ee0 0x7fd87c067390 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd898158e60 0x7fd898155c10 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8980cb460 0x7fd898152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 --2- 172.21.15.81:0/22054254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8980ad490 0x7fd898071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 >> 172.21.15.81:0/22054254 conn(0x7fd8980ce3e0 msgr2=0x7fd8980c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 shutdown_connections 2023-11-29T11:22:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.818+0000 7fd89f02b700 1 -- 172.21.15.81:0/22054254 wait complete. 2023-11-29T11:22:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2023-11-29T11:22:05.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:05.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6f4a73700 1 Processor -- start 2023-11-29T11:22:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6f4a73700 1 -- start start 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6f4a73700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6f00cd5d0 0x7fe6f00cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6f4a73700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe6f00cf100 0x7fe6f015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6f4a73700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00ce730 con 0x7fe6f00adfd0 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6f4a73700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00c9b00 con 0x7fe6f00cd5d0 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6f4a73700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00c9540 con 0x7fe6f00cf100 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6eeffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6f00cd5d0 0x7fe6f00cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6ef7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe6f00adfd0 0x7fe6f0069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40226/0 (socket says 172.21.15.81:40226) 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6eeffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6f00cd5d0 0x7fe6f00cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53490/0 (socket says 172.21.15.81:53490) 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6ef7fe700 1 -- 172.21.15.81:0/1435113166 learned_addr learned my addr 172.21.15.81:0/1435113166 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6effff700 1 --2- 172.21.15.81:0/1435113166 >> v2:172.21.15.176:3300/0 conn(0x7fe6f00cf100 0x7fe6f015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6eeffd700 1 -- 172.21.15.81:0/1435113166 >> v2:172.21.15.176:3300/0 conn(0x7fe6f00cf100 msgr2=0x7fe6f015ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6eeffd700 1 --2- 172.21.15.81:0/1435113166 >> v2:172.21.15.176:3300/0 conn(0x7fe6f00cf100 0x7fe6f015ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6eeffd700 1 -- 172.21.15.81:0/1435113166 >> v1:172.21.15.81:6789/0 conn(0x7fe6f00adfd0 legacy=0x7fe6f0069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6eeffd700 1 -- 172.21.15.81:0/1435113166 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00c9820 con 0x7fe6f00cd5d0 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.938+0000 7fe6eeffd700 1 --2- 172.21.15.81:0/1435113166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cd5d0 0x7fe6f00cebc0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00709a0 tx=0x7fe6e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbd1e907f528d44 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6ee7fc700 1 -- 172.21.15.81:0/1435113166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0011830 con 0x7fe6f00cd5d0 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6ee7fc700 1 -- 172.21.15.81:0/1435113166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e0011990 con 0x7fe6f00cd5d0 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6ee7fc700 1 -- 172.21.15.81:0/1435113166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0011d40 con 0x7fe6f00cd5d0 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 -- 172.21.15.81:0/1435113166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cd5d0 msgr2=0x7fe6f00cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/1435113166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cd5d0 0x7fe6f00cebc0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00709a0 tx=0x7fe6e0009b30 comp rx=0 tx=0).stop 2023-11-29T11:22:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 -- 172.21.15.81:0/1435113166 shutdown_connections 2023-11-29T11:22:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/1435113166 >> v2:172.21.15.176:3300/0 conn(0x7fe6f00cf100 0x7fe6f015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/1435113166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cd5d0 0x7fe6f00cebc0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 -- 172.21.15.81:0/1435113166 >> 172.21.15.81:0/1435113166 conn(0x7fe6f006c660 msgr2=0x7fe6f006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 -- 172.21.15.81:0/1435113166 shutdown_connections 2023-11-29T11:22:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 -- 172.21.15.81:0/1435113166 wait complete. 2023-11-29T11:22:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 Processor -- start 2023-11-29T11:22:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 -- start start 2023-11-29T11:22:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f00adfd0 0x7fe6f0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f00cd5d0 0x7fe6f00c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.942+0000 7fe6f4a73700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cf100 0x7fe6f00b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6f4a73700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00ad1d0 con 0x7fe6f00cf100 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6f4a73700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f01f1940 con 0x7fe6f00cd5d0 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6f4a73700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00af990 con 0x7fe6f00adfd0 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cf100 0x7fe6f00b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cf100 0x7fe6f00b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53498/0 (socket says 172.21.15.81:53498) 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6ef7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f00adfd0 0x7fe6f0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 -- 172.21.15.81:0/2918204831 learned_addr learned my addr 172.21.15.81:0/2918204831 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6eeffd700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f00cd5d0 0x7fe6f00c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 -- 172.21.15.81:0/2918204831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f00adfd0 msgr2=0x7fe6f0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f00adfd0 0x7fe6f0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 -- 172.21.15.81:0/2918204831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f00cd5d0 msgr2=0x7fe6f00c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f00cd5d0 0x7fe6f00c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 -- 172.21.15.81:0/2918204831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00094b0 con 0x7fe6f00cf100 2023-11-29T11:22:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6effff700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cf100 0x7fe6f00b07b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8007e60 tx=0x7fe6e800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6d7fff700 1 -- 172.21.15.81:0/2918204831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800ed30 con 0x7fe6f00cf100 2023-11-29T11:22:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6d7fff700 1 -- 172.21.15.81:0/2918204831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e8014420 con 0x7fe6f00cf100 2023-11-29T11:22:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f00cf580 con 0x7fe6f00cf100 2023-11-29T11:22:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6d7fff700 1 -- 172.21.15.81:0/2918204831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80147d0 con 0x7fe6f00cf100 2023-11-29T11:22:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.946+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f00ce3c0 con 0x7fe6f00cf100 2023-11-29T11:22:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.950+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f00cf710 con 0x7fe6f00cf100 2023-11-29T11:22:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.950+0000 7fe6d7fff700 1 -- 172.21.15.81:0/2918204831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe6e8012050 con 0x7fe6f00cf100 2023-11-29T11:22:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.950+0000 7fe6d7fff700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6dc064ee0 0x7fe6dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:05.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.950+0000 7fe6d7fff700 1 -- 172.21.15.81:0/2918204831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7fe6e80825b0 con 0x7fe6f00cf100 2023-11-29T11:22:05.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.950+0000 7fe6ef7fe700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6dc064ee0 0x7fe6dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:05.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.950+0000 7fe6ef7fe700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6dc064ee0 0x7fe6dc067390 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4007fd0 tx=0x7fe6e4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:05.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:05.958+0000 7fe6d7fff700 1 -- 172.21.15.81:0/2918204831 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe6e8050560 con 0x7fe6f00cf100 2023-11-29T11:22:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.118+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6f00c3b00 con 0x7fe6f00cf100 2023-11-29T11:22:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.118+0000 7fe6d7fff700 1 -- 172.21.15.81:0/2918204831 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18228 (secure 0 0 0) 0x7fe6e8053b80 con 0x7fe6f00cf100 2023-11-29T11:22:06.127 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:06.127 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":98,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:21:20.356075+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:19:38.262251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-29T11:19:38.644298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/353227086":"2023-11-30T11:21:20.356024+0000","172.21.15.81:6836/353227086":"2023-11-30T11:21:20.356024+0000","172.21.15.176:6833/1691706444":"2023-11-30T11:19:58.895424+0000","172.21.15.176:6832/1691706444":"2023-11-30T11:19:58.895424+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6dc064ee0 msgr2=0x7fe6dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6dc064ee0 0x7fe6dc067390 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4007fd0 tx=0x7fe6e4009040 comp rx=0 tx=0).stop 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cf100 msgr2=0x7fe6f00b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cf100 0x7fe6f00b07b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8007e60 tx=0x7fe6e800e3c0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 shutdown_connections 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe6dc064ee0 0x7fe6dc067390 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6f00cf100 0x7fe6f00b07b0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f00cd5d0 0x7fe6f00c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 --2- 172.21.15.81:0/2918204831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f00adfd0 0x7fe6f0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 >> 172.21.15.81:0/2918204831 conn(0x7fe6f006c660 msgr2=0x7fe6f0069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 shutdown_connections 2023-11-29T11:22:06.130 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.122+0000 7fe6f4a73700 1 -- 172.21.15.81:0/2918204831 wait complete. 2023-11-29T11:22:06.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:22:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 Processor -- start 2023-11-29T11:22:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 -- start start 2023-11-29T11:22:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e5c160680 0x7f2e5c071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2e5c069c40 0x7f2e5c0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0cc420 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c0cc6c0 con 0x7f2e5c160680 2023-11-29T11:22:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c0cc9a0 con 0x7f2e5c069c40 2023-11-29T11:22:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e5c160680 0x7f2e5c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5a59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e5c160680 0x7f2e5c071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53514/0 (socket says 172.21.15.81:53514) 2023-11-29T11:22:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5a59c700 1 -- 172.21.15.81:0/3570526433 learned_addr learned my addr 172.21.15.81:0/3570526433 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e59d9b700 1 --2- 172.21.15.81:0/3570526433 >> v2:172.21.15.176:3300/0 conn(0x7f2e5c069c40 0x7f2e5c0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5a59c700 1 -- 172.21.15.81:0/3570526433 >> v2:172.21.15.176:3300/0 conn(0x7f2e5c069c40 msgr2=0x7f2e5c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5a59c700 1 --2- 172.21.15.81:0/3570526433 >> v2:172.21.15.176:3300/0 conn(0x7f2e5c069c40 0x7f2e5c0cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5a59c700 1 -- 172.21.15.81:0/3570526433 >> v1:172.21.15.176:6789/0 conn(0x7f2e5c0b0c30 legacy=0x7f2e5c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5a59c700 1 -- 172.21.15.81:0/3570526433 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c0705c0 con 0x7f2e5c160680 2023-11-29T11:22:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e59d9b700 1 --2- 172.21.15.81:0/3570526433 >> v2:172.21.15.176:3300/0 conn(0x7f2e5c069c40 0x7f2e5c0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:06.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5a59c700 1 --2- 172.21.15.81:0/3570526433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c160680 0x7f2e5c071260 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c06f930 tx=0x7f2e44009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938761d96c36f83e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5959a700 1 -- 172.21.15.81:0/3570526433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400b8a0 con 0x7f2e5c160680 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5959a700 1 -- 172.21.15.81:0/3570526433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4400ba00 con 0x7f2e5c160680 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e5959a700 1 -- 172.21.15.81:0/3570526433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400bd90 con 0x7f2e5c160680 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 -- 172.21.15.81:0/3570526433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c160680 msgr2=0x7f2e5c071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.246+0000 7f2e60965700 1 --2- 172.21.15.81:0/3570526433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c160680 0x7f2e5c071260 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c06f930 tx=0x7f2e44009bf0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 -- 172.21.15.81:0/3570526433 shutdown_connections 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 --2- 172.21.15.81:0/3570526433 >> v2:172.21.15.176:3300/0 conn(0x7f2e5c069c40 0x7f2e5c0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 --2- 172.21.15.81:0/3570526433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c160680 0x7f2e5c071260 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 -- 172.21.15.81:0/3570526433 >> 172.21.15.81:0/3570526433 conn(0x7f2e5c06caf0 msgr2=0x7f2e5c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 -- 172.21.15.81:0/3570526433 shutdown_connections 2023-11-29T11:22:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 -- 172.21.15.81:0/3570526433 wait complete. 2023-11-29T11:22:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 Processor -- start 2023-11-29T11:22:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 -- start start 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5c069c40 0x7f2e5c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c0b0c30 0x7f2e5c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e5c160680 0x7f2e5c0a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0c6970 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0c6c50 con 0x7f2e5c069c40 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e60965700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0c6f30 con 0x7f2e5c160680 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c0b0c30 0x7f2e5c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c0b0c30 0x7f2e5c0c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53524/0 (socket says 172.21.15.81:53524) 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 -- 172.21.15.81:0/1028146219 learned_addr learned my addr 172.21.15.81:0/1028146219 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:06.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e5a59c700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5c069c40 0x7f2e5c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e5ad9d700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e5c160680 0x7f2e5c0a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 -- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e5c160680 msgr2=0x7f2e5c0a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e5c160680 0x7f2e5c0a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 -- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5c069c40 msgr2=0x7f2e5c14de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5c069c40 0x7f2e5c14de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 -- 172.21.15.81:0/1028146219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44009570 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e5a59c700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5c069c40 0x7f2e5c14de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.250+0000 7f2e59d9b700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c0b0c30 0x7f2e5c0c7a10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009fc0 tx=0x7f2e5400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e52ffd700 1 -- 172.21.15.81:0/1028146219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54003a40 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e52ffd700 1 -- 172.21.15.81:0/1028146219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400f040 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c0c9750 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e52ffd700 1 -- 172.21.15.81:0/1028146219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54003e00 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c071940 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c160a50 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e52ffd700 1 -- 172.21.15.81:0/1028146219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2e5401c030 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e52ffd700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e3c064f10 0x7f2e3c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e52ffd700 1 -- 172.21.15.81:0/1028146219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f2e54082060 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e5a59c700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e3c064f10 0x7f2e3c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.254+0000 7f2e5a59c700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e3c064f10 0x7f2e3c0673c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2e44000c00 tx=0x7f2e44008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:06.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.258+0000 7f2e52ffd700 1 -- 172.21.15.81:0/1028146219 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2e5404d400 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.454+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2e5c072500 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.744 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:22:06.738+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:22:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.746+0000 7f2e52ffd700 1 -- 172.21.15.81:0/1028146219 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2e54050040 con 0x7f2e5c0b0c30 2023-11-29T11:22:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e3c064f10 msgr2=0x7f2e3c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e3c064f10 0x7f2e3c0673c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2e44000c00 tx=0x7f2e44008030 comp rx=0 tx=0).stop 2023-11-29T11:22:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c0b0c30 msgr2=0x7f2e5c0c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c0b0c30 0x7f2e5c0c7a10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009fc0 tx=0x7f2e5400d460 comp rx=0 tx=0).stop 2023-11-29T11:22:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 shutdown_connections 2023-11-29T11:22:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2e3c064f10 0x7f2e3c0673c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e5c160680 0x7f2e5c0a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5c0b0c30 0x7f2e5c0c7a10 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 --2- 172.21.15.81:0/1028146219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5c069c40 0x7f2e5c14de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 >> 172.21.15.81:0/1028146219 conn(0x7f2e5c06caf0 msgr2=0x7f2e5c06af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 shutdown_connections 2023-11-29T11:22:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.750+0000 7f2e60965700 1 -- 172.21.15.81:0/1028146219 wait complete. 2023-11-29T11:22:06.759 INFO:tasks.ceph.mds.a.smithi081.stderr: -1944> 2023-11-29T11:21:28.175+0000 7f1ec0cf6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-29T11:22:06.759 INFO:tasks.ceph.mds.a.smithi081.stderr: -1696> 2023-11-29T11:21:29.115+0000 7f1ebd4ef700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x564e1472a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(15)0x10000000001:[<0x10000000000/file v6>,<0x1/dir v13>]//[]","memoryvalue":"(15)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v21>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-29T11:22:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:22:06.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T11:22:06.793 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49f59e700 1 Processor -- start 2023-11-29T11:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49f59e700 1 -- start start 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd4a00711a0 0x7fd4a015a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4a00cb7a0 0x7fd4a00cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49f59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a015d750 con 0x7fd4a015cb40 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a0070b10 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a00cc180 con 0x7fd4a00711a0 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd4a015cb40 0x7fd4a015cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40242/0 (socket says 172.21.15.81:40242) 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49ed9d700 1 -- 172.21.15.81:0/3127835239 learned_addr learned my addr 172.21.15.81:0/3127835239 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49dd9b700 1 --2- 172.21.15.81:0/3127835239 >> v2:172.21.15.81:3300/0 conn(0x7fd4a00cb7a0 0x7fd4a00cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49e59c700 1 --2- 172.21.15.81:0/3127835239 >> v2:172.21.15.176:3300/0 conn(0x7fd4a00711a0 0x7fd4a015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.878+0000 7fd49d59a700 1 -- 172.21.15.81:0/3127835239 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941645397 0 0) 0x7fd4a015d750 con 0x7fd4a015cb40 2023-11-29T11:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49d59a700 1 -- 172.21.15.81:0/3127835239 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4880035d0 con 0x7fd4a015cb40 2023-11-29T11:22:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49dd9b700 1 -- 172.21.15.81:0/3127835239 >> v2:172.21.15.176:3300/0 conn(0x7fd4a00711a0 msgr2=0x7fd4a015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49dd9b700 1 --2- 172.21.15.81:0/3127835239 >> v2:172.21.15.176:3300/0 conn(0x7fd4a00711a0 0x7fd4a015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49dd9b700 1 -- 172.21.15.81:0/3127835239 >> v1:172.21.15.81:6789/0 conn(0x7fd4a015cb40 legacy=0x7fd4a015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49dd9b700 1 -- 172.21.15.81:0/3127835239 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a015da30 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49dd9b700 1 --2- 172.21.15.81:0/3127835239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00cbc40 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0070210 tx=0x7fd494009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b465ac782cb03db server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49d59a700 1 -- 172.21.15.81:0/3127835239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494011830 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49d59a700 1 -- 172.21.15.81:0/3127835239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494011990 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49d59a700 1 -- 172.21.15.81:0/3127835239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494011d20 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 -- 172.21.15.81:0/3127835239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 msgr2=0x7fd4a00cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 --2- 172.21.15.81:0/3127835239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00cbc40 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0070210 tx=0x7fd494009b30 comp rx=0 tx=0).stop 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 -- 172.21.15.81:0/3127835239 shutdown_connections 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 --2- 172.21.15.81:0/3127835239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00cbc40 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 --2- 172.21.15.81:0/3127835239 >> v2:172.21.15.176:3300/0 conn(0x7fd4a00711a0 0x7fd4a015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 -- 172.21.15.81:0/3127835239 >> 172.21.15.81:0/3127835239 conn(0x7fd4a006c660 msgr2=0x7fd4a006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 -- 172.21.15.81:0/3127835239 shutdown_connections 2023-11-29T11:22:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 -- 172.21.15.81:0/3127835239 wait complete. 2023-11-29T11:22:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 Processor -- start 2023-11-29T11:22:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.882+0000 7fd49f59e700 1 -- start start 2023-11-29T11:22:06.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4a00711a0 0x7fd4a0153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4a015cb40 0x7fd4a01ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01551d0 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a0154d40 con 0x7fd4a00711a0 2023-11-29T11:22:06.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c3840 con 0x7fd4a015cb40 2023-11-29T11:22:06.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53542/0 (socket says 172.21.15.81:53542) 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 -- 172.21.15.81:0/1359553421 learned_addr learned my addr 172.21.15.81:0/1359553421 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49e59c700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4a00711a0 0x7fd4a0153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49ed9d700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4a015cb40 0x7fd4a01ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 -- 172.21.15.81:0/1359553421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4a015cb40 msgr2=0x7fd4a01ecfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4a015cb40 0x7fd4a01ecfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 -- 172.21.15.81:0/1359553421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4a00711a0 msgr2=0x7fd4a0153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4a00711a0 0x7fd4a0153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 -- 172.21.15.81:0/1359553421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940094b0 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49dd9b700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00c3300 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd494009b70 tx=0x7fd494004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd48effd700 1 -- 172.21.15.81:0/1359553421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494004480 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd48effd700 1 -- 172.21.15.81:0/1359553421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49401f070 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a0159940 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd48effd700 1 -- 172.21.15.81:0/1359553421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940038c0 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.886+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a0159660 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.890+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a0159c20 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.890+0000 7fd48effd700 1 -- 172.21.15.81:0/1359553421 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd49402a020 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.890+0000 7fd48effd700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd480064ee0 0x7fd480067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.890+0000 7fd48effd700 1 -- 172.21.15.81:0/1359553421 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6640+0+0 (secure 0 0 0) 0x7fd4940835c0 con 0x7fd4a00cb7a0 2023-11-29T11:22:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.890+0000 7fd49e59c700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd480064ee0 0x7fd480067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:06.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.890+0000 7fd49e59c700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd480064ee0 0x7fd480067390 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd490009ad0 tx=0x7fd490008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:06.894+0000 7fd48effd700 1 -- 172.21.15.81:0/1359553421 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd494051520 con 0x7fd4a00cb7a0 2023-11-29T11:22:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.094+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd4a0071570 con 0x7fd4a00cb7a0 2023-11-29T11:22:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.766+0000 7fd48effd700 1 -- 172.21.15.81:0/1359553421 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd494054b40 con 0x7fd4a00cb7a0 2023-11-29T11:22:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd480064ee0 msgr2=0x7fd480067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd480064ee0 0x7fd480067390 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd490009ad0 tx=0x7fd490008040 comp rx=0 tx=0).stop 2023-11-29T11:22:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 msgr2=0x7fd4a00c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00c3300 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd494009b70 tx=0x7fd494004770 comp rx=0 tx=0).stop 2023-11-29T11:22:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 shutdown_connections 2023-11-29T11:22:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd480064ee0 0x7fd480067390 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4a015cb40 0x7fd4a01ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00cb7a0 0x7fd4a00c3300 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 --2- 172.21.15.81:0/1359553421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4a00711a0 0x7fd4a0153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 >> 172.21.15.81:0/1359553421 conn(0x7fd4a006c660 msgr2=0x7fd4a015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 shutdown_connections 2023-11-29T11:22:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.770+0000 7fd49f59e700 1 -- 172.21.15.81:0/1359553421 wait complete. 2023-11-29T11:22:07.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T11:22:07.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.910+0000 7f3e431f1700 1 Processor -- start 2023-11-29T11:22:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.910+0000 7f3e431f1700 1 -- start start 2023-11-29T11:22:07.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c06a4c0 0x7f3e3c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:07.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3e3c0cf0e0 0x7f3e3c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:07.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0cfa80 con 0x7f3e3c0b1ae0 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0d0ab0 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c06a9c0 con 0x7f3e3c06a4c0 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e421ef700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3e3c0b1ae0 0x7f3e3c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40258/0 (socket says 172.21.15.81:40258) 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e421ef700 1 -- 172.21.15.81:0/3099995698 learned_addr learned my addr 172.21.15.81:0/3099995698 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e429f0700 1 --2- 172.21.15.81:0/3099995698 >> v2:172.21.15.176:3300/0 conn(0x7f3e3c0cf0e0 0x7f3e3c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e419ee700 1 --2- 172.21.15.81:0/3099995698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c06a4c0 0x7f3e3c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e411ed700 1 -- 172.21.15.81:0/3099995698 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340124624 0 0) 0x7f3e3c0cfa80 con 0x7f3e3c0b1ae0 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e411ed700 1 -- 172.21.15.81:0/3099995698 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e280035d0 con 0x7f3e3c0b1ae0 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e419ee700 1 -- 172.21.15.81:0/3099995698 >> v2:172.21.15.176:3300/0 conn(0x7f3e3c0cf0e0 msgr2=0x7f3e3c0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:07.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e419ee700 1 --2- 172.21.15.81:0/3099995698 >> v2:172.21.15.176:3300/0 conn(0x7f3e3c0cf0e0 0x7f3e3c0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e419ee700 1 -- 172.21.15.81:0/3099995698 >> v1:172.21.15.81:6789/0 conn(0x7f3e3c0b1ae0 legacy=0x7f3e3c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:07.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e411ed700 1 -- 172.21.15.81:0/3099995698 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201865381 0 0) 0x7f3e280035d0 con 0x7f3e3c0b1ae0 2023-11-29T11:22:07.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e419ee700 1 -- 172.21.15.81:0/3099995698 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c06aca0 con 0x7f3e3c06a4c0 2023-11-29T11:22:07.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e429f0700 1 --2- 172.21.15.81:0/3099995698 >> v2:172.21.15.176:3300/0 conn(0x7f3e3c0cf0e0 0x7f3e3c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e419ee700 1 --2- 172.21.15.81:0/3099995698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c06a4c0 0x7f3e3c06d8e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009850 tx=0x7f3e38009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd02f281c4f5c0b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e411ed700 1 -- 172.21.15.81:0/3099995698 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c001670 con 0x7f3e3c06a4c0 2023-11-29T11:22:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e411ed700 1 -- 172.21.15.81:0/3099995698 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e38004030 con 0x7f3e3c06a4c0 2023-11-29T11:22:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e411ed700 1 -- 172.21.15.81:0/3099995698 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e380043e0 con 0x7f3e3c06a4c0 2023-11-29T11:22:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 -- 172.21.15.81:0/3099995698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c06a4c0 msgr2=0x7f3e3c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 --2- 172.21.15.81:0/3099995698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c06a4c0 0x7f3e3c06d8e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009850 tx=0x7f3e38009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 -- 172.21.15.81:0/3099995698 shutdown_connections 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 --2- 172.21.15.81:0/3099995698 >> v2:172.21.15.176:3300/0 conn(0x7f3e3c0cf0e0 0x7f3e3c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 --2- 172.21.15.81:0/3099995698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c06a4c0 0x7f3e3c06d8e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 -- 172.21.15.81:0/3099995698 >> 172.21.15.81:0/3099995698 conn(0x7f3e3c09bbd0 msgr2=0x7f3e3c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 -- 172.21.15.81:0/3099995698 shutdown_connections 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.914+0000 7f3e431f1700 1 -- 172.21.15.81:0/3099995698 wait complete. 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 Processor -- start 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 -- start start 2023-11-29T11:22:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e3c06a4c0 0x7f3e3c0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c0b1ae0 0x7f3e3c14bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c14c2d0 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0c6690 con 0x7f3e3c06a4c0 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c15d720 con 0x7f3e3c0b1ae0 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53554/0 (socket says 172.21.15.81:53554) 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 -- 172.21.15.81:0/360961161 learned_addr learned my addr 172.21.15.81:0/360961161 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e421ef700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e3c06a4c0 0x7f3e3c0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e419ee700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c0b1ae0 0x7f3e3c14bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 -- 172.21.15.81:0/360961161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c0b1ae0 msgr2=0x7f3e3c14bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c0b1ae0 0x7f3e3c14bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 -- 172.21.15.81:0/360961161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e3c06a4c0 msgr2=0x7f3e3c0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e3c06a4c0 0x7f3e3c0b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 -- 172.21.15.81:0/360961161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009a70 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e429f0700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c0c6150 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400efc0 tx=0x7f3e3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e32ffd700 1 -- 172.21.15.81:0/360961161 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400ca90 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e32ffd700 1 -- 172.21.15.81:0/360961161 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400f040 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e380094b0 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e32ffd700 1 -- 172.21.15.81:0/360961161 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400ce10 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.918+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c0b4380 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.922+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c06af80 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.922+0000 7f3e32ffd700 1 -- 172.21.15.81:0/360961161 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3e34014480 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.922+0000 7f3e32ffd700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:07.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.922+0000 7f3e421ef700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:07.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.922+0000 7f3e32ffd700 1 -- 172.21.15.81:0/360961161 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6640+0+0 (secure 0 0 0) 0x7f3e340828d0 con 0x7f3e3c0cf0e0 2023-11-29T11:22:07.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.922+0000 7f3e421ef700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000f60 tx=0x7f3e2c001230 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:07.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:07.930+0000 7f3e32ffd700 1 -- 172.21.15.81:0/360961161 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3e34050750 con 0x7f3e3c0cf0e0 2023-11-29T11:22:08.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.098+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e3c0b1eb0 con 0x7f3e3c0cf0e0 2023-11-29T11:22:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.778+0000 7f3e32ffd700 1 -- 172.21.15.81:0/360961161 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3e34009d70 con 0x7f3e3c0cf0e0 2023-11-29T11:22:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 msgr2=0x7f3e20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000f60 tx=0x7f3e2c001230 comp rx=0 tx=0).stop 2023-11-29T11:22:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e3c0cf0e0 msgr2=0x7f3e3c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c0c6150 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400efc0 tx=0x7f3e3400c3a0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 shutdown_connections 2023-11-29T11:22:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3e20064ee0 0x7f3e20067390 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c0c6150 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e3c0b1ae0 0x7f3e3c14bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 --2- 172.21.15.81:0/360961161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e3c06a4c0 0x7f3e3c0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.782+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 >> 172.21.15.81:0/360961161 conn(0x7f3e3c09bbd0 msgr2=0x7f3e3c0d1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.786+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 shutdown_connections 2023-11-29T11:22:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.786+0000 7f3e431f1700 1 -- 172.21.15.81:0/360961161 wait complete. 2023-11-29T11:22:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-11-29T11:22:08.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T11:22:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.918+0000 7f5266c71700 1 Processor -- start 2023-11-29T11:22:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.918+0000 7f5266c71700 1 -- start start 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600ce750 0x7f526006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5260070fc0 0x7f5260071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5260071950 con 0x7f52600cdaf0 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526006e7e0 con 0x7f5260070fc0 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52601593c0 con 0x7f52600ce750 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266470700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5260070fc0 0x7f5260071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f526546e700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f52600cdaf0 0x7f526006ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40262/0 (socket says 172.21.15.81:40262) 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f526546e700 1 -- 172.21.15.81:0/2058650007 learned_addr learned my addr 172.21.15.81:0/2058650007 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5265c6f700 1 --2- 172.21.15.81:0/2058650007 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600ce750 0x7f526006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266470700 1 -- 172.21.15.81:0/2058650007 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600ce750 msgr2=0x7f526006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266470700 1 --2- 172.21.15.81:0/2058650007 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600ce750 0x7f526006b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266470700 1 -- 172.21.15.81:0/2058650007 >> v1:172.21.15.81:6789/0 conn(0x7f52600cdaf0 legacy=0x7f526006ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266470700 1 -- 172.21.15.81:0/2058650007 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526006bf30 con 0x7f5260070fc0 2023-11-29T11:22:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266470700 1 --2- 172.21.15.81:0/2058650007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5260070fc0 0x7f5260071410 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f5258009d90 tx=0x7f525800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41632c86a6a0d5f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:08.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5264c6d700 1 -- 172.21.15.81:0/2058650007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800e070 con 0x7f5260070fc0 2023-11-29T11:22:08.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5264c6d700 1 -- 172.21.15.81:0/2058650007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525800bbd0 con 0x7f5260070fc0 2023-11-29T11:22:08.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5264c6d700 1 -- 172.21.15.81:0/2058650007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258012430 con 0x7f5260070fc0 2023-11-29T11:22:08.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 -- 172.21.15.81:0/2058650007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5260070fc0 msgr2=0x7f5260071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 --2- 172.21.15.81:0/2058650007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5260070fc0 0x7f5260071410 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f5258009d90 tx=0x7f525800b330 comp rx=0 tx=0).stop 2023-11-29T11:22:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 -- 172.21.15.81:0/2058650007 shutdown_connections 2023-11-29T11:22:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 --2- 172.21.15.81:0/2058650007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5260070fc0 0x7f5260071410 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 --2- 172.21.15.81:0/2058650007 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600ce750 0x7f526006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 -- 172.21.15.81:0/2058650007 >> 172.21.15.81:0/2058650007 conn(0x7f52600cf5e0 msgr2=0x7f52600cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 -- 172.21.15.81:0/2058650007 shutdown_connections 2023-11-29T11:22:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.922+0000 7f5266c71700 1 -- 172.21.15.81:0/2058650007 wait complete. 2023-11-29T11:22:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 Processor -- start 2023-11-29T11:22:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 -- start start 2023-11-29T11:22:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5260070fc0 0x7f52600accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600cdaf0 0x7f52600ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52600ce750 0x7f5260153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52601f5270 con 0x7f52600ce750 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52601f5510 con 0x7f5260070fc0 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52601f57f0 con 0x7f52600cdaf0 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52600ce750 0x7f5260153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52600ce750 0x7f5260153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53580/0 (socket says 172.21.15.81:53580) 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 -- 172.21.15.81:0/531648022 learned_addr learned my addr 172.21.15.81:0/531648022 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f526546e700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600cdaf0 0x7f52600ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5265c6f700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5260070fc0 0x7f52600accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 -- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600cdaf0 msgr2=0x7f52600ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600cdaf0 0x7f52600ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 -- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5260070fc0 msgr2=0x7f52600accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5260070fc0 0x7f52600accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 -- 172.21.15.81:0/531648022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258009a70 con 0x7f52600ce750 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5265c6f700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5260070fc0 0x7f52600accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266470700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52600ce750 0x7f5260153950 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f5258014040 tx=0x7f5258004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f525e7fc700 1 -- 172.21.15.81:0/531648022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258012430 con 0x7f52600ce750 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f525e7fc700 1 -- 172.21.15.81:0/531648022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5258020070 con 0x7f52600ce750 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f525e7fc700 1 -- 172.21.15.81:0/531648022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258004280 con 0x7f52600ce750 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526006c4f0 con 0x7f52600ce750 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.926+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526006c210 con 0x7f52600ce750 2023-11-29T11:22:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.930+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526006e470 con 0x7f52600ce750 2023-11-29T11:22:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.930+0000 7f525e7fc700 1 -- 172.21.15.81:0/531648022 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f525802e070 con 0x7f52600ce750 2023-11-29T11:22:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.930+0000 7f525e7fc700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5244064ee0 0x7f5244067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.930+0000 7f525e7fc700 1 -- 172.21.15.81:0/531648022 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f5258022070 con 0x7f52600ce750 2023-11-29T11:22:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.930+0000 7f5265c6f700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5244064ee0 0x7f5244067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.930+0000 7f5265c6f700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5244064ee0 0x7f5244067390 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5254007a70 tx=0x7f5254008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:08.934+0000 7f525e7fc700 1 -- 172.21.15.81:0/531648022 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5258051db0 con 0x7f52600ce750 2023-11-29T11:22:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.098+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52600676e0 con 0x7f52600ce750 2023-11-29T11:22:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.794+0000 7f525e7fc700 1 -- 172.21.15.81:0/531648022 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7f525802c0d0 con 0x7f52600ce750 2023-11-29T11:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5244064ee0 msgr2=0x7f5244067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5244064ee0 0x7f5244067390 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5254007a70 tx=0x7f5254008040 comp rx=0 tx=0).stop 2023-11-29T11:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52600ce750 msgr2=0x7f5260153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52600ce750 0x7f5260153950 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f5258014040 tx=0x7f5258004af0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 shutdown_connections 2023-11-29T11:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5244064ee0 0x7f5244067390 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52600ce750 0x7f5260153950 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52600cdaf0 0x7f52600ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 --2- 172.21.15.81:0/531648022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5260070fc0 0x7f52600accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 >> 172.21.15.81:0/531648022 conn(0x7f52600cf5e0 msgr2=0x7f52600aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 shutdown_connections 2023-11-29T11:22:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.802+0000 7f5266c71700 1 -- 172.21.15.81:0/531648022 wait complete. 2023-11-29T11:22:09.813 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-11-29T11:22:09.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-29T11:22:09.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f4134d86700 1 Processor -- start 2023-11-29T11:22:09.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f4134d86700 1 -- start start 2023-11-29T11:22:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f4134d86700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41300cd5d0 0x7f41300ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f4134d86700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413006d1c0 con 0x7f4130158ee0 2023-11-29T11:22:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f4134d86700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41300ca3a0 con 0x7f41300ce230 2023-11-29T11:22:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f4134d86700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413006e000 con 0x7f41300cd5d0 2023-11-29T11:22:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4130158ee0 0x7f41300cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33842/0 (socket says 172.21.15.81:33842) 2023-11-29T11:22:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412f7fe700 1 -- 172.21.15.81:0/1719995865 learned_addr learned my addr 172.21.15.81:0/1719995865 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412ffff700 1 --2- 172.21.15.81:0/1719995865 >> v2:172.21.15.176:3300/0 conn(0x7f41300cd5d0 0x7f41300ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123060814 0 0) 0x7f4120001110 con 0x7f4130158ee0 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f411c0035d0 con 0x7f4130158ee0 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3069253961 0 0) 0x7f411c0035d0 con 0x7f4130158ee0 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 >> v2:172.21.15.176:3300/0 conn(0x7f41300cd5d0 msgr2=0x7f41300ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 --2- 172.21.15.81:0/1719995865 >> v2:172.21.15.176:3300/0 conn(0x7f41300cd5d0 0x7f41300ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 >> v1:172.21.15.176:6789/0 conn(0x7f41300ce230 legacy=0x7f41300cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413006c920 con 0x7f4130158ee0 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f4120001800 con 0x7f4130158ee0 2023-11-29T11:22:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 >> v1:172.21.15.81:6789/0 conn(0x7f4130158ee0 legacy=0x7f41300cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411c003a20 0x7f411c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411c004870 0x7f411c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c005220 0x7f411c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c00e280 con 0x7f411c004870 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c00e3f0 con 0x7f411c005220 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c00e5b0 con 0x7f411c003a20 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f4126ffd700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411c004870 0x7f411c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412f7fe700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411c003a20 0x7f411c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.934+0000 7f412ffff700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c005220 0x7f411c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4126ffd700 1 -- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411c003a20 msgr2=0x7f411c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4126ffd700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411c003a20 0x7f411c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4126ffd700 1 -- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c005220 msgr2=0x7f411c00dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4126ffd700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c005220 0x7f411c00dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4126ffd700 1 -- 172.21.15.81:0/1719995865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0035d0 con 0x7f411c004870 2023-11-29T11:22:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f412ffff700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c005220 0x7f411c00dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f412ffff700 1 -- 172.21.15.81:0/1719995865 reap_dead start 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4126ffd700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411c004870 0x7f411c004ce0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f41300707e0 tx=0x7f411c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afb115946763ae3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4118001300 con 0x7f411c004870 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4118005240 con 0x7f411c004870 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f412effd700 1 -- 172.21.15.81:0/1719995865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180055f0 con 0x7f411c004870 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 -- 172.21.15.81:0/1719995865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411c004870 msgr2=0x7f411c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411c004870 0x7f411c004ce0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f41300707e0 tx=0x7f411c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 -- 172.21.15.81:0/1719995865 shutdown_connections 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 --2- 172.21.15.81:0/1719995865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f411c004870 0x7f411c004ce0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 -- 172.21.15.81:0/1719995865 >> 172.21.15.81:0/1719995865 conn(0x7f41300d0240 msgr2=0x7f41300cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 -- 172.21.15.81:0/1719995865 shutdown_connections 2023-11-29T11:22:09.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 -- 172.21.15.81:0/1719995865 wait complete. 2023-11-29T11:22:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 Processor -- start 2023-11-29T11:22:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.938+0000 7f4134d86700 1 -- start start 2023-11-29T11:22:09.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4134d86700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c004870 0x7f41300b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4134d86700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41300b2960 0x7f413014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4134d86700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413014a650 0x7f4130156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4134d86700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300b2dd0 con 0x7f41300b2960 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4134d86700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413014aac0 con 0x7f411c004870 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4134d86700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41300c36a0 con 0x7f413014a650 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41300b2960 0x7f413014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41300b2960 0x7f413014a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59304/0 (socket says 172.21.15.81:59304) 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 -- 172.21.15.81:0/1927716706 learned_addr learned my addr 172.21.15.81:0/1927716706 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f412f7fe700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c004870 0x7f41300b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f412ffff700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413014a650 0x7f4130156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 -- 172.21.15.81:0/1927716706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413014a650 msgr2=0x7f4130156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413014a650 0x7f4130156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 -- 172.21.15.81:0/1927716706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c004870 msgr2=0x7f41300b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c004870 0x7f41300b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:09.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 -- 172.21.15.81:0/1927716706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413006cee0 con 0x7f41300b2960 2023-11-29T11:22:09.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4126ffd700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41300b2960 0x7f413014a110 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4118000ef0 tx=0x7f4118001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:09.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f412cff9700 1 -- 172.21.15.81:0/1927716706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4118006ad0 con 0x7f41300b2960 2023-11-29T11:22:09.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f412cff9700 1 -- 172.21.15.81:0/1927716706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4118006c30 con 0x7f41300b2960 2023-11-29T11:22:09.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413006cc00 con 0x7f41300b2960 2023-11-29T11:22:09.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f412cff9700 1 -- 172.21.15.81:0/1927716706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180036f0 con 0x7f41300b2960 2023-11-29T11:22:09.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.942+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41300ca640 con 0x7f41300b2960 2023-11-29T11:22:09.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.946+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4130072c20 con 0x7f41300b2960 2023-11-29T11:22:09.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.946+0000 7f412cff9700 1 -- 172.21.15.81:0/1927716706 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4118018070 con 0x7f41300b2960 2023-11-29T11:22:09.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.946+0000 7f412cff9700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4110064f10 0x7f41100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:09.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.946+0000 7f412cff9700 1 -- 172.21.15.81:0/1927716706 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5788+0+0 (secure 0 0 0) 0x7f4118082690 con 0x7f41300b2960 2023-11-29T11:22:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.946+0000 7f412f7fe700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4110064f10 0x7f41100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:09.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.946+0000 7f412f7fe700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4110064f10 0x7f41100673c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4120000c00 tx=0x7f4120007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:09.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:09.950+0000 7f412cff9700 1 -- 172.21.15.81:0/1927716706 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4118050940 con 0x7f41300b2960 2023-11-29T11:22:10.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.118+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f413006f920 con 0x7f41300b2960 2023-11-29T11:22:10.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.126+0000 7f412cff9700 1 -- 172.21.15.81:0/1927716706 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4118053f60 con 0x7f41300b2960 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4110064f10 msgr2=0x7f41100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4110064f10 0x7f41100673c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4120000c00 tx=0x7f4120007040 comp rx=0 tx=0).stop 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41300b2960 msgr2=0x7f413014a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41300b2960 0x7f413014a110 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4118000ef0 tx=0x7f4118001170 comp rx=0 tx=0).stop 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 shutdown_connections 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4110064f10 0x7f41100673c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413014a650 0x7f4130156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41300b2960 0x7f413014a110 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 --2- 172.21.15.81:0/1927716706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f411c004870 0x7f41300b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 >> 172.21.15.81:0/1927716706 conn(0x7f41300d0240 msgr2=0x7f41300caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 shutdown_connections 2023-11-29T11:22:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.130+0000 7f4134d86700 1 -- 172.21.15.81:0/1927716706 wait complete. 2023-11-29T11:22:10.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2023-11-29T11:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2bfff700 1 Processor -- start 2023-11-29T11:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2bfff700 1 -- start start 2023-11-29T11:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e2c0cb460 0x7f7e2c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2bfff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0cd8f0 con 0x7f7e2c158e60 2023-11-29T11:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c06dc60 con 0x7f7e2c0ad490 2023-11-29T11:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0add00 con 0x7f7e2c0cb460 2023-11-29T11:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2a7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e2c0cb460 0x7f7e2c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7e2c158e60 0x7f7e2c0cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33854/0 (socket says 172.21.15.81:33854) 2023-11-29T11:22:10.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2affd700 1 -- 172.21.15.81:0/3872820658 learned_addr learned my addr 172.21.15.81:0/3872820658 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2a7fc700 1 -- 172.21.15.81:0/3872820658 >> v1:172.21.15.176:6789/0 conn(0x7f7e2c0ad490 legacy=0x7f7e2c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2a7fc700 1 -- 172.21.15.81:0/3872820658 >> v1:172.21.15.81:6789/0 conn(0x7f7e2c158e60 legacy=0x7f7e2c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2a7fc700 1 -- 172.21.15.81:0/3872820658 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0cde90 con 0x7f7e2c0cb460 2023-11-29T11:22:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e2a7fc700 1 --2- 172.21.15.81:0/3872820658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c0cb460 0x7f7e2c0c8a30 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009850 tx=0x7f7e20009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c28207e0c89ee server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e29ffb700 1 -- 172.21.15.81:0/3872820658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2000f8a0 con 0x7f7e2c0cb460 2023-11-29T11:22:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e29ffb700 1 -- 172.21.15.81:0/3872820658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2000fa00 con 0x7f7e2c0cb460 2023-11-29T11:22:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.262+0000 7f7e29ffb700 1 -- 172.21.15.81:0/3872820658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2000fd90 con 0x7f7e2c0cb460 2023-11-29T11:22:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- 172.21.15.81:0/3872820658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c0cb460 msgr2=0x7f7e2c0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/3872820658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c0cb460 0x7f7e2c0c8a30 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009850 tx=0x7f7e20009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- 172.21.15.81:0/3872820658 shutdown_connections 2023-11-29T11:22:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/3872820658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c0cb460 0x7f7e2c0c8a30 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- 172.21.15.81:0/3872820658 >> 172.21.15.81:0/3872820658 conn(0x7f7e2c0ce3e0 msgr2=0x7f7e2c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- 172.21.15.81:0/3872820658 shutdown_connections 2023-11-29T11:22:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- 172.21.15.81:0/3872820658 wait complete. 2023-11-29T11:22:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 Processor -- start 2023-11-29T11:22:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- start start 2023-11-29T11:22:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2c0ad490 0x7f7e2c1eff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e2c0cb460 0x7f7e2c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c158e60 0x7f7e2c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c2bc0 con 0x7f7e2c158e60 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c2ea0 con 0x7f7e2c0ad490 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c3180 con 0x7f7e2c0cb460 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c158e60 0x7f7e2c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2c0ad490 0x7f7e2c1eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2a7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e2c0cb460 0x7f7e2c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2c0ad490 0x7f7e2c1eff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58994/0 (socket says 172.21.15.81:58994) 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 -- 172.21.15.81:0/2914431038 learned_addr learned my addr 172.21.15.81:0/2914431038 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2b7fe700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c158e60 0x7f7e2c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59330/0 (socket says 172.21.15.81:59330) 2023-11-29T11:22:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 -- 172.21.15.81:0/2914431038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e2c0cb460 msgr2=0x7f7e2c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e2c0cb460 0x7f7e2c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 -- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c158e60 msgr2=0x7f7e2c0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c158e60 0x7f7e2c0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 -- 172.21.15.81:0/2914431038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e200094b0 con 0x7f7e2c0ad490 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2b7fe700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c158e60 0x7f7e2c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.266+0000 7f7e2affd700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2c0ad490 0x7f7e2c1eff60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c001eb0 tx=0x7f7e1c00c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e137fe700 1 -- 172.21.15.81:0/2914431038 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c005d90 con 0x7f7e2c0ad490 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e137fe700 1 -- 172.21.15.81:0/2914431038 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0070d0 con 0x7f7e2c0ad490 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c06d6a0 con 0x7f7e2c0ad490 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e137fe700 1 -- 172.21.15.81:0/2914431038 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c007440 con 0x7f7e2c0ad490 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c159230 con 0x7f7e2c0ad490 2023-11-29T11:22:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c06d980 con 0x7f7e2c0ad490 2023-11-29T11:22:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e137fe700 1 -- 172.21.15.81:0/2914431038 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7e1c019030 con 0x7f7e2c0ad490 2023-11-29T11:22:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e137fe700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e18064ee0 0x7f7e18067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e137fe700 1 -- 172.21.15.81:0/2914431038 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5788+0+0 (secure 0 0 0) 0x7f7e1c080ed0 con 0x7f7e2c0ad490 2023-11-29T11:22:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.270+0000 7f7e2a7fc700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e18064ee0 0x7f7e18067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.274+0000 7f7e2a7fc700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e18064ee0 0x7f7e18067390 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0cb850 tx=0x7f7e20008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.282+0000 7f7e137fe700 1 -- 172.21.15.81:0/2914431038 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7e1c04a400 con 0x7f7e2c0ad490 2023-11-29T11:22:10.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.506+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f7e2c072500 con 0x7f7e2c0ad490 2023-11-29T11:22:10.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.798+0000 7f7e137fe700 1 -- 172.21.15.81:0/2914431038 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v426) v1 ==== 167+0+0 (secure 0 0 0) 0x7f7e1c04f1b0 con 0x7f7e2c0ad490 2023-11-29T11:22:10.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e18064ee0 msgr2=0x7f7e18067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e18064ee0 0x7f7e18067390 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0cb850 tx=0x7f7e20008030 comp rx=0 tx=0).stop 2023-11-29T11:22:10.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2c0ad490 msgr2=0x7f7e2c1eff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2c0ad490 0x7f7e2c1eff60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c001eb0 tx=0x7f7e1c00c7b0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 shutdown_connections 2023-11-29T11:22:10.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7e18064ee0 0x7f7e18067390 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2c158e60 0x7f7e2c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e2c0cb460 0x7f7e2c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 --2- 172.21.15.81:0/2914431038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2c0ad490 0x7f7e2c1eff60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 >> 172.21.15.81:0/2914431038 conn(0x7f7e2c0ce3e0 msgr2=0x7f7e2c0ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:10.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 shutdown_connections 2023-11-29T11:22:10.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.802+0000 7f7e2bfff700 1 -- 172.21.15.81:0/2914431038 wait complete. 2023-11-29T11:22:10.826 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2023-11-29T11:22:10.826 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:22:10.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2023-11-29T11:22:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.938+0000 7f8bc7fff700 1 Processor -- start 2023-11-29T11:22:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.938+0000 7f8bc7fff700 1 -- start start 2023-11-29T11:22:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.938+0000 7f8bc7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 0x7f8bc80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.938+0000 7f8bc7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8bc80cb460 0x7f8bc80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.938+0000 7f8bc7fff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc80cde00 con 0x7f8bc80ad490 2023-11-29T11:22:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc80ce290 con 0x7f8bc80cb460 2023-11-29T11:22:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc80adcc0 con 0x7f8bc8158ef0 2023-11-29T11:22:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc77fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8bc80cb460 0x7f8bc80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc67fc700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8bc80ad490 0x7f8bc80cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:42226/0 (socket says 172.21.15.81:42226) 2023-11-29T11:22:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc67fc700 1 -- 172.21.15.81:0/3863688432 learned_addr learned my addr 172.21.15.81:0/3863688432 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc77fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8bc80cb460 0x7f8bc80cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:59008/0 (socket says 172.21.15.81:59008) 2023-11-29T11:22:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc6ffd700 1 --2- 172.21.15.81:0/3863688432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 0x7f8bc80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc77fe700 1 -- 172.21.15.81:0/3863688432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 msgr2=0x7f8bc80c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc77fe700 1 --2- 172.21.15.81:0/3863688432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 0x7f8bc80c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc77fe700 1 -- 172.21.15.81:0/3863688432 >> v1:172.21.15.176:6789/0 conn(0x7f8bc80ad490 legacy=0x7f8bc80cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc77fe700 1 -- 172.21.15.81:0/3863688432 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc806d630 con 0x7f8bc80cb460 2023-11-29T11:22:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc77fe700 1 --2- 172.21.15.81:0/3863688432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 0x7f8bc80cbfb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009880 tx=0x7f8bc0009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd747ced5fc6c4b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc5ffb700 1 -- 172.21.15.81:0/3863688432 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0011830 con 0x7f8bc80cb460 2023-11-29T11:22:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc5ffb700 1 -- 172.21.15.81:0/3863688432 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0011990 con 0x7f8bc80cb460 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc5ffb700 1 -- 172.21.15.81:0/3863688432 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0011d20 con 0x7f8bc80cb460 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 -- 172.21.15.81:0/3863688432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 msgr2=0x7f8bc80cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/3863688432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 0x7f8bc80cbfb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009880 tx=0x7f8bc0009b90 comp rx=0 tx=0).stop 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 -- 172.21.15.81:0/3863688432 shutdown_connections 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/3863688432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 0x7f8bc80cbfb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/3863688432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 0x7f8bc80c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 -- 172.21.15.81:0/3863688432 >> 172.21.15.81:0/3863688432 conn(0x7f8bc80ce3e0 msgr2=0x7f8bc80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 -- 172.21.15.81:0/3863688432 shutdown_connections 2023-11-29T11:22:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.942+0000 7f8bc7fff700 1 -- 172.21.15.81:0/3863688432 wait complete. 2023-11-29T11:22:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 Processor -- start 2023-11-29T11:22:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 -- start start 2023-11-29T11:22:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bc80ad490 0x7f8bc80c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 0x7f8bc8151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 0x7f8bc8151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc80c48d0 con 0x7f8bc80ad490 2023-11-29T11:22:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc80adea0 con 0x7f8bc80cb460 2023-11-29T11:22:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc80c8170 con 0x7f8bc8158ef0 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bc80ad490 0x7f8bc80c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bc80ad490 0x7f8bc80c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59344/0 (socket says 172.21.15.81:59344) 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 -- 172.21.15.81:0/2696738595 learned_addr learned my addr 172.21.15.81:0/2696738595 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc67fc700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 0x7f8bc8151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc77fe700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 0x7f8bc8151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 -- 172.21.15.81:0/2696738595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 msgr2=0x7f8bc8151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 0x7f8bc8151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 -- 172.21.15.81:0/2696738595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 msgr2=0x7f8bc8151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 0x7f8bc8151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 -- 172.21.15.81:0/2696738595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00094b0 con 0x7f8bc80ad490 2023-11-29T11:22:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc6ffd700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bc80ad490 0x7f8bc80c4390 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00e840 tx=0x7f8bbc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8baf7fe700 1 -- 172.21.15.81:0/2696738595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0095a0 con 0x7f8bc80ad490 2023-11-29T11:22:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc806dbf0 con 0x7f8bc80ad490 2023-11-29T11:22:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8baf7fe700 1 -- 172.21.15.81:0/2696738595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc013680 con 0x7f8bc80ad490 2023-11-29T11:22:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8baf7fe700 1 -- 172.21.15.81:0/2696738595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0139f0 con 0x7f8bc80ad490 2023-11-29T11:22:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.946+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc806d910 con 0x7f8bc80ad490 2023-11-29T11:22:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.950+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc80cda90 con 0x7f8bc80ad490 2023-11-29T11:22:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.950+0000 7f8baf7fe700 1 -- 172.21.15.81:0/2696738595 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8bbc019030 con 0x7f8bc80ad490 2023-11-29T11:22:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.950+0000 7f8baf7fe700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bb4064ee0 0x7f8bb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.950+0000 7f8baf7fe700 1 -- 172.21.15.81:0/2696738595 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5788+0+0 (secure 0 0 0) 0x7f8bbc081b20 con 0x7f8bc80ad490 2023-11-29T11:22:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.950+0000 7f8bc67fc700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bb4064ee0 0x7f8bb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.950+0000 7f8bc67fc700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bb4064ee0 0x7f8bb4067390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80ccd70 tx=0x7f8bb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:10.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:10.962+0000 7f8baf7fe700 1 -- 172.21.15.81:0/2696738595 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8bbc04fd50 con 0x7f8bc80ad490 2023-11-29T11:22:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.186+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f8bc8072500 con 0x7f8bc80ad490 2023-11-29T11:22:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.798+0000 7f8baf7fe700 1 -- 172.21.15.81:0/2696738595 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v427) v1 ==== 149+0+0 (secure 0 0 0) 0x7f8bbc053370 con 0x7f8bc80ad490 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bb4064ee0 msgr2=0x7f8bb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bb4064ee0 0x7f8bb4067390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80ccd70 tx=0x7f8bb8009040 comp rx=0 tx=0).stop 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bc80ad490 msgr2=0x7f8bc80c4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bc80ad490 0x7f8bc80c4390 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00e840 tx=0x7f8bbc00eb50 comp rx=0 tx=0).stop 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 shutdown_connections 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8bb4064ee0 0x7f8bb4067390 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bc8158ef0 0x7f8bc8151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bc80cb460 0x7f8bc8151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.802+0000 7f8bc7fff700 1 --2- 172.21.15.81:0/2696738595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bc80ad490 0x7f8bc80c4390 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.806+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 >> 172.21.15.81:0/2696738595 conn(0x7f8bc80ce3e0 msgr2=0x7f8bc80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.806+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 shutdown_connections 2023-11-29T11:22:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.806+0000 7f8bc7fff700 1 -- 172.21.15.81:0/2696738595 wait complete. 2023-11-29T11:22:11.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-29T11:22:11.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5b62700 1 Processor -- start 2023-11-29T11:22:11.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5b62700 1 -- start start 2023-11-29T11:22:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5b62700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fa00b1ae0 0x7f5fa006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5b62700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5fa006a4c0 0x7f5fa00d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5b62700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa006a9c0 con 0x7f5fa00cf0e0 2023-11-29T11:22:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5b62700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa006aca0 con 0x7f5fa006a4c0 2023-11-29T11:22:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5b62700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa006af80 con 0x7f5fa00b1ae0 2023-11-29T11:22:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5361700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5fa00cf0e0 0x7f5fa00b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33862/0 (socket says 172.21.15.81:33862) 2023-11-29T11:22:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.946+0000 7f5fa5361700 1 -- 172.21.15.81:0/1023626748 learned_addr learned my addr 172.21.15.81:0/1023626748 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:11.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9ffff700 1 --2- 172.21.15.81:0/1023626748 >> v2:172.21.15.176:3300/0 conn(0x7f5fa006a4c0 0x7f5fa00d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:11.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823949153 0 0) 0x7f5fa006a9c0 con 0x7f5fa00cf0e0 2023-11-29T11:22:11.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa4b60700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fa00b1ae0 0x7f5fa006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:11.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f880035d0 con 0x7f5fa00cf0e0 2023-11-29T11:22:11.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052612860 0 0) 0x7f5f880035d0 con 0x7f5fa00cf0e0 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fa00b1ae0 msgr2=0x7f5fa006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fa00b1ae0 0x7f5fa006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 >> v2:172.21.15.176:3300/0 conn(0x7f5fa006a4c0 msgr2=0x7f5fa00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 --2- 172.21.15.81:0/1023626748 >> v2:172.21.15.176:3300/0 conn(0x7f5fa006a4c0 0x7f5fa00d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00b4380 con 0x7f5fa00cf0e0 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f5f980019f0 con 0x7f5fa00cf0e0 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 >> v1:172.21.15.81:6789/0 conn(0x7f5fa00cf0e0 legacy=0x7f5fa00b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88003a20 0x7f5f88003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f88004400 0x7f5f880048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f88004ff0 0x7f5f8800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa006aca0 con 0x7f5f88004400 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa006af80 con 0x7f5f88004ff0 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8800bf70 con 0x7f5f88003a20 2023-11-29T11:22:11.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa4b60700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5fa00b1ae0 0x7f5fa006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9ffff700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f88004400 0x7f5f880048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5361700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f88004ff0 0x7f5f8800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9ffff700 1 -- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88003a20 msgr2=0x7f5f88003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9ffff700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88003a20 0x7f5f88003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9ffff700 1 -- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f88004ff0 msgr2=0x7f5f8800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9ffff700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f88004ff0 0x7f5f8800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9ffff700 1 -- 172.21.15.81:0/1023626748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880035d0 con 0x7f5f88004400 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5361700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f88004ff0 0x7f5f8800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9ffff700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f88004400 0x7f5f880048d0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009b40 tx=0x7f5f880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f04838946d8bee server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000e6c0 con 0x7f5f88004400 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9000e820 con 0x7f5f88004400 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5f9f7fe700 1 -- 172.21.15.81:0/1023626748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000eb90 con 0x7f5f88004400 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5b62700 1 -- 172.21.15.81:0/1023626748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f88004400 msgr2=0x7f5f880048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5b62700 1 --2- 172.21.15.81:0/1023626748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f88004400 0x7f5f880048d0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009b40 tx=0x7f5f880058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5361700 1 -- 172.21.15.81:0/1023626748 reap_dead start 2023-11-29T11:22:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5b62700 1 -- 172.21.15.81:0/1023626748 shutdown_connections 2023-11-29T11:22:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5b62700 1 -- 172.21.15.81:0/1023626748 >> 172.21.15.81:0/1023626748 conn(0x7f5fa009bbd0 msgr2=0x7f5fa00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5b62700 1 -- 172.21.15.81:0/1023626748 shutdown_connections 2023-11-29T11:22:11.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.950+0000 7f5fa5b62700 1 -- 172.21.15.81:0/1023626748 wait complete. 2023-11-29T11:22:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 Processor -- start 2023-11-29T11:22:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 -- start start 2023-11-29T11:22:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88004400 0x7f5fa015c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa00c6e80 0x7f5fa014f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fa01f1510 0x7f5fa00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa014efe0 con 0x7f5fa00c6e80 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00c6150 con 0x7f5fa01f1510 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa015cf60 con 0x7f5f88004400 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa00c6e80 0x7f5fa014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa00c6e80 0x7f5fa014f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59348/0 (socket says 172.21.15.81:59348) 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 -- 172.21.15.81:0/2617317508 learned_addr learned my addr 172.21.15.81:0/2617317508 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa4b60700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88004400 0x7f5fa015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5361700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fa01f1510 0x7f5fa00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 -- 172.21.15.81:0/2617317508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88004400 msgr2=0x7f5fa015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88004400 0x7f5fa015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 -- 172.21.15.81:0/2617317508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fa01f1510 msgr2=0x7f5fa00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fa01f1510 0x7f5fa00b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 -- 172.21.15.81:0/2617317508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00b60e0 con 0x7f5fa00c6e80 2023-11-29T11:22:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9ffff700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa00c6e80 0x7f5fa014f190 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f5f90016000 tx=0x7f5f900047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9d7fa700 1 -- 172.21.15.81:0/2617317508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000e6c0 con 0x7f5fa00c6e80 2023-11-29T11:22:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9d7fa700 1 -- 172.21.15.81:0/2617317508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f90004050 con 0x7f5fa00c6e80 2023-11-29T11:22:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa00b1eb0 con 0x7f5fa00c6e80 2023-11-29T11:22:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5f9d7fa700 1 -- 172.21.15.81:0/2617317508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90004400 con 0x7f5fa00c6e80 2023-11-29T11:22:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.954+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa00d08e0 con 0x7f5fa00c6e80 2023-11-29T11:22:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.958+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa00b41a0 con 0x7f5fa00c6e80 2023-11-29T11:22:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.958+0000 7f5f9d7fa700 1 -- 172.21.15.81:0/2617317508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f9002c030 con 0x7f5fa00c6e80 2023-11-29T11:22:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.958+0000 7f5f9d7fa700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f8c064ee0 0x7f5f8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.958+0000 7f5f9d7fa700 1 -- 172.21.15.81:0/2617317508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5788+0+0 (secure 0 0 0) 0x7f5f900834e0 con 0x7f5fa00c6e80 2023-11-29T11:22:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.958+0000 7f5fa4b60700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f8c064ee0 0x7f5f8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.958+0000 7f5fa4b60700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f8c064ee0 0x7f5f8c067390 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006b40 tx=0x7f5f94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:11.966+0000 7f5f9d7fa700 1 -- 172.21.15.81:0/2617317508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f900516a0 con 0x7f5fa00c6e80 2023-11-29T11:22:12.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.118+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5fa0072500 con 0x7f5fa00c6e80 2023-11-29T11:22:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.130+0000 7f5f9d7fa700 1 -- 172.21.15.81:0/2617317508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5f90054cc0 con 0x7f5fa00c6e80 2023-11-29T11:22:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f8c064ee0 msgr2=0x7f5f8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f8c064ee0 0x7f5f8c067390 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006b40 tx=0x7f5f94008040 comp rx=0 tx=0).stop 2023-11-29T11:22:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa00c6e80 msgr2=0x7f5fa014f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa00c6e80 0x7f5fa014f190 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f5f90016000 tx=0x7f5f900047e0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 shutdown_connections 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5f8c064ee0 0x7f5f8c067390 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fa01f1510 0x7f5fa00b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa00c6e80 0x7f5fa014f190 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 --2- 172.21.15.81:0/2617317508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88004400 0x7f5fa015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 >> 172.21.15.81:0/2617317508 conn(0x7f5fa009bbd0 msgr2=0x7f5fa00cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 shutdown_connections 2023-11-29T11:22:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.134+0000 7f5fa5b62700 1 -- 172.21.15.81:0/2617317508 wait complete. 2023-11-29T11:22:12.151 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:22:12.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:22:12.169 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:22:12.190 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:22:12.190 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:12.190 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:12.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:22:12.197 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:22:12.197 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:12.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:22:12.242 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:12.242 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:12.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:22:12.248 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:22:12.248 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:12.254 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:22:12.254 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-29T11:22:12.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:12.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa0a0b67700 1 Processor -- start 2023-11-29T11:22:12.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa0a0b67700 1 -- start start 2023-11-29T11:22:12.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa0a0b67700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa09c15d650 0x7fa09c0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa0a0b67700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c0cd720 con 0x7fa09c0cc020 2023-11-29T11:22:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa0a0b67700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c0cd990 con 0x7fa09c159c00 2023-11-29T11:22:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa0a0b67700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c15a040 con 0x7fa09c15d650 2023-11-29T11:22:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa09affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa09c0cc020 0x7fa09c1594f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33874/0 (socket says 172.21.15.81:33874) 2023-11-29T11:22:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa09affd700 1 -- 172.21.15.81:0/3571313049 learned_addr learned my addr 172.21.15.81:0/3571313049 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa09b7fe700 1 --2- 172.21.15.81:0/3571313049 >> v2:172.21.15.176:3300/0 conn(0x7fa09c15d650 0x7fa09c0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa09a7fc700 1 -- 172.21.15.81:0/3571313049 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782755415 0 0) 0x7fa09c0cd720 con 0x7fa09c0cc020 2023-11-29T11:22:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa09a7fc700 1 -- 172.21.15.81:0/3571313049 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0840035d0 con 0x7fa09c0cc020 2023-11-29T11:22:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa09b7fe700 1 -- 172.21.15.81:0/3571313049 >> v1:172.21.15.176:6789/0 conn(0x7fa09c159c00 legacy=0x7fa09c06bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa09b7fe700 1 -- 172.21.15.81:0/3571313049 >> v1:172.21.15.81:6789/0 conn(0x7fa09c0cc020 legacy=0x7fa09c1594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.366+0000 7fa09b7fe700 1 -- 172.21.15.81:0/3571313049 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0cdc70 con 0x7fa09c15d650 2023-11-29T11:22:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa09b7fe700 1 --2- 172.21.15.81:0/3571313049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 0x7fa09c0ce470 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009850 tx=0x7fa08c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2147c0a9568921a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa09a7fc700 1 -- 172.21.15.81:0/3571313049 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c011830 con 0x7fa09c15d650 2023-11-29T11:22:12.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa09a7fc700 1 -- 172.21.15.81:0/3571313049 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c011990 con 0x7fa09c15d650 2023-11-29T11:22:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa09a7fc700 1 -- 172.21.15.81:0/3571313049 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c011d00 con 0x7fa09c15d650 2023-11-29T11:22:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 -- 172.21.15.81:0/3571313049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 msgr2=0x7fa09c0ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 --2- 172.21.15.81:0/3571313049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 0x7fa09c0ce470 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009850 tx=0x7fa08c009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 -- 172.21.15.81:0/3571313049 shutdown_connections 2023-11-29T11:22:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 --2- 172.21.15.81:0/3571313049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 0x7fa09c0ce470 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 -- 172.21.15.81:0/3571313049 >> 172.21.15.81:0/3571313049 conn(0x7fa09c06ec40 msgr2=0x7fa09c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 -- 172.21.15.81:0/3571313049 shutdown_connections 2023-11-29T11:22:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 -- 172.21.15.81:0/3571313049 wait complete. 2023-11-29T11:22:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 Processor -- start 2023-11-29T11:22:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 -- start start 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa09c0cc020 0x7fa09c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.370+0000 7fa0a0b67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09c159c00 0x7fa09c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa0a0b67700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 0x7fa09c15a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa0a0b67700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0b2770 con 0x7fa09c159c00 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa0a0b67700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0b2900 con 0x7fa09c15d650 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa0a0b67700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0c7ad0 con 0x7fa09c0cc020 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09c159c00 0x7fa09c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09c159c00 0x7fa09c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59364/0 (socket says 172.21.15.81:59364) 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 -- 172.21.15.81:0/2204499780 learned_addr learned my addr 172.21.15.81:0/2204499780 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09b7fe700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa09c0cc020 0x7fa09c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09bfff700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 0x7fa09c15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 -- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa09c0cc020 msgr2=0x7fa09c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa09c0cc020 0x7fa09c0c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 -- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 msgr2=0x7fa09c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 0x7fa09c15a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 -- 172.21.15.81:0/2204499780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0094b0 con 0x7fa09c159c00 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09b7fe700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa09c0cc020 0x7fa09c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09affd700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09c159c00 0x7fa09c15a3e0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fa09000c700 tx=0x7fa09000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa083fff700 1 -- 172.21.15.81:0/2204499780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090005d90 con 0x7fa09c159c00 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa083fff700 1 -- 172.21.15.81:0/2204499780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0900070d0 con 0x7fa09c159c00 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c15a250 con 0x7fa09c159c00 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa083fff700 1 -- 172.21.15.81:0/2204499780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090007480 con 0x7fa09c159c00 2023-11-29T11:22:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c0cdf50 con 0x7fa09c159c00 2023-11-29T11:22:12.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c0cc470 con 0x7fa09c159c00 2023-11-29T11:22:12.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa083fff700 1 -- 172.21.15.81:0/2204499780 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa090019030 con 0x7fa09c159c00 2023-11-29T11:22:12.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa083fff700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa088064f10 0x7fa0880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa083fff700 1 -- 172.21.15.81:0/2204499780 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5788+0+0 (secure 0 0 0) 0x7fa090081220 con 0x7fa09c159c00 2023-11-29T11:22:12.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.374+0000 7fa09b7fe700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa088064f10 0x7fa0880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.378+0000 7fa09b7fe700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa088064f10 0x7fa0880673c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0090b0 tx=0x7fa08c01c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.382+0000 7fa083fff700 1 -- 172.21.15.81:0/2204499780 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa09004f450 con 0x7fa09c159c00 2023-11-29T11:22:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.578+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa09c15c770 con 0x7fa09c159c00 2023-11-29T11:22:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.578+0000 7fa083fff700 1 -- 172.21.15.81:0/2204499780 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fa090017de0 con 0x7fa09c159c00 2023-11-29T11:22:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6800,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2152214741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2152214741},{"type":"v1","addr":"172.21.15.176:6835","nonce":2152214741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6833/3107668274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3107668274},{"type":"v1","addr":"172.21.15.176:6833","nonce":3107668274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56},{"gid":8007,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3269434894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3269434894},{"type":"v1","addr":"172.21.15.81:6835","nonce":3269434894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8910,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/294890747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":294890747},{"type":"v1","addr":"172.21.15.81:6837","nonce":294890747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[]} 2023-11-29T11:22:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa088064f10 msgr2=0x7fa0880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa088064f10 0x7fa0880673c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0090b0 tx=0x7fa08c01c040 comp rx=0 tx=0).stop 2023-11-29T11:22:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09c159c00 msgr2=0x7fa09c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09c159c00 0x7fa09c15a3e0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fa09000c700 tx=0x7fa09000cac0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 shutdown_connections 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa088064f10 0x7fa0880673c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c15d650 0x7fa09c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa09c159c00 0x7fa09c15a3e0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 --2- 172.21.15.81:0/2204499780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa09c0cc020 0x7fa09c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 >> 172.21.15.81:0/2204499780 conn(0x7fa09c06ec40 msgr2=0x7fa09c0b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 shutdown_connections 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.582+0000 7fa0a0b67700 1 -- 172.21.15.81:0/2204499780 wait complete. 2023-11-29T11:22:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 68 2023-11-29T11:22:12.601 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-29T11:22:12.602 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-29T11:22:12.602 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T11:22:12.602 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:22:12.602 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-29T11:22:12.602 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-29T11:22:12.602 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T11:22:12.602 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:22:12.603 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-29T11:22:12.603 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-29T11:22:12.603 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T11:22:12.603 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:22:12.603 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-29T11:22:12.603 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-29T11:22:12.603 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T11:22:12.603 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:22:12.612 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T11:22:12.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-29T11:22:12.614 INFO:tasks.ceph.mds.a:Started 2023-11-29T11:22:12.614 DEBUG:teuthology.parallel:result is None 2023-11-29T11:22:12.615 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T11:22:12.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-29T11:22:12.617 INFO:tasks.ceph.mds.c:Started 2023-11-29T11:22:12.617 DEBUG:teuthology.parallel:result is None 2023-11-29T11:22:12.618 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T11:22:12.619 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-29T11:22:12.619 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T11:22:12.620 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-29T11:22:12.620 INFO:tasks.ceph.mds.d:Started 2023-11-29T11:22:12.621 DEBUG:teuthology.parallel:result is None 2023-11-29T11:22:12.622 INFO:tasks.ceph.mds.b:Started 2023-11-29T11:22:12.622 DEBUG:teuthology.parallel:result is None 2023-11-29T11:22:12.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-29T11:22:12.683 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-11-29T11:22:12.691 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:22:12.707 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-29T11:22:12.707 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-29T11:22:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f723492b700 1 Processor -- start 2023-11-29T11:22:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f723492b700 1 -- start start 2023-11-29T11:22:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f723492b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 0x7f7230071af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f723492b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7230072030 0x7f7230069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f723492b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7230071330 con 0x7f723015a120 2023-11-29T11:22:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f723492b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72300cec20 con 0x7f7230072030 2023-11-29T11:22:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f723492b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72300cef00 con 0x7f72300ad650 2023-11-29T11:22:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722ed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f723015a120 0x7f72300cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33896/0 (socket says 172.21.15.81:33896) 2023-11-29T11:22:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722ed9d700 1 -- 172.21.15.81:0/1869753917 learned_addr learned my addr 172.21.15.81:0/1869753917 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722e59c700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 0x7f7230071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722f59e700 1 --2- 172.21.15.81:0/1869753917 >> v2:172.21.15.176:3300/0 conn(0x7f7230072030 0x7f7230069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601143979 0 0) 0x7f7230071330 con 0x7f723015a120 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f721c0035d0 con 0x7f723015a120 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535440284 0 0) 0x7f721c0035d0 con 0x7f723015a120 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 msgr2=0x7f7230071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 0x7f7230071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 >> v2:172.21.15.176:3300/0 conn(0x7f7230072030 msgr2=0x7f7230069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 --2- 172.21.15.81:0/1869753917 >> v2:172.21.15.176:3300/0 conn(0x7f7230072030 0x7f7230069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72300715d0 con 0x7f723015a120 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f7218001670 con 0x7f723015a120 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722f59e700 1 --2- 172.21.15.81:0/1869753917 >> v2:172.21.15.176:3300/0 conn(0x7f7230072030 0x7f7230069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 >> v1:172.21.15.81:6789/0 conn(0x7f723015a120 legacy=0x7f72300cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f721c003a20 0x7f721c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f721c004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 0x7f721c004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300cec20 con 0x7f721c004450 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300cef00 con 0x7f721c003a20 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c00ba30 con 0x7f72300ad650 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722e59c700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f721c004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.718+0000 7f722ed9d700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f721c003a20 0x7f721c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722f59e700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 0x7f721c004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722e59c700 1 -- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 msgr2=0x7f721c004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722e59c700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 0x7f721c004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722e59c700 1 -- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f721c003a20 msgr2=0x7f721c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722e59c700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f721c003a20 0x7f721c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722e59c700 1 -- 172.21.15.81:0/1869753917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0035d0 con 0x7f721c004450 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722f59e700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300ad650 0x7f721c004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722e59c700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f721c004910 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f7220009b70 tx=0x7f721c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c327a2f3b1e6147 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722000e6c0 con 0x7f721c004450 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722000e820 con 0x7f721c004450 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722dd9b700 1 -- 172.21.15.81:0/1869753917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722000eb90 con 0x7f721c004450 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f723492b700 1 -- 172.21.15.81:0/1869753917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 msgr2=0x7f721c004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f723492b700 1 --2- 172.21.15.81:0/1869753917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f721c004910 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f7220009b70 tx=0x7f721c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f722f59e700 1 -- 172.21.15.81:0/1869753917 reap_dead start 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f723492b700 1 -- 172.21.15.81:0/1869753917 shutdown_connections 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f723492b700 1 -- 172.21.15.81:0/1869753917 >> 172.21.15.81:0/1869753917 conn(0x7f72300b1f90 msgr2=0x7f72300ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f723492b700 1 -- 172.21.15.81:0/1869753917 shutdown_connections 2023-11-29T11:22:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f723492b700 1 -- 172.21.15.81:0/1869753917 wait complete. 2023-11-29T11:22:12.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.722+0000 7f723492b700 1 Processor -- start 2023-11-29T11:22:12.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 -- start start 2023-11-29T11:22:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f72300c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72301e36e0 0x7f7230157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300c3e50 0x7f72300c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300c4830 con 0x7f721c004450 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300c22f0 con 0x7f72301e36e0 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72300c2520 con 0x7f72300c3e50 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f72300c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f72300c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59428/0 (socket says 172.21.15.81:59428) 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 -- 172.21.15.81:0/3320290154 learned_addr learned my addr 172.21.15.81:0/3320290154 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722e59c700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72301e36e0 0x7f7230157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722f59e700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300c3e50 0x7f72300c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 -- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300c3e50 msgr2=0x7f72300c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300c3e50 0x7f72300c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 -- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72301e36e0 msgr2=0x7f7230157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72301e36e0 0x7f7230157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 -- 172.21.15.81:0/3320290154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230071af0 con 0x7f721c004450 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722f59e700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300c3e50 0x7f72300c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f722ed9d700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f72300c1db0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f7218001aa0 tx=0x7f72180075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f72277fe700 1 -- 172.21.15.81:0/3320290154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800f690 con 0x7f721c004450 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f72277fe700 1 -- 172.21.15.81:0/3320290154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721800f7f0 con 0x7f721c004450 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72300cf1e0 con 0x7f721c004450 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f72277fe700 1 -- 172.21.15.81:0/3320290154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800fba0 con 0x7f721c004450 2023-11-29T11:22:12.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.726+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7230071c80 con 0x7f721c004450 2023-11-29T11:22:12.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.730+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7230072500 con 0x7f721c004450 2023-11-29T11:22:12.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.730+0000 7f72277fe700 1 -- 172.21.15.81:0/3320290154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f721800fd00 con 0x7f721c004450 2023-11-29T11:22:12.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.730+0000 7f72277fe700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7210064ee0 0x7f7210067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:12.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.730+0000 7f722e59c700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7210064ee0 0x7f7210067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:12.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.730+0000 7f72277fe700 1 -- 172.21.15.81:0/3320290154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5788+0+0 (secure 0 0 0) 0x7f7218081ec0 con 0x7f721c004450 2023-11-29T11:22:12.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.730+0000 7f722e59c700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7210064ee0 0x7f7210067390 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f72200090b0 tx=0x7f722001e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:12.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.738+0000 7f72277fe700 1 -- 172.21.15.81:0/3320290154 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7218050220 con 0x7f721c004450 2023-11-29T11:22:12.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:12.914+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f72300cbd80 con 0x7f721c004450 2023-11-29T11:22:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.814+0000 7f72277fe700 1 -- 172.21.15.81:0/3320290154 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v106) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7218053840 con 0x7f721c004450 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7210064ee0 msgr2=0x7f7210067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7210064ee0 0x7f7210067390 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f72200090b0 tx=0x7f722001e040 comp rx=0 tx=0).stop 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 msgr2=0x7f72300c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f72300c1db0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f7218001aa0 tx=0x7f72180075f0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 shutdown_connections 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7210064ee0 0x7f7210067390 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72300c3e50 0x7f72300c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72301e36e0 0x7f7230157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 --2- 172.21.15.81:0/3320290154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c004450 0x7f72300c1db0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 >> 172.21.15.81:0/3320290154 conn(0x7f72300b1f90 msgr2=0x7f72301df200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 shutdown_connections 2023-11-29T11:22:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.818+0000 7f723492b700 1 -- 172.21.15.81:0/3320290154 wait complete. 2023-11-29T11:22:13.826 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2023-11-29T11:22:13.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-29T11:22:13.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa8f32700 1 Processor -- start 2023-11-29T11:22:13.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa8f32700 1 -- start start 2023-11-29T11:22:13.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa8f32700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faaa40b32e0 0x7faaa40b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:13.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa8f32700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 0x7faaa406a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:13.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa8f32700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40cbe00 con 0x7faaa41584c0 2023-11-29T11:22:13.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa8f32700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa406dbd0 con 0x7faaa40b32e0 2023-11-29T11:22:13.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa8f32700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40b3c60 con 0x7faaa4069cd0 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa2ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faaa40b32e0 0x7faaa40b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa2ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faaa40b32e0 0x7faaa40b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59432/0 (socket says 172.21.15.81:59432) 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa2ffd700 1 -- 172.21.15.81:0/1755295959 learned_addr learned my addr 172.21.15.81:0/1755295959 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.946+0000 7faaa3fff700 1 --2- 172.21.15.81:0/1755295959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 0x7faaa406a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa2ffd700 1 -- 172.21.15.81:0/1755295959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 msgr2=0x7faaa406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa2ffd700 1 --2- 172.21.15.81:0/1755295959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 0x7faaa406a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa2ffd700 1 -- 172.21.15.81:0/1755295959 >> v1:172.21.15.176:6789/0 conn(0x7faaa41584c0 legacy=0x7faaa40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa2ffd700 1 -- 172.21.15.81:0/1755295959 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40cd0f0 con 0x7faaa40b32e0 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa2ffd700 1 --2- 172.21.15.81:0/1755295959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa40b32e0 0x7faaa40b3720 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7faa9400d150 tx=0x7faa9400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c468ef0e7b563c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa27fc700 1 -- 172.21.15.81:0/1755295959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94010070 con 0x7faaa40b32e0 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa27fc700 1 -- 172.21.15.81:0/1755295959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9400ddc0 con 0x7faaa40b32e0 2023-11-29T11:22:13.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa27fc700 1 -- 172.21.15.81:0/1755295959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9400b310 con 0x7faaa40b32e0 2023-11-29T11:22:13.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa8f32700 1 -- 172.21.15.81:0/1755295959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa40b32e0 msgr2=0x7faaa40b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:13.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa8f32700 1 --2- 172.21.15.81:0/1755295959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa40b32e0 0x7faaa40b3720 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7faa9400d150 tx=0x7faa9400d460 comp rx=0 tx=0).stop 2023-11-29T11:22:13.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa8f32700 1 -- 172.21.15.81:0/1755295959 shutdown_connections 2023-11-29T11:22:13.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa8f32700 1 --2- 172.21.15.81:0/1755295959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 0x7faaa406a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa8f32700 1 --2- 172.21.15.81:0/1755295959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa40b32e0 0x7faaa40b3720 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa8f32700 1 -- 172.21.15.81:0/1755295959 >> 172.21.15.81:0/1755295959 conn(0x7faaa40ce3e0 msgr2=0x7faaa40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:13.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa8f32700 1 -- 172.21.15.81:0/1755295959 shutdown_connections 2023-11-29T11:22:13.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.950+0000 7faaa8f32700 1 -- 172.21.15.81:0/1755295959 wait complete. 2023-11-29T11:22:13.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa8f32700 1 Processor -- start 2023-11-29T11:22:13.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa8f32700 1 -- start start 2023-11-29T11:22:13.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa8f32700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 0x7faaa4155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa8f32700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa40b32e0 0x7faaa40c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa8f32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa41584c0 0x7faaa40ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa8f32700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4155a40 con 0x7faaa41584c0 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa8f32700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40c7ee0 con 0x7faaa40b32e0 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa8f32700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40c81c0 con 0x7faaa4069cd0 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa41584c0 0x7faaa40ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa2ffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa40b32e0 0x7faaa40c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa41584c0 0x7faaa40ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59438/0 (socket says 172.21.15.81:59438) 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 -- 172.21.15.81:0/673783742 learned_addr learned my addr 172.21.15.81:0/673783742 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa37fe700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 0x7faaa4155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:13.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 -- 172.21.15.81:0/673783742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 msgr2=0x7faaa4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:13.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 0x7faaa4155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 -- 172.21.15.81:0/673783742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa40b32e0 msgr2=0x7faaa40c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:13.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa40b32e0 0x7faaa40c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:13.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 -- 172.21.15.81:0/673783742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9400bd40 con 0x7faaa41584c0 2023-11-29T11:22:13.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.954+0000 7faaa3fff700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa41584c0 0x7faaa40ade40 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00e810 tx=0x7faa9c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:13.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faa8bfff700 1 -- 172.21.15.81:0/673783742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00c070 con 0x7faaa41584c0 2023-11-29T11:22:13.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa40cd6b0 con 0x7faaa41584c0 2023-11-29T11:22:13.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faa8bfff700 1 -- 172.21.15.81:0/673783742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c013650 con 0x7faaa41584c0 2023-11-29T11:22:13.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faa8bfff700 1 -- 172.21.15.81:0/673783742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c013a00 con 0x7faaa41584c0 2023-11-29T11:22:13.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa40cd3d0 con 0x7faaa41584c0 2023-11-29T11:22:13.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa40cd990 con 0x7faaa41584c0 2023-11-29T11:22:13.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faa8bfff700 1 -- 172.21.15.81:0/673783742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faa9c013b60 con 0x7faaa41584c0 2023-11-29T11:22:13.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faa8bfff700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa90064ee0 0x7faa90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:13.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faa8bfff700 1 -- 172.21.15.81:0/673783742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5530+0+0 (secure 0 0 0) 0x7faa9c081960 con 0x7faaa41584c0 2023-11-29T11:22:13.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faaa37fe700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa90064ee0 0x7faa90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.958+0000 7faaa37fe700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa90064ee0 0x7faa90067390 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7faaa40c5ab0 tx=0x7faa98009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:13.970+0000 7faa8bfff700 1 -- 172.21.15.81:0/673783742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faa9c04fc90 con 0x7faaa41584c0 2023-11-29T11:22:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.186+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faaa4072500 con 0x7faaa41584c0 2023-11-29T11:22:14.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.186+0000 7faa8bfff700 1 -- 172.21.15.81:0/673783742 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5298 (secure 0 0 0) 0x7faa9c0532b0 con 0x7faaa41584c0 2023-11-29T11:22:14.192 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlSOayNhAAtezph/rP5i/F81/canwMdA==", 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdl8qMjBRAAuvMDj+jPn1OjXUEcUl34jg==", 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2023-11-29T11:22:14.194 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlIykpOhAAL31egdG19jdsaMglEpIC5w==", 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlKA1GCxAAOzBuOUs7pjJJOOFwZq8npA==", 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:22:14.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/HGdl92Q/OhAAXGWXiUvswEMnfzScuUn0cw==", 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDHGdl8TbZExAA2IBrIVdDMSaeGFjE0oBYFw==", 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCGHGdlUk9QJhAA3rf+afNjbbsQotcH4YjVQg==", 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJHGdlUPFnLRAAk4y/WOW2lDfYd22+GF2QlA==", 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCPHGdlLLatFRAAz4dG1oXNEITKomtPGnDBmw==", 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCSHGdl34DRKxAAt8kHY0+FALSWN612SIOnsQ==", 2023-11-29T11:22:14.199 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCVHGdl4zPUMBAAsF8NTRCGqXpRuVduNnWO1A==", 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCYHGdlQv/DNRAAFMTV+dTJZ0UZK2eCJiFDuw==", 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgxnnDhAAfROm0RfwzNurvq62gqmGBQ==", 2023-11-29T11:22:14.201 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlgjcpFRAAtcxPbxV34mCHxFVoGYmqmg==", 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:22:14.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlvfbxERAA6d5eRkOBOKhyToZKDKlvYQ==", 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2023-11-29T11:22:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB9HGdlDrDHGhAAfy4RAK8qFAj2Sf6GuRGhBw==", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlW+ELKBAAoMzxY7NGqIJ1SNfaQ/4qVQ==", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2023-11-29T11:22:14.204 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlqaiZMhAAPiboTL+csIYuoxSk+ZwfJA==", 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB8HGdlcf6LLxAAqtoEWzgd41N9uT9tC7bZ/Q==", 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2023-11-29T11:22:14.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2023-11-29T11:22:14.206 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2023-11-29T11:22:14.206 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2023-11-29T11:22:14.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:14.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2023-11-29T11:22:14.206 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:22:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.186+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa90064ee0 msgr2=0x7faa90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.186+0000 7faaa8f32700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa90064ee0 0x7faa90067390 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7faaa40c5ab0 tx=0x7faa98009040 comp rx=0 tx=0).stop 2023-11-29T11:22:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.186+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa41584c0 msgr2=0x7faaa40ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.186+0000 7faaa8f32700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa41584c0 0x7faaa40ade40 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00e810 tx=0x7faa9c00eb20 comp rx=0 tx=0).stop 2023-11-29T11:22:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.190+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 shutdown_connections 2023-11-29T11:22:14.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.190+0000 7faaa8f32700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faa90064ee0 0x7faa90067390 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.190+0000 7faaa8f32700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaa41584c0 0x7faaa40ade40 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.190+0000 7faaa8f32700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faaa40b32e0 0x7faaa40c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.190+0000 7faaa8f32700 1 --2- 172.21.15.81:0/673783742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faaa4069cd0 0x7faaa4155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.190+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 >> 172.21.15.81:0/673783742 conn(0x7faaa40ce3e0 msgr2=0x7faaa406abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.190+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 shutdown_connections 2023-11-29T11:22:14.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.190+0000 7faaa8f32700 1 -- 172.21.15.81:0/673783742 wait complete. 2023-11-29T11:22:14.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644dcc8700 1 Processor -- start 2023-11-29T11:22:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644dcc8700 1 -- start start 2023-11-29T11:22:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644dcc8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f6448164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644dcc8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644806ace0 con 0x7f6448159e70 2023-11-29T11:22:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644dcc8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644806a0d0 con 0x7f6448069c40 2023-11-29T11:22:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644dcc8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644806a3b0 con 0x7f64480cb470 2023-11-29T11:22:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644ccc6700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6448159e70 0x7f644806c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33900/0 (socket says 172.21.15.81:33900) 2023-11-29T11:22:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644ccc6700 1 -- 172.21.15.81:0/963661477 learned_addr learned my addr 172.21.15.81:0/963661477 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644d4c7700 1 --2- 172.21.15.81:0/963661477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f6448164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f64477fe700 1 -- 172.21.15.81:0/963661477 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978018261 0 0) 0x7f644806ace0 con 0x7f6448159e70 2023-11-29T11:22:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f64477fe700 1 -- 172.21.15.81:0/963661477 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64340035d0 con 0x7f6448159e70 2023-11-29T11:22:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f64477fe700 1 -- 172.21.15.81:0/963661477 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980725279 0 0) 0x7f644806a0d0 con 0x7f6448069c40 2023-11-29T11:22:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644d4c7700 1 -- 172.21.15.81:0/963661477 >> v1:172.21.15.176:6789/0 conn(0x7f6448069c40 legacy=0x7f64480cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644d4c7700 1 -- 172.21.15.81:0/963661477 >> v1:172.21.15.81:6789/0 conn(0x7f6448159e70 legacy=0x7f644806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644d4c7700 1 -- 172.21.15.81:0/963661477 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644806a690 con 0x7f64480cb470 2023-11-29T11:22:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f644d4c7700 1 --2- 172.21.15.81:0/963661477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f6448164a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6440009880 tx=0x7f6440009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f03c5d5bd53cd927 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f64477fe700 1 -- 172.21.15.81:0/963661477 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440011830 con 0x7f64480cb470 2023-11-29T11:22:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f64477fe700 1 -- 172.21.15.81:0/963661477 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440011990 con 0x7f64480cb470 2023-11-29T11:22:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.318+0000 7f64477fe700 1 -- 172.21.15.81:0/963661477 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440011d20 con 0x7f64480cb470 2023-11-29T11:22:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- 172.21.15.81:0/963661477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 msgr2=0x7f6448164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 --2- 172.21.15.81:0/963661477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f6448164a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6440009880 tx=0x7f6440009b90 comp rx=0 tx=0).stop 2023-11-29T11:22:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- 172.21.15.81:0/963661477 shutdown_connections 2023-11-29T11:22:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 --2- 172.21.15.81:0/963661477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f6448164a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- 172.21.15.81:0/963661477 >> 172.21.15.81:0/963661477 conn(0x7f64480ce3e0 msgr2=0x7f64480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- 172.21.15.81:0/963661477 shutdown_connections 2023-11-29T11:22:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- 172.21.15.81:0/963661477 wait complete. 2023-11-29T11:22:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 Processor -- start 2023-11-29T11:22:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- start start 2023-11-29T11:22:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6448069c40 0x7f64481580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f64480af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448159e70 0x7f644815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480ca230 con 0x7f6448159e70 2023-11-29T11:22:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480af4c0 con 0x7f6448069c40 2023-11-29T11:22:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64480ca480 con 0x7f64480cb470 2023-11-29T11:22:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448159e70 0x7f644815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448159e70 0x7f644815a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59450/0 (socket says 172.21.15.81:59450) 2023-11-29T11:22:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 -- 172.21.15.81:0/2688779714 learned_addr learned my addr 172.21.15.81:0/2688779714 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f6447fff700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f64480af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644ccc6700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6448069c40 0x7f64481580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 -- 172.21.15.81:0/2688779714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 msgr2=0x7f64480af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f64480af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 -- 172.21.15.81:0/2688779714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6448069c40 msgr2=0x7f64481580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6448069c40 0x7f64481580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 -- 172.21.15.81:0/2688779714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400094b0 con 0x7f6448159e70 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644d4c7700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448159e70 0x7f644815a490 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f64400090b0 tx=0x7f6440004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f64457fa700 1 -- 172.21.15.81:0/2688779714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644001a8c0 con 0x7f6448159e70 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f64457fa700 1 -- 172.21.15.81:0/2688779714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644001e070 con 0x7f6448159e70 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644806d0b0 con 0x7f6448159e70 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.322+0000 7f64457fa700 1 -- 172.21.15.81:0/2688779714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644001ac80 con 0x7f6448159e70 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.326+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644806a970 con 0x7f6448159e70 2023-11-29T11:22:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.326+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644815a240 con 0x7f6448159e70 2023-11-29T11:22:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.326+0000 7f64457fa700 1 -- 172.21.15.81:0/2688779714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f644000f050 con 0x7f6448159e70 2023-11-29T11:22:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.326+0000 7f64457fa700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6428064f10 0x7f64280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.326+0000 7f64457fa700 1 -- 172.21.15.81:0/2688779714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6440082b20 con 0x7f6448159e70 2023-11-29T11:22:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.326+0000 7f644ccc6700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6428064f10 0x7f64280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.330+0000 7f644ccc6700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6428064f10 0x7f64280673c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6430007fd0 tx=0x7f6430007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.334+0000 7f64457fa700 1 -- 172.21.15.81:0/2688779714 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6440050de0 con 0x7f6448159e70 2023-11-29T11:22:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.498+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64480af650 con 0x7f6448159e70 2023-11-29T11:22:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.498+0000 7f64457fa700 1 -- 172.21.15.81:0/2688779714 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+14320 (secure 0 0 0) 0x7f6440018310 con 0x7f6448159e70 2023-11-29T11:22:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":106,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:22:13.799940+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6428064f10 msgr2=0x7f64280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6428064f10 0x7f64280673c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6430007fd0 tx=0x7f6430007de0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448159e70 msgr2=0x7f644815a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448159e70 0x7f644815a490 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f64400090b0 tx=0x7f6440004770 comp rx=0 tx=0).stop 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 shutdown_connections 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6428064f10 0x7f64280673c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6448159e70 0x7f644815a490 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64480cb470 0x7f64480af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 --2- 172.21.15.81:0/2688779714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6448069c40 0x7f64481580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 >> 172.21.15.81:0/2688779714 conn(0x7f64480ce3e0 msgr2=0x7f64480ac680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 shutdown_connections 2023-11-29T11:22:14.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.502+0000 7f644dcc8700 1 -- 172.21.15.81:0/2688779714 wait complete. 2023-11-29T11:22:14.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:22:14.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:22:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903eafe700 1 Processor -- start 2023-11-29T11:22:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903eafe700 1 -- start start 2023-11-29T11:22:14.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903eafe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903806ce60 0x7f90380d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903eafe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90380cce60 0x7f903806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903eafe700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380cd2d0 con 0x7f90380cf470 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903eafe700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903815c8b0 con 0x7f90380cce60 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903eafe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903806d770 con 0x7f903806ce60 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903e2fd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90380cf470 0x7f90380cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33904/0 (socket says 172.21.15.81:33904) 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.638+0000 7f903e2fd700 1 -- 172.21.15.81:0/2042278204 learned_addr learned my addr 172.21.15.81:0/2042278204 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903dafc700 1 --2- 172.21.15.81:0/2042278204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903806ce60 0x7f90380d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903d2fb700 1 --2- 172.21.15.81:0/2042278204 >> v2:172.21.15.176:3300/0 conn(0x7f90380cce60 0x7f903806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903cafa700 1 -- 172.21.15.81:0/2042278204 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329055455 0 0) 0x7f90380cd2d0 con 0x7f90380cf470 2023-11-29T11:22:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903cafa700 1 -- 172.21.15.81:0/2042278204 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90240035d0 con 0x7f90380cf470 2023-11-29T11:22:14.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903d2fb700 1 -- 172.21.15.81:0/2042278204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903806ce60 msgr2=0x7f90380d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:14.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903d2fb700 1 --2- 172.21.15.81:0/2042278204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903806ce60 0x7f90380d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903d2fb700 1 -- 172.21.15.81:0/2042278204 >> v1:172.21.15.81:6789/0 conn(0x7f90380cf470 legacy=0x7f90380cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903d2fb700 1 -- 172.21.15.81:0/2042278204 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903806a7f0 con 0x7f90380cce60 2023-11-29T11:22:14.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903d2fb700 1 --2- 172.21.15.81:0/2042278204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90380cce60 0x7f903806d230 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9034009850 tx=0x7f9034009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7196bcb0f822daec server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903cafa700 1 -- 172.21.15.81:0/2042278204 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034011830 con 0x7f90380cce60 2023-11-29T11:22:14.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903cafa700 1 -- 172.21.15.81:0/2042278204 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9034011990 con 0x7f90380cce60 2023-11-29T11:22:14.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903cafa700 1 -- 172.21.15.81:0/2042278204 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034011d00 con 0x7f90380cce60 2023-11-29T11:22:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- 172.21.15.81:0/2042278204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90380cce60 msgr2=0x7f903806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 --2- 172.21.15.81:0/2042278204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90380cce60 0x7f903806d230 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9034009850 tx=0x7f9034009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- 172.21.15.81:0/2042278204 shutdown_connections 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 --2- 172.21.15.81:0/2042278204 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90380cce60 0x7f903806d230 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 --2- 172.21.15.81:0/2042278204 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903806ce60 0x7f90380d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- 172.21.15.81:0/2042278204 >> 172.21.15.81:0/2042278204 conn(0x7f90380b5760 msgr2=0x7f90380b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- 172.21.15.81:0/2042278204 shutdown_connections 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- 172.21.15.81:0/2042278204 wait complete. 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 Processor -- start 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- start start 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903806ce60 0x7f9038155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90380cce60 0x7f90380af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90380cf470 0x7f90380af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380b2fd0 con 0x7f90380cf470 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9038158e00 con 0x7f903806ce60 2023-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.642+0000 7f903eafe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380aff10 con 0x7f90380cce60 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90380cf470 0x7f90380af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90380cf470 0x7f90380af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59452/0 (socket says 172.21.15.81:59452) 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 -- 172.21.15.81:0/3446111600 learned_addr learned my addr 172.21.15.81:0/3446111600 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903d2fb700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90380cce60 0x7f90380af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903dafc700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903806ce60 0x7f9038155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 -- 172.21.15.81:0/3446111600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90380cce60 msgr2=0x7f90380af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90380cce60 0x7f90380af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 -- 172.21.15.81:0/3446111600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903806ce60 msgr2=0x7f9038155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903806ce60 0x7f9038155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 -- 172.21.15.81:0/3446111600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340094b0 con 0x7f90380cf470 2023-11-29T11:22:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903e2fd700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90380cf470 0x7f90380af8e0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f903000ca20 tx=0x7f903000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f902e7fc700 1 -- 172.21.15.81:0/3446111600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030007480 con 0x7f90380cf470 2023-11-29T11:22:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f902e7fc700 1 -- 172.21.15.81:0/3446111600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90300075e0 con 0x7f90380cf470 2023-11-29T11:22:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903806adb0 con 0x7f90380cf470 2023-11-29T11:22:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f902e7fc700 1 -- 172.21.15.81:0/3446111600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030007970 con 0x7f90380cf470 2023-11-29T11:22:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903806aad0 con 0x7f90380cf470 2023-11-29T11:22:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903806b090 con 0x7f90380cf470 2023-11-29T11:22:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.646+0000 7f902e7fc700 1 -- 172.21.15.81:0/3446111600 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9030019030 con 0x7f90380cf470 2023-11-29T11:22:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.650+0000 7f902e7fc700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f901c064ee0 0x7f901c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.650+0000 7f902e7fc700 1 -- 172.21.15.81:0/3446111600 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f90300813f0 con 0x7f90380cf470 2023-11-29T11:22:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.650+0000 7f903dafc700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f901c064ee0 0x7f901c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.650+0000 7f903dafc700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f901c064ee0 0x7f901c067390 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9028009b50 tx=0x7f9028009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.654+0000 7f902e7fc700 1 -- 172.21.15.81:0/3446111600 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f903004f7a0 con 0x7f90380cf470 2023-11-29T11:22:14.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.818+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9038072c20 con 0x7f90380cf470 2023-11-29T11:22:14.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.818+0000 7f902e7fc700 1 -- 172.21.15.81:0/3446111600 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9030017020 con 0x7f90380cf470 2023-11-29T11:22:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:22:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f901c064ee0 msgr2=0x7f901c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f901c064ee0 0x7f901c067390 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9028009b50 tx=0x7f9028009240 comp rx=0 tx=0).stop 2023-11-29T11:22:14.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90380cf470 msgr2=0x7f90380af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90380cf470 0x7f90380af8e0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f903000ca20 tx=0x7f903000ca50 comp rx=0 tx=0).stop 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 shutdown_connections 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f901c064ee0 0x7f901c067390 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90380cf470 0x7f90380af8e0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90380cce60 0x7f90380af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 --2- 172.21.15.81:0/3446111600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903806ce60 0x7f9038155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 >> 172.21.15.81:0/3446111600 conn(0x7f90380b5760 msgr2=0x7f90380b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 shutdown_connections 2023-11-29T11:22:14.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.822+0000 7f903eafe700 1 -- 172.21.15.81:0/3446111600 wait complete. 2023-11-29T11:22:14.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:22:14.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb65a4fd700 1 Processor -- start 2023-11-29T11:22:14.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb65a4fd700 1 -- start start 2023-11-29T11:22:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb65a4fd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb6540b00e0 0x7fb65415d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb65a4fd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb65415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb65a4fd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6540b04b0 0x7fb65415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb65a4fd700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65409c150 con 0x7fb6540b04b0 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb65a4fd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540ac050 con 0x7fb6540b00e0 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb65a4fd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65406d700 con 0x7fb6540cbb30 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6540b04b0 0x7fb65415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6540b04b0 0x7fb65415dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59460/0 (socket says 172.21.15.81:59460) 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 -- 172.21.15.81:0/2194261233 learned_addr learned my addr 172.21.15.81:0/2194261233 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb658cfa700 1 --2- 172.21.15.81:0/2194261233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb65415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb6594fb700 1 --2- 172.21.15.81:0/2194261233 >> v2:172.21.15.176:3300/0 conn(0x7fb6540b00e0 0x7fb65415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 -- 172.21.15.81:0/2194261233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 msgr2=0x7fb65415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:14.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 --2- 172.21.15.81:0/2194261233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb65415d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 -- 172.21.15.81:0/2194261233 >> v2:172.21.15.176:3300/0 conn(0x7fb6540b00e0 msgr2=0x7fb65415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:14.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 --2- 172.21.15.81:0/2194261233 >> v2:172.21.15.176:3300/0 conn(0x7fb6540b00e0 0x7fb65415d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 -- 172.21.15.81:0/2194261233 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540ac260 con 0x7fb6540b04b0 2023-11-29T11:22:14.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb659cfc700 1 --2- 172.21.15.81:0/2194261233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b04b0 0x7fb65415dbf0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb654066100 tx=0x7fb64c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4676e7ab36ecc74e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb64bfff700 1 -- 172.21.15.81:0/2194261233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00e070 con 0x7fb6540b04b0 2023-11-29T11:22:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb64bfff700 1 -- 172.21.15.81:0/2194261233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c00b910 con 0x7fb6540b04b0 2023-11-29T11:22:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.954+0000 7fb64bfff700 1 -- 172.21.15.81:0/2194261233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00bcc0 con 0x7fb6540b04b0 2023-11-29T11:22:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- 172.21.15.81:0/2194261233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b04b0 msgr2=0x7fb65415dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/2194261233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b04b0 0x7fb65415dbf0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb654066100 tx=0x7fb64c00b330 comp rx=0 tx=0).stop 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- 172.21.15.81:0/2194261233 shutdown_connections 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/2194261233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb65415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/2194261233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b04b0 0x7fb65415dbf0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/2194261233 >> v2:172.21.15.176:3300/0 conn(0x7fb6540b00e0 0x7fb65415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- 172.21.15.81:0/2194261233 >> 172.21.15.81:0/2194261233 conn(0x7fb6540cae70 msgr2=0x7fb6540cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- 172.21.15.81:0/2194261233 shutdown_connections 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- 172.21.15.81:0/2194261233 wait complete. 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 Processor -- start 2023-11-29T11:22:14.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- start start 2023-11-29T11:22:14.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b00e0 0x7fb6540c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6540b04b0 0x7fb65414a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb654069c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540704b0 con 0x7fb6540b00e0 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb654070160 con 0x7fb6540b04b0 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb65a4fd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65414ad20 con 0x7fb6540cbb30 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb6594fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b00e0 0x7fb6540c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb658cfa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6540b04b0 0x7fb65414a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb6594fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b00e0 0x7fb6540c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59462/0 (socket says 172.21.15.81:59462) 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb6594fb700 1 -- 172.21.15.81:0/3547210533 learned_addr learned my addr 172.21.15.81:0/3547210533 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb659cfc700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb654069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb6594fb700 1 -- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 msgr2=0x7fb654069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb6594fb700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb654069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb6594fb700 1 -- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6540b04b0 msgr2=0x7fb65414a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:14.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb6594fb700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6540b04b0 0x7fb65414a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb6594fb700 1 -- 172.21.15.81:0/3547210533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c009b30 con 0x7fb6540b00e0 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb658cfa700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6540b04b0 0x7fb65414a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.958+0000 7fb659cfc700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb654069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb6594fb700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b00e0 0x7fb6540c7c60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb65000e940 tx=0x7fb65000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb649ffb700 1 -- 172.21.15.81:0/3547210533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650013680 con 0x7fb6540b00e0 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb649ffb700 1 -- 172.21.15.81:0/3547210533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6500137e0 con 0x7fb6540b00e0 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65409bdb0 con 0x7fb6540b00e0 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb649ffb700 1 -- 172.21.15.81:0/3547210533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650013b70 con 0x7fb6540b00e0 2023-11-29T11:22:14.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6540cc660 con 0x7fb6540b00e0 2023-11-29T11:22:14.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6540cc9f0 con 0x7fb6540b00e0 2023-11-29T11:22:14.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb649ffb700 1 -- 172.21.15.81:0/3547210533 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb650019030 con 0x7fb6540b00e0 2023-11-29T11:22:14.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.962+0000 7fb649ffb700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb638064f10 0x7fb6380673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:14.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.966+0000 7fb649ffb700 1 -- 172.21.15.81:0/3547210533 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb650081c00 con 0x7fb6540b00e0 2023-11-29T11:22:14.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.966+0000 7fb658cfa700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb638064f10 0x7fb6380673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:14.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.966+0000 7fb658cfa700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb638064f10 0x7fb6380673c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb64400bfd0 tx=0x7fb64400b450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:14.970+0000 7fb649ffb700 1 -- 172.21.15.81:0/3547210533 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb65004fe40 con 0x7fb6540b00e0 2023-11-29T11:22:15.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb654070720 con 0x7fb6540b00e0 2023-11-29T11:22:15.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb649ffb700 1 -- 172.21.15.81:0/3547210533 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb650053460 con 0x7fb6540b00e0 2023-11-29T11:22:15.142 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb638064f10 msgr2=0x7fb6380673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb638064f10 0x7fb6380673c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb64400bfd0 tx=0x7fb64400b450 comp rx=0 tx=0).stop 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b00e0 msgr2=0x7fb6540c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b00e0 0x7fb6540c7c60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb65000e940 tx=0x7fb65000ec50 comp rx=0 tx=0).stop 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 shutdown_connections 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb638064f10 0x7fb6380673c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6540cbb30 0x7fb654069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6540b04b0 0x7fb65414a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 --2- 172.21.15.81:0/3547210533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6540b00e0 0x7fb6540c7c60 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 >> 172.21.15.81:0/3547210533 conn(0x7fb6540cae70 msgr2=0x7fb6540aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 shutdown_connections 2023-11-29T11:22:15.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.134+0000 7fb65a4fd700 1 -- 172.21.15.81:0/3547210533 wait complete. 2023-11-29T11:22:15.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-29T11:22:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b19766700 1 Processor -- start 2023-11-29T11:22:15.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b19766700 1 -- start start 2023-11-29T11:22:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b19766700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b1413cef0 0x7f1b1415b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b19766700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1406c640 0x7f1b1406ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b19766700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1b1415da90 0x7f1b1415df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b19766700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1406cfd0 con 0x7f1b1413cef0 2023-11-29T11:22:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b19766700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1415e9f0 con 0x7f1b1415da90 2023-11-29T11:22:15.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b19766700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1415e450 con 0x7f1b1406c640 2023-11-29T11:22:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b13fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b1413cef0 0x7f1b1415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b13fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b1413cef0 0x7f1b1415b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59470/0 (socket says 172.21.15.81:59470) 2023-11-29T11:22:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b137fe700 1 --2- 172.21.15.81:0/1616143927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1406c640 0x7f1b1406ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b18f65700 1 --2- 172.21.15.81:0/1616143927 >> v2:172.21.15.176:3300/0 conn(0x7f1b1415da90 0x7f1b1415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.258+0000 7f1b13fff700 1 -- 172.21.15.81:0/1616143927 learned_addr learned my addr 172.21.15.81:0/1616143927 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b13fff700 1 -- 172.21.15.81:0/1616143927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1406c640 msgr2=0x7f1b1406ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b13fff700 1 --2- 172.21.15.81:0/1616143927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1406c640 0x7f1b1406ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b13fff700 1 -- 172.21.15.81:0/1616143927 >> v2:172.21.15.176:3300/0 conn(0x7f1b1415da90 msgr2=0x7f1b1415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b13fff700 1 --2- 172.21.15.81:0/1616143927 >> v2:172.21.15.176:3300/0 conn(0x7f1b1415da90 0x7f1b1415df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b13fff700 1 -- 172.21.15.81:0/1616143927 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1415e710 con 0x7f1b1413cef0 2023-11-29T11:22:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b18f65700 1 --2- 172.21.15.81:0/1616143927 >> v2:172.21.15.176:3300/0 conn(0x7f1b1415da90 0x7f1b1415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b13fff700 1 --2- 172.21.15.81:0/1616143927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1413cef0 0x7f1b1415b100 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009910 tx=0x7f1b04009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed2f03959e73e64 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b12ffd700 1 -- 172.21.15.81:0/1616143927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04011830 con 0x7f1b1413cef0 2023-11-29T11:22:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b12ffd700 1 -- 172.21.15.81:0/1616143927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04011990 con 0x7f1b1413cef0 2023-11-29T11:22:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b12ffd700 1 -- 172.21.15.81:0/1616143927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04011d40 con 0x7f1b1413cef0 2023-11-29T11:22:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 -- 172.21.15.81:0/1616143927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1413cef0 msgr2=0x7f1b1415b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 --2- 172.21.15.81:0/1616143927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1413cef0 0x7f1b1415b100 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009910 tx=0x7f1b04009c20 comp rx=0 tx=0).stop 2023-11-29T11:22:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 -- 172.21.15.81:0/1616143927 shutdown_connections 2023-11-29T11:22:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 --2- 172.21.15.81:0/1616143927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1406c640 0x7f1b1406ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 --2- 172.21.15.81:0/1616143927 >> v2:172.21.15.176:3300/0 conn(0x7f1b1415da90 0x7f1b1415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 --2- 172.21.15.81:0/1616143927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1413cef0 0x7f1b1415b100 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 -- 172.21.15.81:0/1616143927 >> 172.21.15.81:0/1616143927 conn(0x7f1b1406e000 msgr2=0x7f1b140b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:15.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 -- 172.21.15.81:0/1616143927 shutdown_connections 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 -- 172.21.15.81:0/1616143927 wait complete. 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 Processor -- start 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.262+0000 7f1b19766700 1 -- start start 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1406c640 0x7f1b14138660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1413cef0 0x7f1b141f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b1415da90 0x7f1b1413b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1415b500 con 0x7f1b1406c640 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141f55c0 con 0x7f1b1415da90 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141f58a0 con 0x7f1b1413cef0 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1406c640 0x7f1b14138660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1406c640 0x7f1b14138660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59474/0 (socket says 172.21.15.81:59474) 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 -- 172.21.15.81:0/2926424749 learned_addr learned my addr 172.21.15.81:0/2926424749 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b137fe700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1413cef0 0x7f1b141f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b18f65700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b1415da90 0x7f1b1413b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 -- 172.21.15.81:0/2926424749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1413cef0 msgr2=0x7f1b141f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1413cef0 0x7f1b141f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 -- 172.21.15.81:0/2926424749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b1415da90 msgr2=0x7f1b1413b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b1415da90 0x7f1b1413b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 -- 172.21.15.81:0/2926424749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c009a70 con 0x7f1b1406c640 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b13fff700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1406c640 0x7f1b14138660 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1b1406bf90 tx=0x7f1b04004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b10ff9700 1 -- 172.21.15.81:0/2926424749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04004240 con 0x7f1b1406c640 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b10ff9700 1 -- 172.21.15.81:0/2926424749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0401f070 con 0x7f1b1406c640 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b10ff9700 1 -- 172.21.15.81:0/2926424749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040045e0 con 0x7f1b1406c640 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04009570 con 0x7f1b1406c640 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1415a900 con 0x7f1b1406c640 2023-11-29T11:22:15.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.266+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1415a620 con 0x7f1b1406c640 2023-11-29T11:22:15.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.270+0000 7f1b10ff9700 1 -- 172.21.15.81:0/2926424749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1b0402a020 con 0x7f1b1406c640 2023-11-29T11:22:15.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.270+0000 7f1b10ff9700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1af8064ee0 0x7f1af8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.270+0000 7f1b10ff9700 1 -- 172.21.15.81:0/2926424749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1b040833e0 con 0x7f1b1406c640 2023-11-29T11:22:15.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.270+0000 7f1b137fe700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1af8064ee0 0x7f1af8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.270+0000 7f1b137fe700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1af8064ee0 0x7f1af8067390 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1b1415e290 tx=0x7f1afc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:15.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.274+0000 7f1b10ff9700 1 -- 172.21.15.81:0/2926424749 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1b040516c0 con 0x7f1b1406c640 2023-11-29T11:22:15.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1b1415abe0 con 0x7f1b1406c640 2023-11-29T11:22:15.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b10ff9700 1 -- 172.21.15.81:0/2926424749 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1b04015090 con 0x7f1b1406c640 2023-11-29T11:22:15.444 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:15.444 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "rbd" 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:15.445 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1af8064ee0 msgr2=0x7f1af8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1af8064ee0 0x7f1af8067390 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1b1415e290 tx=0x7f1afc009240 comp rx=0 tx=0).stop 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1406c640 msgr2=0x7f1b14138660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1406c640 0x7f1b14138660 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1b1406bf90 tx=0x7f1b04004770 comp rx=0 tx=0).stop 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 shutdown_connections 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1af8064ee0 0x7f1af8067390 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b1415da90 0x7f1b1413b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b1413cef0 0x7f1b141f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 --2- 172.21.15.81:0/2926424749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b1406c640 0x7f1b14138660 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 >> 172.21.15.81:0/2926424749 conn(0x7f1b1406e000 msgr2=0x7f1b141580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 shutdown_connections 2023-11-29T11:22:15.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.438+0000 7f1b19766700 1 -- 172.21.15.81:0/2926424749 wait complete. 2023-11-29T11:22:15.459 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-29T11:22:15.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-29T11:22:15.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.570+0000 7f5f0ffff700 1 Processor -- start 2023-11-29T11:22:15.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.570+0000 7f5f0ffff700 1 -- start start 2023-11-29T11:22:15.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 0x7f5f1006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f100cf0e0 0x7f5f100cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f100cfa80 con 0x7f5f100b1ae0 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f100d0ab0 con 0x7f5f100cf0e0 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1006a9c0 con 0x7f5f1006a4c0 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f100cf0e0 0x7f5f100cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0f7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f100cf0e0 0x7f5f100cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59480/0 (socket says 172.21.15.81:59480) 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0f7fe700 1 -- 172.21.15.81:0/1886133780 learned_addr learned my addr 172.21.15.81:0/1886133780 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0e7fc700 1 --2- 172.21.15.81:0/1886133780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 0x7f5f1006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0f7fe700 1 -- 172.21.15.81:0/1886133780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 msgr2=0x7f5f1006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0f7fe700 1 --2- 172.21.15.81:0/1886133780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 0x7f5f1006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0f7fe700 1 -- 172.21.15.81:0/1886133780 >> v1:172.21.15.176:6789/0 conn(0x7f5f100b1ae0 legacy=0x7f5f100d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0f7fe700 1 -- 172.21.15.81:0/1886133780 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1006aca0 con 0x7f5f100cf0e0 2023-11-29T11:22:15.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0f7fe700 1 --2- 172.21.15.81:0/1886133780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100cf0e0 0x7f5f100cf540 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009e50 tx=0x7f5f0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00cbae847567704 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:15.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0dffb700 1 -- 172.21.15.81:0/1886133780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800e070 con 0x7f5f100cf0e0 2023-11-29T11:22:15.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0dffb700 1 -- 172.21.15.81:0/1886133780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800b9c0 con 0x7f5f100cf0e0 2023-11-29T11:22:15.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0dffb700 1 -- 172.21.15.81:0/1886133780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800bd70 con 0x7f5f100cf0e0 2023-11-29T11:22:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 -- 172.21.15.81:0/1886133780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100cf0e0 msgr2=0x7f5f100cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/1886133780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100cf0e0 0x7f5f100cf540 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009e50 tx=0x7f5f0800b330 comp rx=0 tx=0).stop 2023-11-29T11:22:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 -- 172.21.15.81:0/1886133780 shutdown_connections 2023-11-29T11:22:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/1886133780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100cf0e0 0x7f5f100cf540 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/1886133780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 0x7f5f1006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 -- 172.21.15.81:0/1886133780 >> 172.21.15.81:0/1886133780 conn(0x7f5f1009bbd0 msgr2=0x7f5f100b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 -- 172.21.15.81:0/1886133780 shutdown_connections 2023-11-29T11:22:15.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.574+0000 7f5f0ffff700 1 -- 172.21.15.81:0/1886133780 wait complete. 2023-11-29T11:22:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 Processor -- start 2023-11-29T11:22:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 -- start start 2023-11-29T11:22:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 0x7f5f1015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100b1ae0 0x7f5f101560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f100cf0e0 0x7f5f101582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100c69d0 con 0x7f5f100b1ae0 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1015e3b0 con 0x7f5f100cf0e0 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1015d5d0 con 0x7f5f1006a4c0 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100b1ae0 0x7f5f101560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100b1ae0 0x7f5f101560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59482/0 (socket says 172.21.15.81:59482) 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 -- 172.21.15.81:0/633159092 learned_addr learned my addr 172.21.15.81:0/633159092 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0effd700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 0x7f5f1015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0f7fe700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f100cf0e0 0x7f5f101582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 -- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 msgr2=0x7f5f1015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 0x7f5f1015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 -- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f100cf0e0 msgr2=0x7f5f101582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:15.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f100cf0e0 0x7f5f101582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:15.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 -- 172.21.15.81:0/633159092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08009b30 con 0x7f5f100b1ae0 2023-11-29T11:22:15.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0f7fe700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f100cf0e0 0x7f5f101582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:15.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0e7fc700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100b1ae0 0x7f5f101560c0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000d7d0 tx=0x7f5f0000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:15.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5ef7fff700 1 -- 172.21.15.81:0/633159092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f000125f0 con 0x7f5f100b1ae0 2023-11-29T11:22:15.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5ef7fff700 1 -- 172.21.15.81:0/633159092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f00012750 con 0x7f5f100b1ae0 2023-11-29T11:22:15.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5ef7fff700 1 -- 172.21.15.81:0/633159092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00012b00 con 0x7f5f100b1ae0 2023-11-29T11:22:15.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f100b4380 con 0x7f5f100b1ae0 2023-11-29T11:22:15.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.578+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1006af80 con 0x7f5f100b1ae0 2023-11-29T11:22:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.582+0000 7f5ef7fff700 1 -- 172.21.15.81:0/633159092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f00012c60 con 0x7f5f100b1ae0 2023-11-29T11:22:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.582+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f100b1eb0 con 0x7f5f100b1ae0 2023-11-29T11:22:15.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.582+0000 7f5ef7fff700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5efc064ee0 0x7f5efc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.582+0000 7f5ef7fff700 1 -- 172.21.15.81:0/633159092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5f00082130 con 0x7f5f100b1ae0 2023-11-29T11:22:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.582+0000 7f5f0effd700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5efc064ee0 0x7f5efc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:15.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.582+0000 7f5f0effd700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5efc064ee0 0x7f5efc067390 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5f04000f60 tx=0x7f5f04009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:15.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.590+0000 7f5ef7fff700 1 -- 172.21.15.81:0/633159092 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f000504e0 con 0x7f5f100b1ae0 2023-11-29T11:22:15.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:15.750+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5f10072500 con 0x7f5f100b1ae0 2023-11-29T11:22:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.186+0000 7f5ef7fff700 1 -- 172.21.15.81:0/633159092 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5f00053b00 con 0x7f5f100b1ae0 2023-11-29T11:22:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.190+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5efc064ee0 msgr2=0x7f5efc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.190+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5efc064ee0 0x7f5efc067390 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5f04000f60 tx=0x7f5f04009040 comp rx=0 tx=0).stop 2023-11-29T11:22:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.190+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100b1ae0 msgr2=0x7f5f101560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.190+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100b1ae0 0x7f5f101560c0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000d7d0 tx=0x7f5f0000db90 comp rx=0 tx=0).stop 2023-11-29T11:22:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.194+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 shutdown_connections 2023-11-29T11:22:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.194+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5efc064ee0 0x7f5efc067390 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.194+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f100cf0e0 0x7f5f101582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.194+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f100b1ae0 0x7f5f101560c0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.194+0000 7f5f0ffff700 1 --2- 172.21.15.81:0/633159092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f1006a4c0 0x7f5f1015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.194+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 >> 172.21.15.81:0/633159092 conn(0x7f5f1009bbd0 msgr2=0x7f5f100d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:16.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.194+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 shutdown_connections 2023-11-29T11:22:16.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.194+0000 7f5f0ffff700 1 -- 172.21.15.81:0/633159092 wait complete. 2023-11-29T11:22:16.201 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-11-29T11:22:16.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-29T11:22:16.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feeff59e700 1 Processor -- start 2023-11-29T11:22:16.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feeff59e700 1 -- start start 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feeff59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fef00160420 0x7fef000cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feeff59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0006b420 con 0x7fef000c13d0 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feeff59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef001607f0 con 0x7fef000b39d0 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feeff59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0006aef0 con 0x7fef00160420 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefed9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fef000c13d0 0x7fef000cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33914/0 (socket says 172.21.15.81:33914) 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefed9d700 1 -- 172.21.15.81:0/1068360365 learned_addr learned my addr 172.21.15.81:0/1068360365 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefe59c700 1 --2- 172.21.15.81:0/1068360365 >> v2:172.21.15.176:3300/0 conn(0x7fef00160420 0x7fef000cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101746902 0 0) 0x7fef0006b420 con 0x7fef000c13d0 2023-11-29T11:22:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec0035d0 con 0x7fef000c13d0 2023-11-29T11:22:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 235410627 0 0) 0x7feeec0035d0 con 0x7fef000c13d0 2023-11-29T11:22:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 >> v2:172.21.15.176:3300/0 conn(0x7fef00160420 msgr2=0x7fef000cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 --2- 172.21.15.81:0/1068360365 >> v2:172.21.15.176:3300/0 conn(0x7fef00160420 0x7fef000cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 >> v1:172.21.15.176:6789/0 conn(0x7fef000b39d0 legacy=0x7fef00164880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0006b140 con 0x7fef000c13d0 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7feef80019f0 con 0x7fef000c13d0 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 >> v1:172.21.15.81:6789/0 conn(0x7fef000c13d0 legacy=0x7fef000cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeec003a20 0x7feeec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec004870 0x7feeec004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeec005220 0x7feeec00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0006aef0 con 0x7feeec003a20 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec00c0a0 con 0x7feeec005220 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec00c260 con 0x7feeec004870 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefe59c700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeec003a20 0x7feeec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefed9d700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeec005220 0x7feeec00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefdd9b700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec004870 0x7feeec004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefe59c700 1 -- 172.21.15.81:0/1068360365 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec004870 msgr2=0x7feeec004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefe59c700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec004870 0x7feeec004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefe59c700 1 -- 172.21.15.81:0/1068360365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeec005220 msgr2=0x7feeec00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefe59c700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feeec005220 0x7feeec00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefed9d700 1 -- 172.21.15.81:0/1068360365 reap_dead start 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.326+0000 7feefe59c700 1 -- 172.21.15.81:0/1068360365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0035d0 con 0x7feeec003a20 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feefe59c700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeec003a20 0x7feeec003e30 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7feee8009b70 tx=0x7feeec0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed657ee58f53a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800e640 con 0x7feeec003a20 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee800e7a0 con 0x7feeec003a20 2023-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feefd59a700 1 -- 172.21.15.81:0/1068360365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800eb10 con 0x7feeec003a20 2023-11-29T11:22:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feeff59e700 1 -- 172.21.15.81:0/1068360365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeec003a20 msgr2=0x7feeec003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feeff59e700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeec003a20 0x7feeec003e30 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7feee8009b70 tx=0x7feeec0058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feeff59e700 1 -- 172.21.15.81:0/1068360365 shutdown_connections 2023-11-29T11:22:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feeff59e700 1 --2- 172.21.15.81:0/1068360365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeec003a20 0x7feeec003e30 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feeff59e700 1 -- 172.21.15.81:0/1068360365 >> 172.21.15.81:0/1068360365 conn(0x7fef000ce400 msgr2=0x7fef000ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feeff59e700 1 -- 172.21.15.81:0/1068360365 shutdown_connections 2023-11-29T11:22:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.330+0000 7feeff59e700 1 -- 172.21.15.81:0/1068360365 wait complete. 2023-11-29T11:22:16.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 Processor -- start 2023-11-29T11:22:16.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 -- start start 2023-11-29T11:22:16.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec003a20 0x7fef000cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:16.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef000ccc40 0x7fef0015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:16.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef0015a8e0 0x7fef0015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c1f30 con 0x7fef0015a8e0 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c2180 con 0x7fef000ccc40 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c2460 con 0x7feeec003a20 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef0015a8e0 0x7fef0015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef0015a8e0 0x7fef0015ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59502/0 (socket says 172.21.15.81:59502) 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 -- 172.21.15.81:0/510572376 learned_addr learned my addr 172.21.15.81:0/510572376 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefe59c700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec003a20 0x7fef000cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefdd9b700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef000ccc40 0x7fef0015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 -- 172.21.15.81:0/510572376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec003a20 msgr2=0x7fef000cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec003a20 0x7fef000cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 -- 172.21.15.81:0/510572376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef000ccc40 msgr2=0x7fef0015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef000ccc40 0x7fef0015d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 -- 172.21.15.81:0/510572376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00164360 con 0x7fef0015a8e0 2023-11-29T11:22:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feefed9d700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef0015a8e0 0x7fef0015ad20 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fef000c1f00 tx=0x7feef8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:16.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feef6ffd700 1 -- 172.21.15.81:0/510572376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800a8e0 con 0x7fef0015a8e0 2023-11-29T11:22:16.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feef6ffd700 1 -- 172.21.15.81:0/510572376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800aa40 con 0x7fef0015a8e0 2023-11-29T11:22:16.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef00164080 con 0x7fef0015a8e0 2023-11-29T11:22:16.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.334+0000 7feef6ffd700 1 -- 172.21.15.81:0/510572376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800adb0 con 0x7fef0015a8e0 2023-11-29T11:22:16.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.338+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000ad6c0 con 0x7fef0015a8e0 2023-11-29T11:22:16.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.338+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef00072500 con 0x7fef0015a8e0 2023-11-29T11:22:16.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.338+0000 7feef6ffd700 1 -- 172.21.15.81:0/510572376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feef801d460 con 0x7fef0015a8e0 2023-11-29T11:22:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.338+0000 7feef6ffd700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feee0064f10 0x7feee00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.338+0000 7feef6ffd700 1 -- 172.21.15.81:0/510572376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5900+0+0 (secure 0 0 0) 0x7feef8082d90 con 0x7fef0015a8e0 2023-11-29T11:22:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.338+0000 7feefe59c700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feee0064f10 0x7feee00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:16.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.342+0000 7feefe59c700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feee0064f10 0x7feee00673c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7feee80090b0 tx=0x7feee801e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:16.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.346+0000 7feef6ffd700 1 -- 172.21.15.81:0/510572376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feef8051010 con 0x7fef0015a8e0 2023-11-29T11:22:16.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:16.506+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fef0006f910 con 0x7fef0015a8e0 2023-11-29T11:22:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.194+0000 7feef6ffd700 1 -- 172.21.15.81:0/510572376 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) v1 ==== 170+0+0 (secure 0 0 0) 0x7feef8054630 con 0x7fef0015a8e0 2023-11-29T11:22:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.210+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feee0064f10 msgr2=0x7feee00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.210+0000 7feeff59e700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feee0064f10 0x7feee00673c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7feee80090b0 tx=0x7feee801e040 comp rx=0 tx=0).stop 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.210+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef0015a8e0 msgr2=0x7fef0015ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.210+0000 7feeff59e700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef0015a8e0 0x7fef0015ad20 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fef000c1f00 tx=0x7feef8001a20 comp rx=0 tx=0).stop 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.210+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 shutdown_connections 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.214+0000 7feeff59e700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feee0064f10 0x7feee00673c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.214+0000 7feeff59e700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef0015a8e0 0x7fef0015ad20 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.214+0000 7feeff59e700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef000ccc40 0x7fef0015d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.214+0000 7feeff59e700 1 --2- 172.21.15.81:0/510572376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeec003a20 0x7fef000cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.214+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 >> 172.21.15.81:0/510572376 conn(0x7fef000ce400 msgr2=0x7fef000ac9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.214+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 shutdown_connections 2023-11-29T11:22:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.214+0000 7feeff59e700 1 -- 172.21.15.81:0/510572376 wait complete. 2023-11-29T11:22:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-11-29T11:22:17.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-29T11:22:17.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.342+0000 7ff85184e700 1 Processor -- start 2023-11-29T11:22:17.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.342+0000 7ff85184e700 1 -- start start 2023-11-29T11:22:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff84c0cbaf0 0x7ff84c165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c15a3a0 con 0x7ff84c06a6e0 2023-11-29T11:22:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c0ca430 con 0x7ff84c06f010 2023-11-29T11:22:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c0ca710 con 0x7ff84c0cbaf0 2023-11-29T11:22:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85104d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff84c0cbaf0 0x7ff84c165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85084c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff84c06a6e0 0x7ff84c06aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33920/0 (socket says 172.21.15.81:33920) 2023-11-29T11:22:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85084c700 1 -- 172.21.15.81:0/191881765 learned_addr learned my addr 172.21.15.81:0/191881765 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff8437fe700 1 -- 172.21.15.81:0/191881765 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251331472 0 0) 0x7ff848001110 con 0x7ff84c06a6e0 2023-11-29T11:22:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff8437fe700 1 -- 172.21.15.81:0/191881765 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8340035d0 con 0x7ff84c06a6e0 2023-11-29T11:22:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff8437fe700 1 -- 172.21.15.81:0/191881765 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790653968 0 0) 0x7ff84c0ca430 con 0x7ff84c06f010 2023-11-29T11:22:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85104d700 1 -- 172.21.15.81:0/191881765 >> v1:172.21.15.176:6789/0 conn(0x7ff84c06f010 legacy=0x7ff84c161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85104d700 1 -- 172.21.15.81:0/191881765 >> v1:172.21.15.81:6789/0 conn(0x7ff84c06a6e0 legacy=0x7ff84c06aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85104d700 1 -- 172.21.15.81:0/191881765 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0ca9f0 con 0x7ff84c0cbaf0 2023-11-29T11:22:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85104d700 1 --2- 172.21.15.81:0/191881765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c0cbaf0 0x7ff84c165190 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7ff844009d90 tx=0x7ff84400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5221d51b0e0eb3a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff8437fe700 1 -- 172.21.15.81:0/191881765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400e070 con 0x7ff84c0cbaf0 2023-11-29T11:22:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff8437fe700 1 -- 172.21.15.81:0/191881765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84400bb20 con 0x7ff84c0cbaf0 2023-11-29T11:22:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff8437fe700 1 -- 172.21.15.81:0/191881765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400bed0 con 0x7ff84c0cbaf0 2023-11-29T11:22:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 -- 172.21.15.81:0/191881765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c0cbaf0 msgr2=0x7ff84c165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 --2- 172.21.15.81:0/191881765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c0cbaf0 0x7ff84c165190 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7ff844009d90 tx=0x7ff84400b330 comp rx=0 tx=0).stop 2023-11-29T11:22:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 -- 172.21.15.81:0/191881765 shutdown_connections 2023-11-29T11:22:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 --2- 172.21.15.81:0/191881765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c0cbaf0 0x7ff84c165190 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.346+0000 7ff85184e700 1 -- 172.21.15.81:0/191881765 >> 172.21.15.81:0/191881765 conn(0x7ff84c0d0240 msgr2=0x7ff84c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.350+0000 7ff85184e700 1 -- 172.21.15.81:0/191881765 shutdown_connections 2023-11-29T11:22:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.350+0000 7ff85184e700 1 -- 172.21.15.81:0/191881765 wait complete. 2023-11-29T11:22:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.350+0000 7ff85184e700 1 Processor -- start 2023-11-29T11:22:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.350+0000 7ff85184e700 1 -- start start 2023-11-29T11:22:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff84c06a6e0 0x7ff84c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c06f010 0x7ff84c0c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84c0cbaf0 0x7ff84c071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0c6820 con 0x7ff84c06f010 2023-11-29T11:22:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0c97c0 con 0x7ff84c06a6e0 2023-11-29T11:22:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0c8f20 con 0x7ff84c0cbaf0 2023-11-29T11:22:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c06f010 0x7ff84c0c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c06f010 0x7ff84c0c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59514/0 (socket says 172.21.15.81:59514) 2023-11-29T11:22:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 -- 172.21.15.81:0/665984995 learned_addr learned my addr 172.21.15.81:0/665984995 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85084c700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff84c06a6e0 0x7ff84c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85104d700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84c0cbaf0 0x7ff84c071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 -- 172.21.15.81:0/665984995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84c0cbaf0 msgr2=0x7ff84c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84c0cbaf0 0x7ff84c071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 -- 172.21.15.81:0/665984995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff84c06a6e0 msgr2=0x7ff84c158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff84c06a6e0 0x7ff84c158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 -- 172.21.15.81:0/665984995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844009a70 con 0x7ff84c06f010 2023-11-29T11:22:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff843fff700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c06f010 0x7ff84c0c8460 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00c550 tx=0x7ff83c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff8417fa700 1 -- 172.21.15.81:0/665984995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0054e0 con 0x7ff84c06f010 2023-11-29T11:22:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff8417fa700 1 -- 172.21.15.81:0/665984995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0036f0 con 0x7ff84c06f010 2023-11-29T11:22:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c0cafb0 con 0x7ff84c06f010 2023-11-29T11:22:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff8417fa700 1 -- 172.21.15.81:0/665984995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c003aa0 con 0x7ff84c06f010 2023-11-29T11:22:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c0cacd0 con 0x7ff84c06f010 2023-11-29T11:22:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.354+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c0ca070 con 0x7ff84c06f010 2023-11-29T11:22:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.358+0000 7ff8417fa700 1 -- 172.21.15.81:0/665984995 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff83c019030 con 0x7ff84c06f010 2023-11-29T11:22:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.358+0000 7ff8417fa700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff838064f10 0x7ff8380673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.358+0000 7ff85084c700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff838064f10 0x7ff8380673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.358+0000 7ff8417fa700 1 -- 172.21.15.81:0/665984995 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6282+0+0 (secure 0 0 0) 0x7ff83c081200 con 0x7ff84c06f010 2023-11-29T11:22:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.358+0000 7ff85084c700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff838064f10 0x7ff8380673c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff848005930 tx=0x7ff848009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:17.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.366+0000 7ff8417fa700 1 -- 172.21.15.81:0/665984995 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff83c04f2c0 con 0x7ff84c06f010 2023-11-29T11:22:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.562+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff84c0c6960 con 0x7ff84c06f010 2023-11-29T11:22:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.578+0000 7ff8417fa700 1 -- 172.21.15.81:0/665984995 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff84c0c6960 con 0x7ff84c06f010 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff838064f10 msgr2=0x7ff8380673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff838064f10 0x7ff8380673c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff848005930 tx=0x7ff848009040 comp rx=0 tx=0).stop 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c06f010 msgr2=0x7ff84c0c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c06f010 0x7ff84c0c8460 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00c550 tx=0x7ff83c00c860 comp rx=0 tx=0).stop 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 shutdown_connections 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff838064f10 0x7ff8380673c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff84c0cbaf0 0x7ff84c071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c06f010 0x7ff84c0c8460 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 --2- 172.21.15.81:0/665984995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff84c06a6e0 0x7ff84c158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 >> 172.21.15.81:0/665984995 conn(0x7ff84c0d0240 msgr2=0x7ff84c0aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 shutdown_connections 2023-11-29T11:22:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.586+0000 7ff85184e700 1 -- 172.21.15.81:0/665984995 wait complete. 2023-11-29T11:22:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 16 and data pool 17 2023-11-29T11:22:17.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964eeab700 1 Processor -- start 2023-11-29T11:22:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964eeab700 1 -- start start 2023-11-29T11:22:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964eeab700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96481584c0 0x7f96480b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964eeab700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f96480b3820 0x7f964806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964eeab700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96480b3c30 con 0x7f964806c1c0 2023-11-29T11:22:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964eeab700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964806dbd0 con 0x7f96480b3820 2023-11-29T11:22:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964eeab700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96480cd0f0 con 0x7f96481584c0 2023-11-29T11:22:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964d6a8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f96480b3820 0x7f964806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964dea9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96481584c0 0x7f96480b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964dea9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96481584c0 0x7f96480b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:60028/0 (socket says 172.21.15.81:60028) 2023-11-29T11:22:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964e6aa700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f964806c1c0 0x7f96480cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:42296/0 (socket says 172.21.15.81:42296) 2023-11-29T11:22:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964dea9700 1 -- 172.21.15.81:0/1936454756 learned_addr learned my addr 172.21.15.81:0/1936454756 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964dea9700 1 -- 172.21.15.81:0/1936454756 >> v2:172.21.15.176:3300/0 conn(0x7f96480b3820 msgr2=0x7f964806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964dea9700 1 --2- 172.21.15.81:0/1936454756 >> v2:172.21.15.176:3300/0 conn(0x7f96480b3820 0x7f964806bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964dea9700 1 -- 172.21.15.81:0/1936454756 >> v1:172.21.15.176:6789/0 conn(0x7f964806c1c0 legacy=0x7f96480cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964dea9700 1 -- 172.21.15.81:0/1936454756 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96480cd3d0 con 0x7f96481584c0 2023-11-29T11:22:17.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.706+0000 7f964d6a8700 1 --2- 172.21.15.81:0/1936454756 >> v2:172.21.15.176:3300/0 conn(0x7f96480b3820 0x7f964806bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964dea9700 1 --2- 172.21.15.81:0/1936454756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96481584c0 0x7f96480b32e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9640009e50 tx=0x7f964000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe81163f1fe322 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964cea7700 1 -- 172.21.15.81:0/1936454756 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000e070 con 0x7f96481584c0 2023-11-29T11:22:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964cea7700 1 -- 172.21.15.81:0/1936454756 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000b910 con 0x7f96481584c0 2023-11-29T11:22:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964cea7700 1 -- 172.21.15.81:0/1936454756 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000bcc0 con 0x7f96481584c0 2023-11-29T11:22:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 -- 172.21.15.81:0/1936454756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96481584c0 msgr2=0x7f96480b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 --2- 172.21.15.81:0/1936454756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96481584c0 0x7f96480b32e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9640009e50 tx=0x7f964000b330 comp rx=0 tx=0).stop 2023-11-29T11:22:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 -- 172.21.15.81:0/1936454756 shutdown_connections 2023-11-29T11:22:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 --2- 172.21.15.81:0/1936454756 >> v2:172.21.15.176:3300/0 conn(0x7f96480b3820 0x7f964806bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 --2- 172.21.15.81:0/1936454756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96481584c0 0x7f96480b32e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 -- 172.21.15.81:0/1936454756 >> 172.21.15.81:0/1936454756 conn(0x7f96480ce3e0 msgr2=0x7f96480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:17.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 -- 172.21.15.81:0/1936454756 shutdown_connections 2023-11-29T11:22:17.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 -- 172.21.15.81:0/1936454756 wait complete. 2023-11-29T11:22:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 Processor -- start 2023-11-29T11:22:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.710+0000 7f964eeab700 1 -- start start 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f964806c1c0 0x7f9648156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96480b3820 0x7f96480c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96481584c0 0x7f96481f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648156e60 con 0x7f96480b3820 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96480c7730 con 0x7f96481584c0 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96481f49e0 con 0x7f964806c1c0 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96480b3820 0x7f96480c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96480b3820 0x7f96480c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59516/0 (socket says 172.21.15.81:59516) 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 -- 172.21.15.81:0/1195436476 learned_addr learned my addr 172.21.15.81:0/1195436476 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964e6aa700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96481584c0 0x7f96481f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964dea9700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f964806c1c0 0x7f9648156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 -- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f964806c1c0 msgr2=0x7f9648156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f964806c1c0 0x7f9648156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 -- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96481584c0 msgr2=0x7f96481f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96481584c0 0x7f96481f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 -- 172.21.15.81:0/1195436476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963800b750 con 0x7f96480b3820 2023-11-29T11:22:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964e6aa700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96481584c0 0x7f96481f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964d6a8700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96480b3820 0x7f96480c71f0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f963800ecc0 tx=0x7f963800d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f963e7fc700 1 -- 172.21.15.81:0/1195436476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638010640 con 0x7f96480b3820 2023-11-29T11:22:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f963e7fc700 1 -- 172.21.15.81:0/1195436476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96380107a0 con 0x7f96480b3820 2023-11-29T11:22:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9640009b30 con 0x7f96480b3820 2023-11-29T11:22:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f963e7fc700 1 -- 172.21.15.81:0/1195436476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638010b10 con 0x7f96480b3820 2023-11-29T11:22:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96480cd990 con 0x7f96480b3820 2023-11-29T11:22:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96480cd6b0 con 0x7f96480b3820 2023-11-29T11:22:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.714+0000 7f963e7fc700 1 -- 172.21.15.81:0/1195436476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9638010c70 con 0x7f96480b3820 2023-11-29T11:22:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.718+0000 7f963e7fc700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f962c064ee0 0x7f962c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.718+0000 7f963e7fc700 1 -- 172.21.15.81:0/1195436476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9638082a70 con 0x7f96480b3820 2023-11-29T11:22:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.718+0000 7f964dea9700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f962c064ee0 0x7f962c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:17.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.718+0000 7f964dea9700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f962c064ee0 0x7f962c067390 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f964000b370 tx=0x7f9640009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:17.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.726+0000 7f963e7fc700 1 -- 172.21.15.81:0/1195436476 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9638050ad0 con 0x7f96480b3820 2023-11-29T11:22:17.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.890+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96480cdc70 con 0x7f96480b3820 2023-11-29T11:22:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.890+0000 7f963e7fc700 1 -- 172.21.15.81:0/1195436476 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18001 (secure 0 0 0) 0x7f9638082e60 con 0x7f96480b3820 2023-11-29T11:22:17.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:17.899 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:22:17.568354+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f962c064ee0 msgr2=0x7f962c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f962c064ee0 0x7f962c067390 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f964000b370 tx=0x7f9640009000 comp rx=0 tx=0).stop 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96480b3820 msgr2=0x7f96480c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96480b3820 0x7f96480c71f0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f963800ecc0 tx=0x7f963800d630 comp rx=0 tx=0).stop 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 shutdown_connections 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f962c064ee0 0x7f962c067390 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96481584c0 0x7f96481f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96480b3820 0x7f96480c71f0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 --2- 172.21.15.81:0/1195436476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f964806c1c0 0x7f9648156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 >> 172.21.15.81:0/1195436476 conn(0x7f96480ce3e0 msgr2=0x7f96480acc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 shutdown_connections 2023-11-29T11:22:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:17.894+0000 7f964eeab700 1 -- 172.21.15.81:0/1195436476 wait complete. 2023-11-29T11:22:17.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cfa348700 1 Processor -- start 2023-11-29T11:22:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cfa348700 1 -- start start 2023-11-29T11:22:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cfa348700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf4158e60 0x7f0cf40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cfa348700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cf40ad490 0x7f0cf40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cfa348700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40cd8f0 con 0x7f0cf40cad50 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cfa348700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf40add00 con 0x7f0cf40ad490 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cfa348700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40cc4f0 con 0x7f0cf4158e60 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cf8b45700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cf40ad490 0x7f0cf40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cf8b45700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cf40ad490 0x7f0cf40cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59530/0 (socket says 172.21.15.81:59530) 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cf8b45700 1 -- 172.21.15.81:0/155577614 learned_addr learned my addr 172.21.15.81:0/155577614 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.022+0000 7f0cf9346700 1 --2- 172.21.15.81:0/155577614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf4158e60 0x7f0cf40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cf8b45700 1 -- 172.21.15.81:0/155577614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf4158e60 msgr2=0x7f0cf40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cf8b45700 1 --2- 172.21.15.81:0/155577614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf4158e60 0x7f0cf40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cf8b45700 1 -- 172.21.15.81:0/155577614 >> v1:172.21.15.176:6789/0 conn(0x7f0cf40cad50 legacy=0x7f0cf406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cf8b45700 1 -- 172.21.15.81:0/155577614 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf406dc60 con 0x7f0cf40ad490 2023-11-29T11:22:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cf8b45700 1 --2- 172.21.15.81:0/155577614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf40ad490 0x7f0cf40cbfb0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400bc10 tx=0x7f0ce400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6b2046be7e147d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cebfff700 1 -- 172.21.15.81:0/155577614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce400dcb0 con 0x7f0cf40ad490 2023-11-29T11:22:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cebfff700 1 -- 172.21.15.81:0/155577614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce400de10 con 0x7f0cf40ad490 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cebfff700 1 -- 172.21.15.81:0/155577614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4010690 con 0x7f0cf40ad490 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 -- 172.21.15.81:0/155577614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf40ad490 msgr2=0x7f0cf40cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 --2- 172.21.15.81:0/155577614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf40ad490 0x7f0cf40cbfb0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400bc10 tx=0x7f0ce400bf20 comp rx=0 tx=0).stop 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 -- 172.21.15.81:0/155577614 shutdown_connections 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 --2- 172.21.15.81:0/155577614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf40ad490 0x7f0cf40cbfb0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 --2- 172.21.15.81:0/155577614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf4158e60 0x7f0cf40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 -- 172.21.15.81:0/155577614 >> 172.21.15.81:0/155577614 conn(0x7f0cf40ce3e0 msgr2=0x7f0cf40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 -- 172.21.15.81:0/155577614 shutdown_connections 2023-11-29T11:22:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 -- 172.21.15.81:0/155577614 wait complete. 2023-11-29T11:22:18.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 Processor -- start 2023-11-29T11:22:18.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.026+0000 7f0cfa348700 1 -- start start 2023-11-29T11:22:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf40ad490 0x7f0cf4156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40cad50 0x7f0cf415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4158e60 0x7f0cf415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4156950 con 0x7f0cf4158e60 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf406fda0 con 0x7f0cf40cad50 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40c3e70 con 0x7f0cf40ad490 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4158e60 0x7f0cf415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4158e60 0x7f0cf415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59546/0 (socket says 172.21.15.81:59546) 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 -- 172.21.15.81:0/756680074 learned_addr learned my addr 172.21.15.81:0/756680074 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9346700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf40ad490 0x7f0cf4156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf8b45700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40cad50 0x7f0cf415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 -- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf40ad490 msgr2=0x7f0cf4156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf40ad490 0x7f0cf4156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 -- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40cad50 msgr2=0x7f0cf415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40cad50 0x7f0cf415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 -- 172.21.15.81:0/756680074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce400b810 con 0x7f0cf4158e60 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9346700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf40ad490 0x7f0cf4156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:18.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cf9b47700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4158e60 0x7f0cf415baa0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00cc50 tx=0x7f0cec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0ce9ffb700 1 -- 172.21.15.81:0/756680074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00ad80 con 0x7f0cf4158e60 2023-11-29T11:22:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0ce9ffb700 1 -- 172.21.15.81:0/756680074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00ce50 con 0x7f0cf4158e60 2023-11-29T11:22:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf4159230 con 0x7f0cf4158e60 2023-11-29T11:22:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0ce9ffb700 1 -- 172.21.15.81:0/756680074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec003c60 con 0x7f0cf4158e60 2023-11-29T11:22:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf40cde90 con 0x7f0cf4158e60 2023-11-29T11:22:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.030+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf406d6a0 con 0x7f0cf4158e60 2023-11-29T11:22:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.034+0000 7f0ce9ffb700 1 -- 172.21.15.81:0/756680074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0cec010050 con 0x7f0cf4158e60 2023-11-29T11:22:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.034+0000 7f0ce9ffb700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cd8064ee0 0x7f0cd8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.034+0000 7f0cf9346700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cd8064ee0 0x7f0cd8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.034+0000 7f0ce9ffb700 1 -- 172.21.15.81:0/756680074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0cec0820e0 con 0x7f0cf4158e60 2023-11-29T11:22:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.034+0000 7f0cf9346700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cd8064ee0 0x7f0cd8067390 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009ba0 tx=0x7f0cf0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.042+0000 7f0ce9ffb700 1 -- 172.21.15.81:0/756680074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0cec04ffd0 con 0x7f0cf4158e60 2023-11-29T11:22:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.206+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cf406ffc0 con 0x7f0cf4158e60 2023-11-29T11:22:18.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.206+0000 7f0ce9ffb700 1 -- 172.21.15.81:0/756680074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18001 (secure 0 0 0) 0x7f0cf406ffc0 con 0x7f0cf4158e60 2023-11-29T11:22:18.214 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:18.215 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:22:17.568354+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cd8064ee0 msgr2=0x7f0cd8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cd8064ee0 0x7f0cd8067390 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009ba0 tx=0x7f0cf0008040 comp rx=0 tx=0).stop 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4158e60 msgr2=0x7f0cf415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4158e60 0x7f0cf415baa0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00cc50 tx=0x7f0cec00a340 comp rx=0 tx=0).stop 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 shutdown_connections 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0cd8064ee0 0x7f0cd8067390 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4158e60 0x7f0cf415baa0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40cad50 0x7f0cf415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 --2- 172.21.15.81:0/756680074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf40ad490 0x7f0cf4156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.210+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 >> 172.21.15.81:0/756680074 conn(0x7f0cf40ce3e0 msgr2=0x7f0cf40c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:18.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.214+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 shutdown_connections 2023-11-29T11:22:18.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.214+0000 7f0cfa348700 1 -- 172.21.15.81:0/756680074 wait complete. 2023-11-29T11:22:18.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-29T11:22:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.346+0000 7fdbf7fff700 1 Processor -- start 2023-11-29T11:22:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.346+0000 7fdbf7fff700 1 -- start start 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.346+0000 7fdbf7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdbf809bdb0 0x7fdbf815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.346+0000 7fdbf7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.346+0000 7fdbf7fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf80b2db0 con 0x7fdbf80b00e0 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.346+0000 7fdbf7fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf80b3240 con 0x7fdbf809bdb0 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.346+0000 7fdbf7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf806d840 con 0x7fdbf80cbb30 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf6ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdbf80b00e0 0x7fdbf815d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33924/0 (socket says 172.21.15.81:33924) 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf6ffd700 1 -- 172.21.15.81:0/1289483120 learned_addr learned my addr 172.21.15.81:0/1289483120 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf67fc700 1 --2- 172.21.15.81:0/1289483120 >> v2:172.21.15.176:3300/0 conn(0x7fdbf809bdb0 0x7fdbf815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf77fe700 1 --2- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf5ffb700 1 -- 172.21.15.81:0/1289483120 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458871004 0 0) 0x7fdbf80b2db0 con 0x7fdbf80b00e0 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf5ffb700 1 -- 172.21.15.81:0/1289483120 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe00057e0 con 0x7fdbf80b00e0 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf67fc700 1 -- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 msgr2=0x7fdbf806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf67fc700 1 --2- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf806bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf67fc700 1 -- 172.21.15.81:0/1289483120 >> v1:172.21.15.81:6789/0 conn(0x7fdbf80b00e0 legacy=0x7fdbf815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf5ffb700 1 -- 172.21.15.81:0/1289483120 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3484154617 0 0) 0x7fdbe00057e0 con 0x7fdbf80b00e0 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf67fc700 1 -- 172.21.15.81:0/1289483120 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf806d560 con 0x7fdbf809bdb0 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf77fe700 1 --2- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf67fc700 1 --2- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815d9f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009850 tx=0x7fdbe8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1618772de80f559d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf5ffb700 1 -- 172.21.15.81:0/1289483120 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec001670 con 0x7fdbf809bdb0 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf5ffb700 1 -- 172.21.15.81:0/1289483120 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8004030 con 0x7fdbf809bdb0 2023-11-29T11:22:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf5ffb700 1 -- 172.21.15.81:0/1289483120 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80043a0 con 0x7fdbf809bdb0 2023-11-29T11:22:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf7fff700 1 -- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf809bdb0 msgr2=0x7fdbf815d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815d9f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009850 tx=0x7fdbe8009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf7fff700 1 -- 172.21.15.81:0/1289483120 shutdown_connections 2023-11-29T11:22:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/1289483120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815d9f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf7fff700 1 -- 172.21.15.81:0/1289483120 >> 172.21.15.81:0/1289483120 conn(0x7fdbf80cae70 msgr2=0x7fdbf80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf7fff700 1 -- 172.21.15.81:0/1289483120 shutdown_connections 2023-11-29T11:22:18.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.350+0000 7fdbf7fff700 1 -- 172.21.15.81:0/1289483120 wait complete. 2023-11-29T11:22:18.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf7fff700 1 Processor -- start 2023-11-29T11:22:18.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf7fff700 1 -- start start 2023-11-29T11:22:18.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf7fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf80b00e0 0x7fdbf815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf80c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf815bfe0 con 0x7fdbf809bdb0 2023-11-29T11:22:18.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf7fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80c83c0 con 0x7fdbf80b00e0 2023-11-29T11:22:18.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf815b360 con 0x7fdbf80cbb30 2023-11-29T11:22:18.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59554/0 (socket says 172.21.15.81:59554) 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 -- 172.21.15.81:0/2331825208 learned_addr learned my addr 172.21.15.81:0/2331825208 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf67fc700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf80b00e0 0x7fdbf815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf77fe700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf80c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 -- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 msgr2=0x7fdbf80c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf80c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 -- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf80b00e0 msgr2=0x7fdbf815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf80b00e0 0x7fdbf815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 -- 172.21.15.81:0/2331825208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0009a70 con 0x7fdbf809bdb0 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf67fc700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf80b00e0 0x7fdbf815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.354+0000 7fdbf6ffd700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815ad10 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00c540 tx=0x7fdbec00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.358+0000 7fdbdf7fe700 1 -- 172.21.15.81:0/2331825208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec004ca0 con 0x7fdbf809bdb0 2023-11-29T11:22:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.358+0000 7fdbdf7fe700 1 -- 172.21.15.81:0/2331825208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec004e00 con 0x7fdbf809bdb0 2023-11-29T11:22:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.358+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe80094b0 con 0x7fdbf809bdb0 2023-11-29T11:22:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.358+0000 7fdbdf7fe700 1 -- 172.21.15.81:0/2331825208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec007310 con 0x7fdbf809bdb0 2023-11-29T11:22:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.358+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf80ac3d0 con 0x7fdbf809bdb0 2023-11-29T11:22:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.358+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf80ac0f0 con 0x7fdbf809bdb0 2023-11-29T11:22:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.358+0000 7fdbdf7fe700 1 -- 172.21.15.81:0/2331825208 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdbec01a020 con 0x7fdbf809bdb0 2023-11-29T11:22:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.362+0000 7fdbdf7fe700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdbe4064ee0 0x7fdbe4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.362+0000 7fdbdf7fe700 1 -- 172.21.15.81:0/2331825208 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdbec081bd0 con 0x7fdbf809bdb0 2023-11-29T11:22:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.362+0000 7fdbf67fc700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdbe4064ee0 0x7fdbe4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.362+0000 7fdbf67fc700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdbe4064ee0 0x7fdbe4067390 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdbf809c1a0 tx=0x7fdbe8013040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.366+0000 7fdbdf7fe700 1 -- 172.21.15.81:0/2331825208 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdbec04fc30 con 0x7fdbf809bdb0 2023-11-29T11:22:18.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.558+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdbf80cc9f0 con 0x7fdbf809bdb0 2023-11-29T11:22:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.578+0000 7fdbdf7fe700 1 -- 172.21.15.81:0/2331825208 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdbec053250 con 0x7fdbf809bdb0 2023-11-29T11:22:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdbe4064ee0 msgr2=0x7fdbe4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdbe4064ee0 0x7fdbe4067390 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdbf809c1a0 tx=0x7fdbe8013040 comp rx=0 tx=0).stop 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf809bdb0 msgr2=0x7fdbf815ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815ad10 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00c540 tx=0x7fdbec00c900 comp rx=0 tx=0).stop 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 shutdown_connections 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdbe4064ee0 0x7fdbe4067390 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbf80cbb30 0x7fdbf80c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbf80b00e0 0x7fdbf815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 --2- 172.21.15.81:0/2331825208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf809bdb0 0x7fdbf815ad10 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 >> 172.21.15.81:0/2331825208 conn(0x7fdbf80cae70 msgr2=0x7fdbf806a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 shutdown_connections 2023-11-29T11:22:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.582+0000 7fdbf7fff700 1 -- 172.21.15.81:0/2331825208 wait complete. 2023-11-29T11:22:18.604 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-29T11:22:18.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-29T11:22:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.706+0000 7fdca1325700 1 Processor -- start 2023-11-29T11:22:18.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.706+0000 7fdca1325700 1 -- start start 2023-11-29T11:22:18.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca1325700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc9c0cd3a0 0x7fdc9c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca1325700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9c06a4d0 con 0x7fdc9c158850 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca1325700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9c0cc490 con 0x7fdc9c158480 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca1325700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9c06a720 con 0x7fdc9c0cd3a0 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdc9c158850 0x7fdc9c0c9410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33926/0 (socket says 172.21.15.81:33926) 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9b7fe700 1 -- 172.21.15.81:0/3820886952 learned_addr learned my addr 172.21.15.81:0/3820886952 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca0b24700 1 --2- 172.21.15.81:0/3820886952 >> v2:172.21.15.81:3300/0 conn(0x7fdc9c0cd3a0 0x7fdc9c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9affd700 1 -- 172.21.15.81:0/3820886952 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147863047 0 0) 0x7fdc9c06a4d0 con 0x7fdc9c158850 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9affd700 1 -- 172.21.15.81:0/3820886952 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc880035d0 con 0x7fdc9c158850 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9affd700 1 -- 172.21.15.81:0/3820886952 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974196196 0 0) 0x7fdc9c0cc490 con 0x7fdc9c158480 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9affd700 1 -- 172.21.15.81:0/3820886952 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc9c06a4d0 con 0x7fdc9c158480 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca0b24700 1 -- 172.21.15.81:0/3820886952 >> v1:172.21.15.176:6789/0 conn(0x7fdc9c158480 legacy=0x7fdc9c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca0b24700 1 -- 172.21.15.81:0/3820886952 >> v1:172.21.15.81:6789/0 conn(0x7fdc9c158850 legacy=0x7fdc9c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca0b24700 1 -- 172.21.15.81:0/3820886952 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c06aa00 con 0x7fdc9c0cd3a0 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdca0b24700 1 --2- 172.21.15.81:0/3820886952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c0cd3a0 0x7fdc9c0ceca0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400aea0 tx=0x7fdc9400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccd978c47fc7c60 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9affd700 1 -- 172.21.15.81:0/3820886952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400f070 con 0x7fdc9c0cd3a0 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9affd700 1 -- 172.21.15.81:0/3820886952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9400c910 con 0x7fdc9c0cd3a0 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.710+0000 7fdc9affd700 1 -- 172.21.15.81:0/3820886952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400ccc0 con 0x7fdc9c0cd3a0 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- 172.21.15.81:0/3820886952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c0cd3a0 msgr2=0x7fdc9c0ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 --2- 172.21.15.81:0/3820886952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c0cd3a0 0x7fdc9c0ceca0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400aea0 tx=0x7fdc9400c330 comp rx=0 tx=0).stop 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- 172.21.15.81:0/3820886952 shutdown_connections 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 --2- 172.21.15.81:0/3820886952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c0cd3a0 0x7fdc9c0ceca0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- 172.21.15.81:0/3820886952 >> 172.21.15.81:0/3820886952 conn(0x7fdc9c06c660 msgr2=0x7fdc9c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- 172.21.15.81:0/3820886952 shutdown_connections 2023-11-29T11:22:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- 172.21.15.81:0/3820886952 wait complete. 2023-11-29T11:22:18.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 Processor -- start 2023-11-29T11:22:18.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- start start 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cd3a0 0x7fdc9c150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c158480 0x7fdc9c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c158850 0x7fdc9c0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0c3e00 con 0x7fdc9c158480 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c153960 con 0x7fdc9c158850 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.714+0000 7fdca1325700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c153c40 con 0x7fdc9c0cd3a0 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c158480 0x7fdc9c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c158480 0x7fdc9c154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59566/0 (socket says 172.21.15.81:59566) 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 -- 172.21.15.81:0/44676283 learned_addr learned my addr 172.21.15.81:0/44676283 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdca0b24700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c158850 0x7fdc9c0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9bfff700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cd3a0 0x7fdc9c150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 -- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cd3a0 msgr2=0x7fdc9c150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cd3a0 0x7fdc9c150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 -- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c158850 msgr2=0x7fdc9c0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c158850 0x7fdc9c0c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 -- 172.21.15.81:0/44676283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9400ab80 con 0x7fdc9c158480 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9bfff700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cd3a0 0x7fdc9c150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc9b7fe700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c158480 0x7fdc9c154720 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00c550 tx=0x7fdc8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc98ff9700 1 -- 172.21.15.81:0/44676283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c005d90 con 0x7fdc9c158480 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc98ff9700 1 -- 172.21.15.81:0/44676283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0070d0 con 0x7fdc9c158480 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9c0cf1e0 con 0x7fdc9c158480 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc98ff9700 1 -- 172.21.15.81:0/44676283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c007440 con 0x7fdc9c158480 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9c06ace0 con 0x7fdc9c158480 2023-11-29T11:22:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c0cf370 con 0x7fdc9c158480 2023-11-29T11:22:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.718+0000 7fdc98ff9700 1 -- 172.21.15.81:0/44676283 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc8c019030 con 0x7fdc9c158480 2023-11-29T11:22:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.722+0000 7fdc98ff9700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc7c064ee0 0x7fdc7c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.722+0000 7fdc9bfff700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc7c064ee0 0x7fdc7c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.722+0000 7fdc98ff9700 1 -- 172.21.15.81:0/44676283 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdc8c081310 con 0x7fdc9c158480 2023-11-29T11:22:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.722+0000 7fdc9bfff700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc7c064ee0 0x7fdc7c067390 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdc84001230 tx=0x7fdc84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.726+0000 7fdc98ff9700 1 -- 172.21.15.81:0/44676283 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdc8c04a400 con 0x7fdc9c158480 2023-11-29T11:22:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:18.918+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc9c072c20 con 0x7fdc9c158480 2023-11-29T11:22:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.598+0000 7fdc98ff9700 1 -- 172.21.15.81:0/44676283 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc8c04f3a0 con 0x7fdc9c158480 2023-11-29T11:22:19.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc7c064ee0 msgr2=0x7fdc7c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc7c064ee0 0x7fdc7c067390 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdc84001230 tx=0x7fdc84009040 comp rx=0 tx=0).stop 2023-11-29T11:22:19.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c158480 msgr2=0x7fdc9c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c158480 0x7fdc9c154720 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00c550 tx=0x7fdc8c00c910 comp rx=0 tx=0).stop 2023-11-29T11:22:19.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 shutdown_connections 2023-11-29T11:22:19.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc7c064ee0 0x7fdc7c067390 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c158850 0x7fdc9c0c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9c158480 0x7fdc9c154720 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 --2- 172.21.15.81:0/44676283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cd3a0 0x7fdc9c150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 >> 172.21.15.81:0/44676283 conn(0x7fdc9c06c660 msgr2=0x7fdc9c0c61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:19.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 shutdown_connections 2023-11-29T11:22:19.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.602+0000 7fdca1325700 1 -- 172.21.15.81:0/44676283 wait complete. 2023-11-29T11:22:19.626 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-29T11:22:19.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.734+0000 7fce48cef700 1 Processor -- start 2023-11-29T11:22:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.734+0000 7fce48cef700 1 -- start start 2023-11-29T11:22:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.734+0000 7fce48cef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce441584c0 0x7fce440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.734+0000 7fce48cef700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4406caa0 con 0x7fce440b32e0 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce440cd0f0 con 0x7fce4406ace0 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4406dbd0 con 0x7fce441584c0 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce3affd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fce440b32e0 0x7fce4406bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37506/0 (socket says 172.21.15.81:37506) 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce3affd700 1 -- 172.21.15.81:0/1549845177 learned_addr learned my addr 172.21.15.81:0/1549845177 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce437fe700 1 --2- 172.21.15.81:0/1549845177 >> v2:172.21.15.81:3300/0 conn(0x7fce441584c0 0x7fce440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce42ffd700 1 -- 172.21.15.81:0/1549845177 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262264440 0 0) 0x7fce4406caa0 con 0x7fce440b32e0 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce42ffd700 1 -- 172.21.15.81:0/1549845177 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce300046e0 con 0x7fce440b32e0 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce437fe700 1 -- 172.21.15.81:0/1549845177 >> v1:172.21.15.176:6789/0 conn(0x7fce4406ace0 legacy=0x7fce4406c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce42ffd700 1 -- 172.21.15.81:0/1549845177 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2918431578 0 0) 0x7fce300046e0 con 0x7fce440b32e0 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce437fe700 1 -- 172.21.15.81:0/1549845177 >> v1:172.21.15.81:6789/0 conn(0x7fce440b32e0 legacy=0x7fce4406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce437fe700 1 -- 172.21.15.81:0/1549845177 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce440cd3d0 con 0x7fce441584c0 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce437fe700 1 --2- 172.21.15.81:0/1549845177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440cb6f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fce34009850 tx=0x7fce34009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccada260046dcf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce42ffd700 1 -- 172.21.15.81:0/1549845177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c001670 con 0x7fce441584c0 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce42ffd700 1 -- 172.21.15.81:0/1549845177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34004030 con 0x7fce441584c0 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce42ffd700 1 -- 172.21.15.81:0/1549845177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340043c0 con 0x7fce441584c0 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 -- 172.21.15.81:0/1549845177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 msgr2=0x7fce440cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 --2- 172.21.15.81:0/1549845177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440cb6f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fce34009850 tx=0x7fce34009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 -- 172.21.15.81:0/1549845177 shutdown_connections 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 --2- 172.21.15.81:0/1549845177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440cb6f0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 -- 172.21.15.81:0/1549845177 >> 172.21.15.81:0/1549845177 conn(0x7fce440ce3e0 msgr2=0x7fce440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 -- 172.21.15.81:0/1549845177 shutdown_connections 2023-11-29T11:22:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.738+0000 7fce48cef700 1 -- 172.21.15.81:0/1549845177 wait complete. 2023-11-29T11:22:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce48cef700 1 Processor -- start 2023-11-29T11:22:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce48cef700 1 -- start start 2023-11-29T11:22:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce48cef700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406ace0 0x7fce440c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce48cef700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440b32e0 0x7fce44150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce48cef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce48cef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce440c4c10 con 0x7fce441584c0 2023-11-29T11:22:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce48cef700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce440c3cf0 con 0x7fce4406ace0 2023-11-29T11:22:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce48cef700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce440c3f90 con 0x7fce440b32e0 2023-11-29T11:22:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce43fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce43fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48488/0 (socket says 172.21.15.81:48488) 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce43fff700 1 -- 172.21.15.81:0/2164330143 learned_addr learned my addr 172.21.15.81:0/2164330143 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce437fe700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406ace0 0x7fce440c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.742+0000 7fce3affd700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440b32e0 0x7fce44150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce43fff700 1 -- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440b32e0 msgr2=0x7fce44150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce43fff700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440b32e0 0x7fce44150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce43fff700 1 -- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406ace0 msgr2=0x7fce440c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce43fff700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406ace0 0x7fce440c0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce43fff700 1 -- 172.21.15.81:0/2164330143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340094b0 con 0x7fce441584c0 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce437fe700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406ace0 0x7fce440c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce43fff700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440c54b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00cc50 tx=0x7fce3c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:19.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce40ff9700 1 -- 172.21.15.81:0/2164330143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c003c20 con 0x7fce441584c0 2023-11-29T11:22:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce40ff9700 1 -- 172.21.15.81:0/2164330143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c003d80 con 0x7fce441584c0 2023-11-29T11:22:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce40ff9700 1 -- 172.21.15.81:0/2164330143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00ab60 con 0x7fce441584c0 2023-11-29T11:22:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce440cd990 con 0x7fce441584c0 2023-11-29T11:22:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce440cd6b0 con 0x7fce441584c0 2023-11-29T11:22:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce440cdc70 con 0x7fce441584c0 2023-11-29T11:22:19.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce40ff9700 1 -- 172.21.15.81:0/2164330143 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fce3c010050 con 0x7fce441584c0 2023-11-29T11:22:19.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.746+0000 7fce40ff9700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce24064ee0 0x7fce24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.750+0000 7fce437fe700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce24064ee0 0x7fce24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.750+0000 7fce40ff9700 1 -- 172.21.15.81:0/2164330143 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fce3c081f70 con 0x7fce441584c0 2023-11-29T11:22:19.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.750+0000 7fce437fe700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce24064ee0 0x7fce24067390 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fce340090b0 tx=0x7fce34013040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:19.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.758+0000 7fce40ff9700 1 -- 172.21.15.81:0/2164330143 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fce3c04fee0 con 0x7fce441584c0 2023-11-29T11:22:19.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.958+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce44072500 con 0x7fce441584c0 2023-11-29T11:22:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.958+0000 7fce40ff9700 1 -- 172.21.15.81:0/2164330143 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7fce3c053500 con 0x7fce441584c0 2023-11-29T11:22:19.965 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:19.965 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:22:19.584710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8973":{"gid":8973,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/665591010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":665591010},{"type":"v1","addr":"172.21.15.81:6837","nonce":665591010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:22:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce24064ee0 msgr2=0x7fce24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce24064ee0 0x7fce24067390 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fce340090b0 tx=0x7fce34013040 comp rx=0 tx=0).stop 2023-11-29T11:22:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 msgr2=0x7fce440c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440c54b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00cc50 tx=0x7fce3c00cf60 comp rx=0 tx=0).stop 2023-11-29T11:22:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 shutdown_connections 2023-11-29T11:22:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fce24064ee0 0x7fce24067390 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce441584c0 0x7fce440c54b0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440b32e0 0x7fce44150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 --2- 172.21.15.81:0/2164330143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406ace0 0x7fce440c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 >> 172.21.15.81:0/2164330143 conn(0x7fce440ce3e0 msgr2=0x7fce440ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 shutdown_connections 2023-11-29T11:22:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:19.962+0000 7fce48cef700 1 -- 172.21.15.81:0/2164330143 wait complete. 2023-11-29T11:22:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 72 2023-11-29T11:22:19.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:20.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.090+0000 7ff5b1586700 1 Processor -- start 2023-11-29T11:22:20.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.090+0000 7ff5b1586700 1 -- start start 2023-11-29T11:22:20.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.090+0000 7ff5b1586700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff5ac158fc0 0x7ff5ac0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.090+0000 7ff5b1586700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0b1bf0 con 0x7ff5ac0b17a0 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.090+0000 7ff5b1586700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac15d700 con 0x7ff5ac0ce770 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5b1586700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac159390 con 0x7ff5ac158fc0 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5aa7fc700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff5ac0b17a0 0x7ff5ac0ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37518/0 (socket says 172.21.15.81:37518) 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5aa7fc700 1 -- 172.21.15.81:0/2426521079 learned_addr learned my addr 172.21.15.81:0/2426521079 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2426521079 >> v2:172.21.15.176:3300/0 conn(0x7ff5ac158fc0 0x7ff5ac0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/2426521079 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901372185 0 0) 0x7ff5a0001110 con 0x7ff5ac0b17a0 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/2426521079 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5940035d0 con 0x7ff5ac0b17a0 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5aaffd700 1 -- 172.21.15.81:0/2426521079 >> v1:172.21.15.176:6789/0 conn(0x7ff5ac0ce770 legacy=0x7ff5ac06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5aaffd700 1 -- 172.21.15.81:0/2426521079 >> v1:172.21.15.81:6789/0 conn(0x7ff5ac0b17a0 legacy=0x7ff5ac0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/2426521079 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4218721843 0 0) 0x7ff5940035d0 con 0x7ff5ac0b17a0 2023-11-29T11:22:20.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5aaffd700 1 -- 172.21.15.81:0/2426521079 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac15caf0 con 0x7ff5ac158fc0 2023-11-29T11:22:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/2426521079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac0b1260 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009850 tx=0x7ff59c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672a20b560ebc562 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/2426521079 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0001800 con 0x7ff5ac158fc0 2023-11-29T11:22:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/2426521079 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c004030 con 0x7ff5ac158fc0 2023-11-29T11:22:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5a9ffb700 1 -- 172.21.15.81:0/2426521079 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0043c0 con 0x7ff5ac158fc0 2023-11-29T11:22:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5b1586700 1 -- 172.21.15.81:0/2426521079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac158fc0 msgr2=0x7ff5ac0b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5b1586700 1 --2- 172.21.15.81:0/2426521079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac0b1260 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009850 tx=0x7ff59c009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5b1586700 1 -- 172.21.15.81:0/2426521079 shutdown_connections 2023-11-29T11:22:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5b1586700 1 --2- 172.21.15.81:0/2426521079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac0b1260 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5b1586700 1 -- 172.21.15.81:0/2426521079 >> 172.21.15.81:0/2426521079 conn(0x7ff5ac0cc260 msgr2=0x7ff5ac0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5b1586700 1 -- 172.21.15.81:0/2426521079 shutdown_connections 2023-11-29T11:22:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.094+0000 7ff5b1586700 1 -- 172.21.15.81:0/2426521079 wait complete. 2023-11-29T11:22:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5b1586700 1 Processor -- start 2023-11-29T11:22:20.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5b1586700 1 -- start start 2023-11-29T11:22:20.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5b1586700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac0b17a0 0x7ff5ac14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5b1586700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5ac0ce770 0x7ff5ac0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5b1586700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5b1586700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac14b590 con 0x7ff5ac158fc0 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5b1586700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c78a0 con 0x7ff5ac0b17a0 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5b1586700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c6c90 con 0x7ff5ac0ce770 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac15b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48496/0 (socket says 172.21.15.81:48496) 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/857224215 learned_addr learned my addr 172.21.15.81:0/857224215 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:20.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac0b17a0 0x7ff5ac14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5aa7fc700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5ac0ce770 0x7ff5ac0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5ac0ce770 msgr2=0x7ff5ac0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5ac0ce770 0x7ff5ac0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac0b17a0 msgr2=0x7ff5ac14b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac0b17a0 0x7ff5ac14b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 -- 172.21.15.81:0/857224215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c0094b0 con 0x7ff5ac158fc0 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5aa7fc700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5ac0ce770 0x7ff5ac0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.098+0000 7ff5ab7fe700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac15b490 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400cc80 tx=0x7ff5a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5937fe700 1 -- 172.21.15.81:0/857224215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4003c20 con 0x7ff5ac158fc0 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5937fe700 1 -- 172.21.15.81:0/857224215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4003d80 con 0x7ff5ac158fc0 2023-11-29T11:22:20.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac15d0b0 con 0x7ff5ac158fc0 2023-11-29T11:22:20.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5937fe700 1 -- 172.21.15.81:0/857224215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400ab50 con 0x7ff5ac158fc0 2023-11-29T11:22:20.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac15cdd0 con 0x7ff5ac158fc0 2023-11-29T11:22:20.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac15d390 con 0x7ff5ac158fc0 2023-11-29T11:22:20.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5937fe700 1 -- 172.21.15.81:0/857224215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff5a4010050 con 0x7ff5ac158fc0 2023-11-29T11:22:20.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5937fe700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5937fe700 1 -- 172.21.15.81:0/857224215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff5a4081f60 con 0x7ff5ac158fc0 2023-11-29T11:22:20.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.102+0000 7ff5aaffd700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0090b0 tx=0x7ff59c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.110+0000 7ff5937fe700 1 -- 172.21.15.81:0/857224215 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff5a404fee0 con 0x7ff5ac158fc0 2023-11-29T11:22:20.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.270+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5ac0c79e0 con 0x7ff5ac158fc0 2023-11-29T11:22:20.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.274+0000 7ff5937fe700 1 -- 172.21.15.81:0/857224215 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17988 (secure 0 0 0) 0x7ff5a400acb0 con 0x7ff5ac158fc0 2023-11-29T11:22:20.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:20.281 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":110,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:22:18.573529+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:20.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 msgr2=0x7ff598067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0090b0 tx=0x7ff59c008030 comp rx=0 tx=0).stop 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ac158fc0 msgr2=0x7ff5ac15b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac15b490 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400cc80 tx=0x7ff5a400cf90 comp rx=0 tx=0).stop 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 shutdown_connections 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff598064ee0 0x7ff598067390 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ac158fc0 0x7ff5ac15b490 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5ac0ce770 0x7ff5ac0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 --2- 172.21.15.81:0/857224215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5ac0b17a0 0x7ff5ac14b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 >> 172.21.15.81:0/857224215 conn(0x7ff5ac0cc260 msgr2=0x7ff5ac0ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 shutdown_connections 2023-11-29T11:22:20.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.278+0000 7ff5b1586700 1 -- 172.21.15.81:0/857224215 wait complete. 2023-11-29T11:22:20.296 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-29T11:22:20.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:22:20.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43868ef700 1 Processor -- start 2023-11-29T11:22:20.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43868ef700 1 -- start start 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43868ef700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4380069c40 0x7f43800cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43868ef700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f43800cb2a0 0x7f43800c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43868ef700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438006ace0 con 0x7f4380159e70 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43868ef700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43800cb6e0 con 0x7f4380069c40 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43868ef700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438006a0d0 con 0x7f43800cb2a0 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43850ec700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4380069c40 0x7f43800cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43858ed700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4380159e70 0x7f438006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37528/0 (socket says 172.21.15.81:37528) 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43858ed700 1 -- 172.21.15.81:0/2931479591 learned_addr learned my addr 172.21.15.81:0/2931479591 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43860ee700 1 --2- 172.21.15.81:0/2931479591 >> v2:172.21.15.176:3300/0 conn(0x7f43800cb2a0 0x7f43800c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43850ec700 1 -- 172.21.15.81:0/2931479591 >> v2:172.21.15.176:3300/0 conn(0x7f43800cb2a0 msgr2=0x7f43800c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43850ec700 1 --2- 172.21.15.81:0/2931479591 >> v2:172.21.15.176:3300/0 conn(0x7f43800cb2a0 0x7f43800c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43850ec700 1 -- 172.21.15.81:0/2931479591 >> v1:172.21.15.81:6789/0 conn(0x7f4380159e70 legacy=0x7f438006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43850ec700 1 -- 172.21.15.81:0/2931479591 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438006a3b0 con 0x7f4380069c40 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43850ec700 1 --2- 172.21.15.81:0/2931479591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4380069c40 0x7f43800cad60 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f43800afe60 tx=0x7f4378009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21298e7dd9ee0e17 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.398+0000 7f43848eb700 1 -- 172.21.15.81:0/2931479591 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378011830 con 0x7f4380069c40 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43848eb700 1 -- 172.21.15.81:0/2931479591 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378011990 con 0x7f4380069c40 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43848eb700 1 -- 172.21.15.81:0/2931479591 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378011d40 con 0x7f4380069c40 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 -- 172.21.15.81:0/2931479591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4380069c40 msgr2=0x7f43800cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 --2- 172.21.15.81:0/2931479591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4380069c40 0x7f43800cad60 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f43800afe60 tx=0x7f4378009b30 comp rx=0 tx=0).stop 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 -- 172.21.15.81:0/2931479591 shutdown_connections 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 --2- 172.21.15.81:0/2931479591 >> v2:172.21.15.176:3300/0 conn(0x7f43800cb2a0 0x7f43800c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 --2- 172.21.15.81:0/2931479591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4380069c40 0x7f43800cad60 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 -- 172.21.15.81:0/2931479591 >> 172.21.15.81:0/2931479591 conn(0x7f43800ce3e0 msgr2=0x7f43800ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 -- 172.21.15.81:0/2931479591 shutdown_connections 2023-11-29T11:22:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 -- 172.21.15.81:0/2931479591 wait complete. 2023-11-29T11:22:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.402+0000 7f43868ef700 1 Processor -- start 2023-11-29T11:22:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 -- start start 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380069c40 0x7f43800ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43800cb2a0 0x7f43800befd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4380159e70 0x7f43800bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015b150 con 0x7f43800cb2a0 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015bbe0 con 0x7f4380159e70 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438015bec0 con 0x7f4380069c40 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43800cb2a0 0x7f43800befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43800cb2a0 0x7f43800befd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48504/0 (socket says 172.21.15.81:48504) 2023-11-29T11:22:20.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 -- 172.21.15.81:0/3289170555 learned_addr learned my addr 172.21.15.81:0/3289170555 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43858ed700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380069c40 0x7f43800ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43860ee700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4380159e70 0x7f43800bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 -- 172.21.15.81:0/3289170555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380069c40 msgr2=0x7f43800ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380069c40 0x7f43800ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 -- 172.21.15.81:0/3289170555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4380159e70 msgr2=0x7f43800bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4380159e70 0x7f43800bf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 -- 172.21.15.81:0/3289170555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43780094b0 con 0x7f43800cb2a0 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43850ec700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43800cb2a0 0x7f43800befd0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f43780090b0 tx=0x7f4378004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f437e7fc700 1 -- 172.21.15.81:0/3289170555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378004480 con 0x7f43800cb2a0 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f437e7fc700 1 -- 172.21.15.81:0/3289170555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437801f070 con 0x7f43800cb2a0 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f437e7fc700 1 -- 172.21.15.81:0/3289170555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378003900 con 0x7f43800cb2a0 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438006a970 con 0x7f43800cb2a0 2023-11-29T11:22:20.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.406+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438006a690 con 0x7f43800cb2a0 2023-11-29T11:22:20.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.410+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438006d0b0 con 0x7f43800cb2a0 2023-11-29T11:22:20.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.410+0000 7f437e7fc700 1 -- 172.21.15.81:0/3289170555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f437800f050 con 0x7f43800cb2a0 2023-11-29T11:22:20.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.410+0000 7f437e7fc700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4360064ee0 0x7f4360067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.410+0000 7f437e7fc700 1 -- 172.21.15.81:0/3289170555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4378082cd0 con 0x7f43800cb2a0 2023-11-29T11:22:20.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.410+0000 7f43858ed700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4360064ee0 0x7f4360067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.410+0000 7f43858ed700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4360064ee0 0x7f4360067390 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4368005930 tx=0x7f4368009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.418+0000 7f437e7fc700 1 -- 172.21.15.81:0/3289170555 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4378050cb0 con 0x7f43800cb2a0 2023-11-29T11:22:20.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.582+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4380072500 con 0x7f4360064ee0 2023-11-29T11:22:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.598+0000 7f437e7fc700 1 -- 172.21.15.81:0/3289170555 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295479 (secure 0 0 0) 0x7f4380072500 con 0x7f4360064ee0 2023-11-29T11:22:20.610 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4360064ee0 msgr2=0x7f4360067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4360064ee0 0x7f4360067390 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4368005930 tx=0x7f4368009040 comp rx=0 tx=0).stop 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43800cb2a0 msgr2=0x7f43800befd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43800cb2a0 0x7f43800befd0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f43780090b0 tx=0x7f4378004770 comp rx=0 tx=0).stop 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 shutdown_connections 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4360064ee0 0x7f4360067390 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4380159e70 0x7f43800bf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43800cb2a0 0x7f43800befd0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 --2- 172.21.15.81:0/3289170555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4380069c40 0x7f43800ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 >> 172.21.15.81:0/3289170555 conn(0x7f43800ce3e0 msgr2=0x7f43800adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 shutdown_connections 2023-11-29T11:22:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.602+0000 7f43868ef700 1 -- 172.21.15.81:0/3289170555 wait complete. 2023-11-29T11:22:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:22:20.623 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2023-11-29T11:22:18.624807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":125344,"kb_used_data":11360,"kb_used_omap":0,"kb_used_meta":113920,"kb_avail":754849376,"statfs":{"total":773094113280,"available":772965761024,"internally_reserved":0,"allocated":11632640,"data_stored":6203026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":116654080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001028"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":87,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.876037+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:22:12.876037+0000","last_peered":"2023-11-29T11:22:12.876037+0000","last_clean":"2023-11-29T11:22:12.876037+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:22:12.876037+0000","last_undegraded":"2023-11-29T11:22:12.876037+0000","last_fullsized":"2023-11-29T11:22:12.876037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.875962+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:22:12.875962+0000","last_peered":"2023-11-29T11:22:12.875962+0000","last_clean":"2023-11-29T11:22:12.875962+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:22:12.875962+0000","last_undegraded":"2023-11-29T11:22:12.875962+0000","last_fullsized":"2023-11-29T11:22:12.875962+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":90,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.742650+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:22:12.742650+0000","last_peered":"2023-11-29T11:22:12.742650+0000","last_clean":"2023-11-29T11:22:12.742650+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:22:12.742650+0000","last_undegraded":"2023-11-29T11:22:12.742650+0000","last_fullsized":"2023-11-29T11:22:12.742650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":91,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.876280+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:22:12.876280+0000","last_peered":"2023-11-29T11:22:12.876280+0000","last_clean":"2023-11-29T11:22:12.876280+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:22:12.876280+0000","last_undegraded":"2023-11-29T11:22:12.876280+0000","last_fullsized":"2023-11-29T11:22:12.876280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":241,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.876240+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:22:12.876240+0000","last_peered":"2023-11-29T11:22:12.876240+0000","last_clean":"2023-11-29T11:22:12.876240+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:22:12.876240+0000","last_undegraded":"2023-11-29T11:22:12.876240+0000","last_fullsized":"2023-11-29T11:22:12.876240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":90,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.878170+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:22:12.878170+0000","last_peered":"2023-11-29T11:22:12.878170+0000","last_clean":"2023-11-29T11:22:12.878170+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:22:12.878170+0000","last_undegraded":"2023-11-29T11:22:12.878170+0000","last_fullsized":"2023-11-29T11:22:12.878170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":92,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.876248+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:22:12.876248+0000","last_peered":"2023-11-29T11:22:12.876248+0000","last_clean":"2023-11-29T11:22:12.876248+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:22:12.876248+0000","last_undegraded":"2023-11-29T11:22:12.876248+0000","last_fullsized":"2023-11-29T11:22:12.876248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.743878+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:22:12.743878+0000","last_peered":"2023-11-29T11:22:12.743878+0000","last_clean":"2023-11-29T11:22:12.743878+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:22:12.743878+0000","last_undegraded":"2023-11-29T11:22:12.743878+0000","last_fullsized":"2023-11-29T11:22:12.743878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:17.180971+0000","last_change":"2023-11-29T11:22:17.180971+0000","last_active":"2023-11-29T11:22:17.180971+0000","last_peered":"2023-11-29T11:22:17.180971+0000","last_clean":"2023-11-29T11:22:17.180971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:17.180971+0000","last_undegraded":"2023-11-29T11:22:17.180971+0000","last_fullsized":"2023-11-29T11:22:17.180971+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-29T11:22:16.177135+0000","last_change":"2023-11-29T11:22:16.177135+0000","last_active":"2023-11-29T11:22:16.177135+0000","last_peered":"2023-11-29T11:22:16.177135+0000","last_clean":"2023-11-29T11:22:16.177135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-29T11:22:16.177135+0000","last_undegraded":"2023-11-29T11:22:16.177135+0000","last_fullsized":"2023-11-29T11:22:16.177135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-11-29T11:22:12.876243+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:22:12.876243+0000","last_peered":"2023-11-29T11:22:12.876243+0000","last_clean":"2023-11-29T11:22:12.876243+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:22:12.876243+0000","last_undegraded":"2023-11-29T11:22:12.876243+0000","last_fullsized":"2023-11-29T11:22:12.876243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16320,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":14464,"kb_avail":94355520,"statfs":{"total":96636764160,"available":96620052480,"internally_reserved":0,"allocated":1892352,"data_stored":1214565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14811136},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.55500000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1579999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.04,"5min":1.177,"15min":1.327},"last":0.72899999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1559999999999999,"5min":1.5649999999999999,"15min":2.1360000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.85399999999999998,"15min":0.88500000000000001},"min":{"1min":0.58899999999999997,"5min":0.53800000000000003,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.157,"15min":3.0449999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.97199999999999998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1739999999999999,"5min":1.4850000000000001,"15min":1.8009999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97199999999999998,"15min":0.96899999999999997},"min":{"1min":0.64100000000000001,"5min":0.60499999999999998,"15min":0.53900000000000003},"max":{"1min":1.256,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":0.89800000000000002}]},{"osd":3,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.94499999999999995},"min":{"1min":0.68899999999999995,"5min":0.58299999999999996,"15min":0.38100000000000001},"max":{"1min":1.077,"5min":1.667,"15min":1.667},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.92200000000000004,"15min":0.95399999999999996},"min":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.58299999999999996},"max":{"1min":1.218,"5min":1.3280000000000001,"15min":1.4510000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83999999999999997,"15min":0.92100000000000004},"min":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1479999999999999,"5min":1.4370000000000001,"15min":1.446},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0089999999999999,"15min":1.048},"min":{"1min":0.69099999999999995,"5min":0.63700000000000001,"15min":0.33800000000000002},"max":{"1min":1.2529999999999999,"5min":1.736,"15min":1.736},"last":1.018}]},{"osd":5,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.95499999999999996,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.53600000000000003},"max":{"1min":1.278,"5min":1.629,"15min":2.403},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0329999999999999,"15min":1.0880000000000001},"min":{"1min":0.71899999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4470000000000001,"5min":1.53,"15min":1.53},"last":1.0509999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.075,"15min":1.1259999999999999},"min":{"1min":0.77300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.373,"5min":1.708,"15min":1.7230000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.127,"15min":1.1659999999999999},"min":{"1min":0.91600000000000004,"5min":0.72099999999999997,"15min":0.44500000000000001},"max":{"1min":1.3220000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.0740000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15292,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94356548,"statfs":{"total":96636764160,"available":96621105152,"internally_reserved":0,"allocated":1298432,"data_stored":624197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84299999999999997,"15min":0.82699999999999996},"min":{"1min":0.58999999999999997,"5min":0.52600000000000002,"15min":0.44400000000000001},"max":{"1min":1.1000000000000001,"5min":1.212,"15min":1.2909999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.92100000000000004,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.375},"max":{"1min":1.0529999999999999,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":1.23}]},{"osd":1,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.91900000000000004},"min":{"1min":0.54900000000000004,"5min":0.53300000000000003,"15min":0.35199999999999998},"max":{"1min":1.0800000000000001,"5min":1.284,"15min":1.4510000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.04,"15min":0.97399999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.50800000000000001},"max":{"1min":1.1850000000000001,"5min":7.8479999999999999,"15min":7.8479999999999999},"last":1.3879999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84599999999999997,"15min":0.81499999999999995},"min":{"1min":0.624,"5min":0.54900000000000004,"15min":0.49099999999999999},"max":{"1min":1.141,"5min":1.1779999999999999,"15min":1.369},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.89900000000000002,"15min":0.90300000000000002},"min":{"1min":0.63,"5min":0.58999999999999997,"15min":0.40500000000000003},"max":{"1min":1.181,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.89200000000000002}]},{"osd":3,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98999999999999999,"15min":0.93999999999999995},"min":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":7.923,"15min":7.923},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":0.93100000000000005},"min":{"1min":0.67500000000000004,"5min":0.61399999999999999,"15min":0.48099999999999998},"max":{"1min":1.0840000000000001,"5min":1.304,"15min":1.3600000000000001},"last":0.86399999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.90400000000000003},"min":{"1min":0.58499999999999996,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":1.0760000000000001,"5min":2.746,"15min":2.746},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.024,"15min":0.995},"min":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.59199999999999997},"max":{"1min":1.1899999999999999,"5min":7.9569999999999999,"15min":7.9569999999999999},"last":1.429}]},{"osd":5,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.90500000000000003,"15min":0.90200000000000002},"min":{"1min":0.67600000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.26},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0169999999999999,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.59599999999999997,"15min":0.54700000000000004},"max":{"1min":1.125,"5min":1.349,"15min":1.593},"last":1.175}]},{"osd":7,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.099,"15min":1.0860000000000001},"min":{"1min":0.61899999999999999,"5min":0.50700000000000001,"15min":0.42499999999999999},"max":{"1min":1.268,"5min":8.0060000000000002,"15min":8.0060000000000002},"last":1.47},{"interface":"front","average":{"1min":1.081,"5min":1.139,"15min":1.099},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4419999999999999,"5min":7.5730000000000004,"15min":7.5730000000000004},"last":0.93500000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15240,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":13952,"kb_avail":94356600,"statfs":{"total":96636764160,"available":96621158400,"internally_reserved":0,"allocated":1310720,"data_stored":630137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14286848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.59899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.80500000000000005,"5min":0.55200000000000005,"15min":0.53000000000000003},"max":{"1min":1.1619999999999999,"5min":1.278,"15min":1.52},"last":1.3620000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84299999999999997,"15min":0.90600000000000003},"min":{"1min":0.60599999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":1.2350000000000001,"15min":1.512},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90300000000000002,"15min":0.88800000000000001},"min":{"1min":0.67900000000000005,"5min":0.47099999999999997,"15min":0.46000000000000002},"max":{"1min":1.2110000000000001,"5min":1.24,"15min":1.377},"last":1.0740000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.284,"15min":1.5580000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91100000000000003,"15min":0.93799999999999994},"min":{"1min":0.67300000000000004,"5min":0.57999999999999996,"15min":0.51500000000000001},"max":{"1min":1.163,"5min":1.292,"15min":1.4330000000000001},"last":1.121}]},{"osd":3,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91400000000000003},"min":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.48699999999999999},"max":{"1min":1.151,"5min":1.3169999999999999,"15min":1.335},"last":1.4330000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.95199999999999996,"15min":1},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.212,"5min":1.379,"15min":6.6040000000000001},"last":1.222}]},{"osd":4,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.91200000000000003},"min":{"1min":0.76200000000000001,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.198,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.169},{"interface":"front","average":{"1min":0.996,"5min":1.0409999999999999,"15min":1.052},"min":{"1min":0.623,"5min":0.623,"15min":0.38700000000000001},"max":{"1min":1.212,"5min":1.3859999999999999,"15min":1.7230000000000001},"last":1.569}]},{"osd":6,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3300000000000001,"5min":1.3440000000000001,"15min":1.585},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.05,"15min":1.0469999999999999},"min":{"1min":0.80000000000000004,"5min":0.754,"15min":0.58599999999999997},"max":{"1min":1.286,"5min":1.367,"15min":1.575},"last":1.3879999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1140000000000001,"15min":1.103},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.58199999999999996},"max":{"1min":1.341,"5min":1.4690000000000001,"15min":1.6419999999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.131,"15min":1.1719999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64000000000000001},"max":{"1min":1.286,"5min":1.4059999999999999,"15min":1.889},"last":1.3380000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15624,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94356216,"statfs":{"total":96636764160,"available":96620765184,"internally_reserved":0,"allocated":1310720,"data_stored":630137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.871,"15min":0.90100000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.47799999999999998},"max":{"1min":1.0900000000000001,"5min":1.3069999999999999,"15min":1.431},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.123,"5min":1.214,"15min":1.2769999999999999},"last":0.88700000000000001}]},{"osd":1,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.871,"15min":0.88400000000000001},"min":{"1min":0.627,"5min":0.59199999999999997,"15min":0.505},"max":{"1min":1.1619999999999999,"5min":1.2450000000000001,"15min":1.458},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93600000000000005,"15min":0.89700000000000002},"min":{"1min":0.67200000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.1519999999999999,"5min":1.29,"15min":1.401},"last":0.67500000000000004}]},{"osd":2,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.90600000000000003,"15min":0.878},"min":{"1min":0.68300000000000005,"5min":0.58099999999999996,"15min":0.50900000000000001},"max":{"1min":1.04,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.115},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":0.95699999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.497},"max":{"1min":1.089,"5min":1.2430000000000001,"15min":1.343},"last":1.0449999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85099999999999998,"15min":0.872},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.153,"5min":1.1659999999999999,"15min":1.294},"last":1.071},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.94999999999999996,"15min":0.99099999999999999},"min":{"1min":0.71999999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1180000000000001,"5min":1.2230000000000001,"15min":1.8160000000000001},"last":0.94699999999999995}]},{"osd":5,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.90400000000000003,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.3919999999999999,"15min":1.492},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93700000000000006,"15min":0.95899999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.60199999999999998},"max":{"1min":1.0649999999999999,"5min":1.296,"15min":1.3939999999999999},"last":1.256}]},{"osd":6,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.95599999999999996,"15min":0.99199999999999999},"min":{"1min":0.65600000000000003,"5min":0.64500000000000002,"15min":0.59499999999999997},"max":{"1min":1.2050000000000001,"5min":1.276,"15min":1.6120000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.056,"15min":1.0880000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.194,"5min":1.4390000000000001,"15min":1.542},"last":1.1970000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.98999999999999999,"15min":1.0629999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.171,"5min":1.29,"15min":1.498},"last":1.147},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.113,"15min":1.1479999999999999},"min":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.69899999999999995},"max":{"1min":1.3799999999999999,"5min":1.399,"15min":1.905},"last":1.363}]}]},{"osd":3,"up_from":14,"seq":60129542261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15484,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":14208,"kb_avail":94356356,"statfs":{"total":96636764160,"available":96620908544,"internally_reserved":0,"allocated":1298432,"data_stored":624197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14548992},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.27100000000000002},"max":{"1min":1.0700000000000001,"5min":1.093,"15min":6.3840000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.68000000000000005},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.27500000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.282},"last":0.47099999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.34999999999999998},"max":{"1min":1.0409999999999999,"5min":1.111,"15min":19.015999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.61799999999999999,"5min":0.35999999999999999,"15min":0.31},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":6.3540000000000001},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73999999999999999,"15min":0.70199999999999996},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.372},"max":{"1min":1.109,"5min":1.109,"15min":1.494},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.80000000000000004},"min":{"1min":0.54800000000000004,"5min":0.45000000000000001,"15min":0.374},"max":{"1min":1.0600000000000001,"5min":1.1579999999999999,"15min":23.466000000000001},"last":0.76600000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":1.0229999999999999},"min":{"1min":0.753,"5min":0.63300000000000001,"15min":0.36499999999999999},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":15.255000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.95199999999999996,"15min":1.03},"min":{"1min":0.76400000000000001,"5min":0.66700000000000004,"15min":0.60799999999999998},"max":{"1min":1.115,"5min":1.5209999999999999,"15min":23.792999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.99299999999999999,"15min":1.0369999999999999},"min":{"1min":0.79900000000000004,"5min":0.76500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2629999999999999,"5min":1.49,"15min":23.751000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.034,"15min":1.0800000000000001},"min":{"1min":0.77700000000000002,"5min":0.68799999999999994,"15min":0.66700000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":7.0110000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0289999999999999,"15min":1.0669999999999999},"min":{"1min":0.84299999999999997,"5min":0.75,"15min":0.53200000000000003},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":15.292999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.0720000000000001,"15min":1.1439999999999999},"min":{"1min":0.81899999999999995,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.331,"5min":1.367,"15min":23.428999999999998},"last":0.879}]},{"osd":7,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0760000000000001,"15min":1.131},"min":{"1min":0.83199999999999996,"5min":0.76500000000000001,"15min":0.58999999999999997},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":6.4199999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.095,"15min":1.1140000000000001},"min":{"1min":0.874,"5min":0.78100000000000003,"15min":0.437},"max":{"1min":1.954,"5min":1.954,"15min":15.428000000000001},"last":1.0249999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15304,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":94356536,"statfs":{"total":96636764160,"available":96621092864,"internally_reserved":0,"allocated":1310720,"data_stored":630137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60899999999999999,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.879},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.0349999999999999}]},{"osd":1,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.53600000000000003,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.2410000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74099999999999999,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.056,"5min":1.115,"15min":1.115},"last":1.1679999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.03,"5min":1.107,"15min":1.107},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.81499999999999995,"15min":0.78900000000000003},"min":{"1min":0.73099999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.93200000000000005,"15min":0.95099999999999996},"min":{"1min":0.72499999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.371},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.036,"5min":0.94599999999999995,"15min":0.95999999999999996},"min":{"1min":0.85999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.532},"last":1.3169999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.80700000000000005,"5min":0.68500000000000005,"15min":0.622},"max":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.246},{"interface":"front","average":{"1min":1.046,"5min":1.006,"15min":1.0049999999999999},"min":{"1min":0.81499999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2190000000000001,"5min":1.3540000000000001,"15min":1.7989999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.72999999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.04,"15min":1.042},"min":{"1min":0.83099999999999996,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.331,"5min":1.369,"15min":1.7270000000000001},"last":1.099}]},{"osd":7,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0580000000000001,"15min":1.0549999999999999},"min":{"1min":0.89200000000000002,"5min":0.73199999999999998,"15min":0.65900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.76},"last":1.748},{"interface":"front","average":{"1min":1.103,"5min":1.071,"15min":1.0660000000000001},"min":{"1min":0.85899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4910000000000001},"last":1}]}]},{"osd":1,"up_from":14,"seq":60129542260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16524,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94355316,"statfs":{"total":96636764160,"available":96619843584,"internally_reserved":0,"allocated":1904640,"data_stored":1220505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.98399999999999999,"5min":1.0469999999999999,"15min":1.2190000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.439,"5min":0.371,"15min":0.36499999999999999},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.78900000000000003}]},{"osd":2,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.94899999999999995,"5min":1.141,"15min":1.1439999999999999},"last":1.071},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.41999999999999998,"15min":0.36899999999999999},"max":{"1min":0.84599999999999997,"5min":1.119,"15min":1.393},"last":0.5}]},{"osd":3,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.59799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.0089999999999999,"5min":1.3240000000000001,"15min":1.3520000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.631,"15min":1.744},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.93700000000000006,"15min":0.95399999999999996},"min":{"1min":0.59899999999999998,"5min":0.495,"15min":0.495},"max":{"1min":1.456,"5min":1.456,"15min":1.609},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97699999999999998,"15min":1.012},"min":{"1min":0.77900000000000003,"5min":0.71899999999999997,"15min":0.60699999999999998},"max":{"1min":1.3240000000000001,"5min":1.4179999999999999,"15min":1.5069999999999999},"last":1.024}]},{"osd":5,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92800000000000005,"15min":0.97599999999999998},"min":{"1min":0.72199999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2709999999999999,"5min":1.4199999999999999,"15min":1.8660000000000001},"last":1.046},{"interface":"front","average":{"1min":1.048,"5min":1.012,"15min":1.014},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65000000000000002},"max":{"1min":1.407,"5min":1.4139999999999999,"15min":1.5609999999999999},"last":1.129}]},{"osd":6,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.98299999999999998,"15min":1.0489999999999999},"min":{"1min":0.70399999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1839999999999999,"5min":1.47,"15min":1.575},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.002,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.77500000000000002,"5min":0.65600000000000003,"15min":0.65400000000000003},"max":{"1min":1.333,"5min":1.573,"15min":2.1920000000000002},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0249999999999999,"15min":1.052},"min":{"1min":0.79300000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.3700000000000001,"5min":1.4910000000000001,"15min":2.2320000000000002},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.083,"15min":1.1040000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.59099999999999997},"max":{"1min":1.3600000000000001,"5min":1.5409999999999999,"15min":1.6599999999999999},"last":0.98299999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15556,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":14272,"kb_avail":94356284,"statfs":{"total":96636764160,"available":96620834816,"internally_reserved":0,"allocated":1306624,"data_stored":629151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14614528},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.47699999999999998,"5min":0.40999999999999998,"15min":0.316},"max":{"1min":0.95599999999999996,"5min":0.98999999999999999,"15min":1.1220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70699999999999996,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.61299999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":1.157,"5min":1.157,"15min":1.1930000000000001},"last":1.266},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94599999999999995,"5min":1.0509999999999999,"15min":1.2010000000000001},"last":0.98799999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.0840000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.80000000000000004},"min":{"1min":0.64900000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1579999999999999,"5min":1.262,"15min":1.262},"last":1.353}]},{"osd":4,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.878,"15min":0.876},"min":{"1min":0.65600000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.351,"5min":1.351,"15min":1.423},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98299999999999998,"15min":0.99199999999999999},"min":{"1min":0.78100000000000003,"5min":0.60099999999999998,"15min":0.57099999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.4199999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0149999999999999,"15min":1.0169999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.57599999999999996},"max":{"1min":1.149,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.129},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0029999999999999,"15min":1.0009999999999999},"min":{"1min":0.68000000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.5089999999999999},"last":1.722}]},{"osd":6,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0700000000000001},"min":{"1min":0.84399999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.383,"5min":1.417,"15min":1.5189999999999999},"last":1.597},{"interface":"front","average":{"1min":1.093,"5min":1.0600000000000001,"15min":1.097},"min":{"1min":0.755,"5min":0.74199999999999999,"15min":0.629},"max":{"1min":1.349,"5min":1.407,"15min":1.5389999999999999},"last":1.8100000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.097,"15min":1.1200000000000001},"min":{"1min":0.82099999999999995,"5min":0.69599999999999995,"15min":0.65100000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.5649999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.70999999999999996},"max":{"1min":1.4350000000000001,"5min":1.4730000000000001,"15min":1.5700000000000001},"last":1.8620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:22:20.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:22:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 Processor -- start 2023-11-29T11:22:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- start start 2023-11-29T11:22:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a801510d0 0x7f1a8015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a800c98a0 0x7f1a800c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a800ca220 con 0x7f1a80069c40 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800c95d0 con 0x7f1a800c98a0 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800c8e00 con 0x7f1a801510d0 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a800c98a0 0x7f1a800c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a77fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a80069c40 0x7f1a800b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37536/0 (socket says 172.21.15.81:37536) 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a77fff700 1 -- 172.21.15.81:0/3890312298 learned_addr learned my addr 172.21.15.81:0/3890312298 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7ed9d700 1 --2- 172.21.15.81:0/3890312298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a801510d0 0x7f1a8015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7f59e700 1 -- 172.21.15.81:0/3890312298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a801510d0 msgr2=0x7f1a8015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7f59e700 1 --2- 172.21.15.81:0/3890312298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a801510d0 0x7f1a8015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7f59e700 1 -- 172.21.15.81:0/3890312298 >> v1:172.21.15.81:6789/0 conn(0x7f1a80069c40 legacy=0x7f1a800b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7e59c700 1 -- 172.21.15.81:0/3890312298 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075469425 0 0) 0x7f1a800ca220 con 0x7f1a80069c40 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7f59e700 1 -- 172.21.15.81:0/3890312298 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800c9010 con 0x7f1a800c98a0 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7f59e700 1 --2- 172.21.15.81:0/3890312298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a800c9ce0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009d90 tx=0x7f1a7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f821af03f64f73d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7e59c700 1 -- 172.21.15.81:0/3890312298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800e070 con 0x7f1a800c98a0 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7e59c700 1 -- 172.21.15.81:0/3890312298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7800bbd0 con 0x7f1a800c98a0 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a7e59c700 1 -- 172.21.15.81:0/3890312298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78012430 con 0x7f1a800c98a0 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- 172.21.15.81:0/3890312298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 msgr2=0x7f1a800c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 --2- 172.21.15.81:0/3890312298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a800c9ce0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009d90 tx=0x7f1a7800b330 comp rx=0 tx=0).stop 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- 172.21.15.81:0/3890312298 shutdown_connections 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 --2- 172.21.15.81:0/3890312298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a800c9ce0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 --2- 172.21.15.81:0/3890312298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a801510d0 0x7f1a8015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- 172.21.15.81:0/3890312298 >> 172.21.15.81:0/3890312298 conn(0x7f1a8006caf0 msgr2=0x7f1a800ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- 172.21.15.81:0/3890312298 shutdown_connections 2023-11-29T11:22:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.734+0000 7f1a850a5700 1 -- 172.21.15.81:0/3890312298 wait complete. 2023-11-29T11:22:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 Processor -- start 2023-11-29T11:22:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 -- start start 2023-11-29T11:22:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a80069c40 0x7f1a8013e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a8013e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a801510d0 0x7f1a800c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015c9b0 con 0x7f1a800c98a0 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015bfe0 con 0x7f1a801510d0 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015c680 con 0x7f1a80069c40 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a8013e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a8013e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48520/0 (socket says 172.21.15.81:48520) 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 -- 172.21.15.81:0/172556460 learned_addr learned my addr 172.21.15.81:0/172556460 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a7ed9d700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a80069c40 0x7f1a8013e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a7f59e700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a801510d0 0x7f1a800c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 -- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a80069c40 msgr2=0x7f1a8013e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a80069c40 0x7f1a8013e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 -- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a801510d0 msgr2=0x7f1a800c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a801510d0 0x7f1a800c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 -- 172.21.15.81:0/172556460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78009a70 con 0x7f1a800c98a0 2023-11-29T11:22:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a7f59e700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a801510d0 0x7f1a800c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a77fff700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a8013e160 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c5b0 tx=0x7f1a6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a777fe700 1 -- 172.21.15.81:0/172556460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68004ca0 con 0x7f1a800c98a0 2023-11-29T11:22:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a777fe700 1 -- 172.21.15.81:0/172556460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68004e20 con 0x7f1a800c98a0 2023-11-29T11:22:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a777fe700 1 -- 172.21.15.81:0/172556460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68007310 con 0x7f1a800c98a0 2023-11-29T11:22:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a80070170 con 0x7f1a800c98a0 2023-11-29T11:22:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.738+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a800c92f0 con 0x7f1a800c98a0 2023-11-29T11:22:20.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.742+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a801514a0 con 0x7f1a800c98a0 2023-11-29T11:22:20.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.742+0000 7f1a777fe700 1 -- 172.21.15.81:0/172556460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1a6801a020 con 0x7f1a800c98a0 2023-11-29T11:22:20.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.742+0000 7f1a777fe700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a60064ee0 0x7f1a60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:20.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.742+0000 7f1a777fe700 1 -- 172.21.15.81:0/172556460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1a68081cf0 con 0x7f1a800c98a0 2023-11-29T11:22:20.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.742+0000 7f1a7ed9d700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a60064ee0 0x7f1a60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:20.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.742+0000 7f1a7ed9d700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a60064ee0 0x7f1a60067390 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1a70007a60 tx=0x7f1a70008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:20.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.750+0000 7f1a777fe700 1 -- 172.21.15.81:0/172556460 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1a6804fb70 con 0x7f1a800c98a0 2023-11-29T11:22:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.906+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a80072500 con 0x7f1a60064ee0 2023-11-29T11:22:20.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.922+0000 7f1a777fe700 1 -- 172.21.15.81:0/172556460 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310677 (secure 0 0 0) 0x7f1a80072500 con 0x7f1a60064ee0 2023-11-29T11:22:20.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:20.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a60064ee0 msgr2=0x7f1a60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a60064ee0 0x7f1a60067390 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1a70007a60 tx=0x7f1a70008040 comp rx=0 tx=0).stop 2023-11-29T11:22:20.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 msgr2=0x7f1a8013e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:20.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a8013e160 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c5b0 tx=0x7f1a6800c8c0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 shutdown_connections 2023-11-29T11:22:20.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f1a60064ee0 0x7f1a60067390 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a801510d0 0x7f1a800c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a800c98a0 0x7f1a8013e160 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 --2- 172.21.15.81:0/172556460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a80069c40 0x7f1a8013e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 >> 172.21.15.81:0/172556460 conn(0x7f1a8006caf0 msgr2=0x7f1a8014f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 shutdown_connections 2023-11-29T11:22:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:20.930+0000 7f1a850a5700 1 -- 172.21.15.81:0/172556460 wait complete. 2023-11-29T11:22:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:22:20.951 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2023-11-29T11:22:20.625465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":127108,"kb_used_data":11844,"kb_used_omap":0,"kb_used_meta":115200,"kb_avail":754847612,"statfs":{"total":773094113280,"available":772963954688,"internally_reserved":0,"allocated":12128256,"data_stored":6448378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":117964800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.440886"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404567+0000","last_change":"2023-11-29T11:22:17.604841+0000","last_active":"2023-11-29T11:22:19.404567+0000","last_peered":"2023-11-29T11:22:19.404567+0000","last_clean":"2023-11-29T11:22:19.404567+0000","last_became_active":"2023-11-29T11:22:17.604540+0000","last_became_peered":"2023-11-29T11:22:17.604540+0000","last_unstale":"2023-11-29T11:22:19.404567+0000","last_undegraded":"2023-11-29T11:22:19.404567+0000","last_fullsized":"2023-11-29T11:22:19.404567+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:44:29.505176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401688+0000","last_change":"2023-11-29T11:22:17.591209+0000","last_active":"2023-11-29T11:22:19.401688+0000","last_peered":"2023-11-29T11:22:19.401688+0000","last_clean":"2023-11-29T11:22:19.401688+0000","last_became_active":"2023-11-29T11:22:17.590899+0000","last_became_peered":"2023-11-29T11:22:17.590899+0000","last_unstale":"2023-11-29T11:22:19.401688+0000","last_undegraded":"2023-11-29T11:22:19.401688+0000","last_fullsized":"2023-11-29T11:22:19.401688+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:23:38.696168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402574+0000","last_change":"2023-11-29T11:22:17.602748+0000","last_active":"2023-11-29T11:22:19.402574+0000","last_peered":"2023-11-29T11:22:19.402574+0000","last_clean":"2023-11-29T11:22:19.402574+0000","last_became_active":"2023-11-29T11:22:17.602410+0000","last_became_peered":"2023-11-29T11:22:17.602410+0000","last_unstale":"2023-11-29T11:22:19.402574+0000","last_undegraded":"2023-11-29T11:22:19.402574+0000","last_fullsized":"2023-11-29T11:22:19.402574+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:11:54.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402654+0000","last_change":"2023-11-29T11:22:17.603347+0000","last_active":"2023-11-29T11:22:19.402654+0000","last_peered":"2023-11-29T11:22:19.402654+0000","last_clean":"2023-11-29T11:22:19.402654+0000","last_became_active":"2023-11-29T11:22:17.602650+0000","last_became_peered":"2023-11-29T11:22:17.602650+0000","last_unstale":"2023-11-29T11:22:19.402654+0000","last_undegraded":"2023-11-29T11:22:19.402654+0000","last_fullsized":"2023-11-29T11:22:19.402654+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:21:38.391160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589477+0000","last_change":"2023-11-29T11:22:17.598615+0000","last_active":"2023-11-29T11:22:18.589477+0000","last_peered":"2023-11-29T11:22:18.589477+0000","last_clean":"2023-11-29T11:22:18.589477+0000","last_became_active":"2023-11-29T11:22:17.598367+0000","last_became_peered":"2023-11-29T11:22:17.598367+0000","last_unstale":"2023-11-29T11:22:18.589477+0000","last_undegraded":"2023-11-29T11:22:18.589477+0000","last_fullsized":"2023-11-29T11:22:18.589477+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:00:51.999520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403897+0000","last_change":"2023-11-29T11:22:17.601252+0000","last_active":"2023-11-29T11:22:19.403897+0000","last_peered":"2023-11-29T11:22:19.403897+0000","last_clean":"2023-11-29T11:22:19.403897+0000","last_became_active":"2023-11-29T11:22:17.600931+0000","last_became_peered":"2023-11-29T11:22:17.600931+0000","last_unstale":"2023-11-29T11:22:19.403897+0000","last_undegraded":"2023-11-29T11:22:19.403897+0000","last_fullsized":"2023-11-29T11:22:19.403897+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:42.999076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402033+0000","last_change":"2023-11-29T11:22:17.593299+0000","last_active":"2023-11-29T11:22:19.402033+0000","last_peered":"2023-11-29T11:22:19.402033+0000","last_clean":"2023-11-29T11:22:19.402033+0000","last_became_active":"2023-11-29T11:22:17.592674+0000","last_became_peered":"2023-11-29T11:22:17.592674+0000","last_unstale":"2023-11-29T11:22:19.402033+0000","last_undegraded":"2023-11-29T11:22:19.402033+0000","last_fullsized":"2023-11-29T11:22:19.402033+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:32:26.741548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400751+0000","last_change":"2023-11-29T11:22:17.609025+0000","last_active":"2023-11-29T11:22:19.400751+0000","last_peered":"2023-11-29T11:22:19.400751+0000","last_clean":"2023-11-29T11:22:19.400751+0000","last_became_active":"2023-11-29T11:22:17.608675+0000","last_became_peered":"2023-11-29T11:22:17.608675+0000","last_unstale":"2023-11-29T11:22:19.400751+0000","last_undegraded":"2023-11-29T11:22:19.400751+0000","last_fullsized":"2023-11-29T11:22:19.400751+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:06:46.832088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404637+0000","last_change":"2023-11-29T11:22:17.604021+0000","last_active":"2023-11-29T11:22:19.404637+0000","last_peered":"2023-11-29T11:22:19.404637+0000","last_clean":"2023-11-29T11:22:19.404637+0000","last_became_active":"2023-11-29T11:22:17.603746+0000","last_became_peered":"2023-11-29T11:22:17.603746+0000","last_unstale":"2023-11-29T11:22:19.404637+0000","last_undegraded":"2023-11-29T11:22:19.404637+0000","last_fullsized":"2023-11-29T11:22:19.404637+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:44:50.858225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402749+0000","last_change":"2023-11-29T11:22:17.611482+0000","last_active":"2023-11-29T11:22:19.402749+0000","last_peered":"2023-11-29T11:22:19.402749+0000","last_clean":"2023-11-29T11:22:19.402749+0000","last_became_active":"2023-11-29T11:22:17.609826+0000","last_became_peered":"2023-11-29T11:22:17.609826+0000","last_unstale":"2023-11-29T11:22:19.402749+0000","last_undegraded":"2023-11-29T11:22:19.402749+0000","last_fullsized":"2023-11-29T11:22:19.402749+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:29:06.397155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400823+0000","last_change":"2023-11-29T11:22:17.594931+0000","last_active":"2023-11-29T11:22:19.400823+0000","last_peered":"2023-11-29T11:22:19.400823+0000","last_clean":"2023-11-29T11:22:19.400823+0000","last_became_active":"2023-11-29T11:22:17.593937+0000","last_became_peered":"2023-11-29T11:22:17.593937+0000","last_unstale":"2023-11-29T11:22:19.400823+0000","last_undegraded":"2023-11-29T11:22:19.400823+0000","last_fullsized":"2023-11-29T11:22:19.400823+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:30:26.204080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403974+0000","last_change":"2023-11-29T11:22:17.609476+0000","last_active":"2023-11-29T11:22:19.403974+0000","last_peered":"2023-11-29T11:22:19.403974+0000","last_clean":"2023-11-29T11:22:19.403974+0000","last_became_active":"2023-11-29T11:22:17.608533+0000","last_became_peered":"2023-11-29T11:22:17.608533+0000","last_unstale":"2023-11-29T11:22:19.403974+0000","last_undegraded":"2023-11-29T11:22:19.403974+0000","last_fullsized":"2023-11-29T11:22:19.403974+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:43:52.524144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402242+0000","last_change":"2023-11-29T11:22:17.608047+0000","last_active":"2023-11-29T11:22:19.402242+0000","last_peered":"2023-11-29T11:22:19.402242+0000","last_clean":"2023-11-29T11:22:19.402242+0000","last_became_active":"2023-11-29T11:22:17.607765+0000","last_became_peered":"2023-11-29T11:22:17.607765+0000","last_unstale":"2023-11-29T11:22:19.402242+0000","last_undegraded":"2023-11-29T11:22:19.402242+0000","last_fullsized":"2023-11-29T11:22:19.402242+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:31:19.626066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400078+0000","last_change":"2023-11-29T11:22:17.604791+0000","last_active":"2023-11-29T11:22:19.400078+0000","last_peered":"2023-11-29T11:22:19.400078+0000","last_clean":"2023-11-29T11:22:19.400078+0000","last_became_active":"2023-11-29T11:22:17.604177+0000","last_became_peered":"2023-11-29T11:22:17.604177+0000","last_unstale":"2023-11-29T11:22:19.400078+0000","last_undegraded":"2023-11-29T11:22:19.400078+0000","last_fullsized":"2023-11-29T11:22:19.400078+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:00:33.017194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403261+0000","last_change":"2023-11-29T11:22:17.598607+0000","last_active":"2023-11-29T11:22:19.403261+0000","last_peered":"2023-11-29T11:22:19.403261+0000","last_clean":"2023-11-29T11:22:19.403261+0000","last_became_active":"2023-11-29T11:22:17.598325+0000","last_became_peered":"2023-11-29T11:22:17.598325+0000","last_unstale":"2023-11-29T11:22:19.403261+0000","last_undegraded":"2023-11-29T11:22:19.403261+0000","last_fullsized":"2023-11-29T11:22:19.403261+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:01:53.872327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401648+0000","last_change":"2023-11-29T11:22:17.611885+0000","last_active":"2023-11-29T11:22:19.401648+0000","last_peered":"2023-11-29T11:22:19.401648+0000","last_clean":"2023-11-29T11:22:19.401648+0000","last_became_active":"2023-11-29T11:22:17.611603+0000","last_became_peered":"2023-11-29T11:22:17.611603+0000","last_unstale":"2023-11-29T11:22:19.401648+0000","last_undegraded":"2023-11-29T11:22:19.401648+0000","last_fullsized":"2023-11-29T11:22:19.401648+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:04.847164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401805+0000","last_change":"2023-11-29T11:22:17.594821+0000","last_active":"2023-11-29T11:22:19.401805+0000","last_peered":"2023-11-29T11:22:19.401805+0000","last_clean":"2023-11-29T11:22:19.401805+0000","last_became_active":"2023-11-29T11:22:17.594366+0000","last_became_peered":"2023-11-29T11:22:17.594366+0000","last_unstale":"2023-11-29T11:22:19.401805+0000","last_undegraded":"2023-11-29T11:22:19.401805+0000","last_fullsized":"2023-11-29T11:22:19.401805+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:46:24.183487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.587508+0000","last_change":"2023-11-29T11:22:17.598275+0000","last_active":"2023-11-29T11:22:18.587508+0000","last_peered":"2023-11-29T11:22:18.587508+0000","last_clean":"2023-11-29T11:22:18.587508+0000","last_became_active":"2023-11-29T11:22:17.595712+0000","last_became_peered":"2023-11-29T11:22:17.595712+0000","last_unstale":"2023-11-29T11:22:18.587508+0000","last_undegraded":"2023-11-29T11:22:18.587508+0000","last_fullsized":"2023-11-29T11:22:18.587508+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:14:30.234392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402687+0000","last_change":"2023-11-29T11:22:17.603580+0000","last_active":"2023-11-29T11:22:19.402687+0000","last_peered":"2023-11-29T11:22:19.402687+0000","last_clean":"2023-11-29T11:22:19.402687+0000","last_became_active":"2023-11-29T11:22:17.602999+0000","last_became_peered":"2023-11-29T11:22:17.602999+0000","last_unstale":"2023-11-29T11:22:19.402687+0000","last_undegraded":"2023-11-29T11:22:19.402687+0000","last_fullsized":"2023-11-29T11:22:19.402687+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:35:54.820745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400672+0000","last_change":"2023-11-29T11:22:17.604744+0000","last_active":"2023-11-29T11:22:19.400672+0000","last_peered":"2023-11-29T11:22:19.400672+0000","last_clean":"2023-11-29T11:22:19.400672+0000","last_became_active":"2023-11-29T11:22:17.604461+0000","last_became_peered":"2023-11-29T11:22:17.604461+0000","last_unstale":"2023-11-29T11:22:19.400672+0000","last_undegraded":"2023-11-29T11:22:19.400672+0000","last_fullsized":"2023-11-29T11:22:19.400672+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:39:28.649175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400469+0000","last_change":"2023-11-29T11:22:17.601974+0000","last_active":"2023-11-29T11:22:19.400469+0000","last_peered":"2023-11-29T11:22:19.400469+0000","last_clean":"2023-11-29T11:22:19.400469+0000","last_became_active":"2023-11-29T11:22:17.601706+0000","last_became_peered":"2023-11-29T11:22:17.601706+0000","last_unstale":"2023-11-29T11:22:19.400469+0000","last_undegraded":"2023-11-29T11:22:19.400469+0000","last_fullsized":"2023-11-29T11:22:19.400469+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:05:30.132987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589116+0000","last_change":"2023-11-29T11:22:17.595610+0000","last_active":"2023-11-29T11:22:18.589116+0000","last_peered":"2023-11-29T11:22:18.589116+0000","last_clean":"2023-11-29T11:22:18.589116+0000","last_became_active":"2023-11-29T11:22:17.595374+0000","last_became_peered":"2023-11-29T11:22:17.595374+0000","last_unstale":"2023-11-29T11:22:18.589116+0000","last_undegraded":"2023-11-29T11:22:18.589116+0000","last_fullsized":"2023-11-29T11:22:18.589116+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:48:30.280230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.399527+0000","last_change":"2023-11-29T11:22:17.605676+0000","last_active":"2023-11-29T11:22:19.399527+0000","last_peered":"2023-11-29T11:22:19.399527+0000","last_clean":"2023-11-29T11:22:19.399527+0000","last_became_active":"2023-11-29T11:22:17.605328+0000","last_became_peered":"2023-11-29T11:22:17.605328+0000","last_unstale":"2023-11-29T11:22:19.399527+0000","last_undegraded":"2023-11-29T11:22:19.399527+0000","last_fullsized":"2023-11-29T11:22:19.399527+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:45:38.418542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.588417+0000","last_change":"2023-11-29T11:22:17.611445+0000","last_active":"2023-11-29T11:22:18.588417+0000","last_peered":"2023-11-29T11:22:18.588417+0000","last_clean":"2023-11-29T11:22:18.588417+0000","last_became_active":"2023-11-29T11:22:17.611178+0000","last_became_peered":"2023-11-29T11:22:17.611178+0000","last_unstale":"2023-11-29T11:22:18.588417+0000","last_undegraded":"2023-11-29T11:22:18.588417+0000","last_fullsized":"2023-11-29T11:22:18.588417+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:06:01.349898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401881+0000","last_change":"2023-11-29T11:22:17.594621+0000","last_active":"2023-11-29T11:22:19.401881+0000","last_peered":"2023-11-29T11:22:19.401881+0000","last_clean":"2023-11-29T11:22:19.401881+0000","last_became_active":"2023-11-29T11:22:17.594009+0000","last_became_peered":"2023-11-29T11:22:17.594009+0000","last_unstale":"2023-11-29T11:22:19.401881+0000","last_undegraded":"2023-11-29T11:22:19.401881+0000","last_fullsized":"2023-11-29T11:22:19.401881+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:08:08.347285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404164+0000","last_change":"2023-11-29T11:22:17.601776+0000","last_active":"2023-11-29T11:22:19.404164+0000","last_peered":"2023-11-29T11:22:19.404164+0000","last_clean":"2023-11-29T11:22:19.404164+0000","last_became_active":"2023-11-29T11:22:17.601526+0000","last_became_peered":"2023-11-29T11:22:17.601526+0000","last_unstale":"2023-11-29T11:22:19.404164+0000","last_undegraded":"2023-11-29T11:22:19.404164+0000","last_fullsized":"2023-11-29T11:22:19.404164+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:22:27.207391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403228+0000","last_change":"2023-11-29T11:22:17.610025+0000","last_active":"2023-11-29T11:22:19.403228+0000","last_peered":"2023-11-29T11:22:19.403228+0000","last_clean":"2023-11-29T11:22:19.403228+0000","last_became_active":"2023-11-29T11:22:17.609687+0000","last_became_peered":"2023-11-29T11:22:17.609687+0000","last_unstale":"2023-11-29T11:22:19.403228+0000","last_undegraded":"2023-11-29T11:22:19.403228+0000","last_fullsized":"2023-11-29T11:22:19.403228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:35:53.189358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589954+0000","last_change":"2023-11-29T11:22:17.604376+0000","last_active":"2023-11-29T11:22:18.589954+0000","last_peered":"2023-11-29T11:22:18.589954+0000","last_clean":"2023-11-29T11:22:18.589954+0000","last_became_active":"2023-11-29T11:22:17.603764+0000","last_became_peered":"2023-11-29T11:22:17.603764+0000","last_unstale":"2023-11-29T11:22:18.589954+0000","last_undegraded":"2023-11-29T11:22:18.589954+0000","last_fullsized":"2023-11-29T11:22:18.589954+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:21:17.588369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.399665+0000","last_change":"2023-11-29T11:22:17.609953+0000","last_active":"2023-11-29T11:22:19.399665+0000","last_peered":"2023-11-29T11:22:19.399665+0000","last_clean":"2023-11-29T11:22:19.399665+0000","last_became_active":"2023-11-29T11:22:17.609636+0000","last_became_peered":"2023-11-29T11:22:17.609636+0000","last_unstale":"2023-11-29T11:22:19.399665+0000","last_undegraded":"2023-11-29T11:22:19.399665+0000","last_fullsized":"2023-11-29T11:22:19.399665+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:36:04.847164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400630+0000","last_change":"2023-11-29T11:22:17.597781+0000","last_active":"2023-11-29T11:22:19.400630+0000","last_peered":"2023-11-29T11:22:19.400630+0000","last_clean":"2023-11-29T11:22:19.400630+0000","last_became_active":"2023-11-29T11:22:17.597583+0000","last_became_peered":"2023-11-29T11:22:17.597583+0000","last_unstale":"2023-11-29T11:22:19.400630+0000","last_undegraded":"2023-11-29T11:22:19.400630+0000","last_fullsized":"2023-11-29T11:22:19.400630+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:20:45.280885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401831+0000","last_change":"2023-11-29T11:22:17.601317+0000","last_active":"2023-11-29T11:22:19.401831+0000","last_peered":"2023-11-29T11:22:19.401831+0000","last_clean":"2023-11-29T11:22:19.401831+0000","last_became_active":"2023-11-29T11:22:17.600490+0000","last_became_peered":"2023-11-29T11:22:17.600490+0000","last_unstale":"2023-11-29T11:22:19.401831+0000","last_undegraded":"2023-11-29T11:22:19.401831+0000","last_fullsized":"2023-11-29T11:22:19.401831+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:46:24.183487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403190+0000","last_change":"2023-11-29T11:22:17.605566+0000","last_active":"2023-11-29T11:22:19.403190+0000","last_peered":"2023-11-29T11:22:19.403190+0000","last_clean":"2023-11-29T11:22:19.403190+0000","last_became_active":"2023-11-29T11:22:17.605304+0000","last_became_peered":"2023-11-29T11:22:17.605304+0000","last_unstale":"2023-11-29T11:22:19.403190+0000","last_undegraded":"2023-11-29T11:22:19.403190+0000","last_fullsized":"2023-11-29T11:22:19.403190+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:17:04.199230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404021+0000","last_change":"2023-11-29T11:22:17.605675+0000","last_active":"2023-11-29T11:22:19.404021+0000","last_peered":"2023-11-29T11:22:19.404021+0000","last_clean":"2023-11-29T11:22:19.404021+0000","last_became_active":"2023-11-29T11:22:17.605395+0000","last_became_peered":"2023-11-29T11:22:17.605395+0000","last_unstale":"2023-11-29T11:22:19.404021+0000","last_undegraded":"2023-11-29T11:22:19.404021+0000","last_fullsized":"2023-11-29T11:22:19.404021+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:36:32.938197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"109'4","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401550+0000","last_change":"2023-11-29T11:22:17.206012+0000","last_active":"2023-11-29T11:22:19.401550+0000","last_peered":"2023-11-29T11:22:19.401550+0000","last_clean":"2023-11-29T11:22:19.401550+0000","last_became_active":"2023-11-29T11:22:17.205676+0000","last_became_peered":"2023-11-29T11:22:17.205676+0000","last_unstale":"2023-11-29T11:22:19.401550+0000","last_undegraded":"2023-11-29T11:22:19.401550+0000","last_fullsized":"2023-11-29T11:22:19.401550+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:45:34.409186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.588029+0000","last_change":"2023-11-29T11:22:17.605057+0000","last_active":"2023-11-29T11:22:18.588029+0000","last_peered":"2023-11-29T11:22:18.588029+0000","last_clean":"2023-11-29T11:22:18.588029+0000","last_became_active":"2023-11-29T11:22:17.604711+0000","last_became_peered":"2023-11-29T11:22:17.604711+0000","last_unstale":"2023-11-29T11:22:18.588029+0000","last_undegraded":"2023-11-29T11:22:18.588029+0000","last_fullsized":"2023-11-29T11:22:18.588029+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:12:40.340437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402876+0000","last_change":"2023-11-29T11:22:17.210013+0000","last_active":"2023-11-29T11:22:19.402876+0000","last_peered":"2023-11-29T11:22:19.402876+0000","last_clean":"2023-11-29T11:22:19.402876+0000","last_became_active":"2023-11-29T11:22:17.209671+0000","last_became_peered":"2023-11-29T11:22:17.209671+0000","last_unstale":"2023-11-29T11:22:19.402876+0000","last_undegraded":"2023-11-29T11:22:19.402876+0000","last_fullsized":"2023-11-29T11:22:19.402876+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:05:02.011960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403455+0000","last_change":"2023-11-29T11:22:17.601239+0000","last_active":"2023-11-29T11:22:19.403455+0000","last_peered":"2023-11-29T11:22:19.403455+0000","last_clean":"2023-11-29T11:22:19.403455+0000","last_became_active":"2023-11-29T11:22:17.600953+0000","last_became_peered":"2023-11-29T11:22:17.600953+0000","last_unstale":"2023-11-29T11:22:19.403455+0000","last_undegraded":"2023-11-29T11:22:19.403455+0000","last_fullsized":"2023-11-29T11:22:19.403455+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:43:37.933750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589917+0000","last_change":"2023-11-29T11:22:17.218521+0000","last_active":"2023-11-29T11:22:18.589917+0000","last_peered":"2023-11-29T11:22:18.589917+0000","last_clean":"2023-11-29T11:22:18.589917+0000","last_became_active":"2023-11-29T11:22:17.218252+0000","last_became_peered":"2023-11-29T11:22:17.218252+0000","last_unstale":"2023-11-29T11:22:18.589917+0000","last_undegraded":"2023-11-29T11:22:18.589917+0000","last_fullsized":"2023-11-29T11:22:18.589917+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:47:57.664604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402807+0000","last_change":"2023-11-29T11:22:17.603776+0000","last_active":"2023-11-29T11:22:19.402807+0000","last_peered":"2023-11-29T11:22:19.402807+0000","last_clean":"2023-11-29T11:22:19.402807+0000","last_became_active":"2023-11-29T11:22:17.603307+0000","last_became_peered":"2023-11-29T11:22:17.603307+0000","last_unstale":"2023-11-29T11:22:19.402807+0000","last_undegraded":"2023-11-29T11:22:19.402807+0000","last_fullsized":"2023-11-29T11:22:19.402807+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:31:13.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589665+0000","last_change":"2023-11-29T11:22:17.212809+0000","last_active":"2023-11-29T11:22:18.589665+0000","last_peered":"2023-11-29T11:22:18.589665+0000","last_clean":"2023-11-29T11:22:18.589665+0000","last_became_active":"2023-11-29T11:22:17.212549+0000","last_became_peered":"2023-11-29T11:22:17.212549+0000","last_unstale":"2023-11-29T11:22:18.589665+0000","last_undegraded":"2023-11-29T11:22:18.589665+0000","last_fullsized":"2023-11-29T11:22:18.589665+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:48:35.722814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402384+0000","last_change":"2023-11-29T11:22:17.609155+0000","last_active":"2023-11-29T11:22:19.402384+0000","last_peered":"2023-11-29T11:22:19.402384+0000","last_clean":"2023-11-29T11:22:19.402384+0000","last_became_active":"2023-11-29T11:22:17.608846+0000","last_became_peered":"2023-11-29T11:22:17.608846+0000","last_unstale":"2023-11-29T11:22:19.402384+0000","last_undegraded":"2023-11-29T11:22:19.402384+0000","last_fullsized":"2023-11-29T11:22:19.402384+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:55:20.008127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400105+0000","last_change":"2023-11-29T11:22:17.210033+0000","last_active":"2023-11-29T11:22:19.400105+0000","last_peered":"2023-11-29T11:22:19.400105+0000","last_clean":"2023-11-29T11:22:19.400105+0000","last_became_active":"2023-11-29T11:22:17.209733+0000","last_became_peered":"2023-11-29T11:22:17.209733+0000","last_unstale":"2023-11-29T11:22:19.400105+0000","last_undegraded":"2023-11-29T11:22:19.400105+0000","last_fullsized":"2023-11-29T11:22:19.400105+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:21:00.007576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402621+0000","last_change":"2023-11-29T11:22:17.591485+0000","last_active":"2023-11-29T11:22:19.402621+0000","last_peered":"2023-11-29T11:22:19.402621+0000","last_clean":"2023-11-29T11:22:19.402621+0000","last_became_active":"2023-11-29T11:22:17.591128+0000","last_became_peered":"2023-11-29T11:22:17.591128+0000","last_unstale":"2023-11-29T11:22:19.402621+0000","last_undegraded":"2023-11-29T11:22:19.402621+0000","last_fullsized":"2023-11-29T11:22:19.402621+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:35:39.516211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589296+0000","last_change":"2023-11-29T11:22:17.214616+0000","last_active":"2023-11-29T11:22:18.589296+0000","last_peered":"2023-11-29T11:22:18.589296+0000","last_clean":"2023-11-29T11:22:18.589296+0000","last_became_active":"2023-11-29T11:22:17.214312+0000","last_became_peered":"2023-11-29T11:22:17.214312+0000","last_unstale":"2023-11-29T11:22:18.589296+0000","last_undegraded":"2023-11-29T11:22:18.589296+0000","last_fullsized":"2023-11-29T11:22:18.589296+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:10:07.448914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401810+0000","last_change":"2023-11-29T11:22:17.603069+0000","last_active":"2023-11-29T11:22:19.401810+0000","last_peered":"2023-11-29T11:22:19.401810+0000","last_clean":"2023-11-29T11:22:19.401810+0000","last_became_active":"2023-11-29T11:22:17.600277+0000","last_became_peered":"2023-11-29T11:22:17.600277+0000","last_unstale":"2023-11-29T11:22:19.401810+0000","last_undegraded":"2023-11-29T11:22:19.401810+0000","last_fullsized":"2023-11-29T11:22:19.401810+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:40:04.897914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.399591+0000","last_change":"2023-11-29T11:22:17.206308+0000","last_active":"2023-11-29T11:22:19.399591+0000","last_peered":"2023-11-29T11:22:19.399591+0000","last_clean":"2023-11-29T11:22:19.399591+0000","last_became_active":"2023-11-29T11:22:17.205978+0000","last_became_peered":"2023-11-29T11:22:17.205978+0000","last_unstale":"2023-11-29T11:22:19.399591+0000","last_undegraded":"2023-11-29T11:22:19.399591+0000","last_fullsized":"2023-11-29T11:22:19.399591+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:23:14.511236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401810+0000","last_change":"2023-11-29T11:22:17.593503+0000","last_active":"2023-11-29T11:22:19.401810+0000","last_peered":"2023-11-29T11:22:19.401810+0000","last_clean":"2023-11-29T11:22:19.401810+0000","last_became_active":"2023-11-29T11:22:17.593025+0000","last_became_peered":"2023-11-29T11:22:17.593025+0000","last_unstale":"2023-11-29T11:22:19.401810+0000","last_undegraded":"2023-11-29T11:22:19.401810+0000","last_fullsized":"2023-11-29T11:22:19.401810+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:50:50.780616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401884+0000","last_change":"2023-11-29T11:22:17.210075+0000","last_active":"2023-11-29T11:22:19.401884+0000","last_peered":"2023-11-29T11:22:19.401884+0000","last_clean":"2023-11-29T11:22:19.401884+0000","last_became_active":"2023-11-29T11:22:17.209570+0000","last_became_peered":"2023-11-29T11:22:17.209570+0000","last_unstale":"2023-11-29T11:22:19.401884+0000","last_undegraded":"2023-11-29T11:22:19.401884+0000","last_fullsized":"2023-11-29T11:22:19.401884+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:06:00.346061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.590050+0000","last_change":"2023-11-29T11:22:17.605428+0000","last_active":"2023-11-29T11:22:18.590050+0000","last_peered":"2023-11-29T11:22:18.590050+0000","last_clean":"2023-11-29T11:22:18.590050+0000","last_became_active":"2023-11-29T11:22:17.605192+0000","last_became_peered":"2023-11-29T11:22:17.605192+0000","last_unstale":"2023-11-29T11:22:18.590050+0000","last_undegraded":"2023-11-29T11:22:18.590050+0000","last_fullsized":"2023-11-29T11:22:18.590050+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:46:58.333967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404773+0000","last_change":"2023-11-29T11:22:17.213017+0000","last_active":"2023-11-29T11:22:19.404773+0000","last_peered":"2023-11-29T11:22:19.404773+0000","last_clean":"2023-11-29T11:22:19.404773+0000","last_became_active":"2023-11-29T11:22:17.209229+0000","last_became_peered":"2023-11-29T11:22:17.209229+0000","last_unstale":"2023-11-29T11:22:19.404773+0000","last_undegraded":"2023-11-29T11:22:19.404773+0000","last_fullsized":"2023-11-29T11:22:19.404773+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:46:50.686301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404582+0000","last_change":"2023-11-29T11:22:17.609991+0000","last_active":"2023-11-29T11:22:19.404582+0000","last_peered":"2023-11-29T11:22:19.404582+0000","last_clean":"2023-11-29T11:22:19.404582+0000","last_became_active":"2023-11-29T11:22:17.609684+0000","last_became_peered":"2023-11-29T11:22:17.609684+0000","last_unstale":"2023-11-29T11:22:19.404582+0000","last_undegraded":"2023-11-29T11:22:19.404582+0000","last_fullsized":"2023-11-29T11:22:19.404582+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:42:45.686699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.590129+0000","last_change":"2023-11-29T11:22:17.210673+0000","last_active":"2023-11-29T11:22:18.590129+0000","last_peered":"2023-11-29T11:22:18.590129+0000","last_clean":"2023-11-29T11:22:18.590129+0000","last_became_active":"2023-11-29T11:22:17.210383+0000","last_became_peered":"2023-11-29T11:22:17.210383+0000","last_unstale":"2023-11-29T11:22:18.590129+0000","last_undegraded":"2023-11-29T11:22:18.590129+0000","last_fullsized":"2023-11-29T11:22:18.590129+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:03:01.627028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402363+0000","last_change":"2023-11-29T11:22:17.607954+0000","last_active":"2023-11-29T11:22:19.402363+0000","last_peered":"2023-11-29T11:22:19.402363+0000","last_clean":"2023-11-29T11:22:19.402363+0000","last_became_active":"2023-11-29T11:22:17.607437+0000","last_became_peered":"2023-11-29T11:22:17.607437+0000","last_unstale":"2023-11-29T11:22:19.402363+0000","last_undegraded":"2023-11-29T11:22:19.402363+0000","last_fullsized":"2023-11-29T11:22:19.402363+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:59:05.969840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.587461+0000","last_change":"2023-11-29T11:22:17.204802+0000","last_active":"2023-11-29T11:22:18.587461+0000","last_peered":"2023-11-29T11:22:18.587461+0000","last_clean":"2023-11-29T11:22:18.587461+0000","last_became_active":"2023-11-29T11:22:17.204609+0000","last_became_peered":"2023-11-29T11:22:17.204609+0000","last_unstale":"2023-11-29T11:22:18.587461+0000","last_undegraded":"2023-11-29T11:22:18.587461+0000","last_fullsized":"2023-11-29T11:22:18.587461+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:49:35.829271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402926+0000","last_change":"2023-11-29T11:22:17.604646+0000","last_active":"2023-11-29T11:22:19.402926+0000","last_peered":"2023-11-29T11:22:19.402926+0000","last_clean":"2023-11-29T11:22:19.402926+0000","last_became_active":"2023-11-29T11:22:17.604361+0000","last_became_peered":"2023-11-29T11:22:17.604361+0000","last_unstale":"2023-11-29T11:22:19.402926+0000","last_undegraded":"2023-11-29T11:22:19.402926+0000","last_fullsized":"2023-11-29T11:22:19.402926+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:02:25.466547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400089+0000","last_change":"2023-11-29T11:22:17.206888+0000","last_active":"2023-11-29T11:22:19.400089+0000","last_peered":"2023-11-29T11:22:19.400089+0000","last_clean":"2023-11-29T11:22:19.400089+0000","last_became_active":"2023-11-29T11:22:17.206595+0000","last_became_peered":"2023-11-29T11:22:17.206595+0000","last_unstale":"2023-11-29T11:22:19.400089+0000","last_undegraded":"2023-11-29T11:22:19.400089+0000","last_fullsized":"2023-11-29T11:22:19.400089+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:05:49.929230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400308+0000","last_change":"2023-11-29T11:22:17.604980+0000","last_active":"2023-11-29T11:22:19.400308+0000","last_peered":"2023-11-29T11:22:19.400308+0000","last_clean":"2023-11-29T11:22:19.400308+0000","last_became_active":"2023-11-29T11:22:17.604538+0000","last_became_peered":"2023-11-29T11:22:17.604538+0000","last_unstale":"2023-11-29T11:22:19.400308+0000","last_undegraded":"2023-11-29T11:22:19.400308+0000","last_fullsized":"2023-11-29T11:22:19.400308+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:17:03.868840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404070+0000","last_change":"2023-11-29T11:22:17.212108+0000","last_active":"2023-11-29T11:22:19.404070+0000","last_peered":"2023-11-29T11:22:19.404070+0000","last_clean":"2023-11-29T11:22:19.404070+0000","last_became_active":"2023-11-29T11:22:17.211828+0000","last_became_peered":"2023-11-29T11:22:17.211828+0000","last_unstale":"2023-11-29T11:22:19.404070+0000","last_undegraded":"2023-11-29T11:22:19.404070+0000","last_fullsized":"2023-11-29T11:22:19.404070+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:26:18.836112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404305+0000","last_change":"2023-11-29T11:22:17.609136+0000","last_active":"2023-11-29T11:22:19.404305+0000","last_peered":"2023-11-29T11:22:19.404305+0000","last_clean":"2023-11-29T11:22:19.404305+0000","last_became_active":"2023-11-29T11:22:17.608862+0000","last_became_peered":"2023-11-29T11:22:17.608862+0000","last_unstale":"2023-11-29T11:22:19.404305+0000","last_undegraded":"2023-11-29T11:22:19.404305+0000","last_fullsized":"2023-11-29T11:22:19.404305+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:05:30.132987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589207+0000","last_change":"2023-11-29T11:22:17.217183+0000","last_active":"2023-11-29T11:22:18.589207+0000","last_peered":"2023-11-29T11:22:18.589207+0000","last_clean":"2023-11-29T11:22:18.589207+0000","last_became_active":"2023-11-29T11:22:17.216902+0000","last_became_peered":"2023-11-29T11:22:17.216902+0000","last_unstale":"2023-11-29T11:22:18.589207+0000","last_undegraded":"2023-11-29T11:22:18.589207+0000","last_fullsized":"2023-11-29T11:22:18.589207+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:59:09.980487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400281+0000","last_change":"2023-11-29T11:22:17.608179+0000","last_active":"2023-11-29T11:22:19.400281+0000","last_peered":"2023-11-29T11:22:19.400281+0000","last_clean":"2023-11-29T11:22:19.400281+0000","last_became_active":"2023-11-29T11:22:17.607859+0000","last_became_peered":"2023-11-29T11:22:17.607859+0000","last_unstale":"2023-11-29T11:22:19.400281+0000","last_undegraded":"2023-11-29T11:22:19.400281+0000","last_fullsized":"2023-11-29T11:22:19.400281+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:30:41.838983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403646+0000","last_change":"2023-11-29T11:22:17.210022+0000","last_active":"2023-11-29T11:22:19.403646+0000","last_peered":"2023-11-29T11:22:19.403646+0000","last_clean":"2023-11-29T11:22:19.403646+0000","last_became_active":"2023-11-29T11:22:17.209439+0000","last_became_peered":"2023-11-29T11:22:17.209439+0000","last_unstale":"2023-11-29T11:22:19.403646+0000","last_undegraded":"2023-11-29T11:22:19.403646+0000","last_fullsized":"2023-11-29T11:22:19.403646+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:40:15.027468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.588803+0000","last_change":"2023-11-29T11:22:17.605125+0000","last_active":"2023-11-29T11:22:18.588803+0000","last_peered":"2023-11-29T11:22:18.588803+0000","last_clean":"2023-11-29T11:22:18.588803+0000","last_became_active":"2023-11-29T11:22:17.603541+0000","last_became_peered":"2023-11-29T11:22:17.603541+0000","last_unstale":"2023-11-29T11:22:18.588803+0000","last_undegraded":"2023-11-29T11:22:18.588803+0000","last_fullsized":"2023-11-29T11:22:18.588803+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:27:24.726137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402045+0000","last_change":"2023-11-29T11:22:17.214929+0000","last_active":"2023-11-29T11:22:19.402045+0000","last_peered":"2023-11-29T11:22:19.402045+0000","last_clean":"2023-11-29T11:22:19.402045+0000","last_became_active":"2023-11-29T11:22:17.214104+0000","last_became_peered":"2023-11-29T11:22:17.214104+0000","last_unstale":"2023-11-29T11:22:19.402045+0000","last_undegraded":"2023-11-29T11:22:19.402045+0000","last_fullsized":"2023-11-29T11:22:19.402045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:23:14.511236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.587640+0000","last_change":"2023-11-29T11:22:17.610148+0000","last_active":"2023-11-29T11:22:18.587640+0000","last_peered":"2023-11-29T11:22:18.587640+0000","last_clean":"2023-11-29T11:22:18.587640+0000","last_became_active":"2023-11-29T11:22:17.609694+0000","last_became_peered":"2023-11-29T11:22:17.609694+0000","last_unstale":"2023-11-29T11:22:18.587640+0000","last_undegraded":"2023-11-29T11:22:18.587640+0000","last_fullsized":"2023-11-29T11:22:18.587640+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:54:30.350591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589365+0000","last_change":"2023-11-29T11:22:17.219496+0000","last_active":"2023-11-29T11:22:18.589365+0000","last_peered":"2023-11-29T11:22:18.589365+0000","last_clean":"2023-11-29T11:22:18.589365+0000","last_became_active":"2023-11-29T11:22:17.219179+0000","last_became_peered":"2023-11-29T11:22:17.219179+0000","last_unstale":"2023-11-29T11:22:18.589365+0000","last_undegraded":"2023-11-29T11:22:18.589365+0000","last_fullsized":"2023-11-29T11:22:18.589365+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:06:45.828251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.404695+0000","last_change":"2023-11-29T11:22:17.602744+0000","last_active":"2023-11-29T11:22:19.404695+0000","last_peered":"2023-11-29T11:22:19.404695+0000","last_clean":"2023-11-29T11:22:19.404695+0000","last_became_active":"2023-11-29T11:22:17.602169+0000","last_became_peered":"2023-11-29T11:22:17.602169+0000","last_unstale":"2023-11-29T11:22:19.404695+0000","last_undegraded":"2023-11-29T11:22:19.404695+0000","last_fullsized":"2023-11-29T11:22:19.404695+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:47:48.244432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.587594+0000","last_change":"2023-11-29T11:22:17.207446+0000","last_active":"2023-11-29T11:22:18.587594+0000","last_peered":"2023-11-29T11:22:18.587594+0000","last_clean":"2023-11-29T11:22:18.587594+0000","last_became_active":"2023-11-29T11:22:17.207136+0000","last_became_peered":"2023-11-29T11:22:17.207136+0000","last_unstale":"2023-11-29T11:22:18.587594+0000","last_undegraded":"2023-11-29T11:22:18.587594+0000","last_fullsized":"2023-11-29T11:22:18.587594+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:06:23.487395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402969+0000","last_change":"2023-11-29T11:22:17.600402+0000","last_active":"2023-11-29T11:22:19.402969+0000","last_peered":"2023-11-29T11:22:19.402969+0000","last_clean":"2023-11-29T11:22:19.402969+0000","last_became_active":"2023-11-29T11:22:17.600096+0000","last_became_peered":"2023-11-29T11:22:17.600096+0000","last_unstale":"2023-11-29T11:22:19.402969+0000","last_undegraded":"2023-11-29T11:22:19.402969+0000","last_fullsized":"2023-11-29T11:22:19.402969+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:04:39.407060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403019+0000","last_change":"2023-11-29T11:22:17.210660+0000","last_active":"2023-11-29T11:22:19.403019+0000","last_peered":"2023-11-29T11:22:19.403019+0000","last_clean":"2023-11-29T11:22:19.403019+0000","last_became_active":"2023-11-29T11:22:17.210370+0000","last_became_peered":"2023-11-29T11:22:17.210370+0000","last_unstale":"2023-11-29T11:22:19.403019+0000","last_undegraded":"2023-11-29T11:22:19.403019+0000","last_fullsized":"2023-11-29T11:22:19.403019+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:33:14.677894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.587418+0000","last_change":"2023-11-29T11:22:17.602379+0000","last_active":"2023-11-29T11:22:18.587418+0000","last_peered":"2023-11-29T11:22:18.587418+0000","last_clean":"2023-11-29T11:22:18.587418+0000","last_became_active":"2023-11-29T11:22:17.602087+0000","last_became_peered":"2023-11-29T11:22:17.602087+0000","last_unstale":"2023-11-29T11:22:18.587418+0000","last_undegraded":"2023-11-29T11:22:18.587418+0000","last_fullsized":"2023-11-29T11:22:18.587418+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:33:00.088012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.590267+0000","last_change":"2023-11-29T11:22:17.218116+0000","last_active":"2023-11-29T11:22:18.590267+0000","last_peered":"2023-11-29T11:22:18.590267+0000","last_clean":"2023-11-29T11:22:18.590267+0000","last_became_active":"2023-11-29T11:22:17.217813+0000","last_became_peered":"2023-11-29T11:22:17.217813+0000","last_unstale":"2023-11-29T11:22:18.590267+0000","last_undegraded":"2023-11-29T11:22:18.590267+0000","last_fullsized":"2023-11-29T11:22:18.590267+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:16:21.224108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400034+0000","last_change":"2023-11-29T11:22:17.591859+0000","last_active":"2023-11-29T11:22:19.400034+0000","last_peered":"2023-11-29T11:22:19.400034+0000","last_clean":"2023-11-29T11:22:19.400034+0000","last_became_active":"2023-11-29T11:22:17.591579+0000","last_became_peered":"2023-11-29T11:22:17.591579+0000","last_unstale":"2023-11-29T11:22:19.400034+0000","last_undegraded":"2023-11-29T11:22:19.400034+0000","last_fullsized":"2023-11-29T11:22:19.400034+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:47:48.244432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400305+0000","last_change":"2023-11-29T11:22:17.201403+0000","last_active":"2023-11-29T11:22:19.400305+0000","last_peered":"2023-11-29T11:22:19.400305+0000","last_clean":"2023-11-29T11:22:19.400305+0000","last_became_active":"2023-11-29T11:22:17.201126+0000","last_became_peered":"2023-11-29T11:22:17.201126+0000","last_unstale":"2023-11-29T11:22:19.400305+0000","last_undegraded":"2023-11-29T11:22:19.400305+0000","last_fullsized":"2023-11-29T11:22:19.400305+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:56:11.085241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400121+0000","last_change":"2023-11-29T11:22:17.599469+0000","last_active":"2023-11-29T11:22:19.400121+0000","last_peered":"2023-11-29T11:22:19.400121+0000","last_clean":"2023-11-29T11:22:19.400121+0000","last_became_active":"2023-11-29T11:22:17.599182+0000","last_became_peered":"2023-11-29T11:22:17.599182+0000","last_unstale":"2023-11-29T11:22:19.400121+0000","last_undegraded":"2023-11-29T11:22:19.400121+0000","last_fullsized":"2023-11-29T11:22:19.400121+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:22:27.207391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400225+0000","last_change":"2023-11-29T11:22:17.208489+0000","last_active":"2023-11-29T11:22:19.400225+0000","last_peered":"2023-11-29T11:22:19.400225+0000","last_clean":"2023-11-29T11:22:19.400225+0000","last_became_active":"2023-11-29T11:22:17.208161+0000","last_became_peered":"2023-11-29T11:22:17.208161+0000","last_unstale":"2023-11-29T11:22:19.400225+0000","last_undegraded":"2023-11-29T11:22:19.400225+0000","last_fullsized":"2023-11-29T11:22:19.400225+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:46:50.686301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.400531+0000","last_change":"2023-11-29T11:22:17.608445+0000","last_active":"2023-11-29T11:22:19.400531+0000","last_peered":"2023-11-29T11:22:19.400531+0000","last_clean":"2023-11-29T11:22:19.400531+0000","last_became_active":"2023-11-29T11:22:17.608163+0000","last_became_peered":"2023-11-29T11:22:17.608163+0000","last_unstale":"2023-11-29T11:22:19.400531+0000","last_undegraded":"2023-11-29T11:22:19.400531+0000","last_fullsized":"2023-11-29T11:22:19.400531+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:10:08.452750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589393+0000","last_change":"2023-11-29T11:22:17.212194+0000","last_active":"2023-11-29T11:22:18.589393+0000","last_peered":"2023-11-29T11:22:18.589393+0000","last_clean":"2023-11-29T11:22:18.589393+0000","last_became_active":"2023-11-29T11:22:17.211927+0000","last_became_peered":"2023-11-29T11:22:17.211927+0000","last_unstale":"2023-11-29T11:22:18.589393+0000","last_undegraded":"2023-11-29T11:22:18.589393+0000","last_fullsized":"2023-11-29T11:22:18.589393+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:40:14.344489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402075+0000","last_change":"2023-11-29T11:22:17.601023+0000","last_active":"2023-11-29T11:22:19.402075+0000","last_peered":"2023-11-29T11:22:19.402075+0000","last_clean":"2023-11-29T11:22:19.402075+0000","last_became_active":"2023-11-29T11:22:17.600749+0000","last_became_peered":"2023-11-29T11:22:17.600749+0000","last_unstale":"2023-11-29T11:22:19.402075+0000","last_undegraded":"2023-11-29T11:22:19.402075+0000","last_fullsized":"2023-11-29T11:22:19.402075+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:13:22.668935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402099+0000","last_change":"2023-11-29T11:22:17.215122+0000","last_active":"2023-11-29T11:22:19.402099+0000","last_peered":"2023-11-29T11:22:19.402099+0000","last_clean":"2023-11-29T11:22:19.402099+0000","last_became_active":"2023-11-29T11:22:17.214654+0000","last_became_peered":"2023-11-29T11:22:17.214654+0000","last_unstale":"2023-11-29T11:22:19.402099+0000","last_undegraded":"2023-11-29T11:22:19.402099+0000","last_fullsized":"2023-11-29T11:22:19.402099+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:51:09.340894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.588139+0000","last_change":"2023-11-29T11:22:17.607378+0000","last_active":"2023-11-29T11:22:18.588139+0000","last_peered":"2023-11-29T11:22:18.588139+0000","last_clean":"2023-11-29T11:22:18.588139+0000","last_became_active":"2023-11-29T11:22:17.607072+0000","last_became_peered":"2023-11-29T11:22:17.607072+0000","last_unstale":"2023-11-29T11:22:18.588139+0000","last_undegraded":"2023-11-29T11:22:18.588139+0000","last_fullsized":"2023-11-29T11:22:18.588139+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:55:27.953732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589944+0000","last_change":"2023-11-29T11:22:17.214638+0000","last_active":"2023-11-29T11:22:18.589944+0000","last_peered":"2023-11-29T11:22:18.589944+0000","last_clean":"2023-11-29T11:22:18.589944+0000","last_became_active":"2023-11-29T11:22:17.214377+0000","last_became_peered":"2023-11-29T11:22:17.214377+0000","last_unstale":"2023-11-29T11:22:18.589944+0000","last_undegraded":"2023-11-29T11:22:18.589944+0000","last_fullsized":"2023-11-29T11:22:18.589944+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:02:24.462710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":91,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.588433+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:22:17.588433+0000","last_peered":"2023-11-29T11:22:17.588433+0000","last_clean":"2023-11-29T11:22:17.588433+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:22:17.588433+0000","last_undegraded":"2023-11-29T11:22:17.588433+0000","last_fullsized":"2023-11-29T11:22:17.588433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401556+0000","last_change":"2023-11-29T11:22:17.594554+0000","last_active":"2023-11-29T11:22:19.401556+0000","last_peered":"2023-11-29T11:22:19.401556+0000","last_clean":"2023-11-29T11:22:19.401556+0000","last_became_active":"2023-11-29T11:22:17.594314+0000","last_became_peered":"2023-11-29T11:22:17.594314+0000","last_unstale":"2023-11-29T11:22:19.401556+0000","last_undegraded":"2023-11-29T11:22:19.401556+0000","last_fullsized":"2023-11-29T11:22:19.401556+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:11:26.838220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589612+0000","last_change":"2023-11-29T11:22:17.218243+0000","last_active":"2023-11-29T11:22:18.589612+0000","last_peered":"2023-11-29T11:22:18.589612+0000","last_clean":"2023-11-29T11:22:18.589612+0000","last_became_active":"2023-11-29T11:22:17.217966+0000","last_became_peered":"2023-11-29T11:22:17.217966+0000","last_unstale":"2023-11-29T11:22:18.589612+0000","last_undegraded":"2023-11-29T11:22:18.589612+0000","last_fullsized":"2023-11-29T11:22:18.589612+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:31:12.880053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.588220+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:22:17.588220+0000","last_peered":"2023-11-29T11:22:17.588220+0000","last_clean":"2023-11-29T11:22:17.588220+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:22:17.588220+0000","last_undegraded":"2023-11-29T11:22:17.588220+0000","last_fullsized":"2023-11-29T11:22:17.588220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.401251+0000","last_change":"2023-11-29T11:22:17.601318+0000","last_active":"2023-11-29T11:22:19.401251+0000","last_peered":"2023-11-29T11:22:19.401251+0000","last_clean":"2023-11-29T11:22:19.401251+0000","last_became_active":"2023-11-29T11:22:17.600943+0000","last_became_peered":"2023-11-29T11:22:17.600943+0000","last_unstale":"2023-11-29T11:22:19.401251+0000","last_undegraded":"2023-11-29T11:22:19.401251+0000","last_fullsized":"2023-11-29T11:22:19.401251+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:34:04.131717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"109'6","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403326+0000","last_change":"2023-11-29T11:22:17.213701+0000","last_active":"2023-11-29T11:22:19.403326+0000","last_peered":"2023-11-29T11:22:19.403326+0000","last_clean":"2023-11-29T11:22:19.403326+0000","last_became_active":"2023-11-29T11:22:17.210770+0000","last_became_peered":"2023-11-29T11:22:17.210770+0000","last_unstale":"2023-11-29T11:22:19.403326+0000","last_undegraded":"2023-11-29T11:22:19.403326+0000","last_fullsized":"2023-11-29T11:22:19.403326+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:25:07.847663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":94,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.585519+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:22:17.585519+0000","last_peered":"2023-11-29T11:22:17.585519+0000","last_clean":"2023-11-29T11:22:17.585519+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:22:17.585519+0000","last_undegraded":"2023-11-29T11:22:17.585519+0000","last_fullsized":"2023-11-29T11:22:17.585519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.590440+0000","last_change":"2023-11-29T11:22:17.600207+0000","last_active":"2023-11-29T11:22:18.590440+0000","last_peered":"2023-11-29T11:22:18.590440+0000","last_clean":"2023-11-29T11:22:18.590440+0000","last_became_active":"2023-11-29T11:22:17.599966+0000","last_became_peered":"2023-11-29T11:22:17.599966+0000","last_unstale":"2023-11-29T11:22:18.590440+0000","last_undegraded":"2023-11-29T11:22:18.590440+0000","last_fullsized":"2023-11-29T11:22:18.590440+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:46:51.690137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"109'3","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402809+0000","last_change":"2023-11-29T11:22:17.214892+0000","last_active":"2023-11-29T11:22:19.402809+0000","last_peered":"2023-11-29T11:22:19.402809+0000","last_clean":"2023-11-29T11:22:19.402809+0000","last_became_active":"2023-11-29T11:22:17.214613+0000","last_became_peered":"2023-11-29T11:22:17.214613+0000","last_unstale":"2023-11-29T11:22:19.402809+0000","last_undegraded":"2023-11-29T11:22:19.402809+0000","last_fullsized":"2023-11-29T11:22:19.402809+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:30:31.899359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":95,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.578019+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:22:17.578019+0000","last_peered":"2023-11-29T11:22:17.578019+0000","last_clean":"2023-11-29T11:22:17.578019+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:22:17.578019+0000","last_undegraded":"2023-11-29T11:22:17.578019+0000","last_fullsized":"2023-11-29T11:22:17.578019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589648+0000","last_change":"2023-11-29T11:22:17.608044+0000","last_active":"2023-11-29T11:22:18.589648+0000","last_peered":"2023-11-29T11:22:18.589648+0000","last_clean":"2023-11-29T11:22:18.589648+0000","last_became_active":"2023-11-29T11:22:17.607703+0000","last_became_peered":"2023-11-29T11:22:17.607703+0000","last_unstale":"2023-11-29T11:22:18.589648+0000","last_undegraded":"2023-11-29T11:22:18.589648+0000","last_fullsized":"2023-11-29T11:22:18.589648+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:31:13.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.587334+0000","last_change":"2023-11-29T11:22:17.212286+0000","last_active":"2023-11-29T11:22:18.587334+0000","last_peered":"2023-11-29T11:22:18.587334+0000","last_clean":"2023-11-29T11:22:18.587334+0000","last_became_active":"2023-11-29T11:22:17.211999+0000","last_became_peered":"2023-11-29T11:22:17.211999+0000","last_unstale":"2023-11-29T11:22:18.587334+0000","last_undegraded":"2023-11-29T11:22:18.587334+0000","last_fullsized":"2023-11-29T11:22:18.587334+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:26:51.473394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":245,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.597776+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:22:17.597776+0000","last_peered":"2023-11-29T11:22:17.597776+0000","last_clean":"2023-11-29T11:22:17.597776+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:22:17.597776+0000","last_undegraded":"2023-11-29T11:22:17.597776+0000","last_fullsized":"2023-11-29T11:22:17.597776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":94,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.583805+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:22:17.583805+0000","last_peered":"2023-11-29T11:22:17.583805+0000","last_clean":"2023-11-29T11:22:17.583805+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:22:17.583805+0000","last_undegraded":"2023-11-29T11:22:17.583805+0000","last_fullsized":"2023-11-29T11:22:17.583805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589209+0000","last_change":"2023-11-29T11:22:17.594945+0000","last_active":"2023-11-29T11:22:18.589209+0000","last_peered":"2023-11-29T11:22:18.589209+0000","last_clean":"2023-11-29T11:22:18.589209+0000","last_became_active":"2023-11-29T11:22:17.594667+0000","last_became_peered":"2023-11-29T11:22:17.594667+0000","last_unstale":"2023-11-29T11:22:18.589209+0000","last_undegraded":"2023-11-29T11:22:18.589209+0000","last_fullsized":"2023-11-29T11:22:18.589209+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T14:25:08.851500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.403970+0000","last_change":"2023-11-29T11:22:17.211455+0000","last_active":"2023-11-29T11:22:19.403970+0000","last_peered":"2023-11-29T11:22:19.403970+0000","last_clean":"2023-11-29T11:22:19.403970+0000","last_became_active":"2023-11-29T11:22:17.211131+0000","last_became_peered":"2023-11-29T11:22:17.211131+0000","last_unstale":"2023-11-29T11:22:19.403970+0000","last_undegraded":"2023-11-29T11:22:19.403970+0000","last_fullsized":"2023-11-29T11:22:19.403970+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:51:57.169992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.588573+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:22:17.588573+0000","last_peered":"2023-11-29T11:22:17.588573+0000","last_clean":"2023-11-29T11:22:17.588573+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:22:17.588573+0000","last_undegraded":"2023-11-29T11:22:17.588573+0000","last_fullsized":"2023-11-29T11:22:17.588573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.588521+0000","last_change":"2023-11-29T11:22:17.592711+0000","last_active":"2023-11-29T11:22:18.588521+0000","last_peered":"2023-11-29T11:22:18.588521+0000","last_clean":"2023-11-29T11:22:18.588521+0000","last_became_active":"2023-11-29T11:22:17.592453+0000","last_became_peered":"2023-11-29T11:22:17.592453+0000","last_unstale":"2023-11-29T11:22:18.588521+0000","last_undegraded":"2023-11-29T11:22:18.588521+0000","last_fullsized":"2023-11-29T11:22:18.588521+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:30:32.903196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"109'8","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.589196+0000","last_change":"2023-11-29T11:22:17.218285+0000","last_active":"2023-11-29T11:22:18.589196+0000","last_peered":"2023-11-29T11:22:18.589196+0000","last_clean":"2023-11-29T11:22:18.589196+0000","last_became_active":"2023-11-29T11:22:17.217881+0000","last_became_peered":"2023-11-29T11:22:17.217881+0000","last_unstale":"2023-11-29T11:22:18.589196+0000","last_undegraded":"2023-11-29T11:22:18.589196+0000","last_fullsized":"2023-11-29T11:22:18.589196+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:02:24.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":105,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.581472+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:22:17.581472+0000","last_peered":"2023-11-29T11:22:17.581472+0000","last_clean":"2023-11-29T11:22:17.581472+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:22:17.581472+0000","last_undegraded":"2023-11-29T11:22:17.581472+0000","last_fullsized":"2023-11-29T11:22:17.581472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:18.588558+0000","last_change":"2023-11-29T11:22:17.608150+0000","last_active":"2023-11-29T11:22:18.588558+0000","last_peered":"2023-11-29T11:22:18.588558+0000","last_clean":"2023-11-29T11:22:18.588558+0000","last_became_active":"2023-11-29T11:22:17.607882+0000","last_became_peered":"2023-11-29T11:22:17.607882+0000","last_unstale":"2023-11-29T11:22:18.588558+0000","last_undegraded":"2023-11-29T11:22:18.588558+0000","last_fullsized":"2023-11-29T11:22:18.588558+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:17.180971+0000","last_clean_scrub_stamp":"2023-11-29T11:22:17.180971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T18:23:15.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-11-29T11:22:19.402226+0000","last_change":"2023-11-29T11:22:17.207613+0000","last_active":"2023-11-29T11:22:19.402226+0000","last_peered":"2023-11-29T11:22:19.402226+0000","last_clean":"2023-11-29T11:22:19.402226+0000","last_became_active":"2023-11-29T11:22:17.206392+0000","last_became_peered":"2023-11-29T11:22:17.206392+0000","last_unstale":"2023-11-29T11:22:19.402226+0000","last_undegraded":"2023-11-29T11:22:19.402226+0000","last_fullsized":"2023-11-29T11:22:19.402226+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:22:16.177135+0000","last_clean_scrub_stamp":"2023-11-29T11:22:16.177135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T17:18:43.457719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-11-29T11:22:17.597866+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:22:17.597866+0000","last_peered":"2023-11-29T11:22:17.597866+0000","last_clean":"2023-11-29T11:22:17.597866+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:22:17.597866+0000","last_undegraded":"2023-11-29T11:22:17.597866+0000","last_fullsized":"2023-11-29T11:22:17.597866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542261,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16516,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":94355324,"statfs":{"total":96636764160,"available":96619851776,"internally_reserved":0,"allocated":1961984,"data_stored":1248964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.55500000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1579999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.04,"5min":1.177,"15min":1.327},"last":0.92900000000000005}]},{"osd":1,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.86099999999999999,"15min":0.89700000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1559999999999999,"5min":1.5649999999999999,"15min":2.1360000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.85399999999999998,"15min":0.88500000000000001},"min":{"1min":0.58899999999999997,"5min":0.53800000000000003,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.157,"15min":3.0449999999999999},"last":0.63}]},{"osd":2,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.97199999999999998,"15min":0.998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1739999999999999,"5min":1.4850000000000001,"15min":1.8009999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97199999999999998,"15min":0.96899999999999997},"min":{"1min":0.64100000000000001,"5min":0.60499999999999998,"15min":0.53900000000000003},"max":{"1min":1.256,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":0.82999999999999996}]},{"osd":3,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.94499999999999995},"min":{"1min":0.68899999999999995,"5min":0.58299999999999996,"15min":0.38100000000000001},"max":{"1min":1.077,"5min":1.667,"15min":1.667},"last":1.139},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.92200000000000004,"15min":0.95399999999999996},"min":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.58299999999999996},"max":{"1min":1.218,"5min":1.3280000000000001,"15min":1.4510000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83999999999999997,"15min":0.92100000000000004},"min":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1479999999999999,"5min":1.4370000000000001,"15min":1.446},"last":1.052},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.0089999999999999,"15min":1.048},"min":{"1min":0.69099999999999995,"5min":0.63700000000000001,"15min":0.33800000000000002},"max":{"1min":1.2529999999999999,"5min":1.736,"15min":1.736},"last":1.341}]},{"osd":5,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.95499999999999996,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.53600000000000003},"max":{"1min":1.278,"5min":1.629,"15min":2.403},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0329999999999999,"15min":1.0880000000000001},"min":{"1min":0.71899999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4470000000000001,"5min":1.53,"15min":1.53},"last":1.1719999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.075,"15min":1.1259999999999999},"min":{"1min":0.77300000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.373,"5min":1.708,"15min":1.7230000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.127,"15min":1.1659999999999999},"min":{"1min":0.91600000000000004,"5min":0.72099999999999997,"15min":0.44500000000000001},"max":{"1min":1.3220000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.2549999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542262,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15548,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":14208,"kb_avail":94356292,"statfs":{"total":96636764160,"available":96620843008,"internally_reserved":0,"allocated":1363968,"data_stored":658066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14548992},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84299999999999997,"15min":0.82699999999999996},"min":{"1min":0.58999999999999997,"5min":0.52600000000000002,"15min":0.44400000000000001},"max":{"1min":1.1000000000000001,"5min":1.212,"15min":1.2909999999999999},"last":1.573},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.92100000000000004,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.53200000000000003,"15min":0.375},"max":{"1min":1.0529999999999999,"5min":7.7910000000000004,"15min":7.7910000000000004},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.91900000000000004},"min":{"1min":0.54900000000000004,"5min":0.53300000000000003,"15min":0.35199999999999998},"max":{"1min":1.0800000000000001,"5min":1.284,"15min":1.4510000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.04,"15min":0.97399999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.50800000000000001},"max":{"1min":1.1850000000000001,"5min":7.8479999999999999,"15min":7.8479999999999999},"last":1.155}]},{"osd":2,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84599999999999997,"15min":0.81499999999999995},"min":{"1min":0.624,"5min":0.54900000000000004,"15min":0.49099999999999999},"max":{"1min":1.141,"5min":1.1779999999999999,"15min":1.369},"last":0.879},{"interface":"front","average":{"1min":0.873,"5min":0.89900000000000002,"15min":0.90300000000000002},"min":{"1min":0.63,"5min":0.58999999999999997,"15min":0.40500000000000003},"max":{"1min":1.181,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.4510000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98999999999999999,"15min":0.93999999999999995},"min":{"1min":0.59799999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":7.923,"15min":7.923},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":0.93100000000000005},"min":{"1min":0.67500000000000004,"5min":0.61399999999999999,"15min":0.48099999999999998},"max":{"1min":1.0840000000000001,"5min":1.304,"15min":1.3600000000000001},"last":1.2410000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.90400000000000003},"min":{"1min":0.58499999999999996,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":1.0760000000000001,"5min":2.746,"15min":2.746},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.024,"15min":0.995},"min":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.59199999999999997},"max":{"1min":1.1899999999999999,"5min":7.9569999999999999,"15min":7.9569999999999999},"last":1.3340000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.90500000000000003,"15min":0.90200000000000002},"min":{"1min":0.67600000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.26},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0169999999999999,"15min":1.0529999999999999},"min":{"1min":0.64400000000000002,"5min":0.59599999999999997,"15min":0.54700000000000004},"max":{"1min":1.125,"5min":1.349,"15min":1.593},"last":1.528}]},{"osd":7,"last update":"Wed Nov 29 11:22:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.099,"15min":1.0860000000000001},"min":{"1min":0.61899999999999999,"5min":0.50700000000000001,"15min":0.42499999999999999},"max":{"1min":1.268,"5min":8.0060000000000002,"15min":8.0060000000000002},"last":1.421},{"interface":"front","average":{"1min":1.081,"5min":1.139,"15min":1.099},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4419999999999999,"5min":7.5730000000000004,"15min":7.5730000000000004},"last":1.3740000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542261,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15424,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":14080,"kb_avail":94356416,"statfs":{"total":96636764160,"available":96620969984,"internally_reserved":0,"allocated":1368064,"data_stored":658584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14417920},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.83799999999999997,"15min":0.83299999999999996},"min":{"1min":0.59899999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.89200000000000002,"15min":0.88600000000000001},"min":{"1min":0.80500000000000005,"5min":0.55200000000000005,"15min":0.53000000000000003},"max":{"1min":1.1619999999999999,"5min":1.278,"15min":1.52},"last":1.214}]},{"osd":1,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.84299999999999997,"15min":0.90600000000000003},"min":{"1min":0.60599999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":1.2350000000000001,"15min":1.512},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.90300000000000002,"15min":0.88800000000000001},"min":{"1min":0.67900000000000005,"5min":0.47099999999999997,"15min":0.46000000000000002},"max":{"1min":1.2110000000000001,"5min":1.24,"15min":1.377},"last":0.83199999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.121,"5min":1.284,"15min":1.5580000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91100000000000003,"15min":0.93799999999999994},"min":{"1min":0.67300000000000004,"5min":0.57999999999999996,"15min":0.51500000000000001},"max":{"1min":1.163,"5min":1.292,"15min":1.4330000000000001},"last":0.75}]},{"osd":3,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.91400000000000003},"min":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.48699999999999999},"max":{"1min":1.151,"5min":1.3169999999999999,"15min":1.335},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.95199999999999996,"15min":1},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.212,"5min":1.379,"15min":6.6040000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.91200000000000003},"min":{"1min":0.76200000000000001,"5min":0.61799999999999999,"15min":0.54000000000000004},"max":{"1min":1.198,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.996,"5min":1.0409999999999999,"15min":1.052},"min":{"1min":0.623,"5min":0.623,"15min":0.38700000000000001},"max":{"1min":1.212,"5min":1.3859999999999999,"15min":1.7230000000000001},"last":0.876}]},{"osd":6,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3300000000000001,"5min":1.3440000000000001,"15min":1.585},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.034,"5min":1.05,"15min":1.0469999999999999},"min":{"1min":0.80000000000000004,"5min":0.754,"15min":0.58599999999999997},"max":{"1min":1.286,"5min":1.367,"15min":1.575},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:21:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1140000000000001,"15min":1.103},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.58199999999999996},"max":{"1min":1.341,"5min":1.4690000000000001,"15min":1.6419999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.131,"15min":1.1719999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64000000000000001},"max":{"1min":1.286,"5min":1.4059999999999999,"15min":1.889},"last":1.0289999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542261,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15800,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":14464,"kb_avail":94356040,"statfs":{"total":96636764160,"available":96620584960,"internally_reserved":0,"allocated":1359872,"data_stored":657996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14811136},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.871,"15min":0.90100000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.47799999999999998},"max":{"1min":1.0900000000000001,"5min":1.3069999999999999,"15min":1.431},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.123,"5min":1.214,"15min":1.2769999999999999},"last":0.76900000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.871,"15min":0.88400000000000001},"min":{"1min":0.627,"5min":0.59199999999999997,"15min":0.505},"max":{"1min":1.1619999999999999,"5min":1.2450000000000001,"15min":1.458},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93600000000000005,"15min":0.89700000000000002},"min":{"1min":0.67200000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.1519999999999999,"5min":1.29,"15min":1.401},"last":1.1839999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.90600000000000003,"15min":0.878},"min":{"1min":0.68300000000000005,"5min":0.58099999999999996,"15min":0.50900000000000001},"max":{"1min":1.04,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.163},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":0.95699999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.497},"max":{"1min":1.089,"5min":1.2430000000000001,"15min":1.343},"last":1.0700000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.85099999999999998,"15min":0.872},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.153,"5min":1.1659999999999999,"15min":1.294},"last":1.141},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.94999999999999996,"15min":0.99099999999999999},"min":{"1min":0.71999999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1180000000000001,"5min":1.2230000000000001,"15min":1.8160000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.90400000000000003,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.3919999999999999,"15min":1.492},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93700000000000006,"15min":0.95899999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.60199999999999998},"max":{"1min":1.0649999999999999,"5min":1.296,"15min":1.3939999999999999},"last":1.008}]},{"osd":6,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.95599999999999996,"15min":0.99199999999999999},"min":{"1min":0.65600000000000003,"5min":0.64500000000000002,"15min":0.59499999999999997},"max":{"1min":1.2050000000000001,"5min":1.276,"15min":1.6120000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.056,"15min":1.0880000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.194,"5min":1.4390000000000001,"15min":1.542},"last":0.95999999999999996}]},{"osd":7,"last update":"Wed Nov 29 11:21:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.98999999999999999,"15min":1.0629999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.171,"5min":1.29,"15min":1.498},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.113,"15min":1.1479999999999999},"min":{"1min":0.79400000000000004,"5min":0.77800000000000002,"15min":0.69899999999999995},"max":{"1min":1.3799999999999999,"5min":1.399,"15min":1.905},"last":1.093}]}]},{"osd":3,"up_from":14,"seq":60129542262,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15752,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":14400,"kb_avail":94356088,"statfs":{"total":96636764160,"available":96620634112,"internally_reserved":0,"allocated":1376256,"data_stored":659614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14745600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.27100000000000002},"max":{"1min":1.0700000000000001,"5min":1.093,"15min":6.3840000000000003},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.68000000000000005},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.27500000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.282},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.34999999999999998},"max":{"1min":1.0409999999999999,"5min":1.111,"15min":19.015999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.61799999999999999,"5min":0.35999999999999999,"15min":0.31},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":6.3540000000000001},"last":0.621}]},{"osd":2,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73999999999999999,"15min":0.70199999999999996},"min":{"1min":0.48199999999999998,"5min":0.42899999999999999,"15min":0.372},"max":{"1min":1.109,"5min":1.109,"15min":1.494},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.80000000000000004},"min":{"1min":0.54800000000000004,"5min":0.45000000000000001,"15min":0.374},"max":{"1min":1.0600000000000001,"5min":1.1579999999999999,"15min":23.466000000000001},"last":0.72199999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":1.0229999999999999},"min":{"1min":0.753,"5min":0.63300000000000001,"15min":0.36499999999999999},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":15.255000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.95199999999999996,"15min":1.03},"min":{"1min":0.76400000000000001,"5min":0.66700000000000004,"15min":0.60799999999999998},"max":{"1min":1.115,"5min":1.5209999999999999,"15min":23.792999999999999},"last":0.753}]},{"osd":5,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.99299999999999999,"15min":1.0369999999999999},"min":{"1min":0.79900000000000004,"5min":0.76500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2629999999999999,"5min":1.49,"15min":23.751000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.034,"15min":1.0800000000000001},"min":{"1min":0.77700000000000002,"5min":0.68799999999999994,"15min":0.66700000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":7.0110000000000001},"last":1.123}]},{"osd":6,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0289999999999999,"15min":1.0669999999999999},"min":{"1min":0.84299999999999997,"5min":0.75,"15min":0.53200000000000003},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":15.292999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.0720000000000001,"15min":1.1439999999999999},"min":{"1min":0.81899999999999995,"5min":0.73699999999999999,"15min":0.57599999999999996},"max":{"1min":1.331,"5min":1.367,"15min":23.428999999999998},"last":0.82799999999999996}]},{"osd":7,"last update":"Wed Nov 29 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0760000000000001,"15min":1.131},"min":{"1min":0.83199999999999996,"5min":0.76500000000000001,"15min":0.58999999999999997},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":6.4199999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.095,"15min":1.1140000000000001},"min":{"1min":0.874,"5min":0.78100000000000003,"15min":0.437},"max":{"1min":1.954,"5min":1.954,"15min":15.428000000000001},"last":1.1579999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542261,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15480,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":14144,"kb_avail":94356360,"statfs":{"total":96636764160,"available":96620912640,"internally_reserved":0,"allocated":1359872,"data_stored":657996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14483456},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60899999999999999,"15min":0.63400000000000001},"min":{"1min":0.48599999999999999,"5min":0.312,"15min":0.312},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.53600000000000003,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.2410000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74099999999999999,"15min":0.72699999999999998},"min":{"1min":0.51700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.056,"5min":1.115,"15min":1.115},"last":0.67600000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.03,"5min":1.107,"15min":1.107},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.81499999999999995,"15min":0.78900000000000003},"min":{"1min":0.73099999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.80900000000000005}]},{"osd":4,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.93200000000000005,"15min":0.95099999999999996},"min":{"1min":0.72499999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.371},"last":0.999},{"interface":"front","average":{"1min":1.036,"5min":0.94599999999999995,"15min":0.95999999999999996},"min":{"1min":0.85999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.532},"last":0.96699999999999997}]},{"osd":5,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.80700000000000005,"5min":0.68500000000000005,"15min":0.622},"max":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.006,"15min":1.0049999999999999},"min":{"1min":0.81499999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2190000000000001,"5min":1.3540000000000001,"15min":1.7989999999999999},"last":1.105}]},{"osd":6,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.72999999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.04,"15min":1.042},"min":{"1min":0.83099999999999996,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.331,"5min":1.369,"15min":1.7270000000000001},"last":1.129}]},{"osd":7,"last update":"Wed Nov 29 11:22:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0580000000000001,"15min":1.0549999999999999},"min":{"1min":0.89200000000000002,"5min":0.73199999999999998,"15min":0.65900000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.76},"last":1.159},{"interface":"front","average":{"1min":1.103,"5min":1.071,"15min":1.0660000000000001},"min":{"1min":0.85899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4910000000000001},"last":1.0289999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542261,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16772,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94355068,"statfs":{"total":96636764160,"available":96619589632,"internally_reserved":0,"allocated":1961984,"data_stored":1248488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.98399999999999999,"5min":1.0469999999999999,"15min":1.2190000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.439,"5min":0.371,"15min":0.36499999999999999},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.63900000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.94899999999999995,"5min":1.141,"15min":1.1439999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.41999999999999998,"15min":0.36899999999999999},"max":{"1min":0.84599999999999997,"5min":1.119,"15min":1.393},"last":0.80000000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.59799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.0089999999999999,"5min":1.3240000000000001,"15min":1.3520000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.631,"15min":1.744},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.93700000000000006,"15min":0.95399999999999996},"min":{"1min":0.59899999999999998,"5min":0.495,"15min":0.495},"max":{"1min":1.456,"5min":1.456,"15min":1.609},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97699999999999998,"15min":1.012},"min":{"1min":0.77900000000000003,"5min":0.71899999999999997,"15min":0.60699999999999998},"max":{"1min":1.3240000000000001,"5min":1.4179999999999999,"15min":1.5069999999999999},"last":0.97299999999999998}]},{"osd":5,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92800000000000005,"15min":0.97599999999999998},"min":{"1min":0.72199999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2709999999999999,"5min":1.4199999999999999,"15min":1.8660000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.048,"5min":1.012,"15min":1.014},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65000000000000002},"max":{"1min":1.407,"5min":1.4139999999999999,"15min":1.5609999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.98299999999999998,"15min":1.0489999999999999},"min":{"1min":0.70399999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1839999999999999,"5min":1.47,"15min":1.575},"last":0.88},{"interface":"front","average":{"1min":1.002,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.77500000000000002,"5min":0.65600000000000003,"15min":0.65400000000000003},"max":{"1min":1.333,"5min":1.573,"15min":2.1920000000000002},"last":0.81999999999999995}]},{"osd":7,"last update":"Wed Nov 29 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0249999999999999,"15min":1.052},"min":{"1min":0.79300000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.3700000000000001,"5min":1.4910000000000001,"15min":2.2320000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.083,"15min":1.1040000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.59099999999999997},"max":{"1min":1.3600000000000001,"5min":1.5409999999999999,"15min":1.6599999999999999},"last":0.84399999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542261,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15816,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":14464,"kb_avail":94356024,"statfs":{"total":96636764160,"available":96620568576,"internally_reserved":0,"allocated":1376256,"data_stored":658670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14811136},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.47699999999999998,"5min":0.40999999999999998,"15min":0.316},"max":{"1min":0.95599999999999996,"5min":0.98999999999999999,"15min":1.1220000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.70699999999999996,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.74299999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.40600000000000003,"15min":0.374},"max":{"1min":1.157,"5min":1.157,"15min":1.1930000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94599999999999995,"5min":1.0509999999999999,"15min":1.2010000000000001},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.0840000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.80000000000000004},"min":{"1min":0.64900000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1579999999999999,"5min":1.262,"15min":1.262},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.878,"15min":0.876},"min":{"1min":0.65600000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.351,"5min":1.351,"15min":1.423},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.98299999999999998,"15min":0.99199999999999999},"min":{"1min":0.78100000000000003,"5min":0.60099999999999998,"15min":0.57099999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.94999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0149999999999999,"15min":1.0169999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.57599999999999996},"max":{"1min":1.149,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.325},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0029999999999999,"15min":1.0009999999999999},"min":{"1min":0.68000000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.5089999999999999},"last":1.05}]},{"osd":6,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0700000000000001},"min":{"1min":0.84399999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.383,"5min":1.417,"15min":1.5189999999999999},"last":0.88},{"interface":"front","average":{"1min":1.093,"5min":1.0600000000000001,"15min":1.097},"min":{"1min":0.755,"5min":0.74199999999999999,"15min":0.629},"max":{"1min":1.349,"5min":1.407,"15min":1.5389999999999999},"last":1.2669999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:21:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.097,"15min":1.1200000000000001},"min":{"1min":0.82099999999999995,"5min":0.69599999999999995,"15min":0.65100000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.5649999999999999},"last":1.363},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.70999999999999996},"max":{"1min":1.4350000000000001,"5min":1.4730000000000001,"15min":1.5700000000000001},"last":1.0129999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:22:20.957 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-29T11:22:20.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-29T11:22:21.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7f59e700 1 Processor -- start 2023-11-29T11:22:21.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7f59e700 1 -- start start 2023-11-29T11:22:21.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b800b1eb0 0x7f8b800d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8b8006d8e0 0x7f8b800d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7f59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b800d3130 con 0x7f8b800d2ce0 2023-11-29T11:22:21.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8015c6a0 con 0x7f8b8006d8e0 2023-11-29T11:22:21.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b800d00c0 con 0x7f8b800b1eb0 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7dd9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8b8006d8e0 0x7f8b800d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7e59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b800b1eb0 0x7f8b800d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7dd9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8b8006d8e0 0x7f8b800d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58710/0 (socket says 172.21.15.81:58710) 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7ed9d700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8b800d2ce0 0x7f8b800b77d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:47296/0 (socket says 172.21.15.81:47296) 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7e59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b800b1eb0 0x7f8b800d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:36582/0 (socket says 172.21.15.81:36582) 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.082+0000 7f8b7dd9b700 1 -- 172.21.15.81:0/1490098042 learned_addr learned my addr 172.21.15.81:0/1490098042 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7dd9b700 1 -- 172.21.15.81:0/1490098042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b800b1eb0 msgr2=0x7f8b800d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7dd9b700 1 --2- 172.21.15.81:0/1490098042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b800b1eb0 0x7f8b800d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7dd9b700 1 -- 172.21.15.81:0/1490098042 >> v1:172.21.15.176:6789/0 conn(0x7f8b800d2ce0 legacy=0x7f8b800b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7d59a700 1 -- 172.21.15.81:0/1490098042 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128618965 0 0) 0x7f8b78001490 con 0x7f8b800d2ce0 2023-11-29T11:22:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7dd9b700 1 -- 172.21.15.81:0/1490098042 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800cf0b0 con 0x7f8b8006d8e0 2023-11-29T11:22:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7e59c700 1 --2- 172.21.15.81:0/1490098042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b800b1eb0 0x7f8b800d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7dd9b700 1 --2- 172.21.15.81:0/1490098042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b8006d8e0 0x7f8b800d27a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009940 tx=0x7f8b70009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd91303457a64070 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7d59a700 1 -- 172.21.15.81:0/1490098042 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70011830 con 0x7f8b8006d8e0 2023-11-29T11:22:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7d59a700 1 -- 172.21.15.81:0/1490098042 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70011990 con 0x7f8b8006d8e0 2023-11-29T11:22:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7d59a700 1 -- 172.21.15.81:0/1490098042 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70011d20 con 0x7f8b8006d8e0 2023-11-29T11:22:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7f59e700 1 -- 172.21.15.81:0/1490098042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b8006d8e0 msgr2=0x7f8b800d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/1490098042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b8006d8e0 0x7f8b800d27a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009940 tx=0x7f8b70009c50 comp rx=0 tx=0).stop 2023-11-29T11:22:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7f59e700 1 -- 172.21.15.81:0/1490098042 shutdown_connections 2023-11-29T11:22:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/1490098042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b8006d8e0 0x7f8b800d27a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/1490098042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b800b1eb0 0x7f8b800d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7f59e700 1 -- 172.21.15.81:0/1490098042 >> 172.21.15.81:0/1490098042 conn(0x7f8b8009bbb0 msgr2=0x7f8b800b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7f59e700 1 -- 172.21.15.81:0/1490098042 shutdown_connections 2023-11-29T11:22:21.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.086+0000 7f8b7f59e700 1 -- 172.21.15.81:0/1490098042 wait complete. 2023-11-29T11:22:21.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7f59e700 1 Processor -- start 2023-11-29T11:22:21.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7f59e700 1 -- start start 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b8006d8e0 0x7f8b8015d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b800d2ce0 0x7f8b8014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b8015ef90 0x7f8b8014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8014dde0 con 0x7f8b8006d8e0 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8015def0 con 0x7f8b800d2ce0 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8015e1d0 con 0x7f8b8015ef90 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b8006d8e0 0x7f8b8015d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b8006d8e0 0x7f8b8015d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48536/0 (socket says 172.21.15.81:48536) 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7e59c700 1 -- 172.21.15.81:0/3374867045 learned_addr learned my addr 172.21.15.81:0/3374867045 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7ed9d700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b8015ef90 0x7f8b8014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7dd9b700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b800d2ce0 0x7f8b8014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7e59c700 1 -- 172.21.15.81:0/3374867045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b8015ef90 msgr2=0x7f8b8014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7e59c700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b8015ef90 0x7f8b8014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7e59c700 1 -- 172.21.15.81:0/3374867045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b800d2ce0 msgr2=0x7f8b8014d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7e59c700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b800d2ce0 0x7f8b8014d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.090+0000 7f8b7e59c700 1 -- 172.21.15.81:0/3374867045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740094b0 con 0x7f8b8006d8e0 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b7e59c700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b8006d8e0 0x7f8b8015d830 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400ebe0 tx=0x7f8b7400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b6effd700 1 -- 172.21.15.81:0/3374867045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400c850 con 0x7f8b8006d8e0 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b6effd700 1 -- 172.21.15.81:0/3374867045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7400c9b0 con 0x7f8b8006d8e0 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b70009570 con 0x7f8b8006d8e0 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b6effd700 1 -- 172.21.15.81:0/3374867045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7400cd40 con 0x7f8b8006d8e0 2023-11-29T11:22:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8006b2b0 con 0x7f8b8006d8e0 2023-11-29T11:22:21.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b6effd700 1 -- 172.21.15.81:0/3374867045 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8b74019030 con 0x7f8b8006d8e0 2023-11-29T11:22:21.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b800cfc30 con 0x7f8b8006d8e0 2023-11-29T11:22:21.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b6effd700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b60064ee0 0x7f8b60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b6effd700 1 -- 172.21.15.81:0/3374867045 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8b74081f40 con 0x7f8b8006d8e0 2023-11-29T11:22:21.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.094+0000 7f8b7dd9b700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b60064ee0 0x7f8b60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.098+0000 7f8b7dd9b700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b60064ee0 0x7f8b60067390 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009fd0 tx=0x7f8b70008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:21.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.106+0000 7f8b6effd700 1 -- 172.21.15.81:0/3374867045 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8b7404ffa0 con 0x7f8b8006d8e0 2023-11-29T11:22:21.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.318+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f8b800cf300 con 0x7f8b8006d8e0 2023-11-29T11:22:21.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.330+0000 7f8b6effd700 1 -- 172.21.15.81:0/3374867045 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8b7400cea0 con 0x7f8b8006d8e0 2023-11-29T11:22:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.330+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b60064ee0 msgr2=0x7f8b60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.330+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b60064ee0 0x7f8b60067390 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009fd0 tx=0x7f8b70008030 comp rx=0 tx=0).stop 2023-11-29T11:22:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.330+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b8006d8e0 msgr2=0x7f8b8015d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.330+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b8006d8e0 0x7f8b8015d830 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400ebe0 tx=0x7f8b7400eef0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.334+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 shutdown_connections 2023-11-29T11:22:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.334+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8b60064ee0 0x7f8b60067390 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.334+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b8015ef90 0x7f8b8014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.334+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b800d2ce0 0x7f8b8014d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.334+0000 7f8b7f59e700 1 --2- 172.21.15.81:0/3374867045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b8006d8e0 0x7f8b8015d830 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.334+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 >> 172.21.15.81:0/3374867045 conn(0x7f8b8009bbb0 msgr2=0x7f8b800b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.334+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 shutdown_connections 2023-11-29T11:22:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.334+0000 7f8b7f59e700 1 -- 172.21.15.81:0/3374867045 wait complete. 2023-11-29T11:22:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2023-11-29T11:22:21.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:21.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd3222700 1 Processor -- start 2023-11-29T11:22:21.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd3222700 1 -- start start 2023-11-29T11:22:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd3222700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7dcc158ef0 0x7f7dcc0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd3222700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dcc0cde00 con 0x7f7dcc0cb460 2023-11-29T11:22:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd3222700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dcc06d630 con 0x7f7dcc0ad490 2023-11-29T11:22:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd3222700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dcc0ce290 con 0x7f7dcc158ef0 2023-11-29T11:22:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd2a21700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7dcc0cb460 0x7f7dcc06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37542/0 (socket says 172.21.15.81:37542) 2023-11-29T11:22:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd2a21700 1 -- 172.21.15.81:0/884678298 learned_addr learned my addr 172.21.15.81:0/884678298 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd2220700 1 --2- 172.21.15.81:0/884678298 >> v2:172.21.15.176:3300/0 conn(0x7f7dcc158ef0 0x7f7dcc0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd121e700 1 -- 172.21.15.81:0/884678298 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434394350 0 0) 0x7f7dcc0cde00 con 0x7f7dcc0cb460 2023-11-29T11:22:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.462+0000 7f7dd121e700 1 -- 172.21.15.81:0/884678298 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db80035d0 con 0x7f7dcc0cb460 2023-11-29T11:22:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd2220700 1 -- 172.21.15.81:0/884678298 >> v1:172.21.15.176:6789/0 conn(0x7f7dcc0ad490 legacy=0x7f7dcc0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd2220700 1 -- 172.21.15.81:0/884678298 >> v1:172.21.15.81:6789/0 conn(0x7f7dcc0cb460 legacy=0x7f7dcc06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd2220700 1 -- 172.21.15.81:0/884678298 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc06d910 con 0x7f7dcc158ef0 2023-11-29T11:22:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd2220700 1 --2- 172.21.15.81:0/884678298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0c8a30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009850 tx=0x7f7dc8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd7179e1d434d87 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd121e700 1 -- 172.21.15.81:0/884678298 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011830 con 0x7f7dcc158ef0 2023-11-29T11:22:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd121e700 1 -- 172.21.15.81:0/884678298 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8011990 con 0x7f7dcc158ef0 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd121e700 1 -- 172.21.15.81:0/884678298 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011d40 con 0x7f7dcc158ef0 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- 172.21.15.81:0/884678298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc158ef0 msgr2=0x7f7dcc0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 --2- 172.21.15.81:0/884678298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0c8a30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009850 tx=0x7f7dc8009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- 172.21.15.81:0/884678298 shutdown_connections 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 --2- 172.21.15.81:0/884678298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0c8a30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- 172.21.15.81:0/884678298 >> 172.21.15.81:0/884678298 conn(0x7f7dcc0ce3e0 msgr2=0x7f7dcc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- 172.21.15.81:0/884678298 shutdown_connections 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- 172.21.15.81:0/884678298 wait complete. 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 Processor -- start 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- start start 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc0ad490 0x7f7dcc14e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dcc0cb460 0x7f7dcc0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc14e6d0 con 0x7f7dcc158ef0 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc0c76b0 con 0x7f7dcc0ad490 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.466+0000 7f7dd3222700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc0c7b40 con 0x7f7dcc0cb460 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0ac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48538/0 (socket says 172.21.15.81:48538) 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 -- 172.21.15.81:0/1628705970 learned_addr learned my addr 172.21.15.81:0/1628705970 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2220700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc0ad490 0x7f7dcc14e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd1a1f700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dcc0cb460 0x7f7dcc0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 -- 172.21.15.81:0/1628705970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dcc0cb460 msgr2=0x7f7dcc0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dcc0cb460 0x7f7dcc0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 -- 172.21.15.81:0/1628705970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc0ad490 msgr2=0x7f7dcc14e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc0ad490 0x7f7dcc14e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 -- 172.21.15.81:0/1628705970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80094b0 con 0x7f7dcc158ef0 2023-11-29T11:22:21.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd2a21700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0ac3c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400cb40 tx=0x7f7dc400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:21.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dbeffd700 1 -- 172.21.15.81:0/1628705970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4007500 con 0x7f7dcc158ef0 2023-11-29T11:22:21.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dbeffd700 1 -- 172.21.15.81:0/1628705970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4007660 con 0x7f7dcc158ef0 2023-11-29T11:22:21.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dcc0cda90 con 0x7f7dcc158ef0 2023-11-29T11:22:21.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dbeffd700 1 -- 172.21.15.81:0/1628705970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40079f0 con 0x7f7dcc158ef0 2023-11-29T11:22:21.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dcc06dbf0 con 0x7f7dcc158ef0 2023-11-29T11:22:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dcc0cbfb0 con 0x7f7dcc158ef0 2023-11-29T11:22:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.470+0000 7f7dbeffd700 1 -- 172.21.15.81:0/1628705970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7dc4019030 con 0x7f7dcc158ef0 2023-11-29T11:22:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.474+0000 7f7dbeffd700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7db0064ee0 0x7f7db0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.474+0000 7f7dbeffd700 1 -- 172.21.15.81:0/1628705970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7dc4081890 con 0x7f7dcc158ef0 2023-11-29T11:22:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.474+0000 7f7dd2220700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7db0064ee0 0x7f7db0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.474+0000 7f7dd2220700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7db0064ee0 0x7f7db0067390 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80090b0 tx=0x7f7dc801c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:21.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.478+0000 7f7dbeffd700 1 -- 172.21.15.81:0/1628705970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7dc404f8f0 con 0x7f7dcc158ef0 2023-11-29T11:22:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.678+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dcc1f0be0 con 0x7f7dcc158ef0 2023-11-29T11:22:21.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.678+0000 7f7dbeffd700 1 -- 172.21.15.81:0/1628705970 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f7dc4052f10 con 0x7f7dcc158ef0 2023-11-29T11:22:21.685 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:21.685 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:22:19.584710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8973":{"gid":8973,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/665591010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":665591010},{"type":"v1","addr":"172.21.15.81:6837","nonce":665591010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:22:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7db0064ee0 msgr2=0x7f7db0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7db0064ee0 0x7f7db0067390 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80090b0 tx=0x7f7dc801c040 comp rx=0 tx=0).stop 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc158ef0 msgr2=0x7f7dcc0ac3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0ac3c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400cb40 tx=0x7f7dc400cb70 comp rx=0 tx=0).stop 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 shutdown_connections 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7db0064ee0 0x7f7db0067390 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc158ef0 0x7f7dcc0ac3c0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dcc0cb460 0x7f7dcc0abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 --2- 172.21.15.81:0/1628705970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dcc0ad490 0x7f7dcc14e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 >> 172.21.15.81:0/1628705970 conn(0x7f7dcc0ce3e0 msgr2=0x7f7dcc0ab200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 shutdown_connections 2023-11-29T11:22:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:21.682+0000 7f7dd3222700 1 -- 172.21.15.81:0/1628705970 wait complete. 2023-11-29T11:22:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 72 2023-11-29T11:22:22.101 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-29T11:22:17.569132+0000', 'modified': '2023-11-29T11:22:19.584710+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8973}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8973': {'gid': 8973, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/665591010', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 665591010}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 665591010}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-29T11:22:22.101 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-29T11:22:22.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-29T11:22:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.218+0000 7f074c36d700 1 Processor -- start 2023-11-29T11:22:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074c36d700 1 -- start start 2023-11-29T11:22:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074c36d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0744158890 0x7f07440cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074c36d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07440c9590 0x7f074406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074c36d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440cb890 0x7f07440cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074c36d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07440cc220 con 0x7f07440c9590 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074c36d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074406c3b0 con 0x7f0744158890 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074c36d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074406c690 con 0x7f07440cb890 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07440c9590 0x7f074406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07440c9590 0x7f074406b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48546/0 (socket says 172.21.15.81:48546) 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 -- 172.21.15.81:0/4019978344 learned_addr learned my addr 172.21.15.81:0/4019978344 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074a109700 1 --2- 172.21.15.81:0/4019978344 >> v2:172.21.15.176:3300/0 conn(0x7f0744158890 0x7f07440cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f074a90a700 1 --2- 172.21.15.81:0/4019978344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440cb890 0x7f07440cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 -- 172.21.15.81:0/4019978344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440cb890 msgr2=0x7f07440cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 --2- 172.21.15.81:0/4019978344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440cb890 0x7f07440cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 -- 172.21.15.81:0/4019978344 >> v2:172.21.15.176:3300/0 conn(0x7f0744158890 msgr2=0x7f07440cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 --2- 172.21.15.81:0/4019978344 >> v2:172.21.15.176:3300/0 conn(0x7f0744158890 0x7f07440cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 -- 172.21.15.81:0/4019978344 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074406c970 con 0x7f07440c9590 2023-11-29T11:22:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749908700 1 --2- 172.21.15.81:0/4019978344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07440c9590 0x7f074406b9c0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f074406d530 tx=0x7f0738009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d0fc33b57a49b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.222+0000 7f0749107700 1 -- 172.21.15.81:0/4019978344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073800b8a0 con 0x7f07440c9590 2023-11-29T11:22:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f0749107700 1 -- 172.21.15.81:0/4019978344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073800ba00 con 0x7f07440c9590 2023-11-29T11:22:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f0749107700 1 -- 172.21.15.81:0/4019978344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073800bd90 con 0x7f07440c9590 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- 172.21.15.81:0/4019978344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07440c9590 msgr2=0x7f074406b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 --2- 172.21.15.81:0/4019978344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07440c9590 0x7f074406b9c0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f074406d530 tx=0x7f0738009bf0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- 172.21.15.81:0/4019978344 shutdown_connections 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 --2- 172.21.15.81:0/4019978344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440cb890 0x7f07440cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 --2- 172.21.15.81:0/4019978344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07440c9590 0x7f074406b9c0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 --2- 172.21.15.81:0/4019978344 >> v2:172.21.15.176:3300/0 conn(0x7f0744158890 0x7f07440cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- 172.21.15.81:0/4019978344 >> 172.21.15.81:0/4019978344 conn(0x7f07440b0a90 msgr2=0x7f07440b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- 172.21.15.81:0/4019978344 shutdown_connections 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- 172.21.15.81:0/4019978344 wait complete. 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 Processor -- start 2023-11-29T11:22:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- start start 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440c9590 0x7f07441e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07440cb890 0x7f07440c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0744158890 0x7f07440c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07441e6450 con 0x7f0744158890 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07440b1d90 con 0x7f07440cb890 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074c36d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07440b2070 con 0x7f07440c9590 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a90a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0744158890 0x7f07440c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a109700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440c9590 0x7f07441e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f0749908700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07440cb890 0x7f07440c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a109700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440c9590 0x7f07441e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:36606/0 (socket says 172.21.15.81:36606) 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a109700 1 -- 172.21.15.81:0/1220544145 learned_addr learned my addr 172.21.15.81:0/1220544145 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a90a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0744158890 0x7f07440c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48562/0 (socket says 172.21.15.81:48562) 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a90a700 1 -- 172.21.15.81:0/1220544145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440c9590 msgr2=0x7f07441e5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a90a700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440c9590 0x7f07441e5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a90a700 1 -- 172.21.15.81:0/1220544145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07440cb890 msgr2=0x7f07440c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a90a700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07440cb890 0x7f07440c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.226+0000 7f074a90a700 1 -- 172.21.15.81:0/1220544145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738009570 con 0x7f0744158890 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.230+0000 7f074a90a700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0744158890 0x7f07440c6dd0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f073c00e5e0 tx=0x7f073c00e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.230+0000 7f0742ffd700 1 -- 172.21.15.81:0/1220544145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00c070 con 0x7f0744158890 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.230+0000 7f0742ffd700 1 -- 172.21.15.81:0/1220544145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c004250 con 0x7f0744158890 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.230+0000 7f074c36d700 1 -- 172.21.15.81:0/1220544145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074406cf30 con 0x7f0744158890 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.230+0000 7f0742ffd700 1 -- 172.21.15.81:0/1220544145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0036c0 con 0x7f0744158890 2023-11-29T11:22:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.230+0000 7f074c36d700 1 -- 172.21.15.81:0/1220544145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074406cc50 con 0x7f0744158890 2023-11-29T11:22:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.230+0000 7f0742ffd700 1 -- 172.21.15.81:0/1220544145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f073c019020 con 0x7f0744158890 2023-11-29T11:22:22.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f0742ffd700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0730064ee0 0x7f0730067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f0742ffd700 1 -- 172.21.15.81:0/1220544145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f073c081c10 con 0x7f0744158890 2023-11-29T11:22:22.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074a109700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0730064ee0 0x7f0730067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074a109700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0730064ee0 0x7f0730067390 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f07340070b0 tx=0x7f073400c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074f5ef740 1 Processor -- start 2023-11-29T11:22:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074f5ef740 1 -- start start 2023-11-29T11:22:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 0x16dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 0x16e0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074f5ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x159eae0 con 0x142f710 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074f5ef740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x160ebd0 con 0x147a790 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.234+0000 7f074f5ef740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x1607ed0 con 0x142fae0 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48564/0 (socket says 172.21.15.81:48564) 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 -- 172.21.15.81:0/1310434181 learned_addr learned my addr 172.21.15.81:0/1310434181 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074a109700 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 0x16dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074a90a700 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 0x16e0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 -- 172.21.15.81:0/1310434181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 msgr2=0x16dfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 0x16dfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 -- 172.21.15.81:0/1310434181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 msgr2=0x16e0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 0x16e0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 -- 172.21.15.81:0/1310434181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x162dcc0 con 0x142f710 2023-11-29T11:22:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f0749908700 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0340 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f073800b0e0 tx=0x7f0738010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfeed418b1c8b95 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f072bfff700 1 -- 172.21.15.81:0/1310434181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738020070 con 0x142f710 2023-11-29T11:22:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f072bfff700 1 -- 172.21.15.81:0/1310434181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073800bc70 con 0x142f710 2023-11-29T11:22:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f072bfff700 1 -- 172.21.15.81:0/1310434181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738004040 con 0x142f710 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- 172.21.15.81:0/1310434181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 msgr2=0x16e0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0340 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f073800b0e0 tx=0x7f0738010000 comp rx=0 tx=0).stop 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- 172.21.15.81:0/1310434181 shutdown_connections 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 0x16e0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0340 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 --2- 172.21.15.81:0/1310434181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 0x16dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- 172.21.15.81:0/1310434181 >> 172.21.15.81:0/1310434181 conn(0x142feb0 msgr2=0x16c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- 172.21.15.81:0/1310434181 shutdown_connections 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- 172.21.15.81:0/1310434181 wait complete. 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- start start 2023-11-29T11:22:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 Processor -- start 2023-11-29T11:22:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 0x16c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142fae0 0x16b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 0x16c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14b4b20 con 0x142fae0 2023-11-29T11:22:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x16bb490 con 0x147a790 2023-11-29T11:22:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x16ddce0 con 0x142f710 2023-11-29T11:22:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.238+0000 7f074f5ef740 10 client.0 _ll_register_callbacks cb 0x16640d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:22:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142fae0 0x16b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142fae0 0x16b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48574/0 (socket says 172.21.15.81:48574) 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 -- 172.21.15.81:0/3071631704 learned_addr learned my addr 172.21.15.81:0/3071631704 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074a90a700 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 0x16c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074a109700 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 0x16c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 -- 172.21.15.81:0/3071631704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 msgr2=0x16c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 0x16c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 -- 172.21.15.81:0/3071631704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 msgr2=0x16c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 0x16c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 -- 172.21.15.81:0/3071631704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074406c970 con 0x142fae0 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f0749908700 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142fae0 0x16b71d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f073800c010 tx=0x7f07380047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b0551c38883eaa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 1 -- 172.21.15.81:0/3071631704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380036c0 con 0x142fae0 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 1 -- 172.21.15.81:0/3071631704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0738003820 con 0x142fae0 2023-11-29T11:22:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 -- 172.21.15.81:0/3071631704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1600f50 con 0x142fae0 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 1 -- 172.21.15.81:0/3071631704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07380039e0 con 0x142fae0 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 10 client.9120 fetch_fsmap learned FSMap version 72 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 -- 172.21.15.81:0/3071631704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x147b9e0 con 0x142fae0 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 1 -- 172.21.15.81:0/3071631704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1600f50 con 0x142fae0 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 1 -- 172.21.15.81:0/3071631704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f0738003b40 con 0x142fae0 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 10 client.9120 fetch_fsmap finished waiting for FSMap version 72 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 10 client.9120 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 20 client.9120 populate_metadata read hostname 'smithi081' 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x16b4f50 0x16b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 4 client.9120 mds_command: new command op to 8973 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 -- 172.21.15.81:0/3071631704 --> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1600c70 con 0x16b4f50 2023-11-29T11:22:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074a109700 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x16b4f50 0x16b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074a109700 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x16b4f50 0x16b5320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=909128c891d6c34a server_cookie=e3c033322fc51e34 in_seq=0 out_seq=0 2023-11-29T11:22:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 10 client.9120 ms_handle_connect on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 1 -- 172.21.15.81:0/3071631704 <== mds.0 v2:172.21.15.81:6836/665591010 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1600c70 con 0x16b4f50 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 10 client.9120 handle_command_reply: tid=0 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 client.9120 shutdown 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 -- 172.21.15.81:0/3071631704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142fae0 msgr2=0x16b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142fae0 0x16b71d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f073800c010 tx=0x7f07380047e0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 -- 172.21.15.81:0/3071631704 shutdown_connections 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x16b4f50 0x16b5320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x147a790 0x16c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f07297fa700 0 client.9120 ms_handle_reset on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142fae0 0x16b71d0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 --2- 172.21.15.81:0/3071631704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 0x16c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.242+0000 7f074f5ef740 1 -- 172.21.15.81:0/3071631704 >> 172.21.15.81:0/3071631704 conn(0x142feb0 msgr2=0x16c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.246+0000 7f074f5ef740 1 -- 172.21.15.81:0/3071631704 shutdown_connections 2023-11-29T11:22:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.246+0000 7f074f5ef740 1 -- 172.21.15.81:0/3071631704 wait complete. 2023-11-29T11:22:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.246+0000 7f074f5ef740 20 client.9120 trim_cache size 0 max 16384 2023-11-29T11:22:22.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 Processor -- start 2023-11-29T11:22:22.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- start start 2023-11-29T11:22:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142feb0 0x16a1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 0x16e1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x15bda40 con 0x142f710 2023-11-29T11:22:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x1604c60 con 0x142feb0 2023-11-29T11:22:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x15b8260 con 0x142fae0 2023-11-29T11:22:22.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48580/0 (socket says 172.21.15.81:48580) 2023-11-29T11:22:22.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 -- 172.21.15.81:0/163555957 learned_addr learned my addr 172.21.15.81:0/163555957 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074a109700 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142feb0 0x16a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074a90a700 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 0x16e1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 -- 172.21.15.81:0/163555957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 msgr2=0x16e1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 0x16e1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 -- 172.21.15.81:0/163555957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142feb0 msgr2=0x16a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142feb0 0x16a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 -- 172.21.15.81:0/163555957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074406a310 con 0x142f710 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0749908700 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0b30 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f0738001eb0 tx=0x7f0738027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22a99834ce2750d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0740db8700 1 -- 172.21.15.81:0/163555957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738006d00 con 0x142f710 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0740db8700 1 -- 172.21.15.81:0/163555957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07380040f0 con 0x142f710 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f0740db8700 1 -- 172.21.15.81:0/163555957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073802e510 con 0x142f710 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- 172.21.15.81:0/163555957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 msgr2=0x16e0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0b30 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f0738001eb0 tx=0x7f0738027040 comp rx=0 tx=0).stop 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- 172.21.15.81:0/163555957 shutdown_connections 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142fae0 0x16e1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142f710 0x16e0b30 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 --2- 172.21.15.81:0/163555957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142feb0 0x16a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- 172.21.15.81:0/163555957 >> 172.21.15.81:0/163555957 conn(0x16ec630 msgr2=0x16c8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- 172.21.15.81:0/163555957 shutdown_connections 2023-11-29T11:22:22.275 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.266+0000 7f074f5ef740 1 -- 172.21.15.81:0/163555957 wait complete. 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 -- start start 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 Processor -- start 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 0x16a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142fae0 0x16b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142feb0 0x1746270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x16e19f0 con 0x142feb0 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x16b8480 con 0x142fae0 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x169ea90 con 0x142f710 2023-11-29T11:22:22.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 10 client.0 _ll_register_callbacks cb 0x15b42d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142feb0 0x1746270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142feb0 0x1746270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48596/0 (socket says 172.21.15.81:48596) 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f0749908700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142fae0 0x16b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a109700 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 0x16a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 -- 172.21.15.81:0/2307882118 learned_addr learned my addr 172.21.15.81:0/2307882118 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 -- 172.21.15.81:0/2307882118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 msgr2=0x16a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 0x16a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 -- 172.21.15.81:0/2307882118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142fae0 msgr2=0x16b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142fae0 0x16b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 -- 172.21.15.81:0/2307882118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x147b9e0 con 0x142feb0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f07297fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a90a700 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142feb0 0x1746270 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f073c004700 tx=0x7f073c011370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3179eb9530cc0e1e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f07297fa700 1 -- 172.21.15.81:0/2307882118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c05bbb0 con 0x142feb0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f07297fa700 1 -- 172.21.15.81:0/2307882118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f073c05bd10 con 0x142feb0 2023-11-29T11:22:22.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 -- 172.21.15.81:0/2307882118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14ac260 con 0x142feb0 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f07297fa700 1 -- 172.21.15.81:0/2307882118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f073c04f660 con 0x142feb0 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 10 client.9126 fetch_fsmap learned FSMap version 72 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 -- 172.21.15.81:0/2307882118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x15b4a20 con 0x142feb0 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f07297fa700 1 -- 172.21.15.81:0/2307882118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14ac260 con 0x142feb0 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f07297fa700 1 -- 172.21.15.81:0/2307882118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f073c04f7c0 con 0x142feb0 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 10 client.9126 fetch_fsmap finished waiting for FSMap version 72 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 10 client.9126 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 20 client.9126 populate_metadata read hostname 'smithi081' 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x147a790 0x16a1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 4 client.9126 mds_command: new command op to 8973 tid=0[{"prefix": "status"}] 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074f5ef740 1 -- 172.21.15.81:0/2307882118 --> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] -- command(tid 0: {"prefix": "status"}) v1 -- 0x143d260 con 0x147a790 2023-11-29T11:22:22.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.270+0000 7f074a109700 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x147a790 0x16a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f07297fa700 10 client.9126 ms_handle_connect on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074a109700 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x147a790 0x16a1540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b315dcc8744f3058 server_cookie=89182ac77ee2cc56 in_seq=0 out_seq=0 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f07297fa700 1 -- 172.21.15.81:0/2307882118 <== mds.0 v2:172.21.15.81:6836/665591010 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x143d260 con 0x147a790 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f07297fa700 10 client.9126 handle_command_reply: tid=0 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 client.9126 shutdown 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 -- 172.21.15.81:0/2307882118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142feb0 msgr2=0x1746270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142feb0 0x1746270 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f073c004700 tx=0x7f073c011370 comp rx=0 tx=0).stop 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 -- 172.21.15.81:0/2307882118 shutdown_connections 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x147a790 0x16a1540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x142feb0 0x1746270 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x142fae0 0x16b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 --2- 172.21.15.81:0/2307882118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x142f710 0x16a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f07297fa700 0 client.9126 ms_handle_reset on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 -- 172.21.15.81:0/2307882118 >> 172.21.15.81:0/2307882118 conn(0x16ec630 msgr2=0x16e0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 -- 172.21.15.81:0/2307882118 shutdown_connections 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 1 -- 172.21.15.81:0/2307882118 wait complete. 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074f5ef740 20 client.9126 trim_cache size 0 max 16384 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "8e4db050-5755-42f7-ba76-f62443203ed8", 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8973, 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-11-29T11:22:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-11-29T11:22:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.7024920100000003, 2023-11-29T11:22:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 72, 2023-11-29T11:22:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 110, 2023-11-29T11:22:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 110, 2023-11-29T11:22:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 9.5862993420000002 2023-11-29T11:22:22.284 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:22:22.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 -- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0730064ee0 msgr2=0x7f0730067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0730064ee0 0x7f0730067390 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f07340070b0 tx=0x7f073400c040 comp rx=0 tx=0).stop 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 -- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0744158890 msgr2=0x7f07440c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0744158890 0x7f07440c6dd0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f073c00e5e0 tx=0x7f073c00e8f0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 -- 172.21.15.81:0/1220544145 shutdown_connections 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0730064ee0 0x7f0730067390 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0744158890 0x7f07440c6dd0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07440cb890 0x7f07440c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 --2- 172.21.15.81:0/1220544145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07440c9590 0x7f07441e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 -- 172.21.15.81:0/1220544145 >> 172.21.15.81:0/1220544145 conn(0x7f07440b0a90 msgr2=0x7f0744157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 -- 172.21.15.81:0/1220544145 shutdown_connections 2023-11-29T11:22:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.274+0000 7f074c36d700 1 -- 172.21.15.81:0/1220544145 wait complete. 2023-11-29T11:22:22.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:22:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e681e700 1 Processor -- start 2023-11-29T11:22:22.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e681e700 1 -- start start 2023-11-29T11:22:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e681e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 0x7f31e00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e681e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f31e00cb460 0x7f31e00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e681e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e00cd8f0 con 0x7f31e00ad490 2023-11-29T11:22:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e681e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00add00 con 0x7f31e00cb460 2023-11-29T11:22:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e681e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00cc4f0 con 0x7f31e0158e60 2023-11-29T11:22:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e501b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f31e00ad490 0x7f31e00cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37550/0 (socket says 172.21.15.81:37550) 2023-11-29T11:22:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e501b700 1 -- 172.21.15.81:0/847239348 learned_addr learned my addr 172.21.15.81:0/847239348 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e601d700 1 --2- 172.21.15.81:0/847239348 >> v2:172.21.15.176:3300/0 conn(0x7f31e00cb460 0x7f31e00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e581c700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 0x7f31e00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202072261 0 0) 0x7f31e00cd8f0 con 0x7f31e00ad490 2023-11-29T11:22:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.402+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31cc0035d0 con 0x7f31e00ad490 2023-11-29T11:22:22.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076003665 0 0) 0x7f31cc0035d0 con 0x7f31e00ad490 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 msgr2=0x7f31e00c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 0x7f31e00c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 >> v2:172.21.15.176:3300/0 conn(0x7f31e00cb460 msgr2=0x7f31e00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 --2- 172.21.15.81:0/847239348 >> v2:172.21.15.176:3300/0 conn(0x7f31e00cb460 0x7f31e00cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e006dc60 con 0x7f31e00ad490 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f31dc001670 con 0x7f31e00ad490 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 >> v1:172.21.15.81:6789/0 conn(0x7f31e00ad490 legacy=0x7f31e00cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31cc003a50 0x7f31cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 0x7f31cc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31cc004db0 0x7f31cc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00add00 con 0x7f31cc004db0 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00cc4f0 con 0x7f31cc003a50 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc00ba30 con 0x7f31e0158e60 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 --2- 172.21.15.81:0/847239348 >> v2:172.21.15.176:3300/0 conn(0x7f31e00cb460 0x7f31e00cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e581c700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31cc003a50 0x7f31cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e501b700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 0x7f31cc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31cc004db0 0x7f31cc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 -- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 msgr2=0x7f31cc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 0x7f31cc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 -- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31cc003a50 msgr2=0x7f31cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31cc003a50 0x7f31cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 -- 172.21.15.81:0/847239348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0035d0 con 0x7f31cc004db0 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e581c700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31cc003a50 0x7f31cc003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e501b700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e0158e60 0x7f31cc004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31cc004db0 0x7f31cc005220 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f31d800e380 tx=0x7f31cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c9923772190fbb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800ee40 con 0x7f31cc004db0 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800f040 con 0x7f31cc004db0 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e481a700 1 -- 172.21.15.81:0/847239348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8003c60 con 0x7f31cc004db0 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e681e700 1 -- 172.21.15.81:0/847239348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31cc004db0 msgr2=0x7f31cc005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e681e700 1 --2- 172.21.15.81:0/847239348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31cc004db0 0x7f31cc005220 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f31d800e380 tx=0x7f31cc0058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e601d700 1 -- 172.21.15.81:0/847239348 reap_dead start 2023-11-29T11:22:22.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e681e700 1 -- 172.21.15.81:0/847239348 shutdown_connections 2023-11-29T11:22:22.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e681e700 1 -- 172.21.15.81:0/847239348 >> 172.21.15.81:0/847239348 conn(0x7f31e00ce3e0 msgr2=0x7f31e00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:22.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e681e700 1 -- 172.21.15.81:0/847239348 shutdown_connections 2023-11-29T11:22:22.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.406+0000 7f31e681e700 1 -- 172.21.15.81:0/847239348 wait complete. 2023-11-29T11:22:22.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 Processor -- start 2023-11-29T11:22:22.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 -- start start 2023-11-29T11:22:22.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31e01578e0 0x7f31e015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e015aea0 0x7f31e00c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e00c9db0 0x7f31e00c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00ca220 con 0x7f31e00c9db0 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00c5650 con 0x7f31e01578e0 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00c5930 con 0x7f31e015aea0 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e601d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e00c9db0 0x7f31e00c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31e01578e0 0x7f31e015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e501b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e015aea0 0x7f31e00c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31e01578e0 0x7f31e015a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58784/0 (socket says 172.21.15.81:58784) 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 -- 172.21.15.81:0/4173366837 learned_addr learned my addr 172.21.15.81:0/4173366837 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 -- 172.21.15.81:0/4173366837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e015aea0 msgr2=0x7f31e00c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e015aea0 0x7f31e00c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 -- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e00c9db0 msgr2=0x7f31e00c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e00c9db0 0x7f31e00c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 -- 172.21.15.81:0/4173366837 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0159230 con 0x7f31e01578e0 2023-11-29T11:22:22.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e581c700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31e01578e0 0x7f31e015a960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009e80 tx=0x7f31d000e510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31d67fc700 1 -- 172.21.15.81:0/4173366837 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0018070 con 0x7f31e01578e0 2023-11-29T11:22:22.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31d67fc700 1 -- 172.21.15.81:0/4173366837 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000ec80 con 0x7f31e01578e0 2023-11-29T11:22:22.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e00cde90 con 0x7f31e01578e0 2023-11-29T11:22:22.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31d67fc700 1 -- 172.21.15.81:0/4173366837 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000edf0 con 0x7f31e01578e0 2023-11-29T11:22:22.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.410+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e006d6a0 con 0x7f31e01578e0 2023-11-29T11:22:22.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.414+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e0072500 con 0x7f31e01578e0 2023-11-29T11:22:22.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.414+0000 7f31d67fc700 1 -- 172.21.15.81:0/4173366837 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f31d0004020 con 0x7f31e01578e0 2023-11-29T11:22:22.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.414+0000 7f31d67fc700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f31c4064f10 0x7f31c40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:22.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.414+0000 7f31d67fc700 1 -- 172.21.15.81:0/4173366837 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f31d0085ce0 con 0x7f31e01578e0 2023-11-29T11:22:22.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.414+0000 7f31e501b700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f31c4064f10 0x7f31c40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:22.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.414+0000 7f31e501b700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f31c4064f10 0x7f31c40673c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f31e00c45a0 tx=0x7f31dc008d10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.426+0000 7f31d67fc700 1 -- 172.21.15.81:0/4173366837 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f31d0053400 con 0x7f31e01578e0 2023-11-29T11:22:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.626+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31e00ced30 con 0x7f31e01578e0 2023-11-29T11:22:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.626+0000 7f31d67fc700 1 -- 172.21.15.81:0/4173366837 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31d0053cc0 con 0x7f31e01578e0 2023-11-29T11:22:22.633 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f31c4064f10 msgr2=0x7f31c40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f31c4064f10 0x7f31c40673c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f31e00c45a0 tx=0x7f31dc008d10 comp rx=0 tx=0).stop 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31e01578e0 msgr2=0x7f31e015a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31e01578e0 0x7f31e015a960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009e80 tx=0x7f31d000e510 comp rx=0 tx=0).stop 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 shutdown_connections 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f31c4064f10 0x7f31c40673c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e00c9db0 0x7f31e00c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31e015aea0 0x7f31e00c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 --2- 172.21.15.81:0/4173366837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31e01578e0 0x7f31e015a960 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 >> 172.21.15.81:0/4173366837 conn(0x7f31e00ce3e0 msgr2=0x7f31e00ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 shutdown_connections 2023-11-29T11:22:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:22.630+0000 7f31e681e700 1 -- 172.21.15.81:0/4173366837 wait complete. 2023-11-29T11:22:22.647 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:22:22.647 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:22:22.647 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:22:22.647 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:22:22.647 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:22.647 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:22:22.648 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:22:22.648 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:22:22.648 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:22:22.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:22.648 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:22:22.653 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42024sec preferred_lft 42024sec 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:22:22.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:22.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:22.655 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:22:22.670 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:22:22.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:22.672 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:22:22.679 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:22:22.679 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:22:22.680 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:22:22.680 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:22:22.680 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:22:22.680 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:22:22.680 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:22:22.680 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:22:22.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:22.680 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:22:22.680 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:22:22.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:22:22.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:22:22.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:22:22.680 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:22:22.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:22.763 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:22:22.770 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:22:22.770 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:22:22.770 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:22:22.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:22.770 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:22:22.784 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:22:22.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:22:22.784 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:22.833 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:22:22.833 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:22:22.833 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:22.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:22:22.853 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:22:22.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:22:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:22:22.870 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:22:22.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:22.871 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:22:22.921 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:22:22.921 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:22:22.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:22:22.937 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:22:22.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:22:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:22:22.948 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:22:22.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:22.949 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:22:23.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:22:23.006+0000 7efdf1a1a640 -1 init, newargv = 0x564c8ef80660 newargc=15 2023-11-29T11:22:23.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[61679]: starting ceph client 2023-11-29T11:22:23.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[61679]: starting fuse 2023-11-29T11:22:24.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:22:24.121 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:22:24.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:22:24.131 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:22:24.132 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:22:24.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:24.132 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:22:24.137 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:22:24.137 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:22:24.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:22:24.137 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:22:24.137 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:22:24.137 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:22:24.138 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:22:24.139 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:22:24.139 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:22:24.139 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:22:24.139 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:22:24.139 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:24.139 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:22:24.139 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:22:24.258 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.61679.asok 2023-11-29T11:22:24.445 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61679.asok 2023-11-29T11:22:24.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:24.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.61679.asok status 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "61679", 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 9138, 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 9138 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2586562252 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:22:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2586562252 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.9138 192.168.0.1:0/2586562252", 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2586562252", 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 72, 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 110, 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:22:24.545 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:22:24.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:24.552 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:22:24.553 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:24.558 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:22:24.559 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:24.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:24.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:24.575 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:24.575 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:24.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:24.625 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-11-29T11:22:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:6+0 records in 2023-11-29T11:22:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:6+0 records out 2023-11-29T11:22:24.724 INFO:teuthology.orchestra.run.smithi081.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0791545 s, 79.5 MB/s 2023-11-29T11:22:24.725 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:24.725 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:24.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:24.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 Processor -- start 2023-11-29T11:22:24.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- start start 2023-11-29T11:22:24.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed6406e530 0x7fed6406e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed640ceca0 0x7fed640cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed64070b60 con 0x7fed640ccbf0 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed640ce810 con 0x7fed6406e530 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6406ee40 con 0x7fed640ceca0 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed63fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed6406e530 0x7fed6406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed63fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed6406e530 0x7fed6406e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48630/0 (socket says 172.21.15.81:48630) 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed63fff700 1 -- 172.21.15.81:0/1977328812 learned_addr learned my addr 172.21.15.81:0/1977328812 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed68a5e700 1 --2- 172.21.15.81:0/1977328812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed640ceca0 0x7fed640cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed63fff700 1 -- 172.21.15.81:0/1977328812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed640ceca0 msgr2=0x7fed640cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed63fff700 1 --2- 172.21.15.81:0/1977328812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed640ceca0 0x7fed640cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed63fff700 1 -- 172.21.15.81:0/1977328812 >> v1:172.21.15.176:6789/0 conn(0x7fed640ccbf0 legacy=0x7fed64070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:24.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed63fff700 1 -- 172.21.15.81:0/1977328812 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640cc070 con 0x7fed6406e530 2023-11-29T11:22:24.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed63fff700 1 --2- 172.21.15.81:0/1977328812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6406e530 0x7fed6406e900 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fed54009910 tx=0x7fed54009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860b8470241bed6a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:24.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed62ffd700 1 -- 172.21.15.81:0/1977328812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400ba60 con 0x7fed6406e530 2023-11-29T11:22:24.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed62ffd700 1 -- 172.21.15.81:0/1977328812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5400bbc0 con 0x7fed6406e530 2023-11-29T11:22:24.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed62ffd700 1 -- 172.21.15.81:0/1977328812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54009e60 con 0x7fed6406e530 2023-11-29T11:22:24.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1977328812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6406e530 msgr2=0x7fed6406e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:24.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1977328812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6406e530 0x7fed6406e900 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fed54009910 tx=0x7fed54009c20 comp rx=0 tx=0).stop 2023-11-29T11:22:24.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1977328812 shutdown_connections 2023-11-29T11:22:24.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1977328812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed640ceca0 0x7fed640cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:24.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1977328812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed6406e530 0x7fed6406e900 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:24.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1977328812 >> 172.21.15.81:0/1977328812 conn(0x7fed640cdef0 msgr2=0x7fed640d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:24.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1977328812 shutdown_connections 2023-11-29T11:22:24.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.890+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1977328812 wait complete. 2023-11-29T11:22:24.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed6a4c1700 1 Processor -- start 2023-11-29T11:22:24.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed6a4c1700 1 -- start start 2023-11-29T11:22:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed6a4c1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed6406e530 0x7fed64156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed6a4c1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed640ccbf0 0x7fed641e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed6a4c1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed640ceca0 0x7fed64151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed6a4c1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64157ea0 con 0x7fed640ceca0 2023-11-29T11:22:24.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed6a4c1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64158180 con 0x7fed640ccbf0 2023-11-29T11:22:24.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed6a4c1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed64158460 con 0x7fed6406e530 2023-11-29T11:22:24.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed68a5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed640ceca0 0x7fed64151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:24.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed68a5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed640ceca0 0x7fed64151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48636/0 (socket says 172.21.15.81:48636) 2023-11-29T11:22:24.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed68a5e700 1 -- 172.21.15.81:0/1739389434 learned_addr learned my addr 172.21.15.81:0/1739389434 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:24.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed63fff700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed6406e530 0x7fed64156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:24.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.894+0000 7fed637fe700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed640ccbf0 0x7fed641e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed68a5e700 1 -- 172.21.15.81:0/1739389434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed6406e530 msgr2=0x7fed64156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed68a5e700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed6406e530 0x7fed64156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed68a5e700 1 -- 172.21.15.81:0/1739389434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed640ccbf0 msgr2=0x7fed641e6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed68a5e700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed640ccbf0 0x7fed641e6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed68a5e700 1 -- 172.21.15.81:0/1739389434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54009570 con 0x7fed640ceca0 2023-11-29T11:22:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed68a5e700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed640ceca0 0x7fed64151a70 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00e7e0 tx=0x7fed4c00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed60ff9700 1 -- 172.21.15.81:0/1739389434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00c070 con 0x7fed640ceca0 2023-11-29T11:22:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed60ff9700 1 -- 172.21.15.81:0/1739389434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c013610 con 0x7fed640ceca0 2023-11-29T11:22:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed640cc630 con 0x7fed640ceca0 2023-11-29T11:22:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed60ff9700 1 -- 172.21.15.81:0/1739389434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0139c0 con 0x7fed640ceca0 2023-11-29T11:22:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed640cc350 con 0x7fed640ceca0 2023-11-29T11:22:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed640cc910 con 0x7fed640ceca0 2023-11-29T11:22:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.898+0000 7fed60ff9700 1 -- 172.21.15.81:0/1739389434 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fed4c023070 con 0x7fed640ceca0 2023-11-29T11:22:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.902+0000 7fed60ff9700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed44064ee0 0x7fed44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.902+0000 7fed60ff9700 1 -- 172.21.15.81:0/1739389434 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fed4c081ce0 con 0x7fed640ceca0 2023-11-29T11:22:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.902+0000 7fed63fff700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed44064ee0 0x7fed44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.902+0000 7fed63fff700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed44064ee0 0x7fed44067390 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fed54000c00 tx=0x7fed54008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:24.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:24.906+0000 7fed60ff9700 1 -- 172.21.15.81:0/1739389434 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fed4c04fcc0 con 0x7fed640ceca0 2023-11-29T11:22:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.074+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed64072c20 con 0x7fed640ceca0 2023-11-29T11:22:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed60ff9700 1 -- 172.21.15.81:0/1739389434 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17988 (secure 0 0 0) 0x7fed4c017090 con 0x7fed640ceca0 2023-11-29T11:22:25.083 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:25.084 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":110,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:22:18.573529+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed44064ee0 msgr2=0x7fed44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed44064ee0 0x7fed44067390 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fed54000c00 tx=0x7fed54008030 comp rx=0 tx=0).stop 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed640ceca0 msgr2=0x7fed64151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed640ceca0 0x7fed64151a70 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00e7e0 tx=0x7fed4c00eaf0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 shutdown_connections 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fed44064ee0 0x7fed44067390 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed640ceca0 0x7fed64151a70 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed640ccbf0 0x7fed641e6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 --2- 172.21.15.81:0/1739389434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed6406e530 0x7fed64156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 >> 172.21.15.81:0/1739389434 conn(0x7fed640cdef0 msgr2=0x7fed640c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 shutdown_connections 2023-11-29T11:22:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.078+0000 7fed6a4c1700 1 -- 172.21.15.81:0/1739389434 wait complete. 2023-11-29T11:22:25.098 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:22:15.796341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:22:16.553603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:22:25.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:22:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2ddbc7700 1 Processor -- start 2023-11-29T11:22:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2ddbc7700 1 -- start start 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2ddbc7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d80b1ae0 0x7fb2d806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2ddbc7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 0x7fb2d80d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2ddbc7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d806a9c0 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2ddbc7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d806aca0 con 0x7fb2d80b1ae0 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2ddbc7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d806af80 con 0x7fb2d806a4c0 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2dcbc5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d80b1ae0 0x7fb2d806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2dcbc5700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d80b1ae0 0x7fb2d806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48638/0 (socket says 172.21.15.81:48638) 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.218+0000 7fb2dcbc5700 1 -- 172.21.15.81:0/4294518537 learned_addr learned my addr 172.21.15.81:0/4294518537 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2d7fff700 1 --2- 172.21.15.81:0/4294518537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 0x7fb2d80d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2dcbc5700 1 -- 172.21.15.81:0/4294518537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 msgr2=0x7fb2d80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2dcbc5700 1 --2- 172.21.15.81:0/4294518537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 0x7fb2d80d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2dcbc5700 1 -- 172.21.15.81:0/4294518537 >> v1:172.21.15.176:6789/0 conn(0x7fb2d80cf0e0 legacy=0x7fb2d80b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2dcbc5700 1 -- 172.21.15.81:0/4294518537 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80b4380 con 0x7fb2d80b1ae0 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2dcbc5700 1 --2- 172.21.15.81:0/4294518537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80b1ae0 0x7fb2d806d8e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009910 tx=0x7fb2c8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f58945363a4dcb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2d77fe700 1 -- 172.21.15.81:0/4294518537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8011830 con 0x7fb2d80b1ae0 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2d77fe700 1 -- 172.21.15.81:0/4294518537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8011990 con 0x7fb2d80b1ae0 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2d77fe700 1 -- 172.21.15.81:0/4294518537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8011d40 con 0x7fb2d80b1ae0 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/4294518537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80b1ae0 msgr2=0x7fb2d806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/4294518537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80b1ae0 0x7fb2d806d8e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009910 tx=0x7fb2c8009c20 comp rx=0 tx=0).stop 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/4294518537 shutdown_connections 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/4294518537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 0x7fb2d80d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/4294518537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80b1ae0 0x7fb2d806d8e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/4294518537 >> 172.21.15.81:0/4294518537 conn(0x7fb2d809bbd0 msgr2=0x7fb2d80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/4294518537 shutdown_connections 2023-11-29T11:22:25.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/4294518537 wait complete. 2023-11-29T11:22:25.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 Processor -- start 2023-11-29T11:22:25.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.222+0000 7fb2ddbc7700 1 -- start start 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 0x7fb2d815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2d80b1ae0 0x7fb2d815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80cf0e0 0x7fb2d8158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8157f00 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8156670 con 0x7fb2d80b1ae0 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81572c0 con 0x7fb2d806a4c0 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80cf0e0 0x7fb2d8158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80cf0e0 0x7fb2d8158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48654/0 (socket says 172.21.15.81:48654) 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 -- 172.21.15.81:0/1048719122 learned_addr learned my addr 172.21.15.81:0/1048719122 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2d7fff700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2d80b1ae0 0x7fb2d815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dcbc5700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 0x7fb2d815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 -- 172.21.15.81:0/1048719122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 msgr2=0x7fb2d815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 0x7fb2d815e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 -- 172.21.15.81:0/1048719122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2d80b1ae0 msgr2=0x7fb2d815ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2d80b1ae0 0x7fb2d815ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 -- 172.21.15.81:0/1048719122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009570 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2dd3c6700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80cf0e0 0x7fb2d8158320 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000cc80 tx=0x7fb2d000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2d57fa700 1 -- 172.21.15.81:0/1048719122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0003c20 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2d57fa700 1 -- 172.21.15.81:0/1048719122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d0003d80 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d80b60e0 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2d57fa700 1 -- 172.21.15.81:0/1048719122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000aaa0 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d80b1eb0 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.226+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d80d08e0 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.230+0000 7fb2d57fa700 1 -- 172.21.15.81:0/1048719122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb2d0010050 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.230+0000 7fb2d57fa700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2c4064ee0 0x7fb2c4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.230+0000 7fb2d57fa700 1 -- 172.21.15.81:0/1048719122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb2d0081de0 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.230+0000 7fb2dcbc5700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2c4064ee0 0x7fb2c4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.230+0000 7fb2dcbc5700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2c4064ee0 0x7fb2c4067390 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8000c00 tx=0x7fb2c8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.234+0000 7fb2d57fa700 1 -- 172.21.15.81:0/1048719122 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb2d004fe40 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.394+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb2d8158040 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.394+0000 7fb2d57fa700 1 -- 172.21.15.81:0/1048719122 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb2d8158040 con 0x7fb2d80cf0e0 2023-11-29T11:22:25.401 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:22:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2c4064ee0 msgr2=0x7fb2c4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2c4064ee0 0x7fb2c4067390 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8000c00 tx=0x7fb2c8008030 comp rx=0 tx=0).stop 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80cf0e0 msgr2=0x7fb2d8158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80cf0e0 0x7fb2d8158320 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000cc80 tx=0x7fb2d000cf90 comp rx=0 tx=0).stop 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 shutdown_connections 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb2c4064ee0 0x7fb2c4067390 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d80cf0e0 0x7fb2d8158320 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2d80b1ae0 0x7fb2d815ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 --2- 172.21.15.81:0/1048719122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2d806a4c0 0x7fb2d815e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 >> 172.21.15.81:0/1048719122 conn(0x7fb2d809bbd0 msgr2=0x7fb2d80b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 shutdown_connections 2023-11-29T11:22:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.398+0000 7fb2ddbc7700 1 -- 172.21.15.81:0/1048719122 wait complete. 2023-11-29T11:22:25.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:22:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.526+0000 7fe1bd332700 1 Processor -- start 2023-11-29T11:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- start start 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dd280 0x7fe1b0050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1b00dfb70 0x7fe1b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b0052bf0 con 0x7fe1b0036cb0 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00dd650 con 0x7fe1b00dfb70 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0037130 con 0x7fe1b00dd280 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1b00dfb70 0x7fe1b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b77fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1b00dfb70 0x7fe1b0036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48656/0 (socket says 172.21.15.81:48656) 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b77fe700 1 -- 172.21.15.81:0/631853671 learned_addr learned my addr 172.21.15.81:0/631853671 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b7fff700 1 --2- 172.21.15.81:0/631853671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dd280 0x7fe1b0050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b77fe700 1 -- 172.21.15.81:0/631853671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dd280 msgr2=0x7fe1b0050760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b77fe700 1 --2- 172.21.15.81:0/631853671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dd280 0x7fe1b0050760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b77fe700 1 -- 172.21.15.81:0/631853671 >> v1:172.21.15.176:6789/0 conn(0x7fe1b0036cb0 legacy=0x7fe1b00e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b77fe700 1 -- 172.21.15.81:0/631853671 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00528c0 con 0x7fe1b00dfb70 2023-11-29T11:22:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b77fe700 1 --2- 172.21.15.81:0/631853671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dfb70 0x7fe1b0036770 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00bbb0 tx=0x7fe1ac00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caac5bd1c8d21f70 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b6ffd700 1 -- 172.21.15.81:0/631853671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00dd30 con 0x7fe1b00dfb70 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b6ffd700 1 -- 172.21.15.81:0/631853671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac00de90 con 0x7fe1b00dfb70 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1b6ffd700 1 -- 172.21.15.81:0/631853671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac010690 con 0x7fe1b00dfb70 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- 172.21.15.81:0/631853671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dfb70 msgr2=0x7fe1b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 --2- 172.21.15.81:0/631853671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dfb70 0x7fe1b0036770 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00bbb0 tx=0x7fe1ac00bec0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- 172.21.15.81:0/631853671 shutdown_connections 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 --2- 172.21.15.81:0/631853671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dfb70 0x7fe1b0036770 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 --2- 172.21.15.81:0/631853671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dd280 0x7fe1b0050760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- 172.21.15.81:0/631853671 >> 172.21.15.81:0/631853671 conn(0x7fe1b0051770 msgr2=0x7fe1b0051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- 172.21.15.81:0/631853671 shutdown_connections 2023-11-29T11:22:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.530+0000 7fe1bd332700 1 -- 172.21.15.81:0/631853671 wait complete. 2023-11-29T11:22:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bd332700 1 Processor -- start 2023-11-29T11:22:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bd332700 1 -- start start 2023-11-29T11:22:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bd332700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b0036cb0 0x7fe1b00d8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bd332700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dd280 0x7fe1b0179040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bd332700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dfb70 0x7fe1b0179780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bd332700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0048930 con 0x7fe1b00dd280 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bd332700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00d92c0 con 0x7fe1b0036cb0 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bd332700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0179580 con 0x7fe1b00dfb70 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dd280 0x7fe1b0179040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dd280 0x7fe1b0179040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48664/0 (socket says 172.21.15.81:48664) 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 -- 172.21.15.81:0/1885582800 learned_addr learned my addr 172.21.15.81:0/1885582800 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b7fff700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b0036cb0 0x7fe1b00d8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bcb31700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dfb70 0x7fe1b0179780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 -- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dfb70 msgr2=0x7fe1b0179780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dfb70 0x7fe1b0179780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 -- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b0036cb0 msgr2=0x7fe1b00d8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b0036cb0 0x7fe1b00d8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 -- 172.21.15.81:0/1885582800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac00b810 con 0x7fe1b00dd280 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b7fff700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b0036cb0 0x7fe1b00d8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1bcb31700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dfb70 0x7fe1b0179780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.534+0000 7fe1b77fe700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dd280 0x7fe1b0179040 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000bf50 tx=0x7fe1ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1b4ff9700 1 -- 172.21.15.81:0/1885582800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac003c10 con 0x7fe1b00dd280 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b00e0710 con 0x7fe1b00dd280 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1b4ff9700 1 -- 172.21.15.81:0/1885582800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac003d70 con 0x7fe1b00dd280 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1b4ff9700 1 -- 172.21.15.81:0/1885582800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac0106b0 con 0x7fe1b00dd280 2023-11-29T11:22:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b00e0430 con 0x7fe1b00dd280 2023-11-29T11:22:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1b4ff9700 1 -- 172.21.15.81:0/1885582800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe1ac02c440 con 0x7fe1b00dd280 2023-11-29T11:22:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b00e09f0 con 0x7fe1b00dd280 2023-11-29T11:22:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1b4ff9700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe19c064ee0 0x7fe19c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1b4ff9700 1 -- 172.21.15.81:0/1885582800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe1ac083ba0 con 0x7fe1b00dd280 2023-11-29T11:22:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1b7fff700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe19c064ee0 0x7fe19c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.538+0000 7fe1b7fff700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe19c064ee0 0x7fe19c067390 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe1b003a150 tx=0x7fe1a4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.546+0000 7fe1b4ff9700 1 -- 172.21.15.81:0/1885582800 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe1ac051a30 con 0x7fe1b00dd280 2023-11-29T11:22:25.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.710+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1b0005570 con 0x7fe1b00dd280 2023-11-29T11:22:25.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1b4ff9700 1 -- 172.21.15.81:0/1885582800 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1ac02a310 con 0x7fe1b00dd280 2023-11-29T11:22:25.719 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:22:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe19c064ee0 msgr2=0x7fe19c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe19c064ee0 0x7fe19c067390 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe1b003a150 tx=0x7fe1a4009240 comp rx=0 tx=0).stop 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dd280 msgr2=0x7fe1b0179040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dd280 0x7fe1b0179040 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000bf50 tx=0x7fe1ac004770 comp rx=0 tx=0).stop 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 shutdown_connections 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe19c064ee0 0x7fe19c067390 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b00dfb70 0x7fe1b0179780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1b00dd280 0x7fe1b0179040 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 --2- 172.21.15.81:0/1885582800 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b0036cb0 0x7fe1b00d8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 >> 172.21.15.81:0/1885582800 conn(0x7fe1b0051770 msgr2=0x7fe1b00df170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 shutdown_connections 2023-11-29T11:22:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.714+0000 7fe1bd332700 1 -- 172.21.15.81:0/1885582800 wait complete. 2023-11-29T11:22:25.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:22:25.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f099ce8c700 1 Processor -- start 2023-11-29T11:22:25.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f099ce8c700 1 -- start start 2023-11-29T11:22:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f099ce8c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f09980d1e30 0x7f09980b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f099ce8c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980d0460 con 0x7f09980cf110 2023-11-29T11:22:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f099ce8c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980d2380 con 0x7f099806ce60 2023-11-29T11:22:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f099ce8c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980d3390 con 0x7f09980d1e30 2023-11-29T11:22:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f0997fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f09980cf110 0x7f09980cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37556/0 (socket says 172.21.15.81:37556) 2023-11-29T11:22:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f0997fff700 1 -- 172.21.15.81:0/2553057862 learned_addr learned my addr 172.21.15.81:0/2553057862 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f0996ffd700 1 --2- 172.21.15.81:0/2553057862 >> v2:172.21.15.176:3300/0 conn(0x7f09980d1e30 0x7f09980b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139901117 0 0) 0x7f09980d0460 con 0x7f09980cf110 2023-11-29T11:22:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09800035d0 con 0x7f09980cf110 2023-11-29T11:22:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757092201 0 0) 0x7f09800035d0 con 0x7f09980cf110 2023-11-29T11:22:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 >> v2:172.21.15.176:3300/0 conn(0x7f09980d1e30 msgr2=0x7f09980b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 --2- 172.21.15.81:0/2553057862 >> v2:172.21.15.176:3300/0 conn(0x7f09980d1e30 0x7f09980b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 >> v1:172.21.15.176:6789/0 conn(0x7f099806ce60 legacy=0x7f099806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980d2f00 con 0x7f09980cf110 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f09900019f0 con 0x7f09980cf110 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.842+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 >> v1:172.21.15.81:6789/0 conn(0x7f09980cf110 legacy=0x7f09980cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0980003a20 0x7f0980003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0980004870 0x7f0980004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980005220 0x7f098000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980d3390 con 0x7f0980004870 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098000c0a0 con 0x7f0980005220 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098000c260 con 0x7f0980003a20 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0996ffd700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0980004870 0x7f0980004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09977fe700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0980003a20 0x7f0980003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0997fff700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980005220 0x7f098000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0996ffd700 1 -- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0980003a20 msgr2=0x7f0980003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0996ffd700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0980003a20 0x7f0980003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0996ffd700 1 -- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980005220 msgr2=0x7f098000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0996ffd700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980005220 0x7f098000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0996ffd700 1 -- 172.21.15.81:0/2553057862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800035d0 con 0x7f0980004870 2023-11-29T11:22:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0997fff700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980005220 0x7f098000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0997fff700 1 -- 172.21.15.81:0/2553057862 reap_dead start 2023-11-29T11:22:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f0996ffd700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0980004870 0x7f0980004ce0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f098c009b70 tx=0x7f09800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2eafa41362c24c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00e6c0 con 0x7f0980004870 2023-11-29T11:22:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00e820 con 0x7f0980004870 2023-11-29T11:22:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f09967fc700 1 -- 172.21.15.81:0/2553057862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00eb90 con 0x7f0980004870 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f099ce8c700 1 -- 172.21.15.81:0/2553057862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0980004870 msgr2=0x7f0980004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f099ce8c700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0980004870 0x7f0980004ce0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f098c009b70 tx=0x7f09800058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f099ce8c700 1 -- 172.21.15.81:0/2553057862 shutdown_connections 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f099ce8c700 1 --2- 172.21.15.81:0/2553057862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0980004870 0x7f0980004ce0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f099ce8c700 1 -- 172.21.15.81:0/2553057862 >> 172.21.15.81:0/2553057862 conn(0x7f099809bbd0 msgr2=0x7f09980b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f099ce8c700 1 -- 172.21.15.81:0/2553057862 shutdown_connections 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.846+0000 7f099ce8c700 1 -- 172.21.15.81:0/2553057862 wait complete. 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 Processor -- start 2023-11-29T11:22:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 -- start start 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980004870 0x7f099814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f099815c920 0x7f099815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09980b0410 0x7f09980b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099815d980 con 0x7f099815c920 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980b0dc0 con 0x7f0980004870 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099815d3c0 con 0x7f09980b0410 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f0996ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f099815c920 0x7f099815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f09977fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980004870 0x7f099814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f09977fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980004870 0x7f099814f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58814/0 (socket says 172.21.15.81:58814) 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f09977fe700 1 -- 172.21.15.81:0/2383353436 learned_addr learned my addr 172.21.15.81:0/2383353436 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:25.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f0997fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09980b0410 0x7f09980b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f0996ffd700 1 -- 172.21.15.81:0/2383353436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09980b0410 msgr2=0x7f09980b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f0996ffd700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09980b0410 0x7f09980b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f0996ffd700 1 -- 172.21.15.81:0/2383353436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980004870 msgr2=0x7f099814f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:25.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f0996ffd700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980004870 0x7f099814f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f0996ffd700 1 -- 172.21.15.81:0/2383353436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980d25d0 con 0x7f099815c920 2023-11-29T11:22:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f0996ffd700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f099815c920 0x7f099815cd90 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f098c019000 tx=0x7f098c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f097ffff700 1 -- 172.21.15.81:0/2383353436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00e6c0 con 0x7f099815c920 2023-11-29T11:22:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f097ffff700 1 -- 172.21.15.81:0/2383353436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c0038e0 con 0x7f099815c920 2023-11-29T11:22:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099815c700 con 0x7f099815c920 2023-11-29T11:22:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f097ffff700 1 -- 172.21.15.81:0/2383353436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c003c90 con 0x7f099815c920 2023-11-29T11:22:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.850+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09980d28b0 con 0x7f099815c920 2023-11-29T11:22:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.854+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099815d8e0 con 0x7f099815c920 2023-11-29T11:22:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.854+0000 7f097ffff700 1 -- 172.21.15.81:0/2383353436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f098c019030 con 0x7f099815c920 2023-11-29T11:22:25.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.854+0000 7f097ffff700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0984064f10 0x7f09840673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:25.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.854+0000 7f097ffff700 1 -- 172.21.15.81:0/2383353436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f098c082f00 con 0x7f099815c920 2023-11-29T11:22:25.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.854+0000 7f09977fe700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0984064f10 0x7f09840673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:25.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.854+0000 7f09977fe700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0984064f10 0x7f09840673c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0988001050 tx=0x7f0988009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:25.862+0000 7f097ffff700 1 -- 172.21.15.81:0/2383353436 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f098c050f30 con 0x7f099815c920 2023-11-29T11:22:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.026+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0998072500 con 0x7f099815c920 2023-11-29T11:22:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.026+0000 7f097ffff700 1 -- 172.21.15.81:0/2383353436 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f098c054550 con 0x7f099815c920 2023-11-29T11:22:26.033 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:22:26.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0984064f10 msgr2=0x7f09840673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0984064f10 0x7f09840673c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0988001050 tx=0x7f0988009040 comp rx=0 tx=0).stop 2023-11-29T11:22:26.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f099815c920 msgr2=0x7f099815cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f099815c920 0x7f099815cd90 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f098c019000 tx=0x7f098c0047e0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 shutdown_connections 2023-11-29T11:22:26.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0984064f10 0x7f09840673c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09980b0410 0x7f09980b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f099815c920 0x7f099815cd90 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 --2- 172.21.15.81:0/2383353436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0980004870 0x7f099814f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 >> 172.21.15.81:0/2383353436 conn(0x7f099809bbd0 msgr2=0x7f099806ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:26.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 shutdown_connections 2023-11-29T11:22:26.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.030+0000 7f099ce8c700 1 -- 172.21.15.81:0/2383353436 wait complete. 2023-11-29T11:22:26.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:22:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.154+0000 7f21eb34b700 1 Processor -- start 2023-11-29T11:22:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.154+0000 7f21eb34b700 1 -- start start 2023-11-29T11:22:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f21e406a4c0 0x7f21e406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e40cfa80 con 0x7f21e40b1ae0 2023-11-29T11:22:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e40d0ab0 con 0x7f21e406a4c0 2023-11-29T11:22:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e406a9c0 con 0x7f21e40cf0e0 2023-11-29T11:22:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21ea349700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f21e40b1ae0 0x7f21e40d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37562/0 (socket says 172.21.15.81:37562) 2023-11-29T11:22:26.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21ea349700 1 -- 172.21.15.81:0/480267144 learned_addr learned my addr 172.21.15.81:0/480267144 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:26.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9b48700 1 --2- 172.21.15.81:0/480267144 >> v2:172.21.15.176:3300/0 conn(0x7f21e406a4c0 0x7f21e406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eab4a700 1 --2- 172.21.15.81:0/480267144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9347700 1 -- 172.21.15.81:0/480267144 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384733141 0 0) 0x7f21e40cfa80 con 0x7f21e40b1ae0 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9347700 1 -- 172.21.15.81:0/480267144 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d00035d0 con 0x7f21e40b1ae0 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9b48700 1 -- 172.21.15.81:0/480267144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 msgr2=0x7f21e40cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9b48700 1 --2- 172.21.15.81:0/480267144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9b48700 1 -- 172.21.15.81:0/480267144 >> v1:172.21.15.81:6789/0 conn(0x7f21e40b1ae0 legacy=0x7f21e40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9b48700 1 -- 172.21.15.81:0/480267144 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e406aca0 con 0x7f21e406a4c0 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9b48700 1 --2- 172.21.15.81:0/480267144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e406a4c0 0x7f21e406d8e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009850 tx=0x7f21e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac2d1dbfdb46974d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9347700 1 -- 172.21.15.81:0/480267144 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0011830 con 0x7f21e406a4c0 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9347700 1 -- 172.21.15.81:0/480267144 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0011990 con 0x7f21e406a4c0 2023-11-29T11:22:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21e9347700 1 -- 172.21.15.81:0/480267144 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0011d00 con 0x7f21e406a4c0 2023-11-29T11:22:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 -- 172.21.15.81:0/480267144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e406a4c0 msgr2=0x7f21e406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 --2- 172.21.15.81:0/480267144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e406a4c0 0x7f21e406d8e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009850 tx=0x7f21e0009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 -- 172.21.15.81:0/480267144 shutdown_connections 2023-11-29T11:22:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 --2- 172.21.15.81:0/480267144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 --2- 172.21.15.81:0/480267144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e406a4c0 0x7f21e406d8e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 -- 172.21.15.81:0/480267144 >> 172.21.15.81:0/480267144 conn(0x7f21e409bbd0 msgr2=0x7f21e40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.158+0000 7f21eb34b700 1 -- 172.21.15.81:0/480267144 shutdown_connections 2023-11-29T11:22:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 -- 172.21.15.81:0/480267144 wait complete. 2023-11-29T11:22:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 Processor -- start 2023-11-29T11:22:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 -- start start 2023-11-29T11:22:26.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e406a4c0 0x7f21e4159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e40b1ae0 0x7f21e4154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e415f810 con 0x7f21e406a4c0 2023-11-29T11:22:26.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e415b5c0 con 0x7f21e40b1ae0 2023-11-29T11:22:26.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eb34b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e41598f0 con 0x7f21e40cf0e0 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21ea349700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e406a4c0 0x7f21e4159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21ea349700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e406a4c0 0x7f21e4159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48680/0 (socket says 172.21.15.81:48680) 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21ea349700 1 -- 172.21.15.81:0/2847999470 learned_addr learned my addr 172.21.15.81:0/2847999470 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eab4a700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21e9b48700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e40b1ae0 0x7f21e4154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21ea349700 1 -- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 msgr2=0x7f21e40b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21ea349700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21ea349700 1 -- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e40b1ae0 msgr2=0x7f21e4154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21ea349700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e40b1ae0 0x7f21e4154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21ea349700 1 -- 172.21.15.81:0/2847999470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00094b0 con 0x7f21e406a4c0 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21e9b48700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e40b1ae0 0x7f21e4154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.162+0000 7f21eab4a700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21ea349700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e406a4c0 0x7f21e4159b20 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f21d400c4f0 tx=0x7f21d400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21daffd700 1 -- 172.21.15.81:0/2847999470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4005d90 con 0x7f21e406a4c0 2023-11-29T11:22:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21daffd700 1 -- 172.21.15.81:0/2847999470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d40070d0 con 0x7f21e406a4c0 2023-11-29T11:22:26.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e40b4380 con 0x7f21e406a4c0 2023-11-29T11:22:26.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21daffd700 1 -- 172.21.15.81:0/2847999470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4007440 con 0x7f21e406a4c0 2023-11-29T11:22:26.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e406af80 con 0x7f21e406a4c0 2023-11-29T11:22:26.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e40b1eb0 con 0x7f21e406a4c0 2023-11-29T11:22:26.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21daffd700 1 -- 172.21.15.81:0/2847999470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f21d4019030 con 0x7f21e406a4c0 2023-11-29T11:22:26.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21daffd700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f21c8064ee0 0x7f21c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21daffd700 1 -- 172.21.15.81:0/2847999470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f21d4081330 con 0x7f21e406a4c0 2023-11-29T11:22:26.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21e9b48700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f21c8064ee0 0x7f21c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.174 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.166+0000 7f21e9b48700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f21c8064ee0 0x7f21c8067390 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f21e00090b0 tx=0x7f21e001c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.174+0000 7f21daffd700 1 -- 172.21.15.81:0/2847999470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f21d404a400 con 0x7f21e406a4c0 2023-11-29T11:22:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.330+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21e4072500 con 0x7f21e406a4c0 2023-11-29T11:22:26.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21daffd700 1 -- 172.21.15.81:0/2847999470 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21d4017020 con 0x7f21e406a4c0 2023-11-29T11:22:26.339 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f21c8064ee0 msgr2=0x7f21c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f21c8064ee0 0x7f21c8067390 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f21e00090b0 tx=0x7f21e001c040 comp rx=0 tx=0).stop 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e406a4c0 msgr2=0x7f21e4159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e406a4c0 0x7f21e4159b20 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f21d400c4f0 tx=0x7f21d400c8b0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 shutdown_connections 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f21c8064ee0 0x7f21c8067390 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21e40cf0e0 0x7f21e40b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21e40b1ae0 0x7f21e4154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 --2- 172.21.15.81:0/2847999470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e406a4c0 0x7f21e4159b20 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.334+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 >> 172.21.15.81:0/2847999470 conn(0x7f21e409bbd0 msgr2=0x7f21e415bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:26.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.338+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 shutdown_connections 2023-11-29T11:22:26.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.338+0000 7f21eb34b700 1 -- 172.21.15.81:0/2847999470 wait complete. 2023-11-29T11:22:26.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:22:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.466+0000 7f048650c700 1 Processor -- start 2023-11-29T11:22:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.466+0000 7f048650c700 1 -- start start 2023-11-29T11:22:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04800c2a30 0x7f0480164c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2e00 0x7f04800ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04800cf260 0x7f04800b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0480160b60 con 0x7f04800c2a30 2023-11-29T11:22:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0480165140 con 0x7f04800cf260 2023-11-29T11:22:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04800ce890 con 0x7f04800c2e00 2023-11-29T11:22:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04800c2a30 0x7f0480164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f0484aa9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04800cf260 0x7f04800b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047f7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2e00 0x7f04800ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04800c2a30 0x7f0480164c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48692/0 (socket says 172.21.15.81:48692) 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f0484aa9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04800cf260 0x7f04800b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58838/0 (socket says 172.21.15.81:58838) 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047f7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2e00 0x7f04800ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:36752/0 (socket says 172.21.15.81:36752) 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 -- 172.21.15.81:0/3150320754 learned_addr learned my addr 172.21.15.81:0/3150320754 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 -- 172.21.15.81:0/3150320754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2e00 msgr2=0x7f04800ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 --2- 172.21.15.81:0/3150320754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2e00 0x7f04800ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 -- 172.21.15.81:0/3150320754 >> v2:172.21.15.176:3300/0 conn(0x7f04800cf260 msgr2=0x7f04800b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 --2- 172.21.15.81:0/3150320754 >> v2:172.21.15.176:3300/0 conn(0x7f04800cf260 0x7f04800b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 -- 172.21.15.81:0/3150320754 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800cdc80 con 0x7f04800c2a30 2023-11-29T11:22:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047ffff700 1 --2- 172.21.15.81:0/3150320754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800c2a30 0x7f0480164c00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f0480069d60 tx=0x7f0470009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804919b77d4c6307 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047effd700 1 -- 172.21.15.81:0/3150320754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011830 con 0x7f04800c2a30 2023-11-29T11:22:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047effd700 1 -- 172.21.15.81:0/3150320754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470011990 con 0x7f04800c2a30 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f047effd700 1 -- 172.21.15.81:0/3150320754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011d20 con 0x7f04800c2a30 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 -- 172.21.15.81:0/3150320754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800c2a30 msgr2=0x7f0480164c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 --2- 172.21.15.81:0/3150320754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800c2a30 0x7f0480164c00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f0480069d60 tx=0x7f0470009bf0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 -- 172.21.15.81:0/3150320754 shutdown_connections 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 --2- 172.21.15.81:0/3150320754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2e00 0x7f04800ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 --2- 172.21.15.81:0/3150320754 >> v2:172.21.15.176:3300/0 conn(0x7f04800cf260 0x7f04800b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 --2- 172.21.15.81:0/3150320754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800c2a30 0x7f0480164c00 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.470+0000 7f048650c700 1 -- 172.21.15.81:0/3150320754 >> 172.21.15.81:0/3150320754 conn(0x7f04800cc260 msgr2=0x7f04800cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.474+0000 7f048650c700 1 -- 172.21.15.81:0/3150320754 shutdown_connections 2023-11-29T11:22:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.474+0000 7f048650c700 1 -- 172.21.15.81:0/3150320754 wait complete. 2023-11-29T11:22:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.474+0000 7f048650c700 1 Processor -- start 2023-11-29T11:22:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.474+0000 7f048650c700 1 -- start start 2023-11-29T11:22:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2a30 0x7f04800b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04800c2e00 0x7f04800c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800cf260 0x7f04801f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0480161d20 con 0x7f04800cf260 2023-11-29T11:22:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0480162580 con 0x7f04800c2e00 2023-11-29T11:22:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04800b4780 con 0x7f04800c2a30 2023-11-29T11:22:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800cf260 0x7f04801f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800cf260 0x7f04801f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48694/0 (socket says 172.21.15.81:48694) 2023-11-29T11:22:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 -- 172.21.15.81:0/1595858618 learned_addr learned my addr 172.21.15.81:0/1595858618 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f047f7fe700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04800c2e00 0x7f04800c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f047ffff700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2a30 0x7f04800b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 -- 172.21.15.81:0/1595858618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2a30 msgr2=0x7f04800b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2a30 0x7f04800b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 -- 172.21.15.81:0/1595858618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04800c2e00 msgr2=0x7f04800c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04800c2e00 0x7f04800c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 -- 172.21.15.81:0/1595858618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470009570 con 0x7f04800cf260 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f0484aa9700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800cf260 0x7f04801f5670 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f047800efc0 tx=0x7f047800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f047cff9700 1 -- 172.21.15.81:0/1595858618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047800cad0 con 0x7f04800cf260 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f047cff9700 1 -- 172.21.15.81:0/1595858618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047800f040 con 0x7f04800cf260 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04800ce240 con 0x7f04800cf260 2023-11-29T11:22:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f047cff9700 1 -- 172.21.15.81:0/1595858618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047800ce70 con 0x7f04800cf260 2023-11-29T11:22:26.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04800cdf60 con 0x7f04800cf260 2023-11-29T11:22:26.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.478+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04800ce520 con 0x7f04800cf260 2023-11-29T11:22:26.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.482+0000 7f047cff9700 1 -- 172.21.15.81:0/1595858618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0478014480 con 0x7f04800cf260 2023-11-29T11:22:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.482+0000 7f047cff9700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0464064ee0 0x7f0464067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.482+0000 7f047cff9700 1 -- 172.21.15.81:0/1595858618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f04780827d0 con 0x7f04800cf260 2023-11-29T11:22:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.482+0000 7f047ffff700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0464064ee0 0x7f0464067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.482+0000 7f047ffff700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0464064ee0 0x7f0464067390 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0470000c00 tx=0x7f0470008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.486+0000 7f047cff9700 1 -- 172.21.15.81:0/1595858618 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f04780507d0 con 0x7f04800cf260 2023-11-29T11:22:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.658+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0480162730 con 0x7f04800cf260 2023-11-29T11:22:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.658+0000 7f047cff9700 1 -- 172.21.15.81:0/1595858618 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0480162730 con 0x7f04800cf260 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0464064ee0 msgr2=0x7f0464067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0464064ee0 0x7f0464067390 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0470000c00 tx=0x7f0470008030 comp rx=0 tx=0).stop 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800cf260 msgr2=0x7f04801f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800cf260 0x7f04801f5670 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f047800efc0 tx=0x7f047800c0c0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 shutdown_connections 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0464064ee0 0x7f0464067390 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04800cf260 0x7f04801f5670 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04800c2e00 0x7f04800c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 --2- 172.21.15.81:0/1595858618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04800c2a30 0x7f04800b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 >> 172.21.15.81:0/1595858618 conn(0x7f04800cc260 msgr2=0x7f048006bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 shutdown_connections 2023-11-29T11:22:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.662+0000 7f048650c700 1 -- 172.21.15.81:0/1595858618 wait complete. 2023-11-29T11:22:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:22:26.680 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:26.680 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:26.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:26.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.786+0000 7feb29c60700 1 Processor -- start 2023-11-29T11:22:26.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.786+0000 7feb29c60700 1 -- start start 2023-11-29T11:22:26.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feb2413cef0 0x7feb2415b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2415e1a0 0x7feb2406ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2406cfd0 con 0x7feb2406c640 2023-11-29T11:22:26.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2415e9f0 con 0x7feb2413cef0 2023-11-29T11:22:26.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2415e710 con 0x7feb2415e1a0 2023-11-29T11:22:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb28c5e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feb2413cef0 0x7feb2415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb2945f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2415e1a0 0x7feb2406ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb1bfff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7feb2406c640 0x7feb2415da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:47364/0 (socket says 172.21.15.81:47364) 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb1bfff700 1 -- 172.21.15.81:0/3324391696 learned_addr learned my addr 172.21.15.81:0/3324391696 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb1b7fe700 1 -- 172.21.15.81:0/3324391696 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915370788 0 0) 0x7feb14001110 con 0x7feb2406c640 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb1b7fe700 1 -- 172.21.15.81:0/3324391696 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb0c0035d0 con 0x7feb2406c640 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb2945f700 1 -- 172.21.15.81:0/3324391696 >> v2:172.21.15.176:3300/0 conn(0x7feb2413cef0 msgr2=0x7feb2415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb2945f700 1 --2- 172.21.15.81:0/3324391696 >> v2:172.21.15.176:3300/0 conn(0x7feb2413cef0 0x7feb2415b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb2945f700 1 -- 172.21.15.81:0/3324391696 >> v1:172.21.15.176:6789/0 conn(0x7feb2406c640 legacy=0x7feb2415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb2945f700 1 -- 172.21.15.81:0/3324391696 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2415a620 con 0x7feb2415e1a0 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb2945f700 1 --2- 172.21.15.81:0/3324391696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2415e1a0 0x7feb2406ca90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009d90 tx=0x7feb1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc866a07871fef5c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb1b7fe700 1 -- 172.21.15.81:0/3324391696 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00e070 con 0x7feb2415e1a0 2023-11-29T11:22:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb1b7fe700 1 -- 172.21.15.81:0/3324391696 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c00bb20 con 0x7feb2415e1a0 2023-11-29T11:22:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb1b7fe700 1 -- 172.21.15.81:0/3324391696 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00be90 con 0x7feb2415e1a0 2023-11-29T11:22:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 -- 172.21.15.81:0/3324391696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2415e1a0 msgr2=0x7feb2406ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 --2- 172.21.15.81:0/3324391696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2415e1a0 0x7feb2406ca90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009d90 tx=0x7feb1c00b330 comp rx=0 tx=0).stop 2023-11-29T11:22:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 -- 172.21.15.81:0/3324391696 shutdown_connections 2023-11-29T11:22:26.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 --2- 172.21.15.81:0/3324391696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2415e1a0 0x7feb2406ca90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 --2- 172.21.15.81:0/3324391696 >> v2:172.21.15.176:3300/0 conn(0x7feb2413cef0 0x7feb2415b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 -- 172.21.15.81:0/3324391696 >> 172.21.15.81:0/3324391696 conn(0x7feb2406e000 msgr2=0x7feb240b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:26.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 -- 172.21.15.81:0/3324391696 shutdown_connections 2023-11-29T11:22:26.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.790+0000 7feb29c60700 1 -- 172.21.15.81:0/3324391696 wait complete. 2023-11-29T11:22:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb29c60700 1 Processor -- start 2023-11-29T11:22:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb29c60700 1 -- start start 2023-11-29T11:22:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb29c60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2406c640 0x7feb240b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb29c60700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2413cef0 0x7feb24141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb29c60700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb2415e1a0 0x7feb241f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb29c60700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb24142420 con 0x7feb2406c640 2023-11-29T11:22:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb29c60700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb24155710 con 0x7feb2415e1a0 2023-11-29T11:22:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb29c60700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb24142650 con 0x7feb2413cef0 2023-11-29T11:22:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb28c5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2406c640 0x7feb240b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb28c5e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2406c640 0x7feb240b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48700/0 (socket says 172.21.15.81:48700) 2023-11-29T11:22:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb28c5e700 1 -- 172.21.15.81:0/2201044081 learned_addr learned my addr 172.21.15.81:0/2201044081 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb2945f700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb2415e1a0 0x7feb241f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.794+0000 7feb1bfff700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2413cef0 0x7feb24141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb28c5e700 1 -- 172.21.15.81:0/2201044081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2413cef0 msgr2=0x7feb24141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb28c5e700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2413cef0 0x7feb24141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb28c5e700 1 -- 172.21.15.81:0/2201044081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb2415e1a0 msgr2=0x7feb241f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb28c5e700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb2415e1a0 0x7feb241f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb28c5e700 1 -- 172.21.15.81:0/2201044081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c009a70 con 0x7feb2406c640 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb28c5e700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2406c640 0x7feb240b3d70 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7feb2000e9d0 tx=0x7feb2000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb197fa700 1 -- 172.21.15.81:0/2201044081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20009720 con 0x7feb2406c640 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb197fa700 1 -- 172.21.15.81:0/2201044081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2000ee70 con 0x7feb2406c640 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2415abe0 con 0x7feb2406c640 2023-11-29T11:22:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb197fa700 1 -- 172.21.15.81:0/2201044081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2000ca50 con 0x7feb2406c640 2023-11-29T11:22:26.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2415a900 con 0x7feb2406c640 2023-11-29T11:22:26.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.798+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2413d2c0 con 0x7feb2406c640 2023-11-29T11:22:26.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.802+0000 7feb197fa700 1 -- 172.21.15.81:0/2201044081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb20019030 con 0x7feb2406c640 2023-11-29T11:22:26.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.802+0000 7feb197fa700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb10064ee0 0x7feb10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:26.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.802+0000 7feb197fa700 1 -- 172.21.15.81:0/2201044081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feb20081f80 con 0x7feb2406c640 2023-11-29T11:22:26.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.802+0000 7feb1bfff700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb10064ee0 0x7feb10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:26.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.802+0000 7feb1bfff700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb10064ee0 0x7feb10067390 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feb240b1490 tx=0x7feb14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:26.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.810+0000 7feb197fa700 1 -- 172.21.15.81:0/2201044081 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb2004ff00 con 0x7feb2406c640 2023-11-29T11:22:26.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.970+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb24072c20 con 0x7feb2406c640 2023-11-29T11:22:26.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:22:26.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.974+0000 7feb197fa700 1 -- 172.21.15.81:0/2201044081 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17988 (secure 0 0 0) 0x7feb20053520 con 0x7feb2406c640 2023-11-29T11:22:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:26.981 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":110,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:22:18.573529+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:26.983 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb10064ee0 msgr2=0x7feb10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb10064ee0 0x7feb10067390 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feb240b1490 tx=0x7feb14009040 comp rx=0 tx=0).stop 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2406c640 msgr2=0x7feb240b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2406c640 0x7feb240b3d70 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7feb2000e9d0 tx=0x7feb2000ece0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 shutdown_connections 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7feb10064ee0 0x7feb10067390 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb2415e1a0 0x7feb241f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb2413cef0 0x7feb24141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 --2- 172.21.15.81:0/2201044081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb2406c640 0x7feb240b3d70 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 >> 172.21.15.81:0/2201044081 conn(0x7feb2406e000 msgr2=0x7feb240b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:26.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 shutdown_connections 2023-11-29T11:22:26.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:26.978+0000 7feb29c60700 1 -- 172.21.15.81:0/2201044081 wait complete. 2023-11-29T11:22:26.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:22:15.796341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:22:16.553603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:22:26.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:22:27.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.106+0000 7fad18ace700 1 Processor -- start 2023-11-29T11:22:27.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.106+0000 7fad18ace700 1 -- start start 2023-11-29T11:22:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad18ace700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fad14158480 0x7fad140cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad18ace700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad140c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad18ace700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1406a4d0 con 0x7fad140cd3a0 2023-11-29T11:22:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad18ace700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad140cc1f0 con 0x7fad14158480 2023-11-29T11:22:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad18ace700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad140cc490 con 0x7fad14158850 2023-11-29T11:22:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad137fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fad14158480 0x7fad140cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad0bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad140c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad0bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad140c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:36784/0 (socket says 172.21.15.81:36784) 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad13fff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fad140cd3a0 0x7fad140ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:47380/0 (socket says 172.21.15.81:47380) 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad0bfff700 1 -- 172.21.15.81:0/650920135 learned_addr learned my addr 172.21.15.81:0/650920135 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad137fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fad14158480 0x7fad140cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58856/0 (socket says 172.21.15.81:58856) 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad137fe700 1 -- 172.21.15.81:0/650920135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 msgr2=0x7fad140c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad137fe700 1 --2- 172.21.15.81:0/650920135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad140c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad137fe700 1 -- 172.21.15.81:0/650920135 >> v1:172.21.15.176:6789/0 conn(0x7fad140cd3a0 legacy=0x7fad140ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad137fe700 1 -- 172.21.15.81:0/650920135 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1406a720 con 0x7fad14158480 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad0bfff700 1 --2- 172.21.15.81:0/650920135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad140c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad12ffd700 1 -- 172.21.15.81:0/650920135 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717243357 0 0) 0x7fad1406a4d0 con 0x7fad140cd3a0 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad137fe700 1 --2- 172.21.15.81:0/650920135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad14158480 0x7fad140cbcb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fad04009840 tx=0x7fad04009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31fef6b3ebf2229d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.110+0000 7fad12ffd700 1 -- 172.21.15.81:0/650920135 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04005e50 con 0x7fad14158480 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad12ffd700 1 -- 172.21.15.81:0/650920135 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad04006030 con 0x7fad14158480 2023-11-29T11:22:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad12ffd700 1 -- 172.21.15.81:0/650920135 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040063c0 con 0x7fad14158480 2023-11-29T11:22:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- 172.21.15.81:0/650920135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad14158480 msgr2=0x7fad140cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 --2- 172.21.15.81:0/650920135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad14158480 0x7fad140cbcb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fad04009840 tx=0x7fad04009b50 comp rx=0 tx=0).stop 2023-11-29T11:22:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- 172.21.15.81:0/650920135 shutdown_connections 2023-11-29T11:22:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 --2- 172.21.15.81:0/650920135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad140c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 --2- 172.21.15.81:0/650920135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad14158480 0x7fad140cbcb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- 172.21.15.81:0/650920135 >> 172.21.15.81:0/650920135 conn(0x7fad1406c660 msgr2=0x7fad1406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- 172.21.15.81:0/650920135 shutdown_connections 2023-11-29T11:22:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- 172.21.15.81:0/650920135 wait complete. 2023-11-29T11:22:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 Processor -- start 2023-11-29T11:22:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- start start 2023-11-29T11:22:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140cd3a0 0x7fad140b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14158480 0x7fad14148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad141467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14149bb0 con 0x7fad14158480 2023-11-29T11:22:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14149030 con 0x7fad140cd3a0 2023-11-29T11:22:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad18ace700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad14149310 con 0x7fad14158850 2023-11-29T11:22:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad0bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14158480 0x7fad14148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad0bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14158480 0x7fad14148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48712/0 (socket says 172.21.15.81:48712) 2023-11-29T11:22:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad0bfff700 1 -- 172.21.15.81:0/4087311674 learned_addr learned my addr 172.21.15.81:0/4087311674 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad137fe700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140cd3a0 0x7fad140b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.114+0000 7fad13fff700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad141467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad0bfff700 1 -- 172.21.15.81:0/4087311674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 msgr2=0x7fad141467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad0bfff700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad141467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad0bfff700 1 -- 172.21.15.81:0/4087311674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140cd3a0 msgr2=0x7fad140b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad0bfff700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140cd3a0 0x7fad140b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad0bfff700 1 -- 172.21.15.81:0/4087311674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009570 con 0x7fad14158480 2023-11-29T11:22:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad0bfff700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14158480 0x7fad14148550 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7facfc00e9d0 tx=0x7facfc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad10ff9700 1 -- 172.21.15.81:0/4087311674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00ee70 con 0x7fad14158480 2023-11-29T11:22:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad04009450 con 0x7fad14158480 2023-11-29T11:22:27.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1406ace0 con 0x7fad14158480 2023-11-29T11:22:27.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad10ff9700 1 -- 172.21.15.81:0/4087311674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc005a40 con 0x7fad14158480 2023-11-29T11:22:27.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad10ff9700 1 -- 172.21.15.81:0/4087311674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc005db0 con 0x7fad14158480 2023-11-29T11:22:27.125 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf8005310 con 0x7fad14158480 2023-11-29T11:22:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad10ff9700 1 -- 172.21.15.81:0/4087311674 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7facfc019030 con 0x7fad14158480 2023-11-29T11:22:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad10ff9700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7facf4064ee0 0x7facf4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.118+0000 7fad10ff9700 1 -- 172.21.15.81:0/4087311674 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7facfc081f50 con 0x7fad14158480 2023-11-29T11:22:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.122+0000 7fad137fe700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7facf4064ee0 0x7facf4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.127 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.122+0000 7fad137fe700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7facf4064ee0 0x7facf4067390 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fad04009b90 tx=0x7fad04008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.126+0000 7fad10ff9700 1 -- 172.21.15.81:0/4087311674 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7facfc04fdd0 con 0x7fad14158480 2023-11-29T11:22:27.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7facf8005b40 con 0x7fad14158480 2023-11-29T11:22:27.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad10ff9700 1 -- 172.21.15.81:0/4087311674 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7facfc0533f0 con 0x7fad14158480 2023-11-29T11:22:27.295 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7facf4064ee0 msgr2=0x7facf4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7facf4064ee0 0x7facf4067390 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fad04009b90 tx=0x7fad04008070 comp rx=0 tx=0).stop 2023-11-29T11:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14158480 msgr2=0x7fad14148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14158480 0x7fad14148550 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7facfc00e9d0 tx=0x7facfc00ece0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 shutdown_connections 2023-11-29T11:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7facf4064ee0 0x7facf4067390 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad14158850 0x7fad141467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14158480 0x7fad14148550 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 --2- 172.21.15.81:0/4087311674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad140cd3a0 0x7fad140b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 >> 172.21.15.81:0/4087311674 conn(0x7fad1406c660 msgr2=0x7fad1414af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 shutdown_connections 2023-11-29T11:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.290+0000 7fad18ace700 1 -- 172.21.15.81:0/4087311674 wait complete. 2023-11-29T11:22:27.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:22:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 Processor -- start 2023-11-29T11:22:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 -- start start 2023-11-29T11:22:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f827815bb80 0x7f82780b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780ccd00 con 0x7f827806b370 2023-11-29T11:22:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780b19b0 con 0x7f82780aaf40 2023-11-29T11:22:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780cd510 con 0x7f827815bb80 2023-11-29T11:22:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f8277fff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f827806b370 0x7f827815c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37564/0 (socket says 172.21.15.81:37564) 2023-11-29T11:22:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f8277fff700 1 -- 172.21.15.81:0/2035713277 learned_addr learned my addr 172.21.15.81:0/2035713277 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:27.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82777fe700 1 --2- 172.21.15.81:0/2035713277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f827815bb80 0x7f82780b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82767fc700 1 -- 172.21.15.81:0/2035713277 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248660914 0 0) 0x7f82780ccd00 con 0x7f827806b370 2023-11-29T11:22:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82767fc700 1 -- 172.21.15.81:0/2035713277 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82640035d0 con 0x7f827806b370 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82767fc700 1 -- 172.21.15.81:0/2035713277 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290148868 0 0) 0x7f82780b19b0 con 0x7f82780aaf40 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82767fc700 1 -- 172.21.15.81:0/2035713277 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82780ccd00 con 0x7f82780aaf40 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82777fe700 1 -- 172.21.15.81:0/2035713277 >> v1:172.21.15.176:6789/0 conn(0x7f82780aaf40 legacy=0x7f82780b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82777fe700 1 -- 172.21.15.81:0/2035713277 >> v1:172.21.15.81:6789/0 conn(0x7f827806b370 legacy=0x7f827815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82777fe700 1 -- 172.21.15.81:0/2035713277 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780ccf50 con 0x7f827815bb80 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82777fe700 1 --2- 172.21.15.81:0/2035713277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f827815bb80 0x7f82780b2450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8260009880 tx=0x7f8260009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb78ce73029353bb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82767fc700 1 -- 172.21.15.81:0/2035713277 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260011830 con 0x7f827815bb80 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82767fc700 1 -- 172.21.15.81:0/2035713277 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8260011990 con 0x7f827815bb80 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f82767fc700 1 -- 172.21.15.81:0/2035713277 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260011d20 con 0x7f827815bb80 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 -- 172.21.15.81:0/2035713277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f827815bb80 msgr2=0x7f82780b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 --2- 172.21.15.81:0/2035713277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f827815bb80 0x7f82780b2450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8260009880 tx=0x7f8260009b90 comp rx=0 tx=0).stop 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 -- 172.21.15.81:0/2035713277 shutdown_connections 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 --2- 172.21.15.81:0/2035713277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f827815bb80 0x7f82780b2450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 -- 172.21.15.81:0/2035713277 >> 172.21.15.81:0/2035713277 conn(0x7f82780cae70 msgr2=0x7f82780cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.426+0000 7f827c922700 1 -- 172.21.15.81:0/2035713277 shutdown_connections 2023-11-29T11:22:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 -- 172.21.15.81:0/2035713277 wait complete. 2023-11-29T11:22:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 Processor -- start 2023-11-29T11:22:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 -- start start 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f827806b370 0x7f82781556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780aaf40 0x7f827809b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827815bb80 0x7f82781645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c6600 con 0x7f827815bb80 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c59f0 con 0x7f827806b370 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f827c922700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c5cd0 con 0x7f82780aaf40 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f8277fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827815bb80 0x7f82781645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f82777fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f827806b370 0x7f82781556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f8277fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827815bb80 0x7f82781645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48720/0 (socket says 172.21.15.81:48720) 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f82777fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f827806b370 0x7f82781556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58882/0 (socket says 172.21.15.81:58882) 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.430+0000 7f8277fff700 1 -- 172.21.15.81:0/1592193202 learned_addr learned my addr 172.21.15.81:0/1592193202 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f8276ffd700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780aaf40 0x7f827809b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f8277fff700 1 -- 172.21.15.81:0/1592193202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780aaf40 msgr2=0x7f827809b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f8277fff700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780aaf40 0x7f827809b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f8277fff700 1 -- 172.21.15.81:0/1592193202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f827806b370 msgr2=0x7f82781556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f8277fff700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f827806b370 0x7f82781556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f8277fff700 1 -- 172.21.15.81:0/1592193202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600094b0 con 0x7f827815bb80 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f82777fe700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f827806b370 0x7f82781556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f8277fff700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827815bb80 0x7f82781645a0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f827000c500 tx=0x7f827000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f826ffff700 1 -- 172.21.15.81:0/1592193202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270005d90 con 0x7f827815bb80 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780b1c50 con 0x7f827815bb80 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f826ffff700 1 -- 172.21.15.81:0/1592193202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82700070d0 con 0x7f827815bb80 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780cd230 con 0x7f827815bb80 2023-11-29T11:22:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f826ffff700 1 -- 172.21.15.81:0/1592193202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270007440 con 0x7f827815bb80 2023-11-29T11:22:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.434+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82780b1f30 con 0x7f827815bb80 2023-11-29T11:22:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.438+0000 7f826ffff700 1 -- 172.21.15.81:0/1592193202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8270019030 con 0x7f827815bb80 2023-11-29T11:22:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.438+0000 7f826ffff700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8258064f10 0x7f82580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.438+0000 7f826ffff700 1 -- 172.21.15.81:0/1592193202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8270081190 con 0x7f827815bb80 2023-11-29T11:22:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.438+0000 7f82777fe700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8258064f10 0x7f82580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.438+0000 7f82777fe700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8258064f10 0x7f82580673c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f82600090b0 tx=0x7f826001c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.442+0000 7f826ffff700 1 -- 172.21.15.81:0/1592193202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f827004a400 con 0x7f827815bb80 2023-11-29T11:22:27.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.602+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8278072500 con 0x7f827815bb80 2023-11-29T11:22:27.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f826ffff700 1 -- 172.21.15.81:0/1592193202 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8270017020 con 0x7f827815bb80 2023-11-29T11:22:27.611 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:22:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8258064f10 msgr2=0x7f82580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8258064f10 0x7f82580673c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f82600090b0 tx=0x7f826001c040 comp rx=0 tx=0).stop 2023-11-29T11:22:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827815bb80 msgr2=0x7f82781645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827815bb80 0x7f82781645a0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f827000c500 tx=0x7f827000c810 comp rx=0 tx=0).stop 2023-11-29T11:22:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 shutdown_connections 2023-11-29T11:22:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8258064f10 0x7f82580673c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827815bb80 0x7f82781645a0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82780aaf40 0x7f827809b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 --2- 172.21.15.81:0/1592193202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f827806b370 0x7f82781556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 >> 172.21.15.81:0/1592193202 conn(0x7f82780cae70 msgr2=0x7f82780cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 shutdown_connections 2023-11-29T11:22:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.606+0000 7f827c922700 1 -- 172.21.15.81:0/1592193202 wait complete. 2023-11-29T11:22:27.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:22:27.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7b59e700 1 Processor -- start 2023-11-29T11:22:27.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7b59e700 1 -- start start 2023-11-29T11:22:27.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbd7c09bdb0 0x7fbd7c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7c0b2db0 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c0b3240 con 0x7fbd7c09bdb0 2023-11-29T11:22:27.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c06d840 con 0x7fbd7c0b00e0 2023-11-29T11:22:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7a59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd79d9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbd7c09bdb0 0x7fbd7c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7a59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c15d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:36802/0 (socket says 172.21.15.81:36802) 2023-11-29T11:22:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd79d9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbd7c09bdb0 0x7fbd7c15d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:58898/0 (socket says 172.21.15.81:58898) 2023-11-29T11:22:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7ad9d700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fbd7c0cbb30 0x7fbd7c0ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.81:47402/0 (socket says 172.21.15.81:47402) 2023-11-29T11:22:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.734+0000 7fbd7a59c700 1 -- 172.21.15.81:0/2239135222 learned_addr learned my addr 172.21.15.81:0/2239135222 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd79d9b700 1 -- 172.21.15.81:0/2239135222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 msgr2=0x7fbd7c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd79d9b700 1 --2- 172.21.15.81:0/2239135222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd79d9b700 1 -- 172.21.15.81:0/2239135222 >> v1:172.21.15.176:6789/0 conn(0x7fbd7c0cbb30 legacy=0x7fbd7c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd79d9b700 1 -- 172.21.15.81:0/2239135222 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c06d560 con 0x7fbd7c09bdb0 2023-11-29T11:22:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd79d9b700 1 --2- 172.21.15.81:0/2239135222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 0x7fbd7c15d820 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009850 tx=0x7fbd74009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc9a0635d5b742da server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7959a700 1 -- 172.21.15.81:0/2239135222 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74011830 con 0x7fbd7c09bdb0 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7959a700 1 -- 172.21.15.81:0/2239135222 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd74011990 con 0x7fbd7c09bdb0 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7959a700 1 -- 172.21.15.81:0/2239135222 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74011d40 con 0x7fbd7c09bdb0 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7b59e700 1 -- 172.21.15.81:0/2239135222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 msgr2=0x7fbd7c15d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/2239135222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 0x7fbd7c15d820 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009850 tx=0x7fbd74009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7b59e700 1 -- 172.21.15.81:0/2239135222 shutdown_connections 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/2239135222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 0x7fbd7c15d820 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/2239135222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7b59e700 1 -- 172.21.15.81:0/2239135222 >> 172.21.15.81:0/2239135222 conn(0x7fbd7c0cae70 msgr2=0x7fbd7c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7b59e700 1 -- 172.21.15.81:0/2239135222 shutdown_connections 2023-11-29T11:22:27.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.738+0000 7fbd7b59e700 1 -- 172.21.15.81:0/2239135222 wait complete. 2023-11-29T11:22:27.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 Processor -- start 2023-11-29T11:22:27.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 -- start start 2023-11-29T11:22:27.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 0x7fbd7c156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c0c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c0cbb30 0x7fbd7c0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0c29f0 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0c1510 con 0x7fbd7c09bdb0 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c15cc40 con 0x7fbd7c0b00e0 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c0cbb30 0x7fbd7c0aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c0cbb30 0x7fbd7c0aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48728/0 (socket says 172.21.15.81:48728) 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 -- 172.21.15.81:0/192311162 learned_addr learned my addr 172.21.15.81:0/192311162 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7a59c700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 0x7fbd7c156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd79d9b700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c0c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 -- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 msgr2=0x7fbd7c0c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c0c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 -- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 msgr2=0x7fbd7c156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 0x7fbd7c156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 -- 172.21.15.81:0/192311162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740094b0 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd79d9b700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c0c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7ad9d700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c0cbb30 0x7fbd7c0aaf40 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00cbf0 tx=0x7fbd6c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd72ffd700 1 -- 172.21.15.81:0/192311162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00ab10 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd72ffd700 1 -- 172.21.15.81:0/192311162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00ac70 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd72ffd700 1 -- 172.21.15.81:0/192311162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c007070 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c0ac3d0 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.742+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c0ac0f0 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.746+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c06cbe0 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.746+0000 7fbd72ffd700 1 -- 172.21.15.81:0/192311162 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbd6c019030 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.746+0000 7fbd72ffd700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd5c064ee0 0x7fbd5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.746+0000 7fbd72ffd700 1 -- 172.21.15.81:0/192311162 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbd6c081cf0 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.746+0000 7fbd7a59c700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd5c064ee0 0x7fbd5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:27.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.746+0000 7fbd7a59c700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd5c064ee0 0x7fbd5c067390 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbd64006d70 tx=0x7fbd640092e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.754+0000 7fbd72ffd700 1 -- 172.21.15.81:0/192311162 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbd6c04fc60 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.914+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd7c0c2b30 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.914+0000 7fbd72ffd700 1 -- 172.21.15.81:0/192311162 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd7c0c2b30 con 0x7fbd7c0cbb30 2023-11-29T11:22:27.922 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd5c064ee0 msgr2=0x7fbd5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd5c064ee0 0x7fbd5c067390 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbd64006d70 tx=0x7fbd640092e0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c0cbb30 msgr2=0x7fbd7c0aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c0cbb30 0x7fbd7c0aaf40 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00cbf0 tx=0x7fbd6c00cf00 comp rx=0 tx=0).stop 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 shutdown_connections 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbd5c064ee0 0x7fbd5c067390 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c0cbb30 0x7fbd7c0aaf40 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd7c0b00e0 0x7fbd7c0c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 --2- 172.21.15.81:0/192311162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd7c09bdb0 0x7fbd7c156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:27.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 >> 172.21.15.81:0/192311162 conn(0x7fbd7c0cae70 msgr2=0x7fbd7c06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:27.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 shutdown_connections 2023-11-29T11:22:27.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:27.918+0000 7fbd7b59e700 1 -- 172.21.15.81:0/192311162 wait complete. 2023-11-29T11:22:27.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:22:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4ad163a700 1 Processor -- start 2023-11-29T11:22:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4ad163a700 1 -- start start 2023-11-29T11:22:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4ad163a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ac4058ba0 0x7f4ac40553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4ad163a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac4038950 con 0x7f4ac400eff0 2023-11-29T11:22:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4ad163a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40e6fe0 con 0x7f4ac403e7b0 2023-11-29T11:22:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4ad163a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac40e72c0 con 0x7f4ac4058ba0 2023-11-29T11:22:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4ad0e39700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ac4058ba0 0x7f4ac40553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4acb7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ac400eff0 0x7f4ac4056fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37574/0 (socket says 172.21.15.81:37574) 2023-11-29T11:22:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.050+0000 7f4acb7fe700 1 -- 172.21.15.81:0/1161157085 learned_addr learned my addr 172.21.15.81:0/1161157085 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad0e39700 1 -- 172.21.15.81:0/1161157085 >> v1:172.21.15.176:6789/0 conn(0x7f4ac403e7b0 legacy=0x7f4ac400e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad0e39700 1 -- 172.21.15.81:0/1161157085 >> v1:172.21.15.81:6789/0 conn(0x7f4ac400eff0 legacy=0x7f4ac4056fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad0e39700 1 -- 172.21.15.81:0/1161157085 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4053860 con 0x7f4ac4058ba0 2023-11-29T11:22:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4acaffd700 1 -- 172.21.15.81:0/1161157085 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974675669 0 0) 0x7f4ac4038950 con 0x7f4ac400eff0 2023-11-29T11:22:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad0e39700 1 --2- 172.21.15.81:0/1161157085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac4058ba0 0x7f4ac40553c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f4acc02cad0 tx=0x7f4acc04e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6565c02de0c285e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4acaffd700 1 -- 172.21.15.81:0/1161157085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0727d0 con 0x7f4ac4058ba0 2023-11-29T11:22:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4acaffd700 1 -- 172.21.15.81:0/1161157085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc072930 con 0x7f4ac4058ba0 2023-11-29T11:22:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4acaffd700 1 -- 172.21.15.81:0/1161157085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc072cc0 con 0x7f4ac4058ba0 2023-11-29T11:22:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 -- 172.21.15.81:0/1161157085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac4058ba0 msgr2=0x7f4ac40553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 --2- 172.21.15.81:0/1161157085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac4058ba0 0x7f4ac40553c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f4acc02cad0 tx=0x7f4acc04e8b0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 -- 172.21.15.81:0/1161157085 shutdown_connections 2023-11-29T11:22:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 --2- 172.21.15.81:0/1161157085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac4058ba0 0x7f4ac40553c0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 -- 172.21.15.81:0/1161157085 >> 172.21.15.81:0/1161157085 conn(0x7f4ac4059170 msgr2=0x7f4ac4059570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 -- 172.21.15.81:0/1161157085 shutdown_connections 2023-11-29T11:22:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 -- 172.21.15.81:0/1161157085 wait complete. 2023-11-29T11:22:28.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 Processor -- start 2023-11-29T11:22:28.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.054+0000 7f4ad163a700 1 -- start start 2023-11-29T11:22:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac400eff0 0x7f4ac40dded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac403e7b0 0x7f4ac40d7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac4058ba0 0x7f4ac416cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac416c110 con 0x7f4ac403e7b0 2023-11-29T11:22:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac403d250 con 0x7f4ac4058ba0 2023-11-29T11:22:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac403d530 con 0x7f4ac400eff0 2023-11-29T11:22:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac403e7b0 0x7f4ac40d7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac403e7b0 0x7f4ac40d7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48732/0 (socket says 172.21.15.81:48732) 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 -- 172.21.15.81:0/136697258 learned_addr learned my addr 172.21.15.81:0/136697258 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acbfff700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac400eff0 0x7f4ac40dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad0e39700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac4058ba0 0x7f4ac416cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 -- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac400eff0 msgr2=0x7f4ac40dded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac400eff0 0x7f4ac40dded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 -- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac4058ba0 msgr2=0x7f4ac416cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac4058ba0 0x7f4ac416cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 -- 172.21.15.81:0/136697258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc04e720 con 0x7f4ac403e7b0 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acbfff700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac400eff0 0x7f4ac40dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad0e39700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac4058ba0 0x7f4ac416cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acb7fe700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac403e7b0 0x7f4ac40d7810 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000c4e0 tx=0x7f4ac000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ac8ff9700 1 -- 172.21.15.81:0/136697258 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0004ca0 con 0x7f4ac403e7b0 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ac8ff9700 1 -- 172.21.15.81:0/136697258 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac0004e00 con 0x7f4ac403e7b0 2023-11-29T11:22:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac403eb80 con 0x7f4ac403e7b0 2023-11-29T11:22:28.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ac8ff9700 1 -- 172.21.15.81:0/136697258 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0007310 con 0x7f4ac403e7b0 2023-11-29T11:22:28.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac4053b40 con 0x7f4ac403e7b0 2023-11-29T11:22:28.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac4053e20 con 0x7f4ac403e7b0 2023-11-29T11:22:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ac8ff9700 1 -- 172.21.15.81:0/136697258 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ac001a020 con 0x7f4ac403e7b0 2023-11-29T11:22:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ac8ff9700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ab0064f10 0x7f4ab00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4ac8ff9700 1 -- 172.21.15.81:0/136697258 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4ac0081b40 con 0x7f4ac403e7b0 2023-11-29T11:22:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.058+0000 7f4acbfff700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ab0064f10 0x7f4ab00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.062+0000 7f4acbfff700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ab0064f10 0x7f4ab00673c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000f60 tx=0x7f4ab8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.070+0000 7f4ac8ff9700 1 -- 172.21.15.81:0/136697258 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ac004fc00 con 0x7f4ac403e7b0 2023-11-29T11:22:28.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.230+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ac4005570 con 0x7f4ac403e7b0 2023-11-29T11:22:28.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.230+0000 7f4ac8ff9700 1 -- 172.21.15.81:0/136697258 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ac0053220 con 0x7f4ac403e7b0 2023-11-29T11:22:28.237 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:22:28.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ab0064f10 msgr2=0x7f4ab00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ab0064f10 0x7f4ab00673c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000f60 tx=0x7f4ab8009040 comp rx=0 tx=0).stop 2023-11-29T11:22:28.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac403e7b0 msgr2=0x7f4ac40d7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac403e7b0 0x7f4ac40d7810 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000c4e0 tx=0x7f4ac000c8a0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 shutdown_connections 2023-11-29T11:22:28.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ab0064f10 0x7f4ab00673c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac4058ba0 0x7f4ac416cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac403e7b0 0x7f4ac40d7810 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 --2- 172.21.15.81:0/136697258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac400eff0 0x7f4ac40dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 >> 172.21.15.81:0/136697258 conn(0x7f4ac4059170 msgr2=0x7f4ac4038bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:28.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 shutdown_connections 2023-11-29T11:22:28.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.234+0000 7f4ad163a700 1 -- 172.21.15.81:0/136697258 wait complete. 2023-11-29T11:22:28.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:22:28.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa3cd5c700 1 Processor -- start 2023-11-29T11:22:28.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa3cd5c700 1 -- start start 2023-11-29T11:22:28.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa3cd5c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffa3806a530 0x7ffa380cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa3cd5c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3806dc70 con 0x7ffa3806d7d0 2023-11-29T11:22:28.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa3cd5c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3815c6d0 con 0x7ffa380cf050 2023-11-29T11:22:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa3cd5c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa380b5320 con 0x7ffa3806a530 2023-11-29T11:22:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa36ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffa3806d7d0 0x7ffa380b4c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37586/0 (socket says 172.21.15.81:37586) 2023-11-29T11:22:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa36ffd700 1 -- 172.21.15.81:0/4174665341 learned_addr learned my addr 172.21.15.81:0/4174665341 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa37fff700 1 --2- 172.21.15.81:0/4174665341 >> v2:172.21.15.176:3300/0 conn(0x7ffa3806a530 0x7ffa380cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361479398 0 0) 0x7ffa20001110 con 0x7ffa3806d7d0 2023-11-29T11:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa240035d0 con 0x7ffa3806d7d0 2023-11-29T11:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043162952 0 0) 0x7ffa3815c6d0 con 0x7ffa380cf050 2023-11-29T11:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa20001110 con 0x7ffa380cf050 2023-11-29T11:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 355933765 0 0) 0x7ffa240035d0 con 0x7ffa3806d7d0 2023-11-29T11:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 >> v2:172.21.15.176:3300/0 conn(0x7ffa3806a530 msgr2=0x7ffa380cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 --2- 172.21.15.81:0/4174665341 >> v2:172.21.15.176:3300/0 conn(0x7ffa3806a530 0x7ffa380cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 >> v1:172.21.15.176:6789/0 conn(0x7ffa380cf050 legacy=0x7ffa380cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3806a9b0 con 0x7ffa3806d7d0 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7ffa20001800 con 0x7ffa3806d7d0 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 >> v1:172.21.15.81:6789/0 conn(0x7ffa3806d7d0 legacy=0x7ffa380b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.358+0000 7ffa367fc700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa24003bb0 0x7ffa24003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa367fc700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa24004870 0x7ffa24004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa367fc700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24005220 0x7ffa2400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380b5320 con 0x7ffa24003bb0 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2400c130 con 0x7ffa24005220 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2400c2f0 con 0x7ffa24004870 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa377fe700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa24003bb0 0x7ffa24003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa37fff700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24005220 0x7ffa2400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa36ffd700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa24004870 0x7ffa24004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa377fe700 1 -- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa24004870 msgr2=0x7ffa24004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa377fe700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa24004870 0x7ffa24004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa377fe700 1 -- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24005220 msgr2=0x7ffa2400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa377fe700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24005220 0x7ffa2400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa37fff700 1 -- 172.21.15.81:0/4174665341 reap_dead start 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa377fe700 1 -- 172.21.15.81:0/4174665341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa240035d0 con 0x7ffa24003bb0 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa36ffd700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa24004870 0x7ffa24004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa377fe700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa24003bb0 0x7ffa24003fa0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7ffa30002230 tx=0x7ffa240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4015bdf1267c82ff server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30001f30 con 0x7ffa24003bb0 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000ce40 con 0x7ffa24003bb0 2023-11-29T11:22:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa367fc700 1 -- 172.21.15.81:0/4174665341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30003c60 con 0x7ffa24003bb0 2023-11-29T11:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/4174665341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa24003bb0 msgr2=0x7ffa24003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa3cd5c700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa24003bb0 0x7ffa24003fa0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7ffa30002230 tx=0x7ffa240058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/4174665341 shutdown_connections 2023-11-29T11:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa3cd5c700 1 --2- 172.21.15.81:0/4174665341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa24003bb0 0x7ffa24003fa0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/4174665341 >> 172.21.15.81:0/4174665341 conn(0x7ffa3809bb30 msgr2=0x7ffa380b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/4174665341 shutdown_connections 2023-11-29T11:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.362+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/4174665341 wait complete. 2023-11-29T11:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 Processor -- start 2023-11-29T11:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 -- start start 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24003bb0 0x7ffa38159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa380d03a0 0x7ffa3815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa3806cc10 0x7ffa3806d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3806d5f0 con 0x7ffa380d03a0 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3809cc90 con 0x7ffa24003bb0 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3815e860 con 0x7ffa3806cc10 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa380d03a0 0x7ffa3815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa380d03a0 0x7ffa3815e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48744/0 (socket says 172.21.15.81:48744) 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 -- 172.21.15.81:0/1251475041 learned_addr learned my addr 172.21.15.81:0/1251475041 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa377fe700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24003bb0 0x7ffa38159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa37fff700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa3806cc10 0x7ffa3806d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 -- 172.21.15.81:0/1251475041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa3806cc10 msgr2=0x7ffa3806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa3806cc10 0x7ffa3806d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 -- 172.21.15.81:0/1251475041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24003bb0 msgr2=0x7ffa38159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24003bb0 0x7ffa38159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 -- 172.21.15.81:0/1251475041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3806af40 con 0x7ffa380d03a0 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa36ffd700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa380d03a0 0x7ffa3815e320 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000eaf0 tx=0x7ffa2000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa2ffff700 1 -- 172.21.15.81:0/1251475041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000c570 con 0x7ffa380d03a0 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa2ffff700 1 -- 172.21.15.81:0/1251475041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2000c6d0 con 0x7ffa380d03a0 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3806ac60 con 0x7ffa380d03a0 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa2ffff700 1 -- 172.21.15.81:0/1251475041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000ca40 con 0x7ffa380d03a0 2023-11-29T11:22:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.366+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa380b4410 con 0x7ffa380d03a0 2023-11-29T11:22:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.370+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa380d0890 con 0x7ffa380d03a0 2023-11-29T11:22:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.370+0000 7ffa2ffff700 1 -- 172.21.15.81:0/1251475041 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffa2000cba0 con 0x7ffa380d03a0 2023-11-29T11:22:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.370+0000 7ffa2ffff700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa18064ee0 0x7ffa18067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.370+0000 7ffa2ffff700 1 -- 172.21.15.81:0/1251475041 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffa20081c60 con 0x7ffa380d03a0 2023-11-29T11:22:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.370+0000 7ffa377fe700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa18064ee0 0x7ffa18067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.370+0000 7ffa377fe700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa18064ee0 0x7ffa18067390 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ffa30015040 tx=0x7ffa3000a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.378+0000 7ffa2ffff700 1 -- 172.21.15.81:0/1251475041 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffa2004fc60 con 0x7ffa380d03a0 2023-11-29T11:22:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa3806dc70 con 0x7ffa380d03a0 2023-11-29T11:22:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa2ffff700 1 -- 172.21.15.81:0/1251475041 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa3806dc70 con 0x7ffa380d03a0 2023-11-29T11:22:28.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa18064ee0 msgr2=0x7ffa18067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa18064ee0 0x7ffa18067390 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ffa30015040 tx=0x7ffa3000a000 comp rx=0 tx=0).stop 2023-11-29T11:22:28.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa380d03a0 msgr2=0x7ffa3815e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa380d03a0 0x7ffa3815e320 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000eaf0 tx=0x7ffa2000ee00 comp rx=0 tx=0).stop 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 shutdown_connections 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffa18064ee0 0x7ffa18067390 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa3806cc10 0x7ffa3806d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa380d03a0 0x7ffa3815e320 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 --2- 172.21.15.81:0/1251475041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa24003bb0 0x7ffa38159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 >> 172.21.15.81:0/1251475041 conn(0x7ffa3809bb30 msgr2=0x7ffa380afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 shutdown_connections 2023-11-29T11:22:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:28.554+0000 7ffa3cd5c700 1 -- 172.21.15.81:0/1251475041 wait complete. 2023-11-29T11:22:28.564 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:22:28.574 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:22:28.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:28.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:28.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[61679]: fuse finished with error 0 and tester_r 0 2023-11-29T11:22:28.589 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:22:34.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:22:34.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:34.691 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:22:34.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc19cd7700 1 Processor -- start 2023-11-29T11:22:34.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc19cd7700 1 -- start start 2023-11-29T11:22:34.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc19cd7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efc1406d7d0 0x7efc1406a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:34.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc19cd7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efc140b4c10 0x7efc140cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:34.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc19cd7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1406dc70 con 0x7efc140cf050 2023-11-29T11:22:34.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc19cd7700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1406aa70 con 0x7efc1406d7d0 2023-11-29T11:22:34.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc19cd7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1415c6d0 con 0x7efc140b4c10 2023-11-29T11:22:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc13fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efc1406d7d0 0x7efc1406a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc18cd5700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efc140cf050 0x7efc140cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48804/0 (socket says 172.21.15.81:48804) 2023-11-29T11:22:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc18cd5700 1 -- 172.21.15.81:0/1310422229 learned_addr learned my addr 172.21.15.81:0/1310422229 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc194d6700 1 --2- 172.21.15.81:0/1310422229 >> v2:172.21.15.176:3300/0 conn(0x7efc140b4c10 0x7efc140cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc13fff700 1 -- 172.21.15.81:0/1310422229 >> v2:172.21.15.176:3300/0 conn(0x7efc140b4c10 msgr2=0x7efc140cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc13fff700 1 --2- 172.21.15.81:0/1310422229 >> v2:172.21.15.176:3300/0 conn(0x7efc140b4c10 0x7efc140cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc13fff700 1 -- 172.21.15.81:0/1310422229 >> v1:172.21.15.81:6789/0 conn(0x7efc140cf050 legacy=0x7efc140cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc13fff700 1 -- 172.21.15.81:0/1310422229 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1406ac60 con 0x7efc1406d7d0 2023-11-29T11:22:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc13fff700 1 --2- 172.21.15.81:0/1310422229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1406a530 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7efc1408c660 tx=0x7efc04009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfaae20079417ff server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.809+0000 7efc137fe700 1 -- 172.21.15.81:0/1310422229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04011830 con 0x7efc1406d7d0 2023-11-29T11:22:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc137fe700 1 -- 172.21.15.81:0/1310422229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc04011990 con 0x7efc1406d7d0 2023-11-29T11:22:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc137fe700 1 -- 172.21.15.81:0/1310422229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04011d20 con 0x7efc1406d7d0 2023-11-29T11:22:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- 172.21.15.81:0/1310422229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 msgr2=0x7efc1406a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 --2- 172.21.15.81:0/1310422229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1406a530 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7efc1408c660 tx=0x7efc04009b30 comp rx=0 tx=0).stop 2023-11-29T11:22:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- 172.21.15.81:0/1310422229 shutdown_connections 2023-11-29T11:22:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 --2- 172.21.15.81:0/1310422229 >> v2:172.21.15.176:3300/0 conn(0x7efc140b4c10 0x7efc140cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 --2- 172.21.15.81:0/1310422229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1406a530 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- 172.21.15.81:0/1310422229 >> 172.21.15.81:0/1310422229 conn(0x7efc1409bb30 msgr2=0x7efc140b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- 172.21.15.81:0/1310422229 shutdown_connections 2023-11-29T11:22:34.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- 172.21.15.81:0/1310422229 wait complete. 2023-11-29T11:22:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 Processor -- start 2023-11-29T11:22:34.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- start start 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc140b4c10 0x7efc140c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc140cf050 0x7efc140c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1414e380 con 0x7efc1406d7d0 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc141501b0 con 0x7efc140b4c10 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc19cd7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1414f5a0 con 0x7efc140cf050 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.813+0000 7efc18cd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc18cd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1414de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43762/0 (socket says 172.21.15.81:43762) 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc18cd5700 1 -- 172.21.15.81:0/46056407 learned_addr learned my addr 172.21.15.81:0/46056407 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc13fff700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc140b4c10 0x7efc140c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc194d6700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc140cf050 0x7efc140c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc18cd5700 1 -- 172.21.15.81:0/46056407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc140cf050 msgr2=0x7efc140c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc18cd5700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc140cf050 0x7efc140c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc18cd5700 1 -- 172.21.15.81:0/46056407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc140b4c10 msgr2=0x7efc140c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc18cd5700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc140b4c10 0x7efc140c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc18cd5700 1 -- 172.21.15.81:0/46056407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040094b0 con 0x7efc1406d7d0 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc18cd5700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1414de40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7efc08001eb0 tx=0x7efc0800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc117fa700 1 -- 172.21.15.81:0/46056407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08005d90 con 0x7efc1406d7d0 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc117fa700 1 -- 172.21.15.81:0/46056407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc080070d0 con 0x7efc1406d7d0 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc140b4410 con 0x7efc1406d7d0 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc117fa700 1 -- 172.21.15.81:0/46056407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08007440 con 0x7efc1406d7d0 2023-11-29T11:22:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1406af40 con 0x7efc1406d7d0 2023-11-29T11:22:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc140b46f0 con 0x7efc1406d7d0 2023-11-29T11:22:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.817+0000 7efc117fa700 1 -- 172.21.15.81:0/46056407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efc08019030 con 0x7efc1406d7d0 2023-11-29T11:22:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.821+0000 7efc117fa700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc00064ee0 0x7efc00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.821+0000 7efc13fff700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc00064ee0 0x7efc00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.821+0000 7efc117fa700 1 -- 172.21.15.81:0/46056407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efc08080f40 con 0x7efc1406d7d0 2023-11-29T11:22:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.821+0000 7efc13fff700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc00064ee0 0x7efc00067390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efc04000c00 tx=0x7efc04008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:34.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:34.825+0000 7efc117fa700 1 -- 172.21.15.81:0/46056407 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efc0804a400 con 0x7efc1406d7d0 2023-11-29T11:22:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.025+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc1406dc70 con 0x7efc1406d7d0 2023-11-29T11:22:35.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.025+0000 7efc117fa700 1 -- 172.21.15.81:0/46056407 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7efc1406dc70 con 0x7efc1406d7d0 2023-11-29T11:22:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:35.033 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:22:19.584710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8973":{"gid":8973,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/665591010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":665591010},{"type":"v1","addr":"172.21.15.81:6837","nonce":665591010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:22:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc00064ee0 msgr2=0x7efc00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc00064ee0 0x7efc00067390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efc04000c00 tx=0x7efc04008030 comp rx=0 tx=0).stop 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 msgr2=0x7efc1414de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1414de40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7efc08001eb0 tx=0x7efc0800c7b0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 shutdown_connections 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efc00064ee0 0x7efc00067390 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc140cf050 0x7efc140c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc140b4c10 0x7efc140c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 --2- 172.21.15.81:0/46056407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc1406d7d0 0x7efc1414de40 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 >> 172.21.15.81:0/46056407 conn(0x7efc1409bb30 msgr2=0x7efc140afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 shutdown_connections 2023-11-29T11:22:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.029+0000 7efc19cd7700 1 -- 172.21.15.81:0/46056407 wait complete. 2023-11-29T11:22:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 72 2023-11-29T11:22:35.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-29T11:22:35.181 INFO:teuthology.orchestra.run.smithi081.stdout:{"message":"","return_code":0} 2023-11-29T11:22:35.181 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:22:35.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:35.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e2632700 1 Processor -- start 2023-11-29T11:22:35.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e2632700 1 -- start start 2023-11-29T11:22:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e2632700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15d230 0x7f94dc0d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e2632700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc0ccf60 con 0x7f94dc0ce960 2023-11-29T11:22:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e2632700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc15d660 con 0x7f94dc06cc50 2023-11-29T11:22:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e2632700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0b66a0 con 0x7f94dc15d230 2023-11-29T11:22:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1630700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f94dc0ce960 0x7f94dc0d2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48806/0 (socket says 172.21.15.81:48806) 2023-11-29T11:22:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1630700 1 -- 172.21.15.81:0/883491353 learned_addr learned my addr 172.21.15.81:0/883491353 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e0e2f700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15d230 0x7f94dc0d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418928256 0 0) 0x7f94dc0ccf60 con 0x7f94dc0ce960 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c80035d0 con 0x7f94dc0ce960 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060135018 0 0) 0x7f94dc15d660 con 0x7f94dc06cc50 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94dc0ccf60 con 0x7f94dc06cc50 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442122629 0 0) 0x7f94c80035d0 con 0x7f94dc0ce960 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15d230 msgr2=0x7f94dc0d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15d230 0x7f94dc0d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 >> v1:172.21.15.176:6789/0 conn(0x7f94dc06cc50 legacy=0x7f94dc06d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc0b78b0 con 0x7f94dc0ce960 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f94d0001670 con 0x7f94dc0ce960 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 >> v1:172.21.15.81:6789/0 conn(0x7f94dc0ce960 legacy=0x7f94dc0d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94c8003be0 0x7f94c8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15d230 0x7f94c8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94c8004db0 0x7f94c8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0b66a0 con 0x7f94c8004db0 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c800bae0 con 0x7f94c8003be0 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c800bc70 con 0x7f94dc15d230 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1e31700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94c8004db0 0x7f94c8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1630700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94c8003be0 0x7f94c8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e0e2f700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15d230 0x7f94c8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1e31700 1 -- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15d230 msgr2=0x7f94c8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1e31700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15d230 0x7f94c8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1e31700 1 -- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94c8003be0 msgr2=0x7f94c8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1e31700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94c8003be0 0x7f94c8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1e31700 1 -- 172.21.15.81:0/883491353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80035d0 con 0x7f94c8004db0 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94e1e31700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94c8004db0 0x7f94c8005220 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c2f0 tx=0x7f94c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b368eb920ce2936c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4001f30 con 0x7f94c8004db0 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d400ce90 con 0x7f94c8004db0 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.285+0000 7f94cffff700 1 -- 172.21.15.81:0/883491353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4003c60 con 0x7f94c8004db0 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- 172.21.15.81:0/883491353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94c8004db0 msgr2=0x7f94c8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 --2- 172.21.15.81:0/883491353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94c8004db0 0x7f94c8005220 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c2f0 tx=0x7f94c80058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e1e31700 1 -- 172.21.15.81:0/883491353 reap_dead start 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- 172.21.15.81:0/883491353 shutdown_connections 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- 172.21.15.81:0/883491353 >> 172.21.15.81:0/883491353 conn(0x7f94dc0b5860 msgr2=0x7f94dc0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- 172.21.15.81:0/883491353 shutdown_connections 2023-11-29T11:22:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- 172.21.15.81:0/883491353 wait complete. 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 Processor -- start 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- start start 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15ae10 0x7f94dc0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94dc15b1e0 0x7f94dc0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94dc1f4ee0 0x7f94dc1f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc1f26a0 con 0x7f94dc15b1e0 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc1f16c0 con 0x7f94dc1f4ee0 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.289+0000 7f94e2632700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc1f18e0 con 0x7f94dc15ae10 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94dc15b1e0 0x7f94dc0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94dc15b1e0 0x7f94dc0c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43768/0 (socket says 172.21.15.81:43768) 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 -- 172.21.15.81:0/1898456321 learned_addr learned my addr 172.21.15.81:0/1898456321 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e1e31700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94dc1f4ee0 0x7f94dc1f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e1630700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15ae10 0x7f94dc0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 -- 172.21.15.81:0/1898456321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15ae10 msgr2=0x7f94dc0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15ae10 0x7f94dc0c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 -- 172.21.15.81:0/1898456321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94dc1f4ee0 msgr2=0x7f94dc1f5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94dc1f4ee0 0x7f94dc1f5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 -- 172.21.15.81:0/1898456321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc0b7e50 con 0x7f94dc15b1e0 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e0e2f700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94dc15b1e0 0x7f94dc0c8250 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f94d8011700 tx=0x7f94d8011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94cdffb700 1 -- 172.21.15.81:0/1898456321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8015870 con 0x7f94dc15b1e0 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94cdffb700 1 -- 172.21.15.81:0/1898456321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d80159d0 con 0x7f94dc15b1e0 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc0b7b70 con 0x7f94dc15b1e0 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94cdffb700 1 -- 172.21.15.81:0/1898456321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8015d40 con 0x7f94dc15b1e0 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc0b8130 con 0x7f94dc15b1e0 2023-11-29T11:22:35.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc072500 con 0x7f94dc15b1e0 2023-11-29T11:22:35.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.293+0000 7f94cdffb700 1 -- 172.21.15.81:0/1898456321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f94d801b030 con 0x7f94dc15b1e0 2023-11-29T11:22:35.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.297+0000 7f94cdffb700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94c0064f10 0x7f94c00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.297+0000 7f94e1630700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94c0064f10 0x7f94c00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.297+0000 7f94cdffb700 1 -- 172.21.15.81:0/1898456321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f94d8082190 con 0x7f94dc15b1e0 2023-11-29T11:22:35.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.297+0000 7f94e1630700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94c0064f10 0x7f94c00673c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f94d00048f0 tx=0x7f94d0001e00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.301+0000 7f94cdffb700 1 -- 172.21.15.81:0/1898456321 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f94d80501f0 con 0x7f94dc15b1e0 2023-11-29T11:22:35.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.489+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94dc08b4d0 con 0x7f94dc15b1e0 2023-11-29T11:22:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94cdffb700 1 -- 172.21.15.81:0/1898456321 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f94d8053810 con 0x7f94dc15b1e0 2023-11-29T11:22:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:35.499 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:22:19.584710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8973":{"gid":8973,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/665591010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":665591010},{"type":"v1","addr":"172.21.15.81:6837","nonce":665591010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:22:35.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94c0064f10 msgr2=0x7f94c00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94c0064f10 0x7f94c00673c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f94d00048f0 tx=0x7f94d0001e00 comp rx=0 tx=0).stop 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94dc15b1e0 msgr2=0x7f94dc0c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94dc15b1e0 0x7f94dc0c8250 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f94d8011700 tx=0x7f94d8011a10 comp rx=0 tx=0).stop 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 shutdown_connections 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f94c0064f10 0x7f94c00673c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94dc1f4ee0 0x7f94dc1f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94dc15b1e0 0x7f94dc0c8250 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 --2- 172.21.15.81:0/1898456321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94dc15ae10 0x7f94dc0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 >> 172.21.15.81:0/1898456321 conn(0x7f94dc0b5860 msgr2=0x7f94dc0b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 shutdown_connections 2023-11-29T11:22:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.493+0000 7f94e2632700 1 -- 172.21.15.81:0/1898456321 wait complete. 2023-11-29T11:22:35.503 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 72 2023-11-29T11:22:35.513 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2023-11-29T11:22:35.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.537+0000 7f2544471140 1 Processor -- start 2023-11-29T11:22:35.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.537+0000 7f2544471140 1 -- start start 2023-11-29T11:22:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e168970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 0x563c1e1fa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 0x563c1e1fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1e155820 con 0x563c1e128480 2023-11-29T11:22:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1e155ac0 con 0x563c1e1fc350 2023-11-29T11:22:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c1e169d00 con 0x563c1e16c750 2023-11-29T11:22:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e168970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43780/0 (socket says 172.21.15.81:43780) 2023-11-29T11:22:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 -- 172.21.15.81:0/750100276 learned_addr learned my addr 172.21.15.81:0/750100276 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f25427a7700 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 0x563c1e1fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f25417a5700 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 0x563c1e1fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 -- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 msgr2=0x563c1e1fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:35.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 0x563c1e1fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 -- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 msgr2=0x563c1e1fabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 0x563c1e1fabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 -- 172.21.15.81:0/750100276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c00a1c0 con 0x563c1e128480 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f25417a5700 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 0x563c1e1fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2541fa6700 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e168970 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f2534009750 tx=0x7f2534005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b5a83c899d6008 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f253bfff700 1 -- 172.21.15.81:0/750100276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253400f040 con 0x563c1e128480 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f253bfff700 1 -- 172.21.15.81:0/750100276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340088d0 con 0x563c1e128480 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f253bfff700 1 -- 172.21.15.81:0/750100276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534005e10 con 0x563c1e128480 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- 172.21.15.81:0/750100276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 msgr2=0x563c1e168970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e168970 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f2534009750 tx=0x7f2534005a00 comp rx=0 tx=0).stop 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- 172.21.15.81:0/750100276 shutdown_connections 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 0x563c1e1fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 0x563c1e1fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- 172.21.15.81:0/750100276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e168970 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- 172.21.15.81:0/750100276 >> 172.21.15.81:0/750100276 conn(0x563c1e151890 msgr2=0x563c1e16e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- 172.21.15.81:0/750100276 shutdown_connections 2023-11-29T11:22:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- 172.21.15.81:0/750100276 wait complete. 2023-11-29T11:22:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 Processor -- start 2023-11-29T11:22:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- start start 2023-11-29T11:22:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e1f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 0x563c1e1f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 0x563c1e1f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1e292080 con 0x563c1e128480 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1e292320 con 0x563c1e1fc350 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.541+0000 7f2544471140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c1e2925c0 con 0x563c1e16c750 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e1f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e1f9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43782/0 (socket says 172.21.15.81:43782) 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 -- 172.21.15.81:0/1986670307 learned_addr learned my addr 172.21.15.81:0/1986670307 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f25427a7700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 0x563c1e1f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f25417a5700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 0x563c1e1f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 -- 172.21.15.81:0/1986670307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 msgr2=0x563c1e1f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563c1e16c750 0x563c1e1f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 -- 172.21.15.81:0/1986670307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 msgr2=0x563c1e1f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563c1e1fc350 0x563c1e1f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 -- 172.21.15.81:0/1986670307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009410 con 0x563c1e128480 2023-11-29T11:22:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2541fa6700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e1f9230 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f2534000c00 tx=0x7f2534003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f253affd700 1 -- 172.21.15.81:0/1986670307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253400f070 con 0x563c1e128480 2023-11-29T11:22:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f253affd700 1 -- 172.21.15.81:0/1986670307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2534013630 con 0x563c1e128480 2023-11-29T11:22:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c1e07e760 con 0x563c1e128480 2023-11-29T11:22:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f253affd700 1 -- 172.21.15.81:0/1986670307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340139c0 con 0x563c1e128480 2023-11-29T11:22:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c1e064390 con 0x563c1e128480 2023-11-29T11:22:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.545+0000 7f253affd700 1 -- 172.21.15.81:0/1986670307 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2534013b20 con 0x563c1e128480 2023-11-29T11:22:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f253affd700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2524063840 0x7f2524065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f253affd700 1 -- 172.21.15.81:0/1986670307 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2534082f80 con 0x563c1e128480 2023-11-29T11:22:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f25417a5700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2524063840 0x7f2524065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x563c1e1f6730 0x563c1e29c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:1 16.13 16:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v8 -- 0x563c1e291b10 con 0x563c1e1f6730 2023-11-29T11:22:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f25427a7700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x563c1e1f6730 0x563c1e29c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f25417a5700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2524063840 0x7f2524065cf0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f253c000f80 tx=0x7f253c007030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f25427a7700 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x563c1e1f6730 0x563c1e29c120 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f25427a7700 1 -- 172.21.15.81:0/1986670307 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7f252c0098a0 con 0x563c1e1f6730 2023-11-29T11:22:35.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x563c1e1f6730 msgr2=0x563c1e29c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x563c1e1f6730 0x563c1e29c120 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2524063840 msgr2=0x7f2524065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2524063840 0x7f2524065cf0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f253c000f80 tx=0x7f253c007030 comp rx=0 tx=0).stop 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 msgr2=0x563c1e1f9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 --2- 172.21.15.81:0/1986670307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c1e128480 0x563c1e1f9230 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f2534000c00 tx=0x7f2534003020 comp rx=0 tx=0).stop 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f25427a7700 1 -- 172.21.15.81:0/1986670307 reap_dead start 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 shutdown_connections 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 >> 172.21.15.81:0/1986670307 conn(0x563c1e151890 msgr2=0x563c1e1fb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 shutdown_connections 2023-11-29T11:22:35.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.549+0000 7f2544471140 1 -- 172.21.15.81:0/1986670307 wait complete. 2023-11-29T11:22:35.560 INFO:teuthology.orchestra.run.smithi081.stdout:����� 2023-11-29T11:22:35.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-29T11:22:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 Processor -- start 2023-11-29T11:22:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 -- start start 2023-11-29T11:22:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcdf81606b0 0x7fcdf80c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf80c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf80cae70 con 0x7fcdf80ad610 2023-11-29T11:22:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf80cbc10 con 0x7fcdf81606b0 2023-11-29T11:22:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80cb130 con 0x7fcdf80ceef0 2023-11-29T11:22:35.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfe63b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcdf80ad610 0x7fcdf8164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48814/0 (socket says 172.21.15.81:48814) 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfe63b700 1 -- 172.21.15.81:0/1647285530 learned_addr learned my addr 172.21.15.81:0/1647285530 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfde3a700 1 --2- 172.21.15.81:0/1647285530 >> v2:172.21.15.176:3300/0 conn(0x7fcdf81606b0 0x7fcdf80c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfd639700 1 --2- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf80c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfce38700 1 -- 172.21.15.81:0/1647285530 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936258957 0 0) 0x7fcdf80cae70 con 0x7fcdf80ad610 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfce38700 1 -- 172.21.15.81:0/1647285530 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde40035d0 con 0x7fcdf80ad610 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfde3a700 1 -- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 msgr2=0x7fcdf80c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfde3a700 1 --2- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf80c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfde3a700 1 -- 172.21.15.81:0/1647285530 >> v1:172.21.15.81:6789/0 conn(0x7fcdf80ad610 legacy=0x7fcdf8164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfde3a700 1 -- 172.21.15.81:0/1647285530 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf80cb410 con 0x7fcdf81606b0 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfd639700 1 --2- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf80c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfde3a700 1 --2- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf81606b0 0x7fcdf80c13b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009850 tx=0x7fcdec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bddf98fa4e13f0d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfce38700 1 -- 172.21.15.81:0/1647285530 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec011830 con 0x7fcdf81606b0 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfce38700 1 -- 172.21.15.81:0/1647285530 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec011990 con 0x7fcdf81606b0 2023-11-29T11:22:35.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfce38700 1 -- 172.21.15.81:0/1647285530 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec011d40 con 0x7fcdf81606b0 2023-11-29T11:22:35.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 -- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf81606b0 msgr2=0x7fcdf80c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf81606b0 0x7fcdf80c13b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009850 tx=0x7fcdec009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:35.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 -- 172.21.15.81:0/1647285530 shutdown_connections 2023-11-29T11:22:35.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf80c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/1647285530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf81606b0 0x7fcdf80c13b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.665+0000 7fcdfee3c700 1 -- 172.21.15.81:0/1647285530 >> 172.21.15.81:0/1647285530 conn(0x7fcdf80ce3e0 msgr2=0x7fcdf80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:35.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 -- 172.21.15.81:0/1647285530 shutdown_connections 2023-11-29T11:22:35.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 -- 172.21.15.81:0/1647285530 wait complete. 2023-11-29T11:22:35.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 Processor -- start 2023-11-29T11:22:35.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 -- start start 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf80ad610 0x7fcdf80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf81606b0 0x7fcdf815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80cd920 con 0x7fcdf81606b0 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf815d410 con 0x7fcdf80ad610 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfee3c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf815d6f0 con 0x7fcdf80ceef0 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf81606b0 0x7fcdf815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf81606b0 0x7fcdf815f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43784/0 (socket says 172.21.15.81:43784) 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 -- 172.21.15.81:0/2858746410 learned_addr learned my addr 172.21.15.81:0/2858746410 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfde3a700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf80ad610 0x7fcdf80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfd639700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 -- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 msgr2=0x7fcdf815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 -- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf80ad610 msgr2=0x7fcdf80cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf80ad610 0x7fcdf80cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 -- 172.21.15.81:0/2858746410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf0009a70 con 0x7fcdf81606b0 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfde3a700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf80ad610 0x7fcdf80cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.669+0000 7fcdfe63b700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf81606b0 0x7fcdf815f4b0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400c500 tx=0x7fcdf400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdea7fc700 1 -- 172.21.15.81:0/2858746410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4005d90 con 0x7fcdf81606b0 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec0094b0 con 0x7fcdf81606b0 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdea7fc700 1 -- 172.21.15.81:0/2858746410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40070d0 con 0x7fcdf81606b0 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf806ac50 con 0x7fcdf81606b0 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdea7fc700 1 -- 172.21.15.81:0/2858746410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4007440 con 0x7fcdf81606b0 2023-11-29T11:22:35.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf80cb6f0 con 0x7fcdf81606b0 2023-11-29T11:22:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdea7fc700 1 -- 172.21.15.81:0/2858746410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcdf4019030 con 0x7fcdf81606b0 2023-11-29T11:22:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdea7fc700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcddc064ee0 0x7fcddc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdea7fc700 1 -- 172.21.15.81:0/2858746410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcdf40812d0 con 0x7fcdf81606b0 2023-11-29T11:22:35.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdfde3a700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcddc064ee0 0x7fcddc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:35.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.673+0000 7fcdfde3a700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcddc064ee0 0x7fcddc067390 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0090b0 tx=0x7fcdec008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.685+0000 7fcdea7fc700 1 -- 172.21.15.81:0/2858746410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcdf404a400 con 0x7fcdf81606b0 2023-11-29T11:22:35.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcdf815f9f0 con 0x7fcdf81606b0 2023-11-29T11:22:35.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdea7fc700 1 -- 172.21.15.81:0/2858746410 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcdf404f270 con 0x7fcdf81606b0 2023-11-29T11:22:35.891 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-29T11:22:35.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcddc064ee0 msgr2=0x7fcddc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcddc064ee0 0x7fcddc067390 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0090b0 tx=0x7fcdec008030 comp rx=0 tx=0).stop 2023-11-29T11:22:35.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf81606b0 msgr2=0x7fcdf815f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:35.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf81606b0 0x7fcdf815f4b0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400c500 tx=0x7fcdf400c8c0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 shutdown_connections 2023-11-29T11:22:35.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcddc064ee0 0x7fcddc067390 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdf81606b0 0x7fcdf815f4b0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdf80ceef0 0x7fcdf815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 --2- 172.21.15.81:0/2858746410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdf80ad610 0x7fcdf80cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:35.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 >> 172.21.15.81:0/2858746410 conn(0x7fcdf80ce3e0 msgr2=0x7fcdf80c3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:35.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 shutdown_connections 2023-11-29T11:22:35.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:35.885+0000 7fcdfee3c700 1 -- 172.21.15.81:0/2858746410 wait complete. 2023-11-29T11:22:35.905 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-29T11:22:35.905 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-29T11:22:35.906 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-11-29T11:22:35.906 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-29T11:22:35.906 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:35.906 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-29T11:22:35.906 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-29T11:22:35.906 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-29T11:22:35.906 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:22:35.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:35.906 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-11-29T11:22:35.914 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-29T11:22:35.914 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-29T11:22:35.914 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-11-29T11:22:35.914 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:35.914 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42010sec preferred_lft 42010sec 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:35.915 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:38:38:07:12 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d019:90ff:fed6:bba2/64 scope link 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:21:f9:b6:9c:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f021:f9ff:feb6:9ce0/64 scope link 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:35.916 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-29T11:22:35.917 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether f2:4c:30:10:c2:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:22:35.917 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f04c:30ff:fe10:c25d/64 scope link 2023-11-29T11:22:35.917 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-11-29T11:22:35.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:35.917 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-29T11:22:35.972 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:22:35.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:35.974 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-29T11:22:35.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:35.983 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-11-29T11:22:35.983 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-11-29T11:22:35.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-29T11:22:35.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-29T11:22:35.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-29T11:22:35.983 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-11-29T11:22:36.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:36.020 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:22:36.069 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:22:36.069 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:22:36.069 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:22:36.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:36.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-11-29T11:22:36.083 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-29T11:22:36.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:22:36.084 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:36.091 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-29T11:22:36.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-29T11:22:36.091 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:36.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:22:36.109 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:22:36.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:22:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:22:36.121 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:22:36.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:36.122 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:22:36.172 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-29T11:22:36.173 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-29T11:22:36.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:22:36.190 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:22:36.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:22:36.202 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:22:36.203 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:22:36.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:36.204 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:22:36.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2023-11-29T11:22:36.253+0000 7f2f2c2c0640 -1 init, newargv = 0x55c06026c700 newargc=15 2023-11-29T11:22:36.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[62209]: starting ceph client 2023-11-29T11:22:36.266 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[62209]: starting fuse 2023-11-29T11:22:37.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-11-29T11:22:37.331 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-29T11:22:37.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-29T11:22:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-29T11:22:37.345 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-29T11:22:37.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:37.346 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-11-29T11:22:37.352 INFO:teuthology.orchestra.run.smithi081.stdout:52 2023-11-29T11:22:37.352 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-29T11:22:37.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:22:37.352 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-11-29T11:22:37.352 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-11-29T11:22:37.352 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:22:37.352 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-11-29T11:22:37.352 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-11-29T11:22:37.353 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-11-29T11:22:37.354 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-29T11:22:37.354 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:37.354 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2023-11-29T11:22:37.354 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:22:37.480 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.62209.asok 2023-11-29T11:22:37.664 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.62209.asok 2023-11-29T11:22:37.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:37.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.62209.asok status 2023-11-29T11:22:37.765 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:22:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-11-29T11:22:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-29T11:22:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "62209", 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 9243, 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 9243 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1943414615 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1943414615 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.9243 192.168.0.1:0/1943414615", 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/1943414615", 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 72, 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 110, 2023-11-29T11:22:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-11-29T11:22:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-11-29T11:22:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-11-29T11:22:37.768 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:22:37.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:37.775 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-11-29T11:22:37.775 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:37.780 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-11-29T11:22:37.780 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:37.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:37.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:37.791 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:37.791 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:37.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:37.798 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-11-29T11:22:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:6+0 records in 2023-11-29T11:22:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:6+0 records out 2023-11-29T11:22:37.889 INFO:teuthology.orchestra.run.smithi081.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.078356 s, 80.3 MB/s 2023-11-29T11:22:37.890 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:37.890 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:37.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:37.897 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-11-29T11:22:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:6+0 records in 2023-11-29T11:22:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:6+0 records out 2023-11-29T11:22:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0720977 s, 87.3 MB/s 2023-11-29T11:22:38.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:38.026 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-11-29T11:22:38.038 INFO:teuthology.orchestra.run.smithi081.stdout:./ 2023-11-29T11:22:38.038 INFO:teuthology.orchestra.run.smithi081.stdout:./file2_sixmegs 2023-11-29T11:22:38.038 INFO:teuthology.orchestra.run.smithi081.stdout:./file3_sixmegs 2023-11-29T11:22:38.038 INFO:teuthology.orchestra.run.smithi081.stdout:./file1_sixmegs 2023-11-29T11:22:38.039 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:22:38.039 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:22:38.039 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:22:38.039 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:38.039 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-11-29T11:22:38.040 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:22:38.107 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-29T11:22:38.298 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:22:38.298 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:22:38.298 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:22:38.298 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:38.298 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2023-11-29T11:22:38.299 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:22:38.367 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627777 2023-11-29T11:22:38.556 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:22:38.557 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:22:38.557 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:22:38.557 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:38.557 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2023-11-29T11:22:38.557 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:22:38.668 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627778 2023-11-29T11:22:38.856 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-29T11:22:38.856 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-11-29T11:22:38.856 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2023-11-29T11:22:38.856 DEBUG:teuthology.orchestra.run.smithi081:> 2023-11-29T11:22:38.856 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2023-11-29T11:22:38.856 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-11-29T11:22:38.923 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627776 2023-11-29T11:22:39.112 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:39.112 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:39.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315ffff700 1 Processor -- start 2023-11-29T11:22:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315ffff700 1 -- start start 2023-11-29T11:22:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f316015c280 0x7f31600cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f31600ce6c0 0x7f31600cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600ccc40 con 0x7f316015beb0 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31600cc960 con 0x7f316015c280 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31600c9580 con 0x7f31600ce6c0 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f316015c280 0x7f31600cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315e7fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f316015c280 0x7f31600cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43792/0 (socket says 172.21.15.81:43792) 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315e7fc700 1 -- 172.21.15.81:0/2842956879 learned_addr learned my addr 172.21.15.81:0/2842956879 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315f7fe700 1 --2- 172.21.15.81:0/2842956879 >> v2:172.21.15.176:3300/0 conn(0x7f31600ce6c0 0x7f31600cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315e7fc700 1 -- 172.21.15.81:0/2842956879 >> v2:172.21.15.176:3300/0 conn(0x7f31600ce6c0 msgr2=0x7f31600cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315e7fc700 1 --2- 172.21.15.81:0/2842956879 >> v2:172.21.15.176:3300/0 conn(0x7f31600ce6c0 0x7f31600cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315e7fc700 1 -- 172.21.15.81:0/2842956879 >> v1:172.21.15.176:6789/0 conn(0x7f316015beb0 legacy=0x7f31600caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315e7fc700 1 -- 172.21.15.81:0/2842956879 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600c9860 con 0x7f316015c280 2023-11-29T11:22:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315e7fc700 1 --2- 172.21.15.81:0/2842956879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316015c280 0x7f31600cd0d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f3160071310 tx=0x7f315800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb7832cc92e605b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315dffb700 1 -- 172.21.15.81:0/2842956879 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315800e070 con 0x7f316015c280 2023-11-29T11:22:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315dffb700 1 -- 172.21.15.81:0/2842956879 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315800b910 con 0x7f316015c280 2023-11-29T11:22:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.233+0000 7f315dffb700 1 -- 172.21.15.81:0/2842956879 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315800bcc0 con 0x7f316015c280 2023-11-29T11:22:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- 172.21.15.81:0/2842956879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316015c280 msgr2=0x7f31600cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 --2- 172.21.15.81:0/2842956879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316015c280 0x7f31600cd0d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f3160071310 tx=0x7f315800b330 comp rx=0 tx=0).stop 2023-11-29T11:22:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- 172.21.15.81:0/2842956879 shutdown_connections 2023-11-29T11:22:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 --2- 172.21.15.81:0/2842956879 >> v2:172.21.15.176:3300/0 conn(0x7f31600ce6c0 0x7f31600cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 --2- 172.21.15.81:0/2842956879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316015c280 0x7f31600cd0d0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- 172.21.15.81:0/2842956879 >> 172.21.15.81:0/2842956879 conn(0x7f316006c640 msgr2=0x7f316006ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- 172.21.15.81:0/2842956879 shutdown_connections 2023-11-29T11:22:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- 172.21.15.81:0/2842956879 wait complete. 2023-11-29T11:22:39.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 Processor -- start 2023-11-29T11:22:39.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- start start 2023-11-29T11:22:39.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31600ce6c0 0x7f31600b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f316015beb0 0x7f31600ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f316015c280 0x7f31601f1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600c8130 con 0x7f31600ce6c0 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31601f1650 con 0x7f316015beb0 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.237+0000 7f315ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600c8320 con 0x7f316015c280 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31600ce6c0 0x7f31600b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315e7fc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f316015beb0 0x7f31600ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31600ce6c0 0x7f31600b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43798/0 (socket says 172.21.15.81:43798) 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 -- 172.21.15.81:0/69085517 learned_addr learned my addr 172.21.15.81:0/69085517 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315f7fe700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f316015c280 0x7f31601f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 -- 172.21.15.81:0/69085517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f316015c280 msgr2=0x7f31601f1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f316015c280 0x7f31601f1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 -- 172.21.15.81:0/69085517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f316015beb0 msgr2=0x7f31600ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f316015beb0 0x7f31600ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 -- 172.21.15.81:0/69085517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3158009b30 con 0x7f31600ce6c0 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315effd700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31600ce6c0 0x7f31600b1010 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f314800c500 tx=0x7f314800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f31577fe700 1 -- 172.21.15.81:0/69085517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31480052d0 con 0x7f31600ce6c0 2023-11-29T11:22:39.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f31577fe700 1 -- 172.21.15.81:0/69085517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3148005430 con 0x7f31600ce6c0 2023-11-29T11:22:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31600ce4c0 con 0x7f31600ce6c0 2023-11-29T11:22:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f31577fe700 1 -- 172.21.15.81:0/69085517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31480055a0 con 0x7f31600ce6c0 2023-11-29T11:22:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31600ce330 con 0x7f31600ce6c0 2023-11-29T11:22:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.241+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31600cb650 con 0x7f31600ce6c0 2023-11-29T11:22:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.245+0000 7f31577fe700 1 -- 172.21.15.81:0/69085517 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3148019030 con 0x7f31600ce6c0 2023-11-29T11:22:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.245+0000 7f31577fe700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3140064ee0 0x7f3140067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.245+0000 7f31577fe700 1 -- 172.21.15.81:0/69085517 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f31480811a0 con 0x7f31600ce6c0 2023-11-29T11:22:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.245+0000 7f315e7fc700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3140064ee0 0x7f3140067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.245+0000 7f315e7fc700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3140064ee0 0x7f3140067390 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3158000f80 tx=0x7f3158009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.249+0000 7f31577fe700 1 -- 172.21.15.81:0/69085517 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f314804f200 con 0x7f31600ce6c0 2023-11-29T11:22:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.413+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3160070ae0 con 0x7f31600ce6c0 2023-11-29T11:22:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f31577fe700 1 -- 172.21.15.81:0/69085517 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17988 (secure 0 0 0) 0x7f3148052820 con 0x7f31600ce6c0 2023-11-29T11:22:39.423 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:39.424 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":110,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:22:18.573529+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3140064ee0 msgr2=0x7f3140067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3140064ee0 0x7f3140067390 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3158000f80 tx=0x7f3158009000 comp rx=0 tx=0).stop 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31600ce6c0 msgr2=0x7f31600b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31600ce6c0 0x7f31600b1010 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f314800c500 tx=0x7f314800c810 comp rx=0 tx=0).stop 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 shutdown_connections 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3140064ee0 0x7f3140067390 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f316015c280 0x7f31601f1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f316015beb0 0x7f31600ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 --2- 172.21.15.81:0/69085517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31600ce6c0 0x7f31600b1010 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 >> 172.21.15.81:0/69085517 conn(0x7f316006c640 msgr2=0x7f316015a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 shutdown_connections 2023-11-29T11:22:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.417+0000 7f315ffff700 1 -- 172.21.15.81:0/69085517 wait complete. 2023-11-29T11:22:39.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:22:15.796341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:22:16.553603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:22:39.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:22:39.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe7369700 1 Processor -- start 2023-11-29T11:22:39.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe7369700 1 -- start start 2023-11-29T11:22:39.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe7369700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fe00aaf40 0x7f6fe00b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe7369700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe00ccd00 con 0x7f6fe006b370 2023-11-29T11:22:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe7369700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe00b19b0 con 0x7f6fe015bb80 2023-11-29T11:22:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe7369700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe00cd510 con 0x7f6fe00aaf40 2023-11-29T11:22:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe5b66700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fe00aaf40 0x7f6fe00b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe6b68700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6fe006b370 0x7f6fe015c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48822/0 (socket says 172.21.15.81:48822) 2023-11-29T11:22:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe6b68700 1 -- 172.21.15.81:0/1408351790 learned_addr learned my addr 172.21.15.81:0/1408351790 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:39.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe5b66700 1 -- 172.21.15.81:0/1408351790 >> v1:172.21.15.176:6789/0 conn(0x7f6fe015bb80 legacy=0x7f6fe00b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe5b66700 1 -- 172.21.15.81:0/1408351790 >> v1:172.21.15.81:6789/0 conn(0x7f6fe006b370 legacy=0x7f6fe015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe5b66700 1 -- 172.21.15.81:0/1408351790 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00ccf50 con 0x7f6fe00aaf40 2023-11-29T11:22:39.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe5365700 1 -- 172.21.15.81:0/1408351790 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003083442 0 0) 0x7f6fe00ccd00 con 0x7f6fe006b370 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe5b66700 1 --2- 172.21.15.81:0/1408351790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe00aaf40 0x7f6fe00b2b60 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000a9f0 tx=0x7f6fd000ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1443f4aaa2134a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.561+0000 7f6fe5365700 1 -- 172.21.15.81:0/1408351790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000cb70 con 0x7f6fe00aaf40 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe5365700 1 -- 172.21.15.81:0/1408351790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd000ccd0 con 0x7f6fe00aaf40 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe5365700 1 -- 172.21.15.81:0/1408351790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0018620 con 0x7f6fe00aaf40 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- 172.21.15.81:0/1408351790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe00aaf40 msgr2=0x7f6fe00b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 --2- 172.21.15.81:0/1408351790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe00aaf40 0x7f6fe00b2b60 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000a9f0 tx=0x7f6fd000ad00 comp rx=0 tx=0).stop 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- 172.21.15.81:0/1408351790 shutdown_connections 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 --2- 172.21.15.81:0/1408351790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe00aaf40 0x7f6fe00b2b60 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- 172.21.15.81:0/1408351790 >> 172.21.15.81:0/1408351790 conn(0x7f6fe00cae70 msgr2=0x7f6fe00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- 172.21.15.81:0/1408351790 shutdown_connections 2023-11-29T11:22:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- 172.21.15.81:0/1408351790 wait complete. 2023-11-29T11:22:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 Processor -- start 2023-11-29T11:22:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- start start 2023-11-29T11:22:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe006b370 0x7f6fe01edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00aaf40 0x7f6fe015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe015bb80 0x7f6fe015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe015a680 con 0x7f6fe006b370 2023-11-29T11:22:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00ae150 con 0x7f6fe015bb80 2023-11-29T11:22:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe7369700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0159a00 con 0x7f6fe00aaf40 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe006b370 0x7f6fe01edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe006b370 0x7f6fe01edfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43816/0 (socket says 172.21.15.81:43816) 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 -- 172.21.15.81:0/3774555818 learned_addr learned my addr 172.21.15.81:0/3774555818 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6b68700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe015bb80 0x7f6fe015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe5b66700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00aaf40 0x7f6fe015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 -- 172.21.15.81:0/3774555818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00aaf40 msgr2=0x7f6fe015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00aaf40 0x7f6fe015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 -- 172.21.15.81:0/3774555818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe015bb80 msgr2=0x7f6fe015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe015bb80 0x7f6fe015afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 -- 172.21.15.81:0/3774555818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd000a650 con 0x7f6fe006b370 2023-11-29T11:22:39.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.565+0000 7f6fe6367700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe006b370 0x7f6fe01edfa0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c530 tx=0x7f6fdc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fd6ffd700 1 -- 172.21.15.81:0/3774555818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0052d0 con 0x7f6fe006b370 2023-11-29T11:22:39.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe00b1c50 con 0x7f6fe006b370 2023-11-29T11:22:39.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fd6ffd700 1 -- 172.21.15.81:0/3774555818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc005430 con 0x7f6fe006b370 2023-11-29T11:22:39.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fd6ffd700 1 -- 172.21.15.81:0/3774555818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0055a0 con 0x7f6fe006b370 2023-11-29T11:22:39.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe00cd230 con 0x7f6fe006b370 2023-11-29T11:22:39.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe00b1f30 con 0x7f6fe006b370 2023-11-29T11:22:39.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fd6ffd700 1 -- 172.21.15.81:0/3774555818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6fdc019030 con 0x7f6fe006b370 2023-11-29T11:22:39.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fd6ffd700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fc4064ee0 0x7f6fc4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fd6ffd700 1 -- 172.21.15.81:0/3774555818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6fdc0815d0 con 0x7f6fe006b370 2023-11-29T11:22:39.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.569+0000 7f6fe5b66700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fc4064ee0 0x7f6fc4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.573+0000 7f6fe5b66700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fc4064ee0 0x7f6fc4067390 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000a1c0 tx=0x7f6fd0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.577+0000 7f6fd6ffd700 1 -- 172.21.15.81:0/3774555818 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6fdc04f6e0 con 0x7f6fe006b370 2023-11-29T11:22:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6fe015a7c0 con 0x7f6fe006b370 2023-11-29T11:22:39.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fd6ffd700 1 -- 172.21.15.81:0/3774555818 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6fe015a7c0 con 0x7f6fe006b370 2023-11-29T11:22:39.748 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fc4064ee0 msgr2=0x7f6fc4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fc4064ee0 0x7f6fc4067390 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000a1c0 tx=0x7f6fd0008040 comp rx=0 tx=0).stop 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe006b370 msgr2=0x7f6fe01edfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe006b370 0x7f6fe01edfa0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c530 tx=0x7f6fdc00c840 comp rx=0 tx=0).stop 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 shutdown_connections 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6fc4064ee0 0x7f6fc4067390 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe015bb80 0x7f6fe015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00aaf40 0x7f6fe015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 --2- 172.21.15.81:0/3774555818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fe006b370 0x7f6fe01edfa0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.741+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 >> 172.21.15.81:0/3774555818 conn(0x7f6fe00cae70 msgr2=0x7f6fe00cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.745+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 shutdown_connections 2023-11-29T11:22:39.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.745+0000 7f6fe7369700 1 -- 172.21.15.81:0/3774555818 wait complete. 2023-11-29T11:22:39.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:22:39.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c79386700 1 Processor -- start 2023-11-29T11:22:39.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c79386700 1 -- start start 2023-11-29T11:22:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c79386700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c740b2a90 0x7f3c741670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c79386700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c740cff00 con 0x7f3c7415c350 2023-11-29T11:22:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c79386700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c740d0130 con 0x7f3c740ce4f0 2023-11-29T11:22:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c79386700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c740d06f0 con 0x7f3c740b2a90 2023-11-29T11:22:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c72ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3c7415c350 0x7f3c740b0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52426/0 (socket says 172.21.15.81:52426) 2023-11-29T11:22:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c72ffd700 1 -- 172.21.15.81:0/3812142095 learned_addr learned my addr 172.21.15.81:0/3812142095 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c737fe700 1 --2- 172.21.15.81:0/3812142095 >> v2:172.21.15.176:3300/0 conn(0x7f3c740b2a90 0x7f3c741670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c737fe700 1 -- 172.21.15.81:0/3812142095 >> v1:172.21.15.176:6789/0 conn(0x7f3c740ce4f0 legacy=0x7f3c740b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c737fe700 1 -- 172.21.15.81:0/3812142095 >> v1:172.21.15.81:6789/0 conn(0x7f3c7415c350 legacy=0x7f3c740b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c737fe700 1 -- 172.21.15.81:0/3812142095 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740d0410 con 0x7f3c740b2a90 2023-11-29T11:22:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c71ffb700 1 -- 172.21.15.81:0/3812142095 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612224346 0 0) 0x7f3c740cff00 con 0x7f3c7415c350 2023-11-29T11:22:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c737fe700 1 --2- 172.21.15.81:0/3812142095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 0x7f3c741670e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009d90 tx=0x7f3c6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63e1f89581880a6a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.873+0000 7f3c71ffb700 1 -- 172.21.15.81:0/3812142095 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00e070 con 0x7f3c740b2a90 2023-11-29T11:22:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c71ffb700 1 -- 172.21.15.81:0/3812142095 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c00bbd0 con 0x7f3c740b2a90 2023-11-29T11:22:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c71ffb700 1 -- 172.21.15.81:0/3812142095 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c012430 con 0x7f3c740b2a90 2023-11-29T11:22:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 -- 172.21.15.81:0/3812142095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 msgr2=0x7f3c741670e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 --2- 172.21.15.81:0/3812142095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 0x7f3c741670e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009d90 tx=0x7f3c6c00b330 comp rx=0 tx=0).stop 2023-11-29T11:22:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 -- 172.21.15.81:0/3812142095 shutdown_connections 2023-11-29T11:22:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 --2- 172.21.15.81:0/3812142095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 0x7f3c741670e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 -- 172.21.15.81:0/3812142095 >> 172.21.15.81:0/3812142095 conn(0x7f3c740cd330 msgr2=0x7f3c740cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 -- 172.21.15.81:0/3812142095 shutdown_connections 2023-11-29T11:22:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 -- 172.21.15.81:0/3812142095 wait complete. 2023-11-29T11:22:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 Processor -- start 2023-11-29T11:22:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.877+0000 7f3c79386700 1 -- start start 2023-11-29T11:22:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 0x7f3c7415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c740ce4f0 0x7f3c74154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7415c350 0x7f3c740b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740b58e0 con 0x7f3c7415c350 2023-11-29T11:22:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c740b4a50 con 0x7f3c740b2a90 2023-11-29T11:22:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7415cc60 con 0x7f3c740ce4f0 2023-11-29T11:22:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7415c350 0x7f3c740b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7415c350 0x7f3c740b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41100/0 (socket says 172.21.15.81:41100) 2023-11-29T11:22:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 -- 172.21.15.81:0/1361645136 learned_addr learned my addr 172.21.15.81:0/1361645136 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c72ffd700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 0x7f3c7415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c727fc700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c740ce4f0 0x7f3c74154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 -- 172.21.15.81:0/1361645136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c740ce4f0 msgr2=0x7f3c74154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c740ce4f0 0x7f3c74154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 -- 172.21.15.81:0/1361645136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 msgr2=0x7f3c7415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 0x7f3c7415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 -- 172.21.15.81:0/1361645136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009a70 con 0x7f3c7415c350 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c737fe700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7415c350 0x7f3c740b5d00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c014040 tx=0x7f3c6c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c5b7fe700 1 -- 172.21.15.81:0/1361645136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c01b810 con 0x7f3c7415c350 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c5b7fe700 1 -- 172.21.15.81:0/1361645136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c020070 con 0x7f3c7415c350 2023-11-29T11:22:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c740cb360 con 0x7f3c7415c350 2023-11-29T11:22:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c5b7fe700 1 -- 172.21.15.81:0/1361645136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c01bbb0 con 0x7f3c7415c350 2023-11-29T11:22:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c740cb080 con 0x7f3c7415c350 2023-11-29T11:22:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.881+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c740cc890 con 0x7f3c7415c350 2023-11-29T11:22:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.885+0000 7f3c5b7fe700 1 -- 172.21.15.81:0/1361645136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3c6c01bd10 con 0x7f3c7415c350 2023-11-29T11:22:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.885+0000 7f3c5b7fe700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c60064ee0 0x7f3c60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.885+0000 7f3c72ffd700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c60064ee0 0x7f3c60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.885+0000 7f3c5b7fe700 1 -- 172.21.15.81:0/1361645136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3c6c022070 con 0x7f3c7415c350 2023-11-29T11:22:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.885+0000 7f3c72ffd700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c60064ee0 0x7f3c60067390 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3c64000f60 tx=0x7f3c64004a70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:39.889+0000 7f3c5b7fe700 1 -- 172.21.15.81:0/1361645136 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3c6c052b20 con 0x7f3c7415c350 2023-11-29T11:22:40.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.053+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c740b5a20 con 0x7f3c7415c350 2023-11-29T11:22:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.053+0000 7f3c5b7fe700 1 -- 172.21.15.81:0/1361645136 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c740b5a20 con 0x7f3c7415c350 2023-11-29T11:22:40.060 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c60064ee0 msgr2=0x7f3c60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c60064ee0 0x7f3c60067390 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3c64000f60 tx=0x7f3c64004a70 comp rx=0 tx=0).stop 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7415c350 msgr2=0x7f3c740b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7415c350 0x7f3c740b5d00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c014040 tx=0x7f3c6c004af0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 shutdown_connections 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c60064ee0 0x7f3c60067390 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c7415c350 0x7f3c740b5d00 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c740ce4f0 0x7f3c74154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 --2- 172.21.15.81:0/1361645136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c740b2a90 0x7f3c7415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 >> 172.21.15.81:0/1361645136 conn(0x7f3c740cd330 msgr2=0x7f3c74158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:40.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 shutdown_connections 2023-11-29T11:22:40.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.057+0000 7f3c79386700 1 -- 172.21.15.81:0/1361645136 wait complete. 2023-11-29T11:22:40.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:22:40.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90cec5a700 1 Processor -- start 2023-11-29T11:22:40.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90cec5a700 1 -- start start 2023-11-29T11:22:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90cec5a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90c806a4c0 0x7f90c806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90cec5a700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c806a9c0 con 0x7f90c80cf0e0 2023-11-29T11:22:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90cec5a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c806aca0 con 0x7f90c80b1ae0 2023-11-29T11:22:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90cec5a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80d0ab0 con 0x7f90c806a4c0 2023-11-29T11:22:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90ce459700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90c80cf0e0 0x7f90c80cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52442/0 (socket says 172.21.15.81:52442) 2023-11-29T11:22:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90ce459700 1 -- 172.21.15.81:0/4001410294 learned_addr learned my addr 172.21.15.81:0/4001410294 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:40.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90cd457700 1 --2- 172.21.15.81:0/4001410294 >> v2:172.21.15.176:3300/0 conn(0x7f90c806a4c0 0x7f90c806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.193+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085634335 0 0) 0x7f90c806a9c0 con 0x7f90c80cf0e0 2023-11-29T11:22:40.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b00035d0 con 0x7f90c80cf0e0 2023-11-29T11:22:40.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1860015844 0 0) 0x7f90b00035d0 con 0x7f90c80cf0e0 2023-11-29T11:22:40.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 >> v2:172.21.15.176:3300/0 conn(0x7f90c806a4c0 msgr2=0x7f90c806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:40.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 --2- 172.21.15.81:0/4001410294 >> v2:172.21.15.176:3300/0 conn(0x7f90c806a4c0 0x7f90c806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 >> v1:172.21.15.176:6789/0 conn(0x7f90c80b1ae0 legacy=0x7f90c80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c806af80 con 0x7f90c80cf0e0 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f90b8001670 con 0x7f90c80cf0e0 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 >> v1:172.21.15.81:6789/0 conn(0x7f90c80cf0e0 legacy=0x7f90c80cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b0003a70 0x7f90b0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b0004870 0x7f90b0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0005220 0x7f90b000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80d0ab0 con 0x7f90b0003a70 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b000c100 con 0x7f90b0004870 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b000c2c0 con 0x7f90b0005220 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cdc58700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b0003a70 0x7f90b0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cd457700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b0004870 0x7f90b0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ce459700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0005220 0x7f90b000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cdc58700 1 -- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0005220 msgr2=0x7f90b000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:40.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cdc58700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0005220 0x7f90b000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cdc58700 1 -- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b0004870 msgr2=0x7f90b0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cdc58700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b0004870 0x7f90b0004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cdc58700 1 -- 172.21.15.81:0/4001410294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00035d0 con 0x7f90b0003a70 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ce459700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0005220 0x7f90b000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cd457700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b0004870 0x7f90b0004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ce459700 1 -- 172.21.15.81:0/4001410294 reap_dead start 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cdc58700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b0003a70 0x7f90b0003e80 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f90c000c160 tx=0x7f90b00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a2d6721ed11b7b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0001db0 con 0x7f90b0003a70 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c000ccc0 con 0x7f90b0003a70 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90ccc56700 1 -- 172.21.15.81:0/4001410294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0003c60 con 0x7f90b0003a70 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cec5a700 1 -- 172.21.15.81:0/4001410294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b0003a70 msgr2=0x7f90b0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cec5a700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b0003a70 0x7f90b0003e80 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f90c000c160 tx=0x7f90b00058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cec5a700 1 -- 172.21.15.81:0/4001410294 shutdown_connections 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cec5a700 1 --2- 172.21.15.81:0/4001410294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b0003a70 0x7f90b0003e80 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cec5a700 1 -- 172.21.15.81:0/4001410294 >> 172.21.15.81:0/4001410294 conn(0x7f90c809bbd0 msgr2=0x7f90c80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cec5a700 1 -- 172.21.15.81:0/4001410294 shutdown_connections 2023-11-29T11:22:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.197+0000 7f90cec5a700 1 -- 172.21.15.81:0/4001410294 wait complete. 2023-11-29T11:22:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 Processor -- start 2023-11-29T11:22:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 -- start start 2023-11-29T11:22:40.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0003a70 0x7f90c81586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c8159fe0 0x7f90c80b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80b4ce0 0x7f90c809c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80b5160 con 0x7f90c80b4ce0 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8158fb0 con 0x7f90c8159fe0 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8159220 con 0x7f90b0003a70 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80b4ce0 0x7f90c809c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80b4ce0 0x7f90c809c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41124/0 (socket says 172.21.15.81:41124) 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 -- 172.21.15.81:0/3951938514 learned_addr learned my addr 172.21.15.81:0/3951938514 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cdc58700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0003a70 0x7f90c81586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cd457700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c8159fe0 0x7f90c80b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 -- 172.21.15.81:0/3951938514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0003a70 msgr2=0x7f90c81586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0003a70 0x7f90c81586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 -- 172.21.15.81:0/3951938514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c8159fe0 msgr2=0x7f90c80b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c8159fe0 0x7f90c80b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 -- 172.21.15.81:0/3951938514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c80b1eb0 con 0x7f90c80b4ce0 2023-11-29T11:22:40.211 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90ce459700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80b4ce0 0x7f90c809c8e0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f90c808cb50 tx=0x7f90b800e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90c67fc700 1 -- 172.21.15.81:0/3951938514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8010450 con 0x7f90c80b4ce0 2023-11-29T11:22:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90c67fc700 1 -- 172.21.15.81:0/3951938514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b80105b0 con 0x7f90c80b4ce0 2023-11-29T11:22:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c80b4380 con 0x7f90c80b4ce0 2023-11-29T11:22:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90c67fc700 1 -- 172.21.15.81:0/3951938514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8010920 con 0x7f90c80b4ce0 2023-11-29T11:22:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.201+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c80b60e0 con 0x7f90c80b4ce0 2023-11-29T11:22:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.205+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c8072500 con 0x7f90c80b4ce0 2023-11-29T11:22:40.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.205+0000 7f90c67fc700 1 -- 172.21.15.81:0/3951938514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f90b8010a80 con 0x7f90c80b4ce0 2023-11-29T11:22:40.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.205+0000 7f90c67fc700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90b4064f10 0x7f90b40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.205+0000 7f90c67fc700 1 -- 172.21.15.81:0/3951938514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f90b80814f0 con 0x7f90c80b4ce0 2023-11-29T11:22:40.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.205+0000 7f90cdc58700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90b4064f10 0x7f90b40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.214 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.205+0000 7f90cdc58700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90b4064f10 0x7f90b40673c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f90c0005040 tx=0x7f90c0009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.213+0000 7f90c67fc700 1 -- 172.21.15.81:0/3951938514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f90b804b400 con 0x7f90c80b4ce0 2023-11-29T11:22:40.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.377+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90c80d2640 con 0x7f90c80b4ce0 2023-11-29T11:22:40.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.377+0000 7f90c67fc700 1 -- 172.21.15.81:0/3951938514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90b80580a0 con 0x7f90c80b4ce0 2023-11-29T11:22:40.386 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:22:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90b4064f10 msgr2=0x7f90b40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90b4064f10 0x7f90b40673c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f90c0005040 tx=0x7f90c0009030 comp rx=0 tx=0).stop 2023-11-29T11:22:40.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80b4ce0 msgr2=0x7f90c809c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80b4ce0 0x7f90c809c8e0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f90c808cb50 tx=0x7f90b800e9e0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 shutdown_connections 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f90b4064f10 0x7f90b40673c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80b4ce0 0x7f90c809c8e0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90c8159fe0 0x7f90c80b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 --2- 172.21.15.81:0/3951938514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b0003a70 0x7f90c81586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 >> 172.21.15.81:0/3951938514 conn(0x7f90c809bbd0 msgr2=0x7f90c80d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 shutdown_connections 2023-11-29T11:22:40.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.381+0000 7f90cec5a700 1 -- 172.21.15.81:0/3951938514 wait complete. 2023-11-29T11:22:40.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:22:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a3165e700 1 Processor -- start 2023-11-29T11:22:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a3165e700 1 -- start start 2023-11-29T11:22:40.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a3165e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0ce230 0x7f5a2c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a3165e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a2c0cd5d0 0x7f5a2c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a3165e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2c06d1c0 con 0x7f5a2c158ee0 2023-11-29T11:22:40.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a3165e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c06e000 con 0x7f5a2c0cd5d0 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a3165e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0ca3a0 con 0x7f5a2c0ce230 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a30e5d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a2c0cd5d0 0x7f5a2c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a30e5d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a2c0cd5d0 0x7f5a2c0cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41126/0 (socket says 172.21.15.81:41126) 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a30e5d700 1 -- 172.21.15.81:0/1146359292 learned_addr learned my addr 172.21.15.81:0/1146359292 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a2b7fe700 1 --2- 172.21.15.81:0/1146359292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0ce230 0x7f5a2c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a30e5d700 1 -- 172.21.15.81:0/1146359292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0ce230 msgr2=0x7f5a2c0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a30e5d700 1 --2- 172.21.15.81:0/1146359292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0ce230 0x7f5a2c0ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a30e5d700 1 -- 172.21.15.81:0/1146359292 >> v1:172.21.15.176:6789/0 conn(0x7f5a2c158ee0 legacy=0x7f5a2c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a30e5d700 1 -- 172.21.15.81:0/1146359292 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c06c920 con 0x7f5a2c0cd5d0 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a30e5d700 1 --2- 172.21.15.81:0/1146359292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0cd5d0 0x7f5a2c0cab60 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009910 tx=0x7f5a1c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31347a2213d5fb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a2affd700 1 -- 172.21.15.81:0/1146359292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00ba60 con 0x7f5a2c0cd5d0 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.521+0000 7f5a2affd700 1 -- 172.21.15.81:0/1146359292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c00bbc0 con 0x7f5a2c0cd5d0 2023-11-29T11:22:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a2affd700 1 -- 172.21.15.81:0/1146359292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c009e60 con 0x7f5a2c0cd5d0 2023-11-29T11:22:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 -- 172.21.15.81:0/1146359292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0cd5d0 msgr2=0x7f5a2c0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 --2- 172.21.15.81:0/1146359292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0cd5d0 0x7f5a2c0cab60 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009910 tx=0x7f5a1c009c20 comp rx=0 tx=0).stop 2023-11-29T11:22:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 -- 172.21.15.81:0/1146359292 shutdown_connections 2023-11-29T11:22:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 --2- 172.21.15.81:0/1146359292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0cd5d0 0x7f5a2c0cab60 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 --2- 172.21.15.81:0/1146359292 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0ce230 0x7f5a2c0ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 -- 172.21.15.81:0/1146359292 >> 172.21.15.81:0/1146359292 conn(0x7f5a2c0d0240 msgr2=0x7f5a2c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 -- 172.21.15.81:0/1146359292 shutdown_connections 2023-11-29T11:22:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 -- 172.21.15.81:0/1146359292 wait complete. 2023-11-29T11:22:40.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 Processor -- start 2023-11-29T11:22:40.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 -- start start 2023-11-29T11:22:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0cd5d0 0x7f5a2c157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0ce230 0x7f5a2c0c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a2c158ee0 0x7f5a2c0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.525+0000 7f5a3165e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c15a0b0 con 0x7f5a2c0ce230 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a3165e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c1f18d0 con 0x7f5a2c158ee0 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a3165e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c1594a0 con 0x7f5a2c0cd5d0 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0ce230 0x7f5a2c0c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0ce230 0x7f5a2c0c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41138/0 (socket says 172.21.15.81:41138) 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 -- 172.21.15.81:0/773225097 learned_addr learned my addr 172.21.15.81:0/773225097 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2bfff700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0cd5d0 0x7f5a2c157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a30e5d700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a2c158ee0 0x7f5a2c0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 -- 172.21.15.81:0/773225097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0cd5d0 msgr2=0x7f5a2c157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0cd5d0 0x7f5a2c157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 -- 172.21.15.81:0/773225097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a2c158ee0 msgr2=0x7f5a2c0c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a2c158ee0 0x7f5a2c0c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 -- 172.21.15.81:0/773225097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c009570 con 0x7f5a2c0ce230 2023-11-29T11:22:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a2b7fe700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0ce230 0x7f5a2c0c3010 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400d7d0 tx=0x7f5a1400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a28ff9700 1 -- 172.21.15.81:0/773225097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140126b0 con 0x7f5a2c0ce230 2023-11-29T11:22:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a28ff9700 1 -- 172.21.15.81:0/773225097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14012810 con 0x7f5a2c0ce230 2023-11-29T11:22:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c06cee0 con 0x7f5a2c0ce230 2023-11-29T11:22:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a28ff9700 1 -- 172.21.15.81:0/773225097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14012bc0 con 0x7f5a2c0ce230 2023-11-29T11:22:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c06cc00 con 0x7f5a2c0ce230 2023-11-29T11:22:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.529+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c0ca640 con 0x7f5a2c0ce230 2023-11-29T11:22:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.533+0000 7f5a28ff9700 1 -- 172.21.15.81:0/773225097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5a14012d20 con 0x7f5a2c0ce230 2023-11-29T11:22:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.533+0000 7f5a28ff9700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a0c064f10 0x7f5a0c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.533+0000 7f5a28ff9700 1 -- 172.21.15.81:0/773225097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5a14082360 con 0x7f5a2c0ce230 2023-11-29T11:22:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.533+0000 7f5a2bfff700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a0c064f10 0x7f5a0c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.533+0000 7f5a2bfff700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a0c064f10 0x7f5a0c0673c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c157fc0 tx=0x7f5a24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.541+0000 7f5a28ff9700 1 -- 172.21.15.81:0/773225097 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5a14050250 con 0x7f5a2c0ce230 2023-11-29T11:22:40.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.697+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a2c072c20 con 0x7f5a2c0ce230 2023-11-29T11:22:40.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.697+0000 7f5a28ff9700 1 -- 172.21.15.81:0/773225097 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a14053870 con 0x7f5a2c0ce230 2023-11-29T11:22:40.705 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:22:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a0c064f10 msgr2=0x7f5a0c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a0c064f10 0x7f5a0c0673c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c157fc0 tx=0x7f5a24009040 comp rx=0 tx=0).stop 2023-11-29T11:22:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0ce230 msgr2=0x7f5a2c0c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0ce230 0x7f5a2c0c3010 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400d7d0 tx=0x7f5a1400dae0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 shutdown_connections 2023-11-29T11:22:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f5a0c064f10 0x7f5a0c0673c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a2c158ee0 0x7f5a2c0c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2c0ce230 0x7f5a2c0c3010 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 --2- 172.21.15.81:0/773225097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a2c0cd5d0 0x7f5a2c157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 >> 172.21.15.81:0/773225097 conn(0x7f5a2c0d0240 msgr2=0x7f5a2c06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 shutdown_connections 2023-11-29T11:22:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.701+0000 7f5a3165e700 1 -- 172.21.15.81:0/773225097 wait complete. 2023-11-29T11:22:40.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:22:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.829+0000 7ffad98ad700 1 Processor -- start 2023-11-29T11:22:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.829+0000 7ffad98ad700 1 -- start start 2023-11-29T11:22:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffad415c420 0x7ffad40d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad40ce4c0 0x7ffad406b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad40b1330 con 0x7ffad40b1e20 2023-11-29T11:22:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad40cec30 con 0x7ffad415c420 2023-11-29T11:22:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40b0880 con 0x7ffad40ce4c0 2023-11-29T11:22:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad27fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffad415c420 0x7ffad40d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad27fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffad415c420 0x7ffad40d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41146/0 (socket says 172.21.15.81:41146) 2023-11-29T11:22:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad27fc700 1 -- 172.21.15.81:0/1630586871 learned_addr learned my addr 172.21.15.81:0/1630586871 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad37fe700 1 --2- 172.21.15.81:0/1630586871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad40ce4c0 0x7ffad406b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad27fc700 1 -- 172.21.15.81:0/1630586871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad40ce4c0 msgr2=0x7ffad406b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad27fc700 1 --2- 172.21.15.81:0/1630586871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad40ce4c0 0x7ffad406b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad27fc700 1 -- 172.21.15.81:0/1630586871 >> v1:172.21.15.176:6789/0 conn(0x7ffad40b1e20 legacy=0x7ffad40b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad27fc700 1 -- 172.21.15.81:0/1630586871 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad40b0a90 con 0x7ffad415c420 2023-11-29T11:22:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad27fc700 1 --2- 172.21.15.81:0/1630586871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad415c420 0x7ffad40d01b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009e50 tx=0x7ffacc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80759b8f50d6b07 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad1ffb700 1 -- 172.21.15.81:0/1630586871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00e070 con 0x7ffad415c420 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad1ffb700 1 -- 172.21.15.81:0/1630586871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc00b910 con 0x7ffad415c420 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad1ffb700 1 -- 172.21.15.81:0/1630586871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00bcc0 con 0x7ffad415c420 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 -- 172.21.15.81:0/1630586871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad415c420 msgr2=0x7ffad40d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 --2- 172.21.15.81:0/1630586871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad415c420 0x7ffad40d01b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009e50 tx=0x7ffacc00b330 comp rx=0 tx=0).stop 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 -- 172.21.15.81:0/1630586871 shutdown_connections 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 --2- 172.21.15.81:0/1630586871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad40ce4c0 0x7ffad406b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 --2- 172.21.15.81:0/1630586871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad415c420 0x7ffad40d01b0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 -- 172.21.15.81:0/1630586871 >> 172.21.15.81:0/1630586871 conn(0x7ffad40cd370 msgr2=0x7ffad40cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 -- 172.21.15.81:0/1630586871 shutdown_connections 2023-11-29T11:22:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.833+0000 7ffad98ad700 1 -- 172.21.15.81:0/1630586871 wait complete. 2023-11-29T11:22:40.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 Processor -- start 2023-11-29T11:22:40.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 -- start start 2023-11-29T11:22:40.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffad40b1e20 0x7ffad41514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad40ce4c0 0x7ffad406e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad415c420 0x7ffad406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad415e4f0 con 0x7ffad40ce4c0 2023-11-29T11:22:40.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad415d870 con 0x7ffad40b1e20 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad415db50 con 0x7ffad415c420 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad40ce4c0 0x7ffad406e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad40ce4c0 0x7ffad406e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41152/0 (socket says 172.21.15.81:41152) 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 -- 172.21.15.81:0/3735996271 learned_addr learned my addr 172.21.15.81:0/3735996271 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad2ffd700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffad40b1e20 0x7ffad41514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad37fe700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad415c420 0x7ffad406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 -- 172.21.15.81:0/3735996271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad415c420 msgr2=0x7ffad406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad415c420 0x7ffad406e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 -- 172.21.15.81:0/3735996271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffad40b1e20 msgr2=0x7ffad41514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffad40b1e20 0x7ffad41514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 -- 172.21.15.81:0/3735996271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc009b30 con 0x7ffad40ce4c0 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad27fc700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad40ce4c0 0x7ffad406e0a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00b370 tx=0x7ffacc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffacbfff700 1 -- 172.21.15.81:0/3735996271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc004800 con 0x7ffad40ce4c0 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffacbfff700 1 -- 172.21.15.81:0/3735996271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0092e0 con 0x7ffad40ce4c0 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffacbfff700 1 -- 172.21.15.81:0/3735996271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc01b670 con 0x7ffad40ce4c0 2023-11-29T11:22:40.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad40b1050 con 0x7ffad40ce4c0 2023-11-29T11:22:40.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.837+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad40b0d70 con 0x7ffad40ce4c0 2023-11-29T11:22:40.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.841+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad40ce900 con 0x7ffad40ce4c0 2023-11-29T11:22:40.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.841+0000 7ffacbfff700 1 -- 172.21.15.81:0/3735996271 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffacc021030 con 0x7ffad40ce4c0 2023-11-29T11:22:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.841+0000 7ffacbfff700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffab4064ee0 0x7ffab4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.841+0000 7ffacbfff700 1 -- 172.21.15.81:0/3735996271 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffacc0833e0 con 0x7ffad40ce4c0 2023-11-29T11:22:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.841+0000 7ffad2ffd700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffab4064ee0 0x7ffab4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:40.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.845+0000 7ffad2ffd700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffab4064ee0 0x7ffab4067390 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ffabc000f60 tx=0x7ffabc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:40.853+0000 7ffacbfff700 1 -- 172.21.15.81:0/3735996271 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffacc0513c0 con 0x7ffad40ce4c0 2023-11-29T11:22:41.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffad415e630 con 0x7ffad40ce4c0 2023-11-29T11:22:41.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffacbfff700 1 -- 172.21.15.81:0/3735996271 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffad415e630 con 0x7ffad40ce4c0 2023-11-29T11:22:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffab4064ee0 msgr2=0x7ffab4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffab4064ee0 0x7ffab4067390 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ffabc000f60 tx=0x7ffabc009040 comp rx=0 tx=0).stop 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad40ce4c0 msgr2=0x7ffad406e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad40ce4c0 0x7ffad406e0a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00b370 tx=0x7ffacc004af0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 shutdown_connections 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ffab4064ee0 0x7ffab4067390 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffad415c420 0x7ffad406e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad40ce4c0 0x7ffad406e0a0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 --2- 172.21.15.81:0/3735996271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffad40b1e20 0x7ffad41514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 >> 172.21.15.81:0/3735996271 conn(0x7ffad40cd370 msgr2=0x7ffad415b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 shutdown_connections 2023-11-29T11:22:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.025+0000 7ffad98ad700 1 -- 172.21.15.81:0/3735996271 wait complete. 2023-11-29T11:22:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:22:41.046 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:41.046 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:41.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:22:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f4a6e4700 1 Processor -- start 2023-11-29T11:22:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f4a6e4700 1 -- start start 2023-11-29T11:22:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f4a6e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f44069c40 0x7f8f440cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f4a6e4700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8f440cb2a0 0x7f8f440c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f4a6e4700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4406ace0 con 0x7f8f44159e70 2023-11-29T11:22:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f4a6e4700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f440cb720 con 0x7f8f440cb2a0 2023-11-29T11:22:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f4a6e4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4406a0d0 con 0x7f8f44069c40 2023-11-29T11:22:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f496e2700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8f44159e70 0x7f8f4406c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52450/0 (socket says 172.21.15.81:52450) 2023-11-29T11:22:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f496e2700 1 -- 172.21.15.81:0/2668213834 learned_addr learned my addr 172.21.15.81:0/2668213834 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f49ee3700 1 --2- 172.21.15.81:0/2668213834 >> v2:172.21.15.81:3300/0 conn(0x7f8f440cb2a0 0x7f8f440c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f48ee1700 1 --2- 172.21.15.81:0/2668213834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f44069c40 0x7f8f440cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f43fff700 1 -- 172.21.15.81:0/2668213834 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420073319 0 0) 0x7f8f4406ace0 con 0x7f8f44159e70 2023-11-29T11:22:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f48ee1700 1 -- 172.21.15.81:0/2668213834 >> v2:172.21.15.81:3300/0 conn(0x7f8f440cb2a0 msgr2=0x7f8f440c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f48ee1700 1 --2- 172.21.15.81:0/2668213834 >> v2:172.21.15.81:3300/0 conn(0x7f8f440cb2a0 0x7f8f440c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f48ee1700 1 -- 172.21.15.81:0/2668213834 >> v1:172.21.15.81:6789/0 conn(0x7f8f44159e70 legacy=0x7f8f4406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f48ee1700 1 -- 172.21.15.81:0/2668213834 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4406a3b0 con 0x7f8f44069c40 2023-11-29T11:22:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f48ee1700 1 --2- 172.21.15.81:0/2668213834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f44069c40 0x7f8f440cad60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009850 tx=0x7f8f38009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b07b09a3798235fa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f43fff700 1 -- 172.21.15.81:0/2668213834 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38011830 con 0x7f8f44069c40 2023-11-29T11:22:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f43fff700 1 -- 172.21.15.81:0/2668213834 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38011990 con 0x7f8f44069c40 2023-11-29T11:22:41.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.213+0000 7f8f43fff700 1 -- 172.21.15.81:0/2668213834 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38011d40 con 0x7f8f44069c40 2023-11-29T11:22:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/2668213834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f44069c40 msgr2=0x7f8f440cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/2668213834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f44069c40 0x7f8f440cad60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009850 tx=0x7f8f38009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/2668213834 shutdown_connections 2023-11-29T11:22:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/2668213834 >> v2:172.21.15.81:3300/0 conn(0x7f8f440cb2a0 0x7f8f440c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/2668213834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f44069c40 0x7f8f440cad60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/2668213834 >> 172.21.15.81:0/2668213834 conn(0x7f8f440ce3e0 msgr2=0x7f8f440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/2668213834 shutdown_connections 2023-11-29T11:22:41.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/2668213834 wait complete. 2023-11-29T11:22:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 Processor -- start 2023-11-29T11:22:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- start start 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f44069c40 0x7f8f4415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f440cb2a0 0x7f8f440c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f44159e70 0x7f8f4414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4415b540 con 0x7f8f44159e70 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440c41e0 con 0x7f8f44069c40 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440c4480 con 0x7f8f440cb2a0 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f44159e70 0x7f8f4414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f44159e70 0x7f8f4414ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41184/0 (socket says 172.21.15.81:41184) 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 -- 172.21.15.81:0/3034730177 learned_addr learned my addr 172.21.15.81:0/3034730177 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f496e2700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f44069c40 0x7f8f4415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f48ee1700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f440cb2a0 0x7f8f440c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 -- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f440cb2a0 msgr2=0x7f8f440c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f440cb2a0 0x7f8f440c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 -- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f44069c40 msgr2=0x7f8f4415b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f44069c40 0x7f8f4415b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 -- 172.21.15.81:0/3034730177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f380094b0 con 0x7f8f44159e70 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f48ee1700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f440cb2a0 0x7f8f440c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f49ee3700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f44159e70 0x7f8f4414ef50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400eb60 tx=0x7f8f3400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f41ffb700 1 -- 172.21.15.81:0/3034730177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34009740 con 0x7f8f44159e70 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f41ffb700 1 -- 172.21.15.81:0/3034730177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3400c850 con 0x7f8f44159e70 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.217+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4406a970 con 0x7f8f44159e70 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.221+0000 7f8f41ffb700 1 -- 172.21.15.81:0/3034730177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400cbe0 con 0x7f8f44159e70 2023-11-29T11:22:41.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.221+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4406a690 con 0x7f8f44159e70 2023-11-29T11:22:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.221+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4406d0b0 con 0x7f8f44159e70 2023-11-29T11:22:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.221+0000 7f8f41ffb700 1 -- 172.21.15.81:0/3034730177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8f34019030 con 0x7f8f44159e70 2023-11-29T11:22:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.221+0000 7f8f41ffb700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8f30064ee0 0x7f8f30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.221+0000 7f8f41ffb700 1 -- 172.21.15.81:0/3034730177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8f34081fe0 con 0x7f8f44159e70 2023-11-29T11:22:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.221+0000 7f8f496e2700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8f30064ee0 0x7f8f30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.221+0000 7f8f496e2700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8f30064ee0 0x7f8f30067390 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0012e0 tx=0x7f8f3c001aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.229+0000 7f8f41ffb700 1 -- 172.21.15.81:0/3034730177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8f3404ff60 con 0x7f8f44159e70 2023-11-29T11:22:41.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.393+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f44072500 con 0x7f8f44159e70 2023-11-29T11:22:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.397+0000 7f8f41ffb700 1 -- 172.21.15.81:0/3034730177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17988 (secure 0 0 0) 0x7f8f34053580 con 0x7f8f44159e70 2023-11-29T11:22:41.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:41.406 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":110,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:22:18.573529+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8f30064ee0 msgr2=0x7f8f30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8f30064ee0 0x7f8f30067390 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0012e0 tx=0x7f8f3c001aa0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f44159e70 msgr2=0x7f8f4414ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f44159e70 0x7f8f4414ef50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400eb60 tx=0x7f8f3400ee70 comp rx=0 tx=0).stop 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 shutdown_connections 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8f30064ee0 0x7f8f30067390 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f44159e70 0x7f8f4414ef50 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f440cb2a0 0x7f8f440c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 --2- 172.21.15.81:0/3034730177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f44069c40 0x7f8f4415b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 >> 172.21.15.81:0/3034730177 conn(0x7f8f440ce3e0 msgr2=0x7f8f44153620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 shutdown_connections 2023-11-29T11:22:41.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.401+0000 7f8f4a6e4700 1 -- 172.21.15.81:0/3034730177 wait complete. 2023-11-29T11:22:41.420 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:22:15.796341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:22:16.553603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:22:41.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:22:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.529+0000 7f9a60f71700 1 Processor -- start 2023-11-29T11:22:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.529+0000 7f9a60f71700 1 -- start start 2023-11-29T11:22:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9a5c0cf7f0 0x7f9a5c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c06a9c0 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c06aca0 con 0x7f9a5c06a4c0 2023-11-29T11:22:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0d0ab0 con 0x7f9a5c0cf7f0 2023-11-29T11:22:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5b7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9a5c0b1ae0 0x7f9a5c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52464/0 (socket says 172.21.15.81:52464) 2023-11-29T11:22:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5b7fe700 1 -- 172.21.15.81:0/2713071953 learned_addr learned my addr 172.21.15.81:0/2713071953 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5bfff700 1 --2- 172.21.15.81:0/2713071953 >> v2:172.21.15.176:3300/0 conn(0x7f9a5c0cf7f0 0x7f9a5c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5a7fc700 1 -- 172.21.15.81:0/2713071953 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330074606 0 0) 0x7f9a5c06a9c0 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5a7fc700 1 -- 172.21.15.81:0/2713071953 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a440035d0 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5bfff700 1 -- 172.21.15.81:0/2713071953 >> v1:172.21.15.176:6789/0 conn(0x7f9a5c06a4c0 legacy=0x7f9a5c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5bfff700 1 -- 172.21.15.81:0/2713071953 >> v1:172.21.15.81:6789/0 conn(0x7f9a5c0b1ae0 legacy=0x7f9a5c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5bfff700 1 -- 172.21.15.81:0/2713071953 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c06af80 con 0x7f9a5c0cf7f0 2023-11-29T11:22:41.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5bfff700 1 --2- 172.21.15.81:0/2713071953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c0cf7f0 0x7f9a5c06d8e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009d90 tx=0x7f9a5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=176727368ce292e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5a7fc700 1 -- 172.21.15.81:0/2713071953 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400e070 con 0x7f9a5c0cf7f0 2023-11-29T11:22:41.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5a7fc700 1 -- 172.21.15.81:0/2713071953 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5400bb20 con 0x7f9a5c0cf7f0 2023-11-29T11:22:41.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a5a7fc700 1 -- 172.21.15.81:0/2713071953 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400be90 con 0x7f9a5c0cf7f0 2023-11-29T11:22:41.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 -- 172.21.15.81:0/2713071953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c0cf7f0 msgr2=0x7f9a5c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 --2- 172.21.15.81:0/2713071953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c0cf7f0 0x7f9a5c06d8e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009d90 tx=0x7f9a5400b330 comp rx=0 tx=0).stop 2023-11-29T11:22:41.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 -- 172.21.15.81:0/2713071953 shutdown_connections 2023-11-29T11:22:41.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 --2- 172.21.15.81:0/2713071953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c0cf7f0 0x7f9a5c06d8e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 -- 172.21.15.81:0/2713071953 >> 172.21.15.81:0/2713071953 conn(0x7f9a5c09bbd0 msgr2=0x7f9a5c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:41.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 -- 172.21.15.81:0/2713071953 shutdown_connections 2023-11-29T11:22:41.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.533+0000 7f9a60f71700 1 -- 172.21.15.81:0/2713071953 wait complete. 2023-11-29T11:22:41.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a60f71700 1 Processor -- start 2023-11-29T11:22:41.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a60f71700 1 -- start start 2023-11-29T11:22:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a60f71700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c06a4c0 0x7f9a5c15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a60f71700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0b1ae0 0x7f9a5c1f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a60f71700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a5c0cf7f0 0x7f9a5c1f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a60f71700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0a0330 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a60f71700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0c61f0 con 0x7f9a5c06a4c0 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a60f71700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c15dad0 con 0x7f9a5c0cf7f0 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0b1ae0 0x7f9a5c1f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0b1ae0 0x7f9a5c1f1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41196/0 (socket says 172.21.15.81:41196) 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 -- 172.21.15.81:0/1116583213 learned_addr learned my addr 172.21.15.81:0/1116583213 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5bfff700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a5c0cf7f0 0x7f9a5c1f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5b7fe700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c06a4c0 0x7f9a5c15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 -- 172.21.15.81:0/1116583213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a5c0cf7f0 msgr2=0x7f9a5c1f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a5c0cf7f0 0x7f9a5c1f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 -- 172.21.15.81:0/1116583213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c06a4c0 msgr2=0x7f9a5c15d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c06a4c0 0x7f9a5c15d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 -- 172.21.15.81:0/1116583213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54009a70 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.537+0000 7f9a5affd700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0b1ae0 0x7f9a5c1f1840 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00c410 tx=0x7f9a4c00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a43fff700 1 -- 172.21.15.81:0/1116583213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0052d0 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a43fff700 1 -- 172.21.15.81:0/1116583213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c005430 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c0b1eb0 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a43fff700 1 -- 172.21.15.81:0/1116583213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0055a0 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c0b4380 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c0b60e0 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a43fff700 1 -- 172.21.15.81:0/1116583213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9a4c010050 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a43fff700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9a48064ee0 0x7f9a48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a43fff700 1 -- 172.21.15.81:0/1116583213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9a4c081050 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.541+0000 7f9a5b7fe700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9a48064ee0 0x7f9a48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.545+0000 7f9a5b7fe700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9a48064ee0 0x7f9a48067390 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9a50007fd0 tx=0x7f9a50007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.549+0000 7f9a43fff700 1 -- 172.21.15.81:0/1116583213 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9a4c049400 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.709+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a5c072500 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.709+0000 7f9a43fff700 1 -- 172.21.15.81:0/1116583213 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a4c04efd0 con 0x7f9a5c0b1ae0 2023-11-29T11:22:41.718 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9a48064ee0 msgr2=0x7f9a48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9a48064ee0 0x7f9a48067390 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9a50007fd0 tx=0x7f9a50007de0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0b1ae0 msgr2=0x7f9a5c1f1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0b1ae0 0x7f9a5c1f1840 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00c410 tx=0x7f9a4c00c720 comp rx=0 tx=0).stop 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 shutdown_connections 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9a48064ee0 0x7f9a48067390 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9a5c0cf7f0 0x7f9a5c1f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0b1ae0 0x7f9a5c1f1840 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 --2- 172.21.15.81:0/1116583213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9a5c06a4c0 0x7f9a5c15d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 >> 172.21.15.81:0/1116583213 conn(0x7f9a5c09bbd0 msgr2=0x7f9a5c06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:41.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 shutdown_connections 2023-11-29T11:22:41.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.713+0000 7f9a60f71700 1 -- 172.21.15.81:0/1116583213 wait complete. 2023-11-29T11:22:41.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:22:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.833+0000 7f2a6498d700 1 Processor -- start 2023-11-29T11:22:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.833+0000 7f2a6498d700 1 -- start start 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.833+0000 7f2a6498d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a6006a4c0 0x7f2a6006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.833+0000 7f2a6498d700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6006a9c0 con 0x7f2a600b1ae0 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.833+0000 7f2a6498d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6006aca0 con 0x7f2a600cf0e0 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.833+0000 7f2a6498d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a600d0ab0 con 0x7f2a6006a4c0 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.833+0000 7f2a5f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a600b1ae0 0x7f2a600d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52478/0 (socket says 172.21.15.81:52478) 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/3497250835 learned_addr learned my addr 172.21.15.81:0/3497250835 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5effd700 1 --2- 172.21.15.81:0/3497250835 >> v2:172.21.15.176:3300/0 conn(0x7f2a6006a4c0 0x7f2a6006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5e7fc700 1 -- 172.21.15.81:0/3497250835 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421446625 0 0) 0x7f2a6006a9c0 con 0x7f2a600b1ae0 2023-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5e7fc700 1 -- 172.21.15.81:0/3497250835 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a480035d0 con 0x7f2a600b1ae0 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5e7fc700 1 -- 172.21.15.81:0/3497250835 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 783191067 0 0) 0x7f2a480035d0 con 0x7f2a600b1ae0 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5effd700 1 -- 172.21.15.81:0/3497250835 >> v1:172.21.15.176:6789/0 conn(0x7f2a600cf0e0 legacy=0x7f2a600cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5effd700 1 -- 172.21.15.81:0/3497250835 >> v1:172.21.15.81:6789/0 conn(0x7f2a600b1ae0 legacy=0x7f2a600d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5effd700 1 -- 172.21.15.81:0/3497250835 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6006af80 con 0x7f2a6006a4c0 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5effd700 1 --2- 172.21.15.81:0/3497250835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6006a4c0 0x7f2a6006d8e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009850 tx=0x7f2a54009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e7857c383b42292 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5e7fc700 1 -- 172.21.15.81:0/3497250835 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50001670 con 0x7f2a6006a4c0 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5e7fc700 1 -- 172.21.15.81:0/3497250835 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a54004030 con 0x7f2a6006a4c0 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a5e7fc700 1 -- 172.21.15.81:0/3497250835 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540043a0 con 0x7f2a6006a4c0 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a6498d700 1 -- 172.21.15.81:0/3497250835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6006a4c0 msgr2=0x7f2a6006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a6498d700 1 --2- 172.21.15.81:0/3497250835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6006a4c0 0x7f2a6006d8e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009850 tx=0x7f2a54009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a6498d700 1 -- 172.21.15.81:0/3497250835 shutdown_connections 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a6498d700 1 --2- 172.21.15.81:0/3497250835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a6006a4c0 0x7f2a6006d8e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a6498d700 1 -- 172.21.15.81:0/3497250835 >> 172.21.15.81:0/3497250835 conn(0x7f2a6009bbd0 msgr2=0x7f2a600b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a6498d700 1 -- 172.21.15.81:0/3497250835 shutdown_connections 2023-11-29T11:22:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a6498d700 1 -- 172.21.15.81:0/3497250835 wait complete. 2023-11-29T11:22:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.837+0000 7f2a6498d700 1 Processor -- start 2023-11-29T11:22:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 -- start start 2023-11-29T11:22:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6006a4c0 0x7f2a60150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a600b1ae0 0x7f2a600b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a600cf0e0 0x7f2a600b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600b37c0 con 0x7f2a6006a4c0 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600b2bb0 con 0x7f2a600cf0e0 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600b2e90 con 0x7f2a600b1ae0 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6006a4c0 0x7f2a60150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6006a4c0 0x7f2a60150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41212/0 (socket says 172.21.15.81:41212) 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/3672643763 learned_addr learned my addr 172.21.15.81:0/3672643763 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5ffff700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a600cf0e0 0x7f2a600b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5effd700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a600b1ae0 0x7f2a600b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a600b1ae0 msgr2=0x7f2a600b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a600b1ae0 0x7f2a600b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a600cf0e0 msgr2=0x7f2a600b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a600cf0e0 0x7f2a600b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/3672643763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540094b0 con 0x7f2a6006a4c0 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5ffff700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a600cf0e0 0x7f2a600b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5effd700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a600b1ae0 0x7f2a600b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a5f7fe700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6006a4c0 0x7f2a60150d50 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000c540 tx=0x7f2a5000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a47fff700 1 -- 172.21.15.81:0/3672643763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50004ca0 con 0x7f2a6006a4c0 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a47fff700 1 -- 172.21.15.81:0/3672643763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a50004e00 con 0x7f2a6006a4c0 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a600b1eb0 con 0x7f2a6006a4c0 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a47fff700 1 -- 172.21.15.81:0/3672643763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50007310 con 0x7f2a6006a4c0 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.841+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a600b4380 con 0x7f2a6006a4c0 2023-11-29T11:22:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.845+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a600b60e0 con 0x7f2a6006a4c0 2023-11-29T11:22:41.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.845+0000 7f2a47fff700 1 -- 172.21.15.81:0/3672643763 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2a5001a020 con 0x7f2a6006a4c0 2023-11-29T11:22:41.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.845+0000 7f2a47fff700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a4c064ee0 0x7f2a4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:41.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.845+0000 7f2a47fff700 1 -- 172.21.15.81:0/3672643763 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2a50081e40 con 0x7f2a6006a4c0 2023-11-29T11:22:41.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.845+0000 7f2a5effd700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a4c064ee0 0x7f2a4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.845+0000 7f2a5effd700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a4c064ee0 0x7f2a4c067390 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2a540090b0 tx=0x7f2a54013040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:41.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:41.853+0000 7f2a47fff700 1 -- 172.21.15.81:0/3672643763 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2a5004fd30 con 0x7f2a6006a4c0 2023-11-29T11:22:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.013+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a600cebb0 con 0x7f2a6006a4c0 2023-11-29T11:22:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.013+0000 7f2a47fff700 1 -- 172.21.15.81:0/3672643763 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a50053350 con 0x7f2a6006a4c0 2023-11-29T11:22:42.022 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:22:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a4c064ee0 msgr2=0x7f2a4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a4c064ee0 0x7f2a4c067390 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2a540090b0 tx=0x7f2a54013040 comp rx=0 tx=0).stop 2023-11-29T11:22:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6006a4c0 msgr2=0x7f2a60150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6006a4c0 0x7f2a60150d50 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000c540 tx=0x7f2a5000c900 comp rx=0 tx=0).stop 2023-11-29T11:22:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 shutdown_connections 2023-11-29T11:22:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2a4c064ee0 0x7f2a4c067390 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a600cf0e0 0x7f2a600b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a600b1ae0 0x7f2a600b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 --2- 172.21.15.81:0/3672643763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6006a4c0 0x7f2a60150d50 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 >> 172.21.15.81:0/3672643763 conn(0x7f2a6009bbd0 msgr2=0x7f2a600d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:42.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 shutdown_connections 2023-11-29T11:22:42.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.017+0000 7f2a6498d700 1 -- 172.21.15.81:0/3672643763 wait complete. 2023-11-29T11:22:42.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:22:42.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.145+0000 7f247759e700 1 Processor -- start 2023-11-29T11:22:42.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.145+0000 7f247759e700 1 -- start start 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2478157a00 0x7f24780caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2478157dd0 0x7f24780cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247815e970 con 0x7f24780ced30 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247815a700 con 0x7f2478157dd0 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247806a230 con 0x7f2478157a00 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f246dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2478157dd0 0x7f24780cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f246dd9b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2478157dd0 0x7f24780cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41214/0 (socket says 172.21.15.81:41214) 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f246dd9b700 1 -- 172.21.15.81:0/4172849940 learned_addr learned my addr 172.21.15.81:0/4172849940 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247659c700 1 --2- 172.21.15.81:0/4172849940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2478157a00 0x7f24780caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f246dd9b700 1 -- 172.21.15.81:0/4172849940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2478157a00 msgr2=0x7f24780caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f246dd9b700 1 --2- 172.21.15.81:0/4172849940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2478157a00 0x7f24780caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f246dd9b700 1 -- 172.21.15.81:0/4172849940 >> v1:172.21.15.176:6789/0 conn(0x7f24780ced30 legacy=0x7f247815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f246dd9b700 1 -- 172.21.15.81:0/4172849940 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247806b9f0 con 0x7f2478157dd0 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f246dd9b700 1 --2- 172.21.15.81:0/4172849940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2478157dd0 0x7f24780cb0f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f2460009940 tx=0x7f2460009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a51ffccf1c160c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f2475d9b700 1 -- 172.21.15.81:0/4172849940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000ba20 con 0x7f2478157dd0 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f2475d9b700 1 -- 172.21.15.81:0/4172849940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460009e90 con 0x7f2478157dd0 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f2475d9b700 1 -- 172.21.15.81:0/4172849940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000bda0 con 0x7f2478157dd0 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 -- 172.21.15.81:0/4172849940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2478157dd0 msgr2=0x7f24780cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 --2- 172.21.15.81:0/4172849940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2478157dd0 0x7f24780cb0f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f2460009940 tx=0x7f2460009c50 comp rx=0 tx=0).stop 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 -- 172.21.15.81:0/4172849940 shutdown_connections 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 --2- 172.21.15.81:0/4172849940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2478157dd0 0x7f24780cb0f0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 --2- 172.21.15.81:0/4172849940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2478157a00 0x7f24780caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 -- 172.21.15.81:0/4172849940 >> 172.21.15.81:0/4172849940 conn(0x7f247806c660 msgr2=0x7f247806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 -- 172.21.15.81:0/4172849940 shutdown_connections 2023-11-29T11:22:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.149+0000 7f247759e700 1 -- 172.21.15.81:0/4172849940 wait complete. 2023-11-29T11:22:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 Processor -- start 2023-11-29T11:22:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 -- start start 2023-11-29T11:22:42.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24780ced30 0x7f24780c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2478157a00 0x7f24781ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24780b3920 0x7f24780b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24780b4300 con 0x7f24780b3920 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24780c5310 con 0x7f2478157a00 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24780c3840 con 0x7f24780ced30 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24780b3920 0x7f24780b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24780b3920 0x7f24780b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41216/0 (socket says 172.21.15.81:41216) 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 -- 172.21.15.81:0/254281623 learned_addr learned my addr 172.21.15.81:0/254281623 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f246dd9b700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2478157a00 0x7f24781ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247659c700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24780ced30 0x7f24780c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 -- 172.21.15.81:0/254281623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24780ced30 msgr2=0x7f24780c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24780ced30 0x7f24780c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 -- 172.21.15.81:0/254281623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2478157a00 msgr2=0x7f24781ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2478157a00 0x7f24781ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 -- 172.21.15.81:0/254281623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009570 con 0x7f24780b3920 2023-11-29T11:22:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f2476d9d700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24780b3920 0x7f24780b3dc0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f247000cb50 tx=0x7f247000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f246f7fe700 1 -- 172.21.15.81:0/254281623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470003c20 con 0x7f24780b3920 2023-11-29T11:22:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f246f7fe700 1 -- 172.21.15.81:0/254281623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470003d80 con 0x7f24780b3920 2023-11-29T11:22:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.153+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2478071790 con 0x7f24780b3920 2023-11-29T11:22:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.157+0000 7f246f7fe700 1 -- 172.21.15.81:0/254281623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000aa20 con 0x7f24780b3920 2023-11-29T11:22:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.157+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247806bcd0 con 0x7f24780b3920 2023-11-29T11:22:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.157+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24780ca360 con 0x7f24780b3920 2023-11-29T11:22:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.157+0000 7f246f7fe700 1 -- 172.21.15.81:0/254281623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2470010050 con 0x7f24780b3920 2023-11-29T11:22:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.157+0000 7f246f7fe700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2458064f10 0x7f24580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.157+0000 7f246f7fe700 1 -- 172.21.15.81:0/254281623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2470081fe0 con 0x7f24780b3920 2023-11-29T11:22:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.157+0000 7f247659c700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2458064f10 0x7f24580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.161+0000 7f247659c700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2458064f10 0x7f24580673c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f24780caf20 tx=0x7f2468008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.165+0000 7f246f7fe700 1 -- 172.21.15.81:0/254281623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f247004ff50 con 0x7f24780b3920 2023-11-29T11:22:42.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.329+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2478071920 con 0x7f24780b3920 2023-11-29T11:22:42.338 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.329+0000 7f246f7fe700 1 -- 172.21.15.81:0/254281623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2478071920 con 0x7f24780b3920 2023-11-29T11:22:42.338 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2458064f10 msgr2=0x7f24580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2458064f10 0x7f24580673c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f24780caf20 tx=0x7f2468008040 comp rx=0 tx=0).stop 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24780b3920 msgr2=0x7f24780b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24780b3920 0x7f24780b3dc0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f247000cb50 tx=0x7f247000ce60 comp rx=0 tx=0).stop 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 shutdown_connections 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2458064f10 0x7f24580673c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24780b3920 0x7f24780b3dc0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2478157a00 0x7f24781ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 --2- 172.21.15.81:0/254281623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24780ced30 0x7f24780c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 >> 172.21.15.81:0/254281623 conn(0x7f247806c660 msgr2=0x7f24780cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 shutdown_connections 2023-11-29T11:22:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.333+0000 7f247759e700 1 -- 172.21.15.81:0/254281623 wait complete. 2023-11-29T11:22:42.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:22:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.473+0000 7ff51b59e700 1 Processor -- start 2023-11-29T11:22:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.473+0000 7ff51b59e700 1 -- start start 2023-11-29T11:22:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff51c158480 0x7ff51c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff51c0cd3a0 0x7ff51c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51b59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c06a4d0 con 0x7ff51c158850 2023-11-29T11:22:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c0cc1f0 con 0x7ff51c0cd3a0 2023-11-29T11:22:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c0cc490 con 0x7ff51c158480 2023-11-29T11:22:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff51c0cd3a0 0x7ff51c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff51c0cd3a0 0x7ff51c0ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41220/0 (socket says 172.21.15.81:41220) 2023-11-29T11:22:42.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51ad9d700 1 -- 172.21.15.81:0/2077844757 learned_addr learned my addr 172.21.15.81:0/2077844757 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:42.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51a59c700 1 --2- 172.21.15.81:0/2077844757 >> v2:172.21.15.176:3300/0 conn(0x7ff51c158480 0x7ff51c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51ad9d700 1 -- 172.21.15.81:0/2077844757 >> v2:172.21.15.176:3300/0 conn(0x7ff51c158480 msgr2=0x7ff51c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51ad9d700 1 --2- 172.21.15.81:0/2077844757 >> v2:172.21.15.176:3300/0 conn(0x7ff51c158480 0x7ff51c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51ad9d700 1 -- 172.21.15.81:0/2077844757 >> v1:172.21.15.176:6789/0 conn(0x7ff51c158850 legacy=0x7ff51c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51ad9d700 1 -- 172.21.15.81:0/2077844757 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c06a720 con 0x7ff51c0cd3a0 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51a59c700 1 --2- 172.21.15.81:0/2077844757 >> v2:172.21.15.176:3300/0 conn(0x7ff51c158480 0x7ff51c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51ad9d700 1 --2- 172.21.15.81:0/2077844757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c0cd3a0 0x7ff51c0ceca0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0b19d0 tx=0x7ff51400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deb678e3c0b520a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff519d9b700 1 -- 172.21.15.81:0/2077844757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400e070 con 0x7ff51c0cd3a0 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff519d9b700 1 -- 172.21.15.81:0/2077844757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51400b9c0 con 0x7ff51c0cd3a0 2023-11-29T11:22:42.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff519d9b700 1 -- 172.21.15.81:0/2077844757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400bd70 con 0x7ff51c0cd3a0 2023-11-29T11:22:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51b59e700 1 -- 172.21.15.81:0/2077844757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c0cd3a0 msgr2=0x7ff51c0ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.477+0000 7ff51b59e700 1 --2- 172.21.15.81:0/2077844757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c0cd3a0 0x7ff51c0ceca0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0b19d0 tx=0x7ff51400b330 comp rx=0 tx=0).stop 2023-11-29T11:22:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 -- 172.21.15.81:0/2077844757 shutdown_connections 2023-11-29T11:22:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 --2- 172.21.15.81:0/2077844757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c0cd3a0 0x7ff51c0ceca0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 --2- 172.21.15.81:0/2077844757 >> v2:172.21.15.176:3300/0 conn(0x7ff51c158480 0x7ff51c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 -- 172.21.15.81:0/2077844757 >> 172.21.15.81:0/2077844757 conn(0x7ff51c06c660 msgr2=0x7ff51c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 -- 172.21.15.81:0/2077844757 shutdown_connections 2023-11-29T11:22:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 -- 172.21.15.81:0/2077844757 wait complete. 2023-11-29T11:22:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 Processor -- start 2023-11-29T11:22:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 -- start start 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c0cd3a0 0x7ff51c1f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff51c158480 0x7ff51c13be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c158850 0x7ff51c13c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1f2bd0 con 0x7ff51c158850 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c154290 con 0x7ff51c0cd3a0 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1531f0 con 0x7ff51c158480 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c158850 0x7ff51c13c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c158850 0x7ff51c13c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41226/0 (socket says 172.21.15.81:41226) 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 -- 172.21.15.81:0/3854750907 learned_addr learned my addr 172.21.15.81:0/3854750907 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51a59c700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c0cd3a0 0x7ff51c1f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 -- 172.21.15.81:0/3854750907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff51c158480 msgr2=0x7ff51c13be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff51c158480 0x7ff51c13be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 -- 172.21.15.81:0/3854750907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c0cd3a0 msgr2=0x7ff51c1f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c0cd3a0 0x7ff51c1f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 -- 172.21.15.81:0/3854750907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514009b30 con 0x7ff51c158850 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51a59c700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c0cd3a0 0x7ff51c1f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.481+0000 7ff51ad9d700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c158850 0x7ff51c13c360 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0cc940 tx=0x7ff514004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff5137fe700 1 -- 172.21.15.81:0/3854750907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5140099b0 con 0x7ff51c158850 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff5137fe700 1 -- 172.21.15.81:0/3854750907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5140092e0 con 0x7ff51c158850 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c06ace0 con 0x7ff51c158850 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff5137fe700 1 -- 172.21.15.81:0/3854750907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51401c640 con 0x7ff51c158850 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c06aa00 con 0x7ff51c158850 2023-11-29T11:22:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c0cf1e0 con 0x7ff51c158850 2023-11-29T11:22:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff5137fe700 1 -- 172.21.15.81:0/3854750907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff514022030 con 0x7ff51c158850 2023-11-29T11:22:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff5137fe700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff4fc064ee0 0x7ff4fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff5137fe700 1 -- 172.21.15.81:0/3854750907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff514083a10 con 0x7ff51c158850 2023-11-29T11:22:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff51a59c700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff4fc064ee0 0x7ff4fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.485+0000 7ff51a59c700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff4fc064ee0 0x7ff4fc067390 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009a10 tx=0x7ff50c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.493+0000 7ff5137fe700 1 -- 172.21.15.81:0/3854750907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff514051900 con 0x7ff51c158850 2023-11-29T11:22:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.653+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff51c072c20 con 0x7ff51c158850 2023-11-29T11:22:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.653+0000 7ff5137fe700 1 -- 172.21.15.81:0/3854750907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff514054f20 con 0x7ff51c158850 2023-11-29T11:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:22:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff4fc064ee0 msgr2=0x7ff4fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff4fc064ee0 0x7ff4fc067390 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009a10 tx=0x7ff50c008040 comp rx=0 tx=0).stop 2023-11-29T11:22:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c158850 msgr2=0x7ff51c13c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c158850 0x7ff51c13c360 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0cc940 tx=0x7ff514004af0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 shutdown_connections 2023-11-29T11:22:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff4fc064ee0 0x7ff4fc067390 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c158850 0x7ff51c13c360 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff51c158480 0x7ff51c13be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 --2- 172.21.15.81:0/3854750907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff51c0cd3a0 0x7ff51c1f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 >> 172.21.15.81:0/3854750907 conn(0x7ff51c06c660 msgr2=0x7ff51c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 shutdown_connections 2023-11-29T11:22:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.657+0000 7ff51b59e700 1 -- 172.21.15.81:0/3854750907 wait complete. 2023-11-29T11:22:42.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T11:22:42.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64cb59e700 1 Processor -- start 2023-11-29T11:22:42.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64cb59e700 1 -- start start 2023-11-29T11:22:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64cb59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64cb59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc06cc50 con 0x7f64cc06ad40 2023-11-29T11:22:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64cb59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc0cfd10 con 0x7f64cc06d680 2023-11-29T11:22:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64cb59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc06d1f0 con 0x7f64cc0b15e0 2023-11-29T11:22:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c9d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f64cc06ad40 0x7f64cc0b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52486/0 (socket says 172.21.15.81:52486) 2023-11-29T11:22:42.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c9d9b700 1 -- 172.21.15.81:0/1160880704 learned_addr learned my addr 172.21.15.81:0/1160880704 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64ca59c700 1 --2- 172.21.15.81:0/1160880704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c959a700 1 -- 172.21.15.81:0/1160880704 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767451009 0 0) 0x7f64cc06cc50 con 0x7f64cc06ad40 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c959a700 1 -- 172.21.15.81:0/1160880704 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b80035d0 con 0x7f64cc06ad40 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c959a700 1 -- 172.21.15.81:0/1160880704 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13820554 0 0) 0x7f64cc0cfd10 con 0x7f64cc06d680 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c959a700 1 -- 172.21.15.81:0/1160880704 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64cc06cc50 con 0x7f64cc06d680 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64ca59c700 1 -- 172.21.15.81:0/1160880704 >> v1:172.21.15.176:6789/0 conn(0x7f64cc06d680 legacy=0x7f64cc0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64ca59c700 1 -- 172.21.15.81:0/1160880704 >> v1:172.21.15.81:6789/0 conn(0x7f64cc06ad40 legacy=0x7f64cc0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64ca59c700 1 -- 172.21.15.81:0/1160880704 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0cf750 con 0x7f64cc0b15e0 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64ca59c700 1 --2- 172.21.15.81:0/1160880704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc0cf050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009dc0 tx=0x7f64b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95ddf51fe6d4537 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c959a700 1 -- 172.21.15.81:0/1160880704 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400e070 con 0x7f64cc0b15e0 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c959a700 1 -- 172.21.15.81:0/1160880704 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b400bb20 con 0x7f64cc0b15e0 2023-11-29T11:22:42.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.785+0000 7f64c959a700 1 -- 172.21.15.81:0/1160880704 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4012430 con 0x7f64cc0b15e0 2023-11-29T11:22:42.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- 172.21.15.81:0/1160880704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 msgr2=0x7f64cc0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 --2- 172.21.15.81:0/1160880704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc0cf050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009dc0 tx=0x7f64b400b330 comp rx=0 tx=0).stop 2023-11-29T11:22:42.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- 172.21.15.81:0/1160880704 shutdown_connections 2023-11-29T11:22:42.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 --2- 172.21.15.81:0/1160880704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc0cf050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- 172.21.15.81:0/1160880704 >> 172.21.15.81:0/1160880704 conn(0x7f64cc09bb30 msgr2=0x7f64cc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:42.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- 172.21.15.81:0/1160880704 shutdown_connections 2023-11-29T11:22:42.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- 172.21.15.81:0/1160880704 wait complete. 2023-11-29T11:22:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 Processor -- start 2023-11-29T11:22:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- start start 2023-11-29T11:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64cc06ad40 0x7f64cc1f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64cc06d680 0x7f64cc1f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc1efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0d1c00 con 0x7f64cc06d680 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0d1ee0 con 0x7f64cc06ad40 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64cb59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1f3c50 con 0x7f64cc0b15e0 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64c9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64cc06d680 0x7f64cc1f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64c9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64cc06d680 0x7f64cc1f9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41232/0 (socket says 172.21.15.81:41232) 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.789+0000 7f64c9d9b700 1 -- 172.21.15.81:0/186143336 learned_addr learned my addr 172.21.15.81:0/186143336 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64ca59c700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64cc06ad40 0x7f64cc1f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64cad9d700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc1efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c9d9b700 1 -- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 msgr2=0x7f64cc1efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c9d9b700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc1efae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c9d9b700 1 -- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64cc06ad40 msgr2=0x7f64cc1f9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c9d9b700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64cc06ad40 0x7f64cc1f9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c9d9b700 1 -- 172.21.15.81:0/186143336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b4009a70 con 0x7f64cc06d680 2023-11-29T11:22:42.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64cad9d700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc1efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:42.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c9d9b700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64cc06d680 0x7f64cc1f9aa0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c4d0 tx=0x7f64bc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c2ffd700 1 -- 172.21.15.81:0/186143336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc005d90 con 0x7f64cc06d680 2023-11-29T11:22:42.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c2ffd700 1 -- 172.21.15.81:0/186143336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc0070d0 con 0x7f64cc06d680 2023-11-29T11:22:42.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc06ce80 con 0x7f64cc06d680 2023-11-29T11:22:42.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c2ffd700 1 -- 172.21.15.81:0/186143336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc007460 con 0x7f64cc06d680 2023-11-29T11:22:42.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc0cfa30 con 0x7f64cc06d680 2023-11-29T11:22:42.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc06b190 con 0x7f64cc06d680 2023-11-29T11:22:42.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.793+0000 7f64c2ffd700 1 -- 172.21.15.81:0/186143336 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f64bc019030 con 0x7f64cc06d680 2023-11-29T11:22:42.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.797+0000 7f64c2ffd700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f64ac064ee0 0x7f64ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:42.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.797+0000 7f64ca59c700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f64ac064ee0 0x7f64ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:42.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.797+0000 7f64c2ffd700 1 -- 172.21.15.81:0/186143336 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f64bc081480 con 0x7f64cc06d680 2023-11-29T11:22:42.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.797+0000 7f64ca59c700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f64ac064ee0 0x7f64ac067390 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f64b4014040 tx=0x7f64b401e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:42.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.801+0000 7f64c2ffd700 1 -- 172.21.15.81:0/186143336 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f64bc04f3b0 con 0x7f64cc06d680 2023-11-29T11:22:42.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.969+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f64cc1f4110 con 0x7f64cc06d680 2023-11-29T11:22:42.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.969+0000 7f64c2ffd700 1 -- 172.21.15.81:0/186143336 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) v1 ==== 80+0+0 (secure 0 0 0) 0x7f64bc0529d0 con 0x7f64cc06d680 2023-11-29T11:22:42.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f64ac064ee0 msgr2=0x7f64ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f64ac064ee0 0x7f64ac067390 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f64b4014040 tx=0x7f64b401e040 comp rx=0 tx=0).stop 2023-11-29T11:22:42.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64cc06d680 msgr2=0x7f64cc1f9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:42.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64cc06d680 0x7f64cc1f9aa0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c4d0 tx=0x7f64bc00c7e0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 shutdown_connections 2023-11-29T11:22:42.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f64ac064ee0 0x7f64ac067390 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64cc0b15e0 0x7f64cc1efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64cc06d680 0x7f64cc1f9aa0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 --2- 172.21.15.81:0/186143336 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64cc06ad40 0x7f64cc1f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:42.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 >> 172.21.15.81:0/186143336 conn(0x7f64cc09bb30 msgr2=0x7f64cc069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:42.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 shutdown_connections 2023-11-29T11:22:42.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:42.973+0000 7f64cb59e700 1 -- 172.21.15.81:0/186143336 wait complete. 2023-11-29T11:22:42.981 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-11-29T11:22:42.991 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-11-29T11:22:42.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:42.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:43.000 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[62209]: fuse finished with error 0 and tester_r 0 2023-11-29T11:22:43.002 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:22:43.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:22:43.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:43.050 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:22:43.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:22:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 Processor -- start 2023-11-29T11:22:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 -- start start 2023-11-29T11:22:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 0x7f8aac0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8aac0b5940 0x7f8aac0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac0d28e0 con 0x7f8aac06ad00 2023-11-29T11:22:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0cd5c0 con 0x7f8aac0b5940 2023-11-29T11:22:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0d1730 con 0x7f8aac0b4570 2023-11-29T11:22:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab090f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8aac06ad00 0x7f8aac0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52502/0 (socket says 172.21.15.81:52502) 2023-11-29T11:22:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab090f700 1 -- 172.21.15.81:0/161631410 learned_addr learned my addr 172.21.15.81:0/161631410 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab1911700 1 --2- 172.21.15.81:0/161631410 >> v2:172.21.15.81:3300/0 conn(0x7f8aac0b5940 0x7f8aac0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab1110700 1 --2- 172.21.15.81:0/161631410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 0x7f8aac0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8a9ffff700 1 -- 172.21.15.81:0/161631410 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870006831 0 0) 0x7f8aa8001490 con 0x7f8aac06ad00 2023-11-29T11:22:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8a9ffff700 1 -- 172.21.15.81:0/161631410 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a980035d0 con 0x7f8aac06ad00 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab1911700 1 -- 172.21.15.81:0/161631410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 msgr2=0x7f8aac0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab1911700 1 --2- 172.21.15.81:0/161631410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 0x7f8aac0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab1911700 1 -- 172.21.15.81:0/161631410 >> v1:172.21.15.81:6789/0 conn(0x7f8aac06ad00 legacy=0x7f8aac0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8a9ffff700 1 -- 172.21.15.81:0/161631410 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3938373022 0 0) 0x7f8a980035d0 con 0x7f8aac06ad00 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab1911700 1 -- 172.21.15.81:0/161631410 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0b4e80 con 0x7f8aac0b5940 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab1911700 1 --2- 172.21.15.81:0/161631410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac0b5940 0x7f8aac0b5dc0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009850 tx=0x7f8aa4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6508598c7a3e77fe server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8a9ffff700 1 -- 172.21.15.81:0/161631410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8001b80 con 0x7f8aac0b5940 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8a9ffff700 1 -- 172.21.15.81:0/161631410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4004030 con 0x7f8aac0b5940 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8a9ffff700 1 -- 172.21.15.81:0/161631410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40043e0 con 0x7f8aac0b5940 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 -- 172.21.15.81:0/161631410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac0b5940 msgr2=0x7f8aac0b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 --2- 172.21.15.81:0/161631410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac0b5940 0x7f8aac0b5dc0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009850 tx=0x7f8aa4009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 -- 172.21.15.81:0/161631410 shutdown_connections 2023-11-29T11:22:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 --2- 172.21.15.81:0/161631410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac0b5940 0x7f8aac0b5dc0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 --2- 172.21.15.81:0/161631410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 0x7f8aac0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 -- 172.21.15.81:0/161631410 >> 172.21.15.81:0/161631410 conn(0x7f8aac06cac0 msgr2=0x7f8aac0cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.149+0000 7f8ab3374700 1 -- 172.21.15.81:0/161631410 shutdown_connections 2023-11-29T11:22:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.153+0000 7f8ab3374700 1 -- 172.21.15.81:0/161631410 wait complete. 2023-11-29T11:22:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.153+0000 7f8ab3374700 1 Processor -- start 2023-11-29T11:22:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.153+0000 7f8ab3374700 1 -- start start 2023-11-29T11:22:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac06ad00 0x7f8aac0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 0x7f8aac0c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aac0b5940 0x7f8aac150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0c7810 con 0x7f8aac06ad00 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac151440 con 0x7f8aac0b5940 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0cc770 con 0x7f8aac0b4570 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac06ad00 0x7f8aac0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac06ad00 0x7f8aac0c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41246/0 (socket says 172.21.15.81:41246) 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 -- 172.21.15.81:0/1829357367 learned_addr learned my addr 172.21.15.81:0/1829357367 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab090f700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 0x7f8aac0c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1911700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aac0b5940 0x7f8aac150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 -- 172.21.15.81:0/1829357367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 msgr2=0x7f8aac0c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 0x7f8aac0c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 -- 172.21.15.81:0/1829357367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aac0b5940 msgr2=0x7f8aac150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aac0b5940 0x7f8aac150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 -- 172.21.15.81:0/1829357367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40094b0 con 0x7f8aac06ad00 2023-11-29T11:22:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab1110700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac06ad00 0x7f8aac0c6620 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000e840 tx=0x7f8aa000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8a9dffb700 1 -- 172.21.15.81:0/1829357367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00095a0 con 0x7f8aac06ad00 2023-11-29T11:22:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8a9dffb700 1 -- 172.21.15.81:0/1829357367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa0013680 con 0x7f8aac06ad00 2023-11-29T11:22:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac0d1450 con 0x7f8aac06ad00 2023-11-29T11:22:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8a9dffb700 1 -- 172.21.15.81:0/1829357367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00139f0 con 0x7f8aac06ad00 2023-11-29T11:22:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac0d1170 con 0x7f8aac06ad00 2023-11-29T11:22:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.157+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aac0cd1e0 con 0x7f8aac06ad00 2023-11-29T11:22:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.161+0000 7f8a9dffb700 1 -- 172.21.15.81:0/1829357367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8aa0019030 con 0x7f8aac06ad00 2023-11-29T11:22:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.161+0000 7f8a9dffb700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a90064ee0 0x7f8a90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.161+0000 7f8ab090f700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a90064ee0 0x7f8a90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.161+0000 7f8a9dffb700 1 -- 172.21.15.81:0/1829357367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8aa0081e00 con 0x7f8aac06ad00 2023-11-29T11:22:43.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.161+0000 7f8ab090f700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a90064ee0 0x7f8a90067390 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0cce70 tx=0x7f8aa8002170 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.169+0000 7f8a9dffb700 1 -- 172.21.15.81:0/1829357367 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8aa004fd30 con 0x7f8aac06ad00 2023-11-29T11:22:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.365+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8aac072500 con 0x7f8aac06ad00 2023-11-29T11:22:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.365+0000 7f8a9dffb700 1 -- 172.21.15.81:0/1829357367 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f8aa0053350 con 0x7f8aac06ad00 2023-11-29T11:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:22:19.584710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8973":{"gid":8973,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/665591010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":665591010},{"type":"v1","addr":"172.21.15.81:6837","nonce":665591010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:22:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a90064ee0 msgr2=0x7f8a90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a90064ee0 0x7f8a90067390 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0cce70 tx=0x7f8aa8002170 comp rx=0 tx=0).stop 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac06ad00 msgr2=0x7f8aac0c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac06ad00 0x7f8aac0c6620 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000e840 tx=0x7f8aa000eb50 comp rx=0 tx=0).stop 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 shutdown_connections 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8a90064ee0 0x7f8a90067390 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8aac0b5940 0x7f8aac150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8aac0b4570 0x7f8aac0c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 --2- 172.21.15.81:0/1829357367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aac06ad00 0x7f8aac0c6620 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 >> 172.21.15.81:0/1829357367 conn(0x7f8aac06cac0 msgr2=0x7f8aac0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 shutdown_connections 2023-11-29T11:22:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.369+0000 7f8ab3374700 1 -- 172.21.15.81:0/1829357367 wait complete. 2023-11-29T11:22:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 72 2023-11-29T11:22:43.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-29T11:22:43.780 INFO:teuthology.orchestra.run.smithi081.stdout:{"message":"","return_code":0} 2023-11-29T11:22:43.780 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-29T11:22:43.780 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:22:43.781 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:22:43.786 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:22:43.787 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi081.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-29T11:22:43.787 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:22:43.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:22:43.787 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:22:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-29T11:22:43.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:22:43.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo daemon-helper kill ceph --cluster ceph -w 2023-11-29T11:22:43.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2023-11-29T11:22:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219aa32700 1 Processor -- start 2023-11-29T11:22:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219aa32700 1 -- start start 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219aa32700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f219406ada0 0x7f219415a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219aa32700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2194070fc0 0x7f2194071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219aa32700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219406ce00 con 0x7f21940cf060 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219aa32700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2194071980 con 0x7f219406ada0 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219aa32700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21940cd9b0 con 0x7f2194070fc0 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2199a30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f219406ada0 0x7f219415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219922f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f21940cf060 0x7f219406c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52514/0 (socket says 172.21.15.81:52514) 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2199a30700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f219406ada0 0x7f219415a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41262/0 (socket says 172.21.15.81:41262) 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219922f700 1 -- 172.21.15.81:0/981985812 learned_addr learned my addr 172.21.15.81:0/981985812 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219a231700 1 --2- 172.21.15.81:0/981985812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2194070fc0 0x7f2194071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2199a30700 1 -- 172.21.15.81:0/981985812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2194070fc0 msgr2=0x7f2194071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2199a30700 1 --2- 172.21.15.81:0/981985812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2194070fc0 0x7f2194071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2199a30700 1 -- 172.21.15.81:0/981985812 >> v1:172.21.15.81:6789/0 conn(0x7f21940cf060 legacy=0x7f219406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2199a30700 1 -- 172.21.15.81:0/981985812 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21940cdc90 con 0x7f219406ada0 2023-11-29T11:22:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f219a231700 1 --2- 172.21.15.81:0/981985812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2194070fc0 0x7f2194071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2199a30700 1 --2- 172.21.15.81:0/981985812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f219406ada0 0x7f219415a660 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f2190009850 tx=0x7f2190009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255bf26e59a3076a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2198a2e700 1 -- 172.21.15.81:0/981985812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190011830 con 0x7f219406ada0 2023-11-29T11:22:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2198a2e700 1 -- 172.21.15.81:0/981985812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2190011990 con 0x7f219406ada0 2023-11-29T11:22:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.917+0000 7f2198a2e700 1 -- 172.21.15.81:0/981985812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190011d20 con 0x7f219406ada0 2023-11-29T11:22:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- 172.21.15.81:0/981985812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f219406ada0 msgr2=0x7f219415a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 --2- 172.21.15.81:0/981985812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f219406ada0 0x7f219415a660 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f2190009850 tx=0x7f2190009b60 comp rx=0 tx=0).stop 2023-11-29T11:22:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- 172.21.15.81:0/981985812 shutdown_connections 2023-11-29T11:22:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 --2- 172.21.15.81:0/981985812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2194070fc0 0x7f2194071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 --2- 172.21.15.81:0/981985812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f219406ada0 0x7f219415a660 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- 172.21.15.81:0/981985812 >> 172.21.15.81:0/981985812 conn(0x7f21940cf5e0 msgr2=0x7f21940cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- 172.21.15.81:0/981985812 shutdown_connections 2023-11-29T11:22:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- 172.21.15.81:0/981985812 wait complete. 2023-11-29T11:22:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 Processor -- start 2023-11-29T11:22:43.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- start start 2023-11-29T11:22:43.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f219406ada0 0x7f219414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2194070fc0 0x7f21940c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21940cf060 0x7f21940c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21940c7ac0 con 0x7f2194070fc0 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21941e6220 con 0x7f219406ada0 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219aa32700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21941e56a0 con 0x7f21940cf060 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2194070fc0 0x7f21940c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2194070fc0 0x7f21940c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41278/0 (socket says 172.21.15.81:41278) 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 -- 172.21.15.81:0/2911989295 learned_addr learned my addr 172.21.15.81:0/2911989295 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219a231700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21940cf060 0x7f21940c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f2199a30700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f219406ada0 0x7f219414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 -- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21940cf060 msgr2=0x7f21940c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21940cf060 0x7f21940c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 -- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f219406ada0 msgr2=0x7f219414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f219406ada0 0x7f219414e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 -- 172.21.15.81:0/2911989295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900094b0 con 0x7f2194070fc0 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219a231700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21940cf060 0x7f21940c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:43.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f219922f700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2194070fc0 0x7f21940c8230 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f218400c4d0 tx=0x7f218400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f218a7fc700 1 -- 172.21.15.81:0/2911989295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184005d90 con 0x7f2194070fc0 2023-11-29T11:22:43.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.921+0000 7f218a7fc700 1 -- 172.21.15.81:0/2911989295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21840070d0 con 0x7f2194070fc0 2023-11-29T11:22:43.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.925+0000 7f218a7fc700 1 -- 172.21.15.81:0/2911989295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184007440 con 0x7f2194070fc0 2023-11-29T11:22:43.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.925+0000 7f219aa32700 1 -- 172.21.15.81:0/2911989295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21940ce250 con 0x7f2194070fc0 2023-11-29T11:22:43.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.925+0000 7f219aa32700 1 -- 172.21.15.81:0/2911989295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21940cdf70 con 0x7f2194070fc0 2023-11-29T11:22:43.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.925+0000 7f218a7fc700 1 -- 172.21.15.81:0/2911989295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2184019030 con 0x7f2194070fc0 2023-11-29T11:22:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.925+0000 7f218a7fc700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2178064ee0 0x7f2178067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.925+0000 7f218a7fc700 1 -- 172.21.15.81:0/2911989295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f21840813b0 con 0x7f2194070fc0 2023-11-29T11:22:43.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2178064ee0 0x7f2178067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 Processor -- start 2023-11-29T11:22:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- start start 2023-11-29T11:22:43.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2178064ee0 0x7f2178067390 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2190009fd0 tx=0x7f2190008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2538d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x2541e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22d5a30 0x2542340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x23f9c80 con 0x228ad80 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2469d60 con 0x228a9b0 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2463060 con 0x22d5a30 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2538d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2538d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41290/0 (socket says 172.21.15.81:41290) 2023-11-29T11:22:43.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 -- 172.21.15.81:0/2806286055 learned_addr learned my addr 172.21.15.81:0/2806286055 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219922f700 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x2541e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219a231700 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22d5a30 0x2542340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 -- 172.21.15.81:0/2806286055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22d5a30 msgr2=0x2542340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22d5a30 0x2542340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 -- 172.21.15.81:0/2806286055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 msgr2=0x2541e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x2541e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 -- 172.21.15.81:0/2806286055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24884e0 con 0x228ad80 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f2199a30700 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2538d70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f21900040c0 tx=0x7f2190010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71009e3dfb5f4ff server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f21777fe700 1 -- 172.21.15.81:0/2806286055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190003b30 con 0x228ad80 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f21777fe700 1 -- 172.21.15.81:0/2806286055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2190003c90 con 0x228ad80 2023-11-29T11:22:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f21777fe700 1 -- 172.21.15.81:0/2806286055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190025480 con 0x228ad80 2023-11-29T11:22:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- 172.21.15.81:0/2806286055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 msgr2=0x2538d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2538d70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f21900040c0 tx=0x7f2190010000 comp rx=0 tx=0).stop 2023-11-29T11:22:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- 172.21.15.81:0/2806286055 shutdown_connections 2023-11-29T11:22:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x22d5a30 0x2542340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x2541e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 --2- 172.21.15.81:0/2806286055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2538d70 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- 172.21.15.81:0/2806286055 >> 172.21.15.81:0/2806286055 conn(0x228b150 msgr2=0x2523350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- 172.21.15.81:0/2806286055 shutdown_connections 2023-11-29T11:22:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.929+0000 7f219ef14740 1 -- 172.21.15.81:0/2806286055 wait complete. 2023-11-29T11:22:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 -- start start 2023-11-29T11:22:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 Processor -- start 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x2523290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x24f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 0x24f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x230fdc0 con 0x228ad80 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x24fa0f0 con 0x22d5a30 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2523d80 con 0x228a9b0 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 10 client.0 _ll_register_callbacks cb 0x24beb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x24f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x24f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41294/0 (socket says 172.21.15.81:41294) 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 -- 172.21.15.81:0/533634851 learned_addr learned my addr 172.21.15.81:0/533634851 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219a231700 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 0x24f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f2199a30700 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x2523290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 -- 172.21.15.81:0/533634851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 msgr2=0x2523290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x2523290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 -- 172.21.15.81:0/533634851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 msgr2=0x24f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 0x24f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 -- 172.21.15.81:0/533634851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21940cdc90 con 0x228ad80 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219922f700 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x24f8650 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f2184001eb0 tx=0x7f21840529d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e81dae8648ef3b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f2174ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f2174ff9700 1 -- 172.21.15.81:0/533634851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184052460 con 0x228ad80 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f2174ff9700 1 -- 172.21.15.81:0/533634851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f218406bdc0 con 0x228ad80 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 -- 172.21.15.81:0/533634851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x245c0e0 con 0x228ad80 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f2174ff9700 1 -- 172.21.15.81:0/533634851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21840525c0 con 0x228ad80 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 10 client.9345 fetch_fsmap learned FSMap version 72 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 -- 172.21.15.81:0/533634851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x22d6c80 con 0x228ad80 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f2174ff9700 1 -- 172.21.15.81:0/533634851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x245c0e0 con 0x228ad80 2023-11-29T11:22:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f2174ff9700 1 -- 172.21.15.81:0/533634851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f218406f200 con 0x228ad80 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 10 client.9345 fetch_fsmap finished waiting for FSMap version 72 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 10 client.9345 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 20 client.9345 populate_metadata read hostname 'smithi081' 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x24fa630 0x24faa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 4 client.9345 mds_command: new command op to 8973 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f219ef14740 1 -- 172.21.15.81:0/533634851 --> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x245be00 con 0x24fa630 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.933+0000 7f2199a30700 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x24fa630 0x24faa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f2174ff9700 10 client.9345 ms_handle_connect on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f2199a30700 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x24fa630 0x24faa30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3852e844b50a942 server_cookie=bcc7647b1a110d08 in_seq=0 out_seq=0 2023-11-29T11:22:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f2174ff9700 1 -- 172.21.15.81:0/533634851 <== mds.0 v2:172.21.15.81:6836/665591010 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x245be00 con 0x24fa630 2023-11-29T11:22:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f2174ff9700 10 client.9345 handle_command_reply: tid=0 2023-11-29T11:22:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 client.9345 shutdown 2023-11-29T11:22:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 -- 172.21.15.81:0/533634851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 msgr2=0x24f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x24f8650 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f2184001eb0 tx=0x7f21840529d0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 -- 172.21.15.81:0/533634851 shutdown_connections 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x24fa630 0x24faa30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 0x24f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x24f8650 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 --2- 172.21.15.81:0/533634851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x2523290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 -- 172.21.15.81:0/533634851 >> 172.21.15.81:0/533634851 conn(0x228b150 msgr2=0x250c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f2174ff9700 0 client.9345 ms_handle_reset on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 -- 172.21.15.81:0/533634851 shutdown_connections 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 1 -- 172.21.15.81:0/533634851 wait complete. 2023-11-29T11:22:43.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.937+0000 7f219ef14740 20 client.9345 trim_cache size 0 max 16384 2023-11-29T11:22:43.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdfa28c700 1 Processor -- start 2023-11-29T11:22:43.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdfa28c700 1 -- start start 2023-11-29T11:22:43.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdfa28c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf415e480 0x7efdf415af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdfa28c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efdf406e000 0x7efdf406e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdfa28c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efdf40708e0 0x7efdf4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdfa28c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf413d3e0 con 0x7efdf40708e0 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdfa28c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf415de50 con 0x7efdf406e000 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdfa28c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf415b4a0 con 0x7efdf415e480 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efdf40708e0 0x7efdf4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf928a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf415e480 0x7efdf415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efdf40708e0 0x7efdf4070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41302/0 (socket says 172.21.15.81:41302) 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 -- 172.21.15.81:0/90478167 learned_addr learned my addr 172.21.15.81:0/90478167 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf8a89700 1 --2- 172.21.15.81:0/90478167 >> v2:172.21.15.176:3300/0 conn(0x7efdf406e000 0x7efdf406e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 -- 172.21.15.81:0/90478167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf415e480 msgr2=0x7efdf415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 --2- 172.21.15.81:0/90478167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf415e480 0x7efdf415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 -- 172.21.15.81:0/90478167 >> v2:172.21.15.176:3300/0 conn(0x7efdf406e000 msgr2=0x7efdf406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 --2- 172.21.15.81:0/90478167 >> v2:172.21.15.176:3300/0 conn(0x7efdf406e000 0x7efdf406e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 -- 172.21.15.81:0/90478167 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf406e970 con 0x7efdf40708e0 2023-11-29T11:22:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf9a8b700 1 --2- 172.21.15.81:0/90478167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf40708e0 0x7efdf4070d20 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7efdf406c060 tx=0x7efdec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9d8500de9ab69e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf3fff700 1 -- 172.21.15.81:0/90478167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec011830 con 0x7efdf40708e0 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf3fff700 1 -- 172.21.15.81:0/90478167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec011990 con 0x7efdf40708e0 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.945+0000 7efdf3fff700 1 -- 172.21.15.81:0/90478167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec011d20 con 0x7efdf40708e0 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- 172.21.15.81:0/90478167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf40708e0 msgr2=0x7efdf4070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 --2- 172.21.15.81:0/90478167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf40708e0 0x7efdf4070d20 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7efdf406c060 tx=0x7efdec009bf0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- 172.21.15.81:0/90478167 shutdown_connections 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 --2- 172.21.15.81:0/90478167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf40708e0 0x7efdf4070d20 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 --2- 172.21.15.81:0/90478167 >> v2:172.21.15.176:3300/0 conn(0x7efdf406e000 0x7efdf406e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 --2- 172.21.15.81:0/90478167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf415e480 0x7efdf415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- 172.21.15.81:0/90478167 >> 172.21.15.81:0/90478167 conn(0x7efdf40ceee0 msgr2=0x7efdf40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- 172.21.15.81:0/90478167 shutdown_connections 2023-11-29T11:22:43.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- 172.21.15.81:0/90478167 wait complete. 2023-11-29T11:22:43.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 Processor -- start 2023-11-29T11:22:43.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- start start 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdf406e000 0x7efdf4141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf40708e0 0x7efdf4159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf415e480 0x7efdf4159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4143000 con 0x7efdf415e480 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4142380 con 0x7efdf406e000 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdfa28c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4142660 con 0x7efdf40708e0 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdf9a8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf415e480 0x7efdf4159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdf9a8b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf415e480 0x7efdf4159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41308/0 (socket says 172.21.15.81:41308) 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdf9a8b700 1 -- 172.21.15.81:0/2086490395 learned_addr learned my addr 172.21.15.81:0/2086490395 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.949+0000 7efdf928a700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdf406e000 0x7efdf4141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf8a89700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf40708e0 0x7efdf4159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf9a8b700 1 -- 172.21.15.81:0/2086490395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf40708e0 msgr2=0x7efdf4159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf9a8b700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdf40708e0 0x7efdf4159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf9a8b700 1 -- 172.21.15.81:0/2086490395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdf406e000 msgr2=0x7efdf4141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf9a8b700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdf406e000 0x7efdf4141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf9a8b700 1 -- 172.21.15.81:0/2086490395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec009570 con 0x7efdf415e480 2023-11-29T11:22:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf928a700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdf406e000 0x7efdf4141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf9a8b700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdf415e480 0x7efdf4159e50 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7efdf406d540 tx=0x7efdec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 Processor -- start 2023-11-29T11:22:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- start start 2023-11-29T11:22:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec004300 con 0x7efdf415e480 2023-11-29T11:22:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec01f070 con 0x7efdf415e480 2023-11-29T11:22:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdfa28c700 1 -- 172.21.15.81:0/2086490395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf413fc20 con 0x7efdf415e480 2023-11-29T11:22:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0036c0 con 0x7efdf415e480 2023-11-29T11:22:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdfa28c700 1 -- 172.21.15.81:0/2086490395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf413d640 con 0x7efdf415e480 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x250c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2550920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 0x2550e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2425df0 con 0x228ad80 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2467060 con 0x22d5a30 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x24619b0 con 0x228a9b0 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2550920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2550920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41316/0 (socket says 172.21.15.81:41316) 2023-11-29T11:22:43.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 -- 172.21.15.81:0/1650874252 learned_addr learned my addr 172.21.15.81:0/1650874252 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:43.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdfa28c700 1 -- 172.21.15.81:0/2086490395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7efdf413ff00 con 0x7efdf415e480 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219a231700 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 0x2550e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f2199a30700 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x250c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 -- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 msgr2=0x250c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x250c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 -- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 msgr2=0x2550e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 0x2550e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 -- 172.21.15.81:0/1650874252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21941e5ec0 con 0x228ad80 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f2199a30700 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x250c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219922f700 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2550920 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f218400c4a0 tx=0x7f218401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fb60345ae507f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f2177fff700 1 -- 172.21.15.81:0/1650874252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218407f2f0 con 0x228ad80 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f2177fff700 1 -- 172.21.15.81:0/1650874252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218407f4b0 con 0x228ad80 2023-11-29T11:22:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f2177fff700 1 -- 172.21.15.81:0/1650874252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218405afb0 con 0x228ad80 2023-11-29T11:22:43.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efdec02a020 con 0x7efdf415e480 2023-11-29T11:22:43.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- 172.21.15.81:0/1650874252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 msgr2=0x2550920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2550920 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f218400c4a0 tx=0x7f218401e000 comp rx=0 tx=0).stop 2023-11-29T11:22:43.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- 172.21.15.81:0/1650874252 shutdown_connections 2023-11-29T11:22:43.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x22d5a30 0x2550e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x228ad80 0x2550920 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 --2- 172.21.15.81:0/1650874252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228a9b0 0x250c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- 172.21.15.81:0/1650874252 >> 172.21.15.81:0/1650874252 conn(0x228b150 msgr2=0x25391c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- 172.21.15.81:0/1650874252 shutdown_connections 2023-11-29T11:22:43.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- 172.21.15.81:0/1650874252 wait complete. 2023-11-29T11:22:43.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf1ffb700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efde0064f10 0x7efde00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf928a700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efde0064f10 0x7efde00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7efdec083a00 con 0x7efdf415e480 2023-11-29T11:22:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+516 (secure 0 0 0) 0x7efdec0842a0 con 0x7efdf415e480 2023-11-29T11:22:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 -- start start 2023-11-29T11:22:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdfa28c700 1 -- 172.21.15.81:0/2086490395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7efdf4067230 con 0x7efdf415e480 2023-11-29T11:22:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7f219ef14740 1 Processor -- start 2023-11-29T11:22:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.953+0000 7efdf928a700 1 --2- 172.21.15.81:0/2086490395 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7efde0064f10 0x7efde00673c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efde4009fd0 tx=0x7efde400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 7 ==== log(2 entries from seq 1083 at 2023-11-29T11:22:42.739310+0000) v1 ==== 560+0+0 (secure 0 0 0) 0x7efdec084280 con 0x7efdf415e480 2023-11-29T11:22:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x259cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228ad80 0x2554ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22d5a30 0x2555220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2555920 con 0x22d5a30 2023-11-29T11:22:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2555b80 con 0x228a9b0 2023-11-29T11:22:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x24fb070 con 0x228ad80 2023-11-29T11:22:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 10 client.0 _ll_register_callbacks cb 0x2489910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22d5a30 0x2555220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22d5a30 0x2555220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41322/0 (socket says 172.21.15.81:41322) 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 -- 172.21.15.81:0/1186082157 learned_addr learned my addr 172.21.15.81:0/1186082157 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219922f700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228ad80 0x2554ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2199a30700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x259cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 -- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228ad80 msgr2=0x2554ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228ad80 0x2554ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 -- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 msgr2=0x259cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x259cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 -- 172.21.15.81:0/1186082157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x22d6c80 con 0x22d5a30 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219922f700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228ad80 0x2554ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2199a30700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x259cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219a231700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22d5a30 0x2555220 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f218c00dee0 tx=0x7f218c007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c86aa23a800069 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2174ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2174ff9700 1 -- 172.21.15.81:0/1186082157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c013040 con 0x22d5a30 2023-11-29T11:22:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 -- 172.21.15.81:0/1186082157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2190003c90 con 0x22d5a30 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2174ff9700 1 -- 172.21.15.81:0/1186082157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f218c00ada0 con 0x22d5a30 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2174ff9700 1 -- 172.21.15.81:0/1186082157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f218c019470 con 0x22d5a30 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 10 client.9357 fetch_fsmap learned FSMap version 72 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 -- 172.21.15.81:0/1186082157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x240fbb0 con 0x22d5a30 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2174ff9700 1 -- 172.21.15.81:0/1186082157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2190003c90 con 0x22d5a30 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2174ff9700 1 -- 172.21.15.81:0/1186082157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f218c021350 con 0x22d5a30 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 10 client.9357 fetch_fsmap finished waiting for FSMap version 72 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 10 client.9357 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 20 client.9357 populate_metadata read hostname 'smithi081' 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2538930 0x2538d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 4 client.9357 mds_command: new command op to 8973 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f219ef14740 1 -- 172.21.15.81:0/1186082157 --> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x2307500 con 0x2538930 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2199a30700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2538930 0x2538d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2199a30700 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2538930 0x2538d30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb46bd78556b4237 server_cookie=6512ed99e70feaca in_seq=0 out_seq=0 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.957+0000 7f2174ff9700 10 client.9357 ms_handle_connect on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f2174ff9700 1 -- 172.21.15.81:0/1186082157 <== mds.0 v2:172.21.15.81:6836/665591010 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2307500 con 0x2538930 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f2174ff9700 10 client.9357 handle_command_reply: tid=0 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 client.9357 shutdown 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 -- 172.21.15.81:0/1186082157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22d5a30 msgr2=0x2555220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22d5a30 0x2555220 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f218c00dee0 tx=0x7f218c007e90 comp rx=0 tx=0).stop 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 -- 172.21.15.81:0/1186082157 shutdown_connections 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2538930 0x2538d30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f2174ff9700 0 client.9357 ms_handle_reset on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22d5a30 0x2555220 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x228ad80 0x2554ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 --2- 172.21.15.81:0/1186082157 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x228a9b0 0x259cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 -- 172.21.15.81:0/1186082157 >> 172.21.15.81:0/1186082157 conn(0x228b150 msgr2=0x2536ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 -- 172.21.15.81:0/1186082157 shutdown_connections 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 1 -- 172.21.15.81:0/1186082157 wait complete. 2023-11-29T11:22:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219ef14740 20 client.9357 trim_cache size 0 max 16384 2023-11-29T11:22:43.975 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:22:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2023-11-29T11:22:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "ea549a60-ab11-466a-9877-176419ba37f7", 2023-11-29T11:22:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2023-11-29T11:22:43.975 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 -- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2178064ee0 msgr2=0x7f2178067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2178064ee0 0x7f2178067390 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2190009fd0 tx=0x7f2190008030 comp rx=0 tx=0).stop 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 -- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2194070fc0 msgr2=0x7f21940c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2194070fc0 0x7f21940c8230 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f218400c4d0 tx=0x7f218400c890 comp rx=0 tx=0).stop 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 -- 172.21.15.81:0/2911989295 shutdown_connections 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f2178064ee0 0x7f2178067390 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21940cf060 0x7f21940c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2194070fc0 0x7f21940c8230 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 --2- 172.21.15.81:0/2911989295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f219406ada0 0x7f219414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 -- 172.21.15.81:0/2911989295 >> 172.21.15.81:0/2911989295 conn(0x7f21940cf5e0 msgr2=0x7f21940af000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 -- 172.21.15.81:0/2911989295 shutdown_connections 2023-11-29T11:22:43.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:43.961+0000 7f219aa32700 1 -- 172.21.15.81:0/2911989295 wait complete. 2023-11-29T11:22:43.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-11-29T11:22:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda35242700 1 Processor -- start 2023-11-29T11:22:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda35242700 1 -- start start 2023-11-29T11:22:44.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda35242700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 0x7fda3006aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda35242700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda300c1ad0 0x7fda301642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda35242700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda30160c50 con 0x7fda3006b000 2023-11-29T11:22:44.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda35242700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3006b450 con 0x7fda300c1ad0 2023-11-29T11:22:44.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda35242700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda300b3050 con 0x7fda30160880 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fda3006b000 0x7fda300c13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52530/0 (socket says 172.21.15.81:52530) 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2f7fe700 1 -- 172.21.15.81:0/4003600150 learned_addr learned my addr 172.21.15.81:0/4003600150 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2ffff700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 0x7fda3006aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda34a41700 1 --2- 172.21.15.81:0/4003600150 >> v2:172.21.15.176:3300/0 conn(0x7fda300c1ad0 0x7fda301642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262417018 0 0) 0x7fda30160c50 con 0x7fda3006b000 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda180035d0 con 0x7fda3006b000 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914632210 0 0) 0x7fda180035d0 con 0x7fda3006b000 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 msgr2=0x7fda3006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 0x7fda3006aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 >> v2:172.21.15.176:3300/0 conn(0x7fda300c1ad0 msgr2=0x7fda301642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 --2- 172.21.15.81:0/4003600150 >> v2:172.21.15.176:3300/0 conn(0x7fda300c1ad0 0x7fda301642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3006b630 con 0x7fda3006b000 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fda24001670 con 0x7fda3006b000 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 >> v1:172.21.15.81:6789/0 conn(0x7fda3006b000 legacy=0x7fda300c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 0x7fda18003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda18003fa0 0x7fda18004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda18004db0 0x7fda18005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3006b450 con 0x7fda18004db0 2023-11-29T11:22:44.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300b3050 con 0x7fda18003fa0 2023-11-29T11:22:44.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1800ba30 con 0x7fda30160880 2023-11-29T11:22:44.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2ffff700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 0x7fda18003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda18003fa0 0x7fda18004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda34a41700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda18004db0 0x7fda18005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2ffff700 1 -- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda18003fa0 msgr2=0x7fda18004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2ffff700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda18003fa0 0x7fda18004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2ffff700 1 -- 172.21.15.81:0/4003600150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda18004db0 msgr2=0x7fda18005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2ffff700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda18004db0 0x7fda18005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2ffff700 1 -- 172.21.15.81:0/4003600150 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda180035d0 con 0x7fda30160880 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda18003fa0 0x7fda18004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2ffff700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 0x7fda18003a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda20009fc0 tx=0x7fda180058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0b4855ab46f423a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.089+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000ec30 con 0x7fda30160880 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2000f040 con 0x7fda30160880 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda2effd700 1 -- 172.21.15.81:0/4003600150 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20014480 con 0x7fda30160880 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda35242700 1 -- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 msgr2=0x7fda18003a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda35242700 1 --2- 172.21.15.81:0/4003600150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda30160880 0x7fda18003a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda20009fc0 tx=0x7fda180058a0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda34a41700 1 -- 172.21.15.81:0/4003600150 reap_dead start 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda35242700 1 -- 172.21.15.81:0/4003600150 shutdown_connections 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda35242700 1 -- 172.21.15.81:0/4003600150 >> 172.21.15.81:0/4003600150 conn(0x7fda300cae70 msgr2=0x7fda300cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda35242700 1 -- 172.21.15.81:0/4003600150 shutdown_connections 2023-11-29T11:22:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda35242700 1 -- 172.21.15.81:0/4003600150 wait complete. 2023-11-29T11:22:44.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda35242700 1 Processor -- start 2023-11-29T11:22:44.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.093+0000 7fda35242700 1 -- start start 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda35242700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda30160880 0x7fda300c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda35242700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda30150580 0x7fda3009afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda35242700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda301509d0 0x7fda300abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda35242700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300aeb20 con 0x7fda30150580 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda35242700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300ae1a0 con 0x7fda30160880 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda35242700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda300ae460 con 0x7fda301509d0 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda30150580 0x7fda3009afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda30150580 0x7fda3009afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41334/0 (socket says 172.21.15.81:41334) 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2f7fe700 1 -- 172.21.15.81:0/1346338551 learned_addr learned my addr 172.21.15.81:0/1346338551 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda34a41700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda301509d0 0x7fda300abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda30160880 0x7fda300c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2ffff700 1 -- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda301509d0 msgr2=0x7fda300abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda301509d0 0x7fda300abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2ffff700 1 -- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda30150580 msgr2=0x7fda3009afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda30150580 0x7fda3009afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2ffff700 1 -- 172.21.15.81:0/1346338551 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30069fc0 con 0x7fda30160880 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda34a41700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda301509d0 0x7fda300abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda30150580 0x7fda3009afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda30160880 0x7fda300c1f20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fda20019000 tx=0x7fda20009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2cff9700 1 -- 172.21.15.81:0/1346338551 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20004240 con 0x7fda30160880 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2cff9700 1 -- 172.21.15.81:0/1346338551 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20022070 con 0x7fda30160880 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda35242700 1 -- 172.21.15.81:0/1346338551 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda30069ce0 con 0x7fda30160880 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda2cff9700 1 -- 172.21.15.81:0/1346338551 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda200045e0 con 0x7fda30160880 2023-11-29T11:22:44.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.097+0000 7fda35242700 1 -- 172.21.15.81:0/1346338551 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3006a2a0 con 0x7fda30160880 2023-11-29T11:22:44.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda2cff9700 1 -- 172.21.15.81:0/1346338551 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fda2002d020 con 0x7fda30160880 2023-11-29T11:22:44.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda2cff9700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda1c064ee0 0x7fda1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda2cff9700 1 -- 172.21.15.81:0/1346338551 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fda20083d00 con 0x7fda30160880 2023-11-29T11:22:44.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda1c064ee0 0x7fda1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda39724740 1 Processor -- start 2023-11-29T11:22:44.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda39724740 1 -- start start 2023-11-29T11:22:44.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda1c064ee0 0x7fda1c067390 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fda301f9570 tx=0x7fda240079a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda39724740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 0x2175e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda39724740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x2176340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda39724740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f098c0 0x21726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda39724740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x202dd20 con 0x1f098c0 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda39724740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x209dd60 con 0x1ebec10 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda39724740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2097060 con 0x1ebe840 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f098c0 0x21726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda2ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 0x2175e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f098c0 0x21726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41336/0 (socket says 172.21.15.81:41336) 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 -- 172.21.15.81:0/3406849526 learned_addr learned my addr 172.21.15.81:0/3406849526 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/3406849526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x2176340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 -- 172.21.15.81:0/3406849526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 msgr2=0x2176340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 --2- 172.21.15.81:0/3406849526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x2176340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 -- 172.21.15.81:0/3406849526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 msgr2=0x2175e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 --2- 172.21.15.81:0/3406849526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 0x2175e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 -- 172.21.15.81:0/3406849526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20bd0a0 con 0x1f098c0 2023-11-29T11:22:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda34a41700 1 --2- 172.21.15.81:0/3406849526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f098c0 0x21726a0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fda3006e400 tx=0x7fda28009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b883db26cf5f40e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda15ffb700 1 -- 172.21.15.81:0/3406849526 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28014b60 con 0x1f098c0 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda15ffb700 1 -- 172.21.15.81:0/3406849526 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28014cc0 con 0x1f098c0 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.101+0000 7fda15ffb700 1 -- 172.21.15.81:0/3406849526 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2801d440 con 0x1f098c0 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- 172.21.15.81:0/3406849526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f098c0 msgr2=0x21726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 --2- 172.21.15.81:0/3406849526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f098c0 0x21726a0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fda3006e400 tx=0x7fda28009f10 comp rx=0 tx=0).stop 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- 172.21.15.81:0/3406849526 shutdown_connections 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 --2- 172.21.15.81:0/3406849526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1f098c0 0x21726a0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 --2- 172.21.15.81:0/3406849526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x2176340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 --2- 172.21.15.81:0/3406849526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 0x2175e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- 172.21.15.81:0/3406849526 >> 172.21.15.81:0/3406849526 conn(0x1ebefe0 msgr2=0x2157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- 172.21.15.81:0/3406849526 shutdown_connections 2023-11-29T11:22:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- 172.21.15.81:0/3406849526 wait complete. 2023-11-29T11:22:44.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- start start 2023-11-29T11:22:44.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 Processor -- start 2023-11-29T11:22:44.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21390b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x2153250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x2139b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f43c50 con 0x1ebec10 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x213a060 con 0x1f098c0 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2153920 con 0x1ebe840 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x2153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda39724740 10 client.0 _ll_register_callbacks cb 0x20909a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x2153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41350/0 (socket says 172.21.15.81:41350) 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda2f7fe700 1 -- 172.21.15.81:0/969734231 learned_addr learned my addr 172.21.15.81:0/969734231 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda2ffff700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.105+0000 7fda34a41700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x2139b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2f7fe700 1 -- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 msgr2=0x21390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21390b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2f7fe700 1 -- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 msgr2=0x2139b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x2139b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2f7fe700 1 -- 172.21.15.81:0/969734231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda28009c40 con 0x1ebec10 2023-11-29T11:22:44.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda34a41700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x2139b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:44.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2ffff700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:22:44.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x2153250 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fda24015e50 tx=0x7fda24001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4e56525ad27f31 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:44.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:22:44.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 1 -- 172.21.15.81:0/969734231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24014a40 con 0x1ebec10 2023-11-29T11:22:44.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 1 -- 172.21.15.81:0/969734231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fda2401a030 con 0x1ebec10 2023-11-29T11:22:44.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 -- 172.21.15.81:0/969734231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x20900e0 con 0x1ebec10 2023-11-29T11:22:44.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 1 -- 172.21.15.81:0/969734231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda24014ba0 con 0x1ebec10 2023-11-29T11:22:44.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 10 client.9369 fetch_fsmap learned FSMap version 72 2023-11-29T11:22:44.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 -- 172.21.15.81:0/969734231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x1f0ab10 con 0x1ebec10 2023-11-29T11:22:44.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 1 -- 172.21.15.81:0/969734231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x20900e0 con 0x1ebec10 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 1 -- 172.21.15.81:0/969734231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fda24014d00 con 0x1ebec10 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 10 client.9369 fetch_fsmap finished waiting for FSMap version 72 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 10 client.9369 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 20 client.9369 populate_metadata read hostname 'smithi081' 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2154a00 0x2137690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 4 client.9369 mds_command: new command op to 8973 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 -- 172.21.15.81:0/969734231 --> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x208fe00 con 0x2154a00 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2ffff700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2154a00 0x2137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 10 client.9369 ms_handle_connect on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda2ffff700 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2154a00 0x2137690 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8027bddc61a6c497 server_cookie=8b9374f9cd7dd755 in_seq=0 out_seq=0 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 1 -- 172.21.15.81:0/969734231 <== mds.0 v2:172.21.15.81:6836/665591010 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x208fe00 con 0x2154a00 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 10 client.9369 handle_command_reply: tid=0 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 client.9369 shutdown 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 -- 172.21.15.81:0/969734231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 msgr2=0x2153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x2153250 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fda24015e50 tx=0x7fda24001a70 comp rx=0 tx=0).stop 2023-11-29T11:22:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 -- 172.21.15.81:0/969734231 shutdown_connections 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2154a00 0x2137690 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x2139b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda0effd700 0 client.9369 ms_handle_reset on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x2153250 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 --2- 172.21.15.81:0/969734231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 -- 172.21.15.81:0/969734231 >> 172.21.15.81:0/969734231 conn(0x1ebefe0 msgr2=0x214e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 -- 172.21.15.81:0/969734231 shutdown_connections 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 1 -- 172.21.15.81:0/969734231 wait complete. 2023-11-29T11:22:44.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.109+0000 7fda39724740 20 client.9369 trim_cache size 0 max 16384 2023-11-29T11:22:44.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.129+0000 7fda39724740 1 Processor -- start 2023-11-29T11:22:44.138 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.129+0000 7fda39724740 1 -- start start 2023-11-29T11:22:44.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebe840 0x216f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 0x216f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f098c0 0x2137590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.139 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2139f20 con 0x1ebe840 2023-11-29T11:22:44.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x205c440 con 0x1ebec10 2023-11-29T11:22:44.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x20936e0 con 0x1f098c0 2023-11-29T11:22:44.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebe840 0x216f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebe840 0x216f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41362/0 (socket says 172.21.15.81:41362) 2023-11-29T11:22:44.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 -- 172.21.15.81:0/1603417036 learned_addr learned my addr 172.21.15.81:0/1603417036 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:44.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda34a41700 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f098c0 0x2137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.140 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 0x216f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 -- 172.21.15.81:0/1603417036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f098c0 msgr2=0x2137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f098c0 0x2137590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 -- 172.21.15.81:0/1603417036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 msgr2=0x216f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 0x216f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 -- 172.21.15.81:0/1603417036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300ac750 con 0x1ebe840 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebe840 0x216f260 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fda20084030 tx=0x7fda20003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9208c3ea32cbc0fa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda167fc700 1 -- 172.21.15.81:0/1603417036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20053c20 con 0x1ebe840 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda167fc700 1 -- 172.21.15.81:0/1603417036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20053dc0 con 0x1ebe840 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda167fc700 1 -- 172.21.15.81:0/1603417036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20004740 con 0x1ebe840 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- 172.21.15.81:0/1603417036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebe840 msgr2=0x216f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebe840 0x216f260 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fda20084030 tx=0x7fda20003f90 comp rx=0 tx=0).stop 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- 172.21.15.81:0/1603417036 shutdown_connections 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1f098c0 0x2137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1ebec10 0x216f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 --2- 172.21.15.81:0/1603417036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebe840 0x216f260 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- 172.21.15.81:0/1603417036 >> 172.21.15.81:0/1603417036 conn(0x1ebefe0 msgr2=0x21367a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:44.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- 172.21.15.81:0/1603417036 shutdown_connections 2023-11-29T11:22:44.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- 172.21.15.81:0/1603417036 wait complete. 2023-11-29T11:22:44.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 -- start start 2023-11-29T11:22:44.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.133+0000 7fda39724740 1 Processor -- start 2023-11-29T11:22:44.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x21d5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x214e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x202d200 con 0x1ebec10 2023-11-29T11:22:44.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x214f750 con 0x1f098c0 2023-11-29T11:22:44.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x21724e0 con 0x1ebe840 2023-11-29T11:22:44.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 10 client.0 _ll_register_callbacks cb 0x7fda28009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:22:44.144 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x21d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x21d5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41378/0 (socket says 172.21.15.81:41378) 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 -- 172.21.15.81:0/1498557300 learned_addr learned my addr 172.21.15.81:0/1498557300 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda34a41700 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x214e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 -- 172.21.15.81:0/1498557300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 msgr2=0x21506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 -- 172.21.15.81:0/1498557300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 msgr2=0x214e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x214e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 -- 172.21.15.81:0/1498557300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2006ce70 con 0x1ebec10 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda0effd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2f7fe700 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x21d5610 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fda24004a80 tx=0x7fda24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2f9244db9c05c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda0effd700 1 -- 172.21.15.81:0/1498557300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2402bae0 con 0x1ebec10 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda0effd700 1 -- 172.21.15.81:0/1498557300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fda2401a040 con 0x1ebec10 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 -- 172.21.15.81:0/1498557300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda28014cc0 con 0x1ebec10 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda0effd700 1 -- 172.21.15.81:0/1498557300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda24014680 con 0x1ebec10 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 10 client.9375 fetch_fsmap learned FSMap version 72 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 -- 172.21.15.81:0/1498557300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x2043af0 con 0x1ebec10 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda0effd700 1 -- 172.21.15.81:0/1498557300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28014cc0 con 0x1ebec10 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda0effd700 1 -- 172.21.15.81:0/1498557300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fda24035430 con 0x1ebec10 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 10 client.9375 fetch_fsmap finished waiting for FSMap version 72 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 10 client.9375 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 20 client.9375 populate_metadata read hostname 'smithi081' 2023-11-29T11:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2154a00 0x214e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 4 client.9375 mds_command: new command op to 8973 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda39724740 1 -- 172.21.15.81:0/1498557300 --> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1f3b390 con 0x2154a00 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.137+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2154a00 0x214e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda0effd700 10 client.9375 ms_handle_connect on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda2ffff700 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2154a00 0x214e7b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f3c0d69023a661b server_cookie=6c4bd02b1971e4c2 in_seq=0 out_seq=0 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda0effd700 1 -- 172.21.15.81:0/1498557300 <== mds.0 v2:172.21.15.81:6836/665591010 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x1f3b390 con 0x2154a00 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda0effd700 10 client.9375 handle_command_reply: tid=0 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 client.9375 shutdown 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 -- 172.21.15.81:0/1498557300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 msgr2=0x21d5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x21d5610 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fda24004a80 tx=0x7fda24016000 comp rx=0 tx=0).stop 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 -- 172.21.15.81:0/1498557300 shutdown_connections 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2154a00 0x214e7b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x1f098c0 0x214e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ebec10 0x21d5610 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 --2- 172.21.15.81:0/1498557300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x1ebe840 0x21506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 -- 172.21.15.81:0/1498557300 >> 172.21.15.81:0/1498557300 conn(0x1ebefe0 msgr2=0x214c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda0effd700 0 client.9375 ms_handle_reset on v2:172.21.15.81:6836/665591010 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 -- 172.21.15.81:0/1498557300 shutdown_connections 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 1 -- 172.21.15.81:0/1498557300 wait complete. 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda39724740 20 client.9375 trim_cache size 0 max 16384 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: "ea549a60-ab11-466a-9877-176419ba37f7": { 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "ea549a60-ab11-466a-9877-176419ba37f7", 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,repair" 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-11-29T11:22:44.151 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:22:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 -- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda1c064ee0 msgr2=0x7fda1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda1c064ee0 0x7fda1c067390 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fda301f9570 tx=0x7fda240079a0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 -- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda30160880 msgr2=0x7fda300c1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda30160880 0x7fda300c1f20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fda20019000 tx=0x7fda20009750 comp rx=0 tx=0).stop 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 -- 172.21.15.81:0/1346338551 shutdown_connections 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fda1c064ee0 0x7fda1c067390 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda301509d0 0x7fda300abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda30150580 0x7fda3009afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 --2- 172.21.15.81:0/1346338551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda30160880 0x7fda300c1f20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 -- 172.21.15.81:0/1346338551 >> 172.21.15.81:0/1346338551 conn(0x7fda300cae70 msgr2=0x7fda300b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 -- 172.21.15.81:0/1346338551 shutdown_connections 2023-11-29T11:22:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.141+0000 7fda35242700 1 -- 172.21.15.81:0/1346338551 wait complete. 2023-11-29T11:22:44.165 INFO:tasks.cephfs.filesystem:scrub status for tag:ea549a60-ab11-466a-9877-176419ba37f7 - {'path': '/', 'tag': 'ea549a60-ab11-466a-9877-176419ba37f7', 'options': 'recursive,repair'} 2023-11-29T11:22:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:44.749+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 8 ==== log(4 entries from seq 1 at 2023-11-29T11:22:43.963463+0000) v1 ==== 695+0+0 (secure 0 0 0) 0x7efdec05d6f0 con 0x7efdf415e480 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: cluster: 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: id: 8e4db050-5755-42f7-ba76-f62443203ed8 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: health: HEALTH_OK 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: services: 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: mon: 3 daemons, quorum a,b,c (age 10m) 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: mgr: y(active, since 10m), standbys: x 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: mds: 1/1 daemons up, 3 standby 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 10m) 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: data: 2023-11-29T11:22:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: volumes: 1/1 healthy 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: pools: 4 pools, 105 pgs 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: objects: 30 objects, 19 MiB 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: usage: 160 MiB used, 720 GiB / 720 GiB avail 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: pgs: 105 active+clean 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: io: 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: client: 85 B/s rd, 1.0 MiB/s wr, 0 op/s rd, 2 op/s wr 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:22:43.963463+0000 mds.a [INF] scrub queued for path: / 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:22:43.963466+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:22:43.963471+0000 mds.a [INF] scrub summary: active paths [/] 2023-11-29T11:22:44.757 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:22:43.965279+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2023-11-29T11:22:47.775 INFO:teuthology.orchestra.run.smithi081.stdout:2023-11-29T11:22:47.692789+0000 mds.a [INF] scrub summary: idle 2023-11-29T11:22:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:22:47.769+0000 7efdf1ffb700 1 -- 172.21.15.81:0/2086490395 <== mon.0 v2:172.21.15.81:3300/0 9 ==== log(1 entries from seq 5 at 2023-11-29T11:22:47.692789+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7efdec084000 con 0x7efdf415e480 2023-11-29T11:22:57.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:22:57.048 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:14.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-11-29T11:23:14.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.289+0000 7f723925c700 1 Processor -- start 2023-11-29T11:23:14.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.289+0000 7f723925c700 1 -- start start 2023-11-29T11:23:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f723406e530 0x7f723406e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f72340ccbf0 0x7f7234070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f723415dbf0 0x7f723415e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72340ce810 con 0x7f723406e530 2023-11-29T11:23:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723406ee40 con 0x7f72340ccbf0 2023-11-29T11:23:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72340cc070 con 0x7f723415dbf0 2023-11-29T11:23:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f723406e530 0x7f723406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f723406e530 0x7f723406e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44018/0 (socket says 172.21.15.81:44018) 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 -- 172.21.15.81:0/2716421152 learned_addr learned my addr 172.21.15.81:0/2716421152 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723259c700 1 --2- 172.21.15.81:0/2716421152 >> v2:172.21.15.176:3300/0 conn(0x7f72340ccbf0 0x7f7234070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723359e700 1 --2- 172.21.15.81:0/2716421152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f723415dbf0 0x7f723415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 -- 172.21.15.81:0/2716421152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f723415dbf0 msgr2=0x7f723415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 --2- 172.21.15.81:0/2716421152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f723415dbf0 0x7f723415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 -- 172.21.15.81:0/2716421152 >> v2:172.21.15.176:3300/0 conn(0x7f72340ccbf0 msgr2=0x7f7234070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 --2- 172.21.15.81:0/2716421152 >> v2:172.21.15.176:3300/0 conn(0x7f72340ccbf0 0x7f7234070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 -- 172.21.15.81:0/2716421152 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72340cc350 con 0x7f723406e530 2023-11-29T11:23:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7232d9d700 1 --2- 172.21.15.81:0/2716421152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f723406e900 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f72340718c0 tx=0x7f7224009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d171a951b60582 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7231d9b700 1 -- 172.21.15.81:0/2716421152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224011830 con 0x7f723406e530 2023-11-29T11:23:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7231d9b700 1 -- 172.21.15.81:0/2716421152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7224011990 con 0x7f723406e530 2023-11-29T11:23:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f7231d9b700 1 -- 172.21.15.81:0/2716421152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224011d20 con 0x7f723406e530 2023-11-29T11:23:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 -- 172.21.15.81:0/2716421152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 msgr2=0x7f723406e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 --2- 172.21.15.81:0/2716421152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f723406e900 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f72340718c0 tx=0x7f7224009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 -- 172.21.15.81:0/2716421152 shutdown_connections 2023-11-29T11:23:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 --2- 172.21.15.81:0/2716421152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f723415dbf0 0x7f723415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 --2- 172.21.15.81:0/2716421152 >> v2:172.21.15.176:3300/0 conn(0x7f72340ccbf0 0x7f7234070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 --2- 172.21.15.81:0/2716421152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f723406e900 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 -- 172.21.15.81:0/2716421152 >> 172.21.15.81:0/2716421152 conn(0x7f72340cdef0 msgr2=0x7f72340d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 -- 172.21.15.81:0/2716421152 shutdown_connections 2023-11-29T11:23:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.293+0000 7f723925c700 1 -- 172.21.15.81:0/2716421152 wait complete. 2023-11-29T11:23:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.297+0000 7f723925c700 1 Processor -- start 2023-11-29T11:23:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.297+0000 7f723925c700 1 -- start start 2023-11-29T11:23:14.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723925c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f7234156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723925c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72340ccbf0 0x7f7234156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723925c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f723415dbf0 0x7f72341ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723925c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7234157f30 con 0x7f723406e530 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723925c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72341573b0 con 0x7f723415dbf0 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723925c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7234157690 con 0x7f72340ccbf0 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f7234156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f7234156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44026/0 (socket says 172.21.15.81:44026) 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 -- 172.21.15.81:0/3141134606 learned_addr learned my addr 172.21.15.81:0/3141134606 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723259c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72340ccbf0 0x7f7234156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723359e700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f723415dbf0 0x7f72341ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 -- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72340ccbf0 msgr2=0x7f7234156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72340ccbf0 0x7f7234156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 -- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f723415dbf0 msgr2=0x7f72341ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f723415dbf0 0x7f72341ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 -- 172.21.15.81:0/3141134606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224009570 con 0x7f723406e530 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723359e700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f723415dbf0 0x7f72341ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f7232d9d700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f7234156630 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f7224004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f721b7fe700 1 -- 172.21.15.81:0/3141134606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224004590 con 0x7f723406e530 2023-11-29T11:23:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723925c700 1 -- 172.21.15.81:0/3141134606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72340cc910 con 0x7f723406e530 2023-11-29T11:23:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f721b7fe700 1 -- 172.21.15.81:0/3141134606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722401e070 con 0x7f723406e530 2023-11-29T11:23:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f723925c700 1 -- 172.21.15.81:0/3141134606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72340cc630 con 0x7f723406e530 2023-11-29T11:23:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.301+0000 7f721b7fe700 1 -- 172.21.15.81:0/3141134606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224003900 con 0x7f723406e530 2023-11-29T11:23:14.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.305+0000 7f721b7fe700 1 -- 172.21.15.81:0/3141134606 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f722400f050 con 0x7f723406e530 2023-11-29T11:23:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.305+0000 7f721b7fe700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7220064ee0 0x7f7220067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.305+0000 7f721b7fe700 1 -- 172.21.15.81:0/3141134606 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7224020070 con 0x7f723406e530 2023-11-29T11:23:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.305+0000 7f723259c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7220064ee0 0x7f7220067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.305+0000 7f723c4dc740 1 Processor -- start 2023-11-29T11:23:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.305+0000 7f723c4dc740 1 -- start start 2023-11-29T11:23:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.305+0000 7f723259c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7220064ee0 0x7f7220067390 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7234159d70 tx=0x7f7228008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c21b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c220a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c1e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ad9d20 con 0x296a840 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b49d60 con 0x29b58c0 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b43060 con 0x296ac10 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c220a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44040/0 (socket says 172.21.15.81:44040) 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 -- 172.21.15.81:0/3578020011 learned_addr learned my addr 172.21.15.81:0/3578020011 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f7232d9d700 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c21b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723359e700 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c1e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 -- 172.21.15.81:0/3578020011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 msgr2=0x2c21b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c21b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 -- 172.21.15.81:0/3578020011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 msgr2=0x2c1e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c1e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 -- 172.21.15.81:0/3578020011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2b690a0 con 0x296a840 2023-11-29T11:23:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723259c700 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c220a0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f7228011af0 tx=0x7f7228014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a339b892b8250677 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f7218ff9700 1 -- 172.21.15.81:0/3578020011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228025070 con 0x296a840 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f7218ff9700 1 -- 172.21.15.81:0/3578020011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228011ec0 con 0x296a840 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f7218ff9700 1 -- 172.21.15.81:0/3578020011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228004020 con 0x296a840 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 -- 172.21.15.81:0/3578020011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 msgr2=0x2c220a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c220a0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f7228011af0 tx=0x7f7228014000 comp rx=0 tx=0).stop 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 -- 172.21.15.81:0/3578020011 shutdown_connections 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c1e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c220a0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 --2- 172.21.15.81:0/3578020011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c21b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 -- 172.21.15.81:0/3578020011 >> 172.21.15.81:0/3578020011 conn(0x296afe0 msgr2=0x2c03b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 -- 172.21.15.81:0/3578020011 shutdown_connections 2023-11-29T11:23:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.309+0000 7f723c4dc740 1 -- 172.21.15.81:0/3578020011 wait complete. 2023-11-29T11:23:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 -- start start 2023-11-29T11:23:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 Processor -- start 2023-11-29T11:23:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c2a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c05d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29efc50 con 0x296a840 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2bdc8d0 con 0x29b58c0 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2c050a0 con 0x296ac10 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 10 client.0 _ll_register_callbacks cb 0x2b3c9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c2a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c2a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44056/0 (socket says 172.21.15.81:44056) 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 -- 172.21.15.81:0/2024420120 learned_addr learned my addr 172.21.15.81:0/2024420120 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723259c700 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723359e700 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c05d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 -- 172.21.15.81:0/2024420120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 msgr2=0x2c057e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c057e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 -- 172.21.15.81:0/2024420120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 msgr2=0x2c05d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c05d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 -- 172.21.15.81:0/2024420120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72280117a0 con 0x296a840 2023-11-29T11:23:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f7232d9d700 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c2a250 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f7224009f40 tx=0x7f7224054a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bf2384047039d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f72167f4700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:23:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f72167f4700 1 -- 172.21.15.81:0/2024420120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72240547d0 con 0x296a840 2023-11-29T11:23:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f72167f4700 1 -- 172.21.15.81:0/2024420120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f722405cce0 con 0x296a840 2023-11-29T11:23:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.313+0000 7f723c4dc740 1 -- 172.21.15.81:0/2024420120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2b3be00 con 0x296a840 2023-11-29T11:23:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f72167f4700 1 -- 172.21.15.81:0/2024420120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f722405cea0 con 0x296a840 2023-11-29T11:23:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 10 client.9387 fetch_fsmap learned FSMap version 72 2023-11-29T11:23:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 -- 172.21.15.81:0/2024420120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x29b6b10 con 0x296a840 2023-11-29T11:23:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f72167f4700 1 -- 172.21.15.81:0/2024420120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7224075080 con 0x296a840 2023-11-29T11:23:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f72167f4700 1 -- 172.21.15.81:0/2024420120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f722407bd20 con 0x296a840 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 10 client.9387 fetch_fsmap finished waiting for FSMap version 72 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 10 client.9387 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 20 client.9387 populate_metadata read hostname 'smithi081' 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2c285a0 0x2bdae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 4 client.9387 mds_command: new command op to 8973 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 -- 172.21.15.81:0/2024420120 --> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x29e7390 con 0x2c285a0 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723259c700 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2c285a0 0x2bdae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723259c700 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2c285a0 0x2bdae90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=198cbca66738177d server_cookie=6e7ccb51cc1f7548 in_seq=0 out_seq=0 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f72167f4700 10 client.9387 ms_handle_connect on v2:172.21.15.81:6836/665591010 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f72167f4700 1 -- 172.21.15.81:0/2024420120 <== mds.0 v2:172.21.15.81:6836/665591010 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x29e7390 con 0x2c285a0 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f72167f4700 10 client.9387 handle_command_reply: tid=0 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 client.9387 shutdown 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 -- 172.21.15.81:0/2024420120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 msgr2=0x2c2a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c2a250 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f7224009f40 tx=0x7f7224054a40 comp rx=0 tx=0).stop 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 -- 172.21.15.81:0/2024420120 shutdown_connections 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2c285a0 0x2bdae90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c05d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f72167f4700 0 client.9387 ms_handle_reset on v2:172.21.15.81:6836/665591010 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 --2- 172.21.15.81:0/2024420120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c2a250 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 -- 172.21.15.81:0/2024420120 >> 172.21.15.81:0/2024420120 conn(0x296afe0 msgr2=0x2c02cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 -- 172.21.15.81:0/2024420120 shutdown_connections 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 1 -- 172.21.15.81:0/2024420120 wait complete. 2023-11-29T11:23:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.317+0000 7f723c4dc740 20 client.9387 trim_cache size 0 max 16384 2023-11-29T11:23:14.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723c4dc740 1 Processor -- start 2023-11-29T11:23:14.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723c4dc740 1 -- start start 2023-11-29T11:23:14.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c26bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x296ac10 0x2c25ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29b58c0 0x2c261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723c4dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b41ef0 con 0x296a840 2023-11-29T11:23:14.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723c4dc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aef310 con 0x296ac10 2023-11-29T11:23:14.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723c4dc740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ae2510 con 0x29b58c0 2023-11-29T11:23:14.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f7232d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c26bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f7232d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c26bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44072/0 (socket says 172.21.15.81:44072) 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f7232d9d700 1 -- 172.21.15.81:0/3739779582 learned_addr learned my addr 172.21.15.81:0/3739779582 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723259c700 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x296ac10 0x2c25ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f723359e700 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29b58c0 0x2c261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f7232d9d700 1 -- 172.21.15.81:0/3739779582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29b58c0 msgr2=0x2c261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f7232d9d700 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29b58c0 0x2c261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f7232d9d700 1 -- 172.21.15.81:0/3739779582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x296ac10 msgr2=0x2c25ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f7232d9d700 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x296ac10 0x2c25ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.337+0000 7f7232d9d700 1 -- 172.21.15.81:0/3739779582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2b09970 con 0x296a840 2023-11-29T11:23:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c26bd0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f7224054de0 tx=0x7f7224058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312993aefc97f350 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f72197fa700 1 -- 172.21.15.81:0/3739779582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224054c20 con 0x296a840 2023-11-29T11:23:14.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f72197fa700 1 -- 172.21.15.81:0/3739779582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2b3be00 con 0x296a840 2023-11-29T11:23:14.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f72197fa700 1 -- 172.21.15.81:0/3739779582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224051420 con 0x296a840 2023-11-29T11:23:14.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- 172.21.15.81:0/3739779582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 msgr2=0x2c26bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c26bd0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f7224054de0 tx=0x7f7224058000 comp rx=0 tx=0).stop 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- 172.21.15.81:0/3739779582 shutdown_connections 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x29b58c0 0x2c261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x296ac10 0x2c25ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 --2- 172.21.15.81:0/3739779582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c26bd0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- 172.21.15.81:0/3739779582 >> 172.21.15.81:0/3739779582 conn(0x296afe0 msgr2=0x2c309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- 172.21.15.81:0/3739779582 shutdown_connections 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- 172.21.15.81:0/3739779582 wait complete. 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- start start 2023-11-29T11:23:14.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 Processor -- start 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c3d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c3dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c03060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b18f70 con 0x296a840 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b4aff0 con 0x29b58c0 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x2c316a0 con 0x296ac10 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723c4dc740 10 client.0 _ll_register_callbacks cb 0x7f72280096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c3d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c3d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44084/0 (socket says 172.21.15.81:44084) 2023-11-29T11:23:14.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 -- 172.21.15.81:0/1564872886 learned_addr learned my addr 172.21.15.81:0/1564872886 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723359e700 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c03060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f723259c700 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c3dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 -- 172.21.15.81:0/1564872886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 msgr2=0x2c3dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c3dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 -- 172.21.15.81:0/1564872886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 msgr2=0x2c03060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c03060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 -- 172.21.15.81:0/1564872886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x29b6b10 con 0x296a840 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f72167f4700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.341+0000 7f7232d9d700 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c3d7b0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f72240515e0 tx=0x7f7224009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5122fbc65af4b4b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 1 -- 172.21.15.81:0/1564872886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224051420 con 0x296a840 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 1 -- 172.21.15.81:0/1564872886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7224006ca0 con 0x296a840 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 -- 172.21.15.81:0/1564872886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2b3c0e0 con 0x296a840 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 1 -- 172.21.15.81:0/1564872886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7224081af0 con 0x296a840 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 10 client.9393 fetch_fsmap learned FSMap version 72 2023-11-29T11:23:14.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 -- 172.21.15.81:0/1564872886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x2aef450 con 0x296a840 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 1 -- 172.21.15.81:0/1564872886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2b3c0e0 con 0x296a840 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 1 -- 172.21.15.81:0/1564872886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 72) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f722402d070 con 0x296a840 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 10 client.9393 fetch_fsmap finished waiting for FSMap version 72 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 10 client.9393 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 20 client.9393 populate_metadata read hostname 'smithi081' 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2c26530 0x2c035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 4 client.9393 mds_command: new command op to 8973 tid=0[{"prefix": "scrub status"}] 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 -- 172.21.15.81:0/1564872886 --> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2978390 con 0x2c26530 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723259c700 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2c26530 0x2c035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 10 client.9393 ms_handle_connect on v2:172.21.15.81:6836/665591010 2023-11-29T11:23:14.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723259c700 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2c26530 0x2c035a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=841bbffce346078a server_cookie=5d48c4bb33b636fc in_seq=0 out_seq=0 2023-11-29T11:23:14.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 1 -- 172.21.15.81:0/1564872886 <== mds.0 v2:172.21.15.81:6836/665591010 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x2978390 con 0x2c26530 2023-11-29T11:23:14.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 10 client.9393 handle_command_reply: tid=0 2023-11-29T11:23:14.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 client.9393 shutdown 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 -- 172.21.15.81:0/1564872886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 msgr2=0x2c3d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c3d7b0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f72240515e0 tx=0x7f7224009110 comp rx=0 tx=0).stop 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 -- 172.21.15.81:0/1564872886 shutdown_connections 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.81:6836/665591010,v1:172.21.15.81:6837/665591010] conn(0x2c26530 0x2c035a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x29b58c0 0x2c03060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x296ac10 0x2c3dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 --2- 172.21.15.81:0/1564872886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296a840 0x2c3d7b0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f72167f4700 0 client.9393 ms_handle_reset on v2:172.21.15.81:6836/665591010 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 -- 172.21.15.81:0/1564872886 >> 172.21.15.81:0/1564872886 conn(0x296afe0 msgr2=0x2c309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 -- 172.21.15.81:0/1564872886 shutdown_connections 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 1 -- 172.21.15.81:0/1564872886 wait complete. 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723c4dc740 20 client.9393 trim_cache size 0 max 16384 2023-11-29T11:23:14.356 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2023-11-29T11:23:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2023-11-29T11:23:14.357 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:14.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 -- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7220064ee0 msgr2=0x7f7220067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7220064ee0 0x7f7220067390 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7234159d70 tx=0x7f7228008040 comp rx=0 tx=0).stop 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 -- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 msgr2=0x7f7234156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f7234156630 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f7224004770 comp rx=0 tx=0).stop 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 -- 172.21.15.81:0/3141134606 shutdown_connections 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7220064ee0 0x7f7220067390 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f723415dbf0 0x7f72341ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72340ccbf0 0x7f7234156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 --2- 172.21.15.81:0/3141134606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f723406e530 0x7f7234156630 secure :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f7224004770 comp rx=0 tx=0).stop 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.345+0000 7f723925c700 1 -- 172.21.15.81:0/3141134606 >> 172.21.15.81:0/3141134606 conn(0x7f72340cdef0 msgr2=0x7f72340c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.349+0000 7f723925c700 1 -- 172.21.15.81:0/3141134606 shutdown_connections 2023-11-29T11:23:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.349+0000 7f723925c700 1 -- 172.21.15.81:0/3141134606 wait complete. 2023-11-29T11:23:14.370 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-29T11:23:14.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:23:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.577+0000 7f9aeae80700 1 Processor -- start 2023-11-29T11:23:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.577+0000 7f9aeae80700 1 -- start start 2023-11-29T11:23:14.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9ae415d650 0x7f9ae40ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae40cc020 0x7f9ae40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae40cc9b0 con 0x7f9ae41594f0 2023-11-29T11:23:14.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae40cd720 con 0x7f9ae415d650 2023-11-29T11:23:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40cd990 con 0x7f9ae40cc020 2023-11-29T11:23:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aea67f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9ae41594f0 0x7f9ae4159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55022/0 (socket says 172.21.15.81:55022) 2023-11-29T11:23:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aea67f700 1 -- 172.21.15.81:0/4240279973 learned_addr learned my addr 172.21.15.81:0/4240279973 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae9e7e700 1 --2- 172.21.15.81:0/4240279973 >> v2:172.21.15.176:3300/0 conn(0x7f9ae415d650 0x7f9ae40ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae967d700 1 --2- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae40cc020 0x7f9ae40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae8e7c700 1 -- 172.21.15.81:0/4240279973 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740201151 0 0) 0x7f9adc001110 con 0x7f9ae41594f0 2023-11-29T11:23:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae8e7c700 1 -- 172.21.15.81:0/4240279973 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad00035d0 con 0x7f9ae41594f0 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae9e7e700 1 -- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae40cc020 msgr2=0x7f9ae40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae9e7e700 1 --2- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae40cc020 0x7f9ae40cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae9e7e700 1 -- 172.21.15.81:0/4240279973 >> v1:172.21.15.81:6789/0 conn(0x7f9ae41594f0 legacy=0x7f9ae4159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae9e7e700 1 -- 172.21.15.81:0/4240279973 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae40cdc70 con 0x7f9ae415d650 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae967d700 1 --2- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae40cc020 0x7f9ae40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae9e7e700 1 --2- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae415d650 0x7f9ae40ce470 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009850 tx=0x7f9ad8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79e067b68ff22383 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae8e7c700 1 -- 172.21.15.81:0/4240279973 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8011830 con 0x7f9ae415d650 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae8e7c700 1 -- 172.21.15.81:0/4240279973 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8011990 con 0x7f9ae415d650 2023-11-29T11:23:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9ae8e7c700 1 -- 172.21.15.81:0/4240279973 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8011d40 con 0x7f9ae415d650 2023-11-29T11:23:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 -- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae415d650 msgr2=0x7f9ae40ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 --2- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae415d650 0x7f9ae40ce470 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009850 tx=0x7f9ad8009b60 comp rx=0 tx=0).stop 2023-11-29T11:23:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 -- 172.21.15.81:0/4240279973 shutdown_connections 2023-11-29T11:23:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.581+0000 7f9aeae80700 1 --2- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae40cc020 0x7f9ae40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 --2- 172.21.15.81:0/4240279973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae415d650 0x7f9ae40ce470 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 -- 172.21.15.81:0/4240279973 >> 172.21.15.81:0/4240279973 conn(0x7f9ae406ec40 msgr2=0x7f9ae40b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 -- 172.21.15.81:0/4240279973 shutdown_connections 2023-11-29T11:23:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 -- 172.21.15.81:0/4240279973 wait complete. 2023-11-29T11:23:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 Processor -- start 2023-11-29T11:23:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 -- start start 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae40cc020 0x7f9ae40c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae41594f0 0x7f9ae41521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae415d650 0x7f9ae40c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40c6e80 con 0x7f9ae41594f0 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40c6ba0 con 0x7f9ae40cc020 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aeae80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4152ca0 con 0x7f9ae415d650 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae967d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae41594f0 0x7f9ae41521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae967d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae41594f0 0x7f9ae41521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44090/0 (socket says 172.21.15.81:44090) 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae967d700 1 -- 172.21.15.81:0/3998038943 learned_addr learned my addr 172.21.15.81:0/3998038943 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aea67f700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae415d650 0x7f9ae40c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae9e7e700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae40cc020 0x7f9ae40c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae967d700 1 -- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae415d650 msgr2=0x7f9ae40c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae967d700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae415d650 0x7f9ae40c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae967d700 1 -- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae40cc020 msgr2=0x7f9ae40c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae967d700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae40cc020 0x7f9ae40c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae967d700 1 -- 172.21.15.81:0/3998038943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae0009a70 con 0x7f9ae41594f0 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9aea67f700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae415d650 0x7f9ae40c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.585+0000 7f9ae9e7e700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae40cc020 0x7f9ae40c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9ae967d700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae41594f0 0x7f9ae41521f0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000efc0 tx=0x7f9ae000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9ad67fc700 1 -- 172.21.15.81:0/3998038943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000cee0 con 0x7f9ae41594f0 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9ad67fc700 1 -- 172.21.15.81:0/3998038943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae000f040 con 0x7f9ae41594f0 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad80094b0 con 0x7f9ae41594f0 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9ad67fc700 1 -- 172.21.15.81:0/3998038943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0014680 con 0x7f9ae41594f0 2023-11-29T11:23:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae415a250 con 0x7f9ae41594f0 2023-11-29T11:23:14.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae40cdf50 con 0x7f9ae41594f0 2023-11-29T11:23:14.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9ad67fc700 1 -- 172.21.15.81:0/3998038943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ae00147e0 con 0x7f9ae41594f0 2023-11-29T11:23:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9ad67fc700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ac8064ee0 0x7f9ac8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9ad67fc700 1 -- 172.21.15.81:0/3998038943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9ae0082f70 con 0x7f9ae41594f0 2023-11-29T11:23:14.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.589+0000 7f9ae9e7e700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ac8064ee0 0x7f9ac8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:14.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.593+0000 7f9ae9e7e700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ac8064ee0 0x7f9ac8067390 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80090b0 tx=0x7f9ad8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:14.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.597+0000 7f9ad67fc700 1 -- 172.21.15.81:0/3998038943 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ae0050f90 con 0x7f9ae41594f0 2023-11-29T11:23:14.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:14.797+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9ae406bb80 con 0x7f9ae41594f0 2023-11-29T11:23:15.709 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:23:15.705+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:23:15.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.717+0000 7f9ad67fc700 1 -- 172.21.15.81:0/3998038943 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9ae00545b0 con 0x7f9ae41594f0 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ac8064ee0 msgr2=0x7f9ac8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ac8064ee0 0x7f9ac8067390 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80090b0 tx=0x7f9ad8008030 comp rx=0 tx=0).stop 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae41594f0 msgr2=0x7f9ae41521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae41594f0 0x7f9ae41521f0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000efc0 tx=0x7f9ae000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 shutdown_connections 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ac8064ee0 0x7f9ac8067390 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ae415d650 0x7f9ae40c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae41594f0 0x7f9ae41521f0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 --2- 172.21.15.81:0/3998038943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ae40cc020 0x7f9ae40c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 >> 172.21.15.81:0/3998038943 conn(0x7f9ae406ec40 msgr2=0x7f9ae4157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 shutdown_connections 2023-11-29T11:23:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.725+0000 7f9aeae80700 1 -- 172.21.15.81:0/3998038943 wait complete. 2023-11-29T11:23:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:23:15.750 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2023-11-29T11:23:15.770 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-11-29T11:23:15.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 -- start start 2023-11-29T11:23:15.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 Processor -- start 2023-11-29T11:23:15.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559872d9800 0x55598737a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559872d9400 0x55598737ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5559872d9000 0x55598737b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55598730fcc0 con 0x5559872d9400 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55598730e780 con 0x5559872d9800 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55598730fe00 con 0x5559872d9000 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559872d9400 0x55598737ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559872d9400 0x55598737ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44124/0 (socket says 172.21.15.81:44124) 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 -- 172.21.15.81:0/2339621250 learned_addr learned my addr 172.21.15.81:0/2339621250 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4ba618700 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5559872d9000 0x55598737b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9e17700 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559872d9800 0x55598737a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 -- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5559872d9000 msgr2=0x55598737b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5559872d9000 0x55598737b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 -- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559872d9800 msgr2=0x55598737a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559872d9800 0x55598737a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 -- 172.21.15.81:0/2339621250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559872fa9c0 con 0x5559872d9400 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9e17700 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559872d9800 0x55598737a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4ba618700 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5559872d9000 0x55598737b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b9616700 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559872d9400 0x55598737ab00 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x55598814e6f0 tx=0x5559880c2c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9810a7417a6944f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b7612700 1 -- 172.21.15.81:0/2339621250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55598730d600 con 0x5559872d9400 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b7612700 1 -- 172.21.15.81:0/2339621250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555987324600 con 0x5559872d9400 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4b7612700 1 -- 172.21.15.81:0/2339621250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55598730d1e0 con 0x5559872d9400 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2339621250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559872fb380 con 0x5559872d9400 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2339621250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5559872fab60 con 0x5559872d9400 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.785+0000 7fa4bb65d380 4 waiting for MDS map... 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b7612700 1 -- 172.21.15.81:0/2339621250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x555987314c40 con 0x5559872d9400 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b7612700 1 -- 172.21.15.81:0/2339621250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 73) v1 ==== 2565+0+0 (secure 0 0 0) 0x5559880b6300 con 0x5559872d9400 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 4 Got MDS map 73 2023-11-29T11:23:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 10 main: JournalTool::main 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 4 main: JournalTool: connecting to RADOS... 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 Processor -- start 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 -- start start 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160400 0x55598737b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160800 0x55598737bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160c00 0x55598737c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55598730f680 con 0x555988160c00 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55598735e780 con 0x555988160800 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55598735e3c0 con 0x555988160400 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160c00 0x55598737c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160c00 0x55598737c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44138/0 (socket says 172.21.15.81:44138) 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 -- 172.21.15.81:0/185792890 learned_addr learned my addr 172.21.15.81:0/185792890 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9e17700 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160800 0x55598737bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4ba618700 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160400 0x55598737b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 -- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160400 msgr2=0x55598737b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160400 0x55598737b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 -- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160800 msgr2=0x55598737bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160800 0x55598737bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 -- 172.21.15.81:0/185792890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559872fb860 con 0x555988160c00 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9e17700 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160800 0x55598737bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b9616700 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160c00 0x55598737c100 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x55598814fb60 tx=0x5559880c2b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145d39309736b00f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b560e700 1 -- 172.21.15.81:0/185792890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55598730cf20 con 0x555988160c00 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b560e700 1 -- 172.21.15.81:0/185792890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555987630000 con 0x555988160c00 2023-11-29T11:23:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4b560e700 1 -- 172.21.15.81:0/185792890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55598730d600 con 0x555988160c00 2023-11-29T11:23:15.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 -- 172.21.15.81:0/185792890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160c00 msgr2=0x55598737c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160c00 0x55598737c100 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x55598814fb60 tx=0x5559880c2b40 comp rx=0 tx=0).stop 2023-11-29T11:23:15.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 -- 172.21.15.81:0/185792890 shutdown_connections 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160c00 0x55598737c100 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160800 0x55598737bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/185792890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160400 0x55598737b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.789+0000 7fa4bb65d380 1 -- 172.21.15.81:0/185792890 >> 172.21.15.81:0/185792890 conn(0x5559872d8c00 msgr2=0x5559873c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 -- 172.21.15.81:0/185792890 shutdown_connections 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 -- 172.21.15.81:0/185792890 wait complete. 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 Processor -- start 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 -- start start 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160400 0x55598737d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160800 0x55598737cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160c00 0x55598737c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55598735e280 con 0x555988160800 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x55598730e780 con 0x555988160400 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x55598730f900 con 0x555988160c00 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160800 0x55598737cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160800 0x55598737cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44150/0 (socket says 172.21.15.81:44150) 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 -- 172.21.15.81:0/2743156362 learned_addr learned my addr 172.21.15.81:0/2743156362 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9616700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160c00 0x55598737c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4ba618700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160400 0x55598737d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 -- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160c00 msgr2=0x55598737c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160c00 0x55598737c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 -- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160400 msgr2=0x55598737d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160400 0x55598737d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 -- 172.21.15.81:0/2743156362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559872fba00 con 0x555988160800 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b9e17700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160800 0x55598737cc00 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x5559876406f0 tx=0x5559875d0e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b3e0b700 1 -- 172.21.15.81:0/2743156362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55598730cf20 con 0x555988160800 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b3e0b700 1 -- 172.21.15.81:0/2743156362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555987630600 con 0x555988160800 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4b3e0b700 1 -- 172.21.15.81:0/2743156362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55598730d600 con 0x555988160800 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559872fbd40 con 0x555988160800 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559876564e0 con 0x555988160800 2023-11-29T11:23:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.793+0000 7fa4bb65d380 4 main: JournalTool: resolving pool 16 2023-11-29T11:23:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4b3e0b700 1 -- 172.21.15.81:0/2743156362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x555987336840 con 0x555988160800 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4b3e0b700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x555987732000 0x55598737d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4b3e0b700 1 -- 172.21.15.81:0/2743156362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x555987314a80 con 0x555988160800 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 4 main: JournalTool: creating IoCtx.. 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 4 main: Executing for rank 0 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 4 Filtering by inode '1099511627777' 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4ba618700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x555987732000 0x55598737d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x555988161000 0x55598737c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x555988161400 con 0x555988161000 2023-11-29T11:23:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4b9616700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x555988161000 0x55598737c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4ba618700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x555987732000 0x55598737d700 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x555988050cf0 tx=0x55598773c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4b9616700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x555988161000 0x55598737c100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4b9616700 1 -- 172.21.15.81:0/2743156362 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5559880c0fc0 con 0x555988161000 2023-11-29T11:23:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 4 Pointer 400.00000000 is readable 2023-11-29T11:23:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 4 JournalScanner::scan: reading header object '200.00000000' 2023-11-29T11:23:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x555988161800 con 0x555988161000 2023-11-29T11:23:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4b9616700 1 -- 172.21.15.81:0/2743156362 <== osd.0 v2:172.21.15.81:6802/36537 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5559880c0fc0 con 0x555988161000 2023-11-29T11:23:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 10 Header 0x400000 0x405dc0 0x406188 2023-11-29T11:23:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 10 Starting journal scan from offset 0x405dc0 2023-11-29T11:23:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.801+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [read 24000~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x555987732400 con 0x555988161000 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4b9616700 1 -- 172.21.15.81:0/2743156362 <== osd.0 v2:172.21.15.81:6802/36537 3 ==== osd_op_reply(3 200.00000001 [read 24000~968 out=968b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+968 (crc 0 0 0) 0x5559880c0fc0 con 0x555988161000 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 4 Read 0x3c8 bytes from 200.00000001 gap=0 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 10 Parsing data, 0x3c8 bytes available 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 10 Attempting decode at 0x405dc0 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 10 Consumed 0x37c bytes 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 10 Valid entry at 0x405dc0 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 10 Attempting decode at 0x40613c 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 10 Consumed 0x4c bytes 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 10 Valid entry at 0x40613c 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x555987732800 0x55598737bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x555987732c00 con 0x555987732800 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4ba618700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x555987732800 0x55598737bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4ba618700 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x555987732800 0x55598737bb80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4ba618700 1 -- 172.21.15.81:0/2743156362 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5559880c1200 con 0x555987732800 2023-11-29T11:23:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 4 Reached end of journal objects 2023-11-29T11:23:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 4 Scanned objects, 0 missing, 1 valid 2023-11-29T11:23:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 4 Events scanned, 0 gaps 2023-11-29T11:23:15.813 INFO:teuthology.orchestra.run.smithi081.stdout:Events by type: 2023-11-29T11:23:15.813 INFO:teuthology.orchestra.run.smithi081.stdout:Errors: 0 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 4 Found 2 valid events 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 4 Selected 0 events events for processing 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 4 0 events 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x555988161000 msgr2=0x55598737c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x555988161000 0x55598737c100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x555987732800 msgr2=0x55598737bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x555987732800 0x55598737bb80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x555987732000 msgr2=0x55598737d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x555987732000 0x55598737d700 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x555988050cf0 tx=0x55598773c000 comp rx=0 tx=0).stop 2023-11-29T11:23:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160800 msgr2=0x55598737cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160800 0x55598737cc00 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x5559876406f0 tx=0x5559875d0e40 comp rx=0 tx=0).stop 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 shutdown_connections 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x555988161000 0x55598737c100 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x555987732000 0x55598737d700 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555988160c00 0x55598737c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x555987732800 0x55598737bb80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4b9e17700 1 -- 172.21.15.81:0/2743156362 reap_dead start 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555988160800 0x55598737cc00 secure :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x5559876406f0 tx=0x5559875d0e40 comp rx=0 tx=0).stop 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2743156362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555988160400 0x55598737d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 >> 172.21.15.81:0/2743156362 conn(0x5559872d8c00 msgr2=0x5559873c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4b9e17700 1 -- 172.21.15.81:0/2743156362 reap_dead start 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 shutdown_connections 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2743156362 wait complete. 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2339621250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559872d9400 msgr2=0x55598737ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559872d9400 0x55598737ab00 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x55598814e6f0 tx=0x5559880c2c00 comp rx=0 tx=0).stop 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2339621250 shutdown_connections 2023-11-29T11:23:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5559872d9000 0x55598737b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559872d9400 0x55598737ab00 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 --2- 172.21.15.81:0/2339621250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5559872d9800 0x55598737a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2339621250 >> 172.21.15.81:0/2339621250 conn(0x5559872d9c00 msgr2=0x5559873c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2339621250 shutdown_connections 2023-11-29T11:23:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.805+0000 7fa4bb65d380 1 -- 172.21.15.81:0/2339621250 wait complete. 2023-11-29T11:23:15.817 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.067121, result: Events by type: Errors: 0 2023-11-29T11:23:15.818 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2023-11-29T11:23:15.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.893+0000 7f9bdd088380 1 -- start start 2023-11-29T11:23:15.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.893+0000 7f9bdd088380 1 Processor -- start 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565199b7f800 0x565199c20580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565199b7f400 0x565199c20b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565199b7f000 0x565199c21080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565199bb5cc0 con 0x565199b7f400 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x565199bb4780 con 0x565199b7f800 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x565199bb5e00 con 0x565199b7f000 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565199b7f400 0x565199c20b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565199b7f400 0x565199c20b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44160/0 (socket says 172.21.15.81:44160) 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 -- 172.21.15.81:0/3963988228 learned_addr learned my addr 172.21.15.81:0/3963988228 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdc043700 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565199b7f000 0x565199c21080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb842700 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565199b7f800 0x565199c20580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 -- 172.21.15.81:0/3963988228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565199b7f000 msgr2=0x565199c21080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565199b7f000 0x565199c21080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 -- 172.21.15.81:0/3963988228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565199b7f800 msgr2=0x565199c20580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565199b7f800 0x565199c20580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 -- 172.21.15.81:0/3963988228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565199ba09c0 con 0x565199b7f400 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdb041700 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565199b7f400 0x565199c20b00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x56519a9f06c0 tx=0x56519a954c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ce1b1693742125 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bd903d700 1 -- 172.21.15.81:0/3963988228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565199bb3600 con 0x565199b7f400 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bd903d700 1 -- 172.21.15.81:0/3963988228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565199bcb080 con 0x565199b7f400 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bd903d700 1 -- 172.21.15.81:0/3963988228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565199bb31e0 con 0x565199b7f400 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 1 -- 172.21.15.81:0/3963988228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565199ba1380 con 0x565199b7f400 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 1 -- 172.21.15.81:0/3963988228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x565199ba0b60 con 0x565199b7f400 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 4 waiting for MDS map... 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bd903d700 1 -- 172.21.15.81:0/3963988228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x565199bbac40 con 0x565199b7f400 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bd903d700 1 -- 172.21.15.81:0/3963988228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 73) v1 ==== 2565+0+0 (secure 0 0 0) 0x56519a960300 con 0x565199b7f400 2023-11-29T11:23:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 4 Got MDS map 73 2023-11-29T11:23:15.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 10 main: JournalTool::main 2023-11-29T11:23:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.897+0000 7f9bdd088380 4 main: JournalTool: connecting to RADOS... 2023-11-29T11:23:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 Processor -- start 2023-11-29T11:23:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- start start 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 0x565199c21600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c21b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 0x565199c22100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565199bb5680 con 0x56519aa08800 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x565199c04780 con 0x56519aa08c00 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x565199c043c0 con 0x56519aa08400 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c21b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c21b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44164/0 (socket says 172.21.15.81:44164) 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 -- 172.21.15.81:0/4096291321 learned_addr learned my addr 172.21.15.81:0/4096291321 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdc043700 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 0x565199c21600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb041700 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 0x565199c22100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 -- 172.21.15.81:0/4096291321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 msgr2=0x565199c21600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 0x565199c21600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 -- 172.21.15.81:0/4096291321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 msgr2=0x565199c22100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 0x565199c22100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 -- 172.21.15.81:0/4096291321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565199ba1860 con 0x56519aa08800 2023-11-29T11:23:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdb842700 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c21b80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x56519a9f1b90 tx=0x565199e86c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6cbdd22892a7a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bd7039700 1 -- 172.21.15.81:0/4096291321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565199bb3080 con 0x56519aa08800 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bd7039700 1 -- 172.21.15.81:0/4096291321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519a9fc300 con 0x56519aa08800 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bd7039700 1 -- 172.21.15.81:0/4096291321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565199bb3600 con 0x56519aa08800 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- 172.21.15.81:0/4096291321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 msgr2=0x565199c21b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c21b80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x56519a9f1b90 tx=0x565199e86c00 comp rx=0 tx=0).stop 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- 172.21.15.81:0/4096291321 shutdown_connections 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 0x565199c22100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c21b80 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 --2- 172.21.15.81:0/4096291321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 0x565199c21600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- 172.21.15.81:0/4096291321 >> 172.21.15.81:0/4096291321 conn(0x565199b7ec00 msgr2=0x565199c6f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- 172.21.15.81:0/4096291321 shutdown_connections 2023-11-29T11:23:15.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 -- 172.21.15.81:0/4096291321 wait complete. 2023-11-29T11:23:15.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.901+0000 7f9bdd088380 1 Processor -- start 2023-11-29T11:23:15.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 -- start start 2023-11-29T11:23:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 0x565199c23180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c22c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 0x565199c22680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565199c04280 con 0x56519aa08800 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x565199bb4780 con 0x56519aa08c00 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x565199bb5900 con 0x56519aa08400 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c22c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c22c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44174/0 (socket says 172.21.15.81:44174) 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 -- 172.21.15.81:0/2308208723 learned_addr learned my addr 172.21.15.81:0/2308208723 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdc043700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 0x565199c23180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb041700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 0x565199c22680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 -- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 msgr2=0x565199c23180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 0x565199c23180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 -- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 msgr2=0x565199c22680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56519aa08c00 0x565199c22680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 -- 172.21.15.81:0/2308208723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565199ba0000 con 0x56519aa08800 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdc043700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56519aa08400 0x565199c23180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdb842700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c22c00 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x565199eecc60 tx=0x565199e86e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bd5836700 1 -- 172.21.15.81:0/2308208723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565199bb31e0 con 0x56519aa08800 2023-11-29T11:23:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bd5836700 1 -- 172.21.15.81:0/2308208723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519a9fc480 con 0x56519aa08800 2023-11-29T11:23:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565199ba1a00 con 0x56519aa08800 2023-11-29T11:23:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bd5836700 1 -- 172.21.15.81:0/2308208723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565199bb2dc0 con 0x56519aa08800 2023-11-29T11:23:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565199ba1860 con 0x56519aa08800 2023-11-29T11:23:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.905+0000 7f9bdd088380 4 main: JournalTool: resolving pool 16 2023-11-29T11:23:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bd5836700 1 -- 172.21.15.81:0/2308208723 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x565199bdc840 con 0x56519aa08800 2023-11-29T11:23:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bd5836700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x565199fd0000 0x565199c23700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bd5836700 1 -- 172.21.15.81:0/2308208723 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x565199bbaa80 con 0x56519aa08800 2023-11-29T11:23:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdc043700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x565199fd0000 0x565199c23700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 4 main: JournalTool: creating IoCtx.. 2023-11-29T11:23:15.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 4 main: Executing for rank 0 2023-11-29T11:23:15.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 4 Filtering by inode '1099511627778' 2023-11-29T11:23:15.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x56519aa09000 0x565199c22100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x56519aa09400 con 0x56519aa09000 2023-11-29T11:23:15.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdb041700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x56519aa09000 0x565199c22100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdc043700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x565199fd0000 0x565199c23700 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x56519a8f7e60 tx=0x565199e87f80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdb041700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x56519aa09000 0x565199c22100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdb041700 1 -- 172.21.15.81:0/2308208723 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x56519a9eefc0 con 0x56519aa09000 2023-11-29T11:23:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 4 Pointer 400.00000000 is readable 2023-11-29T11:23:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 4 JournalScanner::scan: reading header object '200.00000000' 2023-11-29T11:23:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x56519aa09800 con 0x56519aa09000 2023-11-29T11:23:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdb041700 1 -- 172.21.15.81:0/2308208723 <== osd.0 v2:172.21.15.81:6802/36537 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x56519a9eefc0 con 0x56519aa09000 2023-11-29T11:23:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 10 Header 0x400000 0x405dc0 0x406188 2023-11-29T11:23:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 10 Starting journal scan from offset 0x405dc0 2023-11-29T11:23:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.909+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [read 24000~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x565199fd0400 con 0x56519aa09000 2023-11-29T11:23:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdb041700 1 -- 172.21.15.81:0/2308208723 <== osd.0 v2:172.21.15.81:6802/36537 3 ==== osd_op_reply(3 200.00000001 [read 24000~968 out=968b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+968 (crc 0 0 0) 0x56519a9eefc0 con 0x56519aa09000 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 4 Read 0x3c8 bytes from 200.00000001 gap=0 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 10 Parsing data, 0x3c8 bytes available 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 10 Attempting decode at 0x405dc0 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 10 Consumed 0x37c bytes 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 10 Valid entry at 0x405dc0 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 10 Attempting decode at 0x40613c 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 10 Consumed 0x4c bytes 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 10 Valid entry at 0x40613c 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x565199fd0800 0x565199c21b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v8 -- 0x565199fd0c00 con 0x565199fd0800 2023-11-29T11:23:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdc043700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x565199fd0800 0x565199c21b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdc043700 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x565199fd0800 0x565199c21b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdc043700 1 -- 172.21.15.81:0/2308208723 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56519a9ef200 con 0x565199fd0800 2023-11-29T11:23:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 4 Reached end of journal objects 2023-11-29T11:23:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 4 Scanned objects, 0 missing, 1 valid 2023-11-29T11:23:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 4 Events scanned, 0 gaps 2023-11-29T11:23:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 4 Found 2 valid events 2023-11-29T11:23:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 4 Selected 0 events events for processing 2023-11-29T11:23:15.921 INFO:teuthology.orchestra.run.smithi081.stdout:Events by type: 2023-11-29T11:23:15.922 INFO:teuthology.orchestra.run.smithi081.stdout:Errors: 0 2023-11-29T11:23:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 4 0 events 2023-11-29T11:23:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x56519aa09000 msgr2=0x565199c22100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x56519aa09000 0x565199c22100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x565199fd0800 msgr2=0x565199c21b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x565199fd0800 0x565199c21b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x565199fd0000 msgr2=0x565199c23700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x565199fd0000 0x565199c23700 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x56519a8f7e60 tx=0x565199e87f80 comp rx=0 tx=0).stop 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 msgr2=0x565199c22c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/2308208723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56519aa08800 0x565199c22c00 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x565199eecc60 tx=0x565199e86e40 comp rx=0 tx=0).stop 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdb842700 1 -- 172.21.15.81:0/2308208723 reap_dead start 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdb842700 1 -- 172.21.15.81:0/2308208723 reap_dead start 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 shutdown_connections 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 >> 172.21.15.81:0/2308208723 conn(0x565199b7ec00 msgr2=0x565199c6f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 shutdown_connections 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/2308208723 wait complete. 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/3963988228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565199b7f400 msgr2=0x565199c20b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565199b7f400 0x565199c20b00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x56519a9f06c0 tx=0x56519a954c00 comp rx=0 tx=0).stop 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/3963988228 shutdown_connections 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565199b7f000 0x565199c21080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565199b7f400 0x565199c20b00 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 --2- 172.21.15.81:0/3963988228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565199b7f800 0x565199c20580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/3963988228 >> 172.21.15.81:0/3963988228 conn(0x565199b7fc00 msgr2=0x565199c6f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/3963988228 shutdown_connections 2023-11-29T11:23:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.913+0000 7f9bdd088380 1 -- 172.21.15.81:0/3963988228 wait complete. 2023-11-29T11:23:15.926 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.108122, result: Events by type: Errors: 0 2023-11-29T11:23:15.926 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2023-11-29T11:23:15.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 Processor -- start 2023-11-29T11:23:15.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- start start 2023-11-29T11:23:15.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff706890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7ba5b0 0x564dff728a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7b9500 0x564dff729510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dff677180 con 0x564dff7ba5b0 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dff60a240 con 0x564dff7b9500 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dff706dd0 con 0x564dff6e7440 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7ba5b0 0x564dff728a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7ba5b0 0x564dff728a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44180/0 (socket says 172.21.15.81:44180) 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 -- 172.21.15.81:0/777777638 learned_addr learned my addr 172.21.15.81:0/777777638 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645a11c700 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff706890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645a91d700 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7b9500 0x564dff729510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 -- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 msgr2=0x564dff706890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff706890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 -- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7b9500 msgr2=0x564dff729510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:15.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7b9500 0x564dff729510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 -- 172.21.15.81:0/777777638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c005d20 con 0x564dff7ba5b0 2023-11-29T11:23:15.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645a11c700 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff706890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:15.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645991b700 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7ba5b0 0x564dff728a60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f644c002000 tx=0x7f644c00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b27ad8e476f3d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f6458919700 1 -- 172.21.15.81:0/777777638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c017070 con 0x564dff7ba5b0 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f6458919700 1 -- 172.21.15.81:0/777777638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c008ba0 con 0x564dff7ba5b0 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f6458919700 1 -- 172.21.15.81:0/777777638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c01a040 con 0x564dff7ba5b0 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- 172.21.15.81:0/777777638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7ba5b0 msgr2=0x564dff728a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7ba5b0 0x564dff728a60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f644c002000 tx=0x7f644c00d000 comp rx=0 tx=0).stop 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- 172.21.15.81:0/777777638 shutdown_connections 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7b9500 0x564dff729510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7ba5b0 0x564dff728a60 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 --2- 172.21.15.81:0/777777638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff706890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- 172.21.15.81:0/777777638 >> 172.21.15.81:0/777777638 conn(0x564dff711dc0 msgr2=0x564dff7bb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- 172.21.15.81:0/777777638 shutdown_connections 2023-11-29T11:23:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.961+0000 7f645c5e7140 1 -- 172.21.15.81:0/777777638 wait complete. 2023-11-29T11:23:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645c5e7140 1 Processor -- start 2023-11-29T11:23:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645c5e7140 1 -- start start 2023-11-29T11:23:15.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645c5e7140 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff72e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645c5e7140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7b9500 0x564dff72e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645c5e7140 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7abb90 0x564dff7abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645c5e7140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dff7a9870 con 0x564dff7b9500 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645c5e7140 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dff7ab680 con 0x564dff7abb90 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645c5e7140 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dff7ab920 con 0x564dff6e7440 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645991b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7b9500 0x564dff72e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645a11c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff72e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645991b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7b9500 0x564dff72e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44194/0 (socket says 172.21.15.81:44194) 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645991b700 1 -- 172.21.15.81:0/2627338847 learned_addr learned my addr 172.21.15.81:0/2627338847 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.965+0000 7f645a91d700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7abb90 0x564dff7abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645991b700 1 -- 172.21.15.81:0/2627338847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 msgr2=0x564dff72e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645991b700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff72e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645991b700 1 -- 172.21.15.81:0/2627338847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7abb90 msgr2=0x564dff7abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645991b700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564dff7abb90 0x564dff7abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645991b700 1 -- 172.21.15.81:0/2627338847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dff622390 con 0x564dff7b9500 2023-11-29T11:23:15.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645a11c700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564dff6e7440 0x564dff72e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:23:15.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645991b700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7b9500 0x564dff72e600 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f644c021040 tx=0x7f644c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f64537fe700 1 -- 172.21.15.81:0/2627338847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c017050 con 0x564dff7b9500 2023-11-29T11:23:15.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f64537fe700 1 -- 172.21.15.81:0/2627338847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c013d40 con 0x564dff7b9500 2023-11-29T11:23:15.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564dff6158b0 con 0x564dff7b9500 2023-11-29T11:23:15.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f64537fe700 1 -- 172.21.15.81:0/2627338847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c029660 con 0x564dff7b9500 2023-11-29T11:23:15.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.969+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564dff6225d0 con 0x564dff7b9500 2023-11-29T11:23:15.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f64537fe700 1 -- 172.21.15.81:0/2627338847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f644c00ad70 con 0x564dff7b9500 2023-11-29T11:23:15.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f64537fe700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f643c063810 0x7f643c065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f64537fe700 1 -- 172.21.15.81:0/2627338847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f644c0837a0 con 0x564dff7b9500 2023-11-29T11:23:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f645a11c700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f643c063810 0x7f643c065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f645c5e7140 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x564dff70cf20 0x564dff70d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- osd_op(unknown.0.0:1 16.13 16:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x564dff70d830 con 0x564dff70cf20 2023-11-29T11:23:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f645a91d700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x564dff70cf20 0x564dff70d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f645a11c700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f643c063810 0x7f643c065cc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6444002250 tx=0x7f6444006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.973+0000 7f645a91d700 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x564dff70cf20 0x564dff70d2f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645a91d700 1 -- 172.21.15.81:0/2627338847 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v113'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f64540105d0 con 0x564dff70cf20 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x564dff70cf20 msgr2=0x564dff70d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x564dff70cf20 0x564dff70d2f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f643c063810 msgr2=0x7f643c065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f643c063810 0x7f643c065cc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6444002250 tx=0x7f6444006040 comp rx=0 tx=0).stop 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7b9500 msgr2=0x564dff72e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 --2- 172.21.15.81:0/2627338847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564dff7b9500 0x564dff72e600 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f644c021040 tx=0x7f644c002fb0 comp rx=0 tx=0).stop 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645a91d700 1 -- 172.21.15.81:0/2627338847 reap_dead start 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 shutdown_connections 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 >> 172.21.15.81:0/2627338847 conn(0x564dff711dc0 msgr2=0x564dff7bb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 shutdown_connections 2023-11-29T11:23:15.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:15.977+0000 7f645c5e7140 1 -- 172.21.15.81:0/2627338847 wait complete. 2023-11-29T11:23:15.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-29T11:23:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 Processor -- start 2023-11-29T11:23:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- start start 2023-11-29T11:23:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f746406a4c0 0x7f746406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f74640cf0e0 0x7f74640cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74640cfa40 con 0x7f74640b1ae0 2023-11-29T11:23:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74640d0ab0 con 0x7f746406a4c0 2023-11-29T11:23:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746406a9c0 con 0x7f74640cf0e0 2023-11-29T11:23:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469092700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f746406a4c0 0x7f746406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469893700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f74640b1ae0 0x7f74640d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55052/0 (socket says 172.21.15.81:55052) 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469092700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f746406a4c0 0x7f746406d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44202/0 (socket says 172.21.15.81:44202) 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469893700 1 -- 172.21.15.81:0/3666412319 learned_addr learned my addr 172.21.15.81:0/3666412319 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a094700 1 --2- 172.21.15.81:0/3666412319 >> v2:172.21.15.176:3300/0 conn(0x7f74640cf0e0 0x7f74640cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469092700 1 -- 172.21.15.81:0/3666412319 >> v2:172.21.15.176:3300/0 conn(0x7f74640cf0e0 msgr2=0x7f74640cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469092700 1 --2- 172.21.15.81:0/3666412319 >> v2:172.21.15.176:3300/0 conn(0x7f74640cf0e0 0x7f74640cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469092700 1 -- 172.21.15.81:0/3666412319 >> v1:172.21.15.81:6789/0 conn(0x7f74640b1ae0 legacy=0x7f74640d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7468891700 1 -- 172.21.15.81:0/3666412319 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941091836 0 0) 0x7f74640cfa40 con 0x7f74640b1ae0 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469092700 1 -- 172.21.15.81:0/3666412319 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746406aca0 con 0x7f746406a4c0 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7469092700 1 --2- 172.21.15.81:0/3666412319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f746406a4c0 0x7f746406d8e0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f74640b6440 tx=0x7f7460009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cd27f7dec48e66 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7468891700 1 -- 172.21.15.81:0/3666412319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011830 con 0x7f746406a4c0 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7468891700 1 -- 172.21.15.81:0/3666412319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460011990 con 0x7f746406a4c0 2023-11-29T11:23:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f7468891700 1 -- 172.21.15.81:0/3666412319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460011d40 con 0x7f746406a4c0 2023-11-29T11:23:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- 172.21.15.81:0/3666412319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f746406a4c0 msgr2=0x7f746406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 --2- 172.21.15.81:0/3666412319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f746406a4c0 0x7f746406d8e0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f74640b6440 tx=0x7f7460009b30 comp rx=0 tx=0).stop 2023-11-29T11:23:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- 172.21.15.81:0/3666412319 shutdown_connections 2023-11-29T11:23:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 --2- 172.21.15.81:0/3666412319 >> v2:172.21.15.176:3300/0 conn(0x7f74640cf0e0 0x7f74640cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 --2- 172.21.15.81:0/3666412319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f746406a4c0 0x7f746406d8e0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- 172.21.15.81:0/3666412319 >> 172.21.15.81:0/3666412319 conn(0x7f746409bbd0 msgr2=0x7f74640b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- 172.21.15.81:0/3666412319 shutdown_connections 2023-11-29T11:23:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.101+0000 7f746a895700 1 -- 172.21.15.81:0/3666412319 wait complete. 2023-11-29T11:23:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 Processor -- start 2023-11-29T11:23:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 -- start start 2023-11-29T11:23:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f746406a4c0 0x7f746415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74640b1ae0 0x7f746409c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74640cf0e0 0x7f74640b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746415f520 con 0x7f74640b1ae0 2023-11-29T11:23:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746415ef60 con 0x7f746406a4c0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746415f240 con 0x7f74640cf0e0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74640b1ae0 0x7f746409c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74640b1ae0 0x7f746409c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44206/0 (socket says 172.21.15.81:44206) 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 -- 172.21.15.81:0/2237207081 learned_addr learned my addr 172.21.15.81:0/2237207081 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469893700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f746406a4c0 0x7f746415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a094700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74640cf0e0 0x7f74640b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 -- 172.21.15.81:0/2237207081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74640cf0e0 msgr2=0x7f74640b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74640cf0e0 0x7f74640b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 -- 172.21.15.81:0/2237207081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f746406a4c0 msgr2=0x7f746415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f746406a4c0 0x7f746415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 -- 172.21.15.81:0/2237207081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600094b0 con 0x7f74640b1ae0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f7469092700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74640b1ae0 0x7f746409c540 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f7460009b70 tx=0x7f7460004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f74567fc700 1 -- 172.21.15.81:0/2237207081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600036c0 con 0x7f74640b1ae0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f74567fc700 1 -- 172.21.15.81:0/2237207081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746001e070 con 0x7f74640b1ae0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74640b4380 con 0x7f74640b1ae0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f74567fc700 1 -- 172.21.15.81:0/2237207081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460003a80 con 0x7f74640b1ae0 2023-11-29T11:23:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.105+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746406af80 con 0x7f74640b1ae0 2023-11-29T11:23:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.109+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74640b1eb0 con 0x7f74640b1ae0 2023-11-29T11:23:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.109+0000 7f74567fc700 1 -- 172.21.15.81:0/2237207081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f746000f050 con 0x7f74640b1ae0 2023-11-29T11:23:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.109+0000 7f74567fc700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7448064ee0 0x7f7448067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.109+0000 7f74567fc700 1 -- 172.21.15.81:0/2237207081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f7460083060 con 0x7f74640b1ae0 2023-11-29T11:23:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.109+0000 7f7469893700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7448064ee0 0x7f7448067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.109+0000 7f7469893700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7448064ee0 0x7f7448067390 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7458000f60 tx=0x7f7458007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.117+0000 7f74567fc700 1 -- 172.21.15.81:0/2237207081 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7460051030 con 0x7f74640b1ae0 2023-11-29T11:23:16.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.313+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f7464072500 con 0x7f74640b1ae0 2023-11-29T11:23:16.729 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.721+0000 7f74567fc700 1 -- 172.21.15.81:0/2237207081 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v74) v1 ==== 162+0+0 (secure 0 0 0) 0x7f7460054650 con 0x7f74640b1ae0 2023-11-29T11:23:16.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7448064ee0 msgr2=0x7f7448067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7448064ee0 0x7f7448067390 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7458000f60 tx=0x7f7458007c00 comp rx=0 tx=0).stop 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74640b1ae0 msgr2=0x7f746409c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74640b1ae0 0x7f746409c540 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f7460009b70 tx=0x7f7460004770 comp rx=0 tx=0).stop 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 shutdown_connections 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7448064ee0 0x7f7448067390 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74640cf0e0 0x7f74640b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74640b1ae0 0x7f746409c540 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 --2- 172.21.15.81:0/2237207081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f746406a4c0 0x7f746415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 >> 172.21.15.81:0/2237207081 conn(0x7f746409bbd0 msgr2=0x7f746415bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 shutdown_connections 2023-11-29T11:23:16.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.725+0000 7f746a895700 1 -- 172.21.15.81:0/2237207081 wait complete. 2023-11-29T11:23:16.736 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-29T11:23:16.746 INFO:tasks.ceph.mds.a.smithi081.stderr:/build/ceph-18.0.0-2697-g2f5f6028/src/include/interval_set.h: In function 'void interval_set::insert(T, T, T*, T*) [with T = inodeno_t; C = std::map]' thread 7fcdd05bc700 time 2023-11-29T11:23:16.742479+0000 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr:/build/ceph-18.0.0-2697-g2f5f6028/src/include/interval_set.h: 507: ceph_abort_msg("abort() called") 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev) 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7fcdde2098b7] 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 2: (interval_set::insert(inodeno_t, inodeno_t, inodeno_t*, inodeno_t*)+0x4b4) [0x561ca522a074] 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 3: (InoTable::replay_release_ids(interval_set&)+0x6d) [0x561ca543ea2d] 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 4: (EPurged::replay(MDSRank*)+0x227) [0x561ca55196d7] 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 5: (MDLog::_replay_thread()+0x751) [0x561ca54af0f1] 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 6: (MDLog::ReplayThread::entry()+0x11) [0x561ca5172921] 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fcddde93609] 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 8: clone() 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:23:16.737+0000 7fcdd05bc700 -1 /build/ceph-18.0.0-2697-g2f5f6028/src/include/interval_set.h: In function 'void interval_set::insert(T, T, T*, T*) [with T = inodeno_t; C = std::map]' thread 7fcdd05bc700 time 2023-11-29T11:23:16.742479+0000 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr:/build/ceph-18.0.0-2697-g2f5f6028/src/include/interval_set.h: 507: ceph_abort_msg("abort() called") 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev) 2023-11-29T11:23:16.747 INFO:tasks.ceph.mds.a.smithi081.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7fcdde2098b7] 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: 2: (interval_set::insert(inodeno_t, inodeno_t, inodeno_t*, inodeno_t*)+0x4b4) [0x561ca522a074] 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: 3: (InoTable::replay_release_ids(interval_set&)+0x6d) [0x561ca543ea2d] 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: 4: (EPurged::replay(MDSRank*)+0x227) [0x561ca55196d7] 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: 5: (MDLog::_replay_thread()+0x751) [0x561ca54af0f1] 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: 6: (MDLog::ReplayThread::entry()+0x11) [0x561ca5172921] 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fcddde93609] 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: 8: clone() 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr:*** Caught signal (Aborted) ** 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: in thread 7fcdd05bc700 thread_name:md_log_replay 2023-11-29T11:23:16.748 INFO:tasks.ceph.mds.a.smithi081.stderr: ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev) 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fcddde9f420] 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 2: gsignal() 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 3: abort() 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7fcdde209970] 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 5: (interval_set::insert(inodeno_t, inodeno_t, inodeno_t*, inodeno_t*)+0x4b4) [0x561ca522a074] 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 6: (InoTable::replay_release_ids(interval_set&)+0x6d) [0x561ca543ea2d] 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 7: (EPurged::replay(MDSRank*)+0x227) [0x561ca55196d7] 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 8: (MDLog::_replay_thread()+0x751) [0x561ca54af0f1] 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 9: (MDLog::ReplayThread::entry()+0x11) [0x561ca5172921] 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 10: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fcddde93609] 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 11: clone() 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-11-29T11:23:16.741+0000 7fcdd05bc700 -1 *** Caught signal (Aborted) ** 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: in thread 7fcdd05bc700 thread_name:md_log_replay 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev) 2023-11-29T11:23:16.749 INFO:tasks.ceph.mds.a.smithi081.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fcddde9f420] 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 2: gsignal() 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 3: abort() 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7fcdde209970] 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 5: (interval_set::insert(inodeno_t, inodeno_t, inodeno_t*, inodeno_t*)+0x4b4) [0x561ca522a074] 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 6: (InoTable::replay_release_ids(interval_set&)+0x6d) [0x561ca543ea2d] 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 7: (EPurged::replay(MDSRank*)+0x227) [0x561ca55196d7] 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 8: (MDLog::_replay_thread()+0x751) [0x561ca54af0f1] 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 9: (MDLog::ReplayThread::entry()+0x11) [0x561ca5172921] 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 10: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fcddde93609] 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 11: clone() 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-29T11:23:16.750 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: -1> 2023-11-29T11:23:16.737+0000 7fcdd05bc700 -1 /build/ceph-18.0.0-2697-g2f5f6028/src/include/interval_set.h: In function 'void interval_set::insert(T, T, T*, T*) [with T = inodeno_t; C = std::map]' thread 7fcdd05bc700 time 2023-11-29T11:23:16.742479+0000 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr:/build/ceph-18.0.0-2697-g2f5f6028/src/include/interval_set.h: 507: ceph_abort_msg("abort() called") 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev) 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7fcdde2098b7] 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 2: (interval_set::insert(inodeno_t, inodeno_t, inodeno_t*, inodeno_t*)+0x4b4) [0x561ca522a074] 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 3: (InoTable::replay_release_ids(interval_set&)+0x6d) [0x561ca543ea2d] 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 4: (EPurged::replay(MDSRank*)+0x227) [0x561ca55196d7] 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 5: (MDLog::_replay_thread()+0x751) [0x561ca54af0f1] 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 6: (MDLog::ReplayThread::entry()+0x11) [0x561ca5172921] 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fcddde93609] 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 8: clone() 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.751 INFO:tasks.ceph.mds.a.smithi081.stderr: 0> 2023-11-29T11:23:16.741+0000 7fcdd05bc700 -1 *** Caught signal (Aborted) ** 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: in thread 7fcdd05bc700 thread_name:md_log_replay 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev) 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fcddde9f420] 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 2: gsignal() 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 3: abort() 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7fcdde209970] 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 5: (interval_set::insert(inodeno_t, inodeno_t, inodeno_t*, inodeno_t*)+0x4b4) [0x561ca522a074] 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 6: (InoTable::replay_release_ids(interval_set&)+0x6d) [0x561ca543ea2d] 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 7: (EPurged::replay(MDSRank*)+0x227) [0x561ca55196d7] 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 8: (MDLog::_replay_thread()+0x751) [0x561ca54af0f1] 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 9: (MDLog::ReplayThread::entry()+0x11) [0x561ca5172921] 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 10: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fcddde93609] 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 11: clone() 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-29T11:23:16.752 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:23:16.753 INFO:tasks.ceph.mds.a.smithi081.stderr: -1> 2023-11-29T11:23:16.737+0000 7fcdd05bc700 -1 /build/ceph-18.0.0-2697-g2f5f6028/src/include/interval_set.h: In function 'void interval_set::insert(T, T, T*, T*) [with T = inodeno_t; C = std::map]' thread 7fcdd05bc700 time 2023-11-29T11:23:16.742479+0000 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr:/build/ceph-18.0.0-2697-g2f5f6028/src/include/interval_set.h: 507: ceph_abort_msg("abort() called") 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev) 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7fcdde2098b7] 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 2: (interval_set::insert(inodeno_t, inodeno_t, inodeno_t*, inodeno_t*)+0x4b4) [0x561ca522a074] 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 3: (InoTable::replay_release_ids(interval_set&)+0x6d) [0x561ca543ea2d] 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 4: (EPurged::replay(MDSRank*)+0x227) [0x561ca55196d7] 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 5: (MDLog::_replay_thread()+0x751) [0x561ca54af0f1] 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 6: (MDLog::ReplayThread::entry()+0x11) [0x561ca5172921] 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fcddde93609] 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 8: clone() 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 0> 2023-11-29T11:23:16.741+0000 7fcdd05bc700 -1 *** Caught signal (Aborted) ** 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: in thread 7fcdd05bc700 thread_name:md_log_replay 2023-11-29T11:23:16.754 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev) 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fcddde9f420] 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 2: gsignal() 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 3: abort() 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x7fcdde209970] 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 5: (interval_set::insert(inodeno_t, inodeno_t, inodeno_t*, inodeno_t*)+0x4b4) [0x561ca522a074] 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 6: (InoTable::replay_release_ids(interval_set&)+0x6d) [0x561ca543ea2d] 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 7: (EPurged::replay(MDSRank*)+0x227) [0x561ca55196d7] 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 8: (MDLog::_replay_thread()+0x751) [0x561ca54af0f1] 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 9: (MDLog::ReplayThread::entry()+0x11) [0x561ca5172921] 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 10: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fcddde93609] 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 11: clone() 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-29T11:23:16.755 INFO:tasks.ceph.mds.a.smithi081.stderr: 2023-11-29T11:23:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 Processor -- start 2023-11-29T11:23:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- start start 2023-11-29T11:23:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe6981510d0 0x7fe69815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe698069c40 0x7fe6980b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6980c98a0 0x7fe6980c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6980c95d0 con 0x7fe698069c40 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6980c8e00 con 0x7fe6981510d0 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6980ca240 con 0x7fe6980c98a0 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe698069c40 0x7fe6980b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe698069c40 0x7fe6980b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44212/0 (socket says 172.21.15.81:44212) 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 -- 172.21.15.81:0/2318228896 learned_addr learned my addr 172.21.15.81:0/2318228896 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69d08a700 1 --2- 172.21.15.81:0/2318228896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6980c98a0 0x7fe6980c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69c889700 1 --2- 172.21.15.81:0/2318228896 >> v2:172.21.15.176:3300/0 conn(0x7fe6981510d0 0x7fe69815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 -- 172.21.15.81:0/2318228896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6980c98a0 msgr2=0x7fe6980c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 --2- 172.21.15.81:0/2318228896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6980c98a0 0x7fe6980c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 -- 172.21.15.81:0/2318228896 >> v2:172.21.15.176:3300/0 conn(0x7fe6981510d0 msgr2=0x7fe69815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 --2- 172.21.15.81:0/2318228896 >> v2:172.21.15.176:3300/0 conn(0x7fe6981510d0 0x7fe69815b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 -- 172.21.15.81:0/2318228896 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6980b1170 con 0x7fe698069c40 2023-11-29T11:23:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69c889700 1 --2- 172.21.15.81:0/2318228896 >> v2:172.21.15.176:3300/0 conn(0x7fe6981510d0 0x7fe69815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe697fff700 1 --2- 172.21.15.81:0/2318228896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe698069c40 0x7fe6980b0c30 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fe6980cf8b0 tx=0x7fe680009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63fd8fada7ff1b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe6977fe700 1 -- 172.21.15.81:0/2318228896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680011830 con 0x7fe698069c40 2023-11-29T11:23:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe6977fe700 1 -- 172.21.15.81:0/2318228896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe680011990 con 0x7fe698069c40 2023-11-29T11:23:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe6977fe700 1 -- 172.21.15.81:0/2318228896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680011d40 con 0x7fe698069c40 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- 172.21.15.81:0/2318228896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe698069c40 msgr2=0x7fe6980b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2318228896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe698069c40 0x7fe6980b0c30 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fe6980cf8b0 tx=0x7fe680009c20 comp rx=0 tx=0).stop 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- 172.21.15.81:0/2318228896 shutdown_connections 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2318228896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6980c98a0 0x7fe6980c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2318228896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe698069c40 0x7fe6980b0c30 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2318228896 >> v2:172.21.15.176:3300/0 conn(0x7fe6981510d0 0x7fe69815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- 172.21.15.81:0/2318228896 >> 172.21.15.81:0/2318228896 conn(0x7fe69806caf0 msgr2=0x7fe6980ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- 172.21.15.81:0/2318228896 shutdown_connections 2023-11-29T11:23:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.861+0000 7fe69eaed700 1 -- 172.21.15.81:0/2318228896 wait complete. 2023-11-29T11:23:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 Processor -- start 2023-11-29T11:23:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 -- start start 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe698069c40 0x7fe698140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6980c98a0 0x7fe69815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6981510d0 0x7fe698153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69815e2e0 con 0x7fe6981510d0 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69815d6d0 con 0x7fe6980c98a0 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69815d9b0 con 0x7fe698069c40 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69c889700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe698069c40 0x7fe698140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69d08a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6981510d0 0x7fe698153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69c889700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe698069c40 0x7fe698140160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.81:40192/0 (socket says 172.21.15.81:40192) 2023-11-29T11:23:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69c889700 1 -- 172.21.15.81:0/2851563992 learned_addr learned my addr 172.21.15.81:0/2851563992 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe697fff700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6980c98a0 0x7fe69815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69d08a700 1 -- 172.21.15.81:0/2851563992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe698069c40 msgr2=0x7fe698140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69d08a700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe698069c40 0x7fe698140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69d08a700 1 -- 172.21.15.81:0/2851563992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6980c98a0 msgr2=0x7fe69815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69d08a700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6980c98a0 0x7fe69815b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69d08a700 1 -- 172.21.15.81:0/2851563992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe680009570 con 0x7fe6981510d0 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69d08a700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6981510d0 0x7fe698153670 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe68800e7f0 tx=0x7fe68800eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe6957fa700 1 -- 172.21.15.81:0/2851563992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688013680 con 0x7fe6981510d0 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6980c92f0 con 0x7fe6981510d0 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.865+0000 7fe6957fa700 1 -- 172.21.15.81:0/2851563992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6880137e0 con 0x7fe6981510d0 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.869+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6980c9010 con 0x7fe6981510d0 2023-11-29T11:23:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.869+0000 7fe6957fa700 1 -- 172.21.15.81:0/2851563992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688013b90 con 0x7fe6981510d0 2023-11-29T11:23:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.869+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe698070170 con 0x7fe6981510d0 2023-11-29T11:23:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.869+0000 7fe6957fa700 1 -- 172.21.15.81:0/2851563992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe688019030 con 0x7fe6981510d0 2023-11-29T11:23:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.869+0000 7fe6957fa700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe678064f10 0x7fe6780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.873+0000 7fe69c889700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe678064f10 0x7fe6780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.873+0000 7fe6957fa700 1 -- 172.21.15.81:0/2851563992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fe688081e90 con 0x7fe6981510d0 2023-11-29T11:23:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.873+0000 7fe69c889700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe678064f10 0x7fe6780673c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe690003be0 tx=0x7fe6900098b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:16.877+0000 7fe6957fa700 1 -- 172.21.15.81:0/2851563992 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe68804fcf0 con 0x7fe6981510d0 2023-11-29T11:23:16.952 INFO:tasks.ceph.mds.a.smithi081.stderr:daemon-helper: command crashed with signal 6 2023-11-29T11:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.077+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe69815e090 con 0x7fe6981510d0 2023-11-29T11:23:17.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.081+0000 7fe6957fa700 1 -- 172.21.15.81:0/2851563992 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4652 (secure 0 0 0) 0x7fe688053310 con 0x7fe6981510d0 2023-11-29T11:23:17.087 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:17.088 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:23:16.726945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"a","rank":0,"incarnation":75,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6837/969746689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":969746689},{"type":"v1","addr":"172.21.15.81:6837","nonce":969746689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:23:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe678064f10 msgr2=0x7fe6780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe678064f10 0x7fe6780673c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe690003be0 tx=0x7fe6900098b0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6981510d0 msgr2=0x7fe698153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6981510d0 0x7fe698153670 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe68800e7f0 tx=0x7fe68800eb00 comp rx=0 tx=0).stop 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 shutdown_connections 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe678064f10 0x7fe6780673c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6981510d0 0x7fe698153670 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6980c98a0 0x7fe69815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 --2- 172.21.15.81:0/2851563992 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe698069c40 0x7fe698140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 >> 172.21.15.81:0/2851563992 conn(0x7fe69806caf0 msgr2=0x7fe69814f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 shutdown_connections 2023-11-29T11:23:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.085+0000 7fe69eaed700 1 -- 172.21.15.81:0/2851563992 wait complete. 2023-11-29T11:23:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-11-29T11:23:17.106 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T11:23:17.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:23:17.125 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T11:23:17.146 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T11:23:17.147 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:23:17.147 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:23:17.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:23:17.154 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:23:17.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:17.154 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T11:23:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-29T11:23:17.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:23:17.205 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:23:17.205 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:23:17.213 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:23:17.213 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:23:17.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:17.213 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-29T11:23:17.260 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-29T11:23:17.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:23:17.261 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:23:17.261 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:23:17.269 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:23:17.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:23:17.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:17.269 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-29T11:23:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-29T11:23:17.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:23:17.277 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:23:17.277 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:23:17.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:23:17.284 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:23:17.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:17.284 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-29T11:23:17.290 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-29T11:23:17.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:23:17.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:23:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b7fff700 1 Processor -- start 2023-11-29T11:23:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b7fff700 1 -- start start 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd000 0x7fa9b80cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b7fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9b80cd3d0 0x7fa9b80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b7fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b80ce3a0 con 0x7fa9b80cf120 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b7fff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b80d02c0 con 0x7fa9b80cd3d0 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80d04b0 con 0x7fa9b80cd000 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b77fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa9b80cf120 0x7fa9b80cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55060/0 (socket says 172.21.15.81:55060) 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b77fe700 1 -- 172.21.15.81:0/3775865767 learned_addr learned my addr 172.21.15.81:0/3775865767 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b67fc700 1 --2- 172.21.15.81:0/3775865767 >> v2:172.21.15.176:3300/0 conn(0x7fa9b80cd3d0 0x7fa9b80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.429+0000 7fa9b6ffd700 1 --2- 172.21.15.81:0/3775865767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd000 0x7fa9b80cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3775865767 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912117959 0 0) 0x7fa9b80ce3a0 con 0x7fa9b80cf120 2023-11-29T11:23:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3775865767 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a00035d0 con 0x7fa9b80cf120 2023-11-29T11:23:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b67fc700 1 -- 172.21.15.81:0/3775865767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd000 msgr2=0x7fa9b80cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b67fc700 1 --2- 172.21.15.81:0/3775865767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd000 0x7fa9b80cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b67fc700 1 -- 172.21.15.81:0/3775865767 >> v1:172.21.15.81:6789/0 conn(0x7fa9b80cf120 legacy=0x7fa9b80cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b67fc700 1 -- 172.21.15.81:0/3775865767 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b80ce640 con 0x7fa9b80cd3d0 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b67fc700 1 --2- 172.21.15.81:0/3775865767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd3d0 0x7fa9b80b3480 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009870 tx=0x7fa9a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b53f0073a27ef8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3775865767 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8005e50 con 0x7fa9b80cd3d0 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3775865767 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a8006030 con 0x7fa9b80cd3d0 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b5ffb700 1 -- 172.21.15.81:0/3775865767 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80063c0 con 0x7fa9b80cd3d0 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 -- 172.21.15.81:0/3775865767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd3d0 msgr2=0x7fa9b80b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/3775865767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd3d0 0x7fa9b80b3480 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009870 tx=0x7fa9a8009b80 comp rx=0 tx=0).stop 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 -- 172.21.15.81:0/3775865767 shutdown_connections 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/3775865767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd3d0 0x7fa9b80b3480 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/3775865767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd000 0x7fa9b80cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 -- 172.21.15.81:0/3775865767 >> 172.21.15.81:0/3775865767 conn(0x7fa9b80b2140 msgr2=0x7fa9b80b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 -- 172.21.15.81:0/3775865767 shutdown_connections 2023-11-29T11:23:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 -- 172.21.15.81:0/3775865767 wait complete. 2023-11-29T11:23:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 Processor -- start 2023-11-29T11:23:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.433+0000 7fa9b7fff700 1 -- start start 2023-11-29T11:23:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd000 0x7fa9b814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd3d0 0x7fa9b80c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b80cf120 0x7fa9b8149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80b1070 con 0x7fa9b80cf120 2023-11-29T11:23:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b8149b20 con 0x7fa9b80cd000 2023-11-29T11:23:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b8149dc0 con 0x7fa9b80cd3d0 2023-11-29T11:23:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b80cf120 0x7fa9b8149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b80cf120 0x7fa9b8149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44224/0 (socket says 172.21.15.81:44224) 2023-11-29T11:23:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 -- 172.21.15.81:0/750644553 learned_addr learned my addr 172.21.15.81:0/750644553 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b67fc700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd3d0 0x7fa9b80c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b6ffd700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd000 0x7fa9b814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 -- 172.21.15.81:0/750644553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd3d0 msgr2=0x7fa9b80c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd3d0 0x7fa9b80c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 -- 172.21.15.81:0/750644553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd000 msgr2=0x7fa9b814c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd000 0x7fa9b814c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 -- 172.21.15.81:0/750644553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8009450 con 0x7fa9b80cf120 2023-11-29T11:23:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b77fe700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b80cf120 0x7fa9b8149170 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000cb40 tx=0x7fa9b000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa99f7fe700 1 -- 172.21.15.81:0/750644553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0007500 con 0x7fa9b80cf120 2023-11-29T11:23:17.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa99f7fe700 1 -- 172.21.15.81:0/750644553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b0007660 con 0x7fa9b80cf120 2023-11-29T11:23:17.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b80cec00 con 0x7fa9b80cf120 2023-11-29T11:23:17.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa99f7fe700 1 -- 172.21.15.81:0/750644553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00079f0 con 0x7fa9b80cf120 2023-11-29T11:23:17.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b80ce920 con 0x7fa9b80cf120 2023-11-29T11:23:17.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.437+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b815d6a0 con 0x7fa9b80cf120 2023-11-29T11:23:17.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.441+0000 7fa99f7fe700 1 -- 172.21.15.81:0/750644553 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa9b0019030 con 0x7fa9b80cf120 2023-11-29T11:23:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.441+0000 7fa99f7fe700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a4064f10 0x7fa9a40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.441+0000 7fa99f7fe700 1 -- 172.21.15.81:0/750644553 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fa9b00819f0 con 0x7fa9b80cf120 2023-11-29T11:23:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.441+0000 7fa9b6ffd700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a4064f10 0x7fa9a40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.441+0000 7fa9b6ffd700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a4064f10 0x7fa9a40673c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009b50 tx=0x7fa9ac009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.449+0000 7fa99f7fe700 1 -- 172.21.15.81:0/750644553 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa9b004f870 con 0x7fa9b80cf120 2023-11-29T11:23:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9b8072500 con 0x7fa9b80cf120 2023-11-29T11:23:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa99f7fe700 1 -- 172.21.15.81:0/750644553 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4652 (secure 0 0 0) 0x7fa9b0052e90 con 0x7fa9b80cf120 2023-11-29T11:23:17.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:17.656 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:23:16.726945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"a","rank":0,"incarnation":75,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6837/969746689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":969746689},{"type":"v1","addr":"172.21.15.81:6837","nonce":969746689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:23:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a4064f10 msgr2=0x7fa9a40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a4064f10 0x7fa9a40673c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009b50 tx=0x7fa9ac009240 comp rx=0 tx=0).stop 2023-11-29T11:23:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b80cf120 msgr2=0x7fa9b8149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b80cf120 0x7fa9b8149170 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000cb40 tx=0x7fa9b000cb70 comp rx=0 tx=0).stop 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 shutdown_connections 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fa9a4064f10 0x7fa9a40673c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9b80cf120 0x7fa9b8149170 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9b80cd3d0 0x7fa9b80c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 --2- 172.21.15.81:0/750644553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9b80cd000 0x7fa9b814c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 >> 172.21.15.81:0/750644553 conn(0x7fa9b80b2140 msgr2=0x7fa9b80c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 shutdown_connections 2023-11-29T11:23:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.649+0000 7fa9b7fff700 1 -- 172.21.15.81:0/750644553 wait complete. 2023-11-29T11:23:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-11-29T11:23:17.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:23:17.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 Processor -- start 2023-11-29T11:23:17.779 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 -- start start 2023-11-29T11:23:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 0x7f37040cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37040b32e0 0x7f37040b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f370406bc80 0x7f370406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370406dbd0 con 0x7f370406bc80 2023-11-29T11:23:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37040b3c30 con 0x7f37040b32e0 2023-11-29T11:23:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040cd0f0 con 0x7f37041584c0 2023-11-29T11:23:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f370406bc80 0x7f370406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f370406bc80 0x7f370406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44240/0 (socket says 172.21.15.81:44240) 2023-11-29T11:23:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 -- 172.21.15.81:0/307326217 learned_addr learned my addr 172.21.15.81:0/307326217 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3702d9d700 1 --2- 172.21.15.81:0/307326217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 0x7f37040cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f36fa59c700 1 --2- 172.21.15.81:0/307326217 >> v2:172.21.15.176:3300/0 conn(0x7f37040b32e0 0x7f37040b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 -- 172.21.15.81:0/307326217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 msgr2=0x7f37040cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 --2- 172.21.15.81:0/307326217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 0x7f37040cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 -- 172.21.15.81:0/307326217 >> v2:172.21.15.176:3300/0 conn(0x7f37040b32e0 msgr2=0x7f37040b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 --2- 172.21.15.81:0/307326217 >> v2:172.21.15.176:3300/0 conn(0x7f37040b32e0 0x7f37040b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 -- 172.21.15.81:0/307326217 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37040cd3d0 con 0x7f370406bc80 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370359e700 1 --2- 172.21.15.81:0/307326217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370406bc80 0x7f370406c0a0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f370406f4d0 tx=0x7f36fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855040d49a61cf37 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370259c700 1 -- 172.21.15.81:0/307326217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00e070 con 0x7f370406bc80 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370259c700 1 -- 172.21.15.81:0/307326217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc00b910 con 0x7f370406bc80 2023-11-29T11:23:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f370259c700 1 -- 172.21.15.81:0/307326217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00bcc0 con 0x7f370406bc80 2023-11-29T11:23:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 -- 172.21.15.81:0/307326217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370406bc80 msgr2=0x7f370406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.773+0000 7f3708984700 1 --2- 172.21.15.81:0/307326217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370406bc80 0x7f370406c0a0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f370406f4d0 tx=0x7f36fc00b330 comp rx=0 tx=0).stop 2023-11-29T11:23:17.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 -- 172.21.15.81:0/307326217 shutdown_connections 2023-11-29T11:23:17.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 --2- 172.21.15.81:0/307326217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f370406bc80 0x7f370406c0a0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 --2- 172.21.15.81:0/307326217 >> v2:172.21.15.176:3300/0 conn(0x7f37040b32e0 0x7f37040b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 --2- 172.21.15.81:0/307326217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 0x7f37040cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 -- 172.21.15.81:0/307326217 >> 172.21.15.81:0/307326217 conn(0x7f37040ce3e0 msgr2=0x7f37040ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:17.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 -- 172.21.15.81:0/307326217 shutdown_connections 2023-11-29T11:23:17.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 -- 172.21.15.81:0/307326217 wait complete. 2023-11-29T11:23:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 Processor -- start 2023-11-29T11:23:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 -- start start 2023-11-29T11:23:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f370406bc80 0x7f37040c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37040b32e0 0x7f3704155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 0x7f3704156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c3b30 con 0x7f37040b32e0 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704071f20 con 0x7f370406bc80 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3708984700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c4930 con 0x7f37041584c0 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f36fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37040b32e0 0x7f3704155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f36fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37040b32e0 0x7f3704155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44244/0 (socket says 172.21.15.81:44244) 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f36fa59c700 1 -- 172.21.15.81:0/3659430373 learned_addr learned my addr 172.21.15.81:0/3659430373 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f3702d9d700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f370406bc80 0x7f37040c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f370359e700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 0x7f3704156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f36fa59c700 1 -- 172.21.15.81:0/3659430373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 msgr2=0x7f3704156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f36fa59c700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 0x7f3704156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f36fa59c700 1 -- 172.21.15.81:0/3659430373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f370406bc80 msgr2=0x7f37040c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f36fa59c700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f370406bc80 0x7f37040c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.777+0000 7f36fa59c700 1 -- 172.21.15.81:0/3659430373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009b30 con 0x7f37040b32e0 2023-11-29T11:23:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f36fa59c700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37040b32e0 0x7f3704155f60 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00ea30 tx=0x7f36ec00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f36fbfff700 1 -- 172.21.15.81:0/3659430373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec009720 con 0x7f37040b32e0 2023-11-29T11:23:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f36fbfff700 1 -- 172.21.15.81:0/3659430373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec00eed0 con 0x7f37040b32e0 2023-11-29T11:23:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37040cd990 con 0x7f37040b32e0 2023-11-29T11:23:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f36fbfff700 1 -- 172.21.15.81:0/3659430373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00ca50 con 0x7f37040b32e0 2023-11-29T11:23:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37040cd6b0 con 0x7f37040b32e0 2023-11-29T11:23:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37040cdc70 con 0x7f37040b32e0 2023-11-29T11:23:17.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f36fbfff700 1 -- 172.21.15.81:0/3659430373 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f36ec019030 con 0x7f37040b32e0 2023-11-29T11:23:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f36fbfff700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36e4064f10 0x7f36e40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f36fbfff700 1 -- 172.21.15.81:0/3659430373 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f36ec081f90 con 0x7f37040b32e0 2023-11-29T11:23:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.781+0000 7f3702d9d700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36e4064f10 0x7f36e40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.785+0000 7f3702d9d700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36e4064f10 0x7f36e40673c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009ad0 tx=0x7f36f4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:17.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.789+0000 7f36fbfff700 1 -- 172.21.15.81:0/3659430373 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f36ec04fed0 con 0x7f37040b32e0 2023-11-29T11:23:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.953+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3704072500 con 0x7f37040b32e0 2023-11-29T11:23:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f36fbfff700 1 -- 172.21.15.81:0/3659430373 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f36ec017090 con 0x7f37040b32e0 2023-11-29T11:23:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:17.963 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":113,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:23:14.804121+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.24","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/665591010":"2023-11-30T11:23:14.804071+0000","172.21.15.81:6836/665591010":"2023-11-30T11:23:14.804071+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:23:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36e4064f10 msgr2=0x7f36e40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36e4064f10 0x7f36e40673c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009ad0 tx=0x7f36f4009240 comp rx=0 tx=0).stop 2023-11-29T11:23:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37040b32e0 msgr2=0x7f3704155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37040b32e0 0x7f3704155f60 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00ea30 tx=0x7f36ec00ed40 comp rx=0 tx=0).stop 2023-11-29T11:23:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 shutdown_connections 2023-11-29T11:23:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36e4064f10 0x7f36e40673c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37041584c0 0x7f3704156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37040b32e0 0x7f3704155f60 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 --2- 172.21.15.81:0/3659430373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f370406bc80 0x7f37040c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:17.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 >> 172.21.15.81:0/3659430373 conn(0x7f37040ce3e0 msgr2=0x7f37040ad0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:17.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 shutdown_connections 2023-11-29T11:23:17.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:17.957+0000 7f3708984700 1 -- 172.21.15.81:0/3659430373 wait complete. 2023-11-29T11:23:17.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-29T11:12:45.833054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-29T11:12:46.489736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-29T11:22:15.796341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-29T11:22:16.553603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T11:23:17.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-29T11:23:18.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.089+0000 7f6f2ffff700 1 Processor -- start 2023-11-29T11:23:18.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.089+0000 7f6f2ffff700 1 -- start start 2023-11-29T11:23:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6f30159ec0 0x7f6f300c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f30069c40 0x7f6f300cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2ffff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f300cf6b0 con 0x7f6f300cf210 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f300ca400 con 0x7f6f30159ec0 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3006b6d0 con 0x7f6f30069c40 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6f300cf210 0x7f6f3015db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55066/0 (socket says 172.21.15.81:55066) 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 -- 172.21.15.81:0/3118817152 learned_addr learned my addr 172.21.15.81:0/3118817152 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2effd700 1 --2- 172.21.15.81:0/3118817152 >> v2:172.21.15.81:3300/0 conn(0x7f6f30159ec0 0x7f6f300c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2e7fc700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f30069c40 0x7f6f300cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447945515 0 0) 0x7f6f300cf6b0 con 0x7f6f300cf210 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f180035d0 con 0x7f6f300cf210 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1624756787 0 0) 0x7f6f180035d0 con 0x7f6f300cf210 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f30069c40 msgr2=0x7f6f300cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f30069c40 0x7f6f300cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 >> v2:172.21.15.81:3300/0 conn(0x7f6f30159ec0 msgr2=0x7f6f300c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 --2- 172.21.15.81:0/3118817152 >> v2:172.21.15.81:3300/0 conn(0x7f6f30159ec0 0x7f6f300c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3006b9b0 con 0x7f6f300cf210 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f6f280019f0 con 0x7f6f300cf210 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2effd700 1 --2- 172.21.15.81:0/3118817152 >> v2:172.21.15.81:3300/0 conn(0x7f6f30159ec0 0x7f6f300c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 >> v1:172.21.15.81:6789/0 conn(0x7f6f300cf210 legacy=0x7f6f3015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f30069c40 0x7f6f18003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18003f60 0x7f6f18004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18004db0 0x7f6f18005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300ca400 con 0x7f6f18004db0 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3006b6d0 con 0x7f6f18003f60 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1800ba30 con 0x7f6f30069c40 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18004db0 0x7f6f18005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2effd700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f30069c40 0x7f6f18003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2e7fc700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18003f60 0x7f6f18004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 -- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f30069c40 msgr2=0x7f6f18003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f30069c40 0x7f6f18003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 -- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18003f60 msgr2=0x7f6f18004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18003f60 0x7f6f18004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 -- 172.21.15.81:0/3118817152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180035d0 con 0x7f6f18004db0 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2e7fc700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18003f60 0x7f6f18004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2f7fe700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18004db0 0x7f6f18005220 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f6f28005bc0 tx=0x7f6f180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a526d1f29d1f07 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.093+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28005660 con 0x7f6f18004db0 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2800db70 con 0x7f6f18004db0 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2dffb700 1 -- 172.21.15.81:0/3118817152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28015420 con 0x7f6f18004db0 2023-11-29T11:23:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- 172.21.15.81:0/3118817152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18004db0 msgr2=0x7f6f18005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 --2- 172.21.15.81:0/3118817152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f18004db0 0x7f6f18005220 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f6f28005bc0 tx=0x7f6f180058a0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2f7fe700 1 -- 172.21.15.81:0/3118817152 reap_dead start 2023-11-29T11:23:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- 172.21.15.81:0/3118817152 shutdown_connections 2023-11-29T11:23:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- 172.21.15.81:0/3118817152 >> 172.21.15.81:0/3118817152 conn(0x7f6f3006c660 msgr2=0x7f6f3006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- 172.21.15.81:0/3118817152 shutdown_connections 2023-11-29T11:23:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- 172.21.15.81:0/3118817152 wait complete. 2023-11-29T11:23:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 Processor -- start 2023-11-29T11:23:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- start start 2023-11-29T11:23:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18004db0 0x7f6f300cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30155240 0x7f6f300c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f300afad0 0x7f6f300aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3015d250 con 0x7f6f30155240 2023-11-29T11:23:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cdea0 con 0x7f6f18004db0 2023-11-29T11:23:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300ce330 con 0x7f6f300afad0 2023-11-29T11:23:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30155240 0x7f6f300c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30155240 0x7f6f300c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44282/0 (socket says 172.21.15.81:44282) 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 -- 172.21.15.81:0/1583855000 learned_addr learned my addr 172.21.15.81:0/1583855000 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2effd700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18004db0 0x7f6f300cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2f7fe700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f300afad0 0x7f6f300aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 -- 172.21.15.81:0/1583855000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f300afad0 msgr2=0x7f6f300aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f300afad0 0x7f6f300aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 -- 172.21.15.81:0/1583855000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18004db0 msgr2=0x7f6f300cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18004db0 0x7f6f300cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 -- 172.21.15.81:0/1583855000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300caa10 con 0x7f6f30155240 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.097+0000 7f6f2e7fc700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30155240 0x7f6f300c8ae0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f6f240108c0 tx=0x7f6f24010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.101+0000 7f6f177fe700 1 -- 172.21.15.81:0/1583855000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24014800 con 0x7f6f30155240 2023-11-29T11:23:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.101+0000 7f6f177fe700 1 -- 172.21.15.81:0/1583855000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24014960 con 0x7f6f30155240 2023-11-29T11:23:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.101+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f300cafd0 con 0x7f6f30155240 2023-11-29T11:23:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.101+0000 7f6f177fe700 1 -- 172.21.15.81:0/1583855000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24014d10 con 0x7f6f30155240 2023-11-29T11:23:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.101+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3006bc90 con 0x7f6f30155240 2023-11-29T11:23:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.101+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f30072c20 con 0x7f6f30155240 2023-11-29T11:23:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.101+0000 7f6f177fe700 1 -- 172.21.15.81:0/1583855000 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6f24012040 con 0x7f6f30155240 2023-11-29T11:23:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.105+0000 7f6f177fe700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f1c064f10 0x7f6f1c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.105+0000 7f6f177fe700 1 -- 172.21.15.81:0/1583855000 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f6f24082290 con 0x7f6f30155240 2023-11-29T11:23:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.105+0000 7f6f2effd700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f1c064f10 0x7f6f1c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.105+0000 7f6f2effd700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f1c064f10 0x7f6f1c0673c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6f300c6620 tx=0x7f6f20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.109+0000 7f6f177fe700 1 -- 172.21.15.81:0/1583855000 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6f24050220 con 0x7f6f30155240 2023-11-29T11:23:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.273+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f300cd290 con 0x7f6f30155240 2023-11-29T11:23:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.273+0000 7f6f177fe700 1 -- 172.21.15.81:0/1583855000 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f24053840 con 0x7f6f30155240 2023-11-29T11:23:18.280 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.273+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f1c064f10 msgr2=0x7f6f1c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.273+0000 7f6f2ffff700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f1c064f10 0x7f6f1c0673c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6f300c6620 tx=0x7f6f20008040 comp rx=0 tx=0).stop 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30155240 msgr2=0x7f6f300c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30155240 0x7f6f300c8ae0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f6f240108c0 tx=0x7f6f24010bd0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 shutdown_connections 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f6f1c064f10 0x7f6f1c0673c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f300afad0 0x7f6f300aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f30155240 0x7f6f300c8ae0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 --2- 172.21.15.81:0/1583855000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f18004db0 0x7f6f300cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 >> 172.21.15.81:0/1583855000 conn(0x7f6f3006c660 msgr2=0x7f6f300c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 shutdown_connections 2023-11-29T11:23:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.277+0000 7f6f2ffff700 1 -- 172.21.15.81:0/1583855000 wait complete. 2023-11-29T11:23:18.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T11:23:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe146b5c700 1 Processor -- start 2023-11-29T11:23:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe146b5c700 1 -- start start 2023-11-29T11:23:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe146b5c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1400cbb30 0x7fe14015d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe146b5c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400b04b0 0x7fe14006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe146b5c700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14006d700 con 0x7fe1400b00e0 2023-11-29T11:23:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe146b5c700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14009c150 con 0x7fe1400cbb30 2023-11-29T11:23:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe146b5c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400ac050 con 0x7fe1400b04b0 2023-11-29T11:23:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe145359700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1400cbb30 0x7fe14015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe145359700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1400cbb30 0x7fe14015d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44298/0 (socket says 172.21.15.81:44298) 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe145359700 1 -- 172.21.15.81:0/51137500 learned_addr learned my addr 172.21.15.81:0/51137500 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe14635b700 1 --2- 172.21.15.81:0/51137500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400b04b0 0x7fe14006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe144b58700 1 -- 172.21.15.81:0/51137500 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153531766 0 0) 0x7fe14006d700 con 0x7fe1400b00e0 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe144b58700 1 -- 172.21.15.81:0/51137500 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12c0035d0 con 0x7fe1400b00e0 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe145359700 1 -- 172.21.15.81:0/51137500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400b04b0 msgr2=0x7fe14006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe145359700 1 --2- 172.21.15.81:0/51137500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400b04b0 0x7fe14006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe145359700 1 -- 172.21.15.81:0/51137500 >> v1:172.21.15.81:6789/0 conn(0x7fe1400b00e0 legacy=0x7fe14015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe144b58700 1 -- 172.21.15.81:0/51137500 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 386330226 0 0) 0x7fe12c0035d0 con 0x7fe1400b00e0 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe145359700 1 -- 172.21.15.81:0/51137500 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1400ac260 con 0x7fe1400cbb30 2023-11-29T11:23:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.413+0000 7fe145359700 1 --2- 172.21.15.81:0/51137500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400cbb30 0x7fe14015d880 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009910 tx=0x7fe13c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77f737502efac5b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe144b58700 1 -- 172.21.15.81:0/51137500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130001670 con 0x7fe1400cbb30 2023-11-29T11:23:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe144b58700 1 -- 172.21.15.81:0/51137500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c004030 con 0x7fe1400cbb30 2023-11-29T11:23:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe144b58700 1 -- 172.21.15.81:0/51137500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c0043c0 con 0x7fe1400cbb30 2023-11-29T11:23:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- 172.21.15.81:0/51137500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400cbb30 msgr2=0x7fe14015d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 --2- 172.21.15.81:0/51137500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400cbb30 0x7fe14015d880 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009910 tx=0x7fe13c009c20 comp rx=0 tx=0).stop 2023-11-29T11:23:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- 172.21.15.81:0/51137500 shutdown_connections 2023-11-29T11:23:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 --2- 172.21.15.81:0/51137500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400b04b0 0x7fe14006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 --2- 172.21.15.81:0/51137500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400cbb30 0x7fe14015d880 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- 172.21.15.81:0/51137500 >> 172.21.15.81:0/51137500 conn(0x7fe1400cae70 msgr2=0x7fe1400cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- 172.21.15.81:0/51137500 shutdown_connections 2023-11-29T11:23:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- 172.21.15.81:0/51137500 wait complete. 2023-11-29T11:23:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 Processor -- start 2023-11-29T11:23:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- start start 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400b00e0 0x7fe1401ee670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1400b04b0 0x7fe140070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400cbb30 0x7fe140155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1401f10a0 con 0x7fe1400b00e0 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400c8d50 con 0x7fe1400b04b0 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.417+0000 7fe146b5c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400c9030 con 0x7fe1400cbb30 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400b00e0 0x7fe1401ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400b00e0 0x7fe1401ee670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44300/0 (socket says 172.21.15.81:44300) 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 -- 172.21.15.81:0/732032773 learned_addr learned my addr 172.21.15.81:0/732032773 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145359700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1400b04b0 0x7fe140070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe14635b700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400cbb30 0x7fe140155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 -- 172.21.15.81:0/732032773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400cbb30 msgr2=0x7fe140155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400cbb30 0x7fe140155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 -- 172.21.15.81:0/732032773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1400b04b0 msgr2=0x7fe140070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1400b04b0 0x7fe140070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 -- 172.21.15.81:0/732032773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c009570 con 0x7fe1400b00e0 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe145b5a700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400b00e0 0x7fe1401ee670 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c570 tx=0x7fe13000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe1367fc700 1 -- 172.21.15.81:0/732032773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1300054e0 con 0x7fe1400b00e0 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe1367fc700 1 -- 172.21.15.81:0/732032773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1300036a0 con 0x7fe1400b00e0 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14009bdb0 con 0x7fe1400b00e0 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe1367fc700 1 -- 172.21.15.81:0/732032773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130003a50 con 0x7fe1400b00e0 2023-11-29T11:23:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1400cc660 con 0x7fe1400b00e0 2023-11-29T11:23:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.421+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1400cc9f0 con 0x7fe1400b00e0 2023-11-29T11:23:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.425+0000 7fe1367fc700 1 -- 172.21.15.81:0/732032773 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe130019030 con 0x7fe1400b00e0 2023-11-29T11:23:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.425+0000 7fe1367fc700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe124064f10 0x7fe1240673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.425+0000 7fe1367fc700 1 -- 172.21.15.81:0/732032773 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fe1300817c0 con 0x7fe1400b00e0 2023-11-29T11:23:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.425+0000 7fe145359700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe124064f10 0x7fe1240673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.425+0000 7fe145359700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe124064f10 0x7fe1240673c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe1400cbf40 tx=0x7fe13c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.429+0000 7fe1367fc700 1 -- 172.21.15.81:0/732032773 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe13004f830 con 0x7fe1400b00e0 2023-11-29T11:23:18.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.593+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe140066f20 con 0x7fe1400b00e0 2023-11-29T11:23:18.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.593+0000 7fe1367fc700 1 -- 172.21.15.81:0/732032773 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe130017020 con 0x7fe1400b00e0 2023-11-29T11:23:18.601 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-11-29T11:23:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe124064f10 msgr2=0x7fe1240673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe124064f10 0x7fe1240673c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe1400cbf40 tx=0x7fe13c008030 comp rx=0 tx=0).stop 2023-11-29T11:23:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400b00e0 msgr2=0x7fe1401ee670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400b00e0 0x7fe1401ee670 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c570 tx=0x7fe13000c880 comp rx=0 tx=0).stop 2023-11-29T11:23:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 shutdown_connections 2023-11-29T11:23:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe124064f10 0x7fe1240673c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1400cbb30 0x7fe140155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1400b04b0 0x7fe140070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 --2- 172.21.15.81:0/732032773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1400b00e0 0x7fe1401ee670 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 >> 172.21.15.81:0/732032773 conn(0x7fe1400cae70 msgr2=0x7fe14015c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 shutdown_connections 2023-11-29T11:23:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.597+0000 7fe146b5c700 1 -- 172.21.15.81:0/732032773 wait complete. 2023-11-29T11:23:18.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T11:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff27759e700 1 Processor -- start 2023-11-29T11:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff27759e700 1 -- start start 2023-11-29T11:23:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff27759e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2780cbaf0 0x7ff278165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff27759e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27815a3a0 con 0x7ff27806a6e0 2023-11-29T11:23:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff27759e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780ca430 con 0x7ff27806f010 2023-11-29T11:23:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff27759e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780ca710 con 0x7ff2780cbaf0 2023-11-29T11:23:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff27659c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff27806a6e0 0x7ff27806aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55094/0 (socket says 172.21.15.81:55094) 2023-11-29T11:23:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff27659c700 1 -- 172.21.15.81:0/1118172288 learned_addr learned my addr 172.21.15.81:0/1118172288 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:18.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff276d9d700 1 --2- 172.21.15.81:0/1118172288 >> v2:172.21.15.81:3300/0 conn(0x7ff2780cbaf0 0x7ff278165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.725+0000 7ff275d9b700 1 -- 172.21.15.81:0/1118172288 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912461842 0 0) 0x7ff268001110 con 0x7ff27806a6e0 2023-11-29T11:23:18.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff275d9b700 1 -- 172.21.15.81:0/1118172288 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2640035d0 con 0x7ff27806a6e0 2023-11-29T11:23:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff276d9d700 1 -- 172.21.15.81:0/1118172288 >> v1:172.21.15.176:6789/0 conn(0x7ff27806f010 legacy=0x7ff278161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff276d9d700 1 -- 172.21.15.81:0/1118172288 >> v1:172.21.15.81:6789/0 conn(0x7ff27806a6e0 legacy=0x7ff27806aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff276d9d700 1 -- 172.21.15.81:0/1118172288 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780ca9f0 con 0x7ff2780cbaf0 2023-11-29T11:23:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff276d9d700 1 --2- 172.21.15.81:0/1118172288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2780cbaf0 0x7ff278165190 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7ff270009d90 tx=0x7ff27000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839ca895b58f8e42 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff275d9b700 1 -- 172.21.15.81:0/1118172288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000e070 con 0x7ff2780cbaf0 2023-11-29T11:23:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff275d9b700 1 -- 172.21.15.81:0/1118172288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000bb20 con 0x7ff2780cbaf0 2023-11-29T11:23:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff275d9b700 1 -- 172.21.15.81:0/1118172288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000be90 con 0x7ff2780cbaf0 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- 172.21.15.81:0/1118172288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2780cbaf0 msgr2=0x7ff278165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 --2- 172.21.15.81:0/1118172288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2780cbaf0 0x7ff278165190 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7ff270009d90 tx=0x7ff27000b330 comp rx=0 tx=0).stop 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- 172.21.15.81:0/1118172288 shutdown_connections 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 --2- 172.21.15.81:0/1118172288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2780cbaf0 0x7ff278165190 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- 172.21.15.81:0/1118172288 >> 172.21.15.81:0/1118172288 conn(0x7ff2780d0240 msgr2=0x7ff2780cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- 172.21.15.81:0/1118172288 shutdown_connections 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- 172.21.15.81:0/1118172288 wait complete. 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 Processor -- start 2023-11-29T11:23:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- start start 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27806a6e0 0x7ff2780c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27806f010 0x7ff2780c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2780cbaf0 0x7ff2780c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780c7920 con 0x7ff27806f010 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780c9600 con 0x7ff27806a6e0 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.729+0000 7ff27759e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780c6d10 con 0x7ff2780cbaf0 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27806f010 0x7ff2780c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27806f010 0x7ff2780c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44318/0 (socket says 172.21.15.81:44318) 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 -- 172.21.15.81:0/1357211896 learned_addr learned my addr 172.21.15.81:0/1357211896 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff276d9d700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2780cbaf0 0x7ff2780c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff27659c700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27806a6e0 0x7ff2780c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 -- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2780cbaf0 msgr2=0x7ff2780c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2780cbaf0 0x7ff2780c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 -- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27806a6e0 msgr2=0x7ff2780c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27806a6e0 0x7ff2780c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 -- 172.21.15.81:0/1357211896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009a70 con 0x7ff27806f010 2023-11-29T11:23:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff276d9d700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2780cbaf0 0x7ff2780c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.733+0000 7ff26dd9b700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27806f010 0x7ff2780c7db0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c400 tx=0x7ff26000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff26f7fe700 1 -- 172.21.15.81:0/1357211896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2600052d0 con 0x7ff27806f010 2023-11-29T11:23:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2780cafb0 con 0x7ff27806f010 2023-11-29T11:23:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2780cacd0 con 0x7ff27806f010 2023-11-29T11:23:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff26f7fe700 1 -- 172.21.15.81:0/1357211896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff260005430 con 0x7ff27806f010 2023-11-29T11:23:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff26f7fe700 1 -- 172.21.15.81:0/1357211896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260006ad0 con 0x7ff27806f010 2023-11-29T11:23:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff26f7fe700 1 -- 172.21.15.81:0/1357211896 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff260010050 con 0x7ff27806f010 2023-11-29T11:23:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2780ca070 con 0x7ff27806f010 2023-11-29T11:23:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff26f7fe700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff258064ee0 0x7ff258067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff27659c700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff258064ee0 0x7ff258067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff26f7fe700 1 -- 172.21.15.81:0/1357211896 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7ff260081240 con 0x7ff27806f010 2023-11-29T11:23:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.737+0000 7ff27659c700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff258064ee0 0x7ff258067390 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff268007fd0 tx=0x7ff268007c60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.745+0000 7ff26f7fe700 1 -- 172.21.15.81:0/1357211896 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff260049400 con 0x7ff27806f010 2023-11-29T11:23:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.901+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff278066f50 con 0x7ff27806f010 2023-11-29T11:23:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.905+0000 7ff26f7fe700 1 -- 172.21.15.81:0/1357211896 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff26004f0a0 con 0x7ff27806f010 2023-11-29T11:23:18.911 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.905+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff258064ee0 msgr2=0x7ff258067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.905+0000 7ff27759e700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff258064ee0 0x7ff258067390 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff268007fd0 tx=0x7ff268007c60 comp rx=0 tx=0).stop 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.905+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27806f010 msgr2=0x7ff2780c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.905+0000 7ff27759e700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27806f010 0x7ff2780c7db0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c400 tx=0x7ff26000c710 comp rx=0 tx=0).stop 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.909+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 shutdown_connections 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.909+0000 7ff27759e700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff258064ee0 0x7ff258067390 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.909+0000 7ff27759e700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2780cbaf0 0x7ff2780c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.909+0000 7ff27759e700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27806f010 0x7ff2780c7db0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.909+0000 7ff27759e700 1 --2- 172.21.15.81:0/1357211896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27806a6e0 0x7ff2780c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.909+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 >> 172.21.15.81:0/1357211896 conn(0x7ff2780d0240 msgr2=0x7ff27806aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.909+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 shutdown_connections 2023-11-29T11:23:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:18.909+0000 7ff27759e700 1 -- 172.21.15.81:0/1357211896 wait complete. 2023-11-29T11:23:18.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T11:23:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 Processor -- start 2023-11-29T11:23:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 -- start start 2023-11-29T11:23:19.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca0815c520 0x7fca08069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fca080ac1f0 0x7fca080cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fca080cc830 0x7fca080aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca080cccb0 con 0x7fca080ac1f0 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca080b0910 con 0x7fca080cc830 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0806a470 con 0x7fca0815c520 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fca080ac1f0 0x7fca080cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fca080ac1f0 0x7fca080cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44324/0 (socket says 172.21.15.81:44324) 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 -- 172.21.15.81:0/2129642551 learned_addr learned my addr 172.21.15.81:0/2129642551 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0ce9b700 1 --2- 172.21.15.81:0/2129642551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca0815c520 0x7fca08069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0d69c700 1 --2- 172.21.15.81:0/2129642551 >> v2:172.21.15.176:3300/0 conn(0x7fca080cc830 0x7fca080aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 -- 172.21.15.81:0/2129642551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca0815c520 msgr2=0x7fca08069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 --2- 172.21.15.81:0/2129642551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca0815c520 0x7fca08069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 -- 172.21.15.81:0/2129642551 >> v2:172.21.15.176:3300/0 conn(0x7fca080cc830 msgr2=0x7fca080aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 --2- 172.21.15.81:0/2129642551 >> v2:172.21.15.176:3300/0 conn(0x7fca080cc830 0x7fca080aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 -- 172.21.15.81:0/2129642551 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0806a750 con 0x7fca080ac1f0 2023-11-29T11:23:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca07fff700 1 --2- 172.21.15.81:0/2129642551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca080cc2f0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fca080ac790 tx=0x7fc9fc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1271fe792a2bce8c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca077fe700 1 -- 172.21.15.81:0/2129642551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00b8a0 con 0x7fca080ac1f0 2023-11-29T11:23:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca077fe700 1 -- 172.21.15.81:0/2129642551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc00ba00 con 0x7fca080ac1f0 2023-11-29T11:23:19.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca077fe700 1 -- 172.21.15.81:0/2129642551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00bd90 con 0x7fca080ac1f0 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 -- 172.21.15.81:0/2129642551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 msgr2=0x7fca080cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 --2- 172.21.15.81:0/2129642551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca080cc2f0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fca080ac790 tx=0x7fc9fc009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 -- 172.21.15.81:0/2129642551 shutdown_connections 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 --2- 172.21.15.81:0/2129642551 >> v2:172.21.15.176:3300/0 conn(0x7fca080cc830 0x7fca080aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 --2- 172.21.15.81:0/2129642551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca080cc2f0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 --2- 172.21.15.81:0/2129642551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca0815c520 0x7fca08069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 -- 172.21.15.81:0/2129642551 >> 172.21.15.81:0/2129642551 conn(0x7fca080cae70 msgr2=0x7fca080cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.049+0000 7fca0de9d700 1 -- 172.21.15.81:0/2129642551 shutdown_connections 2023-11-29T11:23:19.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.053+0000 7fca0de9d700 1 -- 172.21.15.81:0/2129642551 wait complete. 2023-11-29T11:23:19.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.053+0000 7fca0de9d700 1 Processor -- start 2023-11-29T11:23:19.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.053+0000 7fca0de9d700 1 -- start start 2023-11-29T11:23:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.053+0000 7fca0de9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca08151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0de9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca080cc830 0x7fca0809a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0de9d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0815c520 0x7fca0815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0de9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0815f7b0 con 0x7fca080ac1f0 2023-11-29T11:23:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0de9d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08099b20 con 0x7fca0815c520 2023-11-29T11:23:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0de9d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca08099e00 con 0x7fca080cc830 2023-11-29T11:23:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca08151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca08151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44336/0 (socket says 172.21.15.81:44336) 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 -- 172.21.15.81:0/853403223 learned_addr learned my addr 172.21.15.81:0/853403223 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca07fff700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca080cc830 0x7fca0809a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0d69c700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0815c520 0x7fca0815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 -- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca080cc830 msgr2=0x7fca0809a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca080cc830 0x7fca0809a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 -- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0815c520 msgr2=0x7fca0815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0815c520 0x7fca0815ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 -- 172.21.15.81:0/853403223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009570 con 0x7fca080ac1f0 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca07fff700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca080cc830 0x7fca0809a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0d69c700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0815c520 0x7fca0815ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0ce9b700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca08151a50 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800e810 tx=0x7fc9f800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca057fa700 1 -- 172.21.15.81:0/853403223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8013610 con 0x7fca080ac1f0 2023-11-29T11:23:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca057fa700 1 -- 172.21.15.81:0/853403223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f8013770 con 0x7fca080ac1f0 2023-11-29T11:23:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0806ad10 con 0x7fca080ac1f0 2023-11-29T11:23:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca057fa700 1 -- 172.21.15.81:0/853403223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8013b20 con 0x7fca080ac1f0 2023-11-29T11:23:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0806aa30 con 0x7fca080ac1f0 2023-11-29T11:23:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0806aff0 con 0x7fca080ac1f0 2023-11-29T11:23:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.057+0000 7fca057fa700 1 -- 172.21.15.81:0/853403223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc9f8023070 con 0x7fca080ac1f0 2023-11-29T11:23:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.061+0000 7fca057fa700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc9f4064ee0 0x7fc9f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.061+0000 7fca07fff700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc9f4064ee0 0x7fc9f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.061+0000 7fca057fa700 1 -- 172.21.15.81:0/853403223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fc9f8081d60 con 0x7fca080ac1f0 2023-11-29T11:23:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.061+0000 7fca07fff700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc9f4064ee0 0x7fc9f4067390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc014040 tx=0x7fc9fc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.065+0000 7fca057fa700 1 -- 172.21.15.81:0/853403223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc9f804fcb0 con 0x7fca080ac1f0 2023-11-29T11:23:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.233+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca08072500 con 0x7fca080ac1f0 2023-11-29T11:23:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.233+0000 7fca057fa700 1 -- 172.21.15.81:0/853403223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9f80532d0 con 0x7fca080ac1f0 2023-11-29T11:23:19.241 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc9f4064ee0 msgr2=0x7fc9f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc9f4064ee0 0x7fc9f4067390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc014040 tx=0x7fc9fc008030 comp rx=0 tx=0).stop 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 msgr2=0x7fca08151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca08151a50 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800e810 tx=0x7fc9f800ebd0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 shutdown_connections 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc9f4064ee0 0x7fc9f4067390 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0815c520 0x7fca0815ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca080cc830 0x7fca0809a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 --2- 172.21.15.81:0/853403223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca080ac1f0 0x7fca08151a50 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 >> 172.21.15.81:0/853403223 conn(0x7fca080cae70 msgr2=0x7fca080b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 shutdown_connections 2023-11-29T11:23:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.237+0000 7fca0de9d700 1 -- 172.21.15.81:0/853403223 wait complete. 2023-11-29T11:23:19.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:23:19.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e62d3700 1 Processor -- start 2023-11-29T11:23:19.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e62d3700 1 -- start start 2023-11-29T11:23:19.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e62d3700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1e00cb470 0x7ff1e0164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e62d3700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e006ace0 con 0x7ff1e0159e70 2023-11-29T11:23:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e62d3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e006a0d0 con 0x7ff1e0069c40 2023-11-29T11:23:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e62d3700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e006a3b0 con 0x7ff1e00cb470 2023-11-29T11:23:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e5ad2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1e00cb470 0x7ff1e0164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e52d1700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1e0159e70 0x7ff1e006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55096/0 (socket says 172.21.15.81:55096) 2023-11-29T11:23:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e5ad2700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1e00cb470 0x7ff1e0164a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44340/0 (socket says 172.21.15.81:44340) 2023-11-29T11:23:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e52d1700 1 -- 172.21.15.81:0/3950165149 learned_addr learned my addr 172.21.15.81:0/3950165149 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e5ad2700 1 -- 172.21.15.81:0/3950165149 >> v1:172.21.15.176:6789/0 conn(0x7ff1e0069c40 legacy=0x7ff1e00cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e5ad2700 1 -- 172.21.15.81:0/3950165149 >> v1:172.21.15.81:6789/0 conn(0x7ff1e0159e70 legacy=0x7ff1e006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.357+0000 7ff1e5ad2700 1 -- 172.21.15.81:0/3950165149 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e006a690 con 0x7ff1e00cb470 2023-11-29T11:23:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e5ad2700 1 --2- 172.21.15.81:0/3950165149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e00cb470 0x7ff1e0164a20 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009850 tx=0x7ff1d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b578e323512f9a19 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1dffff700 1 -- 172.21.15.81:0/3950165149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8011830 con 0x7ff1e00cb470 2023-11-29T11:23:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1dffff700 1 -- 172.21.15.81:0/3950165149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d8011990 con 0x7ff1e00cb470 2023-11-29T11:23:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1dffff700 1 -- 172.21.15.81:0/3950165149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8011d20 con 0x7ff1e00cb470 2023-11-29T11:23:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- 172.21.15.81:0/3950165149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e00cb470 msgr2=0x7ff1e0164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 --2- 172.21.15.81:0/3950165149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e00cb470 0x7ff1e0164a20 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009850 tx=0x7ff1d8009b60 comp rx=0 tx=0).stop 2023-11-29T11:23:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- 172.21.15.81:0/3950165149 shutdown_connections 2023-11-29T11:23:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 --2- 172.21.15.81:0/3950165149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e00cb470 0x7ff1e0164a20 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- 172.21.15.81:0/3950165149 >> 172.21.15.81:0/3950165149 conn(0x7ff1e00ce3e0 msgr2=0x7ff1e00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- 172.21.15.81:0/3950165149 shutdown_connections 2023-11-29T11:23:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- 172.21.15.81:0/3950165149 wait complete. 2023-11-29T11:23:19.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 Processor -- start 2023-11-29T11:23:19.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- start start 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e0069c40 0x7ff1e01e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1e00cb470 0x7ff1e015c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e0159e70 0x7ff1e015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00adb80 con 0x7ff1e0159e70 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e015ceb0 con 0x7ff1e00cb470 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.361+0000 7ff1e62d3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e015d190 con 0x7ff1e0069c40 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e0159e70 0x7ff1e015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e0159e70 0x7ff1e015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44356/0 (socket says 172.21.15.81:44356) 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 -- 172.21.15.81:0/1429858065 learned_addr learned my addr 172.21.15.81:0/1429858065 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e4ad0700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1e00cb470 0x7ff1e015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e52d1700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e0069c40 0x7ff1e01e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 -- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e0069c40 msgr2=0x7ff1e01e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e0069c40 0x7ff1e01e59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 -- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1e00cb470 msgr2=0x7ff1e015c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1e00cb470 0x7ff1e015c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 -- 172.21.15.81:0/1429858065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80094b0 con 0x7ff1e0159e70 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e4ad0700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1e00cb470 0x7ff1e015c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e5ad2700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e0159e70 0x7ff1e015a490 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009fd0 tx=0x7ff1d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1ddffb700 1 -- 172.21.15.81:0/1429858065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8004400 con 0x7ff1e0159e70 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1ddffb700 1 -- 172.21.15.81:0/1429858065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d801f070 con 0x7ff1e0159e70 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e006d0b0 con 0x7ff1e0159e70 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1ddffb700 1 -- 172.21.15.81:0/1429858065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d80036c0 con 0x7ff1e0159e70 2023-11-29T11:23:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e006a970 con 0x7ff1e0159e70 2023-11-29T11:23:19.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.365+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e015a240 con 0x7ff1e0159e70 2023-11-29T11:23:19.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.369+0000 7ff1ddffb700 1 -- 172.21.15.81:0/1429858065 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff1d800f050 con 0x7ff1e0159e70 2023-11-29T11:23:19.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.369+0000 7ff1ddffb700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1cc064ee0 0x7ff1cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.369+0000 7ff1e52d1700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1cc064ee0 0x7ff1cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.369+0000 7ff1ddffb700 1 -- 172.21.15.81:0/1429858065 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7ff1d8082b30 con 0x7ff1e0159e70 2023-11-29T11:23:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.369+0000 7ff1e52d1700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1cc064ee0 0x7ff1cc067390 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4005930 tx=0x7ff1d4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.373+0000 7ff1ddffb700 1 -- 172.21.15.81:0/1429858065 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff1d8050a10 con 0x7ff1e0159e70 2023-11-29T11:23:19.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.573+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1e0072500 con 0x7ff1e0159e70 2023-11-29T11:23:19.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.573+0000 7ff1ddffb700 1 -- 172.21.15.81:0/1429858065 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4652 (secure 0 0 0) 0x7ff1d8054030 con 0x7ff1e0159e70 2023-11-29T11:23:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:19.581 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:23:16.726945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"a","rank":0,"incarnation":75,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6837/969746689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":969746689},{"type":"v1","addr":"172.21.15.81:6837","nonce":969746689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1cc064ee0 msgr2=0x7ff1cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1cc064ee0 0x7ff1cc067390 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4005930 tx=0x7ff1d4009040 comp rx=0 tx=0).stop 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e0159e70 msgr2=0x7ff1e015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e0159e70 0x7ff1e015a490 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009fd0 tx=0x7ff1d8004770 comp rx=0 tx=0).stop 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 shutdown_connections 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7ff1cc064ee0 0x7ff1cc067390 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e0159e70 0x7ff1e015a490 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1e00cb470 0x7ff1e015c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 --2- 172.21.15.81:0/1429858065 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e0069c40 0x7ff1e01e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 >> 172.21.15.81:0/1429858065 conn(0x7ff1e00ce3e0 msgr2=0x7ff1e00c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 shutdown_connections 2023-11-29T11:23:19.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.577+0000 7ff1e62d3700 1 -- 172.21.15.81:0/1429858065 wait complete. 2023-11-29T11:23:19.585 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-11-29T11:23:19.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:23:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 Processor -- start 2023-11-29T11:23:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- start start 2023-11-29T11:23:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b800ad490 0x7f9b800c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800cd8f0 con 0x7f9b80158e60 2023-11-29T11:23:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8006dc60 con 0x7f9b800cb460 2023-11-29T11:23:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800add00 con 0x7f9b800ad490 2023-11-29T11:23:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7f7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9b80158e60 0x7f9b800cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38080/0 (socket says 172.21.15.81:38080) 2023-11-29T11:23:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7f7fe700 1 -- 172.21.15.81:0/1734389302 learned_addr learned my addr 172.21.15.81:0/1734389302 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:19.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/1734389302 >> v2:172.21.15.81:3300/0 conn(0x7f9b800ad490 0x7f9b800c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7e7fc700 1 -- 172.21.15.81:0/1734389302 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390468319 0 0) 0x7f9b800cd8f0 con 0x7f9b80158e60 2023-11-29T11:23:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7e7fc700 1 -- 172.21.15.81:0/1734389302 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b680035d0 con 0x7f9b80158e60 2023-11-29T11:23:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7ffff700 1 -- 172.21.15.81:0/1734389302 >> v1:172.21.15.176:6789/0 conn(0x7f9b800cb460 legacy=0x7f9b8006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7ffff700 1 -- 172.21.15.81:0/1734389302 >> v1:172.21.15.81:6789/0 conn(0x7f9b80158e60 legacy=0x7f9b800cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7ffff700 1 -- 172.21.15.81:0/1734389302 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800cde90 con 0x7f9b800ad490 2023-11-29T11:23:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/1734389302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800ad490 0x7f9b800c8a30 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009d90 tx=0x7f9b7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce0ca91e0a5b0aa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7e7fc700 1 -- 172.21.15.81:0/1734389302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800e070 con 0x7f9b800ad490 2023-11-29T11:23:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7e7fc700 1 -- 172.21.15.81:0/1734389302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800bb20 con 0x7f9b800ad490 2023-11-29T11:23:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b7e7fc700 1 -- 172.21.15.81:0/1734389302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78012430 con 0x7f9b800ad490 2023-11-29T11:23:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- 172.21.15.81:0/1734389302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800ad490 msgr2=0x7f9b800c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 --2- 172.21.15.81:0/1734389302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800ad490 0x7f9b800c8a30 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009d90 tx=0x7f9b7800b330 comp rx=0 tx=0).stop 2023-11-29T11:23:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- 172.21.15.81:0/1734389302 shutdown_connections 2023-11-29T11:23:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 --2- 172.21.15.81:0/1734389302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800ad490 0x7f9b800c8a30 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- 172.21.15.81:0/1734389302 >> 172.21.15.81:0/1734389302 conn(0x7f9b800ce3e0 msgr2=0x7f9b800ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- 172.21.15.81:0/1734389302 shutdown_connections 2023-11-29T11:23:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.705+0000 7f9b84adc700 1 -- 172.21.15.81:0/1734389302 wait complete. 2023-11-29T11:23:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b84adc700 1 Processor -- start 2023-11-29T11:23:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b84adc700 1 -- start start 2023-11-29T11:23:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b84adc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b800ad490 0x7f9b800c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b84adc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b800cb460 0x7f9b800ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b84adc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80158e60 0x7f9b800aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b84adc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c5950 con 0x7f9b80158e60 2023-11-29T11:23:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b84adc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c3d30 con 0x7f9b800ad490 2023-11-29T11:23:19.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b84adc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c3770 con 0x7f9b800cb460 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80158e60 0x7f9b800aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80158e60 0x7f9b800aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53104/0 (socket says 172.21.15.81:53104) 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7ffff700 1 -- 172.21.15.81:0/3278047040 learned_addr learned my addr 172.21.15.81:0/3278047040 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7f7fe700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b800ad490 0x7f9b800c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7effd700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b800cb460 0x7f9b800ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7ffff700 1 -- 172.21.15.81:0/3278047040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b800cb460 msgr2=0x7f9b800ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b800cb460 0x7f9b800ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7ffff700 1 -- 172.21.15.81:0/3278047040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b800ad490 msgr2=0x7f9b800c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b800ad490 0x7f9b800c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.709+0000 7f9b7ffff700 1 -- 172.21.15.81:0/3278047040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78009a70 con 0x7f9b80158e60 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b7ffff700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80158e60 0x7f9b800aeec0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800b680 tx=0x7f9b78004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b67fff700 1 -- 172.21.15.81:0/3278047040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78012430 con 0x7f9b80158e60 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b67fff700 1 -- 172.21.15.81:0/3278047040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78020070 con 0x7f9b80158e60 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8006d6a0 con 0x7f9b80158e60 2023-11-29T11:23:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b67fff700 1 -- 172.21.15.81:0/3278047040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78004280 con 0x7f9b80158e60 2023-11-29T11:23:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b80159230 con 0x7f9b80158e60 2023-11-29T11:23:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8006d980 con 0x7f9b80158e60 2023-11-29T11:23:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b67fff700 1 -- 172.21.15.81:0/3278047040 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9b780043e0 con 0x7f9b80158e60 2023-11-29T11:23:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b67fff700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b6c064ee0 0x7f9b6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b7f7fe700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b6c064ee0 0x7f9b6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.713+0000 7f9b67fff700 1 -- 172.21.15.81:0/3278047040 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f9b78022070 con 0x7f9b80158e60 2023-11-29T11:23:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.717+0000 7f9b7f7fe700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b6c064ee0 0x7f9b6c067390 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9b700011e0 tx=0x7f9b70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.717+0000 7f9b67fff700 1 -- 172.21.15.81:0/3278047040 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9b78052140 con 0x7f9b80158e60 2023-11-29T11:23:19.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.877+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b800c5b00 con 0x7f9b80158e60 2023-11-29T11:23:19.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.881+0000 7f9b67fff700 1 -- 172.21.15.81:0/3278047040 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f9b800c5b00 con 0x7f9b80158e60 2023-11-29T11:23:19.889 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:19.889 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":113,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:23:14.804121+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.24","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/665591010":"2023-11-30T11:23:14.804071+0000","172.21.15.81:6836/665591010":"2023-11-30T11:23:14.804071+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:23:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b6c064ee0 msgr2=0x7f9b6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b6c064ee0 0x7f9b6c067390 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9b700011e0 tx=0x7f9b70009040 comp rx=0 tx=0).stop 2023-11-29T11:23:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80158e60 msgr2=0x7f9b800aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80158e60 0x7f9b800aeec0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800b680 tx=0x7f9b78004af0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 shutdown_connections 2023-11-29T11:23:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9b6c064ee0 0x7f9b6c067390 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80158e60 0x7f9b800aeec0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b800cb460 0x7f9b800ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 --2- 172.21.15.81:0/3278047040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b800ad490 0x7f9b800c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 >> 172.21.15.81:0/3278047040 conn(0x7f9b800ce3e0 msgr2=0x7f9b800c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 shutdown_connections 2023-11-29T11:23:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:19.885+0000 7f9b84adc700 1 -- 172.21.15.81:0/3278047040 wait complete. 2023-11-29T11:23:19.904 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T11:23:19.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:23:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.009+0000 7fdc3b010700 1 Processor -- start 2023-11-29T11:23:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.009+0000 7fdc3b010700 1 -- start start 2023-11-29T11:23:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc3415c300 0x7fdc340adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 0x7fdc3406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3406a080 con 0x7fdc3406b660 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3406ad00 con 0x7fdc3415c300 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340b2a80 con 0x7fdc340ae290 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3a80f700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdc3406b660 0x7fdc3406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38088/0 (socket says 172.21.15.81:38088) 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3a80f700 1 -- 172.21.15.81:0/2113370245 learned_addr learned my addr 172.21.15.81:0/2113370245 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3a00e700 1 --2- 172.21.15.81:0/2113370245 >> v2:172.21.15.176:3300/0 conn(0x7fdc3415c300 0x7fdc340adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3980d700 1 --2- 172.21.15.81:0/2113370245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 0x7fdc3406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3900c700 1 -- 172.21.15.81:0/2113370245 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669163527 0 0) 0x7fdc3406a080 con 0x7fdc3406b660 2023-11-29T11:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3900c700 1 -- 172.21.15.81:0/2113370245 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc200035d0 con 0x7fdc3406b660 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3900c700 1 -- 172.21.15.81:0/2113370245 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871651061 0 0) 0x7fdc200035d0 con 0x7fdc3406b660 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3a00e700 1 -- 172.21.15.81:0/2113370245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 msgr2=0x7fdc3406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3a00e700 1 --2- 172.21.15.81:0/2113370245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 0x7fdc3406b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3a00e700 1 -- 172.21.15.81:0/2113370245 >> v1:172.21.15.81:6789/0 conn(0x7fdc3406b660 legacy=0x7fdc3406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3a00e700 1 -- 172.21.15.81:0/2113370245 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3406a360 con 0x7fdc3415c300 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3a00e700 1 --2- 172.21.15.81:0/2113370245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc3415c300 0x7fdc340adbb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009880 tx=0x7fdc30009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae64312eae23c303 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3900c700 1 -- 172.21.15.81:0/2113370245 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0019f0 con 0x7fdc3415c300 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3900c700 1 -- 172.21.15.81:0/2113370245 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30004030 con 0x7fdc3415c300 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3900c700 1 -- 172.21.15.81:0/2113370245 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc300043a0 con 0x7fdc3415c300 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 -- 172.21.15.81:0/2113370245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc3415c300 msgr2=0x7fdc340adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2113370245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc3415c300 0x7fdc340adbb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009880 tx=0x7fdc30009b90 comp rx=0 tx=0).stop 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 -- 172.21.15.81:0/2113370245 shutdown_connections 2023-11-29T11:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2113370245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 0x7fdc3406b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2113370245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc3415c300 0x7fdc340adbb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 -- 172.21.15.81:0/2113370245 >> 172.21.15.81:0/2113370245 conn(0x7fdc3406e000 msgr2=0x7fdc340b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 -- 172.21.15.81:0/2113370245 shutdown_connections 2023-11-29T11:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.013+0000 7fdc3b010700 1 -- 172.21.15.81:0/2113370245 wait complete. 2023-11-29T11:23:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3b010700 1 Processor -- start 2023-11-29T11:23:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3b010700 1 -- start start 2023-11-29T11:23:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3b010700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 0x7fdc341445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3b010700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc3415c300 0x7fdc341e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3b010700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc341508f0 0x7fdc34151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3b010700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341e5ca0 con 0x7fdc3415c300 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3b010700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341e5f80 con 0x7fdc341508f0 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3b010700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341e6260 con 0x7fdc340ae290 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3980d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc3415c300 0x7fdc341e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3980d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc3415c300 0x7fdc341e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53110/0 (socket says 172.21.15.81:53110) 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3980d700 1 -- 172.21.15.81:0/2130722026 learned_addr learned my addr 172.21.15.81:0/2130722026 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3a80f700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc341508f0 0x7fdc34151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3a00e700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 0x7fdc341445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3980d700 1 -- 172.21.15.81:0/2130722026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 msgr2=0x7fdc341445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3980d700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 0x7fdc341445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3980d700 1 -- 172.21.15.81:0/2130722026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc341508f0 msgr2=0x7fdc34151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3980d700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc341508f0 0x7fdc34151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.017+0000 7fdc3980d700 1 -- 172.21.15.81:0/2130722026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300094b0 con 0x7fdc3415c300 2023-11-29T11:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc3980d700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc3415c300 0x7fdc341e53a0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400e9d0 tx=0x7fdc2400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc2affd700 1 -- 172.21.15.81:0/2130722026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24009720 con 0x7fdc3415c300 2023-11-29T11:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc2affd700 1 -- 172.21.15.81:0/2130722026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400ee70 con 0x7fdc3415c300 2023-11-29T11:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3406a920 con 0x7fdc3415c300 2023-11-29T11:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc2affd700 1 -- 172.21.15.81:0/2130722026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400ca50 con 0x7fdc3415c300 2023-11-29T11:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3406a640 con 0x7fdc3415c300 2023-11-29T11:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3406cd50 con 0x7fdc3415c300 2023-11-29T11:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc2affd700 1 -- 172.21.15.81:0/2130722026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc24023070 con 0x7fdc3415c300 2023-11-29T11:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc2affd700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc18064f10 0x7fdc180673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc3a00e700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc18064f10 0x7fdc180673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.021+0000 7fdc2affd700 1 -- 172.21.15.81:0/2130722026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fdc240823b0 con 0x7fdc3415c300 2023-11-29T11:23:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.025+0000 7fdc3a00e700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc18064f10 0x7fdc180673c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdc300097d0 tx=0x7fdc30010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.029+0000 7fdc2affd700 1 -- 172.21.15.81:0/2130722026 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdc24050200 con 0x7fdc3415c300 2023-11-29T11:23:20.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.225+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc34072c20 con 0x7fdc3415c300 2023-11-29T11:23:20.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc2affd700 1 -- 172.21.15.81:0/2130722026 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4652 (secure 0 0 0) 0x7fdc24017090 con 0x7fdc3415c300 2023-11-29T11:23:20.236 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:20.236 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:23:16.726945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"a","rank":0,"incarnation":75,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6837/969746689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":969746689},{"type":"v1","addr":"172.21.15.81:6837","nonce":969746689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:23:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc18064f10 msgr2=0x7fdc180673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc18064f10 0x7fdc180673c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdc300097d0 tx=0x7fdc30010000 comp rx=0 tx=0).stop 2023-11-29T11:23:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc3415c300 msgr2=0x7fdc341e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc3415c300 0x7fdc341e53a0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400e9d0 tx=0x7fdc2400ece0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 shutdown_connections 2023-11-29T11:23:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdc18064f10 0x7fdc180673c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.238 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc341508f0 0x7fdc34151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc3415c300 0x7fdc341e53a0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 --2- 172.21.15.81:0/2130722026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc340ae290 0x7fdc341445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 >> 172.21.15.81:0/2130722026 conn(0x7fdc3406e000 msgr2=0x7fdc341511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 shutdown_connections 2023-11-29T11:23:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.229+0000 7fdc3b010700 1 -- 172.21.15.81:0/2130722026 wait complete. 2023-11-29T11:23:20.239 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-11-29T11:23:20.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:23:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 Processor -- start 2023-11-29T11:23:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- start start 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c3c06a330 0x7f3c3c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c0cf070 con 0x7f3c3c0d2780 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c0b2070 con 0x7f3c3c0b1ca0 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c06a8a0 con 0x7f3c3c06a330 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c3c06a330 0x7f3c3c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c3c06a330 0x7f3c3c0b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53116/0 (socket says 172.21.15.81:53116) 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3b7fe700 1 -- 172.21.15.81:0/619669007 learned_addr learned my addr 172.21.15.81:0/619669007 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3b7fe700 1 -- 172.21.15.81:0/619669007 >> v1:172.21.15.176:6789/0 conn(0x7f3c3c0b1ca0 legacy=0x7f3c3c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3b7fe700 1 -- 172.21.15.81:0/619669007 >> v1:172.21.15.81:6789/0 conn(0x7f3c3c0d2780 legacy=0x7f3c3c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3b7fe700 1 -- 172.21.15.81:0/619669007 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c06ab80 con 0x7f3c3c06a330 2023-11-29T11:23:20.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3b7fe700 1 --2- 172.21.15.81:0/619669007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c0b6250 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009910 tx=0x7f3c30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47082bc3b7320b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3affd700 1 -- 172.21.15.81:0/619669007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000ba60 con 0x7f3c3c06a330 2023-11-29T11:23:20.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3affd700 1 -- 172.21.15.81:0/619669007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3000bbc0 con 0x7f3c3c06a330 2023-11-29T11:23:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c3affd700 1 -- 172.21.15.81:0/619669007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30009e60 con 0x7f3c3c06a330 2023-11-29T11:23:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- 172.21.15.81:0/619669007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 msgr2=0x7f3c3c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 --2- 172.21.15.81:0/619669007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c0b6250 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009910 tx=0x7f3c30009c20 comp rx=0 tx=0).stop 2023-11-29T11:23:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- 172.21.15.81:0/619669007 shutdown_connections 2023-11-29T11:23:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 --2- 172.21.15.81:0/619669007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c0b6250 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- 172.21.15.81:0/619669007 >> 172.21.15.81:0/619669007 conn(0x7f3c3c0b5740 msgr2=0x7f3c3c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- 172.21.15.81:0/619669007 shutdown_connections 2023-11-29T11:23:20.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.349+0000 7f3c412cf700 1 -- 172.21.15.81:0/619669007 wait complete. 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c412cf700 1 Processor -- start 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c412cf700 1 -- start start 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c412cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c412cf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3c0b1ca0 0x7f3c3c0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c412cf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3c0d2780 0x7f3c3c0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c412cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c1562b0 con 0x7f3c3c06a330 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c412cf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c155fd0 con 0x7f3c3c0d2780 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c412cf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c156e40 con 0x7f3c3c0b1ca0 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53126/0 (socket says 172.21.15.81:53126) 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 -- 172.21.15.81:0/809285132 learned_addr learned my addr 172.21.15.81:0/809285132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3b7fe700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3c0b1ca0 0x7f3c3c0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c40ace700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3c0d2780 0x7f3c3c0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 -- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3c0b1ca0 msgr2=0x7f3c3c0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3c0b1ca0 0x7f3c3c0b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 -- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3c0d2780 msgr2=0x7f3c3c0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3c0d2780 0x7f3c3c0b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 -- 172.21.15.81:0/809285132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30009570 con 0x7f3c3c06a330 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c40ace700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3c0d2780 0x7f3c3c0b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.353+0000 7f3c3bfff700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c149b90 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00c500 tx=0x7f3c2c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c38ff9700 1 -- 172.21.15.81:0/809285132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0052d0 con 0x7f3c3c06a330 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c38ff9700 1 -- 172.21.15.81:0/809285132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c005430 con 0x7f3c3c06a330 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c06b140 con 0x7f3c3c06a330 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c38ff9700 1 -- 172.21.15.81:0/809285132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0055a0 con 0x7f3c3c06a330 2023-11-29T11:23:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c06ae60 con 0x7f3c3c06a330 2023-11-29T11:23:20.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c072c20 con 0x7f3c3c06a330 2023-11-29T11:23:20.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c38ff9700 1 -- 172.21.15.81:0/809285132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3c2c019030 con 0x7f3c3c06a330 2023-11-29T11:23:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c38ff9700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c28064ee0 0x7f3c28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c38ff9700 1 -- 172.21.15.81:0/809285132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f3c2c0812d0 con 0x7f3c3c06a330 2023-11-29T11:23:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.357+0000 7f3c3b7fe700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c28064ee0 0x7f3c28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.361+0000 7f3c3b7fe700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c28064ee0 0x7f3c28067390 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009910 tx=0x7f3c30008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.365+0000 7f3c38ff9700 1 -- 172.21.15.81:0/809285132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3c2c04f2a0 con 0x7f3c3c06a330 2023-11-29T11:23:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.565+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c3c06b540 con 0x7f3c3c06a330 2023-11-29T11:23:20.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c38ff9700 1 -- 172.21.15.81:0/809285132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4652 (secure 0 0 0) 0x7f3c2c0528c0 con 0x7f3c3c06a330 2023-11-29T11:23:20.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:20.575 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-29T11:22:17.569132+0000","modified":"2023-11-29T11:23:16.726945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9408":{"gid":9408,"name":"a","rank":0,"incarnation":75,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6837/969746689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":969746689},{"type":"v1","addr":"172.21.15.81:6837","nonce":969746689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-11-29T11:23:20.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c28064ee0 msgr2=0x7f3c28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c28064ee0 0x7f3c28067390 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009910 tx=0x7f3c30008030 comp rx=0 tx=0).stop 2023-11-29T11:23:20.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 msgr2=0x7f3c3c149b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c149b90 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00c500 tx=0x7f3c2c00c810 comp rx=0 tx=0).stop 2023-11-29T11:23:20.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 shutdown_connections 2023-11-29T11:23:20.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3c28064ee0 0x7f3c28067390 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3c0d2780 0x7f3c3c0b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3c0b1ca0 0x7f3c3c0b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 --2- 172.21.15.81:0/809285132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c06a330 0x7f3c3c149b90 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 >> 172.21.15.81:0/809285132 conn(0x7f3c3c0b5740 msgr2=0x7f3c3c0b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:20.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 shutdown_connections 2023-11-29T11:23:20.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.569+0000 7f3c412cf700 1 -- 172.21.15.81:0/809285132 wait complete. 2023-11-29T11:23:20.579 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2023-11-29T11:23:20.590 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:23:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.697+0000 7f35a1480700 1 Processor -- start 2023-11-29T11:23:20.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.697+0000 7f35a1480700 1 -- start start 2023-11-29T11:23:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f359c160680 0x7f359c071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c069c40 0x7f359c0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f359c0b0c30 0x7f359c0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0cc420 con 0x7f359c160680 2023-11-29T11:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0cc6c0 con 0x7f359c0b0c30 2023-11-29T11:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0cc9a0 con 0x7f359c069c40 2023-11-29T11:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f359c160680 0x7f359c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f359c160680 0x7f359c071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53130/0 (socket says 172.21.15.81:53130) 2023-11-29T11:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 -- 172.21.15.81:0/388011211 learned_addr learned my addr 172.21.15.81:0/388011211 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359a7fc700 1 --2- 172.21.15.81:0/388011211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c069c40 0x7f359c0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359b7fe700 1 --2- 172.21.15.81:0/388011211 >> v2:172.21.15.176:3300/0 conn(0x7f359c0b0c30 0x7f359c0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 -- 172.21.15.81:0/388011211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c069c40 msgr2=0x7f359c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:20.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 --2- 172.21.15.81:0/388011211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c069c40 0x7f359c0cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 -- 172.21.15.81:0/388011211 >> v2:172.21.15.176:3300/0 conn(0x7f359c0b0c30 msgr2=0x7f359c0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 --2- 172.21.15.81:0/388011211 >> v2:172.21.15.176:3300/0 conn(0x7f359c0b0c30 0x7f359c0cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 -- 172.21.15.81:0/388011211 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0705c0 con 0x7f359c160680 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359a7fc700 1 --2- 172.21.15.81:0/388011211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c069c40 0x7f359c0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359b7fe700 1 --2- 172.21.15.81:0/388011211 >> v2:172.21.15.176:3300/0 conn(0x7f359c0b0c30 0x7f359c0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f359affd700 1 --2- 172.21.15.81:0/388011211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c160680 0x7f359c071260 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f359c0c8d90 tx=0x7f358c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453c4d535f01209b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f3599ffb700 1 -- 172.21.15.81:0/388011211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00b8a0 con 0x7f359c160680 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f3599ffb700 1 -- 172.21.15.81:0/388011211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00ba00 con 0x7f359c160680 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f3599ffb700 1 -- 172.21.15.81:0/388011211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00bd90 con 0x7f359c160680 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 -- 172.21.15.81:0/388011211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c160680 msgr2=0x7f359c071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 --2- 172.21.15.81:0/388011211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c160680 0x7f359c071260 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f359c0c8d90 tx=0x7f358c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 -- 172.21.15.81:0/388011211 shutdown_connections 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 --2- 172.21.15.81:0/388011211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c069c40 0x7f359c0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 --2- 172.21.15.81:0/388011211 >> v2:172.21.15.176:3300/0 conn(0x7f359c0b0c30 0x7f359c0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 --2- 172.21.15.81:0/388011211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c160680 0x7f359c071260 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 -- 172.21.15.81:0/388011211 >> 172.21.15.81:0/388011211 conn(0x7f359c06caf0 msgr2=0x7f359c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:20.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 -- 172.21.15.81:0/388011211 shutdown_connections 2023-11-29T11:23:20.711 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.701+0000 7f35a1480700 1 -- 172.21.15.81:0/388011211 wait complete. 2023-11-29T11:23:20.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f35a1480700 1 Processor -- start 2023-11-29T11:23:20.712 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f35a1480700 1 -- start start 2023-11-29T11:23:20.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f35a1480700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c069c40 0x7f359c159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f35a1480700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c0b0c30 0x7f359c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f35a1480700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f359c160d30 0x7f359c1622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f35a1480700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c159c90 con 0x7f359c069c40 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f35a1480700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c161280 con 0x7f359c160d30 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f35a1480700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c161560 con 0x7f359c0b0c30 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c069c40 0x7f359c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c069c40 0x7f359c159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53142/0 (socket says 172.21.15.81:53142) 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 -- 172.21.15.81:0/2240783659 learned_addr learned my addr 172.21.15.81:0/2240783659 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359b7fe700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f359c160d30 0x7f359c1622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359a7fc700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c0b0c30 0x7f359c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 -- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c0b0c30 msgr2=0x7f359c0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c0b0c30 0x7f359c0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 -- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f359c160d30 msgr2=0x7f359c1622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f359c160d30 0x7f359c1622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 -- 172.21.15.81:0/2240783659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c009570 con 0x7f359c069c40 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359b7fe700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f359c160d30 0x7f359c1622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.705+0000 7f359affd700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c069c40 0x7f359c159750 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f358c013000 tx=0x7f358c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35937fe700 1 -- 172.21.15.81:0/2240783659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0036c0 con 0x7f359c069c40 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35937fe700 1 -- 172.21.15.81:0/2240783659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c01f070 con 0x7f359c069c40 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c0c9750 con 0x7f359c069c40 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35937fe700 1 -- 172.21.15.81:0/2240783659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c003a80 con 0x7f359c069c40 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c071940 con 0x7f359c069c40 2023-11-29T11:23:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c160a50 con 0x7f359c069c40 2023-11-29T11:23:20.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35937fe700 1 -- 172.21.15.81:0/2240783659 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f358c02a020 con 0x7f359c069c40 2023-11-29T11:23:20.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35937fe700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3580064ee0 0x7f3580067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:20.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f35937fe700 1 -- 172.21.15.81:0/2240783659 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f358c083820 con 0x7f359c069c40 2023-11-29T11:23:20.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.709+0000 7f359a7fc700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3580064ee0 0x7f3580067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:20.718 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.713+0000 7f359a7fc700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3580064ee0 0x7f3580067390 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f359c071010 tx=0x7f3584008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:20.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.717+0000 7f35937fe700 1 -- 172.21.15.81:0/2240783659 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f358c0517f0 con 0x7f359c069c40 2023-11-29T11:23:20.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-29T11:23:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.881+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f359c072500 con 0x7f359c069c40 2023-11-29T11:23:20.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.881+0000 7f35937fe700 1 -- 172.21.15.81:0/2240783659 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f358c010380 con 0x7f359c069c40 2023-11-29T11:23:20.890 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:20.890 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":113,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:23:14.804121+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-29T11:22:15.796341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-29T11:22:16.553603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.24","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/665591010":"2023-11-30T11:23:14.804071+0000","172.21.15.81:6836/665591010":"2023-11-30T11:23:14.804071+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3580064ee0 msgr2=0x7f3580067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3580064ee0 0x7f3580067390 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f359c071010 tx=0x7f3584008040 comp rx=0 tx=0).stop 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c069c40 msgr2=0x7f359c159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c069c40 0x7f359c159750 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f358c013000 tx=0x7f358c004770 comp rx=0 tx=0).stop 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 shutdown_connections 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f3580064ee0 0x7f3580067390 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f359c160d30 0x7f359c1622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359c0b0c30 0x7f359c0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 --2- 172.21.15.81:0/2240783659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f359c069c40 0x7f359c159750 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 >> 172.21.15.81:0/2240783659 conn(0x7f359c06caf0 msgr2=0x7f359c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 shutdown_connections 2023-11-29T11:23:20.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:20.885+0000 7f35a1480700 1 -- 172.21.15.81:0/2240783659 wait complete. 2023-11-29T11:23:20.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T11:23:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.013+0000 7f5121840700 1 Processor -- start 2023-11-29T11:23:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.013+0000 7f5121840700 1 -- start start 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f511c1537f0 0x7f511c0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f511c15cb50 0x7f511c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c0cad30 con 0x7f511c153420 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c0cdda0 con 0x7f511c1537f0 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c15d4b0 con 0x7f511c15cb50 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f51127fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f511c1537f0 0x7f511c0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f51127fc700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f511c1537f0 0x7f511c0c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53150/0 (socket says 172.21.15.81:53150) 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f51127fc700 1 -- 172.21.15.81:0/1581026615 learned_addr learned my addr 172.21.15.81:0/1581026615 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f511b7fe700 1 --2- 172.21.15.81:0/1581026615 >> v2:172.21.15.176:3300/0 conn(0x7f511c15cb50 0x7f511c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f51127fc700 1 -- 172.21.15.81:0/1581026615 >> v2:172.21.15.176:3300/0 conn(0x7f511c15cb50 msgr2=0x7f511c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f51127fc700 1 --2- 172.21.15.81:0/1581026615 >> v2:172.21.15.176:3300/0 conn(0x7f511c15cb50 0x7f511c15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:21.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f51127fc700 1 -- 172.21.15.81:0/1581026615 >> v1:172.21.15.176:6789/0 conn(0x7f511c153420 legacy=0x7f511c0ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:21.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f51127fc700 1 -- 172.21.15.81:0/1581026615 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0b0cd0 con 0x7f511c1537f0 2023-11-29T11:23:21.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f51127fc700 1 --2- 172.21.15.81:0/1581026615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c0c8f50 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f511c0ce760 tx=0x7f5104009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16a86bcebc0bedf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:21.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f511a7fc700 1 -- 172.21.15.81:0/1581026615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104011830 con 0x7f511c1537f0 2023-11-29T11:23:21.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f511a7fc700 1 -- 172.21.15.81:0/1581026615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5104011990 con 0x7f511c1537f0 2023-11-29T11:23:21.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f511a7fc700 1 -- 172.21.15.81:0/1581026615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104011d20 con 0x7f511c1537f0 2023-11-29T11:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- 172.21.15.81:0/1581026615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 msgr2=0x7f511c0c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 --2- 172.21.15.81:0/1581026615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c0c8f50 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f511c0ce760 tx=0x7f5104009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- 172.21.15.81:0/1581026615 shutdown_connections 2023-11-29T11:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 --2- 172.21.15.81:0/1581026615 >> v2:172.21.15.176:3300/0 conn(0x7f511c15cb50 0x7f511c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 --2- 172.21.15.81:0/1581026615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c0c8f50 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- 172.21.15.81:0/1581026615 >> 172.21.15.81:0/1581026615 conn(0x7f511c06caf0 msgr2=0x7f511c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- 172.21.15.81:0/1581026615 shutdown_connections 2023-11-29T11:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- 172.21.15.81:0/1581026615 wait complete. 2023-11-29T11:23:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 Processor -- start 2023-11-29T11:23:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.017+0000 7f5121840700 1 -- start start 2023-11-29T11:23:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f511c153420 0x7f511c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f511c15cb50 0x7f511c070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0b2d20 con 0x7f511c1537f0 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c148fc0 con 0x7f511c153420 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0b18f0 con 0x7f511c15cb50 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c147940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53166/0 (socket says 172.21.15.81:53166) 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 -- 172.21.15.81:0/579701476 learned_addr learned my addr 172.21.15.81:0/579701476 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f511b7fe700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f511c15cb50 0x7f511c070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f511affd700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f511c153420 0x7f511c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 -- 172.21.15.81:0/579701476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f511c15cb50 msgr2=0x7f511c070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f511c15cb50 0x7f511c070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 -- 172.21.15.81:0/579701476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f511c153420 msgr2=0x7f511c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f511c153420 0x7f511c0b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 -- 172.21.15.81:0/579701476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104009570 con 0x7f511c1537f0 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f51127fc700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c147940 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f5104013000 tx=0x7f5104004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5118ff9700 1 -- 172.21.15.81:0/579701476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104004450 con 0x7f511c1537f0 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c0b0f70 con 0x7f511c1537f0 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5118ff9700 1 -- 172.21.15.81:0/579701476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510401f070 con 0x7f511c1537f0 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5118ff9700 1 -- 172.21.15.81:0/579701476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104003900 con 0x7f511c1537f0 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c0caa00 con 0x7f511c1537f0 2023-11-29T11:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.021+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c0b1250 con 0x7f511c1537f0 2023-11-29T11:23:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.025+0000 7f5118ff9700 1 -- 172.21.15.81:0/579701476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f510400f050 con 0x7f511c1537f0 2023-11-29T11:23:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.025+0000 7f5118ff9700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f50fc064ee0 0x7f50fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.025+0000 7f5118ff9700 1 -- 172.21.15.81:0/579701476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f5104021070 con 0x7f511c1537f0 2023-11-29T11:23:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.025+0000 7f511affd700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f50fc064ee0 0x7f50fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.025+0000 7f511affd700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f50fc064ee0 0x7f50fc067390 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f511c15bbf0 tx=0x7f510c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.033+0000 7f5118ff9700 1 -- 172.21.15.81:0/579701476 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5104051430 con 0x7f511c1537f0 2023-11-29T11:23:21.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:21.233+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f511c072500 con 0x7f511c1537f0 2023-11-29T11:23:22.206 INFO:tasks.ceph.mon.a.smithi081.stderr:2023-11-29T11:23:22.201+0000 7f73519cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T11:23:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.209+0000 7f5118ff9700 1 -- 172.21.15.81:0/579701476 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5104015090 con 0x7f511c1537f0 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f50fc064ee0 msgr2=0x7f50fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f50fc064ee0 0x7f50fc067390 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f511c15bbf0 tx=0x7f510c009040 comp rx=0 tx=0).stop 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 msgr2=0x7f511c147940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c147940 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f5104013000 tx=0x7f5104004770 comp rx=0 tx=0).stop 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 shutdown_connections 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f50fc064ee0 0x7f50fc067390 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f511c15cb50 0x7f511c070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f511c1537f0 0x7f511c147940 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 --2- 172.21.15.81:0/579701476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f511c153420 0x7f511c0b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 >> 172.21.15.81:0/579701476 conn(0x7f511c06caf0 msgr2=0x7f511c0c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 shutdown_connections 2023-11-29T11:23:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.213+0000 7f5121840700 1 -- 172.21.15.81:0/579701476 wait complete. 2023-11-29T11:23:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T11:23:22.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T11:23:22.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.353+0000 7fc92359e700 1 Processor -- start 2023-11-29T11:23:22.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.353+0000 7fc92359e700 1 -- start start 2023-11-29T11:23:22.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc9240ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:22.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92359e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92409c0e0 con 0x7fc9240b2d30 2023-11-29T11:23:22.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92359e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9240b13e0 con 0x7fc92415a3e0 2023-11-29T11:23:22.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240b16c0 con 0x7fc9240cc2f0 2023-11-29T11:23:22.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc922d9d700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc9240b2d30 0x7fc924069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38108/0 (socket says 172.21.15.81:38108) 2023-11-29T11:23:22.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc922d9d700 1 -- 172.21.15.81:0/1213120913 learned_addr learned my addr 172.21.15.81:0/1213120913 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:22.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92259c700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc9240ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282328386 0 0) 0x7fc92409c0e0 con 0x7fc9240b2d30 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc90c0035d0 con 0x7fc9240b2d30 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176551445 0 0) 0x7fc9240b13e0 con 0x7fc92415a3e0 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc92409c0e0 con 0x7fc92415a3e0 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372730150 0 0) 0x7fc90c0035d0 con 0x7fc9240b2d30 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 msgr2=0x7fc9240ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc9240ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 >> v1:172.21.15.176:6789/0 conn(0x7fc92415a3e0 legacy=0x7fc9240cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240b19a0 con 0x7fc9240b2d30 2023-11-29T11:23:22.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7fc91c0019f0 con 0x7fc9240b2d30 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 >> v1:172.21.15.81:6789/0 conn(0x7fc9240b2d30 legacy=0x7fc924069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc90c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc90c004140 0x7fc90c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc90c004db0 0x7fc90c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240b16c0 con 0x7fc90c004db0 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c00bae0 con 0x7fc90c004140 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0100b0 con 0x7fc9240cc2f0 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92259c700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc90c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc921d9b700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc90c004140 0x7fc90c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc922d9d700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc90c004db0 0x7fc90c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92259c700 1 -- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc90c004140 msgr2=0x7fc90c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92259c700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc90c004140 0x7fc90c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92259c700 1 -- 172.21.15.81:0/1213120913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc90c004db0 msgr2=0x7fc90c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92259c700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc90c004db0 0x7fc90c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92259c700 1 -- 172.21.15.81:0/1213120913 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0035d0 con 0x7fc9240cc2f0 2023-11-29T11:23:22.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92259c700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc90c003be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc918009b40 tx=0x7fc90c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89aa50467251a0a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:22.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800e6c0 con 0x7fc9240cc2f0 2023-11-29T11:23:22.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91800e820 con 0x7fc9240cc2f0 2023-11-29T11:23:22.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92159a700 1 -- 172.21.15.81:0/1213120913 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800eb90 con 0x7fc9240cc2f0 2023-11-29T11:23:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92359e700 1 -- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 msgr2=0x7fc90c003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.357+0000 7fc92359e700 1 --2- 172.21.15.81:0/1213120913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc90c003be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc918009b40 tx=0x7fc90c0058a0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 -- 172.21.15.81:0/1213120913 reap_dead start 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 -- 172.21.15.81:0/1213120913 shutdown_connections 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 -- 172.21.15.81:0/1213120913 >> 172.21.15.81:0/1213120913 conn(0x7fc9240cae70 msgr2=0x7fc9240cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 -- 172.21.15.81:0/1213120913 shutdown_connections 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 -- 172.21.15.81:0/1213120913 wait complete. 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 Processor -- start 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 -- start start 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc92414e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc924071f70 0x7fc92415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92415acf0 0x7fc92415b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240c7520 con 0x7fc92415acf0 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240c7800 con 0x7fc924071f70 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92359e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240c7ae0 con 0x7fc9240cc2f0 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92415acf0 0x7fc92415b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92415acf0 0x7fc92415b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53194/0 (socket says 172.21.15.81:53194) 2023-11-29T11:23:22.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 -- 172.21.15.81:0/2136355478 learned_addr learned my addr 172.21.15.81:0/2136355478 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:22.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc92259c700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc92414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:22.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc921d9b700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc924071f70 0x7fc92415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 -- 172.21.15.81:0/2136355478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 msgr2=0x7fc92414e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc92414e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 -- 172.21.15.81:0/2136355478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc924071f70 msgr2=0x7fc92415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc924071f70 0x7fc92415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 -- 172.21.15.81:0/2136355478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92406a350 con 0x7fc92415acf0 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.361+0000 7fc922d9d700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92415acf0 0x7fc92415b190 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fc9240c1a90 tx=0x7fc91c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc912ffd700 1 -- 172.21.15.81:0/2136355478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00a8a0 con 0x7fc92415acf0 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9240b1c80 con 0x7fc92415acf0 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc912ffd700 1 -- 172.21.15.81:0/2136355478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c00aa40 con 0x7fc92415acf0 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc912ffd700 1 -- 172.21.15.81:0/2136355478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00adf0 con 0x7fc92415acf0 2023-11-29T11:23:22.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9240ac280 con 0x7fc92415acf0 2023-11-29T11:23:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc924072500 con 0x7fc92415acf0 2023-11-29T11:23:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc912ffd700 1 -- 172.21.15.81:0/2136355478 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc91c01e460 con 0x7fc92415acf0 2023-11-29T11:23:22.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc912ffd700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc904064f10 0x7fc9040673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc912ffd700 1 -- 172.21.15.81:0/2136355478 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6612+0+0 (secure 0 0 0) 0x7fc91c0826d0 con 0x7fc92415acf0 2023-11-29T11:23:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.365+0000 7fc92259c700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc904064f10 0x7fc9040673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.369+0000 7fc92259c700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc904064f10 0x7fc9040673c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc9180090b0 tx=0x7fc91801e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:22.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.373+0000 7fc912ffd700 1 -- 172.21.15.81:0/2136355478 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc91c050560 con 0x7fc92415acf0 2023-11-29T11:23:22.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:22.565+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc9240ccfd0 con 0x7fc92415acf0 2023-11-29T11:23:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.217+0000 7fc912ffd700 1 -- 172.21.15.81:0/2136355478 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc91c053b80 con 0x7fc92415acf0 2023-11-29T11:23:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc904064f10 msgr2=0x7fc9040673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc904064f10 0x7fc9040673c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc9180090b0 tx=0x7fc91801e040 comp rx=0 tx=0).stop 2023-11-29T11:23:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92415acf0 msgr2=0x7fc92415b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92415acf0 0x7fc92415b190 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fc9240c1a90 tx=0x7fc91c001a20 comp rx=0 tx=0).stop 2023-11-29T11:23:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 shutdown_connections 2023-11-29T11:23:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fc904064f10 0x7fc9040673c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92415acf0 0x7fc92415b190 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc924071f70 0x7fc92415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 --2- 172.21.15.81:0/2136355478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9240cc2f0 0x7fc92414e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 >> 172.21.15.81:0/2136355478 conn(0x7fc9240cae70 msgr2=0x7fc92406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:23.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 shutdown_connections 2023-11-29T11:23:23.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.221+0000 7fc92359e700 1 -- 172.21.15.81:0/2136355478 wait complete. 2023-11-29T11:23:23.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T11:23:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.365+0000 7fbbbcdaa700 1 Processor -- start 2023-11-29T11:23:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.365+0000 7fbbbcdaa700 1 -- start start 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbb8159ee0 0x7fbbb80cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbbb80b4d10 0x7fbbb80cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb8069c40 con 0x7fbbb815a2b0 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb815da60 con 0x7fbbb8159ee0 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb8069e90 con 0x7fbbb80b4d10 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbb8159ee0 0x7fbbb80cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb659c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbb8159ee0 0x7fbbb80cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53198/0 (socket says 172.21.15.81:53198) 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb659c700 1 -- 172.21.15.81:0/483769655 learned_addr learned my addr 172.21.15.81:0/483769655 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb6d9d700 1 --2- 172.21.15.81:0/483769655 >> v2:172.21.15.176:3300/0 conn(0x7fbbb80b4d10 0x7fbbb80cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb659c700 1 -- 172.21.15.81:0/483769655 >> v2:172.21.15.176:3300/0 conn(0x7fbbb80b4d10 msgr2=0x7fbbb80cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb659c700 1 --2- 172.21.15.81:0/483769655 >> v2:172.21.15.176:3300/0 conn(0x7fbbb80b4d10 0x7fbbb80cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb659c700 1 -- 172.21.15.81:0/483769655 >> v1:172.21.15.176:6789/0 conn(0x7fbbb815a2b0 legacy=0x7fbbb80b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb659c700 1 -- 172.21.15.81:0/483769655 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb806a170 con 0x7fbbb8159ee0 2023-11-29T11:23:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb659c700 1 --2- 172.21.15.81:0/483769655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb8159ee0 0x7fbbb80cd1d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80c9c00 tx=0x7fbba0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1d852cbbaee480 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb559a700 1 -- 172.21.15.81:0/483769655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0011830 con 0x7fbbb8159ee0 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb559a700 1 -- 172.21.15.81:0/483769655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba0011990 con 0x7fbbb8159ee0 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbb559a700 1 -- 172.21.15.81:0/483769655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0011d20 con 0x7fbbb8159ee0 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/483769655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb8159ee0 msgr2=0x7fbbb80cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/483769655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb8159ee0 0x7fbbb80cd1d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80c9c00 tx=0x7fbba0009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/483769655 shutdown_connections 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/483769655 >> v2:172.21.15.176:3300/0 conn(0x7fbbb80b4d10 0x7fbbb80cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/483769655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb8159ee0 0x7fbbb80cd1d0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/483769655 >> 172.21.15.81:0/483769655 conn(0x7fbbb806cb60 msgr2=0x7fbbb80cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/483769655 shutdown_connections 2023-11-29T11:23:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.369+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/483769655 wait complete. 2023-11-29T11:23:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbbcdaa700 1 Processor -- start 2023-11-29T11:23:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbbcdaa700 1 -- start start 2023-11-29T11:23:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbbcdaa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80b4d10 0x7fbbb80ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbbcdaa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb8159ee0 0x7fbbb80d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbbcdaa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb815a2b0 0x7fbbb80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbbcdaa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80cc670 con 0x7fbbb815a2b0 2023-11-29T11:23:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbbcdaa700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb815b5a0 con 0x7fbbb8159ee0 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbbcdaa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb81f26b0 con 0x7fbbb80b4d10 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbb6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb815a2b0 0x7fbbb80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbb6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb815a2b0 0x7fbbb80d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53210/0 (socket says 172.21.15.81:53210) 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbb6d9d700 1 -- 172.21.15.81:0/2650010215 learned_addr learned my addr 172.21.15.81:0/2650010215 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbb659c700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80b4d10 0x7fbbb80ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.373+0000 7fbbb5d9b700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb8159ee0 0x7fbbb80d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb6d9d700 1 -- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80b4d10 msgr2=0x7fbbb80ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb6d9d700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80b4d10 0x7fbbb80ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb6d9d700 1 -- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb8159ee0 msgr2=0x7fbbb80d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb6d9d700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb8159ee0 0x7fbbb80d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb6d9d700 1 -- 172.21.15.81:0/2650010215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba0009570 con 0x7fbbb815a2b0 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb659c700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80b4d10 0x7fbbb80ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb5d9b700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb8159ee0 0x7fbbb80d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb6d9d700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb815a2b0 0x7fbbb80d1170 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000efc0 tx=0x7fbbb000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbaeffd700 1 -- 172.21.15.81:0/2650010215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0009b20 con 0x7fbbb815a2b0 2023-11-29T11:23:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbaeffd700 1 -- 172.21.15.81:0/2650010215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb000f040 con 0x7fbbb815a2b0 2023-11-29T11:23:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbaeffd700 1 -- 172.21.15.81:0/2650010215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0009e50 con 0x7fbbb815a2b0 2023-11-29T11:23:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb806a730 con 0x7fbbb815a2b0 2023-11-29T11:23:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb806a450 con 0x7fbbb815a2b0 2023-11-29T11:23:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb806ac50 con 0x7fbbb815a2b0 2023-11-29T11:23:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbaeffd700 1 -- 172.21.15.81:0/2650010215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbbb0014480 con 0x7fbbb815a2b0 2023-11-29T11:23:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbaeffd700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb98064ee0 0x7fbb98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbb659c700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb98064ee0 0x7fbb98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.377+0000 7fbbaeffd700 1 -- 172.21.15.81:0/2650010215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6612+0+0 (secure 0 0 0) 0x7fbbb0082da0 con 0x7fbbb815a2b0 2023-11-29T11:23:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.381+0000 7fbbb659c700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb98064ee0 0x7fbb98067390 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000c00 tx=0x7fbba0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.385+0000 7fbbaeffd700 1 -- 172.21.15.81:0/2650010215 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbbb0050cb0 con 0x7fbbb815a2b0 2023-11-29T11:23:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:23.545+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbbb8072500 con 0x7fbbb815a2b0 2023-11-29T11:23:24.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.225+0000 7fbbaeffd700 1 -- 172.21.15.81:0/2650010215 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbbb00180d0 con 0x7fbbb815a2b0 2023-11-29T11:23:24.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb98064ee0 msgr2=0x7fbb98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:24.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb98064ee0 0x7fbb98067390 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000c00 tx=0x7fbba0008030 comp rx=0 tx=0).stop 2023-11-29T11:23:24.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb815a2b0 msgr2=0x7fbbb80d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:24.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb815a2b0 0x7fbbb80d1170 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000efc0 tx=0x7fbbb000c3a0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 shutdown_connections 2023-11-29T11:23:24.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fbb98064ee0 0x7fbb98067390 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb815a2b0 0x7fbbb80d1170 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbb8159ee0 0x7fbbb80d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 --2- 172.21.15.81:0/2650010215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbb80b4d10 0x7fbbb80ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 >> 172.21.15.81:0/2650010215 conn(0x7fbbb806cb60 msgr2=0x7fbbb80c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:24.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 shutdown_connections 2023-11-29T11:23:24.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.233+0000 7fbbbcdaa700 1 -- 172.21.15.81:0/2650010215 wait complete. 2023-11-29T11:23:24.244 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-11-29T11:23:24.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T11:23:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.365+0000 7f1a0b1a9700 1 Processor -- start 2023-11-29T11:23:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.365+0000 7f1a0b1a9700 1 -- start start 2023-11-29T11:23:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0b1a9700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a0415a110 0x7f1a0415e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0b1a9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 0x7f1a040cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0b1a9700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a040cb470 con 0x7f1a040b1c90 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0b1a9700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0415ebf0 con 0x7f1a0415a110 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0b1a9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0406bdf0 con 0x7f1a04069c40 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0a1a7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a0415a110 0x7f1a0415e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0a1a7700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a0415a110 0x7f1a0415e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53224/0 (socket says 172.21.15.81:53224) 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0a1a7700 1 -- 172.21.15.81:0/925042162 learned_addr learned my addr 172.21.15.81:0/925042162 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a099a6700 1 --2- 172.21.15.81:0/925042162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 0x7f1a040cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0a1a7700 1 -- 172.21.15.81:0/925042162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 msgr2=0x7f1a040cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0a1a7700 1 --2- 172.21.15.81:0/925042162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 0x7f1a040cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0a1a7700 1 -- 172.21.15.81:0/925042162 >> v1:172.21.15.176:6789/0 conn(0x7f1a040b1c90 legacy=0x7f1a040cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0a1a7700 1 -- 172.21.15.81:0/925042162 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0415a4e0 con 0x7f1a0415a110 2023-11-29T11:23:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0a1a7700 1 --2- 172.21.15.81:0/925042162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0415a110 0x7f1a0415e6b0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009910 tx=0x7f1a00009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a271b7cf2607d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a091a5700 1 -- 172.21.15.81:0/925042162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0000ba60 con 0x7f1a0415a110 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a091a5700 1 -- 172.21.15.81:0/925042162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0000bbc0 con 0x7f1a0415a110 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a091a5700 1 -- 172.21.15.81:0/925042162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00009e60 con 0x7f1a0415a110 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/925042162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0415a110 msgr2=0x7f1a0415e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.369+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/925042162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0415a110 0x7f1a0415e6b0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009910 tx=0x7f1a00009c20 comp rx=0 tx=0).stop 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/925042162 shutdown_connections 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/925042162 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 0x7f1a040cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/925042162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a0415a110 0x7f1a0415e6b0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/925042162 >> 172.21.15.81:0/925042162 conn(0x7f1a0406c6b0 msgr2=0x7f1a0406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/925042162 shutdown_connections 2023-11-29T11:23:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/925042162 wait complete. 2023-11-29T11:23:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 Processor -- start 2023-11-29T11:23:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- start start 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 0x7f1a041f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a040b1c90 0x7f1a0414c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a0415a110 0x7f1a040c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0414c880 con 0x7f1a040b1c90 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041f1bd0 con 0x7f1a0415a110 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041f5690 con 0x7f1a04069c40 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a040b1c90 0x7f1a0414c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a040b1c90 0x7f1a0414c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53238/0 (socket says 172.21.15.81:53238) 2023-11-29T11:23:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 -- 172.21.15.81:0/608866620 learned_addr learned my addr 172.21.15.81:0/608866620 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:24.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0a9a8700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a0415a110 0x7f1a040c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:24.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0a1a7700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 0x7f1a041f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 -- 172.21.15.81:0/608866620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 msgr2=0x7f1a041f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 0x7f1a041f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 -- 172.21.15.81:0/608866620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a0415a110 msgr2=0x7f1a040c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a0415a110 0x7f1a040c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 -- 172.21.15.81:0/608866620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00009570 con 0x7f1a040b1c90 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a099a6700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a040b1c90 0x7f1a0414c340 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f19f400d800 tx=0x7f19f400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f19faffd700 1 -- 172.21.15.81:0/608866620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40125f0 con 0x7f1a040b1c90 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f19faffd700 1 -- 172.21.15.81:0/608866620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4012750 con 0x7f1a040b1c90 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0406bb10 con 0x7f1a040b1c90 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f19faffd700 1 -- 172.21.15.81:0/608866620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4012b00 con 0x7f1a040b1c90 2023-11-29T11:23:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.373+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0406a0d0 con 0x7f1a040b1c90 2023-11-29T11:23:24.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.377+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a040676e0 con 0x7f1a040b1c90 2023-11-29T11:23:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.377+0000 7f19faffd700 1 -- 172.21.15.81:0/608866620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f19f4012c60 con 0x7f1a040b1c90 2023-11-29T11:23:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.377+0000 7f19faffd700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f19e8064ee0 0x7f19e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.377+0000 7f19faffd700 1 -- 172.21.15.81:0/608866620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f19f40821d0 con 0x7f1a040b1c90 2023-11-29T11:23:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.377+0000 7f1a0a1a7700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f19e8064ee0 0x7f19e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.381+0000 7f1a0a1a7700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f19e8064ee0 0x7f19e8067390 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1a00000c00 tx=0x7f1a00008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.385+0000 7f19faffd700 1 -- 172.21.15.81:0/608866620 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f19f4050210 con 0x7f1a040b1c90 2023-11-29T11:23:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:24.545+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a04072c20 con 0x7f1a040b1c90 2023-11-29T11:23:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.241+0000 7f19faffd700 1 -- 172.21.15.81:0/608866620 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) v1 ==== 169+0+0 (secure 0 0 0) 0x7f19f4053830 con 0x7f1a040b1c90 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f19e8064ee0 msgr2=0x7f19e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f19e8064ee0 0x7f19e8067390 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1a00000c00 tx=0x7f1a00008030 comp rx=0 tx=0).stop 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a040b1c90 msgr2=0x7f1a0414c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a040b1c90 0x7f1a0414c340 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f19f400d800 tx=0x7f19f400db10 comp rx=0 tx=0).stop 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 shutdown_connections 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f19e8064ee0 0x7f19e8067390 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a0415a110 0x7f1a040c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a040b1c90 0x7f1a0414c340 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 --2- 172.21.15.81:0/608866620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a04069c40 0x7f1a041f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 >> 172.21.15.81:0/608866620 conn(0x7f1a0406c6b0 msgr2=0x7f1a040cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:25.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 shutdown_connections 2023-11-29T11:23:25.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.249+0000 7f1a0b1a9700 1 -- 172.21.15.81:0/608866620 wait complete. 2023-11-29T11:23:25.269 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-11-29T11:23:25.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-29T11:23:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe46def6700 1 Processor -- start 2023-11-29T11:23:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe46def6700 1 -- start start 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe46def6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe468160ac0 0x7fe4680b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe46def6700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe4680cd1c0 0x7fe4680b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe46def6700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4680d0740 con 0x7fe4680b45f0 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe46def6700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680b4f00 con 0x7fe4680cd1c0 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe46def6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680d0990 con 0x7fe468160ac0 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe4677fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe4680b45f0 0x7fe4680d1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38120/0 (socket says 172.21.15.81:38120) 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe4677fe700 1 -- 172.21.15.81:0/2559949642 learned_addr learned my addr 172.21.15.81:0/2559949642 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe45ffff700 1 --2- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe468160ac0 0x7fe4680b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe467fff700 1 --2- 172.21.15.81:0/2559949642 >> v2:172.21.15.176:3300/0 conn(0x7fe4680cd1c0 0x7fe4680b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe466ffd700 1 -- 172.21.15.81:0/2559949642 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585188746 0 0) 0x7fe4680d0740 con 0x7fe4680b45f0 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe466ffd700 1 -- 172.21.15.81:0/2559949642 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4540035d0 con 0x7fe4680b45f0 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe467fff700 1 -- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe468160ac0 msgr2=0x7fe4680b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe467fff700 1 --2- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe468160ac0 0x7fe4680b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe467fff700 1 -- 172.21.15.81:0/2559949642 >> v1:172.21.15.81:6789/0 conn(0x7fe4680b45f0 legacy=0x7fe4680d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe467fff700 1 -- 172.21.15.81:0/2559949642 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4680d0c70 con 0x7fe4680cd1c0 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe45ffff700 1 --2- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe468160ac0 0x7fe4680b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.385+0000 7fe467fff700 1 --2- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680cd1c0 0x7fe4680b59c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe460009d90 tx=0x7fe46000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ce29ffc5199c1c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe466ffd700 1 -- 172.21.15.81:0/2559949642 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000e070 con 0x7fe4680cd1c0 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe466ffd700 1 -- 172.21.15.81:0/2559949642 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000bb20 con 0x7fe4680cd1c0 2023-11-29T11:23:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe466ffd700 1 -- 172.21.15.81:0/2559949642 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460012430 con 0x7fe4680cd1c0 2023-11-29T11:23:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 -- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680cd1c0 msgr2=0x7fe4680b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 --2- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680cd1c0 0x7fe4680b59c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe460009d90 tx=0x7fe46000b330 comp rx=0 tx=0).stop 2023-11-29T11:23:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 -- 172.21.15.81:0/2559949642 shutdown_connections 2023-11-29T11:23:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 --2- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680cd1c0 0x7fe4680b59c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 --2- 172.21.15.81:0/2559949642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe468160ac0 0x7fe4680b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 -- 172.21.15.81:0/2559949642 >> 172.21.15.81:0/2559949642 conn(0x7fe46806cb40 msgr2=0x7fe4680cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 -- 172.21.15.81:0/2559949642 shutdown_connections 2023-11-29T11:23:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 -- 172.21.15.81:0/2559949642 wait complete. 2023-11-29T11:23:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 Processor -- start 2023-11-29T11:23:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.389+0000 7fe46def6700 1 -- start start 2023-11-29T11:23:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680b45f0 0x7fe4680c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4680cd1c0 0x7fe4680b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe468160ac0 0x7fe4680b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c8c50 con 0x7fe468160ac0 2023-11-29T11:23:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c90e0 con 0x7fe4680b45f0 2023-11-29T11:23:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c8040 con 0x7fe4680cd1c0 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe468160ac0 0x7fe4680b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe468160ac0 0x7fe4680b8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53240/0 (socket says 172.21.15.81:53240) 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 -- 172.21.15.81:0/3152496245 learned_addr learned my addr 172.21.15.81:0/3152496245 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe4677fe700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680b45f0 0x7fe4680c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe45ffff700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4680cd1c0 0x7fe4680b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 -- 172.21.15.81:0/3152496245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4680cd1c0 msgr2=0x7fe4680b7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4680cd1c0 0x7fe4680b7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 -- 172.21.15.81:0/3152496245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680b45f0 msgr2=0x7fe4680c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680b45f0 0x7fe4680c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 -- 172.21.15.81:0/3152496245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4500094b0 con 0x7fe468160ac0 2023-11-29T11:23:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe467fff700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe468160ac0 0x7fe4680b8460 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fe460014040 tx=0x7fe460004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe464ff9700 1 -- 172.21.15.81:0/3152496245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600048b0 con 0x7fe468160ac0 2023-11-29T11:23:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe464ff9700 1 -- 172.21.15.81:0/3152496245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460020070 con 0x7fe468160ac0 2023-11-29T11:23:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe464ff9700 1 -- 172.21.15.81:0/3152496245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600276c0 con 0x7fe468160ac0 2023-11-29T11:23:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe460009a70 con 0x7fe468160ac0 2023-11-29T11:23:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4680d1230 con 0x7fe468160ac0 2023-11-29T11:23:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.393+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4680d0f50 con 0x7fe468160ac0 2023-11-29T11:23:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.397+0000 7fe464ff9700 1 -- 172.21.15.81:0/3152496245 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe46002e070 con 0x7fe468160ac0 2023-11-29T11:23:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.397+0000 7fe464ff9700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe448064ee0 0x7fe448067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.397+0000 7fe464ff9700 1 -- 172.21.15.81:0/3152496245 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fe460022070 con 0x7fe468160ac0 2023-11-29T11:23:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.397+0000 7fe4677fe700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe448064ee0 0x7fe448067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.397+0000 7fe4677fe700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe448064ee0 0x7fe448067390 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe458007fd0 tx=0x7fe458007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:25.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.401+0000 7fe464ff9700 1 -- 172.21.15.81:0/3152496245 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe4600522a0 con 0x7fe468160ac0 2023-11-29T11:23:25.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.557+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe46815c660 con 0x7fe468160ac0 2023-11-29T11:23:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe464ff9700 1 -- 172.21.15.81:0/3152496245 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe46002c0a0 con 0x7fe468160ac0 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe448064ee0 msgr2=0x7fe448067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe448064ee0 0x7fe448067390 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe458007fd0 tx=0x7fe458007de0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe468160ac0 msgr2=0x7fe4680b8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe468160ac0 0x7fe4680b8460 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fe460014040 tx=0x7fe460004af0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 shutdown_connections 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe448064ee0 0x7fe448067390 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe468160ac0 0x7fe4680b8460 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4680cd1c0 0x7fe4680b7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 --2- 172.21.15.81:0/3152496245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4680b45f0 0x7fe4680c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 >> 172.21.15.81:0/3152496245 conn(0x7fe46806cb40 msgr2=0x7fe4680cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 shutdown_connections 2023-11-29T11:23:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.569+0000 7fe46def6700 1 -- 172.21.15.81:0/3152496245 wait complete. 2023-11-29T11:23:25.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2023-11-29T11:23:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f7524892700 1 Processor -- start 2023-11-29T11:23:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f7524892700 1 -- start start 2023-11-29T11:23:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f7524892700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75200cb470 0x7f7520164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f7524892700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752006ace0 con 0x7f7520069c40 2023-11-29T11:23:25.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f7524892700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752006a0d0 con 0x7f7520159e70 2023-11-29T11:23:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f7524892700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752006a3b0 con 0x7f75200cb470 2023-11-29T11:23:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f751f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75200cb470 0x7f7520164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f751e59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7520069c40 0x7f75200cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38130/0 (socket says 172.21.15.81:38130) 2023-11-29T11:23:25.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f751e59c700 1 -- 172.21.15.81:0/2822250652 learned_addr learned my addr 172.21.15.81:0/2822250652 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f751f59e700 1 -- 172.21.15.81:0/2822250652 >> v1:172.21.15.176:6789/0 conn(0x7f7520159e70 legacy=0x7f752006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f751f59e700 1 -- 172.21.15.81:0/2822250652 >> v1:172.21.15.81:6789/0 conn(0x7f7520069c40 legacy=0x7f75200cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f751f59e700 1 -- 172.21.15.81:0/2822250652 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752006a690 con 0x7f75200cb470 2023-11-29T11:23:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f751f59e700 1 --2- 172.21.15.81:0/2822250652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75200cb470 0x7f7520164a20 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f7518009d90 tx=0x7f751800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a4aabc66fb9b04 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.693+0000 7f751dd9b700 1 -- 172.21.15.81:0/2822250652 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800e070 con 0x7f75200cb470 2023-11-29T11:23:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751dd9b700 1 -- 172.21.15.81:0/2822250652 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751800bb90 con 0x7f75200cb470 2023-11-29T11:23:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751dd9b700 1 -- 172.21.15.81:0/2822250652 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518003a40 con 0x7f75200cb470 2023-11-29T11:23:25.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- 172.21.15.81:0/2822250652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75200cb470 msgr2=0x7f7520164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 --2- 172.21.15.81:0/2822250652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75200cb470 0x7f7520164a20 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f7518009d90 tx=0x7f751800b330 comp rx=0 tx=0).stop 2023-11-29T11:23:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- 172.21.15.81:0/2822250652 shutdown_connections 2023-11-29T11:23:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 --2- 172.21.15.81:0/2822250652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75200cb470 0x7f7520164a20 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- 172.21.15.81:0/2822250652 >> 172.21.15.81:0/2822250652 conn(0x7f75200ce3e0 msgr2=0x7f75200ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- 172.21.15.81:0/2822250652 shutdown_connections 2023-11-29T11:23:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- 172.21.15.81:0/2822250652 wait complete. 2023-11-29T11:23:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 Processor -- start 2023-11-29T11:23:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- start start 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7520069c40 0x7f7520153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75200cb470 0x7f75200c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520159e70 0x7f75201e6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75200c4940 con 0x7f7520069c40 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75200cd070 con 0x7f75200cb470 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f7524892700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75200cd310 con 0x7f7520159e70 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7520069c40 0x7f7520153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7520069c40 0x7f7520153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53264/0 (socket says 172.21.15.81:53264) 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 -- 172.21.15.81:0/2522777937 learned_addr learned my addr 172.21.15.81:0/2522777937 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751f59e700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520159e70 0x7f75201e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751e59c700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75200cb470 0x7f75200c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 -- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520159e70 msgr2=0x7f75201e6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520159e70 0x7f75201e6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 -- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75200cb470 msgr2=0x7f75200c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:25.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75200cb470 0x7f75200c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 -- 172.21.15.81:0/2522777937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518009a70 con 0x7f7520069c40 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751e59c700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75200cb470 0x7f75200c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f751ed9d700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7520069c40 0x7f7520153250 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f750800b4a0 tx=0x7f750800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.697+0000 7f75177fe700 1 -- 172.21.15.81:0/2522777937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508011830 con 0x7f7520069c40 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f75177fe700 1 -- 172.21.15.81:0/2522777937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7508011990 con 0x7f7520069c40 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752006d0b0 con 0x7f7520069c40 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f75177fe700 1 -- 172.21.15.81:0/2522777937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508011d40 con 0x7f7520069c40 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752006a970 con 0x7f7520069c40 2023-11-29T11:23:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752015a240 con 0x7f7520069c40 2023-11-29T11:23:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f75177fe700 1 -- 172.21.15.81:0/2522777937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f750800f050 con 0x7f7520069c40 2023-11-29T11:23:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f75177fe700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7500064f10 0x7f75000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f75177fe700 1 -- 172.21.15.81:0/2522777937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f7508081930 con 0x7f7520069c40 2023-11-29T11:23:25.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f751e59c700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7500064f10 0x7f75000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:25.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.701+0000 7f751e59c700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7500064f10 0x7f75000673c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f75200c4580 tx=0x7f7510009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.709+0000 7f75177fe700 1 -- 172.21.15.81:0/2522777937 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f750804fbb0 con 0x7f7520069c40 2023-11-29T11:23:25.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:25.929+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f75200adb60 con 0x7f7520069c40 2023-11-29T11:23:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.241+0000 7f75177fe700 1 -- 172.21.15.81:0/2522777937 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v480) v1 ==== 146+0+0 (secure 0 0 0) 0x7f75080531d0 con 0x7f7520069c40 2023-11-29T11:23:26.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7500064f10 msgr2=0x7f75000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7500064f10 0x7f75000673c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f75200c4580 tx=0x7f7510009040 comp rx=0 tx=0).stop 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7520069c40 msgr2=0x7f7520153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7520069c40 0x7f7520153250 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f750800b4a0 tx=0x7f750800b860 comp rx=0 tx=0).stop 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 shutdown_connections 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f7500064f10 0x7f75000673c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520159e70 0x7f75201e6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75200cb470 0x7f75200c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 --2- 172.21.15.81:0/2522777937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7520069c40 0x7f7520153250 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 >> 172.21.15.81:0/2522777937 conn(0x7f75200ce3e0 msgr2=0x7f7520159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 shutdown_connections 2023-11-29T11:23:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:26.245+0000 7f7524892700 1 -- 172.21.15.81:0/2522777937 wait complete. 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ERROR 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner: 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner:ERROR: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks/cephfs/test_forward_scrub.py", line 260, in test_inotable_sync 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2023-11-29T11:23:26.271 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks/cephfs/filesystem.py", line 1143, in wait_for_daemons 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks/cephfs/filesystem.py", line 987, in are_daemons_healthy 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: mds.check_status() 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/daemon/state.py", line 43, in check_status 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 211, in poll 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner:Ran 6 tests in 584.649s 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner: 2023-11-29T11:23:26.272 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner:ERROR: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks/cephfs/test_forward_scrub.py", line 260, in test_inotable_sync 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks/cephfs/filesystem.py", line 1143, in wait_for_daemons 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks/cephfs/filesystem.py", line 987, in are_daemons_healthy 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: mds.check_status() 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/daemon/state.py", line 43, in check_status 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 211, in poll 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-29T11:23:26.273 INFO:tasks.cephfs_test_runner: 2023-11-29T11:23:26.274 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:23:26.374 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2baa0498f9cf4ebc915a57e72a4b77f8 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_7f0cf0b7a2d94dd2189de4bef5865b024f3c7d4b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-29T11:23:26.376 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-29T11:23:26.385 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-29T11:23:26.487 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-29T11:23:26.487 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:23:26.487 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:23:26.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:23:26.509 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-29T11:23:26.509 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:23:26.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346332k,nr_inodes=4086583,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14838 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275496k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275500k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T11:23:26.556 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:23:26.557 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:23:26.564 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:23:26.565 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-29T11:23:26.565 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T11:23:26.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346356k,nr_inodes=4086589,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275500k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275504k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T11:23:26.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:26.572 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-11-29T11:23:26.579 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T11:23:26.579 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T11:23:26.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:26.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T11:23:26.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:26.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T11:23:26.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:26.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-11-29T11:23:26.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:26.813 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-29T11:23:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-29T11:23:26.820 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-29T11:23:26.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:26.821 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-29T11:23:26.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:26.837 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-29T11:23:26.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T11:23:26.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-29T11:23:27.013 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-29T11:23:27.022 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-29T11:23:27.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:23:27.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:27.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:27.145 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.137+0000 7f9db8bf1700 1 Processor -- start 2023-11-29T11:23:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.137+0000 7f9db8bf1700 1 -- start start 2023-11-29T11:23:27.148 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db8bf1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db8bf1700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9db40b3030 0x7f9db406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db8bf1700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db4152f80 con 0x7f9db406c640 2023-11-29T11:23:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db8bf1700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db406cff0 con 0x7f9db40b3030 2023-11-29T11:23:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db8bf1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db415cfe0 con 0x7f9db4152bb0 2023-11-29T11:23:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db2ffd700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9db406c640 0x7f9db40706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38136/0 (socket says 172.21.15.81:38136) 2023-11-29T11:23:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db2ffd700 1 -- 172.21.15.81:0/420427750 learned_addr learned my addr 172.21.15.81:0/420427750 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db3fff700 1 --2- 172.21.15.81:0/420427750 >> v2:172.21.15.81:3300/0 conn(0x7f9db40b3030 0x7f9db406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db37fe700 1 --2- 172.21.15.81:0/420427750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db415caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db27fc700 1 -- 172.21.15.81:0/420427750 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795229519 0 0) 0x7f9db4152f80 con 0x7f9db406c640 2023-11-29T11:23:27.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db27fc700 1 -- 172.21.15.81:0/420427750 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d9c0035d0 con 0x7f9db406c640 2023-11-29T11:23:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db3fff700 1 -- 172.21.15.81:0/420427750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 msgr2=0x7f9db415caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db3fff700 1 --2- 172.21.15.81:0/420427750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db415caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db27fc700 1 -- 172.21.15.81:0/420427750 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 977910349 0 0) 0x7f9d9c0035d0 con 0x7f9db406c640 2023-11-29T11:23:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db3fff700 1 -- 172.21.15.81:0/420427750 >> v1:172.21.15.81:6789/0 conn(0x7f9db406c640 legacy=0x7f9db40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db3fff700 1 -- 172.21.15.81:0/420427750 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4159a30 con 0x7f9db40b3030 2023-11-29T11:23:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db3fff700 1 --2- 172.21.15.81:0/420427750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db40b3030 0x7f9db406cab0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00aea0 tx=0x7f9dac00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896190cf2350214c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db27fc700 1 -- 172.21.15.81:0/420427750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00f070 con 0x7f9db40b3030 2023-11-29T11:23:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db27fc700 1 -- 172.21.15.81:0/420427750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac003a40 con 0x7f9db40b3030 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.141+0000 7f9db27fc700 1 -- 172.21.15.81:0/420427750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8001670 con 0x7f9db40b3030 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 -- 172.21.15.81:0/420427750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db40b3030 msgr2=0x7f9db406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/420427750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db40b3030 0x7f9db406cab0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00aea0 tx=0x7f9dac00c330 comp rx=0 tx=0).stop 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 -- 172.21.15.81:0/420427750 shutdown_connections 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/420427750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db40b3030 0x7f9db406cab0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/420427750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 -- 172.21.15.81:0/420427750 >> 172.21.15.81:0/420427750 conn(0x7f9db406e000 msgr2=0x7f9db40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 -- 172.21.15.81:0/420427750 shutdown_connections 2023-11-29T11:23:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 -- 172.21.15.81:0/420427750 wait complete. 2023-11-29T11:23:27.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.145+0000 7f9db8bf1700 1 Processor -- start 2023-11-29T11:23:27.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 -- start start 2023-11-29T11:23:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db406c640 0x7f9db4148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9db40b3030 0x7f9db40cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db41e6b60 con 0x7f9db406c640 2023-11-29T11:23:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db414b180 con 0x7f9db40b3030 2023-11-29T11:23:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db414a570 con 0x7f9db4152bb0 2023-11-29T11:23:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db406c640 0x7f9db4148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db406c640 0x7f9db4148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53292/0 (socket says 172.21.15.81:53292) 2023-11-29T11:23:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 -- 172.21.15.81:0/504826036 learned_addr learned my addr 172.21.15.81:0/504826036 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db2ffd700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9db40b3030 0x7f9db40cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db3fff700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 -- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 msgr2=0x7f9db414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db414dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 -- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9db40b3030 msgr2=0x7f9db40cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9db40b3030 0x7f9db40cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 -- 172.21.15.81:0/504826036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac00ab80 con 0x7f9db406c640 2023-11-29T11:23:27.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db3fff700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:27.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db37fe700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db406c640 0x7f9db4148410 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f9da400e9d0 tx=0x7f9da400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9d9bfff700 1 -- 172.21.15.81:0/504826036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4009720 con 0x7f9db406c640 2023-11-29T11:23:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9d9bfff700 1 -- 172.21.15.81:0/504826036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da400c850 con 0x7f9db406c640 2023-11-29T11:23:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db4159190 con 0x7f9db406c640 2023-11-29T11:23:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9d9bfff700 1 -- 172.21.15.81:0/504826036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400cbc0 con 0x7f9db406c640 2023-11-29T11:23:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.149+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db4158eb0 con 0x7f9db406c640 2023-11-29T11:23:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.153+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d94005310 con 0x7f9db406c640 2023-11-29T11:23:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.153+0000 7f9d9bfff700 1 -- 172.21.15.81:0/504826036 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9da4019030 con 0x7f9db406c640 2023-11-29T11:23:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.153+0000 7f9d9bfff700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9da0064f10 0x7f9da00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.153+0000 7f9db2ffd700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9da0064f10 0x7f9da00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.153+0000 7f9d9bfff700 1 -- 172.21.15.81:0/504826036 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9da4081ca0 con 0x7f9db406c640 2023-11-29T11:23:27.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.153+0000 7f9db2ffd700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9da0064f10 0x7f9da00673c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9db41f50d0 tx=0x7f9da8001e00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.161+0000 7f9d9bfff700 1 -- 172.21.15.81:0/504826036 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9da4086070 con 0x7f9db406c640 2023-11-29T11:23:27.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.321+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d94000bc0 con 0x7f9da0064f10 2023-11-29T11:23:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9d9bfff700 1 -- 172.21.15.81:0/504826036 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71861 (secure 0 0 0) 0x7f9d94000bc0 con 0x7f9da0064f10 2023-11-29T11:23:27.332 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9da0064f10 msgr2=0x7f9da00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9da0064f10 0x7f9da00673c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9db41f50d0 tx=0x7f9da8001e00 comp rx=0 tx=0).stop 2023-11-29T11:23:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db406c640 msgr2=0x7f9db4148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db406c640 0x7f9db4148410 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f9da400e9d0 tx=0x7f9da400ece0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 shutdown_connections 2023-11-29T11:23:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9da0064f10 0x7f9da00673c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db4152bb0 0x7f9db414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9db40b3030 0x7f9db40cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 --2- 172.21.15.81:0/504826036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db406c640 0x7f9db4148410 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 >> 172.21.15.81:0/504826036 conn(0x7f9db406e000 msgr2=0x7f9db406aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 shutdown_connections 2023-11-29T11:23:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.325+0000 7f9db8bf1700 1 -- 172.21.15.81:0/504826036 wait complete. 2023-11-29T11:23:27.336 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:23:27.346 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2023-11-29T11:23:26.649646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":151620,"kb_used_data":34820,"kb_used_omap":0,"kb_used_meta":116736,"kb_avail":754823100,"statfs":{"total":773094113280,"available":772938854400,"internally_reserved":0,"allocated":35655680,"data_stored":29778124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":119537664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18900774,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-27,"num_read_kb":-24,"num_write":-103,"num_write_kb":-18493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001980"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":97,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.415106+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:23:24.415106+0000","last_peered":"2023-11-29T11:23:24.415106+0000","last_clean":"2023-11-29T11:23:24.415106+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:23:24.415106+0000","last_undegraded":"2023-11-29T11:23:24.415106+0000","last_fullsized":"2023-11-29T11:23:24.415106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":98,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.416431+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:23:24.416431+0000","last_peered":"2023-11-29T11:23:24.416431+0000","last_clean":"2023-11-29T11:23:24.416431+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:23:24.416431+0000","last_undegraded":"2023-11-29T11:23:24.416431+0000","last_fullsized":"2023-11-29T11:23:24.416431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896061+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:23:21.896061+0000","last_peered":"2023-11-29T11:23:21.896061+0000","last_clean":"2023-11-29T11:23:21.896061+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:23:21.896061+0000","last_undegraded":"2023-11-29T11:23:21.896061+0000","last_fullsized":"2023-11-29T11:23:21.896061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":102,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.234852+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:23:24.234852+0000","last_peered":"2023-11-29T11:23:24.234852+0000","last_clean":"2023-11-29T11:23:24.234852+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:23:24.234852+0000","last_undegraded":"2023-11-29T11:23:24.234852+0000","last_fullsized":"2023-11-29T11:23:24.234852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":251,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896754+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:23:21.896754+0000","last_peered":"2023-11-29T11:23:21.896754+0000","last_clean":"2023-11-29T11:23:21.896754+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:23:21.896754+0000","last_undegraded":"2023-11-29T11:23:21.896754+0000","last_fullsized":"2023-11-29T11:23:21.896754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":100,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.318659+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:23:21.318659+0000","last_peered":"2023-11-29T11:23:21.318659+0000","last_clean":"2023-11-29T11:23:21.318659+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:23:21.318659+0000","last_undegraded":"2023-11-29T11:23:21.318659+0000","last_fullsized":"2023-11-29T11:23:21.318659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.897488+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:23:21.897488+0000","last_peered":"2023-11-29T11:23:21.897488+0000","last_clean":"2023-11-29T11:23:21.897488+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:23:21.897488+0000","last_undegraded":"2023-11-29T11:23:21.897488+0000","last_fullsized":"2023-11-29T11:23:21.897488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.229027+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:23:24.229027+0000","last_peered":"2023-11-29T11:23:24.229027+0000","last_clean":"2023-11-29T11:23:24.229027+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:23:24.229027+0000","last_undegraded":"2023-11-29T11:23:24.229027+0000","last_fullsized":"2023-11-29T11:23:24.229027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896810+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:23:21.896810+0000","last_peered":"2023-11-29T11:23:21.896810+0000","last_clean":"2023-11-29T11:23:21.896810+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:23:21.896810+0000","last_undegraded":"2023-11-29T11:23:21.896810+0000","last_fullsized":"2023-11-29T11:23:21.896810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542274,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22900,"kb_used_data":8108,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94348940,"statfs":{"total":96636764160,"available":96613314560,"internally_reserved":0,"allocated":8302592,"data_stored":7567658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.63200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1890000000000001,"5min":1.272,"15min":1.5629999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.327},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86699999999999999,"15min":0.89400000000000002},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1120000000000001,"5min":1.242,"15min":2.1360000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.876},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":3.0449999999999999},"last":1.1890000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.94999999999999996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.151,"5min":1.2949999999999999,"15min":1.8009999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53900000000000003},"max":{"1min":1.1890000000000001,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.71599999999999997,"5min":0.58299999999999996,"15min":0.38100000000000001},"max":{"1min":1.139,"5min":1.294,"15min":1.667},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92200000000000004,"15min":0.94899999999999995},"min":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.58299999999999996},"max":{"1min":1.131,"5min":1.2290000000000001,"15min":1.4510000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.91100000000000003},"min":{"1min":0.65100000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.113,"5min":1.24,"15min":1.446},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.01,"15min":1.046},"min":{"1min":0.92000000000000004,"5min":0.63700000000000001,"15min":0.33800000000000002},"max":{"1min":1.341,"5min":1.389,"15min":1.736},"last":1.1120000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93799999999999994,"15min":1.036},"min":{"1min":0.63,"5min":0.60299999999999998,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3100000000000001,"15min":2.403},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.0169999999999999,"15min":1.079},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2789999999999999,"5min":1.4470000000000001,"15min":1.53},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.052,"15min":1.113},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2430000000000001,"5min":1.375,"15min":1.7230000000000001},"last":1.034},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1160000000000001,"15min":1.161},"min":{"1min":0.93899999999999995,"5min":0.72099999999999997,"15min":0.44500000000000001},"max":{"1min":1.296,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.1619999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542275,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19832,"kb_used_data":5488,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94352008,"statfs":{"total":96636764160,"available":96616456192,"internally_reserved":0,"allocated":5619712,"data_stored":4886416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85299999999999998,"15min":0.83199999999999996},"min":{"1min":0.60499999999999998,"5min":0.57599999999999996,"15min":0.44400000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84799999999999998},"min":{"1min":0.56899999999999995,"5min":0.53200000000000003,"15min":0.375},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":7.7910000000000004},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.284,"15min":1.4510000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.034,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.83099999999999996,"5min":0.58499999999999996,"15min":0.50800000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":7.8479999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.66700000000000004,"5min":0.56399999999999995,"15min":0.49099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.369},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.90600000000000003},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.40500000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":2.7069999999999999},"last":1.353}]},{"osd":3,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92100000000000004,"15min":0.94199999999999995},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.675,"5min":1.675,"15min":7.923},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94099999999999995,"15min":0.93400000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.48099999999999998},"max":{"1min":1.2410000000000001,"5min":1.304,"15min":1.3600000000000001},"last":1.028}]},{"osd":4,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.86699999999999999,"15min":0.90500000000000003},"min":{"1min":0.627,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":2.746},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.024,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.68799999999999994,"5min":0.60899999999999999,"15min":0.59199999999999997},"max":{"1min":1.429,"5min":1.429,"15min":7.9569999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92300000000000004,"15min":0.90400000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.437},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.04,"15min":1.0569999999999999},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.54700000000000004},"max":{"1min":1.528,"5min":1.528,"15min":1.593},"last":1.206}]},{"osd":7,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.0449999999999999,"15min":1.0880000000000001},"min":{"1min":0.70399999999999996,"5min":0.50700000000000001,"15min":0.42499999999999999},"max":{"1min":1.589,"5min":1.589,"15min":8.0060000000000002},"last":1.093},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0760000000000001,"15min":1.0980000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.39300000000000002},"max":{"1min":1.508,"5min":1.508,"15min":7.5730000000000004},"last":0.90400000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542274,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19704,"kb_used_data":5488,"kb_used_omap":0,"kb_used_meta":14208,"kb_avail":94352136,"statfs":{"total":96636764160,"available":96616587264,"internally_reserved":0,"allocated":5619712,"data_stored":4886416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14548992},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":1.373,"15min":1.373},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.92000000000000004,"15min":0.88900000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.52},"last":0.64300000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85599999999999998,"15min":0.89900000000000002},"min":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1679999999999999,"5min":1.2350000000000001,"15min":1.512},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.46000000000000002},"max":{"1min":1.0740000000000001,"5min":1.24,"15min":1.377},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89500000000000002,"15min":0.88},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54200000000000004},"max":{"1min":1.252,"5min":1.284,"15min":1.5580000000000001},"last":0.747},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92400000000000004,"15min":0.93700000000000006},"min":{"1min":0.66200000000000003,"5min":0.60799999999999998,"15min":0.51500000000000001},"max":{"1min":1.2849999999999999,"5min":1.292,"15min":1.4330000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93899999999999995,"15min":0.91500000000000004},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.48699999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.98399999999999999,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":6.6040000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.90800000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"max":{"1min":1.169,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.83199999999999996,"5min":0.623,"15min":0.38700000000000001},"max":{"1min":1.569,"5min":1.569,"15min":1.7230000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.99199999999999999,"15min":1.0309999999999999},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.319,"5min":1.3300000000000001,"15min":1.585},"last":0.999},{"interface":"front","average":{"1min":1.008,"5min":1.056,"15min":1.044},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.58599999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.575},"last":0.78000000000000003}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.111,"15min":1.1040000000000001},"min":{"1min":0.745,"5min":0.73999999999999999,"15min":0.58199999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6419999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1439999999999999,"15min":1.1699999999999999},"min":{"1min":0.88400000000000001,"5min":0.64900000000000002,"15min":0.64000000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.889},"last":0.95099999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22120,"kb_used_data":7520,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":94349720,"statfs":{"total":96636764160,"available":96614113280,"internally_reserved":0,"allocated":7700480,"data_stored":6976690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.58899999999999997,"5min":0.51200000000000001,"15min":0.47799999999999998},"max":{"1min":1.1639999999999999,"5min":1.3069999999999999,"15min":1.431},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84599999999999997,"15min":0.84399999999999997},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.84299999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.505},"max":{"1min":1.26,"5min":1.26,"15min":1.458},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2370000000000001,"5min":1.29,"15min":1.401},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89700000000000002,"15min":0.879},"min":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93100000000000005,"15min":0.95199999999999996},"min":{"1min":0.72799999999999998,"5min":0.52900000000000003,"15min":0.497},"max":{"1min":1.246,"5min":1.246,"15min":1.343},"last":0.80100000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.874,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.96199999999999997,"15min":0.98899999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.8160000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.90300000000000002,"15min":0.92500000000000004},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.59099999999999997},"max":{"1min":1.1919999999999999,"5min":1.3919999999999999,"15min":1.492},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.042,"5min":0.94899999999999995,"15min":0.96399999999999997},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.60199999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.206}]},{"osd":6,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.76800000000000002,"5min":0.64500000000000002,"15min":0.59499999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.6120000000000001},"last":1.081},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.341,"5min":1.4390000000000001,"15min":1.542},"last":0.98199999999999998}]},{"osd":7,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.89700000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.147},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.69899999999999995},"max":{"1min":1.405,"5min":1.405,"15min":1.905},"last":1.2509999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542275,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16200,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94355640,"statfs":{"total":96636764160,"available":96620175360,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.27100000000000002},"max":{"1min":0.88200000000000001,"5min":1.093,"15min":6.3840000000000003},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.27500000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.282},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.70699999999999996},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.34999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":19.015999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73199999999999998,"15min":0.745},"min":{"1min":0.52000000000000002,"5min":0.35999999999999999,"15min":0.31},"max":{"1min":0.87,"5min":1.3169999999999999,"15min":6.3540000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.70599999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93799999999999994,"5min":1.109,"15min":1.494},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.80300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.374},"max":{"1min":1.204,"5min":1.204,"15min":23.466000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0209999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.36499999999999999},"max":{"1min":1.4490000000000001,"5min":1.7969999999999999,"15min":15.255000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.93400000000000005,"15min":1.0249999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.081,"5min":1.236,"15min":23.792999999999999},"last":0.91800000000000004}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97199999999999998,"15min":1.0349999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.161,"5min":1.3180000000000001,"15min":23.751000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0409999999999999,"15min":1.0760000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.66700000000000004},"max":{"1min":1.3080000000000001,"5min":1.3959999999999999,"15min":7.0110000000000001},"last":1.0289999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0329999999999999,"15min":1.069},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.53200000000000003},"max":{"1min":1.4730000000000001,"5min":1.8879999999999999,"15min":15.292999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0509999999999999,"15min":1.1399999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.57599999999999996},"max":{"1min":1.3380000000000001,"5min":1.367,"15min":23.428999999999998},"last":0.98299999999999998}]},{"osd":7,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.093,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.58999999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":6.4199999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.437},"max":{"1min":1.5309999999999999,"5min":1.954,"15min":15.428000000000001},"last":0.997}]}]},{"osd":2,"up_from":14,"seq":60129542274,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17720,"kb_used_data":3440,"kb_used_omap":0,"kb_used_meta":14272,"kb_avail":94354120,"statfs":{"total":96636764160,"available":96618618880,"internally_reserved":0,"allocated":3522560,"data_stored":2789264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14614528},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.312},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":1.8640000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.35199999999999998},"max":{"1min":1.0349999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.833}]},{"osd":1,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33700000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.2410000000000001},"last":2.0139999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76500000000000001,"15min":0.73099999999999998},"min":{"1min":0.61199999999999999,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.762}]},{"osd":3,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.107,"15min":1.107},"last":1.8029999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83199999999999996,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36099999999999999},"max":{"1min":1.0329999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.5569999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.94699999999999995,"15min":0.94999999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.3400000000000001,"15min":1.371},"last":1.952},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.747,"5min":0.73499999999999999,"15min":0.58499999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.532},"last":2.0329999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.01,"15min":0.98699999999999999},"min":{"1min":0.77900000000000003,"5min":0.76100000000000001,"15min":0.622},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":2.069},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0109999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.66800000000000004,"15min":0.46999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.7989999999999999},"last":4.0620000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99399999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":4.1239999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0609999999999999,"15min":1.044},"min":{"1min":0.83999999999999997,"5min":0.70399999999999996,"15min":0.60799999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.7270000000000001},"last":1.633}]},{"osd":7,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.097,"15min":1.0649999999999999},"min":{"1min":0.97599999999999998,"5min":0.83699999999999997,"15min":0.65900000000000003},"max":{"1min":1.748,"5min":1.748,"15min":1.76},"last":2.0979999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.55800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":4.1609999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542274,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16884,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":14912,"kb_avail":94354956,"statfs":{"total":96636764160,"available":96619474944,"internally_reserved":0,"allocated":2011136,"data_stored":1275726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15269888},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95299999999999996,"5min":0.98399999999999999,"15min":1.2190000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.36499999999999999},"max":{"1min":0.94399999999999995,"5min":1.45,"15min":1.45},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71899999999999997,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.40699999999999997},"max":{"1min":1.0960000000000001,"5min":1.141,"15min":1.1439999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.5,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90700000000000003,"5min":1.119,"15min":1.393},"last":0.71699999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.071,"5min":1.3240000000000001,"15min":1.3520000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"max":{"1min":0.98599999999999999,"5min":1.631,"15min":1.744},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94699999999999995,"15min":0.95399999999999996},"min":{"1min":0.70999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.2190000000000001,"5min":1.456,"15min":1.609},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98199999999999998,"15min":1.0089999999999999},"min":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.60699999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.5069999999999999},"last":1.0840000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.97099999999999997},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1950000000000001,"5min":1.4199999999999999,"15min":1.8660000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.752,"5min":0.65500000000000003,"15min":0.65000000000000002},"max":{"1min":1.3080000000000001,"5min":1.407,"15min":1.5609999999999999},"last":1.212}]},{"osd":6,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.997,"15min":1.0449999999999999},"min":{"1min":0.83099999999999996,"5min":0.68999999999999995,"15min":0.66700000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.575},"last":0.999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98899999999999999},"min":{"1min":0.748,"5min":0.65600000000000003,"15min":0.65400000000000003},"max":{"1min":1.194,"5min":1.573,"15min":2.1920000000000002},"last":1.0509999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.04,"15min":1.05},"min":{"1min":0.83699999999999997,"5min":0.77900000000000003,"15min":0.73399999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":2.2320000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0840000000000001,"15min":1.099},"min":{"1min":0.82699999999999996,"5min":0.68899999999999995,"15min":0.59099999999999997},"max":{"1min":1.3839999999999999,"5min":1.5409999999999999,"15min":1.6599999999999999},"last":1.1399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542274,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16260,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94355580,"statfs":{"total":96636764160,"available":96620113920,"internally_reserved":0,"allocated":1437696,"data_stored":697484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.316},"max":{"1min":0.89600000000000002,"5min":0.98999999999999999,"15min":1.1220000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.67500000000000004},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.056,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.374},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98799999999999999,"5min":1.0509999999999999,"15min":1.2010000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.0840000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.80100000000000005},"min":{"1min":0.52200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.72599999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.266,"5min":1.351,"15min":1.423},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.57099999999999995},"max":{"1min":1.4199999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.97299999999999998}]},{"osd":5,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0269999999999999,"15min":1.0189999999999999},"min":{"1min":0.81599999999999995,"5min":0.69999999999999996,"15min":0.57599999999999996},"max":{"1min":1.325,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.292}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0589999999999999,"15min":1.071},"min":{"1min":0.77200000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.175},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.90800000000000003,"5min":0.74199999999999999,"15min":0.629},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.151}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.105,"15min":1.1180000000000001},"min":{"1min":0.90000000000000002,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.363,"5min":1.478,"15min":1.5649999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0549999999999999,"15min":1.0680000000000001},"min":{"1min":0.81000000000000005,"5min":0.73499999999999999,"15min":0.70999999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2210000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:23:27.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9939ad8700 1 Processor -- start 2023-11-29T11:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9939ad8700 1 -- start start 2023-11-29T11:23:27.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9939ad8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9934159e70 0x7f993406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9939ad8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9934069c40 0x7f99340cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9939ad8700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993406ace0 con 0x7f993406cee0 2023-11-29T11:23:27.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9939ad8700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993406a0d0 con 0x7f9934069c40 2023-11-29T11:23:27.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9939ad8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993406a3b0 con 0x7f9934159e70 2023-11-29T11:23:27.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f99392d7700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f993406cee0 0x7f99340b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38146/0 (socket says 172.21.15.81:38146) 2023-11-29T11:23:27.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f99392d7700 1 -- 172.21.15.81:0/205264801 learned_addr learned my addr 172.21.15.81:0/205264801 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:27.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9933fff700 1 --2- 172.21.15.81:0/205264801 >> v2:172.21.15.176:3300/0 conn(0x7f9934069c40 0x7f99340cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9938ad6700 1 --2- 172.21.15.81:0/205264801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9934159e70 0x7f993406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f99337fe700 1 -- 172.21.15.81:0/205264801 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73059721 0 0) 0x7f993406ace0 con 0x7f993406cee0 2023-11-29T11:23:27.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f99337fe700 1 -- 172.21.15.81:0/205264801 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f991c0035d0 con 0x7f993406cee0 2023-11-29T11:23:27.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9933fff700 1 -- 172.21.15.81:0/205264801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9934159e70 msgr2=0x7f993406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:27.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9933fff700 1 --2- 172.21.15.81:0/205264801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9934159e70 0x7f993406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9933fff700 1 -- 172.21.15.81:0/205264801 >> v1:172.21.15.81:6789/0 conn(0x7f993406cee0 legacy=0x7f99340b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9933fff700 1 -- 172.21.15.81:0/205264801 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993406a690 con 0x7f9934069c40 2023-11-29T11:23:27.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f9933fff700 1 --2- 172.21.15.81:0/205264801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 0x7f99340cad60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9924009d90 tx=0x7f992400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7654092f3502cbb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f99337fe700 1 -- 172.21.15.81:0/205264801 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400e070 con 0x7f9934069c40 2023-11-29T11:23:27.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f99337fe700 1 -- 172.21.15.81:0/205264801 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992400bb20 con 0x7f9934069c40 2023-11-29T11:23:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.457+0000 7f99337fe700 1 -- 172.21.15.81:0/205264801 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400be90 con 0x7f9934069c40 2023-11-29T11:23:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.461+0000 7f9939ad8700 1 -- 172.21.15.81:0/205264801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 msgr2=0x7f99340cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.461+0000 7f9939ad8700 1 --2- 172.21.15.81:0/205264801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 0x7f99340cad60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9924009d90 tx=0x7f992400b330 comp rx=0 tx=0).stop 2023-11-29T11:23:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.461+0000 7f9939ad8700 1 -- 172.21.15.81:0/205264801 shutdown_connections 2023-11-29T11:23:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.461+0000 7f9939ad8700 1 --2- 172.21.15.81:0/205264801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 0x7f99340cad60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.461+0000 7f9939ad8700 1 --2- 172.21.15.81:0/205264801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9934159e70 0x7f993406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.461+0000 7f9939ad8700 1 -- 172.21.15.81:0/205264801 >> 172.21.15.81:0/205264801 conn(0x7f99340ce3e0 msgr2=0x7f99340ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:27.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.461+0000 7f9939ad8700 1 -- 172.21.15.81:0/205264801 shutdown_connections 2023-11-29T11:23:27.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.461+0000 7f9939ad8700 1 -- 172.21.15.81:0/205264801 wait complete. 2023-11-29T11:23:27.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 Processor -- start 2023-11-29T11:23:27.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 -- start start 2023-11-29T11:23:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 0x7f993408cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993406cee0 0x7f993415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934159e70 0x7f993415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993408d0f0 con 0x7f9934159e70 2023-11-29T11:23:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934151d10 con 0x7f9934069c40 2023-11-29T11:23:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340ac1a0 con 0x7f993406cee0 2023-11-29T11:23:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934159e70 0x7f993415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934159e70 0x7f993415a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53294/0 (socket says 172.21.15.81:53294) 2023-11-29T11:23:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 -- 172.21.15.81:0/728639188 learned_addr learned my addr 172.21.15.81:0/728639188 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9938ad6700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 0x7f993408cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9933fff700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993406cee0 0x7f993415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 -- 172.21.15.81:0/728639188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993406cee0 msgr2=0x7f993415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993406cee0 0x7f993415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 -- 172.21.15.81:0/728639188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 msgr2=0x7f993408cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 0x7f993408cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 -- 172.21.15.81:0/728639188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924009a70 con 0x7f9934159e70 2023-11-29T11:23:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99392d7700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934159e70 0x7f993415a910 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f992c00c530 tx=0x7f992c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99317fa700 1 -- 172.21.15.81:0/728639188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c005d90 con 0x7f9934159e70 2023-11-29T11:23:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993415a240 con 0x7f9934159e70 2023-11-29T11:23:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99317fa700 1 -- 172.21.15.81:0/728639188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00ce40 con 0x7f9934159e70 2023-11-29T11:23:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993406a970 con 0x7f9934159e70 2023-11-29T11:23:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.465+0000 7f99317fa700 1 -- 172.21.15.81:0/728639188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0072d0 con 0x7f9934159e70 2023-11-29T11:23:27.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.469+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99340ca1e0 con 0x7f9934159e70 2023-11-29T11:23:27.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.469+0000 7f99317fa700 1 -- 172.21.15.81:0/728639188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f992c019030 con 0x7f9934159e70 2023-11-29T11:23:27.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.469+0000 7f99317fa700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9920064ee0 0x7f9920067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.469+0000 7f99317fa700 1 -- 172.21.15.81:0/728639188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f992c080e00 con 0x7f9934159e70 2023-11-29T11:23:27.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.469+0000 7f9938ad6700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9920064ee0 0x7f9920067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.469+0000 7f9938ad6700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9920064ee0 0x7f9920067390 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f99340c88c0 tx=0x7f9928009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.477+0000 7f99317fa700 1 -- 172.21.15.81:0/728639188 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f992c04a400 con 0x7f9934159e70 2023-11-29T11:23:27.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-29T11:23:27.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.633+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9934072500 con 0x7f9920064ee0 2023-11-29T11:23:27.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f99317fa700 1 -- 172.21.15.81:0/728639188 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71861 (secure 0 0 0) 0x7f9934072500 con 0x7f9920064ee0 2023-11-29T11:23:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9920064ee0 msgr2=0x7f9920067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9920064ee0 0x7f9920067390 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f99340c88c0 tx=0x7f9928009240 comp rx=0 tx=0).stop 2023-11-29T11:23:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934159e70 msgr2=0x7f993415a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934159e70 0x7f993415a910 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f992c00c530 tx=0x7f992c00c840 comp rx=0 tx=0).stop 2023-11-29T11:23:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 shutdown_connections 2023-11-29T11:23:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9920064ee0 0x7f9920067390 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934159e70 0x7f993415a910 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f993406cee0 0x7f993415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 --2- 172.21.15.81:0/728639188 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9934069c40 0x7f993408cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 >> 172.21.15.81:0/728639188 conn(0x7f99340ce3e0 msgr2=0x7f99340b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 shutdown_connections 2023-11-29T11:23:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.641+0000 7f9939ad8700 1 -- 172.21.15.81:0/728639188 wait complete. 2023-11-29T11:23:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:23:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2023-11-29T11:23:26.649646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":151620,"kb_used_data":34820,"kb_used_omap":0,"kb_used_meta":116736,"kb_avail":754823100,"statfs":{"total":773094113280,"available":772938854400,"internally_reserved":0,"allocated":35655680,"data_stored":29778124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":119537664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18900774,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-27,"num_read_kb":-24,"num_write":-103,"num_write_kb":-18493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001980"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":97,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.415106+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:23:24.415106+0000","last_peered":"2023-11-29T11:23:24.415106+0000","last_clean":"2023-11-29T11:23:24.415106+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:23:24.415106+0000","last_undegraded":"2023-11-29T11:23:24.415106+0000","last_fullsized":"2023-11-29T11:23:24.415106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":98,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.416431+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:23:24.416431+0000","last_peered":"2023-11-29T11:23:24.416431+0000","last_clean":"2023-11-29T11:23:24.416431+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:23:24.416431+0000","last_undegraded":"2023-11-29T11:23:24.416431+0000","last_fullsized":"2023-11-29T11:23:24.416431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896061+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:23:21.896061+0000","last_peered":"2023-11-29T11:23:21.896061+0000","last_clean":"2023-11-29T11:23:21.896061+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:23:21.896061+0000","last_undegraded":"2023-11-29T11:23:21.896061+0000","last_fullsized":"2023-11-29T11:23:21.896061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":102,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.234852+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:23:24.234852+0000","last_peered":"2023-11-29T11:23:24.234852+0000","last_clean":"2023-11-29T11:23:24.234852+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:23:24.234852+0000","last_undegraded":"2023-11-29T11:23:24.234852+0000","last_fullsized":"2023-11-29T11:23:24.234852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":251,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896754+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:23:21.896754+0000","last_peered":"2023-11-29T11:23:21.896754+0000","last_clean":"2023-11-29T11:23:21.896754+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:23:21.896754+0000","last_undegraded":"2023-11-29T11:23:21.896754+0000","last_fullsized":"2023-11-29T11:23:21.896754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":100,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.318659+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:23:21.318659+0000","last_peered":"2023-11-29T11:23:21.318659+0000","last_clean":"2023-11-29T11:23:21.318659+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:23:21.318659+0000","last_undegraded":"2023-11-29T11:23:21.318659+0000","last_fullsized":"2023-11-29T11:23:21.318659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.897488+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:23:21.897488+0000","last_peered":"2023-11-29T11:23:21.897488+0000","last_clean":"2023-11-29T11:23:21.897488+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:23:21.897488+0000","last_undegraded":"2023-11-29T11:23:21.897488+0000","last_fullsized":"2023-11-29T11:23:21.897488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.229027+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:23:24.229027+0000","last_peered":"2023-11-29T11:23:24.229027+0000","last_clean":"2023-11-29T11:23:24.229027+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:23:24.229027+0000","last_undegraded":"2023-11-29T11:23:24.229027+0000","last_fullsized":"2023-11-29T11:23:24.229027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896810+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:23:21.896810+0000","last_peered":"2023-11-29T11:23:21.896810+0000","last_clean":"2023-11-29T11:23:21.896810+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:23:21.896810+0000","last_undegraded":"2023-11-29T11:23:21.896810+0000","last_fullsized":"2023-11-29T11:23:21.896810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542274,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22900,"kb_used_data":8108,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94348940,"statfs":{"total":96636764160,"available":96613314560,"internally_reserved":0,"allocated":8302592,"data_stored":7567658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.63200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1890000000000001,"5min":1.272,"15min":1.5629999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.327},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86699999999999999,"15min":0.89400000000000002},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1120000000000001,"5min":1.242,"15min":2.1360000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.876},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":3.0449999999999999},"last":1.1890000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.94999999999999996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.151,"5min":1.2949999999999999,"15min":1.8009999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53900000000000003},"max":{"1min":1.1890000000000001,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.71599999999999997,"5min":0.58299999999999996,"15min":0.38100000000000001},"max":{"1min":1.139,"5min":1.294,"15min":1.667},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92200000000000004,"15min":0.94899999999999995},"min":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.58299999999999996},"max":{"1min":1.131,"5min":1.2290000000000001,"15min":1.4510000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.91100000000000003},"min":{"1min":0.65100000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.113,"5min":1.24,"15min":1.446},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.01,"15min":1.046},"min":{"1min":0.92000000000000004,"5min":0.63700000000000001,"15min":0.33800000000000002},"max":{"1min":1.341,"5min":1.389,"15min":1.736},"last":1.1120000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93799999999999994,"15min":1.036},"min":{"1min":0.63,"5min":0.60299999999999998,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3100000000000001,"15min":2.403},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.0169999999999999,"15min":1.079},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2789999999999999,"5min":1.4470000000000001,"15min":1.53},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.052,"15min":1.113},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2430000000000001,"5min":1.375,"15min":1.7230000000000001},"last":1.034},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1160000000000001,"15min":1.161},"min":{"1min":0.93899999999999995,"5min":0.72099999999999997,"15min":0.44500000000000001},"max":{"1min":1.296,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.1619999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542275,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19832,"kb_used_data":5488,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94352008,"statfs":{"total":96636764160,"available":96616456192,"internally_reserved":0,"allocated":5619712,"data_stored":4886416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85299999999999998,"15min":0.83199999999999996},"min":{"1min":0.60499999999999998,"5min":0.57599999999999996,"15min":0.44400000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84799999999999998},"min":{"1min":0.56899999999999995,"5min":0.53200000000000003,"15min":0.375},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":7.7910000000000004},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.284,"15min":1.4510000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.034,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.83099999999999996,"5min":0.58499999999999996,"15min":0.50800000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":7.8479999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.66700000000000004,"5min":0.56399999999999995,"15min":0.49099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.369},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.90600000000000003},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.40500000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":2.7069999999999999},"last":1.353}]},{"osd":3,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92100000000000004,"15min":0.94199999999999995},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.675,"5min":1.675,"15min":7.923},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94099999999999995,"15min":0.93400000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.48099999999999998},"max":{"1min":1.2410000000000001,"5min":1.304,"15min":1.3600000000000001},"last":1.028}]},{"osd":4,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.86699999999999999,"15min":0.90500000000000003},"min":{"1min":0.627,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":2.746},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.024,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.68799999999999994,"5min":0.60899999999999999,"15min":0.59199999999999997},"max":{"1min":1.429,"5min":1.429,"15min":7.9569999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92300000000000004,"15min":0.90400000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.437},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.04,"15min":1.0569999999999999},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.54700000000000004},"max":{"1min":1.528,"5min":1.528,"15min":1.593},"last":1.206}]},{"osd":7,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.0449999999999999,"15min":1.0880000000000001},"min":{"1min":0.70399999999999996,"5min":0.50700000000000001,"15min":0.42499999999999999},"max":{"1min":1.589,"5min":1.589,"15min":8.0060000000000002},"last":1.093},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0760000000000001,"15min":1.0980000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.39300000000000002},"max":{"1min":1.508,"5min":1.508,"15min":7.5730000000000004},"last":0.90400000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542274,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19704,"kb_used_data":5488,"kb_used_omap":0,"kb_used_meta":14208,"kb_avail":94352136,"statfs":{"total":96636764160,"available":96616587264,"internally_reserved":0,"allocated":5619712,"data_stored":4886416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14548992},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":1.373,"15min":1.373},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.92000000000000004,"15min":0.88900000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.52},"last":0.64300000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85599999999999998,"15min":0.89900000000000002},"min":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1679999999999999,"5min":1.2350000000000001,"15min":1.512},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.46000000000000002},"max":{"1min":1.0740000000000001,"5min":1.24,"15min":1.377},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89500000000000002,"15min":0.88},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54200000000000004},"max":{"1min":1.252,"5min":1.284,"15min":1.5580000000000001},"last":0.747},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92400000000000004,"15min":0.93700000000000006},"min":{"1min":0.66200000000000003,"5min":0.60799999999999998,"15min":0.51500000000000001},"max":{"1min":1.2849999999999999,"5min":1.292,"15min":1.4330000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93899999999999995,"15min":0.91500000000000004},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.48699999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.98399999999999999,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":6.6040000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.90800000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"max":{"1min":1.169,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.83199999999999996,"5min":0.623,"15min":0.38700000000000001},"max":{"1min":1.569,"5min":1.569,"15min":1.7230000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.99199999999999999,"15min":1.0309999999999999},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.319,"5min":1.3300000000000001,"15min":1.585},"last":0.999},{"interface":"front","average":{"1min":1.008,"5min":1.056,"15min":1.044},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.58599999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.575},"last":0.78000000000000003}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.111,"15min":1.1040000000000001},"min":{"1min":0.745,"5min":0.73999999999999999,"15min":0.58199999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6419999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1439999999999999,"15min":1.1699999999999999},"min":{"1min":0.88400000000000001,"5min":0.64900000000000002,"15min":0.64000000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.889},"last":0.95099999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22120,"kb_used_data":7520,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":94349720,"statfs":{"total":96636764160,"available":96614113280,"internally_reserved":0,"allocated":7700480,"data_stored":6976690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.58899999999999997,"5min":0.51200000000000001,"15min":0.47799999999999998},"max":{"1min":1.1639999999999999,"5min":1.3069999999999999,"15min":1.431},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84599999999999997,"15min":0.84399999999999997},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.84299999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.505},"max":{"1min":1.26,"5min":1.26,"15min":1.458},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2370000000000001,"5min":1.29,"15min":1.401},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89700000000000002,"15min":0.879},"min":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93100000000000005,"15min":0.95199999999999996},"min":{"1min":0.72799999999999998,"5min":0.52900000000000003,"15min":0.497},"max":{"1min":1.246,"5min":1.246,"15min":1.343},"last":0.80100000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.874,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.96199999999999997,"15min":0.98899999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.8160000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.90300000000000002,"15min":0.92500000000000004},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.59099999999999997},"max":{"1min":1.1919999999999999,"5min":1.3919999999999999,"15min":1.492},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.042,"5min":0.94899999999999995,"15min":0.96399999999999997},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.60199999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.206}]},{"osd":6,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.76800000000000002,"5min":0.64500000000000002,"15min":0.59499999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.6120000000000001},"last":1.081},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.341,"5min":1.4390000000000001,"15min":1.542},"last":0.98199999999999998}]},{"osd":7,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.89700000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.147},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.69899999999999995},"max":{"1min":1.405,"5min":1.405,"15min":1.905},"last":1.2509999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542275,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16200,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94355640,"statfs":{"total":96636764160,"available":96620175360,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.27100000000000002},"max":{"1min":0.88200000000000001,"5min":1.093,"15min":6.3840000000000003},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.27500000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.282},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.70699999999999996},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.34999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":19.015999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73199999999999998,"15min":0.745},"min":{"1min":0.52000000000000002,"5min":0.35999999999999999,"15min":0.31},"max":{"1min":0.87,"5min":1.3169999999999999,"15min":6.3540000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.70599999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93799999999999994,"5min":1.109,"15min":1.494},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.80300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.374},"max":{"1min":1.204,"5min":1.204,"15min":23.466000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0209999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.36499999999999999},"max":{"1min":1.4490000000000001,"5min":1.7969999999999999,"15min":15.255000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.93400000000000005,"15min":1.0249999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.081,"5min":1.236,"15min":23.792999999999999},"last":0.91800000000000004}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97199999999999998,"15min":1.0349999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.161,"5min":1.3180000000000001,"15min":23.751000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0409999999999999,"15min":1.0760000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.66700000000000004},"max":{"1min":1.3080000000000001,"5min":1.3959999999999999,"15min":7.0110000000000001},"last":1.0289999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0329999999999999,"15min":1.069},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.53200000000000003},"max":{"1min":1.4730000000000001,"5min":1.8879999999999999,"15min":15.292999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0509999999999999,"15min":1.1399999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.57599999999999996},"max":{"1min":1.3380000000000001,"5min":1.367,"15min":23.428999999999998},"last":0.98299999999999998}]},{"osd":7,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.093,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.58999999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":6.4199999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.437},"max":{"1min":1.5309999999999999,"5min":1.954,"15min":15.428000000000001},"last":0.997}]}]},{"osd":2,"up_from":14,"seq":60129542274,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17720,"kb_used_data":3440,"kb_used_omap":0,"kb_used_meta":14272,"kb_avail":94354120,"statfs":{"total":96636764160,"available":96618618880,"internally_reserved":0,"allocated":3522560,"data_stored":2789264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14614528},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.312},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":1.8640000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.35199999999999998},"max":{"1min":1.0349999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.833}]},{"osd":1,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33700000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.2410000000000001},"last":2.0139999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76500000000000001,"15min":0.73099999999999998},"min":{"1min":0.61199999999999999,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.762}]},{"osd":3,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.107,"15min":1.107},"last":1.8029999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83199999999999996,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36099999999999999},"max":{"1min":1.0329999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.5569999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.94699999999999995,"15min":0.94999999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.3400000000000001,"15min":1.371},"last":1.952},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.747,"5min":0.73499999999999999,"15min":0.58499999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.532},"last":2.0329999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.01,"15min":0.98699999999999999},"min":{"1min":0.77900000000000003,"5min":0.76100000000000001,"15min":0.622},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":2.069},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0109999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.66800000000000004,"15min":0.46999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.7989999999999999},"last":4.0620000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99399999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":4.1239999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0609999999999999,"15min":1.044},"min":{"1min":0.83999999999999997,"5min":0.70399999999999996,"15min":0.60799999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.7270000000000001},"last":1.633}]},{"osd":7,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.097,"15min":1.0649999999999999},"min":{"1min":0.97599999999999998,"5min":0.83699999999999997,"15min":0.65900000000000003},"max":{"1min":1.748,"5min":1.748,"15min":1.76},"last":2.0979999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.55800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":4.1609999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542274,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16884,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":14912,"kb_avail":94354956,"statfs":{"total":96636764160,"available":96619474944,"internally_reserved":0,"allocated":2011136,"data_stored":1275726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15269888},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95299999999999996,"5min":0.98399999999999999,"15min":1.2190000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.36499999999999999},"max":{"1min":0.94399999999999995,"5min":1.45,"15min":1.45},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71899999999999997,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.40699999999999997},"max":{"1min":1.0960000000000001,"5min":1.141,"15min":1.1439999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.5,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90700000000000003,"5min":1.119,"15min":1.393},"last":0.71699999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.071,"5min":1.3240000000000001,"15min":1.3520000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"max":{"1min":0.98599999999999999,"5min":1.631,"15min":1.744},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94699999999999995,"15min":0.95399999999999996},"min":{"1min":0.70999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.2190000000000001,"5min":1.456,"15min":1.609},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98199999999999998,"15min":1.0089999999999999},"min":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.60699999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.5069999999999999},"last":1.0840000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.97099999999999997},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1950000000000001,"5min":1.4199999999999999,"15min":1.8660000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.752,"5min":0.65500000000000003,"15min":0.65000000000000002},"max":{"1min":1.3080000000000001,"5min":1.407,"15min":1.5609999999999999},"last":1.212}]},{"osd":6,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.997,"15min":1.0449999999999999},"min":{"1min":0.83099999999999996,"5min":0.68999999999999995,"15min":0.66700000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.575},"last":0.999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98899999999999999},"min":{"1min":0.748,"5min":0.65600000000000003,"15min":0.65400000000000003},"max":{"1min":1.194,"5min":1.573,"15min":2.1920000000000002},"last":1.0509999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.04,"15min":1.05},"min":{"1min":0.83699999999999997,"5min":0.77900000000000003,"15min":0.73399999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":2.2320000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0840000000000001,"15min":1.099},"min":{"1min":0.82699999999999996,"5min":0.68899999999999995,"15min":0.59099999999999997},"max":{"1min":1.3839999999999999,"5min":1.5409999999999999,"15min":1.6599999999999999},"last":1.1399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542274,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16260,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94355580,"statfs":{"total":96636764160,"available":96620113920,"internally_reserved":0,"allocated":1437696,"data_stored":697484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.316},"max":{"1min":0.89600000000000002,"5min":0.98999999999999999,"15min":1.1220000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.67500000000000004},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.056,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.374},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98799999999999999,"5min":1.0509999999999999,"15min":1.2010000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.0840000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.80100000000000005},"min":{"1min":0.52200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.72599999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.266,"5min":1.351,"15min":1.423},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.57099999999999995},"max":{"1min":1.4199999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.97299999999999998}]},{"osd":5,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0269999999999999,"15min":1.0189999999999999},"min":{"1min":0.81599999999999995,"5min":0.69999999999999996,"15min":0.57599999999999996},"max":{"1min":1.325,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.292}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0589999999999999,"15min":1.071},"min":{"1min":0.77200000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.175},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.90800000000000003,"5min":0.74199999999999999,"15min":0.629},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.151}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.105,"15min":1.1180000000000001},"min":{"1min":0.90000000000000002,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.363,"5min":1.478,"15min":1.5649999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0549999999999999,"15min":1.0680000000000001},"min":{"1min":0.81000000000000005,"5min":0.73499999999999999,"15min":0.70999999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2210000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:23:27.666 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-29T11:23:27.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:23:27.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.773+0000 7fae6ffff700 1 Processor -- start 2023-11-29T11:23:27.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.773+0000 7fae6ffff700 1 -- start start 2023-11-29T11:23:27.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fae701584c0 0x7fae700cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fae7006ace0 0x7fae700b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700b3c60 con 0x7fae700b32e0 2023-11-29T11:23:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7006dbd0 con 0x7fae701584c0 2023-11-29T11:23:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae700cd0f0 con 0x7fae7006ace0 2023-11-29T11:23:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fae701584c0 0x7fae700cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6effd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fae701584c0 0x7fae700cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53306/0 (socket says 172.21.15.81:53306) 2023-11-29T11:23:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6effd700 1 -- 172.21.15.81:0/1059761591 learned_addr learned my addr 172.21.15.81:0/1059761591 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6f7fe700 1 --2- 172.21.15.81:0/1059761591 >> v2:172.21.15.176:3300/0 conn(0x7fae7006ace0 0x7fae700b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6effd700 1 -- 172.21.15.81:0/1059761591 >> v2:172.21.15.176:3300/0 conn(0x7fae7006ace0 msgr2=0x7fae700b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6effd700 1 --2- 172.21.15.81:0/1059761591 >> v2:172.21.15.176:3300/0 conn(0x7fae7006ace0 0x7fae700b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6effd700 1 -- 172.21.15.81:0/1059761591 >> v1:172.21.15.176:6789/0 conn(0x7fae700b32e0 legacy=0x7fae7006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6effd700 1 -- 172.21.15.81:0/1059761591 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700cd3d0 con 0x7fae701584c0 2023-11-29T11:23:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6effd700 1 --2- 172.21.15.81:0/1059761591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae701584c0 0x7fae700cb6f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fae700b4410 tx=0x7fae60009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9a4a3aa49602ff server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6dffb700 1 -- 172.21.15.81:0/1059761591 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60011830 con 0x7fae701584c0 2023-11-29T11:23:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6dffb700 1 -- 172.21.15.81:0/1059761591 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae60011990 con 0x7fae701584c0 2023-11-29T11:23:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6dffb700 1 -- 172.21.15.81:0/1059761591 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60011d20 con 0x7fae701584c0 2023-11-29T11:23:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 -- 172.21.15.81:0/1059761591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae701584c0 msgr2=0x7fae700cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1059761591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae701584c0 0x7fae700cb6f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fae700b4410 tx=0x7fae60009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 -- 172.21.15.81:0/1059761591 shutdown_connections 2023-11-29T11:23:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1059761591 >> v2:172.21.15.176:3300/0 conn(0x7fae7006ace0 0x7fae700b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1059761591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae701584c0 0x7fae700cb6f0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 -- 172.21.15.81:0/1059761591 >> 172.21.15.81:0/1059761591 conn(0x7fae700ce3e0 msgr2=0x7fae700ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 -- 172.21.15.81:0/1059761591 shutdown_connections 2023-11-29T11:23:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.777+0000 7fae6ffff700 1 -- 172.21.15.81:0/1059761591 wait complete. 2023-11-29T11:23:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6ffff700 1 Processor -- start 2023-11-29T11:23:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6ffff700 1 -- start start 2023-11-29T11:23:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7006ace0 0x7fae700b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae700b32e0 0x7fae700b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae701584c0 0x7fae701e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700c36c0 con 0x7fae7006ace0 2023-11-29T11:23:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6ffff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700c8290 con 0x7fae701584c0 2023-11-29T11:23:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6ffff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae700c3950 con 0x7fae700b32e0 2023-11-29T11:23:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7006ace0 0x7fae700b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7006ace0 0x7fae700b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53322/0 (socket says 172.21.15.81:53322) 2023-11-29T11:23:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6effd700 1 -- 172.21.15.81:0/1946190087 learned_addr learned my addr 172.21.15.81:0/1946190087 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6f7fe700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae701584c0 0x7fae701e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6e7fc700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae700b32e0 0x7fae700b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6effd700 1 -- 172.21.15.81:0/1946190087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae700b32e0 msgr2=0x7fae700b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6effd700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae700b32e0 0x7fae700b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6effd700 1 -- 172.21.15.81:0/1946190087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae701584c0 msgr2=0x7fae701e16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6effd700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae701584c0 0x7fae701e16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.781+0000 7fae6effd700 1 -- 172.21.15.81:0/1946190087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009570 con 0x7fae7006ace0 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.785+0000 7fae6effd700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7006ace0 0x7fae700b01e0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fae60000c00 tx=0x7fae60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.785+0000 7fae57fff700 1 -- 172.21.15.81:0/1946190087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60004510 con 0x7fae7006ace0 2023-11-29T11:23:27.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.785+0000 7fae57fff700 1 -- 172.21.15.81:0/1946190087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6001e070 con 0x7fae7006ace0 2023-11-29T11:23:27.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.785+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae700cd990 con 0x7fae7006ace0 2023-11-29T11:23:27.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.785+0000 7fae57fff700 1 -- 172.21.15.81:0/1946190087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60003900 con 0x7fae7006ace0 2023-11-29T11:23:27.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.785+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae700cd6b0 con 0x7fae7006ace0 2023-11-29T11:23:27.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.785+0000 7fae57fff700 1 -- 172.21.15.81:0/1946190087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fae6000f050 con 0x7fae7006ace0 2023-11-29T11:23:27.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.789+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae700cdc70 con 0x7fae7006ace0 2023-11-29T11:23:27.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.789+0000 7fae57fff700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fae5c064f10 0x7fae5c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:27.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.789+0000 7fae57fff700 1 -- 172.21.15.81:0/1946190087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fae600828b0 con 0x7fae7006ace0 2023-11-29T11:23:27.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.789+0000 7fae6e7fc700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fae5c064f10 0x7fae5c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:27.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.789+0000 7fae6e7fc700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fae5c064f10 0x7fae5c0673c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fae70070990 tx=0x7fae64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:27.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.793+0000 7fae57fff700 1 -- 172.21.15.81:0/1946190087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fae60050b30 con 0x7fae7006ace0 2023-11-29T11:23:27.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.953+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae70072500 con 0x7fae5c064f10 2023-11-29T11:23:27.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.957+0000 7fae57fff700 1 -- 172.21.15.81:0/1946190087 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71861 (secure 0 0 0) 0x7fae70072500 con 0x7fae5c064f10 2023-11-29T11:23:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fae5c064f10 msgr2=0x7fae5c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fae5c064f10 0x7fae5c0673c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fae70070990 tx=0x7fae64009040 comp rx=0 tx=0).stop 2023-11-29T11:23:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7006ace0 msgr2=0x7fae700b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7006ace0 0x7fae700b01e0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fae60000c00 tx=0x7fae60004770 comp rx=0 tx=0).stop 2023-11-29T11:23:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 shutdown_connections 2023-11-29T11:23:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fae5c064f10 0x7fae5c0673c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae701584c0 0x7fae701e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae700b32e0 0x7fae700b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 --2- 172.21.15.81:0/1946190087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7006ace0 0x7fae700b01e0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 >> 172.21.15.81:0/1946190087 conn(0x7fae700ce3e0 msgr2=0x7fae7006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 shutdown_connections 2023-11-29T11:23:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:27.961+0000 7fae6ffff700 1 -- 172.21.15.81:0/1946190087 wait complete. 2023-11-29T11:23:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:23:27.983 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2023-11-29T11:23:26.649646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":151620,"kb_used_data":34820,"kb_used_omap":0,"kb_used_meta":116736,"kb_avail":754823100,"statfs":{"total":773094113280,"available":772938854400,"internally_reserved":0,"allocated":35655680,"data_stored":29778124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":119537664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18900774,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-27,"num_read_kb":-24,"num_write":-103,"num_write_kb":-18493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001980"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":97,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.415106+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:23:24.415106+0000","last_peered":"2023-11-29T11:23:24.415106+0000","last_clean":"2023-11-29T11:23:24.415106+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:23:24.415106+0000","last_undegraded":"2023-11-29T11:23:24.415106+0000","last_fullsized":"2023-11-29T11:23:24.415106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":98,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.416431+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:23:24.416431+0000","last_peered":"2023-11-29T11:23:24.416431+0000","last_clean":"2023-11-29T11:23:24.416431+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:23:24.416431+0000","last_undegraded":"2023-11-29T11:23:24.416431+0000","last_fullsized":"2023-11-29T11:23:24.416431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896061+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:23:21.896061+0000","last_peered":"2023-11-29T11:23:21.896061+0000","last_clean":"2023-11-29T11:23:21.896061+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:23:21.896061+0000","last_undegraded":"2023-11-29T11:23:21.896061+0000","last_fullsized":"2023-11-29T11:23:21.896061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":102,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.234852+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:23:24.234852+0000","last_peered":"2023-11-29T11:23:24.234852+0000","last_clean":"2023-11-29T11:23:24.234852+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:23:24.234852+0000","last_undegraded":"2023-11-29T11:23:24.234852+0000","last_fullsized":"2023-11-29T11:23:24.234852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":251,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896754+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:23:21.896754+0000","last_peered":"2023-11-29T11:23:21.896754+0000","last_clean":"2023-11-29T11:23:21.896754+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:23:21.896754+0000","last_undegraded":"2023-11-29T11:23:21.896754+0000","last_fullsized":"2023-11-29T11:23:21.896754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":100,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.318659+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:23:21.318659+0000","last_peered":"2023-11-29T11:23:21.318659+0000","last_clean":"2023-11-29T11:23:21.318659+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:23:21.318659+0000","last_undegraded":"2023-11-29T11:23:21.318659+0000","last_fullsized":"2023-11-29T11:23:21.318659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:09:23.886186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.897488+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:23:21.897488+0000","last_peered":"2023-11-29T11:23:21.897488+0000","last_clean":"2023-11-29T11:23:21.897488+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:23:21.897488+0000","last_undegraded":"2023-11-29T11:23:21.897488+0000","last_fullsized":"2023-11-29T11:23:21.897488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.229027+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:23:24.229027+0000","last_peered":"2023-11-29T11:23:24.229027+0000","last_clean":"2023-11-29T11:23:24.229027+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:23:24.229027+0000","last_undegraded":"2023-11-29T11:23:24.229027+0000","last_fullsized":"2023-11-29T11:23:24.229027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896810+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:23:21.896810+0000","last_peered":"2023-11-29T11:23:21.896810+0000","last_clean":"2023-11-29T11:23:21.896810+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:23:21.896810+0000","last_undegraded":"2023-11-29T11:23:21.896810+0000","last_fullsized":"2023-11-29T11:23:21.896810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542274,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22900,"kb_used_data":8108,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94348940,"statfs":{"total":96636764160,"available":96613314560,"internally_reserved":0,"allocated":8302592,"data_stored":7567658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.63200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1890000000000001,"5min":1.272,"15min":1.5629999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.327},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86699999999999999,"15min":0.89400000000000002},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1120000000000001,"5min":1.242,"15min":2.1360000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.876},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":3.0449999999999999},"last":1.1890000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.94999999999999996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.151,"5min":1.2949999999999999,"15min":1.8009999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53900000000000003},"max":{"1min":1.1890000000000001,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.71599999999999997,"5min":0.58299999999999996,"15min":0.38100000000000001},"max":{"1min":1.139,"5min":1.294,"15min":1.667},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92200000000000004,"15min":0.94899999999999995},"min":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.58299999999999996},"max":{"1min":1.131,"5min":1.2290000000000001,"15min":1.4510000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.91100000000000003},"min":{"1min":0.65100000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.113,"5min":1.24,"15min":1.446},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.01,"15min":1.046},"min":{"1min":0.92000000000000004,"5min":0.63700000000000001,"15min":0.33800000000000002},"max":{"1min":1.341,"5min":1.389,"15min":1.736},"last":1.1120000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93799999999999994,"15min":1.036},"min":{"1min":0.63,"5min":0.60299999999999998,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3100000000000001,"15min":2.403},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.0169999999999999,"15min":1.079},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2789999999999999,"5min":1.4470000000000001,"15min":1.53},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.052,"15min":1.113},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2430000000000001,"5min":1.375,"15min":1.7230000000000001},"last":1.034},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1160000000000001,"15min":1.161},"min":{"1min":0.93899999999999995,"5min":0.72099999999999997,"15min":0.44500000000000001},"max":{"1min":1.296,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.1619999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542275,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19832,"kb_used_data":5488,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94352008,"statfs":{"total":96636764160,"available":96616456192,"internally_reserved":0,"allocated":5619712,"data_stored":4886416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85299999999999998,"15min":0.83199999999999996},"min":{"1min":0.60499999999999998,"5min":0.57599999999999996,"15min":0.44400000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84799999999999998},"min":{"1min":0.56899999999999995,"5min":0.53200000000000003,"15min":0.375},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":7.7910000000000004},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.284,"15min":1.4510000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.034,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.83099999999999996,"5min":0.58499999999999996,"15min":0.50800000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":7.8479999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.66700000000000004,"5min":0.56399999999999995,"15min":0.49099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.369},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.90600000000000003},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.40500000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":2.7069999999999999},"last":1.353}]},{"osd":3,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92100000000000004,"15min":0.94199999999999995},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.675,"5min":1.675,"15min":7.923},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94099999999999995,"15min":0.93400000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.48099999999999998},"max":{"1min":1.2410000000000001,"5min":1.304,"15min":1.3600000000000001},"last":1.028}]},{"osd":4,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.86699999999999999,"15min":0.90500000000000003},"min":{"1min":0.627,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":2.746},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.024,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.68799999999999994,"5min":0.60899999999999999,"15min":0.59199999999999997},"max":{"1min":1.429,"5min":1.429,"15min":7.9569999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92300000000000004,"15min":0.90400000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.437},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.04,"15min":1.0569999999999999},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.54700000000000004},"max":{"1min":1.528,"5min":1.528,"15min":1.593},"last":1.206}]},{"osd":7,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.0449999999999999,"15min":1.0880000000000001},"min":{"1min":0.70399999999999996,"5min":0.50700000000000001,"15min":0.42499999999999999},"max":{"1min":1.589,"5min":1.589,"15min":8.0060000000000002},"last":1.093},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0760000000000001,"15min":1.0980000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.39300000000000002},"max":{"1min":1.508,"5min":1.508,"15min":7.5730000000000004},"last":0.90400000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542274,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":19704,"kb_used_data":5488,"kb_used_omap":0,"kb_used_meta":14208,"kb_avail":94352136,"statfs":{"total":96636764160,"available":96616587264,"internally_reserved":0,"allocated":5619712,"data_stored":4886416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14548992},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":1.373,"15min":1.373},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.92000000000000004,"15min":0.88900000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.52},"last":0.64300000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85599999999999998,"15min":0.89900000000000002},"min":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1679999999999999,"5min":1.2350000000000001,"15min":1.512},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.46000000000000002},"max":{"1min":1.0740000000000001,"5min":1.24,"15min":1.377},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89500000000000002,"15min":0.88},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54200000000000004},"max":{"1min":1.252,"5min":1.284,"15min":1.5580000000000001},"last":0.747},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92400000000000004,"15min":0.93700000000000006},"min":{"1min":0.66200000000000003,"5min":0.60799999999999998,"15min":0.51500000000000001},"max":{"1min":1.2849999999999999,"5min":1.292,"15min":1.4330000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93899999999999995,"15min":0.91500000000000004},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.48699999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.98399999999999999,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":6.6040000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.90800000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"max":{"1min":1.169,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.83199999999999996,"5min":0.623,"15min":0.38700000000000001},"max":{"1min":1.569,"5min":1.569,"15min":1.7230000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.99199999999999999,"15min":1.0309999999999999},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.319,"5min":1.3300000000000001,"15min":1.585},"last":0.999},{"interface":"front","average":{"1min":1.008,"5min":1.056,"15min":1.044},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.58599999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.575},"last":0.78000000000000003}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.111,"15min":1.1040000000000001},"min":{"1min":0.745,"5min":0.73999999999999999,"15min":0.58199999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6419999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1439999999999999,"15min":1.1699999999999999},"min":{"1min":0.88400000000000001,"5min":0.64900000000000002,"15min":0.64000000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.889},"last":0.95099999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":22120,"kb_used_data":7520,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":94349720,"statfs":{"total":96636764160,"available":96614113280,"internally_reserved":0,"allocated":7700480,"data_stored":6976690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.58899999999999997,"5min":0.51200000000000001,"15min":0.47799999999999998},"max":{"1min":1.1639999999999999,"5min":1.3069999999999999,"15min":1.431},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84599999999999997,"15min":0.84399999999999997},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.84299999999999997}]},{"osd":1,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.505},"max":{"1min":1.26,"5min":1.26,"15min":1.458},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2370000000000001,"5min":1.29,"15min":1.401},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89700000000000002,"15min":0.879},"min":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93100000000000005,"15min":0.95199999999999996},"min":{"1min":0.72799999999999998,"5min":0.52900000000000003,"15min":0.497},"max":{"1min":1.246,"5min":1.246,"15min":1.343},"last":0.80100000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.874,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.96199999999999997,"15min":0.98899999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.8160000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.90300000000000002,"15min":0.92500000000000004},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.59099999999999997},"max":{"1min":1.1919999999999999,"5min":1.3919999999999999,"15min":1.492},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.042,"5min":0.94899999999999995,"15min":0.96399999999999997},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.60199999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.206}]},{"osd":6,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.76800000000000002,"5min":0.64500000000000002,"15min":0.59499999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.6120000000000001},"last":1.081},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.341,"5min":1.4390000000000001,"15min":1.542},"last":0.98199999999999998}]},{"osd":7,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.89700000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.147},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.69899999999999995},"max":{"1min":1.405,"5min":1.405,"15min":1.905},"last":1.2509999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542275,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16200,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94355640,"statfs":{"total":96636764160,"available":96620175360,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.27100000000000002},"max":{"1min":0.88200000000000001,"5min":1.093,"15min":6.3840000000000003},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.27500000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.282},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.70699999999999996},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.34999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":19.015999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73199999999999998,"15min":0.745},"min":{"1min":0.52000000000000002,"5min":0.35999999999999999,"15min":0.31},"max":{"1min":0.87,"5min":1.3169999999999999,"15min":6.3540000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.70599999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93799999999999994,"5min":1.109,"15min":1.494},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.80300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.374},"max":{"1min":1.204,"5min":1.204,"15min":23.466000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0209999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.36499999999999999},"max":{"1min":1.4490000000000001,"5min":1.7969999999999999,"15min":15.255000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.93400000000000005,"15min":1.0249999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.081,"5min":1.236,"15min":23.792999999999999},"last":0.91800000000000004}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97199999999999998,"15min":1.0349999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.161,"5min":1.3180000000000001,"15min":23.751000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0409999999999999,"15min":1.0760000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.66700000000000004},"max":{"1min":1.3080000000000001,"5min":1.3959999999999999,"15min":7.0110000000000001},"last":1.0289999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0329999999999999,"15min":1.069},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.53200000000000003},"max":{"1min":1.4730000000000001,"5min":1.8879999999999999,"15min":15.292999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0509999999999999,"15min":1.1399999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.57599999999999996},"max":{"1min":1.3380000000000001,"5min":1.367,"15min":23.428999999999998},"last":0.98299999999999998}]},{"osd":7,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.093,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.58999999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":6.4199999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.437},"max":{"1min":1.5309999999999999,"5min":1.954,"15min":15.428000000000001},"last":0.997}]}]},{"osd":2,"up_from":14,"seq":60129542274,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17720,"kb_used_data":3440,"kb_used_omap":0,"kb_used_meta":14272,"kb_avail":94354120,"statfs":{"total":96636764160,"available":96618618880,"internally_reserved":0,"allocated":3522560,"data_stored":2789264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14614528},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.312},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":1.8640000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.35199999999999998},"max":{"1min":1.0349999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.833}]},{"osd":1,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33700000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.2410000000000001},"last":2.0139999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76500000000000001,"15min":0.73099999999999998},"min":{"1min":0.61199999999999999,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.762}]},{"osd":3,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.107,"15min":1.107},"last":1.8029999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83199999999999996,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36099999999999999},"max":{"1min":1.0329999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.5569999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.94699999999999995,"15min":0.94999999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.3400000000000001,"15min":1.371},"last":1.952},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.747,"5min":0.73499999999999999,"15min":0.58499999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.532},"last":2.0329999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.01,"15min":0.98699999999999999},"min":{"1min":0.77900000000000003,"5min":0.76100000000000001,"15min":0.622},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":2.069},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0109999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.66800000000000004,"15min":0.46999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.7989999999999999},"last":4.0620000000000003}]},{"osd":6,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99399999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":4.1239999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0609999999999999,"15min":1.044},"min":{"1min":0.83999999999999997,"5min":0.70399999999999996,"15min":0.60799999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.7270000000000001},"last":1.633}]},{"osd":7,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.097,"15min":1.0649999999999999},"min":{"1min":0.97599999999999998,"5min":0.83699999999999997,"15min":0.65900000000000003},"max":{"1min":1.748,"5min":1.748,"15min":1.76},"last":2.0979999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.55800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":4.1609999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542274,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16884,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":14912,"kb_avail":94354956,"statfs":{"total":96636764160,"available":96619474944,"internally_reserved":0,"allocated":2011136,"data_stored":1275726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15269888},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95299999999999996,"5min":0.98399999999999999,"15min":1.2190000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.36499999999999999},"max":{"1min":0.94399999999999995,"5min":1.45,"15min":1.45},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71899999999999997,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.40699999999999997},"max":{"1min":1.0960000000000001,"5min":1.141,"15min":1.1439999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.5,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90700000000000003,"5min":1.119,"15min":1.393},"last":0.71699999999999997}]},{"osd":3,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.071,"5min":1.3240000000000001,"15min":1.3520000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"max":{"1min":0.98599999999999999,"5min":1.631,"15min":1.744},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94699999999999995,"15min":0.95399999999999996},"min":{"1min":0.70999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.2190000000000001,"5min":1.456,"15min":1.609},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98199999999999998,"15min":1.0089999999999999},"min":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.60699999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.5069999999999999},"last":1.0840000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.97099999999999997},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1950000000000001,"5min":1.4199999999999999,"15min":1.8660000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.752,"5min":0.65500000000000003,"15min":0.65000000000000002},"max":{"1min":1.3080000000000001,"5min":1.407,"15min":1.5609999999999999},"last":1.212}]},{"osd":6,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.997,"15min":1.0449999999999999},"min":{"1min":0.83099999999999996,"5min":0.68999999999999995,"15min":0.66700000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.575},"last":0.999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98899999999999999},"min":{"1min":0.748,"5min":0.65600000000000003,"15min":0.65400000000000003},"max":{"1min":1.194,"5min":1.573,"15min":2.1920000000000002},"last":1.0509999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.04,"15min":1.05},"min":{"1min":0.83699999999999997,"5min":0.77900000000000003,"15min":0.73399999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":2.2320000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0840000000000001,"15min":1.099},"min":{"1min":0.82699999999999996,"5min":0.68899999999999995,"15min":0.59099999999999997},"max":{"1min":1.3839999999999999,"5min":1.5409999999999999,"15min":1.6599999999999999},"last":1.1399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542274,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16260,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94355580,"statfs":{"total":96636764160,"available":96620113920,"internally_reserved":0,"allocated":1437696,"data_stored":697484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.316},"max":{"1min":0.89600000000000002,"5min":0.98999999999999999,"15min":1.1220000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.67500000000000004},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.056,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.374},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98799999999999999,"5min":1.0509999999999999,"15min":1.2010000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.0840000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.80100000000000005},"min":{"1min":0.52200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.72599999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.266,"5min":1.351,"15min":1.423},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.57099999999999995},"max":{"1min":1.4199999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.97299999999999998}]},{"osd":5,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0269999999999999,"15min":1.0189999999999999},"min":{"1min":0.81599999999999995,"5min":0.69999999999999996,"15min":0.57599999999999996},"max":{"1min":1.325,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.292}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0589999999999999,"15min":1.071},"min":{"1min":0.77200000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.175},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.90800000000000003,"5min":0.74199999999999999,"15min":0.629},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.151}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.105,"15min":1.1180000000000001},"min":{"1min":0.90000000000000002,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.363,"5min":1.478,"15min":1.5649999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0549999999999999,"15min":1.0680000000000001},"min":{"1min":0.81000000000000005,"5min":0.73499999999999999,"15min":0.70999999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2210000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:23:27.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T11:23:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.089+0000 7f9c9b59e700 1 Processor -- start 2023-11-29T11:23:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.089+0000 7f9c9b59e700 1 -- start start 2023-11-29T11:23:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9c9c06e000 0x7f9c9c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c9c06adf0 0x7f9c9c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c06a960 con 0x7f9c9c158070 2023-11-29T11:23:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c06ceb0 con 0x7f9c9c06adf0 2023-11-29T11:23:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c06d190 con 0x7f9c9c06e000 2023-11-29T11:23:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9ad9d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c9c06adf0 0x7f9c9c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c99d9b700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9c9c158070 0x7f9c9c0ad510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38154/0 (socket says 172.21.15.81:38154) 2023-11-29T11:23:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c99d9b700 1 -- 172.21.15.81:0/842747147 learned_addr learned my addr 172.21.15.81:0/842747147 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9ad9d700 1 --2- 172.21.15.81:0/842747147 >> v2:172.21.15.81:3300/0 conn(0x7f9c9c06adf0 0x7f9c9c15bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53324/0 (socket says 172.21.15.81:53324) 2023-11-29T11:23:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9a59c700 1 --2- 172.21.15.81:0/842747147 >> v2:172.21.15.176:3300/0 conn(0x7f9c9c06e000 0x7f9c9c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9ad9d700 1 -- 172.21.15.81:0/842747147 >> v2:172.21.15.176:3300/0 conn(0x7f9c9c06e000 msgr2=0x7f9c9c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9ad9d700 1 --2- 172.21.15.81:0/842747147 >> v2:172.21.15.176:3300/0 conn(0x7f9c9c06e000 0x7f9c9c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9ad9d700 1 -- 172.21.15.81:0/842747147 >> v1:172.21.15.81:6789/0 conn(0x7f9c9c158070 legacy=0x7f9c9c0ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9ad9d700 1 -- 172.21.15.81:0/842747147 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c06d470 con 0x7f9c9c06adf0 2023-11-29T11:23:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9a59c700 1 --2- 172.21.15.81:0/842747147 >> v2:172.21.15.176:3300/0 conn(0x7f9c9c06e000 0x7f9c9c06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9ad9d700 1 --2- 172.21.15.81:0/842747147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c06adf0 0x7f9c9c15bad0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0cf080 tx=0x7f9c94009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd88c198e49ca48b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9959a700 1 -- 172.21.15.81:0/842747147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9400f8a0 con 0x7f9c9c06adf0 2023-11-29T11:23:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9959a700 1 -- 172.21.15.81:0/842747147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9400fa00 con 0x7f9c9c06adf0 2023-11-29T11:23:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9959a700 1 -- 172.21.15.81:0/842747147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9400fdb0 con 0x7f9c9c06adf0 2023-11-29T11:23:28.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 -- 172.21.15.81:0/842747147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c06adf0 msgr2=0x7f9c9c15bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/842747147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c06adf0 0x7f9c9c15bad0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0cf080 tx=0x7f9c94009b30 comp rx=0 tx=0).stop 2023-11-29T11:23:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 -- 172.21.15.81:0/842747147 shutdown_connections 2023-11-29T11:23:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/842747147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c06adf0 0x7f9c9c15bad0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/842747147 >> v2:172.21.15.176:3300/0 conn(0x7f9c9c06e000 0x7f9c9c06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 -- 172.21.15.81:0/842747147 >> 172.21.15.81:0/842747147 conn(0x7f9c9c0ce3e0 msgr2=0x7f9c9c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 -- 172.21.15.81:0/842747147 shutdown_connections 2023-11-29T11:23:28.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.093+0000 7f9c9b59e700 1 -- 172.21.15.81:0/842747147 wait complete. 2023-11-29T11:23:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 Processor -- start 2023-11-29T11:23:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 -- start start 2023-11-29T11:23:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9c06adf0 0x7f9c9c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c9c06e000 0x7f9c9c1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c158070 0x7f9c9c097500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0ae370 con 0x7f9c9c158070 2023-11-29T11:23:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0c4890 con 0x7f9c9c06e000 2023-11-29T11:23:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0c3d10 con 0x7f9c9c06adf0 2023-11-29T11:23:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c158070 0x7f9c9c097500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c158070 0x7f9c9c097500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53328/0 (socket says 172.21.15.81:53328) 2023-11-29T11:23:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 -- 172.21.15.81:0/1601755585 learned_addr learned my addr 172.21.15.81:0/1601755585 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c99d9b700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c9c06e000 0x7f9c9c1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:28.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9a59c700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9c06adf0 0x7f9c9c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 -- 172.21.15.81:0/1601755585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9c06adf0 msgr2=0x7f9c9c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9c06adf0 0x7f9c9c0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 -- 172.21.15.81:0/1601755585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c9c06e000 msgr2=0x7f9c9c1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c9c06e000 0x7f9c9c1586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 -- 172.21.15.81:0/1601755585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940094b0 con 0x7f9c9c158070 2023-11-29T11:23:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9ad9d700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c158070 0x7f9c9c097500 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f9c940090b0 tx=0x7f9c94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c8affd700 1 -- 172.21.15.81:0/1601755585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9401e070 con 0x7f9c9c158070 2023-11-29T11:23:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c8affd700 1 -- 172.21.15.81:0/1601755585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c940036c0 con 0x7f9c9c158070 2023-11-29T11:23:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c06b250 con 0x7f9c9c158070 2023-11-29T11:23:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c8affd700 1 -- 172.21.15.81:0/1601755585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94003a70 con 0x7f9c9c158070 2023-11-29T11:23:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.097+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c06a5f0 con 0x7f9c9c158070 2023-11-29T11:23:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.101+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c06b3e0 con 0x7f9c9c158070 2023-11-29T11:23:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.101+0000 7f9c8affd700 1 -- 172.21.15.81:0/1601755585 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9c94003bd0 con 0x7f9c9c158070 2023-11-29T11:23:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.101+0000 7f9c8affd700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c7c064ee0 0x7f9c7c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.101+0000 7f9c8affd700 1 -- 172.21.15.81:0/1601755585 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9c94084ce0 con 0x7f9c9c158070 2023-11-29T11:23:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.101+0000 7f9c9a59c700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c7c064ee0 0x7f9c7c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.101+0000 7f9c9a59c700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c7c064ee0 0x7f9c7c067390 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006fd0 tx=0x7f9c90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.109+0000 7f9c8affd700 1 -- 172.21.15.81:0/1601755585 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9c94052ef0 con 0x7f9c9c158070 2023-11-29T11:23:28.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.269+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c9c0ae4b0 con 0x7f9c9c158070 2023-11-29T11:23:28.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c8affd700 1 -- 172.21.15.81:0/1601755585 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+14583 (secure 0 0 0) 0x7f9c94003e60 con 0x7f9c9c158070 2023-11-29T11:23:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:28.280 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":116,"fsid":"8e4db050-5755-42f7-ba76-f62443203ed8","created":"2023-11-29T11:12:35.015175+0000","modified":"2023-11-29T11:23:25.223710+0000","last_up_change":"2023-11-29T11:12:45.058147+0000","last_in_change":"2023-11-29T11:12:37.114273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-29T11:12:45.833054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-29T11:12:46.489736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ceedc3b-b336-48f1-9c10-c8dbdb875268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":36537},{"type":"v1","addr":"172.21.15.81:6805","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":36537},{"type":"v1","addr":"172.21.15.81:6812","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":36537},{"type":"v1","addr":"172.21.15.81:6822","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":36537},{"type":"v1","addr":"172.21.15.81:6818","nonce":36537}]},"public_addr":"172.21.15.81:6805/36537","cluster_addr":"172.21.15.81:6812/36537","heartbeat_back_addr":"172.21.15.81:6822/36537","heartbeat_front_addr":"172.21.15.81:6818/36537","state":["exists","up"]},{"osd":1,"uuid":"0d2b15bd-daa8-455c-aba9-2539259bc473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":36538},{"type":"v1","addr":"172.21.15.81:6806","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":36538},{"type":"v1","addr":"172.21.15.81:6813","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":36538},{"type":"v1","addr":"172.21.15.81:6823","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":36538},{"type":"v1","addr":"172.21.15.81:6819","nonce":36538}]},"public_addr":"172.21.15.81:6806/36538","cluster_addr":"172.21.15.81:6813/36538","heartbeat_back_addr":"172.21.15.81:6823/36538","heartbeat_front_addr":"172.21.15.81:6819/36538","state":["exists","up"]},{"osd":2,"uuid":"b47aae37-55ec-499d-91be-b635b08e7cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":36539},{"type":"v1","addr":"172.21.15.81:6801","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":36539},{"type":"v1","addr":"172.21.15.81:6807","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":36539},{"type":"v1","addr":"172.21.15.81:6815","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":36539},{"type":"v1","addr":"172.21.15.81:6811","nonce":36539}]},"public_addr":"172.21.15.81:6801/36539","cluster_addr":"172.21.15.81:6807/36539","heartbeat_back_addr":"172.21.15.81:6815/36539","heartbeat_front_addr":"172.21.15.81:6811/36539","state":["exists","up"]},{"osd":3,"uuid":"c622b5f3-ecba-4b16-bb81-180b92cb6468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":36540},{"type":"v1","addr":"172.21.15.81:6825","nonce":36540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":36540},{"type":"v1","addr":"172.21.15.81:6827","nonce":36540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":36540},{"type":"v1","addr":"172.21.15.81:6831","nonce":36540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":36540},{"type":"v1","addr":"172.21.15.81:6829","nonce":36540}]},"public_addr":"172.21.15.81:6825/36540","cluster_addr":"172.21.15.81:6827/36540","heartbeat_back_addr":"172.21.15.81:6831/36540","heartbeat_front_addr":"172.21.15.81:6829/36540","state":["exists","up"]},{"osd":4,"uuid":"488bc6a5-2b9c-40b7-976d-5f54f5a75039","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":36811},{"type":"v1","addr":"172.21.15.176:6809","nonce":36811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":36811},{"type":"v1","addr":"172.21.15.176:6811","nonce":36811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":36811},{"type":"v1","addr":"172.21.15.176:6815","nonce":36811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":36811},{"type":"v1","addr":"172.21.15.176:6813","nonce":36811}]},"public_addr":"172.21.15.176:6809/36811","cluster_addr":"172.21.15.176:6811/36811","heartbeat_back_addr":"172.21.15.176:6815/36811","heartbeat_front_addr":"172.21.15.176:6813/36811","state":["exists","up"]},{"osd":5,"uuid":"5edd51cb-2985-49c4-bdb4-ad87cb1e7e73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":36812},{"type":"v1","addr":"172.21.15.176:6825","nonce":36812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":36812},{"type":"v1","addr":"172.21.15.176:6827","nonce":36812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":36812},{"type":"v1","addr":"172.21.15.176:6831","nonce":36812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":36812},{"type":"v1","addr":"172.21.15.176:6829","nonce":36812}]},"public_addr":"172.21.15.176:6825/36812","cluster_addr":"172.21.15.176:6827/36812","heartbeat_back_addr":"172.21.15.176:6831/36812","heartbeat_front_addr":"172.21.15.176:6829/36812","state":["exists","up"]},{"osd":6,"uuid":"8e693d1b-f26c-49d4-b955-1fdc70498cf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":36813},{"type":"v1","addr":"172.21.15.176:6817","nonce":36813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":36813},{"type":"v1","addr":"172.21.15.176:6819","nonce":36813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":36813},{"type":"v1","addr":"172.21.15.176:6823","nonce":36813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":36813},{"type":"v1","addr":"172.21.15.176:6821","nonce":36813}]},"public_addr":"172.21.15.176:6817/36813","cluster_addr":"172.21.15.176:6819/36813","heartbeat_back_addr":"172.21.15.176:6823/36813","heartbeat_front_addr":"172.21.15.176:6821/36813","state":["exists","up"]},{"osd":7,"uuid":"7ef978b7-a25c-49d4-8fe6-54fff58f713c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":36814},{"type":"v1","addr":"172.21.15.176:6801","nonce":36814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":36814},{"type":"v1","addr":"172.21.15.176:6803","nonce":36814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":36814},{"type":"v1","addr":"172.21.15.176:6807","nonce":36814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":36814},{"type":"v1","addr":"172.21.15.176:6805","nonce":36814}]},"public_addr":"172.21.15.176:6801/36814","cluster_addr":"172.21.15.176:6803/36814","heartbeat_back_addr":"172.21.15.176:6807/36814","heartbeat_front_addr":"172.21.15.176:6805/36814","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.126446+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.945948+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.445182+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.180344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:41.672592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.599666+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.697184+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-29T11:12:42.412512+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/969746689":"2023-11-30T11:23:21.237814+0000","172.21.15.81:6836/969746689":"2023-11-30T11:23:21.237814+0000","172.21.15.81:6837/665591010":"2023-11-30T11:23:14.804071+0000","172.21.15.81:6836/665591010":"2023-11-30T11:23:14.804071+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T11:23:28.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c7c064ee0 msgr2=0x7f9c7c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:28.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c7c064ee0 0x7f9c7c067390 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006fd0 tx=0x7f9c90008040 comp rx=0 tx=0).stop 2023-11-29T11:23:28.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c158070 msgr2=0x7f9c9c097500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:28.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c158070 0x7f9c9c097500 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f9c940090b0 tx=0x7f9c94004770 comp rx=0 tx=0).stop 2023-11-29T11:23:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 shutdown_connections 2023-11-29T11:23:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c7c064ee0 0x7f9c7c067390 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c9c158070 0x7f9c9c097500 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c9c06e000 0x7f9c9c1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 --2- 172.21.15.81:0/1601755585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c9c06adf0 0x7f9c9c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 >> 172.21.15.81:0/1601755585 conn(0x7f9c9c0ce3e0 msgr2=0x7f9c9c0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 shutdown_connections 2023-11-29T11:23:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:28.273+0000 7f9c9b59e700 1 -- 172.21.15.81:0/1601755585 wait complete. 2023-11-29T11:23:29.295 INFO:tasks.ceph:Scrubbing osd.0 2023-11-29T11:23:29.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-29T11:23:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.412+0000 7fddb1291700 1 Processor -- start 2023-11-29T11:23:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.412+0000 7fddb1291700 1 -- start start 2023-11-29T11:23:29.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddb1291700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 0x7fddac06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddb1291700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac06a9c0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddb1291700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac06aca0 con 0x7fddac0b1ae0 2023-11-29T11:23:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddb1291700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0d0ab0 con 0x7fddac06a4c0 2023-11-29T11:23:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddb0a90700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fddac0cf0e0 0x7fddac0b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38156/0 (socket says 172.21.15.81:38156) 2023-11-29T11:23:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddb0a90700 1 -- 172.21.15.81:0/1439454824 learned_addr learned my addr 172.21.15.81:0/1439454824 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddab7fe700 1 --2- 172.21.15.81:0/1439454824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 0x7fddac06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddaaffd700 1 -- 172.21.15.81:0/1439454824 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881710559 0 0) 0x7fddac06a9c0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddaaffd700 1 -- 172.21.15.81:0/1439454824 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd980035d0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddaaffd700 1 -- 172.21.15.81:0/1439454824 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406577883 0 0) 0x7fddac06aca0 con 0x7fddac0b1ae0 2023-11-29T11:23:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddab7fe700 1 -- 172.21.15.81:0/1439454824 >> v1:172.21.15.176:6789/0 conn(0x7fddac0b1ae0 legacy=0x7fddac0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddab7fe700 1 -- 172.21.15.81:0/1439454824 >> v1:172.21.15.81:6789/0 conn(0x7fddac0cf0e0 legacy=0x7fddac0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddab7fe700 1 -- 172.21.15.81:0/1439454824 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac06af80 con 0x7fddac06a4c0 2023-11-29T11:23:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddab7fe700 1 --2- 172.21.15.81:0/1439454824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 0x7fddac06d8e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009880 tx=0x7fdd94009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc1312521ffeaf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddaaffd700 1 -- 172.21.15.81:0/1439454824 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40019f0 con 0x7fddac06a4c0 2023-11-29T11:23:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddaaffd700 1 -- 172.21.15.81:0/1439454824 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94010590 con 0x7fddac06a4c0 2023-11-29T11:23:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.416+0000 7fddaaffd700 1 -- 172.21.15.81:0/1439454824 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94010940 con 0x7fddac06a4c0 2023-11-29T11:23:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 -- 172.21.15.81:0/1439454824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 msgr2=0x7fddac06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 --2- 172.21.15.81:0/1439454824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 0x7fddac06d8e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009880 tx=0x7fdd94009b90 comp rx=0 tx=0).stop 2023-11-29T11:23:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 -- 172.21.15.81:0/1439454824 shutdown_connections 2023-11-29T11:23:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 --2- 172.21.15.81:0/1439454824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 0x7fddac06d8e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 -- 172.21.15.81:0/1439454824 >> 172.21.15.81:0/1439454824 conn(0x7fddac09bbd0 msgr2=0x7fddac0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:29.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 -- 172.21.15.81:0/1439454824 shutdown_connections 2023-11-29T11:23:29.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 -- 172.21.15.81:0/1439454824 wait complete. 2023-11-29T11:23:29.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 Processor -- start 2023-11-29T11:23:29.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.420+0000 7fddb1291700 1 -- start start 2023-11-29T11:23:29.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 0x7fddac15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0b1ae0 0x7fddac15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0cf0e0 0x7fddac15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0c6db0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac15d4a0 con 0x7fddac0b1ae0 2023-11-29T11:23:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac15d780 con 0x7fddac06a4c0 2023-11-29T11:23:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0cf0e0 0x7fddac15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddabfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 0x7fddac15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0cf0e0 0x7fddac15bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53344/0 (socket says 172.21.15.81:53344) 2023-11-29T11:23:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 -- 172.21.15.81:0/3259153531 learned_addr learned my addr 172.21.15.81:0/3259153531 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddab7fe700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0b1ae0 0x7fddac15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 -- 172.21.15.81:0/3259153531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 msgr2=0x7fddac15cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac06a4c0 0x7fddac15cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 -- 172.21.15.81:0/3259153531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0b1ae0 msgr2=0x7fddac15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac0b1ae0 0x7fddac15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 -- 172.21.15.81:0/3259153531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940094b0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb0a90700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0cf0e0 0x7fddac15bf10 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fdda4002090 tx=0x7fdda400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400acd0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400ae50 con 0x7fddac0cf0e0 2023-11-29T11:23:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac0b1eb0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4007310 con 0x7fddac0cf0e0 2023-11-29T11:23:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac0b4380 con 0x7fddac0cf0e0 2023-11-29T11:23:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.424+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fddac0b60e0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdda401a030 con 0x7fddac0cf0e0 2023-11-29T11:23:29.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fdda8ff9700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd8c064ee0 0x7fdd8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fddabfff700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd8c064ee0 0x7fdd8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fdda4081c70 con 0x7fddac0cf0e0 2023-11-29T11:23:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fdda8ff9700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fdd8c06b890 0x7fdd8c06dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd8c06e390 con 0x7fdd8c06b890 2023-11-29T11:23:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdda40862a0 con 0x7fddac0cf0e0 2023-11-29T11:23:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fddab7fe700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fdd8c06b890 0x7fdd8c06dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fddabfff700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd8c064ee0 0x7fdd8c067390 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c007fd0 tx=0x7fdd9c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.428+0000 7fddab7fe700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fdd8c06b890 0x7fdd8c06dcc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.432+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 <== osd.0 v2:172.21.15.81:6802/36537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdd8c06e390 con 0x7fdd8c06b890 2023-11-29T11:23:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 --> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fddac072500 con 0x7fdd8c06b890 2023-11-29T11:23:29.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fdda8ff9700 1 -- 172.21.15.81:0/3259153531 <== osd.0 v2:172.21.15.81:6802/36537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fddac072500 con 0x7fdd8c06b890 2023-11-29T11:23:29.456 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-29T11:23:29.456 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fdd8c06b890 msgr2=0x7fdd8c06dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6802/36537,v1:172.21.15.81:6805/36537] conn(0x7fdd8c06b890 0x7fdd8c06dcc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd8c064ee0 msgr2=0x7fdd8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fdd8c064ee0 0x7fdd8c067390 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c007fd0 tx=0x7fdd9c009040 comp rx=0 tx=0).stop 2023-11-29T11:23:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0cf0e0 msgr2=0x7fddac15bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 --2- 172.21.15.81:0/3259153531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddac0cf0e0 0x7fddac15bf10 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fdda4002090 tx=0x7fdda400a340 comp rx=0 tx=0).stop 2023-11-29T11:23:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb0a90700 1 -- 172.21.15.81:0/3259153531 reap_dead start 2023-11-29T11:23:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 shutdown_connections 2023-11-29T11:23:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 >> 172.21.15.81:0/3259153531 conn(0x7fddac09bbd0 msgr2=0x7fddac06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 shutdown_connections 2023-11-29T11:23:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.448+0000 7fddb1291700 1 -- 172.21.15.81:0/3259153531 wait complete. 2023-11-29T11:23:29.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-29T11:23:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ece688700 1 Processor -- start 2023-11-29T11:23:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ece688700 1 -- start start 2023-11-29T11:23:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ece688700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4ec8069c40 0x7f4ec815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ece688700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec80c9010 con 0x7f4ec80c98a0 2023-11-29T11:23:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ece688700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec80c92f0 con 0x7f4ec81510d0 2023-11-29T11:23:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ece688700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec80c95d0 con 0x7f4ec8069c40 2023-11-29T11:23:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4eccc25700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ec80c98a0 0x7f4ec80c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38160/0 (socket says 172.21.15.81:38160) 2023-11-29T11:23:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4eccc25700 1 -- 172.21.15.81:0/1406631145 learned_addr learned my addr 172.21.15.81:0/1406631145 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ec77fe700 1 --2- 172.21.15.81:0/1406631145 >> v2:172.21.15.176:3300/0 conn(0x7f4ec8069c40 0x7f4ec815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ec6ffd700 1 -- 172.21.15.81:0/1406631145 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328815208 0 0) 0x7f4ec80c9010 con 0x7f4ec80c98a0 2023-11-29T11:23:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ec6ffd700 1 -- 172.21.15.81:0/1406631145 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb40035d0 con 0x7f4ec80c98a0 2023-11-29T11:23:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ec77fe700 1 -- 172.21.15.81:0/1406631145 >> v1:172.21.15.176:6789/0 conn(0x7f4ec81510d0 legacy=0x7f4ec80b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ec77fe700 1 -- 172.21.15.81:0/1406631145 >> v1:172.21.15.81:6789/0 conn(0x7f4ec80c98a0 legacy=0x7f4ec80c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ec77fe700 1 -- 172.21.15.81:0/1406631145 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8070170 con 0x7f4ec8069c40 2023-11-29T11:23:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.580+0000 7f4ec77fe700 1 --2- 172.21.15.81:0/1406631145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 0x7f4ec815b260 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009850 tx=0x7f4eb0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee2d64401392a2d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ec6ffd700 1 -- 172.21.15.81:0/1406631145 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0011830 con 0x7f4ec8069c40 2023-11-29T11:23:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ec6ffd700 1 -- 172.21.15.81:0/1406631145 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb0011990 con 0x7f4ec8069c40 2023-11-29T11:23:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ec6ffd700 1 -- 172.21.15.81:0/1406631145 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0011d00 con 0x7f4ec8069c40 2023-11-29T11:23:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ece688700 1 -- 172.21.15.81:0/1406631145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 msgr2=0x7f4ec815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ece688700 1 --2- 172.21.15.81:0/1406631145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 0x7f4ec815b260 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009850 tx=0x7f4eb0009b60 comp rx=0 tx=0).stop 2023-11-29T11:23:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ece688700 1 -- 172.21.15.81:0/1406631145 shutdown_connections 2023-11-29T11:23:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ece688700 1 --2- 172.21.15.81:0/1406631145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 0x7f4ec815b260 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ece688700 1 -- 172.21.15.81:0/1406631145 >> 172.21.15.81:0/1406631145 conn(0x7f4ec806caf0 msgr2=0x7f4ec80ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ece688700 1 -- 172.21.15.81:0/1406631145 shutdown_connections 2023-11-29T11:23:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.584+0000 7f4ece688700 1 -- 172.21.15.81:0/1406631145 wait complete. 2023-11-29T11:23:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 Processor -- start 2023-11-29T11:23:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 -- start start 2023-11-29T11:23:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 0x7f4ec81639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec80c98a0 0x7f4ec814fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec81510d0 0x7f4ec814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81505f0 con 0x7f4ec81510d0 2023-11-29T11:23:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec815b810 con 0x7f4ec8069c40 2023-11-29T11:23:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec815c020 con 0x7f4ec80c98a0 2023-11-29T11:23:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec81510d0 0x7f4ec814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec81510d0 0x7f4ec814f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53346/0 (socket says 172.21.15.81:53346) 2023-11-29T11:23:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 -- 172.21.15.81:0/1609038409 learned_addr learned my addr 172.21.15.81:0/1609038409 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:29.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ec7fff700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 0x7f4ec81639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ec77fe700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec80c98a0 0x7f4ec814fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 -- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec80c98a0 msgr2=0x7f4ec814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec80c98a0 0x7f4ec814fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 -- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 msgr2=0x7f4ec81639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 0x7f4ec81639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 -- 172.21.15.81:0/1609038409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb00094b0 con 0x7f4ec81510d0 2023-11-29T11:23:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ec7fff700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 0x7f4ec81639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4eccc25700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec81510d0 0x7f4ec814f570 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000cb40 tx=0x7f4ec000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ec4ff9700 1 -- 172.21.15.81:0/1609038409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000a9e0 con 0x7f4ec81510d0 2023-11-29T11:23:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ec4ff9700 1 -- 172.21.15.81:0/1609038409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec000ab40 con 0x7f4ec81510d0 2023-11-29T11:23:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec8164de0 con 0x7f4ec81510d0 2023-11-29T11:23:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ec4ff9700 1 -- 172.21.15.81:0/1609038409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000ce60 con 0x7f4ec81510d0 2023-11-29T11:23:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.588+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec81514a0 con 0x7f4ec81510d0 2023-11-29T11:23:29.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.592+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec8164f70 con 0x7f4ec81510d0 2023-11-29T11:23:29.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.592+0000 7f4ec4ff9700 1 -- 172.21.15.81:0/1609038409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ec0019030 con 0x7f4ec81510d0 2023-11-29T11:23:29.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.592+0000 7f4ec4ff9700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ea8064ee0 0x7f4ea8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.592+0000 7f4ec4ff9700 1 -- 172.21.15.81:0/1609038409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4ec0081780 con 0x7f4ec81510d0 2023-11-29T11:23:29.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.592+0000 7f4ec7fff700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ea8064ee0 0x7f4ea8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.592+0000 7f4ec7fff700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ea8064ee0 0x7f4ea8067390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8000f60 tx=0x7f4eb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.600+0000 7f4ec4ff9700 1 -- 172.21.15.81:0/1609038409 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ec004fa00 con 0x7f4ec81510d0 2023-11-29T11:23:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.764+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ec80c5b90 con 0x7f4ea8064ee0 2023-11-29T11:23:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.764+0000 7f4ec4ff9700 1 -- 172.21.15.81:0/1609038409 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4ec80c5b90 con 0x7f4ea8064ee0 2023-11-29T11:23:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ea8064ee0 msgr2=0x7f4ea8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ea8064ee0 0x7f4ea8067390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8000f60 tx=0x7f4eb8009040 comp rx=0 tx=0).stop 2023-11-29T11:23:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec81510d0 msgr2=0x7f4ec814f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec81510d0 0x7f4ec814f570 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000cb40 tx=0x7f4ec000cc20 comp rx=0 tx=0).stop 2023-11-29T11:23:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 shutdown_connections 2023-11-29T11:23:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f4ea8064ee0 0x7f4ea8067390 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec81510d0 0x7f4ec814f570 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec80c98a0 0x7f4ec814fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 --2- 172.21.15.81:0/1609038409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec8069c40 0x7f4ec81639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 >> 172.21.15.81:0/1609038409 conn(0x7f4ec806caf0 msgr2=0x7f4ec8164630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 shutdown_connections 2023-11-29T11:23:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.768+0000 7f4ece688700 1 -- 172.21.15.81:0/1609038409 wait complete. 2023-11-29T11:23:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2023-11-29T11:23:29.793 INFO:tasks.ceph:Scrubbing osd.1 2023-11-29T11:23:29.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-29T11:23:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692e4bc700 1 Processor -- start 2023-11-29T11:23:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692e4bc700 1 -- start start 2023-11-29T11:23:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692e4bc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f69280cf7f0 0x7f692806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692e4bc700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692806a9c0 con 0x7f69280b1ae0 2023-11-29T11:23:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692e4bc700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692806aca0 con 0x7f692806a4c0 2023-11-29T11:23:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692e4bc700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69280d0ab0 con 0x7f69280cf7f0 2023-11-29T11:23:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692d4ba700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f69280b1ae0 0x7f69280d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38152/0 (socket says 172.21.15.81:38152) 2023-11-29T11:23:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692d4ba700 1 -- 172.21.15.81:0/3507710711 learned_addr learned my addr 172.21.15.81:0/3507710711 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692dcbb700 1 --2- 172.21.15.81:0/3507710711 >> v2:172.21.15.176:3300/0 conn(0x7f69280cf7f0 0x7f692806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f691bfff700 1 -- 172.21.15.81:0/3507710711 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025977186 0 0) 0x7f692806a9c0 con 0x7f69280b1ae0 2023-11-29T11:23:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f691bfff700 1 -- 172.21.15.81:0/3507710711 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69140035d0 con 0x7f69280b1ae0 2023-11-29T11:23:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692dcbb700 1 -- 172.21.15.81:0/3507710711 >> v1:172.21.15.176:6789/0 conn(0x7f692806a4c0 legacy=0x7f69280cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692dcbb700 1 -- 172.21.15.81:0/3507710711 >> v1:172.21.15.81:6789/0 conn(0x7f69280b1ae0 legacy=0x7f69280d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692dcbb700 1 -- 172.21.15.81:0/3507710711 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692806af80 con 0x7f69280cf7f0 2023-11-29T11:23:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f692dcbb700 1 --2- 172.21.15.81:0/3507710711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69280cf7f0 0x7f692806d8e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6920009d90 tx=0x7f692000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f683ef49c599d864 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f691bfff700 1 -- 172.21.15.81:0/3507710711 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692000e070 con 0x7f69280cf7f0 2023-11-29T11:23:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f691bfff700 1 -- 172.21.15.81:0/3507710711 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692000bb20 con 0x7f69280cf7f0 2023-11-29T11:23:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.908+0000 7f691bfff700 1 -- 172.21.15.81:0/3507710711 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920012430 con 0x7f69280cf7f0 2023-11-29T11:23:29.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 -- 172.21.15.81:0/3507710711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69280cf7f0 msgr2=0x7f692806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 --2- 172.21.15.81:0/3507710711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69280cf7f0 0x7f692806d8e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6920009d90 tx=0x7f692000b330 comp rx=0 tx=0).stop 2023-11-29T11:23:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 -- 172.21.15.81:0/3507710711 shutdown_connections 2023-11-29T11:23:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 --2- 172.21.15.81:0/3507710711 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69280cf7f0 0x7f692806d8e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 -- 172.21.15.81:0/3507710711 >> 172.21.15.81:0/3507710711 conn(0x7f692809bbd0 msgr2=0x7f69280b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 -- 172.21.15.81:0/3507710711 shutdown_connections 2023-11-29T11:23:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 -- 172.21.15.81:0/3507710711 wait complete. 2023-11-29T11:23:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 Processor -- start 2023-11-29T11:23:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.912+0000 7f692e4bc700 1 -- start start 2023-11-29T11:23:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f692806a4c0 0x7f69280c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69280b1ae0 0x7f6928159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69280cf7f0 0x7f692815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280c7530 con 0x7f69280cf7f0 2023-11-29T11:23:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280c8390 con 0x7f692806a4c0 2023-11-29T11:23:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69280c7780 con 0x7f69280b1ae0 2023-11-29T11:23:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69280cf7f0 0x7f692815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69280cf7f0 0x7f692815a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38150/0 (socket says 172.21.15.81:38150) 2023-11-29T11:23:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 -- 172.21.15.81:0/3571022283 learned_addr learned my addr 172.21.15.81:0/3571022283 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692d4ba700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f692806a4c0 0x7f69280c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692ccb9700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69280b1ae0 0x7f6928159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 -- 172.21.15.81:0/3571022283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69280b1ae0 msgr2=0x7f6928159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69280b1ae0 0x7f6928159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 -- 172.21.15.81:0/3571022283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f692806a4c0 msgr2=0x7f69280c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f692806a4c0 0x7f69280c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 -- 172.21.15.81:0/3571022283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009a70 con 0x7f69280cf7f0 2023-11-29T11:23:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692dcbb700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69280cf7f0 0x7f692815a060 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f692000b680 tx=0x7f6920004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920012430 con 0x7f69280cf7f0 2023-11-29T11:23:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6920020070 con 0x7f69280cf7f0 2023-11-29T11:23:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920004280 con 0x7f69280cf7f0 2023-11-29T11:23:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69280b1eb0 con 0x7f69280cf7f0 2023-11-29T11:23:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69280b4380 con 0x7f69280cf7f0 2023-11-29T11:23:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69280b60e0 con 0x7f69280cf7f0 2023-11-29T11:23:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.916+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f692002e070 con 0x7f69280cf7f0 2023-11-29T11:23:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f6919ffb700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f690c064ee0 0x7f690c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f6920022070 con 0x7f69280cf7f0 2023-11-29T11:23:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f692d4ba700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f690c064ee0 0x7f690c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f6919ffb700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f690c06b890 0x7f690c06dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f690c06e390 con 0x7f690c06b890 2023-11-29T11:23:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69200882a0 con 0x7f69280cf7f0 2023-11-29T11:23:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f692ccb9700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f690c06b890 0x7f690c06dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f692d4ba700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f690c064ee0 0x7f690c067390 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6924007fd0 tx=0x7f6924007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f692ccb9700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f690c06b890 0x7f690c06dcc0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.920+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 <== osd.1 v2:172.21.15.81:6803/36538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f690c06e390 con 0x7f690c06b890 2023-11-29T11:23:29.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 --> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f692815f450 con 0x7f690c06b890 2023-11-29T11:23:29.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f6919ffb700 1 -- 172.21.15.81:0/3571022283 <== osd.1 v2:172.21.15.81:6803/36538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f692815f450 con 0x7f690c06b890 2023-11-29T11:23:29.947 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-29T11:23:29.947 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:29.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f690c06b890 msgr2=0x7f690c06dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6803/36538,v1:172.21.15.81:6806/36538] conn(0x7f690c06b890 0x7f690c06dcc0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f690c064ee0 msgr2=0x7f690c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f690c064ee0 0x7f690c067390 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6924007fd0 tx=0x7f6924007de0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69280cf7f0 msgr2=0x7f692815a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:29.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 --2- 172.21.15.81:0/3571022283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69280cf7f0 0x7f692815a060 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f692000b680 tx=0x7f6920004af0 comp rx=0 tx=0).stop 2023-11-29T11:23:29.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692dcbb700 1 -- 172.21.15.81:0/3571022283 reap_dead start 2023-11-29T11:23:29.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 shutdown_connections 2023-11-29T11:23:29.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 >> 172.21.15.81:0/3571022283 conn(0x7f692809bbd0 msgr2=0x7f692815bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:29.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 shutdown_connections 2023-11-29T11:23:29.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:29.940+0000 7f692e4bc700 1 -- 172.21.15.81:0/3571022283 wait complete. 2023-11-29T11:23:29.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-29T11:23:30.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 Processor -- start 2023-11-29T11:23:30.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- start start 2023-11-29T11:23:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8bc15d650 0x7fe8bc0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe8bc0cc020 0x7fe8bc0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0cc9b0 con 0x7fe8bc1594f0 2023-11-29T11:23:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc15a040 con 0x7fe8bc15d650 2023-11-29T11:23:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0cd720 con 0x7fe8bc0cc020 2023-11-29T11:23:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8ba59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8bc15d650 0x7fe8bc0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8ba59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8bc15d650 0x7fe8bc0ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38158/0 (socket says 172.21.15.81:38158) 2023-11-29T11:23:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8ba59c700 1 -- 172.21.15.81:0/459404024 learned_addr learned my addr 172.21.15.81:0/459404024 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8b9d9b700 1 --2- 172.21.15.81:0/459404024 >> v2:172.21.15.176:3300/0 conn(0x7fe8bc0cc020 0x7fe8bc0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8ba59c700 1 -- 172.21.15.81:0/459404024 >> v2:172.21.15.176:3300/0 conn(0x7fe8bc0cc020 msgr2=0x7fe8bc0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8ba59c700 1 --2- 172.21.15.81:0/459404024 >> v2:172.21.15.176:3300/0 conn(0x7fe8bc0cc020 0x7fe8bc0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8ba59c700 1 -- 172.21.15.81:0/459404024 >> v1:172.21.15.176:6789/0 conn(0x7fe8bc1594f0 legacy=0x7fe8bc159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8ba59c700 1 -- 172.21.15.81:0/459404024 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0cd990 con 0x7fe8bc15d650 2023-11-29T11:23:30.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8ba59c700 1 --2- 172.21.15.81:0/459404024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc15d650 0x7fe8bc0ce470 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cf570 tx=0x7fe8b0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce85d530aecad5d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8b959a700 1 -- 172.21.15.81:0/459404024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0011830 con 0x7fe8bc15d650 2023-11-29T11:23:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8b959a700 1 -- 172.21.15.81:0/459404024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0011990 con 0x7fe8bc15d650 2023-11-29T11:23:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8b959a700 1 -- 172.21.15.81:0/459404024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0011d20 con 0x7fe8bc15d650 2023-11-29T11:23:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- 172.21.15.81:0/459404024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc15d650 msgr2=0x7fe8bc0ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/459404024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc15d650 0x7fe8bc0ce470 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cf570 tx=0x7fe8b0009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- 172.21.15.81:0/459404024 shutdown_connections 2023-11-29T11:23:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/459404024 >> v2:172.21.15.176:3300/0 conn(0x7fe8bc0cc020 0x7fe8bc0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/459404024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc15d650 0x7fe8bc0ce470 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- 172.21.15.81:0/459404024 >> 172.21.15.81:0/459404024 conn(0x7fe8bc06ec40 msgr2=0x7fe8bc0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- 172.21.15.81:0/459404024 shutdown_connections 2023-11-29T11:23:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.068+0000 7fe8bb59e700 1 -- 172.21.15.81:0/459404024 wait complete. 2023-11-29T11:23:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bb59e700 1 Processor -- start 2023-11-29T11:23:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bb59e700 1 -- start start 2023-11-29T11:23:30.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bb59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0cc020 0x7fe8bc0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc1594f0 0x7fe8bc15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bb59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc15d650 0x7fe8bc158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bb59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0c4310 con 0x7fe8bc1594f0 2023-11-29T11:23:30.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bb59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0c45f0 con 0x7fe8bc15d650 2023-11-29T11:23:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bb59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0c48d0 con 0x7fe8bc0cc020 2023-11-29T11:23:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8b9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc1594f0 0x7fe8bc15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8b9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc1594f0 0x7fe8bc15ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38160/0 (socket says 172.21.15.81:38160) 2023-11-29T11:23:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8b9d9b700 1 -- 172.21.15.81:0/3756691053 learned_addr learned my addr 172.21.15.81:0/3756691053 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8bad9d700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc15d650 0x7fe8bc158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8ba59c700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0cc020 0x7fe8bc0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8b9d9b700 1 -- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0cc020 msgr2=0x7fe8bc0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8b9d9b700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0cc020 0x7fe8bc0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8b9d9b700 1 -- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc15d650 msgr2=0x7fe8bc158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8b9d9b700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc15d650 0x7fe8bc158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8b9d9b700 1 -- 172.21.15.81:0/3756691053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009570 con 0x7fe8bc1594f0 2023-11-29T11:23:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.072+0000 7fe8ba59c700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0cc020 0x7fe8bc0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8b9d9b700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc1594f0 0x7fe8bc15ad10 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00efc0 tx=0x7fe8ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8aaffd700 1 -- 172.21.15.81:0/3756691053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac00cdc0 con 0x7fe8bc1594f0 2023-11-29T11:23:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8aaffd700 1 -- 172.21.15.81:0/3756691053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac00f040 con 0x7fe8bc1594f0 2023-11-29T11:23:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc0cdf50 con 0x7fe8bc1594f0 2023-11-29T11:23:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8aaffd700 1 -- 172.21.15.81:0/3756691053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0146a0 con 0x7fe8bc1594f0 2023-11-29T11:23:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc0cdc70 con 0x7fe8bc1594f0 2023-11-29T11:23:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc15a250 con 0x7fe8bc1594f0 2023-11-29T11:23:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8aaffd700 1 -- 172.21.15.81:0/3756691053 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe8ac014800 con 0x7fe8bc1594f0 2023-11-29T11:23:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.076+0000 7fe8aaffd700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe89c064ee0 0x7fe89c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.080+0000 7fe8aaffd700 1 -- 172.21.15.81:0/3756691053 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fe8ac082710 con 0x7fe8bc1594f0 2023-11-29T11:23:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.080+0000 7fe8ba59c700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe89c064ee0 0x7fe89c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.080+0000 7fe8ba59c700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe89c064ee0 0x7fe89c067390 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0000c00 tx=0x7fe8b0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.084+0000 7fe8aaffd700 1 -- 172.21.15.81:0/3756691053 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe8ac050a10 con 0x7fe8bc1594f0 2023-11-29T11:23:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.244+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8bc072c20 con 0x7fe89c064ee0 2023-11-29T11:23:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.244+0000 7fe8aaffd700 1 -- 172.21.15.81:0/3756691053 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe8bc072c20 con 0x7fe89c064ee0 2023-11-29T11:23:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe89c064ee0 msgr2=0x7fe89c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe89c064ee0 0x7fe89c067390 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0000c00 tx=0x7fe8b0008030 comp rx=0 tx=0).stop 2023-11-29T11:23:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc1594f0 msgr2=0x7fe8bc15ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc1594f0 0x7fe8bc15ad10 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00efc0 tx=0x7fe8ac00c3a0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 shutdown_connections 2023-11-29T11:23:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe89c064ee0 0x7fe89c067390 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc15d650 0x7fe8bc158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8bc1594f0 0x7fe8bc15ad10 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 --2- 172.21.15.81:0/3756691053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0cc020 0x7fe8bc0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 >> 172.21.15.81:0/3756691053 conn(0x7fe8bc06ec40 msgr2=0x7fe8bc15c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 shutdown_connections 2023-11-29T11:23:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.248+0000 7fe8bb59e700 1 -- 172.21.15.81:0/3756691053 wait complete. 2023-11-29T11:23:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2023-11-29T11:23:30.268 INFO:tasks.ceph:Scrubbing osd.2 2023-11-29T11:23:30.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-29T11:23:30.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.380+0000 7f0b55888700 1 Processor -- start 2023-11-29T11:23:30.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.380+0000 7f0b55888700 1 -- start start 2023-11-29T11:23:30.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b50150070 0x7f0b500ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b500cb510 0x7f0b500cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5015a3c0 con 0x7f0b50159690 2023-11-29T11:23:30.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5015a1b0 con 0x7f0b50150070 2023-11-29T11:23:30.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500cec90 con 0x7f0b500cb510 2023-11-29T11:23:30.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b54886700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b50150070 0x7f0b500ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b54886700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b50150070 0x7f0b500ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38162/0 (socket says 172.21.15.81:38162) 2023-11-29T11:23:30.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b54886700 1 -- 172.21.15.81:0/2610351938 learned_addr learned my addr 172.21.15.81:0/2610351938 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:30.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b4ffff700 1 --2- 172.21.15.81:0/2610351938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b500cb510 0x7f0b500cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b54886700 1 -- 172.21.15.81:0/2610351938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b500cb510 msgr2=0x7f0b500cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b54886700 1 --2- 172.21.15.81:0/2610351938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b500cb510 0x7f0b500cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b54886700 1 -- 172.21.15.81:0/2610351938 >> v1:172.21.15.176:6789/0 conn(0x7f0b50159690 legacy=0x7f0b50159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b54886700 1 -- 172.21.15.81:0/2610351938 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500cdc70 con 0x7f0b50150070 2023-11-29T11:23:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b54886700 1 --2- 172.21.15.81:0/2610351938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50150070 0x7f0b500ce750 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009910 tx=0x7f0b40009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a07b3fc1754a941 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b4f7fe700 1 -- 172.21.15.81:0/2610351938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000ba60 con 0x7f0b50150070 2023-11-29T11:23:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b4f7fe700 1 -- 172.21.15.81:0/2610351938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000bbc0 con 0x7f0b50150070 2023-11-29T11:23:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b4f7fe700 1 -- 172.21.15.81:0/2610351938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40009e60 con 0x7f0b50150070 2023-11-29T11:23:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 -- 172.21.15.81:0/2610351938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50150070 msgr2=0x7f0b500ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 --2- 172.21.15.81:0/2610351938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50150070 0x7f0b500ce750 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009910 tx=0x7f0b40009c20 comp rx=0 tx=0).stop 2023-11-29T11:23:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 -- 172.21.15.81:0/2610351938 shutdown_connections 2023-11-29T11:23:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 --2- 172.21.15.81:0/2610351938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b500cb510 0x7f0b500cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 --2- 172.21.15.81:0/2610351938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50150070 0x7f0b500ce750 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 -- 172.21.15.81:0/2610351938 >> 172.21.15.81:0/2610351938 conn(0x7f0b5006c6b0 msgr2=0x7f0b5006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 -- 172.21.15.81:0/2610351938 shutdown_connections 2023-11-29T11:23:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.384+0000 7f0b55888700 1 -- 172.21.15.81:0/2610351938 wait complete. 2023-11-29T11:23:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 Processor -- start 2023-11-29T11:23:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 -- start start 2023-11-29T11:23:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b500cb510 0x7f0b500afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b50150070 0x7f0b501f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50159690 0x7f0b501f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500c2990 con 0x7f0b50159690 2023-11-29T11:23:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50144190 con 0x7f0b500cb510 2023-11-29T11:23:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50143eb0 con 0x7f0b50150070 2023-11-29T11:23:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50159690 0x7f0b501f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50159690 0x7f0b501f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38178/0 (socket says 172.21.15.81:38178) 2023-11-29T11:23:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 -- 172.21.15.81:0/4054671248 learned_addr learned my addr 172.21.15.81:0/4054671248 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b54886700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b500cb510 0x7f0b500afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b4ffff700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b50150070 0x7f0b501f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 -- 172.21.15.81:0/4054671248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b50150070 msgr2=0x7f0b501f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b50150070 0x7f0b501f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 -- 172.21.15.81:0/4054671248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b500cb510 msgr2=0x7f0b500afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b500cb510 0x7f0b500afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 -- 172.21.15.81:0/4054671248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40009570 con 0x7f0b50159690 2023-11-29T11:23:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55087700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50159690 0x7f0b501f38e0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800cb50 tx=0x7f0b4800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48003c20 con 0x7f0b50159690 2023-11-29T11:23:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48003d80 con 0x7f0b50159690 2023-11-29T11:23:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b500ce230 con 0x7f0b50159690 2023-11-29T11:23:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800aac0 con 0x7f0b50159690 2023-11-29T11:23:30.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.388+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b500cdf50 con 0x7f0b50159690 2023-11-29T11:23:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b500cbea0 con 0x7f0b50159690 2023-11-29T11:23:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0b48010050 con 0x7f0b50159690 2023-11-29T11:23:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b4d7fa700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b3c064f10 0x7f0b3c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0b48081b50 con 0x7f0b50159690 2023-11-29T11:23:30.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b54886700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b3c064f10 0x7f0b3c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b4d7fa700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f0b3c06b8c0 0x7f0b3c06dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b3c06e3c0 con 0x7f0b3c06b8c0 2023-11-29T11:23:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b480862a0 con 0x7f0b50159690 2023-11-29T11:23:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b4ffff700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f0b3c06b8c0 0x7f0b3c06dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b54886700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b3c064f10 0x7f0b3c0673c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0b40000c00 tx=0x7f0b40008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.392+0000 7f0b4ffff700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f0b3c06b8c0 0x7f0b3c06dcf0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.396+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 <== osd.2 v2:172.21.15.81:6800/36539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0b3c06e3c0 con 0x7f0b3c06b8c0 2023-11-29T11:23:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.412+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 --> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0b50072c20 con 0x7f0b3c06b8c0 2023-11-29T11:23:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.412+0000 7f0b4d7fa700 1 -- 172.21.15.81:0/4054671248 <== osd.2 v2:172.21.15.81:6800/36539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0b50072c20 con 0x7f0b3c06b8c0 2023-11-29T11:23:30.422 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-29T11:23:30.423 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.412+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f0b3c06b8c0 msgr2=0x7f0b3c06dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.412+0000 7f0b55888700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6800/36539,v1:172.21.15.81:6801/36539] conn(0x7f0b3c06b8c0 0x7f0b3c06dcf0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b3c064f10 msgr2=0x7f0b3c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55888700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0b3c064f10 0x7f0b3c0673c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0b40000c00 tx=0x7f0b40008030 comp rx=0 tx=0).stop 2023-11-29T11:23:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50159690 msgr2=0x7f0b501f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55888700 1 --2- 172.21.15.81:0/4054671248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b50159690 0x7f0b501f38e0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800cb50 tx=0x7f0b4800ce60 comp rx=0 tx=0).stop 2023-11-29T11:23:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55087700 1 -- 172.21.15.81:0/4054671248 reap_dead start 2023-11-29T11:23:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 shutdown_connections 2023-11-29T11:23:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 >> 172.21.15.81:0/4054671248 conn(0x7f0b5006c6b0 msgr2=0x7f0b500cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 shutdown_connections 2023-11-29T11:23:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.416+0000 7f0b55888700 1 -- 172.21.15.81:0/4054671248 wait complete. 2023-11-29T11:23:30.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-29T11:23:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83aab49700 1 Processor -- start 2023-11-29T11:23:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83aab49700 1 -- start start 2023-11-29T11:23:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83aab49700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83a40c1ac0 0x7f83a4069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83aab49700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40cae70 con 0x7f83a41606b0 2023-11-29T11:23:30.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83aab49700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40cbc10 con 0x7f83a40ceef0 2023-11-29T11:23:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83aab49700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a40cb130 con 0x7f83a40c1ac0 2023-11-29T11:23:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a9346700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83a40c1ac0 0x7f83a4069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a9b47700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f83a41606b0 0x7f83a40c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38154/0 (socket says 172.21.15.81:38154) 2023-11-29T11:23:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a9b47700 1 -- 172.21.15.81:0/4039309888 learned_addr learned my addr 172.21.15.81:0/4039309888 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a8b45700 1 -- 172.21.15.81:0/4039309888 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088005464 0 0) 0x7f83a40cae70 con 0x7f83a41606b0 2023-11-29T11:23:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a9346700 1 -- 172.21.15.81:0/4039309888 >> v1:172.21.15.176:6789/0 conn(0x7f83a40ceef0 legacy=0x7f83a406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:30.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a9346700 1 -- 172.21.15.81:0/4039309888 >> v1:172.21.15.81:6789/0 conn(0x7f83a41606b0 legacy=0x7f83a40c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a9346700 1 -- 172.21.15.81:0/4039309888 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40cb410 con 0x7f83a40c1ac0 2023-11-29T11:23:30.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a9346700 1 --2- 172.21.15.81:0/4039309888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4069c40 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f839c009d90 tx=0x7f839c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cd1f75a666fd0f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a8b45700 1 -- 172.21.15.81:0/4039309888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00e070 con 0x7f83a40c1ac0 2023-11-29T11:23:30.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a8b45700 1 -- 172.21.15.81:0/4039309888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c00bb90 con 0x7f83a40c1ac0 2023-11-29T11:23:30.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.548+0000 7f83a8b45700 1 -- 172.21.15.81:0/4039309888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c003a40 con 0x7f83a40c1ac0 2023-11-29T11:23:30.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- 172.21.15.81:0/4039309888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 msgr2=0x7f83a4069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 --2- 172.21.15.81:0/4039309888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4069c40 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f839c009d90 tx=0x7f839c00b330 comp rx=0 tx=0).stop 2023-11-29T11:23:30.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- 172.21.15.81:0/4039309888 shutdown_connections 2023-11-29T11:23:30.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 --2- 172.21.15.81:0/4039309888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4069c40 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- 172.21.15.81:0/4039309888 >> 172.21.15.81:0/4039309888 conn(0x7f83a40ce3e0 msgr2=0x7f83a40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:30.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- 172.21.15.81:0/4039309888 shutdown_connections 2023-11-29T11:23:30.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- 172.21.15.81:0/4039309888 wait complete. 2023-11-29T11:23:30.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 Processor -- start 2023-11-29T11:23:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- start start 2023-11-29T11:23:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a40ceef0 0x7f83a4163810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83a41606b0 0x7f83a4162d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4163d50 con 0x7f83a40c1ac0 2023-11-29T11:23:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40c2e60 con 0x7f83a41606b0 2023-11-29T11:23:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aab49700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40c2250 con 0x7f83a40ceef0 2023-11-29T11:23:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9b47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9b47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4161020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38202/0 (socket says 172.21.15.81:38202) 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9b47700 1 -- 172.21.15.81:0/2815791489 learned_addr learned my addr 172.21.15.81:0/2815791489 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9346700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a40ceef0 0x7f83a4163810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aa348700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83a41606b0 0x7f83a4162d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9b47700 1 -- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a40ceef0 msgr2=0x7f83a4163810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9b47700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a40ceef0 0x7f83a4163810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9b47700 1 -- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83a41606b0 msgr2=0x7f83a4162d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9b47700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83a41606b0 0x7f83a4162d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83a9b47700 1 -- 172.21.15.81:0/2815791489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009a70 con 0x7f83a40c1ac0 2023-11-29T11:23:30.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.552+0000 7f83aa348700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83a41606b0 0x7f83a4162d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:30.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f83a9b47700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4161020 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c4e0 tx=0x7f83a000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f839a7fc700 1 -- 172.21.15.81:0/2815791489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0004ca0 con 0x7f83a40c1ac0 2023-11-29T11:23:30.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f839a7fc700 1 -- 172.21.15.81:0/2815791489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a0004e20 con 0x7f83a40c1ac0 2023-11-29T11:23:30.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a40b36c0 con 0x7f83a40c1ac0 2023-11-29T11:23:30.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f839a7fc700 1 -- 172.21.15.81:0/2815791489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0007310 con 0x7f83a40c1ac0 2023-11-29T11:23:30.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a40cb6f0 con 0x7f83a40c1ac0 2023-11-29T11:23:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a40ad610 con 0x7f83a40c1ac0 2023-11-29T11:23:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f839a7fc700 1 -- 172.21.15.81:0/2815791489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f83a001a020 con 0x7f83a40c1ac0 2023-11-29T11:23:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f839a7fc700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8388064ee0 0x7f8388067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f839a7fc700 1 -- 172.21.15.81:0/2815791489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f83a0081990 con 0x7f83a40c1ac0 2023-11-29T11:23:30.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.556+0000 7f83a9346700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8388064ee0 0x7f8388067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.560+0000 7f83a9346700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8388064ee0 0x7f8388067390 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c1eb0 tx=0x7f839c011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.560+0000 7f839a7fc700 1 -- 172.21.15.81:0/2815791489 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f83a004fc00 con 0x7f83a40c1ac0 2023-11-29T11:23:30.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.724+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f83a4072500 con 0x7f8388064ee0 2023-11-29T11:23:30.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.724+0000 7f839a7fc700 1 -- 172.21.15.81:0/2815791489 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83a4072500 con 0x7f8388064ee0 2023-11-29T11:23:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8388064ee0 msgr2=0x7f8388067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8388064ee0 0x7f8388067390 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c1eb0 tx=0x7f839c011000 comp rx=0 tx=0).stop 2023-11-29T11:23:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 msgr2=0x7f83a4161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4161020 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c4e0 tx=0x7f83a000c8a0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 shutdown_connections 2023-11-29T11:23:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f8388064ee0 0x7f8388067390 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83a41606b0 0x7f83a4162d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a40ceef0 0x7f83a4163810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 --2- 172.21.15.81:0/2815791489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a40c1ac0 0x7f83a4161020 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 >> 172.21.15.81:0/2815791489 conn(0x7f83a40ce3e0 msgr2=0x7f83a40b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 shutdown_connections 2023-11-29T11:23:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.728+0000 7f83aab49700 1 -- 172.21.15.81:0/2815791489 wait complete. 2023-11-29T11:23:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2023-11-29T11:23:30.747 INFO:tasks.ceph:Scrubbing osd.3 2023-11-29T11:23:30.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-29T11:23:30.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.860+0000 7fe55286d700 1 Processor -- start 2023-11-29T11:23:30.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.860+0000 7fe55286d700 1 -- start start 2023-11-29T11:23:30.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe54c0b1ae0 0x7fe54c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe54c06a4c0 0x7fe54c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 0x7fe54c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c0cfa80 con 0x7fe54c0b1ae0 2023-11-29T11:23:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c06a9c0 con 0x7fe54c06a4c0 2023-11-29T11:23:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c06aca0 con 0x7fe54c0cf0e0 2023-11-29T11:23:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe54c0b1ae0 0x7fe54c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe54c0b1ae0 0x7fe54c06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38218/0 (socket says 172.21.15.81:38218) 2023-11-29T11:23:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 -- 172.21.15.81:0/3415183012 learned_addr learned my addr 172.21.15.81:0/3415183012 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55106a700 1 --2- 172.21.15.81:0/3415183012 >> v2:172.21.15.176:3300/0 conn(0x7fe54c06a4c0 0x7fe54c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55206c700 1 --2- 172.21.15.81:0/3415183012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 0x7fe54c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 -- 172.21.15.81:0/3415183012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 msgr2=0x7fe54c0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:30.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 --2- 172.21.15.81:0/3415183012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 0x7fe54c0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 -- 172.21.15.81:0/3415183012 >> v2:172.21.15.176:3300/0 conn(0x7fe54c06a4c0 msgr2=0x7fe54c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:30.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 --2- 172.21.15.81:0/3415183012 >> v2:172.21.15.176:3300/0 conn(0x7fe54c06a4c0 0x7fe54c0d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 -- 172.21.15.81:0/3415183012 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c06af80 con 0x7fe54c0b1ae0 2023-11-29T11:23:30.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55186b700 1 --2- 172.21.15.81:0/3415183012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c0b1ae0 0x7fe54c06d8e0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0b88d0 tx=0x7fe548009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4259586de614e2ce server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe550869700 1 -- 172.21.15.81:0/3415183012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548011830 con 0x7fe54c0b1ae0 2023-11-29T11:23:30.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe550869700 1 -- 172.21.15.81:0/3415183012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548011990 con 0x7fe54c0b1ae0 2023-11-29T11:23:30.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe550869700 1 -- 172.21.15.81:0/3415183012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548011d20 con 0x7fe54c0b1ae0 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 -- 172.21.15.81:0/3415183012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c0b1ae0 msgr2=0x7fe54c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 --2- 172.21.15.81:0/3415183012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c0b1ae0 0x7fe54c06d8e0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0b88d0 tx=0x7fe548009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 -- 172.21.15.81:0/3415183012 shutdown_connections 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 --2- 172.21.15.81:0/3415183012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 0x7fe54c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 --2- 172.21.15.81:0/3415183012 >> v2:172.21.15.176:3300/0 conn(0x7fe54c06a4c0 0x7fe54c0d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 --2- 172.21.15.81:0/3415183012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c0b1ae0 0x7fe54c06d8e0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 -- 172.21.15.81:0/3415183012 >> 172.21.15.81:0/3415183012 conn(0x7fe54c09bbd0 msgr2=0x7fe54c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 -- 172.21.15.81:0/3415183012 shutdown_connections 2023-11-29T11:23:30.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.864+0000 7fe55286d700 1 -- 172.21.15.81:0/3415183012 wait complete. 2023-11-29T11:23:30.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.868+0000 7fe55286d700 1 Processor -- start 2023-11-29T11:23:30.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.868+0000 7fe55286d700 1 -- start start 2023-11-29T11:23:30.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c06a4c0 0x7fe54c0d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54c0b1ae0 0x7fe54c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 0x7fe54c14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0d16c0 con 0x7fe54c06a4c0 2023-11-29T11:23:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c15d450 con 0x7fe54c0b1ae0 2023-11-29T11:23:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0d1070 con 0x7fe54c0cf0e0 2023-11-29T11:23:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c06a4c0 0x7fe54c0d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c06a4c0 0x7fe54c0d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38220/0 (socket says 172.21.15.81:38220) 2023-11-29T11:23:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 -- 172.21.15.81:0/4016756633 learned_addr learned my addr 172.21.15.81:0/4016756633 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55106a700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54c0b1ae0 0x7fe54c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55206c700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 0x7fe54c14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 -- 172.21.15.81:0/4016756633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 msgr2=0x7fe54c14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe54c0cf0e0 0x7fe54c14f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 -- 172.21.15.81:0/4016756633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54c0b1ae0 msgr2=0x7fe54c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe54c0b1ae0 0x7fe54c157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 -- 172.21.15.81:0/4016756633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009570 con 0x7fe54c06a4c0 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55186b700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c06a4c0 0x7fe54c0d1b50 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fe548009860 tx=0x7fe548004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548004240 con 0x7fe54c06a4c0 2023-11-29T11:23:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54801f070 con 0x7fe54c06a4c0 2023-11-29T11:23:30.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548004600 con 0x7fe54c06a4c0 2023-11-29T11:23:30.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54c0b1eb0 con 0x7fe54c06a4c0 2023-11-29T11:23:30.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54c0b4380 con 0x7fe54c06a4c0 2023-11-29T11:23:30.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.872+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe54c0b60e0 con 0x7fe54c06a4c0 2023-11-29T11:23:30.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe54802a020 con 0x7fe54c06a4c0 2023-11-29T11:23:30.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe53e7fc700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe530064f10 0x7fe5300673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fe548083090 con 0x7fe54c06a4c0 2023-11-29T11:23:30.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe55106a700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe530064f10 0x7fe5300673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe53e7fc700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7fe53006b750 0x7fe53006db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:30.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe53006e250 con 0x7fe53006b750 2023-11-29T11:23:30.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe548085670 con 0x7fe54c06a4c0 2023-11-29T11:23:30.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe55206c700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7fe53006b750 0x7fe53006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:30.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe55106a700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe530064f10 0x7fe5300673c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe54c15b2a0 tx=0x7fe540009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe55206c700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7fe53006b750 0x7fe53006db80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:30.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.876+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 <== osd.3 v2:172.21.15.81:6824/36540 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe53006e250 con 0x7fe53006b750 2023-11-29T11:23:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.892+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 --> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe54c0d1800 con 0x7fe53006b750 2023-11-29T11:23:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.892+0000 7fe53e7fc700 1 -- 172.21.15.81:0/4016756633 <== osd.3 v2:172.21.15.81:6824/36540 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe54400f040 con 0x7fe53006b750 2023-11-29T11:23:30.903 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:30.903 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-29T11:23:30.903 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:30.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7fe53006b750 msgr2=0x7fe53006db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6824/36540,v1:172.21.15.81:6825/36540] conn(0x7fe53006b750 0x7fe53006db80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:30.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe530064f10 msgr2=0x7fe5300673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe530064f10 0x7fe5300673c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe54c15b2a0 tx=0x7fe540009240 comp rx=0 tx=0).stop 2023-11-29T11:23:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c06a4c0 msgr2=0x7fe54c0d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 --2- 172.21.15.81:0/4016756633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe54c06a4c0 0x7fe54c0d1b50 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fe548009860 tx=0x7fe548004770 comp rx=0 tx=0).stop 2023-11-29T11:23:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55206c700 1 -- 172.21.15.81:0/4016756633 reap_dead start 2023-11-29T11:23:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 shutdown_connections 2023-11-29T11:23:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 >> 172.21.15.81:0/4016756633 conn(0x7fe54c09bbd0 msgr2=0x7fe54c15bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 shutdown_connections 2023-11-29T11:23:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:30.896+0000 7fe55286d700 1 -- 172.21.15.81:0/4016756633 wait complete. 2023-11-29T11:23:30.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-29T11:23:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.024+0000 7f0c290ae700 1 Processor -- start 2023-11-29T11:23:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.024+0000 7f0c290ae700 1 -- start start 2023-11-29T11:23:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.024+0000 7f0c290ae700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 0x7f0c240c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.024+0000 7f0c290ae700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0c2415c780 0x7f0c240cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.024+0000 7f0c290ae700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c240ce4a0 0x7f0c24071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.024+0000 7f0c290ae700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c240cdad0 con 0x7f0c240ce4a0 2023-11-29T11:23:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.024+0000 7f0c290ae700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c240cd4c0 con 0x7f0c2415c780 2023-11-29T11:23:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.024+0000 7f0c290ae700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240ca6d0 con 0x7f0c2415c3b0 2023-11-29T11:23:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c288ad700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c240ce4a0 0x7f0c24071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0c2415c780 0x7f0c240cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0c2415c780 0x7f0c240cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:57576/0 (socket says 172.21.15.81:57576) 2023-11-29T11:23:31.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 -- 172.21.15.81:0/2390643008 learned_addr learned my addr 172.21.15.81:0/2390643008 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:31.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c23fff700 1 --2- 172.21.15.81:0/2390643008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 0x7f0c240c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 -- 172.21.15.81:0/2390643008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 msgr2=0x7f0c240c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:31.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 --2- 172.21.15.81:0/2390643008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 0x7f0c240c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 -- 172.21.15.81:0/2390643008 >> v2:172.21.15.81:3300/0 conn(0x7f0c240ce4a0 msgr2=0x7f0c24071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:31.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 --2- 172.21.15.81:0/2390643008 >> v2:172.21.15.81:3300/0 conn(0x7f0c240ce4a0 0x7f0c24071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 -- 172.21.15.81:0/2390643008 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240cd760 con 0x7f0c2415c780 2023-11-29T11:23:31.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c237fe700 1 --2- 172.21.15.81:0/2390643008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 0x7f0c240cdf60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0c24070480 tx=0x7f0c0c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6222eae43c4c3ed0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c22ffd700 1 -- 172.21.15.81:0/2390643008 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011830 con 0x7f0c2415c780 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c22ffd700 1 -- 172.21.15.81:0/2390643008 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c011990 con 0x7f0c2415c780 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c22ffd700 1 -- 172.21.15.81:0/2390643008 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011d20 con 0x7f0c2415c780 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 -- 172.21.15.81:0/2390643008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 msgr2=0x7f0c240cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 --2- 172.21.15.81:0/2390643008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 0x7f0c240cdf60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0c24070480 tx=0x7f0c0c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 -- 172.21.15.81:0/2390643008 shutdown_connections 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 --2- 172.21.15.81:0/2390643008 >> v2:172.21.15.81:3300/0 conn(0x7f0c240ce4a0 0x7f0c24071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 --2- 172.21.15.81:0/2390643008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 0x7f0c240cdf60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 --2- 172.21.15.81:0/2390643008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 0x7f0c240c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 -- 172.21.15.81:0/2390643008 >> 172.21.15.81:0/2390643008 conn(0x7f0c240b1d40 msgr2=0x7f0c240cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 -- 172.21.15.81:0/2390643008 shutdown_connections 2023-11-29T11:23:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.028+0000 7f0c290ae700 1 -- 172.21.15.81:0/2390643008 wait complete. 2023-11-29T11:23:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 Processor -- start 2023-11-29T11:23:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 -- start start 2023-11-29T11:23:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c240ce4a0 0x7f0c24154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 0x7f0c240b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 0x7f0c240b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2415cc00 con 0x7f0c240ce4a0 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2415d3d0 con 0x7f0c2415c780 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2415ce10 con 0x7f0c2415c3b0 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c240ce4a0 0x7f0c24154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c240ce4a0 0x7f0c24154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38230/0 (socket says 172.21.15.81:38230) 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 -- 172.21.15.81:0/1673988135 learned_addr learned my addr 172.21.15.81:0/1673988135 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c237fe700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 0x7f0c240b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c288ad700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 0x7f0c240b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 -- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 msgr2=0x7f0c240b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 0x7f0c240b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 -- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 msgr2=0x7f0c240b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 0x7f0c240b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 -- 172.21.15.81:0/1673988135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c009570 con 0x7f0c240ce4a0 2023-11-29T11:23:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c288ad700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 0x7f0c240b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c23fff700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c240ce4a0 0x7f0c24154cb0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400ebe0 tx=0x7f0c14009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c20ff9700 1 -- 172.21.15.81:0/1673988135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c14009740 con 0x7f0c240ce4a0 2023-11-29T11:23:31.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c20ff9700 1 -- 172.21.15.81:0/1673988135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400c8b0 con 0x7f0c240ce4a0 2023-11-29T11:23:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c240cab40 con 0x7f0c240ce4a0 2023-11-29T11:23:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c20ff9700 1 -- 172.21.15.81:0/1673988135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400cc40 con 0x7f0c240ce4a0 2023-11-29T11:23:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.032+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c240ca9b0 con 0x7f0c240ce4a0 2023-11-29T11:23:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.036+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2406ef90 con 0x7f0c240ce4a0 2023-11-29T11:23:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.036+0000 7f0c20ff9700 1 -- 172.21.15.81:0/1673988135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0c14019030 con 0x7f0c240ce4a0 2023-11-29T11:23:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.036+0000 7f0c20ff9700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c08064ee0 0x7f0c08067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.036+0000 7f0c20ff9700 1 -- 172.21.15.81:0/1673988135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0c14081d40 con 0x7f0c240ce4a0 2023-11-29T11:23:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.036+0000 7f0c237fe700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c08064ee0 0x7f0c08067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.036+0000 7f0c237fe700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c08064ee0 0x7f0c08067390 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c30a0 tx=0x7f0c0c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.044+0000 7f0c20ff9700 1 -- 172.21.15.81:0/1673988135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0c14050040 con 0x7f0c240ce4a0 2023-11-29T11:23:31.215 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c24072500 con 0x7f0c08064ee0 2023-11-29T11:23:31.216 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c20ff9700 1 -- 172.21.15.81:0/1673988135 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0c24072500 con 0x7f0c08064ee0 2023-11-29T11:23:31.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c08064ee0 msgr2=0x7f0c08067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c08064ee0 0x7f0c08067390 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c30a0 tx=0x7f0c0c008030 comp rx=0 tx=0).stop 2023-11-29T11:23:31.218 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c240ce4a0 msgr2=0x7f0c24154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c240ce4a0 0x7f0c24154cb0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400ebe0 tx=0x7f0c14009e00 comp rx=0 tx=0).stop 2023-11-29T11:23:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 shutdown_connections 2023-11-29T11:23:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f0c08064ee0 0x7f0c08067390 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c2415c780 0x7f0c240b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c2415c3b0 0x7f0c240b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 --2- 172.21.15.81:0/1673988135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c240ce4a0 0x7f0c24154cb0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 >> 172.21.15.81:0/1673988135 conn(0x7f0c240b1d40 msgr2=0x7f0c240afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 shutdown_connections 2023-11-29T11:23:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.208+0000 7f0c290ae700 1 -- 172.21.15.81:0/1673988135 wait complete. 2023-11-29T11:23:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2023-11-29T11:23:31.234 INFO:tasks.ceph:Scrubbing osd.4 2023-11-29T11:23:31.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-29T11:23:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.348+0000 7f4a1a005700 1 Processor -- start 2023-11-29T11:23:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.348+0000 7f4a1a005700 1 -- start start 2023-11-29T11:23:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a140cc1b0 0x7f4a140cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415d300 0x7f4a1415a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a14159e80 con 0x7f4a1415a6b0 2023-11-29T11:23:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1406a4d0 con 0x7f4a140cc1b0 2023-11-29T11:23:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1406a790 con 0x7f4a1415d300 2023-11-29T11:23:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a19003700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a140cc1b0 0x7f4a140cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a19003700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a140cc1b0 0x7f4a140cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38234/0 (socket says 172.21.15.81:38234) 2023-11-29T11:23:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a19003700 1 -- 172.21.15.81:0/251232165 learned_addr learned my addr 172.21.15.81:0/251232165 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a18802700 1 --2- 172.21.15.81:0/251232165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415d300 0x7f4a1415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a19003700 1 -- 172.21.15.81:0/251232165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415d300 msgr2=0x7f4a1415a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a19003700 1 --2- 172.21.15.81:0/251232165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415d300 0x7f4a1415a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a19003700 1 -- 172.21.15.81:0/251232165 >> v1:172.21.15.176:6789/0 conn(0x7f4a1415a6b0 legacy=0x7f4a1406b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a19003700 1 -- 172.21.15.81:0/251232165 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1406aa70 con 0x7f4a140cc1b0 2023-11-29T11:23:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a19003700 1 --2- 172.21.15.81:0/251232165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a140cc1b0 0x7f4a140cd440 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f4a10006fd0 tx=0x7f4a1000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777225f7706e62cf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a0bfff700 1 -- 172.21.15.81:0/251232165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000dc40 con 0x7f4a140cc1b0 2023-11-29T11:23:31.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a0bfff700 1 -- 172.21.15.81:0/251232165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000dda0 con 0x7f4a140cc1b0 2023-11-29T11:23:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a0bfff700 1 -- 172.21.15.81:0/251232165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10004250 con 0x7f4a140cc1b0 2023-11-29T11:23:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 -- 172.21.15.81:0/251232165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a140cc1b0 msgr2=0x7f4a140cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 --2- 172.21.15.81:0/251232165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a140cc1b0 0x7f4a140cd440 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f4a10006fd0 tx=0x7f4a1000bea0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 -- 172.21.15.81:0/251232165 shutdown_connections 2023-11-29T11:23:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 --2- 172.21.15.81:0/251232165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415d300 0x7f4a1415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 --2- 172.21.15.81:0/251232165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a140cc1b0 0x7f4a140cd440 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 -- 172.21.15.81:0/251232165 >> 172.21.15.81:0/251232165 conn(0x7f4a1406c6b0 msgr2=0x7f4a1406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:31.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 -- 172.21.15.81:0/251232165 shutdown_connections 2023-11-29T11:23:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.352+0000 7f4a1a005700 1 -- 172.21.15.81:0/251232165 wait complete. 2023-11-29T11:23:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 Processor -- start 2023-11-29T11:23:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 -- start start 2023-11-29T11:23:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a140cc1b0 0x7f4a140b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415a6b0 0x7f4a140b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1415d300 0x7f4a140c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14153970 con 0x7f4a1415d300 2023-11-29T11:23:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140c2dc0 con 0x7f4a140cc1b0 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140c30a0 con 0x7f4a1415a6b0 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1415d300 0x7f4a140c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1415d300 0x7f4a140c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38242/0 (socket says 172.21.15.81:38242) 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 -- 172.21.15.81:0/1007964639 learned_addr learned my addr 172.21.15.81:0/1007964639 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19003700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a140cc1b0 0x7f4a140b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a18802700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415a6b0 0x7f4a140b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 -- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415a6b0 msgr2=0x7f4a140b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a1415a6b0 0x7f4a140b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 -- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a140cc1b0 msgr2=0x7f4a140b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a140cc1b0 0x7f4a140b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 -- 172.21.15.81:0/1007964639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1000b820 con 0x7f4a1415d300 2023-11-29T11:23:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19003700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a140cc1b0 0x7f4a140b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a19804700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1415d300 0x7f4a140c3e60 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00cc50 tx=0x7f4a0c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00ad80 con 0x7f4a1415d300 2023-11-29T11:23:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00ce50 con 0x7f4a1415d300 2023-11-29T11:23:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1406b030 con 0x7f4a1415d300 2023-11-29T11:23:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c003c60 con 0x7f4a1415d300 2023-11-29T11:23:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.356+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1406ad50 con 0x7f4a1415d300 2023-11-29T11:23:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a140cc580 con 0x7f4a1415d300 2023-11-29T11:23:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4a0c010050 con 0x7f4a1415d300 2023-11-29T11:23:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a09ffb700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49f8064ee0 0x7f49f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4a0c082930 con 0x7f4a1415d300 2023-11-29T11:23:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a19003700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49f8064ee0 0x7f49f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a09ffb700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f49f806b890 0x7f49f806dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49f806e390 con 0x7f49f806b890 2023-11-29T11:23:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a0c082ca0 con 0x7f4a1415d300 2023-11-29T11:23:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a18802700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f49f806b890 0x7f49f806dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.360+0000 7f4a19003700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49f8064ee0 0x7f49f8067390 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4a10019040 tx=0x7f4a10014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.364+0000 7f4a18802700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f49f806b890 0x7f49f806dcc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.364+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 <== osd.4 v2:172.21.15.176:6808/36811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f49f806e390 con 0x7f49f806b890 2023-11-29T11:23:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 --> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a14072c20 con 0x7f49f806b890 2023-11-29T11:23:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a09ffb700 1 -- 172.21.15.81:0/1007964639 <== osd.4 v2:172.21.15.176:6808/36811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4a14072c20 con 0x7f49f806b890 2023-11-29T11:23:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:31.392 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-29T11:23:31.392 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f49f806b890 msgr2=0x7f49f806dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.176:6808/36811,v1:172.21.15.176:6809/36811] conn(0x7f49f806b890 0x7f49f806dcc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49f8064ee0 msgr2=0x7f49f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f49f8064ee0 0x7f49f8067390 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4a10019040 tx=0x7f4a10014000 comp rx=0 tx=0).stop 2023-11-29T11:23:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1415d300 msgr2=0x7f4a140c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 --2- 172.21.15.81:0/1007964639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1415d300 0x7f4a140c3e60 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00cc50 tx=0x7f4a0c00a340 comp rx=0 tx=0).stop 2023-11-29T11:23:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a19804700 1 -- 172.21.15.81:0/1007964639 reap_dead start 2023-11-29T11:23:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 shutdown_connections 2023-11-29T11:23:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 >> 172.21.15.81:0/1007964639 conn(0x7f4a1406c6b0 msgr2=0x7f4a140c1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 shutdown_connections 2023-11-29T11:23:31.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.384+0000 7f4a1a005700 1 -- 172.21.15.81:0/1007964639 wait complete. 2023-11-29T11:23:31.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-29T11:23:31.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1e314700 1 Processor -- start 2023-11-29T11:23:31.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1e314700 1 -- start start 2023-11-29T11:23:31.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1e314700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee1806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1e314700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee18069c40 0x7fee180cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1e314700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fee1806cee0 0x7fee180cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1e314700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1806ace0 con 0x7fee18069c40 2023-11-29T11:23:31.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1e314700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1806a0d0 con 0x7fee1806cee0 2023-11-29T11:23:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1e314700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1806a3b0 con 0x7fee18159e70 2023-11-29T11:23:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee18069c40 0x7fee180cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee18069c40 0x7fee180cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38256/0 (socket says 172.21.15.81:38256) 2023-11-29T11:23:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 -- 172.21.15.81:0/3773052741 learned_addr learned my addr 172.21.15.81:0/3773052741 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1db13700 1 --2- 172.21.15.81:0/3773052741 >> v2:172.21.15.176:3300/0 conn(0x7fee1806cee0 0x7fee180cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1d312700 1 --2- 172.21.15.81:0/3773052741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee1806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 -- 172.21.15.81:0/3773052741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 msgr2=0x7fee1806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 --2- 172.21.15.81:0/3773052741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee1806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 -- 172.21.15.81:0/3773052741 >> v2:172.21.15.176:3300/0 conn(0x7fee1806cee0 msgr2=0x7fee180cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 --2- 172.21.15.81:0/3773052741 >> v2:172.21.15.176:3300/0 conn(0x7fee1806cee0 0x7fee180cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 -- 172.21.15.81:0/3773052741 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1806a690 con 0x7fee18069c40 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1db13700 1 --2- 172.21.15.81:0/3773052741 >> v2:172.21.15.176:3300/0 conn(0x7fee1806cee0 0x7fee180cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1d312700 1 --2- 172.21.15.81:0/3773052741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee1806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee1cb11700 1 --2- 172.21.15.81:0/3773052741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180cad60 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fee180b12c0 tx=0x7fee1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f158856e0fe3f46 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee0ffff700 1 -- 172.21.15.81:0/3773052741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400e070 con 0x7fee18069c40 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee0ffff700 1 -- 172.21.15.81:0/3773052741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1400b9c0 con 0x7fee18069c40 2023-11-29T11:23:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.516+0000 7fee0ffff700 1 -- 172.21.15.81:0/3773052741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400bd70 con 0x7fee18069c40 2023-11-29T11:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 -- 172.21.15.81:0/3773052741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 msgr2=0x7fee180cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 --2- 172.21.15.81:0/3773052741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180cad60 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fee180b12c0 tx=0x7fee1400b330 comp rx=0 tx=0).stop 2023-11-29T11:23:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 -- 172.21.15.81:0/3773052741 shutdown_connections 2023-11-29T11:23:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 --2- 172.21.15.81:0/3773052741 >> v2:172.21.15.176:3300/0 conn(0x7fee1806cee0 0x7fee180cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 --2- 172.21.15.81:0/3773052741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180cad60 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 --2- 172.21.15.81:0/3773052741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee1806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 -- 172.21.15.81:0/3773052741 >> 172.21.15.81:0/3773052741 conn(0x7fee180ce3e0 msgr2=0x7fee180ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 -- 172.21.15.81:0/3773052741 shutdown_connections 2023-11-29T11:23:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.520+0000 7fee1e314700 1 -- 172.21.15.81:0/3773052741 wait complete. 2023-11-29T11:23:31.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 Processor -- start 2023-11-29T11:23:31.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 -- start start 2023-11-29T11:23:31.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1806cee0 0x7fee18155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee180c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1815d1e0 con 0x7fee18069c40 2023-11-29T11:23:31.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee18156140 con 0x7fee1806cee0 2023-11-29T11:23:31.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee180c4140 con 0x7fee18159e70 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38262/0 (socket says 172.21.15.81:38262) 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 -- 172.21.15.81:0/1573935867 learned_addr learned my addr 172.21.15.81:0/1573935867 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1db13700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee180c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1cb11700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1806cee0 0x7fee18155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 -- 172.21.15.81:0/1573935867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 msgr2=0x7fee180c0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee180c0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 -- 172.21.15.81:0/1573935867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1806cee0 msgr2=0x7fee18155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1806cee0 0x7fee18155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 -- 172.21.15.81:0/1573935867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee14009b30 con 0x7fee18069c40 2023-11-29T11:23:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1d312700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180c3a80 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fee0800c7c0 tx=0x7fee0800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee0dffb700 1 -- 172.21.15.81:0/1573935867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011800 con 0x7fee18069c40 2023-11-29T11:23:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee0dffb700 1 -- 172.21.15.81:0/1573935867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08011960 con 0x7fee18069c40 2023-11-29T11:23:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1815a240 con 0x7fee18069c40 2023-11-29T11:23:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee0dffb700 1 -- 172.21.15.81:0/1573935867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011cf0 con 0x7fee18069c40 2023-11-29T11:23:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.524+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1806a970 con 0x7fee18069c40 2023-11-29T11:23:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.528+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee180b32e0 con 0x7fee18069c40 2023-11-29T11:23:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.528+0000 7fee0dffb700 1 -- 172.21.15.81:0/1573935867 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fee08020070 con 0x7fee18069c40 2023-11-29T11:23:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.528+0000 7fee0dffb700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fedfc064ee0 0x7fedfc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.528+0000 7fee0dffb700 1 -- 172.21.15.81:0/1573935867 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fee08081c60 con 0x7fee18069c40 2023-11-29T11:23:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.528+0000 7fee1cb11700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fedfc064ee0 0x7fedfc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.528+0000 7fee1cb11700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fedfc064ee0 0x7fedfc067390 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b370 tx=0x7fee14009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.532+0000 7fee0dffb700 1 -- 172.21.15.81:0/1573935867 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fee0804fee0 con 0x7fee18069c40 2023-11-29T11:23:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.696+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fee18072500 con 0x7fedfc064ee0 2023-11-29T11:23:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.696+0000 7fee0dffb700 1 -- 172.21.15.81:0/1573935867 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee18072500 con 0x7fedfc064ee0 2023-11-29T11:23:31.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fedfc064ee0 msgr2=0x7fedfc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fedfc064ee0 0x7fedfc067390 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b370 tx=0x7fee14009000 comp rx=0 tx=0).stop 2023-11-29T11:23:31.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 msgr2=0x7fee180c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180c3a80 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fee0800c7c0 tx=0x7fee0800cb80 comp rx=0 tx=0).stop 2023-11-29T11:23:31.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 shutdown_connections 2023-11-29T11:23:31.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fedfc064ee0 0x7fedfc067390 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee18159e70 0x7fee180c0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1806cee0 0x7fee18155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 --2- 172.21.15.81:0/1573935867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee18069c40 0x7fee180c3a80 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 >> 172.21.15.81:0/1573935867 conn(0x7fee180ce3e0 msgr2=0x7fee18071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:31.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 shutdown_connections 2023-11-29T11:23:31.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.700+0000 7fee1e314700 1 -- 172.21.15.81:0/1573935867 wait complete. 2023-11-29T11:23:31.709 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2023-11-29T11:23:31.719 INFO:tasks.ceph:Scrubbing osd.5 2023-11-29T11:23:31.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-29T11:23:31.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca2654700 1 Processor -- start 2023-11-29T11:23:31.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca2654700 1 -- start start 2023-11-29T11:23:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca2654700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fec9c0b1ae0 0x7fec9c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca2654700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0cf0e0 0x7fec9c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca2654700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c0cfa80 con 0x7fec9c06a4c0 2023-11-29T11:23:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca2654700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c0d0ab0 con 0x7fec9c0b1ae0 2023-11-29T11:23:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca2654700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c06a9c0 con 0x7fec9c0cf0e0 2023-11-29T11:23:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca1652700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fec9c0b1ae0 0x7fec9c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca1e53700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0cf0e0 0x7fec9c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca1652700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fec9c0b1ae0 0x7fec9c06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.81:57616/0 (socket says 172.21.15.81:57616) 2023-11-29T11:23:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.832+0000 7feca1652700 1 -- 172.21.15.81:0/3717520814 learned_addr learned my addr 172.21.15.81:0/3717520814 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca1652700 1 -- 172.21.15.81:0/3717520814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0cf0e0 msgr2=0x7fec9c0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca1652700 1 --2- 172.21.15.81:0/3717520814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0cf0e0 0x7fec9c0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7fec8ffff700 1 -- 172.21.15.81:0/3717520814 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214629094 0 0) 0x7fec9c0cfa80 con 0x7fec9c06a4c0 2023-11-29T11:23:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca1652700 1 -- 172.21.15.81:0/3717520814 >> v1:172.21.15.176:6789/0 conn(0x7fec9c06a4c0 legacy=0x7fec9c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca1652700 1 -- 172.21.15.81:0/3717520814 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c06aca0 con 0x7fec9c0b1ae0 2023-11-29T11:23:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca1e53700 1 --2- 172.21.15.81:0/3717520814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0cf0e0 0x7fec9c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T11:23:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca1652700 1 --2- 172.21.15.81:0/3717520814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec9c0b1ae0 0x7fec9c06d8e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fec98009910 tx=0x7fec98009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ea1ef18185f54c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7fec8ffff700 1 -- 172.21.15.81:0/3717520814 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98011830 con 0x7fec9c0b1ae0 2023-11-29T11:23:31.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7fec8ffff700 1 -- 172.21.15.81:0/3717520814 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98011990 con 0x7fec9c0b1ae0 2023-11-29T11:23:31.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7fec8ffff700 1 -- 172.21.15.81:0/3717520814 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98011d40 con 0x7fec9c0b1ae0 2023-11-29T11:23:31.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca2654700 1 -- 172.21.15.81:0/3717520814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec9c0b1ae0 msgr2=0x7fec9c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca2654700 1 --2- 172.21.15.81:0/3717520814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec9c0b1ae0 0x7fec9c06d8e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fec98009910 tx=0x7fec98009c20 comp rx=0 tx=0).stop 2023-11-29T11:23:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca2654700 1 -- 172.21.15.81:0/3717520814 shutdown_connections 2023-11-29T11:23:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca2654700 1 --2- 172.21.15.81:0/3717520814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0cf0e0 0x7fec9c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca2654700 1 --2- 172.21.15.81:0/3717520814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec9c0b1ae0 0x7fec9c06d8e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca2654700 1 -- 172.21.15.81:0/3717520814 >> 172.21.15.81:0/3717520814 conn(0x7fec9c09bbd0 msgr2=0x7fec9c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca2654700 1 -- 172.21.15.81:0/3717520814 shutdown_connections 2023-11-29T11:23:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.836+0000 7feca2654700 1 -- 172.21.15.81:0/3717520814 wait complete. 2023-11-29T11:23:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca2654700 1 Processor -- start 2023-11-29T11:23:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca2654700 1 -- start start 2023-11-29T11:23:31.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca2654700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec9c06a4c0 0x7fec9c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca2654700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0b1ae0 0x7fec9c0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca2654700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec9c0cf0e0 0x7fec9c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca2654700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c15f550 con 0x7fec9c06a4c0 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca2654700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c09ccc0 con 0x7fec9c0cf0e0 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca2654700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c15f270 con 0x7fec9c0b1ae0 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1652700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec9c06a4c0 0x7fec9c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1652700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec9c06a4c0 0x7fec9c15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38274/0 (socket says 172.21.15.81:38274) 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1652700 1 -- 172.21.15.81:0/1923243970 learned_addr learned my addr 172.21.15.81:0/1923243970 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1e53700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec9c0cf0e0 0x7fec9c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca0e51700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0b1ae0 0x7fec9c0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1652700 1 -- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0b1ae0 msgr2=0x7fec9c0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1652700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec9c0b1ae0 0x7fec9c0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1652700 1 -- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec9c0cf0e0 msgr2=0x7fec9c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1652700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec9c0cf0e0 0x7fec9c0b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.840+0000 7feca1652700 1 -- 172.21.15.81:0/1923243970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec94009a70 con 0x7fec9c06a4c0 2023-11-29T11:23:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7feca1652700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec9c06a4c0 0x7fec9c15a930 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fec98009f70 tx=0x7fec98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec980044d0 con 0x7fec9c06a4c0 2023-11-29T11:23:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9801e070 con 0x7fec9c06a4c0 2023-11-29T11:23:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec98009570 con 0x7fec9c06a4c0 2023-11-29T11:23:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98003900 con 0x7fec9c06a4c0 2023-11-29T11:23:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c0b4380 con 0x7fec9c06a4c0 2023-11-29T11:23:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec9c06af80 con 0x7fec9c06a4c0 2023-11-29T11:23:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fec9800f050 con 0x7fec9c06a4c0 2023-11-29T11:23:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fec80064f10 0x7fec800673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fec98020070 con 0x7fec9c06a4c0 2023-11-29T11:23:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7fec8006b8c0 0x7fec8006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec8006e3c0 con 0x7fec8006b8c0 2023-11-29T11:23:31.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec98083aa0 con 0x7fec9c06a4c0 2023-11-29T11:23:31.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7feca0e51700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fec80064f10 0x7fec800673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.844+0000 7feca1e53700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7fec8006b8c0 0x7fec8006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:31.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.848+0000 7feca0e51700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fec80064f10 0x7fec800673c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fec9c15ea30 tx=0x7fec90009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.848+0000 7feca1e53700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7fec8006b8c0 0x7fec8006dcf0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:31.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.848+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 <== osd.5 v2:172.21.15.176:6824/36812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fec8006e3c0 con 0x7fec8006b8c0 2023-11-29T11:23:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.864+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 --> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fec9c0b1eb0 con 0x7fec8006b8c0 2023-11-29T11:23:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.864+0000 7fec8dffb700 1 -- 172.21.15.81:0/1923243970 <== osd.5 v2:172.21.15.176:6824/36812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fec9c0b1eb0 con 0x7fec8006b8c0 2023-11-29T11:23:31.874 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:31.874 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-29T11:23:31.874 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.864+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7fec8006b8c0 msgr2=0x7fec8006dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.864+0000 7feca2654700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.176:6824/36812,v1:172.21.15.176:6825/36812] conn(0x7fec8006b8c0 0x7fec8006dcf0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.864+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fec80064f10 msgr2=0x7fec800673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.864+0000 7feca2654700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fec80064f10 0x7fec800673c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fec9c15ea30 tx=0x7fec90009040 comp rx=0 tx=0).stop 2023-11-29T11:23:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.868+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec9c06a4c0 msgr2=0x7fec9c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.868+0000 7feca2654700 1 --2- 172.21.15.81:0/1923243970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec9c06a4c0 0x7fec9c15a930 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fec98009f70 tx=0x7fec98004770 comp rx=0 tx=0).stop 2023-11-29T11:23:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.868+0000 7feca1e53700 1 -- 172.21.15.81:0/1923243970 reap_dead start 2023-11-29T11:23:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.868+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 shutdown_connections 2023-11-29T11:23:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.868+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 >> 172.21.15.81:0/1923243970 conn(0x7fec9c09bbd0 msgr2=0x7fec9c15bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:31.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.868+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 shutdown_connections 2023-11-29T11:23:31.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.868+0000 7feca2654700 1 -- 172.21.15.81:0/1923243970 wait complete. 2023-11-29T11:23:31.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-29T11:23:32.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 Processor -- start 2023-11-29T11:23:32.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 -- start start 2023-11-29T11:23:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80cb460 0x7f69e80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80cde00 con 0x7f69e80ad490 2023-11-29T11:23:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e806d630 con 0x7f69e8158ef0 2023-11-29T11:23:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ce290 con 0x7f69e80cb460 2023-11-29T11:23:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69ed501700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f69e80ad490 0x7f69e806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38164/0 (socket says 172.21.15.81:38164) 2023-11-29T11:23:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69ed501700 1 -- 172.21.15.81:0/1644947708 learned_addr learned my addr 172.21.15.81:0/1644947708 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e7fff700 1 --2- 172.21.15.81:0/1644947708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80cb460 0x7f69e80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e77fe700 1 -- 172.21.15.81:0/1644947708 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233092973 0 0) 0x7f69e80cde00 con 0x7f69e80ad490 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e77fe700 1 -- 172.21.15.81:0/1644947708 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d00035d0 con 0x7f69e80ad490 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e77fe700 1 -- 172.21.15.81:0/1644947708 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744741761 0 0) 0x7f69e806d630 con 0x7f69e8158ef0 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e77fe700 1 -- 172.21.15.81:0/1644947708 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e80cde00 con 0x7f69e8158ef0 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e7fff700 1 -- 172.21.15.81:0/1644947708 >> v1:172.21.15.176:6789/0 conn(0x7f69e8158ef0 legacy=0x7f69e80cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e7fff700 1 -- 172.21.15.81:0/1644947708 >> v1:172.21.15.81:6789/0 conn(0x7f69e80ad490 legacy=0x7f69e806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e7fff700 1 -- 172.21.15.81:0/1644947708 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e806d910 con 0x7f69e80cb460 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e7fff700 1 --2- 172.21.15.81:0/1644947708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80cb460 0x7f69e80c8a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69d80098b0 tx=0x7f69d8009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ed007bdbc4b4c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e77fe700 1 -- 172.21.15.81:0/1644947708 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8011830 con 0x7f69e80cb460 2023-11-29T11:23:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e77fe700 1 -- 172.21.15.81:0/1644947708 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d8011990 con 0x7f69e80cb460 2023-11-29T11:23:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69e77fe700 1 -- 172.21.15.81:0/1644947708 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8011d00 con 0x7f69e80cb460 2023-11-29T11:23:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 -- 172.21.15.81:0/1644947708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80cb460 msgr2=0x7f69e80c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 --2- 172.21.15.81:0/1644947708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80cb460 0x7f69e80c8a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69d80098b0 tx=0x7f69d8009bc0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 -- 172.21.15.81:0/1644947708 shutdown_connections 2023-11-29T11:23:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 --2- 172.21.15.81:0/1644947708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80cb460 0x7f69e80c8a30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:31.996+0000 7f69edd02700 1 -- 172.21.15.81:0/1644947708 >> 172.21.15.81:0/1644947708 conn(0x7f69e80ce3e0 msgr2=0x7f69e80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 -- 172.21.15.81:0/1644947708 shutdown_connections 2023-11-29T11:23:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 -- 172.21.15.81:0/1644947708 wait complete. 2023-11-29T11:23:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 Processor -- start 2023-11-29T11:23:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 -- start start 2023-11-29T11:23:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80ad490 0x7f69e815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80cb460 0x7f69e80af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e8158ef0 0x7f69e8153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80af060 con 0x7f69e80cb460 2023-11-29T11:23:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ae490 con 0x7f69e8158ef0 2023-11-29T11:23:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ae730 con 0x7f69e80ad490 2023-11-29T11:23:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80cb460 0x7f69e80af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80cb460 0x7f69e80af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38280/0 (socket says 172.21.15.81:38280) 2023-11-29T11:23:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 -- 172.21.15.81:0/3405185137 learned_addr learned my addr 172.21.15.81:0/3405185137 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69ecd00700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80ad490 0x7f69e815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69ed501700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e8158ef0 0x7f69e8153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 -- 172.21.15.81:0/3405185137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80ad490 msgr2=0x7f69e815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80ad490 0x7f69e815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 -- 172.21.15.81:0/3405185137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e8158ef0 msgr2=0x7f69e8153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e8158ef0 0x7f69e8153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 -- 172.21.15.81:0/3405185137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80094b0 con 0x7f69e80cb460 2023-11-29T11:23:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e7fff700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80cb460 0x7f69e80af4f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f69d80090b0 tx=0x7f69d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e57fa700 1 -- 172.21.15.81:0/3405185137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8004480 con 0x7f69e80cb460 2023-11-29T11:23:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e57fa700 1 -- 172.21.15.81:0/3405185137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d801f070 con 0x7f69e80cb460 2023-11-29T11:23:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e80cda90 con 0x7f69e80cb460 2023-11-29T11:23:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69e57fa700 1 -- 172.21.15.81:0/3405185137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80038e0 con 0x7f69e80cb460 2023-11-29T11:23:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.000+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e806dbf0 con 0x7f69e80cb460 2023-11-29T11:23:32.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.004+0000 7f69e57fa700 1 -- 172.21.15.81:0/3405185137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f69d802a020 con 0x7f69e80cb460 2023-11-29T11:23:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.004+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e80cbfb0 con 0x7f69e80cb460 2023-11-29T11:23:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.004+0000 7f69e57fa700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d4064ee0 0x7f69d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.004+0000 7f69ecd00700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d4064ee0 0x7f69d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.004+0000 7f69e57fa700 1 -- 172.21.15.81:0/3405185137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f69d8083420 con 0x7f69e80cb460 2023-11-29T11:23:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.004+0000 7f69ecd00700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d4064ee0 0x7f69d4067390 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f69dc007fd0 tx=0x7f69dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.016 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.008+0000 7f69e57fa700 1 -- 172.21.15.81:0/3405185137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f69d8051630 con 0x7f69e80cb460 2023-11-29T11:23:32.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.168+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f69e8072500 con 0x7f69d4064ee0 2023-11-29T11:23:32.179 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69e57fa700 1 -- 172.21.15.81:0/3405185137 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f69e8072500 con 0x7f69d4064ee0 2023-11-29T11:23:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d4064ee0 msgr2=0x7f69d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d4064ee0 0x7f69d4067390 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f69dc007fd0 tx=0x7f69dc009040 comp rx=0 tx=0).stop 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80cb460 msgr2=0x7f69e80af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80cb460 0x7f69e80af4f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f69d80090b0 tx=0x7f69d8004770 comp rx=0 tx=0).stop 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 shutdown_connections 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f69d4064ee0 0x7f69d4067390 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69e8158ef0 0x7f69e8153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e80cb460 0x7f69e80af4f0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 --2- 172.21.15.81:0/3405185137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69e80ad490 0x7f69e815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 >> 172.21.15.81:0/3405185137 conn(0x7f69e80ce3e0 msgr2=0x7f69e8157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 shutdown_connections 2023-11-29T11:23:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.172+0000 7f69edd02700 1 -- 172.21.15.81:0/3405185137 wait complete. 2023-11-29T11:23:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2023-11-29T11:23:32.194 INFO:tasks.ceph:Scrubbing osd.6 2023-11-29T11:23:32.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-29T11:23:32.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.304+0000 7f9c53fff700 1 Processor -- start 2023-11-29T11:23:32.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.304+0000 7f9c53fff700 1 -- start start 2023-11-29T11:23:32.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c53fff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c54158450 0x7f9c540cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540cae00 0x7f9c540cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c53fff700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5415cac0 con 0x7f9c540c8e60 2023-11-29T11:23:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c53fff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c54071990 con 0x7f9c54158450 2023-11-29T11:23:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c53fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540cd5e0 con 0x7f9c540cae00 2023-11-29T11:23:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c52ffd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c54158450 0x7f9c540cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c4bfff700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9c540c8e60 0x7f9c5406c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38174/0 (socket says 172.21.15.81:38174) 2023-11-29T11:23:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c4bfff700 1 -- 172.21.15.81:0/3759098327 learned_addr learned my addr 172.21.15.81:0/3759098327 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c537fe700 1 --2- 172.21.15.81:0/3759098327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540cae00 0x7f9c540cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c52ffd700 1 -- 172.21.15.81:0/3759098327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540cae00 msgr2=0x7f9c540cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c52ffd700 1 --2- 172.21.15.81:0/3759098327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540cae00 0x7f9c540cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c52ffd700 1 -- 172.21.15.81:0/3759098327 >> v1:172.21.15.81:6789/0 conn(0x7f9c540c8e60 legacy=0x7f9c5406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c52ffd700 1 -- 172.21.15.81:0/3759098327 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5415c190 con 0x7f9c54158450 2023-11-29T11:23:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c52ffd700 1 --2- 172.21.15.81:0/3759098327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 0x7f9c540cb4e0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009850 tx=0x7f9c44009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c28ac835431fb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c527fc700 1 -- 172.21.15.81:0/3759098327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44011830 con 0x7f9c54158450 2023-11-29T11:23:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c527fc700 1 -- 172.21.15.81:0/3759098327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44011990 con 0x7f9c54158450 2023-11-29T11:23:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c527fc700 1 -- 172.21.15.81:0/3759098327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44011d20 con 0x7f9c54158450 2023-11-29T11:23:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c53fff700 1 -- 172.21.15.81:0/3759098327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 msgr2=0x7f9c540cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.308+0000 7f9c53fff700 1 --2- 172.21.15.81:0/3759098327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 0x7f9c540cb4e0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009850 tx=0x7f9c44009b60 comp rx=0 tx=0).stop 2023-11-29T11:23:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.312+0000 7f9c53fff700 1 -- 172.21.15.81:0/3759098327 shutdown_connections 2023-11-29T11:23:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.312+0000 7f9c53fff700 1 --2- 172.21.15.81:0/3759098327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540cae00 0x7f9c540cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.312+0000 7f9c53fff700 1 --2- 172.21.15.81:0/3759098327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 0x7f9c540cb4e0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.312+0000 7f9c53fff700 1 -- 172.21.15.81:0/3759098327 >> 172.21.15.81:0/3759098327 conn(0x7f9c540b0990 msgr2=0x7f9c540b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.312+0000 7f9c53fff700 1 -- 172.21.15.81:0/3759098327 shutdown_connections 2023-11-29T11:23:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.312+0000 7f9c53fff700 1 -- 172.21.15.81:0/3759098327 wait complete. 2023-11-29T11:23:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.312+0000 7f9c53fff700 1 Processor -- start 2023-11-29T11:23:32.322 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.312+0000 7f9c53fff700 1 -- start start 2023-11-29T11:23:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540c8e60 0x7f9c541f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c540cae00 0x7f9c540c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 0x7f9c540c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541f4fe0 con 0x7f9c54158450 2023-11-29T11:23:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541f52c0 con 0x7f9c540cae00 2023-11-29T11:23:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541f55a0 con 0x7f9c540c8e60 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 0x7f9c540c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 0x7f9c540c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38310/0 (socket says 172.21.15.81:38310) 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 -- 172.21.15.81:0/2676641063 learned_addr learned my addr 172.21.15.81:0/2676641063 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c52ffd700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540c8e60 0x7f9c541f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4bfff700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c540cae00 0x7f9c540c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 -- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540c8e60 msgr2=0x7f9c541f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c540c8e60 0x7f9c541f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 -- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c540cae00 msgr2=0x7f9c540c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c540cae00 0x7f9c540c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 -- 172.21.15.81:0/2676641063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c440094b0 con 0x7f9c54158450 2023-11-29T11:23:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4bfff700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c540cae00 0x7f9c540c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c537fe700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 0x7f9c540c8550 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c007e40 tx=0x7f9c4c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00ede0 con 0x7f9c54158450 2023-11-29T11:23:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c014420 con 0x7f9c54158450 2023-11-29T11:23:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5415c750 con 0x7f9c54158450 2023-11-29T11:23:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0147d0 con 0x7f9c54158450 2023-11-29T11:23:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5415c470 con 0x7f9c54158450 2023-11-29T11:23:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c5414acc0 con 0x7f9c54158450 2023-11-29T11:23:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9c4c012050 con 0x7f9c54158450 2023-11-29T11:23:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c34064ee0 0x7f9c34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9c4c082350 con 0x7f9c54158450 2023-11-29T11:23:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c52ffd700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c34064ee0 0x7f9c34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7f9c3406b890 0x7f9c3406dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c3406e390 con 0x7f9c3406b890 2023-11-29T11:23:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.316+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c4c084a20 con 0x7f9c54158450 2023-11-29T11:23:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.320+0000 7f9c4bfff700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7f9c3406b890 0x7f9c3406dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.320+0000 7f9c52ffd700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c34064ee0 0x7f9c34067390 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9c44014040 tx=0x7f9c44008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.320+0000 7f9c4bfff700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7f9c3406b890 0x7f9c3406dcc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.320+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 <== osd.6 v2:172.21.15.176:6816/36813 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9c3406e390 con 0x7f9c3406b890 2023-11-29T11:23:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.336+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 --> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9c5414ae40 con 0x7f9c3406b890 2023-11-29T11:23:32.346 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.336+0000 7f9c4b7fe700 1 -- 172.21.15.81:0/2676641063 <== osd.6 v2:172.21.15.176:6816/36813 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9c5414ae40 con 0x7f9c3406b890 2023-11-29T11:23:32.346 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:32.347 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-29T11:23:32.347 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7f9c3406b890 msgr2=0x7f9c3406dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.176:6816/36813,v1:172.21.15.176:6817/36813] conn(0x7f9c3406b890 0x7f9c3406dcc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c34064ee0 msgr2=0x7f9c34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9c34064ee0 0x7f9c34067390 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9c44014040 tx=0x7f9c44008030 comp rx=0 tx=0).stop 2023-11-29T11:23:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 msgr2=0x7f9c540c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 --2- 172.21.15.81:0/2676641063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c54158450 0x7f9c540c8550 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c007e40 tx=0x7f9c4c00e3c0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c537fe700 1 -- 172.21.15.81:0/2676641063 reap_dead start 2023-11-29T11:23:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 shutdown_connections 2023-11-29T11:23:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 >> 172.21.15.81:0/2676641063 conn(0x7f9c540b0990 msgr2=0x7f9c5406b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 shutdown_connections 2023-11-29T11:23:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.340+0000 7f9c53fff700 1 -- 172.21.15.81:0/2676641063 wait complete. 2023-11-29T11:23:32.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-29T11:23:32.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 Processor -- start 2023-11-29T11:23:32.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- start start 2023-11-29T11:23:32.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8201606b0 0x7fd8200c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd8200ceef0 0x7fd8200c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ad610 0x7fd820164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8200cae70 con 0x7fd8201606b0 2023-11-29T11:23:32.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8200cbc10 con 0x7fd8200ceef0 2023-11-29T11:23:32.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8200cb130 con 0x7fd8200ad610 2023-11-29T11:23:32.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8201606b0 0x7fd8200c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8201606b0 0x7fd8200c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38324/0 (socket says 172.21.15.81:38324) 2023-11-29T11:23:32.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 -- 172.21.15.81:0/3836232343 learned_addr learned my addr 172.21.15.81:0/3836232343 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:32.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd815d9b700 1 --2- 172.21.15.81:0/3836232343 >> v2:172.21.15.176:3300/0 conn(0x7fd8200ceef0 0x7fd8200c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81ed9d700 1 --2- 172.21.15.81:0/3836232343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ad610 0x7fd820164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 -- 172.21.15.81:0/3836232343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ad610 msgr2=0x7fd820164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:32.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 --2- 172.21.15.81:0/3836232343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ad610 0x7fd820164040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 -- 172.21.15.81:0/3836232343 >> v2:172.21.15.176:3300/0 conn(0x7fd8200ceef0 msgr2=0x7fd8200c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:32.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 --2- 172.21.15.81:0/3836232343 >> v2:172.21.15.176:3300/0 conn(0x7fd8200ceef0 0x7fd8200c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 -- 172.21.15.81:0/3836232343 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8200cb410 con 0x7fd8201606b0 2023-11-29T11:23:32.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81e59c700 1 --2- 172.21.15.81:0/3836232343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8201606b0 0x7fd8200c13b0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fd82006b850 tx=0x7fd810009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de965157c317003f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81dd9b700 1 -- 172.21.15.81:0/3836232343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810011830 con 0x7fd8201606b0 2023-11-29T11:23:32.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81dd9b700 1 -- 172.21.15.81:0/3836232343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd810011990 con 0x7fd8201606b0 2023-11-29T11:23:32.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81dd9b700 1 -- 172.21.15.81:0/3836232343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810011d20 con 0x7fd8201606b0 2023-11-29T11:23:32.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- 172.21.15.81:0/3836232343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8201606b0 msgr2=0x7fd8200c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3836232343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8201606b0 0x7fd8200c13b0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fd82006b850 tx=0x7fd810009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- 172.21.15.81:0/3836232343 shutdown_connections 2023-11-29T11:23:32.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3836232343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ad610 0x7fd820164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3836232343 >> v2:172.21.15.176:3300/0 conn(0x7fd8200ceef0 0x7fd8200c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3836232343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8201606b0 0x7fd8200c13b0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- 172.21.15.81:0/3836232343 >> 172.21.15.81:0/3836232343 conn(0x7fd8200ce3e0 msgr2=0x7fd8200ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- 172.21.15.81:0/3836232343 shutdown_connections 2023-11-29T11:23:32.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.464+0000 7fd81f59e700 1 -- 172.21.15.81:0/3836232343 wait complete. 2023-11-29T11:23:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81f59e700 1 Processor -- start 2023-11-29T11:23:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81f59e700 1 -- start start 2023-11-29T11:23:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8200ad610 0x7fd82015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81f59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ceef0 0x7fd8200ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81f59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8201606b0 0x7fd8200c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd820162e10 con 0x7fd8200ad610 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81f59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82006b450 con 0x7fd8201606b0 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81f59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8200ace70 con 0x7fd8200ceef0 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8200ad610 0x7fd82015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8200ad610 0x7fd82015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38332/0 (socket says 172.21.15.81:38332) 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 -- 172.21.15.81:0/3178830615 learned_addr learned my addr 172.21.15.81:0/3178830615 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd815d9b700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ceef0 0x7fd8200ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81ed9d700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8201606b0 0x7fd8200c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 -- 172.21.15.81:0/3178830615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ceef0 msgr2=0x7fd8200ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ceef0 0x7fd8200ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 -- 172.21.15.81:0/3178830615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8201606b0 msgr2=0x7fd8200c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8201606b0 0x7fd8200c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 -- 172.21.15.81:0/3178830615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd810009570 con 0x7fd8200ad610 2023-11-29T11:23:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.468+0000 7fd81e59c700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8200ad610 0x7fd82015c400 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fd810000c00 tx=0x7fd810004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd8177fe700 1 -- 172.21.15.81:0/3178830615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810004590 con 0x7fd8200ad610 2023-11-29T11:23:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd8177fe700 1 -- 172.21.15.81:0/3178830615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81001e070 con 0x7fd8200ad610 2023-11-29T11:23:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8200b36c0 con 0x7fd8200ad610 2023-11-29T11:23:32.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd8177fe700 1 -- 172.21.15.81:0/3178830615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810003900 con 0x7fd8200ad610 2023-11-29T11:23:32.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8200cb6f0 con 0x7fd8200ad610 2023-11-29T11:23:32.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd820164580 con 0x7fd8200ad610 2023-11-29T11:23:32.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd8177fe700 1 -- 172.21.15.81:0/3178830615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd81000f050 con 0x7fd8200ad610 2023-11-29T11:23:32.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd8177fe700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd800064ee0 0x7fd800067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd8177fe700 1 -- 172.21.15.81:0/3178830615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fd8100828f0 con 0x7fd8200ad610 2023-11-29T11:23:32.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.472+0000 7fd815d9b700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd800064ee0 0x7fd800067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.476+0000 7fd815d9b700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd800064ee0 0x7fd800067390 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd82006fa20 tx=0x7fd808008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.480+0000 7fd8177fe700 1 -- 172.21.15.81:0/3178830615 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd810050bf0 con 0x7fd8200ad610 2023-11-29T11:23:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.640+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd820162f50 con 0x7fd800064ee0 2023-11-29T11:23:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.640+0000 7fd8177fe700 1 -- 172.21.15.81:0/3178830615 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd808004020 con 0x7fd800064ee0 2023-11-29T11:23:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd800064ee0 msgr2=0x7fd800067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd800064ee0 0x7fd800067390 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd82006fa20 tx=0x7fd808008040 comp rx=0 tx=0).stop 2023-11-29T11:23:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8200ad610 msgr2=0x7fd82015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8200ad610 0x7fd82015c400 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fd810000c00 tx=0x7fd810004770 comp rx=0 tx=0).stop 2023-11-29T11:23:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 shutdown_connections 2023-11-29T11:23:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fd800064ee0 0x7fd800067390 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8201606b0 0x7fd8200c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8200ceef0 0x7fd8200ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 --2- 172.21.15.81:0/3178830615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8200ad610 0x7fd82015c400 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 >> 172.21.15.81:0/3178830615 conn(0x7fd8200ce3e0 msgr2=0x7fd8200af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 shutdown_connections 2023-11-29T11:23:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.644+0000 7fd81f59e700 1 -- 172.21.15.81:0/3178830615 wait complete. 2023-11-29T11:23:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2023-11-29T11:23:32.670 INFO:tasks.ceph:Scrubbing osd.7 2023-11-29T11:23:32.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-29T11:23:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf9097a700 1 Processor -- start 2023-11-29T11:23:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf9097a700 1 -- start start 2023-11-29T11:23:32.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf9097a700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf840e28c0 0x7faf8403c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf9097a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf8403b390 0x7faf840570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf9097a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf84059040 con 0x7faf840e6eb0 2023-11-29T11:23:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf9097a700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf84058a30 con 0x7faf840e28c0 2023-11-29T11:23:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf9097a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf84053850 con 0x7faf8403b390 2023-11-29T11:23:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf840e28c0 0x7faf8403c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8b7fe700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf840e28c0 0x7faf8403c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38348/0 (socket says 172.21.15.81:38348) 2023-11-29T11:23:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8b7fe700 1 -- 172.21.15.81:0/766627535 learned_addr learned my addr 172.21.15.81:0/766627535 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8bfff700 1 --2- 172.21.15.81:0/766627535 >> v2:172.21.15.176:3300/0 conn(0x7faf8403b390 0x7faf840570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8b7fe700 1 -- 172.21.15.81:0/766627535 >> v2:172.21.15.176:3300/0 conn(0x7faf8403b390 msgr2=0x7faf840570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8b7fe700 1 --2- 172.21.15.81:0/766627535 >> v2:172.21.15.176:3300/0 conn(0x7faf8403b390 0x7faf840570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8b7fe700 1 -- 172.21.15.81:0/766627535 >> v1:172.21.15.176:6789/0 conn(0x7faf840e6eb0 legacy=0x7faf8403ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8b7fe700 1 -- 172.21.15.81:0/766627535 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84053b30 con 0x7faf840e28c0 2023-11-29T11:23:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.788+0000 7faf8bfff700 1 --2- 172.21.15.81:0/766627535 >> v2:172.21.15.176:3300/0 conn(0x7faf8403b390 0x7faf840570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf8b7fe700 1 --2- 172.21.15.81:0/766627535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 0x7faf8403c050 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7faf84050260 tx=0x7faf78009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3217cb6ba7f98641 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf8a7fc700 1 -- 172.21.15.81:0/766627535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800b8a0 con 0x7faf840e28c0 2023-11-29T11:23:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf8a7fc700 1 -- 172.21.15.81:0/766627535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7800ba00 con 0x7faf840e28c0 2023-11-29T11:23:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf8a7fc700 1 -- 172.21.15.81:0/766627535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800bd90 con 0x7faf840e28c0 2023-11-29T11:23:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 -- 172.21.15.81:0/766627535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 msgr2=0x7faf8403c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 --2- 172.21.15.81:0/766627535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 0x7faf8403c050 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7faf84050260 tx=0x7faf78009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 -- 172.21.15.81:0/766627535 shutdown_connections 2023-11-29T11:23:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 --2- 172.21.15.81:0/766627535 >> v2:172.21.15.176:3300/0 conn(0x7faf8403b390 0x7faf840570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 --2- 172.21.15.81:0/766627535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 0x7faf8403c050 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 -- 172.21.15.81:0/766627535 >> 172.21.15.81:0/766627535 conn(0x7faf84055c80 msgr2=0x7faf84056080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 -- 172.21.15.81:0/766627535 shutdown_connections 2023-11-29T11:23:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 -- 172.21.15.81:0/766627535 wait complete. 2023-11-29T11:23:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 Processor -- start 2023-11-29T11:23:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.792+0000 7faf9097a700 1 -- start start 2023-11-29T11:23:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8403b390 0x7faf8417b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 0x7faf84052300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840e6eb0 0x7faf840e47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8417c690 con 0x7faf840e28c0 2023-11-29T11:23:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8417bdf0 con 0x7faf840e6eb0 2023-11-29T11:23:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8417c0d0 con 0x7faf8403b390 2023-11-29T11:23:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 0x7faf84052300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 0x7faf84052300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38364/0 (socket says 172.21.15.81:38364) 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 -- 172.21.15.81:0/2310796502 learned_addr learned my addr 172.21.15.81:0/2310796502 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8b7fe700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8403b390 0x7faf8417b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8bfff700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840e6eb0 0x7faf840e47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 -- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8403b390 msgr2=0x7faf8417b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf8403b390 0x7faf8417b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 -- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840e6eb0 msgr2=0x7faf840e47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf840e6eb0 0x7faf840e47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 -- 172.21.15.81:0/2310796502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009570 con 0x7faf840e28c0 2023-11-29T11:23:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf8affd700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 0x7faf84052300 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7faf8c04ed50 tx=0x7faf8c0723e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c066f30 con 0x7faf840e28c0 2023-11-29T11:23:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c072cd0 con 0x7faf840e28c0 2023-11-29T11:23:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf840e7300 con 0x7faf840e28c0 2023-11-29T11:23:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c067d60 con 0x7faf840e28c0 2023-11-29T11:23:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf84058cd0 con 0x7faf840e28c0 2023-11-29T11:23:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.796+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf840e2c90 con 0x7faf840e28c0 2023-11-29T11:23:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faf8c067f80 con 0x7faf840e28c0 2023-11-29T11:23:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf77fff700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faf70064ee0 0x7faf70067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf8b7fe700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faf70064ee0 0x7faf70067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7faf8c0fb530 con 0x7faf840e28c0 2023-11-29T11:23:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf77fff700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7faf7006b890 0x7faf7006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf7006e390 con 0x7faf7006b890 2023-11-29T11:23:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf8c0fb990 con 0x7faf840e28c0 2023-11-29T11:23:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf8b7fe700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faf70064ee0 0x7faf70067390 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7faf78000c00 tx=0x7faf78008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf8bfff700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7faf7006b890 0x7faf7006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.800+0000 7faf8bfff700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7faf7006b890 0x7faf7006dcc0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.804+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 <== osd.7 v2:172.21.15.176:6800/36814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faf7006e390 con 0x7faf7006b890 2023-11-29T11:23:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 --> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faf84005540 con 0x7faf7006b890 2023-11-29T11:23:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf77fff700 1 -- 172.21.15.81:0/2310796502 <== osd.7 v2:172.21.15.176:6800/36814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faf84005540 con 0x7faf7006b890 2023-11-29T11:23:32.829 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-11-29T11:23:32.829 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-29T11:23:32.830 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-11-29T11:23:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7faf7006b890 msgr2=0x7faf7006dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.176:6800/36814,v1:172.21.15.176:6801/36814] conn(0x7faf7006b890 0x7faf7006dcc0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faf70064ee0 msgr2=0x7faf70067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7faf70064ee0 0x7faf70067390 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7faf78000c00 tx=0x7faf78008030 comp rx=0 tx=0).stop 2023-11-29T11:23:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 msgr2=0x7faf84052300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 --2- 172.21.15.81:0/2310796502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf840e28c0 0x7faf84052300 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7faf8c04ed50 tx=0x7faf8c0723e0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf8bfff700 1 -- 172.21.15.81:0/2310796502 reap_dead start 2023-11-29T11:23:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 shutdown_connections 2023-11-29T11:23:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 >> 172.21.15.81:0/2310796502 conn(0x7faf84055c80 msgr2=0x7faf840e6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 shutdown_connections 2023-11-29T11:23:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.820+0000 7faf9097a700 1 -- 172.21.15.81:0/2310796502 wait complete. 2023-11-29T11:23:32.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-29T11:23:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.956+0000 7fb04cb29700 1 Processor -- start 2023-11-29T11:23:32.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.956+0000 7fb04cb29700 1 -- start start 2023-11-29T11:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb0480cb460 0x7fb0480c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0480cd8f0 con 0x7fb048158e60 2023-11-29T11:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04806dc60 con 0x7fb0480ad490 2023-11-29T11:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480add00 con 0x7fb0480cb460 2023-11-29T11:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb0477fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb048158e60 0x7fb0480cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38178/0 (socket says 172.21.15.81:38178) 2023-11-29T11:23:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb0477fe700 1 -- 172.21.15.81:0/2603621410 learned_addr learned my addr 172.21.15.81:0/2603621410 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb03ffff700 1 --2- 172.21.15.81:0/2603621410 >> v2:172.21.15.176:3300/0 conn(0x7fb0480cb460 0x7fb0480c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb046ffd700 1 -- 172.21.15.81:0/2603621410 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148036233 0 0) 0x7fb0480cd8f0 con 0x7fb048158e60 2023-11-29T11:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb046ffd700 1 -- 172.21.15.81:0/2603621410 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0340057e0 con 0x7fb048158e60 2023-11-29T11:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb03ffff700 1 -- 172.21.15.81:0/2603621410 >> v1:172.21.15.176:6789/0 conn(0x7fb0480ad490 legacy=0x7fb04806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb046ffd700 1 -- 172.21.15.81:0/2603621410 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2166961196 0 0) 0x7fb0340057e0 con 0x7fb048158e60 2023-11-29T11:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb03ffff700 1 -- 172.21.15.81:0/2603621410 >> v1:172.21.15.81:6789/0 conn(0x7fb048158e60 legacy=0x7fb0480cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb03ffff700 1 -- 172.21.15.81:0/2603621410 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480cde90 con 0x7fb0480cb460 2023-11-29T11:23:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb03ffff700 1 --2- 172.21.15.81:0/2603621410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480cb460 0x7fb0480c8a30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb030009850 tx=0x7fb030009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71da0aa97c7d8e86 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb046ffd700 1 -- 172.21.15.81:0/2603621410 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038001670 con 0x7fb0480cb460 2023-11-29T11:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb046ffd700 1 -- 172.21.15.81:0/2603621410 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb030004030 con 0x7fb0480cb460 2023-11-29T11:23:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb046ffd700 1 -- 172.21.15.81:0/2603621410 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0300043a0 con 0x7fb0480cb460 2023-11-29T11:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 -- 172.21.15.81:0/2603621410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480cb460 msgr2=0x7fb0480c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 --2- 172.21.15.81:0/2603621410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480cb460 0x7fb0480c8a30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb030009850 tx=0x7fb030009b60 comp rx=0 tx=0).stop 2023-11-29T11:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 -- 172.21.15.81:0/2603621410 shutdown_connections 2023-11-29T11:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 --2- 172.21.15.81:0/2603621410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480cb460 0x7fb0480c8a30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 -- 172.21.15.81:0/2603621410 >> 172.21.15.81:0/2603621410 conn(0x7fb0480ce3e0 msgr2=0x7fb0480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 -- 172.21.15.81:0/2603621410 shutdown_connections 2023-11-29T11:23:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.960+0000 7fb04cb29700 1 -- 172.21.15.81:0/2603621410 wait complete. 2023-11-29T11:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 Processor -- start 2023-11-29T11:23:32.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 -- start start 2023-11-29T11:23:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480ad490 0x7fb048153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0480cb460 0x7fb0480c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb048158e60 0x7fb0480c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481539b0 con 0x7fb0480cb460 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb048071210 con 0x7fb0480ad490 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480714f0 con 0x7fb048158e60 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0480cb460 0x7fb0480c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0480cb460 0x7fb0480c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38370/0 (socket says 172.21.15.81:38370) 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 -- 172.21.15.81:0/2383966149 learned_addr learned my addr 172.21.15.81:0/2383966149 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb0477fe700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480ad490 0x7fb048153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb047fff700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb048158e60 0x7fb0480c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 -- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb048158e60 msgr2=0x7fb0480c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb048158e60 0x7fb0480c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 -- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480ad490 msgr2=0x7fb048153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:32.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480ad490 0x7fb048153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:32.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 -- 172.21.15.81:0/2383966149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300094b0 con 0x7fb0480cb460 2023-11-29T11:23:32.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb047fff700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb048158e60 0x7fb0480c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:32.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb03ffff700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0480cb460 0x7fb0480c3200 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb0300090b0 tx=0x7fb030004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb044ff9700 1 -- 172.21.15.81:0/2383966149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030011630 con 0x7fb0480cb460 2023-11-29T11:23:32.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb044ff9700 1 -- 172.21.15.81:0/2383966149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03001f070 con 0x7fb0480cb460 2023-11-29T11:23:32.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04806d6a0 con 0x7fb0480cb460 2023-11-29T11:23:32.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb044ff9700 1 -- 172.21.15.81:0/2383966149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0300119f0 con 0x7fb0480cb460 2023-11-29T11:23:32.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.964+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb048159230 con 0x7fb0480cb460 2023-11-29T11:23:32.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.968+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04806d980 con 0x7fb0480cb460 2023-11-29T11:23:32.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.968+0000 7fb044ff9700 1 -- 172.21.15.81:0/2383966149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb030017020 con 0x7fb0480cb460 2023-11-29T11:23:32.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.968+0000 7fb044ff9700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb028064ee0 0x7fb028067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:32.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.968+0000 7fb044ff9700 1 -- 172.21.15.81:0/2383966149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fb030021070 con 0x7fb0480cb460 2023-11-29T11:23:32.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.968+0000 7fb0477fe700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb028064ee0 0x7fb028067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:32.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.968+0000 7fb0477fe700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb028064ee0 0x7fb028067390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb0480c99c0 tx=0x7fb038001da0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:32.976+0000 7fb044ff9700 1 -- 172.21.15.81:0/2383966149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb0300519e0 con 0x7fb0480cb460 2023-11-29T11:23:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.140+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb048072500 con 0x7fb028064ee0 2023-11-29T11:23:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.140+0000 7fb044ff9700 1 -- 172.21.15.81:0/2383966149 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb048072500 con 0x7fb028064ee0 2023-11-29T11:23:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb028064ee0 msgr2=0x7fb028067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb028064ee0 0x7fb028067390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb0480c99c0 tx=0x7fb038001da0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0480cb460 msgr2=0x7fb0480c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0480cb460 0x7fb0480c3200 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb0300090b0 tx=0x7fb030004770 comp rx=0 tx=0).stop 2023-11-29T11:23:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 shutdown_connections 2023-11-29T11:23:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fb028064ee0 0x7fb028067390 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb048158e60 0x7fb0480c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0480cb460 0x7fb0480c3200 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 --2- 172.21.15.81:0/2383966149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0480ad490 0x7fb048153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 >> 172.21.15.81:0/2383966149 conn(0x7fb0480ce3e0 msgr2=0x7fb048069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 shutdown_connections 2023-11-29T11:23:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.144+0000 7fb04cb29700 1 -- 172.21.15.81:0/2383966149 wait complete. 2023-11-29T11:23:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2023-11-29T11:23:33.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:23:33.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.264+0000 7f36db59e700 1 Processor -- start 2023-11-29T11:23:33.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.264+0000 7f36db59e700 1 -- start start 2023-11-29T11:23:33.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:33.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d4052bf0 con 0x7f36d40dd280 2023-11-29T11:23:33.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d40528c0 con 0x7f36d4036cb0 2023-11-29T11:23:33.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d40dd650 con 0x7f36d4050760 2023-11-29T11:23:33.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36da59c700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f36d40dd280 0x7f36d40dfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38180/0 (socket says 172.21.15.81:38180) 2023-11-29T11:23:33.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36da59c700 1 -- 172.21.15.81:0/2375725688 learned_addr learned my addr 172.21.15.81:0/2375725688 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d9d9b700 1 --2- 172.21.15.81:0/2375725688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d959a700 1 -- 172.21.15.81:0/2375725688 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073275447 0 0) 0x7f36d4052bf0 con 0x7f36d40dd280 2023-11-29T11:23:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d959a700 1 -- 172.21.15.81:0/2375725688 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c80035d0 con 0x7f36d40dd280 2023-11-29T11:23:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d9d9b700 1 -- 172.21.15.81:0/2375725688 >> v1:172.21.15.176:6789/0 conn(0x7f36d4036cb0 legacy=0x7f36d4053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d9d9b700 1 -- 172.21.15.81:0/2375725688 >> v1:172.21.15.81:6789/0 conn(0x7f36d40dd280 legacy=0x7f36d40dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d9d9b700 1 -- 172.21.15.81:0/2375725688 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40e0430 con 0x7f36d4050760 2023-11-29T11:23:33.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d9d9b700 1 --2- 172.21.15.81:0/2375725688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d4036770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009880 tx=0x7f36c4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c95bb9242443cc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d959a700 1 -- 172.21.15.81:0/2375725688 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c400f8a0 con 0x7f36d4050760 2023-11-29T11:23:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d959a700 1 -- 172.21.15.81:0/2375725688 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c400fa00 con 0x7f36d4050760 2023-11-29T11:23:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36d959a700 1 -- 172.21.15.81:0/2375725688 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c400fd70 con 0x7f36d4050760 2023-11-29T11:23:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 -- 172.21.15.81:0/2375725688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 msgr2=0x7f36d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 --2- 172.21.15.81:0/2375725688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d4036770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009880 tx=0x7f36c4009b90 comp rx=0 tx=0).stop 2023-11-29T11:23:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 -- 172.21.15.81:0/2375725688 shutdown_connections 2023-11-29T11:23:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 --2- 172.21.15.81:0/2375725688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d4036770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 -- 172.21.15.81:0/2375725688 >> 172.21.15.81:0/2375725688 conn(0x7f36d4051770 msgr2=0x7f36d4051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 -- 172.21.15.81:0/2375725688 shutdown_connections 2023-11-29T11:23:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.268+0000 7f36db59e700 1 -- 172.21.15.81:0/2375725688 wait complete. 2023-11-29T11:23:33.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 Processor -- start 2023-11-29T11:23:33.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 -- start start 2023-11-29T11:23:33.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36d4036cb0 0x7f36d404c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:33.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d404b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:33.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36d40dd280 0x7f36d40d6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d41746c0 con 0x7f36d4036cb0 2023-11-29T11:23:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4173a80 con 0x7f36d40dd280 2023-11-29T11:23:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4173d20 con 0x7f36d4050760 2023-11-29T11:23:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36da59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36d4036cb0 0x7f36d404c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36da59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36d4036cb0 0x7f36d404c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38382/0 (socket says 172.21.15.81:38382) 2023-11-29T11:23:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36dad9d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36d40dd280 0x7f36d40d6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36da59c700 1 -- 172.21.15.81:0/3832067438 learned_addr learned my addr 172.21.15.81:0/3832067438 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36d9d9b700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d404b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36dad9d700 1 -- 172.21.15.81:0/3832067438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 msgr2=0x7f36d404b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36dad9d700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d404b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36dad9d700 1 -- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36d4036cb0 msgr2=0x7f36d404c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36dad9d700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36d4036cb0 0x7f36d404c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36dad9d700 1 -- 172.21.15.81:0/3832067438 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40094b0 con 0x7f36d40dd280 2023-11-29T11:23:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36dad9d700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36d40dd280 0x7f36d40d6af0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0684e0 tx=0x7f36dc0723e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36d2ffd700 1 -- 172.21.15.81:0/3832067438 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc066d20 con 0x7f36d40dd280 2023-11-29T11:23:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36d2ffd700 1 -- 172.21.15.81:0/3832067438 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc066ea0 con 0x7f36d40dd280 2023-11-29T11:23:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d40e09f0 con 0x7f36d40dd280 2023-11-29T11:23:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.272+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d40e0710 con 0x7f36d40dd280 2023-11-29T11:23:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.276+0000 7f36d2ffd700 1 -- 172.21.15.81:0/3832067438 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc067d60 con 0x7f36d40dd280 2023-11-29T11:23:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.276+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c0005310 con 0x7f36d40dd280 2023-11-29T11:23:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.276+0000 7f36d2ffd700 1 -- 172.21.15.81:0/3832067438 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f36dc067ec0 con 0x7f36d40dd280 2023-11-29T11:23:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.280+0000 7f36d2ffd700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36bc064ee0 0x7f36bc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.280+0000 7f36da59c700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36bc064ee0 0x7f36bc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.280+0000 7f36d2ffd700 1 -- 172.21.15.81:0/3832067438 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f36dc0fb1d0 con 0x7f36d40dd280 2023-11-29T11:23:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.280+0000 7f36da59c700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36bc064ee0 0x7f36bc067390 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f36cc005930 tx=0x7f36cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.284+0000 7f36d2ffd700 1 -- 172.21.15.81:0/3832067438 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f36dc0c9620 con 0x7f36d40dd280 2023-11-29T11:23:33.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.444+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36c0000bc0 con 0x7f36bc064ee0 2023-11-29T11:23:33.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.448+0000 7f36d2ffd700 1 -- 172.21.15.81:0/3832067438 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71684 (secure 0 0 0) 0x7f36c0000bc0 con 0x7f36bc064ee0 2023-11-29T11:23:33.459 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:33.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36bc064ee0 msgr2=0x7f36bc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36bc064ee0 0x7f36bc067390 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f36cc005930 tx=0x7f36cc009040 comp rx=0 tx=0).stop 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36d40dd280 msgr2=0x7f36d40d6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36d40dd280 0x7f36d40d6af0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0684e0 tx=0x7f36dc0723e0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 shutdown_connections 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f36bc064ee0 0x7f36bc067390 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36d40dd280 0x7f36d40d6af0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36d4050760 0x7f36d404b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 --2- 172.21.15.81:0/3832067438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36d4036cb0 0x7f36d404c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 >> 172.21.15.81:0/3832067438 conn(0x7f36d4051770 msgr2=0x7f36d40d91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:33.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 shutdown_connections 2023-11-29T11:23:33.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:33.452+0000 7f36db59e700 1 -- 172.21.15.81:0/3832067438 wait complete. 2023-11-29T11:23:33.462 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:23:33.473 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":433,"stamp":"2023-11-29T11:23:32.651299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":129604,"kb_used_data":12420,"kb_used_omap":0,"kb_used_meta":117120,"kb_avail":754845116,"statfs":{"total":773094113280,"available":772961398784,"internally_reserved":0,"allocated":12718080,"data_stored":6767510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":119930880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18874368,"num_objects":-6,"num_object_clones":0,"num_object_copies":-12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-12,"num_write_kb":-18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.424434"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":97,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.415106+0000","last_change":"2023-11-29T11:12:47.093324+0000","last_active":"2023-11-29T11:23:24.415106+0000","last_peered":"2023-11-29T11:23:24.415106+0000","last_clean":"2023-11-29T11:23:24.415106+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:23:24.415106+0000","last_undegraded":"2023-11-29T11:23:24.415106+0000","last_fullsized":"2023-11-29T11:23:24.415106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:17:54.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":98,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.416431+0000","last_change":"2023-11-29T11:12:47.107745+0000","last_active":"2023-11-29T11:23:24.416431+0000","last_peered":"2023-11-29T11:23:24.416431+0000","last_clean":"2023-11-29T11:23:24.416431+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:23:24.416431+0000","last_undegraded":"2023-11-29T11:23:24.416431+0000","last_fullsized":"2023-11-29T11:23:24.416431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:47:16.452805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896061+0000","last_change":"2023-11-29T11:12:47.383402+0000","last_active":"2023-11-29T11:23:21.896061+0000","last_peered":"2023-11-29T11:23:21.896061+0000","last_clean":"2023-11-29T11:23:21.896061+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:23:21.896061+0000","last_undegraded":"2023-11-29T11:23:21.896061+0000","last_fullsized":"2023-11-29T11:23:21.896061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":102,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.234852+0000","last_change":"2023-11-29T11:12:47.086969+0000","last_active":"2023-11-29T11:23:24.234852+0000","last_peered":"2023-11-29T11:23:24.234852+0000","last_clean":"2023-11-29T11:23:24.234852+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:23:24.234852+0000","last_undegraded":"2023-11-29T11:23:24.234852+0000","last_fullsized":"2023-11-29T11:23:24.234852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:06:11.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":251,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896754+0000","last_change":"2023-11-29T11:12:48.091314+0000","last_active":"2023-11-29T11:23:21.896754+0000","last_peered":"2023-11-29T11:23:21.896754+0000","last_clean":"2023-11-29T11:23:21.896754+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:23:21.896754+0000","last_undegraded":"2023-11-29T11:23:21.896754+0000","last_fullsized":"2023-11-29T11:23:21.896754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:47.065931+0000","last_clean_scrub_stamp":"2023-11-29T11:12:47.065931+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:34:29.810728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":101,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:25.257727+0000","last_change":"2023-11-29T11:12:47.088821+0000","last_active":"2023-11-29T11:23:25.257727+0000","last_peered":"2023-11-29T11:23:25.257727+0000","last_clean":"2023-11-29T11:23:25.257727+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:23:25.257727+0000","last_undegraded":"2023-11-29T11:23:25.257727+0000","last_fullsized":"2023-11-29T11:23:25.257727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.897488+0000","last_change":"2023-11-29T11:12:47.108080+0000","last_active":"2023-11-29T11:23:21.897488+0000","last_peered":"2023-11-29T11:23:21.897488+0000","last_clean":"2023-11-29T11:23:21.897488+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:23:21.897488+0000","last_undegraded":"2023-11-29T11:23:21.897488+0000","last_fullsized":"2023-11-29T11:23:21.897488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:42:47.345869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":112,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-11-29T11:23:24.229027+0000","last_change":"2023-11-29T11:12:47.107808+0000","last_active":"2023-11-29T11:23:24.229027+0000","last_peered":"2023-11-29T11:23:24.229027+0000","last_clean":"2023-11-29T11:23:24.229027+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:23:24.229027+0000","last_undegraded":"2023-11-29T11:23:24.229027+0000","last_fullsized":"2023-11-29T11:23:24.229027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:51:21.244019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-11-29T11:23:21.896810+0000","last_change":"2023-11-29T11:12:47.107829+0000","last_active":"2023-11-29T11:23:21.896810+0000","last_peered":"2023-11-29T11:23:21.896810+0000","last_clean":"2023-11-29T11:23:21.896810+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:23:21.896810+0000","last_undegraded":"2023-11-29T11:23:21.896810+0000","last_fullsized":"2023-11-29T11:23:21.896810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:12:46.061725+0000","last_clean_scrub_stamp":"2023-11-29T11:12:46.061725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:26:25.214265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542275,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16844,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94354996,"statfs":{"total":96636764160,"available":96619515904,"internally_reserved":0,"allocated":2035712,"data_stored":1288838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.63200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1890000000000001,"5min":1.272,"15min":1.5629999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.327},"last":0.78700000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86699999999999999,"15min":0.89400000000000002},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1120000000000001,"5min":1.242,"15min":2.1360000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.876},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":3.0449999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.94999999999999996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.151,"5min":1.2949999999999999,"15min":1.8009999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53900000000000003},"max":{"1min":1.1890000000000001,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":0.999}]},{"osd":3,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.71599999999999997,"5min":0.58299999999999996,"15min":0.38100000000000001},"max":{"1min":1.139,"5min":1.294,"15min":1.667},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92200000000000004,"15min":0.94899999999999995},"min":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.58299999999999996},"max":{"1min":1.131,"5min":1.2290000000000001,"15min":1.4510000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.91100000000000003},"min":{"1min":0.65100000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.113,"5min":1.24,"15min":1.446},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.01,"15min":1.046},"min":{"1min":0.92000000000000004,"5min":0.63700000000000001,"15min":0.33800000000000002},"max":{"1min":1.341,"5min":1.389,"15min":1.736},"last":0.91800000000000004}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93799999999999994,"15min":1.036},"min":{"1min":0.63,"5min":0.60299999999999998,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3100000000000001,"15min":2.403},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.036,"5min":1.0169999999999999,"15min":1.079},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2789999999999999,"5min":1.4470000000000001,"15min":1.53},"last":1.1319999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.052,"15min":1.113},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2430000000000001,"5min":1.375,"15min":1.7230000000000001},"last":1.206},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1160000000000001,"15min":1.161},"min":{"1min":0.93899999999999995,"5min":0.72099999999999997,"15min":0.44500000000000001},"max":{"1min":1.296,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.98499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542276,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15752,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94356088,"statfs":{"total":96636764160,"available":96620634112,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85299999999999998,"15min":0.83199999999999996},"min":{"1min":0.60499999999999998,"5min":0.57599999999999996,"15min":0.44400000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84799999999999998},"min":{"1min":0.56899999999999995,"5min":0.53200000000000003,"15min":0.375},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":7.7910000000000004},"last":0.93000000000000005}]},{"osd":1,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.284,"15min":1.4510000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.034,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.83099999999999996,"5min":0.58499999999999996,"15min":0.50800000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":7.8479999999999999},"last":1.0209999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.66700000000000004,"5min":0.56399999999999995,"15min":0.49099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.369},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.90600000000000003},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.40500000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":2.7069999999999999},"last":0.97599999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92100000000000004,"15min":0.94199999999999995},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.675,"5min":1.675,"15min":7.923},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94099999999999995,"15min":0.93400000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.48099999999999998},"max":{"1min":1.2410000000000001,"5min":1.304,"15min":1.3600000000000001},"last":0.86399999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.86699999999999999,"15min":0.90500000000000003},"min":{"1min":0.627,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":2.746},"last":0.751},{"interface":"front","average":{"1min":1.024,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.68799999999999994,"5min":0.60899999999999999,"15min":0.59199999999999997},"max":{"1min":1.429,"5min":1.429,"15min":7.9569999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92300000000000004,"15min":0.90400000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.437},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.129,"5min":1.04,"15min":1.0569999999999999},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.54700000000000004},"max":{"1min":1.528,"5min":1.528,"15min":1.593},"last":0.88700000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.0449999999999999,"15min":1.0880000000000001},"min":{"1min":0.70399999999999996,"5min":0.50700000000000001,"15min":0.42499999999999999},"max":{"1min":1.589,"5min":1.589,"15min":8.0060000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0760000000000001,"15min":1.0980000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.39300000000000002},"max":{"1min":1.508,"5min":1.508,"15min":7.5730000000000004},"last":0.998}]}]},{"osd":5,"up_from":14,"seq":60129542275,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15688,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14272,"kb_avail":94356152,"statfs":{"total":96636764160,"available":96620699648,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14614528},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":1.373,"15min":1.373},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.92000000000000004,"15min":0.88900000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.52},"last":0.86399999999999999}]},{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85599999999999998,"15min":0.89900000000000002},"min":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1679999999999999,"5min":1.2350000000000001,"15min":1.512},"last":0.746},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.46000000000000002},"max":{"1min":1.0740000000000001,"5min":1.24,"15min":1.377},"last":1.0649999999999999}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89500000000000002,"15min":0.88},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54200000000000004},"max":{"1min":1.252,"5min":1.284,"15min":1.5580000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92400000000000004,"15min":0.93700000000000006},"min":{"1min":0.66200000000000003,"5min":0.60799999999999998,"15min":0.51500000000000001},"max":{"1min":1.2849999999999999,"5min":1.292,"15min":1.4330000000000001},"last":0.94199999999999995}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93899999999999995,"15min":0.91500000000000004},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.48699999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.98399999999999999,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":6.6040000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.90800000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"max":{"1min":1.169,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.83199999999999996,"5min":0.623,"15min":0.38700000000000001},"max":{"1min":1.569,"5min":1.569,"15min":1.7230000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.99199999999999999,"15min":1.0309999999999999},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.319,"5min":1.3300000000000001,"15min":1.585},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.008,"5min":1.056,"15min":1.044},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.58599999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.575},"last":0.99099999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.111,"15min":1.1040000000000001},"min":{"1min":0.745,"5min":0.73999999999999999,"15min":0.58199999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6419999999999999},"last":1.032},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1439999999999999,"15min":1.1699999999999999},"min":{"1min":0.88400000000000001,"5min":0.64900000000000002,"15min":0.64000000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.889},"last":1.0169999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16072,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94355768,"statfs":{"total":96636764160,"available":96620306432,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.58899999999999997,"5min":0.51200000000000001,"15min":0.47799999999999998},"max":{"1min":1.1639999999999999,"5min":1.3069999999999999,"15min":1.431},"last":1.101},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84599999999999997,"15min":0.84399999999999997},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.505},"max":{"1min":1.26,"5min":1.26,"15min":1.458},"last":0.999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2370000000000001,"5min":1.29,"15min":1.401},"last":1.22}]},{"osd":2,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89700000000000002,"15min":0.879},"min":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93100000000000005,"15min":0.95199999999999996},"min":{"1min":0.72799999999999998,"5min":0.52900000000000003,"15min":0.497},"max":{"1min":1.246,"5min":1.246,"15min":1.343},"last":0.84899999999999998}]},{"osd":3,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.874,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.01,"5min":0.96199999999999997,"15min":0.98899999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.8160000000000001},"last":1.2529999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.90300000000000002,"15min":0.92500000000000004},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.59099999999999997},"max":{"1min":1.1919999999999999,"5min":1.3919999999999999,"15min":1.492},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.042,"5min":0.94899999999999995,"15min":0.96399999999999997},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.60199999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.0329999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.76800000000000002,"5min":0.64500000000000002,"15min":0.59499999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.6120000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.341,"5min":1.4390000000000001,"15min":1.542},"last":1.276}]},{"osd":7,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.89700000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.69899999999999995},"max":{"1min":1.405,"5min":1.405,"15min":1.905},"last":1.538}]}]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16200,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94355640,"statfs":{"total":96636764160,"available":96620175360,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.27100000000000002},"max":{"1min":0.88200000000000001,"5min":1.093,"15min":6.3840000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.27500000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.282},"last":0.626}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.70699999999999996},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.34999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":19.015999999999998},"last":0.748},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73199999999999998,"15min":0.745},"min":{"1min":0.52000000000000002,"5min":0.35999999999999999,"15min":0.31},"max":{"1min":0.87,"5min":1.3169999999999999,"15min":6.3540000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.70599999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93799999999999994,"5min":1.109,"15min":1.494},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.80300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.374},"max":{"1min":1.204,"5min":1.204,"15min":23.466000000000001},"last":1.0660000000000001}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0209999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.36499999999999999},"max":{"1min":1.4490000000000001,"5min":1.7969999999999999,"15min":15.255000000000001},"last":1.091},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.93400000000000005,"15min":1.0249999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.081,"5min":1.236,"15min":23.792999999999999},"last":0.98899999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97199999999999998,"15min":1.0349999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.161,"5min":1.3180000000000001,"15min":23.751000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0409999999999999,"15min":1.0760000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.66700000000000004},"max":{"1min":1.3080000000000001,"5min":1.3959999999999999,"15min":7.0110000000000001},"last":1.1679999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0329999999999999,"15min":1.069},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.53200000000000003},"max":{"1min":1.4730000000000001,"5min":1.8879999999999999,"15min":15.292999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0509999999999999,"15min":1.1399999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.57599999999999996},"max":{"1min":1.3380000000000001,"5min":1.367,"15min":23.428999999999998},"last":1.242}]},{"osd":7,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.093,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.58999999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":6.4199999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.437},"max":{"1min":1.5309999999999999,"5min":1.954,"15min":15.428000000000001},"last":1.26}]}]},{"osd":2,"up_from":14,"seq":60129542275,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15752,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94356088,"statfs":{"total":96636764160,"available":96620634112,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.312},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.35199999999999998},"max":{"1min":1.0349999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33700000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.2410000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76500000000000001,"15min":0.73099999999999998},"min":{"1min":0.61199999999999999,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.93600000000000005}]},{"osd":3,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.107,"15min":1.107},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83199999999999996,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36099999999999999},"max":{"1min":1.0329999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1}]},{"osd":4,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.94699999999999995,"15min":0.94999999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.3400000000000001,"15min":1.371},"last":1.196},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.747,"5min":0.73499999999999999,"15min":0.58499999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.532},"last":1.0529999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.01,"15min":0.98699999999999999},"min":{"1min":0.77900000000000003,"5min":0.76100000000000001,"15min":0.622},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.115},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0109999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.66800000000000004,"15min":0.46999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.7989999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99399999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0609999999999999,"15min":1.044},"min":{"1min":0.83999999999999997,"5min":0.70399999999999996,"15min":0.60799999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.7270000000000001},"last":1.1479999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.097,"15min":1.0649999999999999},"min":{"1min":0.97599999999999998,"5min":0.83699999999999997,"15min":0.65900000000000003},"max":{"1min":1.748,"5min":1.748,"15min":1.76},"last":1.173},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.55800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.97899999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542275,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17036,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":15040,"kb_avail":94354804,"statfs":{"total":96636764160,"available":96619319296,"internally_reserved":0,"allocated":2035712,"data_stored":1288838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15400960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95299999999999996,"5min":0.98399999999999999,"15min":1.2190000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.36499999999999999},"max":{"1min":0.94399999999999995,"5min":1.45,"15min":1.45},"last":0.52100000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71899999999999997,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.40699999999999997},"max":{"1min":1.0960000000000001,"5min":1.141,"15min":1.1439999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.5,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90700000000000003,"5min":1.119,"15min":1.393},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.071,"5min":1.3240000000000001,"15min":1.3520000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"max":{"1min":0.98599999999999999,"5min":1.631,"15min":1.744},"last":0.443}]},{"osd":4,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94699999999999995,"15min":0.95399999999999996},"min":{"1min":0.70999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.2190000000000001,"5min":1.456,"15min":1.609},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98199999999999998,"15min":1.0089999999999999},"min":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.60699999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.5069999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.97099999999999997},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1950000000000001,"5min":1.4199999999999999,"15min":1.8660000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.752,"5min":0.65500000000000003,"15min":0.65000000000000002},"max":{"1min":1.3080000000000001,"5min":1.407,"15min":1.5609999999999999},"last":0.95999999999999996}]},{"osd":6,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.997,"15min":1.0449999999999999},"min":{"1min":0.83099999999999996,"5min":0.68999999999999995,"15min":0.66700000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.575},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98899999999999999},"min":{"1min":0.748,"5min":0.65600000000000003,"15min":0.65400000000000003},"max":{"1min":1.194,"5min":1.573,"15min":2.1920000000000002},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.04,"15min":1.05},"min":{"1min":0.83699999999999997,"5min":0.77900000000000003,"15min":0.73399999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":2.2320000000000002},"last":0.754},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0840000000000001,"15min":1.099},"min":{"1min":0.82699999999999996,"5min":0.68899999999999995,"15min":0.59099999999999997},"max":{"1min":1.3839999999999999,"5min":1.5409999999999999,"15min":1.6599999999999999},"last":0.86899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542275,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16260,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94355580,"statfs":{"total":96636764160,"available":96620113920,"internally_reserved":0,"allocated":1437696,"data_stored":697484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.316},"max":{"1min":0.89600000000000002,"5min":0.98999999999999999,"15min":1.1220000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.67500000000000004},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.056,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.69999999999999996}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.374},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98799999999999999,"5min":1.0509999999999999,"15min":1.2010000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.0840000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.80100000000000005},"min":{"1min":0.52200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.65100000000000002}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.72599999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.266,"5min":1.351,"15min":1.423},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.57099999999999995},"max":{"1min":1.4199999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84099999999999997}]},{"osd":5,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0269999999999999,"15min":1.0189999999999999},"min":{"1min":0.81599999999999995,"5min":0.69999999999999996,"15min":0.57599999999999996},"max":{"1min":1.325,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.72399999999999998}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0589999999999999,"15min":1.071},"min":{"1min":0.77200000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.90800000000000003,"5min":0.74199999999999999,"15min":0.629},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.105,"15min":1.1180000000000001},"min":{"1min":0.90000000000000002,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.363,"5min":1.478,"15min":1.5649999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0549999999999999,"15min":1.0680000000000001},"min":{"1min":0.81000000000000005,"5min":0.73499999999999999,"15min":0.70999999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.95899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:23:33.478 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-11-29T11:12:46.061725+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=46, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.478 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-11-29T11:12:46.061725+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=46, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.478 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-11-29T11:12:46.061725+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=46, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.478 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-11-29T11:12:46.061725+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=46, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.478 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-29T11:12:47.065931+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=47, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.479 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-11-29T11:12:46.061725+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=46, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.479 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-11-29T11:12:46.061725+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=46, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.479 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-11-29T11:12:46.061725+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=46, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.479 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-29T11:12:46.061725+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=12, tm_sec=46, tm_wday=2, tm_yday=333, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=11, tm_min=23, tm_sec=28, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T11:23:33.479 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-29T11:23:34.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-29T11:23:40.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-11-29T11:23:47.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~27s 2023-11-29T11:23:53.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T11:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf72172700 1 Processor -- start 2023-11-29T11:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf72172700 1 -- start start 2023-11-29T11:23:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf72172700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c1584c0 0x7fcf6c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf72172700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf6c069cd0 0x7fcf6c06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf72172700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c0cd0f0 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf72172700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c06dbd0 con 0x7fcf6c069cd0 2023-11-29T11:23:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf72172700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0cd3d0 con 0x7fcf6c1584c0 2023-11-29T11:23:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71971700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf6c069cd0 0x7fcf6c06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71971700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf6c069cd0 0x7fcf6c06a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53250/0 (socket says 172.21.15.81:53250) 2023-11-29T11:23:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71170700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c1584c0 0x7fcf6c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71971700 1 -- 172.21.15.81:0/4040387523 learned_addr learned my addr 172.21.15.81:0/4040387523 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:53.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71971700 1 -- 172.21.15.81:0/4040387523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c1584c0 msgr2=0x7fcf6c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71971700 1 --2- 172.21.15.81:0/4040387523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c1584c0 0x7fcf6c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71971700 1 -- 172.21.15.81:0/4040387523 >> v1:172.21.15.176:6789/0 conn(0x7fcf6c0b32e0 legacy=0x7fcf6c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71971700 1 -- 172.21.15.81:0/4040387523 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c0cd6b0 con 0x7fcf6c069cd0 2023-11-29T11:23:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf71971700 1 --2- 172.21.15.81:0/4040387523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c069cd0 0x7fcf6c06a0f0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009910 tx=0x7fcf64009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c456268ad955f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf63fff700 1 -- 172.21.15.81:0/4040387523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64011830 con 0x7fcf6c069cd0 2023-11-29T11:23:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf63fff700 1 -- 172.21.15.81:0/4040387523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf64011990 con 0x7fcf6c069cd0 2023-11-29T11:23:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.592+0000 7fcf63fff700 1 -- 172.21.15.81:0/4040387523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64011d40 con 0x7fcf6c069cd0 2023-11-29T11:23:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- 172.21.15.81:0/4040387523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c069cd0 msgr2=0x7fcf6c06a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 --2- 172.21.15.81:0/4040387523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c069cd0 0x7fcf6c06a0f0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009910 tx=0x7fcf64009c20 comp rx=0 tx=0).stop 2023-11-29T11:23:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- 172.21.15.81:0/4040387523 shutdown_connections 2023-11-29T11:23:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 --2- 172.21.15.81:0/4040387523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c069cd0 0x7fcf6c06a0f0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 --2- 172.21.15.81:0/4040387523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c1584c0 0x7fcf6c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- 172.21.15.81:0/4040387523 >> 172.21.15.81:0/4040387523 conn(0x7fcf6c0ce3e0 msgr2=0x7fcf6c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- 172.21.15.81:0/4040387523 shutdown_connections 2023-11-29T11:23:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- 172.21.15.81:0/4040387523 wait complete. 2023-11-29T11:23:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 Processor -- start 2023-11-29T11:23:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- start start 2023-11-29T11:23:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c069cd0 0x7fcf6c1f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c0b32e0 0x7fcf6c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6c1584c0 0x7fcf6c1e19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c153bc0 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c152cd0 con 0x7fcf6c1584c0 2023-11-29T11:23:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf72172700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c152fb0 con 0x7fcf6c069cd0 2023-11-29T11:23:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf7096f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c0b32e0 0x7fcf6c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf7096f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c0b32e0 0x7fcf6c0aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53260/0 (socket says 172.21.15.81:53260) 2023-11-29T11:23:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf7096f700 1 -- 172.21.15.81:0/41923325 learned_addr learned my addr 172.21.15.81:0/41923325 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf71971700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6c1584c0 0x7fcf6c1e19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf71170700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c069cd0 0x7fcf6c1f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf7096f700 1 -- 172.21.15.81:0/41923325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c069cd0 msgr2=0x7fcf6c1f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf7096f700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c069cd0 0x7fcf6c1f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf7096f700 1 -- 172.21.15.81:0/41923325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6c1584c0 msgr2=0x7fcf6c1e19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf7096f700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6c1584c0 0x7fcf6c1e19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.596+0000 7fcf7096f700 1 -- 172.21.15.81:0/41923325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009570 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf7096f700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c0b32e0 0x7fcf6c0aea80 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800cc20 tx=0x7fcf6800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf61ffb700 1 -- 172.21.15.81:0/41923325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68003c20 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf61ffb700 1 -- 172.21.15.81:0/41923325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68003d80 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c0cdc70 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf61ffb700 1 -- 172.21.15.81:0/41923325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800aae0 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6c0cd990 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6c0cdf50 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf61ffb700 1 -- 172.21.15.81:0/41923325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcf68010050 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf61ffb700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf50064ee0 0x7fcf50067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf71170700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf50064ee0 0x7fcf50067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf61ffb700 1 -- 172.21.15.81:0/41923325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fcf68081cc0 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.600+0000 7fcf71170700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf50064ee0 0x7fcf50067390 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009b50 tx=0x7fcf5c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.608+0000 7fcf61ffb700 1 -- 172.21.15.81:0/41923325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcf68088080 con 0x7fcf6c0b32e0 2023-11-29T11:23:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.768+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 --> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf6c06b2c0 con 0x7fcf50064ee0 2023-11-29T11:23:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf61ffb700 1 -- 172.21.15.81:0/41923325 <== mgr.4098 v2:172.21.15.81:6832/36408 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71753 (secure 0 0 0) 0x7fcf6c06b2c0 con 0x7fcf50064ee0 2023-11-29T11:23:53.781 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf50064ee0 msgr2=0x7fcf50067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf50064ee0 0x7fcf50067390 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009b50 tx=0x7fcf5c009240 comp rx=0 tx=0).stop 2023-11-29T11:23:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c0b32e0 msgr2=0x7fcf6c0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c0b32e0 0x7fcf6c0aea80 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800cc20 tx=0x7fcf6800cf30 comp rx=0 tx=0).stop 2023-11-29T11:23:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 shutdown_connections 2023-11-29T11:23:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fcf50064ee0 0x7fcf50067390 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6c1584c0 0x7fcf6c1e19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf6c0b32e0 0x7fcf6c0aea80 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 --2- 172.21.15.81:0/41923325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf6c069cd0 0x7fcf6c1f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.772+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 >> 172.21.15.81:0/41923325 conn(0x7fcf6c0ce3e0 msgr2=0x7fcf6c1561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.776+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 shutdown_connections 2023-11-29T11:23:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.776+0000 7fcf72172700 1 -- 172.21.15.81:0/41923325 wait complete. 2023-11-29T11:23:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-11-29T11:23:53.798 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2023-11-29T11:23:52.657257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":129604,"kb_used_data":12420,"kb_used_omap":0,"kb_used_meta":117120,"kb_avail":754845116,"statfs":{"total":773094113280,"available":772961398784,"internally_reserved":0,"allocated":12718080,"data_stored":6767510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":119930880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003676"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":113,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:37.941725+0000","last_change":"2023-11-29T11:23:37.941634+0000","last_active":"2023-11-29T11:23:37.941725+0000","last_peered":"2023-11-29T11:23:37.941725+0000","last_clean":"2023-11-29T11:23:37.941725+0000","last_became_active":"2023-11-29T11:12:47.092923+0000","last_became_peered":"2023-11-29T11:12:47.092923+0000","last_unstale":"2023-11-29T11:23:37.941725+0000","last_undegraded":"2023-11-29T11:23:37.941725+0000","last_fullsized":"2023-11-29T11:23:37.941725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:23:37.941402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:23:37.941402+0000","last_clean_scrub_stamp":"2023-11-29T11:23:37.941402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T19:36:58.760481+0000","scrub_duration":0.0078812580000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":114,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:35.973175+0000","last_change":"2023-11-29T11:23:35.973008+0000","last_active":"2023-11-29T11:23:35.973175+0000","last_peered":"2023-11-29T11:23:35.973175+0000","last_clean":"2023-11-29T11:23:35.973175+0000","last_became_active":"2023-11-29T11:12:47.107113+0000","last_became_peered":"2023-11-29T11:12:47.107113+0000","last_unstale":"2023-11-29T11:23:35.973175+0000","last_undegraded":"2023-11-29T11:23:35.973175+0000","last_fullsized":"2023-11-29T11:23:35.973175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:23:35.972741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:23:35.972741+0000","last_clean_scrub_stamp":"2023-11-29T11:23:35.972741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T22:01:51.967253+0000","scrub_duration":0.0067939180000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":115,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:35.228185+0000","last_change":"2023-11-29T11:23:35.228124+0000","last_active":"2023-11-29T11:23:35.228185+0000","last_peered":"2023-11-29T11:23:35.228185+0000","last_clean":"2023-11-29T11:23:35.228185+0000","last_became_active":"2023-11-29T11:12:47.382781+0000","last_became_peered":"2023-11-29T11:12:47.382781+0000","last_unstale":"2023-11-29T11:23:35.228185+0000","last_undegraded":"2023-11-29T11:23:35.228185+0000","last_fullsized":"2023-11-29T11:23:35.228185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:23:35.227881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:23:35.227881+0000","last_clean_scrub_stamp":"2023-11-29T11:23:35.227881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T16:05:14.165075+0000","scrub_duration":0.0071939129999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":117,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:32.590091+0000","last_change":"2023-11-29T11:23:32.590036+0000","last_active":"2023-11-29T11:23:32.590091+0000","last_peered":"2023-11-29T11:23:32.590091+0000","last_clean":"2023-11-29T11:23:32.590091+0000","last_became_active":"2023-11-29T11:12:47.085988+0000","last_became_peered":"2023-11-29T11:12:47.085988+0000","last_unstale":"2023-11-29T11:23:32.590091+0000","last_undegraded":"2023-11-29T11:23:32.590091+0000","last_fullsized":"2023-11-29T11:23:32.590091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:23:32.589841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:23:32.589841+0000","last_clean_scrub_stamp":"2023-11-29T11:23:32.589841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T15:10:26.139061+0000","scrub_duration":0.0072623660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"116'119","reported_seq":268,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:39.973243+0000","last_change":"2023-11-29T11:23:39.973141+0000","last_active":"2023-11-29T11:23:39.973243+0000","last_peered":"2023-11-29T11:23:39.973243+0000","last_clean":"2023-11-29T11:23:39.973243+0000","last_became_active":"2023-11-29T11:12:48.089559+0000","last_became_peered":"2023-11-29T11:12:48.089559+0000","last_unstale":"2023-11-29T11:23:39.973243+0000","last_undegraded":"2023-11-29T11:23:39.973243+0000","last_fullsized":"2023-11-29T11:23:39.973243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'119","last_scrub_stamp":"2023-11-29T11:23:39.972780+0000","last_deep_scrub":"116'119","last_deep_scrub_stamp":"2023-11-29T11:23:39.972780+0000","last_clean_scrub_stamp":"2023-11-29T11:23:39.972780+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T13:32:49.079112+0000","scrub_duration":0.014214928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":115,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:30.931746+0000","last_change":"2023-11-29T11:23:30.931676+0000","last_active":"2023-11-29T11:23:30.931746+0000","last_peered":"2023-11-29T11:23:30.931746+0000","last_clean":"2023-11-29T11:23:30.931746+0000","last_became_active":"2023-11-29T11:12:47.088427+0000","last_became_peered":"2023-11-29T11:12:47.088427+0000","last_unstale":"2023-11-29T11:23:30.931746+0000","last_undegraded":"2023-11-29T11:23:30.931746+0000","last_fullsized":"2023-11-29T11:23:30.931746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:23:30.931382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:23:30.931382+0000","last_clean_scrub_stamp":"2023-11-29T11:23:30.931382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T23:15:55.954308+0000","scrub_duration":0.0064729590000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":117,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:36.980775+0000","last_change":"2023-11-29T11:23:36.980718+0000","last_active":"2023-11-29T11:23:36.980775+0000","last_peered":"2023-11-29T11:23:36.980775+0000","last_clean":"2023-11-29T11:23:36.980775+0000","last_became_active":"2023-11-29T11:12:47.107005+0000","last_became_peered":"2023-11-29T11:12:47.107005+0000","last_unstale":"2023-11-29T11:23:36.980775+0000","last_undegraded":"2023-11-29T11:23:36.980775+0000","last_fullsized":"2023-11-29T11:23:36.980775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:23:36.980485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:23:36.980485+0000","last_clean_scrub_stamp":"2023-11-29T11:23:36.980485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T11:55:34.858415+0000","scrub_duration":0.006797315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":127,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:34.542498+0000","last_change":"2023-11-29T11:23:34.542401+0000","last_active":"2023-11-29T11:23:34.542498+0000","last_peered":"2023-11-29T11:23:34.542498+0000","last_clean":"2023-11-29T11:23:34.542498+0000","last_became_active":"2023-11-29T11:12:47.107271+0000","last_became_peered":"2023-11-29T11:12:47.107271+0000","last_unstale":"2023-11-29T11:23:34.542498+0000","last_undegraded":"2023-11-29T11:23:34.542498+0000","last_fullsized":"2023-11-29T11:23:34.542498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:23:34.542113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:23:34.542113+0000","last_clean_scrub_stamp":"2023-11-29T11:23:34.542113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T20:39:11.492045+0000","scrub_duration":0.0075302659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":117,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-11-29T11:23:38.989145+0000","last_change":"2023-11-29T11:23:38.989087+0000","last_active":"2023-11-29T11:23:38.989145+0000","last_peered":"2023-11-29T11:23:38.989145+0000","last_clean":"2023-11-29T11:23:38.989145+0000","last_became_active":"2023-11-29T11:12:47.107116+0000","last_became_peered":"2023-11-29T11:12:47.107116+0000","last_unstale":"2023-11-29T11:23:38.989145+0000","last_undegraded":"2023-11-29T11:23:38.989145+0000","last_fullsized":"2023-11-29T11:23:38.989145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-29T11:23:38.988852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-29T11:23:38.988852+0000","last_clean_scrub_stamp":"2023-11-29T11:23:38.988852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T21:12:29.670759+0000","scrub_duration":0.0060089189999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542279,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16844,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94354996,"statfs":{"total":96636764160,"available":96619515904,"internally_reserved":0,"allocated":2035712,"data_stored":1288838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.63200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1890000000000001,"5min":1.272,"15min":1.5629999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.327},"last":1.085}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86699999999999999,"15min":0.89400000000000002},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1120000000000001,"5min":1.242,"15min":2.1360000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.876},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":3.0449999999999999},"last":0.77400000000000002}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.94999999999999996,"15min":0.98899999999999999},"min":{"1min":0.66000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.151,"5min":1.2949999999999999,"15min":1.8009999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53900000000000003},"max":{"1min":1.1890000000000001,"5min":1.2609999999999999,"15min":1.4399999999999999},"last":1.024}]},{"osd":3,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.71599999999999997,"5min":0.58299999999999996,"15min":0.38100000000000001},"max":{"1min":1.139,"5min":1.294,"15min":1.667},"last":1.103},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92200000000000004,"15min":0.94899999999999995},"min":{"1min":0.68500000000000005,"5min":0.65700000000000003,"15min":0.58299999999999996},"max":{"1min":1.131,"5min":1.2290000000000001,"15min":1.4510000000000001},"last":0.86299999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82899999999999996,"15min":0.91100000000000003},"min":{"1min":0.65100000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.113,"5min":1.24,"15min":1.446},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.01,"15min":1.046},"min":{"1min":0.92000000000000004,"5min":0.63700000000000001,"15min":0.33800000000000002},"max":{"1min":1.341,"5min":1.389,"15min":1.736},"last":1.2529999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93799999999999994,"15min":1.036},"min":{"1min":0.63,"5min":0.60299999999999998,"15min":0.53600000000000003},"max":{"1min":1.0920000000000001,"5min":1.3100000000000001,"15min":2.403},"last":1.002},{"interface":"front","average":{"1min":1.036,"5min":1.0169999999999999,"15min":1.079},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2789999999999999,"5min":1.4470000000000001,"15min":1.53},"last":1.141}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.052,"15min":1.113},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2430000000000001,"5min":1.375,"15min":1.7230000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1160000000000001,"15min":1.161},"min":{"1min":0.93899999999999995,"5min":0.72099999999999997,"15min":0.44500000000000001},"max":{"1min":1.296,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3120000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542280,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15752,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94356088,"statfs":{"total":96636764160,"available":96620634112,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85299999999999998,"15min":0.83199999999999996},"min":{"1min":0.60499999999999998,"5min":0.57599999999999996,"15min":0.44400000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84799999999999998},"min":{"1min":0.56899999999999995,"5min":0.53200000000000003,"15min":0.375},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":7.7910000000000004},"last":1.0489999999999999}]},{"osd":1,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.284,"15min":1.4510000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.034,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.83099999999999996,"5min":0.58499999999999996,"15min":0.50800000000000001},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":7.8479999999999999},"last":0.91900000000000004}]},{"osd":2,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.66700000000000004,"5min":0.56399999999999995,"15min":0.49099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.369},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89300000000000002,"15min":0.90600000000000003},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.40500000000000003},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":2.7069999999999999},"last":1.2390000000000001}]},{"osd":3,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92100000000000004,"15min":0.94199999999999995},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.675,"5min":1.675,"15min":7.923},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94099999999999995,"15min":0.93400000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.48099999999999998},"max":{"1min":1.2410000000000001,"5min":1.304,"15min":1.3600000000000001},"last":1.024}]},{"osd":4,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.86699999999999999,"15min":0.90500000000000003},"min":{"1min":0.627,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":2.746},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.024,"5min":0.97299999999999998,"15min":0.999},"min":{"1min":0.68799999999999994,"5min":0.60899999999999999,"15min":0.59199999999999997},"max":{"1min":1.429,"5min":1.429,"15min":7.9569999999999999},"last":1.0009999999999999}]},{"osd":5,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92300000000000004,"15min":0.90400000000000003},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.437},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.129,"5min":1.04,"15min":1.0569999999999999},"min":{"1min":0.75800000000000001,"5min":0.59599999999999997,"15min":0.54700000000000004},"max":{"1min":1.528,"5min":1.528,"15min":1.593},"last":1.3089999999999999}]},{"osd":7,"last update":"Wed Nov 29 11:23:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.0449999999999999,"15min":1.0880000000000001},"min":{"1min":0.70399999999999996,"5min":0.50700000000000001,"15min":0.42499999999999999},"max":{"1min":1.589,"5min":1.589,"15min":8.0060000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0760000000000001,"15min":1.0980000000000001},"min":{"1min":0.84199999999999997,"5min":0.77300000000000002,"15min":0.39300000000000002},"max":{"1min":1.508,"5min":1.508,"15min":7.5730000000000004},"last":1.123}]}]},{"osd":5,"up_from":14,"seq":60129542279,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15688,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14272,"kb_avail":94356152,"statfs":{"total":96636764160,"available":96620699648,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14614528},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85099999999999998,"15min":0.83099999999999996},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":1.373,"15min":1.373},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.92000000000000004,"15min":0.88900000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.52},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.85599999999999998,"15min":0.89900000000000002},"min":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1679999999999999,"5min":1.2350000000000001,"15min":1.512},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.46000000000000002},"max":{"1min":1.0740000000000001,"5min":1.24,"15min":1.377},"last":0.87}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89500000000000002,"15min":0.88},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54200000000000004},"max":{"1min":1.252,"5min":1.284,"15min":1.5580000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92400000000000004,"15min":0.93700000000000006},"min":{"1min":0.66200000000000003,"5min":0.60799999999999998,"15min":0.51500000000000001},"max":{"1min":1.2849999999999999,"5min":1.292,"15min":1.4330000000000001},"last":1.004}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93899999999999995,"15min":0.91500000000000004},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.48699999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.98399999999999999,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":6.6040000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.90800000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54000000000000004},"max":{"1min":1.169,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.83199999999999996,"5min":0.623,"15min":0.38700000000000001},"max":{"1min":1.569,"5min":1.569,"15min":1.7230000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.99199999999999999,"15min":1.0309999999999999},"min":{"1min":0.66400000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.319,"5min":1.3300000000000001,"15min":1.585},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.008,"5min":1.056,"15min":1.044},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.58599999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.575},"last":0.64600000000000002}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.111,"15min":1.1040000000000001},"min":{"1min":0.745,"5min":0.73999999999999999,"15min":0.58199999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6419999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1439999999999999,"15min":1.1699999999999999},"min":{"1min":0.88400000000000001,"5min":0.64900000000000002,"15min":0.64000000000000001},"max":{"1min":1.641,"5min":1.641,"15min":1.889},"last":0.71199999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542279,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16072,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14656,"kb_avail":94355768,"statfs":{"total":96636764160,"available":96620306432,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15007744},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.58899999999999997,"5min":0.51200000000000001,"15min":0.47799999999999998},"max":{"1min":1.1639999999999999,"5min":1.3069999999999999,"15min":1.431},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.84599999999999997,"15min":0.84399999999999997},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.505},"max":{"1min":1.26,"5min":1.26,"15min":1.458},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2370000000000001,"5min":1.29,"15min":1.401},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89700000000000002,"15min":0.879},"min":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.093},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93100000000000005,"15min":0.95199999999999996},"min":{"1min":0.72799999999999998,"5min":0.52900000000000003,"15min":0.497},"max":{"1min":1.246,"5min":1.246,"15min":1.343},"last":0.99199999999999999}]},{"osd":3,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.874,"15min":0.878},"min":{"1min":0.64200000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.01,"5min":0.96199999999999997,"15min":0.98899999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.8160000000000001},"last":1.1830000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.90300000000000002,"15min":0.92500000000000004},"min":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.59099999999999997},"max":{"1min":1.1919999999999999,"5min":1.3919999999999999,"15min":1.492},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.042,"5min":0.94899999999999995,"15min":0.96399999999999997},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.60199999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1419999999999999}]},{"osd":6,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.76800000000000002,"5min":0.64500000000000002,"15min":0.59499999999999997},"max":{"1min":1.331,"5min":1.331,"15min":1.6120000000000001},"last":1.23},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.341,"5min":1.4390000000000001,"15min":1.542},"last":1.0600000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:23:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.89700000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.024},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.69899999999999995},"max":{"1min":1.405,"5min":1.405,"15min":1.905},"last":1.3109999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542280,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16200,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14784,"kb_avail":94355640,"statfs":{"total":96636764160,"available":96620175360,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15138816},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.27100000000000002},"max":{"1min":0.88200000000000001,"5min":1.093,"15min":6.3840000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.68400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.27500000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.282},"last":0.623}]},{"osd":1,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.70699999999999996},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.34999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":19.015999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73199999999999998,"15min":0.745},"min":{"1min":0.52000000000000002,"5min":0.35999999999999999,"15min":0.31},"max":{"1min":0.87,"5min":1.3169999999999999,"15min":6.3540000000000001},"last":0.76600000000000001}]},{"osd":2,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.70599999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93799999999999994,"5min":1.109,"15min":1.494},"last":0.749},{"interface":"front","average":{"1min":0.748,"5min":0.76200000000000001,"15min":0.80300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.374},"max":{"1min":1.204,"5min":1.204,"15min":23.466000000000001},"last":0.79700000000000004}]},{"osd":4,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0209999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.36499999999999999},"max":{"1min":1.4490000000000001,"5min":1.7969999999999999,"15min":15.255000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.93400000000000005,"15min":1.0249999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.081,"5min":1.236,"15min":23.792999999999999},"last":1.171}]},{"osd":5,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97199999999999998,"15min":1.0349999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.161,"5min":1.3180000000000001,"15min":23.751000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0409999999999999,"15min":1.0760000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.66700000000000004},"max":{"1min":1.3080000000000001,"5min":1.3959999999999999,"15min":7.0110000000000001},"last":1.407}]},{"osd":6,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0329999999999999,"15min":1.069},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.53200000000000003},"max":{"1min":1.4730000000000001,"5min":1.8879999999999999,"15min":15.292999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0509999999999999,"15min":1.1399999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.57599999999999996},"max":{"1min":1.3380000000000001,"5min":1.367,"15min":23.428999999999998},"last":1.345}]},{"osd":7,"last update":"Wed Nov 29 11:23:05 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.093,"15min":1.129},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.58999999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":6.4199999999999999},"last":1.304},{"interface":"front","average":{"1min":1.087,"5min":1.0920000000000001,"15min":1.1180000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.437},"max":{"1min":1.5309999999999999,"5min":1.954,"15min":15.428000000000001},"last":1.0429999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542279,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15752,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":94356088,"statfs":{"total":96636764160,"available":96620634112,"internally_reserved":0,"allocated":1441792,"data_stored":698470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.312},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.35199999999999998},"max":{"1min":1.0349999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.89300000000000002}]},{"osd":1,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33700000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.2410000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76500000000000001,"15min":0.73099999999999998},"min":{"1min":0.61199999999999999,"5min":0.42599999999999999,"15min":0.36299999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.79100000000000004}]},{"osd":3,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.33200000000000002},"max":{"1min":1.056,"5min":1.107,"15min":1.107},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83199999999999996,"15min":0.79300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36099999999999999},"max":{"1min":1.0329999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.75}]},{"osd":4,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.94699999999999995,"15min":0.94999999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.3400000000000001,"15min":1.371},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.747,"5min":0.73499999999999999,"15min":0.58499999999999996},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.532},"last":0.85799999999999998}]},{"osd":5,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.01,"15min":0.98699999999999999},"min":{"1min":0.77900000000000003,"5min":0.76100000000000001,"15min":0.622},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0109999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.66800000000000004,"15min":0.46999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.7989999999999999},"last":1.024}]},{"osd":6,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.997,"15min":0.99399999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.40500000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.87},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0609999999999999,"15min":1.044},"min":{"1min":0.83999999999999997,"5min":0.70399999999999996,"15min":0.60799999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.7270000000000001},"last":1.1970000000000001}]},{"osd":7,"last update":"Wed Nov 29 11:23:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.097,"15min":1.0649999999999999},"min":{"1min":0.97599999999999998,"5min":0.83699999999999997,"15min":0.65900000000000003},"max":{"1min":1.748,"5min":1.748,"15min":1.76},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0660000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.55800000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.081}]}]},{"osd":1,"up_from":14,"seq":60129542279,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":17036,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":15040,"kb_avail":94354804,"statfs":{"total":96636764160,"available":96619319296,"internally_reserved":0,"allocated":2035712,"data_stored":1288838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15400960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95299999999999996,"5min":0.98399999999999999,"15min":1.2190000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.36499999999999999},"max":{"1min":0.94399999999999995,"5min":1.45,"15min":1.45},"last":0.745}]},{"osd":2,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71899999999999997,"15min":0.70699999999999996},"min":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.40699999999999997},"max":{"1min":1.0960000000000001,"5min":1.141,"15min":1.1439999999999999},"last":0.873},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.5,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90700000000000003,"5min":1.119,"15min":1.393},"last":0.63}]},{"osd":3,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.071,"5min":1.3240000000000001,"15min":1.3520000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38100000000000001},"max":{"1min":0.98599999999999999,"5min":1.631,"15min":1.744},"last":0.78600000000000003}]},{"osd":4,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94699999999999995,"15min":0.95399999999999996},"min":{"1min":0.70999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.2190000000000001,"5min":1.456,"15min":1.609},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98199999999999998,"15min":1.0089999999999999},"min":{"1min":0.77600000000000002,"5min":0.71899999999999997,"15min":0.60699999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.5069999999999999},"last":1.0860000000000001}]},{"osd":5,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.97099999999999997},"min":{"1min":0.67200000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1950000000000001,"5min":1.4199999999999999,"15min":1.8660000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.02,"5min":1.0109999999999999,"15min":1.014},"min":{"1min":0.752,"5min":0.65500000000000003,"15min":0.65000000000000002},"max":{"1min":1.3080000000000001,"5min":1.407,"15min":1.5609999999999999},"last":1.2010000000000001}]},{"osd":6,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.997,"15min":1.0449999999999999},"min":{"1min":0.83099999999999996,"5min":0.68999999999999995,"15min":0.66700000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.575},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98899999999999999},"min":{"1min":0.748,"5min":0.65600000000000003,"15min":0.65400000000000003},"max":{"1min":1.194,"5min":1.573,"15min":2.1920000000000002},"last":0.97499999999999998}]},{"osd":7,"last update":"Wed Nov 29 11:23:06 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.04,"15min":1.05},"min":{"1min":0.83699999999999997,"5min":0.77900000000000003,"15min":0.73399999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":2.2320000000000002},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0840000000000001,"15min":1.099},"min":{"1min":0.82699999999999996,"5min":0.68899999999999995,"15min":0.59099999999999997},"max":{"1min":1.3839999999999999,"5min":1.5409999999999999,"15min":1.6599999999999999},"last":1.2529999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542279,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16260,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":14848,"kb_avail":94355580,"statfs":{"total":96636764160,"available":96620113920,"internally_reserved":0,"allocated":1437696,"data_stored":697484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15204352},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.316},"max":{"1min":0.89600000000000002,"5min":0.98999999999999999,"15min":1.1220000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.67500000000000004},"min":{"1min":0.435,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.056,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.629}]},{"osd":2,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.374},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98799999999999999,"5min":1.0509999999999999,"15min":1.2010000000000001},"last":0.76700000000000002}]},{"osd":3,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85299999999999998,"5min":0.96599999999999997,"15min":1.0840000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.80100000000000005},"min":{"1min":0.52200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.72599999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.266,"5min":1.351,"15min":1.423},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.999,"5min":0.98799999999999999,"15min":0.99099999999999999},"min":{"1min":0.63800000000000001,"5min":0.60099999999999998,"15min":0.57099999999999995},"max":{"1min":1.4199999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.111}]},{"osd":5,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0269999999999999,"15min":1.0189999999999999},"min":{"1min":0.81599999999999995,"5min":0.69999999999999996,"15min":0.57599999999999996},"max":{"1min":1.325,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.204}]},{"osd":6,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0589999999999999,"15min":1.071},"min":{"1min":0.77200000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.90800000000000003,"5min":0.74199999999999999,"15min":0.629},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.874}]},{"osd":7,"last update":"Wed Nov 29 11:23:01 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.105,"15min":1.1180000000000001},"min":{"1min":0.90000000000000002,"5min":0.78700000000000003,"15min":0.65100000000000002},"max":{"1min":1.363,"5min":1.478,"15min":1.5649999999999999},"last":1.085},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0549999999999999,"15min":1.0680000000000001},"min":{"1min":0.81000000000000005,"5min":0.73499999999999999,"15min":0.70999999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1419999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T11:23:53.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-29T11:23:53.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.904+0000 7f9bc5df7700 1 Processor -- start 2023-11-29T11:23:53.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.904+0000 7f9bc5df7700 1 -- start start 2023-11-29T11:23:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bc5df7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9bc00cd1c0 0x7f9bc00b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bc5df7700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc00d0740 con 0x7f9bc00b45f0 2023-11-29T11:23:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bc5df7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc00d0990 con 0x7f9bc0160ac0 2023-11-29T11:23:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bc5df7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc00d0c70 con 0x7f9bc00cd1c0 2023-11-29T11:23:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9bc00b45f0 0x7f9bc00d1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37444/0 (socket says 172.21.15.81:37444) 2023-11-29T11:23:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 -- 172.21.15.81:0/81228867 learned_addr learned my addr 172.21.15.81:0/81228867 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-29T11:23:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbffff700 1 --2- 172.21.15.81:0/81228867 >> v2:172.21.15.176:3300/0 conn(0x7f9bc00cd1c0 0x7f9bc00b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346546553 0 0) 0x7f9bc00d0740 con 0x7f9bc00b45f0 2023-11-29T11:23:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bac0035d0 con 0x7f9bc00b45f0 2023-11-29T11:23:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2593555951 0 0) 0x7f9bac0035d0 con 0x7f9bc00b45f0 2023-11-29T11:23:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 >> v2:172.21.15.176:3300/0 conn(0x7f9bc00cd1c0 msgr2=0x7f9bc00b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 --2- 172.21.15.81:0/81228867 >> v2:172.21.15.176:3300/0 conn(0x7f9bc00cd1c0 0x7f9bc00b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 >> v1:172.21.15.176:6789/0 conn(0x7f9bc0160ac0 legacy=0x7f9bc00b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc00d0f50 con 0x7f9bc00b45f0 2023-11-29T11:23:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 315380652 0 0) 0x7f9bb0001670 con 0x7f9bc00b45f0 2023-11-29T11:23:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 >> v1:172.21.15.81:6789/0 conn(0x7f9bc00b45f0 legacy=0x7f9bc00d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac003a20 0x7f9bac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac004870 0x7f9bac004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac005220 0x7f9bac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc00d0c70 con 0x7f9bac003a20 2023-11-29T11:23:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac00c0a0 con 0x7f9bac005220 2023-11-29T11:23:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac00c260 con 0x7f9bac004870 2023-11-29T11:23:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac003a20 0x7f9bac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbffff700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac005220 0x7f9bac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbeffd700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac004870 0x7f9bac004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 -- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac004870 msgr2=0x7f9bac004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac004870 0x7f9bac004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 -- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac005220 msgr2=0x7f9bac00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bac005220 0x7f9bac00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbffff700 1 -- 172.21.15.81:0/81228867 reap_dead start 2023-11-29T11:23:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 -- 172.21.15.81:0/81228867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0035d0 con 0x7f9bac003a20 2023-11-29T11:23:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbeffd700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bac004870 0x7f9bac004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T11:23:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbf7fe700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac003a20 0x7f9bac003e30 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000c320 tx=0x7f9bac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921bdc3afdc23b78 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0007c30 con 0x7f9bac003a20 2023-11-29T11:23:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000ce20 con 0x7f9bac003a20 2023-11-29T11:23:53.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bbe7fc700 1 -- 172.21.15.81:0/81228867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0005bc0 con 0x7f9bac003a20 2023-11-29T11:23:53.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bc5df7700 1 -- 172.21.15.81:0/81228867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac003a20 msgr2=0x7f9bac003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.908+0000 7f9bc5df7700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac003a20 0x7f9bac003e30 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000c320 tx=0x7f9bac0058a0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 -- 172.21.15.81:0/81228867 shutdown_connections 2023-11-29T11:23:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 --2- 172.21.15.81:0/81228867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bac003a20 0x7f9bac003e30 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 -- 172.21.15.81:0/81228867 >> 172.21.15.81:0/81228867 conn(0x7f9bc006cb40 msgr2=0x7f9bc00cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 -- 172.21.15.81:0/81228867 shutdown_connections 2023-11-29T11:23:53.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 -- 172.21.15.81:0/81228867 wait complete. 2023-11-29T11:23:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 Processor -- start 2023-11-29T11:23:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 -- start start 2023-11-29T11:23:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0153f70 0x7f9bc015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0154340 0x7f9bc00c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bc00c75a0 0x7f9bc015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc015e8f0 con 0x7f9bc00c75a0 2023-11-29T11:23:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc015ebd0 con 0x7f9bc0154340 2023-11-29T11:23:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bc5df7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc00c6860 con 0x7f9bc0153f70 2023-11-29T11:23:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bbffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bc00c75a0 0x7f9bc015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bbffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bc00c75a0 0x7f9bc015c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53266/0 (socket says 172.21.15.81:53266) 2023-11-29T11:23:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bbffff700 1 -- 172.21.15.81:0/3623751039 learned_addr learned my addr 172.21.15.81:0/3623751039 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bbf7fe700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0153f70 0x7f9bc015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.912+0000 7f9bbeffd700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0154340 0x7f9bc00c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bbffff700 1 -- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0153f70 msgr2=0x7f9bc015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bbffff700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0153f70 0x7f9bc015f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bbffff700 1 -- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0154340 msgr2=0x7f9bc00c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bbffff700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0154340 0x7f9bc00c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bbffff700 1 -- 172.21.15.81:0/3623751039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc015c660 con 0x7f9bc00c75a0 2023-11-29T11:23:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bbeffd700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0154340 0x7f9bc00c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bbffff700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bc00c75a0 0x7f9bc015c7f0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00b5190 tx=0x7f9bb80114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bb7fff700 1 -- 172.21.15.81:0/3623751039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800e070 con 0x7f9bc00c75a0 2023-11-29T11:23:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bb7fff700 1 -- 172.21.15.81:0/3623751039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8003c50 con 0x7f9bc00c75a0 2023-11-29T11:23:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bb7fff700 1 -- 172.21.15.81:0/3623751039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8003e20 con 0x7f9bc00c75a0 2023-11-29T11:23:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc00d1230 con 0x7f9bc00c75a0 2023-11-29T11:23:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc00cd640 con 0x7f9bc00c75a0 2023-11-29T11:23:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.916+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc00c66a0 con 0x7f9bc00c75a0 2023-11-29T11:23:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.920+0000 7f9bb7fff700 1 -- 172.21.15.81:0/3623751039 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9bb8011a10 con 0x7f9bc00c75a0 2023-11-29T11:23:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.920+0000 7f9bb7fff700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ba0064ee0 0x7f9ba0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.920+0000 7f9bb7fff700 1 -- 172.21.15.81:0/3623751039 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9bb80823c0 con 0x7f9bc00c75a0 2023-11-29T11:23:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.920+0000 7f9bbf7fe700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ba0064ee0 0x7f9ba0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.920+0000 7f9bbf7fe700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ba0064ee0 0x7f9ba0067390 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9bc008bd00 tx=0x7f9bb0007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:53.924+0000 7f9bb7fff700 1 -- 172.21.15.81:0/3623751039 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9bb8050570 con 0x7f9bc00c75a0 2023-11-29T11:23:54.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~33s 2023-11-29T11:23:54.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.088+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9bc0072500 con 0x7f9bc00c75a0 2023-11-29T11:23:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.092+0000 7f9bb7fff700 1 -- 172.21.15.81:0/3623751039 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9bb8050570 con 0x7f9bc00c75a0 2023-11-29T11:23:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.092+0000 7f9bb7fff700 1 -- 172.21.15.81:0/3623751039 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9bb8053b90 con 0x7f9bc00c75a0 2023-11-29T11:23:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ba0064ee0 msgr2=0x7f9ba0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ba0064ee0 0x7f9ba0067390 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9bc008bd00 tx=0x7f9bb0007000 comp rx=0 tx=0).stop 2023-11-29T11:23:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bc00c75a0 msgr2=0x7f9bc015c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bc00c75a0 0x7f9bc015c7f0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00b5190 tx=0x7f9bb80114b0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 shutdown_connections 2023-11-29T11:23:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7f9ba0064ee0 0x7f9ba0067390 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bc00c75a0 0x7f9bc015c7f0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0154340 0x7f9bc00c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 --2- 172.21.15.81:0/3623751039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0153f70 0x7f9bc015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 >> 172.21.15.81:0/3623751039 conn(0x7f9bc006cb40 msgr2=0x7f9bc00d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 shutdown_connections 2023-11-29T11:23:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.096+0000 7f9bc5df7700 1 -- 172.21.15.81:0/3623751039 wait complete. 2023-11-29T11:23:54.118 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T11:23:54.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T11:23:54.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.220+0000 7fe01bfff700 1 Processor -- start 2023-11-29T11:23:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.220+0000 7fe01bfff700 1 -- start start 2023-11-29T11:23:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe01c0cf050 0x7fe01c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe01c06a530 0x7fe01c0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c15c6d0 con 0x7fe01c0b4c10 2023-11-29T11:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c06a9d0 con 0x7fe01c0cf050 2023-11-29T11:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c0cf960 con 0x7fe01c06a530 2023-11-29T11:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe01c0cf050 0x7fe01c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01affd700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe01c0cf050 0x7fe01c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53278/0 (socket says 172.21.15.81:53278) 2023-11-29T11:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01affd700 1 -- 172.21.15.81:0/2616767944 learned_addr learned my addr 172.21.15.81:0/2616767944 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01a7fc700 1 --2- 172.21.15.81:0/2616767944 >> v2:172.21.15.176:3300/0 conn(0x7fe01c06a530 0x7fe01c0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01affd700 1 -- 172.21.15.81:0/2616767944 >> v2:172.21.15.176:3300/0 conn(0x7fe01c06a530 msgr2=0x7fe01c0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T11:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01affd700 1 --2- 172.21.15.81:0/2616767944 >> v2:172.21.15.176:3300/0 conn(0x7fe01c06a530 0x7fe01c0cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01affd700 1 -- 172.21.15.81:0/2616767944 >> v1:172.21.15.176:6789/0 conn(0x7fe01c0b4c10 legacy=0x7fe01c0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01affd700 1 -- 172.21.15.81:0/2616767944 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c06ac60 con 0x7fe01c0cf050 2023-11-29T11:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01a7fc700 1 --2- 172.21.15.81:0/2616767944 >> v2:172.21.15.176:3300/0 conn(0x7fe01c06a530 0x7fe01c0cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T11:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01affd700 1 --2- 172.21.15.81:0/2616767944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c0cf050 0x7fe01c06d7d0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0d38d0 tx=0x7fe00c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05a43642a976f95 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe019ffb700 1 -- 172.21.15.81:0/2616767944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00b8a0 con 0x7fe01c0cf050 2023-11-29T11:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe019ffb700 1 -- 172.21.15.81:0/2616767944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe00c00ba00 con 0x7fe01c0cf050 2023-11-29T11:23:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe019ffb700 1 -- 172.21.15.81:0/2616767944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00bdb0 con 0x7fe01c0cf050 2023-11-29T11:23:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 -- 172.21.15.81:0/2616767944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c0cf050 msgr2=0x7fe01c06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 --2- 172.21.15.81:0/2616767944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c0cf050 0x7fe01c06d7d0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0d38d0 tx=0x7fe00c009bf0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 -- 172.21.15.81:0/2616767944 shutdown_connections 2023-11-29T11:23:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 --2- 172.21.15.81:0/2616767944 >> v2:172.21.15.176:3300/0 conn(0x7fe01c06a530 0x7fe01c0cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 --2- 172.21.15.81:0/2616767944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c0cf050 0x7fe01c06d7d0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 -- 172.21.15.81:0/2616767944 >> 172.21.15.81:0/2616767944 conn(0x7fe01c09bb30 msgr2=0x7fe01c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 -- 172.21.15.81:0/2616767944 shutdown_connections 2023-11-29T11:23:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.224+0000 7fe01bfff700 1 -- 172.21.15.81:0/2616767944 wait complete. 2023-11-29T11:23:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.228+0000 7fe01bfff700 1 Processor -- start 2023-11-29T11:23:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.228+0000 7fe01bfff700 1 -- start start 2023-11-29T11:23:54.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.228+0000 7fe01bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c06a530 0x7fe01c14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:54.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.228+0000 7fe01bfff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0b4c10 0x7fe01c09f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c0cf050 0x7fe01c09fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01bfff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c14f160 con 0x7fe01c06a530 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01bfff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0c8a90 con 0x7fe01c0b4c10 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01bfff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c14eb10 con 0x7fe01c0cf050 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c06a530 0x7fe01c14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c06a530 0x7fe01c14dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53290/0 (socket says 172.21.15.81:53290) 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 -- 172.21.15.81:0/1316756066 learned_addr learned my addr 172.21.15.81:0/1316756066 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01a7fc700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0b4c10 0x7fe01c09f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01b7fe700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c0cf050 0x7fe01c09fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 -- 172.21.15.81:0/1316756066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c0cf050 msgr2=0x7fe01c09fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c0cf050 0x7fe01c09fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 -- 172.21.15.81:0/1316756066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0b4c10 msgr2=0x7fe01c09f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0b4c10 0x7fe01c09f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 -- 172.21.15.81:0/1316756066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c009570 con 0x7fe01c06a530 2023-11-29T11:23:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01affd700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c06a530 0x7fe01c14dfd0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fe00c000c00 tx=0x7fe00c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe0037fe700 1 -- 172.21.15.81:0/1316756066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0038c0 con 0x7fe01c06a530 2023-11-29T11:23:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe0037fe700 1 -- 172.21.15.81:0/1316756066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe00c01e070 con 0x7fe01c06a530 2023-11-29T11:23:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c0b4410 con 0x7fe01c06a530 2023-11-29T11:23:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe0037fe700 1 -- 172.21.15.81:0/1316756066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c003c80 con 0x7fe01c06a530 2023-11-29T11:23:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.232+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c06af40 con 0x7fe01c06a530 2023-11-29T11:23:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.236+0000 7fe0037fe700 1 -- 172.21.15.81:0/1316756066 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe00c00f050 con 0x7fe01c06a530 2023-11-29T11:23:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.236+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c0b46f0 con 0x7fe01c06a530 2023-11-29T11:23:54.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.236+0000 7fe0037fe700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe008064ee0 0x7fe008067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T11:23:54.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.236+0000 7fe0037fe700 1 -- 172.21.15.81:0/1316756066 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fe00c020070 con 0x7fe01c06a530 2023-11-29T11:23:54.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.236+0000 7fe01a7fc700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe008064ee0 0x7fe008067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T11:23:54.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.236+0000 7fe01a7fc700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe008064ee0 0x7fe008067390 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0c5e00 tx=0x7fe010008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T11:23:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.244+0000 7fe0037fe700 1 -- 172.21.15.81:0/1316756066 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe00c051720 con 0x7fe01c06a530 2023-11-29T11:23:54.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.444+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe01c072500 con 0x7fe01c06a530 2023-11-29T11:23:54.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.444+0000 7fe0037fe700 1 -- 172.21.15.81:0/1316756066 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+2775 (secure 0 0 0) 0x7fe00c015af0 con 0x7fe01c06a530 2023-11-29T11:23:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-29T11:23:54.452 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7550,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/918209089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":918209089},{"type":"v1","addr":"172.21.15.176:6835","nonce":918209089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8644,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/4014610246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4014610246},{"type":"v1","addr":"172.21.15.176:6834","nonce":4014610246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8967,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3651218769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3651218769},{"type":"v1","addr":"172.21.15.81:6835","nonce":3651218769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[]} 2023-11-29T11:23:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.444+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe008064ee0 msgr2=0x7fe008067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.444+0000 7fe01bfff700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe008064ee0 0x7fe008067390 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0c5e00 tx=0x7fe010008040 comp rx=0 tx=0).stop 2023-11-29T11:23:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.444+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c06a530 msgr2=0x7fe01c14dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T11:23:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.444+0000 7fe01bfff700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c06a530 0x7fe01c14dfd0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fe00c000c00 tx=0x7fe00c004770 comp rx=0 tx=0).stop 2023-11-29T11:23:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.448+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 shutdown_connections 2023-11-29T11:23:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.448+0000 7fe01bfff700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:6832/36408,v1:172.21.15.81:6833/36408] conn(0x7fe008064ee0 0x7fe008067390 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.448+0000 7fe01bfff700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe01c0cf050 0x7fe01c09fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.448+0000 7fe01bfff700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe01c0b4c10 0x7fe01c09f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.448+0000 7fe01bfff700 1 --2- 172.21.15.81:0/1316756066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe01c06a530 0x7fe01c14dfd0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T11:23:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.448+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 >> 172.21.15.81:0/1316756066 conn(0x7fe01c09bb30 msgr2=0x7fe01c0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T11:23:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.448+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 shutdown_connections 2023-11-29T11:23:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-29T11:23:54.448+0000 7fe01bfff700 1 -- 172.21.15.81:0/1316756066 wait complete. 2023-11-29T11:23:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2023-11-29T11:23:54.467 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-29T11:23:54.468 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-29T11:23:54.468 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T11:23:54.468 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:23:54.468 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-29T11:23:54.473 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T11:23:54.473 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T11:23:54.473 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.487 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T11:23:54.488 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T11:23:54.488 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.503 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T11:23:54.504 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T11:23:54.504 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.519 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T11:23:54.519 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-29T11:23:54.519 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-29T11:23:54.519 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.578 INFO:tasks.ceph.osd.0:Stopped 2023-11-29T11:23:54.578 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-29T11:23:54.578 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.654 INFO:tasks.ceph.osd.1:Stopped 2023-11-29T11:23:54.654 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-29T11:23:54.654 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.738 INFO:tasks.ceph.osd.2:Stopped 2023-11-29T11:23:54.738 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-29T11:23:54.738 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.816 INFO:tasks.ceph.osd.3:Stopped 2023-11-29T11:23:54.816 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-29T11:23:54.816 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.880 INFO:tasks.ceph.osd.4:Stopped 2023-11-29T11:23:54.881 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-29T11:23:54.881 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:54.970 INFO:tasks.ceph.osd.5:Stopped 2023-11-29T11:23:54.971 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-29T11:23:54.971 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:55.065 INFO:tasks.ceph.osd.6:Stopped 2023-11-29T11:23:55.065 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-29T11:23:55.065 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:55.132 INFO:tasks.ceph.osd.7:Stopped 2023-11-29T11:23:55.132 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-29T11:23:55.132 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-29T11:23:55.132 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:55.164 INFO:tasks.ceph.mgr.y:Stopped 2023-11-29T11:23:55.164 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-29T11:23:55.164 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:55.194 INFO:tasks.ceph.mgr.x:Stopped 2023-11-29T11:23:55.195 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-29T11:23:55.195 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-29T11:23:55.195 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:55.227 INFO:tasks.ceph.mon.a:Stopped 2023-11-29T11:23:55.228 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-29T11:23:55.228 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:55.256 INFO:tasks.ceph.mon.b:Stopped 2023-11-29T11:23:55.257 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-29T11:23:55.257 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T11:23:55.277 INFO:tasks.ceph.mon.c:Stopped 2023-11-29T11:23:55.277 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-29T11:23:55.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-11-29T11:23:55.298 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:23:55.298 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-29T11:23:55.633 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:23:55.633 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-29T11:23:55.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:23:55.877 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-29T11:23:56.049 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:23:56.049 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-29T11:23:56.234 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:23:56.234 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-29T11:23:56.425 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:23:56.426 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-29T11:23:56.632 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:23:56.633 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-29T11:23:56.816 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:23:56.816 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-29T11:23:57.016 INFO:tasks.ceph:Archiving mon data... 2023-11-29T11:23:57.017 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/data/mon.a.tgz 2023-11-29T11:23:57.017 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-11-29T11:23:57.024 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.wEMCCt8gNf 2023-11-29T11:23:57.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wEMCCt8gNf 2023-11-29T11:23:57.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.wEMCCt8gNf 2023-11-29T11:23:57.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:57.184 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:57.193 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.wEMCCt8gNf is 399KB 2023-11-29T11:23:57.214 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.wEMCCt8gNf 2023-11-29T11:23:57.220 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/data/mon.b.tgz 2023-11-29T11:23:57.220 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2023-11-29T11:23:57.227 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.RotP02ADjH 2023-11-29T11:23:57.227 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RotP02ADjH 2023-11-29T11:23:57.329 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.RotP02ADjH 2023-11-29T11:23:57.394 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.RotP02ADjH is 419KB 2023-11-29T11:23:57.415 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.RotP02ADjH 2023-11-29T11:23:57.421 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/data/mon.c.tgz 2023-11-29T11:23:57.422 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2023-11-29T11:23:57.468 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.0SXBDrolHG 2023-11-29T11:23:57.469 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0SXBDrolHG 2023-11-29T11:23:57.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.0SXBDrolHG 2023-11-29T11:23:57.589 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.0SXBDrolHG is 420KB 2023-11-29T11:23:57.653 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.0SXBDrolHG 2023-11-29T11:23:57.659 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-29T11:23:57.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-29T11:23:57.662 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-29T11:23:57.677 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-29T11:23:57.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-29T11:23:57.680 DEBUG:teuthology.orchestra.run.smithi176:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-29T11:23:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-29T11:23:57.705 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-29T11:23:57.711 INFO:tasks.ceph:Archiving crash dumps... 2023-11-29T11:23:57.712 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/remote/smithi081/crash 2023-11-29T11:23:57.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-29T11:23:57.733 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/remote/smithi176/crash 2023-11-29T11:23:57.734 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-29T11:23:57.769 INFO:tasks.ceph:Shutting down logrotate 2023-11-29T11:23:57.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:57.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:57.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:57.849 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-29T11:23:57.865 INFO:tasks.ceph:Compressing logs... 2023-11-29T11:23:57.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T11:23:57.867 DEBUG:teuthology.orchestra.run.smithi176:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T11:23:59.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-29T11:24:04.247 INFO:tasks.ceph:Archiving logs... 2023-11-29T11:24:04.248 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/remote/smithi081/log 2023-11-29T11:24:04.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-29T11:24:05.613 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/remote/smithi176/log 2023-11-29T11:24:05.613 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-29T11:24:06.316 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-29T11:24:06.326 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-29T11:24:06.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-29T11:24:06.329 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-29T11:24:06.411 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-29T11:24:06.419 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-29T11:24:06.420 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T11:24:06.422 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T11:24:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2023-11-29T11:24:06.444 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2023-11-29T11:24:06.444 INFO:teuthology.orchestra.run.smithi081.stdout:*hv01.front.sepi 44.4.53.2 2 u 64 64 377 0.092 -0.502 0.614 2023-11-29T11:24:06.445 INFO:teuthology.orchestra.run.smithi081.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 64 377 0.084 2.369 0.478 2023-11-29T11:24:06.445 INFO:teuthology.orchestra.run.smithi081.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 64 377 0.072 2.953 0.418 2023-11-29T11:24:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-11-29T11:24:06.446 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2023-11-29T11:24:06.446 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2023-11-29T11:24:06.446 INFO:teuthology.orchestra.run.smithi176.stdout:*hv01.front.sepi 44.4.53.2 2 u 62 64 377 0.081 2.370 2.527 2023-11-29T11:24:06.447 INFO:teuthology.orchestra.run.smithi176.stdout:+hv02.front.sepi 63.231.80.2 3 u 59 64 377 0.099 3.461 1.486 2023-11-29T11:24:06.447 INFO:teuthology.orchestra.run.smithi176.stdout:+hv03.front.sepi 74.6.168.72 3 u 61 64 377 0.081 2.323 2.317 2023-11-29T11:24:06.447 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2023-11-29T11:24:06.447 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-29T11:24:06.456 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-29T11:24:06.456 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-29T11:24:06.466 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-29T11:24:06.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-29T11:24:06.484 INFO:teuthology.task.internal:Duration was 1270.674206 seconds 2023-11-29T11:24:06.484 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-29T11:24:06.494 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-29T11:24:06.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-29T11:24:06.496 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-29T11:24:06.550 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-29T11:24:06.550 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-11-29T11:24:06.550 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-29T11:24:06.562 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2023-11-29T11:24:06.562 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-29T11:24:06.574 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-29T11:24:06.574 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T11:24:06.576 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T11:24:06.609 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-29T11:24:06.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T11:24:06.652 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T11:24:06.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-29T11:24:06.749 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-29T11:24:06.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-29T11:24:06.764 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-29T11:24:06.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-29T11:24:06.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:24:06.792 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:24:06.804 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-11-29T11:24:06.837 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2023-11-29T11:24:06.854 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:24:06.875 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi081.front.sepia.ceph.com, flagging run as failed 2023-11-29T11:24:06.875 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:24:06.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:24:06.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-29T11:24:06.891 INFO:teuthology.task.internal:Transferring archived files... 2023-11-29T11:24:06.892 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/remote/smithi081 2023-11-29T11:24:06.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-29T11:24:13.686 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-11-29T11:24:14.095 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607/remote/smithi081/coredump/1701256996.61005.core.gz: gzip compressed data, was "1701256996.61005.core", last modified: Wed Nov 29 11:24:06 2023, max compression, original size modulo 2^32 240672768 2023-11-29T11:24:14.095 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-11-29T11:24:15.165 INFO:teuthology.task.internal: core looks like: /tmp/tmpv3r1_wf1: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/proc/self/exe', platform: 'x86_64' 2023-11-29T11:24:15.191 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i a 2023-11-29T11:24:15.191 DEBUG:teuthology.orchestra.run.smithi081:> which 'ceph-mds -f --cluster ceph -i a' 2023-11-29T11:24:15.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:24:15.200 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2023-11-29T11:24:15.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-29T11:24:15.223 INFO:teuthology.task.internal:Not uploading archives. 2023-11-29T11:24:15.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-29T11:24:15.246 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-29T11:24:15.246 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-29T11:24:15.251 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-29T11:24:15.257 INFO:teuthology.orchestra.run.smithi081.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 29 11:24 /home/ubuntu/cephtest 2023-11-29T11:24:15.257 INFO:teuthology.orchestra.run.smithi081.stdout: 924113 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Nov 29 11:02 /home/ubuntu/cephtest/archive 2023-11-29T11:24:15.257 INFO:teuthology.orchestra.run.smithi081.stdout: 924115 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 11:24 /home/ubuntu/cephtest/archive/syslog 2023-11-29T11:24:15.257 INFO:teuthology.orchestra.run.smithi081.stdout: 924100 4 -rw-rw-rw- 1 ubuntu ubuntu 1042 Nov 29 11:23 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-29T11:24:15.258 INFO:teuthology.orchestra.run.smithi081.stdout: 924101 120 -rw-rw-rw- 1 ubuntu ubuntu 119572 Nov 29 11:24 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-29T11:24:15.258 INFO:teuthology.orchestra.run.smithi081.stdout: 924103 120 -rw-rw-r-- 1 ubuntu ubuntu 122186 Nov 29 11:24 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T11:24:15.258 INFO:teuthology.orchestra.run.smithi081.stdout: 924114 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 11:23 /home/ubuntu/cephtest/archive/coredump 2023-11-29T11:24:15.258 INFO:teuthology.orchestra.run.smithi081.stdout: 924102 14480 -rw------- 1 root root 240672768 Nov 29 11:23 /home/ubuntu/cephtest/archive/coredump/1701256996.61005.core 2023-11-29T11:24:15.259 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-29T11:24:15.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T11:24:15.260 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-29T11:24:15.270 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-29T11:24:15.281 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-29T11:24:15.291 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi081 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2023-11-29T11:24:15.291 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T11:24:15.297 INFO:teuthology.orchestra.run.smithi176.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 29 11:24 /home/ubuntu/cephtest 2023-11-29T11:24:15.298 INFO:teuthology.orchestra.run.smithi176.stdout: 924113 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 29 11:24 /home/ubuntu/cephtest/archive 2023-11-29T11:24:15.298 INFO:teuthology.orchestra.run.smithi176.stdout: 924115 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 11:24 /home/ubuntu/cephtest/archive/syslog 2023-11-29T11:24:15.298 INFO:teuthology.orchestra.run.smithi176.stdout: 924100 4 -rw-rw-rw- 1 ubuntu ubuntu 938 Nov 29 11:23 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-29T11:24:15.298 INFO:teuthology.orchestra.run.smithi176.stdout: 924101 88 -rw-rw-rw- 1 ubuntu ubuntu 88636 Nov 29 11:24 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-29T11:24:15.298 INFO:teuthology.orchestra.run.smithi176.stdout: 924102 100 -rw-rw-r-- 1 ubuntu ubuntu 100632 Nov 29 11:24 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T11:24:15.299 INFO:teuthology.orchestra.run.smithi176.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-29T11:24:15.320 DEBUG:teuthology.nuke:shortname: smithi081 2023-11-29T11:24:15.321 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T11:24:15.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 10:54:01.310442', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-29T11:24:15.347 DEBUG:teuthology.nuke:shortname: smithi176 2023-11-29T11:24:15.347 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T11:24:15.366 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-29_10:52:27-fs-wip-neesingh-testing-231123-distro-default-smithi/7470607', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 10:54:01.312326', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-29T11:24:15.399 INFO:teuthology.orchestra.console.smithi081:Power off 2023-11-29T11:24:15.399 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T11:24:15.424 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-11-29T11:24:15.424 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:24:15.439 INFO:teuthology.orchestra.console.smithi176:Power off 2023-11-29T11:24:15.439 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T11:24:15.449 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-11-29T11:24:15.462 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-11-29T11:24:15.462 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:24:15.484 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-11-29T11:24:19.450 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:24:19.485 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:24:19.561 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-11-29T11:24:19.594 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-11-29T11:24:23.562 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:24:23.594 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:24:23.673 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-11-29T11:24:23.704 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-11-29T11:24:27.677 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:24:27.704 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:24:27.789 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-29T11:24:27.815 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-11-29T11:24:27.890 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-11-29T11:24:27.916 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-11-29T11:24:28.020 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 1270.6742060184479 failure_reason: 'Test failure: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2baa0498f9cf4ebc915a57e72a4b77f8 status: fail success: false 2023-11-29T11:24:28.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:24:28.107 INFO:teuthology.run:FAIL